Commit Graph

5176 Commits

Author SHA1 Message Date
serxa
abf63d0c33 cleanup 2023-01-05 00:26:28 +00:00
serxa
c4e896f73a cleanup 2023-01-05 00:23:10 +00:00
Sergei Trifonov
5d5cf7d5b0
Merge branch 'master' into cancellable-mutex 2023-01-05 00:50:38 +01:00
serxa
f706cf8903 fix style 2023-01-04 23:49:29 +00:00
serxa
e9e3414ae1 remove debug print 2023-01-04 23:04:04 +00:00
serxa
3ea04f0429 fix typos 2023-01-04 22:59:29 +00:00
serxa
baf6297f1d add fast and cancellable shared_mutex alternatives 2023-01-04 21:50:57 +00:00
Yakov Olkhovskiy
7a5a36cbed
Merge branch 'master' into refactoring-ip-types 2023-01-04 11:11:06 -05:00
Maksim Kita
2482acc600
Merge pull request #44881 from azat/concurrent-bounded-queue-fix
Fix ConcurrentBoundedQueue::emplace() return value in case of finished queue
2023-01-04 15:44:54 +03:00
Raúl Marín
05ce5eec06 Ignore hwmon sensors on label read issues 2023-01-04 12:05:13 +01:00
Alexey Milovidov
a804d9a643
Merge pull request #44856 from ClickHouse/fix-distinct-zero-size-key-44831
Fix: sorted DISTINCT with empty string
2023-01-04 05:16:00 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code
What if I will remove two lines of code?
2023-01-04 04:50:52 +03:00
Nikolay Degterinsky
c6daf0a6eb Merge remote-tracking branch 'upstream/master' into ulid 2023-01-03 19:58:50 +00:00
Azat Khuzhin
a2f17d2d91 Fix ConcurrentBoundedQueue::emplace() return value in case of finished queue
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-03 20:36:12 +01:00
Robert Schulze
cfb6feffde
What happens if I remove these 139 lines of code? 2023-01-03 18:35:31 +00:00
Raúl Marín
0785bf6b29 Do not throw DB::Exception when folders do not exist 2023-01-03 17:05:54 +01:00
kssenii
67509aa2d5 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2023-01-03 16:41:30 +01:00
kssenii
bda8f0d410 Better async buffer from remote 2023-01-03 15:27:37 +01:00
Robert Schulze
421473e974
Merge pull request #44421 from ClickHouse/revert-of-revert-of-age-function
Revert revert of age function
2023-01-03 10:02:18 +01:00
Igor Nikonov
b7062c182a Fix: sorted DISTINCT with empty string 2023-01-03 00:23:05 +00:00
Alexey Milovidov
e855d3519a
Merge branch 'master' into refactoring-ip-types 2023-01-02 21:58:53 +03:00
Robert Schulze
e9e04166d9
Merge remote-tracking branch 'origin/master' into query-result-cache 2023-01-02 08:20:27 +00:00
Larry Luo
71da1b1379 Updated inverted index to use ActionsDAG 2022-12-31 18:05:06 -08:00
HarryLeeIBM
6a5fef632d Added more tests and experimental flag, etc. 2022-12-31 18:05:01 -08:00
Harry-Lee
b43ddde50a Refactor full text search according to reviews 2022-12-31 18:03:14 -08:00
Larry Luo
7d1c34316a Fixed a type in comments 2022-12-31 18:03:14 -08:00
Larry Luo
ca4893307b Reference FST paper title directly 2022-12-31 18:03:14 -08:00
Larry Luo
00e4411740 Created FST namespace to hide FST details 2022-12-31 18:03:14 -08:00
Larry Luo
514e17d037 Code clean up 2022-12-31 18:03:14 -08:00
Larry Luo
1d9bf9962c Code clean up 2022-12-31 18:03:14 -08:00
Larry Luo
7b850b6d93 Refactoring 2022-12-31 18:03:13 -08:00
Larry Luo
3652740535 Code clean up 2022-12-31 18:03:13 -08:00
Larry Luo
0b63d6b5be Resolve conflicts and style errors. 2022-12-31 18:03:13 -08:00
HarryLeeIBM
0839ff60ee Initial Checkin of full text search 2022-12-31 18:00:17 -08:00
Nikolay Degterinsky
dfe93b5d82
Merge pull request #42284 from Algunenano/perf_experiment
Performance experiment
2022-12-30 03:14:22 +01:00
Alexey Milovidov
9378194320
Merge pull request #44688 from ClickHouse/improve-odbc-test
Improve odbc test
2022-12-29 15:40:47 +03:00
Nikolay Degterinsky
945d50af87 Fix build 2022-12-29 02:17:52 +00:00
Raúl Marín
5de11979ce
Unify query elapsed time measurements (#43455)
* Unify query elapsed time reporting

* add-test: Make shell tests executable

* Add some tests around query elapsed time

* Style and ubsan
2022-12-28 21:01:41 +01:00
Alexey Milovidov
4fce10940e
Merge pull request #44629 from Algunenano/revert_flamegraph
Revert "Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log
2022-12-28 22:56:50 +03:00
Raúl Marín
e915ce1e95 Merge remote-tracking branch 'blessed/master' into perf_experiment 2022-12-28 20:15:43 +01:00
Alexey Milovidov
c3eff78f20 Don't be kind with third-party code 2022-12-28 20:07:26 +01:00
Alexey Milovidov
135a32c606
Merge branch 'master' into faster-startup-bc-check 2022-12-27 23:17:24 +03:00
Sergei Trifonov
56b3c6c68f
Merge pull request #44308 from ZhiguoZh/20221216-threadpool-notify
Call std::condition_variable::notify_* without lock in ThreadPool
2022-12-27 15:02:49 +01:00
Raúl Marín
948ce8db93 Revert "Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log"
This reverts commit e99849d031, reversing
changes made to 7ad3ff8a9e.
2022-12-27 14:28:13 +01:00
Alexey Milovidov
42415d49ac
Merge pull request #44607 from ClickHouse/fix-log-messages-coordination
Fix log messages in Coordination
2022-12-27 15:46:14 +03:00
Alexey Milovidov
d68c5c24ca
Merge pull request #44610 from ClickHouse/better-log-meesage
Better log message
2022-12-27 15:45:38 +03:00
Raúl Marín
fc1fa82a39
Merge branch 'master' into perf_experiment 2022-12-27 10:51:58 +01:00
Alexey Milovidov
54c8b162c0 Better log message 2022-12-26 20:09:52 +01:00
Alexey Milovidov
f0fa0977ed Fix wrong log messages 2022-12-26 18:36:07 +01:00
Alexey Milovidov
4f3db6a63a Fix wrong log message 2022-12-26 18:35:43 +01:00
Alexey Milovidov
91c1f9de8f Faster server startup after stress test 2022-12-26 18:13:50 +01:00
Alexey Milovidov
f22fc35900 Minimal changes 2022-12-25 14:18:05 +01:00
Alexander Tokmakov
ca989e9212 less runtime format strings 2022-12-23 19:50:34 +01:00
Alexander Tokmakov
93509395fb add a column with a message pattern to text_log 2022-12-23 15:06:30 +01:00
alesapin
2fecf420cb
Merge pull request #44513 from ClickHouse/small_polishing
Minor code polishing
2022-12-23 13:47:26 +01:00
Alexander Gololobov
0788269c25
Merge pull request #44410 from ClickHouse/fix_unicode_bar
Fix buffer overrun in UnicodeBar::render
2022-12-23 13:17:24 +01:00
kssenii
8308177361 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-23 12:14:46 +01:00
kssenii
853f2ea123 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-23 11:49:02 +01:00
Alexander Gololobov
0ae7f03516
Merge branch 'master' into fix_unicode_bar 2022-12-22 14:53:33 +01:00
alesapin
fa467b3398 Minor code polishing 2022-12-22 14:31:42 +01:00
vdimir
88008726d8
Merge branch 'master' into vdimir/tmp-data-in-fs-cache-2 2022-12-22 10:58:39 +00:00
alesapin
380c6cebe4
Merge pull request #44393 from ClickHouse/small_improvement
Lock table for share during startup for database ordinary
2022-12-22 11:42:42 +01:00
vdimir
d30d25dbbe
Temporary files evict fs cache 2022-12-22 10:22:49 +00:00
Vladimir C
6a0210fb0f
Merge pull request #43785 from mo-avatar/binhexstringliterals 2022-12-22 10:56:18 +01:00
Yakov Olkhovskiy
a8cb29da4b
Merge branch 'master' into refactoring-ip-types 2022-12-21 23:56:24 -05:00
Alexander Gololobov
4b0cbdb4a4 Fixed unused value warning 2022-12-21 10:55:20 +01:00
Robert Schulze
f8378473c4
Fix call to wrong overload on Darwin 2022-12-21 09:00:44 +00:00
Zhiguo Zhou
823cb8a8f0 Call std::condition_variable::notify_one w/o lock in ThreadPool
Calling notify_one function with lock held would let the notified
thread immediately block again, and increase the lock contention.
This commit moves the calls of notify_one function out of critical
sections of ThreadPool, whose lock (ThreadPoolImpl::mutex) is most
extensively contended in some workloads.
2022-12-21 13:50:03 +08:00
kssenii
1d75f740d7 Fix tests 2022-12-20 22:33:54 +01:00
kssenii
6bd4f8c029 Merge remote-tracking branch 'upstream/master' into use-new-named-collections-code-2 2022-12-20 21:17:28 +01:00
alesapin
c902bca426 Remove races 2022-12-20 18:14:06 +01:00
Alexander Gololobov
424ae4686e Cleaups based on code review comments 2022-12-20 17:02:30 +01:00
Robert Schulze
3f03b0b53d
Revert "Revert "Add function 'age'""
This reverts commit 4549b14027.
2022-12-20 10:18:43 +00:00
Raúl Marín
45d27f461b
Merge branch 'master' into perf_experiment 2022-12-20 09:07:48 +00:00
Alexander Gololobov
2ab6b7d033 Check remaining space to avoid buffer overruns; some cleanups 2022-12-20 02:39:44 +01:00
alesapin
c8d9ccf3cd Lock table for share during startup for database ordinary 2022-12-19 18:51:46 +01:00
Sergei Trifonov
6f7bba159f
Merge pull request #41840 from ClickHouse/io-scheduler
IO scheduling subsystem
2022-12-19 15:15:19 +01:00
Robert Schulze
b93c56323c
Merge remote-tracking branch 'origin/master' into query-result-cache 2022-12-19 09:18:36 +00:00
Alexey Milovidov
0511532305
Merge pull request #44256 from azat/hashtable-fix
Fix double-free in HashTable::clearAndShrink() with zero elements in it
2022-12-17 03:20:22 +03:00
Sergei Trifonov
bded03e035
Merge branch 'master' into io-scheduler 2022-12-17 00:39:54 +01:00
kssenii
30547d2dcd Replace old named collections code for url 2022-12-17 00:24:05 +01:00
Alexey Milovidov
d3fd9a6c1e
Merge pull request #44239 from azat/builtin-skim-v2
Builtin skim for fuzzy search in clickhouse client/local history
2022-12-16 21:23:24 +03:00
Sergei Trifonov
f61a98b5dc
Merge branch 'master' into io-scheduler 2022-12-16 15:55:08 +01:00
Azat Khuzhin
81be20edfe Fix double-free in HashTable::clearAndShrink() with zero elements in it
Before this patch HashTable::clearAndShrink() did this:

    destroyElements();
    clearHasZero();

While destroyElements() already destroys the zero element, so it leads
to double free, like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/40003/f09e956ddf150c1aceb210348544bc28876a2d11/stateless_tests__asan__[2/4].html

The issue is only for complex types.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-16 15:22:00 +01:00
Robert Schulze
d1615ec283
Display metrics for query result cache 2022-12-16 10:49:15 +00:00
Nikolai Kochetov
e99849d031
Merge pull request #38953 from ClickHouse/add-allocation-ptr-to-trace-log
Track allocation ptr in system.trace_log. Add aggregate function flamegraph
2022-12-15 18:16:05 +01:00
Alexander Tokmakov
ec36ce7bb3
Merge branch 'master' into threads-in-overcommit-tracker-metric 2022-12-15 19:18:03 +03:00
Robert Schulze
537c64aad2
Merge remote-tracking branch 'origin/master' into query-result-cache
Conflicts:
- tests/queries/0_stateless/02117_show_create_table_system.reference
2022-12-15 12:17:58 +00:00
Alexey Milovidov
d8bb74d68a
Revert "Add information about written rows in progress indicator" 2022-12-15 10:19:15 +03:00
Azat Khuzhin
82aaad61aa Integrate skim into the client/local
Note, that it can the fail the client if the skim itself will fail,
however I haven't seen it panicd, so let's try.

P.S. about adding USE_SKIM into configure header instead of just compile
option for target, it is better, because it allows not to recompile lots
of C++ headers, since we have to add skim library as PUBLIC. But anyway
this will be resolved in a different way, but separatelly.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-14 20:57:41 +01:00
Dmitry Novik
3ab294be82 Also count waiting on global mutext 2022-12-14 18:05:07 +00:00
Dmitry Novik
1e5fdbdef0 Add ThreadsInOvercommitTracker metric 2022-12-14 16:56:19 +00:00
Azat Khuzhin
67fa185611
Revert "Builtin skim" 2022-12-14 17:17:19 +03:00
kssenii
ea5b06023a Merge remote-tracking branch 'refs/remotes/upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-14 13:59:51 +01:00
Alexey Milovidov
c93b7741b3
Merge branch 'master' into builtin-skim 2022-12-14 02:30:21 +03:00
Alexey Milovidov
4549b14027
Revert "Add function 'age'" 2022-12-13 23:28:09 +03:00
Nikolay Degterinsky
9b6d31b95d
Merge branch 'master' into perf_experiment 2022-12-13 17:15:07 +01:00
Igor Nikonov
ca06fd02c1
Merge pull request #43860 from bigo-sg/podopt
A little improve performance of PODArray
2022-12-13 12:57:22 +01:00
Vladimir C
ef45590413
Merge pull request #43925 from jh0x/improve-number-separator
Fixes https://github.com/ClickHouse/ClickHouse/issues/28967
2022-12-13 12:37:32 +01:00
Robert Schulze
1f9b34f133
Merge pull request #44049 from HarryLeeIBM/hlee-s390x-string-htable
Fix endian issue in StringHashTable for s390x
2022-12-13 09:27:52 +01:00
Alexey Milovidov
df17d1b71b
Merge branch 'master' into builtin-skim 2022-12-13 03:33:42 +03:00
Nikolai Kochetov
e451137040 Add comments. 2022-12-12 18:26:07 +00:00
Suzy Wang
093dc95d0f
Merge branch 'master' into s390x_crc32 2022-12-12 09:39:29 -05:00
Robert Schulze
b78652e138
Query result cache 2022-12-12 10:37:10 +00:00
Azat Khuzhin
9ed6aa0be1 Fix -Wshorten-64-to-32 on FreeBSD
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-12 08:05:28 +01:00
Azat Khuzhin
de58e9c02d Integrate skim into the client/local
Note, that it can the fail the client if the skim itself will fail,
however I haven't seen it panicd, so let's try.

P.S. about adding USE_SKIM into configure header instead of just compile
option for target, it is better, because it allows not to recompile lots
of C++ headers, since we have to add skim library as PUBLIC.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-11 15:52:00 +01:00
Alexey Milovidov
9a48cf0da8
Merge pull request #40422 from pkubaj/patch-1
Add FreeBSD/powerpc64le support
2022-12-11 09:38:04 +03:00
mo-avatar
e88b85178f Support SQL standard binary and hex string literals 2022-12-11 13:05:40 +08:00
Yakov Olkhovskiy
38707238b5 fix parser 2022-12-10 06:22:49 +00:00
Yakov Olkhovskiy
79a26203fe add variant parser and use it for toIPv6 2022-12-10 04:39:43 +00:00
Boris Kuschel
592c73e2c3
Merge branch 'master' into openssl_support 2022-12-09 20:21:22 -05:00
Yakov Olkhovskiy
8a923e72fa parser fixed, some optimizations 2022-12-10 00:48:44 +00:00
Yakov Olkhovskiy
02b253cffc fix style 2022-12-09 21:35:05 +00:00
Yakov Olkhovskiy
f7799c173b adapt IPv4 and IPv6 parsers for ReadBuffer, update to fit last master's merge 2022-12-09 21:20:52 +00:00
Suzy Wang
802f633f39
Merge branch 'master' into s390x_crc32 2022-12-09 15:00:46 -05:00
Anton Popov
17c557648e
Merge pull request #44045 from CurtizJ/fix-tracing-of-profile-events
Fix tracing of profile events
2022-12-09 14:12:58 +01:00
HarryLeeIBM
c381eb1b8e Fix endian issue in StringHashTable for s390x 2022-12-08 08:56:56 -08:00
Yakov Olkhovskiy
0641066183
Merge branch 'master' into refactoring-ip-types 2022-12-08 11:12:05 -05:00
Anton Popov
3d2e46dfed fix tracing of profile events 2022-12-08 15:13:53 +00:00
Boris Kuschel
cc3314acbe
Merge branch 'master' into openssl_support 2022-12-08 07:40:43 -05:00
Nikita Taranov
b81ad6aaf7
Add google benchmark to contrib (#43779)
* add google benchmark to contrib

* rework integer_hash_tables_and_hashes

* update readme

* keep benchmarks near the benchmarked code

* fix fasttests build

* rm old target

* fix
2022-12-08 13:38:08 +01:00
Alexander Gololobov
b2042fee32
Merge pull request #44001 from ClickHouse/Avogar-patch-1
Remove test logging of signal "EINTR"
2022-12-08 12:18:04 +01:00
Robert Schulze
f998d0c16b
Merge pull request #43228 from HarryLeeIBM/hlee-s390x-wide-int-order
Fix byte order issue of wide integers for s390x
2022-12-08 09:50:54 +01:00
Yakov Olkhovskiy
bf9194f405 review suggestions 2022-12-07 21:29:17 +00:00
Boris Kuschel
f03f95044e OpenSSL code changes 2022-12-07 13:22:46 -05:00
Joanna Hulboj
c5296db521 Addressed PR comments 2022-12-07 14:23:01 +00:00
Joanna Hulboj
5bb9f851e0 Support numeric literals with underscores 2022-12-07 12:50:51 +00:00
Kruglov Pavel
d042664f54
Remove logging from TimerDescriptor 2022-12-07 13:33:29 +01:00
Kruglov Pavel
1197d3fbe3
Remove test logging of signal "EINTR" 2022-12-07 13:32:43 +01:00
zhanglistar
974df885e0 Rollback reserveForNextSize change 2022-12-07 10:29:00 +08:00
zhanglistar
25e607cce8
Merge branch 'master' into podopt 2022-12-07 10:24:56 +08:00
Nikolai Kochetov
7d6d0676ce Fix build. 2022-12-06 16:59:40 +00:00
Nikolai Kochetov
9a4b3493fd Merge branch 'master' into add-allocation-ptr-to-trace-log 2022-12-06 17:09:54 +01:00
Robert Schulze
f2cad33f1b
Merge pull request #43123 from arenadata/ADQM-623
Add function 'age'
2022-12-05 15:53:28 +01:00
kssenii
d278a0dbfb Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-05 12:59:44 +01:00
kssenii
d91f3808bd Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-12-05 12:54:32 +01:00
Robert Schulze
3c1a721da4
Merge branch 'master' into hlee-s390x-wide-int-order 2022-12-04 18:47:00 +01:00
Roman Vasin
bcb65eb420
Merge branch 'master' into ADQM-623 2022-12-04 20:21:27 +03:00
kssenii
dca3444283 Merge remote-tracking branch 'upstream/master' into named-collections-sql-commands 2022-12-04 15:56:02 +01:00
Kseniia Sumarokova
ec7649cd90
Merge pull request #43639 from CurtizJ/trace-profile-events
Allow to send profile events to `system.trace_log`
2022-12-04 15:50:07 +01:00
Vladimir C
7d6950d397
Revert "Temporary files evict fs cache" 2022-12-02 14:50:56 +01:00
Roman Vasin
59523864b9
Merge branch 'master' into ADQM-623 2022-12-02 15:00:09 +03:00
Suzy Wang
e34af8602c
Merge branch 'master' into s390x_crc32 2022-12-01 11:02:43 -05:00
Suzy Wang
be16e0bce7 Include crc32_s390x as a submodule library 2022-12-01 07:43:32 -08:00
Vladimir C
117d01f2ac
Merge pull request #43457 from ClickHouse/vdimir/tmp-data-in-fs-cache 2022-12-01 13:41:40 +01:00
Alexander Gololobov
6388bc5000
Followup fixes for XML helpers (#43845) 2022-12-01 13:36:40 +01:00
Roman Vasin
620df1ec6f
Merge branch 'master' into ADQM-623 2022-12-01 15:30:36 +03:00
vdimir
7a814d2854
wip: temporary files evict fs cache 2022-12-01 11:49:24 +00:00
vdimir
98fe3c6c02
Temporary files evict fs cache 2022-12-01 11:49:17 +00:00
Antonio Andelic
1f93183dc7
Merge pull request #43087 from ClickHouse/keeper-prometheus
Add support for embedded Prometheus endpoint in Keeper
2022-12-01 12:46:47 +01:00
zhanglistar
c3f6ba6b68 A little improve performance of PODArray 2022-12-01 19:26:58 +08:00
Nikolai Kochetov
7649a3c4d7 Merge branch 'master' into add-allocation-ptr-to-trace-log 2022-12-01 12:12:23 +01:00
alesapin
5b4a16cabb
Merge pull request #43835 from ClickHouse/increase-logging-level-for-keeper
Increase some logging level for keeper client.
2022-12-01 12:01:54 +01:00
Roman Vasin
96d7cf319b
Merge branch 'master' into ADQM-623 2022-11-30 19:25:53 +03:00
Nikolai Kochetov
ecc45e5b1f Review fixes. 2022-11-30 16:15:40 +00:00
Vladimir C
53dc70a2d0
Merge pull request #38191 from BigRedEye/grace_hash_join
Closes https://github.com/ClickHouse/ClickHouse/issues/11596
2022-11-30 17:01:00 +01:00
Vitaly Baranov
f966bf61e0
Merge pull request #43627 from ClickHouse/faster_backup_config_loading
Speedup backup config loading
2022-11-30 16:33:54 +01:00
Nikolai Kochetov
5a67ba8598 Increase some logging level for keeper client. 2022-11-30 15:21:14 +00:00
Antonio Andelic
2f501d5327 Merge branch 'master' into keeper-prometheus 2022-11-30 13:24:37 +01:00
Antonio Andelic
4a145b6c96
Merge pull request #43686 from ClickHouse/more-aggresive-batching-keeper
Try batching requests in Keeper more aggressively
2022-11-30 12:56:25 +01:00
Yakov Olkhovskiy
77266ea754 cleanup 2022-11-29 17:34:16 +00:00
Alexander Gololobov
6f6114993f Enable test with 1M entries after the fix 2022-11-29 15:43:00 +01:00
Alexander Gololobov
06d04a81f5
Merge branch 'master' into faster_backup_config_loading 2022-11-29 14:29:58 +01:00
Antonio Andelic
db46842c8a Merge branch 'master' into more-aggresive-batching-keeper 2022-11-29 12:58:33 +00:00
Nikolai Kochetov
51439e2c19
Merge pull request #43260 from ClickHouse/read-from-mt-in-io-pool
Read from MergeTree in I/O pool
2022-11-29 12:09:03 +01:00
Alexander Gololobov
0a5491c1aa
Merge branch 'master' into faster_backup_config_loading 2022-11-29 09:43:47 +01:00
Alexander Gololobov
a0bd99c8a2
Merge pull request #43584 from ClickHouse/fix_config_child_list_iteration
Iterate list without index-based access
2022-11-29 09:39:46 +01:00
Yakov Olkhovskiy
4d7d9cbd0b some comments and beautification 2022-11-29 01:07:25 +00:00
Alexander Gololobov
8f49c1ea16 Moved helpers to Common/XMLUtils.* 2022-11-28 22:14:18 +01:00
Yakov Olkhovskiy
770b520ded
Merge branch 'master' into refactoring-ip-types 2022-11-28 08:50:19 -05:00
Alexander Gololobov
351c9f7bd2 Descrease element count to 50K until XML key enumeration is fixed in Poco 2022-11-28 13:36:12 +01:00
Alexander Gololobov
d88e3dfe33 Check time elapsed by config loading and key enumeration 2022-11-28 13:24:25 +01:00
Antonio Andelic
2b6661f87c Use lock_guard 2022-11-28 09:17:33 +00:00
Antonio Andelic
678958603b
Merge branch 'master' into keeper-prometheus 2022-11-28 09:48:57 +01:00
Robert Schulze
143637404e
Merge pull request #43078 from ClibMouse/s390x_ip_coding
s390x ip coding functions fixes
2022-11-28 09:11:42 +01:00
Alexander Gololobov
603ccf147b Test ConfigProcessor on a config with many elements 2022-11-28 00:36:42 +01:00
Antonio Andelic
cade21b76e Fix 4LW test 2022-11-26 19:24:10 +00:00
Antonio Andelic
76eca8bdfb Merge branch 'master' into more-aggresive-batching-keeper 2022-11-26 18:28:11 +00:00
Antonio Andelic
cd471e9c61 Add setting for quick batch size 2022-11-26 17:33:40 +00:00
Yakov Olkhovskiy
0854825151 fix DefaultHash64 for IPv6 2022-11-26 17:21:06 +00:00
Suzy Wang
d57a8b502d s390x crc32 fix 2022-11-25 13:12:11 -08:00
Alexey Milovidov
f9c3de5aa5
Update ConfigProcessor.cpp 2022-11-26 00:09:33 +03:00
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3
Fix typo
2022-11-25 15:22:28 +01:00
Nikolai Kochetov
660c942258 Merge branch 'master' into read-from-mt-in-io-pool 2022-11-25 13:56:48 +00:00
Anton Popov
396ecf826b fix tests 2022-11-25 13:05:38 +00:00
Alexander Gololobov
38ecdc0627 Save next pointer before doing changes to the current element 2022-11-25 13:42:43 +01:00
Anton Popov
312dd725b4 allow to send profile events to trace_log 2022-11-24 20:12:16 +00:00
Alexander Gololobov
70c821ea4b Fix iteration in other similar places 2022-11-24 19:08:45 +01:00
Ilya Yatsishin
6fcee9df85
Merge pull request #43496 from qoega/progress-add-writtten-rows 2022-11-24 17:31:02 +01:00
Nikolai Kochetov
d53439390f Review fixes. 2022-11-24 16:04:35 +00:00
Igor Nikonov
20e67b7140 Merge remote-tracking branch 'origin/master' into HEAD 2022-11-24 13:10:37 +00:00
Vladimir C
a2e1269ef2
Revert "Fix endian issue in integer hex string conversion" 2022-11-24 12:22:22 +01:00
Antonio Andelic
a6f38cb1cc
Merge branch 'master' into keeper-prometheus 2022-11-24 12:12:08 +01:00
Vladimir C
b784128c88
Merge pull request #41245 from HarryLeeIBM/hlee-s390x-lru-file-cache 2022-11-24 12:08:36 +01:00
Sergei Trifonov
8186a06c28
Merge branch 'master' into io-scheduler 2022-11-24 12:02:52 +01:00
Raúl Marín
4d3217cb18
Merge branch 'master' into perf_experiment 2022-11-24 10:32:12 +01:00
Alexander Gololobov
85b1fb96a5 Iterate list without index-based access 2022-11-23 17:49:17 +01:00
Nikolai Kochetov
f7d02fbe75 Fixing special build. 2022-11-23 14:05:26 +00:00
kssenii
6044a9257c Merge remote-tracking branch 'upstream/master' into named-collections-sql-commands 2022-11-23 12:00:55 +01:00
Alexey Milovidov
8cb34913a1
Merge pull request #42461 from Enmk/ldap_fix_search_limit
fix LDAP in case of many roles on user
2022-11-22 20:05:14 +01:00
Alexey Milovidov
c23b8c69db
Merge pull request #42791 from azat/fix-pe-overflow
Fix incorrect UserTimeMicroseconds/SystemTimeMicroseconds accounting
2022-11-22 19:22:51 +01:00
Raúl Marín
4aa29b6a63 Merge remote-tracking branch 'blessed/master' into perf_experiment 2022-11-22 19:09:00 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3 2022-11-22 18:30:06 +01:00
Alexey Milovidov
c8b068b4ff
Merge pull request #43447 from ClickHouse/netlink-remove-noise
Remove noise from logs about NetLink in Docker
2022-11-22 18:29:43 +01:00
Yatsishin Ilya
37bebcbe20 Add information about written rows in progress indicator 2022-11-22 14:29:22 +00:00
Sergei Trifonov
59f422f10c
Merge branch 'master' into storage-system-moves 2022-11-22 14:46:00 +01:00
kssenii
5f649baffe Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-11-22 14:19:51 +01:00
Sergei Trifonov
3177ed050f
Merge pull request #43307 from ClickHouse/cpu-progress-protocol-fix
fix CPU load indication on client
2022-11-22 14:09:55 +01:00
Dmitry Novik
e67bda65a0
Merge pull request #43453 from ClickHouse/fix-hard-limit-in-test
Do not reuse jemalloc memory in test_global_overcommit
2022-11-22 13:24:34 +01:00
Nikolai Kochetov
9e84a351c7 Fixing special build. Disable setting by default. 2022-11-22 11:24:24 +00:00
Raúl Marín
8776b2f566 Merge remote-tracking branch 'blessed/master' into perf_experiment 2022-11-22 11:45:36 +01:00
Vitaly Baranov
6c2b53f0ae
Merge pull request #42940 from filimonov/exceptions_with_masker
Add SensitiveDataMasker to exceptions messages
2022-11-21 23:20:15 +01:00
kssenii
155ddd5521 Fix review comments 2022-11-21 21:50:24 +01:00
kssenii
a279bac767 Merge remote-tracking branch 'upstream/master' into named-collections-sql-commands 2022-11-21 21:49:34 +01:00
Dmitry Novik
b17dc24a94 Do not reuse jemalloc memory in test 2022-11-21 16:10:47 +00:00
Alexey Milovidov
4ab6896ece Remove noise from logs about NetLink in Docker 2022-11-21 15:16:27 +01:00
Alexey Milovidov
56f8c0b84b Fix typo 2022-11-21 15:10:15 +01:00
Raúl Marín
ed0c174c0c Merge remote-tracking branch 'blessed/master' into perf_experiment 2022-11-21 11:02:31 +01:00
Antonio Andelic
e78761b66c
Merge branch 'master' into keeper-prometheus 2022-11-21 09:10:10 +01:00
Yakov Olkhovskiy
ee3ce9de70 bugs fixed, some optimization, cleanup, test fixed 2022-11-21 07:45:42 +00:00
kssenii
93365b0b29 Commit forgotten files 2022-11-20 19:28:11 +01:00
kssenii
08e4805c99 Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-11-19 13:26:56 +01:00
Nikolai Kochetov
5da1d893fd
Merge branch 'master' into read-from-mt-in-io-pool 2022-11-18 21:10:45 +01:00
Azat Khuzhin
ccde92f855 Fix incorrect UserTimeMicroseconds/SystemTimeMicroseconds accounting
After #40732 it became possible that getrusage() (from detachQuery(),
from buildPushingToViewsChain()) will be called for incorrect thread,
and so when the difference will be calculated it will be simply garbage.

But actually the root of this problem is #25714, after which it became
possible to have multiple ThreadStatus for one thread, and this is very
tricky (sigh).

Here are some other thoughts about it:
- Make ThreadStatus nested - decided that complexity does not worth it,
  at least only for this case
- Move some members into ThreadGroupStatus - will break per-thread
  statistics (and hence query_thread_log, BTW does somebody uses it?)
- Move some members into a separate structure

But decided to fix the issue w/o any refactoring, to make easy for
backport.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-18 21:10:43 +01:00
Azat Khuzhin
2b936a59e4 Add sanity checks RUsageCounters::incrementProfileEvents()
Can be triggered with the 02380_insert_mv_race test now in
debug/sanitizers build.
2022-11-18 21:10:43 +01:00
Yakov Olkhovskiy
dbaeabcf38 fixed some bugs, some functions corrected, some tests corrected 2022-11-18 20:10:27 +00:00
kssenii
30c5344de4 Get rid of ASTPtr in settings changes 2022-11-18 19:29:45 +01:00
Sergei Trifonov
77100896e3
Merge branch 'master' into storage-system-moves 2022-11-18 16:33:43 +01:00
Sergei Trifonov
35d37bc198
Merge branch 'master' into cpu-progress-protocol-fix 2022-11-18 16:30:40 +01:00
Sergei Trifonov
d05223e70b
Merge pull request #43335 from ClickHouse/revert-43306-revert-43014-disk-s3-throttler
Revert "Revert "S3 request per second rate throttling""
2022-11-18 16:22:30 +01:00
Vitaly Baranov
a348332eab
Merge pull request #43227 from vitlibar/improve-masking-sensitive-info
Improve masking sensitive info
2022-11-18 15:37:50 +01:00
kssenii
41c1a2aad4 Revert "Revert "Better code around SettingsChanges""
This reverts commit 5e61022bac.
2022-11-18 13:16:46 +01:00
kssenii
babc0c84b0 Revert "Not better"
This reverts commit 66175cb9c8.
2022-11-18 13:00:46 +01:00
kssenii
66175cb9c8 Not better 2022-11-18 13:00:30 +01:00
kssenii
5e61022bac Revert "Better code around SettingsChanges"
This reverts commit bed9f7594a.
2022-11-18 12:37:34 +01:00
Suzy Wang
8dc99e8d64
Merge branch 'master' into s390x_ip_coding 2022-11-17 23:35:06 -05:00
Alexey Milovidov
2c292e3866
Merge branch 'master' into ldap_fix_search_limit 2022-11-17 22:20:53 +01:00
Sergei Trifonov
f2f0676bcc
Revert "Revert "S3 request per second rate throttling"" 2022-11-17 17:35:04 +01:00
serxa
1920c6267d typo 2022-11-17 16:20:21 +00:00
serxa
c0d98aa749 do not reorder, ignore 4 readings, fix period 2022-11-17 15:53:47 +00:00
kssenii
5cdf216c8f Merge remote-tracking branch 'upstream/master' into allow-single-disk-instead-of-storage-policy 2022-11-17 16:39:36 +01:00
Nikita Taranov
7beb58b0cf
Optimize merge of uniqExact without_key (#43072)
* impl for uniqExact

* rm unused (read|write)Text methods

* fix style

* small fixes

* impl for variadic uniqExact

* refactor

* fix style

* more agressive inlining

* disable if max_threads=1

* small improvements

* review fixes

* Revert "rm unused (read|write)Text methods"

This reverts commit a7e7480584.

* encapsulate is_able_to_parallelize_merge in Data

* encapsulate is_exact & argument_is_tuple in Data
2022-11-17 13:19:02 +01:00
Vladimir C
a29c5b9e3a
Merge pull request #43232 from ClickHouse/vdimir/max_map_null_totals_bug 2022-11-17 13:10:05 +01:00
Sema Checherinda
1ad48d091d
Merge pull request #43249 from Algunenano/i43247
Fix ubsan in AggregateFunctionMinMaxAny::read with high sizes
2022-11-17 12:21:05 +01:00
Raúl Marín
97d6fc3071 Merge remote-tracking branch 'blessed/master' into perf_experiment 2022-11-17 11:48:46 +01:00
Alexander Tokmakov
9011a18234
Revert "S3 request per second rate throttling" 2022-11-16 22:33:48 +03:00
Sergei Trifonov
159743edd6
Merge pull request #43014 from ClickHouse/disk-s3-throttler
S3 request per second rate throttling
2022-11-16 18:51:06 +01:00
Alexey Milovidov
923f2dd562
Merge branch 'master' into ldap_fix_search_limit 2022-11-16 06:13:07 +01:00
Alexey Milovidov
b4165f95a9
Merge branch 'master' into build/poco-leftovers 2022-11-16 06:09:58 +01:00
Alexey Milovidov
04687c0d69
Merge pull request #43206 from ClickHouse/miscellaneous-changes-parallel-replicas
Miscellaneous changes
2022-11-16 05:30:03 +01:00