Commit Graph

121373 Commits

Author SHA1 Message Date
Azat Khuzhin
5611b2fff4 Add a note about not working _table filter for Merge with analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 16:35:17 +02:00
Han Fei
9488567bf6
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:08 +02:00
Han Fei
f6ca013c53
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:28:00 +02:00
Han Fei
0d44d527ef
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-07-27 16:27:04 +02:00
Nikolay Degterinsky
ee9bad7a31 Fix style 2023-07-27 14:18:46 +00:00
Nikolay Degterinsky
b5160c8072 Fix bugs and better test for SYSTEM STOP LISTEN 2023-07-27 14:16:19 +00:00
Han Fei
f5dfb70f5c
Update src/Storages/MergeTree/MergeTreeDeduplicationLog.cpp 2023-07-27 16:12:20 +02:00
Han Fei
ce38d3c5ea address comment 2023-07-27 16:11:08 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexey Milovidov
8d0a201468
Merge pull request #52661 from ClickHouse/23.8-prepare
Update version after release
2023-07-27 16:35:10 +03:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748)
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-07-27 15:06:34 +02:00
Alexander Gololobov
006453b102
Merge branch 'master' into return_zxid 2023-07-27 14:57:39 +02:00
Anton Popov
541a253580 fix crash with function tuple and one sparse argument 2023-07-27 12:43:38 +00:00
Alexey Milovidov
33300a978e
Update CHANGELOG (#52655) 2023-07-27 14:38:53 +02:00
Yakov Olkhovskiy
8bba7baeaa fix style 2023-07-27 12:34:22 +00:00
Alexander Tokmakov
a70127baec
Merge pull request #52657 from ClickHouse/revert-52518-add-refcount-to-system-table
Revert "Added field `refcount` to `system.remote_data_paths` table"
2023-07-27 15:26:13 +03:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
avogar
b5fc34b770 Rename setting disable_url_encoding to enable_url_encoding and add a test 2023-07-27 12:20:33 +00:00
Yakov Olkhovskiy
9d73be6fca test is added 2023-07-27 12:14:46 +00:00
yariks5s
e749938e92 fixed test 2023-07-27 12:07:34 +00:00
Robert Schulze
f7bd3a2a23
Merge branch 'master' into follow-up-to-50986 2023-07-27 13:14:47 +02:00
Alexander Tokmakov
228de12d94
Update ReplicatedMergeTreeQueue.cpp (#52648) 2023-07-27 13:59:23 +03:00
Antonio Andelic
04361908e6 Fix test_keeper_reconfig_replace_leader 2023-07-27 10:36:02 +00:00
Alexey Milovidov
d7a2a76438
Merge pull request #52644 from ClickHouse/changelog-23.7
Changelog for 23.7
2023-07-27 13:00:18 +03:00
Roman Vasin
578ea9c5e8 Update documentation 2023-07-27 09:50:42 +00:00
Robert Schulze
043ad45ec3
Incorporate review feedback, pt. II 2023-07-27 09:18:24 +00:00
Alexey Milovidov
361e6d9132
Merge branch 'master' into limit_client_fd 2023-07-27 12:17:31 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table
Added field `refcount` to `system.remote_data_paths` table
2023-07-27 12:13:24 +03:00
Alexey Milovidov
044eb0509f
Merge branch 'master' into database-filesystem-remove-catch 2023-07-27 12:12:24 +03:00
Alexey Milovidov
a49c04efda
Merge branch 'master' into distinct-in-order-sqlancer-crashes 2023-07-27 12:12:06 +03:00
Alexey Milovidov
b9676bf0db
Merge branch 'master' into check-for-hiding-cyrillic-characters 2023-07-27 12:10:55 +03:00
Alexey Milovidov
4cf8de9e36
Merge branch 'master' into changelog-23.7 2023-07-27 12:10:44 +03:00
Alexander Tokmakov
16d5c7ae59
Merge pull request #52647 from ClickHouse/fix-style
Fix style
2023-07-27 12:09:23 +03:00
Robert Schulze
2b18872e86
Incorporate review feedback 2023-07-27 08:55:19 +00:00
Antonio Andelic
f61f36800c Fix style 2023-07-27 08:48:23 +00:00
János Benjamin Antal
ac51ade45c Do not run the test without Rust libraries 2023-07-27 08:45:53 +00:00
Robert Schulze
c04fb61487
Merge branch 'master' into follow-up-to-50986 2023-07-27 10:28:59 +02:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15
Fix build with clang-15
2023-07-27 09:49:29 +02:00
Al Korgun
f026ccf11e
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 10:48:25 +03:00
Илья Коргун
bcc41fbc2f Fix reference to a local binding declared in an enclosing function 2023-07-27 10:46:35 +03:00
robot-clickhouse
ddab6590b2
Merge pull request #52626 from ClickHouse/fix_deadlock_in_persistent_table_functions
Fix deadlocks in StorageTableFunctionProxy
2023-07-27 09:38:48 +02:00
Илья Коргун
5395d34fd7 Fix missing constructor call 2023-07-27 10:32:10 +03:00
Илья Коргун
d6afa3de01 Fix missing 'typename' prior to dependent type name 2023-07-27 10:29:36 +03:00
Alexey Milovidov
d2d7139da3 Changelog for 23.7 2023-07-27 08:58:23 +02:00
Илья Коргун
e511072df1 Update named collections related docs 2023-07-27 09:42:38 +03:00
Илья Коргун
7c1832fcfc Fix named collections related statements #51609 2023-07-27 09:41:47 +03:00
robot-ch-test-poll1
a5e073ff7d
Merge pull request #52602 from CheSema/finalize-gindexstore
GinIndexStore: fix a bug when files are finalizated after first write,
2023-07-27 08:31:24 +02:00
Alexey Milovidov
65ffe91bf2 Fix double whitespace 2023-07-27 07:13:26 +02:00
Yakov Olkhovskiy
d35c87c1bd allow positional options for clickhouse-local and populate global udf settings 2023-07-27 05:06:16 +00:00