thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 03:12:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
120,690 Commits 9,326 Branches 1,783 Tags 2.1 GiB
8d0a201468
Commit Graph

120690 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alexey Milovidov
8d0a201468
Merge pull request #52661 from ClickHouse/23.8-prepare 
Update version after release
 2023-07-27 16:35:10 +03:00
Alexey Milovidov
671128140d Update autogenerated version to 23.8.1.1 and contributors 2023-07-27 15:34:05 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748) 
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-07-27 15:06:34 +02:00
Alexey Milovidov
33300a978e
Update CHANGELOG (#52655) 2023-07-27 14:38:53 +02:00
Alexander Tokmakov
a70127baec
Merge pull request #52657 from ClickHouse/revert-52518-add-refcount-to-system-table 
Revert "Added field `refcount` to `system.remote_data_paths` table"
 2023-07-27 15:26:13 +03:00
Alexander Tokmakov
f3dc6dd061
Revert "Added field refcount to system.remote_data_paths table" 2023-07-27 15:23:57 +03:00
Alexander Tokmakov
228de12d94
Update ReplicatedMergeTreeQueue.cpp (#52648) 2023-07-27 13:59:23 +03:00
Alexey Milovidov
d7a2a76438
Merge pull request #52644 from ClickHouse/changelog-23.7 
Changelog for 23.7
 2023-07-27 13:00:18 +03:00
Alexey Milovidov
17b647f6b1
Merge pull request #52518 from CurtizJ/add-refcount-to-system-table 
Added field `refcount` to `system.remote_data_paths` table
 2023-07-27 12:13:24 +03:00
Alexey Milovidov
4cf8de9e36
Merge branch 'master' into changelog-23.7 2023-07-27 12:10:44 +03:00
Alexander Tokmakov
16d5c7ae59
Merge pull request #52647 from ClickHouse/fix-style 
Fix style
 2023-07-27 12:09:23 +03:00
Antonio Andelic
f61f36800c Fix style 2023-07-27 08:48:23 +00:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15 
Fix build with clang-15
 2023-07-27 09:49:29 +02:00
robot-clickhouse
ddab6590b2
Merge pull request #52626 from ClickHouse/fix_deadlock_in_persistent_table_functions 
Fix deadlocks in StorageTableFunctionProxy
 2023-07-27 09:38:48 +02:00
Alexey Milovidov
d2d7139da3 Changelog for 23.7 2023-07-27 08:58:23 +02:00
robot-ch-test-poll1
a5e073ff7d
Merge pull request #52602 from CheSema/finalize-gindexstore 
GinIndexStore: fix a bug when files are finalizated after first write,
 2023-07-27 08:31:24 +02:00
Alexey Milovidov
65ffe91bf2 Fix double whitespace 2023-07-27 07:13:26 +02:00
Kruglov Pavel
fab77783f1
Merge pull request #49367 from ClickHouse/enc 
Partially reimplement Parquet encoder to make it faster and parallelizable
 2023-07-27 00:48:54 +02:00
robot-ch-test-poll2
7bcef0a6c0
Merge pull request #52520 from zvonand/revert-52450-remove-to-decimal-string 
Fix `toDecimalString` function
 2023-07-27 00:18:36 +02:00
Alexey Milovidov
3387b02ede
Merge pull request #52557 from azat/tests/fix-network_receive_time_metric_insert 
tests: increase throttling for 01923_network_receive_time_metric_insert
 2023-07-27 01:11:18 +03:00
robot-ch-test-poll3
5db88e677b
Merge pull request #52328 from ClickHouse/Fix_parameterized_view_with_cte_multiple_usage 
Fix parameterized view with cte and multiple usage
 2023-07-27 00:06:10 +02:00
robot-clickhouse-ci-1
b6bcc32acb
Merge pull request #52606 from nickitat/port_use_prewhere_cols 
Port one more optimisation to `MergeTreePrefetchedReadPool`
 2023-07-27 00:03:47 +02:00
Alexander Tokmakov
954a1d3ede
Improve logging macros (#52519) 
* improve logging macros

* fix

* Update logger_useful.h

* fix

* fix
 2023-07-26 23:38:14 +03:00
Alexey Milovidov
4586290e89
Merge pull request #52509 from ucasfl/operator 
Replace with three way comparison
 2023-07-26 23:30:08 +03:00
Alexey Milovidov
07193904b6
Merge pull request #52598 from ClickHouse/remove-peak-memory-usage-from-client 
Remove peak memory usage from the final message in the client
 2023-07-26 23:26:58 +03:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016) 
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-07-26 19:58:41 +02:00
Nikita Taranov
0a838dc6d1
Revert "Remove mmap/mremap/munmap from Allocator.h" (#52589) 2023-07-26 18:30:18 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Alexander Tokmakov
2479f1352a fix deadlocks in StorageTableFunctionProxy 2023-07-26 17:11:28 +02:00
Kruglov Pavel
933c2f3fb5
Merge pull request #52440 from Enmk/fix_insert_into_buffer_table 
Fixed inserting into Buffer engine
 2023-07-26 16:41:00 +02:00
Anton Popov
338188ae7f fix test 2023-07-26 14:10:27 +00:00
Nikolai Kochetov
a4a8c73108
Merge pull request #48669 from ClickHouse/prewhere-optimization-update-sort-desc 
Update sort desc in ReadFromMergeTree after applying PREWHERE info
 2023-07-26 15:47:18 +02:00
Sema Checherinda
1854a21fbd
Merge branch 'master' into finalize-gindexstore 2023-07-26 16:23:58 +03:00
Kruglov Pavel
3046886843
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-26 15:20:24 +02:00
robot-ch-test-poll4
110500049a
Merge pull request #50532 from nickitat/more_pushdown_for_right_side_of_join 
Push down to right side of a join in more cases
 2023-07-26 14:43:57 +02:00
Kruglov Pavel
19c95d0f9b
Merge pull request #52585 from ClickHouse/Avogar-patch-2 
Fix possible error "Cannot drain connections: cancel first"
 2023-07-26 13:22:34 +02:00
Kruglov Pavel
f176c8389d
Merge branch 'master' into Avogar-patch-2 2023-07-26 13:18:27 +02:00
Kruglov Pavel
a875cf5898
Merge pull request #51286 from Avogar/better-progress-bar-2 
Use read_bytes/total_bytes_to_read for progress bar in s3/file/url/... table functions
 2023-07-26 13:16:49 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Kruglov Pavel
15cc046883
Merge branch 'master' into better-progress-bar-2 2023-07-26 13:12:24 +02:00
Anton Popov
77e645db4f
Merge pull request #52517 from CurtizJ/fix-drop-of-projection 
Fix lightweight delete after drop of projection
 2023-07-26 13:00:08 +02:00
Anton Popov
45542fd712
Merge branch 'master' into fix-drop-of-projection 2023-07-26 12:55:18 +02:00
Nikita Taranov
017d34d40f determine task size by prewhere columns 2023-07-26 12:54:50 +02:00
Robert Schulze
d4737ca033
Merge pull request #50986 from arenadata/ADQM-822 
Implement support of encrypted elements in configuration file
 2023-07-26 12:27:04 +02:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated 
Make shutdown of `ReplicatedMergeTree` tables more soft
 2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445) 
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Antonio Andelic
63d88ebf3c
Merge pull request #52587 from ClickHouse/fix-again-02497_trace_events_stress_long 
Fix `02497_trace_events_stress_long` again
 2023-07-26 11:10:32 +02:00
robot-ch-test-poll4
50dff58097
Merge pull request #51280 from saitama951/external_aggregation_fix 
external_aggregation_fix for big endian machines
 2023-07-26 10:47:15 +02:00
Sema Checherinda
991584506f fix a bug when files are finalizated after first write 2023-07-26 12:42:18 +04:00