thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-13 18:02:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
121,242 Commits 9,328 Branches 1,783 Tags 2.1 GiB
c4fb0a0cd5
Commit Graph

10516 Commits

Author SHA1 Message Date
Alexander Tokmakov
c4fb0a0cd5 fix two minor issue 2023-08-02 23:36:54 +02:00
Nikita Taranov
2cbe79b529
Fix memory consumption when max_block_size is huge in Aggregator + more memory checks (#51566) 
* impl

* remove checks from without_key methods

* maybe will improve smth

* add test

* Update 02797_aggregator_huge_mem_usage_bug.sql

* Update 02797_aggregator_huge_mem_usage_bug.sql

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-08-02 15:11:52 +02:00
Alexander Tokmakov
61977479be
Update SystemLog.cpp (#52858) 2023-08-02 15:18:57 +03:00
Mike Kot
1335d06b8f
Do not replicate ALTER TABLE t FREEZE on Replicated engine (#52064) 
* fix

* do not replicate alter freeze

* fix

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-08-02 14:39:54 +03:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token 
Azure blob storage sas token
 2023-08-01 12:27:17 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939 
Added max_sessions_for_user setting
 2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime 
Introduce fallback ZooKeeper sessions
 2023-07-31 15:14:44 +03:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
kssenii
0cf93e7114 Reduce redundant logging 2023-07-30 13:51:10 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
kssenii
38f12f0664 Revert some commenting 2023-07-30 13:46:40 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view 
Realize parameterized view as new view with parameters substitued
 2023-07-30 05:46:51 +03:00
Alexey Milovidov
a336f06f57
Update Context.cpp 2023-07-30 05:46:05 +03:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache 
Deprecate the `metadata_cache` feature
 2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988 
Added possibility to save logs on crash and options to configure logs buffer
 2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
robot-clickhouse
bba9a2cd28
Merge pull request #51961 from nickitat/exec_udf_allow_parameters 
Don't throw exception when exec udf has parameters
 2023-07-28 11:52:17 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE 
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-27 19:24:54 +02:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics 
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
 2023-07-27 15:19:01 +00:00
Robert Schulze
d48b1cadb0
Merge pull request #52384 from rschu1ze/query_cache_usage_in_query_log 
Include query cache usage in SYSTEM.QUERY_LOG
 2023-07-27 17:16:54 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748) 
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-07-27 15:06:34 +02:00
Robert Schulze
043ad45ec3
Incorporate review feedback, pt. II 2023-07-27 09:18:24 +00:00
Robert Schulze
2b18872e86
Incorporate review feedback 2023-07-27 08:55:19 +00:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15 
Fix build with clang-15
 2023-07-27 09:49:29 +02:00
robot-ch-test-poll3
5db88e677b
Merge pull request #52328 from ClickHouse/Fix_parameterized_view_with_cte_multiple_usage 
Fix parameterized view with cte and multiple usage
 2023-07-27 00:06:10 +02:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016) 
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-07-26 19:58:41 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Kruglov Pavel
3046886843
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-26 15:20:24 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Sema Checherinda
83d869860e
Merge pull request #51946 from arenadata/ADQM-940 
Expose Peak memory usage in query statistics.
 2023-07-25 22:17:58 +03:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma 
Check for punctuation
 2023-07-25 20:30:36 +02:00
Igor Nikonov
9b4357723f
Merge pull request #47135 from ClickHouse/remove-perf-test-duplicate-order-by-and-distinct 
Remove duplicate_order_by_and_distinct optimization
 2023-07-25 17:26:22 +02:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Vasily Nemkov
6add283933
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-25 16:06:42 +02:00
Anton Popov
4531b105ac
Merge branch 'master' into flush-async-insert-queue 2023-07-25 15:48:01 +02:00
Smita Kulkarni
22fec136c1 Create new StorageView with substituted parameters for every SELECT query of a parameterized view 2023-07-25 14:04:55 +02:00
Smita Kulkarni
94ff9a4696 Merge branch 'master' into Fix_parameterized_view_with_cte_multiple_usage 2023-07-25 12:08:38 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count 
Rewrite uniq to count
 2023-07-25 11:41:00 +02:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Dmitry Kardymon
d4d381de7e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 20:04:10 +00:00
Alexey Milovidov
3c034d563b
Merge pull request #52068 from azat/replicated-cluster-prep1 
Preparations for Trivial Support For Resharding (part1)
 2023-07-24 22:57:44 +03:00
Igor Nikonov
91f7185e8c
Merge branch 'master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-24 18:47:23 +02:00
Robert Schulze
c755fde3a4
Include query cache usage in SYSTEM.QUERY_LOG 2023-07-24 16:24:36 +00:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00