Commit Graph

10628 Commits

Author SHA1 Message Date
Duc Canh Le
8aaa46ca90 StorageJoin: do not create clone hash join with all columns 2023-08-04 11:07:33 +00:00
kssenii
4b8b78f220 Revert "Merge pull request #53044 from ClickHouse/revert-52155-database-filesystem-remove-catch"
This reverts commit e71f20891f, reversing
changes made to aa9ab58994.
2023-08-04 12:41:55 +02:00
Alexander Tokmakov
0b312f541a
Revert "Remove try/catch from DatabaseFilesystem" 2023-08-04 13:29:28 +03:00
vdimir
8050edaff6
style convertFieldToTypeStrict 2023-08-04 09:45:13 +00:00
vdimir
079c6783a2
Update decimal_in tests for analyzer 2023-08-04 09:45:12 +00:00
vdimir
0032eb9ab7
Fix IN with decimal in analyzer 2023-08-04 09:45:08 +00:00
Vitaly Baranov
587877dba3
Merge branch 'master' into disable-fs-cache-for-backups 2023-08-04 01:15:23 +02:00
Vitaly Baranov
0af043459a
Merge pull request #52660 from vitlibar/remove-unnecessary-temp-context-access
Remove creation of a unnecessary temporary ContextAccess on login
2023-08-04 01:08:12 +02:00
Alexey Gerasimchuck
1e7daca85b Added new tests for session_log plus bugfix 2023-08-03 22:06:33 +00:00
Alexey Milovidov
95f5d2f37f
Merge pull request #52155 from ClickHouse/database-filesystem-remove-catch
Remove try/catch from DatabaseFilesystem
2023-08-03 23:02:01 +03:00
Alexander Tokmakov
968c79cf3f
Merge pull request #52956 from ClickHouse/fixes_for_databases
Fix some issues with databases
2023-08-03 19:13:41 +03:00
Anton Popov
92cb5e9ae3
Merge pull request #52687 from alkorgun/fix-named-collections-on-cluster-23.7
Fix named collections on cluster 23.7
2023-08-03 14:50:28 +02:00
Alexey Milovidov
29d386fec2
Merge branch 'master' into count-distinct-if 2023-08-03 15:36:11 +03:00
Alexey Milovidov
56660f44b1
Merge branch 'master' into database-filesystem-remove-catch 2023-08-03 15:08:07 +03:00
Vitaly Baranov
f427c779eb Disable using fs cache for backup/restore. 2023-08-03 13:52:32 +02:00
Igor Nikonov
4155b0adfd
Merge pull request #52768 from ClickHouse/fix-window-func-range-check
Fix: check correctly window frame bounds for RANGE
2023-08-03 13:48:55 +02:00
Alexey Milovidov
d417061886 Merge branch 'master' into fix-error-code 2023-08-03 13:48:23 +02:00
Vitaly Baranov
7a112459d3 Implement passing current roles to Context::setUser(). 2023-08-03 13:45:01 +02:00
Vitaly Baranov
16dfb028b6 Remove creation of a unnecessary temporary ContextAccess on login. 2023-08-03 13:44:59 +02:00
Alexander Tokmakov
7684e68008
Add system stop pulling replication log (#52881)
* add system stop pulling replication log

* add const

* fix another stupid test

* Update test.py
2023-08-03 13:34:43 +03:00
vdimir
9cdd4fe41a
Add info about aquired space in cache to not enough space error 2023-08-03 10:32:44 +00:00
Kseniia Sumarokova
621d852289
Merge pull request #52778 from kssenii/revert-revert-drop-cache
Revert revert of system drop filesystem cache by key
2023-08-03 10:55:25 +02:00
Alexander Tokmakov
c4fb0a0cd5 fix two minor issue 2023-08-02 23:36:54 +02:00
Alexey Milovidov
dbf14b5e2d Fix wrong error code "BAD_GET" 2023-08-02 23:16:06 +02:00
Alexey Milovidov
e101f2011b
Merge branch 'master' into count-distinct-if 2023-08-03 00:09:52 +03:00
Igor Nikonov
44b9ed438f
Merge branch 'master' into fix-window-func-range-check 2023-08-02 19:24:55 +02:00
Anton Popov
d43e76b147 fix reading of empty Nested(Array(LowCardinality(...))) 2023-08-02 16:48:08 +00:00
Alexey Milovidov
b17e93e78c Merge branch 'master' into database-filesystem-remove-catch 2023-08-02 17:13:12 +02:00
Nikita Taranov
2cbe79b529
Fix memory consumption when max_block_size is huge in Aggregator + more memory checks (#51566)
* impl

* remove checks from without_key methods

* maybe will improve smth

* add test

* Update 02797_aggregator_huge_mem_usage_bug.sql

* Update 02797_aggregator_huge_mem_usage_bug.sql

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-08-02 15:11:52 +02:00
Alexander Tokmakov
61977479be
Update SystemLog.cpp (#52858) 2023-08-02 15:18:57 +03:00
Mike Kot
1335d06b8f
Do not replicate ALTER TABLE t FREEZE on Replicated engine (#52064)
* fix

* do not replicate alter freeze

* fix

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-08-02 14:39:54 +03:00
Kseniia Sumarokova
eabca22909
Merge branch 'master' into revert-revert-drop-cache 2023-08-01 23:19:38 +02:00
Alexey Milovidov
7954b732fd
Merge branch 'master' into database-filesystem-remove-catch 2023-08-01 20:52:26 +03:00
Nikolai Kochetov
fa06056fa2 Merge branch 'master' into revert-44629-revert_flamegraph 2023-08-01 17:14:16 +00:00
Kseniia Sumarokova
dbc11b83fd
Merge branch 'master' into kssenii-patch-6 2023-08-01 18:40:20 +02:00
Vitaly Baranov
65bd8f5e81
Merge branch 'master' into backups-fix-tmp-files 2023-08-01 16:37:06 +02:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
Kseniia Sumarokova
16851040df
Fix annoying test 2023-08-01 11:21:46 +02:00
Alexey Milovidov
8ce1b87cda Merge branch 'master' of github.com:ClickHouse/ClickHouse into database-filesystem-remove-catch 2023-08-01 07:30:57 +02:00
Igor Nikonov
81c08199a8
Merge branch 'master' into fix-window-func-range-check 2023-07-31 19:45:25 +02:00
Alexander Tokmakov
7359a8108b
Merge pull request #51724 from arenadata/ADQM-939
Added max_sessions_for_user setting
2023-07-31 15:38:58 +03:00
Alexander Tokmakov
01f05e14eb
Merge pull request #50424 from tonickkozlov/tonickkozlov/zk-session-lifetime
Introduce fallback ZooKeeper sessions
2023-07-31 15:14:44 +03:00
flynn
c23893d7c1
Merge branch 'master' into count-distinct-if 2023-07-31 18:53:06 +08:00
kssenii
d136f18c30 Fix 2023-07-31 12:17:30 +02:00
Igor Nikonov
1868497534 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-31 08:50:48 +00:00
Alexey Gerasimchuck
2c07607f25
Merge branch 'master' into ADQM-939 2023-07-31 13:43:45 +10:00
Igor Nikonov
3d7257cc7e Allow Floats as boundaries for RANGE is nonsense 2023-07-30 23:19:54 +00:00
Igor Nikonov
bdf47428f2 Merge remote-tracking branch 'origin/master' into fix-window-func-range-check 2023-07-30 22:40:58 +00:00
Igor Nikonov
6d971bc3a8 Specific check for NaN in window functions with RANGE 2023-07-30 22:35:19 +00:00
Alexey Gerasimchuck
e58b3cfd32 Implemented max sessions for user 2023-07-30 22:09:03 +00:00
alesapin
aba291ca68
Revert "Revert "Add an ability to specify allocations size for sampling memory profiler"" 2023-07-30 14:01:34 +02:00
kssenii
0cf93e7114 Reduce redundant logging 2023-07-30 13:51:10 +02:00
kssenii
20b76010ef Merge remote-tracking branch 'upstream/master' into kssenii-patch-6 2023-07-30 13:46:58 +02:00
kssenii
38f12f0664 Revert some commenting 2023-07-30 13:46:40 +02:00
kssenii
6ae6268ad0 Revert "Merge pull request #51917 from ClickHouse/revert-system-drop-filesystem-cache-by-key"
This reverts commit 520195f7ef, reversing
changes made to e36a638014.
2023-07-30 13:39:54 +02:00
Alexey Milovidov
91e67c105f
Merge pull request #52569 from ClickHouse/Realize_parameterized_view_as_new_storage_view
Realize parameterized view as new view with parameters substitued
2023-07-30 05:46:51 +03:00
Alexey Milovidov
a336f06f57
Update Context.cpp 2023-07-30 05:46:05 +03:00
Igor Nikonov
918571a5ee Fix: check correctly frame bounds for RANGE 2023-07-29 22:04:21 +00:00
pufit
6211845ef0
Merge pull request #51303 from ClickHouse/deprecate-metadata-cache
Deprecate the `metadata_cache` feature
2023-07-28 10:31:02 -04:00
Alexander Tokmakov
39200606ec
Merge pull request #52174 from arenadata/ADQM-988
Added possibility to save logs on crash and options to configure logs buffer
2023-07-28 16:55:00 +03:00
Anton Kozlov
5dfc30528d Introduce fallback ZooKeeper sessions 2023-07-28 11:43:27 +00:00
robot-clickhouse
bba9a2cd28
Merge pull request #51961 from nickitat/exec_udf_allow_parameters
Don't throw exception when exec udf has parameters
2023-07-28 11:52:17 +02:00
Alexey Gerasimchuck
63b05da1f2 System logs improvements 2023-07-28 07:23:34 +00:00
flynn
6de5127c0d fix conflict 2023-07-28 07:11:52 +00:00
pufit
9dbb106dc1 Fix tests, docs 2023-07-27 23:37:09 -04:00
Al Korgun
ebbd662071
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 23:31:35 +03:00
Azat Khuzhin
d40dbdee62 Fix usage of temporary directories during RESTORE
Previously during RESTORE you may get the following warning in logs:

    <Warning> TemporaryFileOnDisk: Temporary path 'tmp/21672kaaaaa' does not exist in './disks/s3_common_disk/'

The reason is that it uses not disks/s3_common_disk/tmp but instead
disks/s3_common_disk/disks/s3_common_disk/tmp path.

Fix this by adding TemporaryFileOnDisk::getRelativePath() and use it
when appropriate.

And now - `find disks`, does not shows any more temporary leftovers.

v2: rename getPath to getAbsolutePath
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-27 19:24:54 +02:00
Robert Schulze
c2ee774350
Add query cache metrics to system.asynchronous_metrics
Cf. https://github.com/ClickHouse/ClickHouse/pull/52384#issuecomment-1653241216
2023-07-27 15:19:01 +00:00
Robert Schulze
d48b1cadb0
Merge pull request #52384 from rschu1ze/query_cache_usage_in_query_log
Include query cache usage in SYSTEM.QUERY_LOG
2023-07-27 17:16:54 +02:00
Jiebin Sun
78f3a575f9
Convert hashSets in parallel before merge (#50748)
* Convert hashSets in parallel before merge

Before merge, if one of the lhs and rhs is singleLevelSet and the other is twoLevelSet,
then the SingleLevelSet will call convertToTwoLevel(). The convert process is not in parallel
and it will cost lots of cycle if it cosume all the singleLevelSet.

The idea of the patch is to convert all the singleLevelSets to twoLevelSets in parallel if
the hashsets are not all singleLevel or not all twoLevel.

I have tested the patch on Intel 2 x 112 vCPUs SPR server with clickbench and latest upstream
ClickHouse.
Q5 has got a big 264% performance improvement and 24 queries have got at least 5% performance
gain. The overall geomean of 43 queries has gained 7.4% more than the base code.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* add resize() for the data_vec in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Add the performance test prepare_hash_before_merge.xml

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* Fit the CI to rename the data set from hits_v1 to test.hits.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

* remove the redundant branch in UniqExactSet

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* Remove the empty methods and add throw exception in parallelizeMergePrepare()

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>

---------

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-07-27 15:06:34 +02:00
Robert Schulze
043ad45ec3
Incorporate review feedback, pt. II 2023-07-27 09:18:24 +00:00
Alexey Milovidov
044eb0509f
Merge branch 'master' into database-filesystem-remove-catch 2023-07-27 12:12:24 +03:00
Robert Schulze
2b18872e86
Incorporate review feedback 2023-07-27 08:55:19 +00:00
robot-ch-test-poll1
abc48a0b73
Merge pull request #52627 from ClickHouse/fix_build_with_clang15
Fix build with clang-15
2023-07-27 09:49:29 +02:00
Al Korgun
f026ccf11e
Merge branch 'ClickHouse:master' into fix-named-collections-on-cluster-23.7 2023-07-27 10:48:25 +03:00
Илья Коргун
7c1832fcfc Fix named collections related statements #51609 2023-07-27 09:41:47 +03:00
Alexey Milovidov
eae86f603c Fix the test 2023-07-27 06:34:09 +02:00
robot-ch-test-poll3
5db88e677b
Merge pull request #52328 from ClickHouse/Fix_parameterized_view_with_cte_multiple_usage
Fix parameterized view with cte and multiple usage
2023-07-27 00:06:10 +02:00
Nikolay Degterinsky
d89e2e6a27
Add SYSTEM STOP LISTEN query (#51016)
Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-07-26 19:58:41 +02:00
Alexander Tokmakov
74f3e76b18 fix build with clang-15 2023-07-26 17:15:28 +02:00
Kruglov Pavel
3046886843
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-26 15:20:24 +02:00
Nikita Taranov
04180549b0
Fix possible double-free in Aggregator (#52439) 2023-07-26 13:15:58 +02:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Sema Checherinda
83d869860e
Merge pull request #51946 from arenadata/ADQM-940
Expose Peak memory usage in query statistics.
2023-07-25 22:17:58 +03:00
Nikita Mikhaylov
1dc9ca2c24
Merge pull request #52549 from ClickHouse/whitespace-before-comma
Check for punctuation
2023-07-25 20:30:36 +02:00
Igor Nikonov
9b4357723f
Merge pull request #47135 from ClickHouse/remove-perf-test-duplicate-order-by-and-distinct
Remove duplicate_order_by_and_distinct optimization
2023-07-25 17:26:22 +02:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Vasily Nemkov
6add283933
Merge branch 'master' into fix_insert_into_buffer_table 2023-07-25 16:06:42 +02:00
Anton Popov
4531b105ac
Merge branch 'master' into flush-async-insert-queue 2023-07-25 15:48:01 +02:00
Smita Kulkarni
22fec136c1 Create new StorageView with substituted parameters for every SELECT query of a parameterized view 2023-07-25 14:04:55 +02:00
Smita Kulkarni
94ff9a4696 Merge branch 'master' into Fix_parameterized_view_with_cte_multiple_usage 2023-07-25 12:08:38 +02:00
Yarik Briukhovetskyi
5f767b0dfa
Merge pull request #52004 from JackyWoo/rewrite_uniq_to_count
Rewrite uniq to count
2023-07-25 11:41:00 +02:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Dmitry Kardymon
d4d381de7e Merge remote-tracking branch 'origin/master' into ADQM-940 2023-07-24 20:04:10 +00:00
Alexey Milovidov
3c034d563b
Merge pull request #52068 from azat/replicated-cluster-prep1
Preparations for Trivial Support For Resharding (part1)
2023-07-24 22:57:44 +03:00
Igor Nikonov
91f7185e8c
Merge branch 'master' into remove-perf-test-duplicate-order-by-and-distinct 2023-07-24 18:47:23 +02:00
Robert Schulze
c755fde3a4
Include query cache usage in SYSTEM.QUERY_LOG 2023-07-24 16:24:36 +00:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
Nikita Taranov
df5ff1383c
Fix settings not applied for explain query when format provided (#51859) 2023-07-24 14:57:05 +02:00
Anton Popov
347f442f84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-07-24 10:55:31 +00:00