thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-13 01:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
126,951 Commits 9,322 Branches 1,783 Tags 2.1 GiB
665dfe6135
Commit Graph

11304 Commits

Author SHA1 Message Date
robot-ch-test-poll1
59a3b3356f
Merge pull request #55296 from rschu1ze/qc-better-logging 
Improve logging in query cache
 2023-10-07 17:59:19 +02:00
kssenii
1a839adec7 Add one more try-catch 2023-10-07 15:31:15 +02:00
Robert Schulze
a72ae92328
Make the logging in the query cache easier to understand 2023-10-07 11:33:11 +00:00
alesapin
e55a615f06
Merge pull request #55253 from vitlibar/fix-async-insert-access-check-for-defaults 
Evaluate defaults during async insert safer
 2023-10-07 12:26:35 +02:00
kssenii
289020f454 Merge remote-tracking branch 'upstream/master' into fix-background-download-in-cache 2023-10-07 12:19:33 +02:00
kssenii
9df0b8f67c Fix 2023-10-06 12:41:37 +02:00
Duc Canh Le
bea4a4eb85 Merge branch 'master' into clickhouse_fix_too_many_marks 
rebase and re-trigger CI
 2023-10-06 09:45:48 +00:00
Vitaly Baranov
cf7eea569b Fix quota consumption 2023-10-05 15:46:36 +02:00
Kseniia Sumarokova
68a3cd57a1
Fix data race in context 2023-10-05 15:29:56 +02:00
vdimir
406dfe277c
fix style 2023-10-05 11:58:00 +02:00
Vitaly Baranov
a54d3f31e4 Add new fields to InsertQuery::hash and operator == 2023-10-05 11:03:05 +02:00
kssenii
c57a92f5fc Better 2023-10-05 10:50:57 +02:00
Vitaly Baranov
76766a200e Fix access checking in evaluations of defaults during async insert. 2023-10-05 10:26:44 +02:00
Duc Canh Le
ae417ef39c adding comments 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-10-05 07:49:17 +00:00
kssenii
d13588e130 Fix 2023-10-05 09:41:17 +02:00
Nikolai Kochetov
b67a0fe344
Merge pull request #55121 from kitaisreal/context-lock-contention-fix 
Context lock contention fix
 2023-10-03 11:17:59 +02:00
robot-ch-test-poll
e06f72ee55
Merge pull request #54052 from VanDarkholme7/missing_subcolumns 
Support missed Object(Nullable(json)) subcolumns in query.
 2023-10-03 10:32:51 +02:00
Duc Canh Le
a09c53233b only rebuild indexes when index granularity changes 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-10-03 01:27:45 +00:00
vdimir
8b119f03cb
Merge branch 'master' into vdimir/fix_file_cache_tmp_write_buffer 2023-10-02 14:56:37 +02:00
Nikita Taranov
97e705325b
Optimise memory consumption when external group by generates ton of temporary files (#54798) 
* impl

* fix

* fix test
 2023-10-02 13:09:40 +02:00
Maksim Kita
71cb6457de Fixed code review issues 2023-10-02 13:53:17 +03:00
Duc Canh Le
0064d3637f rebuild indexes and projections when UPDATE compact parts with index_granularity_bytes > 0 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-10-02 07:36:57 +00:00
filimonov
bff832c7f0 Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1 
See #53287
 2023-10-02 08:34:46 +02:00
Gabriel Archer
00da4e01c0 tabs 2023-09-30 14:11:10 +02:00
Gabriel Archer
b89ff6ee6c tabs 2023-09-30 13:27:32 +02:00
Gabriel Archer
a6968a9a02 simpler 2023-09-30 13:14:09 +02:00
robot-ch-test-poll
f5542e1cad
Merge pull request #55129 from CurtizJ/describe-virtuals 
Allow to include virtual columns into `DESCRIBE` query
 2023-09-29 23:29:58 +02:00
vdimir
c64e5e282c
Fix file cache temporary file segment range in FileSegment::reserve 2023-09-29 17:49:58 +00:00
Anton Popov
9b0e222cd2 allow to include virtual columns into DESCRIBE query 2023-09-29 11:08:46 +00:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test 
Fix broken test
 2023-09-29 11:13:31 +02:00
Gabriel
81cbe2a819 Use the tuple element names as column names in untuple() 2023-09-29 10:51:03 +02:00
Maksim Kita
07b9b5d7dd Context lock contention fix 2023-09-29 11:16:47 +03:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
Sema Checherinda
f73eef9ed8
Merge pull request #54697 from CheSema/s3_retry_cancelation_point 
add cancelation point to s3 retries
 2023-09-28 19:01:09 +02:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
Sema Checherinda
a1afab5308 add comment 2023-09-28 12:50:11 +02:00
vdimir
ea1ab52f60
fix 2023-09-28 09:13:01 +00:00
vdimir
9b4cf43fe4
Store NULL in scalar result map for empty subquery result 2023-09-28 09:12:57 +00:00
Yong Wang
8c9da6bacf Merge remote-tracking branch 'origin/master' into Kusto-phase2-oss-pr 2023-09-27 22:35:14 -07:00
Alexey Milovidov
cc96a53c5a
Merge pull request #55053 from kssenii/update-unit-test 
Update gtest_lru_file_cache.cpp
 2023-09-28 02:40:42 +03:00
Sema Checherinda
31ea4052d0 cut the build dependency between commin_io and other libraries 2023-09-28 00:15:36 +02:00
Sema Checherinda
5fdca302e6 fix build, resolve process_list_elem race 2023-09-28 00:15:36 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
kssenii
42783894b7 Add comments 2023-09-27 20:07:19 +02:00
Robert Schulze
2d750e9e2f
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-27 12:15:29 +00:00
kssenii
3cbc1a3335 Update unit test 2023-09-27 11:57:47 +02:00
凌涛
0d256a381a add doc 
fix tests

modify code stype and spelling

add tests and modify code style
 2023-09-27 17:03:53 +08:00
robot-ch-test-poll4
9aab5f40ac
Merge pull request #55029 from kitaisreal/profile-events-context-lock-wait-microseconds 
ProfileEvents added ContextLockWaitMicroseconds
 2023-09-26 23:03:08 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
Alexey Milovidov
29d3b34dfc
Merge pull request #54090 from ClickHouse/remove-current-status 
Remove CurrentStatusInfo
 2023-09-26 21:38:07 +03:00
Maksim Kita
eb1b3e6a3a ProfileEvents added ContextLockWaitMicroseconds 2023-09-26 19:08:22 +03:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109) 
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2023-09-26 17:50:19 +02:00
kssenii
14b09d3cdc Add caching 2023-09-26 16:23:24 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists 
Implement `createIfNotExists` in Keeper natively
 2023-09-26 16:04:51 +02:00
Kruglov Pavel
69a17bbef6
Merge pull request #52853 from Avogar/http-valid-json-on-exception 
Output valid JSON/XML on excetpion during HTTP query execution
 2023-09-26 14:25:55 +02:00
kssenii
7317ff3684 Fxi 2023-09-26 12:56:47 +02:00
Kseniia Sumarokova
745673181e
Merge pull request #54985 from kssenii/add-assertion-in-desctructor 
Add assertion
 2023-09-26 12:24:03 +02:00
Robert Schulze
9fff447716
Re-enable clang-tidy checks 2023-09-26 09:34:12 +00:00
VanDarkholme7
9d74502488
Merge branch 'ClickHouse:master' into missing_subcolumns 2023-09-26 13:48:16 +08:00
kssenii
d368dda185 Remove incorrect assertion 2023-09-25 23:14:15 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
0c490465d4
Stabilize tests 2023-09-25 17:07:48 +00:00
kssenii
59068ec59d Add assertion 2023-09-25 13:34:47 +02:00
Alexey Milovidov
580f3c1a01 Merge branch 'master' into remove-current-status 2023-09-24 20:56:17 +02:00
Alexey Milovidov
7bef66ae6a
Merge pull request #54436 from azat/prewhere-filter-fix 
Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL
 2023-09-24 20:05:06 +03:00
robot-clickhouse-ci-2
f51cf202e3
Merge pull request #54240 from wangtZJU/fix_multi_join_rewrite 
fix name clash for multiple join rewriter v2
 2023-09-23 21:35:46 +02:00
robot-ch-test-poll4
9d61ed4665
Merge pull request #54664 from bigo-sg/arrow_join_max_block_size 
Respect max_block_size for array join to avoid possible OOM
 2023-09-23 21:30:51 +02:00
Azat Khuzhin
24c0d53df7 Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL 
In case of FINAL the result of the expression for PREWHERE can be
changed after applying merge algorithm, and this is the problem for
SimpleAggregateFunction since after applying merging algorithm the value
can be changed.

Note, analyzer does not has this bug because it simply does not reuse
columns from PREWHERE (they does not passed via
GlobalPlannerContext::createColumnIdentifier())

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: update tests references (see https://s3.amazonaws.com/clickhouse-test-reports/54436/baaa688f40fcd064952f62dc8c62ddc752dd0046/fast_test.html)
v3: allow reusing expression from PREWHERE w/o FINAL and revert tests references changes
 2023-09-23 20:55:06 +02:00
robot-ch-test-poll2
4f037c2504
Merge pull request #54928 from arenadata/ADQM-1230 
Fix data race during BackupsWorker::backup_log initialization
 2023-09-23 04:56:12 +02:00
robot-clickhouse-ci-2
d98234dc9d
Merge pull request #54803 from Avogar/ephemeral-columns-from-files 
Forbid special columns for file/s3/url/... storages, fix insert into ephemeral columns from files
 2023-09-22 23:24:42 +02:00
Alexander Tokmakov
21ffbd88de
Merge pull request #54859 from ClickHouse/fix_zero_copy_locks 
Fix zero copy locks with hardlinks
 2023-09-22 18:27:03 +02:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Vitaly Baranov
3a2ca1f69c
Merge pull request #51261 from evillique/users-valid-until 
Add VALID UNTIL clause for users
 2023-09-22 12:38:30 +02:00
Victor Krasnov
fea886907d Fix data race during backup_log initialization 2023-09-22 09:54:33 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Robert Schulze
f5137dd0b4
More clang-tidy fixes 2023-09-21 14:40:57 +00:00
Pavel Novitskiy
853e3f0aa7
Add drop table IF EMPTY (#48915) 2023-09-21 09:20:18 -04:00
Igor Nikonov
d260b7abe4
Merge pull request #54519 from ClickHouse/parallel-replicas-not-enough-replicas 
Disable parallel replicas on shards with not enough nodes
 2023-09-21 14:07:25 +02:00
wangtao.2077
d80de4ff3a fix name clash for multi join rewrit 2023-09-21 16:33:52 +08:00
Robert Schulze
50c51c2854
Fix new clang-tidy-s 2023-09-20 22:17:39 +00:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
avogar
3e08800cb5 Forbid special columns for file/s3/url/... storages, fix insert into ephemeral columns from files 2023-09-20 16:25:55 +00:00
Antonio Andelic
b65b1ee97b Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-20 13:56:36 +00:00
Igor Nikonov
c9bf365767 Polishing 2023-09-20 13:47:11 +00:00
Igor Nikonov
4808c34f3b Fix log message 2023-09-20 13:45:54 +00:00
Alexander Tokmakov
2ba9263098
Merge pull request #54840 from ClickHouse/revert-54791-hanfei/duplicate_index 
Revert "refine error code of duplicated index in create query"
 2023-09-20 15:44:12 +02:00
Igor Nikonov
2d446fc1ca Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-20 13:40:08 +00:00
Robert Schulze
5729871605
Merge remote-tracking branch 'rschu1ze/master' into qc-throw 2023-09-20 13:25:51 +00:00
Alexander Tokmakov
06513f60eb
Revert "refine error code of duplicated index in create query" 2023-09-20 15:16:39 +02:00
Duc Canh Le
3646c9fa58 caching skip-able entries in DDLWorker 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-09-20 10:57:12 +00:00
Nikolai Kochetov
0bc41bab74
Merge pull request #54544 from kitaisreal/key-condition-in-function-different-types 
KeyCondition IN function support different types
 2023-09-20 12:54:01 +02:00
robot-clickhouse
428a689196
Merge pull request #54810 from ClickHouse/imp-invalid-identifier 
Use appropriate error code instead of LOGICAL_ERROR
 2023-09-20 12:32:00 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532) 
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
 2023-09-20 11:31:12 +02:00
凌涛
9e3c54ddb9 add function getHttpHeader 2023-09-20 10:07:02 +08:00
Yakov Olkhovskiy
e8cd429453 add error code INVALID_IDENTIFIER 2023-09-19 22:11:58 +00:00
Igor Nikonov
e28f4e819c
Merge branch 'master' into parallel-replicas-not-enough-replicas 2023-09-19 23:05:24 +02:00
Igor Nikonov
3b4ff5a3d0
Merge branch 'master' into pr-distributed-prefer-localhost-replica 2023-09-19 23:01:30 +02:00
Robert Schulze
a15029ecb5
Query Cache: Reject queries with non-deterministic functions by default 
https://github.com/ClickHouse/support-escalation/issues/963
 2023-09-19 16:41:43 +00:00
Han Fei
003f5f77eb refine error code of duplicated index in create query 2023-09-19 15:01:28 +02:00
Kruglov Pavel
e163670357
Merge branch 'master' into http-valid-json-on-exception 2023-09-19 13:42:53 +02:00
VanDarkholme7
db6e67073e fix 2023-09-19 12:50:15 +08:00
VanDarkholme7
783b48b730
Merge branch 'ClickHouse:master' into missing_subcolumns 2023-09-19 10:33:06 +08:00
VanDarkholme7
78660eb859 Replace missed Object(Nullable(json)) subcolumns 2023-09-19 09:55:45 +08:00
Igor Nikonov
572249a60c
Merge branch 'master' into pr-distributed-prefer-localhost-replica 2023-09-18 21:48:21 +02:00
Kruglov Pavel
3aaaf7600c
Merge pull request #54655 from Avogar/fix-use-structure-from-insertion-table 
Fix using structure from insertion tables in case of defaults and explicit insert columns
 2023-09-18 18:54:28 +02:00
Igor Nikonov
081fa19a97
Merge branch 'master' into pr-distributed-prefer-localhost-replica 2023-09-18 18:30:49 +02:00
Igor Nikonov
047d214436 Merge remote-tracking branch 'origin/master' into parallel-replicas-not-enough-replicas 2023-09-18 15:29:56 +00:00
Igor Nikonov
c285f85cad Fix: correct check if all shards have only 1 node 2023-09-18 14:43:10 +00:00
Antonio Andelic
69333912d5 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-18 10:57:11 +00:00
Kruglov Pavel
9c888ea42b
Merge pull request #53549 from Avogar/group-by-constant-keys 
Optimize group by constant keys
 2023-09-18 12:12:40 +02:00
taiyang-li
39ca44b51a Respect max_block_size for array join to avoid possible OOM 2023-09-18 11:04:38 +08:00
Igor Nikonov
fae229e3ea Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-17 21:03:56 +00:00
Igor Nikonov
a138d8a376 Use index to access shard addresses 2023-09-17 21:03:14 +00:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st 
Remove broken lockless variant of re2
 2023-09-17 15:30:57 +02:00
avogar
a075d03f01 Fix 2023-09-15 14:28:25 +00:00
Maksim Kita
60a63212c8 Fixed tests 2023-09-15 17:04:24 +03:00
Kruglov Pavel
2075f9c667
Merge branch 'master' into group-by-constant-keys 2023-09-15 15:10:08 +02:00
Kruglov Pavel
dbd24b240c
Merge branch 'master' into http-valid-json-on-exception 2023-09-15 14:55:31 +02:00
vdimir
404ea84dc5
Handle case when clone resized block comsumes more memory, try to fix it for ColumnVector 2023-09-15 10:30:06 +00:00
avogar
7cfdd88ccf Address comments 2023-09-15 09:32:41 +00:00
vdimir
01ee24eefa
fix 2023-09-15 09:03:09 +00:00
vdimir
40d42f4123
hash join use memory tracker delta to decide on shrink to fit 2023-09-15 09:03:08 +00:00
Alexey Milovidov
5a47803a80
Update HashJoin.h 2023-09-15 09:03:08 +00:00
vdimir
ac3c12e8b2
Shrink blocks in HashJoin on consuming half of maximum memory 2023-09-15 09:03:07 +00:00
yur3k
f6c4fba890
Made shrinkToFit interface mutable. Improved shrinkToFit implementation. 2023-09-15 09:03:07 +00:00
yur3k
e2ce8ed9aa
Added shrinkToFit methods to IColumn and Block. shrinkToFit now used unconditionally in HashJoin. 2023-09-15 09:03:06 +00:00
avogar
b9c28ef1f7 Fix for analyzer 2023-09-14 20:10:07 +00:00
avogar
93c49dfeaa Fix using structure from insertion tables in case of defaults and explicit insert columns 2023-09-14 19:31:12 +00:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
slvrtrn
c0961d9378 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-13 19:33:11 +02:00
Alexey Milovidov
bd4aec0601
Revert "Optimize uniq to count" 2023-09-13 09:14:06 +03:00
Nikolay Degterinsky
268c45d900 Merge remote-tracking branch 'upstream/master' into users-valid-until 2023-09-12 23:44:22 +00:00
Igor Nikonov
7b3f32b95a
Merge pull request #54520 from ClickHouse/pr-cleanup 
Parallel replicas: cleanup unused params
 2023-09-12 19:48:18 +02:00
slvrtrn
28e2ebf9db Merge remote-tracking branch 'refs/remotes/origin/simplified-prepared-statements-for-mysql' into simplified-prepared-statements-for-mysql 2023-09-12 18:41:36 +02:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
robot-clickhouse
1c8ee76ba2
Merge pull request #54513 from Avogar/formats-with-names-no-header 
Fix possible parsing error in WithNames formats with disabled input_format_with_names_use_header
 2023-09-12 17:58:03 +02:00
Dmitry Novik
7edc0a30a3
Merge pull request #54335 from arenadata/ADQM-1109 
Added peak_threads_usage to query_log table
 2023-09-12 16:03:27 +02:00
Igor Nikonov
1287f68745 Handle clusterAllReplicas/remote cases to avoid unnecessary logging 2023-09-12 12:52:29 +00:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Alexey Gerasimchuck
60c9dd226d
Update src/Interpreters/QueryLog.h 
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
 2023-09-12 10:10:05 +10:00
Igor Nikonov
d5ea047ab8 Parallel replicas: cleanup unused params 2023-09-11 21:52:40 +00:00
Igor Nikonov
2293923f66 Disable parallel replicas on shards with not enough nodes 2023-09-11 21:46:46 +00:00
avogar
2d8f33bfa2 Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header 2023-09-11 14:55:37 +00:00
Nikolai Kochetov
59108f3d96
Merge pull request #54476 from ClickHouse/revert-54470-revert-48607-master 
Revert "Revert "Add settings for real-time updates during query execution""
 2023-09-11 14:59:13 +02:00
Igor Nikonov
1785e1c00c Fix build: remove unused variables 2023-09-11 12:30:55 +00:00
Igor Nikonov
918bd814bd Add canUseParallelReplicas() for convenience 2023-09-11 12:19:07 +00:00
Igor Nikonov
f3f3eddd52 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-11 12:13:45 +00:00
Kruglov Pavel
21a2cf7707
Merge pull request #54337 from wat-ze-hex/show-functions-2023-09-04 
Add SHOW FUNCTIONS support to client
 2023-09-11 13:03:02 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00