Commit Graph

11399 Commits

Author SHA1 Message Date
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
Raúl Marín
3eaf752284 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-17 11:36:39 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
robot-ch-test-poll1
aca98cf725
Merge pull request #53774 from helifu/master13
Display reloaded values of server settings
2023-10-16 21:17:17 +02:00
Antonio Andelic
55b8b1440d Allow FINAL with parallel replicas with custom key 2023-10-16 14:04:05 +00:00
Raúl Marín
f799f5d7a1 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-16 15:07:11 +02:00
vdimir
d7c77420b6
QueryNormalizer only checks stack size 2023-10-16 10:33:04 +00:00
Kseniia Sumarokova
a4bd6891e1
Merge pull request #55164 from ClickHouse/vdimir/fix_file_cache_tmp_write_buffer
Fix file cache temporary file segment range in FileSegment::reserve
2023-10-16 11:44:46 +02:00
alesapin
697c1e3bb0
Merge pull request #55604 from ClickHouse/evillique-partition-parameters
Implement query paramenters support in partition expression
2023-10-16 10:26:02 +02:00
Antonio Andelic
b6b92f46cc
Merge pull request #55541 from ClickHouse/sample-segfault
Better exception messages but without SEGFAULT
2023-10-16 08:43:52 +02:00
alesapin
3b02748cb6 Fix some typos 2023-10-15 15:43:02 +02:00
Alexey Milovidov
50ee412b19
Merge pull request #55625 from ClickHouse/preparation-key-condition
KeyCondition: preparation
2023-10-14 22:13:39 +02:00
Alexey Milovidov
0a3e431c87 Additional changes 2023-10-14 04:50:30 +02:00
Alexey Milovidov
6d8f28aad0 Merge branch 'master' into better-depth-check 2023-10-14 01:48:59 +02:00
slvrtrn
447631976e Add MySQL String BLOB vs TEXT configuration 2023-10-13 20:36:14 +02:00
HarryLeeIBM
25545d504d Replace setting density to max_rows_in postings_list for full text search 2023-10-13 10:31:21 -07:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups"
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
2023-10-13 18:55:51 +02:00
Mikhail f. Shiryaev
e816ec7d6a
Merge branch 'master' into vdimir/fix_file_cache_tmp_write_buffer 2023-10-13 18:15:52 +02:00
Alexander Tokmakov
f95b0eb553
Merge pull request #54828 from canhld94/ddl_worker_host_cache
Caching skip-able entries in DDLWorker
2023-10-13 17:34:15 +02:00
alesapin
47d48d81e0 Implement feature 2023-10-13 16:22:18 +02:00
vdimir
ba5cd016dd
Fix crash in QueryNormalizer with cyclic aliases 2023-10-13 14:03:36 +00:00
Raúl Marín
c5bd29792a Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 15:05:47 +02:00
Antonio Andelic
a83ebb1862 Merge branch 'master' into sample-segfault 2023-10-13 12:53:32 +00:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
bfe174f71b Fix test 2023-10-13 12:57:57 +02:00
vdimir
e64abfc557
Merge pull request #49555 from ClickHouse/vdimir/analyzer_fix_join_tests
Fixing join tests with analyzer
2023-10-13 12:29:58 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Raúl Marín
500dab9569 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 10:12:57 +02:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups
Add replica groups to Replicated database engine
2023-10-12 18:14:42 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
Antonio Andelic
470c858f21
Update src/Interpreters/InterpreterSelectQuery.cpp 2023-10-12 16:06:00 +02:00
vdimir
3aac663bd2
fix 2023-10-12 10:46:58 +00:00
vdimir
dcdcdc5a86
fix style check 2023-10-12 10:45:57 +00:00
vdimir
94fa777b8d
Fix 01890_materialized_distributed_join
Function getHeaderForProcessingStage handle join on top of query tree
2023-10-12 10:45:57 +00:00
Antonio Andelic
5d5d4a8443 Check if storage is nullptr 2023-10-12 09:50:04 +00:00
robot-clickhouse-ci-1
c40a79f0b4
Merge pull request #54813 from lingtaolf/feature/function-getClientHttpHeader
Add function getHttpHeader
2023-10-12 10:13:20 +02:00
Robert Schulze
7b14392675
Merge pull request #55481 from rschu1ze/better-use-mysql-types-in-show-columns
Make `use_mysql_types_in_show_columns` affect only `SHOW COLUMNS`
2023-10-12 00:36:46 +02:00
Robert Schulze
db75a41d10
+ comment 2023-10-11 15:50:13 +00:00
Robert Schulze
a7c7a25e0f
Fix a leftover 2023-10-11 15:49:16 +00:00
Igor Nikonov
62060a0603 Merge remote-tracking branch 'origin/master' into pr-coordinator-usage-cleanup 2023-10-11 15:11:15 +00:00
Igor Nikonov
9d95f4e1b6 Cleanup: parallel replica coordinator usage 2023-10-11 15:04:59 +00:00
Robert Schulze
9d04d3c3ad
Merge remote-tracking branch 'rschu1ze/master' into better-use-mysql-types-in-show-columns 2023-10-11 15:04:03 +00:00
robot-ch-test-poll1
80aa9cad51
Merge pull request #55479 from slvrtrn/fix-mysql-datetime-incompatibilities
Fix MySQL text protocol DateTime formatting and LowCardinality(Nullable(T)) types reporting
2023-10-11 16:56:26 +02:00
Raúl Marín
0b9bd809e7 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-11 16:50:22 +02:00
Robert Schulze
9741e7b175
Fix style 2023-10-11 14:32:42 +00:00
robot-clickhouse-ci-2
1a601759e4
Merge pull request #55467 from ClickHouse/revert-54840-revert-54791-hanfei/duplicate_index
Revert "Revert "refine error code of duplicated index in create query""
2023-10-11 16:22:27 +02:00
Yakov Olkhovskiy
0738984edf
Merge pull request #42510 from ClibMouse/Kusto-phase2-oss-pr
Support Kusto Query Language dialect - phase 2
2023-10-11 08:35:26 -04:00
Robert Schulze
380ba7c9e5
Rewrite to avoid CYCLIC_ALIAS errors 2023-10-11 12:11:44 +00:00
凌涛
21afc422dd Merge branch 'master' into feature/function-getClientHttpHeader 2023-10-11 12:01:25 +08:00
Robert Schulze
bd43b84bf8
Make use_mysql_types_in_show_columns affect only SHOW COLUMNS 2023-10-10 23:09:49 +00:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
2023-10-10 19:51:09 +02:00
Raúl Marín
95d2063e91 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-10 17:29:45 +02:00
Nikita Mikhaylov
4456fe40f9
Remove the old code for projection analysis (#55112) 2023-10-10 17:13:32 +02:00
Han Fei
bb204ed0bd refine exception messages 2023-10-10 15:46:52 +02:00
Han Fei
3757bcf2cf
Revert "Revert "refine error code of duplicated index in create query"" 2023-10-10 15:44:15 +02:00
Kruglov Pavel
5ded0005a3
Merge pull request #55064 from AVMusorin/system-drop-format-cache
Allow drop cache for Protobuf format
2023-10-10 14:23:11 +02:00
helifu
ca0c4ba147
Merge branch 'ClickHouse:master' into master13 2023-10-10 13:49:49 +08:00
凌涛
51e2e59a97 Merge remote-tracking branch 'origin/master' into feature/function-getClientHttpHeader 2023-10-10 10:56:24 +08:00
Alexey Milovidov
0094be5d43
Merge pull request #55352 from kitaisreal/context-locks-small-fixes
Context locks small fixes
2023-10-09 21:50:59 +02:00
Anton Popov
26a938c8cf
Merge pull request #55202 from canhld94/clickhouse_fix_too_many_marks
Fix recalculation of skip indexes in ALTER UPDATE queries when table has adaptive granularity
2023-10-09 19:24:59 +02:00
Maksim Kita
5d5db60aed Fixed code review issues 2023-10-09 13:23:16 +03:00
Aleksandr Musorin
8d0c961af0 Allow drop cache for protobuf format
Before it was impossible to update Protobuf schema without server
restart. With this commit, it is enough to send query `SYSTEM DROP
SCHEMA FORMAT CACHE [FOR Protobuf]`.
2023-10-09 10:41:15 +02:00
Alexey Milovidov
b619d07baf
Merge pull request #55353 from ClickHouse/fix-garbage-2
Fix trash optimization (up to a certain extent)
2023-10-09 02:42:56 +02:00
Alexey Milovidov
b6d4ae51c6 Better recursion depth check 2023-10-09 02:40:47 +02:00
Alexey Milovidov
2aaddcce18 Better exception messages 2023-10-08 22:54:33 +02:00
Alexey Milovidov
ca7bf062e0 Fix garbage 2023-10-08 21:53:26 +02:00
Robert Schulze
d4e7fa2542
Merge pull request #55123 from garcher22/untuple
Use the tuple element names as column names in `untuple()`
2023-10-08 20:14:29 +02:00
Maksim Kita
f0643a2311 Context locks small fixes 2023-10-08 19:55:45 +03:00
Robert Schulze
8c35ccf9e8
Some fixups 2023-10-08 10:29:46 +00:00
Kseniia Sumarokova
20868f3b65
Merge pull request #55252 from kssenii/fix-background-download-in-cache
Fix for background download in fs cache
2023-10-08 10:38:23 +02:00
robot-ch-test-poll1
59a3b3356f
Merge pull request #55296 from rschu1ze/qc-better-logging
Improve logging in query cache
2023-10-07 17:59:19 +02:00
kssenii
1a839adec7 Add one more try-catch 2023-10-07 15:31:15 +02:00
Robert Schulze
a72ae92328
Make the logging in the query cache easier to understand 2023-10-07 11:33:11 +00:00
alesapin
e55a615f06
Merge pull request #55253 from vitlibar/fix-async-insert-access-check-for-defaults
Evaluate defaults during async insert safer
2023-10-07 12:26:35 +02:00
kssenii
289020f454 Merge remote-tracking branch 'upstream/master' into fix-background-download-in-cache 2023-10-07 12:19:33 +02:00
JackyWoo
d23d976f57 Merge branch 'master' into optimize_uniq_to_count2 2023-10-07 09:04:57 +08:00
kssenii
9df0b8f67c Fix 2023-10-06 12:41:37 +02:00
Duc Canh Le
bea4a4eb85 Merge branch 'master' into clickhouse_fix_too_many_marks
rebase and re-trigger CI
2023-10-06 09:45:48 +00:00
Vitaly Baranov
cf7eea569b Fix quota consumption 2023-10-05 15:46:36 +02:00
Kseniia Sumarokova
68a3cd57a1
Fix data race in context 2023-10-05 15:29:56 +02:00
vdimir
406dfe277c
fix style 2023-10-05 11:58:00 +02:00
Vitaly Baranov
a54d3f31e4 Add new fields to InsertQuery::hash and operator == 2023-10-05 11:03:05 +02:00
kssenii
c57a92f5fc Better 2023-10-05 10:50:57 +02:00
Vitaly Baranov
76766a200e Fix access checking in evaluations of defaults during async insert. 2023-10-05 10:26:44 +02:00
Duc Canh Le
ae417ef39c adding comments
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-05 07:49:17 +00:00
kssenii
d13588e130 Fix 2023-10-05 09:41:17 +02:00
Nikolai Kochetov
d944b59902 Merge branch 'master' into planner-prepare-filters-for-analysis-2 2023-10-03 14:28:16 +00:00
Nikolai Kochetov
3b757d60a2 Remove commented code. 2023-10-03 14:22:20 +00:00
Nikolai Kochetov
b67a0fe344
Merge pull request #55121 from kitaisreal/context-lock-contention-fix
Context lock contention fix
2023-10-03 11:17:59 +02:00
robot-ch-test-poll
e06f72ee55
Merge pull request #54052 from VanDarkholme7/missing_subcolumns
Support missed Object(Nullable(json)) subcolumns in query.
2023-10-03 10:32:51 +02:00
Duc Canh Le
a09c53233b only rebuild indexes when index granularity changes
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-03 01:27:45 +00:00
vdimir
8b119f03cb
Merge branch 'master' into vdimir/fix_file_cache_tmp_write_buffer 2023-10-02 14:56:37 +02:00
Nikita Taranov
97e705325b
Optimise memory consumption when external group by generates ton of temporary files (#54798)
* impl

* fix

* fix test
2023-10-02 13:09:40 +02:00
Maksim Kita
71cb6457de Fixed code review issues 2023-10-02 13:53:17 +03:00
Duc Canh Le
0064d3637f rebuild indexes and projections when UPDATE compact parts with index_granularity_bytes > 0
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-02 07:36:57 +00:00
filimonov
bff832c7f0 Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1
See #53287
2023-10-02 08:34:46 +02:00
Gabriel Archer
00da4e01c0 tabs 2023-09-30 14:11:10 +02:00
Gabriel Archer
b89ff6ee6c tabs 2023-09-30 13:27:32 +02:00
Gabriel Archer
a6968a9a02 simpler 2023-09-30 13:14:09 +02:00
robot-ch-test-poll
f5542e1cad
Merge pull request #55129 from CurtizJ/describe-virtuals
Allow to include virtual columns into `DESCRIBE` query
2023-09-29 23:29:58 +02:00
vdimir
c64e5e282c
Fix file cache temporary file segment range in FileSegment::reserve 2023-09-29 17:49:58 +00:00
Anton Popov
9b0e222cd2 allow to include virtual columns into DESCRIBE query 2023-09-29 11:08:46 +00:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
Fix broken test
2023-09-29 11:13:31 +02:00
Gabriel
81cbe2a819 Use the tuple element names as column names in untuple() 2023-09-29 10:51:03 +02:00
Maksim Kita
07b9b5d7dd Context lock contention fix 2023-09-29 11:16:47 +03:00
avogar
e8ea41e2d4 Add setting to print pretty deep nested Tuples 2023-09-28 22:17:44 +00:00
Sema Checherinda
f73eef9ed8
Merge pull request #54697 from CheSema/s3_retry_cancelation_point
add cancelation point to s3 retries
2023-09-28 19:01:09 +02:00
kssenii
4a7922507b Minor changes 2023-09-28 16:18:00 +02:00
Sema Checherinda
a1afab5308 add comment 2023-09-28 12:50:11 +02:00
vdimir
ea1ab52f60
fix 2023-09-28 09:13:01 +00:00
vdimir
9b4cf43fe4
Store NULL in scalar result map for empty subquery result 2023-09-28 09:12:57 +00:00
Amos Bird
51f603bdfc
Rename as suggested. 2023-09-28 15:11:56 +08:00
Amos Bird
056b2693a3
Reorganize combinators into dedicated folder 2023-09-28 15:11:55 +08:00
Yong Wang
8c9da6bacf Merge remote-tracking branch 'origin/master' into Kusto-phase2-oss-pr 2023-09-27 22:35:14 -07:00
Alexey Milovidov
cc96a53c5a
Merge pull request #55053 from kssenii/update-unit-test
Update gtest_lru_file_cache.cpp
2023-09-28 02:40:42 +03:00
Sema Checherinda
31ea4052d0 cut the build dependency between commin_io and other libraries 2023-09-28 00:15:36 +02:00
Sema Checherinda
5fdca302e6 fix build, resolve process_list_elem race 2023-09-28 00:15:36 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
kssenii
42783894b7 Add comments 2023-09-27 20:07:19 +02:00
Robert Schulze
2d750e9e2f
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-27 12:15:29 +00:00
kssenii
3cbc1a3335 Update unit test 2023-09-27 11:57:47 +02:00
凌涛
0d256a381a add doc
fix tests

modify code stype and spelling

add tests and modify code style
2023-09-27 17:03:53 +08:00
JackyWoo
826f7ac7eb Merge branch 'master' into optimize_uniq_to_count2 2023-09-27 09:14:28 +08:00
JackyWoo
c40558a961 Fix uniq function name 2023-09-27 09:14:24 +08:00
robot-ch-test-poll4
9aab5f40ac
Merge pull request #55029 from kitaisreal/profile-events-context-lock-wait-microseconds
ProfileEvents added ContextLockWaitMicroseconds
2023-09-26 23:03:08 +02:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
Alexey Milovidov
29d3b34dfc
Merge pull request #54090 from ClickHouse/remove-current-status
Remove CurrentStatusInfo
2023-09-26 21:38:07 +03:00
Maksim Kita
eb1b3e6a3a ProfileEvents added ContextLockWaitMicroseconds 2023-09-26 19:08:22 +03:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109)
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
2023-09-26 17:50:19 +02:00
kssenii
14b09d3cdc Add caching 2023-09-26 16:23:24 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists
Implement `createIfNotExists` in Keeper natively
2023-09-26 16:04:51 +02:00
Kruglov Pavel
69a17bbef6
Merge pull request #52853 from Avogar/http-valid-json-on-exception
Output valid JSON/XML on excetpion during HTTP query execution
2023-09-26 14:25:55 +02:00
kssenii
7317ff3684 Fxi 2023-09-26 12:56:47 +02:00
Kseniia Sumarokova
745673181e
Merge pull request #54985 from kssenii/add-assertion-in-desctructor
Add assertion
2023-09-26 12:24:03 +02:00
Robert Schulze
9fff447716
Re-enable clang-tidy checks 2023-09-26 09:34:12 +00:00
VanDarkholme7
9d74502488
Merge branch 'ClickHouse:master' into missing_subcolumns 2023-09-26 13:48:16 +08:00
JackyWoo
d03bf3d53a use lower case 2023-09-26 09:33:51 +08:00
JackyWoo
b65f709e3b Merge branch 'master' into optimize_uniq_to_count2 2023-09-26 09:30:46 +08:00
kssenii
d368dda185 Remove incorrect assertion 2023-09-25 23:14:15 +02:00
kssenii
251b0165ca Better 2023-09-25 22:55:41 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Robert Schulze
0c490465d4
Stabilize tests 2023-09-25 17:07:48 +00:00
kssenii
59068ec59d Add assertion 2023-09-25 13:34:47 +02:00
JackyWoo
c4ae83bddc Merge branch 'master' into optimize_uniq_to_count2 2023-09-25 10:23:30 +08:00
Alexey Milovidov
580f3c1a01 Merge branch 'master' into remove-current-status 2023-09-24 20:56:17 +02:00
Alexey Milovidov
7bef66ae6a
Merge pull request #54436 from azat/prewhere-filter-fix
Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL
2023-09-24 20:05:06 +03:00
robot-clickhouse-ci-2
f51cf202e3
Merge pull request #54240 from wangtZJU/fix_multi_join_rewrite
fix name clash for multiple join rewriter v2
2023-09-23 21:35:46 +02:00
robot-ch-test-poll4
9d61ed4665
Merge pull request #54664 from bigo-sg/arrow_join_max_block_size
Respect max_block_size for array join to avoid possible OOM
2023-09-23 21:30:51 +02:00
Azat Khuzhin
24c0d53df7 Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL
In case of FINAL the result of the expression for PREWHERE can be
changed after applying merge algorithm, and this is the problem for
SimpleAggregateFunction since after applying merging algorithm the value
can be changed.

Note, analyzer does not has this bug because it simply does not reuse
columns from PREWHERE (they does not passed via
GlobalPlannerContext::createColumnIdentifier())

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: update tests references (see https://s3.amazonaws.com/clickhouse-test-reports/54436/baaa688f40fcd064952f62dc8c62ddc752dd0046/fast_test.html)
v3: allow reusing expression from PREWHERE w/o FINAL and revert tests references changes
2023-09-23 20:55:06 +02:00