Commit Graph

11399 Commits

Author SHA1 Message Date
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
2023-10-25 22:20:28 +02:00
Maksim Kita
901294d352 Fixed code review issues 2023-10-25 21:41:26 +03:00
Alexander Tokmakov
0f4260bf26 fix some bad code by making it worse 2023-10-25 19:51:51 +02:00
Maksim Kita
82d4d52b06 Add SHOW SETTING query 2023-10-25 18:49:00 +03:00
flynn
229762e4c1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-union-distinct 2023-10-25 13:10:56 +00:00
Raúl Marín
6068277af9
Merge pull request #55815 from jetgm/master
Add SHOW MERGES
2023-10-25 11:44:30 +02:00
Robert Schulze
665dfe6135
Merge pull request #55278 from kitaisreal/context-added-tsa
Context added TSA
2023-10-25 10:41:00 +02:00
Raúl Marín
bee9eb5df4
Merge pull request #55962 from Algunenano/show_databases_limit
Fix `SHOW DATABASES LIMIT <N>`
2023-10-25 10:27:43 +02:00
jetgm
ca766e3033 update doc and change order by 2023-10-25 11:08:25 +08:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330)
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
2023-10-24 12:08:17 -07:00
Maksim Kita
0e176fa0ed Fixed code review issues 2023-10-24 19:39:25 +03:00
Robert Schulze
1375733643
Merge pull request #55955 from rschu1ze/test-bug-43644
Test for Bug 43644
2023-10-24 16:16:52 +02:00
Kruglov Pavel
62b154930a
Merge pull request #53504 from filimonov/ignore_max_distributed_connections_for_async_remote
Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1
2023-10-24 14:15:21 +02:00
Robert Schulze
38a2ba5769
Cosmetics 2023-10-24 09:53:20 +00:00
Raúl Marín
70adb4ca17 Fix SHOW DATABASES LIMIT <N> 2023-10-24 11:42:20 +02:00
Robert Schulze
b361b8e3e3
Merge remote-tracking branch 'rschu1ze/master' into test-bug-43644 2023-10-24 08:53:10 +00:00
Robert Schulze
db1cca592e
Test for Bug 43644 2023-10-23 20:47:58 +00:00
Kseniia Sumarokova
699de2317a
Merge pull request #55863 from jrdi/describe-load-metadata-threads
Add load_metadata_threads to describe filesystem cache
2023-10-23 21:40:52 +02:00
vdimir
643fef589d
Revert "[remove before merging] Shuffle CHECK TABLE results"
This reverts commit 8bb2378952.
2023-10-23 12:33:36 +00:00
Duc Canh Le
5923e1b116
Cache cast function in set during execution (#55712)
* Cache cast function in set during execution

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* minor fix for performance test

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* Update src/Interpreters/castColumn.cpp

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* improvement

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* fix use-after-free

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

---------

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
2023-10-23 13:31:44 +02:00
vdimir
8bb2378952
[remove before merging] Shuffle CHECK TABLE results 2023-10-23 10:56:06 +00:00
vdimir
3332f70275
upd 2023-10-23 10:56:06 +00:00
vdimir
d254c4e4a0
Do no check ast in InterpreterCheckQuery to use max_threads 2023-10-23 10:13:26 +00:00
vdimir
8f0d7954ff
IStorage::checkDataNext returns optional 2023-10-23 10:12:30 +00:00
vdimir
9d840c6532
Use single thread for check table with check_query_single_value_result=0 2023-10-23 09:36:41 +00:00
vdimir
fe95c0d0e4
Improve CHECK TABLE system query
Resubmit PR #52745
2023-10-23 09:35:26 +00:00
Maksim Kita
d363e062f1 Updated implementation 2023-10-23 12:00:29 +03:00
Maksim Kita
ba37880208 Context added TSA 2023-10-23 12:00:29 +03:00
Jordi Villar
839c05e3b8 Add load_metadata_threads to describe filesystem cache 2023-10-23 09:01:12 +02:00
jetgm
6fbc5277b6 improve query 2023-10-23 09:56:19 +08:00
flynn
b42c633706 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-union-distinct 2023-10-22 16:00:12 +00:00
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
Alexey Milovidov
3d0631a37d
Merge pull request #55871 from Algunenano/predicate_pushdown
Disable predicate pushdown if the CTE contains stateful functions
2023-10-21 01:36:24 +02:00
Aleksei Filatov
0a1f3f205c
Add external HTTP Basic authenticator (#55199) 2023-10-20 19:24:19 +02:00
Anton Popov
5819bcd07a
Support asynchronous inserts for native protocol (#54730)
* support async insert for native protocol

* use separate queue for async inserts via native protocol

* fix test

* better logging for async inserts and more tests

* disable mixed internal and external data in async inserts

* fix tests

* fix quota in async inserts

* disable async insert for secondary query of distributed
2023-10-20 18:39:48 +02:00
flynn
fda36deec3 Fix normalize ASTSelectWithUnionQuery strip FORMAT of the query 2023-10-20 16:33:21 +00:00
Raúl Marín
c690a3af8b Disable predicate pushdown if the CTE contains stateful functions 2023-10-20 15:04:42 +02:00
Raúl Marín
4a53943926 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-19 15:20:50 +00:00
Raúl Marín
3873a935f4
Merge pull request #55739 from Algunenano/use_default_format_on_http_exception
Respect default format when using http_write_exception_in_output_format
2023-10-19 13:47:36 +02:00
jetgm
bde5c5a4a8 add show merges 2023-10-19 18:17:28 +08:00
Robert Schulze
8b1e7a1ea1
Merge pull request #55771 from zhongyuankai/only_cache_initial_query
Query Cache: Only cache initial query
2023-10-18 22:55:52 +02:00
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes
Fixes for storage `S3Queue`
2023-10-18 21:51:51 +02:00
zhongyuankai
d73afed7d5 fix style 2023-10-18 23:09:38 +08:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
2023-10-18 10:57:18 +02:00
huzhicheng
0b52d29cd8 Query Cache: Only cache initial query 2023-10-18 16:56:17 +08:00
Amos Bird
602f01f651
Reuse granule during skip index reading 2023-10-18 14:40:34 +08:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
vdimir
b5693d3fa6
Merge pull request #55602 from ClickHouse/vdimir/fix_cyclic_aliases_crash
Fix crash in QueryNormalizer with cyclic aliases
2023-10-17 16:31:37 +02:00
Raúl Marín
b4a4c1e02e Only change headers if necessary 2023-10-17 16:02:06 +02:00
Raúl Marín
e500dc22e4 Respect default format when using http_write_exception_in_output_format 2023-10-17 14:14:58 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows
Inverted index: Replace setting density with `max_rows_in_postings_list`
2023-10-17 11:36:46 +02:00
Raúl Marín
3eaf752284 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-17 11:36:39 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
robot-ch-test-poll1
aca98cf725
Merge pull request #53774 from helifu/master13
Display reloaded values of server settings
2023-10-16 21:17:17 +02:00
Antonio Andelic
55b8b1440d Allow FINAL with parallel replicas with custom key 2023-10-16 14:04:05 +00:00
Raúl Marín
f799f5d7a1 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-16 15:07:11 +02:00
vdimir
d7c77420b6
QueryNormalizer only checks stack size 2023-10-16 10:33:04 +00:00
Kseniia Sumarokova
a4bd6891e1
Merge pull request #55164 from ClickHouse/vdimir/fix_file_cache_tmp_write_buffer
Fix file cache temporary file segment range in FileSegment::reserve
2023-10-16 11:44:46 +02:00
alesapin
697c1e3bb0
Merge pull request #55604 from ClickHouse/evillique-partition-parameters
Implement query paramenters support in partition expression
2023-10-16 10:26:02 +02:00
Antonio Andelic
b6b92f46cc
Merge pull request #55541 from ClickHouse/sample-segfault
Better exception messages but without SEGFAULT
2023-10-16 08:43:52 +02:00
alesapin
3b02748cb6 Fix some typos 2023-10-15 15:43:02 +02:00
Alexey Milovidov
50ee412b19
Merge pull request #55625 from ClickHouse/preparation-key-condition
KeyCondition: preparation
2023-10-14 22:13:39 +02:00
Alexey Milovidov
0a3e431c87 Additional changes 2023-10-14 04:50:30 +02:00
Alexey Milovidov
6d8f28aad0 Merge branch 'master' into better-depth-check 2023-10-14 01:48:59 +02:00
slvrtrn
447631976e Add MySQL String BLOB vs TEXT configuration 2023-10-13 20:36:14 +02:00
HarryLeeIBM
25545d504d Replace setting density to max_rows_in postings_list for full text search 2023-10-13 10:31:21 -07:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups"
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
2023-10-13 18:55:51 +02:00
Mikhail f. Shiryaev
e816ec7d6a
Merge branch 'master' into vdimir/fix_file_cache_tmp_write_buffer 2023-10-13 18:15:52 +02:00
Alexander Tokmakov
f95b0eb553
Merge pull request #54828 from canhld94/ddl_worker_host_cache
Caching skip-able entries in DDLWorker
2023-10-13 17:34:15 +02:00
alesapin
47d48d81e0 Implement feature 2023-10-13 16:22:18 +02:00
vdimir
ba5cd016dd
Fix crash in QueryNormalizer with cyclic aliases 2023-10-13 14:03:36 +00:00
Raúl Marín
c5bd29792a Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 15:05:47 +02:00
Antonio Andelic
a83ebb1862 Merge branch 'master' into sample-segfault 2023-10-13 12:53:32 +00:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
bfe174f71b Fix test 2023-10-13 12:57:57 +02:00
vdimir
e64abfc557
Merge pull request #49555 from ClickHouse/vdimir/analyzer_fix_join_tests
Fixing join tests with analyzer
2023-10-13 12:29:58 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Raúl Marín
500dab9569 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 10:12:57 +02:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups
Add replica groups to Replicated database engine
2023-10-12 18:14:42 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
Antonio Andelic
470c858f21
Update src/Interpreters/InterpreterSelectQuery.cpp 2023-10-12 16:06:00 +02:00
vdimir
3aac663bd2
fix 2023-10-12 10:46:58 +00:00
vdimir
dcdcdc5a86
fix style check 2023-10-12 10:45:57 +00:00
vdimir
94fa777b8d
Fix 01890_materialized_distributed_join
Function getHeaderForProcessingStage handle join on top of query tree
2023-10-12 10:45:57 +00:00
Antonio Andelic
5d5d4a8443 Check if storage is nullptr 2023-10-12 09:50:04 +00:00
robot-clickhouse-ci-1
c40a79f0b4
Merge pull request #54813 from lingtaolf/feature/function-getClientHttpHeader
Add function getHttpHeader
2023-10-12 10:13:20 +02:00
Robert Schulze
7b14392675
Merge pull request #55481 from rschu1ze/better-use-mysql-types-in-show-columns
Make `use_mysql_types_in_show_columns` affect only `SHOW COLUMNS`
2023-10-12 00:36:46 +02:00
Robert Schulze
db75a41d10
+ comment 2023-10-11 15:50:13 +00:00
Robert Schulze
a7c7a25e0f
Fix a leftover 2023-10-11 15:49:16 +00:00
Igor Nikonov
62060a0603 Merge remote-tracking branch 'origin/master' into pr-coordinator-usage-cleanup 2023-10-11 15:11:15 +00:00
Igor Nikonov
9d95f4e1b6 Cleanup: parallel replica coordinator usage 2023-10-11 15:04:59 +00:00
Robert Schulze
9d04d3c3ad
Merge remote-tracking branch 'rschu1ze/master' into better-use-mysql-types-in-show-columns 2023-10-11 15:04:03 +00:00
robot-ch-test-poll1
80aa9cad51
Merge pull request #55479 from slvrtrn/fix-mysql-datetime-incompatibilities
Fix MySQL text protocol DateTime formatting and LowCardinality(Nullable(T)) types reporting
2023-10-11 16:56:26 +02:00
Raúl Marín
0b9bd809e7 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-11 16:50:22 +02:00
Robert Schulze
9741e7b175
Fix style 2023-10-11 14:32:42 +00:00
robot-clickhouse-ci-2
1a601759e4
Merge pull request #55467 from ClickHouse/revert-54840-revert-54791-hanfei/duplicate_index
Revert "Revert "refine error code of duplicated index in create query""
2023-10-11 16:22:27 +02:00
Yakov Olkhovskiy
0738984edf
Merge pull request #42510 from ClibMouse/Kusto-phase2-oss-pr
Support Kusto Query Language dialect - phase 2
2023-10-11 08:35:26 -04:00
Robert Schulze
380ba7c9e5
Rewrite to avoid CYCLIC_ALIAS errors 2023-10-11 12:11:44 +00:00
凌涛
21afc422dd Merge branch 'master' into feature/function-getClientHttpHeader 2023-10-11 12:01:25 +08:00