Commit Graph

5313 Commits

Author SHA1 Message Date
Igor Nikonov
e1019ba3c4 Disabling parallel replicas per shard will be done separately 2023-09-18 15:27:55 +00:00
Kruglov Pavel
9c888ea42b
Merge pull request #53549 from Avogar/group-by-constant-keys
Optimize group by constant keys
2023-09-18 12:12:40 +02:00
taiyang-li
39ca44b51a Respect max_block_size for array join to avoid possible OOM 2023-09-18 11:04:38 +08:00
Robert Schulze
f5e8028bb1
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
2023-09-17 15:30:57 +02:00
Amos Bird
0518b64b58
Fix nullable primary key in final (#54164)
* Fix nullable primary key in final

* Real fix

* Address reviews
2023-09-15 22:44:13 +02:00
Smita Kulkarni
8ef910e1fa Updated to check if cleanup is enabled before adding to cleanedup_rows_count 2023-09-15 22:34:09 +02:00
Kruglov Pavel
2075f9c667
Merge branch 'master' into group-by-constant-keys 2023-09-15 15:10:08 +02:00
avogar
35d975bfea Add comment in ParallelInputFormat, remove unneded include 2023-09-15 13:07:04 +00:00
Kruglov Pavel
dbd24b240c
Merge branch 'master' into http-valid-json-on-exception 2023-09-15 14:55:31 +02:00
Sema Checherinda
45cf793544
Merge pull request #53919 from canhld94/optimize_all_lonely_parts
Do not implicitly read pk and version columns in lonely parts if unnecessary
2023-09-15 13:11:00 +02:00
Robert Schulze
7b378dbad3
Remove broken lockless variant of re2 2023-09-14 16:40:42 +00:00
Vitaly Baranov
9a0e1ef592 Fix sorting of UNION ALL of already sorted results. 2023-09-14 15:04:37 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql
Implement the MySQL binary protocol implementation for initial support of Tableau Online
2023-09-14 12:27:11 +02:00
slvrtrn
c0961d9378 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-13 19:33:11 +02:00
Sema Checherinda
8a9b544a97
Merge branch 'master' into optimize_all_lonely_parts 2023-09-13 16:07:19 +02:00
Arthur Passos
da8caeffd2 Merge branch 'master' into arrow_parquet_account_for_monotonically_increasing_offsets_across_batches 2023-09-12 17:50:36 -03:00
Igor Nikonov
7b3f32b95a
Merge pull request #54520 from ClickHouse/pr-cleanup
Parallel replicas: cleanup unused params
2023-09-12 19:48:18 +02:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
Anton Popov
3e242f8ba3
Merge pull request #54351 from Avogar/null-as-default-nested
Support NULL as default for nested types Array/Tuple/Map for input formats
2023-09-12 14:58:21 +02:00
Igor Nikonov
1287f68745 Handle clusterAllReplicas/remote cases to avoid unnecessary logging 2023-09-12 12:52:29 +00:00
robot-clickhouse
63243fbc03
Merge pull request #54480 from amosbird/fix_54406
Fix aggregate projections with normalized states
2023-09-12 13:43:41 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Igor Nikonov
d5ea047ab8 Parallel replicas: cleanup unused params 2023-09-11 21:52:40 +00:00
Igor Nikonov
2293923f66 Disable parallel replicas on shards with not enough nodes 2023-09-11 21:46:46 +00:00
Amos Bird
667426f1f2
DataTypeAggregateFunction::strictEquals 2023-09-12 03:54:19 +08:00
avogar
803d8dcf85 Support NULL as default for nested types Array/Tuple/Map for input formats 2023-09-11 18:18:33 +00:00
Nikolai Kochetov
59108f3d96
Merge pull request #54476 from ClickHouse/revert-54470-revert-48607-master
Revert "Revert "Add settings for real-time updates during query execution""
2023-09-11 14:59:13 +02:00
Amos Bird
fb0f9ff565
Fix aggregate projections with normalized states 2023-09-10 03:21:22 +08:00
Alexey Milovidov
c0a43df749
Merge pull request #54435 from Alex-Cheng/small_finetune_merge_join
Small fine-tune for using ColumnNullable pointer
2023-09-09 19:28:28 +03:00
alexX512
7f77869216 Increase amount of rows in requests for partial result tests
(cherry picked from commit 54bc3fea9a)
2023-09-09 10:33:05 +00:00
Nikolai Kochetov
9b936c44db
Revert "Revert "Add settings for real-time updates during query execution"" 2023-09-09 12:29:39 +02:00
Alexey Milovidov
03a755732a
Revert "Add settings for real-time updates during query execution" 2023-09-09 03:10:23 +03:00
Azat Khuzhin
ffa82e9297 Fix filtering parts with indexHint for non analyzer
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-08 18:17:06 +02:00
Anton Popov
1aa34c16e3 Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-08 14:00:45 +00:00
Nikolai Kochetov
0095124791
Merge pull request #48607 from alexX512/master
Add settings for real-time updates during query execution
2023-09-08 09:05:33 +02:00
robot-ch-test-poll2
f28ad1e136
Merge pull request #54368 from ClickHouse/fix_replacing_final_error
Fix logical error in vertical merge + replacing merge tree + optimize cleanup
2023-09-07 15:45:43 +02:00
Alex Cheng
75dc6d9708 small fine-tune for using ColumnNullable pointer 2023-09-07 20:41:32 +08:00
Arthur Passos
f34d40cde3 docs 2023-09-06 17:26:34 -03:00
Arthur Passos
a8027be612 fix 2023-09-06 17:25:27 -03:00
robot-ch-test-poll3
7f756ed613
Merge pull request #54354 from ClickHouse/parallel-replicas-cleanup
Parallel replicas: remove unused code
2023-09-06 19:38:14 +02:00
Arthur Passos
ce673d6bea arrow-parquet account for monotonically increasing offsets across multiple batches 2023-09-06 13:59:39 -03:00
Alexander Sapin
4368c00052 Fix logical error in vertical merge + replacing merge tree + optimize cleanup 2023-09-06 18:43:56 +02:00
Kruglov Pavel
5b29640b22
Merge branch 'master' into group-by-constant-keys 2023-09-06 18:06:51 +02:00
robot-ch-test-poll4
8c71582316
Merge pull request #54185 from ClickHouse/analyzer-partition-id-pruning
Fix partition id pruning for analyzer.
2023-09-06 16:53:35 +02:00
Igor Nikonov
c51cfef065 Remove unused code 2023-09-06 12:53:58 +00:00
Igor Nikonov
54c5158291
Merge pull request #54315 from ClickHouse/add-logs-parallel-replica-over-distributed
Add logs for parallel replica over distributed
2023-09-06 14:23:45 +02:00
Anton Popov
401496aa1f Apply suggestions from code review
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-09-06 10:27:46 +00:00
robot-clickhouse-ci-1
02339a1f22
Merge pull request #54326 from ClickHouse/fix_segfault_system_zookeeper
Fix segfault in system.zookeeper
2023-09-06 02:20:50 +02:00
Alexander Tokmakov
a8489c21da fix segfault in system.zookeeper 2023-09-05 20:23:16 +02:00
Igor Nikonov
47d572d8bc Log cluster_for_parallel_replicas on initiator 2023-09-05 13:17:10 +00:00
slvrtrn
6e0a254368 Update tests, update imports, remove requirements 2023-09-04 21:50:06 +02:00
slvrtrn
bb0eff9669 Revert format changes 2023-09-04 21:15:26 +02:00
irenjj
c9261bbf18 Merge remote-tracking branch 'upstream/master' into feat_markdown 2023-09-04 22:35:53 +08:00
Raúl Marín
e192d4c624
Fix summary reporting with parallel replicas with LIMIT (#53050) 2023-09-04 15:53:06 +02:00
Alexey Milovidov
b660ac9bf1 Merge #54236 2023-09-04 03:57:39 +02:00
Alexey Milovidov
476e15ce3d
Merge pull request #54236 from YinZheng-Sun/Fix
remove semicolon
2023-09-04 04:54:30 +03:00
Yinzheng-Sun
74ec546052 remove semicolon 2023-09-03 21:52:39 +08:00
Nikolai Kochetov
63c681daf4 Try fix tests. 2023-09-01 18:20:56 +00:00
Nikolai Kochetov
4cbfca78e4 Fixing 01748_partition_id_pruning 2023-09-01 14:29:31 +00:00
alexX512
36b8932b37 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-31 21:40:50 +00:00
Nikolai Kochetov
52a7206002 Fix rows_before_limit_at_least for DelayedSource. 2023-08-31 12:53:58 +00:00
Robert Schulze
aefb543734
Merge remote-tracking branch 'rschu1ze/master' into feat_markdown 2023-08-31 11:32:44 +00:00
slvrtrn
8378441248 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-30 19:00:51 +02:00
slvrtrn
f4dd6be8a8 WIP prepared statements 2023-08-30 18:59:39 +02:00
Duc Canh Le
11c94246c7 do not implicitly read pk + version and compute sort expression for lonely parts
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-30 05:05:57 +00:00
Sergei Trifonov
802579f3f1
Merge pull request #49618 from ClickHouse/concurrency-control-controllable
Make concurrency control controllable
2023-08-29 19:44:51 +02:00
Anton Popov
02391eafe1 refactoring of reading from MergeTree tables 2023-08-29 13:40:12 +00:00
alexX512
2670af53df Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-29 13:37:58 +00:00
alexX512
70f926a75a Style fix 2023-08-29 13:37:46 +00:00
alexX512
238f6e8327 fix style 2023-08-29 13:15:38 +00:00
Kseniia Sumarokova
463a197da4
Merge pull request #53847 from kssenii/fix-segfault-in-pg
Fix possible segfault while using PostgreSQL engine
2023-08-29 14:45:46 +02:00
alexX512
b3ba00f443 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-29 10:59:29 +00:00
alexX512
47a908dfa8 Add support for nested supqueries for AggregationPartialResult transform and more comments 2023-08-29 10:45:34 +00:00
Duc Canh Le
e9b0d3e4a2 do not implicitly read pk and version columns in lonely parts if nnot necessary 2023-08-29 09:41:18 +00:00
Raúl Marín
45e8185f9b Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-08-29 11:17:34 +02:00
Alexey Milovidov
b7d8ebf5e2
Merge pull request #53511 from Enmk/fix-ReplacingMergeTree-do_not_merge_across_partitions_select_final
Fixed SELECTing from ReplacingMergeTree with do_not_merge_across_partitions_select_final
2023-08-28 16:07:06 +03:00
vdimir
b92c436c29
Merge pull request #53699 from ClickHouse/vdimir/filter_pushdown_const_bug 2023-08-28 11:45:05 +02:00
irenjj
51aa89eed8 Add a setting to automatically escape special characters in Markdown. 2023-08-28 00:10:33 +08:00
alesapin
0e601b856f
Merge pull request #53751 from Algunenano/clang18
Support clang-18 (Wmissing-field-initializers)
2023-08-25 23:27:06 +02:00
slvrtrn
055d2e3c3d Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-25 21:27:47 +02:00
slvrtrn
734ffd916c WIP prepared statements 2023-08-25 20:31:21 +02:00
kssenii
4af1bf60ed Fix 2023-08-25 19:24:31 +02:00
kssenii
49d33774f9 Fix 2023-08-25 17:47:56 +02:00
Vasily Nemkov
f896c6349c Merge commit upstream/master into fix-ReplacingMergeTree-do_not_merge_across_partitions_select_final 2023-08-25 16:02:54 +02:00
Raúl Marín
6490213207 Merge remote-tracking branch 'blessed/master' into clang18 2023-08-24 17:35:26 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
avogar
c4f8113a78 Fix tests 2023-08-24 15:05:45 +00:00
Kruglov Pavel
cd3433f95a
Merge pull request #53407 from Avogar/tsv-single-carriage-return
Fix processing single carriage return in TSV file segmentation engine
2023-08-24 16:06:05 +02:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
avogar
93ba73715a Merge branch 'master' of github.com:ClickHouse/ClickHouse into group-by-constant-keys 2023-08-23 18:47:42 +00:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
avogar
68e3af56d4 Address comments 2023-08-23 13:19:15 +00:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Kruglov Pavel
fee323b122
Update src/Processors/Formats/IRowInputFormat.h
Co-authored-by: Michael Kolupaev <michael.kolupaev@clickhouse.com>
2023-08-23 12:15:47 +02:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
Alexey Milovidov
67c3b7fa65
Merge pull request #53711 from ClickHouse/sorted-distinct-sparse-columns
Fix: sorted distinct with sparse columns
2023-08-23 11:34:01 +03:00
Igor Nikonov
22895c1d0d Fix: sorted distinct with sparse columns 2023-08-22 23:33:30 +00:00
avogar
cd228754c8 Apply suggestions 2023-08-22 17:32:35 +00:00
Kruglov Pavel
6e3f2fedbd
Apply suggestions from code review
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
2023-08-22 19:05:06 +02:00
vdimir
b23773380c
Fix filter pushdown for full_sorting_merge join 2023-08-22 15:06:50 +00:00
avogar
6119246948 Better 2023-08-22 14:51:46 +00:00
robot-clickhouse-ci-1
698ceee1a9
Merge pull request #53631 from amosbird/fix_53630
Fix data race of shell command
2023-08-22 15:12:26 +02:00
Kruglov Pavel
67c5c0203b
Merge branch 'master' into fast-count-from-files 2023-08-22 15:03:48 +02:00
avogar
7f9e81d504 Clean up 2023-08-22 12:55:00 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Antonio Andelic
e0af6e5879
Merge pull request #53644 from ClickHouse/fix-delayed-source-with-totals
Correctly handle totals and extremes with `DelayedSource`
2023-08-22 12:24:16 +02:00
Robert Schulze
acaa2eee58
Merge pull request #53556 from ClibMouse/feature/big-endian-UUID-correction
Change Big Endian-UUID to work the same as Little Endian-UUID
2023-08-22 11:57:44 +02:00
Alexey Milovidov
9874556d85
Merge pull request #53655 from ClibMouse/more-fix-big-endian
State of State and avg aggregation function fix for big endian
2023-08-22 11:49:54 +03:00
Amos Bird
f13fd5b5dc
Wait for some pooled commands 2023-08-22 16:26:35 +08:00
Amos Bird
bd9f526f93
Fix data race of shell command 2023-08-22 14:50:56 +08:00
Michael Kolupaev
d752611c43 Performance test 2023-08-21 14:15:52 -07:00
Michael Kolupaev
2f4d433e69 Parquet filter pushdown 2023-08-21 14:15:52 -07:00
Michael Kolupaev
6009e1b293
Merge pull request #53324 from bigo-sg/ch_gluten_2583
Implement native orc input format without arrow to improve performance
2023-08-21 13:44:57 -07:00
Alexey Milovidov
d7180c7d5c
Merge pull request #53645 from ClickHouse/prepared-set-cache-in-mutation-pipeline-stuck
Prepared set cache in mutation pipeline stuck
2023-08-21 22:21:45 +03:00
Suzy Wang
7cfc2a0872 update api name 2023-08-21 12:18:32 -07:00
Suzy Wang
6edf8f78cc more fixes for big endian 2023-08-21 12:13:56 -07:00
Nikolai Kochetov
f0b68393a8
Merge pull request #53162 from ClickHouse/not-ready-set-bug
Not-ready Set
2023-08-21 21:09:15 +02:00
Kruglov Pavel
fed253a671
Fix build 2023-08-21 16:46:23 +02:00
Antonio Andelic
c4bf151d83 Correctly handle totals and extremes with DelayedSource 2023-08-21 14:07:59 +00:00
Nikolai Kochetov
2d932f0953 Remove obsolete code. 2023-08-21 14:04:07 +00:00
Kruglov Pavel
098818b234
Fix build 2023-08-21 15:45:45 +02:00
Nikolai Kochetov
e9149981ea Fix check for delayed ports. 2023-08-21 13:08:32 +00:00
Kruglov Pavel
88aee95122
Merge branch 'master' into fast-count-from-files 2023-08-21 14:46:33 +02:00
avogar
e590f15d3d Fix for carriage return in tsv 2023-08-21 12:46:03 +00:00
avogar
584bd57f5c Clean up 2023-08-21 12:43:11 +00:00
avogar
47304bf7aa Optimize count from files in most input formats 2023-08-21 12:30:52 +00:00
Kruglov Pavel
c68456a20a
Merge pull request #52692 from Avogar/variable-number-of-volumns-more-formats
Allow variable number of columns in more formats, make it work with schema inference
2023-08-21 13:28:35 +02:00
avogar
4c12914406 Fix single carriage return processing in TSV file segmentation engine 2023-08-21 11:26:18 +00:00
Nikolai Kochetov
388e2a09d6 Merge branch 'master' into not-ready-set-bug 2023-08-21 10:59:51 +00:00
taiyang-li
e5a399d0e9 change as requested 2023-08-21 14:51:25 +08:00
taiyang-li
f2e4315d59 fix building 2023-08-21 14:11:48 +08:00
taiyang-li
3cd9eb9b84 fix style 2023-08-21 12:12:31 +08:00
taiyang-li
3781245027 change as request 2023-08-21 12:10:39 +08:00
taiyang-li
f723e8d43a change as request 2023-08-21 12:09:02 +08:00
Igor Nikonov
a69ea02418 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-19 21:43:25 +00:00
taiyang-li
9866d2727e change as request 2023-08-19 17:31:19 +08:00
Alexey Milovidov
c42c4046fe
Merge pull request #53573 from amosbird/fix_53454
Proper destruction of task in ShellCommandSource
2023-08-19 12:19:29 +03:00
Amos Bird
052281896a
Proper destruction of task 2023-08-19 13:56:57 +08:00
Michael Kolupaev
a1522e22ea
Merge pull request #53281 from Avogar/batch-small-parquet-row-groups
Optimize reading small row groups by batching them together in Parquet
2023-08-18 17:15:42 -07:00
Igor Nikonov
aebda10f7c Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-18 23:00:58 +00:00
kothiga
f33c585bc5
Addressing feedback. 2023-08-18 13:50:31 -07:00
Austin Kothig
6b42975d33
Change BE-UUID to work the same as LE-UUID. Included high and low getters to provide cleaner code when accessing undertype. 2023-08-18 08:19:46 -07:00
avogar
7fa72f5cdf Optimize group by constant keys 2023-08-18 12:47:26 +00:00
Kruglov Pavel
3bae63e48e
Fix special build 2023-08-18 13:56:32 +02:00
taiyang-li
4f9429d2e4 fix ut tests/queries/0_stateless/00900_null_array_orc_load.sh 2023-08-18 17:58:24 +08:00
Vasily Nemkov
55168dc075 Merge remote-tracking branch 'upstream/master' into fix-ReplacingMergeTree-do_not_merge_across_partitions_select_final 2023-08-18 11:41:56 +02:00
Amos Bird
1c300a31b1
Fix build 2023-08-18 15:38:48 +08:00
Amos Bird
b2dd055cdf
Use poll instead 2023-08-18 15:38:48 +08:00
Amos Bird
c43bf153f5
Refactor 2023-08-18 15:38:46 +08:00