thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-04 21:42:39 +00:00
Code Issues Packages Projects Releases Wiki Activity
128,362 Commits 9,185 Branches 1,782 Tags 2.3 GiB
d6df7d8403
Commit Graph

1320 Commits

Author SHA1 Message Date
Nikolai Kochetov
91c241532f Add a check for header structure. 2023-08-16 20:26:23 +00:00
Sergei Trifonov
771710b377
Merge branch 'master' into concurrency-control-controllable 2023-08-11 16:50:13 +02:00
ltrk2
a2054c04dd
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-10 10:21:34 -04:00
ltrk2
139e9433a8
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-09 09:48:00 -04:00
Alexey Milovidov
aa757490bd Ditch tons of garbage 2023-08-09 02:19:02 +02:00
alexX512
520a3c6eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-07 16:52:51 +00:00
alexX512
51372d841d Style fix 2023-08-07 16:52:38 +00:00
alexX512
080b4badbd Support partial result for aggregating transform during query execution 2023-08-07 15:58:14 +00:00
Sergei Trifonov
dcac12c8f9
Merge branch 'master' into concurrency-control-controllable 2023-08-07 13:43:02 +02:00
Alexey Milovidov
e89bd2932c
Merge branch 'master' into vdimir/join_filter_set_sparse 2023-08-05 00:49:52 +03:00
Kruglov Pavel
b1fe9ce8f7
Merge branch 'master' into formats-with-subcolumns 2023-08-04 13:01:12 +02:00
vdimir
13d5ef9164
Convert sparse to full in CreateSetAndFilterOnTheFlyStep 2023-08-03 14:43:03 +00:00
ltrk2
a29b36612b
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-03 09:41:25 -04:00
Alexey Milovidov
86f9c120d7 Merge branch 'master' into more-checks-in-thread-status 2023-08-03 14:34:31 +02:00
Alexey Milovidov
b740922c1e
Merge branch 'master' into more-checks-in-thread-status 2023-08-03 00:10:59 +03:00
alexX512
0d84226914 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-08-02 19:18:59 +00:00
alexX512
ee01d64350 Style fix 2023-08-02 18:42:57 +00:00
alexX512
06e187e58a Split mergeSortingTransform and mergeSortingPartialResultTransform into 2 files 2023-08-02 18:15:25 +00:00
Igor Nikonov
44b9ed438f
Merge branch 'master' into fix-window-func-range-check 2023-08-02 19:24:55 +02:00
ltrk2
27a2d4d1c7
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-08-02 11:36:43 -04:00
Anton Popov
ff137773e7
Merge branch 'master' into formats-with-subcolumns 2023-08-02 15:24:56 +02:00
Nikita Taranov
2cbe79b529
Fix memory consumption when max_block_size is huge in Aggregator + more memory checks (#51566) 
* impl

* remove checks from without_key methods

* maybe will improve smth

* add test

* Update 02797_aggregator_huge_mem_usage_bug.sql

* Update 02797_aggregator_huge_mem_usage_bug.sql

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-08-02 15:11:52 +02:00
alexX512
9ac2d12f3b Add test for partial sorting result 2023-08-02 13:07:02 +00:00
Sergei Trifonov
01196ac41f
Merge branch 'master' into concurrency-control-controllable 2023-08-01 15:40:50 +02:00
alexX512
8e3296a44a Add support of local progress in scheduler 2023-08-01 13:31:18 +00:00
Ilya Yatsishin
e2a021aaf4
Merge pull request #52636 from ClickHouse/distinct-in-order-sqlancer-crashes 
Suspicious DISTINCT crashes from sqlancer
 2023-08-01 14:03:22 +02:00
Anton Popov
8447a93931 fix sorting of sparse columns with large limit 2023-07-31 17:40:22 +00:00
Igor Nikonov
918571a5ee Fix: check correctly frame bounds for RANGE 2023-07-29 22:04:21 +00:00
ltrk2
6c9a1b14ef
Merge branch 'master' into feature/mergetree-checksum-big-endian-support 2023-07-28 16:18:46 -04:00
Igor Nikonov
407fb58d4b Fix style check 2023-07-27 20:53:36 +00:00
Igor Nikonov
83fd3d4c89 Additional checks related to DistinctSortedChunkTransform 
In response to suspicious crash reports from sqlancer for DISTINCT queries
 2023-07-26 21:59:13 +00:00
Kruglov Pavel
0d34e97dbe
Merge branch 'master' into formats-with-subcolumns 2023-07-26 13:30:35 +02:00
alexX512
1fe2f052e3 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-07-25 09:36:44 +00:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Alexey Milovidov
63c5dac972
Merge branch 'master' into more-checks-in-thread-status 2023-07-22 04:58:28 +03:00
Alexey Milovidov
d0cb6596e1
Merge pull request #52259 from Chen768959/fix-50582 
fix issue#50582 Not found column NULL in block
 2023-07-22 01:05:59 +03:00
Igor Nikonov
8c8e097b72
Merge pull request #51013 from bigo-sg/grace_hash_join_full_right_202306 
Grace hash join support full & right join
 2023-07-21 22:22:06 +02:00
alexX512
c403f56e09 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2023-07-21 17:56:53 +00:00
lgbo-ustc
24371c33bf remove DelayedBlocksTask::finish 2023-07-21 09:24:16 +08:00
chen768959
f2d184cf1b Consistent style for if statements. 2023-07-20 19:11:08 +08:00
chen768959
84f6a7336c Prevent going beyond the index of const_columns_to_remove. 2023-07-20 19:03:42 +08:00
Robert Schulze
bd761c365a
Make serializeAST() more regular 2023-07-20 10:39:26 +00:00
lgbo-ustc
91dc6a35e1 update 2023-07-20 18:22:01 +08:00
lgbo-ustc
0ba97eeea5 wip: grace hash join support full & right join 2023-07-20 18:22:01 +08:00
chen768959
067e3caa2c Remove constants from description_sorted_. 2023-07-20 18:13:19 +08:00
ltrk2
51e2c58a53 Implement endianness-independent SipHash and MergeTree checksum serialization 2023-07-19 10:01:55 -07:00
Chen768959
549026f0ae
fix style error 
fix Trailing whitespaces
 2023-07-19 16:11:14 +08:00
Chen768959
9b7ecbaa27
fix issue#50582 
The buildInputOrderInfo() method in optimizeReadInOrder.cpp adds constant columns to order_key_prefix_descr. However, since header_without_constants does not contain constant columns, the constant columns in description_sorted_ also need to be removed in advance.
 2023-07-18 22:00:47 +08:00
Kruglov Pavel
1dd05319b5
Merge branch 'master' into formats-with-subcolumns 2023-07-17 19:13:42 +02:00
Kruglov Pavel
06de25451a
Merge branch 'master' into formats-with-subcolumns 2023-07-06 16:21:52 +02:00
Alexey Milovidov
387ae223c6
Merge branch 'master' into more-checks-in-thread-status 2023-07-05 20:35:11 +03:00
Igor Nikonov
bf190381f5 addJoinedBlock -> addBlockToJoin 2023-07-05 17:03:18 +00:00
robot-ch-test-poll
0fb6dd8f89
Merge pull request #51800 from Avogar/assert-current-thread 
Add assert in ThreadStatus destructor for correct current_thread
 2023-07-05 03:14:33 +02:00
Kruglov Pavel
a2805f8f44
Merge branch 'master' into formats-with-subcolumns 2023-07-04 23:27:03 +02:00
avogar
98aa6b317f Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions 2023-07-04 21:17:26 +00:00
Alexey Milovidov
2c96580a77
Merge branch 'master' into concurrency-control-controllable 2023-07-04 23:16:04 +03:00
avogar
32ee0e7d08 Add assert in ThreadStatus destructor for correct current_thread 2023-07-04 17:35:26 +00:00
Alexey Milovidov
37e173785a
Merge branch 'master' into more-checks-in-thread-status 2023-07-04 00:20:47 +03:00
Antonio Andelic
9a79fd6f70 Better 2023-06-30 11:51:20 +00:00
Alexey Milovidov
b8e6bd3299
Merge branch 'master' into refactor-subqueries-for-in 2023-06-26 06:05:12 +03:00
Sema Checherinda
95349a405b release buffers with exception context 2023-06-22 13:00:13 +02:00
Nikolai Kochetov
a940031878 Merge branch 'master' into refactor-subqueries-for-in 2023-06-22 12:18:48 +02:00
Nikolai Kochetov
0af028ab3f Refactor a bit more. 2023-06-21 20:55:27 +00:00
Nikolai Kochetov
7280078bc6 Refactoring a bit more. 2023-06-19 19:01:56 +00:00
Azat Khuzhin
3e419730c3 Disable parallelize_output_from_storages for processing MATERIALIZED VIEWs 
Adding more processors for parallelize_output_from_storages is not a
costless operation (I've experienced some issues in production because
of this), and it is not easy to fix in a normal way, so let's disable it
for now.

Before this patch:
- INSERT INTO input SELECT * FROM numbers(10e6) SETTINGS parallelize_output_from_storages=1, min_insert_block_size_rows=1000
  0 rows in set. Elapsed: 3.648 sec. Processed 20.00 million rows, 120.00 MB (5.48 million rows/s., 32.90 MB/s.)

- INSERT INTO input SELECT * FROM numbers(10e6) SETTINGS parallelize_output_from_storages=0, min_insert_block_size_rows=1000
  0 rows in set. Elapsed: 1.851 sec. Processed 20.00 million rows, 120.00 MB (10.80 million rows/s., 64.82 MB/s.)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-14 19:11:23 +03:00
Nikolai Kochetov
7025232175 Fixing cache for sets. 2023-06-12 18:59:07 +00:00
Alexey Milovidov
3c023febc4
Merge pull request #50698 from kitaisreal/reverse-transform-small-improvement 
ReverseTransform small improvement
 2023-06-10 14:59:23 +03:00
Nikolai Kochetov
6ce8329bda Merge branch 'master' into refactor-subqueries-for-in 2023-06-09 20:04:27 +02:00
Nikolai Kochetov
e0277b071b
Merge pull request #50699 from ClickHouse/vdimir/revert_grace_join_changed 
Revert recent grace hash join changes
 2023-06-09 17:56:52 +02:00
Maksim Kita
7079b4c885 ReverseTransform small improvement 2023-06-08 15:22:09 +03:00
vdimir
f0a1c8afa2
Revert "Merge pull request #49483 from bigo-sg/grace_hash_full_join" 
This reverts commit fa93c388b1, reversing
changes made to a2c0a65344.
 2023-06-08 09:40:41 +00:00
Antonio Andelic
b11f744252
Correctly disable async insert with deduplication when it's not needed (#50663) 
* Correctly disable async insert when it's not used

* Better

* Add comment

* Better

* Fix tests

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-06-07 20:33:08 +02:00
Nikolai Kochetov
92859ebb3b Fixing more tests. 2023-06-01 21:15:15 +00:00
Nikolai Kochetov
b5b261b22c Merge branch 'master' into refactor-subqueries-for-in 2023-05-25 21:22:06 +02:00
Nikolai Kochetov
7ebe19f5fb Fixing more tests 2023-05-25 19:18:11 +00:00
Nikolai Kochetov
30ff5113d9 Fixing more tests. 2023-05-25 13:33:52 +00:00
Igor Nikonov
8645af5809 Hoping to get into next release 2023-05-23 14:54:22 +00:00
Igor Nikonov
3a29f275e0 Fix: do not generate suffix on new chunk if didn't reach current range end 2023-05-22 21:50:12 +00:00
Igor Nikonov
4c97ca0a9e Merge remote-tracking branch 'origin/master' into fill_with_by_sorting_prefix_2 2023-05-22 18:59:58 +00:00
Nikolai Kochetov
ff6400f91a Merge branch 'master' into refactor-subqueries-for-in 2023-05-22 13:07:51 +02:00
lgbo-ustc
35d8388705 update 2023-05-22 10:17:41 +08:00
lgbo-ustc
2582399271 fixed: a in-memory bucket contains rows of other buckets 2023-05-22 10:17:41 +08:00
lgbo-ustc
603c024eb0 ensure only the last processor could access non-joined blocks 2023-05-22 10:17:41 +08:00
lgbo-ustc
7772fed161 update 
1. fixed the memoery overflow problem when  handle all delayed buckets parallely
2. resue exists tests
 2023-05-22 10:17:40 +08:00
lgbo-ustc
39ff030a6e grace hash join supports right/full join 2023-05-22 10:17:40 +08:00
Igor Nikonov
0d585746de Fixes 
+ disallow usage of the same column in sorting prefix and INTERPOLATE
+ sorting prefix is empty if use_with_fill_by_sorting_prefix is off
 2023-05-15 17:08:00 +00:00
Igor Nikonov
b2dddf7cf8 Fix style 2023-05-14 16:06:35 +00:00
Igor Nikonov
e743693fb3 Merge remote-tracking branch 'origin/master' into fill_with_by_sorting_prefix_2 2023-05-14 15:56:12 +00:00
Igor Nikonov
93384d6546 Fix suffix generation (see added test in commit 3355894) 2023-05-14 15:52:49 +00:00
Alexey Milovidov
5a44dc26e7 Fixes for clang-17 2023-05-13 02:57:31 +02:00
Igor Nikonov
72f4aed64b Add setting use_with_fill_by_sorting_prefix 2023-05-10 21:08:29 +00:00
Igor Nikonov
a0ef2e272f Fix suffix generation for empty result set 2023-05-10 12:41:33 +00:00
Igor Nikonov
37bc0becc9 Merge remote-tracking branch 'origin/master' into fill_with_by_sorting_prefix_2 2023-05-10 10:53:10 +00:00
Igor Nikonov
93161f70d1 Correct suffix handling for ranges 2023-05-10 10:45:43 +00:00
Alexey Milovidov
aa280bcd10 Slightly better 2023-05-07 23:12:28 +02:00
Alexey Milovidov
3880053348 Slightly better 2023-05-07 23:02:41 +02:00
Alexey Milovidov
736eac4a5d Remove commented code 2023-05-07 22:46:02 +02:00
Igor Nikonov
0dfeb880ce Fix 01034_with_fill_and_push_down_predicate.sql 2023-05-07 08:08:02 +00:00
Alexey Milovidov
6fddb5bad3 Simplification 2023-05-07 06:31:00 +02:00
Alexey Milovidov
a695d6227d Make concurrency control controllable 2023-05-07 06:16:30 +02:00