Commit Graph

5875 Commits

Author SHA1 Message Date
Alexey Milovidov
c7efd2afea Revert #58267 2023-12-28 04:09:33 +01:00
Alexey Milovidov
1d9dbfd18b
Merge pull request #49103 from ClickHouse/check-about-global-sorting
Fixed a sorting order breakage in TTL GROUP BY
2023-12-28 01:35:14 +01:00
Alexey Milovidov
e7c987058c
Merge pull request #58250 from Avogar/json-compact-each-row-parallel-parsing
Fix parallel parsing for JSONCompactEachRow
2023-12-28 01:23:30 +01:00
Alexey Milovidov
38d050060e
Merge branch 'master' into merge-tree-final-extract-non-intersecting-parts-ranges 2023-12-28 01:18:18 +01:00
Raúl Marín
87eb18eb74 Speed up numbers table function 2023-12-28 01:02:03 +01:00
Alexey Milovidov
8d984df135
Merge pull request #58237 from azat/build/fwd-decl-exception
Some code refactoring (was an attempt to improve build time, but failed)
2023-12-28 00:21:09 +01:00
Alexey Milovidov
dcbd3b9c26
Merge pull request #58267 from ClickHouse/fix_is_deleted_compatibility
Re-introduce `is_deleted` column for ReplacingMergeTree
2023-12-28 00:13:01 +01:00
Alexey Milovidov
df6bec57aa
Merge branch 'master' into merge-tree-final-extract-non-intersecting-parts-ranges 2023-12-27 18:23:28 +01:00
Alexander Tokmakov
f924848347 partially revert #54368 (f28ad1e136) 2023-12-27 18:17:59 +01:00
Alexander Tokmakov
d7a6148828 partially revert #54706 (135df6870c) 2023-12-27 18:13:51 +01:00
avogar
fee2eadaf0 Fix parallel parsing for JSONCompactEachRow 2023-12-27 16:16:41 +00:00
Nikita Mikhaylov
a3fa378401
Update TTLAggregationAlgorithm.cpp 2023-12-27 17:02:52 +01:00
Nikita Mikhaylov
ac87daf8c3 Fix bug in TTL GROUP BY
(cherry picked from commit d9f2a2935c1c6760ef2725f2eb6d13ed9f0815fe)
2023-12-27 15:50:20 +00:00
Nikita Mikhaylov
b60109d43e Better 2023-12-27 15:50:20 +00:00
Igor Nikonov
4fe54c213b Fix: round-robin load balancing for custom key queries
+ even subqueries distribution over available nodes for custom key query
+ creating load balancing instance for each custom key query separately
2023-12-27 15:06:41 +00:00
Alexey Milovidov
f00337e2ba
Merge pull request #57872 from CurtizJ/optimize-aggregation-consecutive-keys
Better optimization of consecutive keys in aggregation
2023-12-27 15:44:22 +01:00
Azat Khuzhin
b9233f6d4f Move Allocator code into module part
This should reduce amount of code that should be recompiled on
Exception.h changes (and everything else that had been included there).

This will actually not help a lot, because it is also included into
PODArray.h and ThreadPool.h at least... Sigh.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-27 15:42:08 +01:00
Alexander Tokmakov
01d042c490 Revert "Merge pull request #57932 from ClickHouse/remove-shit-cleanup"
This reverts commit 2d58dc512c, reversing
changes made to 41873dc4a3.
2023-12-27 13:46:06 +01:00
Alexey Milovidov
7e3f3fc3e6
Update RowRef.h 2023-12-27 15:38:16 +03:00
Alexey Milovidov
77ec4a0422
Merge pull request #58218 from kitaisreal/merge-tree-automatically-derive-do-not-merge-across-partitions-select-final-setting
MergeTree derive do_not_merge_across_partitions_select_final setting
2023-12-27 13:26:17 +01:00
Duc Canh Le
fc0cbd4c68 remove unused error code
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-12-27 09:40:35 +00:00
Duc Canh Le
476ca4246d Merge branch 'master' into final_no_copy
Resolve conflicts + add some comments

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-12-27 07:00:58 +00:00
Igor Nikonov
bee15325fc Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-26 21:56:46 +00:00
Maksim Kita
cbf9304d1f MergeTree automatically derive do_not_merge_across_partitions_select_final setting 2023-12-26 12:41:21 +03:00
Amos Bird
bfcccf9fa3
Primary key analysis for _part_offset 2023-12-26 17:03:59 +08:00
Maksim Kita
c5959068cb Fixed tests 2023-12-25 12:51:17 +03:00
Maksim Kita
46446ed0c4 Fixed tests 2023-12-25 12:51:17 +03:00
Maksim Kita
51d6c444f5 Fixed tests 2023-12-25 12:51:17 +03:00
Maksim Kita
269e9706fb MergeTree FINAL extract non intersecting parts ranges 2023-12-25 12:51:17 +03:00
Azat Khuzhin
3be3b0a280 Fix incorrect Exceptions
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 21:26:32 +01:00
Michael Kolupaev
a3f204cb7e Fix base address for ranges 2023-12-24 05:14:34 +00:00
Michael Kolupaev
172687f53a Fix DWARFBlockInputFormat failing on DWARF 5 unit address ranges 2023-12-23 21:43:37 +00:00
Alexey Milovidov
6a23fe034f Remove parallel parsing for JSONCompactEachRow 2023-12-23 06:17:47 +01:00
Yarik Briukhovetskyi
483a377834
Merge pull request #57995 from yariks5s/paste_join
Implementing PASTE JOIN
2023-12-22 12:56:06 +01:00
Duc Canh Le
17ed277191 FINAL to not compare rows from same non-L0 part
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-12-22 03:57:06 +00:00
Kseniia Sumarokova
189d0ec147
Merge branch 'master' into broken-projections-better-handling 2023-12-21 17:17:50 +01:00
Kruglov Pavel
e419bd2d3b
Fix special build 2023-12-21 17:10:59 +01:00
Raúl Marín
77efdf3a9e Merge remote-tracking branch 'blessed/master' into log_and_exception_verbose 2023-12-21 16:07:47 +01:00
Raúl Marín
ced9407cef Improve error messages 2023-12-21 10:29:05 +01:00
Igor Nikonov
db87ea0b86 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-20 20:48:51 +00:00
Nikita Mikhaylov
cb6c9557ff
Merge branch 'master' into remove-old-projections-code 2023-12-20 17:45:38 +01:00
Nikolai Kochetov
4d7a5d47ee
Merge pull request #58045 from ClickHouse/make-windowInsertResultInto-constant
Make window insert result into constant
2023-12-20 17:42:34 +01:00
Nikita Taranov
d57ac6dfdb
Set replica number to its position in cluster definition (#57800)
* impl

* fix
2023-12-20 17:33:05 +01:00
Nikolai Kochetov
b10183e7af
Merge pull request #58048 from ClickHouse/follow-up-57691
Follow up for #57691
2023-12-20 12:54:19 +01:00
Alexey Milovidov
d190866fc0
Merge pull request #58031 from ClickHouse/revert-57766-fix-bug-window-functions
Revert "Fix bug window functions: revert #39631"
2023-12-20 01:08:08 +01:00
Kruglov Pavel
087946f385
Merge branch 'master' into variant-data-type 2023-12-20 00:40:18 +01:00
Raúl Marín
ccff198265
Rename canUseParallelReplicas to canUseTaskBasedParallelReplicas (#58025) 2023-12-19 23:21:19 +01:00
Yarik Briukhovetskyi
6e816d45ae
Merge branch 'master' into paste_join 2023-12-19 20:02:24 +01:00
yariks5s
4e418a89d9 fixed suggestions 2023-12-19 19:00:37 +00:00
Nikolai Kochetov
9510b2ccfe Follow up for 57691 2023-12-19 17:57:52 +00:00
Nikolai Kochetov
ddb582c8b4 Make windowInsertResultInto constant 2023-12-19 16:52:50 +00:00
avogar
319ae440b6 Implement Variant data type 2023-12-19 16:45:15 +00:00
Nikolai Kochetov
a69005525b Fix function ntile. 2023-12-19 16:15:39 +00:00
Nikolai Kochetov
8ab6564538
Revert "Fix bug window functions: revert #39631" 2023-12-19 13:30:59 +01:00
Alexey Milovidov
7178bd5c88
Merge pull request #57910 from Algunenano/log_message_string
Improvements for 00002_log_and_exception_messages_formatting
2023-12-18 21:02:23 +01:00
Nikolai Kochetov
5290b3c9ce
Merge pull request #57855 from kitaisreal/interpreter-create-query-sample-block-fix
InterpreterCreateQuery sample block fix
2023-12-18 17:22:24 +01:00
yariks5s
975c954d1a style check 2023-12-18 15:42:50 +00:00
yariks5s
6740316a88 init 2023-12-18 15:02:51 +00:00
Anton Popov
10bc2db56d add setting 2023-12-18 13:57:07 +00:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Igor Nikonov
af6401761e Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-17 13:32:53 +00:00
Alexey Milovidov
a18a61b34c Fix style 2023-12-15 23:36:50 +01:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
Igor Nikonov
a735820400 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-15 21:14:43 +00:00
Raúl Marín
b269f87f4c Better text_log with ErrnoException 2023-12-15 19:27:56 +01:00
Kruglov Pavel
4687b4a576
Delete debug logging in OutputFormatWithUTF8ValidationAdaptor 2023-12-15 14:54:04 +01:00
Maksim Kita
8a5ffbb5f2 InterpreterCreateQuery sample block fix 2023-12-15 12:55:19 +03:00
Igor Nikonov
1370a8c6c4 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-14 18:29:38 +00:00
Duc Canh Le
93dd6b83e7
Do not allow creating replicated table with inconsistent merge params (#56833)
* save all merge params to zookeeper

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* calculate hash for graphite merge params

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* add graphite params hash to zookeeper + fix tests

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* install new graphite for testing

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* fix backward incompatibility

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* minor fix test

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* Update src/Storages/MergeTree/ReplicatedMergeTreeTableMetadata.cpp

Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>

* remove peekString and add more comments

- peekString doesn't always work even for ReadBufferFromString
- more comment re. backward compatibility

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

---------

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-12-14 17:26:35 +01:00
Anton Popov
82ebb5e2d1
Merge pull request #57790 from CurtizJ/fix-external-aggregation-with-projections
Fix result of external aggregation in case of partially materialized projection
2023-12-13 22:56:02 +01:00
Igor Nikonov
72f1c415f1 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-13 15:03:05 +00:00
Kruglov Pavel
77c8ad44d5
Fix build 2023-12-12 18:44:45 +01:00
avogar
41674bd98e Fix tests 2023-12-12 17:42:45 +00:00
Anton Popov
64d7abde09 fix result of external aggregation in case of partially materialized projection 2023-12-12 16:51:23 +00:00
Kruglov Pavel
ee39dca8c7
Merge branch 'master' into better-parsing-exceptions 2023-12-12 17:10:38 +01:00
Nikolai Kochetov
23ef8444d1
Merge pull request #57691 from ClickHouse/reset-agg-state-whenever-possible
Release memory for aggregation earlier.
2023-12-12 15:36:03 +01:00
avogar
fa8ae6ac56 Fix build 2023-12-12 14:13:15 +00:00
avogar
6a5e8c36d7 Fix reading Nested for Parquet/ORC 2023-12-12 14:13:15 +00:00
Kruglov Pavel
8a447bf57c
Merge pull request #55892 from Avogar/schema-inference-union
Add 'union' mode for schema inference
2023-12-12 15:02:06 +01:00
Nikolai Kochetov
f1a330e95d Add a comment 2023-12-12 13:46:29 +00:00
Alexey Milovidov
22200566c8 Revert "Merge pull request #39631 from ClickHouse/parallel-window"
This reverts commit 33cc853d61, reversing
changes made to b05a3d02ed.
2023-12-12 03:45:00 +01:00
Kruglov Pavel
9dba7aa13d
Merge pull request #57364 from Avogar/better-json-fallback
Better JSON -> JSONEachRow fallback without catching exceptions
2023-12-11 19:03:50 +01:00
Kruglov Pavel
20510cde34
Merge pull request #57006 from Avogar/save-errors-better
Fix early stop while parsing file with skipping lots of errors
2023-12-11 19:03:14 +01:00
Nikolai Kochetov
fcaa556bf7 Fixing test. 2023-12-11 13:39:10 +00:00
Igor Nikonov
f7e6a17052 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-10 20:21:47 +00:00
Nikolai Kochetov
5e1dccf1f4 Fixing tests 2023-12-08 22:36:01 +00:00
Nikolai Kochetov
a76d9c259f Fixing style 2023-12-08 21:06:18 +00:00
avogar
ee7af95bc0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-12-08 20:29:28 +00:00
Nikolai Kochetov
ff0340b0fc Release memory for aggregation earlier. 2023-12-08 18:18:45 +00:00
kssenii
0621b79d1a Merge remote-tracking branch 'origin/master' into broken-projections-better-handling 2023-12-08 17:27:29 +01:00
Igor Nikonov
94fb23af0b Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-07 11:52:40 +00:00
kssenii
188d4d66c9 Merge with master 2023-12-07 12:45:36 +01:00
Yakov Olkhovskiy
ac7210b9b3
Merge pull request #57461 from ClickHouse/fix-ephemeral-matview
Fix: don't exclude ephemeral column when building pushing to view chain
2023-12-06 16:46:54 -05:00
Kseniia Sumarokova
29c770502a
Fix possible segfault in PostgreSQLSource 2023-12-06 14:34:06 +01:00
Igor Nikonov
b4922eece4 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-06 10:44:30 +00:00
Joanna Hulboj
0aeb9fba19 Move consuming of leading zeros from ReadBuffer to char buffer 2023-12-05 21:55:43 +00:00
Nikolai Kochetov
903f5db5f9 Merge branch 'master' into non-ready-set-ttl 2023-12-05 15:45:08 +00:00
Nikolai Kochetov
681cfaa38a
Merge pull request #56764 from ClickHouse/avoid-stuck-for-indefinite-sourcers
Try to fix hang in 01104_distributed_numbers_test
2023-12-05 16:34:02 +01:00
Igor Nikonov
71204c2a82 Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-12-05 12:00:45 +00:00
Anton Popov
69896d94be fix tests 2023-12-04 21:40:19 +00:00
Nikolai Kochetov
6a821f9e73 Fix some staff 2023-12-04 19:24:27 +00:00
Anton Popov
40a1744b7c Merge remote-tracking branch 'upstream/master' into HEAD 2023-12-04 18:10:43 +00:00
Nikolai Kochetov
7ab4af06df Attempt to support subqueries in TTL. (2) 2023-12-04 18:04:42 +00:00
Kseniia Sumarokova
7bcc1afa8c
Merge branch 'master' into broken-projections-better-handling 2023-12-04 13:21:57 +01:00
Yakov Olkhovskiy
b601b66146 don't exclude ephemeral column when pushing to view 2023-12-04 06:56:33 +00:00
Nikita Taranov
2362bb2cc9
Don't fall-back to in-order pool when max_streams = 1 for remote fs (#57334)
* impl

* update tests

* update one more test
2023-12-01 21:39:26 +01:00
Nikolai Kochetov
508046e692 Attempt to support subqueries in TTL. 2023-12-01 20:31:26 +00:00
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
Kseniia Sumarokova
5c3d1b5991
Merge branch 'master' into broken-projections-better-handling 2023-11-30 21:33:35 +01:00
Raúl Marín
46acd8736c
Merge pull request #57189 from Algunenano/fix_respect_nulls
Fix RESPECT NULLS
2023-11-30 20:21:42 +01:00
Igor Nikonov
b4bf611d5d Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-11-30 14:09:26 +00:00
Igor Nikonov
59daabe95a Some refactoring and cleanup
+ change load balancing for custom key w/o hedged connections
  (need the test though)
2023-11-30 14:08:01 +00:00
Kruglov Pavel
c6fecfb1af
Merge pull request #56901 from KevinyhZou/Fix_allow_cr_end_of_csv_line
Fix allow cr end of line for csv
2023-11-29 20:57:58 +01:00
Kruglov Pavel
1d840ca026
Fix style 2023-11-29 20:49:53 +01:00
avogar
b493ce2385 Better JSON -> JSONEachRow fallback without catching exceptions 2023-11-29 14:19:38 +00:00
Igor Nikonov
836d149e90 Fix: use only one connection per replica 2023-11-29 13:42:18 +00:00
Han Fei
4c0efb0262
Merge pull request #53240 from hanfei1991/hanfei/statistic
use statistic to order prewhere conditions better
2023-11-29 12:26:44 +01:00
vdimir
470a092e3d
Merge pull request #51745 from ClickHouse/vdimir/setting_join_algorithm_order
Setting JoinAlgorithm respect specified order
2023-11-29 11:24:39 +01:00
vdimir
a6eb2ad930
Fix JoinStep::describeJoinActions 2023-11-28 19:09:01 +00:00
Igor Nikonov
a06a71834a Merge remote-tracking branch 'origin/master' into pr-custom-key-failover 2023-11-28 18:07:04 +00:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
János Benjamin Antal
4c2451f837
Merge pull request #56741 from ClickHouse/well-known-protos 2023-11-28 15:21:15 +01:00
Raúl Marín
48fff248e5 Merge remote-tracking branch 'blessed/master' into fix_respect_nulls 2023-11-28 12:28:36 +01:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Raúl Marín
80cc1b3a17 Remove addBatchSinglePlaceFromInterval 2023-11-27 23:12:17 +01:00
Joanna Hulboj
da8f210caa
Merge branch 'ClickHouse:master' into no-octal-leading-zeroes 2023-11-27 21:00:48 +01:00
Igor Nikonov
e823046646 Fixes 2023-11-27 15:27:04 +00:00
Raúl Marín
4250c6626c Move handling of RESPECT NULLS outside of the parser 2023-11-27 11:00:27 +01:00
Antonio Andelic
4c2de5219d
Merge pull request #57196 from amosbird/fix-57194
Fix incorrect JOIN plan optimization with partially materialized normal projection
2023-11-27 09:15:13 +01:00
Igor Nikonov
774347d231 Parallel replicas custom key: skip unavailable replicas 2023-11-26 21:38:49 +00:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
Alexey Milovidov
61c9d304f0
Merge pull request #57125 from ClickHouse/try-fix-57097
Cancel executor in ~CreatingSetsTransform
2023-11-25 03:02:39 +01:00
Amos Bird
472027e948
Fix JOIN plan with normal projection 2023-11-24 21:47:00 +08:00
Igor Nikonov
0434044a7e
Merge pull request #57054 from ClickHouse/pr-cleanup-narrow-dependency
Parallel replicas: cleanup, narrow dependency
2023-11-23 20:12:37 +01:00
Robert Schulze
e392fcab5b
Allow global and individual disabling of settings
- 'query_plan_enable_optimizations' is now a global kill switch for all
  plan-level optimizations

- even if it is true, individual optimizations can still be disabled
  individually via their respective settings
2023-11-23 18:46:48 +00:00
Robert Schulze
194e676c70
Put all query plan settings under their own settings 2023-11-23 18:45:08 +00:00
Robert Schulze
4b764b8bc9
Cosmetics 2023-11-23 18:43:10 +00:00
Robert Schulze
77d48e4d55
"optimise" --> "optimize". Sorry, friends from the UK. 2023-11-23 18:41:35 +00:00
Robert Schulze
674159857e
Merge pull request #57144 from rschu1ze/disable-reorder-functions-after-sorting
Allow to disable reorder-functions-after-sorting optimization
2023-11-23 19:38:31 +01:00
Robert Schulze
4f10ad3f3c
Allow to disable reorder-functions-after-sorting optimization 2023-11-23 13:16:03 +00:00
Nikolai Kochetov
1919ec723d Cancel executor in ~CreatingSetsTransform 2023-11-22 17:31:29 +00:00
Kruglov Pavel
e1904cbdf1
Cancel PipelineExecutor properly in case of exception in spawnThreads 2023-11-22 14:43:52 +01:00
János Benjamin Antal
ab935e3dd7 Use the google proto files when importing protobuf schemas 2023-11-22 12:39:41 +00:00
Alexey Milovidov
d0653f244b
Merge pull request #57062 from ClickHouse/add-comment-to-transformPipeline
Better comment for ITransformingStep::transformPipeline
2023-11-22 13:37:11 +01:00
Kruglov Pavel
96a3cefff6
Merge pull request #56118 from edef1c/large-arrow-list
Support reading arrow::LargeListArray
2023-11-22 13:28:46 +01:00
Duc Canh Le
4faef352f9 minor fix and comments
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-22 09:23:52 +00:00
Duc Canh Le
4b0382442f Merge branch 'master' into final_no_copy
Try fixing CI issues
2023-11-22 08:53:38 +00:00
Anton Popov
65efb18842 Merge remote-tracking branch 'upstream/master' into HEAD 2023-11-21 17:30:38 +00:00
Igor Nikonov
63a1625b77 Merge remote-tracking branch 'origin/master' into pr-cleanup-narrow-dependency 2023-11-21 16:05:48 +00:00
Nikolai Kochetov
b1ec8a3670 Better comment for ITransformingStep::transformPipeline 2023-11-21 15:35:09 +00:00
Igor Nikonov
66f6a6575f Cleanup iteration: settings usage 2023-11-21 13:29:04 +00:00
avogar
7e392eec50 Better exception messages in input formats 2023-11-21 13:13:42 +00:00
Raúl Marín
47abb9e879 Fix race condition in RemoteSource 2023-11-21 14:07:14 +01:00
kssenii
c0a0431e04 Merge remote-tracking branch 'origin/master' into broken-projections-better-handling 2023-11-21 13:22:30 +01:00
Duc Canh Le
2e2a4021f2 fix array join wrong query result
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-21 09:06:17 +00:00
kevinyhzou
3adc8fdf78 Fix ci 2023-11-21 11:22:12 +08:00
avogar
6d3de41dc2 Fix skipping lots rows with errors 2023-11-20 18:07:54 +00:00
avogar
ffa90628f0 Make input format errors logger a bit better 2023-11-20 17:22:49 +00:00
avogar
872556a5d4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-union 2023-11-20 14:03:36 +00:00
Igor Nikonov
7020177e7c
Merge branch 'master' into pr-cleanup-remote-source 2023-11-19 21:33:47 +01:00
Alexey Milovidov
d56cbda185 Add metrics for the number of queued jobs, which is useful for the IO thread pool 2023-11-18 19:07:59 +01:00
Raúl Marín
fc793fe31f
Merge pull request #56120 from kitaisreal/window-functions-decrease-amount-of-virtual-function-calls
WindowTransform decrease amount of virtual function calls
2023-11-17 13:24:38 +01:00
kevinyhzou
b8bb9835fb Fix allow cr end of line 2023-11-17 16:09:15 +08:00
Kruglov Pavel
8e78d4c9c1
Merge pull request #56304 from yariks5s/npy_data_caching
Implement countRows for Npy data format
2023-11-16 17:01:25 +01:00
Kruglov Pavel
1831ecc38f
Merge pull request #56424 from yariks5s/npy_float_16
Float16 support for npy format
2023-11-16 17:00:24 +01:00
kssenii
6c42a3fad6 Better 2023-11-16 16:51:05 +01:00
Igor Nikonov
110245bf0b
Merge branch 'master' into pr-cleanup-remote-source 2023-11-16 12:41:32 +01:00
Raúl Marín
6d094efd80 Merge remote-tracking branch 'blessed/master' into window-functions-decrease-amount-of-virtual-function-calls 2023-11-16 12:32:11 +01:00
Dmitry Novik
33cc853d61
Merge pull request #39631 from ClickHouse/parallel-window
Window function parallel evaluation
2023-11-16 11:50:16 +01:00
Amos Bird
1e46460910
Fix nullable primary key in final (#56452) 2023-11-15 22:27:05 +01:00
Dmitry Novik
592c653cac Fixup 2023-11-15 20:26:07 +00:00
Dmitry Novik
83acec9511 Fix max_threads = 1 case 2023-11-15 18:58:14 +00:00
Nikolai Kochetov
9dbfb22baf Add a comment. 2023-11-15 16:02:14 +00:00
Nikolai Kochetov
a52fb6de32 Revert changes to TaskQueue 2023-11-15 15:50:23 +00:00
yariks5s
4e48df6bfc improved nulls 2023-11-15 12:15:21 +00:00
Nikolai Kochetov
dbdf734a32 Fix build. Prettify code. 2023-11-15 12:12:07 +00:00
yariks5s
9376ac5603 added implementation for negative nulls 2023-11-15 11:42:52 +00:00
Yarik Briukhovetskyi
12a8a38d35
Merge branch 'ClickHouse:master' into npy_data_caching 2023-11-15 12:15:41 +01:00
Nikolai Kochetov
0a628de87c Try to fix hang in 01104_distributed_numbers_test 2023-11-14 17:42:10 +00:00
yariks5s
80dffe5823 fixed null due to review 2023-11-14 15:55:46 +00:00
Duc Canh Le
fa699a33c0 address review comments
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-14 15:26:57 +00:00
yariks5s
22a9f71393 fixed due to review 2023-11-14 13:15:14 +00:00
Alexey Milovidov
ac9f01079a
Merge pull request #56722 from ClickHouse/remove-orphan-headers
Remove orphan header files
2023-11-14 12:03:10 +01:00
Robert Schulze
2931bbfe62
Merge pull request #56665 from rschu1ze/refactor-ast-hash-calculation
Small refactoring of AST hash calculation (follow-up to #56545)
2023-11-14 11:24:30 +01:00
Alexey Milovidov
9bf62dd622 Remove orphan header files 2023-11-14 07:43:11 +01:00
Alexey Milovidov
c81cc3f953
Merge pull request #56660 from ClickHouse/better-ccache-2
Better use of build cache
2023-11-13 19:28:33 +01:00
Robert Schulze
d6df7d8403
Merge remote-tracking branch 'rschu1ze/master' into refactor-ast-hash-calculation 2023-11-13 15:54:21 +00:00
Alexey Milovidov
2ad98a58c9
Better caching of arrow build (#56657)
* Better caching of Arrow build
* Fix error
* Remove useless files
2023-11-13 16:51:01 +01:00
Kruglov Pavel
d5280df6d3
Merge pull request #56122 from bigo-sg/orc_tuple_field_prune
Allow tuple field pruning in ORC to speed up scaning
2023-11-13 14:46:43 +00:00
Robert Schulze
b899270372
Remove default value for argument 'ignore_aliases' from IAST::updateTreeHash() 2023-11-13 13:18:35 +00:00
Alexey Milovidov
82c461031e Fix build 2023-11-13 10:09:23 +01:00
Alexey Milovidov
9a7f5ab0a1 Better use of build cache 2023-11-13 08:54:24 +01:00
Alexey Milovidov
fcd45d47e4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-cpp-templates-2 2023-11-11 03:45:54 +01:00
Alexey Milovidov
c095b1e9ef
Merge pull request #56502 from amosbird/fix-56481
Fix two cases of projection analysis.
2023-11-11 02:29:04 +01:00
Alexey Milovidov
3bec4dce8e Merge branch 'master' into remove-cpp-templates-2 2023-11-11 00:50:32 +01:00
Maksim Kita
bf08f3ef5a
Revert "Inserting only non-duplicate chunks in MV" 2023-11-10 21:21:13 +03:00
Alexey Milovidov
8c253b9e3e Remove C++ templates 2023-11-10 05:25:02 +01:00
Amos Bird
51ca7d05fb
Fix tests 2023-11-10 10:23:03 +08:00
Amos Bird
16578d97a3
Fix two cases of projection analysis.
1. Fix projection analysis with partitions.
2. Apply alter conversions during projection analysis.
2023-11-10 10:23:02 +08:00
Nikolai Kochetov
0bfa2b6975
Merge pull request #56254 from ClickHouse/aggregate-by-partition-analyzer
Properly process aliases for aggregation-by-partition optimization.
2023-11-09 12:49:25 +01:00
Igor Nikonov
7c4d197ca5
Merge branch 'master' into pr-cleanup-remote-source 2023-11-08 19:38:15 +01:00
Yarik Briukhovetskyi
b8ea31db43
Merge pull request #56309 from yariks5s/preferred_optimize_projection_name
New setting preferred_projection_name
2023-11-08 18:06:03 +01:00
Nikolai Kochetov
7eacea4c51
Update src/Processors/QueryPlan/Optimizations/useDataParallelAggregation.cpp
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-11-08 17:28:57 +01:00
taiyang-li
6199bb83a9 Merge branch 'master' into orc_tuple_field_prune 2023-11-08 14:54:12 +08:00
yariks5s
6f6454e696 style check 2023-11-07 18:12:56 +00:00
yariks5s
181231d500 init 2023-11-07 17:56:02 +00:00
Robert Schulze
32a3b1b049
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 15:17:59 +00:00
Sema Checherinda
02df5ac59c
Merge pull request #54340 from KevinyhZou/bug_fix_csv_parse_crlf
Fix CSV read while the end of line is CR(\r)
2023-11-07 12:51:05 +01:00
Robert Schulze
54b5d573d7
Merge remote-tracking branch 'rschu1ze/master' into idatatype-convenience-functions 2023-11-07 10:18:30 +00:00
yariks5s
2e03462d87 style fix 2023-11-06 22:26:35 +00:00
edef
a52e22a858 Support reading arrow::LargeListArray 2023-11-06 21:17:29 +00:00
yariks5s
faba36225e fixed tests 2023-11-06 19:10:00 +00:00
yariks5s
ec32c23f0c style check 2023-11-06 15:25:14 +00:00
yariks5s
7206419a6b Merge branch 'preferred_optimize_projection_name' of github.com:yariks5s/ClickHouse into preferred_optimize_projection_name 2023-11-06 14:30:33 +00:00
yariks5s
e48e6b6a5a fixed review, changed tests 2023-11-06 14:30:10 +00:00
Robert Schulze
8896134531
Cleanup IDataType convenience functions 2023-11-06 13:25:32 +00:00
Alexander Tokmakov
eba52b318d
Merge pull request #56272 from ClickHouse/rdb_fix_rare_logical_error
Fix rare logical error in Replicated database
2023-11-06 14:14:55 +01:00
kevinyhzou
2a50daf5dd Allow cr at end of csv line 2023-11-06 12:21:42 +08:00
kevinyhzou
ef30e6723d bug fix csv read while end of line is not crlf 2023-11-06 12:21:42 +08:00
Igor Nikonov
9bdcba1b20
Merge branch 'master' into pr-progress-bar 2023-11-05 00:09:46 +01:00
Alexey Milovidov
36d18acf35
Merge pull request #55007 from Alex-Cheng/refactor-MergeJoinTransform
Refactor merge join transform
2023-11-04 17:08:07 +01:00
taiyang-li
8e23dd9090 add some comments 2023-11-04 10:08:26 +08:00
taiyang-li
8a6ae6e150 change as request 2023-11-04 09:41:01 +08:00
Dmitry Novik
23564148f9 Merge remote-tracking branch 'origin/master' into parallel-window 2023-11-03 17:53:51 +00:00
yariks5s
6d9b517b19 fix suggestions 2023-11-03 17:21:37 +00:00
Yarik Briukhovetskyi
92588dfac7
style fix 2023-11-03 18:07:19 +01:00
yariks5s
d95262622b init 2023-11-03 16:47:06 +00:00
Kruglov Pavel
7e4742f68a
Merge pull request #56167 from ClickHouse/revert-56150-revert-55989-lc-as-arrow-dict-fix
Revert "Revert "Fix output/input of Arrow dictionary column""
2023-11-03 16:18:10 +00:00
yariks5s
4235c690d4 init commit 2023-11-03 15:14:25 +00:00
vdimir
86524fce0f
Merge pull request #56246 from ClickHouse/vdimir/analyzer_01019_alter_materialized_view
Analyzer: fix 01019_alter_materialized_view_consistent
2023-11-03 11:04:14 +01:00
taiyang-li
4b7146d47e remove useless codes 2023-11-03 16:03:26 +08:00
Alexander Tokmakov
0ce1560e5d retry if table replica being restarted 2023-11-02 18:30:32 +01:00
Nikolai Kochetov
80d4e9a045 Merge branch 'master' into aggregate-by-partition-analyzer 2023-11-02 11:21:38 +00:00
Alexey Milovidov
1267246785
Merge pull request #55642 from ClickHouse/morton-utils
Indexing by space-filling curves
2023-11-02 12:21:33 +01:00
Nikolai Kochetov
5b6bf58730 Proper process aliases for aggregation-by-partition optimization. 2023-11-02 11:19:37 +00:00
vdimir
5703e0995b
Analyzer: fix 01019_alter_materialized_view_consistent 2023-11-02 10:27:22 +00:00
taiyang-li
819c7e75ff Merge branch 'master' into orc_tuple_field_prune 2023-11-02 17:52:05 +08:00
taiyang-li
6ccde98943 change as request 2023-11-02 11:01:50 +08:00
李扬
424f1bec93
Apply suggestions from code review
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2023-11-02 10:30:28 +08:00
李扬
c899ff9da2
Apply suggestions from code review
Co-authored-by: Kruglov Pavel <48961922+Avogar@users.noreply.github.com>
2023-11-02 10:30:14 +08:00
Alexey Milovidov
697f2591b9 Merge with master 2023-11-02 00:33:33 +01:00
Kruglov Pavel
aa7c1f63ab
Merge pull request #56172 from Avogar/fix-schema-cache-for-json
Fix schema cache for fallback JSON->JSONEachRow with changed settings
2023-11-01 20:24:34 +01:00
Kruglov Pavel
e6f00d5e1d
Merge pull request #56117 from bigo-sg/fixed_struct_field_prune
Improve parquet struct fields reading
2023-11-01 15:32:50 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
taiyang-li
dc897215da fix failed uts tests/queries/0_stateless/02312_parquet_orc_arrow_names_tuples.sql 2023-11-01 20:42:07 +08:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00
taiyang-li
24c45a4ee0 fix failed uts 2023-11-01 18:47:11 +08:00
taiyang-li
001cbe7912 fix typos 2023-11-01 16:58:25 +08:00
taiyang-li
b276587422 fix failed uts 2023-11-01 15:43:20 +08:00
lgbo-ustc
8334585eaf improve parquet struct field reading 2023-11-01 15:18:39 +08:00