avogar
b6c91d9ace
Support Decimals and Date32 in Avro format
2023-03-10 15:48:18 +00:00
Igor Nikonov
acffc98bd1
Fix build
2023-03-09 12:22:32 +00:00
Kruglov Pavel
fe973f3d6f
Merge branch 'master' into native-types-conversions
2023-03-09 13:03:25 +01:00
Kruglov Pavel
71b6d6c6ae
Merge pull request #47114 from Avogar/parquet-compression
...
Improve working with compression methods in Parquet/ORC/Arrow formats
2023-03-09 13:02:18 +01:00
Igor Nikonov
2ea3faf90c
Remove distinct on top of MergingAggregatedStep as well
2023-03-09 11:44:38 +00:00
Igor Nikonov
feefce7de5
Test + remove debug logging
2023-03-09 09:24:50 +00:00
Azat Khuzhin
d7b5e36218
Merge branch 'master' into mv-ignore-errors
2023-03-08 22:13:05 +01:00
Igor Nikonov
c952886e66
Merge remote-tracking branch 'origin/master' into query-plan-update-sort-description
2023-03-08 18:09:37 +00:00
Igor Nikonov
cfa7119fa7
Fix: apply reading in order for distinct
...
+ respect aliases
2023-03-08 17:56:33 +00:00
avogar
79ef95bc0c
Fix tests and builds
2023-03-08 12:54:22 +00:00
Maksim Kita
b6f3b81403
Query plan filter push down optimization filled JOIN fix
2023-03-08 11:16:06 +01:00
Vladimir C
4f048ce535
Merge pull request #47153 from ClickHouse/vdimir/grace_hash_limit_race_45986
2023-03-08 10:18:32 +01:00
Igor Nikonov
3f7dd78c9b
Merge remote-tracking branch 'origin/master' into query-plan-update-sort-description
2023-03-07 22:45:31 +00:00
Igor Nikonov
79d4d029b8
Fix Distinct properties
2023-03-07 22:40:11 +00:00
Igor Nikonov
6f2851ef70
Update FilterStep
2023-03-07 22:16:22 +00:00
Igor Nikonov
e88912009a
Update data streams for entire plan
2023-03-07 20:49:55 +00:00
Alexander Tokmakov
ffd55d951d
Merge branch 'master' into followup_46681
2023-03-07 23:38:06 +03:00
Kruglov Pavel
69a1309ade
Merge branch 'master' into native-types-conversions
2023-03-07 20:06:17 +01:00
Kruglov Pavel
ba0cc95441
Fix typo
2023-03-07 20:04:52 +01:00
Igor Nikonov
5f5e15f8c1
Update sort description to respect aliases in header
2023-03-07 18:28:10 +00:00
Nikolai Kochetov
8186473cc2
Remove some commented code.
2023-03-07 14:28:28 +00:00
Alexander Tokmakov
7ce20f5cd2
fix tests
2023-03-07 14:25:28 +01:00
Alexey Perevyshin
e676c1de0b
Merge branch 'master' into master
2023-03-07 09:48:49 +03:00
Kruglov Pavel
479cd9b90b
Merge pull request #46972 from Avogar/json-date-int-inference
...
Fix date and int inference from string in JSON
2023-03-06 20:40:38 +01:00
Kruglov Pavel
3de905bb7c
Merge pull request #46616 from Avogar/fix-ipv4-ipv6-formats
...
Fix IPv4/IPv6 serialization/deserialization in binary formats
2023-03-06 19:40:29 +01:00
Kruglov Pavel
fed645a494
Don't use switch
2023-03-06 18:03:54 +01:00
Kruglov Pavel
df34ab240d
Don't use switch
2023-03-06 18:03:17 +01:00
Vladimir C
3076e92980
Apply suggestions from code review
...
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
2023-03-06 16:56:02 +01:00
avogar
d8e5fb5195
Use switch, use lz4 by default
2023-03-06 15:12:15 +00:00
Vladimir C
48f644a958
Fix style in JoiningTransform.cpp
2023-03-06 10:38:21 +01:00
vdimir
a0f5756751
Fix DelayedJoinedBlocksWorkerTransform for grace hash join
2023-03-03 16:30:01 +00:00
Alexander Tokmakov
cadaf06829
Merge pull request #46681 from ClickHouse/fix_insert_cancellation_in_native_protocol
...
Fix queries cancellation when a client dies
2023-03-03 16:27:20 +03:00
Maksim Kita
3cd88003dd
Merge pull request #47101 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
...
Analyzer Planner fixes before enable by default
2023-03-02 22:16:39 +03:00
Alexander Tokmakov
c518f3690e
Merge branch 'master' into fix_insert_cancellation_in_native_protocol
2023-03-02 18:24:08 +01:00
Kruglov Pavel
3b034e7c35
Merge branch 'master' into parquet-compression
2023-03-02 15:55:48 +01:00
Robert Schulze
740aeaba1f
Apply some CTAD
2023-03-02 13:36:47 +00:00
Kruglov Pavel
ce8e49a9a0
Merge pull request #45693 from Avogar/fix-kafka-protobuf
...
Fix formats parser resetting, test processing bad messages in kafka
2023-03-02 11:50:45 +01:00
avogar
a6cf2cdab8
Fix style, add docs
2023-03-02 10:36:07 +00:00
Alexey Milovidov
57ac42f48b
Merge pull request #46804 from nickitat/async_reading_small_limit
...
Fix async reading pipeline when small limit is present
2023-03-02 02:30:19 +03:00
avogar
5ab5902f38
Allow control compression in Parquet/ORC/Arrow output formats, support more compression for input formats
2023-03-01 21:27:46 +00:00
Maksim Kita
51ee007e01
Fixed tests
2023-03-01 18:05:07 +01:00
Alexander Tokmakov
a97e15e36f
Merge branch 'master' into fix_insert_cancellation_in_native_protocol
2023-03-01 14:26:41 +01:00
Kseniia Sumarokova
fc619d06ba
Merge pull request #40807 from maks-buren630501/master
...
Fix create materialized view with MaterializedPostgreSQL
2023-02-28 15:10:14 +01:00
Kruglov Pavel
65f06fc9b1
Merge branch 'master' into json-date-int-inference
2023-02-28 14:31:57 +01:00
Kruglov Pavel
545e5c0f5b
Merge pull request #46617 from Avogar/use-parquet-2
...
Change default parquet format version to v2_latest, add a setting to controle the version
2023-02-28 14:30:59 +01:00
kssenii
24ce30c41b
Merge remote-tracking branch 'upstream/master' into maks-buren630501-master
2023-02-27 22:06:11 +01:00
avogar
ab899bf2f3
Allow types conversion in Native input format
2023-02-27 19:28:19 +00:00
Nikolai Kochetov
1e0ea2446e
Refactor a bit.
2023-02-27 16:59:32 +00:00
Nikolai Kochetov
9bf828cc98
Refactor a bit.
2023-02-27 16:43:54 +00:00
avogar
2e921e3d6b
Fix date and int inference from string in JSON
2023-02-27 16:00:19 +00:00
Nikolai Kochetov
0400677483
makeMaterializingDAG
2023-02-27 15:41:50 +00:00
avogar
12a9ff36b2
Better exception messages when schema_inference_hints is ill-formatted
2023-02-27 15:20:56 +00:00
Kruglov Pavel
443dedddca
Merge branch 'master' into use-parquet-2
2023-02-27 14:31:43 +01:00
Nikolai Kochetov
3392b96cc3
Merge branch 'master' into aggregate-projections-analysis-query-plan
2023-02-27 14:07:04 +01:00
Nikita Taranov
70d5a41c51
impl
2023-02-27 13:57:29 +01:00
Yakov Olkhovskiy
7b8d2d716e
bypass empty blocks
2023-02-25 23:26:38 +00:00
Nikolai Kochetov
7045ed539f
Refactor a bit more.
2023-02-24 20:04:12 +00:00
Nikolai Kochetov
53b006dd5c
Refactor a bit more.
2023-02-24 19:59:13 +00:00
Nikolai Kochetov
030a0ba7fb
Refactor a bit more.
2023-02-24 18:39:27 +00:00
avogar
12b38ece1d
Fix build
2023-02-24 13:07:09 +00:00
Kruglov Pavel
2150b836b1
Merge branch 'master' into fix-kafka-protobuf
2023-02-24 12:48:07 +01:00
Alexander Tokmakov
fe92fd8a61
Merge branch 'master' into fix_insert_cancellation_in_native_protocol
2023-02-23 22:35:31 +01:00
Nikolai Kochetov
c63bbbb374
Refactor a bit more.
2023-02-23 20:22:12 +00:00
Alexander Tokmakov
d21a6a3ba4
fix
2023-02-23 20:52:39 +01:00
Kruglov Pavel
47f9ca2166
Merge branch 'master' into fix-ipv4-ipv6-formats
2023-02-23 20:32:43 +01:00
avogar
54622566df
Add setting to change parquet version
2023-02-23 16:14:10 +00:00
Anton Popov
955b54a6f8
Merge pull request #46753 from CurtizJ/fallback-from-async-insert
...
Fallback from async insert in case of large amount of data
2023-02-23 16:21:44 +01:00
Kruglov Pavel
35887911e3
Merge pull request #46284 from Avogar/null-as-default-all-formats
...
Extend setting `input_format_null_as_default` for more formats
2023-02-23 14:48:22 +01:00
Igor Nikonov
271b72abf4
Merge pull request #46642 from ClickHouse/remove_redundant_sorting_fix
...
Fix: remove redundant sorting optimization
2023-02-22 23:33:15 +01:00
Anton Popov
d5864fa88e
allow to fallback from async insert in case of large amount of data
2023-02-22 21:59:24 +00:00
Nikolai Kochetov
c8ce1f2b50
Refactor a bit.
2023-02-22 17:27:21 +00:00
Nikolai Kochetov
67db9123d8
Refactor a bit.
2023-02-22 16:40:40 +00:00
flynn
678e4250cd
Fix incorrect predicate push down with grouping sets ( #46151 )
2023-02-22 11:54:19 +01:00
Azat Khuzhin
d0b50adffa
Remove materialized_views_ignore_errors from FinalizingViewsTransform
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-22 11:00:14 +01:00
Alexander Tokmakov
f5c232707d
cancel insert queries correctly
2023-02-21 22:04:39 +01:00
Nikolai Kochetov
a0b88f0a2d
Fix typos.
2023-02-21 20:01:59 +00:00
Nikolai Kochetov
a47860af17
Fixing more tests.
2023-02-21 19:50:17 +00:00
Igor Nikonov
807a49021c
Merge remote-tracking branch 'origin/master' into remove_redundant_sorting_fix
2023-02-21 16:59:16 +00:00
Igor Nikonov
45b1b66fd8
Remove unnecessary comment
2023-02-21 16:58:45 +00:00
Azat Khuzhin
81435282ec
Add an entry to system.query_views_log regardless of materialized_views_ignore_errors
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-21 17:23:19 +01:00
Kruglov Pavel
a25255cabc
Update StreamingFormatExecutor.h
2023-02-21 16:57:44 +01:00
Kruglov Pavel
ef0d6becba
Merge branch 'master' into null-as-default-all-formats
2023-02-21 16:52:39 +01:00
Nikolai Kochetov
c5f93eb108
Fix more tests.
2023-02-21 15:44:50 +00:00
Azat Khuzhin
a110e0f022
Allow to ignore errors while pushing to MATERILIZED VIEW
...
This can be useful in the following scenarious:
- you want to duplicate the data to another table and you don't care
about the errors
- you want to duplicate system.*_log to another server, you are adding
materialized view that will push to Distributed table, but you don't
want to miss original blocks in the local system.*_log
- you want to push some data to a 3d party service, using i.e. URL
engine.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-21 16:28:38 +01:00
Alexander Gololobov
5354b0d069
Merge pull request #46140 from ClickHouse/split_prewhere_dag
...
Split PREWHERE DAG into multiple read steps
2023-02-21 14:37:09 +01:00
Kseniia Sumarokova
1f3be929f7
Update ReadFromMergeTree.cpp
2023-02-21 12:50:26 +01:00
Igor Nikonov
2dfc0d008b
Fix: remove redundant sorting optimization
...
+ incorrect sorting step removal in case of parent step has more than 1
children
2023-02-21 11:48:28 +00:00
Nikita Taranov
593de3416b
Fix typo in read prefetch
2023-02-21 12:27:08 +01:00
Kruglov Pavel
828a06b511
Merge branch 'master' into fix-kafka-protobuf
2023-02-20 21:45:43 +01:00
Kruglov Pavel
b0424c1021
Merge pull request #46171 from Avogar/insert-null-as-default
...
Use default of column type in `insert_null_as_default` if column DEFAULT values is not specified
2023-02-20 21:45:02 +01:00
avogar
a568704d63
Fix avro
2023-02-20 20:43:28 +00:00
Kruglov Pavel
9866ecfe8b
Merge branch 'master' into null-as-default-all-formats
2023-02-20 20:49:30 +01:00
Nikolai Kochetov
ee597b939f
Merge branch 'master' into aggregate-projections-analysis-query-plan
2023-02-20 19:46:52 +00:00
Maksim Kita
4d23f74a53
Merge pull request #46494 from kitaisreal/query-plan-filter-push-down-sorting-fix
...
Planner filter push down optimization fix
2023-02-20 21:36:34 +03:00
Nikolai Kochetov
37a5e10b75
Fix more tests.
2023-02-20 17:55:10 +00:00
avogar
42ae0582d3
Try to use parquet v2 instead of v1 in output format
2023-02-20 17:46:54 +00:00
avogar
8da3594cd8
Fix IPv4/IPv6 serialization/deserialization in binary formats
2023-02-20 17:42:56 +00:00
Nikolai Kochetov
84e442e620
Fixing build and style.
2023-02-20 14:21:20 +00:00
Nikolai Kochetov
2a8460d962
Merge branch 'master' into aggregate-projections-analysis-query-plan
2023-02-20 13:54:05 +01:00
Alexey Milovidov
d8cda3dbb8
Remove PVS-Studio
2023-02-19 23:30:05 +01:00
Alexey Milovidov
17992b178a
Merge pull request #45364 from nickitat/aggr_partitions_independently
...
Add option to aggregate partitions independently
2023-02-19 17:44:18 +03:00
Maksim Kita
72719584ea
Planner filter push down optimization fix
2023-02-19 12:02:59 +01:00
Maksim Kita
6dffe52e68
Merge pull request #46471 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
...
Analyzer planner fixes before enable by default
2023-02-19 13:49:18 +03:00
Maksim Kita
cbd961de98
Fixed code review issues
2023-02-18 17:06:00 +01:00
Nikita Taranov
eee39b7bd1
bring back lost lines
2023-02-18 14:30:49 +00:00
Nikita Taranov
ef61c22167
another review fixes
2023-02-18 14:26:24 +00:00
Nikita Taranov
f70044f34b
Merge branch 'master' into aggr_partitions_independently
2023-02-18 13:19:05 +00:00
Kseniia Sumarokova
bda4c94f66
Merge pull request #45384 from ucasfl/iceberg
2023-02-17 23:38:24 +01:00
Igor Nikonov
0bad474fb5
Merge pull request #44176 from ClickHouse/igor/remove_redundant_distinct
...
Remove redundant DISTINCT
2023-02-17 22:07:03 +01:00
Nikolai Kochetov
6de781afcc
Fix 01710 tests.
2023-02-17 19:18:46 +00:00
Igor Nikonov
486501296c
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-17 14:40:02 +00:00
Igor Nikonov
64dfc9f8ce
Fix clang-analyzer warning
2023-02-17 14:39:20 +00:00
flynn
ebd88aab41
Merge branch 'master' into iceberg
2023-02-17 21:53:29 +08:00
Igor Nikonov
3871959605
Merge branch 'master' into fix-crash-with-distinct
2023-02-17 11:43:43 +01:00
Alexey Milovidov
993a39e2a1
Merge pull request #46360 from genzgd/http_client_version
...
Allow to provide the protocol version by HTTP clients to tune the compatibility of the Native output format.
2023-02-16 22:17:04 +03:00
Nikolai Kochetov
9cca571777
Fix constants in the result of MergingSortedAlgorithm.
2023-02-16 17:58:35 +00:00
Alexander Gololobov
a6061e022e
Merge branch 'master' into split_prewhere_dag
2023-02-16 14:43:58 +01:00
youennL-cs
6526c2a8ab
[RFC] Replacing merge tree new engine ( #41005 )
...
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree
* Add new test for the new ReplacingMergeTree engine
* Limit sign value to -1/1
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree
* Add new test for the new ReplacingMergeTree engine
* Limit sign value to -1/1
* Replace sign column(Int8) by is_deleted(UInt8)
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree
* Add new test for the new ReplacingMergeTree engine
* Limit sign value to -1/1
* Replace sign column(Int8) by is_deleted(UInt8)
* Add new engine to ReplacingMergeTree corresponding to the ReplacingCollapsingMergeTree
* Add new test for the new ReplacingMergeTree engine
* Limit sign value to -1/1
* Replace sign column(Int8) by is_deleted(UInt8)
* Add keyword 'CLEANUP' when OPTIMIZE
* Cleanup uniquely when it's a replacingMergeTree
* Propagate CLEANUP information and change from 'with_cleanup' to 'cleanup'
* Cleanup data flagged as 'is_deleted'
* Fix merge when optimize and add a test
* Fix OPTIMIZE and INSERT + add tests
* New fix for cleanup at the merge
* Cleanup debug logs
* Add the SETTINGS option 'clean_deleted_rows' that can be 'never' or 'always'
* Fix regression bug; Now REplicatedMergeTree can be called as before without 'is_deleted'
* Add Replicated tests
* Disable tag 'long' for our test and cleanup some white spaces
* Update tests
* Fix tests and remove additional useless whitespace
* Fix replica test
* Style clean && add condition check for is_deleted values
* clean_deleted_rows settings is nom an enum
* Add valid default value to the clean_deleted_rows settings
* Update cleanup checkers to use the enum and fix typos in the test
* Fix submodule contrib/AMQP-CPP pointer
* Add missing messages in test reference and remove a print with non derterministic order
* fix replica test reference
* Fix edge case
* Fix a typo for the spell checker
* Fix reference
* Fix a condition to raise an error if is_deleted differ from 0/1 and cleanup
* Change tests file name and update number
* This should fix the ReplacingMergeTree parameter set
* Fix replicated parameters
* Disable allow_deprecated_syntax_for_merge_tree for our new column
* Fix a test
* Remove non deterministic order print in the test
* Test on replicas
* Remove a condition, when checking optional parameters, that should not be sueful since we disabled the deprected_syntaxe
* Revert "Remove a condition, when checking optional parameters, that should not be useful since we disabled the deprected_syntaxe"
This reverts commit b65d64c05e
2023-02-16 16:03:16 +03:00
Maksim Kita
b72ea982b0
Remove unnecessary includes of InterpreterSelectQuery header
2023-02-16 12:17:03 +01:00
Maksim Kita
4ddf1b0f48
Planner filter push down optimization fix
2023-02-16 12:17:03 +01:00
Maksim Kita
80af0666ea
Analyzer support Materialized View
2023-02-16 12:17:03 +01:00
Maksim Kita
077555bd5d
Analyzer support build pushing to views chain
2023-02-16 12:17:03 +01:00
Maksim Kita
f8442b2a8d
Analyzer support LiveView
2023-02-16 12:17:03 +01:00
Kseniia Sumarokova
947753bd4c
Merge pull request #46409 from kssenii/follow-up-to-46168
...
Follow-up to #46168
2023-02-16 11:26:54 +01:00
Nikolay Degterinsky
ebec5b8050
Merge pull request #46422 from evillique/move-sources
...
Move MongoDB and PostgreSQL sources to Sources folder
2023-02-16 10:51:45 +01:00
flynn
ecc39978d7
fix conflict
2023-02-16 02:23:55 +00:00
Alexander Tokmakov
53e32b19e6
Update AggregatingTransform.cpp
2023-02-16 02:13:18 +03:00
Igor Nikonov
cb89fccac6
Disable debug output
2023-02-15 21:26:00 +00:00
Igor Nikonov
766f04b04c
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-15 21:24:25 +00:00
Nikolai Kochetov
f524dae924
Fix more tests.
2023-02-15 19:17:24 +00:00
alexX512
26fd12e0c7
Add checking for source processors in executing graph
2023-02-15 15:40:42 +00:00
Vladimir C
3e77463125
Merge pull request #46256 from bigo-sg/window_functions
2023-02-15 15:36:41 +01:00
Kruglov Pavel
e56dead5aa
Merge branch 'master' into fix-kafka-protobuf
2023-02-15 15:16:25 +01:00
Vladimir C
645fee3d94
Merge pull request #46009 from ClickHouse/vdimir/fix_read_in_order_final_desc
2023-02-15 11:23:07 +01:00
Nikolay Degterinsky
bcc4adf73d
Merge branch 'master' into move-sources
2023-02-15 08:46:09 +01:00
alexX512
5aabfe8644
Hard cancel for pipeline executor
2023-02-15 06:50:33 +00:00
lgbo-ustc
bfbd880475
fixed binary_tidy build failure
2023-02-15 08:44:10 +08:00
Nikolay Degterinsky
6e4b660033
Move MongoDB and PostgreSQL sources to Sources folder
2023-02-14 22:35:10 +00:00
Igor Nikonov
3eef3bf643
Simplify aggregation pass
...
always checking AggregatingStep and skipping Rollup, Cube, TotalsHaving
2023-02-14 21:49:56 +00:00
alexX512
e424ad9ba8
Delete unimportant logs
2023-02-14 21:24:33 +00:00
alexX512
b466855e04
Add hard_cancel mod
2023-02-14 21:20:01 +00:00
Igor Nikonov
425b99afca
GROUP BY WITH TOTALS
2023-02-14 21:14:41 +00:00
Nikolai Kochetov
62bce41d3d
Fix more tests.
2023-02-14 19:31:20 +00:00
Kseniia Sumarokova
fe155bb210
Merge branch 'master' into follow-up-to-46168
2023-02-14 18:28:46 +01:00
Geoff Genz
f3bcf26959
Merge branch 'ClickHouse:master' into http_client_version
2023-02-14 09:31:29 -07:00
kssenii
5bda358fb7
Follow-up to #46168
2023-02-14 15:45:38 +01:00
flynn
e05b4e9745
fix conflict
2023-02-14 13:49:28 +00:00
Nikita Taranov
cbd10c4493
Fix mbm with aio on top of query plan ( #45892 )
2023-02-14 14:02:54 +01:00
Igor Nikonov
49763f7dc2
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-14 12:13:22 +00:00
Igor Nikonov
7e24b5f059
Fix tests & review comment
2023-02-14 12:10:02 +00:00
Geoff Genz
2857b16562
Merge branch 'ClickHouse:master' into http_client_version
2023-02-14 03:41:17 -07:00
robot-ch-test-poll4
7c420f0982
Merge pull request #46350 from CurtizJ/fix-format-values
...
Fix `LOGICAL_ERROR` in async inserts with invalid data in format `VALUES`
2023-02-14 10:12:08 +01:00
Alexey Milovidov
307551f857
Update NativeFormat.cpp
2023-02-14 11:08:33 +03:00
lgbo-ustc
74d6ccad4f
fixed
...
change window specification as (partition by a order by b rows between unbounded preceding and unbounded following)
2023-02-14 15:49:12 +08:00
lgbo-ustc
0b32a655a8
fixed
2023-02-14 15:49:12 +08:00
lgbo-ustc
9a496aea6a
add new window function, ntile
2023-02-14 15:49:11 +08:00
Nikolai Kochetov
522a39f93f
Normal Projections analysis using query plan [In progress]
2023-02-13 19:56:31 +00:00
Nikolai Kochetov
e6e486c4a1
Not crash with minmax projection.
2023-02-13 17:10:10 +00:00
Nikolai Kochetov
d6ea566b20
Mostly support minmax projection.
2023-02-13 16:52:21 +00:00
Geoff Genz
be8bf3a6a3
Merge branch 'master' into http_client_version
2023-02-13 08:43:59 -07:00
Anton Popov
7f31196606
fix LOGICAL_ERROR in async inserts
2023-02-13 14:59:14 +00:00
Kruglov Pavel
e139070043
Merge branch 'master' into fix-kafka-protobuf
2023-02-13 12:38:18 +01:00
Vladimir C
89cb55aa1f
whitespace
2023-02-13 12:19:31 +01:00
Vladimir C
1a89ecd386
Apply suggestions from code review
...
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-02-13 12:17:56 +01:00
vdimir
e4c0afcc3e
Do not build filtering set for sorting join with const columns
2023-02-13 12:17:56 +01:00
Alexander Gololobov
8fc08c74f0
Pass action_settings to getReadTaskColumns()
2023-02-12 21:55:53 +01:00
Alexander Gololobov
7634b9f56e
Added settings to enable the new logic
2023-02-12 21:54:23 +01:00
kssenii
3067c1d723
Merge remote-tracking branch 'upstream/master' into resubmit-prefetches
2023-02-11 11:36:23 +01:00
Alexander Gololobov
f2a975f548
Merge pull request #46270 from Avogar/fix-arrow-lc
...
Fix possible out of bounds error while reading LowCardinality(Nullable) in Arrow format
2023-02-11 10:03:00 +01:00
Vladimir C
ea670acb72
Add comment to requestReadingInOrder
2023-02-10 20:05:18 +01:00
Kruglov Pavel
8bbf62508f
Merge branch 'master' into fix-kafka-protobuf
2023-02-10 18:32:25 +01:00
Kruglov Pavel
2a3cb8b4ee
Merge pull request #45340 from Avogar/parquet-fixed-binary
...
Support FixedSizeBinary type in Parquet/Arrow
2023-02-10 18:31:20 +01:00
avogar
04cf144edc
Fix TSKV, update docs
2023-02-10 17:20:51 +00:00
Alexey Milovidov
d5d87bc6b7
Merge pull request #46152 from ClickHouse/with-fill-bigint
...
More convenient usage of big integers and ORDER BY WITH FILL.
2023-02-10 20:05:32 +03:00
avogar
d1efd02480
Extend setting input_format_null_as_default for more formats
2023-02-10 16:41:09 +00:00
avogar
deda940d87
Fix possible out of bounds error while reading LowCardinality(Nullable) in Arrow format
2023-02-10 12:57:47 +00:00
Geoff Genz
99c3ff53c5
Merge remote-tracking branch 'origin/master' into http_client_version
...
# Conflicts:
# src/Interpreters/Context.cpp
# src/Interpreters/Context.h
2023-02-10 04:35:53 -07:00
Geoff Genz
db982695fa
Simplify NativeOutputFormat constructors
2023-02-10 04:30:08 -07:00
Geoff Genz
7ed8ed0284
Add support for client_protocol_version sent with HTTP
2023-02-10 03:47:06 -07:00
flynn
37a850bd36
Merge branch 'master' of github.com:ClickHouse/ClickHouse into iceberg
2023-02-10 08:47:14 +00:00
flynn
db15634a01
fix conflict
2023-02-10 08:41:04 +00:00
avogar
ba761e04d7
Handle unknown exceptions
2023-02-09 12:31:01 +00:00
Kruglov Pavel
c3c0356fdd
Merge branch 'master' into fix-kafka-protobuf
2023-02-09 13:04:55 +01:00
Igor Nikonov
df23731061
Removing DISTINCT on top of aggregation if possible
2023-02-09 11:37:15 +00:00
vdimir
45f7ef6c8f
Do not apply read in reverse order for queries with final
2023-02-09 11:00:22 +00:00
vdimir
a179528ea4
Revert "Fix read in order optimization for DESC sorting with FINAL"
...
This reverts commit cf762347d5
2023-02-09 10:47:45 +00:00
Robert Schulze
e490ec91d9
Merge branch 'master' into rs/fix-fragile-linking
2023-02-09 11:33:59 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary
2023-02-09 11:26:38 +01:00
vdimir
cf762347d5
Fix read in order optimization for DESC sorting with FINAL
2023-02-09 10:26:37 +00:00
Vladimir C
0042c20770
Merge pull request #46054 from alexX512/bug_fix_pulling_pipeline
2023-02-09 10:50:46 +01:00
Alexey Milovidov
3a75ede60a
Implement #16733
2023-02-09 08:41:47 +01:00
Alexey Milovidov
cb847172ea
Fix something
2023-02-09 08:39:46 +01:00
Alexey Milovidov
a40ef2bf18
Make it better
2023-02-09 08:09:19 +01:00
Alexey Milovidov
292a5abbc9
Merge remote-tracking branch 'origin/master' into with-fill-bigint
2023-02-09 01:47:51 +01:00
Alexander Tokmakov
8101b044fa
Merge pull request #46091 from azat/sanity-assertions
...
Sanity assertions for closing file descriptors
2023-02-09 01:02:03 +03:00
kssenii
b0b865c32e
Resubmit prefetches
2023-02-08 21:26:24 +01:00
avogar
c3e8dd8984
Fix low cardinality case
2023-02-08 19:14:28 +00:00
Nikolai Kochetov
e7dba2a85b
Partly support minmax projection.
2023-02-08 18:34:22 +00:00
Nikolai Kochetov
d04b3a30cc
Fix 01710_projections_partial_optimize_aggregation_in_order
2023-02-08 14:26:20 +00:00
Nikolai Kochetov
f30d1efe2f
Fix test 01710_projections.
2023-02-08 13:32:34 +00:00
Robert Schulze
6ff232d782
Merge branch 'master' into rs/fix-fragile-linking
2023-02-08 12:51:12 +01:00
Kruglov Pavel
4e2918cee3
Merge branch 'master' into parquet-fixed-binary
2023-02-08 12:31:13 +01:00
Igor Nikonov
72c393e7c4
Merge pull request #46014 from ClickHouse/inorder-optimization-update-sorting-properties
...
Update sorting properties after reading in order applied
2023-02-08 10:19:47 +01:00
Alexey Milovidov
a9ec73a209
Fix strange trash
2023-02-08 08:26:27 +01:00
Igor Nikonov
5709c9832c
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-07 11:49:25 +00:00
Igor Nikonov
14f8eff290
Fixes: checking if steps between DISTINCTs can generate new rows
2023-02-07 11:48:23 +00:00
Robert Schulze
08c1f8346e
Merge remote-tracking branch 'origin/master' into rs/fix-fragile-linking
2023-02-07 11:22:00 +00:00
Azat Khuzhin
8cc41b7f41
Check return value of ::close()
...
Note, that according close(2), EINTR should not be retriable for close()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-07 11:28:22 +01:00
Anton Popov
3ad5a085da
Merge pull request #45987 from CurtizJ/fix-sparse-columns-crash
...
Fix `INTERSECT` and `EXCEPT` with sparse columns
2023-02-06 23:01:02 +01:00
Nikolai Kochetov
b2cc2332f5
Fix 01710_force_use_projection.
2023-02-06 19:20:03 +00:00
Nikolai Kochetov
a542626fa3
Make 01710_aggregate_projections work.
2023-02-06 18:42:58 +00:00
Alexey Perevyshin
7a4d658a46
Merge branch 'master' into bug_fix_pulling_pipeline
2023-02-06 14:24:26 +03:00
flynn
0dd8a61a8e
fix conflict
2023-02-06 03:25:12 +00:00
Robert Schulze
84b9ff450f
Fix terribly broken, fragile and potentially cyclic linking
...
Sorry for the clickbaity title. This is about static method
ConnectionTimeouts::getHTTPTimeouts(). It was be declared in header
IO/ConnectionTimeouts.h, and defined in header
IO/ConnectionTimeoutsContext.h (!). This is weird and caused issues with
linking on s390x (##45520). There was an attempt to fix some
inconsistencies (#45848 ) but neither did @Algunenano nor me at first
really understand why the definition is in the header.
Turns out that ConnectionTimeoutsContext.h is only #include'd from
source files which are part of the normal server build BUT NOT part of
the keeper standalone build (which must be enabled via CMake
-DBUILD_STANDALONE_KEEPER=1). This dependency was not documented and as
a result, some misguided workarounds were introduced earlier, e.g.
0341c6c54b
2023-02-05 20:49:34 +00:00
Igor Nikonov
089a0009ad
Polishing
...
+ try to stabilize distinct in order perf test
2023-02-05 13:38:20 +00:00
alexX512
ea07f08f75
Fix bug with wrong checking of execution finish in PullingAsyncPipeline
2023-02-05 13:23:26 +00:00
flynn
f89a6cf68d
Improve format JSONColumns when result is empty
2023-02-05 13:13:21 +00:00
alexX512
3482960f90
Merge branch 'master' of github.com:ClickHouse/ClickHouse
2023-02-05 13:08:49 +00:00
alexX512
b31decc15a
Fix bug with wrong checking of execution finish in PullingAsyncPipeline
2023-02-05 12:54:50 +00:00
Nikita Taranov
1f1be6195e
fix
2023-02-04 21:54:48 +00:00
Nikita Taranov
750933d265
fix
2023-02-04 21:09:44 +00:00
Nikita Taranov
b983b363f8
Merge branch 'master' into aggr_partitions_independently
2023-02-04 18:24:31 +00:00
Nikita Taranov
5183cc6ee5
fix
2023-02-04 16:14:53 +00:00
Nikolai Kochetov
310a4c69af
Aggregate Projections analysis using query plan [In progress]
2023-02-03 18:30:06 +00:00
Igor Nikonov
f49f5d7091
Update tests
...
+ updadte sorting properties after applying aggregation in order
2023-02-03 17:10:31 +00:00
Igor Nikonov
38a0ef8743
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-03 15:13:06 +00:00
Igor Nikonov
82e50fc211
Fix review comments
2023-02-03 15:12:20 +00:00
Anton Popov
88f2068bfb
Merge branch 'master' into fix-sparse-columns-crash
2023-02-03 16:01:11 +01:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] ( #43772 )
2023-02-03 14:34:18 +01:00
Igor Nikonov
ed00db7580
Update sorting properties after reading in order applied
2023-02-03 13:15:06 +00:00
Igor Nikonov
7b922784e8
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-03 10:29:37 +00:00
Robert Schulze
6908093787
Merge pull request #45973 from ClickHouse/final-codecs
...
Add "final" specifier to some classes
2023-02-03 10:52:59 +01:00
Anton Popov
ca20b1e32f
fix INTERSECT and EXCEPT with sparse columns
2023-02-03 00:17:55 +00:00
Igor Nikonov
46ed757472
Fix review comments
2023-02-02 20:07:47 +00:00
Robert Schulze
3472ed4f0d
Make some classes 'final'
2023-02-02 15:59:39 +00:00
Antonio Andelic
a39e4e24c6
Merge branch 'master' into optimize_parquet_reader
2023-02-02 14:18:00 +01:00
Igor Nikonov
32ab4dc693
Fix review comments
2023-02-02 11:46:13 +00:00
Igor Nikonov
996b833faa
Some polishing
2023-02-02 11:14:26 +00:00
Alexey Milovidov
97b6934ed6
Update ParquetBlockInputFormat.cpp
2023-02-02 02:42:21 +03:00
Nikita Taranov
4fbbca075b
review fixes
2023-02-01 23:01:02 +00:00
Igor Nikonov
8f873d5682
Disable optimize_duplicate_order_by_and_distinct
...
+ tests
2023-02-01 21:13:44 +00:00
Nikolai Kochetov
ae420b30e5
Aggregate Projections analysis using query plan [In progress]
2023-02-01 17:55:06 +00:00
Igor Nikonov
fc71acc768
Fix DISTINCT with intersect/except
2023-02-01 13:06:34 +00:00
Igor Nikonov
d3d5e67a36
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-02-01 12:03:06 +00:00
liuneng
17fc22a21e
add parquet max_block_size setting
2023-02-01 18:29:20 +08:00
Robert Schulze
b512316586
Merge pull request #45682 from ClickHouse/rename-qrc-to-qc
...
Rename "Query Result Cache" to "Query Cache"
2023-02-01 11:23:29 +01:00
liuneng
cda9b0beea
optimize parquet reader
2023-02-01 15:54:10 +08:00
Nikolai Kochetov
e2c32ccbca
Aggregate Projections analysis using query plan [In progress]
2023-01-31 20:33:01 +00:00
Alexey Milovidov
075dfe9005
Merge pull request #45750 from ucasfl/arrow-duration
...
Arrow support duration type
2023-01-31 20:34:38 +03:00
flynn
ffddc0dcce
fix conflict
2023-01-31 10:28:58 +00:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
...
Reasons:
- The cache will at some point store intermediate results as opposed to
only query results. We should change the terminology now without
having to worry about backward compat.
- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
cache".
- The new name is ca. 13.8% more catchy.
(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Igor Nikonov
f8bcf78593
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-01-30 23:12:09 +00:00
Igor Nikonov
fdb9336b02
Respect aliases when compare DISTINCT columns
2023-01-30 23:08:26 +00:00
Nikita Taranov
8223fc6ab9
stash
2023-01-30 23:02:27 +00:00
Nikolai Kochetov
f09f8f80af
Aggregate Projections analysis using query plan [In progress]
2023-01-30 20:09:58 +00:00
Nikita Taranov
8b51bd84c0
improve perf
2023-01-30 17:11:56 +00:00
Nikita Taranov
3e3d1d15a8
properly handle case when there is nondeterministic functions
2023-01-30 17:11:56 +00:00
Nikita Taranov
581f31ad3d
better
2023-01-30 17:11:56 +00:00
Nikita Taranov
a18343773f
improve perf
2023-01-30 17:11:56 +00:00
Nikita Taranov
0d393c7a7f
cosmetics
2023-01-30 17:11:56 +00:00
Nikita Taranov
47f57b7a5d
few heuristics to disable optimisation
2023-01-30 17:11:56 +00:00
Nikita Taranov
3ce725023c
fix style & build
2023-01-30 17:11:56 +00:00
Nikita Taranov
52fe7edbd9
better key analysis
2023-01-30 17:11:56 +00:00
Nikita Taranov
962f163dbd
add settings
2023-01-30 17:11:52 +00:00
Nikita Taranov
b59ba628a9
do not group buckets w/o need
2023-01-30 17:10:45 +00:00
Nikita Taranov
abe9ab2dff
small fix for matchTrees
2023-01-30 17:10:45 +00:00
Nikita Taranov
d7e1e6314c
move matchTrees to separate file
2023-01-30 17:10:45 +00:00
Nikita Taranov
2057db68a2
cosmetics
2023-01-30 17:10:45 +00:00
Nikita Taranov
1d45cce03c
support for aggr in order
2023-01-30 17:10:45 +00:00
Nikita Taranov
a2c9aeb7c9
stash
2023-01-30 17:10:45 +00:00
flynn
801d6db486
Arrow support duration type
2023-01-29 10:55:31 +00:00
flynn
9b517cdc76
fix conflict
2023-01-29 08:34:56 +00:00
Alexey Milovidov
9ad87f9917
Fix style and typo
2023-01-29 03:51:42 +01:00
Alexey Milovidov
54bb8b1ceb
Merge branch 'master' into fix-kafka-protobuf
2023-01-29 00:59:40 +03:00
Igor Nikonov
101a0cc90b
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-01-27 19:08:38 +00:00
Nikolai Kochetov
286a58801e
Aggregate Projections analysis using query plan [In progress]
2023-01-27 18:38:14 +00:00
Igor Nikonov
300f78df96
Merge pull request #45567 from ClickHouse/enable-remove-redundant-sorting
...
Enable query_plan_remove_redundant_sorting optimization by default
2023-01-27 19:14:36 +01:00
avogar
0a99d421f5
Fix formats parser resetting, test processing bad messages in kafka
2023-01-27 13:22:50 +00:00
Igor Nikonov
4480d8ae60
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-01-26 22:16:24 +00:00
Igor Nikonov
60a69d4689
Fix distinct after JOIN or UNION
2023-01-26 21:53:08 +00:00
exX512
1793730df8
Change behaviour of cancel in PipelineExecutor
2023-01-26 21:30:36 +00:00
Igor Nikonov
211edc054e
Fix check for sum*(Float)
2023-01-26 19:26:53 +00:00
Alexander Tokmakov
067b1f5f13
Merge branch 'master' into exception_message_patterns4
2023-01-26 15:20:58 +01:00
Igor Nikonov
105d72e299
Fix: sum*() with Nullable(Float)
2023-01-26 13:17:06 +00:00
Igor Nikonov
e1302e1a32
Fix: sum*() with Floats
...
sum(Float) depends on order, do not remove sorting in such case
2023-01-25 22:39:28 +00:00
Igor Nikonov
eea076cee0
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-01-25 20:16:41 +00:00
Igor Nikonov
dd5acf9caf
Update
2023-01-25 17:09:26 +00:00
Azat Khuzhin
71286e779e
Extend assertion in buildPushingToViewsChain() to respect is_detached
...
Follow-up for: #45566 (@tavplubix)
Refs: #43161 (@AlfVII)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-25 15:42:06 +01:00
Alexander Tokmakov
d1baa7300c
reformat ParsingException
2023-01-24 23:21:29 +01:00
Alexander Tokmakov
dd57215934
Merge branch 'master' into exception_message_patterns4
2023-01-24 17:03:12 +01:00
Kruglov Pavel
23c12ac8ee
Merge branch 'master' into parquet-fixed-binary
2023-01-24 16:51:05 +01:00
Kruglov Pavel
689fbea759
Merge pull request #45478 from Avogar/fix-arrow-abort
...
Fix possible aborts in arrow lib
2023-01-24 16:37:44 +01:00
Kruglov Pavel
4bd3f0e5ef
Merge pull request #44953 from Avogar/tsv-csv-detect-header
...
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-24 15:13:52 +01:00
Alexander Tokmakov
6ecae8388e
Merge branch 'master' into exception_message_patterns4
2023-01-24 14:42:36 +01:00
Igor Nikonov
7108189b45
Merge remote-tracking branch 'origin/master' into revert-45414-revert-43905-igor/remove_redundant_order_by
2023-01-24 11:46:24 +00:00
Alexey Milovidov
851f6bf910
Merge pull request #45448 from azat/fix-query-hang
...
Fix possible (likely distributed) query hung
2023-01-24 13:00:37 +03:00
Alexander Tokmakov
c6910f39b9
fix
2023-01-24 01:11:58 +01:00
Kruglov Pavel
cd1cd904a7
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 23:49:56 +01:00
Alexander Tokmakov
bb4c8e169f
check number of parameters in format string
2023-01-23 23:16:16 +01:00
Alexander Tokmakov
3f6594f4c6
forbid old ctor of Exception
2023-01-23 22:18:05 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Kruglov Pavel
478a552a0a
Merge branch 'master' into tsv-csv-detect-header
2023-01-23 21:47:17 +01:00
Robert Schulze
0ab7ae6c17
Merge pull request #43797 from ClickHouse/query-result-cache
...
Query result cache [experimental]
2023-01-23 19:54:35 +01:00
Maksim Kita
7b48c75e82
Merge pull request #45485 from kitaisreal/remove-unnecessary-get-total-row-count-function-calls
...
Remove unnecessary getTotalRowCount function calls
2023-01-23 21:02:51 +03:00
Kruglov Pavel
af2c1bac6a
Fix typo
2023-01-23 17:13:16 +01:00
Kruglov Pavel
01ddf326ac
Merge branch 'master' into parquet-fixed-binary
2023-01-23 15:31:45 +01:00
Kruglov Pavel
84200be7d2
Better comment
2023-01-23 15:31:07 +01:00
Anton Popov
f181254fb0
fix race in destructor of ParallelParsingInputFormat
2023-01-23 01:18:58 +00:00
Igor Nikonov
f807b4b315
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_distinct
2023-01-22 18:30:30 +00:00
Robert Schulze
340f406553
Merge branch 'master' into query-result-cache
2023-01-22 13:21:36 +01:00
Maksim Kita
47385a19e7
Remove unnecessary getTotalRowCount function calls
2023-01-21 11:27:07 +01:00
Azat Khuzhin
a64f6b5f3e
Fix possible (likely distributed) query hung
...
Recently I saw the following, the client executed long distributed query
and terminated the connection, and in this case query cancellation will
be done from PullingAsyncPipelineExecutor dtor, but during cancellation
one of nodes sent ECONNRESET, and this leads to an exception from
PullingAsyncPipelineExecutor::cancel(), and this leads to a deadlock
when multiple threads waits each others, because cancel() for
LazyOutputFormat wasn't called.
Here is as relevant portion of logs:
2023.01.04 08:26:09.236208 [ 37968 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Debug> executeQuery: (from 10.61.13.253:44266, user: default) TooLongDistributedQueryToPost
...
2023.01.04 08:26:09.262424 [ 37968 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Trace> MergeTreeInOrderSelectProcessor: Reading 1 ranges in order from part 9_330_538_18, approx. 61440 rows starting from 0
2023.01.04 08:26:09.266399 [ 26788 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Trace> Connection (s4.ch:9000): Connecting. Database: (not specified). User: default
2023.01.04 08:26:09.266849 [ 26788 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Trace> Connection (s4.ch:9000): Connected to ClickHouse server version 22.10.1.
2023.01.04 08:26:09.267165 [ 26788 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Debug> Connection (s4.ch:9000): Sent data for 2 scalars, total 2 rows in 3.1587e-05 sec., 62635 rows/sec., 68.00 B (2.03 MiB/sec.), compressed 0.4594594594594595 times to 148.00 B (4.41 MiB/sec.)
2023.01.04 08:39:13.047170 [ 37968 ] {f2ed6149-146d-4a3d-874a-b0b751c7b567} <Error> PullingAsyncPipelineExecutor: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (10.7.142.115:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):
0. ./.build/./contrib/libcxx/include/exception:133: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x1818234c in /usr/lib/debug/usr/bin/clickhouse.debug
1. ./.build/./src/Common/Exception.cpp:69: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0x1004fbda in /usr/lib/debug/usr/bin/clickhouse.debug
2. ./.build/./src/Common/NetException.h:12: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x14e352f3 in /usr/lib/debug/usr/bin/clickhouse.debug
3. ./.build/./src/IO/BufferBase.h:39: DB::Connection::sendCancel() @ 0x15c21e6b in /usr/lib/debug/usr/bin/clickhouse.debug
4. ./.build/./src/Client/MultiplexedConnections.cpp:0: DB::MultiplexedConnections::sendCancel() @ 0x15c4d5b7 in /usr/lib/debug/usr/bin/clickhouse.debug
5. ./.build/./src/QueryPipeline/RemoteQueryExecutor.cpp:627: DB::RemoteQueryExecutor::tryCancel(char const*, std::__1::unique_ptr<DB::RemoteQueryExecutorReadContext, std::__1::default_delete<DB::RemoteQueryExecutorReadContext> >*) @ 0x14446c09 in /usr/lib/debug/usr/bin/clickhouse.debug
6. ./.build/./contrib/libcxx/include/__iterator/wrap_iter.h💯 DB::ExecutingGraph::cancel() @ 0x15d2c0de in /usr/lib/debug/usr/bin/clickhouse.debug
7. ./.build/./contrib/libcxx/include/__memory/unique_ptr.h:300: DB::PullingAsyncPipelineExecutor::cancel() @ 0x15d32055 in /usr/lib/debug/usr/bin/clickhouse.debug
8. ./.build/./contrib/libcxx/include/__memory/unique_ptr.h:312: DB::PullingAsyncPipelineExecutor::~PullingAsyncPipelineExecutor() @ 0x15d31f4f in /usr/lib/debug/usr/bin/clickhouse.debug
9. ./.build/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::processOrdinaryQueryWithProcessors() @ 0x15cde919 in /usr/lib/debug/usr/bin/clickhouse.debug
10. ./.build/./src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x15cd8554 in /usr/lib/debug/usr/bin/clickhouse.debug
11. ./.build/./src/Server/TCPHandler.cpp:1904: DB::TCPHandler::run() @ 0x15ce6479 in /usr/lib/debug/usr/bin/clickhouse.debug
12. ./.build/./contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x18074f07 in /usr/lib/debug/usr/bin/clickhouse.debug
13. ./.build/./contrib/libcxx/include/__memory/unique_ptr.h:54: Poco::Net::TCPServerDispatcher::run() @ 0x180753ed in /usr/lib/debug/usr/bin/clickhouse.debug
14. ./.build/./contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x181e3807 in /usr/lib/debug/usr/bin/clickhouse.debug
15. ./.build/./contrib/poco/Foundation/include/Poco/SharedPtr.h:156: Poco::ThreadImpl::runnableEntry(void*) @ 0x181e1483 in /usr/lib/debug/usr/bin/clickhouse.debug
16. ? @ 0x7ffff7e55fd4 in ?
17. ? @ 0x7ffff7ed666c in ?
(version 22.10.1.1)
And here is the state of the threads:
<details>
<summary>system.stack_trace</summary>
```sql
SELECT
arrayStringConcat(arrayMap(x -> demangle(addressToSymbol(x)), trace), '\n') AS sym
FROM system.stack_trace
WHERE query_id = 'f2ed6149-146d-4a3d-874a-b0b751c7b567'
SETTINGS allow_introspection_functions=1
Row 1:
──────
sym:
pthread_cond_wait
std::__1::condition_variable::wait(std::__1::unique_lock<std::__1::mutex>&)
bool ConcurrentBoundedQueue<DB::Chunk>::emplaceImpl<DB::Chunk>(std::__1::optional<unsigned long>, DB::Chunk&&)
DB::IOutputFormat::work()
DB::ExecutionThreadContext::executeTask()
DB::PipelineExecutor::executeStepImpl(unsigned long, std::__1::atomic<bool>*)
Row 2:
──────
sym:
pthread_cond_wait
Poco::EventImpl::waitImpl()
DB::PipelineExecutor::joinThreads()
DB::PipelineExecutor::executeImpl(unsigned long)
DB::PipelineExecutor::execute(unsigned long)
Row 3:
──────
sym:
pthread_cond_wait
Poco::EventImpl::waitImpl()
DB::PullingAsyncPipelineExecutor::Data::~Data()
DB::PullingAsyncPipelineExecutor::~PullingAsyncPipelineExecutor()
DB::TCPHandler::processOrdinaryQueryWithProcessors()
DB::TCPHandler::runImpl()
DB::TCPHandler::run()
Poco::Net::TCPServerConnection::start()
Poco::Net::TCPServerDispatcher::run()
Poco::PooledThread::run()
Poco::ThreadImpl::runnableEntry(void*)
```
</details>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-21 08:05:56 +01:00
Azat Khuzhin
e2fcf0f072
Catch exception on query cancellation
...
Since we still want to join the thread, yes it will be done in dtor, but
this looks better.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-21 08:05:56 +01:00
Azat Khuzhin
0566f72d36
Cleanup PullingAsyncPipelineExecutor::cancel()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-21 08:05:56 +01:00
avogar
86336940f8
Better comment
2023-01-20 16:41:59 +00:00
avogar
4432ee9927
Fix aborts in arrow lib
2023-01-20 16:40:33 +00:00
avogar
550a703fbc
Make a bit better
2023-01-20 14:58:39 +00:00
Kruglov Pavel
28ddcc2432
Merge branch 'master' into tsv-csv-detect-header
2023-01-20 15:08:38 +01:00
Nikolai Kochetov
134ac9b2dd
Aggregate Projections analysis using query plan [In progress]
2023-01-19 19:53:22 +00:00
avogar
c34c0aa22e
Fix comments
2023-01-19 16:03:46 +00:00
Kruglov Pavel
9820beae68
Apply suggestions from code review
...
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2023-01-19 16:11:13 +01:00
Igor Nikonov
d0ce804bfc
Fix: dynamic_cast -> typeid_cast for SortingStep
2023-01-19 13:40:21 +00:00
Igor Nikonov
df3776d24b
Make test stable
...
+ disable debug logging
2023-01-19 11:43:40 +00:00
Ilya Yatsishin
00962b7ad5
Merge pull request #45424 from Avogar/fix-json-import-nested
2023-01-19 10:31:40 +01:00
Igor Nikonov
57d2fd300a
Fix: correct update of data stream sorting properties after removing
...
sorting
2023-01-19 00:11:58 +00:00
avogar
a8f20363f4
Fix JSON/BSONEachRow parsing with HTTP
2023-01-18 22:49:03 +00:00
Igor Nikonov
1866f990de
Revert "Revert "Remove redundant sorting""
2023-01-18 20:12:34 +01:00
Igor Nikonov
7ed8fec94f
Revert "Remove redundant sorting"
2023-01-18 18:38:25 +01:00
flynn
4dcd3cc4f6
fix style
2023-01-18 08:46:06 +00:00
flynn
a8e1363151
implement storage iceberg
2023-01-18 03:43:56 +00:00
Robert Schulze
4f90824347
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-17 22:49:53 +00:00
Igor Nikonov
0db9bf38a2
Merge branch 'master' into igor/remove_redundant_order_by
2023-01-17 22:26:24 +01:00
Nikolai Kochetov
9c6c6d9844
Aggregate Projections analysis using query plan [In progress]
2023-01-17 20:12:34 +00:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern
...
Add a column with a message pattern to text_log
2023-01-17 20:19:32 +03:00
Igor Nikonov
0cfa08df7a
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_order_by
2023-01-17 16:28:17 +00:00
Igor Nikonov
9855504403
Rename source file according to implementation
2023-01-17 16:24:51 +00:00
Kruglov Pavel
96bb99f864
Merge branch 'master' into tsv-csv-detect-header
2023-01-17 15:33:02 +01:00
Igor Nikonov
6328e02f22
Fix: update input/output stream properties
...
After removing sorting step we need to update sorting properties of
input/ouput streams
2023-01-17 13:39:18 +00:00
Sema Checherinda
35431e91e3
Merge pull request #45276 from ucasfl/avro-fix
...
Fix some avro reading bugs
2023-01-17 12:48:44 +01:00
avogar
5bf4704e7a
Support FixedSizeBinary type in Parquet/Arrow
2023-01-16 21:01:31 +00:00
avogar
1c0941d72a
Add docs and examples
2023-01-16 16:46:41 +00:00
avogar
3ea80b0f54
Merge branch 'master' of github.com:ClickHouse/ClickHouse into tsv-csv-detect-header
2023-01-16 15:14:25 +00:00
Igor Nikonov
a34991cb65
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_order_by
2023-01-16 12:14:02 +00:00
Robert Schulze
099e30ef2a
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-16 08:04:49 +00:00
Robert Schulze
27fe7ebd93
Cosmetics
2023-01-15 16:12:48 +00:00
flynn
29eb30b49f
Fix some reading avro format bugs
...
fix
2023-01-14 18:05:26 +00:00
Alexander Tokmakov
2d7773fccc
Merge branch 'master' into text_log_add_pattern
2023-01-13 20:33:46 +01:00
avogar
e2470dd670
Fix tests
2023-01-13 17:03:53 +00:00
Robert Schulze
d7d3f61c73
Cleanup SourceFromChunks a bit
2023-01-13 10:57:31 +00:00
Robert Schulze
15e11741cb
Cosmetics
2023-01-13 00:00:23 +00:00
Robert Schulze
1b53307375
Refcount cache entries to improve lookup performance
2023-01-12 23:38:39 +00:00
Robert Schulze
0c528fca29
Introduce SourceFromChunks to avoid unnecessary partial result chunk concatenation
2023-01-12 23:01:00 +00:00
avogar
b461935374
Better
2023-01-12 13:11:04 +00:00
Kruglov Pavel
05a11ff4a4
Merge branch 'master' into tsv-csv-detect-header
2023-01-12 12:35:18 +01:00
Maksim Kita
a140d6c5b1
Fixed code review issues
2023-01-12 12:07:58 +01:00
Maksim Kita
47f4159909
Analyzer support distributed queries processing
2023-01-12 12:07:58 +01:00
avogar
e4d774d906
Better naming
2023-01-11 22:57:14 +00:00
avogar
26cd56d113
Fix tests, make better
2023-01-11 22:52:15 +00:00
Alexander Gololobov
6adf1c025f
Merge pull request #45165 from ClickHouse/more_logging_for_replicated_ttl
...
More logging to facilitate debugging of flaky test_ttl_replicated
2023-01-11 23:24:48 +01:00
avogar
3b45863d15
Make better implementation, fix tests
2023-01-11 17:12:56 +00:00
Alexander Gololobov
659fa96365
More logging to facilitate debugging
2023-01-11 13:06:38 +01:00
Nikolai Kochetov
5e7a6ac619
Merge pull request #45122 from ClickHouse/revert-45121-revert-44653-custom-reading-for-mutation
...
Revert "Revert "Custom reading for mutation""
2023-01-11 12:37:32 +01:00
avogar
6312b75f44
Fix style
2023-01-10 16:28:52 +00:00
avogar
615fe4cecb
Fix tests
2023-01-10 16:27:23 +00:00
Maksim Kita
fbba28b31e
Analyzer aggregation without column fix
2023-01-10 16:49:55 +01:00
Nikolai Kochetov
4673b3fe1d
Revert "Revert "Custom reading for mutation""
2023-01-10 16:31:01 +01:00
Alexander Tokmakov
c8ec130be4
Revert "Custom reading for mutation"
2023-01-10 17:51:30 +03:00
Nikolai Kochetov
11418963c0
Merge pull request #44653 from ClickHouse/custom-reading-for-mutation
...
Custom reading for mutation
2023-01-10 12:16:24 +01:00
Robert Schulze
923fa2c15a
Fix review comments, pt. II
2023-01-10 10:21:08 +00:00
Robert Schulze
0c3b034887
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-10 09:02:41 +00:00
Alexey Milovidov
1229a20fb3
Merge pull request #45047 from ClickHouse/fix-buffer-overflow
...
Fix buffer overflow in parser
2023-01-10 05:06:03 +03:00
Yakov Olkhovskiy
4f32f3b8cb
Merge pull request #44484 from bigo-sg/arrow_struct_field
...
Optimization for reading struct fields in parquet/orc files
2023-01-09 15:36:26 -05:00
Nikolai Kochetov
3e430b1b6e
Add comments. Remove unused flag from Context.
2023-01-09 19:52:11 +00:00
Kseniia Sumarokova
119501f1d9
Merge pull request #44698 from Avogar/parquet-bool
...
Support Bool type in Arrow/Parquet/ORC
2023-01-09 12:56:28 +01:00
lgbo-ustc
b639bcabc0
some fixes
2023-01-09 18:13:00 +08:00
lgbo-ustc
f127b3a60a
update ArrowFieldIndexUtil
2023-01-09 18:13:00 +08:00
lgbo-ustc
a3bdfddc9d
support nested table
2023-01-09 18:13:00 +08:00
lgbo-ustc
4f3f781b85
fixed test case
2023-01-09 18:13:00 +08:00
lgbo-ustc
755f03db4e
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
f6850d96cb
fixed missing columns
2023-01-09 18:13:00 +08:00
lgbo-ustc
4cf6beee27
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
81e2832133
fixed
2023-01-09 18:13:00 +08:00
lgbo-ustc
77cea49cec
fixed including header failure
2023-01-09 18:13:00 +08:00
lgbo-ustc
8f8f6f966b
Optimization for reading struct fields in parquet/orc files
2023-01-09 18:13:00 +08:00
Igor Nikonov
7298b39a18
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_order_by
2023-01-09 10:08:48 +00:00
Igor Nikonov
cec7dc5a5a
Renaming according to setting
2023-01-09 10:06:47 +00:00
Igor Nikonov
e29cd5d640
Rename settings to remove_redundant_sorting
2023-01-09 09:50:00 +00:00
Alexey Milovidov
eea5a2c521
Merge branch 'master' into fix-buffer-overflow
2023-01-09 09:15:29 +03:00
Alexey Milovidov
0d39d26a34
Don't fix parallel formatting
2023-01-09 06:15:20 +01:00
Alexey Milovidov
d331f0ce82
Fix buffer overflow in parser
2023-01-09 03:31:12 +01:00
Alexey Milovidov
0d8d6eca67
Non significant changes
2023-01-09 01:51:05 +01:00
Alexey Milovidov
797dfdd42e
Non significant changes
2023-01-09 01:50:19 +01:00
Alexey Milovidov
3430df2f8c
Non significant changes
2023-01-09 01:48:57 +01:00
avogar
ee72799121
Fix tests, make better
2023-01-06 20:46:43 +00:00
Robert Schulze
45dbcf88e5
Merge remote-tracking branch 'origin/master' into query-result-cache
2023-01-06 20:42:48 +00:00
Igor Nikonov
2187bdd4cc
Disable diagnostics
...
+ cleanup
+ disable optimization in sort performance test since it removes sorting
at all
2023-01-06 17:00:05 +00:00
Igor Nikonov
d2d5a09802
Fix typo
2023-01-06 15:01:31 +00:00
Igor Nikonov
48b58a9fed
Merge remote-tracking branch 'origin/master' into igor/remove_redundant_order_by
2023-01-06 13:55:26 +00:00
Igor Nikonov
d886b56338
Fix review comments
2023-01-06 13:54:28 +00:00
avogar
7fcdb08ec6
Detect header in CSV/TSV/CustomSeparated files automatically
2023-01-05 22:57:25 +00:00
