Commit Graph

37313 Commits

Author SHA1 Message Date
Vladimir C
00d9289366
Merge pull request #46175 from ClickHouse/vdimir/join_filtering_step_pipeline_stuck 2023-02-13 13:22:17 +01:00
Alexey Milovidov
8265db80ff
Merge pull request #46309 from ClickHouse/revert-39737
[RFC] Revert #39737
2023-02-13 14:41:02 +03:00
Antonio Andelic
454705b261 Add support for DELETE/UPDATE for KeeperMap 2023-02-13 11:22:43 +00:00
Sema Checherinda
5882f3878f
except zero values election_timeout 2023-02-13 12:22:08 +01:00
Vladimir C
89cb55aa1f
whitespace 2023-02-13 12:19:31 +01:00
Vladimir C
1a89ecd386 Apply suggestions from code review
Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
2023-02-13 12:17:56 +01:00
vdimir
e4c0afcc3e Do not build filtering set for sorting join with const columns 2023-02-13 12:17:56 +01:00
Alexey Milovidov
9be1bba92f
Merge pull request #46310 from ClickHouse/replicas_status_remove_mutex
Remove mutex from replicas_status
2023-02-13 13:36:11 +03:00
Salvatore Mesoraca
fff2c09b87
coordination: do not allow election_timeout_lower_bound_ms > election_timeout_upper_bound_ms 2023-02-13 10:09:45 +01:00
Aleksei Filatov
8f123c365e Refine removing metadata file with invalid format for DiskObjectStorage 2023-02-13 10:59:42 +03:00
Alexey Milovidov
1b912c07cd
Merge pull request #42391 from ClickHouse/filimonov-kafka-Local-No-offset-stored
Attempt to fix 'Local: No offset stored message' from Kafka
2023-02-13 10:49:49 +03:00
Antonio Andelic
8d16fe5793
Merge branch 'master' into add-support-for-settings-alias 2023-02-13 08:46:00 +01:00
mateng0915
6e9dc2527f fixed review comments 2023-02-13 11:43:01 +08:00
mateng915
c876ad901b
Merge branch 'master' into replicas_status_api_optimize 2023-02-13 11:38:55 +08:00
Alexey Milovidov
ddd21ac706
Merge pull request #46313 from ClickHouse/read-task-instrumentation
Instrumentation of callbacks (read tasks of parallel replicas) for distributed queries
2023-02-13 03:38:24 +03:00
Alexey Milovidov
2e57fab8e3 Instrumentation of callbacks for distributed queries 2023-02-12 10:04:05 +01:00
Alexey Milovidov
4315853d95 Add an option for watchdog to restart the child process 2023-02-12 09:45:24 +01:00
Alexey Milovidov
e6b44756dc Fixed build 2023-02-12 07:45:28 +01:00
Alexey Milovidov
b8cbc947ce Remove mutex from replicas_status 2023-02-12 07:39:16 +01:00
Alexey Milovidov
e2079b78a3 [RFC] Revert #39737 2023-02-12 07:24:42 +01:00
Alexey Milovidov
384ae944fe Merge branch 'master' into filimonov-kafka-Local-No-offset-stored 2023-02-12 04:01:07 +01:00
Alexey Milovidov
5f00bc49f8
Merge branch 'master' into addParts 2023-02-12 05:55:18 +03:00
Alexey Milovidov
a97f9b2caf
Update MergeTreeData.cpp 2023-02-12 05:55:07 +03:00
Alexey Milovidov
6e0dab71ed
Merge pull request #46188 from bigo-sg/rewrite_array_exists
Rewrite array exists to has
2023-02-12 05:53:22 +03:00
Alexey Milovidov
395d6b6bd5
Merge pull request #46282 from CurtizJ/return-back-vertical-merges
Allow vertical merges from compact to wide parts [2]
2023-02-12 05:51:12 +03:00
Yakov Olkhovskiy
47509aea83 propagate storage limits to subquery 2023-02-12 02:11:46 +00:00
serxa
df6b4c4372 fix typo 2023-02-11 20:18:19 +00:00
serxa
9a7f70f595 fix comment 2023-02-11 16:54:57 +00:00
serxa
eb8cf6f816 Merge branch 'round-robin-merge-scheduler' of github.com:ClickHouse/ClickHouse into round-robin-merge-scheduler 2023-02-11 16:45:55 +00:00
serxa
d2f8377c47 fix check 2023-02-11 16:45:45 +00:00
Sergei Trifonov
297587531b
Merge branch 'master' into round-robin-merge-scheduler 2023-02-11 17:19:27 +01:00
serxa
c58b165b0f add config option to select scheduling policy 2023-02-11 16:18:42 +00:00
Kseniia Sumarokova
ed6f623f3a
Merge pull request #46168 from kssenii/resubmit-prefetches
Allow to increase prefetching of data for reads
2023-02-11 16:22:47 +01:00
Kseniia Sumarokova
f5a05ac87a
Merge pull request #46295 from ClickHouse/kssenii-patch-6
Update RabbitMQProducer.cpp
2023-02-11 16:21:12 +01:00
flynn
50dace9571 fix 2023-02-11 13:58:19 +00:00
Kruglov Pavel
e84baa9106
Merge pull request #43179 from tonickkozlov/tonickkozlov/add-interserver-dns-retries
CLICKHOUSE-2375 Add interserver DNS retries
2023-02-11 14:35:40 +01:00
flynn
d3255fa420 Merge branch 'master' of github.com:ClickHouse/ClickHouse into log-engine 2023-02-11 12:26:16 +00:00
kssenii
f37519aa3b Remove noisy logging 2023-02-11 11:39:11 +01:00
kssenii
3067c1d723 Merge remote-tracking branch 'upstream/master' into resubmit-prefetches 2023-02-11 11:36:23 +01:00
Kseniia Sumarokova
2c397551a0
Update RabbitMQProducer.cpp 2023-02-11 11:23:29 +01:00
Kseniia Sumarokova
0e48ddc4c7
Merge pull request #46283 from kssenii/add-logs-for-rabbit
Add more logging to RabbitMQ (to help debug tests)
2023-02-11 11:21:13 +01:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler 2023-02-11 10:30:26 +01:00
Sergei Trifonov
2931c3bbe1
Merge pull request #45711 from ClickHouse/io-scheduler-integration
Integrate IO scheduler with buffers for remote reads and writes
2023-02-11 10:26:58 +01:00
Alexander Gololobov
f2a975f548
Merge pull request #46270 from Avogar/fix-arrow-lc
Fix possible out of bounds error while reading LowCardinality(Nullable) in Arrow format
2023-02-11 10:03:00 +01:00
robot-ch-test-poll2
4e9d1275c7
Merge pull request #46278 from CheSema/race-check-table
fix data race between check table request and background checker
2023-02-11 09:50:48 +01:00
Alexey Milovidov
44bd95a410
Merge pull request #46167 from ClickHouse/rs/reject-dos-patterns
Reject hyperscan regexes which are prone to ReDoS
2023-02-11 06:04:03 +03:00
Alexey Milovidov
c6dc39f9e2
Merge pull request #46232 from aiven-sal/aiven-sal/format
ASTFunction: never rewrite tuple function as literal when formatting
2023-02-11 05:56:08 +03:00
kssenii
3545568440 Fix build 2023-02-10 22:15:44 +01:00
Han Fei
2190a2a6c4
Merge pull request #46043 from ucasfl/view-syntax
Forbid wrong create view syntax
2023-02-10 21:54:57 +01:00
Kseniia Sumarokova
3be36c7979
Merge pull request #41976 from kssenii/allow-single-disk-instead-of-storage-policy
Allow configuring storage as `SETTINGS disk='<disk_name>'` (instead of `storage_policy`) and explicit disk creation `SETTINGS disk=disk(<disk_configuration>)`
2023-02-10 21:38:50 +01:00
Vladimir C
ea670acb72
Add comment to requestReadingInOrder 2023-02-10 20:05:18 +01:00
serxa
8c3f85e58d more review fixes 2023-02-10 17:39:28 +00:00
Kruglov Pavel
2a3cb8b4ee
Merge pull request #45340 from Avogar/parquet-fixed-binary
Support FixedSizeBinary type in Parquet/Arrow
2023-02-10 18:31:20 +01:00
kssenii
96e745be09 Add logging 2023-02-10 18:14:49 +01:00
Alexey Milovidov
d5d87bc6b7
Merge pull request #46152 from ClickHouse/with-fill-bigint
More convenient usage of big integers and ORDER BY WITH FILL.
2023-02-10 20:05:32 +03:00
Anton Popov
1205932a19 add setting to disable vertical merges from compact parts 2023-02-10 16:33:46 +00:00
kssenii
468d5216da Remove logging because of test 00002_log_and_exception_messages_formatting 2023-02-10 17:25:26 +01:00
Antonio Andelic
9e11f06e79
Merge pull request #46191 from ClickHouse/s3-reorder-creds
Prefer explicitly defined credentials for S3
2023-02-10 16:35:54 +01:00
Sema Checherinda
ef133ee30d fix data race between check table query and background part checker thread 2023-02-10 16:22:35 +01:00
Suzy Wang
1c2a52c57b
Update src/Storages/StorageS3Cluster.cpp 2023-02-10 10:09:24 -05:00
Anton Popov
a252d3a139 Revert "Merge pull request #46236 from ClickHouse/revert-45681-compact-parts-vertical-merge"
This reverts commit 27bc317ef9, reversing
changes made to ccf7b6f4c1.
2023-02-10 14:13:29 +00:00
flynn
45ee7c7081 fix 2023-02-10 13:56:47 +00:00
Anton Popov
27bc317ef9
Merge pull request #46236 from ClickHouse/revert-45681-compact-parts-vertical-merge
Revert "Allow vertical merges from compact to wide parts"
2023-02-10 14:31:33 +01:00
Alexander Tokmakov
8eae498ec6
Merge pull request #45936 from vitlibar/add-setting-check-referential-deps-on-drop
Check referential dependencies on DROP TABLE
2023-02-10 16:21:00 +03:00
KitKatKKK
d31457de44
Update src/Storages/MergeTree/MergeTreeData.cpp
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-10 21:14:42 +08:00
KitKatKKK
7664114349
Update src/Storages/MergeTree/MergeTreeData.cpp
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-10 21:14:33 +08:00
Salvatore Mesoraca
8f65dc4ff7
ASTFunction: avoid rewriting tuple function as literal when not safe
It is not always safe to implicitly rewrite a `tuple` function
call to a literal. Even when the tuple has more then one element
e.g.
`SELECT (tuple(1, 2, 3) AS x).1` is not equivalent to
`SELECT ((1, 2, 3) AS x).1`, the latter is interpreted as
`SELECT tuple((1, 2, 3) AS x).1`.
2023-02-10 14:01:25 +01:00
avogar
deda940d87 Fix possible out of bounds error while reading LowCardinality(Nullable) in Arrow format 2023-02-10 12:57:47 +00:00
kssenii
571aabdb69 Fix clang-tidy 2023-02-10 12:39:05 +01:00
Robert Schulze
17561c3dae
Fix build 2023-02-10 11:25:59 +00:00
kssenii
8458c7821b Review comments fix 2023-02-10 12:06:24 +01:00
Nikolai Kochetov
8c22c740a4
Merge pull request #46205 from ClickHouse/fix-write-buffer-destruction-order-for-vertical-merge
Fix write buffer destruction order for vertical merge.
2023-02-10 11:47:23 +01:00
Vladimir C
bd39e29cab
Merge pull request #46065 from aiven-sal/aiven-sal/siphash128 2023-02-10 10:41:45 +01:00
KitKatKKK
ea300ce13b
Merge branch 'master' into addParts 2023-02-10 16:48:04 +08:00
KitKatKKK
fa73b00a66
Update src/Storages/MergeTree/MergeTreeData.h
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-10 16:46:57 +08:00
attack204
7f41173a1f rename API 2023-02-10 16:24:10 +08:00
attack204
93e92dab3b rename API 2023-02-10 16:05:50 +08:00
Antonio Andelic
c02adec4b8 Early return 2023-02-10 07:47:48 +00:00
Alexey Milovidov
786aa069e1
Merge pull request #46187 from ClickHouse/speed-up-count-digits
Speed up `countDigits`
2023-02-10 07:41:12 +03:00
taiyang-li
5c1425b322 Merge branch 'rewrite_array_exists' of https://github.com/bigo-sg/ClickHouse into rewrite_array_exists 2023-02-10 11:32:56 +08:00
taiyang-li
58c348fecd fix build error 2023-02-10 11:27:10 +08:00
attack204
52960d4e7d add API to MergeTreeData 2023-02-10 11:00:11 +08:00
pufit
19a2fba0b3
Merge pull request #46042 from jh0x/improve-into-date-from-uint16
Improve behavior of conversion into Date for boundary value 65535
2023-02-09 20:49:28 -05:00
Alexey Milovidov
b5cb3209be
Merge pull request #46095 from ClickHouse/decimal-performance
Improve performance of Decimal conversion when scale does not change
2023-02-10 02:35:31 +03:00
serxa
acabee8554 review fixes 2023-02-09 20:17:46 +00:00
Nikolai Kochetov
4aa6e4d683 Revert "Add return flag for preFinalize."
This reverts commit 3261378ef8.
2023-02-09 19:51:09 +00:00
Nikolai Kochetov
3261378ef8 Add return flag for preFinalize. 2023-02-09 19:50:54 +00:00
Suzy Wang
64313d7020
Merge branch 'master' into z-build-0120 2023-02-09 14:49:22 -05:00
serxa
a4006ec5a1 add explanation 2023-02-09 19:49:11 +00:00
Nikolai Kochetov
98765cc20b Disable delayed streams for Vertical merges for non-remote disks. 2023-02-09 19:39:34 +00:00
serxa
bf299b6696 Merge branch 'round-robin-merge-scheduler' of github.com:ClickHouse/ClickHouse into round-robin-merge-scheduler 2023-02-09 19:33:17 +00:00
serxa
cc3c76944b remove redundant code 2023-02-09 19:31:54 +00:00
Sergei Trifonov
e3727d9b0e
Merge branch 'master' into round-robin-merge-scheduler 2023-02-09 20:04:59 +01:00
serxa
f61f95fcec Replace background executor scheduler merges and mutations with round-robin 2023-02-09 18:54:15 +00:00
Robert Schulze
566fb5b9da
Merge pull request #46006 from ClickHouse/rs/fix-fragile-linking
Fix terribly broken, fragile and potentially cyclic linking
2023-02-09 18:19:44 +01:00
Robert Schulze
74937cf27b
Reject DoS-prone hyperscan regexes 2023-02-09 17:17:35 +00:00
Antonio Andelic
f96d480563
Merge branch 'master' into add-support-for-settings-alias 2023-02-09 16:07:45 +01:00
Anton Popov
612fe0bd00
Revert "Allow vertical merges from compact to wide parts" 2023-02-09 15:42:46 +01:00
alesapin
9b23068d5e
Merge pull request #45821 from ClickHouse/explicit_drop_part_entry_type
Make separate DROP_PART log entry type
2023-02-09 15:11:13 +01:00
李扬
b9c942e2e7
Merge branch 'master' into rewrite_array_exists 2023-02-09 21:47:38 +08:00
taiyang-li
14dd696e95 fix build error 2023-02-09 21:47:05 +08:00
pufit
f0366e4614
Merge branch 'master' into improve-into-date-from-uint16 2023-02-09 08:44:31 -05:00
attack204
ac81ef0fd8 beauty 2023-02-09 20:36:08 +08:00
attack204
07ea30e6e0 beauty 2023-02-09 20:35:28 +08:00
Vitaly Baranov
39bacfb9dc
Merge branch 'master' into allow-single-disk-instead-of-storage-policy 2023-02-09 13:16:55 +01:00
serxa
4fada6f992 fix typo 2023-02-09 11:50:28 +00:00
kssenii
2a48a96f83 Fix tests 2023-02-09 12:26:15 +01:00
vdimir
45f7ef6c8f
Do not apply read in reverse order for queries with final 2023-02-09 11:00:22 +00:00
Nikolai Kochetov
65ec9bd7d0 Fix write buffer destruction order for vertical merge. 2023-02-09 10:58:49 +00:00
alesapin
859f528fe1
Merge pull request #45648 from ClickHouse/45508_Update_strategy_for_system_sync_replica
Updated checking of SYSTEM SYNC REPLICA
2023-02-09 11:51:05 +01:00
vdimir
a179528ea4
Revert "Fix read in order optimization for DESC sorting with FINAL"
This reverts commit cf762347d5.
2023-02-09 10:47:45 +00:00
Robert Schulze
e490ec91d9
Merge branch 'master' into rs/fix-fragile-linking 2023-02-09 11:33:59 +01:00
Kruglov Pavel
b5f90c608a
Merge branch 'master' into parquet-fixed-binary 2023-02-09 11:26:38 +01:00
vdimir
cf762347d5
Fix read in order optimization for DESC sorting with FINAL 2023-02-09 10:26:37 +00:00
Vladimir C
0042c20770
Merge pull request #46054 from alexX512/bug_fix_pulling_pipeline 2023-02-09 10:50:46 +01:00
taiyang-li
e1fed0352e remove useless code 2023-02-09 16:32:11 +08:00
taiyang-li
19ca0ec4af add passes for rewriting arrayexists 2023-02-09 16:30:53 +08:00
Antonio Andelic
ae731b739a Prefer explicitly defined creds for S3 2023-02-09 08:13:16 +00:00
KitKatKKK
54513d1db1
Merge branch 'master' into addParts 2023-02-09 15:41:49 +08:00
Alexey Milovidov
3a75ede60a Implement #16733 2023-02-09 08:41:47 +01:00
Alexey Milovidov
cb847172ea Fix something 2023-02-09 08:39:46 +01:00
taiyang-li
af7a6abf80 fix bugs 2023-02-09 15:15:08 +08:00
Alexey Milovidov
a40ef2bf18 Make it better 2023-02-09 08:09:19 +01:00
Alexey Milovidov
d9fbf643bc
Merge pull request #45226 from hanfei1991/hanfei/gwp-asan
Introduce llvm/gwp-asan
2023-02-09 09:24:52 +03:00
pufit
7cf71d1f82
Merge pull request #46144 from ClickHouse/46131-fix-config-attributes-merge
Fix config merge for XML attributes.
2023-02-08 23:28:13 -05:00
taiyang-li
1ce12c8ab5 add visitor files 2023-02-09 12:26:32 +08:00
taiyang-li
48f0fb0d52 rewrite array exists to has 2023-02-09 12:06:42 +08:00
Alexey Milovidov
8392b35d50 Speed up countDigits 2023-02-09 04:39:12 +01:00
attack204
a5d7f002ec beauty 2023-02-09 11:03:04 +08:00
attack204
9ce15279ae reformat 2023-02-09 10:54:18 +08:00
zk_kiger
886e821d1e
Merge branch 'master' into improve_format_datetime_joda 2023-02-09 10:08:29 +08:00
Alexey Milovidov
66043eec24
Merge branch 'master' into decimal-performance 2023-02-09 04:59:37 +03:00
attack204
f65756c0c8 fix style 2023-02-09 09:34:11 +08:00
Alexey Milovidov
292a5abbc9 Merge remote-tracking branch 'origin/master' into with-fill-bigint 2023-02-09 01:47:51 +01:00
Alexander Tokmakov
4fd4058259
Merge pull request #45629 from arthurpassos/fix_cares_crash
Cancel c-ares failed requests and retry on system interrupts to prevent callbacks with dangling references and premature resolution failures
2023-02-09 02:29:29 +03:00
Vitaly Baranov
4869d3806c Add setting check_referential_table_dependencies to check referential dependencies on DROP TABLE. 2023-02-08 23:56:59 +01:00
Ilya Yatsishin
9f480b8fa2
Merge pull request #46132 from azat/file-fd-schema-inference 2023-02-08 23:23:32 +01:00
Alexander Tokmakov
648812b652
Merge pull request #46003 from azat/client-settings-fix
Fix applying settings for FORMAT on the client
2023-02-09 01:06:35 +03:00
Alexander Tokmakov
8101b044fa
Merge pull request #46091 from azat/sanity-assertions
Sanity assertions for closing file descriptors
2023-02-09 01:02:03 +03:00
Alexander Tokmakov
65cbb0fcfc
Merge pull request #46138 from vitlibar/fix-dependency-checks
Fix dependency checks
2023-02-09 00:54:40 +03:00
Anton Popov
31adebdca8
Merge pull request #46045 from azat/compact-nested-fix
Fix reading of non existing nested columns with multiple level in compact parts
2023-02-08 22:54:11 +01:00
Han Fei
64b84f8e31 fix style 2023-02-08 22:16:28 +01:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
serxa
cfb8291029 Cleanup disk unittest 2023-02-08 18:14:05 +00:00
Han Fei
8f665b5bbf fix 2023-02-08 18:28:06 +01:00
Sergei Trifonov
b0fc551c27
Merge branch 'master' into io-scheduler-integration 2023-02-08 18:16:00 +01:00
Han Fei
a4efb1fbda fix compile 2023-02-08 18:06:36 +01:00
attack204
ecaa97c5b1 fix style 2023-02-08 23:45:39 +08:00
Han Fei
d9aab84701 fix fork hang 2023-02-08 16:20:42 +01:00
pufit
e833decd88 try to fix memory leak 2023-02-08 15:17:46 +00:00