Commit Graph

9953 Commits

Author SHA1 Message Date
avogar
75c4ef0be7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into s3-cluster-schema-inference 2022-10-18 11:58:12 +00:00
Tian Xinhui
45c6974f7d
Use alias for std::shared_ptr<MergeMutateSelectedEntry> (#42211)
* use alias for MergeMutateSelectedEntry share ptr

* fix StorageMergeTree.cpp
2022-10-18 13:35:34 +02:00
alesapin
673adfbd5c
Merge pull request #42317 from ClickHouse/fix_another_trash_with_zero_cop
Fix another trash in zero-copy replication
2022-10-18 12:51:16 +02:00
Antonio Andelic
06b2eeb5a7 Small changes to settings 2022-10-18 09:31:16 +00:00
Antonio Andelic
bd2522fdd0 Merge branch 'master' into optimize-partitions-in-background 2022-10-18 09:13:59 +00:00
Antonio Andelic
ee2f5977d5
Merge branch 'master' into keeper-upload-snapshot-to-s3 2022-10-18 10:02:50 +02:00
Ilya Yatsishin
36b63badb3
Merge pull request #42223 from qoega/hdfs-empty-url 2022-10-18 09:34:10 +02:00
Nikolai Kochetov
3d1ed2969a Fix possible LOGICAL_ERROR in binary ariphmetics monotonicity. Fix invalid evaluation of binary monotonic function in KeyCondition. 2022-10-17 18:21:03 +00:00
Alexander Tokmakov
57f6e27300 Merge branch 'master' into improve_replica_recovery 2022-10-17 18:37:31 +02:00
Duc Canh Le
9af817bb43
Fix read from buffer with read in order (#42236) 2022-10-17 14:25:31 +02:00
Antonio Andelic
7c7395575f Merge branch 'master' into keeper-upload-snapshot-to-s3 2022-10-17 11:02:36 +00:00
Ilya Yatsishin
dd0fc2435e Merge remote-tracking branch 'origin/master' into hdfs-empty-url 2022-10-17 12:48:42 +02:00
Nikolai Kochetov
c9aa6a655c
Merge pull request #42319 from ClickHouse/fix-alter-update-wrong-type
Fix an invalid type of a column after attach and alter.
2022-10-17 12:44:16 +02:00
alesapin
051e3a0db5 Fix if 2022-10-17 12:27:05 +02:00
alesapin
cf6442fa65
Merge pull request #42222 from ClickHouse/disable_concurrent_parts_removal
Disable concurrent parts removal
2022-10-17 12:17:55 +02:00
Antonio Andelic
125501b36a Merge branch 'master' into use-multiread-more 2022-10-17 07:32:30 +00:00
Antonio Andelic
f3c4d0eff2 Fix keeperMap test 2022-10-17 07:29:22 +00:00
Smita Kulkarni
91433e5b9c Added ** glob support for recursive directory traversal to filesystem and S3.
Implementation:
* Updated parseGlob to not add ‘/‘ restriction when ** is used.
* Updated S3 & filesystem to fetch files and not use regex match if glob is **.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02459_glob_for_recursive_directory_traversal.sh
2022-10-17 09:04:25 +02:00
Ilya Yatsishin
165785f716 mErge remote-tracking branch 'origin/master' into hdfs-empty-url 2022-10-15 19:13:59 +02:00
Vitaly Baranov
91c438eebe
Merge pull request #42263 from vitlibar/refactor-udf
Refactor the implementation of user-defined functions
2022-10-15 12:33:10 +02:00
Kruglov Pavel
3d9f46a1e7
Merge branch 'master' into s3-cluster-schema-inference 2022-10-14 22:07:54 +02:00
avogar
52427e6028 Remove code duplication 2022-10-14 18:07:02 +00:00
Nikolai Kochetov
b98b1759c8 Fix additional_table_filters for Distributed. 2022-10-14 17:04:42 +00:00
Kruglov Pavel
ff11904850
Merge branch 'master' into improve-combinators 2022-10-14 17:19:31 +02:00
Nikolai Kochetov
b18c6fd8e6 Fix an invalid type of a column after attach and alter. 2022-10-14 14:52:26 +00:00
alesapin
e0c2518416 Fix another trash in zero-copy replication 2022-10-14 16:50:48 +02:00
Ilya Yatsishin
3361b27965 less 2022-10-14 14:27:52 +02:00
alesapin
fd718c0d00 Merge branch 'master' into disable_concurrent_parts_removal 2022-10-14 13:32:11 +02:00
alesapin
4e1a10fb34 better check 2022-10-14 13:32:08 +02:00
Ilya Yatsishin
bbf88b66a0 more 2022-10-13 11:42:35 +02:00
Vitaly Baranov
2e59d671fc Split UserDefinedSQLObjectsLoader to interface and implementation. 2022-10-13 10:32:32 +02:00
Ilya Yatsishin
e7ca30cd11 fix typo 2022-10-13 10:10:13 +02:00
Alexey Milovidov
96332d9159
Merge branch 'master' into fix-projections 2022-10-13 02:23:32 +02:00
xinhuitian
daaf01c344 early return 2022-10-12 12:18:17 +08:00
flynn
312afdc280 remove useless code 2022-10-12 03:48:37 +00:00
Alexey Milovidov
bbd1196a96
Update MergeTreeData.cpp 2022-10-12 00:57:02 +03:00
Ilya Yatsishin
3201c08bb5 style 2022-10-11 13:54:03 +02:00
Ilya Yatsishin
28c7a22428 address review comments 2022-10-11 11:59:48 +02:00
Antonio Andelic
5e6a7c1678 Use multiread where possible 2022-10-11 09:27:46 +00:00
Alexey Milovidov
56e59dd536
Merge branch 'master' into fix-projections 2022-10-11 02:24:12 +03:00
Ilya Yatsishin
95c5c8a744 Fail fast on empty URL 2022-10-10 14:50:09 +02:00
alesapin
f6b0dc168d Disable concurrent parts removal 2022-10-10 14:10:04 +02:00
alesapin
8a2ba6cd81
Add logging during merge tree startup (#42163) 2022-10-10 09:32:13 +02:00
Alexey Milovidov
e27dbf4369
Update MergeTreeDataSelectExecutor.cpp 2022-10-09 18:27:47 +03:00
Alexey Milovidov
cebc38fa6e Fix a bug with projections and aggregate_functions_null_for_empty setting 2022-10-09 05:30:25 +02:00
Alexey Milovidov
9ee6896916
Merge pull request #42002 from ClickHouse/relax-too-many-parts-threshold
Relax "too many parts" threshold
2022-10-08 20:17:01 +03:00
Alexander Tokmakov
bd10a9d2d4
Merge pull request #42168 from ClickHouse/unreachable_macro
Abort instead of `__builtin_unreachable` in debug builds
2022-10-08 19:05:57 +03:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
alesapin
f695b75eef
Merge pull request #42147 from ClickHouse/more_logs_for_parent_parts
Fix checking parent for old-format parts
2022-10-08 12:08:15 +02:00
Alexey Milovidov
e4ac4a29a9 Fix error 2022-10-08 00:24:51 +02:00
Alexey Milovidov
a45f7c3023 Relax "too many parts" thresholds 2022-10-08 00:24:51 +02:00
Alexey Milovidov
169c505603 Relax "too many parts" thresholds 2022-10-08 00:24:51 +02:00
Alexey Milovidov
b9159db82f Remove temporary live views 2022-10-08 00:16:36 +02:00
Alexander Tokmakov
4175f8cde6 abort instead of __builtin_unreachable in debug builds 2022-10-07 21:49:08 +02:00
Nikolai Kochetov
eccee280a2
Merge pull request #42136 from ClickHouse/revert-27787
Revert #27787
2022-10-07 20:38:38 +02:00
Alexander Tokmakov
1a78e8a817 fix 2022-10-07 20:22:03 +02:00
Sergei Trifonov
a313aa4ede
Merge pull request #41908 from AlfVII/remove-table-is-dropped-exception-when-not-needed
Don't report TABLE_IS_DROPPED exception in order to skip table in case is was just dropped
2022-10-07 18:40:08 +02:00
Alexander Tokmakov
ec2bca51ca Merge branch 'master' into improve_replica_recovery 2022-10-07 16:35:57 +02:00
Alexander Tokmakov
b8d9066004 Revert "Resurrect parallel distributed insert select with s3Cluster (#41535)"
This reverts commit 860e34e760.
2022-10-07 15:53:30 +02:00
alesapin
f1d93d52d1 Fix checking parent for old-format parts 2022-10-07 14:49:25 +02:00
Alexander Tokmakov
bb78bf1c70 improve replica recovery 2022-10-06 21:09:12 +02:00
Nikolai Kochetov
c1cc04d44d Revert #27787 2022-10-06 20:27:55 +02:00
alesapin
3373480ede
Merge pull request #42036 from ClickHouse/fix_one_more_no_such_key
Fix No such key during table drop
2022-10-06 14:50:02 +02:00
Robert Schulze
cc24fcd6d5
Merge pull request #41873 from ClickHouse/generated-file-cleanup
Consolidate CMake-generated config headers
2022-10-06 14:31:03 +02:00
Raúl Marín
adbaaca2f5
QOL log improvements (#41947)
* Uniformize disk reservation logs

* Remove log about destroying stuff that appears all the time

* More tweaks on disk reservation logs

* Reorder logs in hash join

* Remove log that provides little information

* Collapse part removal logs

Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2022-10-06 14:22:44 +02:00
Robert Schulze
78be400ac0
Merge remote-tracking branch 'origin/master' into generated-file-cleanup 2022-10-06 12:22:43 +00:00
Nikita Mikhaylov
860e34e760
Resurrect parallel distributed insert select with s3Cluster (#41535) 2022-10-06 13:47:32 +02:00
Nikita Mikhaylov
766107df0a
Fixed the restriction on maximum size of replicated fetches (#42090) 2022-10-06 13:18:46 +02:00
Anton Popov
aabec50988
Merge pull request #42040 from CurtizJ/async-inserts-log
Add system table `asynchronous_insert_log`
2022-10-06 13:14:41 +02:00
alesapin
adb34f6eae
Merge branch 'master' into fix_one_more_no_such_key 2022-10-06 12:42:16 +02:00
alesapin
6d24e16fda
Merge pull request #42067 from ClickHouse/fix_drop_of_completely_dropped_table
Fix drop of completely dropped table
2022-10-06 12:40:38 +02:00
Kseniia Sumarokova
3cff776109
Merge pull request #41254 from filimonov/system_disks_unreserved_space
Add unreserved_space column to system.disks
2022-10-06 12:28:23 +02:00
Vladimir C
97fb381255
Merge pull request #41813 from zhongyuankai/fix_dist_msg 2022-10-06 11:19:56 +02:00
Vladimir C
3f24c904ad
Merge pull request #41842 from amosbird/index_analysis_1 2022-10-06 11:14:21 +02:00
Robert Schulze
da5a2e2db0
Merge remote-tracking branch 'origin/master' into generated-file-cleanup
Physical merge conflicts:
- src/Common/ZooKeeper/ZooKeeperImpl.cpp
- src/Core/config_core.h.in
- src/Functions/FunctionsAES.h
- src/Functions/config_functions.h.in
- src/configure_config.cmake

Logical merge conflicts:
- Functions/tryDecrypt.cpp
2022-10-06 08:43:25 +00:00
Anton Popov
190e1f6830
Merge branch 'master' into async-inserts-log 2022-10-06 01:59:27 +02:00
alesapin
1541d68607 Better exception 2022-10-05 20:40:35 +02:00
alesapin
4ed522d2a0 Fix 2022-10-05 20:36:55 +02:00
alesapin
cf145910e3 Revert first fix 2022-10-05 20:34:48 +02:00
alesapin
644376aa2c Better fix 2022-10-05 20:32:43 +02:00
Anton Popov
f7cf35d1dd
Merge pull request #42072 from CurtizJ/fix-fuzzer-4
Fix assertion in bloom filter index
2022-10-05 16:38:13 +02:00
alesapin
e6fe71b385
Update src/Storages/StorageReplicatedMergeTree.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2022-10-05 16:12:08 +02:00
alesapin
63be310441
Update src/Storages/StorageReplicatedMergeTree.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2022-10-05 16:12:03 +02:00
Anton Popov
f61e98f0e8
Merge pull request #40668 from ClickHouse/async-insert-max-data-size-fix
Use settings from query context for async INSERTs
2022-10-05 15:15:19 +02:00
Anton Popov
02cdc20d5d
Merge pull request #40096 from CurtizJ/fuzz-table-definitions
Add fuzzer for table definitions
2022-10-05 14:53:48 +02:00
Anton Popov
2f423071f2 fix assertion in bloom filter index 2022-10-04 19:27:56 +00:00
Nikita Mikhaylov
2933a28a5d
Add log message and lower the retry timeout in MergeTreeRestartingThread (#42026) 2022-10-04 20:07:11 +02:00
alesapin
425b296928 Revert "Revert "Merge pull request #41832 from ClickHouse/make_copy_instead_of_hardlink""
This reverts commit f50d46fb8c.
2022-10-04 17:40:23 +02:00
alesapin
6f185333ff Fix drop completely dropped table one more time 2022-10-04 17:39:28 +02:00
alesapin
f50d46fb8c Revert "Merge pull request #41832 from ClickHouse/make_copy_instead_of_hardlink"
This reverts commit 0097f15ee7, reversing
changes made to 4e422b8046.
2022-10-04 17:33:01 +02:00
alesapin
2bfae244cc Add comments 2022-10-04 17:30:25 +02:00
alesapin
4a6fa10e71
Merge branch 'master' into fix_one_more_no_such_key 2022-10-04 15:19:05 +02:00
Anton Popov
9a2cabd3a1
Merge branch 'master' into async-inserts-log 2022-10-04 15:10:50 +02:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions 2022-10-04 15:10:31 +02:00
Kseniia Sumarokova
6d02fa3c5f
Merge pull request #42022 from kssenii/better-exception-merge-tree-data-load-parts
More detailed exception message
2022-10-04 11:20:35 +02:00
Anton Popov
148995894f add system table asynchronous_inserts_log 2022-10-03 21:35:55 +00:00
alesapin
210882b9c4 Better fix 2022-10-03 23:30:50 +02:00
Anton Popov
5cb6357549 fix style check 2022-10-03 19:37:27 +00:00
Sergei Trifonov
4b4fae5bb1
Merge branch 'master' into remove-table-is-dropped-exception-when-not-needed 2022-10-03 19:52:08 +02:00
alesapin
71e1b1df73 add comment 2022-10-03 19:09:24 +02:00
alesapin
3114ddcad2 Fix failure during table drop 2022-10-03 19:06:12 +02:00
Alexey Milovidov
c8872fe96d
Merge pull request #42001 from ClickHouse/part-thresholds-override-more-sane
More sane behavior of part number thresholds override in query level settings
2022-10-03 17:25:39 +03:00
Anton Popov
6e61cf92f5 Merge remote-tracking branch 'upstream/master' into HEAD 2022-10-03 13:16:57 +00:00
Kseniia Sumarokova
0bfbb5c38a
Merge branch 'master' into system_disks_unreserved_space 2022-10-03 14:25:47 +02:00
kssenii
0dc71e9883 More detailed exception message 2022-10-03 14:21:53 +02:00
Alexander Tokmakov
00914a174d
Merge pull request #41410 from ClickHouse/keeper-multiread
Add MultiRead support in Keeper and internal ZK client
2022-10-03 14:17:57 +03:00
Alexander Tokmakov
a2c29076d6 avoid detached broken part duplicates 2022-10-03 12:27:17 +02:00
Alexander Tokmakov
3f9c9c9a77 fix intersecting part if session expired during queue initialization 2022-10-03 12:27:17 +02:00
Alexander Tokmakov
7b5b7e4963
Merge pull request #41945 from ClickHouse/enable_more_s3_tests
Enable some disabled S3 tests
2022-10-03 13:25:50 +03:00
Robert Schulze
db5ef7b3cb
Merge branch 'master' into generated-file-cleanup 2022-10-02 23:13:18 +02:00
Alexey Milovidov
0da9ed8a18
Merge branch 'master' into part-thresholds-override-more-sane 2022-10-02 02:26:21 +03:00
Alexander Tokmakov
e40917a9c5 fix 2022-10-02 00:44:46 +02:00
Alexey Milovidov
7b71524109 More sane behavior of part number thresholds override in query level settings 2022-10-01 20:18:12 +02:00
Vitaly Baranov
c16ae1b916
Merge pull request #41980 from vitlibar/remove-warning-when-perform-ttl-move-on-insert-false
Remove confusing warning when perform_ttl_move_on_insert is false
2022-10-01 15:32:34 +02:00
Kseniia Sumarokova
59596e9067
Merge pull request #41970 from kssenii/fix-use-env-credentials-s3
Fix use_environment_credentials for s3 table function
2022-10-01 13:54:58 +02:00
Vitaly Baranov
7be9744bab Remove confusing warning when inserting with perform_ttl_move_on_insert=false. 2022-09-30 20:51:48 +02:00
alesapin
00bf90186a Better 2022-09-30 19:03:54 +02:00
alesapin
350ff96628 Fix potential race condition with broken parts 2022-09-30 19:01:06 +02:00
avogar
c74b5c8126 Fix schema inference in s3Cluster and improve in hdfsCluster 2022-09-30 16:59:17 +00:00
Anton Popov
9916e35b3f
Merge pull request #41701 from CurtizJ/fix-monotonic-order-by
Fix `ORDER BY` monotonic functions
2022-09-30 17:32:37 +02:00
kssenii
fb3bcd2fe9 Fix use_environment_credentials 2022-09-30 12:25:39 +02:00
Vladimir C
895afdec45
Merge pull request #40893 from ClickHouse/vdimir/track-tmp-disk 2022-09-30 11:27:24 +02:00
Robert Schulze
cc92a2d174
Merge branch 'master' into generated-file-cleanup 2022-09-30 09:56:31 +02:00
alesapin
0097f15ee7
Merge pull request #41832 from ClickHouse/make_copy_instead_of_hardlink
Use copy for some operations instead of hardlinks
2022-09-29 17:12:08 +02:00
Alexander Tokmakov
4e422b8046
Merge pull request #41741 from ClickHouse/fix_intersecting_parts
Fix intersecting parts
2022-09-29 18:00:22 +03:00
Amos Bird
44eaa9583b
Merge branch 'master' into index_analysis_1 2022-09-29 20:25:03 +08:00
Antonio Andelic
94f1fe39bb Add support for exists in multiread 2022-09-29 10:39:33 +00:00
vdimir
c0898ce289
Use abstraction for temporary data on disk in Sort and Aggregation 2022-09-29 09:51:41 +00:00
Antonio Andelic
fcc54104a4 Define methods for multi read requests 2022-09-29 09:19:47 +00:00
Antonio Andelic
3109ce51c6 Merge branch 'master' into keeper-multiread 2022-09-29 06:50:49 +00:00
Alfonso Martinez
981f2e119f Forgot to add function to header 2022-09-29 08:44:10 +02:00
Alfonso Martinez
261ab8e1d0 Fixed style 2022-09-28 18:59:07 +02:00
Alfonso Martinez
65b161341c Replaced changed functions for tryLockForShare 2022-09-28 18:08:10 +02:00
Anton Popov
34bc16cd5b avoid more useless errors 2022-09-28 15:55:39 +00:00
Alfonso Martinez
6bb166b79b exception replaced by nullptr 2022-09-28 17:41:51 +02:00
alesapin
905d4585ac
Merge branch 'master' into make_copy_instead_of_hardlink 2022-09-28 16:47:45 +02:00
Robert Schulze
f24fab7747
Fix some #include atrocities 2022-09-28 13:49:28 +00:00
alesapin
072c19ba96
Merge pull request #41838 from tbsal/tbsal_34798
Improve feedback when replacing partition with different primary key
2022-09-28 15:33:11 +02:00
Robert Schulze
fd86829824
Consolidate config_core.h into config.h
Less duplication, less confusion ...
2022-09-28 13:31:57 +00:00
alesapin
1d9e126f94
Merge pull request #41856 from ClickHouse/fix_possible_no_such_key
Remove two redundant lines
2022-09-28 15:05:55 +02:00
Robert Schulze
09c62f6728
Consolidate config_formats.h into config.h
Less duplication, less confusion ...
2022-09-28 12:59:05 +00:00
Kruglov Pavel
6340369c2a
Merge branch 'master' into improve-combinators 2022-09-28 14:55:30 +02:00
Robert Schulze
0753fd1c77
Consolidate config_functions.h into config.h
Less duplication, less confusion ...
2022-09-28 12:48:26 +00:00
Robert Schulze
6d70b4a1f6
Generate config_version.h into ${CONFIG_INCLUDE_PATH}
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
Robert Schulze
78fc36ca49
Generate config.h into ${CONFIG_INCLUDE_PATH}
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
alesapin
2eef384807 Add comments and test 2022-09-28 13:09:48 +02:00
Alexey Milovidov
1653482406
Merge pull request #41823 from ClickHouse/trying_to_fix_compressed_marks
Fix compressed marks read for compact parts
2022-09-28 14:06:56 +03:00
alesapin
9e77d520d4 Merge branch 'master' into make_copy_instead_of_hardlink 2022-09-28 12:10:00 +02:00
Kseniia Sumarokova
b0a362e403
Merge pull request #41839 from ClickHouse/kssenii-patch-5
Remove unused variable in registerStorageMergeTree.cpp
2022-09-28 11:58:01 +02:00
Antonio Andelic
a9f73d344d
Merge pull request #41784 from ClickHouse/fix-drop-keeper-map-again
Possible fix for KeeperMap drop
2022-09-28 10:28:50 +02:00