Igor Nikonov
c0d1be9cab
Merge pull request #42560 from ClickHouse/igor/replicated_merge_tree_some_polishing
...
Some polishing: replicated merge tree
2022-10-23 15:15:24 +02:00
Anton Popov
56e5daba0c
remove DataPartStorageBuilder
2022-10-23 00:23:15 +00:00
Igor Nikonov
730a3ba849
Merge branch 'master' into igor/replicated_merge_tree_some_polishing
2022-10-22 19:54:09 +02:00
Han Fei
2fc91fd338
fix behaviour of max_rows_to_read for trival limit queries
2022-10-22 18:27:24 +02:00
Amos Bird
f104dd08cd
Only fix LowCardinality for now
2022-10-22 15:47:13 +08:00
Azat Khuzhin
905a95e166
Review fixes
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 22:40:13 +02:00
Igor Nikonov
851f556d65
Remove unused parameter
2022-10-21 14:35:37 +02:00
Igor Nikonov
13d31eefbc
Replicated merge tree polishing
...
+ make read-only members const
+ reduce memory allocations
2022-10-21 14:02:52 +02:00
Azat Khuzhin
784f7d988c
Fix -Wshorten-64-to-32 in examples
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:43 +02:00
Azat Khuzhin
4e76629aaf
Fixes for -Wshorten-64-to-32
...
- lots of static_cast
- add safe_cast
- types adjustments
- config
- IStorage::read/watch
- ...
- some TODO's (to convert types in future)
P.S. That was quite a journey...
v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
Antonio Andelic
3091d609fa
Merge branch 'master' into optimize-partitions-in-background
2022-10-21 11:01:41 +02:00
Alexander Tokmakov
0d8a814d80
Merge pull request #42254 from xinhuitian/optimize-selectPartsToMutate
...
Early return of corner cases in selectPartsToMutate function
2022-10-20 18:13:37 +03:00
Alexander Tokmakov
5b03bbce2e
Merge pull request #41981 from ClickHouse/fixes_for_replicated_merge_tree2
...
Some fixes for ReplicatedMergeTree
2022-10-20 16:57:51 +03:00
alesapin
24d02b5516
Merge pull request #42441 from ClickHouse/check_readonly_in_background_tasks
...
Deactivate tasks in ReplicatedMergeTree until startup
2022-10-20 15:36:20 +02:00
Robert Schulze
469d6ad624
Merge pull request #42485 from ClickHouse/fix-bad_cast-in-annoy
...
Fix bad_cast in Annoy index
2022-10-20 15:27:58 +02:00
Alexander Tokmakov
d668a82829
Merge branch 'master' into improve_replica_recovery
2022-10-20 14:25:09 +03:00
Amos Bird
2499ab3b3a
Use convertFieldToType
2022-10-20 17:53:52 +08:00
Antonio Andelic
9d7e44409a
Merge pull request #41342 from ClickHouse/keeper-upload-snapshot-to-s3
...
Upload Keeper snapshots to S3
2022-10-20 09:14:59 +02:00
Antonio Andelic
77eb353839
Merge pull request #42243 from ClickHouse/use-multiread-more
...
Use MultiRead where possible
2022-10-20 09:04:54 +02:00
Nikolai Kochetov
d85bfe6ea3
Merge pull request #42322 from ClickHouse/additional-filters-and-distributed
...
Fix additional_table_filters for Distributed.
2022-10-19 17:09:51 +02:00
Alexander Tokmakov
84ef32e33f
Merge branch 'master' into improve_replica_recovery
2022-10-19 16:28:01 +02:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-19 17:25:24 +03:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index
...
- Problem originally found by data type fuzzer
https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html
- This commit restricts which data types are allowed for Annoy indexes
(similar things are done for other index types).
2022-10-19 13:40:39 +00:00
Antonio Andelic
05e6b94b54
Polishing
2022-10-19 12:59:28 +00:00
Antonio Andelic
e5408aac99
Simplify logic
2022-10-19 12:34:20 +00:00
Amos Bird
549597fe80
Fix misbehavior of key analysis.
...
When key types cannot be inside Nullable, it can break key analysis. See
https://github.com/ClickHouse/ClickHouse/issues/42456 .
2022-10-19 12:15:27 +08:00
Alexey Milovidov
46917c023c
Update AlterCommands.cpp
2022-10-19 00:25:21 +03:00
Alexander Tokmakov
1d9d753167
fix
2022-10-18 18:13:18 +02:00
Nikolai Kochetov
216d671cdf
Update AlterCommands.cpp
2022-10-18 17:56:34 +02:00
Alexander Tokmakov
ea77ff9022
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-18 17:25:25 +02:00
Nikolai Kochetov
b109767dda
Merge branch 'master' into fix-multi-arg-monotonicity
2022-10-18 14:47:33 +00:00
Alexey Milovidov
7befe2825c
Update StorageReplicatedMergeTree.cpp
2022-10-18 17:36:11 +03:00
Alexey Milovidov
0623ad4e37
Update StorageReplicatedMergeTree.cpp
2022-10-18 17:35:44 +03:00
Nikolai Kochetov
a5711fda44
Revert "Revert #27787 "
...
This reverts commit c1cc04d44d
.
2022-10-18 14:00:50 +00:00
alesapin
9769057767
Deactivate all tasks
2022-10-18 15:53:52 +02:00
alesapin
ab8da5a539
Deactivate mutationsFinalizingTask until startup
2022-10-18 15:50:02 +02:00
Kruglov Pavel
25e13bdd2f
Merge pull request #41107 from Avogar/improve-combinators
...
Support all combinators combination in WindowTransform/arratReduce*/initializeAggregation/aggregate functions versioning
2022-10-18 15:24:49 +02:00
Antonio Andelic
d105796c91
Merge branch 'master' into optimize-partitions-in-background
2022-10-18 12:24:03 +00:00
Antonio Andelic
e828dce331
Disable auto optimize by default
2022-10-18 12:11:23 +00:00
Tian Xinhui
45c6974f7d
Use alias for std::shared_ptr<MergeMutateSelectedEntry> ( #42211 )
...
* use alias for MergeMutateSelectedEntry share ptr
* fix StorageMergeTree.cpp
2022-10-18 13:35:34 +02:00
alesapin
673adfbd5c
Merge pull request #42317 from ClickHouse/fix_another_trash_with_zero_cop
...
Fix another trash in zero-copy replication
2022-10-18 12:51:16 +02:00
Antonio Andelic
06b2eeb5a7
Small changes to settings
2022-10-18 09:31:16 +00:00
Antonio Andelic
bd2522fdd0
Merge branch 'master' into optimize-partitions-in-background
2022-10-18 09:13:59 +00:00
Antonio Andelic
ee2f5977d5
Merge branch 'master' into keeper-upload-snapshot-to-s3
2022-10-18 10:02:50 +02:00
Ilya Yatsishin
36b63badb3
Merge pull request #42223 from qoega/hdfs-empty-url
2022-10-18 09:34:10 +02:00
Nikolai Kochetov
3d1ed2969a
Fix possible LOGICAL_ERROR in binary ariphmetics monotonicity. Fix invalid evaluation of binary monotonic function in KeyCondition.
2022-10-17 18:21:03 +00:00
Alexander Tokmakov
57f6e27300
Merge branch 'master' into improve_replica_recovery
2022-10-17 18:37:31 +02:00
Duc Canh Le
9af817bb43
Fix read from buffer with read in order ( #42236 )
2022-10-17 14:25:31 +02:00
Antonio Andelic
7c7395575f
Merge branch 'master' into keeper-upload-snapshot-to-s3
2022-10-17 11:02:36 +00:00
Ilya Yatsishin
dd0fc2435e
Merge remote-tracking branch 'origin/master' into hdfs-empty-url
2022-10-17 12:48:42 +02:00
Nikolai Kochetov
c9aa6a655c
Merge pull request #42319 from ClickHouse/fix-alter-update-wrong-type
...
Fix an invalid type of a column after attach and alter.
2022-10-17 12:44:16 +02:00
alesapin
051e3a0db5
Fix if
2022-10-17 12:27:05 +02:00
alesapin
cf6442fa65
Merge pull request #42222 from ClickHouse/disable_concurrent_parts_removal
...
Disable concurrent parts removal
2022-10-17 12:17:55 +02:00
Antonio Andelic
125501b36a
Merge branch 'master' into use-multiread-more
2022-10-17 07:32:30 +00:00
Antonio Andelic
f3c4d0eff2
Fix keeperMap test
2022-10-17 07:29:22 +00:00
Smita Kulkarni
91433e5b9c
Added ** glob support for recursive directory traversal to filesystem and S3.
...
Implementation:
* Updated parseGlob to not add ‘/‘ restriction when ** is used.
* Updated S3 & filesystem to fetch files and not use regex match if glob is **.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02459_glob_for_recursive_directory_traversal.sh
2022-10-17 09:04:25 +02:00
Ilya Yatsishin
165785f716
mErge remote-tracking branch 'origin/master' into hdfs-empty-url
2022-10-15 19:13:59 +02:00
Vitaly Baranov
91c438eebe
Merge pull request #42263 from vitlibar/refactor-udf
...
Refactor the implementation of user-defined functions
2022-10-15 12:33:10 +02:00
avogar
52427e6028
Remove code duplication
2022-10-14 18:07:02 +00:00
Nikolai Kochetov
b98b1759c8
Fix additional_table_filters for Distributed.
2022-10-14 17:04:42 +00:00
Kruglov Pavel
ff11904850
Merge branch 'master' into improve-combinators
2022-10-14 17:19:31 +02:00
Nikolai Kochetov
b18c6fd8e6
Fix an invalid type of a column after attach and alter.
2022-10-14 14:52:26 +00:00
alesapin
e0c2518416
Fix another trash in zero-copy replication
2022-10-14 16:50:48 +02:00
Ilya Yatsishin
3361b27965
less
2022-10-14 14:27:52 +02:00
alesapin
fd718c0d00
Merge branch 'master' into disable_concurrent_parts_removal
2022-10-14 13:32:11 +02:00
alesapin
4e1a10fb34
better check
2022-10-14 13:32:08 +02:00
Ilya Yatsishin
bbf88b66a0
more
2022-10-13 11:42:35 +02:00
Vitaly Baranov
2e59d671fc
Split UserDefinedSQLObjectsLoader to interface and implementation.
2022-10-13 10:32:32 +02:00
Ilya Yatsishin
e7ca30cd11
fix typo
2022-10-13 10:10:13 +02:00
Alexey Milovidov
96332d9159
Merge branch 'master' into fix-projections
2022-10-13 02:23:32 +02:00
xinhuitian
daaf01c344
early return
2022-10-12 12:18:17 +08:00
flynn
312afdc280
remove useless code
2022-10-12 03:48:37 +00:00
Alexey Milovidov
bbd1196a96
Update MergeTreeData.cpp
2022-10-12 00:57:02 +03:00
Ilya Yatsishin
3201c08bb5
style
2022-10-11 13:54:03 +02:00
Ilya Yatsishin
28c7a22428
address review comments
2022-10-11 11:59:48 +02:00
Antonio Andelic
5e6a7c1678
Use multiread where possible
2022-10-11 09:27:46 +00:00
Alexey Milovidov
56e59dd536
Merge branch 'master' into fix-projections
2022-10-11 02:24:12 +03:00
Ilya Yatsishin
95c5c8a744
Fail fast on empty URL
2022-10-10 14:50:09 +02:00
alesapin
f6b0dc168d
Disable concurrent parts removal
2022-10-10 14:10:04 +02:00
alesapin
8a2ba6cd81
Add logging during merge tree startup ( #42163 )
2022-10-10 09:32:13 +02:00
Alexey Milovidov
e27dbf4369
Update MergeTreeDataSelectExecutor.cpp
2022-10-09 18:27:47 +03:00
Alexey Milovidov
cebc38fa6e
Fix a bug with projections and aggregate_functions_null_for_empty setting
2022-10-09 05:30:25 +02:00
Alexey Milovidov
9ee6896916
Merge pull request #42002 from ClickHouse/relax-too-many-parts-threshold
...
Relax "too many parts" threshold
2022-10-08 20:17:01 +03:00
Alexander Tokmakov
bd10a9d2d4
Merge pull request #42168 from ClickHouse/unreachable_macro
...
Abort instead of `__builtin_unreachable` in debug builds
2022-10-08 19:05:57 +03:00
Alexey Milovidov
9bf5fe728b
Merge pull request #42173 from ClickHouse/remove-temporary-live-view
...
Remove TEMPORARY LIVE VIEW
2022-10-08 19:05:33 +03:00
alesapin
f695b75eef
Merge pull request #42147 from ClickHouse/more_logs_for_parent_parts
...
Fix checking parent for old-format parts
2022-10-08 12:08:15 +02:00
Alexey Milovidov
e4ac4a29a9
Fix error
2022-10-08 00:24:51 +02:00
Alexey Milovidov
a45f7c3023
Relax "too many parts" thresholds
2022-10-08 00:24:51 +02:00
Alexey Milovidov
169c505603
Relax "too many parts" thresholds
2022-10-08 00:24:51 +02:00
Alexey Milovidov
b9159db82f
Remove temporary live views
2022-10-08 00:16:36 +02:00
Alexander Tokmakov
4175f8cde6
abort instead of __builtin_unreachable in debug builds
2022-10-07 21:49:08 +02:00
Nikolai Kochetov
eccee280a2
Merge pull request #42136 from ClickHouse/revert-27787
...
Revert #27787
2022-10-07 20:38:38 +02:00
Alexander Tokmakov
1a78e8a817
fix
2022-10-07 20:22:03 +02:00
Sergei Trifonov
a313aa4ede
Merge pull request #41908 from AlfVII/remove-table-is-dropped-exception-when-not-needed
...
Don't report TABLE_IS_DROPPED exception in order to skip table in case is was just dropped
2022-10-07 18:40:08 +02:00
Alexander Tokmakov
ec2bca51ca
Merge branch 'master' into improve_replica_recovery
2022-10-07 16:35:57 +02:00
Alexander Tokmakov
b8d9066004
Revert "Resurrect parallel distributed insert select with s3Cluster ( #41535 )"
...
This reverts commit 860e34e760
.
2022-10-07 15:53:30 +02:00
alesapin
f1d93d52d1
Fix checking parent for old-format parts
2022-10-07 14:49:25 +02:00
Alexander Tokmakov
bb78bf1c70
improve replica recovery
2022-10-06 21:09:12 +02:00
Nikolai Kochetov
c1cc04d44d
Revert #27787
2022-10-06 20:27:55 +02:00
alesapin
3373480ede
Merge pull request #42036 from ClickHouse/fix_one_more_no_such_key
...
Fix No such key during table drop
2022-10-06 14:50:02 +02:00