Vladimir C
ddde5096ef
Merge branch 'master' into vdimir/tmp-file-metrics
2022-08-25 15:23:35 +02:00
Antonio Andelic
797e21761a
Address PR comments
2022-08-24 18:32:03 +00:00
Antonio Andelic
da0d6056f4
Merge branch 'master' into replicate-tables-readonly
2022-08-24 17:29:33 +00:00
vdimir
7194df1184
Move back TemporaryFile -> TemporaryFileOnDisk
2022-08-24 16:14:11 +00:00
vdimir
1e24a731f7
Move Disks/TemporaryFileOnDisk -> Common/TemporaryFile
2022-08-24 16:14:10 +00:00
vdimir
cd4038d511
Use TemporaryFileOnDisk instead of Poco::TemporaryFile
2022-08-24 16:14:08 +00:00
Alexander Gololobov
1c2dd50ca5
Fix vertical merge of parts with lightweight deleted rows
2022-08-24 15:18:33 +02:00
FArthur-cmd
f59735d4f9
fix style
2022-08-21 12:45:35 +00:00
FArthur-cmd
fb7785c740
add support queries with parameters, add setting to avoid memory overflow
2022-08-21 11:07:03 +00:00
alesapin
78ba732b31
Merge branch 'master' into data_source_description
2022-08-21 12:11:21 +02:00
FArthur-cmd
1e8910f048
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into annoy-2
2022-08-21 08:45:03 +00:00
Alexey Milovidov
ab91c99495
Merge branch 'master' into control_block_size_in_aggregator
2022-08-20 21:28:27 +03:00
alesapin
e4d486fbba
Merge pull request #40346 from ClickHouse/fix_ttl_vertical_merge_bug
...
Fix bug with multiple TTL merges on expired column
2022-08-20 17:09:32 +02:00
Alexey Milovidov
6f39e3e039
Merge pull request #40419 from ClickHouse/fix-parallel-replicas
...
Fix obvious trash in Parallel replicas
2022-08-20 14:10:14 +03:00
Nikita Mikhaylov
4a453f0776
Fix obvious trash
2022-08-19 18:08:13 +00:00
alesapin
d8664c3227
Add shortcut for backups
2022-08-19 16:58:30 +02:00
Antonio Andelic
d07fd218a2
Fix initialization
2022-08-19 14:56:17 +00:00
Antonio Andelic
eeb716d36b
Remove unused error code
2022-08-19 12:03:02 +00:00
Antonio Andelic
ee3df77fda
Simplify logic
2022-08-19 11:12:20 +00:00
Antonio Andelic
5e2c8869a9
Merge branch 'master' into replicate-tables-readonly
2022-08-19 09:41:11 +00:00
Antonio Andelic
3f7d28cc6b
Address PR comments
2022-08-19 09:39:59 +00:00
Antonio Andelic
a8f3b62bf6
Use global zookeeper
2022-08-19 08:49:51 +00:00
Antonio Andelic
6f533313e9
Restart everything during attach
2022-08-19 08:17:02 +00:00
alesapin
a2e08299f8
Update src/Storages/MergeTree/IMergedBlockOutputStream.cpp
...
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
2022-08-18 15:36:55 +02:00
alesapin
20a2e786c9
Fix bug with multiple TTL merges on expired column
2022-08-18 14:21:20 +02:00
Alexander Tokmakov
6e5e0689a3
Merge branch 'master' into parallel_drop_ranges_execution
2022-08-18 13:43:29 +03:00
Antonio Andelic
7dce8e5ebd
Use just atomic for first try
2022-08-18 06:57:40 +00:00
FArthur-cmd
05331603f5
fix size
2022-08-18 06:16:18 +00:00
kssenii
d63d34f7bb
Merge master
2022-08-17 15:49:32 +02:00
alesapin
4398a357c8
Merge pull request #40151 from ClickHouse/fix_cannot_quickly_remove_directory
...
Fix "Cannot quickly remove directory"
2022-08-17 12:11:18 +02:00
Antonio Andelic
1936ea6377
Fix test issues
2022-08-17 08:28:53 +00:00
Nikita Taranov
6bdbaccc37
use max_block_size from settings
2022-08-16 18:56:22 +02:00
Antonio Andelic
b0b9f96837
Use setting for retry period, create independent zookeeper sessions
2022-08-16 13:07:51 +00:00
Alexander Tokmakov
387b69caea
fix race condition
2022-08-16 14:03:31 +02:00
Alexander Tokmakov
d4fb75c8db
Revert "fix race with check thread"
...
This reverts commit 45284108ba
2022-08-16 12:49:17 +02:00
Antonio Andelic
9ac4ca265a
Small initialization fixes
2022-08-16 08:19:02 +00:00
Antonio Andelic
2ed42bca7e
Merge branch 'master' into replicate-tables-readonly
2022-08-16 08:17:53 +00:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
...
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
Alexander Tokmakov
b3f3b60ac3
allow parallel execution of disjoint drop ranges
2022-08-15 20:32:03 +02:00
FArthur-cmd
1d048432a1
update contrib and update cmake
2022-08-15 14:35:51 +00:00
Alexander Tokmakov
c18f3bef91
fix
2022-08-15 16:03:03 +02:00
Alexander Tokmakov
edaff70010
better error message when restoring covered parts
2022-08-15 13:53:14 +02:00
Alexey Milovidov
3d5ceb8fee
Merge branch 'master' into disable-zero-copy-replication
2022-08-14 01:40:20 +02:00
Alexey Milovidov
201cf69854
Merge pull request #39470 from nicelulu/issues_39469
...
Fix issues 39469
2022-08-13 03:13:28 +03:00
Alexey Milovidov
0e450787f3
Edit the documentation
2022-08-12 21:24:27 +02:00
Alexey Milovidov
a88e713102
Disable zero-copy replication by default
2022-08-12 21:22:11 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
...
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Anton Popov
4bd50bb06c
Merge branch 'master' into distinct_sorted_simplify
2022-08-12 17:11:18 +02:00
Antonio Andelic
c6b3a897d2
Test replicated table without ZK, small fixes
2022-08-12 11:56:46 +00:00
Alexander Tokmakov
e691888267
fix build
2022-08-12 13:03:57 +02:00
Alexander Tokmakov
d24b9874bc
fix Cannot quickly remove directory
2022-08-12 12:47:25 +02:00
Antonio Andelic
1c0f85ccdb
Attach table in background
2022-08-12 09:32:13 +00:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Amos Bird
fa8fab2e8f
Fix KeyCondition with other filters
2022-08-11 19:20:44 +08:00
Jianmei Zhang
d1051d822c
Use getSerializedFileExtension() to get correct file extension for index ( #40095 )
2022-08-11 12:39:40 +02:00
Alexey Milovidov
38fc0cc783
Merge branch 'master' into issues_39469
2022-08-11 04:45:06 +03:00
Alexander Tokmakov
fff903ee81
fix
2022-08-10 15:48:56 +02:00
vdimir
b7c5c54181
Fix build
2022-08-10 13:43:55 +00:00
vdimir
5eb4cd39e0
Merge branch 'master' into refactor-prepared-sets
2022-08-10 11:47:49 +00:00
Alexander Tokmakov
54614f5b98
Merge branch 'master' into fix_old_tmp_dirs_cleanup
2022-08-10 13:13:04 +02:00
kssenii
5c3227ba56
Merge master
2022-08-10 12:00:34 +02:00
FArthur-cmd
0ab937afbb
small update
2022-08-10 09:55:07 +00:00
Maksim Kita
aff8149f5c
Merge pull request #39998 from kitaisreal/actions-dag-refactoring
...
ActionsDAG rename index to outputs
2022-08-10 11:44:18 +02:00
kssenii
0dda03c94b
Fix checks
2022-08-10 00:06:58 +02:00
Alexander Tokmakov
060b270929
fix
2022-08-09 23:16:08 +02:00
Alexander Tokmakov
fe572104aa
fix old tmp dirs cleanup
2022-08-09 18:44:51 +02:00
Maksim Kita
a576a55375
Fixed build
2022-08-09 15:03:59 +02:00
zhangxiao871
8bae5f24af
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master
2022-08-09 15:49:03 +08:00
Nikolai Kochetov
540ae64f37
Fix big memory usage for fetch.
2022-08-08 13:32:49 +00:00
vdimir
708747ca0b
Merge branch 'master' into refactor-prepared-sets
2022-08-08 14:27:18 +02:00
Alexander Tokmakov
25a9bf5deb
Merge pull request #39922 from ClickHouse/fix_flaky_tests_commit_obsolete_part
...
Fix flaky tests (`Tried to commit obsolete part`)
2022-08-05 14:36:43 +03:00
kssenii
91f4143b6e
Merge master
2022-08-05 12:14:08 +02:00
Alexander Tokmakov
4bf7a2ca3a
fix warning
2022-08-05 12:05:50 +02:00
Nikolai Kochetov
2fe893ba67
Merge pull request #25563 from ClickHouse/use-dag-in-key-condition
...
Use ActionsDAG in KeyCondition
2022-08-05 11:22:46 +02:00
kssenii
7a9b0bc47f
Merge master
2022-08-05 01:48:52 +02:00
Anton Popov
0492ef63a4
Merge pull request #39464 from CurtizJ/fix-custom-serializations
...
Fix columns of type `Object` with sparse serialization
2022-08-05 00:55:41 +02:00
Nikolai Kochetov
60599197b2
Review fixes.
2022-08-04 15:23:10 +00:00
Nikolai Kochetov
658a269d56
Merge branch 'master' into use-dag-in-key-condition
2022-08-04 16:18:40 +02:00
FArthur-cmd
a2eafae157
fix bug with limit in order by
2022-08-04 12:33:18 +00:00
alesapin
1eb28f5f5f
Merge pull request #39860 from ClickHouse/avoid_additional_disk_touch
...
Better total part size calculation on mutation
2022-08-04 14:21:31 +02:00
Vladimir C
a627b00c43
Merge branch 'master' into refactor-prepared-sets
2022-08-04 13:27:38 +02:00
Nikolay Degterinsky
71cb055ecc
Merge pull request #39812 from guowangy/applyFunction-multi-thread
...
KeyCondition: optimize applyFunction in multi-thread scenario
2022-08-04 01:36:47 +02:00
Anton Popov
04f6a85070
fix mutations
2022-08-03 17:34:46 +00:00
Maksim Kita
e6efb47aa3
Merge pull request #39850 from kitaisreal/select-query-has-join-method
...
Add hasJoin method into ASTSelectQuery
2022-08-03 18:50:25 +02:00
Anton Popov
5da32fafb3
fix ALTER MODIFY COLUMN from nested
2022-08-03 15:08:38 +00:00
alesapin
f608e62c27
Fix call
2022-08-03 14:17:31 +02:00
alesapin
56a4d26e87
Better total part size calculation on mutation
2022-08-03 14:15:45 +02:00
Maksim Kita
3e6b663020
ASTSelectQuery added hasJoin method
2022-08-03 11:25:45 +02:00
Anton Popov
a333cc4146
Merge remote-tracking branch 'upstream/master' into HEAD
2022-08-02 12:57:43 +00:00
Igor Nikonov
56697125d3
Merge remote-tracking branch 'origin/master' into distinct_sorted_simplify
2022-08-02 11:18:46 +00:00
Wangyang Guo
91e3e2f18b
KeyCondition: optimize applyFunction in multi-thread scenario
...
Construct and deconstruct args (ColumnsWithTypeAndName) will inc/dec
ref_count (actually this is a atomic lock inc/dec operation) to share_ptr,
which may share the same DataTypePtr among different threads. This will
have a lock contention issue in large parallel situation.
The patch try to minimize `args` scope and reduce unnecessary
construct/destory of instances. It will improve the performance in
multi-thread cases.
2022-08-02 16:16:16 +08:00
Robert Schulze
bf574b9154
Merge pull request #39760 from ClickHouse/bit-fiddling
...
Use std::popcount, ::countl_zero, ::countr_zero functions
2022-08-01 17:04:51 +02:00
Dmitry Novik
ab5a147065
Merge pull request #38725 from azat/fix-order-by-projection
...
Fix ORDER BY that matches projections ORDER BY
2022-08-01 00:32:59 +02:00
kssenii
e5f4a619ed
Merge master
2022-07-31 20:24:40 +03:00
Robert Schulze
a7734672b9
Use std::popcount, ::countl_zero, ::countr_zero functions
...
- Introduced with the C++20 <bit> header
- The problem with __builtin_c(l|t)z() is that 0 as input has an
undefined result (*) and the code did not always check. The std::
versions do not have this issue.
- In some cases, we continue to use buildin_c(l|t)z(), (e.g. in
src/Common/BitHelpers.h) because the std:: versions only accept
unsigned inputs (and they also check that) and the casting would be
ugly.
(*) https://gcc.gnu.org/onlinedocs/gcc/Other-Builtins.html
2022-07-31 15:16:51 +00:00
Igor Nikonov
7b0b38e997
DistinctSortedTransform works only if columns contains sort prefix of
...
sort description
2022-07-29 20:01:07 +00:00
Nikolai Kochetov
59a11b32ad
Merge branch 'master' into use-dag-in-key-condition
2022-07-29 17:01:33 +02:00
Igor Nikonov
ae82bfb7f3
Merge remote-tracking branch 'origin/master' into distinct_sorted_simplify
2022-07-29 13:12:03 +00:00
Anton Popov
57e4fb2e30
Merge remote-tracking branch 'upstream/master' into HEAD
2022-07-29 11:42:11 +00:00
Anton Popov
bb551566e7
fix build
2022-07-29 11:41:53 +00:00
Anton Popov
04fd72cdef
fix alter column rename
2022-07-28 13:19:23 +00:00
Vladimir C
115506356c
Merge branch 'master' into refactor-prepared-sets
2022-07-27 19:57:23 +02:00
Nikolai Kochetov
6206e468a4
Ignor materialize function for ActionsDAG in PK analysis.
2022-07-27 17:02:48 +00:00
Anton Popov
56039c8780
fix alter of LowCardinality
2022-07-27 15:35:09 +00:00
Anton Popov
4cf0353892
try to fix Nested
2022-07-27 14:05:16 +00:00
Filatenkov Artur
a218597546
Merge branch 'master' into annoy-2
2022-07-27 15:37:58 +03:00
FArthur-cmd
6b5e92e68a
change index policy
2022-07-27 15:36:07 +03:00
vdimir
8eecb9ef82
upd PreparedSets: rename/change signature of methods, add comments
2022-07-27 11:22:16 +00:00
Alexander Tokmakov
8fc075a527
Merge pull request #39619 from ClickHouse/try-do-enable-global-allocations-for-attach
...
Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread
2022-07-27 13:13:04 +03:00
Alexander Gololobov
a64aa00869
Merge pull request #37893 from zhangjmruc/feature/sql-standard-delete
...
Support SQL standard "delete from ... where ..." syntax and lightweight implementation on merge tree tables
2022-07-26 23:39:07 +02:00
vdimir
5ce2960f03
Get rid of SelectQueryInfoBase -> SelectQueryInfo
2022-07-26 18:39:09 +00:00
vdimir
d9928ac93d
Add methods to SubqueryForSet, do not use refernce to SetPtr
2022-07-26 18:39:09 +00:00
vdimir
1e3fa2e01f
Refactor PreparedSets/SubqueryForSet
2022-07-26 18:39:02 +00:00
Anton Popov
9321ca34cf
try to fix Nested
2022-07-26 17:32:37 +00:00
Nikolai Kochetov
33ce662d3e
Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread in some places. Reduced MemoryTrackerBlockerInThread level to User.
2022-07-26 15:22:00 +00:00
Kruglov Pavel
c683cb252f
Merge pull request #39227 from amosbird/rename-log1
...
Rename log when rename merge tree tables
2022-07-26 17:12:44 +02:00
Alexander Gololobov
25deba2c1b
Merge branch 'master' into feature/sql-standard-delete
2022-07-25 22:13:20 +02:00
Alexander Tokmakov
778dcf6994
Merge pull request #39230 from Algunenano/improve_replicated_merge_logging
...
Improve logging around replicated merges
2022-07-25 18:42:12 +03:00
Alexander Gololobov
48de02a7b8
Capitalized const name
2022-07-25 16:32:16 +02:00
Alexander Gololobov
7b44950d1d
More detailed comment
2022-07-25 16:14:33 +02:00
Nikolai Kochetov
b70be40804
Merge branch 'master' into use-dag-in-key-condition
2022-07-25 14:30:22 +02:00
Nikolai Kochetov
1ce8e714d3
Fixing build.
2022-07-25 12:30:01 +00:00
Alexander Gololobov
460950ecdc
Merge branch 'master' into feature/sql-standard-delete
2022-07-24 21:27:22 +02:00
Igor Nikonov
eacc57b6a4
Simplify DistinctSorted
...
+ use ordinary Distinct for deduplication in MergeTree when no sorting provided
2022-07-24 14:26:25 +00:00
Azat Khuzhin
22d8e532ed
Fix ORDER BY that matches projections ORDER BY
...
In case of projection is seleted and it is comlete (all parts has such
projection) and ORDER BY matches projection ORDER BY, and
optimize_read_in_order=1 (default), then the sorting is simply not done,
because projections has separate plan, and so
InterpreterSelectQuery::executeOrder() -> SortingStep has
pipeline.getNumStreams() == 0 and it cannot do sorting.
Fix this, by adding sorting when creating plan for reading from
projections.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-24 15:23:13 +03:00
Kseniia Sumarokova
04944ff6f5
Merge pull request #39509 from monadbobo/remove_duplicate_code
...
Removed some duplicate code.
2022-07-24 14:24:40 +03:00
Alexander Gololobov
6692770113
Allow to update "system" virtual columns such as _row_exists
2022-07-24 12:21:47 +02:00
Alexander Gololobov
c8b3c574a4
Disable lightweight delete if table has projections
2022-07-24 12:21:47 +02:00
Alexander Gololobov
be64b45583
Properly handle empty parts list
2022-07-24 12:21:47 +02:00
Alexander Gololobov
594195451e
Cleanups
2022-07-24 12:21:18 +02:00
Kseniia Sumarokova
f146183400
Merge pull request #39491 from ClickHouse/remove_unused_constructor
...
Remove unused constructor
2022-07-23 21:16:39 +02:00
mergify[bot]
c01ff2d38a
Merge branch 'master' into improve_replicated_merge_logging
2022-07-23 19:10:10 +00:00
Anton Popov
3d03b2714b
try to fix Nested
2022-07-22 23:05:11 +00:00
Nikolai Kochetov
dd65a36c59
Fix another one test.
2022-07-22 19:11:25 +00:00
Nikolai Kochetov
53175e43f3
Better support for projections.
2022-07-22 19:11:25 +00:00
Simon Liu
2305f282dc
Removed some duplicate code.
2022-07-23 02:27:17 +08:00
Anton Popov
49627aa554
Merge remote-tracking branch 'upstream/master' into HEAD
2022-07-22 17:16:06 +00:00
Alexander Tokmakov
bed2206ae9
Merge pull request #39460 from ClickHouse/remove_some_dead_and_commented_code
...
Remove some dead and commented code
2022-07-22 13:24:34 +03:00
alesapin
69984b28e0
Remove unused constructor
2022-07-22 12:21:10 +02:00
Vadim Volodin
8f14c60932
remove exception for old partitions, add server configuration option to enable system unfreeze
2022-07-22 13:10:08 +03:00
zhangxiao871
5549b64c06
Fix issues 39469
2022-07-21 23:52:33 +08:00
Anton Popov
10719fd61d
fix style check
2022-07-21 15:06:55 +00:00
Anton Popov
e0d2c8fb37
fix json type with sparse columns
2022-07-21 14:47:19 +00:00
Vadim Volodin
85bf022258
review zookeeper and partition matching
2022-07-21 16:57:28 +03:00
Alexander Tokmakov
a8da5d96fc
remove some dead and commented code
2022-07-21 15:05:48 +02:00
Alexander Gololobov
1ea9f143ff
Leave only _row_exists-based implementation of lightweight delete
2022-07-21 11:26:13 +02:00
Nikolai Kochetov
e15967e9db
Merge pull request #38475 from ClickHouse/additional-filters
...
Additional filters for a table (from setting)
2022-07-21 07:52:04 +02:00
Alexey Milovidov
fd691000b7
Merge pull request #39342 from azat/bg-executor-fix
...
Fix possible UB in MergeTreeBackgroundExecutor (leads to SIGSEGV on race with DROP/DETACH)
2022-07-21 05:22:51 +03:00
Nikolai Kochetov
91043351aa
Fixing build.
2022-07-20 20:30:16 +00:00
