Antonio Andelic
f043790e6d
Add support for update
2022-08-31 14:33:53 +00:00
Robert Schulze
ca01286028
Merge pull request #39629 from ClickHouse/catboost-bridge
...
Move CatBoost evaluation into clickhouse-library-bridge
2022-08-31 16:16:11 +02:00
Antonio Andelic
0e6b3b870a
Add support for delete in RocksDB
2022-08-31 13:08:27 +00:00
vdimir
6c15db9b11
Setting max_analyze_depth forbid only second analyze
2022-08-31 11:57:41 +02:00
vdimir
60454bd722
Fix error codes in InterpreterSelectQuery.cpp
2022-08-31 11:57:41 +02:00
vdimir
f38f39ed6f
Use max_analyze_depth
2022-08-31 11:57:41 +02:00
vdimir
928adb2b38
[WIP] Limit number of analyze for one query
2022-08-31 11:57:41 +02:00
Kseniia Sumarokova
9abcfce529
Merge pull request #40759 from kssenii/fix-write-through-cache-logical-error
...
Fix logical error from write-though cache from stress test
2022-08-31 11:55:18 +02:00
Duc Canh Le
aebd1cb7de
Merge branch 'master' into ch_canh_intersect_distinct
2022-08-31 12:08:20 +08:00
Anton Popov
3504781529
Merge branch 'master' into fix-read-in-order-fixed-prefix
2022-08-30 23:32:43 +02:00
Sema Checherinda
412973daee
Update src/Interpreters/AsynchronousMetrics.cpp
...
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2022-08-30 21:57:39 +02:00
Sema Checherinda
6b23abe2b6
Update src/Interpreters/AsynchronousMetrics.cpp
...
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2022-08-30 21:57:33 +02:00
Dmitry Novik
003483b616
Add compatibility setting
2022-08-30 20:49:40 +02:00
kssenii
a5f69517ae
Allow to load marks in threadpool
2022-08-30 20:20:05 +02:00
Sema Checherinda
9bb4f556c3
work on remarks on the review
2022-08-30 20:18:35 +02:00
Dmitry Novik
0a8378d9cd
Merge branch 'master' into betterorderbyoptimization
2022-08-30 14:23:22 +02:00
Vladimir C
7266c007b7
Merge pull request #39131 from amosbird/cte-global-with-fix1
...
Fix unused unknown columns introduced by WITH statement
2022-08-30 13:52:19 +02:00
Kseniia Sumarokova
54f6f5bb2c
Merge branch 'master' into fix-write-through-cache-logical-error
2022-08-30 13:30:13 +02:00
Alexander Tokmakov
0ec7f068cc
Merge pull request #40677 from ClickHouse/query-insert-oom
...
Avoid deadlock in case of new query and OOM
2022-08-30 13:54:34 +03:00
Duc Canh Le
8590cc46c4
implement intersect + except distinct
2022-08-30 18:09:01 +08:00
Frank Chen
f17d56b528
Merge branch 'master' into tracing_context_propagation
2022-08-30 14:24:36 +08:00
Sema Checherinda
e436b4f4cc
Metric for the number of detached parts
2022-08-30 02:12:57 +02:00
Robert Schulze
4d511332c4
chore: delete obsolete modelEvaluate() function
...
- superseded by catboostEvaluate() which no longer uses the internal
repository for external models
- also removed was statement SYSTEM RELOAD MODELS and the monitoring view
SYSTEM.SYSTEMMODELS
2022-08-29 20:27:06 +00:00
Dmitry Novik
e25ed9547e
Update src/Interpreters/ProcessList.h
2022-08-29 20:26:37 +02:00
Dmitry Novik
865ee5d0d6
Refactor code
2022-08-29 20:24:35 +02:00
Dmitry Novik
1169315580
Add OvercommitTracker blocking
2022-08-29 19:44:05 +02:00
Maksim Kita
88141cae98
Merge pull request #40732 from azat/thread-status-fix-leak
...
Fix memory leak while pushing to MVs w/o query context (from Kafka/...)
2022-08-29 19:36:25 +02:00
kssenii
545c6c8be4
Fix
2022-08-29 17:50:27 +02:00
Dmitry Novik
cfe509c3de
Block overcommit tracker in ProcessList near allocations
2022-08-29 17:49:01 +02:00
Vladimir C
5cbe7e0846
Merge pull request #40548 from ClickHouse/vdimir/warn-suppress-40330
...
Add config option warning_supress_regexp
2022-08-29 14:02:00 +02:00
Anton Popov
2a3e012931
Merge branch 'master' into fix-read-in-order-fixed-prefix
2022-08-29 13:17:26 +02:00
vdimir
afb6b7d9cf
Test plan and pipeline for filtering step for join
2022-08-29 09:49:15 +00:00
vdimir
afeff512b5
Aux port for ReadHeadBalancedProcessor is empty Block
2022-08-29 09:49:14 +00:00
vdimir
67a9acc8db
rename CreatingSetOnTheFlyStep -> CreateSetAndFilterOnTheFlyStep
2022-08-29 09:49:07 +00:00
vdimir
6ae15db3ad
check join kind for before applying max_rows_in_set_to_optimize_join
2022-08-29 09:49:04 +00:00
vdimir
51a51694d6
Create sets for joins: better code
2022-08-29 09:49:01 +00:00
vdimir
c778bba13f
Create sets for joins: wip
2022-08-29 09:47:00 +00:00
vdimir
71708d595f
Create sets for joins: wip
2022-08-29 09:46:59 +00:00
vdimir
8f06430ebd
Create sets for joins: upd
2022-08-29 09:46:58 +00:00
vdimir
031aaf3a45
Add Creating/FilterBySetsOnTheFlyStep for full sorting join
2022-08-29 09:46:57 +00:00
Azat Khuzhin
269453a646
Avoid leaking of ThreadGroupStatus::finished_threads_counters_memory
...
Cleanup them in ThreadStatus::detachQuery(), anyway they cannot be
received after by the client.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-29 11:08:50 +02:00
Kseniia Sumarokova
a0bc5b6ea4
Merge pull request #40705 from azat/stress/max_read_buffer_size
...
Fix LOGICAL_ERROR with max_read_buffer_size=0 during reading marks
2022-08-28 12:41:16 +02:00
Azat Khuzhin
c801469e9e
Fix LOGICAL_ERROR with max_read_buffer_size=0 during reading marks
...
The problem is that the buffer size validated after marks reading in
MergeTreeReaderStream::init(), since it requires to read marks first.
And later it is passed to AsynchronousReadBufferFromFileDescriptor,
which throws LOGICAL_ERROR because buffer_size < alignment.
Fix this my simply disallow such values for max_read_buffer_size (I
thougt about modifying createReadBufferFromFileBase(), but it is not
used for remote reads -- remote_fs_buffer_size).
Fixes : #40669
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-27 14:12:07 +02:00
Alexey Milovidov
6940bdab3b
Merge branch 'master' into fix-recursive-buffer
2022-08-26 21:25:11 +03:00
Dmitry Novik
5b7fe91675
Avoid deadlock in case of new query and OOM
2022-08-26 17:02:31 +02:00
Alexey Milovidov
ebe7d2d25e
Fix stack overflow on recursive Buffer tables and system.tables
2022-08-25 21:26:32 +02:00
Frank Chen
92f7ca3616
Move TracingContextOnThread::current() out of class for simplicity
...
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 20:23:56 +08:00
Frank Chen
bb00dcc19b
Remove using namespace from header
...
Signed-off-by: Frank Chen <frank.chen021@outlook.com>
2022-08-25 20:20:13 +08:00
vdimir
414872b1b9
Rename logger.warning_supress_regex -> warning_supress_regexp
2022-08-25 11:00:01 +02:00
vdimir
19cb068f64
Add config option warning_supress_regex
2022-08-25 11:00:01 +02:00
Frank Chen
99c37ce6c6
Merge branch 'master' into tracing_context_propagation
2022-08-25 10:07:16 +08:00
Nikita Taranov
ac34a17551
Merge branch 'master' into control_block_size_in_aggregator
2022-08-24 20:25:28 +02:00
vdimir
91788f29e8
Upd TemporaryFileOnDisk
2022-08-24 16:15:54 +00:00
vdimir
7194df1184
Move back TemporaryFile -> TemporaryFileOnDisk
2022-08-24 16:14:11 +00:00
vdimir
51c44424cc
More metrics for temp files
2022-08-24 16:14:09 +00:00
vdimir
cd4038d511
Use TemporaryFileOnDisk instead of Poco::TemporaryFile
2022-08-24 16:14:08 +00:00
vdimir
1321ac87b5
Minor fixes
2022-08-24 16:14:07 +00:00
Alexander Tokmakov
b8abecb908
Merge pull request #40577 from ClickHouse/revert-39107-parallel-insert-select-s3-cluster
...
Revert "Parallel distributed insert select from *Cluster table functions"
2022-08-24 15:26:03 +03:00
Alexander Tokmakov
9820c3fce0
Merge pull request #40545 from ClickHouse/fix_restart_replica_race
...
Fix race on system restart replica
2022-08-24 15:18:36 +03:00
Alexander Tokmakov
f9f85a0e8b
Revert "Parallel distributed insert select from *Cluster table functions ( #39107 )"
...
This reverts commit d3cc234986
2022-08-24 15:17:15 +03:00
Frank Chen
cd19366b44
Move classes into DB::OpenTelemetry namespace
2022-08-24 16:41:40 +08:00
Frank Chen
efc6a60a60
Clean code
2022-08-24 15:59:44 +08:00
Amos Bird
a8d8293466
Fix unused columns introduced by with stmt
2022-08-24 00:40:01 +08:00
Alexander Tokmakov
77178a18fa
fix race on system restart replica
2022-08-23 16:10:44 +02:00
Vladimir C
3ee52eb25f
Merge pull request #40335 from liql2007/master
...
Fix bugs in MergeJoin when 'not_processed' is not null
2022-08-23 16:02:23 +02:00
Kseniia Sumarokova
d814a56277
Merge pull request #40420 from kssenii/fix-cache-bug
...
Fix incorrect fallback to skip cache in case of very high concurrency level
2022-08-23 14:18:38 +02:00
Vadim Volodin
9c371d518f
fix enable_unfreeze handler and sanitizer hints
2022-08-23 13:53:06 +03:00
Robert Schulze
635cc7617e
Merge pull request #40464 from ClickHouse/less-string-ref
...
Reduce some usage of StringRef
2022-08-23 12:16:00 +02:00
Nikita Taranov
b31342ec2c
fix
2022-08-22 19:29:48 +02:00
kssenii
26384b2543
Fix
2022-08-22 00:02:05 +02:00
Robert Schulze
4caf2c4c33
Reduce some usage of StringRef
...
See #39535 and #39300
2022-08-21 18:10:32 +00:00
Alexey Milovidov
ab91c99495
Merge branch 'master' into control_block_size_in_aggregator
2022-08-20 21:28:27 +03:00
Alexey Milovidov
74e1f4dc61
Fix clang-tidy
2022-08-20 17:09:20 +02:00
Frank Chen
024fef1aec
Merge branch 'master' into tracing_context_propagation
2022-08-20 14:23:36 +08:00
Alexander Tokmakov
8cbdd39c81
Update ActionsDAG.cpp
2022-08-19 11:34:15 +03:00
Alexander Tokmakov
b9e090699a
Merge branch 'master' into fix_incorrect_replica_idenifier
2022-08-18 21:18:10 +03:00
Alexander Tokmakov
629690c32b
fix "incorrect replica identifier"
2022-08-18 16:13:27 +02:00
Frank Chen
a3b6ad2a65
Merge branch 'master' into tracing_context_propagation
2022-08-18 20:59:07 +08:00
Kseniia Sumarokova
be1b835f88
Merge branch 'master' into fix-typo
2022-08-18 14:00:23 +02:00
Nikolai Kochetov
5a85531ef7
Merge pull request #38286 from Avogar/schema-inference-cache
...
Add schema inference cache for s3/hdfs/file/url
2022-08-18 13:07:50 +02:00
yinpeiqi
042ad7d9a8
fix typo
2022-08-18 18:45:16 +08:00
Kseniia Sumarokova
d8fd1f9c37
Merge pull request #36171 from kssenii/make-cache-composable
...
Make cache composable, allow not to evict certain files (regarding .idx, .mrk, ..), delete old cache version
2022-08-18 12:37:34 +02:00
Kruglov Pavel
d7056376eb
Merge pull request #40068 from Avogar/schema-inference-hints
...
Allow to specify structure hints in schema inference
2022-08-18 12:19:45 +02:00
liql2007
db0ca7c1d4
fix bugs in MergeJoin when 'not_processed' is not null
2022-08-18 18:09:47 +08:00
Vladimir C
7ac0eb1af1
Merge pull request #40035 from ClickHouse/vdimir/cluster-discovery-observer
...
Add observer mode to (zoo)keeper cluster discovery feature
2022-08-18 10:53:49 +02:00
vdimir
7305158a58
More robust ClusterDiscovery::updateCluster
2022-08-17 14:46:06 +00:00
kssenii
d63d34f7bb
Merge master
2022-08-17 15:49:32 +02:00
Yong Wang
c2c457ea0e
Kusto-phase1: Change the dialect to Enum, rename sql_dialect to dialect, set limit to subquery
2022-08-17 06:03:41 -07:00
avogar
8dd54c043d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into schema-inference-cache
2022-08-17 11:47:40 +00:00
Igor Nikonov
46ed4f6cdf
Merge pull request #38719 from ClickHouse/skipping_sorting_step
...
SortingStep: deduce way to sort based on input stream sort description
2022-08-17 12:58:11 +02:00
Alexander Tokmakov
d1ffa21e2f
fix
2022-08-17 12:17:37 +02:00
Alexander Tokmakov
caa270b72a
Merge pull request #39933 from ClickHouse/auto_convert_ordinary_to_atomic
...
Add flag that enables automatic conversion from Ordinary to Atomic
2022-08-17 12:40:49 +03:00
Nikita Mikhaylov
a7c3f23dfb
Merge branch 'master' into auto_convert_ordinary_to_atomic
2022-08-17 00:38:25 +02:00
Yong Wang
87182ccd51
Kusto-phase1: Add Support to Kusto Query Language
...
This is the initial implement of Kusto Query Language.
in this commit, we support the following features as MVP :
Tabular expression statements
Limit returned results
Select Column (basic project)
sort, order
Perform string equality operations
Filter using a list of elements
Filter using common string operations
Some string operators
Aggregate by columns
Base aggregate functions
only support avg, count ,min, max, sum
Aggregate by time intervals
2022-08-16 17:31:38 -04:00
Nikita Taranov
14d45f9d86
fix style
2022-08-16 18:56:22 +02:00
Nikita Taranov
a6c4f9218a
clean up
2022-08-16 18:56:22 +02:00
Nikita Taranov
248011d7d9
move to utils
2022-08-16 18:56:22 +02:00
Nikita Taranov
6bdbaccc37
use max_block_size from settings
2022-08-16 18:56:22 +02:00
Nikita Taranov
370c25cd2a
fix comment
2022-08-16 18:56:22 +02:00
Nikita Taranov
2b76abdacd
fix tidy
2022-08-16 18:56:22 +02:00
Nikita Taranov
66b3268c65
fix
2022-08-16 18:56:22 +02:00
Nikita Taranov
56c09bf8a9
generate many blocks in convertToBlockImplNotFinal
2022-08-16 18:56:22 +02:00
Nikita Taranov
433657e978
rm prepareBlockAndFill
2022-08-16 18:56:22 +02:00
Nikita Taranov
63bc894a42
more parallelism
2022-08-16 18:56:22 +02:00
Nikita Taranov
f650b23ee3
generate many blocks
2022-08-16 18:56:22 +02:00
Nikita Taranov
db0110fd7a
more accurate crutch
2022-08-16 18:56:22 +02:00
Nikita Taranov
e5e0a24ab3
return chunks from prepareBlockAndFillWithoutKey
2022-08-16 18:56:22 +02:00
Nikita Taranov
4e974661d6
refactor convertToBlockImpl
2022-08-16 18:56:22 +02:00
Nikita Taranov
bca28ba9f8
split prepareBlockAndFill
2022-08-16 18:56:22 +02:00
Igor Nikonov
d4367de7bb
Rename setting to optimize_sorting_by_input_stream_properties
2022-08-16 16:27:41 +00:00
Alexander Tokmakov
0136262a2a
fix
2022-08-16 18:03:02 +02:00
Igor Nikonov
51f4716b29
Fix review comments
2022-08-16 14:59:53 +00:00
Alexander Tokmakov
832d7c6e7c
Merge branch 'master' into replicated_database_improvements
2022-08-16 15:49:13 +02:00
avogar
936c457734
Remove unnended field
2022-08-16 09:51:52 +00:00
avogar
e1ff996ec3
Allow to specify structure hints in schema inference
2022-08-16 09:46:57 +00:00
Maksim Kita
110470809b
Merge pull request #40121 from amosbird/profile-processor-1
...
Extend processors_profile_log with more info
2022-08-16 09:49:12 +02:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Igor Nikonov
7a9bdbe81a
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-15 20:59:37 +00:00
Alexey Milovidov
4f1b964f2f
Merge branch 'master' into window-order-by
2022-08-15 19:31:55 +03:00
Alexey Milovidov
a0693c3a84
Merge pull request #40225 from ClickHouse/simplify-code
...
Simplify the code and check what will happen
2022-08-15 19:05:38 +03:00
Igor Nikonov
ea10fd65b8
Sorting properties in EXPLAIN PLAN
...
~ change formatting for sorting
~ rename sortmode option -> sorting
2022-08-15 15:14:59 +00:00
Nikita Mikhaylov
d3cc234986
Parallel distributed insert select from *Cluster table functions ( #39107 )
2022-08-15 12:41:17 +02:00
Alexey Milovidov
24371f6cf0
Simplify the code and check what will happen
2022-08-15 06:56:29 +02:00
Alexey Milovidov
903021f35a
Merge branch 'master' into profile-events-incomplete-result
2022-08-14 11:04:19 +03:00
Alexey Milovidov
1a8ddf2956
Addition to prev. revision
2022-08-14 09:35:22 +02:00
Alexey Milovidov
216c1d8efa
Revert "Use separate counter for RSS in global memory tracker."
2022-08-14 09:50:12 +03:00
Igor Nikonov
d83bea626c
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-13 21:46:34 +00:00
Igor Nikonov
9566e2995d
Fix of check if sorting order is preserved
2022-08-13 21:44:29 +00:00
Igor Nikonov
f33a0d8c85
More simple way to check if sorting order is preserved
...
- there is a case where it's done wrong
2022-08-12 23:42:37 +00:00
Kseniia Sumarokova
a6cfc7bc3b
Merge pull request #34651 from alexX512/master
...
New caching strategies
2022-08-12 17:23:37 +02:00
Igor Nikonov
bf037275a5
More robust check if sorting order is changed by expression
...
+ tests
2022-08-12 14:57:18 +00:00
vdimir
89dca02e1d
Fix ClusterDiscovery
2022-08-12 13:26:17 +00:00
vdimir
cef6c4f8ce
Add observer mode to (zoo)keeper cluster discovery feature
2022-08-12 13:26:12 +00:00
Nikita Taranov
17956cb668
Extend protocol with query parameters ( #39906 )
2022-08-12 14:28:35 +02:00
Nikolai Kochetov
86061d945e
Merge pull request #39826 from amosbird/projection-row-policy-fix
...
Primary key analysis for row_policy_filter and additional_filter
2022-08-12 11:32:58 +02:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Kseniia Sumarokova
be69169f97
Merge pull request #38048 from KinderRiven/decoupling_cache_function_and_algorithm
...
Decoupling local cache function and cache algorithm
2022-08-11 16:49:56 +02:00
Amos Bird
99a38e41aa
processor profile
2022-08-11 21:03:34 +08:00
Maksim Kita
45d69951e2
Merge pull request #40069 from Algunenano/interpreter_udf_visitor
...
Don't visit the AST for UDFs if none are registered
2022-08-11 14:54:14 +02:00
Igor Nikonov
d9f5c56c41
Fix compilation errors after fixing merge conflicts
2022-08-11 12:51:45 +00:00
Igor Nikonov
75f6fcfa70
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-11 12:35:55 +00:00
Vladimir C
643084417e
Merge pull request #40113 from vdimir/dict-join-refactoring-followup
...
Delete files DictionaryJoinAdapter.h/cpp
2022-08-11 13:25:45 +02:00
Amos Bird
fa8fab2e8f
Fix KeyCondition with other filters
2022-08-11 19:20:44 +08:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
...
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
vdimir
61ad12279e
Delete files DictionaryJoinAdapter.h/cpp
...
Follow-up for https://github.com/ClickHouse/ClickHouse/pull/38956
2022-08-11 10:27:14 +00:00
Maksim Kita
6bec0f5854
Merge pull request #38956 from vdimir/dict-join-refactoring
...
Join with dictionary refactoring
2022-08-11 11:54:11 +02:00
Vladimir C
2d44e6c458
Merge pull request #39343 from vdimir/refactor-prepared-sets
...
Refactor PreparedSets/SubqueryForSet
2022-08-11 11:19:18 +02:00
Vladimir Chebotaryov
748979a9c0
Merge branch 'master' into betterorderbyoptimization
2022-08-11 11:09:52 +03:00
Raúl Marín
ce9c0c2da3
Style
2022-08-10 21:53:11 +02:00
KinderRiven
9d83b93e88
fix rebase
2022-08-11 00:11:40 +08:00
Raúl Marín
32c63f43a1
Don't visit the AST for UDFs if none are registered
2022-08-10 17:54:56 +02:00
kssenii
0ff5609738
Finish support for persistent files
2022-08-10 16:54:59 +02:00
Nikita Mikhaylov
8e8e845a89
Merge branch 'master' into separate-counter-for-rss-in-memory-tracker
2022-08-10 16:44:24 +02:00
vdimir
90fa2ed8c1
better code for join with dict
2022-08-10 14:20:29 +00:00
vdimir
44c688332a
IKeyValueEntity is not inheritor of IStorage
2022-08-10 14:20:28 +00:00
vdimir
ad91c16ba0
Rename join_common -> JoinUtils
2022-08-10 14:20:28 +00:00
vdimir
f7b130b0cb
Rename IKVStorage.h -> IKeyValueStorage.h
2022-08-10 14:20:28 +00:00
vdimir
442ffb0349
Fix build after resolving conflicts
2022-08-10 14:20:27 +00:00
vdimir
d1aea19987
Remove old join with dictionary
2022-08-10 14:20:26 +00:00
vdimir
7073067d40
check attributes for join with dict
2022-08-10 14:20:26 +00:00
vdimir
3347345873
Join with dictionary uses DirectJoin
2022-08-10 14:20:18 +00:00
vdimir
b7c5c54181
Fix build
2022-08-10 13:43:55 +00:00
Nikolai Kochetov
933043d841
Minor fixes.
2022-08-10 12:38:35 +00:00
vdimir
5eb4cd39e0
Merge branch 'master' into refactor-prepared-sets
2022-08-10 11:47:49 +00:00
kssenii
5c3227ba56
Merge master
2022-08-10 12:00:34 +02:00
Maksim Kita
aff8149f5c
Merge pull request #39998 from kitaisreal/actions-dag-refactoring
...
ActionsDAG rename index to outputs
2022-08-10 11:44:18 +02:00
Vladimir C
1196d1d117
Merge pull request #40009 from ClickHouse/vdimir/rename-joined-project-input
...
Project input for rename joined columns step
2022-08-10 10:32:36 +02:00
Yakov Olkhovskiy
ffbaf72bab
Merge pull request #39874 from ClickHouse/fix-quota-key
...
Fix quota_key
2022-08-10 00:12:44 -04:00
Igor Nikonov
754a9fb096
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-09 22:20:17 +00:00
Igor Nikonov
bf5269d536
Avoid copying SortDescription during SortingStep construction
2022-08-09 22:19:25 +00:00
kssenii
0dda03c94b
Fix checks
2022-08-10 00:06:58 +02:00
Maksim Kita
acbfcf440b
Merge branch 'master' into actions-dag-refactoring
2022-08-09 18:52:08 +02:00
Igor Nikonov
70b52f7cb9
Fix test, review comments
2022-08-09 16:29:56 +00:00
Igor Nikonov
366ead3828
Consider aliases when checking if sorting order is preserved by
...
expression
2022-08-09 11:27:17 +00:00
vdimir
29efed0c77
Project input for rename joined columns step
2022-08-08 19:11:53 +00:00
Alexander Gololobov
4c86130796
More generic check for MergeTree table family
2022-08-08 19:04:35 +02:00
Maksim Kita
c030fd05e7
ActionsDAG rename index to outputs
2022-08-08 18:01:32 +02:00
Yakov Olkhovskiy
d39e9f65de
Merge branch 'master' into fix-quota-key
2022-08-08 11:54:21 -04:00
Alexander Tokmakov
2c5da1466d
Merge branch 'master' into replicated_database_improvements
2022-08-08 16:08:27 +02:00
Alexander Tokmakov
848511affb
take permanently detached tables into account
2022-08-08 16:06:08 +02:00
Igor Nikonov
86c5280db3
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-08 12:43:06 +00:00
Igor Nikonov
6572a447fa
Check if sorting order is preserved for FilterStep
2022-08-08 12:42:10 +00:00
vdimir
708747ca0b
Merge branch 'master' into refactor-prepared-sets
2022-08-08 14:27:18 +02:00
avogar
1cfb5b7cf1
Fix build
2022-08-08 12:17:18 +00:00
alexX512
62f84b88eb
Review fixes
2022-08-07 20:02:21 +00:00
alexX512
2be72560f4
Add loading of mark cache policy
2022-08-07 19:59:39 +00:00
alexX512
6bf29cb610
Change class LRUCache to class CachBase. Check running CacheBase with default pcahce policy SLRU
2022-08-07 19:59:30 +00:00
alexX512
1133e42367
Add CacheBase clas instead of LRUCache and SLRUCache fo simpler configuration oache policiesf
2022-08-07 19:16:40 +00:00
Igor Nikonov
988ce29e9e
Check if expression step violates sorting correctly
2022-08-06 22:37:14 +00:00
Azat Khuzhin
2d7de7f683
Remove dictionaries from prometheus metrics on DETACH/DROP
...
Fixes : #23436 (cc @kitaisreal)
Introduced-in: #9622 (cc @YiuRULE)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:58:07 +03:00
Alexander Tokmakov
f2c4cad255
add flag that enables automatic canversion from Ordinary to Atomic
2022-08-05 21:41:25 +02:00
avogar
9b1a267203
Refactor, remove TTL, add size limit, add system table and system query
2022-08-05 16:20:15 +00:00
Nikolai Kochetov
b41b716245
Update AsynchronousMetrics.cpp
2022-08-05 18:16:35 +02:00
Igor Nikonov
f5f6ada69b
ActionsDAG check is not dependent on sort description
2022-08-05 11:00:18 +00:00
kssenii
91f4143b6e
Merge master
2022-08-05 12:14:08 +02:00
Nikolai Kochetov
2fe893ba67
Merge pull request #25563 from ClickHouse/use-dag-in-key-condition
...
Use ActionsDAG in KeyCondition
2022-08-05 11:22:46 +02:00
kssenii
7a9b0bc47f
Merge master
2022-08-05 01:48:52 +02:00
Igor Nikonov
246f7b71b6
Merge branch 'master' into skipping_sorting_step
2022-08-05 00:03:54 +02:00
Igor Nikonov
a70c47f780
EXPLAIN PLAN sortmode options
...
+ ActionsDAG fixes
2022-08-04 22:02:53 +00:00
Igor Nikonov
0a659f5ab8
Analyze ActionsDAG in ExpressionStep
...
+ check if sorting order can be kept from prevous step
+ EXPLAIN PLAN header=1 contains Sort Mode and Sort Description for each step
+ some tests
+ fix some review comments
2022-08-04 19:30:25 +00:00
Alexander Tokmakov
460f2f2e39
Merge branch 'master' into store_cleanup_all_disks
2022-08-04 19:48:41 +02:00
Yakov Olkhovskiy
23037daf17
Merge branch 'master' into fix-quota-key
2022-08-04 12:14:49 -04:00
Nikolai Kochetov
658a269d56
Merge branch 'master' into use-dag-in-key-condition
2022-08-04 16:18:40 +02:00
Alexander Tokmakov
6a5171c829
Update DatabaseCatalog.cpp
2022-08-04 17:10:13 +03:00
Vladimir C
a627b00c43
Merge branch 'master' into refactor-prepared-sets
2022-08-04 13:27:38 +02:00
Alexey Milovidov
9e46abc560
Merge pull request #39420 from amosbird/better-projection1-fix1
...
Normalize AggregateFunction types and state representations
2022-08-04 03:06:55 +03:00
Alexey Milovidov
f474eb957d
Merge pull request #39758 from ClickHouse/tsan_clang_15
...
Try clang-15 for build with tsan
2022-08-04 01:56:52 +03:00
Yakov Olkhovskiy
2e34b384c1
update tcp protocol, add quota_key
2022-08-03 15:44:08 -04:00
Alexander Tokmakov
a269cf29e4
remove unused dirs from store on all disks
2022-08-03 19:49:16 +02:00
Nikita Taranov
4943202921
Improve memory usage during memory efficient merging of aggregation results ( #39429 )
2022-08-03 17:56:59 +02:00
Igor Nikonov
9eef299e11
Merge pull request #39103 from tonickkozlov/tonickkozlov/37032/do-not-optimize-functions-shadowing-args
...
Do not optimize GROUP BY functions that shadow their arguments
2022-08-03 15:06:42 +02:00
Alexander Tokmakov
1a059035b8
fix logical error on connection loss
2022-08-03 14:13:01 +02:00
Vladimir Chebotaryov
484d8f7028
Merge branch 'master' into betterorderbyoptimization
2022-08-03 08:14:50 +03:00
Frank Chen
1c9b462c80
Merge remote-tracking branch 'origin/master' into tracing_context_propagation
2022-08-02 20:18:22 +08:00
Alexander Tokmakov
691526b7de
ignore unknown hosts when looking for current host
2022-08-02 12:51:00 +02:00
Anton Kozlov
ce70f3dacb
fixed 02303_query_kind test; added logging in 02352_grouby_shadows_arg test
2022-08-02 10:50:27 +00:00
Igor Nikonov
4bf42ce867
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-08-02 10:50:25 +00:00
Igor Nikonov
0cb59aa38c
ExpressionStep: simple check if expression changes sorting order
2022-08-02 10:45:05 +00:00
Alexander Tokmakov
82b50e79cf
Merge branch 'master' into tsan_clang_15
2022-08-02 13:00:55 +03:00
Alexander Tokmakov
5050e0aca5
Revert "Limit number of analyze for one query"
2022-08-02 12:48:31 +03:00
Nikolai Kochetov
a3bf9496d4
Merge pull request #39799 from ClickHouse/fix-extra-column-after-array-join-optimization
...
Fix extra column after ARRAY JOIN optimization.
2022-08-02 10:35:35 +02:00
Frank Chen
40c6e4c0d6
Merge remote-tracking branch 'origin/master' into tracing_context_propagation
2022-08-02 10:02:09 +08:00
Nikolai Kochetov
77c143aa23
Fix extra column after ARRAY JOIN optimization.
2022-08-01 17:56:27 +00:00
Alexander Tokmakov
1567b65473
Merge branch 'master' into replicated_database_improvements
2022-08-01 19:12:37 +02:00
Alexander Tokmakov
0d68b1c67f
fix build with clang-15
2022-08-01 18:00:54 +02:00
Robert Schulze
bf574b9154
Merge pull request #39760 from ClickHouse/bit-fiddling
...
Use std::popcount, ::countl_zero, ::countr_zero functions
2022-08-01 17:04:51 +02:00
Amos Bird
f11d0484f3
Normalize everything else
2022-08-01 21:04:11 +08:00
Anton Popov
8a3ec52b5e
Merge pull request #39752 from CurtizJ/fix-index-analysis
...
Fix index analysis with tuples and `IN`
2022-08-01 14:41:46 +02:00
Kruglov Pavel
6457c069a9
Merge pull request #39293 from kssenii/fix-positional-args-case
...
Fix positional arguments in case of unneeded columns pruning
2022-08-01 12:42:18 +02:00
Vladimir Chebotaryov
aaa6049678
Merge branch 'master' into betterorderbyoptimization
2022-08-01 11:42:48 +03:00
Dmitry Novik
ab5a147065
Merge pull request #38725 from azat/fix-order-by-projection
...
Fix ORDER BY that matches projections ORDER BY
2022-08-01 00:32:59 +02:00
Robert Schulze
d39259a4c0
More conversions
2022-07-31 22:06:02 +00:00
Vladimir Chebotaryov
9fc3addea9
Fixed using column_after_join for handling WINDOW expressions in ExpressionAnalyzer, shall be aggregated_columns.
2022-07-31 23:36:20 +03:00
Nikolai Kochetov
22fbfe19a4
Merge branch 'master' into use-dag-in-key-condition
2022-07-31 21:54:12 +02:00
Alexey Milovidov
ccef227494
Merge pull request #38185 from vdimir/analyze_stuck
...
Limit number of analyze for one query
2022-07-31 22:53:09 +03:00
kssenii
e5f4a619ed
Merge master
2022-07-31 20:24:40 +03:00
Robert Schulze
a7734672b9
Use std::popcount, ::countl_zero, ::countr_zero functions
...
- Introduced with the C++20 <bit> header
- The problem with __builtin_c(l|t)z() is that 0 as input has an
undefined result (*) and the code did not always check. The std::
versions do not have this issue.
- In some cases, we continue to use buildin_c(l|t)z(), (e.g. in
src/Common/BitHelpers.h) because the std:: versions only accept
unsigned inputs (and they also check that) and the casting would be
ugly.
(*) https://gcc.gnu.org/onlinedocs/gcc/Other-Builtins.html
2022-07-31 15:16:51 +00:00
Igor Nikonov
7f0adb5eb0
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-07-31 07:07:36 +00:00
Anton Popov
095e400075
fix index analysis with tuples and IN
2022-07-31 00:38:52 +00:00
kssenii
d66c108a04
Fix
2022-07-30 18:42:22 +03:00
Maksim Kita
acb0137dbb
Merge pull request #39718 from kitaisreal/join-enums-refactoring
...
Join enums refactoring
2022-07-30 13:53:08 +02:00
Alexey Milovidov
1e974b55ea
Merge branch 'master' into analyze_stuck
2022-07-30 04:56:21 +03:00
kssenii
efff78819a
Merge remote-tracking branch 'upstream/master' into fix-positional-args-case
2022-07-29 22:07:51 +03:00
Maksim Kita
8ba42876fc
Fixed build
2022-07-29 19:35:15 +02:00
Maksim Kita
8fc6bad4f4
Join enums refactoring
2022-07-29 18:35:05 +02:00
Alexander Tokmakov
07617df98e
Merge branch 'master' into fix_flaky_tests_ordinary
2022-07-29 18:02:05 +03:00
Nikolai Kochetov
59a11b32ad
Merge branch 'master' into use-dag-in-key-condition
2022-07-29 17:01:33 +02:00
Alexander Tokmakov
0cef018c29
clear mmapio cache when dropping table from Ordinary
2022-07-29 14:26:41 +02:00
Robert Schulze
a3c52f1140
Merge pull request #39679 from azat/fix-utils
...
Fix utils build on CI
2022-07-29 14:02:53 +02:00
Alexander Tokmakov
396e49d243
Merge pull request #39686 from azat/zookeeper_log.duration_ms
...
Add duration_ms into system.zookeeper_log
2022-07-29 11:40:30 +03:00
Azat Khuzhin
498c8b3c52
Fix clang-tidy in utils/examples
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-29 11:36:51 +03:00
Yakov Olkhovskiy
0f1747b421
Merge pull request #39621 from amosbird/trivial-optimization
...
Combining sumIf->countIf and multiIf->if opt.
2022-07-28 16:08:36 -04:00
Azat Khuzhin
e1f8cff3b4
Add duration_ms into system.zookeeper_log
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-28 22:34:51 +03:00
Nikolai Kochetov
6919ae7c91
Fixing a test with indexHint
2022-07-28 12:24:16 +00:00
Alexander Tokmakov
b3732df248
Merge branch 'master' into replicated_database_improvements
2022-07-28 13:08:30 +02:00
Alexander Tokmakov
c7fb6aa6d5
fix style check so maybe CI checks will strart
2022-07-28 13:07:46 +02:00
Antonio Andelic
15e999f8bc
Merge pull request #39096 from ClickHouse/keeper-version-check
...
Add version for Keeper API
2022-07-28 10:10:49 +02:00
Vitaly Baranov
f8ebe76826
Merge pull request #39503 from vitlibar/improve-system-backups-table
...
Improve system.backups table
2022-07-27 20:25:39 +02:00
Vladimir C
115506356c
Merge branch 'master' into refactor-prepared-sets
2022-07-27 19:57:23 +02:00
Alexander Tokmakov
24725b5f95
fix synchronous queries
2022-07-27 19:15:00 +02:00
Vladimir C
a8be51f4df
Merge pull request #39567 from Algunenano/progress_result_rows_and_bytes
...
Add result_rows and result_bytes to progress reports
2022-07-27 16:43:55 +02:00
vdimir
8eecb9ef82
upd PreparedSets: rename/change signature of methods, add comments
2022-07-27 11:22:16 +00:00
Nikolai Kochetov
873432fb53
Merge pull request #37849 from ClickHouse/bug-with-fill-date
...
Enforce equality of WITH FILL type with ORDER BY column's type for date/time types.
2022-07-27 12:27:53 +02:00
Alexander Tokmakov
44463cfca0
Merge pull request #39565 from ClickHouse/fix_39511
...
Fix create/drop index on cluster
2022-07-27 13:21:51 +03:00
Alexander Tokmakov
8fc075a527
Merge pull request #39619 from ClickHouse/try-do-enable-global-allocations-for-attach
...
Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread
2022-07-27 13:13:04 +03:00
Vitaly Baranov
fc16a15ecf
Rename column "uuid" -> "id" in system.backups and allow user to set it in a query.
2022-07-27 09:04:10 +02:00
Vitaly Baranov
d129be2a9e
Remove column "backup_name" from the result of a BACKUP/RESTORE query
2022-07-27 09:04:10 +02:00
Vitaly Baranov
afd0982187
Remove column "internal" from system.backups
2022-07-27 09:04:10 +02:00
Vitaly Baranov
16a60b5e93
Merge pull request #39455 from vitlibar/fix-locks-add-tests
...
Improve synchronization between hosts in distributed backup and fix locks
2022-07-27 09:02:58 +02:00
Alexander Gololobov
a64aa00869
Merge pull request #37893 from zhangjmruc/feature/sql-standard-delete
...
Support SQL standard "delete from ... where ..." syntax and lightweight implementation on merge tree tables
2022-07-26 23:39:07 +02:00
vdimir
5ce2960f03
Get rid of SelectQueryInfoBase -> SelectQueryInfo
2022-07-26 18:39:09 +00:00
vdimir
11d37a8dc9
Properly initialize prepared_sets
2022-07-26 18:39:09 +00:00
vdimir
d9928ac93d
Add methods to SubqueryForSet, do not use refernce to SetPtr
2022-07-26 18:39:09 +00:00
vdimir
1e3fa2e01f
Refactor PreparedSets/SubqueryForSet
2022-07-26 18:39:02 +00:00
Nikolai Kochetov
fa0707b4e7
Review fixes.
2022-07-26 17:51:09 +00:00
Amos Bird
5ad8314367
Combining sumIf->countIf and multiIf->if opt.
2022-07-26 23:55:13 +08:00
Nikolai Kochetov
33ce662d3e
Replace MemoryTrackerBlockerInThread to LockMemoryExceptionInThread in some places. Reduced MemoryTrackerBlockerInThread level to User.
2022-07-26 15:22:00 +00:00
Dmitry Novik
cf381df93f
Merge branch 'master' into window-order-by
2022-07-26 13:32:35 +02:00
Vitaly Baranov
f0cd564648
Changes after review and added comments.
2022-07-26 11:58:05 +02:00
Vladimir C
3bd5ca9b6a
Merge pull request #39271 from vdimir/join-alg-setting
...
Cleanup logic around join_algorithm setting, add docs
2022-07-26 11:00:22 +02:00
Vladimir C
888417e788
Merge pull request #39556 from vdimir/asof_optimize_predicate_bug_37813
...
Fix bug in ASOF JOIN with enable_optimize_predicate_expression
2022-07-26 10:51:25 +02:00
Alexander Gololobov
0666ec2e1f
Merge branch 'master' into feature/sql-standard-delete
2022-07-26 10:42:39 +02:00
Raúl Marín
6e3a4b0a3d
Add result_rows and result_bytes to progress reports and summary
2022-07-26 10:40:16 +02:00
Antonio Andelic
35b61cc94e
Merge branch 'master' into keeper-version-check
2022-07-26 07:47:57 +00:00
jianmei zhang
c1834d183b
ReplicatedMergeTree support lightweight delete
2022-07-26 11:50:09 +08:00
Vladimir Chebotaryov
f32d9c5539
Uppercase ROWS, GROUPS, RANGE in queries with windows. ( #39410 )
2022-07-25 22:53:53 +02:00
Alexander Tokmakov
fafda5cae0
Merge branch 'master' into replicated_database_improvements
2022-07-25 20:22:22 +02:00
Alexander Tokmakov
f1e1cff272
fix create/drop index on cluster
2022-07-25 18:00:54 +02:00
Alexander Gololobov
48de02a7b8
Capitalized const name
2022-07-25 16:32:16 +02:00
vdimir
b6f640013d
Fix bug in ASOF JOIN with enable_optimize_predicate_expression
2022-07-25 12:58:34 +00:00
Nikolai Kochetov
b70be40804
Merge branch 'master' into use-dag-in-key-condition
2022-07-25 14:30:22 +02:00
Igor Nikonov
572dd864fe
Merge remote-tracking branch 'origin/master' into skipping_sorting_step
2022-07-25 12:19:14 +00:00
Alexander Gololobov
460950ecdc
Merge branch 'master' into feature/sql-standard-delete
2022-07-24 21:27:22 +02:00
Alexey Milovidov
0209012e5e
Merge pull request #39517 from pkit/pkit/fix_examples
...
fix `-DENABLE_EXAMPLES=1` in master
2022-07-24 17:41:23 +03:00
Azat Khuzhin
22d8e532ed
Fix ORDER BY that matches projections ORDER BY
...
In case of projection is seleted and it is comlete (all parts has such
projection) and ORDER BY matches projection ORDER BY, and
optimize_read_in_order=1 (default), then the sorting is simply not done,
because projections has separate plan, and so
InterpreterSelectQuery::executeOrder() -> SortingStep has
pipeline.getNumStreams() == 0 and it cannot do sorting.
Fix this, by adding sorting when creating plan for reading from
projections.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-24 15:23:13 +03:00
Alexander Gololobov
c8b3c574a4
Disable lightweight delete if table has projections
2022-07-24 12:21:47 +02:00
Alexander Gololobov
594195451e
Cleanups
2022-07-24 12:21:18 +02:00
Constantine Peresypkin
d645d03e89
fix -DENABLE_EXAMPLES=1 in master
2022-07-23 19:00:52 +02:00
Alexander Tokmakov
39ba920cb6
Merge branch 'master' into replicated_database_improvements
2022-07-22 13:38:26 +02:00
Ilya Yatsishin
196fe5a269
Merge branch 'master' into exact-rows-before-limit
2022-07-22 12:34:30 +02:00
Alexander Tokmakov
bed2206ae9
Merge pull request #39460 from ClickHouse/remove_some_dead_and_commented_code
...
Remove some dead and commented code
2022-07-22 13:24:34 +03:00
Antonio Andelic
3040ff0959
Merge branch 'master' into keeper-version-check
2022-07-22 08:07:55 +00:00
Vitaly Baranov
7795b2cec3
Fix system.backups: now it can show duplicate UUIDs with different flag.
2022-07-21 20:30:26 +02:00
Dmitry Novik
c79b93505f
Merge branch 'master' into window-order-by
2022-07-21 19:34:06 +02:00
Alexander Gololobov
50bd8147fd
Make lightweight delete work with compact parts (not in optimal way yet)
2022-07-21 17:59:34 +02:00
Nikolai Kochetov
17de7b2876
Revert "Fix trivial count optimization with array join"
2022-07-21 17:14:34 +02:00
vdimir
96bcae419c
Cleanup logic around join_algorithm setting
2022-07-21 14:53:39 +00:00
Maksim Kita
82fc7375dd
Merge pull request #39444 from amosbird/fix-trivial-count-opt-1
...
Fix trivial count optimization with array join
2022-07-21 16:35:49 +02:00
Vadim Volodin
85bf022258
review zookeeper and partition matching
2022-07-21 16:57:28 +03:00
Alexander Tokmakov
a8da5d96fc
remove some dead and commented code
2022-07-21 15:05:48 +02:00
Anton Kozlov
0e44e34e69
Do not optimize GROUP BY functions that shadow their arguments
2022-07-21 11:33:48 +00:00
Nikolai Kochetov
e6969d5010
Respect table alias for additional_table_filters.
2022-07-21 11:23:09 +00:00
Vitaly Baranov
dc392cd4d3
Improve synchronization between hosts in distributed backup.
...
Use ephemeral zk nodes to check other hosts for termination.
2022-07-21 11:45:26 +02:00
Alexander Gololobov
1ea9f143ff
Leave only _row_exists-based implementation of lightweight delete
2022-07-21 11:26:13 +02:00
Amos Bird
98ff54700a
Fix trivial count optimization with array join
2022-07-21 16:23:25 +08:00
Nikolai Kochetov
e15967e9db
Merge pull request #38475 from ClickHouse/additional-filters
...
Additional filters for a table (from setting)
2022-07-21 07:52:04 +02:00
Azat Khuzhin
4b3f90870d
Remove specialization global lock/unlock from ActionLocksManager ( #39215 )
...
This had been done in InterpreterSystemQuery explicitly, with grants
checking.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-21 01:29:35 +02:00
Alexander Tokmakov
6e77155dc8
fix
2022-07-20 23:11:35 +02:00
Nikolai Kochetov
6028f7909b
Fixing build.
2022-07-20 20:45:29 +00:00
Nikolai Kochetov
91aa2385ca
Merge branch 'master' into additional-filters
2022-07-20 18:56:24 +02:00
Igor Nikonov
7616a24c40
Merge pull request #38980 from ClickHouse/explain_ast_rewrite_follow_up
...
EXPLAIN AST rewrite: rename to optimize
2022-07-20 18:42:14 +02:00
Nikolai Kochetov
4e8cd70b1d
Merge branch 'master' into use-dag-in-key-condition
2022-07-20 17:38:33 +02:00
Harry Lee
466fceb3ee
Fix exception in AsynchronousMetrics for s390x ( #39193 )
2022-07-20 15:25:33 +02:00
Yakov Olkhovskiy
c4d040e02c
Merge branch 'master' into bug-with-fill-date
2022-07-20 09:10:45 -04:00
Dmitry Novik
3ceaa25d8f
Merge branch 'master' into window-order-by
2022-07-20 14:46:54 +02:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
...
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
e295fd5090
Merge branch 'master' into replicated_database_improvements
2022-07-20 12:49:18 +02:00
Igor Nikonov
5509850b23
Merge branch 'master' into explain_ast_rewrite_follow_up
2022-07-20 12:18:47 +02:00
Nikolai Kochetov
f570cde815
Fixing build.
2022-07-19 20:19:57 +00:00
Dmitry Novik
382194165f
Skip window functions
2022-07-19 17:33:21 +00:00
Igor Nikonov
c74600d282
Merge branch 'master' into skipping_sorting_step
2022-07-19 18:59:36 +02:00
Igor Nikonov
1fe83cc8d8
optimize_sorting_for_input_stream setting and perf tests
2022-07-19 16:58:15 +00:00
Nikolai Kochetov
eaeb30a71a
Merge branch 'master' into use-dag-in-key-condition
2022-07-19 18:39:52 +02:00
vdimir
c0547bb09c
fix space
2022-07-19 18:33:55 +02:00
vdimir
10e4ef135d
Set default value cross_to_inner_join_rewrite = 2 for comma join
2022-07-19 18:33:54 +02:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls
2022-07-19 14:58:01 +02:00
Igor Nikonov
37af968548
Rename option rewrite -> optimize
2022-07-19 12:40:50 +00:00
kssenii
21ebf8874e
Merge remote-tracking branch 'upstream/master' into make-cache-composable
2022-07-19 13:36:42 +02:00
Alexander Tokmakov
acb1fa53ed
Merge pull request #39341 from ClickHouse/fix_memory_exceptions_with_transactions
...
Fix memory exceptions with transactions
2022-07-19 13:31:15 +03:00
Nikolai Kochetov
3ee3144708
Merge branch 'master' into separate-counter-for-rss-in-memory-tracker
2022-07-18 23:20:38 +02:00
Nikolai Kochetov
87e5b31598
Do not include memory buffered by allocator into drift.
2022-07-18 21:16:16 +00:00
Nikolai Kochetov
7ca6663812
Revert "Track mmap."
...
This reverts commit 77c66666b3
2022-07-18 20:21:37 +00:00
Nikolai Kochetov
77c66666b3
Track mmap.
2022-07-18 20:21:21 +00:00
Alexander Gololobov
ae0d00083c
Renamed __row_exists to _row_exists
2022-07-18 20:07:36 +02:00
Alexander Gololobov
f324ca9921
Cleanups
2022-07-18 20:07:22 +02:00
Alexander Gololobov
f956810fdd
Rewrite DELETE FROM into UPDATE __row_exist=0
2022-07-18 20:07:10 +02:00
Alexander Gololobov
9de72d995a
POC lightweight delete using __row_exists virtual column and prewhere-like filtering
2022-07-18 20:06:42 +02:00
Robert Schulze
6df3c9d799
Merge pull request #39300 from ClickHouse/stringref-to-stringview
...
First try at reducing the use of StringRef
2022-07-18 19:20:16 +02:00
Dmitry Novik
cf30f08937
Respect ORDER BY clause in window functions
2022-07-18 16:42:38 +00:00
Alexander Tokmakov
51c4ffad8c
block memory exceptions in TransactionLog
2022-07-18 17:40:09 +02:00
kssenii
0aed5a602a
Merge master
2022-07-18 16:16:28 +02:00
kssenii
a6655bea1c
Some fixes
2022-07-18 14:23:08 +02:00
Antonio Andelic
5170ac0898
Merge branch 'master' into keeper-version-check
2022-07-18 08:57:50 +00:00
Antonio Andelic
742e3d7643
Merge branch 'master' into keeper-version-check
2022-07-18 08:45:00 +00:00
Alexander Tokmakov
611da87217
Merge pull request #39263 from ClickHouse/fix_assertion_in_transactions
...
Fix assertion in transactions
2022-07-18 11:43:50 +03:00
Robert Schulze
13482af4ee
First try at reducing the use of StringRef
...
- to be replaced by std::string_view
- suggested in #39262
2022-07-17 17:26:02 +00:00
Robert Schulze
fffeab2e86
Merge pull request #39262 from ClickHouse/stringref-by-value
...
Pass const StringRef by value, not by reference
2022-07-17 16:53:15 +02:00
kssenii
8ad26b3111
Merge master
2022-07-16 22:50:03 +02:00
kssenii
e6437f46b1
Fix
2022-07-16 22:23:49 +02:00
Ilya Yatsishin
43ed3df474
Merge pull request #39225 from qoega/query-log-fix-result-bytes
2022-07-15 23:46:03 +02:00
Alexander Tokmakov
e69ea920bf
Merge branch 'master' into fix_assertion_in_transactions
2022-07-15 18:18:34 +03:00
Alexander Tokmakov
5ef7f5f494
Merge pull request #39229 from azat/fix-noexcept-scope
...
[RFC] Fix NOEXCEPT_SCOPE (before it calls std::terminate and looses the exception)
2022-07-15 18:14:56 +03:00
Nikolai Kochetov
f6a82a6a53
Merge pull request #39157 from ClickHouse/bug-lost-column
...
prewhere action should preserve sorting columns
2022-07-15 16:37:40 +02:00
Alexander Tokmakov
ae16555aa4
Merge branch 'master' into replicated_database_improvements
2022-07-15 15:50:23 +02:00
Alexander Tokmakov
94b5f1f536
disable transactions with Ordinary database
2022-07-15 15:36:01 +02:00
Robert Schulze
deda29b46b
Pass const StringRef by value, not by reference
...
See #39224
2022-07-15 11:34:56 +00:00
Kruglov Pavel
a944a92d4c
Merge pull request #39224 from Avogar/string-view-by-value
...
Pass const std::string_view by value, not by reference
2022-07-15 13:05:56 +02:00
jianmei zhang
780cdfb8f0
Code changes based on review opinions. Make ordinary single alter delete lightwight by default
2022-07-15 12:32:42 +08:00
jianmei zhang
6e6f77ef8a
Fix compile error in clang tidy build
2022-07-15 12:32:41 +08:00
jianmei zhang
9d27af7ee2
For some columns mutations, skip to apply deleted mask when read some columns. Also add unit test case
2022-07-15 12:32:41 +08:00
jianmei zhang
b4a37e1e22
Disable optimizations for count() when lightweight delete exists, add hasLightweightDelete() function in IMergeTreeDataPart
2022-07-15 12:32:41 +08:00
jianmei zhang
8696319d62
Support lightweight delete execution using string as deleted rows mask,also part of select can handle LWD
2022-07-15 12:32:41 +08:00
jianmei zhang
8df7b7a030
Support new mutation type for lightweight
2022-07-15 12:32:41 +08:00
jianmei zhang
192ca25e87
Fix style check errors
2022-07-15 12:32:41 +08:00
jianmei zhang
a46188216f
Support delete from ... where syntax on mergetree tables
2022-07-15 12:32:41 +08:00
Sergei Trifonov
62f975da60
Merge pull request #39095 from ClickHouse/remote-io-bandwidth-limits
...
add max_remote_{read,write}_network_bandwidth_for_server settings
2022-07-14 23:14:53 +02:00
Nikolai Kochetov
3c9d4c537a
Another try.
2022-07-14 18:36:50 +00:00
avogar
9291d33080
Pass const std::string_view & by value, not by reference
2022-07-14 16:11:57 +00:00
Yakov Olkhovskiy
1f09303d54
Merge pull request #39181 from azat/part_log-merge_algorithm
...
Add merge_algorithm to system.part_log
2022-07-14 11:43:04 -04:00
Sergei Trifonov
b2317ff710
renaming to be consistent
2022-07-14 17:33:22 +02:00
Azat Khuzhin
b20407fab9
Fix NOEXCEPT_SCOPE (before it calls std::terminate and looses the exception)
...
Current implementation of NOEXCEPT_SCOPE will not work, you cannot
rethrow exception outside the catch block, this will simply terminate
(via std::terminate) the program.
In other words NOEXCEPT_SCOPE macro will simply call std::terminate on
exception and will lost original exception.
But if NOEXCEPT_SCOPE will accept the code that should be runned w/o
exceptions, then it can catch exception and log it, rewrite it in this
way.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-14 17:16:18 +03:00
Yatsishin Ilya
32e48f661a
Fixed query_log result_bytes metric that showed inseted rows instead of bytes
2022-07-14 12:51:56 +00:00
Sergei Trifonov
8a693469f0
Merge branch 'master' into remote-io-bandwidth-limits
2022-07-14 12:38:35 +02:00
Vladimir C
66f2ea5ebb
Merge pull request #39123 from vdimir/fjs-pushdown
...
Pushdown filter to the right side of sorting join
2022-07-14 09:32:19 +02:00
Nikolai Kochetov
dc20b85078
Remove debug output.
2022-07-13 21:08:23 +00:00
Nikolai Kochetov
9528f7e753
Merge branch 'master' into bug-lost-column
2022-07-13 23:06:38 +02:00
Nikolai Kochetov
ba863b11a4
A little fix. Added test.
2022-07-13 21:06:15 +00:00
Anton Popov
5cb3b25754
Merge pull request #39161 from amosbird/text-log-source-regexp
...
Control send logs behavior with source name regexp
2022-07-13 21:13:54 +02:00
Sergei Trifonov
15ab3bc99f
use context->getWriteSettings()
2022-07-13 19:48:57 +02:00
kssenii
1faf253074
Merge master
2022-07-13 19:30:19 +02:00
Sergei Trifonov
f854507729
merge master and resolve conflicts
2022-07-13 19:07:28 +02:00
Dmitry Novik
9e4f516f35
Merge pull request #39112 from ClickHouse/window-expressions-fix
...
Fix ActionsDAG construction for window expressions
2022-07-13 18:19:01 +02:00
Antonio Andelic
f05f22aa13
Merge branch 'master' into keeper-version-check
2022-07-13 15:25:48 +00:00
kssenii
d026a8360b
Merge remote-tracking branch 'upstream/master' into make-cache-composable
2022-07-13 16:52:33 +02:00
Azat Khuzhin
3720a3843c
Add merge_algorithm to system.part_log
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-13 17:16:25 +03:00
Yakov Olkhovskiy
3fd367ea58
check metadata_snapshot is not empty
2022-07-13 10:08:24 -04:00
Antonio Andelic
93d8b8bb61
small fixes
2022-07-13 13:01:13 +00:00
Vladimir C
27ec36ca91
Merge pull request #37648 from vdimir/enable_parallel_hash
...
Bugfixes and performance improvements for parallel_hash
2022-07-13 14:52:57 +02:00
vdimir
bddf6c1b32
Pushdown filter to the right side of sorting join
2022-07-13 11:36:25 +00:00
kssenii
0d2d3ac2b4
Merge master
2022-07-13 13:26:15 +02:00
Amos Bird
90fa4863f9
Text log source regexp
2022-07-13 17:52:14 +08:00
Yakov Olkhovskiy
1f57f92bf7
prewhere action should preserve sorting columns
2022-07-13 03:01:23 -04:00
Amos Bird
0595c50c92
Fix trivial count with empty set
2022-07-13 12:54:52 +08:00
Dmitry Novik
66ade34508
Merge branch 'master' into window-expressions-fix
2022-07-12 22:36:19 +02:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls
2022-07-12 22:36:04 +02:00
vdimir
af55f1c1e3
Update toPowerOfTwo in ConcurrentHashJoin
2022-07-12 20:22:35 +02:00
vdimir
b4176828c6
Apply intHash64 on top of WeakHash32 for parallel join
2022-07-12 20:22:35 +02:00
vdimir
218288ee6c
upd ConcurrentHashJoin
2022-07-12 20:22:35 +02:00
vdimir
2ec373c6a7
Number of shards in parallel hash join is always power of two
2022-07-12 20:22:35 +02:00
vdimir
f3e84d8fc6
fix order in 01913_join_push_down_bug 00952_input_function
2022-07-12 20:22:35 +02:00
vdimir
a7ea163e3b
Fix parallel hash join to lowcard keys
2022-07-12 20:22:35 +02:00
vdimir
9e0cb37bd7
Disable parallel hash join for asof
2022-07-12 20:22:35 +02:00
Dmitry Novik
d046132265
Allow to use higher-order functions in window expressions
2022-07-11 23:47:46 +00:00
Dmitry Novik
fd9d897df2
Fix ActionsDAG for window expressions
2022-07-11 23:18:44 +00:00
Dmitry Novik
29cfe33ed7
Small fix
2022-07-11 18:14:49 +00:00
Dmitry Novik
66074b3950
Fix distributed aggregation
2022-07-11 18:11:58 +00:00
Robert Schulze
1a7727a254
Prefix overridden add_executable() command with "clickhouse_"
...
A simple HelloWorld program with zero includes except iostream triggers
a build of ca. 2000 source files. The reason is that ClickHouse's
top-level CMakeLists.txt overrides "add_executable()" to link all
binaries against "clickhouse_new_delete". This links against
"clickhouse_common_io", which in turn has lots of 3rd party library
dependencies ... Without linking "clickhouse_new_delete", the number of
compiled files for "HelloWorld" goes down to ca. 70.
As an example, the self-extracting-executable needs none of its current
dependencies but other programs may also benefit.
In order to restore access to the original "add_executable()", the
overriding version is now prefixed. There is precedence for a
"clickhouse_" prefix (as opposed to "ch_"), for example
"clickhouse_split_debug_symbols". In general prefixing makes sense also
because overriding CMake commands relies on undocumented behavior and is
considered not-so-great practice (*).
(*) https://crascit.com/2018/09/14/do-not-redefine-cmake-commands/
2022-07-11 19:36:18 +02:00
Ilya Yatsishin
4625e7f519
Merge branch 'master' into exact-rows-before-limit
2022-07-11 15:41:35 +02:00
Sergei Trifonov
43779ec280
add max_remote_{read,write}_network_bandwidth_for_server settings
2022-07-11 14:59:39 +02:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
...
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
Antonio Andelic
37f799550b
Merge pull request #38072 from lingpeng0314/master
...
Add Keeper related monitoring data
2022-07-10 09:39:57 +02:00
Frank Chen
c559370ec9
Fix test cases
2022-07-09 20:20:04 +08:00
Frank Chen
c2ae762a5a
Fix tests
2022-07-09 13:59:11 +08:00
Frank Chen
da57a993e4
Fix CI
2022-07-09 13:43:10 +08:00
vdimir
79c185d22b
make current_query_analyze_count atomic
2022-07-08 13:01:17 +00:00
Alexander Tokmakov
dbaaf2ad83
Merge branch 'master' into replicated_database_improvements
2022-07-08 14:29:02 +02:00
vdimir
d681469275
max_pipeline_depth only throws an error
2022-07-08 11:56:42 +00:00
vdimir
9c348380f6
second analyze and max_pipeline_depth
2022-07-08 11:56:42 +00:00
Alexey Milovidov
a0488dc901
Update src/Interpreters/Context.h
2022-07-08 11:56:42 +00:00
Alexey Milovidov
eae82d7530
Update src/Interpreters/InterpreterSelectQuery.cpp
2022-07-08 11:56:41 +00:00
vdimir
fdf35b20a8
Limit number of analyze for one query
2022-07-08 11:56:40 +00:00
Frank Chen
9711559391
Remove extra code
2022-07-08 18:56:07 +08:00
Frank Chen
6ae2504e57
Fix code
2022-07-08 18:55:59 +08:00
Alexander Tokmakov
63fc95903c
fix tests
2022-07-07 23:59:15 +02:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls
2022-07-07 20:54:38 +02:00
Dmitry Novik
1587385f7a
Cleanup code
2022-07-07 18:53:20 +00:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join
2022-07-07 19:16:49 +02:00
Dmitry Novik
24243c51be
Fix distributed grouping sets with nulls
2022-07-07 16:40:35 +00:00
Frank Chen
90efbc323d
Fix conflicts
2022-07-07 17:44:32 +08:00
Frank Chen
93dc109e36
Fix code
2022-07-07 17:44:19 +08:00
Frank Chen
495555f04f
Remove useless span
2022-07-07 17:42:53 +08:00
Frank Chen
57a7e4a7c9
Remove old API reference
2022-07-07 17:42:35 +08:00
Frank Chen
8c04456148
Fix query span at executeQuery layer
2022-07-07 17:41:58 +08:00
Frank Chen
2e8c530bed
Move thread trace context out of ThreadStatus
2022-07-07 17:41:10 +08:00
Igor Nikonov
fa0d54a3b2
Merge remote-tracking branch 'origin/master' into order_by_with_braces
2022-07-07 08:13:49 +00:00
Igor Nikonov
01bbfd86ad
Merge pull request #38910 from ClickHouse/explain_ast_after_rewrite
...
EXPLAIN AST rewrite option
2022-07-07 10:09:55 +02:00
lingpeng0314
079d4bd0dd
rename keeper_4lw_info to keeper_info
...
- to make clang build successfully
2022-07-07 15:13:51 +08:00
Igor Nikonov
6be6a13c2f
Merge branch 'master' into order_by_with_braces
2022-07-07 00:36:12 +02:00
Igor Nikonov
77317c65fd
Merge pull request #38902 from ClickHouse/interpreter_cleanup_2
...
Interpreter cleanup: ContextPtr -> const ContextPtr & in parameters
2022-07-06 23:46:55 +02:00
Alexander Tokmakov
388872550a
Merge branch 'master' into replicated_database_improvements
2022-07-06 19:54:53 +02:00
Alexander Tokmakov
30e9104b6e
ignore cluster if equals to db name
2022-07-06 19:54:05 +02:00
Igor Nikonov
810926c7fc
Rename setting after_rewrite -> rewrite
2022-07-06 17:29:30 +00:00
Alexander Tokmakov
3a94ae8f67
normalize CREATE ON CLUSTER on initiator
2022-07-06 18:50:00 +02:00
vdimir
b27d3ec5ce
Fix build
2022-07-06 15:11:23 +00:00
vdimir
2fd229448c
Fix style FullSortingMergeJoin.h
2022-07-06 14:28:06 +00:00
vdimir
7c586a9e7c
Minor updates for full soring merge join
2022-07-06 14:28:05 +00:00
vdimir
881d352e05
upd full sorting join
2022-07-06 14:28:05 +00:00
vdimir
0b994bb258
fix build
2022-07-06 14:27:32 +00:00
vdimir
c8cd962bac
couple of tests for full_sorting_merge
2022-07-06 14:27:31 +00:00
vdimir
c200ce490b
full sorting join using and nulls
2022-07-06 14:27:30 +00:00
vdimir
753a567da8
full sorting join with using
2022-07-06 14:27:29 +00:00
vdimir
d184e184b4
full sort join: check key types, more tests
2022-07-06 14:26:19 +00:00
vdimir
4e88e8f5ec
full sort join: move block list to all join state
2022-07-06 14:26:17 +00:00
vdimir
6d198ff3d7
fix style
2022-07-06 14:25:11 +00:00
vdimir
d34a66c915
wip sorting merge
2022-07-06 14:25:09 +00:00
vdimir
1b429fc1af
wip: any left/right sorting join
2022-07-06 14:23:46 +00:00
vdimir
4a16195964
Calculate output header for full sorting merge join
2022-07-06 14:23:45 +00:00
vdimir
2a0e497ced
Rename enumerators in JoinPipelineType
2022-07-06 14:23:45 +00:00
vdimir
fa8eb35599
Pipeline for full sorting merge join
2022-07-06 14:23:44 +00:00
Igor Nikonov
f1bec4ef21
EXPLAIN AST option after_rewrite
2022-07-06 14:21:59 +00:00
Maksim Kita
b94489d52c
Merge pull request #38859 from kitaisreal/merge-tree-merge-disable-batch-optimization
...
MergeTree merge disable batch optimization
2022-07-06 15:59:40 +02:00
Vladimir C
3c7fdb604d
Merge pull request #35363 from vdimir/kv-join
2022-07-06 15:57:30 +02:00
Nikolai Kochetov
65cd0cc61c
Fixing style.
2022-07-06 13:44:06 +00:00
Igor Nikonov
9ca08f8fda
Continue: ContextPtr -> const ContextPtr & in parameters
2022-07-06 13:13:19 +00:00
Nikolai Kochetov
f63b27498f
Add additional_result_filter setting.
2022-07-06 12:37:37 +00:00
Ilya Yatsishin
1863fb82f6
Merge pull request #38814 from qoega/otel-debug
...
Use native Map type for OpenTelemetry attributes
2022-07-06 14:33:56 +02:00
Igor Nikonov
059c5c0f0a
Simple cleanup: context ptr usage in interpreters
2022-07-06 12:29:20 +00:00
mergify[bot]
0f3965b258
Merge branch 'master' into order_by_with_braces
2022-07-06 10:27:22 +00:00
Igor Nikonov
a0f6f6f82d
Fix: rewrite only outer braces
2022-07-06 10:23:05 +00:00
Igor Nikonov
5a01c27eb1
Fix: clear children in order by element during rewriting
...
- remove unnecessary code for this PR
2022-07-05 22:48:48 +00:00
Igor Nikonov
fd62494a77
Fix: ORDER BY with braces inefficient execution
2022-07-05 22:48:48 +00:00
Igor Nikonov
99de1ee109
Simple cleanup: interpreters and parsers
2022-07-05 22:13:39 +00:00
kssenii
e55169ebad
Fix
2022-07-05 20:15:35 +02:00
Yatsishin Ilya
e9b7f52874
another one
2022-07-05 17:36:45 +00:00
Maksim Kita
bdc21737d5
MergeTree merge disable batch optimization
2022-07-05 16:15:00 +02:00
Nikolai Kochetov
659a6452f5
Added SettingMap. Use Map for additional_table_filters.
2022-07-05 13:10:09 +00:00
vdimir
0232c9267d
Pass CHPC_DATABASE_URL to perf tests
2022-07-05 14:00:15 +02:00
Yatsishin Ilya
f39ce7e668
Merge remote-tracking branch 'origin' into otel-debug
2022-07-05 11:30:36 +00:00
vdimir
17903117d2
better
2022-07-05 10:46:08 +00:00
Kruglov Pavel
a6a9824261
Merge pull request #38362 from Avogar/better-exception-messages
...
Better exception messages on wrong table engines/functions argument types
2022-07-05 11:21:44 +02:00
kssenii
b52084265c
Merge master
2022-07-04 21:37:43 +02:00
vdimir
c0cb588e45
Fix build
2022-07-04 17:28:34 +00:00
vdimir
43afda408b
do not call setStorageJoin when setting isn't set
2022-07-04 17:28:15 +00:00
vdimir
65ac97ce89
direct join: handle nullable, add tests
2022-07-04 17:28:14 +00:00
vdimir
0c12adc934
fix style
2022-07-04 17:28:14 +00:00
vdimir
e40f799f96
handle right rey rename in direct join
2022-07-04 17:28:13 +00:00
vdimir
87794f9b5b
get/setTotas to IJoin
2022-07-04 17:28:13 +00:00
vdimir
a1388813e4
fix src/Interpreters/ExpressionAnalyzer.cpp
2022-07-04 17:28:12 +00:00
vdimir
8359753a85
Move DirectJoin to separate file
2022-07-04 17:28:11 +00:00
vdimir
51a6c347ad
make join_alorithm settings with multiple choices
2022-07-04 17:28:11 +00:00
