Commit Graph

4247 Commits

Author SHA1 Message Date
Azat Khuzhin
ff12f5102a Avoid running LIMIT BY/DISTINCT step on the initiator for optimize_distributed_group_by_sharding_key
Before the following queries was running LimitBy/Distinct step on the
initator:

  select distinct sharding_key from dist order by k

While this can be omitted.
2021-08-02 21:04:30 +03:00
Nikolai Kochetov
d63a5e1c96
Merge pull request #26675 from Algunenano/kill_better
Handle KILL requests while running pipeline executors
2021-08-02 17:37:54 +03:00
Raúl Marín
9f32ecca89 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-02 16:21:10 +02:00
Alexander Tokmakov
42a8bb6872 fix assertions in Replicated database 2021-08-02 16:19:11 +03:00
vdimir
593b7e9bbb
Do not throw exception if unknwon column met while join rewriting 2021-08-02 14:51:34 +03:00
vdimir
7364f35da6
Add alwaysReturnsEmptySet for Merge Join 2021-08-02 13:49:56 +03:00
Nikolai Kochetov
6951e8147d
Merge pull request #27020 from amosbird/shardlevelconstness
Shard-level const column
2021-08-02 13:45:20 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
Anton Popov
cc3ed12ed6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 02:56:00 +03:00
terrylin
09a4f82d0f code style check 2021-07-31 20:36:40 +08:00
Amos Bird
c03b20d1a1
Fix 2021-07-31 17:02:33 +08:00
Amos Bird
479d4fa991
Add shardNum() and shardCount() functions 2021-07-31 15:45:39 +08:00
Vitaly Baranov
99929981ab
Merge pull request #25687 from MaxWk/profile-default-database
add setting profile_default_database
2021-07-31 08:37:02 +03:00
alesapin
c321e750ad Fix style 2021-07-30 21:00:25 +03:00
Vladimir Chebotarev
b32c024571
Update AsynchronousMetrics.cpp 2021-07-30 20:03:57 +03:00
Vladimir Chebotarev
3c3fbf9a53 Improved logging of some errors in AsynchronousMetrics. 2021-07-30 17:36:28 +03:00
alesapin
4746002776 Add an ability to build ClickHouse without NLP functions 2021-07-30 16:30:30 +03:00
Amos Bird
9bdd9c912e
update as suggested 2021-07-30 20:19:39 +08:00
Amos Bird
7b9e81742f
Shard level constness 2021-07-30 18:53:34 +08:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
alesapin
444ad67663
Merge pull request #26972 from ClickHouse/fix_zookeeper_log_initialization
Fix system.zookeeper_log initialization
2021-07-30 12:24:19 +03:00
terrylin
c49c2e5e18 fix compile error 2021-07-30 17:15:04 +08:00
terrylin
55f3e7e65a improvement of materilize ttl 2021-07-30 12:27:15 +08:00
Alexander Tokmakov
47995a053e fix system.zookeeper_log initialization 2021-07-29 17:48:49 +03:00
Raúl Marín
eda40ff987 Add running pipelineExecutors to the QueryStatus 2021-07-29 13:03:14 +02:00
Maksim Kita
fd19f47311 Fixed MSan tests 2021-07-28 19:47:36 +03:00
vdimir
a0ed37e04e
Ignore constness in ExpressionActionsChain::JoinStep
Fix 01064_pm_all_join_const_and_nullable with bad cast check
2021-07-28 16:35:02 +03:00
alesapin
d91380cd71 Fix bug when default column reference non materialized column 2021-07-28 15:04:42 +03:00
Alexander Tokmakov
fab4529c97 Merge branch 'master' into rename_materialize_mysql 2021-07-28 12:18:01 +03:00
Raúl Marín
4a09c54a04 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-07-28 10:38:47 +02:00
alesapin
1277db4435
Merge pull request #26129 from ClickHouse/system_zookeeper_log
Add system.zookeeper_log table
2021-07-28 11:22:29 +03:00
万康
0c203dd43d add missing changes 2021-07-28 14:05:22 +08:00
Alexander Tokmakov
fc9ab2cda7 Merge branch 'master' into rename_materialize_mysql 2021-07-27 22:38:40 +03:00
Alexander Tokmakov
378dcef813 fixes 2021-07-27 19:57:28 +03:00
Maksim Kita
3a6b37691a Compile aggregate functions without key 2021-07-27 19:50:57 +03:00
Raúl Marín
db0cdd696f Dependent views: Report progress 2021-07-27 16:29:34 +02:00
Raúl Marín
0d9bf0a08e Avoid havin multiple profilers in the same thread 2021-07-27 16:29:34 +02:00
Raúl Marín
0a5c9868b0 Changes necessary master merge 2021-07-27 16:29:34 +02:00
Raúl Marín
e4b65da6e4 PushingToViewsBlockOutputStream: Detatch ThreadStatus' 2021-07-27 16:29:34 +02:00
Raúl Marín
75d18bc79b CI linters and compiler errors 2021-07-27 16:29:34 +02:00
Raúl Marín
69577a782f Views: Once started, finish all concurrent views before throwing
Since sequential processing executes things in phases too, try to finish
all (non errored out) views before throwing any exception
2021-07-27 16:29:33 +02:00
Raúl Marín
297b939c66 Fix test #01600 2021-07-27 16:29:33 +02:00
Raúl Marín
70b7bb4eaa Refresh table acecss information before the final query_log
Table access should show the tables used by joins in dependent views
2021-07-27 16:29:33 +02:00
Raúl Marín
f0125262b7 Add views and it's tables to system.query_log 2021-07-27 16:29:33 +02:00
Raúl Marín
14e8029e01 Initial basic tests and change name to not include uuid 2021-07-27 16:29:33 +02:00
Raúl Marín
97215faf7b Remove unnecessary include 2021-07-27 16:29:33 +02:00
Raúl Marín
eb994d8f04 Fix a couple of bugs
- Don't use threads if there is only one dependent view and parallel_view
- Reset the current_thread when destroying views ThreadStatus
2021-07-27 16:29:33 +02:00
Raúl Marín
7c1fcc94b0 View log: Make sure to only profile events during view execution 2021-07-27 16:29:33 +02:00
Raúl Marín
e0ee7839f7 Only use threads when necessary and log written status 2021-07-27 16:29:31 +02:00
Raúl Marín
6b9ec2a62e WIP 2021-07-27 16:28:28 +02:00
Raúl Marín
efe1938437 WIP: Slow improvements 2021-07-27 16:26:29 +02:00
Raúl Marín
ea5c02a605 WIP 2021-07-27 16:26:27 +02:00
Raúl Marín
bc1ccd2d62 Flush materialization log on FLUSH_LOGS 2021-07-27 16:23:46 +02:00
Raúl Marín
f34cb886cc Add materialization log accessor to Context 2021-07-27 16:23:46 +02:00
Raúl Marín
c5b14f5075 Add materialization log to SystemLog 2021-07-27 16:23:46 +02:00
Raúl Marín
07c71c226e Add QueryMaterializationLog class 2021-07-27 16:23:46 +02:00
Nikolai Kochetov
97bc754dd8
Merge pull request #26758 from ClickHouse/output-streams-to-processors
Remove some output streams
2021-07-27 17:19:26 +03:00
kevin wan
a56a3c793c
Merge branch 'master' into profile-default-database 2021-07-27 21:08:08 +08:00
Alexander Kuzmenkov
ece7d000dd
Merge pull request #26736 from Algunenano/ch_local_remote_localhost
CH local: Treat localhost:port as a remote database
2021-07-27 15:30:54 +03:00
Alexander Tokmakov
a7e644f774 support old name 2021-07-26 21:24:32 +03:00
Alexander Tokmakov
63ab38ee09 rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
Nikolai Kochetov
61f8524ae7 Fix style. 2021-07-26 20:36:54 +03:00
Nikolai Kochetov
9b5a816b43 Merge branch 'master' into output-streams-to-processors 2021-07-26 18:03:11 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
mergify[bot]
044be267d6
Merge branch 'master' into improve_create_or_replace 2021-07-26 08:38:48 +00:00
alexey-milovidov
7b76bfc719
Merge pull request #26318 from amosbird/connectionpoolfactory
Connection pool cache
2021-07-26 06:45:03 +03:00
Vitaly Baranov
7b4e5f8e21
Merge pull request #26759 from vitlibar/changing-default-roles-affects-new-sessions
Changing default roles affects new sessions only.
2021-07-24 23:15:14 +03:00
Alexey Milovidov
edfeb0957f Fix strange code 2021-07-24 04:52:18 +03:00
Alexey Milovidov
04199ed81e Fix the case of empty column name 2021-07-24 04:25:00 +03:00
Alexey Milovidov
ff0129d801 Merge branch 'master' into fix-bad-cast 2021-07-24 03:58:34 +03:00
alexey-milovidov
dab9cfb9c9
Merge pull request #26713 from ClickHouse/remove-more-and--more-streams
Remove more streams.
2021-07-24 02:24:10 +03:00
Vitaly Baranov
db97921b5b Changing default roles affects new sessions only. 2021-07-23 23:23:14 +03:00
Nikolai Kochetov
9c92f43359 Update storages. 2021-07-23 22:33:59 +03:00
Nikolai Kochetov
2dc5c89b66 Update Storage::write 2021-07-23 17:25:35 +03:00
Maksim Kita
6e2d992dce
Merge pull request #26719 from kitaisreal/compile-aggregate-functions-profile-events-fix
Compile aggregate functions profile events fix
2021-07-23 16:17:57 +03:00
Vitaly Baranov
67d4da224a
Merge pull request #26384 from Cas-pian/grant_by_replace
add grant by replace support
2021-07-23 14:40:47 +03:00
Raúl Marín
383c982715 CH local: Treat localhost:port as a remote database 2021-07-23 13:16:35 +02:00
Nikolai Kochetov
52cc98e9c7
Update MergeJoin.cpp 2021-07-23 13:55:28 +03:00
Nikolai Kochetov
80e0e24448 Fix unit test and style. 2021-07-23 12:29:53 +03:00
Maksim Kita
e961de3ea0 Fixed build 2021-07-23 11:15:29 +03:00
Vitaly Baranov
19d5a6ab2f
Merge pull request #26714 from vitlibar/new-function-current-profiles
New functions currentProfiles(), enabledProfiles(), defaultProfiles().
2021-07-23 09:10:29 +03:00
Alexey Milovidov
4bbbf58f3e Fix test 2021-07-23 03:34:49 +03:00
Alexey Milovidov
6e41a1b5ca Fix error 2021-07-23 02:22:37 +03:00
Maksim Kita
42201d3e30 Fixed code review issues 2021-07-23 01:03:44 +03:00
Maksim Kita
1fea19846b Compile aggregate functions profile events fix 2021-07-23 00:43:31 +03:00
Vitaly Baranov
7afcc65060 Add new functions currentProfiles(), enabledProfiles(), defaultProfiles(). 2021-07-22 22:20:53 +03:00
Nikolai Kochetov
3c17a62686
Merge pull request #26590 from ClickHouse/remove-some-more-streams
Remove some streams.
2021-07-22 21:28:50 +03:00
Nikolai Kochetov
f56a45155f Merge branch 'master' into remove-more-and--more-streams 2021-07-22 19:10:39 +03:00
Nikolai Kochetov
fd754430eb Remove more streams. 2021-07-22 19:05:52 +03:00
alexey-milovidov
c3206f6c85
Merge pull request #26470 from ClickHouse/fix-flaky-test-20
Fix flaky test `distributed_ddl_output_mode`
2021-07-22 15:32:22 +03:00
Alexey Milovidov
49dac9a46f Move code to .cpp 2021-07-22 03:38:28 +03:00
Vladimir
576b407804
Support conditions in JOIN ON section (#24420)
* Try to enforce table identification in CollectJoinOnKeysMatcher

* Support filtering conditions in JOIN ON for HashJoin

* Correct handle non equi join

* Update test 00878_join_unexpected_results

* Join on filters calculated as one row before join

* Do not lookup key in hash join if condition for row is not hold

* better

* Support filtering conditions in JOIN ON for MergeJoin

* Support Nullable mask in JOIN ON section

* Fix style in Interpreters/TableJoin.cpp

* Change return type of getColumnAsMask in join_common to ColumnPtr

* Handle Nullable(Nothing) type in JOIN ON section, add test cases

* Fix type cast JoinCommon::getColumnAsMask

* Check type if conditions in JOIN ON section, support functions

* Update tests with JOIN ON

* Style changes, add comments for conditions in JOIN ON section

* Add test cases for join on condtions

* JOIN ON key1 = key2 AND (cond1 OR cond2)

* Remove CollectJoinOnKeysVisitor has_join_keys

* Add test cases for join on nullable/lc conditions

* Fix style

* Change error code 48 to 403 in join on tests

* Fix whitespace
2021-07-21 20:03:33 +03:00
Nikolai Kochetov
f38de35b14 Rename some constants. 2021-07-21 19:13:17 +03:00
Realist007
31e26862b5
Merge branch 'master' into feature/create-simple-lambda-function 2021-07-21 10:33:53 +03:00
Alexey Milovidov
f62fc8c43d Fix another cause of flakiness 2021-07-21 04:05:56 +03:00
alexey-milovidov
fcca3e3e56
Merge pull request #26423 from ClickHouse/fix-header-for-scalar-query-with-empty-result
Fix incompatible result type for scalar queries with empty result.
2021-07-21 02:07:04 +03:00
Alexey Milovidov
8a37bbc217 Fix flaky test, one more attempt 2021-07-21 01:27:27 +03:00
ANDREI STAROVEROV
c03a75a289 Fix tests 2021-07-21 01:02:18 +03:00
ANDREI STAROVEROV
7966bded6c Add storing on disk for created functions 2021-07-20 23:20:23 +03:00
Alexey Milovidov
4a0ec010af Merge remote-tracking branch 'origin/master' into fix-flaky-test-20 2021-07-20 21:47:22 +03:00
Nikolai Kochetov
179ec05a72 Remove some streams. 2021-07-20 21:18:43 +03:00
Nikita Mikhaylov
348a3abb0b
Merge pull request #26508 from kitaisreal/storage-dictionary-quoted-names-fix
Storage Dictionary quoted names fix
2021-07-20 19:35:48 +03:00
Caspian
7c6dc56bcd
Merge branch 'master' into grant_by_replace 2021-07-20 17:41:12 +08:00
Maksim Kita
9b53f4f2b3 Storage Dictionary quoted names fix 2021-07-20 11:35:10 +03:00
ANDREI STAROVEROV
6ce203504b Add access rights 2021-07-20 02:34:04 +03:00
Alexey Milovidov
f9bfb4101a Fix style 2021-07-20 01:00:48 +03:00
Alexey Milovidov
72a76d34f5 Merge remote-tracking branch 'origin/master' into fix-flaky-test-20 2021-07-20 01:00:25 +03:00
Alexey Milovidov
909a50e648 Fix flaky test 2021-07-20 00:58:48 +03:00
Alexey Milovidov
084554aac4 Even better 2021-07-19 21:46:30 +03:00
Alexey Milovidov
2e4dcc2422 More correct 2021-07-19 20:23:16 +03:00
Alexey Milovidov
c85b7ad556 Push exception into pipe 2021-07-19 19:46:58 +03:00
Nikolai Kochetov
7a24e72e76 Merge branch 'master' into fix-header-for-scalar-query-with-empty-result 2021-07-19 15:48:44 +03:00
Nikolai Kochetov
96e20e2641 Fix some tests. 2021-07-19 15:35:55 +03:00
mergify[bot]
39f71f4a08
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-19 12:27:38 +00:00
Vitaly Baranov
4f1926550b
Merge pull request #26429 from vitlibar/remove-mysql-wire-context
Remove MySQLWireContext
2021-07-19 12:21:24 +03:00
Maksim Kita
0be89e838d
Merge pull request #26475 from amosbird/fixaliascolumn
Fix column alias rewriting
2021-07-18 23:53:01 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32
Continuation of #25774
2021-07-18 21:44:45 +03:00
Amos Bird
d74aa64f6b
Fix column alias rewriting 2021-07-18 23:27:19 +08:00
alexey-milovidov
b52411a715
Merge pull request #12455 from amosbird/npc
Nullable primary key with correct KeyCondition
2021-07-18 17:52:20 +03:00
Caspian
591d583c5b support REPLACE GRANT NONE syntax 2021-07-18 16:58:48 +08:00
万康
d826115f2a fix code style 2021-07-18 14:56:26 +08:00
Alexey Milovidov
e0d27da222 Rewrite distributed DDL to Processors 2021-07-18 00:45:07 +03:00
Alexey Milovidov
c648e8356b Remove even more code 2021-07-17 21:58:51 +03:00
Alexey Milovidov
261a220227 Remove some code 2021-07-17 21:06:46 +03:00
alexey-milovidov
2316f42009
Merge pull request #26365 from Algunenano/set_index
Draft: Don't build set for indices when analyzing a query
2021-07-17 19:21:58 +03:00
mergify[bot]
89634ae224
Merge branch 'master' into estimates_for_select_query 2021-07-16 23:15:30 +00:00
alexey-milovidov
149c5a0e9b
Merge pull request #26381 from ClickHouse/separate-step-for-distributed
Add separate step to read from remote.
2021-07-17 01:29:43 +03:00
alexey-milovidov
f3a5d3227a
Merge pull request #26428 from ClickHouse/fix-msan-from-22517
Fix msan crash from 22517
2021-07-17 01:11:55 +03:00
alexey-milovidov
330bf9d510
Update ExecuteScalarSubqueriesVisitor.cpp 2021-07-17 01:11:44 +03:00
Vitaly Baranov
0f8b196682 Remove MySQLWireContext. 2021-07-16 22:21:20 +03:00
Anton Popov
f61ea15d56 fix pushdown of limit to reading stage 2021-07-16 20:40:00 +03:00
Anton Popov
03c785931a fix pushdown of limit to reading stage 2021-07-16 17:27:38 +03:00
Nikolai Kochetov
1c1cc22a06 Fix msan crash from #22517. 2021-07-16 17:22:26 +03:00
Anton Popov
c45a9e3bd6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-16 17:11:34 +03:00
Nikolai Kochetov
d996d0bae9 Fix incompatible result type for scalar queries with empty result. 2021-07-16 16:38:35 +03:00
Nikolai Kochetov
a30b0eb542 Fix style. 2021-07-16 14:33:01 +03:00
Nikolai Kochetov
d3099e0c89 Fix build and add comment. 2021-07-16 13:56:13 +03:00
caspian
c06f45ea4f fix for USAGE or NONE privilege 2021-07-16 16:53:25 +08:00
Alexey Milovidov
924319dc32 Less logging in AsynchronousMetrics 2021-07-16 10:32:02 +03:00
Vladimir
c8ead44c23
Merge pull request #26374 from vdimir/infinite-pmj-fix 2021-07-16 09:50:44 +03:00
Vitaly Baranov
427813071d
Merge pull request #26363 from vitlibar/fix-crash-login-as-dropped-user
Fix possible crash when login as dropped user
2021-07-16 09:47:35 +03:00
Vitaly Baranov
f5ae8e3304
Merge pull request #26383 from vitlibar/fix-access-rights-intersection
Fix calculating of intersection of access rights.
2021-07-16 09:46:31 +03:00
caspian
6a05a7d51a just drop old privileges and assign new 2021-07-16 14:39:14 +08:00
Vitaly Baranov
02fd365485 Fix calculating of intersection of access rights. 2021-07-16 00:29:27 +03:00
Nikolai Kochetov
f36d14f68f Add separate step to read from remote. 2021-07-15 19:15:16 +03:00
Vitaly Baranov
6c74b44729 Fix possible crash when login as dropped user. 2021-07-15 19:01:34 +03:00
vdimir
cf77a3e05a
Fix infine non joined block stream in merge join 2021-07-15 18:22:46 +03:00
Raúl Marín
c2f0d7c514 Don't build set for indices when analyzing a query 2021-07-15 14:25:22 +02:00
kssenii
3ba2d114d5 Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32"
This reverts commit 94a210650f, reversing
changes made to 0893b9ff8e.
2021-07-15 11:41:52 +00:00
caspian
4c0456650a add grant by replace support 2021-07-15 18:04:26 +08:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283" 2021-07-15 10:53:35 +03:00
alexey-milovidov
0893b9ff8e
Merge pull request #26218 from amosbird/projection-improve1
Aggressive IN index analysis for projections.
2021-07-15 08:13:45 +03:00
alexey-milovidov
96030dc2d7
Merge pull request #26250 from vdimir/issue-26017-join-totals-key
Fix block structure mismatch in join totals
2021-07-15 08:03:37 +03:00
Amos Bird
3f05211b09
Connection pool factory. 2021-07-15 00:01:45 +08:00
Amos Bird
0558ecdc3f
Aggressive IN index analysis for projections. 2021-07-14 22:56:52 +08:00
vdimir
b49e37aa07
Rewrite join totals, fix block structure mismatch 2021-07-14 13:02:23 +03:00
Alexander Tokmakov
f0ed6be269 Merge branch 'master' into system_zookeeper_log 2021-07-13 20:49:37 +03:00
Peng Jian
8522589483 Collect the amount of parts, rows and marks during the build query pipeline 2021-07-13 22:50:47 +08:00
Anton Popov
cb042afa9d pushdown limit while reading in order of primary key 2021-07-13 17:24:45 +03:00
mergify[bot]
d5898ecba6
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-13 14:03:05 +00:00
Nikita Mikhaylov
c255f152aa
Merge pull request #26051 from ClickHouse/fix_21184
Fix sequence_id in MySQL protocol
2021-07-13 16:03:25 +03:00
alexey-milovidov
af7ecb7f7a
Merge pull request #25798 from azat/optimize_skip_unused_shards_rewrite_in-types-fix
Fix optimize_skip_unused_shards_rewrite_in for non-UInt64 types
2021-07-13 11:40:59 +03:00
alexey-milovidov
101ee12f18
Merge pull request #26038 from amosbird/projection-fix11
Fix normal projection with prewhere
2021-07-13 11:40:08 +03:00
alexey-milovidov
cf95804c79
Merge pull request #26217 from amosbird/globalinfix
Proper GLOBAL IN function rewrite.
2021-07-13 04:57:54 +03:00
alexey-milovidov
4b1e38eed9
Merge branch 'master' into projection-fix11 2021-07-13 04:52:15 +03:00
Alexey Milovidov
29e8b783ba Comments 2021-07-13 03:59:52 +03:00
alexey-milovidov
f5f9e35331
Merge pull request #26241 from evillique/column_size
Add column sizes for `Log` and `TinyLog` tables
2021-07-13 03:54:03 +03:00
alexey-milovidov
d28b143c49
Merge pull request #26246 from FArthur-cmd/adding-system-warnings-26039
Adding system warnings 26039
2021-07-13 03:44:53 +03:00
alexey-milovidov
5295f7ebb2
Merge pull request #26235 from ClickHouse/check-non-deterministic-functions-in-keys
Check for non-deterministic functions in keys, including constant expressions
2021-07-13 02:46:44 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32
Datatype Date32, support range 1925 to 2283
2021-07-12 20:33:39 +03:00
Alexey Milovidov
e0ae04297a Fix fast test 2021-07-12 18:19:49 +03:00
vdimir
a61b7f2326
Add reqired right keys to join totals block 2021-07-12 18:00:55 +03:00
万康
60f556be2d add default_database to user 2021-07-12 22:35:07 +08:00
Artur
278099e663 correct code style 2021-07-12 12:21:18 +00:00
Alexey Milovidov
d848e5495c Better implementation 2021-07-12 09:36:46 +03:00
Alexey Milovidov
ff5c433f10 Check for non-deterministic functions in keys, including constant expressions 2021-07-12 08:58:19 +03:00
Alexey Milovidov
822cc0fec3 Lowered amount of syscalls in AsynchronousMetrics 2021-07-12 04:12:34 +03:00
Amos Bird
7c6c1234f8
Proper GLOBAL IN function rewrite. 2021-07-11 14:21:57 +08:00
Alexey Milovidov
1ce40d6629 Fix bad code (default function argument) 2021-07-11 04:01:23 +03:00
Alexey Milovidov
9c0097cd9b Review fixes 2021-07-11 02:14:03 +03:00
Alexey Milovidov
78cde85ea8 Merge branch 'master' into estimates_for_select_query 2021-07-11 02:11:16 +03:00
alexey-milovidov
6f81482a94
Merge pull request #26179 from ClickHouse/untuple-transformers-msan
Added failing test #24404
2021-07-10 19:17:36 +03:00
Peng Jian
a7c4aa2497 fix build error 2021-07-10 19:22:40 +08:00
Alexey Milovidov
efbc308739 Remove harmful code and fix crash 2021-07-10 10:27:48 +03:00
Alexander Tokmakov
ca45054de5 add enums 2021-07-10 00:18:20 +03:00
Artur
8113580237 Add warning in debug mode 2021-07-09 14:40:32 +00:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
kssenii
947bb4a942 Fix progress bar for local 2021-07-09 16:43:00 +03:00
Peng Jian
c08dd0b75e Fix the explain estimates with Null format lost result 2021-07-09 21:25:58 +08:00
Peng Jian
fb793696a1 Add bytes to result of EXPLAIN ESTIMATES 2021-07-09 19:17:03 +08:00
Peng Jian
b526aacd56 Show estimates for SELECT query 2021-07-09 18:29:45 +08:00
Artur
146a45a8b3 Adding system.warnings 2021-07-09 09:27:51 +00:00
alexey-milovidov
7c17e2526d
Merge pull request #25634 from vdimir/join-materialized-columns
Support materialized and aliased columns in joins
2021-07-09 03:18:49 +03:00
alexey-milovidov
c98e131a81
Merge pull request #26072 from vdimir/fix-offset-check-in-window-frame
Fix logical error with signed and unsigned offset in WindowFrame::checkValid
2021-07-09 03:06:15 +03:00
Realist007
50149abfa5
Merge branch 'master' into feature/create-simple-lambda-function 2021-07-09 00:16:26 +03:00
vdimir
d4256a8583
Minor style changes in JoinedTables 2021-07-08 13:49:13 +03:00
tavplubix
8333a09258
Update Context.cpp 2021-07-08 13:18:54 +03:00
vdimir
5d7fc61bd5
Merge branch 'master' into join-materialized-columns 2021-07-08 12:30:00 +03:00
vdimir
2304f6a31b
Remove dots from exception message in WindowDescription.cpp 2021-07-08 12:24:37 +03:00
vdimir
71d0682a2b
Use FieldVisitor to compare offsets in WindowFrame::checkValid 2021-07-08 12:24:08 +03:00
vdimir
39de7f8a2a
Fix logical error with signed and unsinged offset in WindowFrame::checkValid 2021-07-08 11:16:57 +03:00
Alexey Milovidov
ee1b3696a2 Fix error in AsynchronousMetrics 2021-07-08 06:15:30 +03:00
Alexander Tokmakov
1a470fb777 fix sequence_id in MySQL protocol 2021-07-07 20:03:28 +03:00
alesapin
aa86fac4e7 Fix unbundled build 2021-07-07 14:07:20 +03:00
alesapin
f0fc12d0dd Merge branch 'master' into evillique-nlp 2021-07-07 12:14:49 +03:00
Raúl Marín
d87607b160 AsynchronousMetrics: Don't assume temperature is always positive 2021-07-07 11:09:38 +02:00
mergify[bot]
446474932b
Merge branch 'master' into projection-fix11 2021-07-07 05:02:44 +00:00
Amos Bird
55981cb0ae
Fix normal projection 2021-07-07 13:01:30 +08:00
alexey-milovidov
80eaf85301
Merge pull request #24416 from elevankoff/system-metrics
Common system metrics collection
2021-07-07 03:21:49 +03:00
Azat Khuzhin
d5cb792e9e Add conversion of values from IN section for optimize_skip_unused_shards_rewrite_in 2021-07-07 00:18:24 +03:00
Azat Khuzhin
a3add4f85f Fix optimize_skip_unused_shards_rewrite_in for non-UInt64 types
The following should happens before:
- incorrect shards was selected
- "Cannot infer type of an empty tuple" exception for empty tuple() for localhost
- "Function tuple requires at least one argument" exception for empty tuple() for remote node
2021-07-07 00:18:24 +03:00
Azat Khuzhin
57da47e1fd Refactor code around optimize_skip_unused_shards_rewrite_in a little 2021-07-07 00:17:39 +03:00
mergify[bot]
7aec53a842
Merge branch 'master' into improve_create_or_replace 2021-07-06 12:51:16 +00:00
Alexander Tokmakov
c0bbe67cc9 fix 2021-07-06 13:26:03 +03:00
Alexander Tokmakov
5e44fa32b4 Merge branch 'master' into improve_create_or_replace 2021-07-06 11:50:43 +03:00
Maksim Kita
20b7fab7af
Merge pull request #26014 from ClickHouse/remove-old-code
Remove old code
2021-07-06 11:08:04 +03:00
Maksim Kita
2afdb744bb
Merge pull request #25989 from kitaisreal/compile-aggregate-functions-perf-tests-fix
Compile aggregate functions perf tests fix
2021-07-06 11:04:11 +03:00
Alexey Milovidov
504d2c0c56 Remove old code 2021-07-06 05:31:09 +03:00
alexey-milovidov
b724138541
Merge pull request #25786 from kssenii/inconsisteny
Fix inconsistent behaviour of GROUP BY constant on empty set
2021-07-06 03:36:50 +03:00
Alexey Milovidov
94a024c7c8 Fix warning 2021-07-06 01:12:49 +03:00
Alexey Milovidov
945b54441d Comments 2021-07-05 22:41:50 +03:00
Alexey Milovidov
ac1baaf6d4 Comments 2021-07-05 22:37:12 +03:00
Alexey Milovidov
1fde0e13cc A check just in case 2021-07-05 22:32:33 +03:00
Alexey Milovidov
22ba93789b Fix warning 2021-07-05 22:29:36 +03:00
Alexey Milovidov
ce9c9c5e16 Merge remote-tracking branch 'origin/master' into system-metrics 2021-07-05 22:08:55 +03:00
Alexander Tokmakov
0f377fc4d8 Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-05 22:07:56 +03:00
Kseniia Sumarokova
c72a1be0be
Merge pull request #25064 from ucasfl/merge
Database argument for StorageMerge support regular expression.
2021-07-05 14:14:44 +03:00
Maksim Kita
577e69898a Compile aggregate functions perf tests fix 2021-07-05 12:17:01 +03:00
Alexey Milovidov
783ec5116a Skip errors 2021-07-05 05:55:11 +03:00
Alexey Milovidov
c3b975ecb1 Add network statistics 2021-07-05 05:47:33 +03:00
Alexey Milovidov
70bdc166e0 Add block device statistics 2021-07-05 05:24:36 +03:00
NengLiu
8b88988618 Merge branch 'master' into datatype-date32
# Conflicts:
#	src/DataStreams/PostgreSQLBlockInputStream.cpp
2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f Merge remote-tracking branch 'origin/master' into datatype-date32 2021-07-05 10:15:08 +08:00
Alexey Milovidov
dda4d0e34e Add EDAC 2021-07-05 04:18:12 +03:00
Alexey Milovidov
d7eca6ec35 Better temperatures 2021-07-05 03:56:14 +03:00
Alexey Milovidov
347ceac618 Better temperatures 2021-07-05 03:51:22 +03:00
Alexey Milovidov
5d5d2efd48 More temperatures 2021-07-05 03:40:28 +03:00
Alexey Milovidov
d437ec2e1d Merge branch 'master' into system-metrics 2021-07-05 03:03:07 +03:00
Alexey Milovidov
b320905f34 Whitespaces 2021-07-05 03:02:47 +03:00
Alexey Milovidov
295afd29a1 Fix style 2021-07-05 03:02:23 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Alexey Milovidov
c059d0a0ee More metrics 2021-07-05 01:41:09 +03:00
Alexey Milovidov
0f8ea9b8f6 More metrics 2021-07-05 01:33:32 +03:00
Alexey Milovidov
b5840210c1 Adjustments 2021-07-05 00:54:46 +03:00
Alexey Milovidov
3a10d3802b Development 2021-07-05 00:33:00 +03:00
Alexey Milovidov
08aca329bd Development 2021-07-05 00:22:58 +03:00
Alexey Milovidov
c4675285bf Development 2021-07-04 23:49:36 +03:00
Maksim Kita
df1dba5a7d Fixed Arcadia 2021-07-04 21:05:33 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Kseniia Sumarokova
9b4d35ef95
Merge pull request #25940 from kssenii/move-to-prewhere-if-final
Add setting optimize_move_to_prewhere_if_final
2021-07-04 11:33:24 +03:00
Alexey Milovidov
935e0327a5 Development 2021-07-04 06:03:49 +03:00
Alexey Milovidov
0769366441 Remove part of trash 2021-07-04 04:19:19 +03:00
Alexey Milovidov
f6b5dbd666 Merge branch 'master' into system-metrics 2021-07-04 03:27:13 +03:00
Kseniia Sumarokova
705e839390
Merge branch 'master' into inconsisteny 2021-07-04 02:29:56 +03:00
kssenii
e866faa975 Fix 2021-07-04 02:20:36 +03:00
alexey-milovidov
07cc8a010f
Merge pull request #25941 from vdimir/joined-tables-minor-fix
Build subquery in replaceJoinedTable without parsing
2021-07-04 02:00:20 +03:00
kssenii
77879f6826 Better 2021-07-04 01:53:51 +03:00
ANDREI STAROVEROV
3bf0db519e Improve tests and validation of new functions 2021-07-03 23:17:02 +03:00
mergify[bot]
52366c4303
Merge branch 'master' into move-to-prewhere-if-final 2021-07-03 16:07:09 +00:00
Realist007
d99e7059cd
Merge branch 'master' into feature/create-simple-lambda-function 2021-07-03 19:04:10 +03:00
Alexey Milovidov
127455f15f Remove experimental ANTLR parser 2021-07-03 18:48:03 +03:00
alexey-milovidov
51bf60a938
Merge pull request #17769 from xjewer/alex/remove_engine_setting
CLICKHOUSE-784: reset merge tree setting
2021-07-03 18:27:15 +03:00
alexey-milovidov
1dda771864
Merge pull request #25554 from CurtizJ/fix-alter-ttl-column
Fix `ALTER MODIFY COLUMN` of columns, which participates in TTL expressions
2021-07-03 18:26:37 +03:00
Maksim Kita
55220d49f9 Fixed code review issues 2021-07-03 16:29:32 +03:00
vdimir
317ade9b4c
Build subquery in replaceJoinedTable without parsing 2021-07-03 16:24:41 +03:00
Kseniia Sumarokova
b639a30dfc
Merge pull request #25939 from kssenii/fix-special-build-check
Fix clang tidy build check
2021-07-03 15:14:16 +03:00
mergify[bot]
a318ed966a
Merge branch 'master' into inconsisteny 2021-07-03 11:58:09 +00:00
Maksim Kita
c584312c57
Merge pull request #25924 from ClickHouse/joins-idiotic
Partially fix idiotic code in JOINs
2021-07-03 14:55:26 +03:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
kssenii
a9a91a4f15 Setting move to prewhere if final 2021-07-03 11:37:50 +00:00
kssenii
ae1bb3f18b Fix clang-tidy 2021-07-03 13:16:55 +03:00
kssenii
02681019f8 Fix 2021-07-03 08:48:42 +00:00
Alexey Milovidov
b20c0e2674 Partially fix idiotic code in JOINs 2021-07-03 03:23:14 +03:00
mergify[bot]
02cb287dc9
Merge branch 'master' into fix-alter-ttl-column 2021-07-02 23:49:46 +00:00
Alexander Tokmakov
aa3f0b2032 fix 2021-07-02 19:39:55 +03:00
Maksim Kita
b3e3a3cde0 Fixed tests 2021-07-02 16:36:02 +03:00
feng lv
b0dffa3f3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into merge 2021-07-02 13:19:38 +00:00
Vitaly Baranov
8b4fabe60c Fix crash on call dictGet() with bad arguments. 2021-07-02 14:46:12 +03:00
Alexey Milovidov
0e621788c7 Allow constexpr parameters for aggregate functions 2021-07-02 03:53:08 +03:00
Maksim Kita
97e1ddbe94 Fix before merge 2021-07-01 22:56:36 +03:00
Maksim Kita
4bd398c0e5 Fixed tests 2021-07-01 22:56:36 +03:00
Maksim Kita
f33a38381d Fixed tests 2021-07-01 22:56:36 +03:00
Maksim Kita
325b54f623 Aggregator compile only part of aggregate functions 2021-07-01 22:56:36 +03:00
Maksim Kita
22491c8adc Compile AggregateFunctionCount 2021-07-01 22:56:36 +03:00
Maksim Kita
fdf172a61e Fixed tests 2021-07-01 22:56:36 +03:00
Maksim Kita
30021f0335 Fixed tests 2021-07-01 22:56:36 +03:00
Maksim Kita
da8c957167 Aggregator added CompiledExpressionCache 2021-07-01 22:56:36 +03:00
Maksim Kita
7b3952adda Fixed tests 2021-07-01 22:56:36 +03:00
Maksim Kita
0fb8ea530f Avoid using exception unsafe method 2021-07-01 22:56:36 +03:00
Maksim Kita
d24d3ae992 Added second variant of compilation 2021-07-01 22:56:36 +03:00
Maksim Kita
1e2f22a183 Aggregator compile part of aggregate functions 2021-07-01 22:56:36 +03:00
Maksim Kita
d4742f91e6 Check min_count_to_compile_aggregate_expression setting before compilation 2021-07-01 22:56:36 +03:00
Maksim Kita
507d9405e2 Compile AggregateFunctionAvgWeighted 2021-07-01 22:56:36 +03:00
Maksim Kita
f93da5ed2b Compile AggregateFunctionNullUnary 2021-07-01 22:56:35 +03:00
Maksim Kita
b491e75a56 Fix compile functions data type offset 2021-07-01 22:56:35 +03:00
Maksim Kita
a5ef0067b8 Compile AggregateFunctionIf 2021-07-01 22:56:35 +03:00
Maksim Kita
9b71b1040a Aggregate functions update compile interface 2021-07-01 22:56:35 +03:00
Maksim Kita
3fe559b31f Compile aggregate functions 2021-07-01 22:56:35 +03:00
Aleksei Semiglazov
9a5365fc41
CLICKHOUSE-784: reset merge tree setting
Add an ability to reset custom setting to default and remove it from table's metadata.
This will allow to rollback the change without knowing the system/config's default.

Signed-off-by: Aleksei Semiglazov <asemiglazov@cloudflare.com>
2021-07-01 20:09:54 +01:00
Alexander Tokmakov
1b2416007e fix 2021-07-01 19:43:59 +03:00
Alexander Tokmakov
d9a77e3a1a improve CREATE OR REPLACE query 2021-07-01 16:21:38 +03:00
feng lv
fe22563465 fix conflict 2021-07-01 13:09:33 +00:00
kssenii
f01c8edbff Fix access to tables after restart 2021-07-01 07:33:58 +00:00
Kseniia Sumarokova
360f772762
Merge pull request #25795 from sand6255/MySQL-column-comments-support
MySQL Engine column comments support
2021-06-30 20:18:47 +03:00
Maksim Kita
1e9e073b0a
Merge pull request #25618 from vdimir/slow-dict-join-fix
Fix unnecessary dictionary re-reads in KeyGetterForDict
2021-06-30 10:54:48 +03:00
Maksim Kita
5b3fc9b49e Added comment 2021-06-30 01:46:57 +03:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
Maksim Kita
b2177ab723 ExpressionCache destruction fix 2021-06-29 23:40:15 +03:00
Alexander Tokmakov
fd914f3d97 fix 'Not found column' error in MaterializeMySQL 2021-06-29 20:47:41 +03:00
Nikolai Kochetov
d5bd2b1fa9
Merge pull request #25719 from ClickHouse/remove-PrewhereDAGInfo
Remove PrewhereDAGInfo.
2021-06-29 18:58:03 +03:00
Kostiantyn Storozhuk
a9510f25f9 Style fix 2021-06-29 15:22:08 +08:00
Kostiantyn Storozhuk
296593716d Reverted constructor change 2021-06-29 14:37:53 +08:00
alexey-milovidov
5b21ca72ac
Merge pull request #25801 from azat/storage-merge-no-col-fix
Fix "No available columns" for Merge() storage
2021-06-29 04:23:52 +03:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge
Merging #23934
2021-06-29 04:19:53 +03:00
Azat Khuzhin
15a14d6da2 Fix "No available columns" for Merge() storage 2021-06-29 00:39:38 +03:00
Kseniia Sumarokova
d9c46003cb
Merge pull request #25781 from sand6255/MaterializeMySQL-Engine-column-comments-improvement
MaterializeMySQL: Improved column comments support
2021-06-28 21:57:24 +03:00
Kseniia Sumarokova
9d02af7d8b
Merge pull request #25676 from sand6255/MaterializeMySQL-Support-Enum-Data-Type
MaterializeMySQL: support ENUM data type
2021-06-28 19:15:00 +03:00
Kostiantyn Storozhuk
c2c78929cb Implemented MySQL column comments support 2021-06-28 22:44:38 +08:00
Maksim Kita
352e1f27ff Update using Map datatyle in system log tables before merge 2021-06-28 14:42:21 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
Kostiantyn Storozhuk
ca4783d854 Fixed typo and casting 2021-06-28 15:22:13 +08:00
alexey-milovidov
a11351a473
Merge pull request #25484 from vdimir/issue-19589
Fix assert with non uint8 in prewhere
2021-06-28 00:03:12 +03:00
kssenii
aa7133c239 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-27 20:08:00 +00:00
kssenii
c3a2fc0584 Review fixes 2021-06-27 19:17:17 +00:00
alexey-milovidov
6e0c8f0122
Merge pull request #25737 from amosbird/dataracereloadcluster
Fix data race in getClusters()
2021-06-27 17:55:28 +03:00
feng lv
06242f85e6 fix 2021-06-27 06:09:23 +00:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
Amos Bird
4da1b8154a
Fix data race in getClusters() 2021-06-26 22:15:57 +08:00
Maksim Kita
008adabec2 Support REPLACE DICTIONARY, CREATE OR REPLACE DICTIONARY queries 2021-06-26 14:28:13 +03:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560)
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
2021-06-25 18:21:56 +03:00
feng lv
61550f91f2 fix and update test 2021-06-25 15:01:57 +00:00
Nikolai Kochetov
3544b059ce Merge branch 'master' into remove-PrewhereDAGInfo 2021-06-25 17:52:03 +03:00
Nikolai Kochetov
6bc0a628cd Remove PrewhereDAGInfo. 2021-06-25 17:49:28 +03:00
Kostiantyn Storozhuk
ca04b077ef Improved column comments support 2021-06-25 22:30:11 +08:00
feng lv
07a47b4bd3 fix 2021-06-25 13:51:17 +00:00
Nikita Mikhaylov
930a2aa0b7
Merge pull request #24095 from vdimir/view-join-settings
Use global settings for query to VIEW
2021-06-25 16:44:28 +03:00
Anton Popov
4a250dc14e
Merge pull request #25371 from CurtizJ/add-compatibility-setting
Add compatibility setting for name of tuple literals
2021-06-25 15:08:13 +03:00
vdimir
2949cd1e6f
Support ALIASed columns in JOIN ON expression 2021-06-25 14:50:02 +03:00
Kostiantyn Storozhuk
3c71e067fa Update docs and style 2021-06-25 19:27:03 +08:00
Kostiantyn Storozhuk
7516d39091 Style fixes 2021-06-25 16:44:28 +08:00
Storozhuk Kostiantyn
4a3145f586 Materialize my sql support enum data type
* Implemented Enum for MaterializeMySQL
2021-06-25 16:42:25 +08:00
vdimir
241b64d02c
Support ALIASed columns for right joined table 2021-06-24 17:57:21 +03:00
vdimir
af7776554b
Fix space in ExpressionAnalyzer.cpp 2021-06-24 17:16:57 +03:00
vdimir
84e02911cf
Materialized columns for joined table, don't add to asterisk select 2021-06-24 17:14:36 +03:00
vdimir
b00efaf3d1
Add materialized columns to joined columns 2021-06-23 17:03:39 +03:00
vdimir
4ce829d7c1
Create KeyGetter outside of joinRightColumns 2021-06-23 14:27:39 +03:00
vdimir
8f9166df4e
Add read flag to KeyGetterForDict 2021-06-23 14:15:31 +03:00
Azat Khuzhin
e148ef739d Drop replicas from dirname for internal_replication=true
Under use_compact_format_in_distributed_parts_names=1 and
internal_replication=true the server encodes all replicas for the
directory name for async INSERT into Distributed, and the directory name
looks like:

    shard1_replica1,shard1_replica2,shard3_replica3

This is required for creating connections (to specific replicas only),
but in case of internal_replication=true, this can be avoided, since
this path will always includes all replicas.

This patch replaces all replicas with "_all_replicas" marker.

Note, that initial problem was that this path may overflow the NAME_MAX
if you will have more then 15 replicas, and the server will fail to
create the directory.

Also note, that changed directory name should not be a problem, since:
- empty directories will be removed since #16729
- and replicas encoded in the directory name is also supported anyway.
2021-06-23 02:47:38 +03:00
vdimir
85bcf8a1dc
Merge branch 'master' into view-join-settings 2021-06-22 17:36:44 +03:00
Neng Liu
7ed1728a37 Merge branch 'master' into datatype-date32
# Conflicts:
#	src/DataTypes/IDataType.h
#	src/Functions/CustomWeekTransforms.h
2021-06-22 10:00:18 +08:00