Commit Graph

5773 Commits

Author SHA1 Message Date
Vitaly Baranov
e026258f42
Update InterpreterSetRoleQuery.h 2020-02-22 19:32:15 +03:00
Alexander Tokmakov
ac0e2c2256 Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 16:42:45 +03:00
Alexey Milovidov
5cf3414b8a
More strict aliasing 2020-02-22 10:17:52 +08:00
Vitaly Baranov
c1e870d493
Merge pull request #9182 from vitlibar/RBAC-5.2
RBAC-5.2
2020-02-22 03:55:17 +03:00
Alexander Tokmakov
d6205fa4fa Merge branch 'master' into fix_expressions_in_metadata 2020-02-22 03:17:15 +03:00
alexey-milovidov
716a7e907f
Merge pull request #9275 from 4ertus2/joins
Negative test for partial_merge_join variants
2020-02-22 00:26:05 +03:00
Alexander Tokmakov
db669cef63 Merge branch 'master' into fix_expressions_in_metadata 2020-02-21 18:22:52 +03:00
alexey-milovidov
ee710dd1f7
Merge pull request #9235 from zhang2014/fix/ISSUES-9230
ISSUES-9230 pushed SelectQueryOption into join expression
2020-02-21 17:55:57 +03:00
Alexander Tokmakov
e117e5838e fixes 2020-02-21 16:44:44 +03:00
chertus
759d137162 add negative test for partial_merge_join variants 2020-02-21 16:16:59 +03:00
Nikolai Kochetov
30d41b34ba Merged with master 2020-02-21 11:47:56 +03:00
Vitaly Baranov
e017bacc48 Implement SQL queries for creating and controlling roles. 2020-02-21 06:03:09 +03:00
Vitaly Baranov
ae18d443c8 Introduce roles. 2020-02-21 06:03:03 +03:00
Vitaly Baranov
543587fc46 Remove ATTACH and DETACH access types, check CREATE and DROP access types instead of them. 2020-02-21 03:27:29 +03:00
Vitaly Baranov
4f85c148b5 Move event handling away from Context. 2020-02-21 03:27:23 +03:00
alexey-milovidov
219f94ca97
Merge pull request #9082 from 4ertus2/joins
Switch JOIN algo on the fly
2020-02-21 02:01:23 +03:00
Vitaly Baranov
5849dd2236 Slightly better solution for checking row policy for distributed tables,
now it checks both current user's and initial user's filters.
2020-02-21 00:57:42 +03:00
Vitaly Baranov
244c9d5325 Add class GenericRoleSet to represent a set of IDs of users and roles. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
ed2061db8a Better pointers: std::shared_ptr<const QuotaContext> instead of std::shared_ptr<QuotaContext>, boost::atomic_shared_ptr instead of std::atomic_load/store. 2020-02-21 00:57:42 +03:00
Vitaly Baranov
9edea08b6d Improve parsers of access managing SQL. 2020-02-21 00:57:42 +03:00
Alexander Tokmakov
e1f5a620b5 more complex test and some fixes 2020-02-20 23:24:04 +03:00
alesapin
f06bcee7bc Merge with master 2020-02-20 22:36:36 +03:00
chertus
aeefb78157 add comments to JoinSwitcher 2020-02-20 22:13:12 +03:00
alexey-milovidov
4433947670
Merge pull request #9227 from ClickHouse/simplier_alter_prepare
Simplier alter prepare
2020-02-20 21:45:27 +03:00
Alexey Milovidov
5894a750d5 Merge branch 'master' into session-cleaner-better-build-time 2020-02-20 21:43:40 +03:00
chertus
f683437a8c remove dangerous optimisation 2020-02-20 20:19:16 +03:00
Clément Rodriguez
1f275c965f Rebase with upstream/master 2020-02-20 16:32:05 +01:00
Alexander Tokmakov
c492ee93d9 fold constant expressions in storage engine arguments 2020-02-20 17:13:43 +03:00
chertus
9748f8dcf6 fix bug with comma join and in 2020-02-20 16:33:14 +03:00
Alexey Milovidov
f888c6ac88 Fixed build 2020-02-20 16:21:58 +03:00
Clément Rodriguez
dd4353311f Merge remote-tracking branch 'upstream/master' 2020-02-20 14:07:37 +01:00
CurtizJ
3f7f13ce05 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-20 15:36:55 +03:00
chertus
56fa3cc1eb correct fallback for PREFER_PARTIAL_MERGE: HashJoin -> MergeJoin instead of HashJoin -> JoinSwitcher 2020-02-20 14:26:00 +03:00
alesapin
a576811c45 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:48:48 +03:00
alesapin
cbd8b697c4 Better error codes and exception messages, remove duplicated headers 2020-02-20 13:04:15 +03:00
zhang2014
130e76d5c0 ISSUES-9230 pushed SelectQueryOption into join expression 2020-02-20 11:15:59 +08:00
chertus
3d7959d2e8 fix join_algorithm and partial_merge_join settings check 2020-02-19 22:11:23 +03:00
Alexey Milovidov
a739e42740 Better build time 2020-02-19 21:41:22 +03:00
chertus
fa8f07374b fix CROSS to INNER JOIN rewrite with [NOT] LIKE 2020-02-19 20:22:16 +03:00
CurtizJ
803d9da496 add test for mutations with TTL 2020-02-19 20:18:12 +03:00
Nikolai Kochetov
e0c30259fb Remove readWithProcessors from IStorage. 2020-02-19 19:02:37 +03:00
alesapin
1914b1dab7 Add missed headers 2020-02-19 17:58:06 +03:00
alesapin
28b2a03b08 First version 2020-02-19 17:49:45 +03:00
chertus
9f43fa87c3 make switched flag atomic 2020-02-19 17:23:21 +03:00
Clément Rodriguez
cdd99d7f23 Merge 2020-02-19 15:23:17 +01:00
alesapin
6f266c94ed Trying to simplify alter commands logic 2020-02-19 15:52:27 +03:00
chertus
3348697128 fix storage join 2020-02-19 15:37:56 +03:00
Nikolai Kochetov
75af5414d9 Try fix test_delayed_replica_failover 2020-02-19 15:30:56 +03:00
chertus
48ac7d35ae Merge branch 'master' into joins 2020-02-19 14:21:40 +03:00
chertus
f748427ffd minor fix (remove logic dependent on partial_merge_join setting) 2020-02-19 14:20:35 +03:00
CurtizJ
b0f7905567 better TTL calculations with mutations 2020-02-18 22:03:40 +03:00
chertus
74a5227ac4 add join_algorithm setting 2020-02-18 20:31:22 +03:00
chertus
fbecd0c155 use default_max_bytes_in_join in JoinSwitcher if no join limits 2020-02-18 17:19:13 +03:00
chertus
f1673e1344 fix JoinSwitcher logic 2020-02-18 15:41:23 +03:00
alesapin
b3fe0b51a1 Merge branch 'master' into alter_on_top_of_mutations 2020-02-18 14:32:12 +03:00
CurtizJ
49c80c88ef Merge remote-tracking branch 'upstream/master' into alter-ttl 2020-02-18 10:58:07 +03:00
CurtizJ
7022376a2a remove debug prints 2020-02-17 23:45:16 +03:00
CurtizJ
2ff030be35 recalculate TTL expressions during mutations 2020-02-17 23:39:24 +03:00
chertus
a9e743d8bd minor JoinSwitcher optimisation 2020-02-17 20:41:38 +03:00
chertus
5717d48333 better includes 2020-02-17 20:21:03 +03:00
chertus
4a658f4325 swtich HashJoin to MergeJoin if JOIN limit exceeded 2020-02-17 20:08:31 +03:00
alesapin
6a02b99faf Slightly refactor merger mutator 2020-02-17 18:44:13 +03:00
Ivan Lezhankin
102dad0ca0 Merge branch 'master' into arcadia 2020-02-17 17:37:10 +03:00
Nikolai Kochetov
9eda64fcf7 Update SelectStreamFactory. 2020-02-17 17:28:44 +03:00
Ivan Lezhankin
39ea079034 More clean-up 2020-02-17 17:27:09 +03:00
alesapin
72ed29f1e8 Remove some garbage from code 2020-02-17 16:35:17 +03:00
alesapin
47c649f6c3 Fix all style warnings 2020-02-17 15:47:34 +03:00
Nikolai Kochetov
4599fbd798 Added force_tree_shaped_pipeline flag to SelectQueryInfo. 2020-02-17 13:42:14 +03:00
chertus
c2d6167f2a Merge branch 'master' into joins 2020-02-17 13:19:15 +03:00
alexey-milovidov
41c883ace3
Merge pull request #8911 from millb/secure_password
Changed format for path in replicas
2020-02-16 07:17:12 +03:00
alexey-milovidov
4ebb240be6
Update Cluster.h 2020-02-16 07:13:54 +03:00
alexey-milovidov
5ebabe519f
Update Cluster.cpp 2020-02-16 07:12:48 +03:00
alexey-milovidov
480881563a
Slightly more readable. 2020-02-16 07:11:19 +03:00
alexey-milovidov
38c4f3ed84
Merge pull request #9131 from ClickHouse/better_temporary_live_view_syntax
Better CREATE syntax for temporary LIVE VIEW
2020-02-15 02:55:37 +03:00
Alexander Kuzmenkov
51815044c5
Merge pull request #8943 from ClickHouse/aku/flush-perf
[wip] Improve flush performance in SystemLog
2020-02-14 22:41:44 +03:00
Alexander Tokmakov
6889951396 better syntax for temporary LIVE VIEW 2020-02-14 21:20:20 +03:00
Nikolai Kochetov
52a63275ea Merge with master. 2020-02-14 20:47:39 +03:00
Nikolai Kochetov
97f0e1ffdc Fix SelectStreamFactory. 2020-02-14 20:03:23 +03:00
Alexander Kuzmenkov
6b09956277 review fixes 2020-02-14 16:09:51 +03:00
alesapin
11f30dcc61 Remove more comments 2020-02-14 14:15:05 +03:00
CurtizJ
ddb3a55f67 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-14 13:15:16 +03:00
Nikolai Kochetov
4cf65451de Update SelectStreamFactory. 2020-02-14 12:36:00 +03:00
Nikolai Kochetov
bb6d6a37b3 Fix build. 2020-02-14 12:28:13 +03:00
alesapin
199c22c363 Better naming 2020-02-13 23:09:48 +03:00
alexey-milovidov
296621f757
Merge pull request #9076 from sundy-li/mysql-show-tables
Show Queries more like MySQL did
2020-02-13 16:50:12 +03:00
alexey-milovidov
3cfcdcd79f
Update InterpreterShowTablesQuery.cpp 2020-02-13 16:46:35 +03:00
Mikhail Korotov
5d1396ca33
Update Cluster.h 2020-02-12 17:32:18 +03:00
Ivan
bef233f450
Add simple memory profiler (#8765)
* Add new trace type to system.trace_log table

* [WIP]

* Add settings for soft limit raising.

* Remove unused diff

* Remove unused diff

* Some renames

* Fix client hanging on quit

* Remove obsolete pointer for trace collector in context.

* Use memory tracker on query level.

* Fix TSan tests

* Try to simplify TraceCollector initialization.

It allows to workaround first call inside signal handler

* Initialize TraceCollector before setting signal handlers

* Attempt to fix

* Fix Int64 → UInt64 for |size|

* Explicitly reset global TraceCollector instance.
2020-02-12 15:37:40 +03:00
Mikhail Korotov
43d4838849 Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:13:50 +03:00
millb
6abeabc1f2 fixed bugs 2020-02-12 13:13:11 +03:00
Mikhail Korotov
5bd74b464d Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-12 13:08:10 +03:00
chertus
d2d4118730 add JoinSwitcher 2020-02-11 21:28:37 +03:00
Ivan Lezhankin
5644fa8c41 Explicitly reset global TraceCollector instance. 2020-02-11 18:16:53 +03:00
sundy
250475557d Show Queries more like MySQL 2020-02-11 19:36:12 +08:00
Mikhail Korotov
f8db74fca6 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-11 13:51:37 +03:00
Artem Zuikov
840d4c5f4a
Merge pull request #9067 from 4ertus2/some
Refactoring: actualize ExpressionAnalyzer public interface
2020-02-11 13:48:56 +03:00
Nikolai Kochetov
42692ad07b Fix typeo in ExternalModelsLoader. 2020-02-11 08:32:27 +03:00
chertus
b4ea4ca654 actualize ExpressionAnalyzer public interface 2020-02-10 22:55:13 +03:00
Artem Zuikov
bd6d9a427b
Some InterpreterSelectQuery refactoring (#9035)
move ExpressionActionsChain logic out of InterpreterSelectQuery
2020-02-10 18:50:12 +03:00
Ivan Lezhankin
cc63739837 Fix Int64 → UInt64 for |size| 2020-02-10 18:24:26 +03:00
alesapin
2a866043aa some trash 2020-02-10 16:32:59 +03:00
tavplubix
4543177931 Merge pull request #9048 from ClickHouse/fix_mutation_order
Fix primary.idx corruption after delete mutation
2020-02-09 19:21:23 +03:00
Alexander Kuzmenkov
2b683f6fc9 boop 2020-02-09 17:15:29 +03:00
Alexander Kuzmenkov
75920565c9 Improve flush performance in SystemLog
It started having problems under heavy workloads such as saving all
memory allocations to trace_log table. To improve that, stop popping
entries one by one from the log queue, and actually stop using the queue
completely, because we don't use most of its methods or its backpressure
feature. Just keep a vector of messages and flush it to disk
periodically.
2020-02-07 22:32:49 +03:00
Ivan
1b55150701
Add row-level filter support to Distributed engine (#8926)
* Add tests
* Implement support for initial user on remote side.
2020-02-07 22:31:09 +03:00
alesapin
dea937ad84 Don't use ORDER BY for empty key 2020-02-07 20:10:24 +03:00
Ivan Lezhankin
abb1220cb3 Merge branch 'master' into memory-profiler 2020-02-07 18:16:41 +03:00
alesapin
f3a35998e1 Fix primary.idx corruption after delete mutation 2020-02-07 16:54:17 +03:00
Anton Popov
3e8179108b
Merge pull request #8892 from PerformanceVision/select_constants
DB::Exception: Parameters are out of bound when we have a constant on the SELECT clause
2020-02-07 14:05:16 +03:00
Vitaly Baranov
7ebcd4b290
Merge pull request #8875 from vitlibar/RBAC-5
RBAC-5.1
2020-02-07 03:40:15 +03:00
Artem Zuikov
31948a063a
Trying to fix early constant folding (#9010)
add setting to disable early constant folding
2020-02-07 03:05:51 +03:00
Vitaly Baranov
d2ff1e5dd4 Implement partial revokes. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
421120b997 Implement SQL queries to manipulate users and grants. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
c9f2713cc4 Remove getting user by name from Context. 2020-02-06 18:12:53 +03:00
Vitaly Baranov
08c6061bdf Add user_id to Context. 2020-02-06 18:12:54 +03:00
alesapin
790ef52aef
Merge pull request #9024 from CurtizJ/fix-range-reader
Fix prewhere optimization.
2020-02-06 11:25:59 +03:00
zhang2014
784230b7a8 ISSUES-8971 fix non from 2020-02-06 08:30:14 +08:00
CurtizJ
db47ef923c fix prewhere 2020-02-05 19:42:27 +03:00
Ivan Lezhankin
a5ccc72656 Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-05 16:52:49 +03:00
zhang2014
16bb4e975d ISSUES-8971 support explain & view storage 2020-02-05 19:40:18 +08:00
Artem Zuikov
8c23840cc8
ExpressionActions refactoring: extract ArrayJoinAction class (#8998)
refactoring: extract ArrayJoinAction class
2020-02-05 13:12:19 +03:00
Mikhail Korotov
ad77771b9a Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-04 12:05:47 +03:00
Guillaume Tassery
a79a9cf078 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-04 05:09:12 +01:00
Nikolai Kochetov
ed71fb347e Update SelectStreamFactory. 2020-02-03 21:14:26 +03:00
Nikolai Kochetov
71f746e01a Update SelectStreamFactory. 2020-02-03 20:55:06 +03:00
Ivan Lezhankin
634d3bedd3 Attempt to fix 2020-02-03 20:06:59 +03:00
millb
cb7dc72c4b Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password 2020-02-03 19:04:16 +03:00
millb
663e944b33 Attempt 2020-02-03 19:03:42 +03:00
Nikolai Kochetov
30586111a6 fix totals port for pipe. 2020-02-03 17:50:19 +03:00
Ivan Lezhankin
88095b636e Merge remote-tracking branch 'upstream/master' into memory-profiler 2020-02-03 16:21:21 +03:00
Mikhail Korotov
e0eb2f5428
Update Cluster.cpp 2020-02-03 16:18:00 +03:00
alexey-milovidov
5689bef818
Merge pull request #8967 from CurtizJ/attach-if-not-exists
Fix query 'ATTACH TABLE IF NOT EXISTS'
2020-02-03 15:41:57 +03:00
CurtizJ
2d7ff400ed Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-03 13:46:00 +03:00
CurtizJ
a5b5cb2e94 fix query 'ATTACH TABLE IF NOT EXISTS' 2020-02-03 13:38:09 +03:00
Mikhail Korotov
bf3caa0373 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-03 13:08:20 +03:00
Guillaume Tassery
4189a0d70b Merge branch 'master' of github.com:ClickHouse/ClickHouse into select_constants 2020-02-03 10:46:37 +01:00
alesapin
5864cab472 Merge branch 'master' into alter_on_top_of_mutations 2020-02-03 12:09:19 +03:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id
Use OS thread id everywhere instead of internal thread number.
2020-02-03 03:57:35 +03:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt
Rename ANY INNER to SEMI JOIN for partial merge join
2020-02-03 01:53:52 +03:00
Alexey Milovidov
1463764199 Removed useless code (found by PVS Studio) 2020-02-02 23:59:18 +03:00
Alexey Milovidov
d11f3cb78f Changed thread_id to UInt64 to support more OS 2020-02-02 23:01:13 +03:00
chertus
d2e8b24970 better compatibility in EngineJoin 2020-02-02 19:12:48 +03:00
chertus
8c371ed75f syntax ANY INNER to SEMI LEFT JOIN rewrite 2020-02-02 17:07:50 +03:00
Alexey Milovidov
39b31907b5 Rename function #7477 2020-02-02 05:35:47 +03:00
Alexey Milovidov
f9eb4e79f6 Using OS tid everywhere #7477 2020-02-02 05:28:14 +03:00
alexey-milovidov
c1535e10d4
Merge pull request #8813 from CurtizJ/merging-in-arrays
Merging #5342 (IN with function result).
2020-02-02 04:33:54 +03:00
alexey-milovidov
ef2346b0fa
Update ActionsVisitor.cpp 2020-02-02 04:33:13 +03:00
Vitaly Baranov
caeed69fe0 Change access rights dynamically when users.xml is edited. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
168002376b Remove old access rights checking code. 2020-01-31 20:27:32 +03:00