Commit Graph

4599 Commits

Author SHA1 Message Date
Nikita Mikhaylov
875d7aef8b better 2019-08-13 17:32:32 +03:00
Nikita Mikhaylov
bbe20b3f9f done 2019-08-13 17:31:46 +03:00
chertus
87fbc2a5cb minor improvements 2019-08-13 16:48:09 +03:00
chertus
10a1991855 move getAggregates() into SyntaxAnalyzer 2019-08-13 15:39:03 +03:00
alesapin
bf5ec73582 Fix clang build 2019-08-13 14:40:45 +03:00
alesapin
7b1039568c Revert old changed 2019-08-13 14:24:18 +03:00
chertus
3d00e4b374 remove wrong logic 2019-08-13 13:56:12 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
chertus
f2a03d9d51 several fixes 2019-08-13 03:25:51 +03:00
Alexey Milovidov
60504bc2c8 Change logger_name column in text_log to LowCardinality #6037 2019-08-13 02:47:15 +03:00
chertus
15d2561ac8 more ExpressionAnalyzer refactoring 2019-08-12 22:27:09 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
alexey-milovidov
27c46be554
Merge pull request #6435 from yandex/batch-aggregator
Batch aggregator (experimental)
2019-08-12 04:52:22 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
alexey-milovidov
8520288044
Merge pull request #6416 from 4ertus2/some
Refactoring: move collectUsedColumns() to SyntaxAnalyzer
2019-08-11 05:16:22 +03:00
Alexey Milovidov
cc5b34d778 Addition to prev. revision 2019-08-11 04:00:54 +03:00
Alexey Milovidov
f00fa640ba Removed old optimization that is now dominated by the new optimization 2019-08-11 02:40:15 +03:00
Alexey Milovidov
011e50cae6 Removed useless function arguments 2019-08-11 02:27:25 +03:00
Alexey Milovidov
3885cc20b8 Improved performance of aggregation without key 2019-08-11 02:22:23 +03:00
Alexey Milovidov
efa51a6cd9 Batch aggregation (experimental) 2019-08-11 01:36:55 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Nikita Vasilev
75e381bde4 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-10 23:07:50 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
Olga Khvostikova
dd6f48342d
Merge pull request #6428 from yandex/low-cardinality-setting-in-cast
Fix behavior low cardinality setting in creating materialized view (Fix #6293)
2019-08-10 18:26:59 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
stavrolia
626b75b6a5 Fix behavior low cardinality setting in creating materialized view 2019-08-09 22:17:19 +03:00
chertus
6491de7edd forget to remove field in last patch 2019-08-09 19:17:01 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
9bd949fff5 Convert streams structure to sample block in InterpreterSelectQuery. 2019-08-09 17:57:15 +03:00
chertus
e06c994b0e refactoring: move collectUsedColumns from ExpressionAnalyzer to SyntaxAnalyzer 2019-08-09 17:50:04 +03:00
Nikolai Kochetov
78516083ac Remove dry_run flag from InterpreterSelectQuery::executeImpl. 2019-08-09 16:42:58 +03:00
Nikolai Kochetov
a1023bebff Fix tests. 2019-08-09 16:37:42 +03:00
alesapin
2803fcc2ba Make atomic settings 2019-08-09 16:07:19 +03:00
Alexey Milovidov
a6e4b34ab4 Fixed unpleasant code #6401 2019-08-08 23:02:30 +03:00
Alexey Milovidov
1437065c70 Fixed tests and error messages #6351 2019-08-08 22:42:34 +03:00
Alexander Tokmakov
ae6efb23b4 Merge branch 'master' into alter_table_drop_detached_part 2019-08-08 22:31:31 +03:00
alesapin
a03fcd9f12 Make settings values atomic to avoid race conditions 2019-08-08 22:29:56 +03:00
alexey-milovidov
35f4e7cf33
Merge pull request #6351 from 4ertus2/some
Disable ANY RIGHT and ANY FULL JOINs by default
2019-08-08 19:16:49 +03:00
Alexander Tokmakov
b5eee531a9 fix setting name 2019-08-08 19:08:43 +03:00
Nikolai Kochetov
9ac401573f Added InterpreterSelectQuery::getSampleBlockImpl. Disable dry_run. 2019-08-08 18:18:28 +03:00
chertus
391574f361 rename setting + disable ANY INNER JOIN too 2019-08-08 17:20:25 +03:00
alesapin
75c3ed967a Checking updatable for user settings 2019-08-07 19:13:28 +03:00
Nikolai Kochetov
42c2833932 Added function which calculates header for execution step (InterpreterSelectQuery::getHeaderForExecutionStep). Removed InterpreterSelectQuery:;getSampleBlock from StorageDistributed and StorageMerge. 2019-08-07 16:41:36 +03:00
Nikita Vasilev
90ce4608fb Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-06 21:07:13 +03:00
Nikolai Kochetov
e73ea8a131 Make InterpreterSelectQuery::analyzeExpressions static. 2019-08-06 16:00:56 +03:00
alexey-milovidov
9dd9553d73
Merge pull request #6344 from amosbird/c9
Optimize Count() Cond.
2019-08-06 13:55:45 +03:00
Amos Bird
9950c9442b Update 2019-08-06 09:34:49 +08:00
chertus
c909e00865 disable ANY RIGHT and ANY FULL JOINs by default 2019-08-05 22:23:02 +03:00
Nikita Vasilev
4e8ab12816 refactoring 2019-08-05 21:22:44 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00
Amos Bird
a7db425592 Optimize Count() Cond.
Follow up https://github.com/yandex/ClickHouse/pull/6028
2019-08-05 22:15:15 +08:00
chertus
ef7d19e143 better JOIN exception messages #5565 2019-08-05 17:03:14 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Alexey Milovidov
8c05766888 Attempt to simplify text log 2019-08-04 18:51:04 +03:00
alexey-milovidov
a0599214ef
Merge pull request #6103 from nikitamikhaylov/system_text_log
Allow to write ClickHouse text logs into system table.
2019-08-04 17:51:34 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
Alexey Milovidov
8b85e09f06 Removed useless includes 2019-08-04 03:34:43 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
72e3f35924
Merge pull request #6309 from yandex/compiler-no-defaultlibs
Avoid extra dependency in Compiler (used with compile = 1 setting)
2019-08-03 18:46:03 +03:00
alexey-milovidov
349ad17436
Merge pull request #6298 from yandex/aku/uint816-nocache
Disable consecutive key optimization for UInt8/16.
2019-08-03 06:23:03 +03:00
Alexey Milovidov
ea98bd4ae2 Avoid extra dependency in Compiler (used with compile = 1 setting) 2019-08-03 06:01:13 +03:00
alexey-milovidov
149ed67462
Merge pull request #6281 from yandex/fix-low-cardinality-aggregate-arguments
Fix LowCardinality arguments conversion in AggregateFunctionFactory
2019-08-03 01:50:21 +03:00
alexey-milovidov
f149e3b436
Merge pull request #6277 from yandex/aku/pairnoinit
Make PairNoInit a simple struct.
2019-08-02 22:56:12 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
alexey-milovidov
3e0ce7df58
Merge pull request #6249 from 4ertus2/joins
Fix join_use_nulls. Nulls in JOIN keys issue
2019-08-02 22:07:03 +03:00
CurtizJ
e06a53a5d9 fix ranges selection at reading in order 2019-08-02 20:34:29 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Alexander Kuzmenkov
d808fafa8f Disable consecutive key optimization for UInt8/16.
These types use a FixedHashMap for aggregation, which makes lookup
almost free, so we don't have to cache the last lookup result.

This is a part of StringHashMap PR #5417 by Amos Bird.
2019-08-02 18:37:32 +03:00
chertus
c5a661a05c undo wrong changes 2019-08-01 22:56:29 +03:00
chertus
94813b21ba restore names deduplication 2019-08-01 22:48:21 +03:00
chertus
479a0a9c8e fix case with several same keys in join 2019-08-01 22:39:39 +03:00
Nikolai Kochetov
a8378e8ef0 Fix LowCardinality arguments conversion for AggregateFunctionFactory. 2019-08-01 21:22:38 +03:00
chertus
4072214b5d fix UB in join keys order 2019-08-01 20:27:51 +03:00
Alexander Kuzmenkov
011150fa8a Make PairNoInit a simple struct. 2019-08-01 19:54:33 +03:00
Nikita Mikhaylov
241751542e CamelCase 2019-08-01 19:37:50 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
Nikita Mikhaylov
9dbb758133 better style 2019-08-01 15:40:12 +03:00
Nikita Mikhaylov
406f7a2bfe done 2019-08-01 14:11:08 +03:00
Nikita Mikhaylov
a9fea0314e better style 2019-08-01 13:31:29 +03:00
alexey-milovidov
e8cac8ab6e
Merge pull request #6253 from yandex/std-filesystem-2
Changed boost::filesystem to std::filesystem
2019-08-01 04:32:40 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
alesapin
cfbae59701
Merge pull request #6236 from yandex/fix_prewhere_remote
Fix bug in prewhere + distributed
2019-07-31 23:22:29 +03:00
chertus
10edd76fe4 fix join_use_nulls results for key columns 2019-07-31 23:19:52 +03:00
alesapin
f70b0ed910 Slightly better 2019-07-31 18:05:21 +03:00
alesapin
aed4e5d1c4 Get type from source column 2019-07-31 17:57:14 +03:00
alesapin
4481bf429f Remove nulltype from assignment 2019-07-31 17:54:58 +03:00
Nikita Mikhaylov
cac7972837 better 2019-07-31 17:18:59 +03:00
Nikita Mikhaylov
ad4459c4a2 fixed flush_logs + added pretty function 2019-07-31 17:03:23 +03:00
alesapin
2254e6fd32 Fix comment 2019-07-31 15:35:23 +03:00
alesapin
46c1e9d1a2 Use COPY_COLUMN instead of PROJECT 2019-07-31 15:33:58 +03:00
chertus
f402ae5092 Merge branch 'master' into joins 2019-07-31 14:40:19 +03:00
alesapin
e6052ec117 Fix bug in prewhere + distributed 2019-07-31 13:22:56 +03:00
alexey-milovidov
94454e514d
Merge pull request #6211 from 4ertus2/asof
Support ASOF JOIN ON syntax
2019-07-31 06:00:22 +03:00
alexey-milovidov
10ab19b2e4
Merge pull request #6231 from yandex/bad-server-shutdown
Fixed bad server shutdown
2019-07-31 05:53:11 +03:00
alexey-milovidov
7fd6204114
Merge pull request #6197 from yandex/thread_local_rng
Less number of "clock_gettime" calls; fixed ABI compatibility between debug/release in Allocator.
2019-07-31 04:36:30 +03:00
Alexey Milovidov
b6275010f2 Fixed error with server shutdown 2019-07-31 02:12:04 +03:00
alexey-milovidov
cb37c79c41
Merge pull request #6201 from yandex/speed-up-dladdr
Introspection functions + better stack traces.
2019-07-31 00:49:16 +03:00
chertus
504d548d79 AnalyzedJoin refactoring 2019-07-30 21:39:37 +03:00
Nikita Mikhaylov
e06b3b17b3 some changes to log all text logs 2019-07-30 17:04:18 +03:00
chertus
24fd416084 remove unused ExpressionAnalyzer settings 2019-07-30 14:41:11 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00
Alexey Milovidov
372c4d89b2 Enabled line numbers in stack traces 2019-07-30 01:26:44 +03:00
chertus
7b4ddd268e support ASOF JOIN ON syntax 2019-07-29 17:58:36 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
Yuriy
f1694a1746 build fix 2019-07-29 03:09:17 +03:00
alexey-milovidov
3e9dd7ed42
Merge pull request #6196 from zlobober/patch-2
Fix build under gcc-8.2
2019-07-29 02:21:46 +03:00
Max Akhmedov
5e9ea2a905
Remove spaces from empty line 2019-07-28 20:46:48 +03:00
alexey-milovidov
129e88ee26
Merge pull request #6189 from CurtizJ/order-by-efficient
Fix reading in order of sorting key and refactoring.
2019-07-28 19:43:49 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Max Akhmedov
f632a0b241
Fix build under gcc-8.2 2019-07-28 18:12:07 +03:00
Yuriy
b1d5f4ca20 disabled mysql_native_password when password is specified as a plain text as it allows to connect to ClickHouse knowing only SHA1 instead of a password 2019-07-28 17:17:33 +03:00
Yuriy
760afb007c arbitrary passwords 2019-07-28 16:36:27 +03:00
Yuriy
21ce5331d1 implemented mysql_native_password auth plugin for compatibility with mysqljs 2019-07-28 16:12:26 +03:00
Gleb Novikov
8f4883b0d2 Better constraint exception 2019-07-28 15:33:40 +03:00
CurtizJ
b4991b38bf Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-28 04:26:43 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
alexey-milovidov
12a15316fd
Merge pull request #6181 from 4ertus2/joins
Fix crop column names in GLOBAL JOIN ON
2019-07-28 00:31:29 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
60289cd764 fix optimizeSortingWithPK 2019-07-27 03:15:22 +03:00
CurtizJ
cb85721cba handle ExpressionAnalyzer exceptions, while trying to optimize order by, in case of complicated queries 2019-07-27 03:02:04 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
chertus
9f9ba3a06f restore cropped names in JOIN ON section for distributed queries 2019-07-26 20:43:42 +03:00
alexey-milovidov
2442e65367
Merge pull request #6124 from yandex/merge-profiler
Fixes for query profiler.
2019-07-26 03:51:57 +03:00
alexey-milovidov
a3e4c1d39f
Merge pull request #6131 from 4ertus2/joins
Better JOIN ON keys extraction
2019-07-26 02:10:45 +03:00
Alexey Milovidov
f4ec18b30f Merge branch 'system_text_log' of https://github.com/nikitamikhaylov/ClickHouse into nikitamikhaylov-system_text_log 2019-07-26 01:51:19 +03:00
Alexey Milovidov
0cce86db3f Merge remote-tracking branch 'origin/master' into merge-profiler 2019-07-26 00:41:24 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
chertus
554e4ab5b8 fix cross alliasing case with JOIN ON 2019-07-25 22:25:51 +03:00
Alexey Milovidov
93c7f6aedf Merge branch 'fix_ISSUE5695' of https://github.com/TCeason/ClickHouse into TCeason-fix_ISSUE5695 2019-07-25 19:09:18 +03:00
CurtizJ
b1cc019bd4 fix pipeline 2019-07-25 14:00:14 +03:00
chertus
06076e67a3 Merge branch 'master' into joins 2019-07-25 13:48:32 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
alexey-milovidov
a985897a07
Update PredicateExpressionsOptimizer.h 2019-07-25 04:05:16 +03:00
alexey-milovidov
3022c4a759
Update PredicateExpressionsOptimizer.cpp 2019-07-25 04:04:03 +03:00
Alexey Milovidov
4c57405770 Added information about revision to trace log 2019-07-24 23:12:32 +03:00
Alexey Milovidov
cfb2066198 Added information about thread number to trace log 2019-07-24 23:10:23 +03:00
chertus
b3123df58e use source and joined columns to detect JOIN ON right and left keys 2019-07-24 18:37:37 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
Nikita Mikhaylov
38607af95f nothing interesting 2019-07-24 11:26:23 +03:00
Alexey Milovidov
a3f6b70433 Fixed warning from PVS-Studio 2019-07-23 23:07:33 +03:00
chertus
9da1b0089c visitor for JOIN ON keys extraction 2019-07-23 22:49:15 +03:00
Alexander Tokmakov
3c2172b750 parse and interpret query 2019-07-23 22:25:10 +03:00
Nikita Mikhaylov
811e3ab241 style check 2019-07-23 17:50:38 +03:00
Alexey Milovidov
1b00e99334 Fixed error with initialization of query profiler 2019-07-23 17:30:14 +03:00