Commit Graph

5476 Commits

Author SHA1 Message Date
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins
New ANY, SEMI, ANTI JOIN (HashJoin only)
2019-12-05 14:38:20 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
Alexey Milovidov
eef44d3fc5 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:31:08 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime
Fix bug with minimal dictionary lifetime equals zero
2019-12-03 02:32:38 +03:00
Alexey Milovidov
034ef665f1 Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 00:36:31 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
chertus
0251f4e442 perf: move applyLazyDefaults() out of cycle for ALL JOIN 2019-12-02 14:45:21 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE
Do not reload *all* dictionaries on CREATE DATABASE
2019-12-02 11:50:44 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Vasily Nemkov
70512f8289 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-30 21:49:15 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns
Fix union with diff columns
2019-11-26 19:40:45 +03:00
Vladimir Chebotarev
e3f299e3c4 Fixed background pool logger name. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Olga Khvostikova
953f3a5ddf
Merge pull request #7897 from ClickHouse/better-exception-messages
Slightly better usability of exception messages
2019-11-26 13:20:56 +03:00
Nikolai Kochetov
f301e60ef5 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:14:56 +03:00
Nikolai Kochetov
a6a0b2dea3 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:01:02 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias
Fix reading empty set with prewhere dependent on alias column.
2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas
Fix prewhere with max_parallel_replicas.
2019-11-26 09:29:49 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
tavplubix
fde727c4eb Update Context.cpp 2019-11-25 14:42:09 +03:00
Pervakov Grigory
9fbc55c61a Change max_table_size_to_drop and max_partition_size_to_drop to atmoic. Update hint in default config. 2019-11-25 14:42:09 +03:00
Alexey Milovidov
2d9d116267 Slightly better exception messages 2019-11-23 03:18:56 +03:00
Nikita Mikhaylov
1d170ed607 use set from storage set for set in index 2019-11-22 18:45:03 +03:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions
Fix Storage lifetime in table functions
2019-11-22 02:29:06 +03:00
Vasily Nemkov
66d64e7100 PR-comment fixes: factored out std::is_same_v to a constexpt variable. 2019-11-21 01:05:09 +03:00
Vasily Nemkov
23e9a582f2 Fixed using DecimalX and DateTime64 with ASOF JOIN
With tests
2019-11-20 12:00:10 +03:00
Denis Zhuravlev
cf0c8392b3
fix error message
on the right , on the left -> on the left on the right #7853
2019-11-19 20:57:06 -04:00
alexey-milovidov
4d4de7da95
Merge pull request #7793 from DeifyTheGod/master
fix zero-access user creation
2019-11-19 20:04:07 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Alexander Tokmakov
8562789059 Revert "add debug assert for Context"
This reverts commit 2f708c72be.
2019-11-19 01:36:03 +03:00
Alexander Tokmakov
a4d557f998 fix Context in interpretSubquery 2019-11-18 19:18:09 +03:00
Alexander Tokmakov
2f708c72be add debug assert for Context 2019-11-18 19:01:36 +03:00
Amos Bird
9af0c00053
Optimize PREWHERE
So that it's never worse than WHERE.
2019-11-18 22:59:03 +08:00
nonexistence
dea19a82f9 change to std::optional 2019-11-18 16:35:31 +03:00
Vitaly Baranov
681f03c625
Merge pull request #7653 from vitlibar/skip-unknown-settings-with-warnings
Skip unknown settings with warnings.
2019-11-18 13:50:52 +03:00
alexey-milovidov
3735a7e210
Merge pull request #7758 from 4ertus2/ast
Check if table has qualified column
2019-11-18 01:37:48 +03:00
alexey-milovidov
4dd66385b5
Merge pull request #7789 from zhang2014/fix/ISSUES-7784
ISSUES-7784 disabled predicate optimize for WITH FILL expression
2019-11-17 23:36:42 +03:00
Alexander Tokmakov
2173bf5f4a Merge branch 'master' into possible_segfaults_in_table_functions 2019-11-17 16:48:13 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict().
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
2019-11-17 03:51:51 +03:00
Alexander Tokmakov
55f60a6bad hold shared pointers to table function Storage and Context from InterpreterSelectQuery 2019-11-15 21:42:32 +03:00
nonexistence
a460001bae fix zero-access user creation 2019-11-15 18:55:08 +03:00
zhang2014
15b20e0b96 ISSUES-7784 disabled predicate optimize for WITH FILL expression 2019-11-15 22:10:36 +08:00
Anton Popov
0318e6d820
Update dbms/src/Interpreters/InterpreterSelectQuery.cpp
Co-Authored-By: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2019-11-15 17:09:34 +03:00
CurtizJ
475356f2b7 more clarifying names to avoid mistakes 2019-11-15 17:03:42 +03:00
chertus
8286bbf913 Merge branch 'master' into joins 2019-11-14 16:16:52 +03:00
chertus
31028b8f3b support nested column names 2019-11-13 19:49:29 +03:00
chertus
d70904d7ee better column to table matching: check if table has qualified column 2019-11-13 18:00:21 +03:00
CurtizJ
f6b601cb9c fix order by with pk optimization 2019-11-13 17:57:45 +03:00
Nikita Mikhaylov
b0e24b6c92 better naming 2019-11-13 16:52:08 +03:00
Nikita Mikhaylov
c8bfa6db59 done 2019-11-13 15:43:55 +03:00
Vasily Nemkov
f8d90af4ce Fixed regression of converting Date to DateTime (and vice versa) Field values on INSERT. 2019-11-13 12:46:53 +03:00
Nikolai Kochetov
28b195a0f1
Merge pull request #7672 from ClickHouse/processors-4-tmp
Processors 4
2019-11-11 21:22:06 +03:00
chertus
8321deefac Merge branch 'master' into joins 2019-11-11 20:54:45 +03:00
alexey-milovidov
44cf1483c8
Merge pull request #7710 from amosbird/batchreduce2
Better addBatchArray aggregator
2019-11-11 20:36:34 +03:00
chertus
b51e6f9fe3 trying to remove perf degradation 2019-11-11 14:42:10 +03:00
alexey-milovidov
e14f395001
Merge pull request #7506 from Enmk/odbc_bridge_nullable_fix
odbc table function now respects external_table_functions_use_nulls
2019-11-11 12:03:09 +03:00
Amos Bird
3707da4fbf
Better addBatchArray aggregator 2019-11-11 16:56:11 +08:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
alexey-milovidov
1d910c5071
Merge pull request #7608 from amosbird/batchreduce
Optimize arrayReduce, -Array and -State combinators
2019-11-10 22:10:03 +03:00
Alexey Milovidov
6a5f042a7f Removed fixed index granularity from system logs 2019-11-10 17:04:29 +03:00
Nikolai Kochetov
cc16ac3c3c Return resize processor before aggregating. 2019-11-09 12:24:55 +03:00
Nikolai Kochetov
f909575196 Try fix test 2019-11-08 20:30:56 +03:00
chertus
6f40bcfcee perf optimisation 2019-11-08 19:13:43 +03:00
Nikolai Kochetov
dd7ed390f6 Merge branch 'master' into processors-4-tmp 2019-11-08 18:53:03 +03:00
Vasily Nemkov
5624bb3abb odbc table function now respects external_table_functions_use_nulls setting
* Passing setting value to ODBC-bridge on each request
 * Handling that setting value correctly in ODBC-bridge
 * Fixed issue with executing table-functions on context with no settings
   applied in `SELECT ... SETTINGS x=foo` query.
 * Added tests to verify fix.
2019-11-08 14:30:11 +03:00
alesapin
40a5cf4bb9 Forbidden to use column name more than once in insert query. 2019-11-08 12:57:32 +03:00
millb
7a2dcf451a Merge branch 'master' into url_engine_problem 2019-11-08 02:19:09 +03:00
alexey-milovidov
7f01fd13b3
Merge pull request #7624 from azat/_shard_num
[RFC] Add _shard_num virtual column for the Distributed engine
2019-11-08 00:55:41 +03:00
alexey-milovidov
a2e79cc427
Merge pull request #7574 from ClickHouse/processors-4
Fix tests for processors
2019-11-08 00:46:30 +03:00
chertus
b8d464aa03 new consistent ANY JOIN (LEFT, INNER, RIGHT) 2019-11-08 00:32:44 +03:00
chertus
2cafe933ea revert some changes 2019-11-07 15:42:39 +03:00
Vasily Nemkov
e6efdf1ce2 Fixed Decimal in operator IN regression (00862_decimal_in) 2019-11-07 15:35:17 +03:00
Nikolai Kochetov
feed418fb3 Disable task pinning and resize. 2019-11-07 14:49:13 +03:00
alesapin
982eae7b30 Remove redundant change 2019-11-07 11:49:09 +03:00
alesapin
18e59f2771 Remove some functions from mutations interpreter 2019-11-07 11:40:36 +03:00
Amos Bird
544af39d23
Vectorize arrayReduce and -Array combinator
Also devirtualize -State combinator.
2019-11-07 11:53:47 +08:00
chertus
252fab54a2 less specializations 2019-11-06 23:25:27 +03:00
chertus
d388918c60 Join.cpp refactoring 2019-11-06 22:40:53 +03:00
Azat Khuzhin
0677ae048c Wrap _shard_num with toUInt32 for simpler JOIN with system.clusters.shard_num 2019-11-06 21:02:42 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
2019-11-06 15:26:12 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped
Unify hash tables interface (separated for review)
2019-11-06 13:49:39 +03:00
Nikolai Kochetov
86a9c2b98e Try to fix tests. 2019-11-06 12:45:47 +03:00
alexey-milovidov
78f7826a09
Update InterpreterSelectQuery.cpp 2019-11-06 11:17:26 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
Nikolai Kochetov
055f21c9b7 Less wrappers for procesors pipeline. 2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
millb
d62cd6efa8 Merge branch 'master' into url_engine_problem 2019-11-05 14:42:53 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins
Rewrite NonJoinedBlockInputStream
2019-11-04 14:49:47 +03:00
alexey-milovidov
782e2f6c13
Merge pull request #7606 from amosbird/nullformat
Better Null format for tcp handler.
2019-11-04 14:27:27 +03:00
Amos Bird
8f902dc2a9
Better null format for tcp handler. 2019-11-04 11:53:26 +08:00
chertus
b7b664845d return right x in RIGHT|FULL JOIN .. USING(x) from NonJoinedBlockInputStream if not qualified 2019-11-03 23:30:49 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master
Merge for #7363
2019-11-02 00:57:13 +03:00
chertus
334b91f351 revrite NonJoinedBlockInputStream (in progress) 2019-11-01 20:41:07 +03:00
Nikolai Kochetov
239d92a94c Code cleanup. 2019-11-01 18:31:02 +03:00
Nikolai Kochetov
575eabd4ff Add flag to set that set is created. 2019-11-01 16:56:33 +03:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt
Early constant folding.
2019-11-01 16:54:02 +03:00
Nikolai Kochetov
1f7a798c97 Add flag to set that set is created. 2019-11-01 13:58:29 +03:00
Nikolai Kochetov
d31cac33b2 Small fixes. 2019-11-01 12:41:20 +03:00
Nikolai Kochetov
5bb47e2484
Merge pull request #7181 from ClickHouse/processors-and-storages
Processors and storages
2019-11-01 12:04:49 +03:00
Nikolai Kochetov
c0fccd5b87 Simplified code. 2019-11-01 11:32:41 +03:00
Nikolai Kochetov
9a5a0a2a3b Fix types for set elements. 2019-10-31 19:14:06 +03:00
Vitaly Baranov
56011d4649
Merge pull request #7553 from vitlibar/add-constraints-columns-to-table-system-settings
Add constraints columns to table system.settings
2019-10-31 19:06:46 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Vitaly Baranov
272608762e Fix comment. 2019-10-31 11:45:14 +03:00
Vitaly Baranov
5601d6ae66 Add constraints columns to table system.settings 2019-10-31 01:45:57 +03:00
alexey-milovidov
0d2a2c332f
Merge pull request #7366 from achimbab/fixbug_inop
Made IN operator support Array(LowCardinality(Nullable(String)))
2019-10-31 00:26:22 +03:00
alexey-milovidov
883c868b36
Merge pull request #7523 from ClickHouse/fix-thread-context-attach
Disable context replacement for internal queries
2019-10-31 00:07:13 +03:00
Alexey Milovidov
fe73354320 Improvements after #7510 2019-10-30 22:15:55 +03:00
alexey-milovidov
ddb58eeb8b
Merge pull request #7510 from amosbird/smartcount
Instant count() for MergeTree
2019-10-30 20:42:00 +03:00
Artem Zuikov
0f68c5a12a
Merge pull request #7530 from 4ertus2/joins
Fix right table key nullability (join_use_keys = 0)
2019-10-30 13:30:27 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
chertus
deb2406b30 fix JOIN right table keys nullability 2019-10-29 22:39:42 +03:00
chertus
12b57aedf0 remove error prone code 2019-10-29 16:52:05 +03:00
alesapin
cde07dd620 Disable context replacement for internal queries 2019-10-29 13:27:19 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
Nikolai Kochetov
43c8d13de6
Merge pull request #7496 from amosbird/fix15
Fix HAVING without GROUP BY
2019-10-28 02:44:24 +03:00
Amos Bird
77bdfb3350
Fix HAVING without GROUP BY 2019-10-27 22:10:54 +08:00
alesapin
04ca163518 Merge branch 'master' into dictionaries_ddl_loader 2019-10-25 10:58:04 +03:00
chertus
f2028e901d review related changes 2019-10-24 16:04:50 +03:00
chertus
12cd21f3c3 Merge branch 'master' into ast 2019-10-24 15:20:09 +03:00
Artem Zuikov
39b64dff87
Merge pull request #7454 from 4ertus2/refactoring
Refactoring: extract non aliases logic out of QueryNormalizer
2019-10-24 14:34:53 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
chertus
20093fa065 extract more logic out of QueryNormalizer 2019-10-23 16:59:03 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
alesapin
c3519ff376 Better check of dictionary lifetime for updates 2019-10-23 16:02:40 +03:00
Alexander Kuzmenkov
1a609c27bd
Merge pull request #6243 from ClickHouse/aku/hashtables
Introduce String Hash Map to speed up aggregation over short string keys.
2019-10-23 12:52:50 +03:00
alesapin
6a0246f58e Fix if 2019-10-23 12:40:09 +03:00
alesapin
0abb2e538b Remove strange logic 2019-10-23 12:36:20 +03:00
alesapin
fb349757ba Fix ubsan error 2019-10-23 12:27:34 +03:00
alesapin
dc6090a2ac More readable code in external loader 2019-10-22 16:41:17 +03:00
alesapin
ae42dd1cea Better doLoading locking logic 2019-10-22 15:57:58 +03:00
alesapin
d3461f9d46 TODO comments 2019-10-22 14:03:16 +03:00
alesapin
4c5d150d7a Review fixes 2019-10-22 13:47:43 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table (#7265)
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
  To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
chertus
851b00c99f minor visitors improvement 2019-10-21 19:22:54 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
alesapin
ff7850cfbd Remove strange code in favor of less strange code 2019-10-21 17:59:35 +03:00
millb
8b8ca9a141 Support redirect improvement 2019-10-21 17:45:57 +03:00
alesapin
f7043c38bd Less diff 2019-10-21 17:20:42 +03:00
alesapin
fc05110d66 Better naming 2019-10-21 17:07:47 +03:00
alesapin
e4a936cf41 Fix add and reload 2019-10-21 16:54:23 +03:00
Amos Bird
a864447802 Introduce String Hash Map.
It speeds up aggregation over short string keys. Use it as a default
aggregation method for string keys.
2019-10-21 16:27:35 +03:00
chertus
4f0859a5fa Merge branch 'master' into ast 2019-10-21 15:08:05 +03:00
chertus
5ef7376cbf fix distributed join on 2019-10-21 14:22:22 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
f64f6658ce Merge branch 'master' into url_engine_problem 2019-10-21 11:44:31 +03:00
alexey-milovidov
8b8cc67873
Merge pull request #7390 from azat/processlist-log-queue_max_wait_ms
Add a message in case of queue_wait_max_ms wait takes place
2019-10-20 17:55:36 +03:00
Azat Khuzhin
94948c2579 Add a message in case of queue_wait_max_ms wait takes place
Since there no information about this, while this can be interesting,
for example to tune max_concurrent_queries in some cases.
2019-10-18 23:36:12 +03:00
chertus
c5a850240c better ambiguous column detection in multiple join rewriter 2019-10-18 20:09:17 +03:00
chertus
2533652847 columns match priority: table alias > table name> aliased table name 2019-10-18 19:16:57 +03:00
alesapin
cdc195727e Fix some races from lazy load and add ugly interface to loader (need to be refactored) 2019-10-18 19:04:09 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
Alexander Kuzmenkov
3143fa37d7
Merge pull request #7371 from CurtizJ/fix-optimize-read-in-order
Fix optimize_read_in_order with IN and a subquery.
2019-10-18 15:55:53 +03:00
philip.han
5f1b14e313 Remove a dynamically sized array in BloomFilterHash.h 2019-10-18 19:39:10 +09:00
philip.han
1d423fad73 Blocked "nested-array-type" for the bloom_filter 2019-10-18 11:55:01 +09:00
chertus
0f6176cc2d throw on ambiguous qualified column 2019-10-18 00:08:28 +03:00
alesapin
c29b39002d Fix race condition, add test 2019-10-17 20:36:53 +03:00
alesapin
05392fd882 Fix deadlock, add test and refactoring 2019-10-17 20:18:54 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Kuzmenkov
b62c9e729d
Merge pull request #7215 from ClickHouse/formats_improvements
Miscellaneous formats improvements
2019-10-17 17:37:38 +03:00
CurtizJ
546414c015 fix optimize_read_in_order with in subquery 2019-10-17 16:11:27 +03:00
alesapin
6dfe5c7142 Better introspection 2019-10-17 16:05:12 +03:00
Ivan
e595df05d9
Fix CREATE TABLE AS from table with virtual columns (#7183)
* Disable undefined instrumentation for rdkafka
2019-10-17 14:12:35 +03:00
philip.han
08a348fbd1 Made IN operator support Array(LowCardinality(Nullable(String))) 2019-10-17 19:08:36 +09:00
alesapin
3987a45ea2 Fix build and style 2019-10-17 12:05:48 +03:00
alesapin
a19a699bef Fix confused variables 2019-10-16 20:52:56 +03:00
chertus
483108f46f column to table matching refactoring 2019-10-16 20:33:53 +03:00
alesapin
01e23f0a22 Better load of dictionaries 2019-10-16 20:06:52 +03:00
alesapin
b4e0ded048 Almost working 2019-10-16 17:59:52 +03:00
chertus
e6e88241fc SyntaxAnalyzer refactoring: better getTablesWithColumns() 2019-10-16 17:47:58 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Artem Zuikov
b70ca30447
Merge pull request #7335 from 4ertus2/ast
Remove asterisk_left_columns_only setting
2019-10-16 13:57:17 +03:00
Artem Zuikov
3ceeb95145
Merge pull request #7282 from 4ertus2/asof
ASOF JOIN inequalities
2019-10-16 13:46:52 +03:00
philip.han
a2bf848e12 Made bloom_filter type of index supporting LowCardinality and Nullable 2019-10-16 15:22:56 +09:00
alesapin
e690a3ca32 Half working code 2019-10-15 21:04:17 +03:00
chertus
ccc8c1ad2a restore logic for array join (it's probably a hidden error) 2019-10-15 20:39:23 +03:00
Artem Zuikov
cf99f88bc4 PartialMergeJoin flush data on disk (#7186) 2019-10-15 19:31:49 +03:00
chertus
c727777a9c resolve some for review sentences 2019-10-15 18:49:00 +03:00
chertus
9667e54201 remove asterisk_left_columns_only setting 2019-10-15 17:42:57 +03:00
alesapin
3e068b81de Add loading of external dictionaries 2019-10-15 17:09:57 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
2019-10-14 14:25:03 +03:00
alesapin
ecde224692 More tests 2019-10-14 12:52:43 +03:00
alesapin
155731a676 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-14 11:49:18 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216
Fix for #7216
2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes
Include PODArray.h into fewer files.
2019-10-12 15:08:41 +03:00
Nikolai Kochetov
25510e3d38 Try to fix perftests. 2019-10-12 13:06:07 +03:00
Vasily Nemkov
8648ebf75c Initial implementation of DateTime64 parsing functions; 2019-10-12 10:03:38 +03:00
chertus
91c7ae83a3 asof join inequalities 2019-10-11 20:56:26 +03:00
Nikolai Kochetov
217eab0cfa Fix test. 2019-10-11 20:55:33 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
alesapin
967fe64793 Add simpliest tests 2019-10-11 18:22:30 +03:00
Vitaly Baranov
8c24d5e66a
Merge pull request #7235 from vitlibar/RBAC-1
RBAC-1
2019-10-11 17:16:32 +03:00
alesapin
ae42dc0d4c Attach detach and introspection queries for dictionaries 2019-10-11 16:21:52 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
alesapin
3dfe961291 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-11 12:14:07 +03:00
Vitaly Baranov
060257c8c5 Remove Authentication::setType() function and fix comments. 2019-10-11 00:48:36 +03:00
Nikolai Kochetov
e48755d045 Merge branch 'master' into processors-and-storages 2019-10-11 00:46:37 +03:00
Nikolai Kochetov
9a89ee8eab
Merge pull request #7264 from ClickHouse/disable-memory-tracker-for-stack-trace
Disable memory tracker for exception stack.
2019-10-11 00:45:36 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
9f6d9d6130 Move the code which checks client host to a separate class. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
Nikolai Kochetov
0ce86e1f8f Disable memory tracker for exception stack. 2019-10-10 21:55:16 +03:00
alexey-milovidov
9c1c596146
Merge pull request #7252 from ClickHouse/fix-bad-code-in-transform-query-for-external-database
Fix bad code in transforming query for external database.
2019-10-10 21:10:36 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Nikolai Kochetov
742b948156 Disable memory tracker for exception stack. 2019-10-10 19:30:33 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247)
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
2019-10-10 17:38:08 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
millb
350f0b8a1c Merge remote-tracking branch 'origin/url_engine_problem' into url_engine_problem 2019-10-10 16:47:17 +03:00
millb
a00089f0b4 Renamed StorageOfAllowedURL -> RemoteHostFilter 2019-10-10 15:58:06 +03:00
Mikhail Korotov
4710d2184c
Update Context.cpp 2019-10-10 01:24:27 +03:00
millb
a97739f67f Created class StorageOfAllowedURL
Created test for table function remote and remoteSecure
Created check allowed url in remote and remoteSecure
Fixed tests
2019-10-09 23:29:41 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser
Dictionaries ddl parser
2019-10-09 12:51:08 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes
Include Field.h and FieldVisitor.h into fewer files.
2019-10-08 22:40:30 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db
Lazy Database
2019-10-08 22:15:55 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alesapin
cd05564b17 Add show create dictionary 2019-10-08 15:34:04 +03:00
Vasily Nemkov
8792738944 Prohibit implicit conversion of UInt64-Field to DateTime64 2019-10-08 10:01:17 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
Alexander Kuzmenkov
56b065881a Include FieldVisitors.h in less files. 2019-10-07 20:23:05 +03:00
Alexander Tokmakov
b4d9dc2a90 query parameters in evaluateConstantExpression 2019-10-07 18:46:50 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now
Fix header for function 'now'
2019-10-05 22:35:23 +03:00
alexey-milovidov
ce12fb6b3c
Update ExpressionAnalyzer.cpp 2019-10-05 22:34:57 +03:00
alexey-milovidov
40b22061f0
Update InterpreterSelectQuery.cpp 2019-10-05 22:34:25 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
alexey-milovidov
9c2f3ba41a
Merge pull request #6984 from achimbab/pr_bf
Made bloom_filter type of index supporting arrays
2019-10-04 18:08:42 +03:00
Vasily Nemkov
1069812d88 Fixed converting DateTime64-Field on client into DataTypeDateTime64-field type.
Since DateTime64 is just a typedef, and there is no explicit Field-type
for it, we have to solely rely on type_hint provided by origin column.
If the hint is missing, there is no way of distinguishing DateTime64
from Decimal64.

Alternative could be having explicit converting code, (and it looks like
it has to be added at some point).
2019-10-04 17:04:17 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions
Merging Values with expressions
2019-10-04 12:51:22 +03:00
alesapin
cf094cd62b
Merge pull request #7155 from ClickHouse/dictionaries_ddl
Preparation of ExternalLoader for Dictionaries DDL
2019-10-03 20:12:19 +03:00
Nikolai Kochetov
76d1412953 Fix actions for distributed. 2019-10-03 18:47:42 +03:00
Nikolai Kochetov
e5c1df010f Remove allow_different_constant_values from InterpreterSelectQuery. 2019-10-03 15:02:30 +03:00
Nikolai Kochetov
3142955e6c InterpreterSelectQuery: reuse actions from getSampleBlock in readImpl. 2019-10-03 14:58:52 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field
Fix some MemorySanitizer warnings for Fields.
2019-10-03 10:33:44 +03:00
Alexander Tokmakov
a58996817f allow query parameters in Values 2019-10-02 22:54:40 +03:00
Alexander Tokmakov
565c273eaa Merge branch 'master' into merging_values_with_expressions 2019-10-02 20:51:44 +03:00
Alexander Kuzmenkov
4af8e76bdd Use proper types for Field.
When a Field is inserted into a column, its type should be the same as
the column data type to avoid implicit reinterpret_cast. Change a
couple of usages where these types were different.
2019-10-02 16:48:26 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
Vasily Nemkov
31d5730513 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-02 13:54:59 +03:00
Vasily Nemkov
6e813002d5 Proper serialization of DateTime64 also updated functions support. 2019-10-02 08:53:38 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
Artem Zuikov
48ab9afce6
Merge pull request #7122 from 4ertus2/mjoin
Squash left-hand blocks in partial merge join (optimization)
2019-10-01 17:23:10 +03:00
chertus
038428bccf do not affect other SquashingBlockInputStream instances 2019-10-01 16:01:08 +03:00
Vasilyev Nikita
5793a02ef9 impr Lazy database 2019-10-01 15:44:17 +03:00
Nikolai Kochetov
9e74b8a6fe Disable check for constants in Converting stream while converting to header. 2019-10-01 13:58:39 +03:00
alesapin
8429f46f3c Return getUpdateTime method to interface 2019-10-01 11:58:47 +03:00
alesapin
709783a1bc Add missed header 2019-09-30 22:42:31 +03:00
alesapin
0e6331e892 Add comments 2019-09-30 19:54:50 +03:00
alesapin
08681ac210 Preparation for AST configurations for external dictionaries 2019-09-30 19:12:08 +03:00
chertus
5df8f870c4 try remove some PVS errors 2019-09-30 18:45:53 +03:00
millb
9246f258e8 Created ability to configure allowed URL in config.xml without tests. 2019-09-30 18:29:05 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
chertus
5212d43ae4 simplify pmj settings 2019-09-30 17:36:45 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alesapin
bc6caba4db Remove redundant argument 2019-09-30 14:18:01 +03:00
alexey-milovidov
24b3145144
Update evaluateConstantExpression.cpp 2019-09-29 01:12:29 +03:00
alexey-milovidov
102b5a7dd4
Merge pull request #7111 from ClickHouse/dictionaries_ddl
Small dictionaries refactoring
2019-09-27 22:05:14 +03:00
root
f54f55bbdc Add const. 2019-09-28 00:38:13 +08:00
root
bc13482eea Add globalIn. 2019-09-27 22:24:48 +08:00
alesapin
9ee031413c Remove a lot of unused code 2019-09-27 15:36:54 +03:00
chertus
baaf0a7c5b partial_merge_join_optimisations -> partial_merge_join_optimizations 2019-09-27 15:25:02 +03:00
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
alesapin
506dbd49cb Add missed row 2019-09-27 12:02:06 +03:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
alesapin
bba3a96ff4 Remove redundant argument 2019-09-26 20:24:55 +03:00
alesapin
0e28dc4e51 Remove redundant classes 2019-09-26 19:12:15 +03:00
Vasily Nemkov
9cc2baf05c DataType64 as decimal
compiles
2019-09-26 18:12:40 +03:00
alesapin
089e3146c9 Add missed files 2019-09-26 14:19:10 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
alesapin
903f826640 Remove runtime factory and remove one redundant object 2019-09-26 13:08:38 +03:00
chertus
dd08f06c81 squash left-hand blocks in partial merge join 2019-09-25 22:17:32 +03:00
alexey-milovidov
64e889d872
Merge pull request #7070 from 4ertus2/mjoin
PartialMergeJoin optimisation (skip not intersected blocks)
2019-09-25 02:24:42 +03:00
chertus
0467229eff fix all left partial merge join on block borders 2019-09-24 21:21:57 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables.
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
chertus
80d902a401 fix case with duplicated right keys 2019-09-24 16:45:59 +03:00
Alexey Milovidov
7384e04430 Revert "CHYT-142: extend KeyCondition interface so that it returns BoolMask."
This reverts commit 2cacc3cfd2.
2019-09-24 04:29:26 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459
Implement cross-compilation support Linux → Darwin
2019-09-24 02:20:17 +03:00
chertus
1f9b8418e0 pmj skip not intersected optimisation 2019-09-23 22:36:47 +03:00
Alexey Milovidov
11e7ea51e9 Fixed compatibility for distributed queries between 19.14 and earlier versions #7068 2019-09-23 22:22:28 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
chertus
016f3b0a45 fix partial merge join with totals 2019-09-23 17:37:42 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
philip.han
613927c36c Removed useless code and improve type checking for bloom_filter index 2019-09-23 12:40:48 +09:00
alexey-milovidov
816ac1ca8d
Merge pull request #7037 from silviucpp/silviu-fix-osx
Fix osx build
2019-09-22 04:53:36 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
alexey-milovidov
f8d19f6bf3
Merge pull request #6968 from azat-archive/create_as_skip_indices
[RFC] Introduce create_as_skip_indices
2019-09-20 23:53:49 +03:00
alexey-milovidov
1dc58dcb15
Update InterpreterCreateQuery.cpp 2019-09-20 23:53:14 +03:00
alexey-milovidov
2432a68009
Merge pull request #7022 from 4ertus2/bugs
Fix "Unknown identifier" in ORDER BY and GROUP BY with Multiple Joins
2019-09-20 23:45:51 +03:00
alexey-milovidov
3f500aad4b
Merge pull request #6976 from sfod/issue-3571
Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without agg…
2019-09-20 23:39:00 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Alexander Tokmakov
d353746f2b minor fixes 2019-09-20 22:44:52 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
alexey-milovidov
123b8cb43c
Merge pull request #6990 from Akazz/timeout_for_sync_replica_cmd
Fixed timeout mechanism for SYNC REPLICA command + simplified related code
2019-09-20 20:32:51 +03:00
alexey-milovidov
aabd6906f2
Merge pull request #6982 from 4ertus2/mjoin
PartialMergeJoin bugfixes
2019-09-20 20:19:00 +03:00
chertus
7726130303 fix multiple joins aliasing for order by and group by 2019-09-20 19:01:19 +03:00
Alexander Kazakov
2d807368e1 Adjusted timings in test + more verbose diagnostics 2019-09-20 00:20:58 +03:00
Azat Khuzhin
b2a3db1048
Ignore indices for CREATE TABLE .. AS .. if storage do not support them 2019-09-19 23:55:38 +03:00
chertus
0bc345fdc0 MergeJoin compare nullables 2019-09-19 20:09:59 +03:00
chertus
da14951ecd implement MergeJoin.joinTotals() 2019-09-19 17:53:03 +03:00
Akazz
4ae3db45c6 Fixed timeout reading in SYNC REPLICA 2019-09-19 14:04:57 +03:00
alexey-milovidov
1fe79ad43c
Merge pull request #6941 from dimarub2000/enums_in_section
IN with Enums numeric values
2019-09-19 02:24:34 +03:00
alexey-milovidov
9c675e50bb
Merge pull request #6963 from nicelulu/issue_6616
optimize limit 1,0 and test.
2019-09-19 02:23:56 +03:00
chertus
b8b6197288 partial_merge_join settings affects LEFT and INNER JOINs only 2019-09-18 22:12:53 +03:00
chertus
08a28d2dc2 fix pm join bug (wrong right equal range copy) 2019-09-18 21:44:44 +03:00
chertus
194e49e751 fix UB in MergeJoinCursor 2019-09-18 19:46:00 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
sfod
0bad4b4a05 Throw exceptions if WITH TOTALS/ROLLUP/CUBE are specified without aggregate functions 2019-09-18 16:08:51 +03:00