Commit Graph

5567 Commits

Author SHA1 Message Date
Vitaly Baranov
9f5ab54fc2 Rework RowPolicy based on IAccessEntity. 2019-12-19 13:37:02 +03:00
Guillaume Tassery
d5d8fd7004 refactor target_table to table for better hemogny 2019-12-19 10:27:12 +01:00
philip.han
89039abf69 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into bugfix_bloomfilter 2019-12-19 17:18:29 +09:00
Guillaume Tassery
9e808e4a0d Let the command SYSTEM RELOAD DICTIONARY to use ON CLUSTER syntax 2019-12-19 08:54:43 +01:00
Guillaume Tassery
d5b4b40b4e Add parser 2019-12-19 04:46:20 +01:00
Vxider
c61e2aef3f set at least 1 even if settings.max_insert_threads is zero 2019-12-19 11:28:00 +08:00
Vitaly Baranov
41b0ba98dd SYSTEM RELOAD db.dict syntax is now supported. 2019-12-19 03:38:24 +03:00
Vitaly Baranov
68187b5e08 Getting from a dictionary isn't blocked until SYSTEM RELOAD is finished. 2019-12-19 03:22:58 +03:00
Alexey Milovidov
766aced61c Merge branch 'master' of github.com:yandex/ClickHouse into update-llvm-bisect 2019-12-19 00:36:18 +03:00
Amos Bird
630ef97854 Allow table identifier as the first arg to joinGet (#7707) 2019-12-18 23:36:51 +03:00
Alexey Milovidov
b90b090040 Addition to prev. revision 2019-12-18 08:26:17 +03:00
Alexey Milovidov
12f21dd584 Removed useless memset 2019-12-18 08:11:26 +03:00
Alexey Milovidov
0bc4a64b89 Attempt to make it working 2019-12-18 07:21:06 +03:00
alexey-milovidov
fcbd76815c
Merge branch 'master' into update-llvm-bisect 2019-12-18 04:22:10 +03:00
Alexey Milovidov
55dd76cdbf Fixed build 2019-12-18 03:38:20 +03:00
Alexey Milovidov
ffb506b073 Fixed build 2019-12-18 03:37:35 +03:00
Alexey Milovidov
8f67b0bf3d Returned normal LLVM headers in ExpressionJIT 2019-12-18 03:35:54 +03:00
Alexey Milovidov
5e9d7c1b9d Update to llvm-9.0.0 2019-12-18 02:29:48 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alexey-milovidov
b2fcaff0dc
Merge pull request #8252 from 4ertus2/bugs
Fix crash in FULL JOIN with LowCard in key (attempt 2)
2019-12-18 01:58:56 +03:00
Alexey Milovidov
eff1a95016 Update to 4637e15844661778c871b5f9642228e79a87e6e9 2019-12-18 01:09:29 +03:00
Alexey Milovidov
5378b2ade4 Update to 079df9ab2cd137141d5444f994ecc9721a6e2b68 2019-12-18 00:58:32 +03:00
Alexey Milovidov
5945644207 Update to 6cadc7c06ba 2019-12-18 00:51:47 +03:00
Alexey Milovidov
bc827c1649 Removed support for old LLVM 2019-12-18 00:00:01 +03:00
chertus
d7a2f45299 Fix crash in FULL JOIN with LowCard in key (attempt 2) 2019-12-17 18:02:42 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors.
Clearer names for load and reload functions in ExternalLoader.
2019-12-17 13:45:47 +03:00
Alexander Kuzmenkov
94b98e7f29
Set: initialize filter for Null values as well. (#8235)
Found with MemorySanitizer.
2019-12-17 13:20:04 +03:00
Vxider
0490510b0b resolve conflicts 2019-12-17 16:18:17 +08:00
alexey-milovidov
7092520617
Update BloomFilterHash.h 2019-12-17 08:46:46 +03:00
Vxider
49065a6348 use threadPool and code style update 2019-12-17 12:22:58 +08:00
Vxider
2a94832ef6 parallel INSERT in INSERT SELECT query 2019-12-17 12:22:58 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
a2180b0bb3 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-16 23:07:16 +03:00
Alexander Tokmakov
9e566d997e fix insert select from mysql(...) 2019-12-16 17:28:44 +03:00
alexey-milovidov
bf1414cc76
Merge pull request #8225 from ClickHouse/tcmalloc-deprecate
Deprecate tcmalloc
2019-12-16 03:20:56 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
Alexey Milovidov
ebf16a8a17 Deprecated tcmalloc 2019-12-16 01:37:27 +03:00
alexey-milovidov
cd556a35e6
Merge pull request #8210 from 4ertus2/bugs
Fix `There's no column` error for materialized and alias columns
2019-12-14 19:45:07 +03:00
alexey-milovidov
39a8f1e9c7
Merge pull request #8202 from zhang2014/feature/support_drop_mysql_database
ISSUES-6063 support drop mysql database engine
2019-12-14 19:44:17 +03:00
chertus
8c9ca6891f fix 'There's no column' error for materialized and alias columns 2019-12-13 21:46:55 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
philip.han
fe7ae014d8 Fixed bloom_filter bug that counting error for Array(Nullable(String)). 2019-12-13 18:38:03 +09:00
root
63aaf64e93 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into lulu-master1 2019-12-13 16:12:43 +08:00
alexey-milovidov
ad76a1bafb
Merge pull request #8185 from vitlibar/fix-drop-dictionary-if-exists
Fix DROP DICTIONARY IF EXISTS
2019-12-13 02:47:06 +03:00
alexey-milovidov
31e4d40501
Merge pull request #8106 from ClickHouse/function-refactoring
Function refactoring
2019-12-13 02:30:55 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names
Add parts_to_do_names column to system.mutations.
2019-12-13 02:30:03 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool
Fixed metrics in `BackgroundProcessingPool`
2019-12-13 02:26:52 +03:00
Vladimir Chebotarev
8a423a94b6 Fixed a typo. 2019-12-13 01:18:25 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some
Refactoring: extract getTableExpressions() variants into own file
2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL:
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
2019-12-12 21:45:58 +03:00
Vitaly Baranov
f81d9b4e73 Fix DROP DICTIONARY IF EXISTS db.dict - now it doesn't throw exceptions
even if db doesn't exist.
2019-12-12 21:37:44 +03:00
Nikolai Kochetov
d29561984a Fix build. 2019-12-12 19:59:17 +03:00
chertus
77ab1dbccb move one more function 2019-12-12 19:54:04 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00
alexey-milovidov
c47acef529
Merge pull request #8163 from ClickHouse/dictionaries_ddl_on_cluster
Dictionaries ddl on cluster
2019-12-12 18:20:15 +03:00
alesapin
8fb9541958
Merge pull request #7946 from Alex-Burmak/filesystem_abstraction
Filesystem abstraction layer
2019-12-12 18:12:35 +03:00
Nikolai Kochetov
7082f8028b Merged with master. 2019-12-12 18:04:30 +03:00
Nikolai Kochetov
06f2fa8433 Add more comments, rename classes, move functions adaptors to separate file. 2019-12-12 17:56:03 +03:00
Nikolai Kochetov
168a55b617 Fix build. 2019-12-12 17:55:55 +03:00
Nikolai Kochetov
5289b67b70 update LLVMFunction. 2019-12-12 17:55:35 +03:00
Nikolai Kochetov
a9f1a2e382 Fix compile errors. 2019-12-12 17:55:36 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
zhangxiao018
c03f126057 fix trivial count query with ConvertingBlockInputStream. 2019-12-12 18:21:08 +08:00
Nikolai Kochetov
7ad2a6dd0b
Merge pull request #7170 from Enmk/DateTime64
DateTime64 data type
2019-12-12 12:20:22 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Vasily Nemkov
f8fec0402b Merge commit 'e7540dcf686936a490f89d0735f74c2f5f009821' into DateTime64 2019-12-11 17:38:32 +03:00
alesapin
3229261c91 Fix dictionary_source check 2019-12-11 14:09:21 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
07c4fa3cc0 Correct merge of background move pool. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3e3e9ac56f Moved settings for BackgroundProcessingPool to configuration. 2019-12-11 13:24:20 +03:00
alesapin
4385aab4a1 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-11 12:29:55 +03:00
CurtizJ
45a9751c31 refactoring of order by optimization 2019-12-11 04:34:39 +03:00
CurtizJ
9e75892516 refactoring of order by optimization 2019-12-11 02:18:24 +03:00
alesapin
ea8994b9e4 Add restrections for several sources of external dictionaries 2019-12-10 20:27:29 +03:00
Alexander Kuzmenkov
50a8a7197f Prepare for stricter type checking in Field. 2019-12-10 16:40:45 +03:00
Nikolai Kochetov
fd62c09a8b Update FunctionCapture and FunctionExpression. 2019-12-09 17:36:47 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
Nikolai Kochetov
18bfa684a2 Rename IFunction.h to IFunctionImpl.h in functions implementations. 2019-12-09 16:12:54 +03:00
Alexey Milovidov
b5e05d761b Whitespace 2019-12-09 04:15:42 +03:00
Nikolai Kochetov
a73eb4292b Functions refactor part 1. 2019-12-09 00:06:37 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
alesapin
af7b8f9274
Merge pull request #8051 from ClickHouse/fix_collations_behaviour
Fix several bugs with collations.
2019-12-08 11:10:23 +03:00
alesapin
2fffe2802f Review fixes 2019-12-07 16:13:14 +03:00
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
Vxider
47f8d9713a build fix 2019-12-06 23:35:23 +08:00
alesapin
de6cd490ef
Merge pull request #8037 from vitlibar/system-reload-dictionary-causes-complete-reloading
SYSTEM RELOAD DICTIONARY reloads a dictionary completely
2019-12-06 12:55:41 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
38fa1af5ca Disable quota consumptions for the system queries and for selecting
from the `system.quota` and `system.quotas` tables.
2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
c733e5b50b Add functions for writing std::chrono to string. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
9b44848179 SYSTEM RELOAD DICTIONARY now reloads a dictionary with update_field completely. 2019-12-05 19:45:05 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
chertus
852e891499 better comment 2019-12-05 15:01:34 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins
New ANY, SEMI, ANTI JOIN (HashJoin only)
2019-12-05 14:38:20 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
Alexey Milovidov
eef44d3fc5 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 04:31:08 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime
Fix bug with minimal dictionary lifetime equals zero
2019-12-03 02:32:38 +03:00
Alexey Milovidov
034ef665f1 Merge branch 'master' of github.com:yandex/ClickHouse into enable-experimental-indices-and-make-settings-obsolete 2019-12-03 00:36:31 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
chertus
0251f4e442 perf: move applyLazyDefaults() out of cycle for ALL JOIN 2019-12-02 14:45:21 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE
Do not reload *all* dictionaries on CREATE DATABASE
2019-12-02 11:50:44 +03:00
Alexey Milovidov
8916b8f2e6 Make data skipping indices non-experimental. Make settings about data skipping indices, multiple JOINs and CROSS to INNER JOIN conversion obsolete, 2019-11-30 23:41:02 +03:00
Vasily Nemkov
70512f8289 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-30 21:49:15 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns
Fix union with diff columns
2019-11-26 19:40:45 +03:00
Vladimir Chebotarev
e3f299e3c4 Fixed background pool logger name. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Olga Khvostikova
953f3a5ddf
Merge pull request #7897 from ClickHouse/better-exception-messages
Slightly better usability of exception messages
2019-11-26 13:20:56 +03:00
Nikolai Kochetov
f301e60ef5 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:14:56 +03:00
Nikolai Kochetov
a6a0b2dea3 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:01:02 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias
Fix reading empty set with prewhere dependent on alias column.
2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas
Fix prewhere with max_parallel_replicas.
2019-11-26 09:29:49 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
tavplubix
fde727c4eb Update Context.cpp 2019-11-25 14:42:09 +03:00
Pervakov Grigory
9fbc55c61a Change max_table_size_to_drop and max_partition_size_to_drop to atmoic. Update hint in default config. 2019-11-25 14:42:09 +03:00
Alexey Milovidov
2d9d116267 Slightly better exception messages 2019-11-23 03:18:56 +03:00
Nikita Mikhaylov
1d170ed607 use set from storage set for set in index 2019-11-22 18:45:03 +03:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions
Fix Storage lifetime in table functions
2019-11-22 02:29:06 +03:00
Vasily Nemkov
66d64e7100 PR-comment fixes: factored out std::is_same_v to a constexpt variable. 2019-11-21 01:05:09 +03:00
Vasily Nemkov
23e9a582f2 Fixed using DecimalX and DateTime64 with ASOF JOIN
With tests
2019-11-20 12:00:10 +03:00
Denis Zhuravlev
cf0c8392b3
fix error message
on the right , on the left -> on the left on the right #7853
2019-11-19 20:57:06 -04:00
alexey-milovidov
4d4de7da95
Merge pull request #7793 from DeifyTheGod/master
fix zero-access user creation
2019-11-19 20:04:07 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Alexander Tokmakov
8562789059 Revert "add debug assert for Context"
This reverts commit 2f708c72be.
2019-11-19 01:36:03 +03:00
Alexander Tokmakov
a4d557f998 fix Context in interpretSubquery 2019-11-18 19:18:09 +03:00
Alexander Tokmakov
2f708c72be add debug assert for Context 2019-11-18 19:01:36 +03:00
Amos Bird
9af0c00053
Optimize PREWHERE
So that it's never worse than WHERE.
2019-11-18 22:59:03 +08:00
nonexistence
dea19a82f9 change to std::optional 2019-11-18 16:35:31 +03:00
Vitaly Baranov
681f03c625
Merge pull request #7653 from vitlibar/skip-unknown-settings-with-warnings
Skip unknown settings with warnings.
2019-11-18 13:50:52 +03:00
alexey-milovidov
3735a7e210
Merge pull request #7758 from 4ertus2/ast
Check if table has qualified column
2019-11-18 01:37:48 +03:00
alexey-milovidov
4dd66385b5
Merge pull request #7789 from zhang2014/fix/ISSUES-7784
ISSUES-7784 disabled predicate optimize for WITH FILL expression
2019-11-17 23:36:42 +03:00
Alexander Tokmakov
2173bf5f4a Merge branch 'master' into possible_segfaults_in_table_functions 2019-11-17 16:48:13 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict().
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
2019-11-17 03:51:51 +03:00
Alexander Tokmakov
55f60a6bad hold shared pointers to table function Storage and Context from InterpreterSelectQuery 2019-11-15 21:42:32 +03:00
nonexistence
a460001bae fix zero-access user creation 2019-11-15 18:55:08 +03:00
zhang2014
15b20e0b96 ISSUES-7784 disabled predicate optimize for WITH FILL expression 2019-11-15 22:10:36 +08:00
Anton Popov
0318e6d820
Update dbms/src/Interpreters/InterpreterSelectQuery.cpp
Co-Authored-By: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2019-11-15 17:09:34 +03:00
CurtizJ
475356f2b7 more clarifying names to avoid mistakes 2019-11-15 17:03:42 +03:00
chertus
8286bbf913 Merge branch 'master' into joins 2019-11-14 16:16:52 +03:00
chertus
31028b8f3b support nested column names 2019-11-13 19:49:29 +03:00
chertus
d70904d7ee better column to table matching: check if table has qualified column 2019-11-13 18:00:21 +03:00
CurtizJ
f6b601cb9c fix order by with pk optimization 2019-11-13 17:57:45 +03:00
Nikita Mikhaylov
b0e24b6c92 better naming 2019-11-13 16:52:08 +03:00
Nikita Mikhaylov
c8bfa6db59 done 2019-11-13 15:43:55 +03:00
Vasily Nemkov
f8d90af4ce Fixed regression of converting Date to DateTime (and vice versa) Field values on INSERT. 2019-11-13 12:46:53 +03:00
Nikolai Kochetov
28b195a0f1
Merge pull request #7672 from ClickHouse/processors-4-tmp
Processors 4
2019-11-11 21:22:06 +03:00
chertus
8321deefac Merge branch 'master' into joins 2019-11-11 20:54:45 +03:00
alexey-milovidov
44cf1483c8
Merge pull request #7710 from amosbird/batchreduce2
Better addBatchArray aggregator
2019-11-11 20:36:34 +03:00
chertus
b51e6f9fe3 trying to remove perf degradation 2019-11-11 14:42:10 +03:00
alexey-milovidov
e14f395001
Merge pull request #7506 from Enmk/odbc_bridge_nullable_fix
odbc table function now respects external_table_functions_use_nulls
2019-11-11 12:03:09 +03:00
Amos Bird
3707da4fbf
Better addBatchArray aggregator 2019-11-11 16:56:11 +08:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
alexey-milovidov
1d910c5071
Merge pull request #7608 from amosbird/batchreduce
Optimize arrayReduce, -Array and -State combinators
2019-11-10 22:10:03 +03:00
Alexey Milovidov
6a5f042a7f Removed fixed index granularity from system logs 2019-11-10 17:04:29 +03:00
Nikolai Kochetov
cc16ac3c3c Return resize processor before aggregating. 2019-11-09 12:24:55 +03:00
Nikolai Kochetov
f909575196 Try fix test 2019-11-08 20:30:56 +03:00
chertus
6f40bcfcee perf optimisation 2019-11-08 19:13:43 +03:00
Nikolai Kochetov
dd7ed390f6 Merge branch 'master' into processors-4-tmp 2019-11-08 18:53:03 +03:00
Vasily Nemkov
5624bb3abb odbc table function now respects external_table_functions_use_nulls setting
* Passing setting value to ODBC-bridge on each request
 * Handling that setting value correctly in ODBC-bridge
 * Fixed issue with executing table-functions on context with no settings
   applied in `SELECT ... SETTINGS x=foo` query.
 * Added tests to verify fix.
2019-11-08 14:30:11 +03:00
alesapin
40a5cf4bb9 Forbidden to use column name more than once in insert query. 2019-11-08 12:57:32 +03:00
millb
7a2dcf451a Merge branch 'master' into url_engine_problem 2019-11-08 02:19:09 +03:00
alexey-milovidov
7f01fd13b3
Merge pull request #7624 from azat/_shard_num
[RFC] Add _shard_num virtual column for the Distributed engine
2019-11-08 00:55:41 +03:00
alexey-milovidov
a2e79cc427
Merge pull request #7574 from ClickHouse/processors-4
Fix tests for processors
2019-11-08 00:46:30 +03:00
chertus
b8d464aa03 new consistent ANY JOIN (LEFT, INNER, RIGHT) 2019-11-08 00:32:44 +03:00
chertus
2cafe933ea revert some changes 2019-11-07 15:42:39 +03:00
Vasily Nemkov
e6efdf1ce2 Fixed Decimal in operator IN regression (00862_decimal_in) 2019-11-07 15:35:17 +03:00
Nikolai Kochetov
feed418fb3 Disable task pinning and resize. 2019-11-07 14:49:13 +03:00
alesapin
982eae7b30 Remove redundant change 2019-11-07 11:49:09 +03:00
alesapin
18e59f2771 Remove some functions from mutations interpreter 2019-11-07 11:40:36 +03:00
Amos Bird
544af39d23
Vectorize arrayReduce and -Array combinator
Also devirtualize -State combinator.
2019-11-07 11:53:47 +08:00
chertus
252fab54a2 less specializations 2019-11-06 23:25:27 +03:00
chertus
d388918c60 Join.cpp refactoring 2019-11-06 22:40:53 +03:00
Azat Khuzhin
0677ae048c Wrap _shard_num with toUInt32 for simpler JOIN with system.clusters.shard_num 2019-11-06 21:02:42 +03:00
alesapin
8c7deaa70d More safier, but still ugly mutations interpreter 2019-11-06 20:28:03 +03:00
Azat Khuzhin
81aeff2d2a Add _shard_num virtual column for the Distributed engine
With JOIN from system.clusters one can figure out from which server data
came.

TODO:
- optimization to avoid communicating with unrelated shards (for queries
  like "AND _shard_num = n")
- fix aliases (see tests with serverError expected)

v0: AddingConstColumnBlockInputStream
v2: VirtualColumnUtils::rewriteEntityInAst
v3: fix remote(Distributed) by appending _shard_num only if has been requested
2019-11-06 15:26:12 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped
Unify hash tables interface (separated for review)
2019-11-06 13:49:39 +03:00
Nikolai Kochetov
86a9c2b98e Try to fix tests. 2019-11-06 12:45:47 +03:00
alexey-milovidov
78f7826a09
Update InterpreterSelectQuery.cpp 2019-11-06 11:17:26 +03:00
chertus
950e95c178 support JOIN ON expression 2019-11-05 23:22:20 +03:00
Nikolai Kochetov
055f21c9b7 Less wrappers for procesors pipeline. 2019-11-05 20:33:03 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
millb
d62cd6efa8 Merge branch 'master' into url_engine_problem 2019-11-05 14:42:53 +03:00
Vasily Nemkov
c6eb0fcff7 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-04 17:06:22 +03:00
alexey-milovidov
81e33ca817
Merge pull request #7586 from 4ertus2/joins
Rewrite NonJoinedBlockInputStream
2019-11-04 14:49:47 +03:00
alexey-milovidov
782e2f6c13
Merge pull request #7606 from amosbird/nullformat
Better Null format for tcp handler.
2019-11-04 14:27:27 +03:00
Amos Bird
8f902dc2a9
Better null format for tcp handler. 2019-11-04 11:53:26 +08:00
chertus
b7b664845d return right x in RIGHT|FULL JOIN .. USING(x) from NonJoinedBlockInputStream if not qualified 2019-11-03 23:30:49 +03:00
chertus
d4e1468022 fix Join.saved_block_sample columns' nullability 2019-11-03 22:33:59 +03:00
Amos Bird
f0b3c1f7c7
early constant folding improvement 2019-11-03 21:17:46 +08:00
alexey-milovidov
dda93e2275
Merge pull request #7561 from ClickHouse/achimbab-master
Merge for #7363
2019-11-02 00:57:13 +03:00
chertus
334b91f351 revrite NonJoinedBlockInputStream (in progress) 2019-11-01 20:41:07 +03:00
Nikolai Kochetov
239d92a94c Code cleanup. 2019-11-01 18:31:02 +03:00
Nikolai Kochetov
575eabd4ff Add flag to set that set is created. 2019-11-01 16:56:33 +03:00
alexey-milovidov
4081b0be90
Merge pull request #7497 from amosbird/countopt
Early constant folding.
2019-11-01 16:54:02 +03:00
Nikolai Kochetov
1f7a798c97 Add flag to set that set is created. 2019-11-01 13:58:29 +03:00
Nikolai Kochetov
d31cac33b2 Small fixes. 2019-11-01 12:41:20 +03:00
Nikolai Kochetov
5bb47e2484
Merge pull request #7181 from ClickHouse/processors-and-storages
Processors and storages
2019-11-01 12:04:49 +03:00
Nikolai Kochetov
c0fccd5b87 Simplified code. 2019-11-01 11:32:41 +03:00
Nikolai Kochetov
9a5a0a2a3b Fix types for set elements. 2019-10-31 19:14:06 +03:00
Vitaly Baranov
56011d4649
Merge pull request #7553 from vitlibar/add-constraints-columns-to-table-system-settings
Add constraints columns to table system.settings
2019-10-31 19:06:46 +03:00
Amos Bird
e04cdd4ebb
Early constant folding. 2019-10-31 23:54:32 +08:00
Nikolai Kochetov
a80338e066 Merged with master 2019-10-31 14:41:29 +03:00
Vitaly Baranov
272608762e Fix comment. 2019-10-31 11:45:14 +03:00
Vitaly Baranov
5601d6ae66 Add constraints columns to table system.settings 2019-10-31 01:45:57 +03:00
alexey-milovidov
0d2a2c332f
Merge pull request #7366 from achimbab/fixbug_inop
Made IN operator support Array(LowCardinality(Nullable(String)))
2019-10-31 00:26:22 +03:00
alexey-milovidov
883c868b36
Merge pull request #7523 from ClickHouse/fix-thread-context-attach
Disable context replacement for internal queries
2019-10-31 00:07:13 +03:00
Alexey Milovidov
fe73354320 Improvements after #7510 2019-10-30 22:15:55 +03:00
alexey-milovidov
ddb58eeb8b
Merge pull request #7510 from amosbird/smartcount
Instant count() for MergeTree
2019-10-30 20:42:00 +03:00
Artem Zuikov
0f68c5a12a
Merge pull request #7530 from 4ertus2/joins
Fix right table key nullability (join_use_keys = 0)
2019-10-30 13:30:27 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
chertus
deb2406b30 fix JOIN right table keys nullability 2019-10-29 22:39:42 +03:00
chertus
12b57aedf0 remove error prone code 2019-10-29 16:52:05 +03:00
alesapin
cde07dd620 Disable context replacement for internal queries 2019-10-29 13:27:19 +03:00
Amos Bird
2c75a51d4f
Instant count() for MergeTree
Use (Replicated)MergeTree's metadata to do trivial count()
2019-10-29 17:45:47 +08:00
Nikolai Kochetov
43c8d13de6
Merge pull request #7496 from amosbird/fix15
Fix HAVING without GROUP BY
2019-10-28 02:44:24 +03:00
Amos Bird
77bdfb3350
Fix HAVING without GROUP BY 2019-10-27 22:10:54 +08:00
alesapin
04ca163518 Merge branch 'master' into dictionaries_ddl_loader 2019-10-25 10:58:04 +03:00
chertus
f2028e901d review related changes 2019-10-24 16:04:50 +03:00
chertus
12cd21f3c3 Merge branch 'master' into ast 2019-10-24 15:20:09 +03:00
Artem Zuikov
39b64dff87
Merge pull request #7454 from 4ertus2/refactoring
Refactoring: extract non aliases logic out of QueryNormalizer
2019-10-24 14:34:53 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
Vasily Nemkov
d6ff36c760 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-10-24 07:52:50 +03:00
chertus
20093fa065 extract more logic out of QueryNormalizer 2019-10-23 16:59:03 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
alesapin
c3519ff376 Better check of dictionary lifetime for updates 2019-10-23 16:02:40 +03:00
Alexander Kuzmenkov
1a609c27bd
Merge pull request #6243 from ClickHouse/aku/hashtables
Introduce String Hash Map to speed up aggregation over short string keys.
2019-10-23 12:52:50 +03:00
alesapin
6a0246f58e Fix if 2019-10-23 12:40:09 +03:00
alesapin
0abb2e538b Remove strange logic 2019-10-23 12:36:20 +03:00
alesapin
fb349757ba Fix ubsan error 2019-10-23 12:27:34 +03:00
alesapin
dc6090a2ac More readable code in external loader 2019-10-22 16:41:17 +03:00
alesapin
ae42dd1cea Better doLoading locking logic 2019-10-22 15:57:58 +03:00
alesapin
d3461f9d46 TODO comments 2019-10-22 14:03:16 +03:00
alesapin
4c5d150d7a Review fixes 2019-10-22 13:47:43 +03:00
Ivan
7ba4e36e73
Don't push to MVs when inserting into Kafka table (#7265)
* Do not insert values into MV when inserting directly to Kafka
* Add method noPushingToViews() to IStorage interface
  To separate InterpreterInsertQuery and StorageKafka
2019-10-22 13:31:28 +03:00
Nikolai Kochetov
2b334a4adb Review fixes. 2019-10-21 19:26:29 +03:00
chertus
851b00c99f minor visitors improvement 2019-10-21 19:22:54 +03:00
Nikolai Kochetov
2893c35930 Merged with master. 2019-10-21 18:33:44 +03:00
alesapin
ff7850cfbd Remove strange code in favor of less strange code 2019-10-21 17:59:35 +03:00
millb
8b8ca9a141 Support redirect improvement 2019-10-21 17:45:57 +03:00
alesapin
f7043c38bd Less diff 2019-10-21 17:20:42 +03:00
alesapin
fc05110d66 Better naming 2019-10-21 17:07:47 +03:00
alesapin
e4a936cf41 Fix add and reload 2019-10-21 16:54:23 +03:00
Amos Bird
a864447802 Introduce String Hash Map.
It speeds up aggregation over short string keys. Use it as a default
aggregation method for string keys.
2019-10-21 16:27:35 +03:00
chertus
4f0859a5fa Merge branch 'master' into ast 2019-10-21 15:08:05 +03:00
chertus
5ef7376cbf fix distributed join on 2019-10-21 14:22:22 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
f64f6658ce Merge branch 'master' into url_engine_problem 2019-10-21 11:44:31 +03:00
alexey-milovidov
8b8cc67873
Merge pull request #7390 from azat/processlist-log-queue_max_wait_ms
Add a message in case of queue_wait_max_ms wait takes place
2019-10-20 17:55:36 +03:00
Azat Khuzhin
94948c2579 Add a message in case of queue_wait_max_ms wait takes place
Since there no information about this, while this can be interesting,
for example to tune max_concurrent_queries in some cases.
2019-10-18 23:36:12 +03:00
chertus
c5a850240c better ambiguous column detection in multiple join rewriter 2019-10-18 20:09:17 +03:00
chertus
2533652847 columns match priority: table alias > table name> aliased table name 2019-10-18 19:16:57 +03:00
alesapin
cdc195727e Fix some races from lazy load and add ugly interface to loader (need to be refactored) 2019-10-18 19:04:09 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
Alexander Kuzmenkov
3143fa37d7
Merge pull request #7371 from CurtizJ/fix-optimize-read-in-order
Fix optimize_read_in_order with IN and a subquery.
2019-10-18 15:55:53 +03:00
philip.han
5f1b14e313 Remove a dynamically sized array in BloomFilterHash.h 2019-10-18 19:39:10 +09:00
philip.han
1d423fad73 Blocked "nested-array-type" for the bloom_filter 2019-10-18 11:55:01 +09:00
chertus
0f6176cc2d throw on ambiguous qualified column 2019-10-18 00:08:28 +03:00
alesapin
c29b39002d Fix race condition, add test 2019-10-17 20:36:53 +03:00
alesapin
05392fd882 Fix deadlock, add test and refactoring 2019-10-17 20:18:54 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Alexander Kuzmenkov
b62c9e729d
Merge pull request #7215 from ClickHouse/formats_improvements
Miscellaneous formats improvements
2019-10-17 17:37:38 +03:00
CurtizJ
546414c015 fix optimize_read_in_order with in subquery 2019-10-17 16:11:27 +03:00
alesapin
6dfe5c7142 Better introspection 2019-10-17 16:05:12 +03:00
Ivan
e595df05d9
Fix CREATE TABLE AS from table with virtual columns (#7183)
* Disable undefined instrumentation for rdkafka
2019-10-17 14:12:35 +03:00
philip.han
08a348fbd1 Made IN operator support Array(LowCardinality(Nullable(String))) 2019-10-17 19:08:36 +09:00
alesapin
3987a45ea2 Fix build and style 2019-10-17 12:05:48 +03:00
alesapin
a19a699bef Fix confused variables 2019-10-16 20:52:56 +03:00
chertus
483108f46f column to table matching refactoring 2019-10-16 20:33:53 +03:00
alesapin
01e23f0a22 Better load of dictionaries 2019-10-16 20:06:52 +03:00
alesapin
b4e0ded048 Almost working 2019-10-16 17:59:52 +03:00
chertus
e6e88241fc SyntaxAnalyzer refactoring: better getTablesWithColumns() 2019-10-16 17:47:58 +03:00
Alexander Tokmakov
aa9d29d6ae Merge branch 'master' into formats_improvements 2019-10-16 17:15:13 +03:00
Artem Zuikov
b70ca30447
Merge pull request #7335 from 4ertus2/ast
Remove asterisk_left_columns_only setting
2019-10-16 13:57:17 +03:00
Artem Zuikov
3ceeb95145
Merge pull request #7282 from 4ertus2/asof
ASOF JOIN inequalities
2019-10-16 13:46:52 +03:00
philip.han
a2bf848e12 Made bloom_filter type of index supporting LowCardinality and Nullable 2019-10-16 15:22:56 +09:00
alesapin
e690a3ca32 Half working code 2019-10-15 21:04:17 +03:00
chertus
ccc8c1ad2a restore logic for array join (it's probably a hidden error) 2019-10-15 20:39:23 +03:00
Artem Zuikov
cf99f88bc4 PartialMergeJoin flush data on disk (#7186) 2019-10-15 19:31:49 +03:00
chertus
c727777a9c resolve some for review sentences 2019-10-15 18:49:00 +03:00
chertus
9667e54201 remove asterisk_left_columns_only setting 2019-10-15 17:42:57 +03:00
alesapin
3e068b81de Add loading of external dictionaries 2019-10-15 17:09:57 +03:00
Alexander Kuzmenkov
160d8a6416 Ignore non-convertible values at any depth on the right side of IN
operator.

The values that are not convertible to the left argument type can't
match anyway, so it is safe to discard them.
2019-10-14 14:25:03 +03:00
alesapin
ecde224692 More tests 2019-10-14 12:52:43 +03:00
alesapin
155731a676 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-14 11:49:18 +03:00
Nikolai Kochetov
757488369f Merge branch 'master' into processors-3 2019-10-12 19:24:02 +03:00
Nikolai Kochetov
51bce40d5e
Merge pull request #7284 from ClickHouse/fix-7216
Fix for #7216
2019-10-12 19:20:33 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes
Include PODArray.h into fewer files.
2019-10-12 15:08:41 +03:00
Nikolai Kochetov
25510e3d38 Try to fix perftests. 2019-10-12 13:06:07 +03:00
Vasily Nemkov
8648ebf75c Initial implementation of DateTime64 parsing functions; 2019-10-12 10:03:38 +03:00
chertus
91c7ae83a3 asof join inequalities 2019-10-11 20:56:26 +03:00
Nikolai Kochetov
217eab0cfa Fix test. 2019-10-11 20:55:33 +03:00
Nikolai Kochetov
2684bd0d5e Fixes for 7216 2019-10-11 20:27:54 +03:00
alesapin
967fe64793 Add simpliest tests 2019-10-11 18:22:30 +03:00
Vitaly Baranov
8c24d5e66a
Merge pull request #7235 from vitlibar/RBAC-1
RBAC-1
2019-10-11 17:16:32 +03:00
alesapin
ae42dc0d4c Attach detach and introspection queries for dictionaries 2019-10-11 16:21:52 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
alesapin
3dfe961291 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-11 12:14:07 +03:00
Vitaly Baranov
060257c8c5 Remove Authentication::setType() function and fix comments. 2019-10-11 00:48:36 +03:00
Nikolai Kochetov
e48755d045 Merge branch 'master' into processors-and-storages 2019-10-11 00:46:37 +03:00
Nikolai Kochetov
9a89ee8eab
Merge pull request #7264 from ClickHouse/disable-memory-tracker-for-stack-trace
Disable memory tracker for exception stack.
2019-10-11 00:45:36 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
9f6d9d6130 Move the code which checks client host to a separate class. 2019-10-11 00:18:52 +03:00
Vitaly Baranov
12d1d87d64 Move authentication code to a separate class. 2019-10-11 00:18:52 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
Nikolai Kochetov
0ce86e1f8f Disable memory tracker for exception stack. 2019-10-10 21:55:16 +03:00
alexey-milovidov
9c1c596146
Merge pull request #7252 from ClickHouse/fix-bad-code-in-transform-query-for-external-database
Fix bad code in transforming query for external database.
2019-10-10 21:10:36 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Nikolai Kochetov
742b948156 Disable memory tracker for exception stack. 2019-10-10 19:30:33 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247)
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
2019-10-10 17:38:08 +03:00
Nikolai Kochetov
ef14df4632 Added more comments. 2019-10-10 17:16:15 +03:00
millb
350f0b8a1c Merge remote-tracking branch 'origin/url_engine_problem' into url_engine_problem 2019-10-10 16:47:17 +03:00
millb
a00089f0b4 Renamed StorageOfAllowedURL -> RemoteHostFilter 2019-10-10 15:58:06 +03:00
Mikhail Korotov
4710d2184c
Update Context.cpp 2019-10-10 01:24:27 +03:00
millb
a97739f67f Created class StorageOfAllowedURL
Created test for table function remote and remoteSecure
Created check allowed url in remote and remoteSecure
Fixed tests
2019-10-09 23:29:41 +03:00
Alexey Milovidov
b302fec362 Fixed bad code in transformQueryForExternalDatabase 2019-10-09 22:58:50 +03:00
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
alesapin
ef0b2f5936
Merge pull request #7209 from ClickHouse/dictionaries_ddl_parser
Dictionaries ddl parser
2019-10-09 12:51:08 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes
Include Field.h and FieldVisitor.h into fewer files.
2019-10-08 22:40:30 +03:00
alexey-milovidov
b9aa5d812d
Merge pull request #7171 from nikvas0/nikvas0/lazy_db
Lazy Database
2019-10-08 22:15:55 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alesapin
cd05564b17 Add show create dictionary 2019-10-08 15:34:04 +03:00
Vasily Nemkov
8792738944 Prohibit implicit conversion of UInt64-Field to DateTime64 2019-10-08 10:01:17 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
Alexander Kuzmenkov
56b065881a Include FieldVisitors.h in less files. 2019-10-07 20:23:05 +03:00