Commit Graph

679 Commits

Author SHA1 Message Date
alexey-milovidov
7af621f6f7
Merge pull request #3728 from amosbird/join
Versatile StorageJoin
2018-12-10 23:16:53 +03:00
chertus
9236e94e1b ExecuteScalarSubqueriesVisitor via InDepthNodeVisitor 2018-12-10 16:02:45 +03:00
chertus
2afe664d67 RequiredSourceColumnsVisitor via InDepthNodeVisitor 2018-12-07 19:28:20 +03:00
chertus
31c629bf55 GlobalSubqueriesMatcher via InDepthNodeVisitor 2018-12-07 18:36:54 +03:00
chertus
abffefc830 ExternalTablesVisitor via InDepthNodeVisitor 2018-12-07 18:14:50 +03:00
chertus
75af882cf3 fix AST debug print with underline symbol 2018-12-07 15:34:40 +03:00
Amos Bird
65b654a1b6 Versatile StorageJoin
This commit does the following:

1. StorageJoin with simple keys now supports reading
2. StorageJoin can be created with Join settings applied. Syntax is
similar to MergeTree and Kafka
3. Left Any StorageJoin with one simple key can be used as a
dictionary-like structure by function joinGet.

Examples are listed in the related test file.
2018-12-02 16:49:39 +08:00
Alexey Zatelepin
d3d9242462 Merge branch 'master' into alter-order-by
Conflicts:
	dbms/src/Parsers/ASTAlterQuery.h
	dbms/src/Parsers/ParserAlterQuery.cpp
	dbms/src/Storages/AlterCommands.cpp
	dbms/src/Storages/AlterCommands.h
2018-11-26 16:01:48 +03:00
Alexey Milovidov
5a0feee45e Removed "conditional computations" feature, because it is not ready #2272 2018-11-26 04:39:04 +03:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
Alexey Milovidov
6f48ebbb06 Better exception message in case of "unknown identifier" [#CLICKHOUSE-4142] 2018-11-21 23:35:55 +03:00
Alexey Zatelepin
29b34365e6 Merge branch 'master' into alter-order-by
Conflicts:
	dbms/src/Interpreters/ExpressionAnalyzer.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
2018-11-13 16:27:19 +03:00
Alexey Zatelepin
7167bfd7b3 fix prewhere with FINAL for VersionedCollapsingMergeTree [#CLICKHOUSE-3859] 2018-11-13 16:15:12 +03:00
Nikolai Kochetov
28be6d6443 Review fixes. 2018-11-09 20:23:48 +03:00
Nikolai Kochetov
1e9aeba603 Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-09 18:01:18 +03:00
Nikolai Kochetov
726ae0cb9a Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-08 19:47:12 +03:00
Nikolai Kochetov
29fe5ea5b6 Review fixes. 2018-11-08 14:17:31 +03:00
Nikolai Kochetov
90120493bf Syntax analyzer (in progress). 2018-11-08 12:06:11 +03:00
Nikolai Kochetov
a5a36d0078 Syntax analyzer (in progress). 2018-11-08 12:01:41 +03:00
Nikolai Kochetov
6ebfd2c42f Syntax analyzer (in progress). 2018-11-08 12:01:12 +03:00
Nikolai Kochetov
748b0f7077 SyntaxAnalyzer (in progress). 2018-11-07 15:44:05 +03:00
Nikolai Kochetov
bcd6e03257 SyntaxAnalyzer (in progress). 2018-11-06 21:13:35 +03:00
Artem Zuikov
eb535c4b9b
Merge pull request #3500 from 4ertus2/joins
refactoring: one place for db and table extraction from AST
2018-11-01 14:59:56 +03:00
alesapin
63c6647be4 Better comment 2018-11-01 14:23:23 +03:00
alesapin
abcc692dbf CLICKHOUSE-4096: Fix nested unaliased joins segfault 2018-11-01 14:23:23 +03:00
chertus
d8674a264a ExpressionAnalyzer fix columns deduplication 2018-10-31 15:58:12 +03:00
chertus
4ff0391ca6 DatabaseAndTableWithAlias - the only place for db & table expraction from AST 2018-10-30 19:31:21 +03:00
chertus
d2518fdb3f more refactoring: funcs to extract database_and_table from AST 2018-10-29 22:04:28 +03:00
chertus
95c618b163 ExpressionAnalyzer: remove duplicated code 2018-10-26 18:13:02 +03:00
chertus
a62fae8332 Merge branch 'master' into joins 2018-10-22 11:25:43 +03:00
chertus
5aedca40c2 fix asan 2018-10-18 22:27:28 +03:00
chertus
a32e06d298 more ExpressionAnalyzer refactoring [CLICKHOUSE-3996] 2018-10-18 18:03:14 +03:00
chertus
5d3f03a6d2 minor refactoring (function naming) 2018-10-17 14:06:46 +03:00
chertus
40f1805bf4 fix gcc build 2018-10-17 13:59:05 +03:00
chertus
27d66a45c3 extract more visitors from ExpressionAnalyzer [CLICKHOUSE-3996] 2018-10-16 22:00:05 +03:00
chertus
4071155043 better ActionsVisitor extraction [CLICKHOUSE-3996] 2018-10-16 15:34:20 +03:00
chertus
9120d5f38e extract visitor from ExpressionAnalyser [CLICKHOUSE-3996] 2018-10-12 18:41:28 +03:00
chertus
c593d9a971 extract ExecuteScalarSubqueriesVisitor from ExpressionAnalyser [CLICKHOUSE-3996] 2018-10-11 22:28:59 +03:00
Alexey Milovidov
2c0ea27377 Miscellaneous #3145 2018-10-10 23:35:21 +03:00
alexey-milovidov
b9ecc4b819
Merge pull request #3340 from CurtizJ/issue-3253
Fix unnecessarily preparations for join at initial server [ISSUE-3253]
2018-10-10 23:04:13 +03:00
CurtizJ
815380b8b2 fix unnecessarily preparations for join at initial server 2018-10-10 20:07:21 +03:00
chertus
1b7354f809 disable AST logging 2018-10-10 19:23:27 +03:00
chertus
ec8d3b388d move DumpASTNode to own file, style fixes [CLICKHOUSE-4001] 2018-10-09 17:32:11 +03:00
chertus
20b733aaf0 Merge branch 'master' into joins 2018-10-09 13:47:01 +03:00
alexey-milovidov
36c3feea80
Merge pull request #3270 from yandex/left-join-right-keys-fix
Left join right keys fix
2018-10-07 23:26:40 +03:00
Nikolai Kochetov
064facd8de Updated test. 2018-10-05 10:43:58 +03:00
alexey-milovidov
b9d1eb4154
Merge pull request #3298 from yandex/fix-prewhere-with-altered-columns
Fix prewhere with altered columns
2018-10-04 23:57:11 +03:00
Nikolai Kochetov
b1fa3fab9d Fix prewhere whith final. #2827 2018-10-04 21:18:54 +03:00
Nikolai Kochetov
c4c14de02f Join aliases and duplicating columns fixes.
Join aliases and duplicating columns fixes. [#CLICKHOUSE-3994] #3145
2018-10-02 21:17:39 +03:00
chertus
69b9c25801 Merge branch 'master' into joins 2018-09-28 20:09:05 +03:00
chertus
59df909f87 more ast debug info 2018-09-28 18:01:13 +03:00
chertus
b4ea89e1f3 minor fix 2018-09-28 14:46:52 +03:00
chertus
669ab71502 rename files according to class name 2018-09-28 13:52:08 +03:00
Nikolai Kochetov
97add69825 Rename WithDictionary to LowCardinality. 2018-09-28 13:44:59 +03:00
chertus
57d2c9db60 AST debug stuff: DumpASTNode, TranslateQualifiedNamesVisitor, hide AST explain command [CLICKHOUSE-4001] 2018-09-27 22:25:18 +03:00
zhang2014
b887ec8e98 ISSUES-3145 support qualified asterisk 2018-09-25 10:42:51 +08:00
zhang2014
f3dcc2ef41 ISSUES-3145 support qualified asterisk 2018-09-24 23:28:18 +08:00
alexey-milovidov
b1eb66c03e
Merge branch 'master' into low-cardinality-fixes 2018-09-21 13:43:37 +03:00
chertus
6442b5b167 refactoring: hide ASTIdentifier kind 2018-09-20 16:13:33 +03:00
Nikolai Kochetov
d2fbc3df58 Fix in function for low cardinality argument. #3004 2018-09-20 13:55:10 +03:00
alexey-milovidov
92b2cc6625
Merge pull request #3107 from zhang2014/fix/ISSUES-3105
ISSUES-3105 fix some bugs in the predicate optimizer
2018-09-13 22:19:11 +03:00
zhang2014
25f79593a2 ISSUES-3105 fix some bugs in the predicate optimizer 2018-09-13 20:08:27 +08:00
alexey-milovidov
20d5ddd58c
Merge branch 'master' into alter-update 2018-09-10 17:17:10 +03:00
Nikolai Kochetov
1d62c9309c Fix sampling with prewhere. [#CLICKHOUSE-3972] 2018-09-10 13:06:12 +03:00
Alexey Milovidov
c9b612de48 Attempt to fix CLICKHOUSE-3888 bug 2018-09-10 06:59:48 +03:00
Nikolai Kochetov
8311c23d83 Fix test. 2018-09-07 23:23:28 +03:00
Nikolai Kochetov
76f47ed6ba Fix test. 2018-09-07 22:57:26 +03:00
Alexey Zatelepin
133c9c7c37 Merge branch 'master' into alter-update
Conflicts:
	docs/en/query_language/alter.md
2018-09-07 19:11:02 +03:00
Nikolai Kochetov
6e41be3476 Avoid removing columns used in sample expression in prewhere actions. [#CLICKHOUSE-3969] 2018-09-07 19:01:21 +03:00
Nikolai Kochetov
8593145794 Merged with master 2018-09-06 21:30:03 +03:00
Nikolai Kochetov
641771f66f Fix virtual columns for prewhere with aliases. 2018-09-06 20:45:49 +03:00
Alexander Sapin
03174e131d Merge remote-tracking branch 'upstream/master' 2018-09-06 12:39:42 +03:00
Nikolai Kochetov
21081266e8 Fix test. 2018-09-05 16:04:28 +03:00
Nikolai Kochetov
1994fb832b Fix test. 2018-09-05 15:16:37 +03:00
Nikolai Kochetov
3c6db8ebc1 Fix prewhere with aliased columns. [#CLICKHOUSE-3944] 2018-09-04 21:28:01 +03:00
Alexey Zatelepin
4f91833e67 Merge branch 'master' into alter-update
Conflicts:
	dbms/src/Parsers/ASTIdentifier.cpp
2018-09-04 17:39:08 +03:00
Alexey Zatelepin
b6a5bbc4e9 move validation to MutationsInterpreter [#CLICKHOUSE-13] 2018-09-04 17:33:48 +03:00
Alexey Zatelepin
d4d1020798 execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13] 2018-09-03 22:34:49 +03:00
alesapin
11d248ba10 Resolve conflict 2018-09-03 13:11:10 +03:00
Alexey Milovidov
f97d9e8f3f Fixed build #2957 2018-09-02 03:25:33 +03:00
Alexey Milovidov
f7107f12b4 Merge branch 'master' into extra-warnings 2018-09-02 03:13:36 +03:00
alexey-milovidov
64b48b5fcf
Merge pull request #2907 from zhang2014/feature/support_join_for_table_function
ISSUES-2906 support join for table function
2018-09-01 20:49:49 +03:00
alexey-milovidov
889e060993
Merge pull request #3006 from VadimPE/CLICKHOUSE-1660
CLICKHOUSE-1660 Added duplicated columns removal in USING(...)
2018-09-01 20:43:54 +03:00
VadimPE
db8e63ff67 CLICKHOUSE-1660 Added duplicated columns removal in USING(...) 2018-08-31 13:00:46 +03:00
alesapin
711b228a30 Merge remote-tracking branch 'upstream/master' 2018-08-31 10:15:33 +03:00
alexey-milovidov
a05cdfbb45
Merge branch 'master' into extra-warnings 2018-08-31 03:03:44 +03:00
Alexey Milovidov
5df5df8971 utils/check-style/check-style -n 2018-08-31 00:13:34 +03:00
alesapin
6bfde2825e Fix conflict 2018-08-30 22:23:00 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
VadimPE
5551f2902c CLICKHOUSE-1660 2018-08-30 15:32:11 +03:00
alexey-milovidov
b05c62be9f
Merge pull request #2994 from CurtizJ/CLICKHOUSE-3935
ClickHouse-3935  Fix bug with qualified columns in where clause
2018-08-30 15:01:47 +03:00
CurtizJ
764aa70d04 fix bug with quailified columns in where clause 2018-08-30 01:09:04 +03:00
CurtizJ
b43d403815 Revert "fix bug with quailified columns in where clause"
This reverts commit e007fd2b9e.
2018-08-30 01:04:45 +03:00
CurtizJ
e007fd2b9e fix bug with quailified columns in where clause 2018-08-29 22:45:29 +03:00
alexey-milovidov
794b4d30a8
Merge pull request #2989 from yandex/fix-context-lifetime-try-2-quick
Fix lifetime of Context reference in functions (first quick variant) …
2018-08-29 21:32:48 +03:00
Alexey Milovidov
3361247126 Fix lifetime of Context reference in functions (first quick variant) [#CLICKHOUSE-2] 2018-08-29 18:36:24 +03:00
VadimPE
f253719eac CLICKHOUSE-3934 add SettingsJoinStrictness 2018-08-29 18:15:42 +03:00
Alexey Milovidov
697067f207 Fix lifetime of Context reference in functions (first quick variant) [#CLICKHOUSE-2] 2018-08-29 17:59:08 +03:00
VadimPE
d626ae11a7 CLICKHOUSE-3934 2018-08-29 16:54:43 +03:00
Vadim Plakhtinskiy
f0c16900aa CLICKHOUSE-3934 fix bug with CROSS JOIN 2018-08-29 16:51:07 +03:00
Vadim
98abde8480
Update ExpressionAnalyzer.cpp 2018-08-28 17:41:15 +03:00
Vadim
096b5e6a9d
Update ExpressionAnalyzer.cpp 2018-08-28 17:40:07 +03:00
Vadim
564ddbf8d8
Update ExpressionAnalyzer.cpp 2018-08-28 17:33:57 +03:00
VadimPE
398d38eead CLICKHOUSE-3934 add join_default_strictness 2018-08-28 16:57:31 +03:00
Alexey Milovidov
3efffba44e Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 21:05:28 +03:00
Alexey Milovidov
956f76e000 Enabling -Wshadow [#CLICKHOUSE-2] 2018-08-27 20:58:43 +03:00
Alexey Milovidov
eee6644a22 Better exception message in case of wrong number of arguments for function "if" [#CLICKHOUSE-3932] 2018-08-24 12:57:42 +03:00
zhang2014
cdc4c65adc ISSUES-2906 support join for table function 2018-08-24 15:40:09 +08:00
zhang2014
83ceeca199 ISSUES-2906 support join for table function 2018-08-24 14:45:24 +08:00
zhang2014
32cc611f5d ISSUES-863 fix predicate optimizer not work for asterisk 2018-08-24 10:05:43 +08:00
Alexey Milovidov
465ff07398 Merge branch 'master' of github.com:yandex/ClickHouse 2018-08-20 18:50:09 +03:00
Alexey Milovidov
2717185991 Modified names #2015 2018-08-20 18:49:39 +03:00
Nikolai Kochetov
391b4b5927 Merged with master. 2018-08-20 15:25:06 +03:00
Alexey Milovidov
5410f73ba7 Fixed warnings #2015 2018-08-15 00:49:51 +03:00
alexey-milovidov
ce9c6a5ab3
Merge branch 'master' into feature/ISSUES-863 2018-08-15 00:34:23 +03:00
alexey-milovidov
e7b671ec98
Merge branch 'master' into feature/ISSUES-863 2018-08-15 00:10:21 +03:00
zhang2014
62a85536b4 ISSUES-2786 add asterisk_left_columns_only setting 2018-08-13 11:02:50 +08:00
zhang2014
d7cd77640d ISSUES-2786 fix replace asterisk with join query 2018-08-13 11:01:55 +08:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Alexey Milovidov
2016374d20 Merging #2226 2018-08-05 10:05:43 +03:00
Alexey Milovidov
5bce1d78b0 Correct number of columns is returned from an element of UNION ALL inside a subquery if some column was queried more than once #2786 2018-08-05 06:28:31 +03:00
zhang2014
d61c53fc3e ISSUES-863 support predicate push down with subquery 2018-08-01 17:56:02 +08:00
alexey-milovidov
405d7f9232
Merge pull request #2742 from yandex/support-join-on-syntax
Support join on syntax
2018-08-01 00:30:46 +03:00
Nikolai Kochetov
9359ae7650 Fix test. 2018-07-31 20:34:17 +03:00
alexey-milovidov
f6b9c46d24
Update ExpressionAnalyzer.cpp 2018-07-31 06:04:35 +03:00
Nikolai Kochetov
368e7d0b08 Added joined_block_actions to SubqueryForSet for join subquery. [#CLICKHOUSE-3761]
3Added joined_block_actions to join expression action.
2018-07-30 22:41:27 +03:00
Nikolai Kochetov
bc054f2247 Fix tests. [#CLICKHOUSE-3761] 2018-07-30 22:40:43 +03:00
Alexey Milovidov
bbdd780be0 Fixed error when IN is used as an aggregation key [#CLICKHOUSE-3855] 2018-07-27 21:14:58 +03:00
Nikolai Kochetov
7d9ebae2c2 Better comments. 2018-07-27 20:11:56 +03:00
Nikolai Kochetov
b5d6240646 Merged with master 2018-07-27 19:21:43 +03:00
Nikolai Kochetov
5123e0f86f Remove joined table qualifiers from column names. [#CLICKHOUSE-3761] 2018-07-27 19:03:16 +03:00
Nikolai Kochetov
65dcca22a2 Substitute aliases for required columns in ExpressionAnalyzer. [#CLICKHOUSE-3761] 2018-07-27 19:02:56 +03:00
Nikolai Kochetov
11d66d8733 Support expressions for right JOIN keys. [#CLICKHOUSE-3761] 2018-07-27 19:02:42 +03:00
Nikolai Kochetov
98e5821769 Resolve qualified names for JOIN ON expression. [#CLICKHOUSE-3761] 2018-07-27 19:02:23 +03:00
Nikolai Kochetov
cc613d7ad3 Added JOIN keys to the list of needed columns for JOIN expression action. 2018-07-27 19:02:20 +03:00
Nikolai Kochetov
391ff31829 Added actions for JOIN key columns. [#CLICKHOUSE-3761] 2018-07-27 19:02:10 +03:00
Nikolai Kochetov
5058d1a345 Added columns from join on key of right table if they have different name from left block key in merged block. [#CLICKHOUSE-3761] 2018-07-27 19:01:48 +03:00
Nikolai Kochetov
92719e1f48 Supported JOIN ON syntax for single and chain in expression analyzer. [#CLICKHOUSE-3761] 2018-07-27 19:01:25 +03:00
Nikolai Kochetov
fd4d992294 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 19:01:25 +03:00
Nikolai Kochetov
dd4ac9f3f1 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:57:52 +03:00
Nikolai Kochetov
0f4c8e2f0a Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:56:43 +03:00
Nikolai Kochetov
bbd13a25e4 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:54:10 +03:00
Alexey Milovidov
a4d699e7f5 Comment [#CLICKHOUSE-2] 2018-07-20 18:50:39 +03:00
Alexey Milovidov
31dbbb05d2 Removed useless setting #2677 2018-07-19 23:22:49 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. (#2677)
* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]

* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"

This reverts commit 9eafc13f3b.

* Revert "Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]"

This reverts commit e28ad4b5fe.

* Fixed test #2677

* Update InterpreterSelectQuery.cpp
2018-07-19 16:36:21 +03:00
Alexey Milovidov
e6c293ab60 Added setting "use_index_for_in_with_subqueries_max_values" #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
Nikolai Kochetov
bd4a899dd3 Reduced the number of IAST::getColumnName() calls in ExpressionAnalyzer. 2018-06-28 20:25:09 +03:00
Nikolai Kochetov
bd7c72de5c Spelling. 2018-06-25 16:08:35 +03:00