Commit Graph

798 Commits

Author SHA1 Message Date
JackyWoo
46eda82cdc new analyzer: move functions out of any 2023-07-27 17:47:01 +08:00
JackyWoo
95c41f49e0 not change projection columns 2023-07-27 15:41:16 +08:00
JackyWoo
8faecdb7ac support alias for new analyzer
(cherry picked from commit 08409059cc)
2023-07-27 15:41:16 +08:00
JackyWoo
0c11a9b2a2 ignore alias for UniqToCountPass
(cherry picked from commit cd1111b17b)
2023-07-27 15:40:59 +08:00
JackyWoo
fccd6e2abf rewrite uniq to count in new analyzer
(cherry picked from commit 8004f37e97)
2023-07-27 15:40:59 +08:00
Dmitry Novik
9ea479a1a1 Analyzer: Support ARRAY JOIN COLUMNS(...) syntax 2023-07-26 13:37:33 +00:00
Yarik Briukhovetskyi
11016d4c5f
Revert "Rewrite uniq to count" 2023-07-25 16:46:50 +02:00
Nikita Taranov
94fa2f18b1 fix analyzer 2023-07-24 15:16:56 +02:00
Zhiguo Zhou
9ff409f16e Enforce type check for function arguments in preimage optimization
Date/Date32/DateTime/DateTime64 columns are required for arguments
of time converters, such as toYear and toYYYYMM.
2023-07-24 21:00:58 +08:00
Zhiguo Zhou
b88fc4277a Add a pass in Analyzer for time filter optimization with preimage
The preimage has been identified as the general solution to the
optimization of predicates with time converters (#15257). PR #50951
implemented this solution via the AST rewrite.

As a follow-up, this commit extends the optimization to the experi-
mental analyzer by replacing the sub-QueryTree of the time filter
with its preimage-transformed one. The optimization is implemented
as a new pass in the Analyzer.
2023-07-24 13:48:48 +08:00
ltrk2
b8a959da89 Correct a finding from clang-tidy 2023-07-19 10:01:58 -07:00
ltrk2
ba4072f049 Adapt changes around SipHash 2023-07-19 10:01:58 -07:00
ltrk2
51e2c58a53 Implement endianness-independent SipHash and MergeTree checksum serialization 2023-07-19 10:01:55 -07:00
JackyWoo
08409059cc support alias for new analyzer 2023-07-19 18:46:20 +08:00
JackyWoo
71c12bbdc4
Merge branch 'master' into rewrite_uniq_to_count 2023-07-19 15:54:23 +08:00
Dmitry Novik
e8833cffcc Merge remote-tracking branch 'origin/master' into storage-merge-aliases-analyzer 2023-07-17 16:48:07 +00:00
Kruglov Pavel
2793305a71
Merge pull request #51825 from ucasfl/schema
Fix use_structure_from_insertion_table_in_table_functions does not work with materialized and alias columns
2023-07-17 18:25:54 +02:00
JackyWoo
cd1111b17b ignore alias for UniqToCountPass 2023-07-11 10:45:08 +08:00
JackyWoo
8004f37e97 rewrite uniq to count in new analyzer 2023-07-10 17:16:41 +08:00
Alexey Milovidov
f4696d762c Revert "Merge pull request #49419 from ClickHouse/fix-function-parameter-exception"
This reverts commit b921476a3b, reversing
changes made to 7896d30737.
2023-07-08 00:56:42 +02:00
flynn
c178a362c5 Fix for new analyzer 2023-07-06 02:31:08 +00:00
Nikolai Kochetov
22e49748b5 Cleanup. 2023-06-22 14:23:04 +00:00
Dmitry Novik
118b84703b WIP on StorageMerge and distributed JOIN 2023-06-21 01:51:34 +02:00
Yakov Olkhovskiy
8f0aa8781c replace storage in function 'in' subquery 2023-06-19 02:14:44 +00:00
Dmitry Novik
6489922dc1 Fix for column aliases that use other aliases 2023-06-16 18:49:59 +00:00
Yakov Olkhovskiy
3f5682a792 use view_source from context 2023-06-14 21:34:43 +00:00
Dmitry Novik
26c9042ea0 Analyzer: support aliases in StorageMerge 2023-06-12 17:06:52 +00:00
Yakov Olkhovskiy
b680b1ac1e propagate insertion values storage into subquery 2023-06-11 23:58:49 +00:00
Nikolai Kochetov
6ce8329bda Merge branch 'master' into refactor-subqueries-for-in 2023-06-09 20:04:27 +02:00
Nikolai Kochetov
9a4043a4b4 Fixing more tests. 2023-06-09 17:51:59 +00:00
Dmitry Novik
280e80fcd4
Merge branch 'master' into analyzer-distr-query 2023-06-07 00:32:09 +02:00
Dmitry Novik
c8d85a43c7 Fix unit tests 2023-06-05 12:22:32 +00:00
Dmitry Novik
d9a6e36685 Add comments 2023-06-05 11:02:23 +00:00
robot-ch-test-poll4
b1de1d3ada
Merge pull request #50535 from kitaisreal/query-node-small-fix
QueryNode small fix
2023-06-04 02:20:15 +02:00
Maksim Kita
e61131c4bb QueryNode small fix 2023-06-03 21:45:53 +03:00
Nikolai Kochetov
92859ebb3b Fixing more tests. 2023-06-01 21:15:15 +00:00
Dmitry Novik
480db8622d Always add table name while converting ColumnNode to AST 2023-06-01 15:21:55 +00:00
Dmitry Novik
c6dcb69b85 Fix GLOBAL IN 2023-06-01 14:34:30 +00:00
Dmitry Novik
bc7b7f2cd2 Always add source alias in ColumnNode::toASTImpl 2023-06-01 14:34:30 +00:00
Dmitry Novik
d79bd5694a Fix LambdaNode::cloneImpl 2023-06-01 14:34:30 +00:00
Dmitry Novik
a4cb82127d Analyzer: WIP on distributed queries 2023-06-01 14:34:29 +00:00
vdimir
783b54624b
add comment to join_use_nulls in QueryAnalyzer::resolveMatcher 2023-05-30 16:49:10 +00:00
vdimir
d727893693
Handle function nodes in getColumnSideFromJoinTree 2023-05-30 16:40:40 +00:00
vdimir
12141bb6cd
Check can become nullable before applying join_use_nulls 2023-05-30 16:40:39 +00:00
vdimir
40d658e467
Fix join_use_nulls in analyzer 2023-05-30 16:40:36 +00:00
Nikolai Kochetov
b5b261b22c Merge branch 'master' into refactor-subqueries-for-in 2023-05-25 21:22:06 +02:00
Dmitry Novik
fc10ba871f Analyzer: Do not execute table functions multiple times 2023-05-22 16:36:34 +00:00
Nikolai Kochetov
ff6400f91a Merge branch 'master' into refactor-subqueries-for-in 2023-05-22 13:07:51 +02:00
Dmitry Novik
aea71cf1bb
Merge branch 'master' into group-by-constant-fix 2023-05-19 01:29:56 +02:00
Dmitry Novik
2287dd8633
Merge pull request #49800 from ClickHouse/fix-adding-cast
Analyzer: apply _CAST to constants only once
2023-05-16 17:05:02 +02:00
Dmitry Novik
d2e185d86d Analyzer: do not optimize GROUP BY keys with ROLLUP and CUBE 2023-05-12 14:36:54 +00:00
Dmitry Novik
5fdaef851c Handle constants carefully 2023-05-12 14:14:40 +00:00
Dmitry Novik
0c0ea7bfc0 Analyzer: apply _CAST to constants only once 2023-05-11 23:07:48 +00:00
Dmitry Novik
5c34ee3019 Skip unresolved table function arguments 2023-05-09 15:14:49 +00:00
Dmitry Novik
f0bfdb6b02 Refactor Query Tree visitor 2023-05-09 14:22:23 +00:00
Nikolai Kochetov
618486815b Merge branch 'master' into refactor-subqueries-for-in 2023-05-05 20:39:09 +02:00
Antonio Andelic
1dacd5b526 Merge branch 'master' into fix-cnf-new-analyzer 2023-05-05 07:44:22 +00:00
Nikolai Kochetov
f598a39ea2 Refactor PreparedSets [3] 2023-05-04 17:54:08 +00:00
Antonio Andelic
ae62b227f0 More fixes 2023-05-03 08:30:22 +00:00
Dmitry Novik
3d76c92f30 Throw exception for non-parametric functions in new analyzer 2023-05-02 15:40:19 +00:00
Antonio Andelic
13739cd26b Correctly stop CNF convert for too many atomics 2023-05-02 12:29:15 +00:00
Dmitry Novik
604e3f9112 Fix 02540_duplicate_primary_key2 2023-04-26 13:20:25 +00:00
Dmitry Novik
98202d8c5d Fix 02699_polygons_sym_difference_rollup 2023-04-24 18:00:38 +00:00
Alexander Gololobov
ba5ca15c40
Merge pull request #46835 from ClickHouse/reduce_mem_in_mutation_with_subquery
Reduce memory consumption by mutations with big subqueries used with IN
2023-04-17 23:55:08 +02:00
Robert Schulze
8eabc43068
Merge pull request #48591 from ucasfl/show-table
support show table
2023-04-14 18:42:29 +02:00
Alexander Gololobov
05a9d1cbfc Cleanups 2023-04-14 16:12:18 +02:00
Alexander Gololobov
0b9579bfb8 Reworked, testing 2023-04-14 16:12:18 +02:00
Dmitry Novik
5cc9b46f78 Merge remote-tracking branch 'origin/master' into optimize-compilation 2023-04-13 16:04:09 +02:00
flynn
f87782b6b5 support show table 2023-04-10 06:37:47 +00:00
Yakov Olkhovskiy
8a19ac4e73
Merge branch 'master' into imp-use-structure-from-insertion 2023-04-06 00:51:44 -04:00
Yakov Olkhovskiy
e3457da144 for auto check subset of columns support, fix some minor issues 2023-04-03 16:05:21 +00:00
Dmitry Novik
a06e1f4d59 Fix lambda type resolution 2023-04-03 15:46:32 +00:00
Alexey Milovidov
5ebf66819b
Merge pull request #47617 from ClickHouse/cnf-new-analyzer
CNF/Constraint optimizer in new analyzer
2023-04-02 20:09:34 +03:00
Yakov Olkhovskiy
2f280e247a review suggestions 2023-03-31 21:37:18 +00:00
Yakov Olkhovskiy
79a8bf7375
Merge branch 'master' into imp-use-structure-from-insertion 2023-03-30 09:12:10 -04:00
Antonio Andelic
b22d3e9136 Remove wrong assert 2023-03-30 10:21:48 +00:00
Yakov Olkhovskiy
739c20abdd clang issue, test 2023-03-29 14:05:31 +00:00
Antonio Andelic
611e7c6382 Ignore null constants in logical optimizer 2023-03-29 12:37:43 +00:00
Yakov Olkhovskiy
a03bf8568a implement use_structure_from_insertion_table_in_table_functions=auto 2023-03-28 17:03:35 +00:00
Antonio Andelic
1605afe647 Fix test 2023-03-28 08:12:21 +00:00
Antonio Andelic
86b40a1b79 address PR review 2023-03-27 10:03:40 +00:00
Antonio Andelic
e4a78a982f Merge branch 'master' into cnf-new-analyzer 2023-03-27 07:43:21 +00:00
Yakov Olkhovskiy
a4e2d09001 without schema inference from actual data 2023-03-24 21:58:23 +00:00
Yakov Olkhovskiy
1108a299a6
Merge branch 'master' into imp-use-structure-from-insertion 2023-03-24 16:36:12 -04:00
Maksim Kita
5cb2d30563
Merge pull request #47316 from ClickHouse/vdimir/transform_external_query_analyzer
Support transformQueryForExternalDatabase for analyzer
2023-03-24 17:53:00 +01:00
Yakov Olkhovskiy
83ca006fcb same fix for analyzer 2023-03-24 13:16:54 +00:00
Dmitry Novik
3488a4d84b Improve file includes 2023-03-24 03:44:52 +01:00
vdimir
426f4ec233
Better transformQueryForExternalDatabase for analyzer 2023-03-22 16:58:34 +00:00
Maksim Kita
f45dac99c2 Revert "Revert "Analyzer planner fixes before enable by default"" 2023-03-22 17:19:32 +01:00
Maksim Kita
40b077c22b
Merge pull request #47506 from CurtizJ/get-subcolumn
Better support of identifiers from compound expressions in analyzer
2023-03-22 11:19:25 +03:00
vdimir
a5cca40cf0 Pass ConvertToASTOptions by constref 2023-03-22 08:59:04 +01:00
vdimir
ebd71f226c Support SETTINGS argument of table functions 2023-03-22 08:59:04 +01:00
vdimir
023d14a894 Support transformQueryForExternalDatabase for analyzer 2023-03-22 08:59:04 +01:00
Anton Popov
52a394168e fix clang-tidy 2023-03-20 14:33:27 +00:00
Alexey Milovidov
e788bf0712
Merge pull request #47721 from ClickHouse/revert-47622-analyzer-planner-fixes-before-enable-by-default
Revert "Analyzer planner fixes before enable by default"
2023-03-20 03:24:03 +03:00
Robert Schulze
0e01e912fe
Preparation for libcxx(abi), llvm, clang-tidy 16 2023-03-19 17:25:41 +00:00
Alexey Milovidov
ef5e8462da
Revert "Analyzer planner fixes before enable by default" 2023-03-19 19:25:37 +03:00
Maksim Kita
5187138510
Merge pull request #47622 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
Analyzer planner fixes before enable by default
2023-03-18 13:11:40 +03:00
Antonio Andelic
a2c0e2e4e7 Use pointer 2023-03-17 14:55:17 +00:00
Antonio Andelic
7f8622752c Update description 2023-03-17 14:17:16 +00:00
Antonio Andelic
0fb9f9ffe6 Add support for substitute column 2023-03-17 13:38:01 +00:00
Anton Popov
4c9e2aecbd allow to use qualified matcher for Map type 2023-03-16 19:50:15 +00:00
Anton Popov
00aaa29a85 better hint for compound identifiers 2023-03-16 18:00:39 +00:00
Antonio Andelic
65e5bfe820 Use set 2023-03-16 17:19:24 +00:00
Antonio Andelic
985a0285c7 Merge branch 'master' into cnf-new-analyzer 2023-03-16 16:00:51 +00:00
Antonio Andelic
e07a8e1fd2 Some fixes with tests 2023-03-16 15:59:48 +00:00
Antonio Andelic
c7787a6652 Fix column resolution 2023-03-16 14:57:07 +00:00
Antonio Andelic
0f6e4d3934 Start implementing constraint optimizer 2023-03-16 09:30:55 +00:00
Maksim Kita
5329041479
Merge pull request #47539 from ClickHouse/interpolate-const-fix
Support constants in INTERPOLATE clause (new analyzer)
2023-03-15 22:06:49 +03:00
Maksim Kita
6c2084052c Fixed tests 2023-03-15 15:21:49 +01:00
Maksim Kita
c102adb728 Analyzer added PREWHERE support 2023-03-15 15:21:49 +01:00
Antonio Andelic
80d248aa06 Finish first part of CNF 2023-03-14 14:18:29 +00:00
Dmitry Novik
802a3d8ed2 Fix style 2023-03-14 12:46:59 +00:00
Dmitry Novik
ae3d30a736 Merge remote-tracking branch 'origin/master' into fix-grouping-for-grouping-sets 2023-03-14 12:01:51 +00:00
Dmitry Novik
49b0bc21ad Resolve as FunctionGrouping 2023-03-14 03:33:31 +00:00
Dmitry Novik
6f99adcdaa Support constants in INTERPOLATE clause (new analyzer) 2023-03-13 18:41:14 +00:00
Antonio Andelic
aa56dddc56 Add CNF 2023-03-13 08:08:31 +00:00
Anton Popov
6ba79c2737 better support of identifiers from compound expressions 2023-03-12 16:24:50 +00:00
Maksim Kita
d6c7c2193c Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
faaa1d8570 Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
0aaef3b1d0 Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
25088187d4 Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
3d34247998 Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
0358cb36d8 Fixed tests 2023-03-11 11:51:54 +01:00
Maksim Kita
677408e02e Fixed style check 2023-03-11 11:51:54 +01:00
Maksim Kita
a762112e15 Analyzer support distributed JOINS and subqueries in IN functions 2023-03-11 11:51:54 +01:00
Dmitry Novik
2699ef477f Move visitor 2023-03-10 14:36:56 +00:00
Dmitry Novik
1f59536d4a Remove whitespaces 2023-03-10 00:03:48 +00:00
Dmitry Novik
a305c6e7ab Fix distributed GROUPING SETS and GROUPING function 2023-03-09 18:00:23 +00:00
Yakov Olkhovskiy
581f3af921
Merge pull request #47324 from ClickHouse/analyzer-limit-fix
Analyzer - fix combine logic for limit expression and limit setting
2023-03-09 08:56:09 -05:00
Yakov Olkhovskiy
86afb8a72d shortcut for trivial case, fix test, fix comment 2023-03-09 02:24:37 +00:00
Dmitry Novik
e2bb5f12a1 Use correct context 2023-03-08 15:28:23 +00:00
Dmitry Novik
9c617cbf27 Fix GROUPING function initialization for grouping sets 2023-03-08 15:19:57 +00:00
Maksim Kita
fb45fd758d
Merge pull request #47225 from kitaisreal/array-exists-to-has-pass-fix
Fix RewriteArrayExistsToHasPass
2023-03-08 17:44:24 +03:00
Yakov Olkhovskiy
df698355df comment 2023-03-08 14:25:24 +00:00
Maksim Kita
299b1d8fed
Merge pull request #45910 from ClickHouse/analyzer-group-by-use-nulls
Support `group_by_use_nulls` setting in new analyzer
2023-03-08 13:14:10 +03:00
Maksim Kita
b2b8b7f872 Fix RewriteArrayExistsToHasPass 2023-03-08 10:09:55 +01:00
Yakov Olkhovskiy
7966c114bd analyzer - fix combine logic for limit expression and limit setting 2023-03-08 05:40:10 +00:00
Dmitry Novik
13f1e5b022 Merge remote-tracking branch 'origin/master' into analyzer-group-by-use-nulls 2023-03-07 16:16:48 +00:00
Antonio Andelic
ced97cefbb Address review comments 2023-03-07 12:07:22 +00:00
Antonio Andelic
083f8cdd64 Merge branch 'master' into or-equality-chain-to-in 2023-03-07 09:09:09 +00:00
Maksim Kita
3cd88003dd
Merge pull request #47101 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
Analyzer Planner fixes before enable by default
2023-03-02 22:16:39 +03:00
Maksim Kita
d55b800fc6 Fixed code review issues 2023-03-02 13:43:03 +01:00
Robert Schulze
15fec805fb
Merge pull request #46950 from ClickHouse/rs/uninline-likePatternToRegexp
Un-inline likePatternToRegexp()
2023-03-01 21:38:40 +01:00
Maksim Kita
47ece846bc Fixed tests 2023-03-01 18:05:07 +01:00
Maksim Kita
d39be3ac9c Fixed tests 2023-03-01 18:05:07 +01:00
Maksim Kita
14e01566a0 Fixed tests 2023-03-01 18:05:07 +01:00
Maksim Kita
51ee007e01 Fixed tests 2023-03-01 18:05:07 +01:00
Maksim Kita
6209d13ad5 Analyzer support _shardNum column to shardNum() function rewrite 2023-03-01 18:03:42 +01:00
Maksim Kita
40fc36bb6f Fixed tests 2023-03-01 18:03:42 +01:00
Maksim Kita
2672f24ced Analyzer cyclic aliases fix 2023-03-01 18:03:41 +01:00
Maksim Kita
1b946b314e Analyzer convert LIMIT OFFSET expressions 2023-03-01 18:03:41 +01:00
Maksim Kita
0ee0324c2c Analyzer ARRAY JOIN conversion to AST fix 2023-03-01 18:03:41 +01:00
Yakov Olkhovskiy
e800557743
Merge pull request #46705 from canhld94/ch_fix_aggregate_arithmetic
Fix arithmetic operations in aggregate optimization
2023-03-01 00:49:34 -05:00
Dmitry Novik
54680b1a0a Merge remote-tracking branch 'origin/master' into analyzer-group-by-use-nulls 2023-03-01 01:08:17 +00:00
Dmitry Novik
d953baa7e3 Review improvements + fixup 2023-02-28 16:12:51 +00:00
Maksim Kita
0764649c5d
Merge pull request #46632 from ClickHouse/analyzer-limit-settings-2
Analyzer - apply limit and offset settings - second attempt
2023-02-27 21:39:34 +03:00
Robert Schulze
35f4b42608
Move likePatternToRegexp from Functions/ to Common/ 2023-02-27 16:41:15 +00:00
Duc Canh Le
eba00f5094
Merge branch 'master' into ch_fix_aggregate_arithmetic 2023-02-27 09:44:40 +08:00
Maksim Kita
b8b399db4c
Merge pull request #46408 from ClickHouse/vdimir/cross_to_inner_analyzer_0
Add CrossToInnerJoinPass
2023-02-24 21:21:50 +03:00
Vladimir C
264b894b16
Remove unneeded recursion CrossToInnerJoinPass/findInTableExpression 2023-02-24 12:03:31 +01:00
Antonio Andelic
8227a6e7bf Fix tests 2023-02-24 09:12:08 +00:00
Antonio Andelic
e37a3801ca Add new logical optimizations 2023-02-23 16:04:51 +00:00
vdimir
b94b446592
Style CrossToInnerJoinVisitor 2023-02-23 14:05:58 +00:00
Antonio Andelic
f49a67752e Support constant on LHS 2023-02-23 13:28:36 +00:00
vdimir
bea8525234
Get rid of where_stack in CrossToInnerJoinVisitor 2023-02-23 13:20:51 +00:00
Antonio Andelic
cf48a0748f Merge branch 'master' into or-equality-chain-to-in 2023-02-23 11:49:22 +00:00
Yakov Olkhovskiy
99095446af review suggestions 2023-02-22 17:22:13 +00:00
Maksim Kita
40d2798cb4 Analyzer AutoFinalOnQueryPass fix 2023-02-22 15:51:13 +01:00
vdimir
d4bb84e68b
make clang-tidy happy about CrossToInnerJoinPass 2023-02-22 09:56:10 +00:00
Duc Canh Le
4c489288d8
Merge branch 'master' into ch_fix_aggregate_arithmetic 2023-02-22 10:35:23 +08:00
ducle.canh
f93b95c6ab fix aggre arithmetic operations in aggregate optimization 2023-02-22 10:32:47 +08:00
Yakov Olkhovskiy
cf493d1dfb replace settings limit and offset with corresponding expression nodes 2023-02-21 22:36:02 +00:00
vdimir
ba04a3cc1f
Fixes for CrossToInnerPass 2023-02-21 17:26:26 +00:00
vdimir
07158e6253
Add CrossToInnerJoinPass 2023-02-21 17:26:19 +00:00
Antonio Andelic
bdad6a480e Add tests 2023-02-21 12:56:09 +00:00
Antonio Andelic
bf02029810 Add pass for transforming or equality chain to single IN 2023-02-21 12:19:58 +00:00
Yakov Olkhovskiy
ce2b044532 analyzer - apply limit and offset settings 2023-02-21 03:29:14 +00:00
Arthur Passos
3d9b23e5f3
Merge branch 'master' into add_select_final_mt_setting 2023-02-19 15:01:41 -03:00
Maksim Kita
6dffe52e68
Merge pull request #46471 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
Analyzer planner fixes before enable by default
2023-02-19 13:49:18 +03:00
Maksim Kita
7cc10008e3 Fixed build 2023-02-18 20:34:12 +01:00
Maksim Kita
cbd961de98 Fixed code review issues 2023-02-18 17:06:00 +01:00
Maksim Kita
05baf271f0 Analyzer fix table functions with invalid arguments analysis 2023-02-16 12:17:04 +01:00
Maksim Kita
6b2adc1ec2 Analyzer storage Merge fixes 2023-02-16 12:17:03 +01:00
Maksim Kita
b1ab2af7ad Analyzer support storage Merge 2023-02-16 12:17:03 +01:00
Maksim Kita
469ad2c51b Fixed build 2023-02-16 12:17:03 +01:00
Maksim Kita
80af0666ea Analyzer support Materialized View 2023-02-16 12:17:03 +01:00
Maksim Kita
be9406ec0e Fixed tests 2023-02-16 12:17:03 +01:00
Maksim Kita
b2cc71f413 Fixed tests 2023-02-16 12:17:03 +01:00
Maksim Kita
c29f3c0f99 Analyzer fix GROUP BY columns validation 2023-02-16 12:17:03 +01:00
Maksim Kita
84065fb13f Analyzer added distributed table functions support 2023-02-16 12:17:03 +01:00
Maksim Kita
9b7cd64093 Analyzer join_use_nulls fix 2023-02-16 12:17:03 +01:00
Maksim Kita
c0e513efeb Fixed style check 2023-02-16 12:17:03 +01:00
Maksim Kita
3a624e6bef Analyzer ColumnNode AST conversion fix 2023-02-16 12:17:03 +01:00
Maksim Kita
f21486c95b Analyzer validate that there are no window functions in GROUP BY 2023-02-16 12:17:03 +01:00
Maksim Kita
af38660cf5 Analyzer support ARRAY JOIN with Nested 2023-02-16 12:17:03 +01:00
Maksim Kita
f73c49b082 Fixed style check 2023-02-16 12:17:03 +01:00
Maksim Kita
5cc56eb108 Analyzer better support for single_join_prefer_left_table setting 2023-02-16 12:17:03 +01:00
Maksim Kita
7e58e23d3a Analyzer subquery resolve fix 2023-02-16 12:17:03 +01:00
Maksim Kita
70eb41c6a8 Analyzer add single_join_prefer_left_table setting 2023-02-16 12:17:03 +01:00
Maksim Kita
caaff8f387 GroupingFunctionsResolvePass crash fix 2023-02-16 12:17:03 +01:00
Maksim Kita
387f035560 QueryTreePassManager add ComparisonTupleEliminationPass 2023-02-16 12:17:03 +01:00
Maksim Kita
a12aea45f6 Analyzer matcher resolve fix 2023-02-16 12:17:02 +01:00
Maksim Kita
8497eba49f Fixed tests 2023-02-16 12:17:02 +01:00
Maksim Kita
cd3e8482ae Analyzer TableFunctionExplain fix 2023-02-16 12:17:02 +01:00
Maksim Kita
2830877e22 Analyzer support table functions 2023-02-16 12:17:02 +01:00
Maksim Kita
8374133123 Analyzer evaluate scalar subquery fix 2023-02-16 12:17:02 +01:00
Maksim Kita
484fc40e64 Analyzer identifier resolution for subcolumns fix 2023-02-16 12:17:02 +01:00
Maksim Kita
d3b604de5a FunctionToSubcolumnsPass mapContains map argument result type fix 2023-02-16 12:17:02 +01:00
Maksim Kita
5b7fb9c458 Analyzer support enable_global_with_statement setting 2023-02-16 12:17:02 +01:00
Maksim Kita
d703c65dbd Analyzer lambda resolve unknown identifier crash fix 2023-02-16 12:17:02 +01:00
Maksim Kita
480619af63 Analyzer ARRAY JOIN disable alias validation for subquery or table function 2023-02-16 12:17:02 +01:00
Maksim Kita
b9cb067153 Analyzer table function arguments resolution fix 2023-02-16 12:17:02 +01:00
Maksim Kita
86ee97aed5 AggregateFunctionsArithmeticOperationsPass disable optimization if both arguments are non constant 2023-02-16 12:17:02 +01:00
Maksim Kita
301d9e22c2 Analyzer change countDistinct function implementation using count_distinct_implementation setting 2023-02-16 12:17:02 +01:00
Maksim Kita
75cbb0e0d0 Analyzer scalar subqueries execution fix 2023-02-16 12:17:02 +01:00
Maksim Kita
fa0ef340b6 Analyzer IN function invalid arguments size error fix 2023-02-16 12:17:02 +01:00
Maksim Kita
45f45b290c Analyzer recursive SQL user defined functions fix 2023-02-16 12:17:02 +01:00
Maksim Kita
9b7710ba40 Analyzer count function handling with unqualified matcher fix 2023-02-16 12:17:02 +01:00
Maksim Kita
c7c5e29ff7 Analyzer resolve identifier as table expression crash fix 2023-02-16 12:17:02 +01:00
Maksim Kita
7ffee1dafe QueryTreePassManager disable validation for aggregate functions with LowCardinality arguments 2023-02-16 12:17:02 +01:00
Maksim Kita
945ce7ca63 Planner support indexHint function 2023-02-16 12:17:02 +01:00
Maksim Kita
2aef331846 Analyzer JOIN disable USING for non identifier nodes 2023-02-16 12:17:02 +01:00
Maksim Kita
03f14f7c50 Analyzer fix MutationsInterpreter 2023-02-16 12:17:02 +01:00
Maksim Kita
77fee97705 MergeTreeIndexFullText fix prepared set index analysis 2023-02-16 12:17:02 +01:00
Dmitry Novik
0e5975c50d
Merge branch 'master' into analyzer-group-by-use-nulls 2023-02-15 17:01:30 +01:00
Alexey Milovidov
77f60311da
Merge branch 'master' into add_select_final_mt_setting 2023-02-15 15:35:37 +03:00
Nikolay Degterinsky
eb3a7f55b9 Fix parameterized queries with REPLACE transformer 2023-02-14 22:02:54 +00:00
Dmitry Novik
1fce8e4eed Fix alias resolve with group_by_use_nulls 2023-02-13 18:35:34 +00:00
taiyang-li
14dd696e95 fix build error 2023-02-09 21:47:05 +08:00
taiyang-li
19ca0ec4af add passes for rewriting arrayexists 2023-02-09 16:30:53 +08:00
Vladimir C
247d6c1edd
Merge pull request #44730 from bigo-sg/optimize_aggregate_function_withif 2023-02-08 15:26:47 +01:00
Anton Popov
f0b0eacbad
Merge pull request #45992 from CurtizJ/fix-type-object-analyzer
Fix basic functionality with type `Object` and new analyzer
2023-02-08 14:25:17 +01:00
Kruglov Pavel
8bdb1c3453
Merge pull request #44728 from bigo-sg/improve_count_if
Improve count if rewrite
2023-02-08 12:21:29 +01:00
Anton Popov
a394f9c92a check is storage supports subcolumns 2023-02-03 17:05:57 +00:00
Anton Popov
08b618205d fix basic functionality with type Object and new analyzer 2023-02-03 01:52:07 +00:00
Arthur Passos
75e3faed85 remove unnecessary comment 2023-02-02 17:32:07 -03:00
Arthur Passos
2de89f62e2 make function static 2023-02-02 17:30:09 -03:00
Arthur Passos
74298f111e Implement AutoFinalQueryOnPass to enable it on Analyzer as well 2023-02-02 17:25:04 -03:00
Dmitry Novik
d589864828 Cleanup code 2023-02-01 18:12:13 +00:00
Dmitry Novik
eee7df8149 WIP on group_by_use_nulls 2023-02-01 13:33:32 +00:00
taofengliu
95ebfbe0c7 bug fix 2023-01-31 18:34:17 +08:00
taiyang-li
a728dd71ac update comments 2023-01-30 15:10:43 +08:00
taiyang-li
29e01c3792 fix bug 2023-01-30 15:06:01 +08:00
taiyang-li
7f30f91f0b fix bug 2023-01-30 14:32:23 +08:00
taiyang-li
6810107105 fix style 2023-01-30 10:03:29 +08:00
taiyang-li
aa3d67e2d6 fix bugs 2023-01-29 20:48:46 +08:00
taiyang-li
fa6dea8b6b remove useless code 2023-01-29 19:50:30 +08:00
taiyang-li
eeef2dae77 fix cores 2023-01-29 19:48:46 +08:00
taiyang-li
952058e69e fix core 2023-01-29 15:42:42 +08:00
taiyang-li
7f3114d806 merge master and solve conflicts 2023-01-29 09:59:16 +08:00
Alexander Tokmakov
c366806c3e
Merge pull request #45527 from ClickHouse/exception_message_patterns4
Better formatting for exception messages 2
2023-01-27 15:31:52 +03:00
Alexander Tokmakov
067b1f5f13 Merge branch 'master' into exception_message_patterns4 2023-01-26 15:20:58 +01:00
Maksim Kita
a19346b59a OptimizeGroupByFunctionKeysPass style fixes 2023-01-26 12:48:12 +01:00
Maksim Kita
32129ca7dc Fixed build 2023-01-26 12:47:50 +01:00
Maksim Kita
6d3a5241e8 QueryTreePassManager refactor passes to use QueryNode, UnionNode scope context 2023-01-26 12:47:50 +01:00
Maksim Kita
8e6593f367 Fixed code review issues 2023-01-26 12:46:58 +01:00
Maksim Kita
b538fae749 Analyzer SETTINGS push down 2023-01-26 12:46:58 +01:00
Maksim Kita
7a8a8dcd2f
Merge pull request #45415 from ClickHouse/redundant-group-by-keys
Remove redundant group by keys with constants
2023-01-26 14:45:25 +03:00
Alexander Tokmakov
3744fa2c63 format more messages 2023-01-25 21:16:42 +01:00
Dmitry Novik
f71c213aff
Merge branch 'master' into column-source-check 2023-01-25 12:53:36 +01:00
Alexander Tokmakov
bb4c8e169f check number of parameters in format string 2023-01-23 23:16:16 +01:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages (#45449)
* save format string for NetException

* format exceptions

* format exceptions 2

* format exceptions 3

* format exceptions 4

* format exceptions 5

* format exceptions 6

* fix

* format exceptions 7

* format exceptions 8

* Update MergeTreeIndexGin.cpp

* Update AggregateFunctionMap.cpp

* Update AggregateFunctionMap.cpp

* fix
2023-01-24 00:13:58 +03:00
Dmitry Novik
796b362e2d Make ColumnNode::isEqualImpl more strict 2023-01-23 17:33:57 +00:00
Maksim Kita
e6ee5554d1 Fixed tests 2023-01-20 11:15:13 +01:00
Maksim Kita
3363f7c718 Added GroupingFunctionsResolvePass 2023-01-19 19:06:02 +01:00
Dmitry Novik
fff9fd4f00 Remove redundant group by keys with constants 2023-01-18 17:44:06 +00:00
Dmitry Novik
11701d0ff5 Resolve OR function after modification 2023-01-18 17:17:16 +00:00
Dmitry Novik
df26f4fc37
Revert "Revert "Support optimize_or_like_chain in QueryTreePassManager"" 2023-01-18 18:14:03 +01:00
Anton Popov
5df0f91857
Revert "Support optimize_or_like_chain in QueryTreePassManager" 2023-01-18 17:34:19 +01:00
Maksim Kita
cabcc761ed
Merge pull request #45357 from kitaisreal/analyzer-compound-identifier-typo-correction-fix
Analyzer compound identifier typo correction fix
2023-01-18 17:59:32 +03:00
Maksim Kita
3a550691c9
Merge pull request #42797 from ClickHouse/or-like-chain
Support optimize_or_like_chain in QueryTreePassManager
2023-01-18 13:09:33 +03:00
Maksim Kita
21b94813ad Fixed code review issues 2023-01-18 11:02:29 +01:00
Dmitry Novik
3b0ac7272c Update reference files 2023-01-18 00:30:30 +00:00
Dmitry Novik
752aed696a Merge remote-tracking branch 'origin/master' into group-by-function-elimination 2023-01-17 23:33:33 +00:00
Maksim Kita
4f7f2ed9e1
Merge pull request #45300 from ClickHouse/revert-45299-revert-44882-function-node-validation
Revert "Revert "Validate function arguments in query tree""
2023-01-17 21:51:26 +03:00
Maksim Kita
d758d83937 Analyzer compound identifier typo correction fix 2023-01-17 14:29:48 +01:00
Maksim Kita
d6a36b1d16 Fixed code review issues 2023-01-17 12:02:50 +01:00
Maksim Kita
af716ca25d Fixed tests 2023-01-17 11:20:24 +01:00
Maksim Kita
250c93614c Revert "Revert "Validate function arguments in query tree"" 2023-01-17 11:20:24 +01:00
SmitaRKulkarni
bb4f251448
Merge branch 'master' into 42648_Support_scalar_subqueries_cache 2023-01-17 08:10:25 +01:00
Dmitry Novik
104e55bc22 Merge remote-tracking branch 'origin/master' into or-like-chain 2023-01-16 18:56:22 +00:00
Dmitry Novik
aa2a19eaa4 Use proper map for QueryTreeNode 2023-01-16 18:43:22 +00:00
Dmitry Novik
0aecc9ad80 Updates after the review 2023-01-16 17:43:36 +00:00
Maksim Kita
cd2d794c99
Merge branch 'master' into 42648_Support_scalar_subqueries_cache 2023-01-16 13:49:43 +03:00
Maksim Kita
8f5250e000
Revert "Validate function arguments in query tree" 2023-01-16 10:14:34 +01:00
Maksim Kita
60d2a0bf7f
Merge pull request #44882 from ClickHouse/function-node-validation
Validate function arguments in query tree
2023-01-16 11:31:02 +03:00
Dmitry Novik
3d23654720 Skip validation of function IN 2023-01-13 23:10:16 +00:00
Nikolay Degterinsky
36c20bf293 Merge remote-tracking branch 'upstream/master' into better_asterisk_parser 2023-01-13 19:15:55 +00:00
Smita Kulkarni
d132d30707 Addressed review comments - 42648 Support scalar subqueries cache 2023-01-13 17:28:35 +01:00
Maksim Kita
dc24d831cf
Merge pull request #42970 from ClickHouse/optimize-redundant-function
Implement optimize_redundant_functions_in_order_by on top of QueryTree.
2023-01-13 17:36:56 +03:00
Maksim Kita
05b1b78104
Merge pull request #44013 from kitaisreal/analyzer-aggregate-functions-passes-small-fixes
Analyzer aggregate functions passes small fixes
2023-01-13 17:31:53 +03:00
Maksim Kita
296dc5006d Fixed tests 2023-01-13 10:59:26 +01:00
Maksim Kita
47f4159909 Analyzer support distributed queries processing 2023-01-12 12:07:58 +01:00
Maksim Kita
2f0eabab54 Fixed tests 2023-01-12 11:30:55 +01:00
Dmitry Novik
5fb1f9db19 Reformat code 2023-01-12 00:29:56 +00:00
Dmitry Novik
5b43202015 Merge remote-tracking branch 'origin/master' into group-by-function-elimination 2023-01-12 00:00:49 +00:00
Dmitry Novik
ba3b828ae7 Fix style 2023-01-11 21:07:26 +00:00
Dmitry Novik
98427319e0 Fix style check 2023-01-11 19:54:12 +00:00
Dmitry Novik
7112d4ec83 Improve exception message 2023-01-11 19:21:07 +00:00