Commit Graph

63627 Commits

Author SHA1 Message Date
Amos Bird
012eb56e3b
fix ya make (projection only) 2021-05-11 18:12:28 +08:00
Amos Bird
ef918aeaff
Rebase and fix 2021-05-11 18:12:28 +08:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection
TODO set index analysis in projection
2021-05-11 18:12:27 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order 2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns 2021-05-11 18:12:27 +08:00
Amos Bird
35961c0c5d
Use ActionsDAG to rewrite projection queries 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
bf95b684a7
Remove copy constructor from ProjectionDescription 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks. 2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
233e8bc927
Added test with normal projections. 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
c2396c5144
Disable read-in-order optimization in case of projections. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
95431168c2
Try to enable normal projections. 2021-05-11 18:12:26 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
427f444ba4
Fix prewhere. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3d36fb57eb
Cleanup code. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster. 2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage 2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
2021-05-11 18:12:23 +08:00
vdimir
adb5fe2f30
Finalize CompressedWriteBuffer in TemporaryFileStream 2021-05-11 12:23:35 +03:00
Alexey Milovidov
e85d87feec Remove Russian admin tips as they are not updated 2021-05-11 12:19:55 +03:00
Maksim Kita
fdaffe869d
Merge pull request #24007 from ClickHouse/fix-bad-code-2
Fix bad code
2021-05-11 12:03:53 +03:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again
Add uniqThetaSketch again
2021-05-11 11:24:43 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue
Add _partition_value virtual column
2021-05-11 11:23:00 +03:00
Nikolai Kochetov
4ff612f2c3
Merge pull request #23701 from sevirov/sevirov-DOCSUP-5885-update_the_sql_statement_explain_ast
DOCSUP-5885: Update the SQL-statement EXPLAIN AST
2021-05-11 11:14:51 +03:00
alexey-milovidov
066d02dd2f
Merge pull request #23631 from ClickHouse/normalize-bigint
Make big integers production ready.
2021-05-11 11:07:52 +03:00
Alexander Kuzmenkov
6b6caba9cf
Merge pull request #23726 from ClickHouse/aku/fuzzer-typo
fix a typo in query formatting check in fuzzer
2021-05-11 05:44:49 +03:00
Alexey Milovidov
eb8a4ffe4b Fix bad code 2021-05-11 02:43:58 +03:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
2fcdc85dc7 Fix integration test 2021-05-11 01:54:52 +03:00
alexey-milovidov
6d0bd4f7d2
Merge pull request #23969 from ClickHouse/aku/long-trace-id
support longer query ids in trace log for perf tests
2021-05-10 23:35:40 +03:00
alexey-milovidov
59448eb319
Merge pull request #24004 from kitaisreal/compile-dag-fix-sip-hash
CompileDAG fix Sip hash
2021-05-10 23:33:28 +03:00
Alexey Milovidov
b9b3e4b60a Fix style and wording in #23946 2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00
Maksim Kita
a4d7e190ac CompileDAG fix Sip hash 2021-05-10 22:47:07 +03:00
Alexey Milovidov
94592f0d54 Whitespaces 2021-05-10 21:16:06 +03:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
mergify[bot]
f5e77d7200
Merge branch 'master' into aku/fuzzer-typo 2021-05-10 17:54:19 +00:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp 2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp 2021-05-10 20:20:05 +03:00
Maksim Kita
9d90b586ff
Merge pull request #23990 from kitaisreal/dictionaries-dict-get-or-null-handle-empty-rows-execute
Function dictGetOrNull handle empty rows execute
2021-05-10 20:05:26 +03:00
alexey-milovidov
ab33b80edc
Merge pull request #23962 from azat/external-group-by-overflow-row-fix
Fix SIGSEGV for external GROUP BY and overflow row
2021-05-10 20:02:05 +03:00
michon470
91a9ae22e1
Update docs/en/sql-reference/functions/array-functions.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-05-10 19:13:53 +03:00
michon470
a13a070eee
Update docs/en/sql-reference/functions/array-functions.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-05-10 19:13:31 +03:00
michon470
704adf3b88
Update docs/en/sql-reference/functions/array-functions.md
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-05-10 19:13:16 +03:00
Alexey Milovidov
db4447d819 Fix integration test 2021-05-10 17:45:37 +03:00
Maksim Kita
71b994b417 CompileDAG updated SipHash 2021-05-10 15:56:55 +03:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions 2021-05-10 12:14:08 +03:00
Maksim Kita
e72c139bf6 Fixed code review issues 2021-05-10 11:09:32 +03:00