Anton Popov
99ebabd822
Merge remote-tracking branch 'upstream/master' into HEAD
2021-12-17 19:02:29 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
Anton Popov
ccd78e3838
Merge remote-tracking branch 'upstream/master' into HEAD
2021-11-22 17:19:35 +03:00
Anton Popov
afe8d3c424
refactor merged index conditions
2021-11-21 22:49:34 +03:00
Anton Popov
833652e8f4
Merge branch 'nikvas0/simple_optimizations' of git://github.com/nikvas0/ClickHouse into merging-constraints
2021-11-10 19:35:28 +03:00
Anton Popov
a20922b2d3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-11-09 15:36:25 +03:00
Maksim Kita
7beaeb8b13
Merge branch 'master' into indexcache
2021-10-15 12:59:09 +03:00
Amos Bird
ebfb013ea1
Fix potential leak of query_id_holder
2021-10-11 15:56:00 +08:00
Amos Bird
a2256b1307
Dedicated Mark/Uncompressed cache for skip indices
2021-08-23 15:27:31 +08:00
Anton Popov
61239343e3
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-08-20 16:33:30 +03:00
Amos Bird
ea7dc495cf
Better code.
2021-08-17 12:32:49 +08:00
Amos Bird
90881aab09
Better code style
2021-08-16 22:17:07 +08:00
Amos Bird
b162a2b699
Improve projection analysis.
...
Remove duplicate index analysis and avoid possible invalid limit checks
during projection analysis.
2021-08-16 20:11:57 +08:00
Anton Popov
f99374cca6
Merge remote-tracking branch 'origin/sparse-serialization' into HEAD
2021-07-20 18:20:21 +03:00
Amos Bird
28b567a01b
Update
2021-07-14 23:09:17 +08:00
alexey-milovidov
55fc7323fd
Update MergeTreeDataSelectExecutor.h
2021-07-14 22:56:52 +08:00
Amos Bird
0558ecdc3f
Aggressive IN index analysis for projections.
2021-07-14 22:56:52 +08:00
Anton Popov
6ba41dc265
fix projections with storage snapshot
2021-07-12 16:45:35 +03:00
Anton Popov
3ed7f5a6cc
dynamic subcolumns: add snapshot for storage
2021-07-09 06:15:41 +03:00
Nikolai Kochetov
58fbc544cc
Add more comments.
2021-05-28 20:16:09 +03:00
Nikolai Kochetov
295a302bc8
Remove settings from ReadFromMergeTree.
2021-05-28 17:34:02 +03:00
Nikolai Kochetov
94f1ac5a16
Remove some commented code.
2021-05-28 12:41:07 +03:00
Nikolai Kochetov
1aeb705b20
Fix some tests.
2021-05-27 19:53:58 +03:00
Nikolai Kochetov
cbdf3752ef
Part 3.
2021-05-27 16:40:33 +03:00
Nikolai Kochetov
a51a6ea0b7
Part 2.
2021-05-26 21:14:43 +03:00
Nikolai Kochetov
34eaa48294
Part 1.
2021-05-25 19:34:43 +03:00
Alexey Milovidov
d32819f068
Mark false positives for PVS-Studio
2021-05-24 06:59:12 +03:00
Nikita Vasilev
dd343f087e
fix
2021-05-21 19:23:33 +03:00
alesapin
17f229857c
Merge branch 'master' into nvartolomei-parts-move
2021-05-17 13:52:48 +03:00
Nikita Vasilev
6102ea643a
Merge remote-tracking branch 'upstream/master' into nikvas0/simple_optimizations
2021-05-16 19:51:41 +03:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard
2021-05-11 15:36:40 +03:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection
...
TODO set index analysis in projection
2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules.
2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
Nikita Vasilev
4bf5547350
fix
2021-05-06 11:29:24 +03:00
Nikita Vasilev
564a484642
fix
2021-05-02 22:16:40 +03:00
Nicolae Vartolomei
53d57ffb52
Part movement between shards
...
Integrate query deduplication from #17348
2021-04-27 14:20:12 +01:00
Amos Bird
8a3b5c1fab
Add _partition_value virtual column
2021-04-27 16:15:59 +08:00
Amos Bird
50f2e488bd
Fix invalid virtual column expr
2021-04-21 10:29:03 +08:00
Nikolai Kochetov
f6d86d6032
Merge branch 'master' into add-read-from-mt-step
2021-04-12 15:23:32 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Nikolai Kochetov
7ffbeac9df
Add info about indexes to ReadFromMergeTree step.
2021-04-08 14:48:54 +03:00
Nikolai Kochetov
7c5a9133df
Add index info to ReadFromStorageStep.
2021-04-08 11:19:04 +03:00
Nikolai Kochetov
9f39f5d52d
Add more counters to MergeTreeDataSelectExecutor
2021-04-06 15:39:55 +03:00
Amos Bird
93b661ad5a
partition id pruning
2021-03-04 19:43:03 +08:00
alesapin
c29d7c7f49
Shutup clang tidy
2021-03-02 19:13:36 +03:00
alesapin
9ebf1b4fad
Get rid of separate minmax index fields
2021-03-02 13:33:54 +03:00
Azat Khuzhin
68f23b7087
Improve logging during MergeTree reading
...
- Remove "Not using primary index on part {}" message (too noisy)
- Add number of total marks before filtering by primary key into the
common message
- Make "Index {} has dropped {} / {} granules." not per-part, but
per-query
2021-02-13 18:08:55 +03:00
alesapin
7cbc135e72
More isolated code
2021-02-05 12:54:34 +03:00
