Nikolai Kochetov
ad8a344b46
Move TTL streams and algo
2021-10-15 13:11:57 +03:00
Nikolai Kochetov
2957971ee3
Remove some last streams.
2021-10-13 21:22:02 +03:00
Nikolai Kochetov
340b53ef85
Remove some more streams.
2021-10-08 17:03:54 +03:00
Alexander Tokmakov
4119848a41
better diagnostic for OPTIMIZE
2021-10-07 13:08:10 +03:00
Nikita Mikhaylov
9756b8dc33
Added an ability to execute more merges and mutations than threads, added new settings ( #29140 )
2021-10-01 00:26:24 +03:00
Amos Bird
23d3d894e6
Fix projection merges and mutations.
2021-09-24 22:45:50 +08:00
Nikita Mikhaylov
c52b8ec083
Introduced MergeTask and MutateTask ( #25165 )
...
Introduced MergeTask and MutateTask
2021-09-17 00:19:58 +03:00
alesapin
dd7493d871
Merge pull request #27038 from excitoon-favorites/altermaterializecolumn
...
`ALTER TABLE ... MATERIALIZE COLUMN`
2021-09-03 15:50:52 +03:00
Nikolai Kochetov
5f0b1bc4e3
Merge pull request #26286 from amosbird/projection-improve2
...
Virtual projection for min max indices.
2021-09-02 13:03:30 +03:00
Vladimir Chebotarev
ce0850007f
1. Draw some circles.
2021-08-30 11:49:26 +03:00
Amos Bird
9e7ae5dd6d
Use real tmp file instead of predefined one
2021-08-29 16:54:15 +08:00
Amos Bird
b68857d086
Simplify projection, add minmax_count projection.
2021-08-28 11:25:37 +08:00
Amos Bird
0169fce78e
Projection bug fixes and refactoring.
2021-08-26 19:09:31 +08:00
Maksim Kita
2403686bb9
Merge pull request #28135 from amosbird/projection-improve3
...
Get rid of useless projection columns during merge
2021-08-25 22:14:38 +03:00
Amos Bird
a6b2a6ee36
Get rid of useless projection columns during merge
2021-08-25 20:54:27 +08:00
lthaooo
314ba1e682
Merge branch 'master' into materialize_ttl_recalculate_only
2021-08-25 10:56:24 +08:00
mergify[bot]
ae22bab2c4
Merge branch 'master' into materialize_ttl_recalculate_only
2021-08-24 08:49:19 +00:00
Vitaly Baranov
ff1fad8521
Use setSetting() with implicit conversion true/false -> Field.
2021-08-23 08:57:00 +03:00
mergify[bot]
68a52fc065
Merge branch 'master' into projection-fix12
2021-08-11 17:08:04 +00:00
Amos Bird
e63c26edb7
Fix projection materialization with missing columns
2021-08-10 21:47:27 +08:00
Azat Khuzhin
038241b6ed
Add new index data skipping minmax index format for proper Nullable support
...
Note, that it cannot be done w/o new extension, since index does not
have any header.
v2: use IDisk interface for existence check
v3: remove extra file existence check
v4: fix MATERIALIZE INDEX
2021-08-08 19:30:12 +03:00
terrylin
dd539f0a0d
improvement of materilize ttl
2021-08-05 15:33:02 +08:00
terrylin
6f42ec6b9b
fix compile error
2021-08-05 00:16:21 +08:00
terrylin
88b9e7f24f
materialize ttl recalculate only optional
2021-08-04 22:16:13 +08:00
terrylin
c49c2e5e18
fix compile error
2021-07-30 17:15:04 +08:00
terrylin
55f3e7e65a
improvement of materilize ttl
2021-07-30 12:27:15 +08:00
Anton Popov
19d0f1bbfc
Merge remote-tracking branch 'upstream/master' into HEAD
2021-07-13 16:12:08 +03:00
Alexey Milovidov
81646f8389
Merge branch 'master' into ditch-aio
2021-07-11 03:06:45 +03:00
alesapin
4c85dae572
Merge pull request #25743 from ClickHouse/fix_aggregation_ttl
...
Fix bug in execution of TTL GROUP BY
2021-07-07 10:49:16 +03:00
Alexey Milovidov
21fb6ddea5
Remove AIO for sequential reads
2021-07-05 23:02:24 +03:00
mergify[bot]
9da1c98998
Merge branch 'master' into fix_aggregation_ttl
2021-07-03 15:07:44 +00:00
mergify[bot]
02cb287dc9
Merge branch 'master' into fix-alter-ttl-column
2021-07-02 23:49:46 +00:00
tavplubix
afbc6bf17d
Merge pull request #25684 from ClickHouse/cancel_merges_on_drop_partition
...
Cancel merges on DROP PARTITION
2021-06-30 23:41:04 +03:00
alesapin
72b281987e
Add more debug
2021-06-28 17:15:51 +03:00
Anton Popov
fa8ad1a7c6
reduce memory usage in queries with 'ORDER BY primary_key'
2021-06-25 19:23:41 +03:00
Alexander Tokmakov
76156af5cc
cancel merges on drop partition
2021-06-24 17:07:43 +03:00
alesapin
47b29092b4
Fix bug in MergerMutator parts selector
2021-06-22 16:47:42 +03:00
Anton Popov
662d5b8495
fix ALTER MODIFY COLUMN of columns, that participates in TTL expressions
2021-06-21 18:20:18 +03:00
kssenii
a0d8d689d3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-27 15:44:12 +03:00
alesapin
6e29404a75
Add max_parts_to_merge_at_once setting
2021-05-25 16:21:17 +03:00
kssenii
3dee003f9b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-20 19:20:09 +03:00
Amos Bird
c68ef31065
Skip data finalization when doing projection materialization.
2021-05-20 00:28:50 +08:00
kssenii
9b8df78fdd
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-17 17:42:05 +03:00
Alexander Tokmakov
970ad94851
Merge branch 'master' into fix_intersecting_parts
2021-05-14 13:17:02 +03:00
Alexander Tokmakov
2da12f0b59
fix intersection of drop range and merge
2021-05-13 17:04:36 +03:00
Alexander Tokmakov
e114c7eb8b
fix virtual parts in REPLACE_RANGE
2021-05-13 14:29:59 +03:00
kssenii
0527f0ea33
Merge branch 'master' of github.com:ClickHouse/ClickHouse into poco-file-to-std-fs
2021-05-12 16:54:18 +03:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks.
2021-05-11 18:12:27 +08:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
Alexander Tokmakov
eef899ae63
better code, add test
2021-05-10 21:03:37 +03:00
