Commit Graph

240 Commits

Author SHA1 Message Date
alesapin
56039c91f9
Update src/Interpreters/MutationsInterpreter.cpp 2024-04-26 13:51:25 +02:00
Eliot Hautefeuille
520aa02059
fix: update: nested materialized columns: size check fixes 2024-04-19 00:10:41 +02:00
kssenii
0a5ce69880 Review fix 2024-03-26 22:02:50 +01:00
kssenii
a777045dd3 Fix and more tests for broken projections handling 2024-03-26 18:47:48 +01:00
kssenii
e3d2fb28cf Merge remote-tracking branch 'origin/master' into revert-refert-of-broken-projections-handling 2024-03-25 13:54:39 +01:00
Dmitry Novik
836fe46c33 Disable new analyzer in MutationsInterpreter #ci_set_analyzer 2024-03-18 15:50:58 +01:00
Kseniia Sumarokova
7e7fc4127d
Merge branch 'master' into revert-refert-of-broken-projections-handling 2024-03-10 10:01:34 +01:00
Anton Popov
7fe7f3a79d address review comments 2024-03-05 16:03:02 +00:00
Anton Popov
1b9e6c936e better interfaces for virtual columns 2024-03-01 22:29:56 +00:00
Anton Popov
8a4e15536b refactoring of virtual columns 2024-02-29 18:01:54 +00:00
Anton Popov
0ceeb13b7f refactoring of virtual columns 2024-02-28 19:58:55 +00:00
Anton Popov
9f8ac76345 Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-28 14:42:37 +00:00
kssenii
7ac453ab4c Revert "Merge pull request #60436 from nickitat/revert_56864"
This reverts commit 8719a601fa, reversing
changes made to 657857f982.
2024-02-27 23:06:14 +08:00
Nikita Taranov
854f1b064b Revert "Merge pull request #56864 from ClickHouse/broken-projections-better-handling"
This reverts commit caaafbcedb, reversing
changes made to d45b248f96.
2024-02-27 00:13:28 +01:00
Anton Popov
23f300b581 refactoring of virtual columns 2024-02-21 00:57:35 +00:00
Kseniia Sumarokova
99653fc778
Merge branch 'master' into broken-projections-better-handling 2024-01-26 16:27:23 +01:00
Maksim Kita
5bb734a4bb ActionsDAG buildFilterActionsDAG refactoring 2024-01-25 18:24:14 +03:00
Maksim Kita
2a327107b6 Updated implementation 2024-01-25 14:31:49 +03:00
kssenii
48e489682b Merge remote-tracking branch 'origin/master' into broken-projections-better-handling 2024-01-19 10:49:27 +01:00
Azat Khuzhin
48a700edba Support query parameters in ALTER TABLE ... PART
But, to make this happen it is not enough to simply fix the parser, the
whole ASTs for ALTER should be fixed as well, since they store `ASTPtr`
instead of `IAST *`, and so because of `ReplaceQueryParameterVisitor`
does not work for ALTER query.

So this patch converts ASTPtr to `IAST *` for ASTAlterQuery and
ASTAlterCommand (plus it also fixes when the children for
ASTAlterCommand had not been updated sometimes).

And only after this it is possible to adjust the parser (see
places with `parser_string_and_substituion` in the parser code).

v2: also fix ASTAlterCommand::clone (add missing components) and ParserAlterCommand::parseImpl
v3: fix APPLY DELETED MASK
v4: fix mutations_execute_nondeterministic_on_initiator/mutations_execute_subqueries_on_initiator
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-01-15 14:16:54 +03:00
Kseniia Sumarokova
a6b5b7460b
Merge branch 'master' into broken-projections-better-handling 2024-01-10 16:46:18 +01:00
Anton Popov
f252412915 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-06 03:08:52 +00:00
Azat Khuzhin
837f4ea676 Add ability to throttle merges/mutations
Main motivation was to has an ability to throttle background tasks, to
avoid affecting queries.

To new server settings had been added for this:
- max_mutations_bandwidth_for_server
- max_merges_bandwidth_for_server

Note, that they limit only reading, since usually you will not write
more data then you read, but sometimes it is possible in case of ALTER
UPDATE.

But for now, to keep things simple, I decided to limit this with only
2 settings instead of 4.

Note, that if the write throttling will be needed, then they can use the
same settings, and just create new throttler for write.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-24 22:31:49 +01:00
Kseniia Sumarokova
189d0ec147
Merge branch 'master' into broken-projections-better-handling 2023-12-21 17:17:50 +01:00
Nikita Mikhaylov
cb6c9557ff
Merge branch 'master' into remove-old-projections-code 2023-12-20 17:45:38 +01:00
Anton Popov
1960713176 add docs 2023-12-13 17:29:34 +00:00
Anton Popov
c0e45c15fb add test for lightweight deletes and mutations 2023-12-05 13:38:25 +00:00
Anton Popov
40a1744b7c Merge remote-tracking branch 'upstream/master' into HEAD 2023-12-04 18:10:43 +00:00
Anton Popov
8d30e22a09 fix lighweight delete with heavy delete 2023-12-04 13:00:50 +00:00
Anton Popov
7fbe7462b6 add mutation command to apply deleted mask 2023-12-01 19:12:05 +00:00
Kseniia Sumarokova
5c3d1b5991
Merge branch 'master' into broken-projections-better-handling 2023-11-30 21:33:35 +01:00
Han Fei
6733438adc Merge branch 'master' into hanfei/statistic 2023-11-28 16:35:00 +01:00
Han Fei
7bd2ea3add Merge branch 'master' into hanfei/statistic 2023-11-27 23:31:23 +01:00
Nikolay Degterinsky
cf717bdb62 Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column 2023-11-23 14:51:36 +00:00
Anton Popov
65efb18842 Merge remote-tracking branch 'upstream/master' into HEAD 2023-11-21 17:30:38 +00:00
kssenii
6c42a3fad6 Better 2023-11-16 16:51:05 +01:00
kssenii
eb7aad0016 Do not consider parts broken if only projections are broken 2023-11-16 12:47:28 +01:00
Amos Bird
829fc61e77
Add scalars in all cases 2023-10-27 01:41:02 +08:00
Anton Popov
fb666e137c remove old code of projection analysis 2023-10-12 23:25:20 +00:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Duc Canh Le
ae417ef39c adding comments
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-05 07:49:17 +00:00
Duc Canh Le
a09c53233b only rebuild indexes when index granularity changes
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-03 01:27:45 +00:00
Duc Canh Le
0064d3637f rebuild indexes and projections when UPDATE compact parts with index_granularity_bytes > 0
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-10-02 07:36:57 +00:00
Han Fei
4e7745f757 Merge branch 'master' into hanfei/statistic 2023-09-26 21:43:53 +02:00
Han Fei
8cb9fe0154 refine code 2023-09-26 19:16:01 +02:00
SmitaRKulkarni
d8adf05de2
Added a new column _block_number (#47532)
Added a new virtual column _block_number which is persisted on merges when allow_experimental_block_number_column is enabled
2023-09-20 11:31:12 +02:00
Han Fei
ddcb64f39f update docs and refine statements 2023-09-08 02:27:17 +02:00
Han Fei
2330a28f7b support estimate by stat 2023-09-04 15:51:00 +02:00
Han Fei
10c622fa08 Merge branch 'master' into hanfei/statistic 2023-08-24 15:56:06 +02:00
Han Fei
c29261e5b4 support estimate by t-digest 2023-08-24 14:10:22 +02:00