Commit Graph

1268 Commits

Author SHA1 Message Date
Alexander Tokmakov
7fb78aa4d4
Merge pull request #60856 from azat/alter-select-throughtput-v2
[RFC] Reduce overhead of the mutations for SELECTs (v2)
2024-04-26 17:46:57 +00:00
Azat Khuzhin
be6777bc86 Reduce overhead of the mutations for SELECTs (v2)
SELECTs are affected by the mutations, since it tries to apply them on
fly, and scanning over existing mutations can take significant amount of
time (for simple queries, i.e. count())

And also even after mutation had been finished, it still a problem,
because mutations are not removed instantly.

So instead introduce an atomic counter alter_conversions_mutations, that
is incremented for new mutations and decremented once mutation
finished/killed, that way once the mutation finished they will not
affect queries.

Here are some numbers for non-RENAME mutations:

    rmt vanilla w/o mutations | queries: 3693, QPS: 494.813
    rmt vanilla w/ mutations  | queries: 2190, QPS: 388.256
    rmt patched w/o mutations | queries: 3168, QPS: 620.061
    rmt patched w/ mutations  | queries: 3155, QPS: 614.424
    mt vanilla w/o mutations  | queries: 3498, QPS: 656.399
    mt vanilla w/ mutations   | queries: 3821, QPS: 600.425
    mt patched w/o mutations  | queries: 5732, QPS: 745.585
    mt patched w/ mutations   | queries: 4719, QPS: 715.034

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-04-25 14:35:21 +02:00
Robert Schulze
8d7221fe35
Add test for bug 33446 2024-04-23 13:20:27 +00:00
Robert Schulze
7c0c3168c1
Revert "Add test for bug #33446" 2024-04-22 16:13:13 +02:00
Robert Schulze
b2d76b1dea
Merge pull request #62511 from rschu1ze/one_thousand_joins
Add test for bug #33446
2024-04-22 09:41:47 +00:00
János Benjamin Antal
6189cd49e1
Merge pull request #62210 from bigo-sg/json_format_early_skip
Improve `JSONEachRowRowInputFormat` by skipping all remaining fields when all required fields are read
2024-04-17 13:32:58 +00:00
Robert Schulze
5cad63b9d5
Add test for bug 33446 2024-04-17 13:31:35 +00:00
lgbo-ustc
d4773ef1bb Merge remote-tracking branch 'origin/master' into json_format_early_skip 2024-04-17 08:56:54 +08:00
Dmitry Novik
7c63d99625
Merge pull request #62564 from ClickHouse/analyzer-perf-tests
Always use new analyzer in performance tests
2024-04-16 20:45:16 +00:00
Robert Schulze
3272d75ec8
Merge pull request #62583 from KevinyhZou/improve_utc_timestamp_transform
Improve performance of `(to|from)_utc_timestamp` functions
2024-04-16 16:45:45 +00:00
Robert Schulze
b6af948eb4
Reduce performance test size 2024-04-16 10:09:17 +00:00
Robert Schulze
3257780ce3
Merge pull request #62392 from bigo-sg/opt_memchr
Speed up `splitByRegexp`
2024-04-16 08:07:49 +00:00
liuneng
92116dc8e5 change test max_threads 2024-04-16 11:08:47 +08:00
Robert Schulze
fad21c9958
Add test back 2024-04-15 10:29:05 +00:00
kevinyhzou
a9711c4bec modify test 2024-04-12 16:57:34 +08:00
kevinyhzou
878e0ed26b add performance test 2024-04-12 16:37:35 +08:00
lgbo-ustc
feddc40c45 update test 2024-04-12 10:00:52 +08:00
lgbo-ustc
e9635189d2 Merge remote-tracking branch 'origin/master' into json_format_early_skip 2024-04-12 08:53:38 +08:00
Dmitry Novik
5d7882bb60
Always use new analyzer in perf tests 2024-04-11 16:50:01 +02:00
Maksim Kita
1218cf1568 Updated implementation 2024-04-11 11:09:08 +03:00
Maksim Kita
0dcd70b5a5 Added performance tests 2024-04-11 11:09:08 +03:00
lgbo-ustc
d2e840f60a update 2024-04-11 15:59:04 +08:00
lgbo-ustc
a87fb7dc84 Merge remote-tracking branch 'origin/master' into json_format_early_skip 2024-04-11 14:37:12 +08:00
taiyang-li
4f4fa79ce7 last commit 2024-04-10 16:19:34 +08:00
Maksim Kita
35e1e5aff7 Perf script update path in documentation 2024-04-09 14:42:29 +03:00
taiyang-li
07815d93de add perf tests 2024-04-08 18:31:11 +08:00
lgbo-ustc
28de6d8b25 Merge remote-tracking branch 'origin/master' into json_format_early_skip 2024-04-08 10:15:33 +08:00
lgbo-ustc
cbedf8c5d2 improve by skip to line end when all fields are read 2024-04-03 10:30:32 +08:00
Robert Schulze
d729b63293
Merge pull request #61144 from bigo-sg/inline_poaarray_details
Inline small but frequently invoked functions in PODArrayDetails
2024-04-02 13:25:25 +02:00
Raúl Marín
b2e764f633 Revert "Merge pull request #61564 from liuneng1994/optimize_in_single_value"
This reverts commit 20a45b4073, reversing
changes made to a642f4d3ec.
2024-04-01 13:51:56 +02:00
János Benjamin Antal
e288528ede
Merge pull request #61931 from ClickHouse/fix-aggregating-merge-tree-simple-aggregate-function-string
Fix performance test `aggregating_merge_tree_simple_aggregate_function_string`
2024-03-28 08:39:45 +01:00
Dmitry Novik
65121b712e Merge remote-tracking branch 'origin/master' into enable-analyzer 2024-03-26 19:02:30 +01:00
János Benjamin Antal
1ec7258d1e Enable allow_suspicious_primary_key for perf tests that need it 2024-03-26 11:09:03 +00:00
Dmitry Novik
8bd49aa303 Try to fix perf tests 2024-03-25 17:06:42 +01:00
Yarik Briukhovetskyi
20a45b4073
Merge pull request #61564 from liuneng1994/optimize_in_single_value
New analyzer pass to optimize in single value
2024-03-25 12:53:01 +01:00
李扬
be68b21de4
Merge branch 'ClickHouse:master' into opt_memcpy_small 2024-03-21 11:27:10 +08:00
李扬
7c44505b49
Merge branch 'ClickHouse:master' into inline_poaarray_details 2024-03-21 10:20:45 +08:00
Raúl Marín
6c7be89c61
Merge pull request #61100 from Algunenano/experiment_int128
30x faster printing for 256-bit integers
2024-03-20 12:32:26 +01:00
liuneng
a29d4f5db2 fix bug 2024-03-20 10:24:57 +08:00
liuneng
532d72a7d8 add test case 2024-03-19 17:30:16 +08:00
Raúl Marín
4626a0b3a1 Merge remote-tracking branch 'blessed/master' into experiment_int128 2024-03-18 16:10:32 +01:00
Robert Schulze
f02db275c5
Merge remote-tracking branch 'rschu1ze/master' into dotProduct-memcpy 2024-03-18 09:26:29 +00:00
李扬
4da1dbd2c2
Merge branch 'ClickHouse:master' into inline_poaarray_details 2024-03-18 10:57:48 +08:00
李扬
9296be3747
Merge branch 'ClickHouse:master' into opt_memcpy_small 2024-03-18 10:35:09 +08:00
Sema Checherinda
025ad9791c
Merge pull request #58879 from azat/small-block-lock-contention
Improve query performance in case of very small blocks
2024-03-13 17:08:37 +01:00
Raúl Marín
cc92b8ffc5 Merge remote-tracking branch 'blessed/master' into experiment_int128 2024-03-13 13:57:41 +01:00
taiyang-li
dc9548d31b add perf test 2024-03-13 18:57:33 +08:00
taiyang-li
d17212616c add perf tests 2024-03-13 17:26:45 +08:00
Raúl Marín
45efa69189 Add perf tests 2024-03-08 15:17:59 +01:00
Robert Schulze
245ea0c186
Implement const/non-const shortcut 2024-03-06 16:56:01 +00:00