Commit Graph

125236 Commits

Author SHA1 Message Date
Kseniia Sumarokova
5057a31bac
Merge pull request #54844 from kssenii/materialized-postrgesql-safer-parts
Fix "Invalid number of rows in Chunk" in MaterializedPostgreSQL
2023-09-25 23:37:12 +02:00
Robert Schulze
e7ed8f8f44
Merge pull request #54047 from rschu1ze/annoy-parallel
Parallelize Annoy index creation + minor test fix
2023-09-25 22:29:38 +02:00
robot-ch-test-poll4
ba1ca74a37
Merge pull request #54990 from ClickHouse/tylerhannan-README-update
Update README.md
2023-09-25 20:19:48 +02:00
Robert Schulze
6f3d7fcc86
Better lint 2023-09-25 17:11:32 +00:00
Robert Schulze
10cee14bce
Fix docs 2023-09-25 17:09:58 +00:00
Robert Schulze
0149e4226f
Cosmetics 2023-09-25 17:09:22 +00:00
Robert Schulze
d24130092b
Fix spelling 2023-09-25 17:08:42 +00:00
Robert Schulze
3562204850
+ docs 2023-09-25 17:08:37 +00:00
Robert Schulze
0c490465d4
Stabilize tests 2023-09-25 17:07:48 +00:00
Robert Schulze
d170304359
Parallelize Annoy index creation + minor test fix 2023-09-25 17:07:23 +00:00
Kruglov Pavel
af8b1e4978
Merge pull request #54855 from Avogar/obsolete-format-settings
Move obsolete format settings to separate section
2023-09-25 18:00:31 +02:00
Tyler Hannan
1abf60937a
Update README.md
Updating README
2023-09-25 17:11:20 +02:00
vdimir
70ae994e77
Merge pull request #54935 from ucasfl/hamming-distance
Add several string distance functions
2023-09-25 17:06:16 +02:00
Alexey Milovidov
0629b8679b
Merge pull request #54926 from Alex-Cheng/fix_exception_msg_in_pipe
Fix an exception message in Pipe::addTransform
2023-09-25 17:24:57 +03:00
Azat Khuzhin
aa5c02c1be
Remove 02151_hash_table_sizes_stats_distributed (fixes broken CI) (#54969)
* Fix 02151_hash_table_sizes_stats_distributed (fixes broken CI)

Fixes: #54961
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Remove 02151_hash_table_sizes_stats_distributed

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-25 14:23:46 +02:00
Kseniia Sumarokova
f172ad1473
Merge pull request #54984 from kssenii/delete-test
Delete a test
2023-09-25 13:15:05 +02:00
kssenii
ca14363d0d Delete a test 2023-09-25 13:10:25 +02:00
alesapin
75b2f90923
Merge pull request #54772 from Avogar/less-flaky-async-tests
Add retries to rests test_async_query_sending/test_async_connect
2023-09-25 12:05:11 +02:00
alesapin
53158fa789
Merge pull request #54939 from evillique/fix-race
Fix data race in SYSTEM STOP LISTEN
2023-09-25 11:28:24 +02:00
Alexey Milovidov
ca7796ba85
Merge pull request #54960 from ClickHouse/tuple_element_distributed
Add a test for compatibility
2023-09-25 00:17:03 +03:00
Alexey Milovidov
aa37814b3a
Merge pull request #54250 from zvonand/zvonand-fix-53156
Add sub-second precision to `formatReadableTimeDelta`
2023-09-25 00:15:56 +03:00
Alexey Milovidov
477922617c
Merge pull request #54961 from ClickHouse/remove-test-hash_table_sizes_stats
Remove test `02151_hash_table_sizes_stats`
2023-09-24 20:28:15 +03:00
Alexey Milovidov
81cfa0344a Remove test 02151_hash_table_sizes_stats 2023-09-24 19:27:35 +02:00
Alexey Milovidov
cfe8317fb3 Add a test for compatibility 2023-09-24 19:17:33 +02:00
robot-ch-test-poll3
f23339b4be
Merge pull request #54946 from azat/system.stack_trace-max_block_size
Respect max_block_size while generating rows for system.stack_trace (will fix flakiness of the test)
2023-09-24 19:10:17 +02:00
Alexey Milovidov
7bef66ae6a
Merge pull request #54436 from azat/prewhere-filter-fix
Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL
2023-09-24 20:05:06 +03:00
Andrey Zvonov
d2c95334aa
Merge branch 'ClickHouse:master' into zvonand-fix-53156 2023-09-24 16:15:42 +03:00
Nikolay Degterinsky
ff66d29376
Merge pull request #51469 from frinkr/perf-huge-ast
Improve performace for huge ast by direct-writing the column name for ASTLiteral
2023-09-24 14:56:50 +02:00
Azat Khuzhin
907d385df4 Resubmit 01051_system_stack_trace without flakiness (change max_block_size)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-24 14:01:24 +02:00
Azat Khuzhin
7a761730fa Respect max_block_size while reading form system.stack_trace
Reading from system.stack_trace can be very slow, especially if you read
all columns (there are some optimizations to avoid doing some actions),
that requires:
- reading /proc/self/task
- reading /proc/self/task/*/comm
- sending signal to each of the thread (to read query_id and trace_id)

And even if you have some conditions (for which there are some
optimizations, i.e. not sending signal to the thread which is the
slowest operation under load) it will still send signals to every thread
and wait for result.

This patch implements reading from system.stack_trace with respect to
max_block_size, that will make queries with lower max_block_size and
LIMIT works significantly faster.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-24 14:01:24 +02:00
Azat Khuzhin
01d22805ef Remove indent for anonymous namespace
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-24 14:01:24 +02:00
Azat Khuzhin
e0bca06a5d Add some logging for preparing rows for system.stack_trace
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-09-24 14:00:43 +02:00
zvonand
9559a6949b added subseconds to formatReadableTimeDelta and add tests 2023-09-24 13:04:56 +02:00
zvonand
2ab38761d7 added docs 2023-09-24 13:01:23 +02:00
Nikolay Degterinsky
256a699f43 Merge remote-tracking branch 'upstream/master' into perf-huge-ast 2023-09-24 00:29:03 +00:00
Alexey Milovidov
776c6adfe6
Merge pull request #54553 from Avogar/better-types-inference
Better integer types inference for Int64/UInt64 fields
2023-09-24 02:07:48 +03:00
Alexey Milovidov
e96dde24d3
Merge pull request #54951 from ClickHouse/remove-test-system-stack-trace
Remove test `01051_system_stack_trace`
2023-09-24 02:06:15 +03:00
Alexey Milovidov
b0d76b0028 Remove test 01051_system_stack_trace 2023-09-24 01:05:27 +02:00
Alexey Milovidov
b8b3c674f0
Merge pull request #54769 from Avogar/fix-timer-descriptor
Don't use default move assignment in TimerDescriptor
2023-09-24 02:03:08 +03:00
robot-clickhouse
320e4c47f3
Merge pull request #54943 from amosbird/fix-54941
Rebuild minmax_count_projection when partition key gets modified
2023-09-23 22:11:52 +02:00
robot-clickhouse-ci-2
2a26557391
Merge pull request #54399 from vahpetr/fix-nats-high-cpu-usage
Fix NATS high cpu usage
2023-09-23 21:36:21 +02:00
robot-clickhouse-ci-2
f51cf202e3
Merge pull request #54240 from wangtZJU/fix_multi_join_rewrite
fix name clash for multiple join rewriter v2
2023-09-23 21:35:46 +02:00
Alexey Milovidov
664ac27cf2
Merge pull request #54507 from ClickHouse/flush-logs-for-system-backup-logs-test
Flush logs for system.backup_log test.
2023-09-23 22:33:21 +03:00
robot-ch-test-poll4
9d61ed4665
Merge pull request #54664 from bigo-sg/arrow_join_max_block_size
Respect max_block_size for array join to avoid possible OOM
2023-09-23 21:30:51 +02:00
Sergei Trifonov
c1489d52b7
Merge pull request #54618 from ClickHouse/io-scheduling-throttler
add IO scheduling node to limit bandwidth
2023-09-23 21:26:17 +02:00
Alexey Milovidov
e89a8e4d13
Merge pull request #53492 from ClickHouse/fix-prewhere-lost-column
Fix: moved to prewhere condition actions can lose column
2023-09-23 22:24:00 +03:00
Alexey Milovidov
06415c7a53
Merge pull request #52082 from JackyWoo/rewrite_move_functions_out_of_any 2023-09-23 22:22:45 +03:00
Alexey Milovidov
cf080677bf
Simplify code 2023-09-23 22:22:27 +03:00
Azat Khuzhin
24c0d53df7 Fix possible incorrect result with SimpleAggregateFunction in PREWHERE and FINAL
In case of FINAL the result of the expression for PREWHERE can be
changed after applying merge algorithm, and this is the problem for
SimpleAggregateFunction since after applying merging algorithm the value
can be changed.

Note, analyzer does not has this bug because it simply does not reuse
columns from PREWHERE (they does not passed via
GlobalPlannerContext::createColumnIdentifier())

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: update tests references (see https://s3.amazonaws.com/clickhouse-test-reports/54436/baaa688f40fcd064952f62dc8c62ddc752dd0046/fast_test.html)
v3: allow reusing expression from PREWHERE w/o FINAL and revert tests references changes
2023-09-23 20:55:06 +02:00
flynn
0a701ba7e9 fix spell 2023-09-23 17:50:02 +00:00