Commit Graph

150033 Commits

Author SHA1 Message Date
Robert Schulze
076c4a9ce9
Merge pull request #67930 from rschu1ze/fix-stat-assert
Fix stress test error with TDigest statistics
2024-08-08 16:34:58 +00:00
Alexey Milovidov
2e6ecf6913
Merge pull request #66311 from azat/rdkafka-fix-data-race
Fix possible data-race StorageKafka with statistics_interval_ms>0
2024-08-08 18:56:22 +02:00
Alexey Milovidov
42ae591017
Merge pull request #68021 from rschu1ze/bump-rocksdb
Revert "Revert "Bump rocksdb from v8.10 to v9.4 + enable jemalloc and liburing""
2024-08-08 15:18:53 +00:00
robot-clickhouse
06d7691fa6
Merge pull request #68045 from ClickHouse/auto/v24.7.3.42-stable
Update version_date.tsv and changelog after v24.7.3.42-stable
2024-08-08 14:13:09 +00:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper
Kafka ZooKeeper
2024-08-08 14:02:27 +00:00
robot-clickhouse
9cf60214e1 Update version_date.tsv and changelogs after v24.7.3.42-stable 2024-08-08 13:43:12 +00:00
Alexey Katsman
f00f18ae69
Merge pull request #68031 from ClickHouse/tavplubix-patch-10
Add a link in trace_log docs
2024-08-08 12:59:07 +00:00
Yakov Olkhovskiy
cbfc80a184
Merge pull request #67587 from ClickHouse/fix-create-view-with-recursive
Fix: creation of view with recursive CTE
2024-08-08 12:16:48 +00:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
alesapin
ac3dd0a9dc
Merge pull request #67873 from ClickHouse/fix-02597_column_update_tricy_expression_and_replication
[CI Fest] Fix `02597_column_update_tricy_expression_and_replication`
2024-08-08 11:58:37 +00:00
Raúl Marín
32d949d9a2
Merge pull request #67941 from Algunenano/fast_test_for_fast_tests
Remove slow tests from fasttest check
2024-08-08 11:24:12 +00:00
Ilya Yatsishin
f21a48dac6
Merge pull request #67064 from zvonand/hdfs-double-asterisk
Add `**` to `hdfs` docs, add test for `**` in `hdfs`
2024-08-08 11:12:55 +00:00
Robert Schulze
18085eca8a
Merge pull request #68027 from rschu1ze/docs-3rdparty
Docs: Update 3rd party library guide
2024-08-08 10:51:28 +00:00
Alexander Tokmakov
2e5b71cdb1
Update trace_log.md 2024-08-08 12:27:03 +02:00
Raúl Marín
cabe90d048
Merge pull request #67914 from Algunenano/no-parallel-3
Remove some no-parallel tags from tests (Part 3)
2024-08-08 09:46:29 +00:00
Max K.
706144a4ba
Merge pull request #68022 from ClickHouse/ci_pr_filter_job_fix
CI: Fix for filtering jobs in PRs
2024-08-08 09:19:26 +00:00
Robert Schulze
37641a0b4b
Merge remote-tracking branch 'ClickHouse/master' into fix-stat-assert 2024-08-08 08:57:22 +00:00
Robert Schulze
76b8bcd97a
Update 2024-08-08 08:46:46 +00:00
Max K.
01b6d4043b
Merge pull request #67978 from ClickHouse/ci_integration_tests_uncover_logs
CI: Integration tests uncover some logging
2024-08-08 08:45:23 +00:00
Robert Schulze
effaeeeeac
Update 3rd party lib guide 2024-08-08 08:43:39 +00:00
Dmitry Novik
486d717e88
Merge pull request #67661 from bigo-sg/win_bug
Fix crash on `percent_rank`
2024-08-08 08:28:48 +00:00
Max K.
beb43734ae
Merge pull request #67898 from ClickHouse/ci_mergeable_check_fix_2
CI: Fix for setting Mergeable Check from sync
2024-08-08 08:20:01 +00:00
Alexey Milovidov
82ffa75b7a
Merge pull request #68023 from ClickHouse/revert-65860-atomic-database-in-clickhouse-local
Revert "Use `Atomic` database by default in `clickhouse-local`"
2024-08-08 10:07:30 +02:00
Alexey Milovidov
6a2ebfc95b
Revert "Use Atomic database by default in clickhouse-local" 2024-08-08 10:07:14 +02:00
János Benjamin Antal
92be2db5b6 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-08 08:01:43 +00:00
Max Kainov
59a63cd110 CI: Fix for filtering jobs in PRs 2024-08-08 09:56:31 +02:00
Andrey Zvonov
29d701aea7
Forgot to drop table in test 2024-08-08 10:51:57 +03:00
Robert Schulze
5a17d93bf3
Fix freebsd build 2024-08-08 07:29:20 +00:00
Robert Schulze
5c97205742
Reapply "Bump rocksdb from v8.10 to v9.4 + enable jemalloc and liburing"
This reverts commit ff8ce505d7.
2024-08-08 07:23:10 +00:00
Azat Khuzhin
301ac5dab7 Fix possible data-race StorageKafka with statistics_interval_ms>0
The problem here is that ignorelist did not work by some reason, if I
will look at the ignored functions it should not contain any TSan
interseption code, while it does:

    $ lldb-13 clickhouse
    (lldb) target create "clickhouse"
    disas -n rd_avg_rollover
    Current executable set to '/home/azat/ch/tmp/tsan-test/clickhouse' (x86_64).
    (lldb) disas -n rd_avg_rollover
    clickhouse`rd_kafka_stats_emit_avg:
    clickhouse[0x1cbf84a7] <+39>:  leaq   0x30(%r15), %r12
    clickhouse[0x1cbf84ab] <+43>:  movq   %r12, %rdi
    clickhouse[0x1cbf84ae] <+46>:  callq  0x1ccdad40                ; rdk_thread_mutex_lock at tinycthread.c:111
    clickhouse[0x1cbf84b3] <+51>:  leaq   0x58(%r15), %rdi
    clickhouse[0x1cbf84b7] <+55>:  callq  0x71b5390                 ; __tsan_read4
    clickhouse[0x1cbf84bc] <+60>:  cmpl   $0x0, 0x58(%r15)
    clickhouse[0x1cbf84c1] <+65>:  je     0x1cbf8595                ; <+277> [inlined] rd_avg_rollover + 238 at rdavg.h
    clickhouse[0x1cbf84c7] <+71>:  leaq   -0xc8(%rbp), %rdi
    clickhouse[0x1cbf84ce] <+78>:  xorl   %esi, %esi
    clickhouse[0x1cbf84d0] <+80>:  callq  0x1ccdac80                ; rdk_thread_mutex_init at tinycthread.c:62
    clickhouse[0x1cbf84d5] <+85>:  leaq   0x5c(%r15), %rdi
    clickhouse[0x1cbf84d9] <+89>:  callq  0x71b5390                 ; __tsan_read4

    (lldb) disas -n rd_avg_calc
    clickhouse`rd_kafka_broker_ops_io_serve:
    clickhouse[0x1cbdf086] <+1990>: leaq   0x5a4(%rbx), %rdi
    clickhouse[0x1cbdf08d] <+1997>: callq  0x71b5390                 ; __tsan_read4
    clickhouse[0x1cbdf092] <+2002>: cmpl   $0x0, 0x5a4(%rbx)
    clickhouse[0x1cbdf099] <+2009>: je     0x1cbdf12b                ; <+2155> [inlined] rd_kafka_broker_timeout_scan + 719 at rdkafka_broker.c

I guess the reason is that they had been inlined

So now rd_avg_calc() guarded with a mutex.

Refs: https://github.com/ClickHouse/librdkafka/pull/11
Fixes: https://github.com/ClickHouse/ClickHouse/issues/60939
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-08 07:43:29 +02:00
Yakov Olkhovskiy
013680e397 empty commit 2024-08-08 03:00:51 +00:00
Yakov Olkhovskiy
3319a5e6f8
Merge pull request #67341 from ClickHouse/fix-race-tcphandler
Fix: data race in TCPHandler on socket timeouts settings
2024-08-08 02:50:24 +00:00
Alexey Milovidov
e0975213bc
Merge pull request #66821 from ClickHouse/randomize-trace_profile_events
Randomize `trace_profile_events`
2024-08-08 02:05:13 +00:00
Alexey Milovidov
d60cb9d3a6
Merge pull request #67960 from azat/tests/03002_part_log_rmt_fetch__error
tests: fix 03002_part_log_rmt_fetch_merge_error flakiness
2024-08-08 01:43:23 +00:00
Alexey Milovidov
e07069c500
Merge pull request #68002 from Algunenano/no-parallel-5
Remove some no-parallel tags from tests (Part 5)
2024-08-08 01:42:58 +00:00
Alexey Milovidov
31dd584df3
Merge pull request #68011 from ClickHouse/fix-test-02845_threads_count_in_distributed_queries
Fix test `02845_threads_count_in_distributed_queries`
2024-08-08 01:42:45 +00:00
Alexey Milovidov
ae6139e66c
Merge pull request #68007 from ClickHouse/qoega-patch-7
Follow up for #67843
2024-08-08 01:38:54 +00:00
Konstantin Bogdanov
b4cb5dcdd3
Typo 2024-08-08 02:47:21 +02:00
robot-clickhouse
f4e1bde9b6
Automatic style fix 2024-08-08 02:47:21 +02:00
Konstantin Bogdanov
5329fba9a2
Fix harder 2024-08-08 02:47:21 +02:00
Konstantin Bogdanov
c42725331d
Fix 2024-08-08 02:47:02 +02:00
lgbo-ustc
daf62e1682 update 2024-08-08 08:30:10 +08:00
Nikita Mikhaylov
ef31d9301b
Merge pull request #68014 from ClickHouse/revert-67904-bump-rocksdb3
Revert "Bump rocksdb from v8.10 to v9.4 + enable jemalloc and liburing"
2024-08-08 00:07:49 +00:00
Nikita Mikhaylov
ff8ce505d7
Revert "Bump rocksdb from v8.10 to v9.4 + enable jemalloc and liburing" 2024-08-08 00:20:16 +02:00
Nikita Fomichev
755b06b455
Merge pull request #67793 from ClickHouse/flaky-test_reload_after_fail_by_timer
Integration tests: fix flaky `test_dictionaries_update_and_reload::test_reload_after_fail_by_timer`
2024-08-07 21:36:54 +00:00
Azat Khuzhin
85427030aa tests: fix 03002_part_log_rmt_fetch_merge_error flakiness
CI found [1]:

    --- /usr/share/clickhouse-test/queries/0_stateless/03002_part_log_rmt_fetch_merge_error.reference	2024-08-07 05:09:42.058643403 +0200
    +++ /tmp/clickhouse-test/0_stateless/03002_part_log_rmt_fetch_merge_error.stdout	2024-08-07 05:54:45.514083455 +0200
    @@ -6,5 +6,7 @@
     after
     rmt_master	NewPart	0	1
     rmt_master	MergeParts	0	1
    +rmt_master	RemovePart	0	1
     rmt_slave	MergeParts	1	0
     rmt_slave	DownloadPart	0	2
    +rmt_slave	RemovePart	0	1

    MergeTree settings used in test: --ratio_of_defaults_for_sparse_serialization 1.0 --prefer_fetch_merged_part_size_threshold 3517855074 --vertical_merge_algorithm_min_rows_to_activate 1000000 --vertical_merge_algorithm_min_columns_to_activate 100 --allow_vertical_merges_from_compact_to_wide_parts 0 --min_merge_bytes_to_use_direct_io 10737418240 --index_granularity_bytes 7659983 --merge_max_block_size 17667 --index_granularity 48465 --min_bytes_for_wide_part 1073741824 --marks_compress_block_size 58048 --primary_key_compress_block_size 18342 --replace_long_file_name_to_hash 0 --max_file_name_length 36 --min_bytes_for_full_part_storage 536870912 --compact_parts_max_bytes_to_buffer 148846831 --compact_parts_max_granules_to_buffer 140 --compact_parts_merge_max_bytes_to_prefetch_part 4513530 --cache_populated_by_fetch 1 --concurrent_part_removal_threshold 8 --old_parts_lifetime 10

The reason is old_parts_lifetime=10

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67511/881d57a7644057b586e4cdb95ebb8785d912d4c5/stateless_tests__msan__%5B3_4%5D.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-07 23:06:14 +02:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832 Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
Alexey Milovidov
1fcd8320cf Merge branch 'fix-test-02845_threads_count_in_distributed_queries' into randomize-trace_profile_events 2024-08-07 22:24:39 +02:00
Alexey Milovidov
92d5d5e8dc Merge branch 'master' into randomize-trace_profile_events 2024-08-07 22:24:20 +02:00