Commit Graph

10173 Commits

Author SHA1 Message Date
Yarik Briukhovetskyi
086c0f03a6
Merge pull request #65997 from yariks5s/hive_style_partitioning
Implementing Hive-style partitioning
2024-08-13 10:04:21 +00:00
Alexey Milovidov
203857020f
Merge pull request #68178 from ClickHouse/fix-68177
Fix `test_cluster_all_replicas`
2024-08-12 21:52:13 +00:00
János Benjamin Antal
ac6826392d
Merge pull request #67554 from ClickHouse/fix-message-queue-sink-from-http-interface
Fix message queue sink from http interface
2024-08-12 21:29:14 +00:00
János Benjamin Antal
eaa5715a02
Merge pull request #68200 from ClickHouse/remove-log-engine-from-kafka-integration-tests
Remove Log engine from Kafka integration tests
2024-08-12 20:44:53 +00:00
Alexey Milovidov
74fb08198c Merge branch 'master' into fix-68177 2024-08-12 18:39:06 +02:00
Alexey Milovidov
58ed71bf11
Merge pull request #68181 from ClickHouse/fix-leftovers
Fix leftovers
2024-08-12 16:22:17 +00:00
János Benjamin Antal
737948470d Fix syntax 2024-08-12 11:54:34 +00:00
Sema Checherinda
5e836bc20e
Merge pull request #67472 from ClickHouse/chesema-02765
speed up system flush logs
2024-08-12 11:51:55 +00:00
János Benjamin Antal
8f124710ef Remove Log engine from Kafka integration tests
It doesn't work well when `thread_per_consumer` is used as writer can make readers starve when `shared_time_mutex` prefers writes over reads.
2024-08-12 10:27:21 +00:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning 2024-08-12 11:44:45 +02:00
Alexey Milovidov
6f189e9eb7 Fix leftovers 2024-08-12 07:17:17 +02:00
Alexey Milovidov
b3504def35 Fix leftovers 2024-08-12 07:15:08 +02:00
Alexey Milovidov
5acf9f6f81 Fix test_cluster_all_replicas 2024-08-12 07:01:52 +02:00
Alexander Tokmakov
7de1c4bfc3
Merge pull request #68051 from ClickHouse/tavplubix-patch-10
Update test_drop_is_lock_free/test.py
2024-08-11 11:21:38 +00:00
János Benjamin Antal
79a964bfff Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-10 21:53:57 +00:00
János Benjamin Antal
556f669878 Separate test into separate file to pass bugfix check 2024-08-10 21:53:22 +00:00
alesapin
c945209427
Merge pull request #68003 from ClickHouse/ignore_broken_projections_on_start
Ignore disappeared projections on start
2024-08-10 19:34:40 +00:00
Alexey Milovidov
e7215d1029
Merge pull request #67959 from jkartseva/fix-flaky-test-storage-s3-queue
Fix flaky `test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed`
2024-08-10 00:12:09 +00:00
Sema Checherinda
99b9db9ba7 Merge branch 'master' into chesema-02765 2024-08-09 19:54:44 +02:00
Yarik Briukhovetskyi
701c787eea
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-09 17:53:49 +02:00
János Benjamin Antal
21be195dd8 Revert unnecessary change 2024-08-09 13:14:09 +00:00
János Benjamin Antal
2900c7006e Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-09 13:06:58 +00:00
Sema Checherinda
1e67b46b57
Merge pull request #67684 from ClickHouse/chesema-rewrite-storage-policy
rework usage of custom table's disks
2024-08-09 12:36:29 +00:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
alesapin
bc20b637ea Add missing file 2024-08-08 21:47:23 +02:00
Miсhael Stetsyuk
ef294f0dab
Merge pull request #67913 from ClickHouse/add-replication-lag-and-recovery-time-metrics-resubmit
[resubmit] add replication lag and recovery time metrics
2024-08-08 16:37:30 +00:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning 2024-08-08 17:54:53 +02:00
Alexander Tokmakov
33ba78ee42
Update test.py 2024-08-08 17:47:12 +02:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper
Kafka ZooKeeper
2024-08-08 14:02:27 +00:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 14:52:33 +02:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
Ilya Yatsishin
f21a48dac6
Merge pull request #67064 from zvonand/hdfs-double-asterisk
Add `**` to `hdfs` docs, add test for `**` in `hdfs`
2024-08-08 11:12:55 +00:00
Sema Checherinda
0939e7f922 Merge branch 'master' into chesema-02765 2024-08-08 12:57:04 +02:00
Sema Checherinda
69ac203c9f fix tests 2024-08-08 12:56:33 +02:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 11:45:01 +02:00
János Benjamin Antal
92be2db5b6 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-08 08:01:43 +00:00
Andrey Zvonov
29d701aea7
Forgot to drop table in test 2024-08-08 10:51:57 +03:00
Julia Kartseva
d6ecabb41d Fix flaky test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
Disable parallel processing for the Ordered mode for the
test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
test.

The reason for this is that the load between the processing nodes is
too uneven when s3queue_processing_threads_num != 1,
e.g.:

```
$ grep res1 pytest.log
2024-08-07 07:15:58 [ 575 ] DEBUG : res1 size: 13300, res2 size: 1700, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

In CIs environment, there are rare cases when one of the processors handles all the workload,
while the other is busy-waiting, and the test fails on assert:

When s3queue_processing_threads_num == 1, the workload is evenly
distributed:

```
$ grep res1 pytest.log
2024-08-07 07:26:52 [ 586 ] DEBUG : res1 size: 7200, res2 size: 7800, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

This change only fixes test flakiness. Further investigation of the Order
mode parallelism is required.
2024-08-08 06:13:36 +00:00
Alexey Milovidov
ae6139e66c
Merge pull request #68007 from ClickHouse/qoega-patch-7
Follow up for #67843
2024-08-08 01:38:54 +00:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Yarik Briukhovetskyi
c6c0a44b93
fix flaky tests 2024-08-07 23:57:19 +02:00
Nikita Fomichev
755b06b455
Merge pull request #67793 from ClickHouse/flaky-test_reload_after_fail_by_timer
Integration tests: fix flaky `test_dictionaries_update_and_reload::test_reload_after_fail_by_timer`
2024-08-07 21:36:54 +00:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832 Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Andrey Zvonov
c6482a092b
Merge branch 'master' into hdfs-double-asterisk 2024-08-07 21:42:00 +03:00
Ilya Yatsishin
7341dcefd4
Follow up for #67843 2024-08-07 20:36:23 +02:00
Ilya Yatsishin
ac4bed2f42
Merge pull request #67843 from qoega/improve-integration-tests-3
Improve integration tests 3
2024-08-07 18:06:37 +00:00
robot-clickhouse
94398996b2 Automatic style fix 2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96 Make tests more sturdier for flaky test check 2024-08-07 17:27:24 +00:00