Commit Graph

10240 Commits

Author SHA1 Message Date
János Benjamin Antal
21be195dd8 Revert unnecessary change 2024-08-09 13:14:09 +00:00
János Benjamin Antal
2900c7006e Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-09 13:06:58 +00:00
Sema Checherinda
1e67b46b57
Merge pull request #67684 from ClickHouse/chesema-rewrite-storage-policy
rework usage of custom table's disks
2024-08-09 12:36:29 +00:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
divanik
b67b7a62a4 Merge branches 'divanik/add_local_and_azure_iceberg_support' and 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-09 09:40:32 +00:00
alesapin
bc20b637ea Add missing file 2024-08-08 21:47:23 +02:00
Miсhael Stetsyuk
ef294f0dab
Merge pull request #67913 from ClickHouse/add-replication-lag-and-recovery-time-metrics-resubmit
[resubmit] add replication lag and recovery time metrics
2024-08-08 16:37:30 +00:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning 2024-08-08 17:54:53 +02:00
Alexander Tokmakov
33ba78ee42
Update test.py 2024-08-08 17:47:12 +02:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper
Kafka ZooKeeper
2024-08-08 14:02:27 +00:00
kruglov
cab274e1b6 Fixed error on generated columns in MaterializedPostgreSQL 2024-08-08 16:50:53 +03:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 14:52:33 +02:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
Ilya Yatsishin
f21a48dac6
Merge pull request #67064 from zvonand/hdfs-double-asterisk
Add `**` to `hdfs` docs, add test for `**` in `hdfs`
2024-08-08 11:12:55 +00:00
Sema Checherinda
0939e7f922 Merge branch 'master' into chesema-02765 2024-08-08 12:57:04 +02:00
Sema Checherinda
69ac203c9f fix tests 2024-08-08 12:56:33 +02:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 11:45:01 +02:00
János Benjamin Antal
92be2db5b6 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-08 08:01:43 +00:00
Andrey Zvonov
29d701aea7
Forgot to drop table in test 2024-08-08 10:51:57 +03:00
Julia Kartseva
d6ecabb41d Fix flaky test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
Disable parallel processing for the Ordered mode for the
test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
test.

The reason for this is that the load between the processing nodes is
too uneven when s3queue_processing_threads_num != 1,
e.g.:

```
$ grep res1 pytest.log
2024-08-07 07:15:58 [ 575 ] DEBUG : res1 size: 13300, res2 size: 1700, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

In CIs environment, there are rare cases when one of the processors handles all the workload,
while the other is busy-waiting, and the test fails on assert:

When s3queue_processing_threads_num == 1, the workload is evenly
distributed:

```
$ grep res1 pytest.log
2024-08-07 07:26:52 [ 586 ] DEBUG : res1 size: 7200, res2 size: 7800, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

This change only fixes test flakiness. Further investigation of the Order
mode parallelism is required.
2024-08-08 06:13:36 +00:00
Alexey Milovidov
ae6139e66c
Merge pull request #68007 from ClickHouse/qoega-patch-7
Follow up for #67843
2024-08-08 01:38:54 +00:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Yarik Briukhovetskyi
c6c0a44b93
fix flaky tests 2024-08-07 23:57:19 +02:00
Nikita Fomichev
755b06b455
Merge pull request #67793 from ClickHouse/flaky-test_reload_after_fail_by_timer
Integration tests: fix flaky `test_dictionaries_update_and_reload::test_reload_after_fail_by_timer`
2024-08-07 21:36:54 +00:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832 Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Nikita Taranov
1082792950 fix test 2024-08-07 20:21:50 +01:00
Andrey Zvonov
c6482a092b
Merge branch 'master' into hdfs-double-asterisk 2024-08-07 21:42:00 +03:00
Ilya Yatsishin
7341dcefd4
Follow up for #67843 2024-08-07 20:36:23 +02:00
Ilya Yatsishin
ac4bed2f42
Merge pull request #67843 from qoega/improve-integration-tests-3
Improve integration tests 3
2024-08-07 18:06:37 +00:00
robot-clickhouse
94398996b2 Automatic style fix 2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96 Make tests more sturdier for flaky test check 2024-08-07 17:27:24 +00:00
Sema Checherinda
06d154055f adjust tests 2024-08-07 19:19:33 +02:00
divanik
f5e993df2a Add tests 2024-08-07 16:46:33 +00:00
alesapin
ad678cb5a8 Ignore disappeared projections on start 2024-08-07 18:24:03 +02:00
János Benjamin Antal
b3c30b05d6 Make test_kafka_insert repeatable 2024-08-07 13:22:22 +00:00
János Benjamin Antal
139fe624c2 Fix typos 2024-08-07 13:16:47 +00:00
Nikita Taranov
49871bacc1 fix test 2024-08-07 12:37:39 +01:00
János Benjamin Antal
8b5c8e5361 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-07 11:33:21 +00:00
divanik
299af052f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-07 11:13:53 +00:00
Sema Checherinda
272941021f
Merge pull request #66279 from ClickHouse/chesema-processor-onCancel
merge tree sink cancel delayed_chunk
2024-08-07 11:12:22 +00:00
robot-clickhouse
b9f564f6f4 Automatic style fix 2024-08-07 11:12:21 +00:00
Ilya Yatsishin
47111eb5af
Merge pull request #67511 from ClickHouse/revert-67507-revert-66536-external-replace-to-null
Revert "Revert "Add settings to replace external engines to Null during create""
2024-08-07 10:38:04 +00:00
Sema Checherinda
633f700df6 adjust tests 2024-08-07 12:23:23 +02:00
robot-clickhouse
00efd5fc0d Automatic style fix 2024-08-07 12:21:41 +02:00
Sema Checherinda
86267418f9 fix tests, rework recreation tables conditions, add log about ignored logs 2024-08-07 12:21:41 +02:00
pufit
3b642e7f91
Merge pull request #66364 from azat/cluster-inter-server-secret-fix
Fix cluster() for inter-server secret (preserve initial user as before)
2024-08-07 04:58:12 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index
added tests for page index in parquet files
2024-08-07 00:15:07 +00:00
Alexey Gerasimchuck
a43ed76ae8 Fixed session log parallel/sequenced test work within a single fixture 2024-08-06 22:20:12 +00:00
Nikita Taranov
f54083a1d8
Merge branch 'master' into cpu_cgroup_aware 2024-08-06 23:13:40 +02:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Ilya Yatsishin
881d57a764
Merge branch 'master' into revert-67507-revert-66536-external-replace-to-null 2024-08-06 21:04:17 +02:00
Yatsishin Ilya
8cfcf341ae fix 2024-08-06 18:26:52 +00:00
Michael Stetsyuk
df2675fad0 [resubmit] add replication lag and recovery time metrics 2024-08-06 15:06:02 +00:00
Azat Khuzhin
bdfaffa9d7 tests: make test_distributed_inter_server_secret idempotent
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:59:23 +02:00
Sema Checherinda
0eb6a41f57 Merge branch 'master' into chesema-processor-onCancel 2024-08-06 16:36:28 +02:00
divanik
c4e29466de qMerge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-06 11:59:47 +00:00
Andrey Zvonov
7d45424d31 specify files in test: 2024-08-06 11:18:47 +00:00
Andrey Zvonov
97f1cfc232 add ** glob to hdfs docs 2024-08-06 11:18:47 +00:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Yarik Briukhovetskyi
27cdbb54d7
fix black 2024-08-06 13:10:03 +02:00
Nikita Mikhaylov
4e2b6a5e49 Fix docs and a test 2024-08-06 13:06:34 +02:00
Sema Checherinda
995187006a rework custom table's disk usage 2024-08-06 13:05:23 +02:00
Yarik Briukhovetskyi
aa3d8086c3
fix integration tests 2024-08-06 12:30:39 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Nikita Mikhaylov
4829ba31d3 Actually fix a test 2024-08-05 21:18:53 +00:00
Azat Khuzhin
0dccc34a20 Fix cluster() for inter-server secret (preserve initial user as before)
The behaviour of cluster() with inter-server secret had been changed in #63013,
after it started to use "default" user, and this introduces a
regression.

The intention of that patch was to adjust only remote(), since it only
it accept custom user, which should be ignored.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/66287
Fixes: https://github.com/ClickHouse/ClickHouse/issues/66352
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
Azat Khuzhin
9d7710684b tests/test_distributed_inter_server_secret: get_query_user_info return list
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
divanik
9e85f89e95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-05 16:15:28 +00:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
2c78122717
Merge pull request #67667 from zvonand/fix-ldap-entrypoint-2
Even better healthcheck for ldap
2024-08-05 15:31:59 +00:00
Nikita Mikhaylov
330aae9517 Even better test 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
0301af99e5 Fixed a bunch of tests 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
d080f863ea
fix black 2024-08-05 17:07:17 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Yatsishin Ilya
3e633ad0d0 more changes 2024-08-05 14:43:28 +00:00
robot-clickhouse
5d9d5bf919 Automatic style fix 2024-08-05 16:34:55 +02:00
Sema Checherinda
462fe8b7ff repro for #67478 2024-08-05 16:34:55 +02:00
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance
Fix flaky `test_system_kafka_consumers_rebalance`
2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
János Benjamin Antal
8f6476adb7 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-05 12:26:00 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type
Support true UUID type for MongoDB engine
2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
2024-08-05 12:23:40 +00:00
Yarik Briukhovetskyi
fd1e354e85
fix flaky check for integration tests 2024-08-05 13:43:06 +02:00
maxvostrikov
e0362b00f5 squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
Nikita Fomichev
bd6c7a504d Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
János Benjamin Antal
230b5150c2 Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-05 09:14:13 +00:00
János Benjamin Antal
f816158dbc Address review comments 2024-08-05 09:11:55 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Nikita Fomichev
29f1d9df36 Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 10:03:49 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Alexey Gerasimchuck
6897178c41 fixed typo 2024-08-04 22:29:03 +00:00
Alexey Gerasimchuck
b2ec479cee Fixed race condition in session log tests 2024-08-04 22:23:08 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Alexey Milovidov
a449ffe6fc Merge branch 'master' into fix-test_delayed_replica_failover 2024-08-04 22:58:18 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec)
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq
Try to fix RabbitMQ test failures
2024-08-04 19:26:23 +02:00