Commit Graph

10412 Commits

Author SHA1 Message Date
Sema Checherinda
1e67b46b57
Merge pull request #67684 from ClickHouse/chesema-rewrite-storage-policy
rework usage of custom table's disks
2024-08-09 12:36:29 +00:00
Nikita Taranov
ffa1371dde Merge branch 'master' into keep_alive_max_reqs 2024-08-09 12:24:45 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
divanik
b67b7a62a4 Merge branches 'divanik/add_local_and_azure_iceberg_support' and 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-09 09:40:32 +00:00
alesapin
bc20b637ea Add missing file 2024-08-08 21:47:23 +02:00
Miсhael Stetsyuk
ef294f0dab
Merge pull request #67913 from ClickHouse/add-replication-lag-and-recovery-time-metrics-resubmit
[resubmit] add replication lag and recovery time metrics
2024-08-08 16:37:30 +00:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning 2024-08-08 17:54:53 +02:00
Alexander Tokmakov
33ba78ee42
Update test.py 2024-08-08 17:47:12 +02:00
János Benjamin Antal
c9adfe246b
Merge pull request #57625 from ClickHouse/kafka-zookeeper
Kafka ZooKeeper
2024-08-08 14:02:27 +00:00
kruglov
cab274e1b6 Fixed error on generated columns in MaterializedPostgreSQL 2024-08-08 16:50:53 +03:00
Yarik Briukhovetskyi
edccd30016
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 14:52:33 +02:00
Nikita Mikhaylov
4c289aa2dc
Merge pull request #64183 from vitlibar/ts-engine
Add new TimeSeries table engine to handle Prometheus protocols
2024-08-08 12:03:12 +00:00
Ilya Yatsishin
f21a48dac6
Merge pull request #67064 from zvonand/hdfs-double-asterisk
Add `**` to `hdfs` docs, add test for `**` in `hdfs`
2024-08-08 11:12:55 +00:00
Sema Checherinda
0939e7f922 Merge branch 'master' into chesema-02765 2024-08-08 12:57:04 +02:00
Sema Checherinda
69ac203c9f fix tests 2024-08-08 12:56:33 +02:00
Yarik Briukhovetskyi
6384488826
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-08 11:45:01 +02:00
János Benjamin Antal
92be2db5b6 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-08 08:01:43 +00:00
Andrey Zvonov
29d701aea7
Forgot to drop table in test 2024-08-08 10:51:57 +03:00
Julia Kartseva
d6ecabb41d Fix flaky test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
Disable parallel processing for the Ordered mode for the
test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed
test.

The reason for this is that the load between the processing nodes is
too uneven when s3queue_processing_threads_num != 1,
e.g.:

```
$ grep res1 pytest.log
2024-08-07 07:15:58 [ 575 ] DEBUG : res1 size: 13300, res2 size: 1700, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

In CIs environment, there are rare cases when one of the processors handles all the workload,
while the other is busy-waiting, and the test fails on assert:

When s3queue_processing_threads_num == 1, the workload is evenly
distributed:

```
$ grep res1 pytest.log
2024-08-07 07:26:52 [ 586 ] DEBUG : res1 size: 7200, res2 size: 7800, total_rows: 15000 (test.py:813, test_multiple_tables_streaming_sync_distributed)
```

This change only fixes test flakiness. Further investigation of the Order
mode parallelism is required.
2024-08-08 06:13:36 +00:00
Alexey Milovidov
ae6139e66c
Merge pull request #68007 from ClickHouse/qoega-patch-7
Follow up for #67843
2024-08-08 01:38:54 +00:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Yarik Briukhovetskyi
c6c0a44b93
fix flaky tests 2024-08-07 23:57:19 +02:00
Nikita Fomichev
755b06b455
Merge pull request #67793 from ClickHouse/flaky-test_reload_after_fail_by_timer
Integration tests: fix flaky `test_dictionaries_update_and_reload::test_reload_after_fail_by_timer`
2024-08-07 21:36:54 +00:00
Nikita Mikhaylov
f37e0c7fc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-07 21:01:13 +00:00
Nikita Mikhaylov
b2722d8832 Disallow LowCardinality type for external tables 2024-08-07 20:54:40 +00:00
Alexey Milovidov
8b3e85dd8d
Merge pull request #67785 from arenadata/ADQM-FixedTestRaceCondition
Fixed session_log related tests race condition on logout
2024-08-07 20:01:48 +00:00
Nikita Taranov
1082792950 fix test 2024-08-07 20:21:50 +01:00
Andrey Zvonov
c6482a092b
Merge branch 'master' into hdfs-double-asterisk 2024-08-07 21:42:00 +03:00
Ilya Yatsishin
7341dcefd4
Follow up for #67843 2024-08-07 20:36:23 +02:00
Ilya Yatsishin
ac4bed2f42
Merge pull request #67843 from qoega/improve-integration-tests-3
Improve integration tests 3
2024-08-07 18:06:37 +00:00
robot-clickhouse
94398996b2 Automatic style fix 2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96 Make tests more sturdier for flaky test check 2024-08-07 17:27:24 +00:00
Sema Checherinda
06d154055f adjust tests 2024-08-07 19:19:33 +02:00
divanik
f5e993df2a Add tests 2024-08-07 16:46:33 +00:00
alesapin
ad678cb5a8 Ignore disappeared projections on start 2024-08-07 18:24:03 +02:00
János Benjamin Antal
b3c30b05d6 Make test_kafka_insert repeatable 2024-08-07 13:22:22 +00:00
János Benjamin Antal
139fe624c2 Fix typos 2024-08-07 13:16:47 +00:00
Nikita Taranov
49871bacc1 fix test 2024-08-07 12:37:39 +01:00
János Benjamin Antal
8b5c8e5361 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-07 11:33:21 +00:00
iceFireser
3a89b7034f modify integration test 2024-08-07 19:16:22 +08:00
divanik
299af052f8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-07 11:13:53 +00:00
Sema Checherinda
272941021f
Merge pull request #66279 from ClickHouse/chesema-processor-onCancel
merge tree sink cancel delayed_chunk
2024-08-07 11:12:22 +00:00
robot-clickhouse
b9f564f6f4 Automatic style fix 2024-08-07 11:12:21 +00:00
Ilya Yatsishin
47111eb5af
Merge pull request #67511 from ClickHouse/revert-67507-revert-66536-external-replace-to-null
Revert "Revert "Add settings to replace external engines to Null during create""
2024-08-07 10:38:04 +00:00
Sema Checherinda
633f700df6 adjust tests 2024-08-07 12:23:23 +02:00
robot-clickhouse
00efd5fc0d Automatic style fix 2024-08-07 12:21:41 +02:00
Sema Checherinda
86267418f9 fix tests, rework recreation tables conditions, add log about ignored logs 2024-08-07 12:21:41 +02:00
iceFireser
7d42101593 Re-trigger ci 2024-08-07 14:19:40 +08:00
pufit
3b642e7f91
Merge pull request #66364 from azat/cluster-inter-server-secret-fix
Fix cluster() for inter-server secret (preserve initial user as before)
2024-08-07 04:58:12 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index
added tests for page index in parquet files
2024-08-07 00:15:07 +00:00
Alexey Gerasimchuck
a43ed76ae8 Fixed session log parallel/sequenced test work within a single fixture 2024-08-06 22:20:12 +00:00
Nikita Taranov
f54083a1d8
Merge branch 'master' into cpu_cgroup_aware 2024-08-06 23:13:40 +02:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Ilya Yatsishin
881d57a764
Merge branch 'master' into revert-67507-revert-66536-external-replace-to-null 2024-08-06 21:04:17 +02:00
Yatsishin Ilya
8cfcf341ae fix 2024-08-06 18:26:52 +00:00
MikhailBurdukov
012ea3cc6d Rebase 2024-08-06 15:32:04 +00:00
MikhailBurdukov
4143eea587 Add test to skip parallel 2024-08-06 15:21:50 +00:00
MikhailBurdukov
3ebc3852f4 Allow filtering ip addresses by ip family in DNS resolver 2024-08-06 15:21:49 +00:00
Michael Stetsyuk
df2675fad0 [resubmit] add replication lag and recovery time metrics 2024-08-06 15:06:02 +00:00
Azat Khuzhin
bdfaffa9d7 tests: make test_distributed_inter_server_secret idempotent
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:59:23 +02:00
Sema Checherinda
0eb6a41f57 Merge branch 'master' into chesema-processor-onCancel 2024-08-06 16:36:28 +02:00
divanik
c4e29466de qMerge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-06 11:59:47 +00:00
Andrey Zvonov
7d45424d31 specify files in test: 2024-08-06 11:18:47 +00:00
Andrey Zvonov
97f1cfc232 add ** glob to hdfs docs 2024-08-06 11:18:47 +00:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Yarik Briukhovetskyi
27cdbb54d7
fix black 2024-08-06 13:10:03 +02:00
Nikita Mikhaylov
4e2b6a5e49 Fix docs and a test 2024-08-06 13:06:34 +02:00
Sema Checherinda
995187006a rework custom table's disk usage 2024-08-06 13:05:23 +02:00
Yarik Briukhovetskyi
aa3d8086c3
fix integration tests 2024-08-06 12:30:39 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Nikita Mikhaylov
4829ba31d3 Actually fix a test 2024-08-05 21:18:53 +00:00
Azat Khuzhin
0dccc34a20 Fix cluster() for inter-server secret (preserve initial user as before)
The behaviour of cluster() with inter-server secret had been changed in #63013,
after it started to use "default" user, and this introduces a
regression.

The intention of that patch was to adjust only remote(), since it only
it accept custom user, which should be ignored.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/66287
Fixes: https://github.com/ClickHouse/ClickHouse/issues/66352
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
Azat Khuzhin
9d7710684b tests/test_distributed_inter_server_secret: get_query_user_info return list
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
divanik
9e85f89e95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-05 16:15:28 +00:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
2c78122717
Merge pull request #67667 from zvonand/fix-ldap-entrypoint-2
Even better healthcheck for ldap
2024-08-05 15:31:59 +00:00
Nikita Mikhaylov
330aae9517 Even better test 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
0301af99e5 Fixed a bunch of tests 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
d080f863ea
fix black 2024-08-05 17:07:17 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Yatsishin Ilya
3e633ad0d0 more changes 2024-08-05 14:43:28 +00:00
robot-clickhouse
5d9d5bf919 Automatic style fix 2024-08-05 16:34:55 +02:00
Sema Checherinda
462fe8b7ff repro for #67478 2024-08-05 16:34:55 +02:00
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance
Fix flaky `test_system_kafka_consumers_rebalance`
2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
János Benjamin Antal
8f6476adb7 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-05 12:26:00 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type
Support true UUID type for MongoDB engine
2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
2024-08-05 12:23:40 +00:00
Yarik Briukhovetskyi
fd1e354e85
fix flaky check for integration tests 2024-08-05 13:43:06 +02:00
maxvostrikov
e0362b00f5 squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
Nikita Fomichev
bd6c7a504d Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
János Benjamin Antal
230b5150c2 Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-05 09:14:13 +00:00
János Benjamin Antal
f816158dbc Address review comments 2024-08-05 09:11:55 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Nikita Fomichev
29f1d9df36 Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 10:03:49 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Alexey Gerasimchuck
6897178c41 fixed typo 2024-08-04 22:29:03 +00:00
Alexey Gerasimchuck
b2ec479cee Fixed race condition in session log tests 2024-08-04 22:23:08 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Alexey Milovidov
a449ffe6fc Merge branch 'master' into fix-test_delayed_replica_failover 2024-08-04 22:58:18 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec)
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq
Try to fix RabbitMQ test failures
2024-08-04 19:26:23 +02:00
Nikita Fomichev
c4a0e7665c
Merge pull request #67747 from azat/tests/test_ttl_move
Fix test_ttl_move::test_alter_with_merge_work flakiness
2024-08-04 16:47:24 +00:00
Alexey Milovidov
6fd4552fad Merge branch 'master' into fix-log-and-exception-messages-formatting 2024-08-04 18:08:28 +02:00
Alexey Milovidov
fbd3e122e1
Merge pull request #67512 from ClickHouse/divanik/fix_retry_integration_tests_decorator
[Green CI] Test `test_storage_azure_blob_storage/test.py` is flaky
2024-08-04 15:46:55 +00:00
Azat Khuzhin
062490e1b4 tests: fix test_ttl_move::test_alter_with_merge_work flakiness
Increase timeout for TTL DELETE, since otherwise if other routines will
take too long, the part will be removed when it should be still be on
"external" disk:

    2024.08.04 03:48:53.803032 [ 622 ] {} <Information> default.mt_test_alter_with_merge_work_1722743323 (9dc6904a-f082-4f06-be7a-efe4733e811c): Will drop empty part all_1_3_4_4

And this is how part_log looks like:

    SELECT
        event_time,
        event_type,
        rows,
        part_name,
        error,
        database,
        disk_name
    FROM system.part_log
    WHERE `table` = 'mt_test_alter_with_merge_work_1722743323'
    ORDER BY event_time ASC

    Query id: a118b3cd-e4fe-45a5-b675-d73bdd887d79

        ┌──────────event_time─┬─event_type─┬─rows─┬─part_name───┬─error─┬─database─┬─disk_name─┐
     1. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_1_1_0   │     0 │ default  │ jbod1     │
     2. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_2_2_0   │     0 │ default  │ jbod2     │
     3. │ 2024-08-04 03:48:45 │ NewPart    │    2 │ all_3_3_0   │     0 │ default  │ jbod1     │
     4. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_1_1_0_4 │     0 │ default  │ jbod1     │
     5. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_2_2_0_4 │     0 │ default  │ jbod2     │
     6. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_3_3_0_4 │     0 │ default  │ jbod1     │
     7. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_1_1_0_4 │     0 │ default  │ external  │
     8. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_3_3_0_4 │     0 │ default  │ jbod2     │
     9. │ 2024-08-04 03:48:47 │ MergeParts │    6 │ all_1_3_1_4 │     0 │ default  │ jbod2     │
    10. │ 2024-08-04 03:48:48 │ MovePart   │    6 │ all_1_3_1_4 │     0 │ default  │ external  │
    11. │ 2024-08-04 03:48:52 │ MergeParts │    4 │ all_1_3_2_4 │     0 │ default  │ external  │
    12. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_3_4 │     0 │ default  │ external  │ # rows==0
    13. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_4_4 │     0 │ default  │ external  │
        └─────────────────────┴────────────┴──────┴─────────────┴───────┴──────────┴───────────┘

CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__tsan__[5_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:25:18 +02:00
Azat Khuzhin
47dbc5e05b tests: add debug info into test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:16:40 +02:00
Azat Khuzhin
f0aaac3bd1 tests: remove useless retries from test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:14:42 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:06:50 +02:00
Azat Khuzhin
59e5a09b49 Use RabbitMQ without management in tests (attempt to improve startup)
Sometimes startup can take ~90 seconds [1]:

    2024-08-03 23:11:38.756067+00:00 [info] <0.9.0> Time to start RabbitMQ: 94651980 us

Unlike normally ~10 [2]:

    2024-08-04 00:33:07.016137+00:00 [info] <0.9.0> Time to start RabbitMQ: 10082489 us

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/b4e3bbcb82158bea4f5db1d9f5c28cfb741d1d51/integration_tests__asan__old_analyzer__[4_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__asan__old_analyzer__[4_6].html

I've tried locally, the difference is very small, 3135665 us
(+management) vs (2740747 us), but still something, and who knows how it
works under pressure.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:04:41 +02:00
Alexey Milovidov
6a20f777f6
Merge pull request #67428 from ClickHouse/enable-text-log
Enable `text_log` by default
2024-08-03 23:02:40 +00:00
Alexey Milovidov
a051eb2a5d Fix tests 2024-08-04 00:24:17 +02:00
Azat Khuzhin
2f00c96271 Support true UUID type for MongoDB engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-03 23:51:41 +02:00
Alexey Milovidov
60648e5240
Revert "Add replication lag and recovery time metrics" 2024-08-03 18:41:17 +02:00
Vitaly Baranov
bd22140fa4 Add test. 2024-08-03 16:20:23 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Miсhael Stetsyuk
14fce8b8da
Merge pull request #66704 from ClickHouse/add-S3DiskNoKeyErrors-metric
Add S3DiskNoKeyErrors metric
2024-08-03 12:44:33 +00:00
Antonio Andelic
1b20d47202
Merge pull request #67665 from ClickHouse/fix-udf-reload
Fix reloading SQL UDFs with UNION
2024-08-03 08:05:12 +00:00
Alexey Milovidov
74adf3d3fc Merge branch 'master' into enable-text-log 2024-08-03 02:33:37 +02:00
Alexey Milovidov
7af5340e6e
Merge pull request #67362 from ClickHouse/vdimir/test_cache_evicted_by_temporary_data
Trying to fix test_cache_evicted_by_temporary_data and print debug info
2024-08-03 00:31:09 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12
Update check_rabbitmq_is_available
2024-08-03 00:30:31 +00:00
Alexey Milovidov
dbb059912d
Merge pull request #67672 from ClickHouse/integration-tests-fix-ports
Integration tests: fix ports clashing problem
2024-08-03 00:29:58 +00:00
Antonio Andelic
10e28236b9 Merge branch 'master' into fix-udf-reload 2024-08-02 21:31:32 +02:00
Alexey Milovidov
743bd5fd6d Merge branch 'master' into enable-text-log 2024-08-02 17:49:04 +02:00
Miсhael Stetsyuk
f1df59d6c9
Merge pull request #66703 from ClickHouse/add-replication-lag-and-recovery-time-metrics
Add replication lag and recovery time metrics
2024-08-02 15:21:43 +00:00
Nikita Fomichev
1fd9464947
Merge pull request #67454 from ClickHouse/24.7-testing-and-docs
24.7 add missing documentation and testing
2024-08-02 15:00:47 +00:00
Nikita Fomichev
664e131f4f Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
Antonio Andelic
c2dd62256a
Merge pull request #67658 from ClickHouse/fix-flaky-test_replicated_table_attach
Fix flaky `test_replicated_table_attach`
2024-08-02 13:54:19 +00:00
alesapin
a930c768c3
Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch
[Docs] Building integration tests runner docker image for a local testing
2024-08-02 13:22:59 +00:00
Nikita Fomichev
5256e8e6d0 Integration tests: fix ports clashing problem 3 2024-08-02 14:36:49 +02:00
Nikita Fomichev
a64e625f0b Integration tests: fix ports clashing problem 2 2024-08-02 14:03:27 +02:00
maxvostrikov
c9b29ad113 squash! fix for parallel execution 2024-08-02 13:53:48 +02:00
Julia Kartseva
528187410f
Merge pull request #65751 from jkartseva/store-plain-rw-metadata-separately
Store `plain_rewritable` disk metadata in the separate `'__meta'` layout; add flat object storage directory structure
2024-08-02 11:52:59 +00:00
robot-clickhouse
34cba1bdda Automatic style fix 2024-08-02 11:46:12 +00:00
Michael Stetsyuk
7d45529fe8 randomize query id in test_checking_s3_blobs_paranoid 2024-08-02 12:37:40 +01:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Michael Stetsyuk
092c837119 randomize table name in test_storage_delta 2024-08-02 12:14:37 +01:00
vdimir
02e4843605
test_cache_evicted_by_temporary_data drop cache 2024-08-02 10:37:52 +00:00
Antonio Andelic
76e2e886db Merge branch 'master' into fix-udf-reload 2024-08-02 12:37:13 +02:00
Andrey Zvonov
064c0eb958 even better healthcheck for ldap 2024-08-02 10:35:32 +00:00
vdimir
eb3fd60f3e
Trying to fix test_cache_evicted_by_temporary_data and print debug info 2024-08-02 10:18:52 +00:00
serxa
8724c5ad52 Merge branch 'master' into s3-streams-scheduler 2024-08-02 09:52:55 +00:00
Yarik Briukhovetskyi
35c4ee9268
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-02 11:30:33 +02:00
Antonio Andelic
6c8f458b0b Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
Michael Stetsyuk
9c05a0ad5a rm dirs in test_storage_delta 2024-08-02 09:34:32 +01:00
Pablo Marcos
dc65c0aa07 Fix doc for parallel test execution
Copy-pasterino strikes again. I forgot to remove the single quote.
With it, pytest thinks the whole argument is a file:

(no name '/ClickHouse/tests/integration/test_storage_s3_queue/test.py::test_max_set_age -- --count 10 -n 5' in any of [<Module test.py>])
2024-08-02 07:17:09 +00:00
Antonio Andelic
774cba09df Fix flaky test_replicated_table_attach 2024-08-02 08:49:47 +02:00
iceFireser
5ebb2c54b0 Re-trigger ci 2024-08-02 14:07:44 +08:00
Julia Kartseva
d6da86dad2 Store plain_rewritable metadata in a separate layout 2024-08-02 04:28:07 +00:00
Alexey Katsman
a596f0b6d1
Merge pull request #67506 from alexkats/fix-mask
[Green CI] Fix potentially flaky test_mask_sensitive_info integration test
2024-08-01 20:55:56 +00:00
Yarik Briukhovetskyi
cdf8e5572c
Merge branch 'master' into hive_style_partitioning 2024-08-01 20:12:40 +02:00
Antonio Andelic
1d8e886d7b
Merge pull request #67448 from ClickHouse/keeper-map-retries
Add Keeper retries in `KeeperMap`
2024-08-01 17:19:19 +00:00
Antonio Andelic
bf98336819
Merge pull request #67595 from ClickHouse/update-minio
Update minio in integration tests
2024-08-01 16:19:28 +00:00
Alexey Milovidov
3603252f03 Merge branch 'master' into enable-text-log 2024-08-01 17:34:21 +02:00
Alex Katsman
0913f0189b Don't count a search query as a search pattern match 2024-08-01 14:08:50 +00:00
Michael Stetsyuk
1d85f9b1cb fix remove_local_directory_contents 2024-08-01 14:58:11 +01:00
Alexander Tokmakov
c0bd2120c8
Merge pull request #66519 from XuJia0210/feature_disable_insertion_and_mutation
Feature disable insertion and mutation
2024-08-01 13:35:25 +00:00
Vitaly Baranov
67f85fb43b
Merge pull request #67494 from vitlibar/fix-test_mutation
Fix test test_backup_restore_on_cluster/test.py::test_mutation
2024-08-01 12:49:47 +00:00
maxvostrikov
a8e7c8ae9a fix for parallel execution 2024-08-01 14:45:46 +02:00
Alexander Tokmakov
3e61ff2553
Merge pull request #67590 from pamarcos/fix-test_zookeeper_config_load_balancing
Fix test_zookeeper_config_load_balancing after adding the xdist worker name to the instance
2024-08-01 12:13:04 +00:00
Kseniia Sumarokova
2c018d6f4d
Update cluster.py 2024-08-01 13:38:41 +02:00
Yarik Briukhovetskyi
f6f85f90c3
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-01 13:15:20 +02:00
robot-clickhouse
572ad2f6fe Automatic style fix 2024-08-01 11:12:00 +00:00
maxvostrikov
928d5df3f0 added tests for https://github.com/ClickHouse/ClickHouse/pull/65475
Support writting page index into parquet file
2024-08-01 12:32:43 +02:00
Antonio Andelic
c77f6d78d9 Update minio 2024-08-01 12:09:58 +02:00
Pablo Marcos
da3a37c561 Improve regex to take into account the xdist name in the instance 2024-08-01 09:38:34 +00:00
Robert Schulze
64526e6e3a
Merge pull request #67435 from rschu1ze/multiquery-followup
Remove obsolete `--multiquery` parameter from tests
2024-08-01 09:12:41 +00:00
Antonio Andelic
7db4065898 Add retries to create 2024-08-01 10:34:53 +02:00
Antonio Andelic
c2df527a32 Reduce fault rate 2024-08-01 08:42:54 +02:00
Antonio Andelic
d571e517fa Merge branch 'master' into keeper-map-retries 2024-08-01 08:41:06 +02:00
János Benjamin Antal
0e36db5437 Do not check the value of num_messages_read because it is not reliable
librdkafka usually polls both messages on the first SELECT, but sometimes only one. If it polls only one message first, then it will read two messages before rebalancing at the second SELECT from the table. This means it usually reads a single message twice (thus num_messages_read = 4 is usually fine as 1 discarded message + 3 actually consumed message). But when only one message is read in the first SELECT, then 2 messages are discarded, thus num_messages_read will be 5 as 2 discarded message + 3 actually consumed messages.
2024-07-31 22:09:04 +00:00
Alexey Milovidov
26e42036b3 Merge branch 'master' into enable-text-log 2024-07-31 22:46:56 +02:00
robot-clickhouse
bada9ea9be Automatic style fix 2024-07-31 17:30:32 +00:00
János Benjamin Antal
e7fc206069 Add test 2024-07-31 17:20:01 +00:00
János Benjamin Antal
1e9a621b54
Merge branch 'master' into kafka-zookeeper 2024-07-31 19:16:03 +02:00
robot-clickhouse
f9c9d85e41 Automatic style fix 2024-07-31 16:51:05 +00:00
Yarik Briukhovetskyi
fac73a0944
Merge branch 'master' into hive_style_partitioning 2024-07-31 18:25:08 +02:00
Pablo Marcos
3332faa014
Merge pull request #67035 from pamarcos/fix-flaky-test_storage_s3_queue-test_max_set_age
[Green CI] Fix test test_storage_s3_queue/test.py::test_max_set_age
2024-07-31 16:09:34 +00:00
Robert Schulze
d0a030f03e
Merge remote-tracking branch 'ClickHouse/master' into multiquery-followup 2024-07-31 15:39:33 +00:00
serxa
a45027f22c Fix flaky test_delayed_replica_failover 2024-07-31 15:22:48 +00:00
divanik
67f4792b77 Style check 2024-07-31 14:16:40 +00:00
Michael Stetsyuk
27f4f468b9 make it possible to rerun test_recovery_time_metric multiple times 2024-07-31 14:55:00 +01:00
robot-clickhouse
7dbd3d7534 Automatic style fix 2024-07-31 13:51:48 +00:00
Michael Stetsyuk
31c142a96d make it possible to rerun test_storage_delta and test_checking_s3_blobs_paranoid 2024-07-31 14:44:54 +01:00
Antonio Andelic
6b7c5eb5da Fix drop 2024-07-31 14:43:58 +02:00
Pablo Marcos
15e0033016 Bring back the strict check
Also update the doc.
2024-07-31 12:09:52 +00:00
divanik
d5f8540fbb Fix 2024-07-31 12:00:09 +00:00
Ilya Yatsishin
4bf7aa1950
Revert "Revert "Add settings to replace external engines to Null during create"" 2024-07-31 13:30:14 +02:00
Vitaly Baranov
debcc2e610 Fix test test_mutation 2024-07-31 12:31:52 +02:00
divanik
7e2e24c75d Unifiing tests changes 2024-07-31 10:29:12 +00:00
Raúl Marín
4e2f8576e5
Revert "Add settings to replace external engines to Null during create" 2024-07-31 11:50:58 +02:00
Robert Schulze
85fd9fc377
Merge remote-tracking branch 'ClickHouse/master' into multiquery-followup 2024-07-31 07:49:55 +00:00
Antonio Andelic
e65cdcea1b Merge branch 'master' into keeper-map-retries 2024-07-31 09:22:53 +02:00
Antonio Andelic
34ddcdcc64
Merge pull request #67360 from ClickHouse/fix-test_replicated_table_attach
Fix attaching replicated table after exception during startup
2024-07-31 06:59:32 +00:00
Yakov Olkhovskiy
adf7ee1c7a merge master 2024-07-30 23:05:45 +00:00
Alexey Milovidov
4aedb9d402 Update test 2024-07-30 23:02:22 +02:00
Michael Stetsyuk
8d2b804c67 fxs 2024-07-30 21:57:08 +01:00
Vitaly Baranov
6c730a366e
Merge pull request #67231 from vitlibar/fix-test_broken_projections
Remove test test_broken_projections_in_backups_1
2024-07-30 17:26:44 +00:00
Sema Checherinda
a5598be1d2 Merge branch 'master' into chesema-processor-onCancel 2024-07-30 19:25:04 +02:00
Michael Stetsyuk
aa26291ff2 fxs 2024-07-30 18:15:24 +01:00
Antonio Andelic
19ac2b2cdd Merge branch 'master' into keeper-map-retries 2024-07-30 16:53:01 +02:00
Antonio Andelic
7d5c30e76c No retries when partitioned 2024-07-30 16:26:19 +02:00
Sergei Trifonov
05f1d122b1
Merge pull request #67232 from azat/dashboard-from-config-resubmit
Add ability to load dashboards for system.dashboards from config
2024-07-30 13:18:22 +00:00
iceFireser
ec759699f3 format the tests/integration/test_replicated_database/test.py 2024-07-30 21:07:59 +08:00
Michael Stetsyuk
8b52d7b711 fxs 2024-07-30 13:35:19 +01:00
divanik
de99ee1b05 Change docs 2024-07-30 12:07:31 +00:00
Antonio Andelic
0124d211ec Better 2024-07-30 14:00:52 +02:00
divanik
fd075470d6 Add docs 2024-07-30 11:54:00 +00:00
Antonio Andelic
eb129b539f Add tests 2024-07-30 13:48:14 +02:00
Robert Schulze
d4d3d590e3
Remove obsolete --multiquery parameter from tests 2024-07-30 11:04:41 +00:00
Nikita Fomichev
b1e80883f0 accept_invalid_certificate in client config: additional testing
#65238
2024-07-30 11:57:42 +02:00
Yarik Briukhovetskyi
f0da5c528f
Merge branch 'master' into hive_style_partitioning 2024-07-30 11:49:14 +02:00
haozelong
16d7ff11be Fix the problem that alter modfiy order by causes inconsistent metadata 2024-07-30 17:16:19 +08:00
Alexey Milovidov
95a5dc6f34
Merge pull request #66536 from qoega/external-replace-to-null
Add settings to replace external engines to Null during create
2024-07-30 09:03:35 +00:00
Antonio Andelic
861bdb51f8 Fix test 2024-07-30 09:43:03 +02:00
Antonio Andelic
a471ee16e1 Merge branch 'master' into fix-test_replicated_table_attach 2024-07-30 08:46:27 +02:00
Yakov Olkhovskiy
c1f45f632b merge master 2024-07-30 05:12:43 +00:00
Alexey Milovidov
5bb20f4c1c
Merge pull request #67336 from vitlibar/fix-test_disallow_concurrency
Fix test `test_backup_restore_on_cluster/test_disallow_concurrency`
2024-07-30 01:30:27 +00:00
jsc0218
10fe3e6c55
Merge pull request #65419 from jsc0218/ClearExceptionMsgTableEngineGrant
Clear Hint in Table Engine and Sources
2024-07-29 23:26:06 +00:00
Vitaly Baranov
8dfe4a93f6 Rewrite function get_broken_projections_info() without using system.errors 2024-07-29 23:44:52 +02:00
Ilya Yatsishin
06b3185e57 fixes 2024-07-29 20:05:29 +02:00
Alexey Milovidov
04447945ac
Merge pull request #66506 from ClickHouse/ast-data-type
Introduce `ASTDataType`
2024-07-29 16:08:11 +00:00
robot-clickhouse
f7f2a9872d Automatic style fix 2024-07-29 16:02:14 +00:00
János Benjamin Antal
28ae671875 Print debug info 2024-07-29 15:52:25 +00:00
János Benjamin Antal
b9670c782f Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-07-29 14:42:41 +00:00
Ilya Yatsishin
efa218b534 address comments 2024-07-29 15:54:54 +02:00
Ilya Yatsishin
307e1be999 Merge remote-tracking branch 'origin/master' into external-replace-to-null 2024-07-29 15:48:43 +02:00
jsc0218
4df64a40e2 Merge remote-tracking branch 'origin/master' into ClearExceptionMsgTableEngineGrant 2024-07-29 13:17:48 +00:00
Antonio Andelic
aa50bb0987 Fix attach thread after exception 2024-07-29 13:55:16 +02:00
Vitaly Baranov
634c513ba7 Fix cleanup in test_backup_restore_on_cluster/test.py::test_system_functions 2024-07-29 13:19:24 +02:00
Pablo Marcos
ba63bd1de7 Merge branch 'master' into fix-flaky-test_storage_s3_queue-test_max_set_age 2024-07-29 11:15:31 +00:00
Pablo Marcos
4cf7e6a79d Remove logging traces to help debugging 2024-07-29 11:15:03 +00:00
Vitaly Baranov
6c104e7c73 Simplify test test_backup_restore_on_cluster/test_disallow_concurrency 2024-07-29 13:12:05 +02:00
Vitaly Baranov
8f6a8b7ad6 Fix test test_backup_restore_on_cluster/test_disallow_concurrency 2024-07-29 13:12:05 +02:00
Kruglov Pavel
813f4015db
Merge branch 'master' into json-data-type 2024-07-29 13:08:51 +02:00
Pablo Marcos
5b9427dc56 Fix test flakiness
- Increase from 10s to 20s the max_age. Removes flakiness due to
  the files in minio still present in following execution, even
  if the cleanup stage of the test is clearly removing them.
- Use a busy-loop to check conditions directly, removing the
  unnecessary sleep.
2024-07-29 10:36:18 +00:00
Andrey Zvonov
ac001c0c6f no parallel for kerberized kafka 2024-07-29 08:41:23 +00:00
Vitaly Baranov
56353f7d22 Remove test test_broken_projections_in_backups_1 2024-07-29 05:25:46 +02:00
Alexey Milovidov
da582fd2e9 Merge branch 'fix-kafka' into ast-data-type 2024-07-28 21:17:52 +02:00
Alexey Milovidov
1f784d1862 Tests for Kafka cannot run in parallel 2024-07-28 21:15:23 +02:00
Alexey Milovidov
10b3cb92bc Tests for Kafka cannot run in parallel 2024-07-28 21:14:47 +02:00
Vitaly Baranov
99322feabe Add parameter 'backups.test_randomize_order' to backup configuration
to make reproducing the issue easier.
2024-07-28 03:44:01 +02:00
Alexey Milovidov
3818d701d6 Merge branch 'master' into ast-data-type 2024-07-27 04:19:41 +02:00
Azat Khuzhin
870ec237bb Add ability to load dashboards for system.dashboards from config
One of the obvious reasons is to allow rendering them with readonly
user, which is not possible right now, due to usage of merge() function
there.

Another one, is to add some custom metrics.

Note, that once set, they overrides the default dashboards preset.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-26 21:21:09 +02:00
Sergei Trifonov
8943561372
Merge pull request #67223 from ClickHouse/fix-test-pkill
Fix flaky `test_pkill_query_log` (tsan)
2024-07-26 17:57:11 +00:00
serxa
1e12ac577a Fix flaky test_pkill_query_log (tsan) 2024-07-26 14:26:37 +00:00
Alexey Milovidov
36a875dda4 Merge branch 'fix-idiotic-code' into ast-data-type 2024-07-26 15:32:15 +02:00
Han Fei
a9ceb0c49c
Merge pull request #66915 from zvonand/zvonand-fix-66835
[CI fest] Try to fix `test_broken_projections/test.py::test_broken_ignored_replicated`
2024-07-26 11:31:32 +00:00