Commit Graph

10342 Commits

Author SHA1 Message Date
Yarik Briukhovetskyi
27cdbb54d7
fix black 2024-08-06 13:10:03 +02:00
Nikita Mikhaylov
4e2b6a5e49 Fix docs and a test 2024-08-06 13:06:34 +02:00
Sema Checherinda
995187006a rework custom table's disk usage 2024-08-06 13:05:23 +02:00
Yarik Briukhovetskyi
aa3d8086c3
fix integration tests 2024-08-06 12:30:39 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Nikita Mikhaylov
4829ba31d3 Actually fix a test 2024-08-05 21:18:53 +00:00
Azat Khuzhin
0dccc34a20 Fix cluster() for inter-server secret (preserve initial user as before)
The behaviour of cluster() with inter-server secret had been changed in #63013,
after it started to use "default" user, and this introduces a
regression.

The intention of that patch was to adjust only remote(), since it only
it accept custom user, which should be ignored.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/66287
Fixes: https://github.com/ClickHouse/ClickHouse/issues/66352
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
Azat Khuzhin
9d7710684b tests/test_distributed_inter_server_secret: get_query_user_info return list
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:24:24 +02:00
divanik
9e85f89e95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_local_and_azure_iceberg_support 2024-08-05 16:15:28 +00:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
2c78122717
Merge pull request #67667 from zvonand/fix-ldap-entrypoint-2
Even better healthcheck for ldap
2024-08-05 15:31:59 +00:00
Nikita Mikhaylov
330aae9517 Even better test 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
0301af99e5 Fixed a bunch of tests 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
d080f863ea
fix black 2024-08-05 17:07:17 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Yatsishin Ilya
3e633ad0d0 more changes 2024-08-05 14:43:28 +00:00
robot-clickhouse
5d9d5bf919 Automatic style fix 2024-08-05 16:34:55 +02:00
Sema Checherinda
462fe8b7ff repro for #67478 2024-08-05 16:34:55 +02:00
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance
Fix flaky `test_system_kafka_consumers_rebalance`
2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
János Benjamin Antal
8f6476adb7 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-05 12:26:00 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type
Support true UUID type for MongoDB engine
2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
2024-08-05 12:23:40 +00:00
Yarik Briukhovetskyi
fd1e354e85
fix flaky check for integration tests 2024-08-05 13:43:06 +02:00
maxvostrikov
e0362b00f5 squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
Nikita Fomichev
bd6c7a504d Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
János Benjamin Antal
230b5150c2 Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-05 09:14:13 +00:00
János Benjamin Antal
f816158dbc Address review comments 2024-08-05 09:11:55 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Nikita Fomichev
29f1d9df36 Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 10:03:49 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Alexey Gerasimchuck
6897178c41 fixed typo 2024-08-04 22:29:03 +00:00
Alexey Gerasimchuck
b2ec479cee Fixed race condition in session log tests 2024-08-04 22:23:08 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Alexey Milovidov
a449ffe6fc Merge branch 'master' into fix-test_delayed_replica_failover 2024-08-04 22:58:18 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec)
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq
Try to fix RabbitMQ test failures
2024-08-04 19:26:23 +02:00
Nikita Fomichev
c4a0e7665c
Merge pull request #67747 from azat/tests/test_ttl_move
Fix test_ttl_move::test_alter_with_merge_work flakiness
2024-08-04 16:47:24 +00:00
Alexey Milovidov
6fd4552fad Merge branch 'master' into fix-log-and-exception-messages-formatting 2024-08-04 18:08:28 +02:00
Alexey Milovidov
fbd3e122e1
Merge pull request #67512 from ClickHouse/divanik/fix_retry_integration_tests_decorator
[Green CI] Test `test_storage_azure_blob_storage/test.py` is flaky
2024-08-04 15:46:55 +00:00
Azat Khuzhin
062490e1b4 tests: fix test_ttl_move::test_alter_with_merge_work flakiness
Increase timeout for TTL DELETE, since otherwise if other routines will
take too long, the part will be removed when it should be still be on
"external" disk:

    2024.08.04 03:48:53.803032 [ 622 ] {} <Information> default.mt_test_alter_with_merge_work_1722743323 (9dc6904a-f082-4f06-be7a-efe4733e811c): Will drop empty part all_1_3_4_4

And this is how part_log looks like:

    SELECT
        event_time,
        event_type,
        rows,
        part_name,
        error,
        database,
        disk_name
    FROM system.part_log
    WHERE `table` = 'mt_test_alter_with_merge_work_1722743323'
    ORDER BY event_time ASC

    Query id: a118b3cd-e4fe-45a5-b675-d73bdd887d79

        ┌──────────event_time─┬─event_type─┬─rows─┬─part_name───┬─error─┬─database─┬─disk_name─┐
     1. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_1_1_0   │     0 │ default  │ jbod1     │
     2. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_2_2_0   │     0 │ default  │ jbod2     │
     3. │ 2024-08-04 03:48:45 │ NewPart    │    2 │ all_3_3_0   │     0 │ default  │ jbod1     │
     4. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_1_1_0_4 │     0 │ default  │ jbod1     │
     5. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_2_2_0_4 │     0 │ default  │ jbod2     │
     6. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_3_3_0_4 │     0 │ default  │ jbod1     │
     7. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_1_1_0_4 │     0 │ default  │ external  │
     8. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_3_3_0_4 │     0 │ default  │ jbod2     │
     9. │ 2024-08-04 03:48:47 │ MergeParts │    6 │ all_1_3_1_4 │     0 │ default  │ jbod2     │
    10. │ 2024-08-04 03:48:48 │ MovePart   │    6 │ all_1_3_1_4 │     0 │ default  │ external  │
    11. │ 2024-08-04 03:48:52 │ MergeParts │    4 │ all_1_3_2_4 │     0 │ default  │ external  │
    12. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_3_4 │     0 │ default  │ external  │ # rows==0
    13. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_4_4 │     0 │ default  │ external  │
        └─────────────────────┴────────────┴──────┴─────────────┴───────┴──────────┴───────────┘

CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__tsan__[5_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:25:18 +02:00
Azat Khuzhin
47dbc5e05b tests: add debug info into test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:16:40 +02:00
Azat Khuzhin
f0aaac3bd1 tests: remove useless retries from test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:14:42 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:06:50 +02:00
Azat Khuzhin
59e5a09b49 Use RabbitMQ without management in tests (attempt to improve startup)
Sometimes startup can take ~90 seconds [1]:

    2024-08-03 23:11:38.756067+00:00 [info] <0.9.0> Time to start RabbitMQ: 94651980 us

Unlike normally ~10 [2]:

    2024-08-04 00:33:07.016137+00:00 [info] <0.9.0> Time to start RabbitMQ: 10082489 us

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/b4e3bbcb82158bea4f5db1d9f5c28cfb741d1d51/integration_tests__asan__old_analyzer__[4_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__asan__old_analyzer__[4_6].html

I've tried locally, the difference is very small, 3135665 us
(+management) vs (2740747 us), but still something, and who knows how it
works under pressure.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:04:41 +02:00
Alexey Milovidov
6a20f777f6
Merge pull request #67428 from ClickHouse/enable-text-log
Enable `text_log` by default
2024-08-03 23:02:40 +00:00
Alexey Milovidov
a051eb2a5d Fix tests 2024-08-04 00:24:17 +02:00
Azat Khuzhin
2f00c96271 Support true UUID type for MongoDB engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-03 23:51:41 +02:00
Alexey Milovidov
60648e5240
Revert "Add replication lag and recovery time metrics" 2024-08-03 18:41:17 +02:00
Vitaly Baranov
bd22140fa4 Add test. 2024-08-03 16:20:23 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Miсhael Stetsyuk
14fce8b8da
Merge pull request #66704 from ClickHouse/add-S3DiskNoKeyErrors-metric
Add S3DiskNoKeyErrors metric
2024-08-03 12:44:33 +00:00
Antonio Andelic
1b20d47202
Merge pull request #67665 from ClickHouse/fix-udf-reload
Fix reloading SQL UDFs with UNION
2024-08-03 08:05:12 +00:00
Alexey Milovidov
74adf3d3fc Merge branch 'master' into enable-text-log 2024-08-03 02:33:37 +02:00
Alexey Milovidov
7af5340e6e
Merge pull request #67362 from ClickHouse/vdimir/test_cache_evicted_by_temporary_data
Trying to fix test_cache_evicted_by_temporary_data and print debug info
2024-08-03 00:31:09 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12
Update check_rabbitmq_is_available
2024-08-03 00:30:31 +00:00
Alexey Milovidov
dbb059912d
Merge pull request #67672 from ClickHouse/integration-tests-fix-ports
Integration tests: fix ports clashing problem
2024-08-03 00:29:58 +00:00
Antonio Andelic
10e28236b9 Merge branch 'master' into fix-udf-reload 2024-08-02 21:31:32 +02:00
Alexey Milovidov
743bd5fd6d Merge branch 'master' into enable-text-log 2024-08-02 17:49:04 +02:00
Miсhael Stetsyuk
f1df59d6c9
Merge pull request #66703 from ClickHouse/add-replication-lag-and-recovery-time-metrics
Add replication lag and recovery time metrics
2024-08-02 15:21:43 +00:00
Nikita Fomichev
1fd9464947
Merge pull request #67454 from ClickHouse/24.7-testing-and-docs
24.7 add missing documentation and testing
2024-08-02 15:00:47 +00:00
Nikita Fomichev
664e131f4f Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
Antonio Andelic
c2dd62256a
Merge pull request #67658 from ClickHouse/fix-flaky-test_replicated_table_attach
Fix flaky `test_replicated_table_attach`
2024-08-02 13:54:19 +00:00
Pablo Marcos
27cada2017 Merge branch 'master' into system-query-metric-log 2024-08-02 13:23:31 +00:00
alesapin
a930c768c3
Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch
[Docs] Building integration tests runner docker image for a local testing
2024-08-02 13:22:59 +00:00
Nikita Fomichev
5256e8e6d0 Integration tests: fix ports clashing problem 3 2024-08-02 14:36:49 +02:00
Nikita Fomichev
a64e625f0b Integration tests: fix ports clashing problem 2 2024-08-02 14:03:27 +02:00
maxvostrikov
c9b29ad113 squash! fix for parallel execution 2024-08-02 13:53:48 +02:00
Julia Kartseva
528187410f
Merge pull request #65751 from jkartseva/store-plain-rw-metadata-separately
Store `plain_rewritable` disk metadata in the separate `'__meta'` layout; add flat object storage directory structure
2024-08-02 11:52:59 +00:00
robot-clickhouse
34cba1bdda Automatic style fix 2024-08-02 11:46:12 +00:00
Michael Stetsyuk
7d45529fe8 randomize query id in test_checking_s3_blobs_paranoid 2024-08-02 12:37:40 +01:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Michael Stetsyuk
092c837119 randomize table name in test_storage_delta 2024-08-02 12:14:37 +01:00
vdimir
02e4843605
test_cache_evicted_by_temporary_data drop cache 2024-08-02 10:37:52 +00:00
Antonio Andelic
76e2e886db Merge branch 'master' into fix-udf-reload 2024-08-02 12:37:13 +02:00
Andrey Zvonov
064c0eb958 even better healthcheck for ldap 2024-08-02 10:35:32 +00:00
vdimir
eb3fd60f3e
Trying to fix test_cache_evicted_by_temporary_data and print debug info 2024-08-02 10:18:52 +00:00
Yarik Briukhovetskyi
35c4ee9268
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-02 11:30:33 +02:00
Antonio Andelic
6c8f458b0b Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
Michael Stetsyuk
9c05a0ad5a rm dirs in test_storage_delta 2024-08-02 09:34:32 +01:00
Pablo Marcos
dc65c0aa07 Fix doc for parallel test execution
Copy-pasterino strikes again. I forgot to remove the single quote.
With it, pytest thinks the whole argument is a file:

(no name '/ClickHouse/tests/integration/test_storage_s3_queue/test.py::test_max_set_age -- --count 10 -n 5' in any of [<Module test.py>])
2024-08-02 07:17:09 +00:00
Antonio Andelic
774cba09df Fix flaky test_replicated_table_attach 2024-08-02 08:49:47 +02:00
Julia Kartseva
d6da86dad2 Store plain_rewritable metadata in a separate layout 2024-08-02 04:28:07 +00:00
Alexey Katsman
a596f0b6d1
Merge pull request #67506 from alexkats/fix-mask
[Green CI] Fix potentially flaky test_mask_sensitive_info integration test
2024-08-01 20:55:56 +00:00
Yarik Briukhovetskyi
cdf8e5572c
Merge branch 'master' into hive_style_partitioning 2024-08-01 20:12:40 +02:00
Antonio Andelic
1d8e886d7b
Merge pull request #67448 from ClickHouse/keeper-map-retries
Add Keeper retries in `KeeperMap`
2024-08-01 17:19:19 +00:00
Antonio Andelic
bf98336819
Merge pull request #67595 from ClickHouse/update-minio
Update minio in integration tests
2024-08-01 16:19:28 +00:00
Alexey Milovidov
3603252f03 Merge branch 'master' into enable-text-log 2024-08-01 17:34:21 +02:00
Alex Katsman
0913f0189b Don't count a search query as a search pattern match 2024-08-01 14:08:50 +00:00
Michael Stetsyuk
1d85f9b1cb fix remove_local_directory_contents 2024-08-01 14:58:11 +01:00
Alexander Tokmakov
c0bd2120c8
Merge pull request #66519 from XuJia0210/feature_disable_insertion_and_mutation
Feature disable insertion and mutation
2024-08-01 13:35:25 +00:00
Vitaly Baranov
67f85fb43b
Merge pull request #67494 from vitlibar/fix-test_mutation
Fix test test_backup_restore_on_cluster/test.py::test_mutation
2024-08-01 12:49:47 +00:00
maxvostrikov
a8e7c8ae9a fix for parallel execution 2024-08-01 14:45:46 +02:00
Alexander Tokmakov
3e61ff2553
Merge pull request #67590 from pamarcos/fix-test_zookeeper_config_load_balancing
Fix test_zookeeper_config_load_balancing after adding the xdist worker name to the instance
2024-08-01 12:13:04 +00:00
Kseniia Sumarokova
2c018d6f4d
Update cluster.py 2024-08-01 13:38:41 +02:00
Yarik Briukhovetskyi
f6f85f90c3
Merge branch 'ClickHouse:master' into hive_style_partitioning 2024-08-01 13:15:20 +02:00
robot-clickhouse
572ad2f6fe Automatic style fix 2024-08-01 11:12:00 +00:00
maxvostrikov
928d5df3f0 added tests for https://github.com/ClickHouse/ClickHouse/pull/65475
Support writting page index into parquet file
2024-08-01 12:32:43 +02:00
Antonio Andelic
c77f6d78d9 Update minio 2024-08-01 12:09:58 +02:00
Pablo Marcos
da3a37c561 Improve regex to take into account the xdist name in the instance 2024-08-01 09:38:34 +00:00
Robert Schulze
64526e6e3a
Merge pull request #67435 from rschu1ze/multiquery-followup
Remove obsolete `--multiquery` parameter from tests
2024-08-01 09:12:41 +00:00
Antonio Andelic
7db4065898 Add retries to create 2024-08-01 10:34:53 +02:00
Antonio Andelic
c2df527a32 Reduce fault rate 2024-08-01 08:42:54 +02:00
Antonio Andelic
d571e517fa Merge branch 'master' into keeper-map-retries 2024-08-01 08:41:06 +02:00
János Benjamin Antal
0e36db5437 Do not check the value of num_messages_read because it is not reliable
librdkafka usually polls both messages on the first SELECT, but sometimes only one. If it polls only one message first, then it will read two messages before rebalancing at the second SELECT from the table. This means it usually reads a single message twice (thus num_messages_read = 4 is usually fine as 1 discarded message + 3 actually consumed message). But when only one message is read in the first SELECT, then 2 messages are discarded, thus num_messages_read will be 5 as 2 discarded message + 3 actually consumed messages.
2024-07-31 22:09:04 +00:00
Alexey Milovidov
26e42036b3 Merge branch 'master' into enable-text-log 2024-07-31 22:46:56 +02:00
robot-clickhouse
bada9ea9be Automatic style fix 2024-07-31 17:30:32 +00:00
János Benjamin Antal
e7fc206069 Add test 2024-07-31 17:20:01 +00:00
János Benjamin Antal
1e9a621b54
Merge branch 'master' into kafka-zookeeper 2024-07-31 19:16:03 +02:00
robot-clickhouse
f9c9d85e41 Automatic style fix 2024-07-31 16:51:05 +00:00
Yarik Briukhovetskyi
fac73a0944
Merge branch 'master' into hive_style_partitioning 2024-07-31 18:25:08 +02:00
Pablo Marcos
3332faa014
Merge pull request #67035 from pamarcos/fix-flaky-test_storage_s3_queue-test_max_set_age
[Green CI] Fix test test_storage_s3_queue/test.py::test_max_set_age
2024-07-31 16:09:34 +00:00
Robert Schulze
d0a030f03e
Merge remote-tracking branch 'ClickHouse/master' into multiquery-followup 2024-07-31 15:39:33 +00:00
serxa
a45027f22c Fix flaky test_delayed_replica_failover 2024-07-31 15:22:48 +00:00
divanik
67f4792b77 Style check 2024-07-31 14:16:40 +00:00
Michael Stetsyuk
27f4f468b9 make it possible to rerun test_recovery_time_metric multiple times 2024-07-31 14:55:00 +01:00
robot-clickhouse
7dbd3d7534 Automatic style fix 2024-07-31 13:51:48 +00:00
Michael Stetsyuk
31c142a96d make it possible to rerun test_storage_delta and test_checking_s3_blobs_paranoid 2024-07-31 14:44:54 +01:00
Antonio Andelic
6b7c5eb5da Fix drop 2024-07-31 14:43:58 +02:00
Pablo Marcos
15e0033016 Bring back the strict check
Also update the doc.
2024-07-31 12:09:52 +00:00
divanik
d5f8540fbb Fix 2024-07-31 12:00:09 +00:00
Ilya Yatsishin
4bf7aa1950
Revert "Revert "Add settings to replace external engines to Null during create"" 2024-07-31 13:30:14 +02:00
Vitaly Baranov
debcc2e610 Fix test test_mutation 2024-07-31 12:31:52 +02:00
divanik
7e2e24c75d Unifiing tests changes 2024-07-31 10:29:12 +00:00
Raúl Marín
4e2f8576e5
Revert "Add settings to replace external engines to Null during create" 2024-07-31 11:50:58 +02:00
Robert Schulze
85fd9fc377
Merge remote-tracking branch 'ClickHouse/master' into multiquery-followup 2024-07-31 07:49:55 +00:00
Antonio Andelic
e65cdcea1b Merge branch 'master' into keeper-map-retries 2024-07-31 09:22:53 +02:00
Antonio Andelic
34ddcdcc64
Merge pull request #67360 from ClickHouse/fix-test_replicated_table_attach
Fix attaching replicated table after exception during startup
2024-07-31 06:59:32 +00:00
Yakov Olkhovskiy
adf7ee1c7a merge master 2024-07-30 23:05:45 +00:00
Alexey Milovidov
4aedb9d402 Update test 2024-07-30 23:02:22 +02:00
Michael Stetsyuk
8d2b804c67 fxs 2024-07-30 21:57:08 +01:00
Vitaly Baranov
6c730a366e
Merge pull request #67231 from vitlibar/fix-test_broken_projections
Remove test test_broken_projections_in_backups_1
2024-07-30 17:26:44 +00:00
Sema Checherinda
a5598be1d2 Merge branch 'master' into chesema-processor-onCancel 2024-07-30 19:25:04 +02:00
Michael Stetsyuk
aa26291ff2 fxs 2024-07-30 18:15:24 +01:00
Antonio Andelic
19ac2b2cdd Merge branch 'master' into keeper-map-retries 2024-07-30 16:53:01 +02:00
Antonio Andelic
7d5c30e76c No retries when partitioned 2024-07-30 16:26:19 +02:00
Sergei Trifonov
05f1d122b1
Merge pull request #67232 from azat/dashboard-from-config-resubmit
Add ability to load dashboards for system.dashboards from config
2024-07-30 13:18:22 +00:00
Michael Stetsyuk
8b52d7b711 fxs 2024-07-30 13:35:19 +01:00
divanik
de99ee1b05 Change docs 2024-07-30 12:07:31 +00:00
Antonio Andelic
0124d211ec Better 2024-07-30 14:00:52 +02:00
divanik
fd075470d6 Add docs 2024-07-30 11:54:00 +00:00
Antonio Andelic
eb129b539f Add tests 2024-07-30 13:48:14 +02:00
Robert Schulze
d4d3d590e3
Remove obsolete --multiquery parameter from tests 2024-07-30 11:04:41 +00:00
Nikita Fomichev
b1e80883f0 accept_invalid_certificate in client config: additional testing
#65238
2024-07-30 11:57:42 +02:00
Yarik Briukhovetskyi
f0da5c528f
Merge branch 'master' into hive_style_partitioning 2024-07-30 11:49:14 +02:00
Alexey Milovidov
95a5dc6f34
Merge pull request #66536 from qoega/external-replace-to-null
Add settings to replace external engines to Null during create
2024-07-30 09:03:35 +00:00
Antonio Andelic
861bdb51f8 Fix test 2024-07-30 09:43:03 +02:00
Antonio Andelic
a471ee16e1 Merge branch 'master' into fix-test_replicated_table_attach 2024-07-30 08:46:27 +02:00
Yakov Olkhovskiy
c1f45f632b merge master 2024-07-30 05:12:43 +00:00
Alexey Milovidov
5bb20f4c1c
Merge pull request #67336 from vitlibar/fix-test_disallow_concurrency
Fix test `test_backup_restore_on_cluster/test_disallow_concurrency`
2024-07-30 01:30:27 +00:00
jsc0218
10fe3e6c55
Merge pull request #65419 from jsc0218/ClearExceptionMsgTableEngineGrant
Clear Hint in Table Engine and Sources
2024-07-29 23:26:06 +00:00
Vitaly Baranov
8dfe4a93f6 Rewrite function get_broken_projections_info() without using system.errors 2024-07-29 23:44:52 +02:00
Ilya Yatsishin
06b3185e57 fixes 2024-07-29 20:05:29 +02:00
Alexey Milovidov
04447945ac
Merge pull request #66506 from ClickHouse/ast-data-type
Introduce `ASTDataType`
2024-07-29 16:08:11 +00:00
robot-clickhouse
f7f2a9872d Automatic style fix 2024-07-29 16:02:14 +00:00
János Benjamin Antal
28ae671875 Print debug info 2024-07-29 15:52:25 +00:00
János Benjamin Antal
b9670c782f Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-07-29 14:42:41 +00:00
Ilya Yatsishin
efa218b534 address comments 2024-07-29 15:54:54 +02:00
Ilya Yatsishin
307e1be999 Merge remote-tracking branch 'origin/master' into external-replace-to-null 2024-07-29 15:48:43 +02:00
jsc0218
4df64a40e2 Merge remote-tracking branch 'origin/master' into ClearExceptionMsgTableEngineGrant 2024-07-29 13:17:48 +00:00
Antonio Andelic
aa50bb0987 Fix attach thread after exception 2024-07-29 13:55:16 +02:00
Vitaly Baranov
634c513ba7 Fix cleanup in test_backup_restore_on_cluster/test.py::test_system_functions 2024-07-29 13:19:24 +02:00
Pablo Marcos
ba63bd1de7 Merge branch 'master' into fix-flaky-test_storage_s3_queue-test_max_set_age 2024-07-29 11:15:31 +00:00
Pablo Marcos
4cf7e6a79d Remove logging traces to help debugging 2024-07-29 11:15:03 +00:00
Vitaly Baranov
6c104e7c73 Simplify test test_backup_restore_on_cluster/test_disallow_concurrency 2024-07-29 13:12:05 +02:00
Vitaly Baranov
8f6a8b7ad6 Fix test test_backup_restore_on_cluster/test_disallow_concurrency 2024-07-29 13:12:05 +02:00
Kruglov Pavel
813f4015db
Merge branch 'master' into json-data-type 2024-07-29 13:08:51 +02:00
Pablo Marcos
5b9427dc56 Fix test flakiness
- Increase from 10s to 20s the max_age. Removes flakiness due to
  the files in minio still present in following execution, even
  if the cleanup stage of the test is clearly removing them.
- Use a busy-loop to check conditions directly, removing the
  unnecessary sleep.
2024-07-29 10:36:18 +00:00
Andrey Zvonov
ac001c0c6f no parallel for kerberized kafka 2024-07-29 08:41:23 +00:00
Vitaly Baranov
56353f7d22 Remove test test_broken_projections_in_backups_1 2024-07-29 05:25:46 +02:00
Alexey Milovidov
da582fd2e9 Merge branch 'fix-kafka' into ast-data-type 2024-07-28 21:17:52 +02:00
Alexey Milovidov
1f784d1862 Tests for Kafka cannot run in parallel 2024-07-28 21:15:23 +02:00
Alexey Milovidov
10b3cb92bc Tests for Kafka cannot run in parallel 2024-07-28 21:14:47 +02:00
Vitaly Baranov
99322feabe Add parameter 'backups.test_randomize_order' to backup configuration
to make reproducing the issue easier.
2024-07-28 03:44:01 +02:00
Alexey Milovidov
3818d701d6 Merge branch 'master' into ast-data-type 2024-07-27 04:19:41 +02:00
Azat Khuzhin
870ec237bb Add ability to load dashboards for system.dashboards from config
One of the obvious reasons is to allow rendering them with readonly
user, which is not possible right now, due to usage of merge() function
there.

Another one, is to add some custom metrics.

Note, that once set, they overrides the default dashboards preset.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-07-26 21:21:09 +02:00
Sergei Trifonov
8943561372
Merge pull request #67223 from ClickHouse/fix-test-pkill
Fix flaky `test_pkill_query_log` (tsan)
2024-07-26 17:57:11 +00:00
serxa
1e12ac577a Fix flaky test_pkill_query_log (tsan) 2024-07-26 14:26:37 +00:00
Alexey Milovidov
36a875dda4 Merge branch 'fix-idiotic-code' into ast-data-type 2024-07-26 15:32:15 +02:00
Han Fei
a9ceb0c49c
Merge pull request #66915 from zvonand/zvonand-fix-66835
[CI fest] Try to fix `test_broken_projections/test.py::test_broken_ignored_replicated`
2024-07-26 11:31:32 +00:00
Pablo Marcos
3f1dbdfce9 Clarify documentation 2024-07-26 11:01:10 +00:00
Pablo Marcos
98418120cd Add parallel integration test execution to doc 2024-07-26 10:22:57 +00:00
Pablo Marcos
5bf89a4331 Set a different instance dir when using pytest-xdist
This allows executing in integration tests in parallel
without directory clashes.
2024-07-26 08:42:54 +00:00
Alexey Milovidov
d00a29898e Merge branch 'master' into ast-data-type 2024-07-26 04:56:05 +02:00
Igor Nikonov
e32109174e
Merge pull request #66880 from zoomxi/unavaliable_replicas
Fix: throw if can't connect to any participating replicas for parallel replicas query execution
2024-07-25 19:56:06 +00:00
Alexey Milovidov
4bf8d72a67 Merge branch 'fix-idiotic-code' into ast-data-type 2024-07-25 19:06:15 +02:00
Alexey Milovidov
76fc054aa8
Merge pull request #66998 from ClickHouse/remove-kerberized-hdfs
Remove the support for Kerberized HDFS
2024-07-25 16:51:12 +00:00
Yatsishin Ilya
e57f5a90ea Merge remote-tracking branch 'origin' into improve-integration-tests-3 2024-07-25 14:53:10 +00:00
Pablo Marcos
59f9c12504 Increase sleep time make sure there is a new failure
The previous sleep was already adding +5s to make sure
the TTL was properly applied, so we'd rather use the
same value here instead of just 1s.
2024-07-25 14:37:50 +00:00
Antonio Andelic
670413a69d
Merge pull request #67016 from ClickHouse/static-order-mess
Try to fix exception logging in destructors of static objects
2024-07-25 13:46:22 +00:00
Daniil Ivanik
2457a2a7d7
Merge pull request #66851 from yohannj/fix_error_codes
Update error codes related to number of accepted arguments
2024-07-25 13:32:14 +00:00
Vitaly Baranov
ac514a5103
Merge pull request #66881 from vitlibar/fix-broken-part-error-while-restoring-to-s3-plain-rewritable
Fix broken part error while restoring to s3_plain_rewritable
2024-07-25 11:16:31 +00:00
alesapin
0a023e763a
Merge pull request #67067 from ClickHouse/increase_timeout_for_server
[CI Fest] Increase timeout for test_broken_part_during_merge
2024-07-25 10:17:09 +00:00
János Benjamin Antal
d785f4dde9
Merge pull request #67070 from ClickHouse/fix-flaky-test-seekable-formats-tests
Fix flaky `test_seekable_formats_url` and `test_seekable_formats` S3 storage tests
2024-07-25 08:32:52 +00:00
Ilya Yatsishin
db5b4c0e96
Merge pull request #66986 from qoega/integration-flaky-check-repeat
Add hardening to integration tests flaky check: repeat test case multiple times with same environment.
2024-07-25 08:18:37 +00:00
Nikita Fomichev
e1f89f41f7
Merge pull request #67027 from ClickHouse/fix-flaky-integration-tests
Integration tests: fix flaky tests `test_backup_restore_on_cluster/test_concurrency.py` & `test_manipulate_statistics/test.py`
2024-07-25 07:50:17 +00:00
zoomxi
82959ce5b3 format test.py 2024-07-25 09:55:23 +08:00
Yatsishin Ilya
5f5eb0a3f2 Merge remote-tracking branch 'origin' into improve-integration-tests-3 2024-07-24 20:29:09 +00:00
Yatsishin Ilya
b77d1b35d5 Merge branch 'qoega-patch-6' into improve-integration-tests-3 2024-07-24 20:29:01 +00:00
Yatsishin Ilya
34c8351bce black 2024-07-24 19:55:21 +00:00
Yatsishin Ilya
9c28c64adf Fix deprecated HDFS image and harden test_storage_hdfs. 2024-07-24 19:55:03 +00:00
Kruglov Pavel
d694723d5f
Merge branch 'master' into json-data-type 2024-07-24 21:26:20 +02:00
Alexey Milovidov
397a523971
Merge pull request #67019 from ClickHouse/divanik/fix_test_azure_flaky
[Green CI] Fix test test_storage_azure_blob_storage
2024-07-24 19:03:05 +00:00
robot-clickhouse
ce153c9b54 Automatic style fix 2024-07-24 16:05:18 +00:00
Vitaly Baranov
2e25808e58 Fix test test_backup_restore_s3. 2024-07-24 18:04:29 +02:00
János Benjamin Antal
fa48ff0ca1 Separate tests 2024-07-24 15:49:17 +00:00
alesapin
f990f235da Increase timeout for test_broken_part_during_merge 2024-07-24 17:20:19 +02:00
Pablo Marcos
f03d4bb7d5 Format with black 2024-07-24 15:10:25 +00:00
Alexey Milovidov
01ce22049a Fix tests 2024-07-24 14:29:14 +02:00
Pablo Marcos
91b7001df6 Refactor test to improve it
- Create wait_for_condition that checks greedily for a period of time
- Remove redundant checks
- Allow other tests running in parallel to have `ObjectStorageQueueFailedFiles` errors
2024-07-24 12:08:31 +00:00
Nikita Fomichev
9aaf806021 Integration tests: fix flaky tests 2 2024-07-24 14:03:40 +02:00
Pablo Marcos
b25cad23ed Use unique names for tables and files 2024-07-24 11:42:51 +00:00
Yatsishin Ilya
e57fca5af5 Merge branch 'integration-flaky-check-repeat' into improve-integration-tests-3 2024-07-24 11:34:23 +00:00
Yatsishin Ilya
d507adf9a7 fix 2024-07-24 11:33:31 +00:00
Nikita Fomichev
2ea10d9994 Integration tests: fix flaky tests 2024-07-24 13:13:58 +02:00
divanik
f21a9e5d08 Fix bug 2024-07-24 11:00:49 +00:00
divanik
1b95a68dc0 Fix typo 2024-07-24 10:48:18 +00:00
divanik
8c19d502f8 Add decorator and retries for azurite 2024-07-24 10:44:06 +00:00
robot-clickhouse
e7b5c0ea19 Automatic style fix 2024-07-24 10:14:35 +00:00
Antonio Andelic
48b3008126 Handle better static destructors 2024-07-24 12:04:28 +02:00
Robert Schulze
68a0b28b81
Merge pull request #66934 from rschu1ze/issue-66887
Un-flake test_runtime_configurable_cache_size
2024-07-24 08:10:59 +00:00
Ilya Yatsishin
02ee0d8dd4
Merge pull request #66896 from qoega/improve-integration-tests-1
Improved test_storage_s3 tests to make it repeatable
2024-07-24 07:52:39 +00:00
Alexey Milovidov
e156db4922 Remove the support for Kerberized HDFS 2024-07-24 07:56:11 +02:00
zoomxi
d460fa9f36 create coordinator after the number of replicas to use for the query is determined 2024-07-24 09:57:00 +08:00
Yatsishin Ilya
39d4cf8b7f Merge remote-tracking branch 'qoega/improve-integration-tests-1' into improve-integration-tests-3 2024-07-23 22:14:37 +00:00
Ilya Yatsishin
d04ca9eea6 fix 2024-07-24 00:08:32 +02:00
Ilya Yatsishin
fe487a11bf Merge remote-tracking branch 'qoega/improve-integration-tests-2' into integration-flaky-check-repeat 2024-07-23 23:57:31 +02:00
Yatsishin Ilya
7a6233340e Hardening of test_backup_restore_new test 2024-07-23 21:57:01 +00:00
Ilya Yatsishin
2f8b28a17c Touch test to trigger flaky check 2024-07-23 17:05:23 +02:00
Ilya Yatsishin
e0a7aa80af Enable repeat for flaky check for more tests hardening 2024-07-23 16:57:07 +02:00
Yatsishin Ilya
e671d4c55d more changes 2024-07-23 14:43:49 +00:00
Robert Schulze
919005c4f7
Incorporate review feedback 2024-07-23 13:10:01 +00:00
Robert Schulze
496c1fbf84
Un-flake test_runtime_configurable_cache_size 2024-07-23 12:46:09 +00:00
Sema Checherinda
20f22278bd Merge branch 'master' into chesema-processor-onCancel 2024-07-23 14:32:11 +02:00
avogar
bc7fd604b7 Fix tests, builds and docs 2024-07-23 10:10:15 +00:00
Yatsishin Ilya
1c723e7fd7 black 2024-07-23 09:10:47 +00:00
Andrey Zvonov
8fb560d257 add replica sync 2024-07-23 07:08:58 +00:00
Antonio Andelic
133e734d73 Move to integration test 2024-07-23 09:05:09 +02:00
zoomxi
dee5790b22 According to the suggestions from cr, modify test code 2024-07-23 10:49:37 +08:00
Pablo Marcos
5a22a64c98 Merge branch 'master' into system-query-metric-log 2024-07-22 18:53:40 +00:00
Yatsishin Ilya
ac679892ab fix 2024-07-22 16:28:11 +00:00
Yatsishin Ilya
69be00cbf0 Improve 2024-07-22 16:27:28 +00:00
jsc0218
ae5eccbf20 just a commit to trigger CI 2024-07-22 13:39:48 +00:00
Alexey Milovidov
ffb766d30e
Merge pull request #66818 from ClickHouse/miscellaneous
Miscellaneous
2024-07-22 13:24:21 +00:00
Yatsishin Ilya
af4c2fa8a4 fix 2024-07-22 12:27:24 +00:00
Yatsishin Ilya
2dc264928f Added tests, rewritten logic which engines and table functions to allow, added replace for create table ... AS table_function() syntax. 2024-07-22 11:33:51 +00:00
zoomxi
8246614f5e throw if can't connect to any participating replicas 2024-07-22 19:21:24 +08:00
Yohann Jardin
2f1818b8d5 update error codes related to number of accepted arguments 2024-07-22 11:21:54 +02:00