Commit Graph

10014 Commits

Author SHA1 Message Date
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance
Fix flaky `test_system_kafka_consumers_rebalance`
2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type
Support true UUID type for MongoDB engine
2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
2024-08-05 12:23:40 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec)
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq
Try to fix RabbitMQ test failures
2024-08-04 19:26:23 +02:00
Nikita Fomichev
c4a0e7665c
Merge pull request #67747 from azat/tests/test_ttl_move
Fix test_ttl_move::test_alter_with_merge_work flakiness
2024-08-04 16:47:24 +00:00
Alexey Milovidov
6fd4552fad Merge branch 'master' into fix-log-and-exception-messages-formatting 2024-08-04 18:08:28 +02:00
Alexey Milovidov
fbd3e122e1
Merge pull request #67512 from ClickHouse/divanik/fix_retry_integration_tests_decorator
[Green CI] Test `test_storage_azure_blob_storage/test.py` is flaky
2024-08-04 15:46:55 +00:00
Azat Khuzhin
062490e1b4 tests: fix test_ttl_move::test_alter_with_merge_work flakiness
Increase timeout for TTL DELETE, since otherwise if other routines will
take too long, the part will be removed when it should be still be on
"external" disk:

    2024.08.04 03:48:53.803032 [ 622 ] {} <Information> default.mt_test_alter_with_merge_work_1722743323 (9dc6904a-f082-4f06-be7a-efe4733e811c): Will drop empty part all_1_3_4_4

And this is how part_log looks like:

    SELECT
        event_time,
        event_type,
        rows,
        part_name,
        error,
        database,
        disk_name
    FROM system.part_log
    WHERE `table` = 'mt_test_alter_with_merge_work_1722743323'
    ORDER BY event_time ASC

    Query id: a118b3cd-e4fe-45a5-b675-d73bdd887d79

        ┌──────────event_time─┬─event_type─┬─rows─┬─part_name───┬─error─┬─database─┬─disk_name─┐
     1. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_1_1_0   │     0 │ default  │ jbod1     │
     2. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_2_2_0   │     0 │ default  │ jbod2     │
     3. │ 2024-08-04 03:48:45 │ NewPart    │    2 │ all_3_3_0   │     0 │ default  │ jbod1     │
     4. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_1_1_0_4 │     0 │ default  │ jbod1     │
     5. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_2_2_0_4 │     0 │ default  │ jbod2     │
     6. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_3_3_0_4 │     0 │ default  │ jbod1     │
     7. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_1_1_0_4 │     0 │ default  │ external  │
     8. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_3_3_0_4 │     0 │ default  │ jbod2     │
     9. │ 2024-08-04 03:48:47 │ MergeParts │    6 │ all_1_3_1_4 │     0 │ default  │ jbod2     │
    10. │ 2024-08-04 03:48:48 │ MovePart   │    6 │ all_1_3_1_4 │     0 │ default  │ external  │
    11. │ 2024-08-04 03:48:52 │ MergeParts │    4 │ all_1_3_2_4 │     0 │ default  │ external  │
    12. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_3_4 │     0 │ default  │ external  │ # rows==0
    13. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_4_4 │     0 │ default  │ external  │
        └─────────────────────┴────────────┴──────┴─────────────┴───────┴──────────┴───────────┘

CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__tsan__[5_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:25:18 +02:00
Azat Khuzhin
47dbc5e05b tests: add debug info into test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:16:40 +02:00
Azat Khuzhin
f0aaac3bd1 tests: remove useless retries from test_ttl_move::test_alter_with_merge_work
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 14:14:42 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:06:50 +02:00
Azat Khuzhin
59e5a09b49 Use RabbitMQ without management in tests (attempt to improve startup)
Sometimes startup can take ~90 seconds [1]:

    2024-08-03 23:11:38.756067+00:00 [info] <0.9.0> Time to start RabbitMQ: 94651980 us

Unlike normally ~10 [2]:

    2024-08-04 00:33:07.016137+00:00 [info] <0.9.0> Time to start RabbitMQ: 10082489 us

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/b4e3bbcb82158bea4f5db1d9f5c28cfb741d1d51/integration_tests__asan__old_analyzer__[4_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__asan__old_analyzer__[4_6].html

I've tried locally, the difference is very small, 3135665 us
(+management) vs (2740747 us), but still something, and who knows how it
works under pressure.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 09:04:41 +02:00
Alexey Milovidov
6a20f777f6
Merge pull request #67428 from ClickHouse/enable-text-log
Enable `text_log` by default
2024-08-03 23:02:40 +00:00
Alexey Milovidov
a051eb2a5d Fix tests 2024-08-04 00:24:17 +02:00
Azat Khuzhin
2f00c96271 Support true UUID type for MongoDB engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-03 23:51:41 +02:00
Alexey Milovidov
60648e5240
Revert "Add replication lag and recovery time metrics" 2024-08-03 18:41:17 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Miсhael Stetsyuk
14fce8b8da
Merge pull request #66704 from ClickHouse/add-S3DiskNoKeyErrors-metric
Add S3DiskNoKeyErrors metric
2024-08-03 12:44:33 +00:00
Antonio Andelic
1b20d47202
Merge pull request #67665 from ClickHouse/fix-udf-reload
Fix reloading SQL UDFs with UNION
2024-08-03 08:05:12 +00:00
Alexey Milovidov
74adf3d3fc Merge branch 'master' into enable-text-log 2024-08-03 02:33:37 +02:00
Alexey Milovidov
7af5340e6e
Merge pull request #67362 from ClickHouse/vdimir/test_cache_evicted_by_temporary_data
Trying to fix test_cache_evicted_by_temporary_data and print debug info
2024-08-03 00:31:09 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12
Update check_rabbitmq_is_available
2024-08-03 00:30:31 +00:00
Alexey Milovidov
dbb059912d
Merge pull request #67672 from ClickHouse/integration-tests-fix-ports
Integration tests: fix ports clashing problem
2024-08-03 00:29:58 +00:00
Antonio Andelic
10e28236b9 Merge branch 'master' into fix-udf-reload 2024-08-02 21:31:32 +02:00
Alexey Milovidov
743bd5fd6d Merge branch 'master' into enable-text-log 2024-08-02 17:49:04 +02:00
Miсhael Stetsyuk
f1df59d6c9
Merge pull request #66703 from ClickHouse/add-replication-lag-and-recovery-time-metrics
Add replication lag and recovery time metrics
2024-08-02 15:21:43 +00:00
Nikita Fomichev
1fd9464947
Merge pull request #67454 from ClickHouse/24.7-testing-and-docs
24.7 add missing documentation and testing
2024-08-02 15:00:47 +00:00
Nikita Fomichev
664e131f4f Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
Antonio Andelic
c2dd62256a
Merge pull request #67658 from ClickHouse/fix-flaky-test_replicated_table_attach
Fix flaky `test_replicated_table_attach`
2024-08-02 13:54:19 +00:00
alesapin
a930c768c3
Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch
[Docs] Building integration tests runner docker image for a local testing
2024-08-02 13:22:59 +00:00
Nikita Fomichev
5256e8e6d0 Integration tests: fix ports clashing problem 3 2024-08-02 14:36:49 +02:00
Nikita Fomichev
a64e625f0b Integration tests: fix ports clashing problem 2 2024-08-02 14:03:27 +02:00
Julia Kartseva
528187410f
Merge pull request #65751 from jkartseva/store-plain-rw-metadata-separately
Store `plain_rewritable` disk metadata in the separate `'__meta'` layout; add flat object storage directory structure
2024-08-02 11:52:59 +00:00
robot-clickhouse
34cba1bdda Automatic style fix 2024-08-02 11:46:12 +00:00
Michael Stetsyuk
7d45529fe8 randomize query id in test_checking_s3_blobs_paranoid 2024-08-02 12:37:40 +01:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Michael Stetsyuk
092c837119 randomize table name in test_storage_delta 2024-08-02 12:14:37 +01:00
vdimir
02e4843605
test_cache_evicted_by_temporary_data drop cache 2024-08-02 10:37:52 +00:00
Antonio Andelic
76e2e886db Merge branch 'master' into fix-udf-reload 2024-08-02 12:37:13 +02:00
vdimir
eb3fd60f3e
Trying to fix test_cache_evicted_by_temporary_data and print debug info 2024-08-02 10:18:52 +00:00
Antonio Andelic
6c8f458b0b Fix reloading SQL UDFs with UNION 2024-08-02 11:13:41 +02:00
Michael Stetsyuk
9c05a0ad5a rm dirs in test_storage_delta 2024-08-02 09:34:32 +01:00
Pablo Marcos
dc65c0aa07 Fix doc for parallel test execution
Copy-pasterino strikes again. I forgot to remove the single quote.
With it, pytest thinks the whole argument is a file:

(no name '/ClickHouse/tests/integration/test_storage_s3_queue/test.py::test_max_set_age -- --count 10 -n 5' in any of [<Module test.py>])
2024-08-02 07:17:09 +00:00
Antonio Andelic
774cba09df Fix flaky test_replicated_table_attach 2024-08-02 08:49:47 +02:00
Julia Kartseva
d6da86dad2 Store plain_rewritable metadata in a separate layout 2024-08-02 04:28:07 +00:00