thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-20 08:40:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
150,644 Commits 8,927 Branches 1,765 Tags 2 GiB
f4280203a0
Commit Graph

10190 Commits

Author SHA1 Message Date
Ilya Yatsishin
7341dcefd4
Follow up for #67843 2024-08-07 20:36:23 +02:00
Ilya Yatsishin
ac4bed2f42
Merge pull request #67843 from qoega/improve-integration-tests-3 
Improve integration tests 3
 2024-08-07 18:06:37 +00:00
robot-clickhouse
94398996b2 Automatic style fix 2024-08-07 17:47:22 +00:00
János Benjamin Antal
d992431f96 Make tests more sturdier for flaky test check 2024-08-07 17:27:24 +00:00
Sema Checherinda
06d154055f adjust tests 2024-08-07 19:19:33 +02:00
alesapin
ad678cb5a8 Ignore disappeared projections on start 2024-08-07 18:24:03 +02:00
János Benjamin Antal
b3c30b05d6 Make test_kafka_insert repeatable 2024-08-07 13:22:22 +00:00
János Benjamin Antal
139fe624c2 Fix typos 2024-08-07 13:16:47 +00:00
Nikita Taranov
49871bacc1 fix test 2024-08-07 12:37:39 +01:00
János Benjamin Antal
8b5c8e5361 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-07 11:33:21 +00:00
Sema Checherinda
272941021f
Merge pull request #66279 from ClickHouse/chesema-processor-onCancel 
merge tree sink cancel delayed_chunk
 2024-08-07 11:12:22 +00:00
robot-clickhouse
b9f564f6f4 Automatic style fix 2024-08-07 11:12:21 +00:00
Ilya Yatsishin
47111eb5af
Merge pull request #67511 from ClickHouse/revert-67507-revert-66536-external-replace-to-null 
Revert "Revert "Add settings to replace external engines to Null during create""
 2024-08-07 10:38:04 +00:00
Sema Checherinda
633f700df6 adjust tests 2024-08-07 12:23:23 +02:00
robot-clickhouse
00efd5fc0d Automatic style fix 2024-08-07 12:21:41 +02:00
Sema Checherinda
86267418f9 fix tests, rework recreation tables conditions, add log about ignored logs 2024-08-07 12:21:41 +02:00
pufit
3b642e7f91
Merge pull request #66364 from azat/cluster-inter-server-secret-fix 
Fix cluster() for inter-server secret (preserve initial user as before)
 2024-08-07 04:58:12 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index 
added tests for page index in parquet files
 2024-08-07 00:15:07 +00:00
Alexey Gerasimchuck
a43ed76ae8 Fixed session log parallel/sequenced test work within a single fixture 2024-08-06 22:20:12 +00:00
Nikita Taranov
053285dc1c Merge branch 'master' into keep_alive_max_reqs 2024-08-06 20:55:48 +01:00
Ilya Yatsishin
881d57a764
Merge branch 'master' into revert-67507-revert-66536-external-replace-to-null 2024-08-06 21:04:17 +02:00
Yatsishin Ilya
8cfcf341ae fix 2024-08-06 18:26:52 +00:00
Michael Stetsyuk
df2675fad0 [resubmit] add replication lag and recovery time metrics 2024-08-06 15:06:02 +00:00
Azat Khuzhin
bdfaffa9d7 tests: make test_distributed_inter_server_secret idempotent 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-06 16:59:23 +02:00
Sema Checherinda
0eb6a41f57 Merge branch 'master' into chesema-processor-onCancel 2024-08-06 16:36:28 +02:00
Andrey Zvonov
7d45424d31 specify files in test: 2024-08-06 11:18:47 +00:00
Andrey Zvonov
97f1cfc232 add ** glob to hdfs docs 2024-08-06 11:18:47 +00:00
Nikita Mikhaylov
80d2686013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-06 13:12:03 +02:00
Yarik Briukhovetskyi
27cdbb54d7
fix black 2024-08-06 13:10:03 +02:00
Nikita Mikhaylov
4e2b6a5e49 Fix docs and a test 2024-08-06 13:06:34 +02:00
Sema Checherinda
995187006a rework custom table's disk usage 2024-08-06 13:05:23 +02:00
Yarik Briukhovetskyi
aa3d8086c3
fix integration tests 2024-08-06 12:30:39 +02:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta 
Analyzer is finally Beta
 2024-08-06 09:39:29 +00:00
Nikita Mikhaylov
4829ba31d3 Actually fix a test 2024-08-05 21:18:53 +00:00
Azat Khuzhin
0dccc34a20 Fix cluster() for inter-server secret (preserve initial user as before) 
The behaviour of cluster() with inter-server secret had been changed in #63013,
after it started to use "default" user, and this introduces a
regression.

The intention of that patch was to adjust only remote(), since it only
it accept custom user, which should be ignored.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/66287
Fixes: https://github.com/ClickHouse/ClickHouse/issues/66352
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-05 20:24:24 +02:00
Azat Khuzhin
9d7710684b tests/test_distributed_inter_server_secret: get_query_user_info return list 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-05 20:24:24 +02:00
Nikita Mikhaylov
6f025090eb Merge branch 'master' of github.com:ClickHouse/ClickHouse into ts-engine 2024-08-05 17:46:14 +02:00
Nikita Mikhaylov
2c78122717
Merge pull request #67667 from zvonand/fix-ldap-entrypoint-2 
Even better healthcheck for ldap
 2024-08-05 15:31:59 +00:00
Nikita Mikhaylov
330aae9517 Even better test 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
0301af99e5 Fixed a bunch of tests 2024-08-05 15:29:15 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
d080f863ea
fix black 2024-08-05 17:07:17 +02:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Yatsishin Ilya
3e633ad0d0 more changes 2024-08-05 14:43:28 +00:00
robot-clickhouse
5d9d5bf919 Automatic style fix 2024-08-05 16:34:55 +02:00
Sema Checherinda
462fe8b7ff repro for #67478 2024-08-05 16:34:55 +02:00
János Benjamin Antal
7551c2602b
Merge pull request #67566 from ClickHouse/fix-flaky-test_system_kafka_consumers_rebalance 
Fix flaky `test_system_kafka_consumers_rebalance`
 2024-08-05 13:01:46 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting 
Fix test `00002_log_and_exception_messages_formatting`
 2024-08-05 12:34:33 +00:00
János Benjamin Antal
8f6476adb7 Merge remote-tracking branch 'origin/master' into kafka-zookeeper 2024-08-05 12:26:00 +00:00
Alexey Milovidov
243eb515d6
Merge pull request #66671 from azat/mongodb-uuid-type 
Support true UUID type for MongoDB engine
 2024-08-05 12:25:17 +00:00
János Benjamin Antal
0da44ad047
Merge pull request #67394 from ClickHouse/add-debug-to-s3-queue-shards-distributed 
Print debug info in `test_storage_s3_queue/test.py::test_shards_distributed`
 2024-08-05 12:23:40 +00:00
Yarik Briukhovetskyi
fd1e354e85
fix flaky check for integration tests 2024-08-05 13:43:06 +02:00
maxvostrikov
e0362b00f5 squash! fix for parallel execution 2024-08-05 11:52:07 +02:00
Nikita Fomichev
bd6c7a504d Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 11:45:49 +02:00
János Benjamin Antal
230b5150c2 Merge remote-tracking branch 'origin/master' into fix-message-queue-sink-from-http-interface 2024-08-05 09:14:13 +00:00
János Benjamin Antal
f816158dbc Address review comments 2024-08-05 09:11:55 +00:00
János Benjamin Antal
517bb64636 Merge remote-tracking branch 'origin/master' into fix-flaky-test_system_kafka_consumers_rebalance 2024-08-05 09:04:37 +00:00
Nikita Fomichev
29f1d9df36 Integration tests: fix flaky test_dictionaries_update_and_reload::test_reload_after_fail_by_timer 2024-08-05 10:03:49 +02:00
Alexey Gerasimchuck
e5134e14ea Disabled parallel run 2024-08-05 07:59:51 +00:00
Alexey Gerasimchuck
6897178c41 fixed typo 2024-08-04 22:29:03 +00:00
Alexey Gerasimchuck
b2ec479cee Fixed race condition in session log tests 2024-08-04 22:23:08 +00:00
Alexey Milovidov
4504326b2a Merge branch 'no-flaky-check' into fix-log-and-exception-messages-formatting 2024-08-05 00:03:25 +02:00
Azat Khuzhin
a49924b383 tests: avoid leaving leftovers after test_storage_mongodb (fixes flaky chec) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 22:01:08 +02:00
Alexey Milovidov
6f9d78d873
Merge pull request #67743 from azat/tests/test_storage_rabbitmq 
Try to fix RabbitMQ test failures
 2024-08-04 19:26:23 +02:00
Nikita Fomichev
c4a0e7665c
Merge pull request #67747 from azat/tests/test_ttl_move 
Fix test_ttl_move::test_alter_with_merge_work flakiness
 2024-08-04 16:47:24 +00:00
Alexey Milovidov
6fd4552fad Merge branch 'master' into fix-log-and-exception-messages-formatting 2024-08-04 18:08:28 +02:00
Alexey Milovidov
fbd3e122e1
Merge pull request #67512 from ClickHouse/divanik/fix_retry_integration_tests_decorator 
[Green CI] Test `test_storage_azure_blob_storage/test.py` is flaky
 2024-08-04 15:46:55 +00:00
Azat Khuzhin
062490e1b4 tests: fix test_ttl_move::test_alter_with_merge_work flakiness 
Increase timeout for TTL DELETE, since otherwise if other routines will
take too long, the part will be removed when it should be still be on
"external" disk:

    2024.08.04 03:48:53.803032 [ 622 ] {} <Information> default.mt_test_alter_with_merge_work_1722743323 (9dc6904a-f082-4f06-be7a-efe4733e811c): Will drop empty part all_1_3_4_4

And this is how part_log looks like:

    SELECT
        event_time,
        event_type,
        rows,
        part_name,
        error,
        database,
        disk_name
    FROM system.part_log
    WHERE `table` = 'mt_test_alter_with_merge_work_1722743323'
    ORDER BY event_time ASC

    Query id: a118b3cd-e4fe-45a5-b675-d73bdd887d79

        ┌──────────event_time─┬─event_type─┬─rows─┬─part_name───┬─error─┬─database─┬─disk_name─┐
     1. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_1_1_0   │     0 │ default  │ jbod1     │
     2. │ 2024-08-04 03:48:44 │ NewPart    │    2 │ all_2_2_0   │     0 │ default  │ jbod2     │
     3. │ 2024-08-04 03:48:45 │ NewPart    │    2 │ all_3_3_0   │     0 │ default  │ jbod1     │
     4. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_1_1_0_4 │     0 │ default  │ jbod1     │
     5. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_2_2_0_4 │     0 │ default  │ jbod2     │
     6. │ 2024-08-04 03:48:46 │ MutatePart │    2 │ all_3_3_0_4 │     0 │ default  │ jbod1     │
     7. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_1_1_0_4 │     0 │ default  │ external  │
     8. │ 2024-08-04 03:48:47 │ MovePart   │    2 │ all_3_3_0_4 │     0 │ default  │ jbod2     │
     9. │ 2024-08-04 03:48:47 │ MergeParts │    6 │ all_1_3_1_4 │     0 │ default  │ jbod2     │
    10. │ 2024-08-04 03:48:48 │ MovePart   │    6 │ all_1_3_1_4 │     0 │ default  │ external  │
    11. │ 2024-08-04 03:48:52 │ MergeParts │    4 │ all_1_3_2_4 │     0 │ default  │ external  │
    12. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_3_4 │     0 │ default  │ external  │ # rows==0
    13. │ 2024-08-04 03:48:53 │ MergeParts │    0 │ all_1_3_4_4 │     0 │ default  │ external  │
        └─────────────────────┴────────────┴──────┴─────────────┴───────┴──────────┴───────────┘

CI: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__tsan__[5_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:25:18 +02:00
Azat Khuzhin
47dbc5e05b tests: add debug info into test_ttl_move::test_alter_with_merge_work 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:16:40 +02:00
Azat Khuzhin
f0aaac3bd1 tests: remove useless retries from test_ttl_move::test_alter_with_merge_work 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 14:14:42 +02:00
Azat Khuzhin
dc527b6fd1 tests: detailed errors for RabbitMQ startup 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:07:05 +02:00
Azat Khuzhin
264be9c598 tests: increase timeout for RabbitMQ startup 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:06:50 +02:00
Azat Khuzhin
59e5a09b49 Use RabbitMQ without management in tests (attempt to improve startup) 
Sometimes startup can take ~90 seconds [1]:

    2024-08-03 23:11:38.756067+00:00 [info] <0.9.0> Time to start RabbitMQ: 94651980 us

Unlike normally ~10 [2]:

    2024-08-04 00:33:07.016137+00:00 [info] <0.9.0> Time to start RabbitMQ: 10082489 us

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/b4e3bbcb82158bea4f5db1d9f5c28cfb741d1d51/integration_tests__asan__old_analyzer__[4_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/66671/2f00c962711e13ca00af324366421fe4593b4ce6/integration_tests__asan__old_analyzer__[4_6].html

I've tried locally, the difference is very small, 3135665 us
(+management) vs (2740747 us), but still something, and who knows how it
works under pressure.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 09:04:41 +02:00
Alexey Milovidov
6a20f777f6
Merge pull request #67428 from ClickHouse/enable-text-log 
Enable `text_log` by default
 2024-08-03 23:02:40 +00:00
Alexey Milovidov
a051eb2a5d Fix tests 2024-08-04 00:24:17 +02:00
Azat Khuzhin
2f00c96271 Support true UUID type for MongoDB engine 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-03 23:51:41 +02:00
Alexey Milovidov
60648e5240
Revert "Add replication lag and recovery time metrics" 2024-08-03 18:41:17 +02:00
Vitaly Baranov
bd22140fa4 Add test. 2024-08-03 16:20:23 +02:00
divanik
fb2f15c3b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/fix_retry_integration_tests_decorator 2024-08-03 13:59:48 +00:00
Miсhael Stetsyuk
14fce8b8da
Merge pull request #66704 from ClickHouse/add-S3DiskNoKeyErrors-metric 
Add S3DiskNoKeyErrors metric
 2024-08-03 12:44:33 +00:00
Antonio Andelic
1b20d47202
Merge pull request #67665 from ClickHouse/fix-udf-reload 
Fix reloading SQL UDFs with UNION
 2024-08-03 08:05:12 +00:00
Alexey Milovidov
74adf3d3fc Merge branch 'master' into enable-text-log 2024-08-03 02:33:37 +02:00
Alexey Milovidov
7af5340e6e
Merge pull request #67362 from ClickHouse/vdimir/test_cache_evicted_by_temporary_data 
Trying to fix test_cache_evicted_by_temporary_data and print debug info
 2024-08-03 00:31:09 +00:00
Alexey Milovidov
94f8855f6e
Merge pull request #67597 from ClickHouse/kssenii-patch-12 
Update check_rabbitmq_is_available
 2024-08-03 00:30:31 +00:00
Alexey Milovidov
dbb059912d
Merge pull request #67672 from ClickHouse/integration-tests-fix-ports 
Integration tests: fix ports clashing problem
 2024-08-03 00:29:58 +00:00
Antonio Andelic
10e28236b9 Merge branch 'master' into fix-udf-reload 2024-08-02 21:31:32 +02:00
Alexey Milovidov
743bd5fd6d Merge branch 'master' into enable-text-log 2024-08-02 17:49:04 +02:00
Miсhael Stetsyuk
f1df59d6c9
Merge pull request #66703 from ClickHouse/add-replication-lag-and-recovery-time-metrics 
Add replication lag and recovery time metrics
 2024-08-02 15:21:43 +00:00
Nikita Fomichev
1fd9464947
Merge pull request #67454 from ClickHouse/24.7-testing-and-docs 
24.7 add missing documentation and testing
 2024-08-02 15:00:47 +00:00
Nikita Fomichev
664e131f4f Integration tests: fix ports clashing problem 4 2024-08-02 16:09:48 +02:00
Antonio Andelic
c2dd62256a
Merge pull request #67658 from ClickHouse/fix-flaky-test_replicated_table_attach 
Fix flaky `test_replicated_table_attach`
 2024-08-02 13:54:19 +00:00
alesapin
a930c768c3
Merge pull request #67449 from ClickHouse/divanik/add_docs_about_docker_runner_image_relaunch 
[Docs] Building integration tests runner docker image for a local testing
 2024-08-02 13:22:59 +00:00
Nikita Fomichev
5256e8e6d0 Integration tests: fix ports clashing problem 3 2024-08-02 14:36:49 +02:00
Nikita Fomichev
a64e625f0b Integration tests: fix ports clashing problem 2 2024-08-02 14:03:27 +02:00
maxvostrikov
c9b29ad113 squash! fix for parallel execution 2024-08-02 13:53:48 +02:00
Julia Kartseva
528187410f
Merge pull request #65751 from jkartseva/store-plain-rw-metadata-separately 
Store `plain_rewritable` disk metadata in the separate `'__meta'` layout; add flat object storage directory structure
 2024-08-02 11:52:59 +00:00
robot-clickhouse
34cba1bdda Automatic style fix 2024-08-02 11:46:12 +00:00
Michael Stetsyuk
7d45529fe8 randomize query id in test_checking_s3_blobs_paranoid 2024-08-02 12:37:40 +01:00
Nikita Fomichev
7d1e958097 Integration tests: fix ports clashing problem 2024-08-02 13:32:59 +02:00
Michael Stetsyuk
092c837119 randomize table name in test_storage_delta 2024-08-02 12:14:37 +01:00