Commit Graph

550 Commits

Author SHA1 Message Date
Nikita Fomichev
fe43ea27d2 Tests: fix timeouts handling in case of github timeout termination 2024-07-03 13:37:36 +02:00
alesapin
a2626037bc Improve object storage tags in tests 2024-07-02 14:15:59 +02:00
Kseniia Sumarokova
ee0c4093d4
Update run.sh 2024-07-02 12:03:27 +02:00
Michael Kolupaev
557cd2c08f Escape the $ 2024-06-20 18:56:06 +00:00
Michael Kolupaev
16baecf5a6 attach_gdb.lib: print registers before all stacks 2024-06-20 18:54:36 +00:00
Pablo Marcos
71f8937abd Merge branch 'master' into system-error-log 2024-06-20 16:33:44 +00:00
Alexander Tokmakov
5798898314
Merge pull request #65309 from ClickHouse/save_server_data
Save server data for failed stateless tests
2024-06-18 18:46:24 +00:00
Pablo Marcos
216d26987a Add test and config changes for system.error_log 2024-06-18 08:37:40 +00:00
Alexander Tokmakov
fb110827f8 save server data for failed stateless tests 2024-06-17 23:29:03 +02:00
Alexey Milovidov
24dfc10755 Remove outdated override in stress tests 2024-06-16 12:57:05 +02:00
Alexey Milovidov
02677892e3 Fix libunwind in CI 2024-06-13 21:03:02 +02:00
alesapin
59784a4cf2 Upload blob_storage_log from stateless tests 2024-06-05 15:04:15 +02:00
Alexey Milovidov
cafd074e0a Prevent stack overflow in Fuzzer and Stress test 2024-05-18 05:11:18 +02:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Raúl Marín
463f95e956 Extra constraints for stress and fuzzer tests 2024-05-07 13:47:35 +02:00
alesapin
4eb5bea203
Merge pull request #63354 from ClickHouse/fix_azurite_version
Rollback azurite to working version
2024-05-06 09:25:23 +00:00
alesapin
b8b4a3a6dd Fxi 2024-05-04 12:24:07 +02:00
Anton Popov
b991f77d04 randomize setting enable_block_offset_column in stress tests 2024-05-03 17:22:37 +00:00
Alexander Sapin
b1eb0a8e9c Try rollback azurite
(cherry picked from commit 967e51c1d6)
2024-05-03 18:42:59 +02:00
alesapin
b4e3880c6b Test work without azurite 2024-04-27 12:30:28 +02:00
alesapin
8b050b2548 Merge branch 'ci_add_azure_tests' of github.com:ClickHouse/ClickHouse into ci_add_azure_tests 2024-04-26 19:18:18 +02:00
alesapin
349147b5b5 One more time 2024-04-26 19:16:27 +02:00
Alexander Sapin
adfe2f78a9 Try to make error more clear 2024-04-25 12:35:08 +02:00
alesapin
4d0ce04a91 Always start clickhouse with env forwarding 2024-04-24 20:03:23 +02:00
Alexander Sapin
9896c50c3f azurite only in memory 2024-04-17 14:53:45 +02:00
Smita Kulkarni
d1a81e718c Merge branch 'master' into ci_add_azure_tests 2024-04-17 14:26:41 +02:00
Alexander Sapin
90ef5cc516 better 2024-04-15 18:52:17 +02:00
Alexander Sapin
0f2cc6e00a Disable logs 2024-04-15 15:17:36 +02:00
Alexander Sapin
daea269a28 Try without debug logs 2024-04-15 14:42:20 +02:00
Robert Schulze
3c35f14804
Merge remote-tracking branch 'ClickHouse/master' into mkmkme/protobuf-25.1 2024-04-15 12:38:59 +00:00
Alexey Milovidov
d903e189c4
Update docker/test/stateless/run.sh 2024-04-12 01:01:04 +02:00
Raúl Marín
361d73f7a4 Try to fix Bugfix validation job 2024-04-12 00:07:53 +02:00
Nikolay Degterinsky
6f78e89044 Merge remote-tracking branch 'upstream/master' into docker-image 2024-04-09 13:13:58 +00:00
Nikolay Degterinsky
f45acef131 Support for a tiny feature in stateless tests image 2024-04-09 00:33:18 +00:00
Alexey Milovidov
0fccaafda4 Fix tests 2024-04-04 20:06:40 +02:00
Mikhail Koviazin
e7a664e9df
Merge remote-tracking branch 'upstream/master' into mkmkme/protobuf-25.1 2024-04-03 13:51:37 +03:00
Mikhail Koviazin
a9a1bd1afe
docker/stateless-test: install protobuf-compiler v25.1 2024-03-28 16:08:24 +01:00
Nikolay Degterinsky
dae3a9e389
Fix 2024-03-28 06:31:46 +01:00
Nikolay Degterinsky
54348e5e8c
Fix logs saving in DatabaseReplicated tests 2024-03-28 06:27:48 +01:00
Mikhail f. Shiryaev
6550b6f227
Merge pull request #61607 from ClickHouse/fix-configs-bugfix
Fix configs for upgrade and bugfix
2024-03-20 10:44:43 +01:00
Mikhail f. Shiryaev
fce926446b
Fix sed to not produce local_blob_storage_blob_storage 2024-03-19 18:05:57 +01:00
Raúl Marín
b290fda45a
Merge pull request #61333 from Algunenano/fuzz_log
Minor changes in stress and fuzzer reports
2024-03-19 17:54:38 +01:00
Mikhail f. Shiryaev
301037ca6a
Replace cat | sed; mv by sed -i 2024-03-19 17:53:32 +01:00
Alexey Milovidov
2a4116cfb3
Merge pull request #61410 from tomershafir/thread-fuzzer-sleep-rand
ThreadFuzzer: randomize sleep time
2024-03-19 15:56:14 +03:00
tomershafir
23169117ae thread-fuzzer: randomize sleep time 2024-03-15 00:02:09 +02:00
Azat Khuzhin
02ae7e54a7 Fix bugfix check (due to "unknown object storage type: azure")
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-14 14:57:33 +01:00
Raúl Marín
2982f3b369 Fix stress test sanitizer report 2024-03-13 19:12:43 +01:00
Alexey Milovidov
3b8a8c9649 Better gitignore 2024-03-10 09:28:30 +01:00
Mikhail f. Shiryaev
176ed5f96b
Use curl instead of wget 2024-03-07 09:52:24 +01:00
Mikhail f. Shiryaev
1d8fe381be
Update the odbc in stateless tests 2024-03-07 09:52:23 +01:00
Mikhail f. Shiryaev
017a81692f
Merge pull request #60553 from ClickHouse/update-shellcheck
Update shellcheck
2024-03-04 11:21:34 +01:00
Alexey Milovidov
c51b50aa1a
Merge pull request #60375 from azat/ci/bugfix-check-fix
Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
2024-03-03 23:11:40 +03:00
Azat Khuzhin
c343ec4bcf Fix bugfix and upgrade checks (due to "Unknown handler type 'redirect'" error)
CI: https://s3.amazonaws.com/clickhouse-test-reports/60694/418a6258ac1b55d5e225107bd9ebfc711ca6511b/upgrade_check__msan_.html
CI: https://s3.amazonaws.com/clickhouse-test-reports/60689/707200d2a4ee765c5109dcca78aaaa7f2c63ab85/bugfix_validation.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-03-03 12:00:49 +01:00
Mikhail f. Shiryaev
17210bb494
Fix type, add _server suffix to start and stop functions 2024-03-01 00:21:31 +01:00
Mikhail f. Shiryaev
f40e25f5c3
Check all shell scripts in docker directories 2024-02-29 17:41:33 +01:00
Antonio Andelic
2b51497e55
Update docker/test/stateless/run.sh 2024-02-26 08:50:23 +01:00
Azat Khuzhin
83e7f3e1a1 Fix bugfix check (due to unknown commit_logs_cache_size_threshold)
Bugfix check is broken on CI [1], because of:

    2024.02.23 06:12:59.294500 [ 757 ] {} Application: Code: 115. DB::Exception: Unknown setting latest_logs_cache_size_threshold: in Coordination settings config. (UNKNOWN_SETTING), Stack trace (when copying this message, always include the lines below):

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/60031/89eb2a38c0a7c113b7b0a96c8069fea6eb48ae9d/bugfix_validation.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-02-24 21:17:03 +01:00
Raúl Marín
c359f29842 Merge remote-tracking branch 'blessed/master' into stress_log 2024-02-23 10:50:46 +01:00
Raúl Marín
9c99a2dd2a Maybe better 2024-02-22 13:20:57 +01:00
Raúl Marín
b83b7a7ab7 Stress test: Include the first sanitizer block message in the report 2024-02-22 12:59:12 +01:00
Raúl Marín
5684a14160 Ignore valid 'No such key errors' in stress tests 2024-02-22 11:47:43 +01:00
Alexey Milovidov
99b66f75bd Sequential run 2024-02-10 02:27:55 +01:00
Alexey Milovidov
d466e8d61e Run coverage collection sequentially 2024-02-09 03:55:39 +01:00
Alexey Milovidov
41ff8b3217 Reading Docker files 2024-02-09 00:15:52 +01:00
Raúl Marín
a64ce70671 Pin python dependencies in stateless tests 2024-02-06 20:11:04 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Kseniia Sumarokova
60c37fb9bf
Update run.sh 2024-01-31 13:44:16 +01:00
Alexey Milovidov
35ea956255
Merge pull request #59295 from ClickHouse/fix_block_number
Fix `_block_number` column with non-default serializations and mutation
2024-01-30 04:07:09 +01:00
alesapin
cef109a887 Fix backward compatibility check 2024-01-29 13:19:46 +01:00
Kseniia Sumarokova
cc4d4647f5
Update run.sh 2024-01-28 22:24:03 +01:00
Kseniia Sumarokova
41883ddb34
Update run.sh 2024-01-28 18:15:11 +01:00
Kseniia Sumarokova
febd4ce8d7
Update run.sh 2024-01-28 13:41:33 +01:00
alesapin
d70fe79a1e Revert "Disable randomization of allow_experimental_block_number_column flag (#56474)"
This reverts commit 951d9ac144.
2024-01-28 12:28:08 +01:00
Kseniia Sumarokova
24ab61932e
Update run.sh 2024-01-27 22:42:43 +01:00
Kseniia Sumarokova
163a3e44d3
Update run.sh 2024-01-26 21:22:39 +01:00
Kseniia Sumarokova
291427d931
Update stateless/run.sh 2024-01-23 14:51:55 +01:00
Kseniia Sumarokova
bfb822b775
Try fix style check 2024-01-22 20:32:47 +01:00
Kseniia Sumarokova
a23d71b7bb
Update run.sh 2024-01-22 18:19:58 +01:00
Kseniia Sumarokova
5d67e26fc4
Merge pull request #58869 from ClickHouse/force-check-for-cached-custom-disk
Fix for custom cached disk creation
2024-01-20 14:47:36 +01:00
Kseniia Sumarokova
a661c6b2c0
Update run.sh 2024-01-19 10:37:21 +01:00
alesapin
3dc8b2dbf7
Merge pull request #58955 from ClickHouse/more_safe_way_to_dump_Logs
More safe way to dump system logs in tests
2024-01-19 10:20:55 +01:00
Alexander Sapin
ea6ca96c85 More safe way to dump system logs in tests 2024-01-18 17:51:48 +01:00
kssenii
255a52a8ff Fix tests with database replicated 2024-01-18 13:26:47 +01:00
Kruglov Pavel
8d7c24aa5a Install pyarrow in stateless tests 2024-01-12 13:06:51 +00:00
Max Kainov
82d3d57053 Sync content of the docker test images 2024-01-04 12:45:17 +00:00
Alexander Tokmakov
961cb894b5
Update run.sh 2023-12-20 16:56:39 +01:00
Sema Checherinda
939d602c3c fix typo 2023-12-18 19:30:05 +01:00
Sema Checherinda
a12fe7473c add killed by timeout message 2023-12-18 18:08:57 +01:00
Alexey Milovidov
72e3a7e86e Implement FIXME 2023-12-17 22:00:39 +01:00
kssenii
fd2c9dcc1a One more fix for bugfix check 2023-12-04 11:01:09 +01:00
alesapin
e8864a94cc
Update docker/test/stateless/run.sh 2023-12-03 22:33:35 +01:00
alesapin
a5782cb56b Revert "Revert bugfix check fix attempt"
This reverts commit dcc5ae2928.
2023-12-03 16:04:22 +01:00
kssenii
dcc5ae2928 Revert bugfix check fix attempt 2023-12-01 20:23:39 +01:00
Kseniia Sumarokova
98eb061812
Update run.sh 2023-12-01 13:49:31 +01:00
Kseniia Sumarokova
12368d56c1
Update run.sh 2023-12-01 13:44:35 +01:00
kssenii
bdf7d0907f Fix shellcheck 2023-11-30 21:30:39 +01:00
kssenii
0e9aa9b1cd Try fix bugfix check 2023-11-30 14:14:32 +01:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 21:00:51 +01:00
Alexey Milovidov
3c2cf5dc70 Enable Analyzer in Stress and Fuzz tests 2023-11-20 21:52:47 +01:00
Antonio Andelic
052134b143 Better 2023-11-16 07:32:11 +00:00
Antonio Andelic
a828410993 Fix randomization of Keeper configs in stress tests 2023-11-15 12:14:48 +00:00
SmitaRKulkarni
951d9ac144
Disable randomization of allow_experimental_block_number_column flag (#56474)
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-11-13 15:44:06 +01:00
Alexey Milovidov
67e4d22c56 Fix typo 2023-11-12 03:04:47 +01:00
Alexey Milovidov
ed0e3873a3 Add a test 2023-11-12 02:45:25 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown
Force shutdown in upgrade test
2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci
Randomize block_number column setting in ci
2023-10-30 12:30:51 +01:00
Smita Kulkarni
13c90c0b86 Removed unwanted file and added chanegs to stress_test 2023-10-27 14:56:25 +02:00
Raúl Marín
e93f64670b Force shutdown in upgrade test 2023-10-27 11:16:00 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Smita Kulkarni
c39ca0b549 Fixed clang-tidy and updated to randomize compression for stress test 2023-10-19 11:59:22 +02:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
Fix broken test
2023-09-29 11:13:31 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh 2023-09-28 01:05:35 +02:00
kssenii
1f13e3ac92 Fix database replicated tests using the same paths for filesystem cache 2023-09-27 11:43:30 +02:00
Antonio Andelic
3dbb6dcf4e Better 2023-09-22 13:47:28 +00:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
Joe Lynch
a5b508d6c5
Fix json in header 2023-09-07 14:59:33 +02:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 (#54246)
* Update run.sh

* Update run.sh
2023-09-05 14:55:41 +02:00
Alexander Tokmakov
b08e8940e2
Update run.sh 2023-09-02 13:34:05 +02:00
Alexander Tokmakov
d9438b176c save system tables from s3 in the report 2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c111adb7ce
Replace dlcdn.apache.org by archive domain 2023-08-30 18:40:36 +02:00
Alexey Milovidov
3b85c5ed0e Put the script into the base Docker image 2023-08-12 02:14:58 +02:00
Alexey Milovidov
0ba3fea7fe Apply recommendations 2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a Protection if the repository is old 2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300 Address review comments 2023-08-10 04:32:39 +02:00
Alexey Milovidov
0bab88b7cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-07 18:58:32 +02:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74 Maybe fix bash 2023-08-06 12:51:37 +02:00
Alexey Milovidov
f0a632f1f1 Fix shellcheck 2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Alexey Milovidov
972653cde3 Change the default timezones in Docker test images 2023-07-30 05:18:52 +02:00
Azat Khuzhin
2389e0f0b6 Randomize timezone in tests across non-deterministic around 1970 and default
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).

But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.

So to catch such issues in the PRs itself, let's randomize
session_timezone as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Alexey Milovidov
75d051dd55 Remove useless packages 2023-07-06 01:49:53 +02:00
Antonio Andelic
c06afc53b4 Make scripts backwards compatible 2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5 Wait with retries 2023-06-30 14:52:21 +00:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
d1bb8f24c0 Retry chroot creation in ZK 2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images 2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits 2023-06-13 17:53:19 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck 2023-06-06 12:23:00 +02:00
avogar
e8c6c7967b Move attaching gdb to separate lib 2023-06-05 18:21:40 +00:00
avogar
8973259678 Test attach gdb in stateless tests 2023-06-02 15:00:24 +00:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780)
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Alexander Tokmakov
5b263b9ffe fix 2023-03-23 15:36:17 +01:00
Alexander Tokmakov
f6f459c12e fix stress tests statuses 2023-02-14 13:12:53 +01:00