Kseniia Sumarokova
12368d56c1
Update run.sh
2023-12-01 13:44:35 +01:00
kssenii
bdf7d0907f
Fix shellcheck
2023-11-30 21:30:39 +01:00
kssenii
0e9aa9b1cd
Try fix bugfix check
2023-11-30 14:14:32 +01:00
Azat Khuzhin
3903b4bb39
Fix system.*_log in artifacts on CI
...
For now it is broken due to #53086 :
Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 21:00:51 +01:00
Alexey Milovidov
3c2cf5dc70
Enable Analyzer in Stress and Fuzz tests
2023-11-20 21:52:47 +01:00
Antonio Andelic
052134b143
Better
2023-11-16 07:32:11 +00:00
Antonio Andelic
a828410993
Fix randomization of Keeper configs in stress tests
2023-11-15 12:14:48 +00:00
SmitaRKulkarni
951d9ac144
Disable randomization of allow_experimental_block_number_column flag ( #56474 )
...
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-11-13 15:44:06 +01:00
Alexey Milovidov
67e4d22c56
Fix typo
2023-11-12 03:04:47 +01:00
Alexey Milovidov
ed0e3873a3
Add a test
2023-11-12 02:45:25 +01:00
Smita Kulkarni
3fdf0daf1b
Merge branch 'master' into 49507_Support_compression_for_keeper_protocol
2023-10-31 10:43:28 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown
...
Force shutdown in upgrade test
2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci
...
Randomize block_number column setting in ci
2023-10-30 12:30:51 +01:00
Smita Kulkarni
13c90c0b86
Removed unwanted file and added chanegs to stress_test
2023-10-27 14:56:25 +02:00
Raúl Marín
e93f64670b
Force shutdown in upgrade test
2023-10-27 11:16:00 +02:00
Smita Kulkarni
cd7c1d1f8c
Updated to enable allow_experimental_block_numner_column for stress tests only
2023-10-23 16:59:12 +02:00
Smita Kulkarni
af5349f76b
Merge branch 'master' into 49507_Support_compression_for_keeper_protocol
2023-10-19 12:03:40 +02:00
Smita Kulkarni
c39ca0b549
Fixed clang-tidy and updated to randomize compression for stress test
2023-10-19 11:59:22 +02:00
Antonio Andelic
70d366a8eb
Control feature flag randomization with env
2023-10-18 07:59:49 +00:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
...
Fix broken test
2023-09-29 11:13:31 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh
2023-09-28 01:05:35 +02:00
kssenii
1f13e3ac92
Fix database replicated tests using the same paths for filesystem cache
2023-09-27 11:43:30 +02:00
Antonio Andelic
3dbb6dcf4e
Better
2023-09-22 13:47:28 +00:00
avogar
d5889c8cc8
Move all tests/ci/*.lib files to stateless-tests image
2023-09-15 11:27:09 +00:00
Joe Lynch
a5b508d6c5
Fix json in header
2023-09-07 14:59:33 +02:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 ( #54246 )
...
* Update run.sh
* Update run.sh
2023-09-05 14:55:41 +02:00
Alexander Tokmakov
b08e8940e2
Update run.sh
2023-09-02 13:34:05 +02:00
Alexander Tokmakov
d9438b176c
save system tables from s3 in the report
2023-09-01 23:04:35 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export
2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
c111adb7ce
Replace dlcdn.apache.org by archive domain
2023-08-30 18:40:36 +02:00
Alexey Milovidov
3b85c5ed0e
Put the script into the base Docker image
2023-08-12 02:14:58 +02:00
Alexey Milovidov
0ba3fea7fe
Apply recommendations
2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a
Protection if the repository is old
2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300
Address review comments
2023-08-10 04:32:39 +02:00
Alexey Milovidov
0bab88b7cb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-07 18:58:32 +02:00
Alexey Milovidov
fbb2be21cc
Slightly better
2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74
Maybe fix bash
2023-08-06 12:51:37 +02:00
Alexey Milovidov
f0a632f1f1
Fix shellcheck
2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9
Enable export (first try)
2023-08-06 04:38:04 +02:00
Antonio Andelic
e366ca61f5
Merge branch 'master' into add-reading-from-archives
2023-08-01 15:33:20 +00:00
Antonio Andelic
6a1cf5c683
Extend tests
2023-07-31 13:27:06 +00:00
Alexey Milovidov
972653cde3
Change the default timezones in Docker test images
2023-07-30 05:18:52 +02:00
Azat Khuzhin
2389e0f0b6
Randomize timezone in tests across non-deterministic around 1970 and default
...
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).
But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.
So to catch such issues in the PRs itself, let's randomize
session_timezone as well.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Alexey Milovidov
75d051dd55
Remove useless packages
2023-07-06 01:49:53 +02:00
Antonio Andelic
c06afc53b4
Make scripts backwards compatible
2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5
Wait with retries
2023-06-30 14:52:21 +00:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
...
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
d1bb8f24c0
Retry chroot creation in ZK
2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits
2023-06-13 17:53:19 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck
2023-06-06 12:23:00 +02:00
avogar
e8c6c7967b
Move attaching gdb to separate lib
2023-06-05 18:21:40 +00:00
avogar
8973259678
Test attach gdb in stateless tests
2023-06-02 15:00:24 +00:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id ( #49780 )
...
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
Here is some infomation:
1.old table:
CREATE TABLE a1 (`id` UInt64)
ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
2.new table:
CREATE TABLE a2 (`id` UInt64)
ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
3.error info:
<Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(DUPLICATE_INTERSERVER_IO_ENDPOINT)
<Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(NO_SUCH_INTERSERVER_IO_ENDPOINT)
* Revert "Add zookeeper name in endpoint id"
This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
* Fix incompatible with a new setting
* add a test, fix other issues
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
* Update 02735_system_zookeeper_connection.reference
* Update 02735_system_zookeeper_connection.sql
* Update run.sh
* Remove the 'no-fasttest' tag
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Alexander Tokmakov
5b263b9ffe
fix
2023-03-23 15:36:17 +01:00
Alexander Tokmakov
f6f459c12e
fix stress tests statuses
2023-02-14 13:12:53 +01:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] ( #43772 )
2023-02-03 14:34:18 +01:00
Alexander Tokmakov
1413b9537c
make error patterns more useful
2023-01-17 20:04:25 +01:00
Alexander Tokmakov
2d7773fccc
Merge branch 'master' into text_log_add_pattern
2023-01-13 20:33:46 +01:00
Alexey Milovidov
4694dad87c
Break CI
2023-01-08 07:59:31 +01:00
Alexey Milovidov
803c7e4443
Fix GitHub
2023-01-03 17:47:15 +01:00
Alexey Milovidov
a695629e51
Merge branch 'master' into modern-tools
2023-01-03 19:44:25 +03:00
Pradeep Chhetri
fa234878d6
Cleanup setup_minio.sh ( #44858 )
2023-01-03 14:29:50 +01:00
Alexey Milovidov
a39d0f6a50
Fix two typos
2023-01-02 00:11:15 +01:00
Alexey Milovidov
0b324ab836
Modern tools
2023-01-01 20:53:06 +01:00
Alexander Tokmakov
f2b177880f
print stats in tests
2022-12-23 16:04:29 +01:00
kssenii
7509bb2d3f
Fix
2022-12-19 21:29:35 +01:00
Nikolay Degterinsky
c0497ddf36
Add lz4 to the stateless tests image
2022-10-05 06:45:21 +00:00
BoloniniD
55c79230b3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-29 23:53:25 +03:00
Antonio Andelic
0f92e5e576
Add option for loading only system tables from path using clickhouse-local
2022-09-19 14:18:42 +00:00
BoloniniD
452ef4435b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-16 20:05:56 +03:00
alesapin
e904822051
Bump minio version in tests
2022-09-09 16:54:03 +02:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3
2022-09-09 11:48:31 +03:00
Alexey Milovidov
2a7d9f0778
Merge branch 'master' into high-level-coverage
2022-08-26 23:44:52 +02:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh
2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh
2022-08-26 13:33:12 +03:00
Alexey Milovidov
440d10370a
Report high-level function test coverage
2022-08-26 01:59:14 +02:00
kssenii
52832ea788
May be fix database replicated check
2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Alexey Milovidov
6b8f4f1d59
Merge branch 'master' into server-side-time
2022-08-12 21:36:40 +02:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary
2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time
2022-08-12 17:40:02 +03:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23
run tests with Ordinary database in flaky check
2022-08-11 21:32:03 +02:00
Alexey Milovidov
7aff85fc79
Fix test Dockerfile
2022-08-10 19:41:29 +02:00
kssenii
e81f85a79e
Fix checks
2022-08-07 16:44:02 +02:00
Azat Khuzhin
791377e4dc
tests: avoid prometheus.port overlap for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
kssenii
9685f9a8b7
Fix checks
2022-08-05 22:16:33 +02:00
kssenii
2850f68ac9
Fix checks
2022-08-01 20:48:05 +02:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3
2022-07-30 23:14:05 +03:00
kssenii
274457e5cf
Allow cache over azure blob storage, add tests
2022-07-18 16:15:04 +02:00
Anton Popov
efed134758
fix test
2022-07-14 21:48:34 +00:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3
2022-06-28 16:53:06 +03:00
Alexander Tokmakov
2c5a88faba
deprecate Ordinary database
2022-06-23 10:20:14 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
...
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too
2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
...
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
BoloniniD
b05ee41d25
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-06 16:03:10 +03:00
Alexander Tokmakov
1ab5dcae38
fix for aarch64
2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f
fix
2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15
fix
2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344
hotfix for minio in functional tests
2022-06-03 20:47:26 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster
[2] ( #35812 )
2022-06-03 15:54:29 +02:00
BoloniniD
dd8aefdf1e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-01 11:46:55 +03:00
Alexander Tokmakov
1ae919a18a
Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
...
This reverts commit 18d094d79d
, reversing
changes made to 224f4dc620
.
2022-05-28 19:23:58 +02:00
Azat Khuzhin
28e0bb78db
tests/stateless: properly wait for server
...
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:
Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html
So use proper wait via "clickhouse stop"
v2: Fix permissions pid file for replicated database servers
They do not use default, /var/run/clickhouse-server, that do not have
proper permissions.
Fixes : #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Alexander Tokmakov
7a9c9da0bd
Update run.sh
2022-05-04 01:10:40 +03:00
Alexander Tokmakov
193a50a688
Update run.sh
2022-05-03 23:17:03 +03:00
Alexander Tokmakov
3baf72f1d4
save system logs in func tests if server crashed
2022-05-03 20:10:07 +02:00
BoloniniD
a26acd3660
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-04-22 18:12:54 +03:00
Azat Khuzhin
08e74b98f5
tests: do not check queries after tests for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-20 21:34:31 +03:00
BoloniniD
30712ead45
Merge branch 'master' into BLAKE3
2022-04-13 00:45:44 +03:00
Alexander Tokmakov
5a50ad9de3
Merge branch 'master' into mvcc_prototype
2022-03-31 11:35:04 +02:00
Azat Khuzhin
8b84829e93
ci: replace directory system log tables artifacts with tsv
...
Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
used, replace them with plain TSVWithNamesAndTypes, also note, that
after schema inference it is even pretty easy to use
- support replicated database env correctly
Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 21:50:55 +03:00
Alexander Tokmakov
287d858fda
Merge branch 'master' into mvcc_prototype
2022-03-29 16:24:12 +02:00
BoloniniD
2d2420c8a9
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-29 11:00:50 +03:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster
table function ( #35544 )
2022-03-29 00:46:35 +02:00
Alexander Tokmakov
9702b5177d
Merge branch 'master' into mvcc_prototype
2022-03-14 21:45:38 +01:00
BoloniniD
253afd032f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-13 21:18:46 +03:00
Alexey Milovidov
d0716b035f
Revert "Change timezone in Docker"
2022-03-13 04:03:06 +03:00
Alexey Milovidov
6b9129c494
Change timezone in Docker
2022-03-11 23:21:45 +01:00
kssenii
9983a5d802
Add test for profile events
2022-02-28 15:47:12 +01:00
Alexander Tokmakov
aa6b9a2abc
Merge branch 'master' into mvcc_prototype
2022-02-23 23:22:03 +03:00
BoloniniD
3f149e88be
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-19 20:23:19 +03:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
...
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Alexander Tokmakov
dae044f86b
Merge branch 'master' into mvcc_prototype
2022-02-17 13:49:37 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type
...
Workaround for bug when AWS mistakenly set Content-Type to XML
2022-02-17 13:11:14 +03:00
alesapin
0b099b140f
Fix
2022-02-17 10:39:33 +03:00
alesapin
3b531e43b7
Setup credentials
2022-02-15 16:12:08 +03:00
Yatsishin Ilya
bbe2c07a7b
remove clickhouse-test deb completely
2022-02-15 12:03:51 +00:00
alesapin
e1fb220bb7
Fix test
2022-02-15 13:31:41 +03:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz"
...
This reverts commit efd8044ab7
, reversing
changes made to 4bb69bcb15
.
2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images
2022-02-07 12:35:32 +01:00
alesapin
06499ce847
Revert "Remove docker change"
...
This reverts commit 3c80e0bff8
.
2022-02-04 14:32:11 +03:00
BoloniniD
23e29e22a0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-03 19:32:14 +03:00
Alexander Tokmakov
ca5f951558
Merge branch 'master' into mvcc_prototype
2022-02-03 18:56:44 +03:00
alesapin
3c80e0bff8
Remove docker change
2022-02-02 20:36:04 +03:00
alesapin
80800e051e
Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3
2022-02-02 19:42:04 +03:00
alesapin
18f08ed932
Revert "Revert "Add func tests run with s3""
2022-02-01 10:20:06 +03:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3"
2022-02-01 05:46:13 +03:00
alesapin
b6828f1b4a
Supress some tests for S3
2022-01-31 19:09:25 +03:00
BoloniniD
6f078c164d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-01-26 20:11:27 +03:00
Yatsishin Ilya
3a55f7a7d6
Do not use clickhouse-test.deb in stateless
2022-01-24 11:53:42 +00:00
Alexander Tokmakov
4dd216ce8f
Merge branch 'master' into mvcc_prototype
2022-01-14 17:11:32 +03:00
Alexander Tokmakov
e1a41fc694
add system log for introspection
2022-01-14 17:03:00 +03:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master
2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI
2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
8779b6763d
Use architecture specific version of minio
2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
18a9aac61e
Use mysql-client-8.0 from ubuntu original repo
2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version
2022-01-12 17:07:52 +01:00