Azat Khuzhin
ce9cdc408c
Upgrade MinIO to support accepting non signed requests
...
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.
The problem is in this place [1].
[1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)
And this had been added only in [2].
[2]: https://github.com/minio/minio/pull/16484
But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update
...
Fix deadlock in LDAP assigned role update
2023-10-08 00:38:10 +02:00
Julian Maicher
19f8f365b2
test: Add IT that reproduces deadlock
2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d
Remove Meilisearch
2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
...
Fix broken test
2023-09-29 11:13:31 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test
2023-09-28 09:39:56 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh
2023-09-28 01:05:35 +02:00
kssenii
1f13e3ac92
Fix database replicated tests using the same paths for filesystem cache
2023-09-27 11:43:30 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists
...
Implement `createIfNotExists` in Keeper natively
2023-09-26 16:04:51 +02:00
Antonio Andelic
ce583cb7fe
Fix upgrade tests
2023-09-25 13:21:37 +00:00
Antonio Andelic
176baa6695
Merge branch 'master' into keeper-operation-create-if-not-exists
2023-09-22 13:47:30 +00:00
Antonio Andelic
3dbb6dcf4e
Better
2023-09-22 13:47:28 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17
2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user
2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
16fc2739c6
Use xargs to parallel submodules
2023-09-20 19:09:06 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit
2023-09-20 19:09:06 +02:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17
2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
...
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Robert Schulze
d31a43a379
Remove Woboq
2023-09-18 17:44:04 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16
2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94
review suggestions
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a
cleanup, fix tee to escape non-decodable symbols
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355
review suggestions
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060
run docker
2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
b7a17bf8dd
add libFuzzer tests, initial integration
2023-09-17 16:36:49 +00:00
avogar
d5889c8cc8
Move all tests/ci/*.lib files to stateless-tests image
2023-09-15 11:27:09 +00:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter
...
Bugfix/local multiquery parameter
2023-09-15 11:46:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql
...
Implement the MySQL binary protocol implementation for initial support of Tableau Online
2023-09-14 12:27:11 +02:00
bakam412
c5c3833a80
fix tests
2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d
Fix LowCardinality/Nullable columns issues
2023-09-13 23:40:31 +02:00
slvrtrn
dddea9219a
Address the review comments
2023-09-12 18:39:03 +02:00
slvrtrn
611a75a87f
Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql
2023-09-12 10:38:44 +02:00
Antonio Andelic
479ae52f9c
Merge branch 'master' into keeper-batch-flushes
2023-09-11 11:36:23 +00:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing
...
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
2023-09-11 06:18:47 +02:00
Joe Lynch
eed11c36a4
Add jq to fasttest container
2023-09-10 23:11:24 +02:00
Alexey Milovidov
aac645efdc
Merge pull request #54469 from ClickHouse/ci-instance-type
...
Add `instance_type` column to CI Logs and the `checks` table
2023-09-09 19:21:57 +03:00
Alexey Milovidov
0728df37e6
Add instance_type
column to CI Logs and the checks
table
2023-09-09 01:44:14 +02:00
Joe Lynch
a5b508d6c5
Fix json in header
2023-09-07 14:59:33 +02:00
Antonio Andelic
824b90f754
Merge branch 'master' into keeper-batch-flushes
2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
...
Closes #31643
2023-09-06 13:01:38 +00:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 ( #54246 )
...
* Update run.sh
* Update run.sh
2023-09-05 14:55:41 +02:00
slvrtrn
4f4640ec90
Add DateTime64 support
2023-09-04 20:49:29 +02:00
Antonio Andelic
365bc584ec
Merge branch 'master' into keeper-batch-flushes
2023-09-04 07:24:21 +00:00
Alexander Tokmakov
b08e8940e2
Update run.sh
2023-09-02 13:34:05 +02:00
Alexander Tokmakov
d9438b176c
save system tables from s3 in the report
2023-09-01 23:04:35 +02:00
Antonio Andelic
5f1a75ceae
Fix tests
2023-09-01 12:13:33 +00:00
Mikhail f. Shiryaev
d4f21704e4
Increase distributed_ddl_task_timeout
...
Co-authored-by: alesapin <alesapin@clickhouse.com>
2023-09-01 11:29:33 +02:00
Mikhail f. Shiryaev
c611007694
The external logs have had colliding arguments
2023-09-01 11:25:42 +02:00
Kseniia Sumarokova
54a715da2d
Update Dockerfile
2023-08-31 14:34:41 +02:00
Kseniia Sumarokova
f4c3807547
Update Dockerfile
...
Better comment
2023-08-31 14:27:35 +02:00
Kseniia Sumarokova
b2c44d85c0
Update Dockerfile
2023-08-31 14:25:43 +02:00
slvrtrn
8483d1c701
Binary protocol tests
2023-08-31 13:26:27 +02:00
Mikhail f. Shiryaev
ab3e9df57f
Address review points
2023-08-30 22:06:32 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export
2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
a683d5e2f3
Replace defaul assingment by default usage
2023-08-30 22:04:34 +02:00
slvrtrn
8378441248
Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql
2023-08-30 19:00:51 +02:00
slvrtrn
f4dd6be8a8
WIP prepared statements
2023-08-30 18:59:39 +02:00
Mikhail f. Shiryaev
c111adb7ce
Replace dlcdn.apache.org by archive domain
2023-08-30 18:40:36 +02:00
Alexander Tokmakov
9180c631aa
Update setup_export_logs.sh
2023-08-25 21:03:24 +03:00
Kseniia Sumarokova
4239154b44
Follow-up to #53611
2023-08-24 16:15:04 +02:00
Raúl Marín
333fc76300
Remove useless slow on client check
2023-08-22 16:30:57 +02:00
alesapin
a4ad63baa2
Merge pull request #53512 from canhld94/allow_non_standalone_keeper_integration_test
...
Allow non standalone keeper run in integration tests
2023-08-22 13:20:37 +02:00
kssenii
951081c8fb
Merge remote-tracking branch 'upstream/master' into fix-upgrade-check
2023-08-21 19:28:19 +02:00
Maksim Kita
034ff13a05
CMake small refactoring
2023-08-21 12:51:39 +03:00
kssenii
307e5d6b9b
Fix
2023-08-20 10:37:20 +02:00
Maksim Kita
21f2b10f56
Test
2023-08-19 17:38:14 +03:00
kssenii
5382442da0
Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks
2023-08-19 08:44:36 +04:00
Alexander Tokmakov
428810a5b2
Update setup_export_logs.sh
2023-08-18 13:37:29 +03:00
Alexander Tokmakov
fdca288a73
make sending logs less fragile
2023-08-17 16:49:50 +02:00
Duc Canh Le
2406e9a987
allow non standalone keeper run in integration tests
...
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-17 11:10:35 +00:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
...
Update style checker
2023-08-17 12:56:20 +02:00
Alexey Milovidov
c3e6f7e9ae
Leave only simplifications
2023-08-17 03:59:15 +02:00
Alexey Milovidov
857856b8b6
Leave only simplifications
2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance
2023-08-17 03:56:27 +02:00
Mikhail f. Shiryaev
3c36af111d
Update style checker
2023-08-17 00:03:58 +02:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start
2023-08-16 01:03:29 +02:00
kssenii
164b4f0ae3
Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks
2023-08-15 20:30:01 +04:00
Alexey Milovidov
e357702fd0
What will happen if I remove this?
2023-08-14 01:26:38 +02:00
Alexey Milovidov
e11e7c6218
Fix typos
2023-08-14 01:26:15 +02:00
Alexey Milovidov
3c6af254bc
Remove something
2023-08-14 01:26:04 +02:00
Alexey Milovidov
957045c70b
Maybe fix error
2023-08-13 20:15:30 +02:00
kssenii
c3b8bc0267
Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks
2023-08-13 21:14:42 +04:00
Alexey Milovidov
d1e50b1cbf
Simplification
2023-08-13 06:48:19 +02:00
Alexey Milovidov
d434e58eae
Fix errors
2023-08-13 06:45:41 +02:00
Alexey Milovidov
748a65b2bb
Fix error
2023-08-13 06:35:32 +02:00
Alexey Milovidov
645834ffb6
Fix errors
2023-08-13 04:54:20 +02:00
Alexey Milovidov
8dc0884099
Fix error
2023-08-13 04:20:06 +02:00
Alexey Milovidov
7132571375
Fix error
2023-08-13 04:18:07 +02:00
Alexey Milovidov
49485a6770
Fix shellcheck
2023-08-13 02:43:51 +02:00
Alexey Milovidov
fd3d0f7fa4
Merge branch 'master' into export-logs-in-ci-performance
2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2
Improvements
2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd
Merge branch 'master' into export-logs-in-ci-fuzz
2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
...
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
ec779ca246
Export logs from CI in performance (part 2)
2023-08-13 00:32:55 +02:00
Alexey Milovidov
9f9b794feb
Export logs from CI in performance (preparation)
2023-08-13 00:32:55 +02:00
Alexey Milovidov
a3ae62a1d1
Fix YAML
2023-08-13 01:18:08 +03:00
Alexey Milovidov
87a40fb02c
Fix YAML
2023-08-13 00:16:40 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
...
Add SQLTest
2023-08-13 00:35:46 +03:00
Alexey Milovidov
afbb91600e
Export logs from CI in fuzzer
2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5
Export logs from CI in stress tests
2023-08-12 22:30:18 +02:00
Alexey Milovidov
f314c29386
Export logs to CI from stateful tests
2023-08-12 21:58:17 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
...
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Alexey Milovidov
0792d36415
Merge pull request #53286 from arthurpassos/pin_coredns_version_and_fix_tests
...
Bring back **garbage** dns tests
2023-08-12 17:24:38 +03:00
Alexey Milovidov
a1d3f1836e
Fix shellcheck
2023-08-12 02:46:28 +02:00
Alexey Milovidov
3b85c5ed0e
Put the script into the base Docker image
2023-08-12 02:14:58 +02:00
kssenii
44efd74c8d
Change log level
2023-08-11 20:41:31 +02:00
Alexey Milovidov
736ff1c127
Merge branch 'master' into allow-creating-system-tables-at-startup
2023-08-11 01:25:49 +02:00
Arthur Passos
9781a8cee9
bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query
2023-08-10 16:45:29 -03:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest
2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci
2023-08-10 16:56:14 +03:00
Alexey Milovidov
0ba3fea7fe
Apply recommendations
2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a
Protection if the repository is old
2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300
Address review comments
2023-08-10 04:32:39 +02:00
Alexey Milovidov
f2621e70ae
Remove unrecognizable garbage from the performance test
2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f
Remove unrecognizable garbage from the performance test
2023-08-10 03:26:11 +02:00
Alexey Milovidov
10bc51514b
Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci
2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a
Merge branch 'master' into allow-creating-system-tables-at-startup
2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest
2023-08-09 05:10:47 +03:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests ( #52072 )
...
* metrics_perf_events_enabled turn off in perf tests
* turn on metrics_perf_events_enabled for heating and profile requests
* close_perf_descriptors fix the condition
* do not read opend but disabled perf event
* Revert "do not read opend but disabled perf event"
This reverts commit eeab1c9c63
.
2023-08-07 23:25:16 +02:00
Alexey Milovidov
0bab88b7cb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup
2023-08-07 18:58:18 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15
...
Add `abort_on_error=1` to `TSAN_OPTIONS`
2023-08-07 17:17:04 +03:00
Alexey Milovidov
fbb2be21cc
Slightly better
2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74
Maybe fix bash
2023-08-06 12:51:37 +02:00
Antonio Andelic
cafa5ef2f3
Merge branch 'master' into add-reading-from-archives
2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1
Fix shellcheck
2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9
Enable export (first try)
2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7
YAML is mandatory
2023-08-06 02:52:36 +02:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2
...
tests: fix possible EADDRINUSE v2
2023-08-05 13:39:25 +03:00
Nikita Taranov
555c90a50c
add to integration tests
2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1
to TSAN_OPTIONS
for stress tests
2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop
2023-08-04 17:53:57 +02:00
Alexey Milovidov
65e8ee8fb7
Fix paths
2023-08-03 15:28:18 +02:00
Antonio Andelic
96bad0537a
Merge branch 'master' into add-reading-from-archives
2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab
tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
...
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb
tests: use explicit address for console to avoid EADDRINUSE
...
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.
And even though this is a problem of MinIO I'm not a go developer to fix
it.
v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912
Merge branch 'master' into sqltest
2023-08-02 20:08:39 +02:00
Antonio Andelic
e366ca61f5
Merge branch 'master' into add-reading-from-archives
2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3
2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest
2023-08-01 16:14:28 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
...
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc
Disable for fasttest
2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49
Update dockerfile
2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683
Extend tests
2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd
Merge branch 'allow-oom-stress-upgrade-checks' into move-regions
2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5
Allow OOM in Stress and Upgrade checks
2023-07-31 12:27:35 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions
2023-07-30 10:34:10 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile
2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6
Fix Docker
2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3
Change the default timezones in Docker test images
2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6
Fix Docker
2023-07-30 04:22:36 +02:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated
...
Make shutdown of `ReplicatedMergeTree` tables more soft
2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests ( #51445 )
...
* Fix attaching gdb in stress tests
* Fix
* Update run.sh
* Try remove run_with_retry
* Return run_with_retry
* Don't set -e in run_with_retry if it was't set before
* Update tests/ci/utils.lib
* Fix bash
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated
2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone
...
Randomize timezone in tests across non-deterministic around 1970 and default
2023-07-24 22:47:52 +03:00
Azat Khuzhin
2389e0f0b6
Randomize timezone in tests across non-deterministic around 1970 and default
...
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).
But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.
So to catch such issues in the PRs itself, let's randomize
session_timezone as well.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop
2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd
Fix CI
2023-07-23 17:30:23 +02:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated
2023-07-23 00:12:29 +02:00
Mikhail f. Shiryaev
cf01800a63
Sort DOCKER_*_TAG stuff
2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1
Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav
2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b
Sanitize compose files in integration-tests-runner
2023-07-22 15:45:47 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated
2023-07-22 12:11:39 +02:00
Alexey Milovidov
de2016261e
Get rid of it
2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
...
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
999cce12b1
Merge branch 'master' into sqltest
2023-07-22 01:55:54 +02:00
Alexey Milovidov
fa44f84377
Fix style
2023-07-20 04:50:18 +02:00
Alexey Milovidov
f458108c44
Fix style
2023-07-19 22:15:23 +02:00
Yatsishin Ilya
bb4924ab63
Multiple sqllogictest improvements
2023-07-19 12:24:31 +00:00
Ilya Golshtein
4259176f24
test_for_basic_auth_registry - original zk configuration restored
2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d
test_for_basic_auth_registry - fix port in test_kafka_formats
2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb
test_for_basic_auth_registry - UnknownTopicOrPartitionException
2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a
test_for_basic_auth_registry - both tests works, simplifications
2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a
test_for_basic_auth_registry - started, but only auth test works
2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f
test_for_basic_auth_registry - one kafka instance again
2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4
test_for_basic_auth_registry - attempt to have two kafka instances
2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834
test_for_basic_auth_registry - mock up
2023-07-19 08:32:44 +00:00
robot-clickhouse
891c01e6ab
Automatic style fix
2023-07-19 02:37:02 +00:00
Alexey Milovidov
9b10e0a5bc
Improvement
2023-07-19 04:09:19 +02:00
Alexey Milovidov
fe59729537
Improvement
2023-07-19 04:01:00 +02:00
Alexey Milovidov
76677e009b
Improvement
2023-07-19 04:00:50 +02:00
Alexey Milovidov
50dac21483
Improvement
2023-07-19 03:54:09 +02:00
Alexey Milovidov
2255307a47
Improvement
2023-07-19 03:49:47 +02:00
Alexey Milovidov
fcf4a6ea88
Fix error
2023-07-19 03:48:48 +02:00
Alexey Milovidov
174166b233
Fix error
2023-07-19 03:47:41 +02:00
Alexey Milovidov
df5abcf685
Update Docker
2023-07-19 03:45:43 +02:00
Alexey Milovidov
8e3bd222f0
Add SQLTest
2023-07-19 03:42:32 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated
2023-07-17 19:04:29 +02:00
Azat Khuzhin
6f6562c96b
Fix running integration tests with spaces in it's names
...
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]
[1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html
Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.
v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d
Fix flakiness of test_keeper_s3_snapshot
...
This is part of "Why my PR is not merged?" patch set series.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
...
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
Azat Khuzhin
a10aa9ad50
Force libunwind usage (removes gcc_eh support)
...
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).
gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.
Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720
Allow OOM in AST Fuzzer with Sanitizers
2023-07-08 05:57:23 +02:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages
2023-07-07 13:44:13 +03:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2
2023-07-06 21:10:41 +02:00
Alexander Sapin
9ae0dc730c
Review fixes + enable in ci
2023-07-06 17:15:26 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error
2023-07-06 16:09:52 +02:00
Antonio Andelic
085f7caccf
Move config changes after configure
2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55
Remove useless packages
2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks
...
Fix disk config for upgrade tests
2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b
Correctly move config
2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce
2023-07-05 10:28:57 +02:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 13:05:41 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
...
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824
Add odbcinst dep to sqllogic docker
2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation
2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4
Make scripts backwards compatible
2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5
Wait with retries
2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation
2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
...
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create
2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0
Retry chroot creation in ZK
2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests
2023-06-29 12:24:19 +02:00
Alexander Tokmakov
296f9968c0
fix
2023-06-28 23:20:02 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker
2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
91dc6dfe34
Update mysql-php-client to the recent rolling version
2023-06-28 22:19:39 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too
2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
edcf981c48
Update mysql odbc connector
2023-06-28 22:19:31 +02:00
Mikhail f. Shiryaev
5a8ce1f2fe
Do not upload the binaries for fast-tests to tests-reports
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
7b4e6faece
Speedup the submodules cloning
2023-06-28 22:19:28 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images
2023-06-28 22:11:48 +02:00
Alexey Milovidov
de58339c3b
Merge branch 'fix-perf-tests-jemalloc' of github.com:azat/ClickHouse into many-fixes
2023-06-27 05:35:26 +02:00
Alexey Milovidov
4ee74ec213
Two tests are twice longer in average with Analyzer and sometimes failing
2023-06-26 02:19:52 +02:00
Azat Khuzhin
5871ca0836
Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled
...
jemalloc can show the following warning:
Number of CPUs detected is not deterministic. Per-CPU arena disabled
It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()
And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:
smpboot: Allowing 128 CPUs, 64 hotplug CPUs
And from sysfs:
# grep . /sys/devices/system/cpu/{possible,online,offline}
/sys/devices/system/cpu/possible:0-127
/sys/devices/system/cpu/online:0-63
/sys/devices/system/cpu/offline:64-127
From ACPI:
# acpidump -o acpi
# acpixtract -a acpi
# iasl -d *.dat
# grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
64 Processor Enabled : 0
64 Processor Enabled : 1
So I guess this is the same as what happened in this perf run [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html
P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-25 09:37:37 +02:00
Alexander Tokmakov
f973bd7516
suppress check for covered parts in zk
2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling
...
Improve scheduling of background tasks in ReplicatedMergeTree
2023-06-20 16:25:19 +03:00
Alexander Tokmakov
5dd9b10c8e
fix
2023-06-19 20:14:28 +02:00
Yatsishin Ilya
b472480d48
Fix branch name
2023-06-19 10:06:56 +00:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log
2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main
2023-06-16 00:28:09 +02:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone
...
Fix 'Illegal column timezone' in stress tests
2023-06-14 17:56:57 +03:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits
2023-06-13 17:53:19 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests
...
Attach gdb in stateless tests
2023-06-13 17:04:17 +03:00
Alexander Tokmakov
3a2fa65075
fix 'Illegal column timezone' in stress tests
2023-06-13 16:02:54 +02:00
alesapin
a614aa3b03
More leftovers
2023-06-10 16:06:37 +02:00
alesapin
20b66689f3
Fix test
2023-06-10 13:34:51 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck
2023-06-06 12:23:00 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow
...
Fail perf tests when too many queries slowed down
2023-06-06 11:33:04 +02:00
avogar
e8c6c7967b
Move attaching gdb to separate lib
2023-06-05 18:21:40 +00:00
Nikita Taranov
4506299d73
impl
2023-06-02 23:14:09 +02:00
avogar
8973259678
Test attach gdb in stateless tests
2023-06-02 15:00:24 +00:00
Alexander Tokmakov
1544067fb3
Update run.sh
2023-06-01 23:28:19 +03:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id ( #49780 )
...
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
Here is some infomation:
1.old table:
CREATE TABLE a1 (`id` UInt64)
ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
2.new table:
CREATE TABLE a2 (`id` UInt64)
ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
3.error info:
<Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(DUPLICATE_INTERSERVER_IO_ENDPOINT)
<Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(NO_SUCH_INTERSERVER_IO_ENDPOINT)
* Revert "Add zookeeper name in endpoint id"
This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
* Fix incompatible with a new setting
* add a test, fix other issues
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
* Update 02735_system_zookeeper_connection.reference
* Update 02735_system_zookeeper_connection.sql
* Update run.sh
* Remove the 'no-fasttest' tag
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Azat Khuzhin
73661c3a46
Move tunnings for woboq codebrowser to cmake out from build.sh
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-18 18:18:30 +02:00
Mikhail f. Shiryaev
e79c1cdb1a
Attempt to increas parallelism for codebrowser_generator
2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
65d1ae77ee
Use updated upstream woboq
2023-05-12 19:22:49 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
ec701d96c7
Rework the codebrowser build directories structure
2023-05-12 19:22:47 +02:00
Mikhail f. Shiryaev
7614c1c848
Move the command for codebrowser into a script
2023-05-12 19:22:45 +02:00
Azat Khuzhin
a0cc5b7e47
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-10 16:28:36 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
...
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
Han Fei
505d9be7b2
address comments
2023-05-10 13:56:17 +02:00
Azat Khuzhin
be39e8e566
Merge remote-tracking branch 'u/master' into build/llvm-16
...
Conflicts:
docker/test/codebrowser/Dockerfile
2023-05-09 20:40:43 +02:00
Mikhail f. Shiryaev
780b5a6f97
Fix a wrong built generator removal, use depth=1
2023-05-09 12:36:02 +02:00
Azat Khuzhin
bf17c819c3
docker: fix path to clang builtin headers for woboq code browser
...
By default woboq uses $version.$minor.$patch, while clang simply uses
$version:
CMake Error at generator/CMakeLists.txt:77 (message):
Could not find any clang builtins headers in
/usr/lib/llvm-16/lib/clang/16.0.4/include
# ls -d /usr/lib/llvm-16/lib/clang/16/include
/usr/lib/llvm-16/lib/clang/16/include
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:31:55 +02:00
Azat Khuzhin
08b8b7e587
docker: remove symlink for libclang (not required anymore)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:30:02 +02:00
Azat Khuzhin
82536fedde
docker: install libclang-16-dev for woboq code browser
...
Otherwise you will get the following error:
CMake Error at /usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake:792 (message):
The imported target "clangBasic" references the file
"/usr/lib/llvm-16/lib/libclangBasic.a"
but this file does not exist. Possible reasons include:
* The file was deleted, renamed, or moved to another location.
* An install or uninstall procedure did not complete successfully.
* The installation package was faulty and contained
"/usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake"
but not all the files it references.
Call Stack (most recent call first):
/usr/lib/llvm-16/lib/cmake/clang/ClangConfig.cmake:20 (include)
generator/CMakeLists.txt:7 (Find_Package)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:25:50 +02:00
Han Fei
64b67b9a37
Merge branch 'master' into hanfei/fiu
2023-05-09 01:14:30 +02:00
Azat Khuzhin
c525d13272
Enable back thread fuzzuer under TSan
...
Since initial issue got resolved [1].
[1]: https://github.com/google/sanitizers/issues/1540
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-08 22:35:09 +02:00
Azat Khuzhin
c37fe64040
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-08 22:33:52 +02:00
Dmitry Novik
a3b3b78eb0
EXPECTED_TO_FAIL -> NOT_FAILED
2023-05-05 17:53:15 +00:00
Dmitry Novik
0baaaaba42
KNOWN_BROKEN -> BROKEN
2023-05-05 17:43:54 +00:00
Dmitry Novik
5422e3058f
Use more specific test status
2023-05-05 16:19:01 +00:00
Dmitry Novik
b13e3abc4d
Improve CI check for Analyzer
2023-05-05 15:17:16 +00:00
alesapin
08039024a2
Merge pull request #49492 from ClickHouse/add_server_jepsen_image
...
Fixes in server jepsen image
2023-05-04 12:02:27 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage
...
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
2023-05-04 11:47:43 +02:00
alesapin
27f9384717
Followup
2023-05-03 23:33:19 +02:00
alesapin
c1d8fab2da
Fxi
2023-05-03 21:05:19 +02:00
alesapin
6e8934f856
Improve image for local run
2023-05-03 14:40:18 +02:00
Han Fei
d608ba41e7
try to fix
2023-05-02 00:05:36 +02:00
Kseniia Sumarokova
d4aa96e262
Merge branch 'master' into better-local-object-storage
2023-04-28 21:05:05 +02:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage
2023-04-27 14:54:04 +02:00
robot-clickhouse
3448b112d8
Automatic style fix
2023-04-27 12:31:00 +00:00
Alexey Milovidov
8eae3ed3a5
Fix garbage #48719
2023-04-27 13:48:23 +02:00
Kseniia Sumarokova
c4abe66d77
Update run.sh
2023-04-25 12:25:49 +02:00
kssenii
f38dfc9206
Update run.sh
2023-04-23 12:49:22 +02:00
Kseniia Sumarokova
370aa60159
Update run.sh
2023-04-21 22:10:06 +02:00
robot-clickhouse
eda1379180
Automatic style fix
2023-04-21 19:04:36 +00:00
Dmitry Novik
5fef967872
Make error message better
2023-04-21 18:11:54 +00:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci
2023-04-21 15:43:16 +02:00
kssenii
e58c16318f
Merge remote-tracking branch 'upstream/master' into better-local-object-storage
2023-04-21 12:49:40 +02:00
kssenii
88f412ad23
Fix upgrade check, fix integration test
2023-04-21 12:44:08 +02:00
Mikhail f. Shiryaev
634cf010b9
Merge pull request #48935 from ClickHouse/fasttests-build-time
...
Add building stage to the fasttests report, respect existing status on rerun
2023-04-20 15:50:18 +02:00
Mikhail f. Shiryaev
c80d8081d2
Add building stage to the fasttests report
2023-04-19 13:35:28 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS
2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup
2023-04-19 09:44:53 +02:00
Dmitry Novik
308970da83
Add logging
2023-04-18 13:53:13 +00:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci
2023-04-18 13:07:45 +02:00
Dmitry Novik
6197d3d55f
Pass volume only for analyzer
2023-04-18 00:12:30 +00:00
Sema Checherinda
0354a964cd
turn on all CI back
2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e
introduce sqllogic runner
2023-04-16 13:57:24 +02:00
Dmitry Novik
3df33d74f5
Get rid of another docker image
2023-04-13 17:22:12 +02:00
kssenii
4bf01c611c
Fix
2023-04-13 16:56:11 +02:00
kssenii
6f53784f22
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-04-13 15:56:40 +02:00
robot-clickhouse
fa7b72570b
Automatic style fix
2023-04-12 17:09:37 +00:00
Dmitry Novik
360fc59694
Handle known broken tests
2023-04-12 16:46:30 +00:00
Azat Khuzhin
a1272e8536
Pass existing TSAN_OPTIONS to integration tests and append new options
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
Azat Khuzhin
61bf70be12
Add second_deadlock_stack=1 for TSan on CI
...
To improve TSan reports.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:05:57 +02:00
kssenii
00282483c9
Address remaining review comments
2023-04-07 18:29:55 +02:00
kssenii
c40f17a276
One more attempt
2023-04-06 20:09:06 +02:00
kssenii
4a94074f71
Try fix java errors in CI
2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91
Remove redundant from dockerd-entrypoint.sh
2023-04-05 14:40:30 +02:00
kssenii
319417062f
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-30 18:29:46 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests
2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests
2023-03-29 23:33:24 +02:00
kssenii
fcc8e4223c
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-29 14:13:27 +02:00
kssenii
04b28bf822
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-28 15:39:24 +02:00
Raúl Marín
ff209db129
Merge branch 'master' into zk_inject_timeout
2023-03-27 19:46:10 +02:00
Raúl Marín
c47dcb0805
Enable ZK fault injection on new servers (but not during startup)
2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
...
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
...
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository
2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread
...
Fix terminate in parts check thread
2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix
2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX
2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53
apply black formatter
2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe
fix
2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 ( #47858 )
2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e
apply black to all python scripts
2023-03-20 17:30:20 +00:00
Alexey Milovidov
0f7f620100
Update one more place
2023-03-19 01:07:11 +01:00
Alexey Milovidov
89a76c2d77
Use LLVM 16
2023-03-18 23:45:57 +01:00
kssenii
f776f4ff46
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993
2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad
fix intersecting parts, better fault injections
2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae
ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881
ci/upgrade: remove obsolete function call
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7
ci/upgrade: fix creating system database with Ordinary engine
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:12:32 +01:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper
...
Fix Keeper with `force_sync = false`
2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9
Use force_sync=true in upgrade check
2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68
Add spark to tests, rewrite tests, fix bug
2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880
suppress expected errors from test 01111 in Upgrade check
2023-03-08 15:27:43 +01:00
Alexander Tokmakov
d34f00f437
Update run.sh
2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa
Suppress "Cannot flush" for Distributed tables in upgrade check
...
CI reports [1]:
2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
[1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image
2023-02-28 20:20:04 +01:00
Kruglov Pavel
261c3aa86d
Update
2023-02-27 16:42:29 +01:00
avogar
ff67fc4b06
Remove llvm-9 from dependencies
2023-02-24 16:59:27 +00:00
avogar
e52a995e46
Fix style
2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01
Make better
2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-02-24 13:52:22 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests ( #46641 )
...
* Avoid OOM in perf tests
At some point perf tests started to fail for one setup on CI [1]:
/home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed python3 performance_comparison_check.py "$CHECK_NAME"
Error: Process completed with exit code 137.
[1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
---------
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-23 14:05:18 +01:00
Alexander Tokmakov
dcf8aeab8f
Update stress
2023-02-21 22:16:05 +03:00
Alexander Tokmakov
97e9df0148
Update stress
2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests ( #41534 )
...
* Update stress
* fix
---------
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-02-21 15:36:23 +03:00
Alexander Tokmakov
669c4e94d5
Update compare.sh
2023-02-20 17:35:30 +03:00
Azat Khuzhin
5a5f99a27e
Add CPU flamegraphs for perf tests
...
In Real profiler there is too much noise (polling, cond vars, ...)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
...
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix
2023-02-16 14:31:11 +01:00
Azat Khuzhin
bddead1ea2
Revert "Merge pull request #38212 from azat/no-stress"
...
This reverts commit 24d5be1669
, reversing
changes made to a756b4be27
.
After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.
Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix
2023-02-15 17:13:40 +03:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler
2023-02-14 20:39:02 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses
...
Fix stress tests statuses
2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e
fix stress tests statuses
2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh
2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh
2023-02-14 13:10:18 +01:00
Azat Khuzhin
dc5d7809b6
Do not continue perf tests in case of exception in create_query/fill_query
...
Previously due to using of threading.Thread, exception had been
ignored, and perf test simply continues, yes it will show some errors,
but it also may show that the test became faster, while it is because
the underlying table was empty.
Replace threading.Thread with a SafeThread (inline implementation) that
simply rethrow exception in join.
Here is an example of such report [1], look at the ip_trie test.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/2101b66570cbb9eb9a492afa8ab82d562c34336b/performance_comparison_[3/4]/report.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 17:31:15 +01:00
serxa
c17dc8e284
fix
2023-02-11 16:48:47 +00:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler
2023-02-11 10:30:26 +01:00
Kruglov Pavel
38fbf88ea7
Merge branch 'master' into split-bc-check
2023-02-10 18:28:49 +01:00
Kruglov Pavel
43e660ebd2
Update run.sh
2023-02-10 18:28:19 +01:00
Alexander Tokmakov
9c20e42807
Update run.sh
2023-02-10 14:25:26 +03:00
Alexander Tokmakov
d61c665cd5
Update run.sh
2023-02-10 14:01:48 +03:00
Kruglov Pavel
4067453602
Update run.sh
2023-02-10 11:57:02 +01:00
serxa
f61f95fcec
Replace background executor scheduler merges and mutations with round-robin
2023-02-09 18:54:15 +00:00
avogar
53a3cfc9e0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-02-09 13:24:19 +00:00
Alexander Tokmakov
de1c4f5764
fix disabled by mistake hung check
2023-02-08 22:37:22 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ ( #46075 )
...
* Replicate poco into base/poco/
* De-register poco submodule
* Build poco from ClickHouse
* Exclude poco from stylecheck
* Exclude poco from whitespace check
* Exclude poco from typo check
* Remove x bit from sources/headers (the style check complained)
* Exclude poco from duplicate include check
* Fix fasttest
* Remove contrib/poco-cmake/*
* Simplify poco build descriptions
* Remove poco stuff not used by ClickHouse
* Glob poco sources
* Exclude poco from clang-tidy
2023-02-08 12:04:11 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings
...
Allow to randomize merge tree settings in tests
2023-02-04 02:59:52 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd
...
Add systemd.service for clickhouse-keeper
2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2
2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] ( #43772 )
2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation
2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
4c86e9125b
Add necessary dependency for sanitizers
2023-02-02 13:40:04 +01:00
robot-clickhouse
ddbc8ceee8
Automatic style fix
2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d
better context for stress tests failures
2023-02-02 01:02:12 +01:00
Alexander Tokmakov
283057493b
Merge pull request #45869 from ClickHouse/stress_report_add_context
...
Add some context to stress test failures
2023-02-01 16:19:08 +03:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
...
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
Alexander Tokmakov
472aa12ba3
add some context to stress test failures
2023-02-01 01:25:31 +01:00
Alexey Milovidov
b18dc419b7
Merge pull request #45691 from ClickHouse/tavplubix-patch-2
...
Suppress TOO_MANY_PARTS in BC check
2023-01-29 04:22:42 +03:00
Saulius Valatka
fb45ed038f
add liburing to build
2023-01-28 21:54:44 +02:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels
...
Add ability to ignore unknown keys in JSON object for named tuples
2023-01-27 21:11:05 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings
2023-01-27 16:03:00 +01:00
Kruglov Pavel
81875fe559
Update run.sh
2023-01-27 14:45:10 +01:00
Alexander Tokmakov
87c1937039
Update run.sh
2023-01-27 15:28:40 +03:00
Azat Khuzhin
d21fa27379
Enable simdjson in fasttest (should be pretty lightweight)
...
The library and callers are pretty lightweight, so as tests for
JSONExtact, so this should be OK
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
avogar
dc0c1c33bb
Update
2023-01-26 14:50:59 +00:00
Anton Popov
92fa39798b
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-26 13:29:23 +00:00
Alexander Tokmakov
9b670946db
Merge branch 'master' into exception_message_patterns5
2023-01-26 00:41:32 +01:00
avogar
ced2f69a01
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-01-25 19:47:27 +00:00
Kruglov Pavel
61d836b79d
Update run.sh
2023-01-25 18:59:50 +01:00
Alexander Tokmakov
ae795d87b2
fix
2023-01-25 16:06:40 +01:00
avogar
09951c70c4
Fix
2023-01-24 16:45:07 +00:00
Alexander Tokmakov
bfd2ee1918
Update stress
2023-01-24 14:36:29 +03:00
Anton Popov
08b2e524c7
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-23 15:34:53 +00:00
Azat Khuzhin
9d88f4df27
stress: remove unused --client-cmd
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Robert Schulze
40ced78a7e
Update report.py
2023-01-22 20:01:55 +01:00
Robert Schulze
de8fc04b03
Performance report: "Partial queries" --> "Backward-incompatible queries
2023-01-22 17:43:27 +00:00
Nikolay Degterinsky
97900e9613
Merge pull request #45479 from evillique/astfuzzer-retries
...
Add more retries to AST Fuzzer
2023-01-22 13:45:38 +01:00
avogar
fd9b735505
Merge with master, add some fixes
2023-01-20 20:22:03 +00:00
avogar
d34c8f8432
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-01-20 19:28:15 +00:00
Nikolay Degterinsky
c2ac4fece0
Add more retries to AST Fuzzer
2023-01-20 16:46:24 +00:00
Alexander Tokmakov
1413b9537c
make error patterns more useful
2023-01-17 20:04:25 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern
...
Add a column with a message pattern to text_log
2023-01-17 20:19:32 +03:00
Alexey Milovidov
ec8c38c174
Add review suggestion
2023-01-13 22:53:17 +01:00
Alexey Milovidov
167d980fe2
Fix GitHub
2023-01-13 22:52:05 +01:00
Alexander Tokmakov
2d7773fccc
Merge branch 'master' into text_log_add_pattern
2023-01-13 20:33:46 +01:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-13 05:22:18 +03:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634
...
Add keytab parameter in kerberos section of config.xml
2023-01-12 15:07:45 -05:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type
...
Rework CI reports to have a class and clarify the logic
2023-01-12 18:20:40 +01:00
Anton Popov
ca80240d84
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-12 12:13:45 +00:00
Ilya Yatsishin
a927ecfe04
Merge pull request #45201 from ClickHouse/qoega-patch-5
2023-01-12 10:08:02 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-12 07:17:03 +03:00
Alexey Milovidov
c75c6c2298
Update run-fuzzer.sh
2023-01-12 07:16:10 +03:00
Alexey Milovidov
703f223e50
Remove trash from stress test
2023-01-12 04:56:20 +01:00
Mikhail f. Shiryaev
9219dc1c6e
Make sqlancer lighter by some optimizations
2023-01-11 22:43:10 +01:00
Ilya Yatsishin
ca367a6a64
Add CACHE_INVALIDATOR for sqlancer builds
2023-01-11 22:24:01 +01:00
Alexander Tokmakov
8fa1b070c6
minor cleanup in stress/run.sh
2023-01-10 19:55:06 +01:00
Alexey Milovidov
8d82f1f59e
Fix trash
2023-01-10 02:59:55 +01:00
Alexey Milovidov
17445fdd96
Fix Fuzzer script
2023-01-10 02:57:56 +01:00
Alexey Milovidov
62c0385da9
Fix Fuzzer script
2023-01-10 02:55:57 +01:00
Mikhail f. Shiryaev
84861c2b7c
Add TODO to style-check image
2023-01-09 12:10:26 +01:00
Roman Vasin
2995c6d866
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634
2023-01-09 08:26:45 +00:00
Alexey Milovidov
0b5bb118d9
Fix bash
2023-01-09 07:01:20 +01:00
Alexey Milovidov
4b2f651f72
Fix bash
2023-01-09 04:34:30 +01:00
Alexey Milovidov
e8d661b511
Merge branch 'master' into break-ci
2023-01-09 04:34:10 +01:00
Alexey Milovidov
f374d3a44e
Fix performance test
2023-01-09 01:59:48 +01:00
Alexey Milovidov
03ae644ea3
Fix performance test
2023-01-09 01:58:42 +01:00
Alexey Milovidov
e9d5bd7df3
Fix tar
2023-01-09 01:56:25 +01:00
Alexey Milovidov
93525229a9
Fix trash in Stress test
2023-01-08 23:02:49 +01:00
Alexey Milovidov
06e2fa7ebc
Merge branch 'master' into max_memory_usage_in_stress_test
2023-01-08 10:23:01 +03:00
Alexey Milovidov
3f01910446
Fix error
2023-01-08 07:59:31 +01:00
Alexey Milovidov
51038be3d5
Break CI
2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c
Break CI
2023-01-08 07:59:31 +01:00
Alexey Milovidov
fa1d595059
Merge pull request #44819 from ClickHouse/modern-tools
...
Modern tools, part 1
2023-01-08 09:50:39 +03:00
Alexey Milovidov
b9d6ce02dc
Set max memory usage for queries in the stress test
2023-01-08 06:04:56 +01:00
Alexey Milovidov
b9777fb439
Fix OOM in Fuzzer
2023-01-08 05:57:29 +01:00
Alexey Milovidov
9254c62281
Merge branch 'modern-tools' of github.com:ClickHouse/ClickHouse into modern-tools
2023-01-08 03:21:00 +01:00
Alexey Milovidov
e298035d08
Fix performance test
2023-01-08 03:20:42 +01:00
Alexey Milovidov
983bd527dd
Merge branch 'master' into modern-tools
2023-01-08 03:19:30 +01:00
Alexey Milovidov
e07dd44f79
Merge pull request #45026 from ClickHouse/fix-fuzzer-3
...
Fix false positive in Fuzzer, alternative variant
2023-01-08 04:59:13 +03:00
Alexey Milovidov
bf57564ec5
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-08 02:26:09 +01:00
Alexey Milovidov
d22f25b72f
Merge pull request #45025 from ClickHouse/fix-fuzzer-2
...
Fix false positive in Fuzzer
2023-01-08 04:24:22 +03:00
Alexey Milovidov
cc32bec83b
Fix false positive in Fuzzer, alternative variant
2023-01-08 01:20:11 +01:00
Alexey Milovidov
c308c40eed
Fix false positive in Fuzzer
2023-01-08 01:14:46 +01:00
Alexey Milovidov
2065871b87
Merge branch 'master' into no-adduser
2023-01-07 23:24:40 +03:00
Alexey Milovidov
a9324c0517
More ok cases for Fuzzer
2023-01-07 02:23:15 +01:00
Alexey Milovidov
869428f228
Remove adduser
dependency
2023-01-07 01:45:54 +01:00
Alexey Milovidov
3211f63911
Add dmesg.log to Fuzzer
2023-01-07 01:18:35 +01:00
Alexey Milovidov
772b6b69a9
Fix strange trash in Fuzzer
2023-01-07 00:40:01 +01:00
Alexey Milovidov
42f25cb6a6
Amend
2023-01-07 00:57:47 +03:00