Alexey Milovidov
077cd535e2
Improvements
2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd
Merge branch 'master' into export-logs-in-ci-fuzz
2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
...
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
ec779ca246
Export logs from CI in performance (part 2)
2023-08-13 00:32:55 +02:00
Alexey Milovidov
9f9b794feb
Export logs from CI in performance (preparation)
2023-08-13 00:32:55 +02:00
Alexey Milovidov
a3ae62a1d1
Fix YAML
2023-08-13 01:18:08 +03:00
Alexey Milovidov
87a40fb02c
Fix YAML
2023-08-13 00:16:40 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
...
Add SQLTest
2023-08-13 00:35:46 +03:00
Alexey Milovidov
afbb91600e
Export logs from CI in fuzzer
2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5
Export logs from CI in stress tests
2023-08-12 22:30:18 +02:00
Alexey Milovidov
f314c29386
Export logs to CI from stateful tests
2023-08-12 21:58:17 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
...
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Alexey Milovidov
0792d36415
Merge pull request #53286 from arthurpassos/pin_coredns_version_and_fix_tests
...
Bring back **garbage** dns tests
2023-08-12 17:24:38 +03:00
Alexey Milovidov
a1d3f1836e
Fix shellcheck
2023-08-12 02:46:28 +02:00
Alexey Milovidov
3b85c5ed0e
Put the script into the base Docker image
2023-08-12 02:14:58 +02:00
kssenii
44efd74c8d
Change log level
2023-08-11 20:41:31 +02:00
Alexey Milovidov
736ff1c127
Merge branch 'master' into allow-creating-system-tables-at-startup
2023-08-11 01:25:49 +02:00
Arthur Passos
9781a8cee9
bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query
2023-08-10 16:45:29 -03:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest
2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci
2023-08-10 16:56:14 +03:00
Alexey Milovidov
0ba3fea7fe
Apply recommendations
2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a
Protection if the repository is old
2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300
Address review comments
2023-08-10 04:32:39 +02:00
Alexey Milovidov
f2621e70ae
Remove unrecognizable garbage from the performance test
2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f
Remove unrecognizable garbage from the performance test
2023-08-10 03:26:11 +02:00
Alexey Milovidov
10bc51514b
Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci
2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a
Merge branch 'master' into allow-creating-system-tables-at-startup
2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest
2023-08-09 05:10:47 +03:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests ( #52072 )
...
* metrics_perf_events_enabled turn off in perf tests
* turn on metrics_perf_events_enabled for heating and profile requests
* close_perf_descriptors fix the condition
* do not read opend but disabled perf event
* Revert "do not read opend but disabled perf event"
This reverts commit eeab1c9c63
.
2023-08-07 23:25:16 +02:00
Alexey Milovidov
0bab88b7cb
Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci
2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup
2023-08-07 18:58:18 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15
...
Add `abort_on_error=1` to `TSAN_OPTIONS`
2023-08-07 17:17:04 +03:00
Alexey Milovidov
fbb2be21cc
Slightly better
2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74
Maybe fix bash
2023-08-06 12:51:37 +02:00
Antonio Andelic
cafa5ef2f3
Merge branch 'master' into add-reading-from-archives
2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1
Fix shellcheck
2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9
Enable export (first try)
2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7
YAML is mandatory
2023-08-06 02:52:36 +02:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2
...
tests: fix possible EADDRINUSE v2
2023-08-05 13:39:25 +03:00
Nikita Taranov
555c90a50c
add to integration tests
2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1
to TSAN_OPTIONS
for stress tests
2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop
2023-08-04 17:53:57 +02:00
Alexey Milovidov
65e8ee8fb7
Fix paths
2023-08-03 15:28:18 +02:00
Antonio Andelic
96bad0537a
Merge branch 'master' into add-reading-from-archives
2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab
tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
...
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb
tests: use explicit address for console to avoid EADDRINUSE
...
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.
And even though this is a problem of MinIO I'm not a go developer to fix
it.
v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912
Merge branch 'master' into sqltest
2023-08-02 20:08:39 +02:00
Antonio Andelic
e366ca61f5
Merge branch 'master' into add-reading-from-archives
2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3
2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest
2023-08-01 16:14:28 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
...
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc
Disable for fasttest
2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49
Update dockerfile
2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683
Extend tests
2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd
Merge branch 'allow-oom-stress-upgrade-checks' into move-regions
2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5
Allow OOM in Stress and Upgrade checks
2023-07-31 12:27:35 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions
2023-07-30 10:34:10 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile
2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6
Fix Docker
2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3
Change the default timezones in Docker test images
2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6
Fix Docker
2023-07-30 04:22:36 +02:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated
...
Make shutdown of `ReplicatedMergeTree` tables more soft
2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests ( #51445 )
...
* Fix attaching gdb in stress tests
* Fix
* Update run.sh
* Try remove run_with_retry
* Return run_with_retry
* Don't set -e in run_with_retry if it was't set before
* Update tests/ci/utils.lib
* Fix bash
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated
2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone
...
Randomize timezone in tests across non-deterministic around 1970 and default
2023-07-24 22:47:52 +03:00
Azat Khuzhin
2389e0f0b6
Randomize timezone in tests across non-deterministic around 1970 and default
...
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).
But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.
So to catch such issues in the PRs itself, let's randomize
session_timezone as well.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop
2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd
Fix CI
2023-07-23 17:30:23 +02:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated
2023-07-23 00:12:29 +02:00
Mikhail f. Shiryaev
cf01800a63
Sort DOCKER_*_TAG stuff
2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1
Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav
2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b
Sanitize compose files in integration-tests-runner
2023-07-22 15:45:47 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated
2023-07-22 12:11:39 +02:00
Alexey Milovidov
de2016261e
Get rid of it
2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
...
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
999cce12b1
Merge branch 'master' into sqltest
2023-07-22 01:55:54 +02:00
Alexey Milovidov
fa44f84377
Fix style
2023-07-20 04:50:18 +02:00
Alexey Milovidov
f458108c44
Fix style
2023-07-19 22:15:23 +02:00
Yatsishin Ilya
bb4924ab63
Multiple sqllogictest improvements
2023-07-19 12:24:31 +00:00
Ilya Golshtein
4259176f24
test_for_basic_auth_registry - original zk configuration restored
2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d
test_for_basic_auth_registry - fix port in test_kafka_formats
2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb
test_for_basic_auth_registry - UnknownTopicOrPartitionException
2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a
test_for_basic_auth_registry - both tests works, simplifications
2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a
test_for_basic_auth_registry - started, but only auth test works
2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f
test_for_basic_auth_registry - one kafka instance again
2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4
test_for_basic_auth_registry - attempt to have two kafka instances
2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834
test_for_basic_auth_registry - mock up
2023-07-19 08:32:44 +00:00
robot-clickhouse
891c01e6ab
Automatic style fix
2023-07-19 02:37:02 +00:00
Alexey Milovidov
9b10e0a5bc
Improvement
2023-07-19 04:09:19 +02:00
Alexey Milovidov
fe59729537
Improvement
2023-07-19 04:01:00 +02:00
Alexey Milovidov
76677e009b
Improvement
2023-07-19 04:00:50 +02:00
Alexey Milovidov
50dac21483
Improvement
2023-07-19 03:54:09 +02:00
Alexey Milovidov
2255307a47
Improvement
2023-07-19 03:49:47 +02:00
Alexey Milovidov
fcf4a6ea88
Fix error
2023-07-19 03:48:48 +02:00
Alexey Milovidov
174166b233
Fix error
2023-07-19 03:47:41 +02:00
Alexey Milovidov
df5abcf685
Update Docker
2023-07-19 03:45:43 +02:00
Alexey Milovidov
8e3bd222f0
Add SQLTest
2023-07-19 03:42:32 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated
2023-07-17 19:04:29 +02:00
Azat Khuzhin
6f6562c96b
Fix running integration tests with spaces in it's names
...
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]
[1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html
Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.
v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d
Fix flakiness of test_keeper_s3_snapshot
...
This is part of "Why my PR is not merged?" patch set series.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
...
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
Azat Khuzhin
a10aa9ad50
Force libunwind usage (removes gcc_eh support)
...
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).
gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.
Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720
Allow OOM in AST Fuzzer with Sanitizers
2023-07-08 05:57:23 +02:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages
2023-07-07 13:44:13 +03:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2
2023-07-06 21:10:41 +02:00
Alexander Sapin
9ae0dc730c
Review fixes + enable in ci
2023-07-06 17:15:26 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error
2023-07-06 16:09:52 +02:00
Antonio Andelic
085f7caccf
Move config changes after configure
2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55
Remove useless packages
2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks
...
Fix disk config for upgrade tests
2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b
Correctly move config
2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce
2023-07-05 10:28:57 +02:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 13:05:41 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
...
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824
Add odbcinst dep to sqllogic docker
2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation
2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4
Make scripts backwards compatible
2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5
Wait with retries
2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation
2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
...
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create
2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0
Retry chroot creation in ZK
2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests
2023-06-29 12:24:19 +02:00
Alexander Tokmakov
296f9968c0
fix
2023-06-28 23:20:02 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker
2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
91dc6dfe34
Update mysql-php-client to the recent rolling version
2023-06-28 22:19:39 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too
2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
edcf981c48
Update mysql odbc connector
2023-06-28 22:19:31 +02:00
Mikhail f. Shiryaev
5a8ce1f2fe
Do not upload the binaries for fast-tests to tests-reports
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
7b4e6faece
Speedup the submodules cloning
2023-06-28 22:19:28 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images
2023-06-28 22:11:48 +02:00
Alexey Milovidov
de58339c3b
Merge branch 'fix-perf-tests-jemalloc' of github.com:azat/ClickHouse into many-fixes
2023-06-27 05:35:26 +02:00
Alexey Milovidov
4ee74ec213
Two tests are twice longer in average with Analyzer and sometimes failing
2023-06-26 02:19:52 +02:00
Azat Khuzhin
5871ca0836
Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled
...
jemalloc can show the following warning:
Number of CPUs detected is not deterministic. Per-CPU arena disabled
It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()
And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:
smpboot: Allowing 128 CPUs, 64 hotplug CPUs
And from sysfs:
# grep . /sys/devices/system/cpu/{possible,online,offline}
/sys/devices/system/cpu/possible:0-127
/sys/devices/system/cpu/online:0-63
/sys/devices/system/cpu/offline:64-127
From ACPI:
# acpidump -o acpi
# acpixtract -a acpi
# iasl -d *.dat
# grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
64 Processor Enabled : 0
64 Processor Enabled : 1
So I guess this is the same as what happened in this perf run [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html
P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-25 09:37:37 +02:00
Alexander Tokmakov
f973bd7516
suppress check for covered parts in zk
2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling
...
Improve scheduling of background tasks in ReplicatedMergeTree
2023-06-20 16:25:19 +03:00
Alexander Tokmakov
5dd9b10c8e
fix
2023-06-19 20:14:28 +02:00
Yatsishin Ilya
b472480d48
Fix branch name
2023-06-19 10:06:56 +00:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log
2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main
2023-06-16 00:28:09 +02:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone
...
Fix 'Illegal column timezone' in stress tests
2023-06-14 17:56:57 +03:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits
2023-06-13 17:53:19 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests
...
Attach gdb in stateless tests
2023-06-13 17:04:17 +03:00
Alexander Tokmakov
3a2fa65075
fix 'Illegal column timezone' in stress tests
2023-06-13 16:02:54 +02:00
alesapin
a614aa3b03
More leftovers
2023-06-10 16:06:37 +02:00
alesapin
20b66689f3
Fix test
2023-06-10 13:34:51 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck
2023-06-06 12:23:00 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow
...
Fail perf tests when too many queries slowed down
2023-06-06 11:33:04 +02:00
avogar
e8c6c7967b
Move attaching gdb to separate lib
2023-06-05 18:21:40 +00:00