Antonio Andelic
1124c7ae8b
Correctly move config
2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce
2023-07-05 10:28:57 +02:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 13:05:41 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
...
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824
Add odbcinst dep to sqllogic docker
2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation
2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4
Make scripts backwards compatible
2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5
Wait with retries
2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation
2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
...
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create
2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0
Retry chroot creation in ZK
2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests
2023-06-29 12:24:19 +02:00
Alexander Tokmakov
296f9968c0
fix
2023-06-28 23:20:02 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker
2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
91dc6dfe34
Update mysql-php-client to the recent rolling version
2023-06-28 22:19:39 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too
2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
edcf981c48
Update mysql odbc connector
2023-06-28 22:19:31 +02:00
Mikhail f. Shiryaev
5a8ce1f2fe
Do not upload the binaries for fast-tests to tests-reports
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images
2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
7b4e6faece
Speedup the submodules cloning
2023-06-28 22:19:28 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images
2023-06-28 22:11:48 +02:00
Alexey Milovidov
de58339c3b
Merge branch 'fix-perf-tests-jemalloc' of github.com:azat/ClickHouse into many-fixes
2023-06-27 05:35:26 +02:00
Alexey Milovidov
4ee74ec213
Two tests are twice longer in average with Analyzer and sometimes failing
2023-06-26 02:19:52 +02:00
Azat Khuzhin
5871ca0836
Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled
...
jemalloc can show the following warning:
Number of CPUs detected is not deterministic. Per-CPU arena disabled
It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()
And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:
smpboot: Allowing 128 CPUs, 64 hotplug CPUs
And from sysfs:
# grep . /sys/devices/system/cpu/{possible,online,offline}
/sys/devices/system/cpu/possible:0-127
/sys/devices/system/cpu/online:0-63
/sys/devices/system/cpu/offline:64-127
From ACPI:
# acpidump -o acpi
# acpixtract -a acpi
# iasl -d *.dat
# grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
64 Processor Enabled : 0
64 Processor Enabled : 1
So I guess this is the same as what happened in this perf run [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html
P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-25 09:37:37 +02:00
Alexander Tokmakov
f973bd7516
suppress check for covered parts in zk
2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling
...
Improve scheduling of background tasks in ReplicatedMergeTree
2023-06-20 16:25:19 +03:00
Alexander Tokmakov
5dd9b10c8e
fix
2023-06-19 20:14:28 +02:00
Yatsishin Ilya
b472480d48
Fix branch name
2023-06-19 10:06:56 +00:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log
2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main
2023-06-16 00:28:09 +02:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone
...
Fix 'Illegal column timezone' in stress tests
2023-06-14 17:56:57 +03:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits
2023-06-13 17:53:19 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests
...
Attach gdb in stateless tests
2023-06-13 17:04:17 +03:00
Alexander Tokmakov
3a2fa65075
fix 'Illegal column timezone' in stress tests
2023-06-13 16:02:54 +02:00
alesapin
a614aa3b03
More leftovers
2023-06-10 16:06:37 +02:00
alesapin
20b66689f3
Fix test
2023-06-10 13:34:51 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck
2023-06-06 12:23:00 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow
...
Fail perf tests when too many queries slowed down
2023-06-06 11:33:04 +02:00
avogar
e8c6c7967b
Move attaching gdb to separate lib
2023-06-05 18:21:40 +00:00
Nikita Taranov
4506299d73
impl
2023-06-02 23:14:09 +02:00
avogar
8973259678
Test attach gdb in stateless tests
2023-06-02 15:00:24 +00:00
Alexander Tokmakov
1544067fb3
Update run.sh
2023-06-01 23:28:19 +03:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id ( #49780 )
...
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
Here is some infomation:
1.old table:
CREATE TABLE a1 (`id` UInt64)
ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
2.new table:
CREATE TABLE a2 (`id` UInt64)
ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
ORDER BY (id);
3.error info:
<Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(DUPLICATE_INTERSERVER_IO_ENDPOINT)
<Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
(NO_SUCH_INTERSERVER_IO_ENDPOINT)
* Revert "Add zookeeper name in endpoint id"
This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.
* Add zookeeper name in endpoint id
When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.
* Fix incompatible with a new setting
* add a test, fix other issues
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
* Update 02735_system_zookeeper_connection.reference
* Update 02735_system_zookeeper_connection.sql
* Update run.sh
* Remove the 'no-fasttest' tag
* Update 02442_auxiliary_zookeeper_endpoint_id.sql
---------
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Azat Khuzhin
73661c3a46
Move tunnings for woboq codebrowser to cmake out from build.sh
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-18 18:18:30 +02:00
Mikhail f. Shiryaev
e79c1cdb1a
Attempt to increas parallelism for codebrowser_generator
2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
65d1ae77ee
Use updated upstream woboq
2023-05-12 19:22:49 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary
2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
ec701d96c7
Rework the codebrowser build directories structure
2023-05-12 19:22:47 +02:00
Mikhail f. Shiryaev
7614c1c848
Move the command for codebrowser into a script
2023-05-12 19:22:45 +02:00
Azat Khuzhin
a0cc5b7e47
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-10 16:28:36 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
...
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
Han Fei
505d9be7b2
address comments
2023-05-10 13:56:17 +02:00
Azat Khuzhin
be39e8e566
Merge remote-tracking branch 'u/master' into build/llvm-16
...
Conflicts:
docker/test/codebrowser/Dockerfile
2023-05-09 20:40:43 +02:00
Mikhail f. Shiryaev
780b5a6f97
Fix a wrong built generator removal, use depth=1
2023-05-09 12:36:02 +02:00
Azat Khuzhin
bf17c819c3
docker: fix path to clang builtin headers for woboq code browser
...
By default woboq uses $version.$minor.$patch, while clang simply uses
$version:
CMake Error at generator/CMakeLists.txt:77 (message):
Could not find any clang builtins headers in
/usr/lib/llvm-16/lib/clang/16.0.4/include
# ls -d /usr/lib/llvm-16/lib/clang/16/include
/usr/lib/llvm-16/lib/clang/16/include
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:31:55 +02:00
Azat Khuzhin
08b8b7e587
docker: remove symlink for libclang (not required anymore)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:30:02 +02:00
Azat Khuzhin
82536fedde
docker: install libclang-16-dev for woboq code browser
...
Otherwise you will get the following error:
CMake Error at /usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake:792 (message):
The imported target "clangBasic" references the file
"/usr/lib/llvm-16/lib/libclangBasic.a"
but this file does not exist. Possible reasons include:
* The file was deleted, renamed, or moved to another location.
* An install or uninstall procedure did not complete successfully.
* The installation package was faulty and contained
"/usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake"
but not all the files it references.
Call Stack (most recent call first):
/usr/lib/llvm-16/lib/cmake/clang/ClangConfig.cmake:20 (include)
generator/CMakeLists.txt:7 (Find_Package)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:25:50 +02:00
Han Fei
64b67b9a37
Merge branch 'master' into hanfei/fiu
2023-05-09 01:14:30 +02:00
Azat Khuzhin
c525d13272
Enable back thread fuzzuer under TSan
...
Since initial issue got resolved [1].
[1]: https://github.com/google/sanitizers/issues/1540
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-08 22:35:09 +02:00
Azat Khuzhin
c37fe64040
Merge remote-tracking branch 'u/master' into build/llvm-16
2023-05-08 22:33:52 +02:00
Dmitry Novik
a3b3b78eb0
EXPECTED_TO_FAIL -> NOT_FAILED
2023-05-05 17:53:15 +00:00
Dmitry Novik
0baaaaba42
KNOWN_BROKEN -> BROKEN
2023-05-05 17:43:54 +00:00
Dmitry Novik
5422e3058f
Use more specific test status
2023-05-05 16:19:01 +00:00
Dmitry Novik
b13e3abc4d
Improve CI check for Analyzer
2023-05-05 15:17:16 +00:00
alesapin
08039024a2
Merge pull request #49492 from ClickHouse/add_server_jepsen_image
...
Fixes in server jepsen image
2023-05-04 12:02:27 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage
...
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
2023-05-04 11:47:43 +02:00
alesapin
27f9384717
Followup
2023-05-03 23:33:19 +02:00
alesapin
c1d8fab2da
Fxi
2023-05-03 21:05:19 +02:00
alesapin
6e8934f856
Improve image for local run
2023-05-03 14:40:18 +02:00
Han Fei
d608ba41e7
try to fix
2023-05-02 00:05:36 +02:00
Kseniia Sumarokova
d4aa96e262
Merge branch 'master' into better-local-object-storage
2023-04-28 21:05:05 +02:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage
2023-04-27 14:54:04 +02:00
robot-clickhouse
3448b112d8
Automatic style fix
2023-04-27 12:31:00 +00:00
Alexey Milovidov
8eae3ed3a5
Fix garbage #48719
2023-04-27 13:48:23 +02:00
Kseniia Sumarokova
c4abe66d77
Update run.sh
2023-04-25 12:25:49 +02:00
kssenii
f38dfc9206
Update run.sh
2023-04-23 12:49:22 +02:00
Kseniia Sumarokova
370aa60159
Update run.sh
2023-04-21 22:10:06 +02:00
robot-clickhouse
eda1379180
Automatic style fix
2023-04-21 19:04:36 +00:00
Dmitry Novik
5fef967872
Make error message better
2023-04-21 18:11:54 +00:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci
2023-04-21 15:43:16 +02:00
kssenii
e58c16318f
Merge remote-tracking branch 'upstream/master' into better-local-object-storage
2023-04-21 12:49:40 +02:00
kssenii
88f412ad23
Fix upgrade check, fix integration test
2023-04-21 12:44:08 +02:00
Mikhail f. Shiryaev
634cf010b9
Merge pull request #48935 from ClickHouse/fasttests-build-time
...
Add building stage to the fasttests report, respect existing status on rerun
2023-04-20 15:50:18 +02:00
Mikhail f. Shiryaev
c80d8081d2
Add building stage to the fasttests report
2023-04-19 13:35:28 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS
2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup
2023-04-19 09:44:53 +02:00
Dmitry Novik
308970da83
Add logging
2023-04-18 13:53:13 +00:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci
2023-04-18 13:07:45 +02:00
Dmitry Novik
6197d3d55f
Pass volume only for analyzer
2023-04-18 00:12:30 +00:00
Sema Checherinda
0354a964cd
turn on all CI back
2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e
introduce sqllogic runner
2023-04-16 13:57:24 +02:00
Dmitry Novik
3df33d74f5
Get rid of another docker image
2023-04-13 17:22:12 +02:00
kssenii
4bf01c611c
Fix
2023-04-13 16:56:11 +02:00
kssenii
6f53784f22
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-04-13 15:56:40 +02:00
robot-clickhouse
fa7b72570b
Automatic style fix
2023-04-12 17:09:37 +00:00
Dmitry Novik
360fc59694
Handle known broken tests
2023-04-12 16:46:30 +00:00
Azat Khuzhin
a1272e8536
Pass existing TSAN_OPTIONS to integration tests and append new options
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
Azat Khuzhin
61bf70be12
Add second_deadlock_stack=1 for TSan on CI
...
To improve TSan reports.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:05:57 +02:00
kssenii
00282483c9
Address remaining review comments
2023-04-07 18:29:55 +02:00
kssenii
c40f17a276
One more attempt
2023-04-06 20:09:06 +02:00
kssenii
4a94074f71
Try fix java errors in CI
2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91
Remove redundant from dockerd-entrypoint.sh
2023-04-05 14:40:30 +02:00
kssenii
319417062f
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-30 18:29:46 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests
2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests
2023-03-29 23:33:24 +02:00
kssenii
fcc8e4223c
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-29 14:13:27 +02:00
kssenii
04b28bf822
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-28 15:39:24 +02:00
Raúl Marín
ff209db129
Merge branch 'master' into zk_inject_timeout
2023-03-27 19:46:10 +02:00
Raúl Marín
c47dcb0805
Enable ZK fault injection on new servers (but not during startup)
2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
...
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
...
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository
2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread
...
Fix terminate in parts check thread
2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix
2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX
2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53
apply black formatter
2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe
fix
2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 ( #47858 )
2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e
apply black to all python scripts
2023-03-20 17:30:20 +00:00
Alexey Milovidov
0f7f620100
Update one more place
2023-03-19 01:07:11 +01:00
Alexey Milovidov
89a76c2d77
Use LLVM 16
2023-03-18 23:45:57 +01:00
kssenii
f776f4ff46
Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes
2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993
2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad
fix intersecting parts, better fault injections
2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae
ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881
ci/upgrade: remove obsolete function call
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7
ci/upgrade: fix creating system database with Ordinary engine
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:12:32 +01:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper
...
Fix Keeper with `force_sync = false`
2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9
Use force_sync=true in upgrade check
2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68
Add spark to tests, rewrite tests, fix bug
2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880
suppress expected errors from test 01111 in Upgrade check
2023-03-08 15:27:43 +01:00
Alexander Tokmakov
d34f00f437
Update run.sh
2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa
Suppress "Cannot flush" for Distributed tables in upgrade check
...
CI reports [1]:
2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
[1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image
2023-02-28 20:20:04 +01:00
Kruglov Pavel
261c3aa86d
Update
2023-02-27 16:42:29 +01:00
avogar
ff67fc4b06
Remove llvm-9 from dependencies
2023-02-24 16:59:27 +00:00
avogar
e52a995e46
Fix style
2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01
Make better
2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-02-24 13:52:22 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests ( #46641 )
...
* Avoid OOM in perf tests
At some point perf tests started to fail for one setup on CI [1]:
/home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed python3 performance_comparison_check.py "$CHECK_NAME"
Error: Process completed with exit code 137.
[1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
---------
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-23 14:05:18 +01:00
Alexander Tokmakov
dcf8aeab8f
Update stress
2023-02-21 22:16:05 +03:00
Alexander Tokmakov
97e9df0148
Update stress
2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests ( #41534 )
...
* Update stress
* fix
---------
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-02-21 15:36:23 +03:00
Alexander Tokmakov
669c4e94d5
Update compare.sh
2023-02-20 17:35:30 +03:00
Azat Khuzhin
5a5f99a27e
Add CPU flamegraphs for perf tests
...
In Real profiler there is too much noise (polling, cond vars, ...)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
...
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix
2023-02-16 14:31:11 +01:00
Azat Khuzhin
bddead1ea2
Revert "Merge pull request #38212 from azat/no-stress"
...
This reverts commit 24d5be1669
, reversing
changes made to a756b4be27
.
After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.
Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix
2023-02-15 17:13:40 +03:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler
2023-02-14 20:39:02 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses
...
Fix stress tests statuses
2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e
fix stress tests statuses
2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh
2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh
2023-02-14 13:10:18 +01:00
Azat Khuzhin
dc5d7809b6
Do not continue perf tests in case of exception in create_query/fill_query
...
Previously due to using of threading.Thread, exception had been
ignored, and perf test simply continues, yes it will show some errors,
but it also may show that the test became faster, while it is because
the underlying table was empty.
Replace threading.Thread with a SafeThread (inline implementation) that
simply rethrow exception in join.
Here is an example of such report [1], look at the ip_trie test.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/2101b66570cbb9eb9a492afa8ab82d562c34336b/performance_comparison_[3/4]/report.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-13 17:31:15 +01:00
serxa
c17dc8e284
fix
2023-02-11 16:48:47 +00:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler
2023-02-11 10:30:26 +01:00
Kruglov Pavel
38fbf88ea7
Merge branch 'master' into split-bc-check
2023-02-10 18:28:49 +01:00
Kruglov Pavel
43e660ebd2
Update run.sh
2023-02-10 18:28:19 +01:00
Alexander Tokmakov
9c20e42807
Update run.sh
2023-02-10 14:25:26 +03:00
Alexander Tokmakov
d61c665cd5
Update run.sh
2023-02-10 14:01:48 +03:00
Kruglov Pavel
4067453602
Update run.sh
2023-02-10 11:57:02 +01:00
serxa
f61f95fcec
Replace background executor scheduler merges and mutations with round-robin
2023-02-09 18:54:15 +00:00
avogar
53a3cfc9e0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-02-09 13:24:19 +00:00
Alexander Tokmakov
de1c4f5764
fix disabled by mistake hung check
2023-02-08 22:37:22 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ ( #46075 )
...
* Replicate poco into base/poco/
* De-register poco submodule
* Build poco from ClickHouse
* Exclude poco from stylecheck
* Exclude poco from whitespace check
* Exclude poco from typo check
* Remove x bit from sources/headers (the style check complained)
* Exclude poco from duplicate include check
* Fix fasttest
* Remove contrib/poco-cmake/*
* Simplify poco build descriptions
* Remove poco stuff not used by ClickHouse
* Glob poco sources
* Exclude poco from clang-tidy
2023-02-08 12:04:11 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings
...
Allow to randomize merge tree settings in tests
2023-02-04 02:59:52 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd
...
Add systemd.service for clickhouse-keeper
2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2
2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] ( #43772 )
2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation
2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
4c86e9125b
Add necessary dependency for sanitizers
2023-02-02 13:40:04 +01:00
robot-clickhouse
ddbc8ceee8
Automatic style fix
2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d
better context for stress tests failures
2023-02-02 01:02:12 +01:00
Alexander Tokmakov
283057493b
Merge pull request #45869 from ClickHouse/stress_report_add_context
...
Add some context to stress test failures
2023-02-01 16:19:08 +03:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
...
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
Alexander Tokmakov
472aa12ba3
add some context to stress test failures
2023-02-01 01:25:31 +01:00
Alexey Milovidov
b18dc419b7
Merge pull request #45691 from ClickHouse/tavplubix-patch-2
...
Suppress TOO_MANY_PARTS in BC check
2023-01-29 04:22:42 +03:00
Saulius Valatka
fb45ed038f
add liburing to build
2023-01-28 21:54:44 +02:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels
...
Add ability to ignore unknown keys in JSON object for named tuples
2023-01-27 21:11:05 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings
2023-01-27 16:03:00 +01:00
Kruglov Pavel
81875fe559
Update run.sh
2023-01-27 14:45:10 +01:00
Alexander Tokmakov
87c1937039
Update run.sh
2023-01-27 15:28:40 +03:00
Azat Khuzhin
d21fa27379
Enable simdjson in fasttest (should be pretty lightweight)
...
The library and callers are pretty lightweight, so as tests for
JSONExtact, so this should be OK
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
avogar
dc0c1c33bb
Update
2023-01-26 14:50:59 +00:00
Anton Popov
92fa39798b
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-26 13:29:23 +00:00
Alexander Tokmakov
9b670946db
Merge branch 'master' into exception_message_patterns5
2023-01-26 00:41:32 +01:00
avogar
ced2f69a01
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-01-25 19:47:27 +00:00
Kruglov Pavel
61d836b79d
Update run.sh
2023-01-25 18:59:50 +01:00
Alexander Tokmakov
ae795d87b2
fix
2023-01-25 16:06:40 +01:00
avogar
09951c70c4
Fix
2023-01-24 16:45:07 +00:00
Alexander Tokmakov
bfd2ee1918
Update stress
2023-01-24 14:36:29 +03:00
Anton Popov
08b2e524c7
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-23 15:34:53 +00:00
Azat Khuzhin
9d88f4df27
stress: remove unused --client-cmd
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-23 13:47:59 +01:00
Robert Schulze
40ced78a7e
Update report.py
2023-01-22 20:01:55 +01:00
Robert Schulze
de8fc04b03
Performance report: "Partial queries" --> "Backward-incompatible queries
2023-01-22 17:43:27 +00:00
Nikolay Degterinsky
97900e9613
Merge pull request #45479 from evillique/astfuzzer-retries
...
Add more retries to AST Fuzzer
2023-01-22 13:45:38 +01:00
avogar
fd9b735505
Merge with master, add some fixes
2023-01-20 20:22:03 +00:00
avogar
d34c8f8432
Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-01-20 19:28:15 +00:00
Nikolay Degterinsky
c2ac4fece0
Add more retries to AST Fuzzer
2023-01-20 16:46:24 +00:00
Alexander Tokmakov
1413b9537c
make error patterns more useful
2023-01-17 20:04:25 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern
...
Add a column with a message pattern to text_log
2023-01-17 20:19:32 +03:00
Alexey Milovidov
ec8c38c174
Add review suggestion
2023-01-13 22:53:17 +01:00
Alexey Milovidov
167d980fe2
Fix GitHub
2023-01-13 22:52:05 +01:00
Alexander Tokmakov
2d7773fccc
Merge branch 'master' into text_log_add_pattern
2023-01-13 20:33:46 +01:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-13 05:22:18 +03:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634
...
Add keytab parameter in kerberos section of config.xml
2023-01-12 15:07:45 -05:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type
...
Rework CI reports to have a class and clarify the logic
2023-01-12 18:20:40 +01:00
Anton Popov
ca80240d84
Merge remote-tracking branch 'upstream/master' into HEAD
2023-01-12 12:13:45 +00:00
Ilya Yatsishin
a927ecfe04
Merge pull request #45201 from ClickHouse/qoega-patch-5
2023-01-12 10:08:02 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-12 07:17:03 +03:00
Alexey Milovidov
c75c6c2298
Update run-fuzzer.sh
2023-01-12 07:16:10 +03:00
Alexey Milovidov
703f223e50
Remove trash from stress test
2023-01-12 04:56:20 +01:00
Mikhail f. Shiryaev
9219dc1c6e
Make sqlancer lighter by some optimizations
2023-01-11 22:43:10 +01:00
Ilya Yatsishin
ca367a6a64
Add CACHE_INVALIDATOR for sqlancer builds
2023-01-11 22:24:01 +01:00
Alexander Tokmakov
8fa1b070c6
minor cleanup in stress/run.sh
2023-01-10 19:55:06 +01:00
Alexey Milovidov
8d82f1f59e
Fix trash
2023-01-10 02:59:55 +01:00
Alexey Milovidov
17445fdd96
Fix Fuzzer script
2023-01-10 02:57:56 +01:00
Alexey Milovidov
62c0385da9
Fix Fuzzer script
2023-01-10 02:55:57 +01:00
Mikhail f. Shiryaev
84861c2b7c
Add TODO to style-check image
2023-01-09 12:10:26 +01:00
Roman Vasin
2995c6d866
Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634
2023-01-09 08:26:45 +00:00
Alexey Milovidov
0b5bb118d9
Fix bash
2023-01-09 07:01:20 +01:00
Alexey Milovidov
4b2f651f72
Fix bash
2023-01-09 04:34:30 +01:00
Alexey Milovidov
e8d661b511
Merge branch 'master' into break-ci
2023-01-09 04:34:10 +01:00
Alexey Milovidov
f374d3a44e
Fix performance test
2023-01-09 01:59:48 +01:00
Alexey Milovidov
03ae644ea3
Fix performance test
2023-01-09 01:58:42 +01:00
Alexey Milovidov
e9d5bd7df3
Fix tar
2023-01-09 01:56:25 +01:00
Alexey Milovidov
93525229a9
Fix trash in Stress test
2023-01-08 23:02:49 +01:00
Alexey Milovidov
06e2fa7ebc
Merge branch 'master' into max_memory_usage_in_stress_test
2023-01-08 10:23:01 +03:00
Alexey Milovidov
3f01910446
Fix error
2023-01-08 07:59:31 +01:00
Alexey Milovidov
51038be3d5
Break CI
2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c
Break CI
2023-01-08 07:59:31 +01:00
Alexey Milovidov
fa1d595059
Merge pull request #44819 from ClickHouse/modern-tools
...
Modern tools, part 1
2023-01-08 09:50:39 +03:00
Alexey Milovidov
b9d6ce02dc
Set max memory usage for queries in the stress test
2023-01-08 06:04:56 +01:00
Alexey Milovidov
b9777fb439
Fix OOM in Fuzzer
2023-01-08 05:57:29 +01:00
Alexey Milovidov
9254c62281
Merge branch 'modern-tools' of github.com:ClickHouse/ClickHouse into modern-tools
2023-01-08 03:21:00 +01:00
Alexey Milovidov
e298035d08
Fix performance test
2023-01-08 03:20:42 +01:00
Alexey Milovidov
983bd527dd
Merge branch 'master' into modern-tools
2023-01-08 03:19:30 +01:00
Alexey Milovidov
e07dd44f79
Merge pull request #45026 from ClickHouse/fix-fuzzer-3
...
Fix false positive in Fuzzer, alternative variant
2023-01-08 04:59:13 +03:00
Alexey Milovidov
bf57564ec5
Merge branch 'master' into add-dmesg-log-to-fuzzer
2023-01-08 02:26:09 +01:00
Alexey Milovidov
d22f25b72f
Merge pull request #45025 from ClickHouse/fix-fuzzer-2
...
Fix false positive in Fuzzer
2023-01-08 04:24:22 +03:00
Alexey Milovidov
cc32bec83b
Fix false positive in Fuzzer, alternative variant
2023-01-08 01:20:11 +01:00
Alexey Milovidov
c308c40eed
Fix false positive in Fuzzer
2023-01-08 01:14:46 +01:00
Alexey Milovidov
2065871b87
Merge branch 'master' into no-adduser
2023-01-07 23:24:40 +03:00
Alexey Milovidov
a9324c0517
More ok cases for Fuzzer
2023-01-07 02:23:15 +01:00
Alexey Milovidov
869428f228
Remove adduser
dependency
2023-01-07 01:45:54 +01:00
Alexey Milovidov
3211f63911
Add dmesg.log to Fuzzer
2023-01-07 01:18:35 +01:00
Alexey Milovidov
772b6b69a9
Fix strange trash in Fuzzer
2023-01-07 00:40:01 +01:00
Alexey Milovidov
42f25cb6a6
Amend
2023-01-07 00:57:47 +03:00
Alexey Milovidov
22fcabd229
Remove expert-level grep usages.
2023-01-07 00:57:11 +03:00
Alexey Milovidov
36f4d30820
Fix GitHub
2023-01-05 19:28:58 +01:00
Alexey Milovidov
e54d30a812
Merge branch 'master' into modern-tools
2023-01-05 21:24:47 +03:00
Ilya Yatsishin
a28d6fb490
Merge pull request #44848 from qoega/green-ci-2
...
Pre-pulling images for integration tests to detect broken infrastructure earlier
2023-01-05 17:29:39 +01:00
Yatsishin Ilya
932a2f9e09
revert minio changes
2023-01-05 09:12:56 +00:00
Alexey Milovidov
9756d46ad7
Merge branch 'master' into fix-integration-base
2023-01-05 00:02:51 +03:00
Yatsishin Ilya
9cf599e58b
Merge remote-tracking branch 'origin/master' into green-ci-2
2023-01-04 15:49:22 +00:00
avogar
a7dbbff426
Merge branch 'split-bc-check' of github.com:ClickHouse/ClickHouse into split-bc-check
2023-01-04 15:06:38 +00:00
avogar
f1ca7e54d5
Make better
2023-01-04 15:06:16 +00:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check
2023-01-04 15:17:02 +01:00
Alexey Milovidov
52b3fd223d
Merge branch 'master' into perf_log_sync_time
2023-01-04 05:29:27 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code
...
What if I will remove two lines of code?
2023-01-04 04:50:52 +03:00
Ilya Yatsishin
49155d9614
Merge pull request #44711 from qoega/green-ci-1
...
Improve some integration tests and add pytest-random
2023-01-03 22:39:54 +01:00
avogar
64df6ca520
Split stress test and backward compatibility check
2023-01-03 19:22:31 +00:00
Alexey Milovidov
cb8e7c8059
Merge pull request #44824 from ClickHouse/stress-test-less-oom
...
Less OOM in stress test
2023-01-03 22:12:34 +03:00
Alexey Milovidov
453dac69c7
Merge pull request #44855 from ClickHouse/fuzzer-more-cases-of-oom
...
More cases of OOM in Fuzzer
2023-01-03 22:11:38 +03:00
Mikhail f. Shiryaev
5257ff627b
Optimize and fix zookeeper downloading and installation
2023-01-03 19:32:12 +01:00
Alexey Milovidov
803c7e4443
Fix GitHub
2023-01-03 17:47:15 +01:00
Alexey Milovidov
a695629e51
Merge branch 'master' into modern-tools
2023-01-03 19:44:25 +03:00
Pradeep Chhetri
fa234878d6
Cleanup setup_minio.sh ( #44858 )
2023-01-03 14:29:50 +01:00
Alexey Milovidov
8125f3adc0
More cases of OOM in Fuzzer
2023-01-03 01:17:28 +01:00
Alexey Milovidov
b975b22f8b
Merge branch 'master' into stress-test-less-oom
2023-01-02 22:32:41 +03:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code
2023-01-02 22:15:36 +03:00
Alexey Milovidov
557396db15
Merge with master
2023-01-02 20:09:50 +01:00
Yatsishin Ilya
fb9e363204
remove unnecessary change
2023-01-02 17:06:07 +00:00
Yatsishin Ilya
631c55e379
Fix compose files to work without correct environment
2023-01-02 16:45:50 +00:00
Yatsishin Ilya
f779fe3c0a
Improve some integration tests
2023-01-02 12:43:16 +01:00
Alexey Milovidov
f7fbaf9c99
Merge pull request #44829 from ClickHouse/adjust-css-in-fuzz-report
...
Adjust CSS
2023-01-02 05:41:18 +03:00
Alexey Milovidov
47ae8c5c79
Remove more lines
2023-01-02 02:06:11 +01:00
Alexey Milovidov
bb6c28b07c
Fix something strange
2023-01-02 01:51:15 +01:00
Alexey Milovidov
4171003b1a
Adjust CSS
2023-01-02 01:28:05 +01:00
Alexey Milovidov
75d363c264
Update docker/test/fuzzer/run-fuzzer.sh
...
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2023-01-02 03:09:05 +03:00
Alexey Milovidov
a39d0f6a50
Fix two typos
2023-01-02 00:11:15 +01:00
Alexey Milovidov
6e946cc757
Less OOM in stress test
2023-01-01 23:22:26 +01:00
Alexey Milovidov
f99ff1f33b
Merge branch 'master' into modern-tools
2023-01-01 22:55:44 +03:00
Alexey Milovidov
0b324ab836
Modern tools
2023-01-01 20:53:06 +01:00
Alexey Milovidov
ea4df8a692
Stash
2023-01-01 20:50:51 +01:00
Alexey Milovidov
f4dc658901
Fix grep
2023-01-01 17:11:44 +01:00
Alexey Milovidov
d4d0647ccd
Merge pull request #44812 from ClickHouse/remove-testflows
...
Remove the remainings of TestFlows
2023-01-01 18:15:39 +03:00
Alexey Milovidov
ea04181d11
Remove remainings of TestFlows
2023-01-01 03:17:31 +01:00
Alexey Milovidov
01acbafb37
Merge pull request #44769 from ClickHouse/fatal-fuzz
...
Print fatal messages in Fuzzer
2023-01-01 01:10:54 +03:00
Alexey Milovidov
e2c00cefb8
Merge pull request #44810 from ClickHouse/stress-test-is-a-trash
...
Fix total trash in stress test
2023-01-01 01:09:02 +03:00
Alexey Milovidov
7434a2cbbb
Merge pull request #44807 from ClickHouse/fix-typo-in-stress-test
...
Retry packages download if GitHub returned HTTP 500.
2023-01-01 01:08:48 +03:00
Alexey Milovidov
a7ccc618c6
Fix total trash in stress test
2022-12-31 15:40:06 +01:00
Alexey Milovidov
78ed8a6d69
GitHub is unreliable; copy-paste code from Stackoverflow to solve it
2022-12-31 14:45:44 +01:00
Alexey Milovidov
d4a35f7682
Fix typo in stress test
2022-12-31 14:31:40 +01:00
Alexey Milovidov
be3ab1562c
Update run-fuzzer.sh
2022-12-31 16:23:53 +03:00
Alexey Milovidov
8f7a84c964
Print fatal messages in Fuzzer
2022-12-30 22:16:30 +01:00
Alexey Milovidov
234193acc9
Print fatal messages in Fuzzer
2022-12-30 22:13:47 +01:00
alesapin
acad2fac63
Remove database ordinary from stress test
2022-12-30 18:48:25 +01:00
Raúl Marín
91dea53dbe
Perf test: Log the time spent waiting for file sync
2022-12-30 12:03:43 +01:00
Alexey Milovidov
e54bf36a3e
Merge pull request #44722 from ClickHouse/rename_file
...
Rename log in stress test
2022-12-30 01:44:48 +03:00
Alexey Milovidov
f84064d05a
Merge pull request #44720 from ClickHouse/improve-fuzzer
...
A few improvements to AST Fuzzer
2022-12-30 01:43:55 +03:00
Alexey Milovidov
f423dced5a
Debug deadlock in stress test
2022-12-29 20:06:09 +01:00
alesapin
9eeb7db2f3
Rename log in stress test
2022-12-29 19:33:32 +01:00
Alexey Milovidov
79ae191611
A few improvements to AST Fuzzer
2022-12-29 18:55:28 +01:00
Alexey Milovidov
eb9cff33ca
Merge pull request #44669 from ClickHouse/remove-questdb
...
Remove questdb (it makes a little sense but the test was flaky)
2022-12-29 01:55:55 +03:00
alesapin
3eda778707
Better
2022-12-28 14:29:27 +01:00
Alexey Milovidov
f30272279c
Whitespace
2022-12-28 12:41:44 +01:00
Alexey Milovidov
135a32c606
Merge branch 'master' into faster-startup-bc-check
2022-12-27 23:17:24 +03:00
alesapin
f93c52ac69
Add +x flag for run-fuzzer.sh
2022-12-27 19:48:58 +01:00
Alexey Milovidov
735fe5b189
Merge pull request #44282 from nickitat/set_mem_limit_for_fuzz_tests
...
Set memory limit for server in AST fuzz tests
2022-12-27 16:05:26 +03:00
Alexey Milovidov
44de7195d1
Merge branch 'master' into fix-fuzzer-html
2022-12-27 15:35:54 +03:00
Alexey Milovidov
bfe895975e
Merge pull request #44575 from ClickHouse/minimal-changes
...
Non-significant changes
2022-12-27 15:34:27 +03:00
Alexey Milovidov
9645941cdf
Merge pull request #44616 from ClickHouse/sanitizer-out-of-memory
...
Do not fail the AST fuzzer if sanitizer is out of memory
2022-12-27 15:15:26 +03:00
Alexey Milovidov
05c27f4e15
Merge pull request #44603 from ClickHouse/runlog
...
Rename `runlog.log` to `run.log` in tests
2022-12-27 15:14:05 +03:00
alesapin
338c554525
Push
2022-12-27 13:00:14 +01:00
alesapin
e4e6cccbf8
Remove garbage
2022-12-27 12:59:09 +01:00
Alexey Milovidov
b85409f976
Do not fail if sanitizer is out of memory
2022-12-26 22:46:37 +01:00
Alexey Milovidov
a0753cbca2
Disable analyzer in fuzz and stress tests
2022-12-26 19:04:10 +01:00
Alexey Milovidov
91c1f9de8f
Faster server startup after stress test
2022-12-26 18:13:50 +01:00
Alexey Milovidov
6ba360be71
Rename runlog.log to run.log
2022-12-26 16:29:32 +01:00
Roman Vasin
483e26cf2f
Merge branch 'master' into ADQM-634
2022-12-26 15:34:38 +03:00
Alexey Milovidov
fe73b0f648
Update run-fuzzer.sh
2022-12-25 22:14:25 +03:00
alesapin
211c6062bc
Fix
2022-12-25 19:37:02 +01:00
Alexey Milovidov
31bd775073
Update run-fuzzer.sh
2022-12-25 19:53:26 +03:00
Alexey Milovidov
51503fc9e4
Fuzzer HTML: fix trash
2022-12-25 16:19:42 +01:00
Alexey Milovidov
f22fc35900
Minimal changes
2022-12-25 14:18:05 +01:00
alesapin
bd19c6b699
Make BC check optional (if env var set)
2022-12-24 17:46:22 +01:00
Alexander Tokmakov
f2b177880f
print stats in tests
2022-12-23 16:04:29 +01:00
Nikita Taranov
c79c80f841
better
2022-12-20 19:56:29 +01:00
Anton Popov
56187c5f0e
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-20 13:37:23 +00:00
kssenii
7509bb2d3f
Fix
2022-12-19 21:29:35 +01:00
Mikhail f. Shiryaev
815ba5b48f
Add check for submodules sanity
2022-12-19 17:36:03 +01:00
Roman Vasin
64c0c6ae99
Refactor test_kerberos_auth test
2022-12-19 11:28:49 +00:00
Alexey Milovidov
87b4a32d59
Merge pull request #43392 from azat/tests/pdb
...
Improve pytest --pdb experience by preserving dockerd on SIGINT
2022-12-17 04:24:10 +03:00
Alexey Milovidov
a3dc5e8b0a
Merge pull request #44132 from azat/bump-libdivide
...
Bump libdivide (to gain some new optimizations)
2022-12-17 04:07:08 +03:00
Anton Popov
b6f2754afb
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-16 14:37:34 +00:00
Nikita Taranov
7058a5e7ed
impl
2022-12-15 18:37:04 +01:00
Roman Vasin
e2ced517dd
Add integration test test_kerberos_auth
2022-12-14 13:39:23 +00:00
Alexander Tokmakov
3f336190a7
Update run.sh
2022-12-14 14:21:21 +03:00
Anton Popov
87e02a1744
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-14 02:08:10 +00:00
Alexander Tokmakov
f68a407636
Update docker/test/stress/run.sh
...
Co-authored-by: Alexander Gololobov <440544+davenger@users.noreply.github.com>
2022-12-13 18:58:02 +03:00
Alexander Tokmakov
49f3e8e19b
Update run.sh
2022-12-13 18:47:13 +03:00
Alexander Tokmakov
371e85d854
Merge pull request #44157 from ClickHouse/fix_session_expired_on_startup
...
Ignore "session expired" errors after BC check
2022-12-13 15:10:36 +03:00
Azat Khuzhin
cdfe62f303
Update libdivide
...
This will includes at least [1].
[1]: https://github.com/ridiculousfish/libdivide/pull/94
v2: Define LIBDIVIDE_* macros mutually exclusive
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-13 10:45:01 +01:00
Alexander Tokmakov
469406c494
ignore session expired errors after BC check
2022-12-12 14:02:14 +01:00
Sema Checherinda
9a3aecd4c1
set max-tries bigger when backward compatibility check runs, old version still drop parts at shutdown
2022-12-05 16:05:14 +01:00
Sema Checherinda
dc52a40c04
decrease stop max-tries back to default, do not clear old parts at shutdown
2022-12-05 16:05:14 +01:00
Anton Popov
5d9077cdb6
Merge remote-tracking branch 'upstream/master' into HEAD
2022-12-02 12:06:45 +00:00
Mikhail f. Shiryaev
8897aa7fe8
Merge pull request #43132 from ClickHouse/strict-typing-ci
...
Enable strict typing check in tests/ci
2022-12-01 14:37:25 +01:00
Mikhail f. Shiryaev
1c5610bf65
Changes during the review
2022-12-01 14:06:17 +01:00
Azat Khuzhin
4c1fb543e1
Sync everything to persistent storage to avoid writeback affects perf tests ( #43530 )
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-12-01 13:42:59 +01:00
Alexey Milovidov
54e27d4230
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project
2022-11-30 00:25:25 +01:00
Alexander Tokmakov
ac578efc05
Update run.sh
2022-11-29 20:16:59 +03:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI
2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
e46f615176
Simplify checks list in style-check image
2022-11-29 16:50:22 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project
2022-11-28 16:09:14 +01:00
Alexander Tokmakov
9a948dc05a
Merge pull request #43593 from ClickHouse/fix_fuzzer_run
...
Remove code that I do not understand
2022-11-28 18:01:11 +03:00
Azat Khuzhin
ca16f5136f
stress: use --max-tries only since 22.12
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-27 09:40:39 +01:00
Azat Khuzhin
2c36b52050
stress: increase timeout for server waiting after TERM
...
Greater timeout after TERM may reduce about of KILL, let's try.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-27 09:40:39 +01:00
Alexander Tokmakov
cdbd1cb158
fix
2022-11-26 18:45:50 +01:00
Nikita Taranov
d1c258cf20
Add xxh3
hash function ( #43411 )
...
* impl
* try fix
* add docs
* add test
* rm unused file
* excellent
2022-11-26 00:14:08 +01:00
Alexander Tokmakov
a982e62f65
fix
2022-11-25 19:01:24 +01:00
Alexander Tokmakov
98e6c76a60
fix
2022-11-25 16:58:18 +01:00
Alexander Tokmakov
91b4b8e1d5
Merge branch 'master' into fix_fuzzer_run
2022-11-25 16:57:47 +01:00
Mikhail f. Shiryaev
58557c87c2
Merge pull request #43654 from ClickHouse/optimize-builder-image
...
Optimize binary-builder size
2022-11-25 15:24:57 +01:00
Alexey Milovidov
69d1be50bc
Merge pull request #43446 from ClickHouse/fix-typo-3
...
Fix typo
2022-11-25 15:22:28 +01:00
Alexander Tokmakov
1e1caf1440
Update run-fuzzer.sh
2022-11-25 15:06:52 +03:00
Mikhail f. Shiryaev
a68dc6280d
Optimize binary-builder size
2022-11-25 12:17:51 +01:00
Alexander Tokmakov
e125f4016b
fix
2022-11-24 21:37:08 +01:00
Alexander Tokmakov
162c7db972
Update run-fuzzer.sh
2022-11-24 14:29:48 +03:00
alesapin
f64f0461fe
Merge pull request #43288 from ClickHouse/Enable_compress_marks_and_primary_key
...
Enable compress marks and primary key for CI
2022-11-24 12:24:04 +01:00
Alexander Tokmakov
f3b7193635
remove code that I do not understand
2022-11-23 21:49:44 +01:00
alesapin
41d3825770
Merge branch 'Enable_compress_marks_and_primary_key' of https://github.com/ClickHouse/ClickHouse into Enable_compress_marks_and_primary_key
2022-11-22 19:12:00 +01:00
alesapin
31142808de
Disable compressed marks and index in stress tests
2022-11-22 19:10:51 +01:00
Alexey Milovidov
b7e4547f53
Merge branch 'master' into fix-typo-3
2022-11-22 18:30:06 +01:00
Alexey Milovidov
56f8c0b84b
Fix typo
2022-11-21 15:10:15 +01:00
Alexey Milovidov
17e2189199
Fix backward compatibility check
2022-11-21 12:51:51 +01:00
Azat Khuzhin
6e52748af6
Improve pytest --pdb experience by preserving dockerd on SIGINT
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-19 10:47:44 +01:00
alesapin
2dbf07f58a
Splitting checks
2022-11-18 17:38:17 +01:00
Igor Nikonov
b12ebab65c
Enable keeper fault injection and retries for insert queries in
...
funcntional tests
2022-11-11 18:07:15 +00:00
Antonio Andelic
e512d7f036
Merge pull request #42619 from ClickHouse/jepen-multiple-tests
...
Extend Jepsen tests with support for server
2022-11-10 09:01:40 +01:00
Alexander Tokmakov
af78f4b66a
Merge branch 'master' into tavplubix-patch-5
2022-11-09 16:20:24 +03:00
Alexander Tokmakov
9edb4d779b
fix
2022-11-09 12:18:29 +01:00
Alexander Tokmakov
d9af3d61b6
Merge branch 'master' into tavplubix-patch-5
2022-11-09 12:17:54 +01:00
Alexander Tokmakov
236f3329bc
Update run-fuzzer.sh
2022-11-08 22:54:58 +03:00
Dmitry Novik
a3c1049f9d
Update run-fuzzer.sh
2022-11-08 19:42:13 +01:00
Alexander Tokmakov
e659fb5d85
Update run-fuzzer.sh
2022-11-08 19:11:44 +03:00
alesapin
de6014e4a5
Update run-fuzzer.sh
2022-11-07 22:54:08 +01:00
Alexander Tokmakov
b8174a63a8
Merge branch 'master' into fix_intersecting_parts2
2022-11-07 20:26:36 +01:00
Mikhail f. Shiryaev
105c6a70f0
Update GH actions checkers
2022-11-07 13:19:40 +01:00
Antonio Andelic
7467490861
Increase test count
2022-11-07 10:39:16 +00:00
Antonio Andelic
8e1a4bcf9a
Update CI config
2022-11-07 09:42:00 +00:00
Antonio Andelic
e751557599
Merge branch 'master' into jepen-multiple-tests
2022-11-07 08:13:49 +00:00
Antonio Andelic
98d3b4a835
Support Jepsen for server in CI
2022-11-04 13:40:13 +00:00
Alexander Tokmakov
acbad99b24
remove abandonable_lock part 2
2022-11-02 14:28:49 +01:00
Robert Schulze
ba4fa7e391
Replace libcxx(abi) by llvm-project as fasttest dependency
2022-10-30 13:04:22 +00:00
Anton Popov
c7f6a410ac
fix some tests
2022-10-28 23:26:06 +00:00
Anton Popov
6a9f195390
do not randomize mt settings with 'show create table'
2022-10-28 15:54:16 +00:00
Anton Popov
d09039418f
Merge remote-tracking branch 'upstream/master' into HEAD
2022-10-28 14:35:45 +00:00
Antonio Andelic
c5fe2c9be7
Merge branch 'master' into jepen-multiple-tests
2022-10-28 11:34:15 +00:00
Yatsishin Ilya
3ab23ef3f2
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-28 07:21:39 +00:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition
...
Fix c-ares crash
2022-10-27 17:17:22 +03:00
Yatsishin Ilya
3a19752d54
style
2022-10-27 14:08:23 +00:00
Yatsishin Ilya
8a5ef517e3
style
2022-10-27 13:30:35 +00:00
Antonio Andelic
1db9888508
Merge branch 'master' into jepen-multiple-tests
2022-10-27 09:06:51 +00:00
Yatsishin Ilya
d8e8dd006f
support server fail
2022-10-27 09:06:11 +00:00
Yatsishin Ilya
8e77180968
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-26 08:31:00 +00:00
Yatsishin Ilya
c89c14a05d
add NoREC
2022-10-25 10:34:55 +00:00
Alexey Milovidov
c48127534b
Merge pull request #41753 from pkit/morton_coding
...
add Morton Coding (ZCurve)
2022-10-25 06:10:37 +02:00
Alexey Milovidov
4f582e19a8
Merge pull request #42479 from ClickHouse/Avogar-patch-1
...
Add error "Destination table is myself" to exception list in BC check
2022-10-25 04:55:12 +02:00
Alexey Milovidov
c4fd827442
Merge pull request #42483 from ClickHouse/Avogar-patch-2
...
Get current clickhouse version without sending query in BC check
2022-10-25 04:54:24 +02:00
Antonio Andelic
5bc9be8a5f
Start defining tests for server
2022-10-24 15:04:57 +00:00
Yatsishin Ilya
15b6de2aae
Merge remote-tracking branch 'origin/master' into revive-sqlancer
2022-10-24 08:26:01 +00:00
Azat Khuzhin
f0aed68893
ci/stress: fix memory limits overrides for hung check
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-22 20:53:18 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding
2022-10-22 04:39:13 +02:00
Alexander Tokmakov
77ea58d539
Update run-fuzzer.sh
2022-10-21 17:58:20 +03:00
Arthur Passos
50f9acb221
Merge branch 'master' into fix_ares_fd_process_race_condition
2022-10-20 13:35:58 -03:00
Yatsishin Ilya
ab41c8e8ce
black
2022-10-19 17:16:41 +00:00
Yatsishin Ilya
7d90d54af8
better reporting
2022-10-19 17:02:49 +00:00
Yatsishin Ilya
5121e9b096
update docker scripts
2022-10-19 16:30:01 +00:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-19 17:25:24 +03:00
Antonio Andelic
10b176fe19
Merge pull request #41854 from azat/tests/stress/fix-dbg-sym-bc
...
tests: fix debug symbols (and possible crashes) for backward compatiblity check
2022-10-19 16:18:41 +02:00
Constantine Peresypkin
5b3b11b517
add Morton Coding (ZCurve)
2022-10-19 15:59:25 +02:00
Kruglov Pavel
2ca0d37e83
Get current clickhouse version without sending query in BC check
2022-10-19 13:25:03 +02:00
Kruglov Pavel
632965212f
Add error "Destination table is myself" to exception list in BC check
2022-10-19 12:52:32 +02:00
Azat Khuzhin
7893ff0785
Update woboq_codebrowser location
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-18 17:31:15 +02:00
Alexander Tokmakov
ea77ff9022
Merge branch 'master' into fixes_for_replicated_merge_tree2
2022-10-18 17:25:25 +02:00
Yatsishin Ilya
b8193a0eb3
one more time
2022-10-17 17:42:18 +00:00
Yatsishin Ilya
6f26816d4f
fix
2022-10-17 16:31:19 +00:00
Yatsishin Ilya
7a74792c1b
shellcheck
2022-10-17 16:30:36 +00:00
Yatsishin Ilya
aa432fe95a
staging
2022-10-17 15:20:20 +00:00
Yatsishin Ilya
6a82d54314
add CI files
2022-10-17 14:46:50 +00:00
Yatsishin Ilya
9320ae1abf
update sqlancer docker files
2022-10-17 13:10:31 +00:00
Azat Khuzhin
a0ceef48da
Add a workaround for "The imported target "merge-fdata" references the file" error
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Azat Khuzhin
f7b2addae9
Bump llvm/clang to 15.0.2
...
Otherwise right now codebrowser image is broken [1], due to changes in
cmake:
#10 1.607 CMake Error at /usr/lib/llvm-15/lib/cmake/llvm/LLVMExports.cmake:1693 (message):
#10 1.607 The imported target "merge-fdata" references the file
#10 1.607
#10 1.607 "/usr/lib/llvm-15/bin/merge-fdata"
[1]: https://s3.amazonaws.com/clickhouse-test-reports/42349/36502270eb9f195dcd2dc8b350db9367c619f0f8/push_to_dockerhub_amd64.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-17 12:29:59 +02:00
Arthur Passos
6d22bb78e0
custom py script in integ tests
2022-10-14 12:39:08 -03:00
Alexander Tokmakov
dc99e67d3f
Update run-fuzzer.sh
2022-10-14 17:45:17 +03:00
Alexey Milovidov
aa9e8f1cde
Merge branch 'master' into new-http-compression-methods
2022-10-05 23:07:01 +03:00
Nikolay Degterinsky
c0497ddf36
Add lz4 to the stateless tests image
2022-10-05 06:45:21 +00:00
Anton Popov
8ca73eab03
Merge branch 'master' into fuzz-table-definitions
2022-10-04 15:10:31 +02:00
Vitaly Baranov
65c61877c7
Merge pull request #33435 from BoloniniD/BLAKE3
...
Integrating Rust code into ClickHouse
2022-10-03 15:25:06 +02:00
Alexander Tokmakov
4211605093
disable zk fault injections in bc check
2022-10-03 13:13:29 +02:00
Robert Schulze
5d15d28843
Fix warning that ENABLE_REPLXX is unused
...
- 3rd party lib replxx is mandatory since #37719
- remove the corresponding CMake switch from the fasttest build
2022-10-03 08:36:23 +00:00
BoloniniD
3a3ca51980
Fixes after review
2022-10-02 20:52:05 +03:00
BoloniniD
fe7b2fdf6e
Merge branch 'master' into BLAKE3
2022-09-30 18:51:31 +03:00
BoloniniD
55c79230b3
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-29 23:53:25 +03:00
Alexander Tokmakov
8741785a72
temporarily disable ThreadFuzzer with tsan
2022-09-29 18:08:35 +02:00
Anton Popov
4ac5df2540
drop all fuzzed tables
2022-09-28 14:52:10 +00:00
Anton Popov
c8beae8237
Merge remote-tracking branch 'upstream/master' into HEAD
2022-09-28 12:47:02 +00:00
Azat Khuzhin
9b20468198
tests: fix debug symbols (and possible crashes) for backward compatiblity check
...
stress running previous version of the server w/o correct debug symbols
right now, since nobody restore clickhouse.debug file, and this can lead
to the following issues, like in [1]:
- incorrect stack traces
- gdb crashes
- clickhouse crashes, due to non-robust internal DWARF parser (probably)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/41730/8cc53a48ae99a765085f44a75fa49314d1f1cc7d/stress_test__ubsan_.html
Right now I decided not to rework the script to make it less error
prone, but simply fix the problem.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-27 22:50:28 +02:00
alesapin
69f3a66538
Keep the most important log in stress tests
2022-09-27 11:16:10 +02:00
Antonio Andelic
97cf045203
Merge pull request #41721 from ClickHouse/collect-correctly-logs-in-stress-test
...
Collect logs in Stress test using clickhouse-local
2022-09-27 08:43:44 +02:00
Antonio Andelic
eb78761a7e
Collect necessary
2022-09-26 16:30:01 +00:00
Antonio Andelic
6f4a636e8f
Remove wildcard
2022-09-26 11:21:53 +00:00
Antonio Andelic
8fde8b2c56
Try with multiple calls
2022-09-26 11:03:24 +00:00
Antonio Andelic
c60d9db687
Merge branch 'master' into ignore-attach-thread-keeper-errors
2022-09-26 08:38:48 +02:00
Antonio Andelic
5ff1bcd553
Merge branch 'master' into collect-correctly-logs-in-stress-test
2022-09-26 08:38:38 +02:00
alesapin
06e0f554d8
Fix fetch to local disk
2022-09-23 16:46:53 +02:00
Antonio Andelic
1d93c56d1a
Collect logs using clickhouse-local
2022-09-23 10:54:16 +00:00
Antonio Andelic
a17a3e1de1
Ignore Keeper hardware errors
2022-09-23 08:23:57 +00:00
Antonio Andelic
0f92e5e576
Add option for loading only system tables from path using clickhouse-local
2022-09-19 14:18:42 +00:00
BoloniniD
5b4fb4bf66
Merge branch 'master' into BLAKE3
2022-09-18 23:14:37 +03:00
Alexey Milovidov
ecfd8cb5a6
Remove trash error message from integration tests
2022-09-17 20:24:56 +02:00
BoloniniD
452ef4435b
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-09-16 20:05:56 +03:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
BoloniniD
0df426d329
Corrosion fixes + review fixes
2022-09-16 00:05:21 +03:00
Nikita Taranov
def4eeac70
Fix perf tests ( #41332 )
...
We run left server two times. If after the first run server will not be properly stopped, we will get `Address already in use: [::]:9001` exception on the second run.
2022-09-15 12:27:08 +02:00
Kseniia Sumarokova
b2c9c04c7b
Merge pull request #40821 from kssenii/improve-marks-cache-loading
...
Allow to load marks in threadpool in advance
2022-09-13 12:31:58 +02:00
kssenii
46f74aaba9
Update stress/run.sh
2022-09-12 20:10:35 +02:00
BoloniniD
fe239e7ee9
Fix style + free err_msg before throwing exception
2022-09-12 18:46:54 +03:00
Kseniia Sumarokova
49e0b1316d
Merge pull request #41144 from ClickHouse/bump_minio_version
...
Bump minio version in tests
2022-09-12 13:55:14 +02:00
Azat Khuzhin
ced30a2072
Switch to llvm/clang 15
...
It had been released few hours ago, and I want to check how clang-15
generates DWARF-5
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-10 21:38:34 +02:00
Igor Nikonov
06070fe0ae
Merge branch 'master' into fix_int8_test_standalone_keeper_mode
2022-09-09 22:03:02 +02:00
Alexander Tokmakov
e77b9e4d0c
Merge pull request #40775 from azat/ci/core-dumps-rework
...
Rework core collecting on CI (eliminate gcore usage)
2022-09-09 20:20:10 +03:00
alesapin
e904822051
Bump minio version in tests
2022-09-09 16:54:03 +02:00
Igor Nikonov
dbfb448290
Fix: integration test, standalone keeper mode
...
There is logic regarding which keeper binary use to start keeper cluster in an integration test
There 2 options:
(1) standalone keeper binary (expected binary name clickhouse-keeper)
(2) clickhouse binary with keeper inside
Fixed:
- option (1) didn't work since docker_compose_keeper.yaml didn't create
target clickhouse-keeper at all
- if clickhouse-keeper existed, option (1) was taken but
clickhouse-keeper could be just a link to clickhouse binary (the link
is created always during build if cmake option BUILD_STANDALONE_KEEPER is OFF)
2022-09-09 14:51:34 +00:00
BoloniniD
e8bcbcd016
Merge branch 'master' into BLAKE3
2022-09-09 11:48:31 +03:00
Alexey Milovidov
7776512b04
Merge pull request #41002 from azat/ci/fix-oom-check
...
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
2022-09-06 06:41:36 +03:00
Alexander Tokmakov
b264be3c63
Merge branch 'master' into zookeeper_client_fault_injection
2022-09-05 22:13:09 +03:00
Azat Khuzhin
2724b67537
ci/stress: clear dmesg before run to fix "OOM in dmesg" check
...
CI: https://s3.amazonaws.com/clickhouse-test-reports/40772/afa137ae2b6108e72c2d6e43556a04548afa2ea9/stress_test__ubsan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-05 15:51:36 +02:00
Kseniia Sumarokova
e12858dca5
Merge pull request #36837 from ClickHouse/stress_s3
...
Trying stress on top of S3
2022-09-05 15:12:55 +02:00
Alexander Tokmakov
abffd4595e
Merge branch 'master' into zookeeper_client_fault_injection
2022-09-05 15:03:26 +03:00
Azat Khuzhin
25e3bebd9d
Rework core collecting on CI (eliminate gcore usage)
...
gcore is a gdb command, that internally uses gdb to dump the core.
However with proper configuration of limits (core_dump.size_limit) it
should not be required, althought some issues is possible:
- non standard kernel.core_pattern
- sanitizers
So yes, gcore is more "universal" (you don't need to configure any
`kernel_pattern`), but it is ad-hoc, and it has drawbacks -
**it does not work when gdb fails**. For example gdb may fail with
`Dwarf Error: DW_FORM_strx1 found in non-DWO CU` in case of DWARF-5 [1].
[1]: https://github.com/ClickHouse/ClickHouse/pull/40772#issuecomment-1236331323 .
Let's try to switch to more native way.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-09-04 22:07:16 +02:00
Ilya Golshtein
74561b40ae
stylecheck renewed
2022-09-02 17:42:18 +03:00
Alexander Tokmakov
8bdb589c2b
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-29 13:34:57 +02:00
alesapin
133ca01447
Merge branch 'master' into stress_s3
2022-08-29 11:25:28 +02:00
Alexey Milovidov
7bd1142f63
Merge pull request #40647 from ClickHouse/high-level-coverage
...
Report high-level function and data types test coverage
2022-08-27 23:13:10 +03:00
Alexey Milovidov
f86242c17e
Merge pull request #40699 from ClickHouse/remove-unbundled
...
Remove the remaining parts of "unbundled" build
2022-08-27 21:54:42 +03:00
Alexey Milovidov
00afbadb53
Merge branch 'master' into high-level-coverage
2022-08-27 19:34:26 +03:00
Azat Khuzhin
ebc61a36e0
tests/stress: improve OOM detection (add separate check by dmesg)
...
Right now if you will look at the OOM errors:
- OOM killer (or signal 9) in clickhouse-server.log
- Backward compatibility check: OOM messages in clickhouse-server.log
Most of them are not real, but just clickhouse server got KILLed by
clickhouse stop, #40678 may imporove the situation, but to definitely
sure that there was OOM let's look at dmesg.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-27 12:46:58 +02:00
Alexey Milovidov
91ed3ebe9a
Remove the remaining parts of "unbundled" build
2022-08-27 02:18:47 +02:00
Alexey Milovidov
2a7d9f0778
Merge branch 'master' into high-level-coverage
2022-08-26 23:44:52 +02:00
Azat Khuzhin
3b519c5d44
tests/stress: capture stacktrace of server hungs if pid was removed already
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-26 22:06:32 +03:00
Alexander Tokmakov
263c467d90
Update setup_hdfs_minicluster.sh
2022-08-26 14:09:42 +03:00
Alexander Tokmakov
76e3ab8c59
Update setup_hdfs_minicluster.sh
2022-08-26 13:33:12 +03:00
alesapin
704c4b2c5b
Stop thread fuzzer on shutdown
2022-08-26 11:54:54 +02:00
Alexey Milovidov
440d10370a
Report high-level function test coverage
2022-08-26 01:59:14 +02:00
alesapin
3ff6489fae
Merge branch 'master' into stress_s3
2022-08-25 13:14:58 +02:00
alesapin
ad692f732a
Merge branch 'master' into stress_s3
2022-08-25 13:13:30 +02:00
alesapin
35f9815b8e
Fix backward comp check
2022-08-24 14:43:02 +02:00
Alexey Milovidov
35ce19ab63
Merge pull request #40354 from azat/tests/stress-dmesg-v3
...
tests/stress: use --privileged over --cap-add syslog to obtain dmesg
2022-08-20 14:13:55 +03:00
Nikita Taranov
9f1ee52b00
Run all queries from changed perf tests ( #40322 )
...
* impl
* fix
2022-08-19 19:46:07 +02:00
Azat Khuzhin
50bddc43dc
tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl
...
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-18 21:23:50 +03:00
alesapin
922818bbd9
Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3
2022-08-18 14:46:50 +02:00
alesapin
932ea146f5
Merge branch 'master' into stress_s3
2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed
Disable cache on writes
2022-08-17 19:00:53 +02:00
alesapin
600d22851f
Grep dangerous S3 errors
2022-08-17 12:43:11 +02:00
alesapin
0433b801d2
Configure properly
2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70
Fix tables creation
2022-08-16 18:28:17 +02:00
kssenii
52832ea788
May be fix database replicated check
2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
...
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
alesapin
243bd492fa
Trying to fix it
2022-08-15 20:55:11 +02:00
alesapin
96722a13bb
Merge branch 'master' into stress_s3
2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010
better error message when restoring covered parts
2022-08-15 13:53:14 +02:00
Alexey Milovidov
6b8f4f1d59
Merge branch 'master' into server-side-time
2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
...
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary
2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time
2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh
2022-08-12 14:30:18 +03:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23
run tests with Ordinary database in flaky check
2022-08-11 21:32:03 +02:00
Alexander Tokmakov
b9d18182f2
fix
2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763
enable fuzzing of table definitions
2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
...
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
Anton Popov
e347fa2f45
add fuzzer for table definition
2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804
Fix Fasttest
2022-08-11 03:29:46 +02:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py
2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2
...
copy self-extracting to output
2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23
Remove old code
2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79
Fix test Dockerfile
2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56
Merge master
2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b
Fix checks
2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto
2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress
2022-08-09 09:16:03 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output"
2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls
...
fix nats-io TLS support
2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96
Change font in CI reports just in case (might be worse)
2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment
...
copy self-extracting to output
2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e
Fix checks
2022-08-07 16:44:02 +02:00
Azat Khuzhin
791377e4dc
tests: avoid prometheus.port overlap for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588
tests/stress: add dmesg output (to see OOM details)
...
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:
2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
...
2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
kssenii
9685f9a8b7
Fix checks
2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment
2022-08-05 08:14:48 -04:00
Constantine Peresypkin
10c76917ea
fix nats-io TLS support
...
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support
fixes #39525
2022-08-05 11:20:05 +02:00
kssenii
7a9b0bc47f
Merge master
2022-08-05 01:48:52 +02:00