Azat Khuzhin
50bddc43dc
tests/stress: ignore NETLINK_ERROR from checkPermissionsImpl
...
Since now with --privileged it has CAP_SYS_ADMIN and tries to
communicate via netlink.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-19 14:07:06 +02:00
Alexander Tokmakov
3d253ec51b
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-18 21:23:50 +03:00
alesapin
922818bbd9
Merge branch 'stress_s3' of github.com:ClickHouse/ClickHouse into stress_s3
2022-08-18 14:46:50 +02:00
alesapin
932ea146f5
Merge branch 'master' into stress_s3
2022-08-18 13:14:47 +02:00
alesapin
86b1e33eed
Disable cache on writes
2022-08-17 19:00:53 +02:00
alesapin
600d22851f
Grep dangerous S3 errors
2022-08-17 12:43:11 +02:00
alesapin
0433b801d2
Configure properly
2022-08-17 12:27:15 +02:00
Alexander Tokmakov
ae000e9125
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-17 12:48:54 +03:00
alesapin
1ec6627a70
Fix tables creation
2022-08-16 18:28:17 +02:00
kssenii
52832ea788
May be fix database replicated check
2022-08-16 11:51:57 +02:00
kssenii
eb26b219b9
Merge master
2022-08-16 00:56:27 +02:00
Alexander Tokmakov
589c3408d2
Merge pull request #40234 from ClickHouse/better_message_on_restore_covered
...
Better error message when restoring covered parts
2022-08-15 22:01:48 +03:00
alesapin
243bd492fa
Trying to fix it
2022-08-15 20:55:11 +02:00
alesapin
96722a13bb
Merge branch 'master' into stress_s3
2022-08-15 20:20:31 +02:00
Alexander Tokmakov
edaff70010
better error message when restoring covered parts
2022-08-15 13:53:14 +02:00
Alexey Milovidov
6b8f4f1d59
Merge branch 'master' into server-side-time
2022-08-12 21:36:40 +02:00
Alexander Tokmakov
46aaf842f8
Merge pull request #40031 from ClickHouse/fix_old_tmp_dirs_cleanup
...
Fix old temporary directories cleanup
2022-08-12 20:31:20 +03:00
Alexander Tokmakov
b3deae3593
Merge branch 'master' into flaky_check_ordinary
2022-08-12 18:11:39 +03:00
Alexey Milovidov
8c3d1f2b5b
Merge branch 'master' into server-side-time
2022-08-12 17:40:02 +03:00
Alexander Tokmakov
467ef7bbc2
Update run.sh
2022-08-12 14:30:18 +03:00
kssenii
768a207176
Merge master
2022-08-11 22:25:53 +02:00
Alexander Tokmakov
06e42a1b23
run tests with Ordinary database in flaky check
2022-08-11 21:32:03 +02:00
Alexander Tokmakov
b9d18182f2
fix
2022-08-11 15:27:26 +02:00
Anton Popov
0ba886f763
enable fuzzing of table definitions
2022-08-11 12:24:15 +00:00
Maksim Kita
627424889d
Merge pull request #39926 from azat/dict-prom-fix
...
Remove dictionaries from prometheus metrics on DETACH/DROP
2022-08-11 13:10:47 +02:00
Anton Popov
e347fa2f45
add fuzzer for table definition
2022-08-11 02:34:10 +00:00
Alexey Milovidov
c323f64804
Fix Fasttest
2022-08-11 03:29:46 +02:00
Alexander Tokmakov
bb46bfa6d9
Update process_functional_tests_result.py
2022-08-10 21:20:52 +03:00
Alexey Milovidov
cbeba683d8
Merge pull request #40017 from ClickHouse/ci-self-extracting-s3-deployment-2
...
copy self-extracting to output
2022-08-10 21:10:23 +03:00
Alexey Milovidov
774ba4db23
Remove old code
2022-08-10 19:44:13 +02:00
Alexey Milovidov
7aff85fc79
Fix test Dockerfile
2022-08-10 19:41:29 +02:00
kssenii
5c3227ba56
Merge master
2022-08-10 12:00:34 +02:00
kssenii
0dda03c94b
Fix checks
2022-08-10 00:06:58 +02:00
Alexey Milovidov
f7d995681b
Merge branch 'master' into replace-yandex-to-noto
2022-08-09 22:43:52 +03:00
Yakov Olkhovskiy
09e6b1a497
run clickhouse to decompress
2022-08-09 09:16:03 -04:00
Alexander Tokmakov
3bc583c22b
Revert "copy self-extracting to output"
2022-08-08 20:13:40 +03:00
Alexey Milovidov
0921548a37
Merge pull request #39527 from pkit/pkit/fix_nats_tls
...
fix nats-io TLS support
2022-08-08 08:28:14 +03:00
Alexey Milovidov
0349d9da96
Change font in CI reports just in case (might be worse)
2022-08-08 07:25:29 +02:00
Alexey Milovidov
cb7f072fe8
Merge pull request #39617 from ClickHouse/ci-self-extracting-s3-deployment
...
copy self-extracting to output
2022-08-08 08:19:15 +03:00
kssenii
e81f85a79e
Fix checks
2022-08-07 16:44:02 +02:00
Azat Khuzhin
791377e4dc
tests: avoid prometheus.port overlap for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 13:00:53 +03:00
Azat Khuzhin
3772415588
tests/stress: add dmesg output (to see OOM details)
...
max_server_memory_usage already set to 75%, so OOM should not happens,
the reason is that because RSS does not match with memory tracker
statistics:
2022.08.05 12:36:57.869896 [ 82524 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 64.69 GiB, peak 65.26 GiB, will set to 62.80 GiB (RSS), difference: -1.89 GiB
...
2022.08.05 12:37:00.213440 [ 82334 ] {} <Error> void DB::MergeTreeBackgroundExecutor<DB::MergeMutateRuntimeQueue>::routine(DB::TaskRuntimeDataPtr) [Queue = DB::MergeMutateRuntimeQueue]: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 64.68 GiB (attempt to allocate chunk of 1298794 bytes), maximum: 51.44 GiB. OvercommitTracker decision: Memory overcommit isn't used. Waiting time or orvercommit denominator are set to zero.. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-08-06 12:34:38 +03:00
kssenii
9685f9a8b7
Fix checks
2022-08-05 22:16:33 +02:00
Yakov Olkhovskiy
4c78f0fc7d
Merge branch 'master' into ci-self-extracting-s3-deployment
2022-08-05 08:14:48 -04:00
Constantine Peresypkin
10c76917ea
fix nats-io TLS support
...
nats-io library needs `NATS_HAS_TLS` define to correctly compile-in TLS
support
fixes #39525
2022-08-05 11:20:05 +02:00
kssenii
7a9b0bc47f
Merge master
2022-08-05 01:48:52 +02:00
Anton Popov
4f2c73f9f6
Merge remote-tracking branch 'upstream/master' into HEAD
2022-08-04 23:08:15 +00:00
BoloniniD
48c91619b0
Merge branch 'master' into BLAKE3
2022-08-04 20:30:47 +03:00
Kruglov Pavel
235649cb98
Merge pull request #39458 from Avogar/fix-cancel-insert-into-function
...
Fix WriteBuffer finalize when cancel insert into function
2022-08-04 13:02:08 +02:00
Mikhail f. Shiryaev
8533769132
Use compression and cleanup with the recent version ccache
2022-08-03 14:49:07 +02:00
Mikhail f. Shiryaev
eeaf08525f
Use test-util as source for base-test, fasttest and package builder
2022-08-03 14:49:06 +02:00
BoloniniD
b745842c36
Fix Rust build in fasttest
2022-08-03 10:20:57 +03:00
BoloniniD
b161773f71
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-08-02 20:25:25 +03:00
kssenii
d462782d1a
Fix checks
2022-08-02 14:27:45 +02:00
Alexander Tokmakov
e5c47cb26f
Update run.sh
2022-08-02 12:10:53 +03:00
Alexander Tokmakov
ecf7ce1f74
Merge branch 'master' into zookeeper_client_fault_injection
2022-08-01 20:49:01 +02:00
kssenii
2850f68ac9
Fix checks
2022-08-01 20:48:05 +02:00
Alexander Tokmakov
3cc20f05ba
Update run.sh
2022-08-01 20:47:14 +03:00
kssenii
e5f4a619ed
Merge master
2022-07-31 20:24:40 +03:00
Alexey Milovidov
36e6500e54
Merge branch 'master' into BLAKE3
2022-07-30 23:14:05 +03:00
Yakov Olkhovskiy
f5442cba86
clickhouse may be compressed - run once to decompress
2022-07-29 15:06:15 -04:00
Yakov Olkhovskiy
72be640cfb
clickhouse may be compressed - run once to decompress
2022-07-29 15:04:50 -04:00
avogar
573d9c1b57
Fix stress test
2022-07-29 18:30:40 +00:00
Mikhail f. Shiryaev
672e67aa8e
Change mysql-odbc url
2022-07-29 11:52:20 +02:00
Mikhail f. Shiryaev
061e61919a
Merge pull request #39450 from ClickHouse/tsal-clang-13
...
Build thread sanitizer binaries with clang-13
2022-07-26 15:13:17 +02:00
Mikhail f. Shiryaev
3e0db34ed9
Merge pull request #39390 from ClickHouse/paint-it-black
...
Automatic fixes for black formatting for domestic repo PRs
2022-07-22 17:19:00 +02:00
Mikhail f. Shiryaev
c6b251d0cb
Revert "Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests"
...
This reverts commit 0ae0cc54aa
, reversing
changes made to 1d7cf28cab
.
2022-07-22 12:14:23 +02:00
jasperzhu
614f3b14a2
Merge branch 'master' into dev_intel_iaa_deflate
2022-07-22 11:05:44 +08:00
Mikhail f. Shiryaev
7d2cf648df
Make a docker image for style check lighter
2022-07-21 16:59:49 +02:00
Mikhail f. Shiryaev
dacfc7886c
Improve style_check scripts style a little bit
2022-07-21 16:59:44 +02:00
Alexander Tokmakov
9e9969cea7
Merge pull request #37827 from arthurpassos/host_regexp_multiple_domains
...
Test host_regexp against all PTR records instead of only one
2022-07-21 16:43:05 +03:00
Arthur Passos
828de2a674
Add host regexp multiple PTR records integration tests
2022-07-20 14:09:38 -03:00
Dmitry Novik
a09422de7b
Merge pull request #38642 from ClickHouse/group-by-use-nulls
...
Add group_by_use_nulls setting
2022-07-20 14:42:42 +02:00
Alexander Tokmakov
840ace663b
Update run.sh
2022-07-20 13:19:53 +03:00
Dmitry Novik
50989bdb68
Merge branch 'master' into group-by-use-nulls
2022-07-19 14:58:01 +02:00
kssenii
df17df67c2
Fix checks
2022-07-19 10:45:54 +02:00
jasperzhu
c044c67745
Merge branch 'master' into dev_intel_iaa_deflate
2022-07-19 15:32:57 +08:00
kssenii
274457e5cf
Allow cache over azure blob storage, add tests
2022-07-18 16:15:04 +02:00
kssenii
8ad26b3111
Merge master
2022-07-16 22:50:03 +02:00
Alexander Tokmakov
b770f9903d
Update run.sh
2022-07-15 20:03:00 +03:00
Alexander Tokmakov
5c24cd979b
Merge pull request #39256 from ClickHouse/bc_check_fix_stacks_in_gdb
...
Fix stacktraces in gdb in BC check
2022-07-15 17:54:18 +03:00
Anton Popov
da97a22465
Merge pull request #39243 from CurtizJ/send-logs-level-colors
...
Do not color logs on client if they are redirected to file
2022-07-15 13:33:13 +02:00
Alexander Tokmakov
77487e996c
fix stacktraces in gdb in bc check
2022-07-15 12:23:28 +02:00
Anton Popov
efed134758
fix test
2022-07-14 21:48:34 +00:00
kssenii
15a2d60f23
Fix checks
2022-07-14 22:04:39 +02:00
Alexander Tokmakov
f8e23c1deb
Update run.sh
2022-07-14 17:29:08 +03:00
Anton Popov
97425bb167
turn on merge tree settings randomization
2022-07-13 21:07:12 +00:00
Alexander Tokmakov
991493e6fc
Update run.sh
2022-07-13 15:22:36 +03:00
Dmitry Novik
5f65b45269
Merge branch 'master' into group-by-use-nulls
2022-07-12 22:36:04 +02:00
Kseniia Sumarokova
f69ec635d0
Merge pull request #39110 from ClickHouse/kssenii-patch-4
...
Fix meilisearch tests
2022-07-12 18:32:49 +02:00
Kseniia Sumarokova
f629fd7e57
Update docker_compose_meili.yml
2022-07-12 15:50:35 +02:00
Alexander Tokmakov
948f15eff3
Update run.sh
2022-07-12 14:01:53 +03:00
Kseniia Sumarokova
bcd9453f33
Set meilieserach client version too
2022-07-12 12:15:20 +02:00
Kseniia Sumarokova
aebb73a24d
Update docker_compose_meili.yml
2022-07-11 21:41:15 +02:00
Arthur Passos
7b626da080
remove cpp-dns and udns from fasttest
2022-07-11 12:43:56 -03:00
Vladimir C
ca2e27aaa2
Merge pull request #37841 from vdimir/perf-save-to-stat
...
Send perf tests results to ci database
2022-07-11 13:07:40 +02:00
jinjunzh
7cb5b35bef
remove qpl from fasttest
2022-07-09 13:54:23 -04:00
Vladimir C
bfba67cf88
Update docker/test/performance-comparison/compare.sh
2022-07-08 17:13:20 +02:00
Alexander Tokmakov
2b886ddc2e
Update run.sh
2022-07-08 16:47:54 +03:00
Vladimir C
9555d72dfc
Remove head ci-checks.tsv
2022-07-08 15:26:07 +02:00
Alexander Tokmakov
57b8a6a542
Update run.sh
2022-07-08 13:53:35 +03:00
Dmitry Novik
0b18b4ed43
Use group_by_use_nulls in tests more often
2022-07-07 18:58:46 +00:00
Dmitry Novik
d1df66687b
Merge branch 'master' into group-by-use-nulls
2022-07-07 20:54:38 +02:00
Vladimir C
db838f1343
Merge pull request #35796 from vdimir/full-sorting-merge-join
2022-07-07 19:16:49 +02:00
Kruglov Pavel
8ffd6cd22c
Merge pull request #38717 from Avogar/improve-bc-check
...
Try to improve backward compatibility check
2022-07-07 18:52:34 +02:00
vdimir
b0c0ec370d
Add join_algorithm='full_sorting_merge' to stress tests
2022-07-06 14:27:34 +00:00
Kruglov Pavel
a3a94a1c09
Avoid false positive red sanitizer asserts check in stress test
2022-07-06 14:32:17 +02:00
mergify[bot]
e746760e41
Merge branch 'master' into improve-bc-check
2022-07-06 11:53:43 +00:00
jinjunzh
ba38969e9c
enable qpl for clickhouse-keeper build
2022-07-05 15:28:41 -04:00
vdimir
f701b58dd0
Update check_name in performance comparsion upload
2022-07-05 14:24:58 +02:00
vdimir
e4917914ae
Revert "show grants in compare.sh"
...
This reverts commit 4d3a64b318aa665bf1494cca6ae94e58dc8d361e.
2022-07-05 14:00:27 +02:00
vdimir
3731bd44c1
Revert "[testing] run only one perftest"
...
This reverts commit 3b079827b78e04ac20043346998ce9d546969746.
2022-07-05 14:00:26 +02:00
vdimir
051dd63a62
Fix types in ci-checks.tsv in compare.sh
2022-07-05 14:00:26 +02:00
vdimir
c1d44fee9f
upd compare.sh
2022-07-05 14:00:26 +02:00
vdimir
b1ee16ef77
show grants in compare.sh
2022-07-05 14:00:26 +02:00
vdimir
18dc718e4e
do not create tables for perf tests
2022-07-05 14:00:25 +02:00
vdimir
f8fa10578c
Use default database for perf tests
2022-07-05 14:00:25 +02:00
vdimir
7352c26e89
create tables for perf tests
2022-07-05 14:00:25 +02:00
vdimir
45b2b1ca8a
[wip] persist pertest results
2022-07-05 14:00:24 +02:00
vdimir
c2d774d598
[testing] run only one perftest
2022-07-05 14:00:24 +02:00
vdimir
aac2f8aefc
Rename envs for performance comparsion
2022-07-05 14:00:24 +02:00
Kseniia Sumarokova
6c3d648f49
Merge branch 'master' into nats-integration
2022-07-04 21:06:07 +02:00
Kruglov Pavel
45ac74617b
Fix
2022-07-04 20:38:21 +02:00
Dmitry Novik
614ce26ee7
Add group_be_use_nulls setting to stress tests
2022-07-04 18:09:48 +00:00
Kruglov Pavel
65dd81586b
Update run.sh
2022-07-04 17:30:22 +02:00
Arthur Passos
6c987fb28e
Minor adjustments
2022-07-04 10:13:50 -03:00
Arthur Passos
52c5d7e0f9
Add cpp-dns and udns to docker/test/fasttest
2022-07-04 10:06:26 -03:00
avogar
17da24b584
Try to improve backward compatibility check
2022-07-04 13:02:22 +00:00
Azat Khuzhin
8e9c1eaa73
tests/stress: redirect gdb output on stop hang to gdb.log
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-07-03 14:46:17 +03:00
Alexander Tokmakov
b238ed4093
fix stress tests
2022-07-01 17:19:00 +02:00
Alexander Tokmakov
4dde5a6165
Merge pull request #38568 from ClickHouse/tavplubix-patch-1
...
Allow Ordinary database in Stress Tests
2022-06-30 16:23:08 +03:00
Alexander Tokmakov
4bf1443dae
Update download.sh
2022-06-30 01:00:08 +03:00
Alexander Tokmakov
cd2cb10f60
another try to fix performance tests
2022-06-29 20:55:46 +03:00
Alexander Tokmakov
baeb1811e1
try to fix performance tests
2022-06-29 16:59:16 +03:00
Alexander Tokmakov
3ff26939fc
Update run.sh
2022-06-29 15:46:40 +03:00
mergify[bot]
3f266954f0
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 18:13:36 +00:00
Alexander Tokmakov
0bb036dd21
Update Dockerfile
2022-06-28 20:35:20 +03:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 15:49:52 +00:00
Alexander Tokmakov
66cf6da35c
Merge pull request #38518 from ClickHouse/tavplubix-patch-1
...
Fix `_csv.Error: field larger than field limit`
2022-06-28 18:46:43 +03:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
...
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
BoloniniD
6ddcec0906
Merge branch 'master' into BLAKE3
2022-06-28 16:53:06 +03:00
Alexander Tokmakov
428628238f
Merge branch 'master' into deprecate_ordinary_database
2022-06-28 15:40:33 +02:00
Kruglov Pavel
25100ad5e5
Merge pull request #38520 from ClickHouse/Avogar-patch-1
...
Fix application errors grep in stress test
2022-06-28 14:26:22 +02:00
Alexander Tokmakov
411512ed6f
Update run.sh
2022-06-28 14:28:06 +03:00
Kruglov Pavel
f7419e0703
Fix application errors grep in stress test
2022-06-28 13:12:21 +02:00
Alexander Tokmakov
456e03758b
Update process_functional_tests_result.py
2022-06-28 13:52:39 +03:00
Vladimir Chebotarev
89dc2844db
Fix for integration tests fix.
2022-06-27 23:13:40 +03:00
Alexander Tokmakov
7c37079a96
Merge branch 'master' into deprecate_ordinary_database
2022-06-27 14:46:59 +02:00
Vladimir Chebotarev
2b19e69930
Don't try to kill empty list of containers in integration/runner
.
2022-06-27 06:12:10 +03:00
jasperzhu
b2f98fa73b
Merge branch 'master' into dev_intel_iaa_deflate
2022-06-27 10:21:21 +08:00
Mikhail f. Shiryaev
848ae7b130
Update docker-compose to try get rid of v1 errors
2022-06-24 16:49:48 +02:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method"
2022-06-24 12:19:41 +03:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
...
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
Alexander Tokmakov
dbf2763788
automatically convert system database to Atomic
2022-06-23 21:38:43 +02:00
Alexander Tokmakov
2c5a88faba
deprecate Ordinary database
2022-06-23 10:20:14 +02:00
Alexander Tokmakov
1595ff5620
Merge pull request #38260 from bigo-sg/hive_test
...
Improve the stability for hive storage integration test
2022-06-22 21:08:23 +03:00
lgbo-ustc
eddb6443f2
rollback dockerd-entrypoint.sh
2022-06-21 16:25:24 +08:00
lgbo-ustc
cdd7a54995
improve stability for hive intergration test
2022-06-21 15:59:54 +08:00
lgbo-ustc
633c3c8287
update hive test
2022-06-21 15:10:48 +08:00
Saulius Valatka
6bbabf59d9
simplify build, add read method randomized tests, fix typos
2022-06-21 09:59:46 +03:00
Alexander Tokmakov
b5a977ad54
Merge pull request #38213 from azat/stress-thread-fuzzer-v2
...
tests/stress: fix TSan detection
2022-06-20 16:46:31 +03:00
Azat Khuzhin
dce71bbe06
tests/stress: fix TSan detection
...
+ test -f package_folder/clickhouse-client_22.7.1.1+tsan_all.deb package_folder/clickhouse-common-static-dbg_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-common-static_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-keeper_22.7.1.1+tsan_amd64.deb package_folder/clickhouse-server_22.7.1.1+tsan_all.deb
/run.sh: line 13: test: too many arguments
Follow-up for: #38207 (cc @tavplubix)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 08:10:03 +03:00
Azat Khuzhin
e307a728ca
tests: add no-stress tag
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
e79c24deda
docker/test/stress/stress: apply black
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-20 07:48:10 +03:00
Azat Khuzhin
d154288fc6
tests/stress: fix TSan detection (enables thread fuzzer for non-TSan builds)
...
Follow-up for: #38106 (cc @tavplubix @alesapin)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-19 19:27:25 +03:00
alesapin
0ae0cc54aa
Merge pull request #38106 from ClickHouse/tsan_less_flaky_tests
...
Some fixes for tests with tsan
2022-06-18 14:22:43 +02:00
Alexander Tokmakov
5ba304476d
Merge pull request #37560 from azat/tests-scripts-proper-wait
...
Proper wait of the clickhouse-server in tests
2022-06-17 18:23:30 +03:00
Alexander Tokmakov
3e8aa2dc47
Update run.sh
2022-06-16 13:24:21 +03:00
jasperzhu
bca18b2caf
Merge branch 'master' into dev_intel_iaa_deflate
2022-06-16 08:56:27 +08:00
Alexander Tokmakov
9cac78b498
make tests with tsan less flaky
2022-06-15 19:54:46 +02:00
Azat Khuzhin
23494e9957
tests: avoid "_csv.Error: field larger than field limit (131072)" error
...
v2: apply black
v3: ignore only hung check report
v4: ignore everything after "Database: "
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:59 +03:00
Azat Khuzhin
4ae0dccf00
docker/test/util/process_functional_tests_result.py: fix typo
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-14 18:16:31 +03:00
Mikhail f. Shiryaev
3ba7d1b2e2
Trying get rid of llvm in stateful tests image
2022-06-10 18:12:24 +02:00
Mikhail f. Shiryaev
92fb62aed5
Pin minio client version too
2022-06-10 18:11:45 +02:00
Mikhail f. Shiryaev
4d45839f17
Generalize setup_minio.sh
...
- Cleanup apt garbage in the container
- Download the same binary in docker and setup_minio.sh
- Use binary and not rpm for minio
- Sort packages in Dockerfile's
2022-06-10 15:04:45 +02:00
Mikhail f. Shiryaev
62f60c1462
Merge branch 'master' into doc-aspell
2022-06-09 11:01:25 +02:00
Mikhail f. Shiryaev
145c916e65
Update pylint
2022-06-08 15:15:13 +02:00
vdimir
27ebad89c5
Add doc_spell_output.txt to process_style_check_result.py
2022-06-08 14:28:44 +02:00
vdimir
abce81058e
Add doc aspell
2022-06-08 14:25:56 +02:00
Kruglov Pavel
83418ebba2
Merge pull request #37712 from vdimir/duplicate_download_previous_release
...
Get rid of duplicate download_previous_release
2022-06-07 12:51:34 +02:00
BoloniniD
b05ee41d25
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-06 16:03:10 +03:00
jinjunzh
c7ca746994
fixed build issues in clickhouse-keeper
2022-06-05 14:46:28 -04:00
Alexander Tokmakov
1ab5dcae38
fix for aarch64
2022-06-03 23:49:06 +02:00
Alexander Tokmakov
c21783273f
fix
2022-06-03 21:58:58 +02:00
Alexander Tokmakov
66f8c69c15
fix
2022-06-03 21:53:44 +02:00
Alexander Tokmakov
5916633344
hotfix for minio in functional tests
2022-06-03 20:47:26 +02:00
Nikita Mikhaylov
fe477355df
Added support for schema inference for hdfsCluster
[2] ( #35812 )
2022-06-03 15:54:29 +02:00
Kruglov Pavel
ed3bc4328e
Merge pull request #37788 from ClickHouse/Avogar-patch-5
...
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-03 13:09:04 +02:00
Alexey Milovidov
1529d47207
Merge pull request #34754 from ClickHouse/llvm-14
...
Switch to clang/llvm 14
2022-06-03 14:07:34 +03:00
Ilya Yatsishin
a57432659a
Merge remote-tracking branch 'origin/master' into aarch64-perf
2022-06-02 14:31:55 +02:00
Ilya Yatsishin
64befe9753
Filter out incompatible performance test
2022-06-02 14:29:24 +02:00
Kruglov Pavel
196863ade5
Ignore PART_IS_TEMPORARILY_LOCKED error in BC check
2022-06-02 13:33:27 +02:00
Alexey Milovidov
b5f48a7d3f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into llvm-14
2022-06-01 22:09:58 +02:00
Vladimir C
2622791b9e
upd
2022-06-01 16:17:17 +02:00
mergify[bot]
3866c27850
Merge branch 'master' into stress_s3
2022-06-01 12:02:33 +00:00
BoloniniD
dd8aefdf1e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-06-01 11:46:55 +03:00
jinjunzh
1d3ae2d88c
fixed unable to find library -ldl in docker build
2022-05-31 17:14:08 -04:00
vdimir
4d336d0228
Get rid of duplicate download_previous_release
2022-05-31 17:50:29 +00:00
jinjunzh
822cef10b3
add nasm into more docker configuration
2022-05-30 21:16:06 -04:00
jasperzhu
fc03af2259
Merge branch 'master' into dev_intel_iaa_deflate
2022-05-30 17:49:04 +08:00
jinjunzh
4857d6e2c3
add nasm into docker configuration
2022-05-30 17:45:26 -04:00
mergify[bot]
df9f7c59a2
Merge branch 'master' into try_fix_tests
2022-05-29 15:04:48 +00:00
Alexey Milovidov
c1169019d2
Merge branch 'master' into llvm-14
2022-05-29 02:29:02 +02:00
Alexey Milovidov
e500ec5fd8
Update run-fuzzer.sh
2022-05-28 21:25:20 +03:00
Alexander Tokmakov
1ae919a18a
Revert "Merge pull request #35865 from azat/clickhouse-test-left-queries"
...
This reverts commit 18d094d79d
, reversing
changes made to 224f4dc620
.
2022-05-28 19:23:58 +02:00
Alexey Milovidov
f7a5b1fdaf
Remove margin in test reports and change the font
2022-05-28 03:24:56 +02:00
Azat Khuzhin
827e73a2f4
tests/fasttest: simplify waiting of the server
...
Note, thiat removes "ability to run fasttest locally", but other jobs
cannot do this.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
2570136e5e
tests/sqlancer: remove superior wait of the server stop
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:19:15 +03:00
Azat Khuzhin
d90f21a569
tests/stateful: properly wait the server
...
v2: fix permissions for /var/run/clickhouse-server?
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
478b03c5cb
tests/fuzzer: use "clickhouse stop" to stop the server
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Azat Khuzhin
28e0bb78db
tests/stateless: properly wait for server
...
If 10 seconds will not be enough to finish the server, then
clickhouse-local (that goes after) cannot obtain the logs due to status
file will be locked, like in [1]:
Code: 76. DB::Exception: Cannot lock file /var/lib/clickhouse/status. Another server instance in same directory is already running. (CANNOT_OPEN_FILE)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/35075/4a064e5b6f81136f2bf923d85001f25fa05d39ce/stateless_tests_flaky_check__address__actions_.html
So use proper wait via "clickhouse stop"
v2: Fix permissions pid file for replicated database servers
They do not use default, /var/run/clickhouse-server, that do not have
proper permissions.
Fixes : #36885
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 07:18:51 +03:00
Kseniia Sumarokova
02d162c25d
Merge branch 'master' into nats-integration
2022-05-25 10:04:39 +02:00
Alexey Milovidov
a5541dc2d5
Merge branch 'master' into llvm-14
2022-05-25 01:56:24 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes
...
Do computations on the raw input data without copying to Eigen::Matrix
2022-05-24 20:59:04 +02:00
tchepavel
43226a57fc
Merge branch 'master' into nats-integration
2022-05-24 18:15:11 +03:00
Alexander Gololobov
7d0ed7e51a
Remove eigen library
2022-05-24 10:24:50 +02:00
tchepavel
d9436ec7dd
Merge branch 'master' into nats-integration
2022-05-23 14:30:09 +03:00
vdimir
6d2fab49f4
Add join_algorithm='parallel_hash' to stress test
2022-05-23 10:18:22 +02:00
Alexey Milovidov
dce7a86ca9
Merge branch 'master' into llvm-14
2022-05-22 22:38:07 +02:00
Michael Nutt
23dbf1b257
Merge branch 'master' into hashid
2022-05-20 08:42:01 -04:00
Michael Nutt
e0c14dfc01
fix includes
2022-05-18 20:16:43 -04:00
Mikhail f. Shiryaev
79c30f5e58
Do not fail if output and workspace are the same
2022-05-18 01:38:46 +02:00
Mikhail f. Shiryaev
1f67665c95
Build performance output in release builds
2022-05-18 01:38:44 +02:00
tchepavel
2692d88a42
Merge branch 'master' into nats-integration
2022-05-17 16:59:57 +03:00
tchepavel
a3af94d49e
Documentation; integration tests; subscribe on startup
2022-05-17 16:58:09 +03:00
Kseniia Sumarokova
94683786dc
Merge branch 'master' into MeiliSearch
2022-05-16 22:42:09 +02:00
tchepavel
35cbe48ca3
Fixing; preparing test
2022-05-16 13:03:28 +03:00
Nikolai Kochetov
f1bc2bc615
Merge branch 'master' into llvm-14
2022-05-16 12:03:26 +02:00
tchepavel
7317c76d3c
Merge branch 'master' into nats-integration
2022-05-15 14:41:22 +03:00
jasperzhu
5e607e6cf5
Merge branch 'master' into dev_intel_iaa_deflate
2022-05-15 10:59:07 +08:00
tchepavel
cc94378698
Add nats-io cmake; finally fix publishing
2022-05-12 19:11:32 +03:00
Mikhail Artemenko
12717f2417
fix <Breaking changes> in Meilisearch v0.27.0
2022-05-12 16:51:00 +03:00
jasperzhu
c74732ae79
Merge branch 'master' into dev_intel_iaa_deflate
2022-05-12 21:28:13 +08:00
Alexander Tokmakov
425b31ba1b
Update stress
2022-05-12 15:04:12 +03:00
Alexander Tokmakov
c23bc01196
Merge branch 'master' into zookeeper_client_fault_injection
2022-05-11 17:20:42 +02:00
Alexander Gololobov
b34a55c9e9
Merge branch 'master' into array-distance-functions
2022-05-11 16:55:02 +02:00
Yakov Olkhovskiy
6d3a54a044
Merge pull request #36467 from olevino/wyhash
...
Wyhash
2022-05-11 09:57:09 -04:00
qieqieplus
6903b3d33c
fix ci fast test
2022-05-11 17:16:23 +08:00
Mikhail f. Shiryaev
3fa955aec1
Merge pull request #37057 from ClickHouse/changelog
...
Changelog script
2022-05-11 10:54:29 +02:00
mergify[bot]
0e2a86dcee
Merge branch 'master' into MeiliSearch
2022-05-11 08:49:19 +00:00
Mikhail f. Shiryaev
d5b1e39bb9
Merge pull request #36866 from ClickHouse/integration-tests
...
Fix using proper image for integration tests; improve logging; fix docker volume cleaning in integration-tests-runner.
2022-05-11 10:46:51 +02:00
alesapin
3cc8e2af51
Merge pull request #37079 from ClickHouse/disable_thread_fuzzer
...
Disable thread fuzzer after server restart
2022-05-10 23:24:34 +02:00
Mikhail f. Shiryaev
3802944cc0
Merge pull request #36863 from ClickHouse/tests-result-for-not-finished
...
Replace `Timeout` with `Tests not finished`
2022-05-10 19:23:34 +02:00
Mikhail f. Shiryaev
e31ac2e717
Fix cleaning up integration-runner docker volume
2022-05-10 17:41:49 +02:00
alesapin
af99183950
Disable thread fuzzer after server restart
2022-05-10 15:16:21 +02:00
mergify[bot]
5c742cf2d5
Merge branch 'master' into stress_s3
2022-05-10 12:26:26 +00:00
Alexander Tokmakov
9346c9363a
Merge pull request #37052 from ClickHouse/fix_server_termination_stress_tests
...
Print stacks if we cannot terminate server in stress tests
2022-05-10 13:12:44 +03:00
Alexander Tokmakov
17c954bea7
fix shellcheck
2022-05-10 11:48:55 +02:00
Mikhail f. Shiryaev
d78709c656
Add dependencies and CI for changelogs generator
2022-05-10 11:25:38 +02:00
Alexander Tokmakov
92d423c478
print stacks if wa cannot terminate server in stress tests
2022-05-09 19:43:51 +02:00
Alexander Tokmakov
b647f8f9bf
Update run.sh
2022-05-09 17:48:10 +03:00
Alexey Milovidov
419687ac50
Update run.sh
2022-05-09 10:17:49 +02:00
Mikhail f. Shiryaev
b14dca2fac
Improve stress tests report a little bit
2022-05-09 10:17:40 +02:00
jinjunzh
fd5085c290
Merge branch 'dev_intel_iaa_deflate' of https://github.com/jinjunzh/ClickHouse into dev_intel_iaa_deflate
2022-05-05 12:00:30 -04:00
jinjunzh
c4bce5234e
add nasm source into contrib for nasm compiler
2022-05-05 11:56:11 -04:00
Mikhail f. Shiryaev
37533eb14b
Improve comment FIXME for errors report
2022-05-04 16:56:43 +02:00
Mikhail f. Shiryaev
2b67208dea
Ignore slow query as errors in performance tests report
2022-05-04 13:02:48 +02:00
Alexander Tokmakov
c3f177f0ac
Merge pull request #36885 from ClickHouse/fix_system_logs_saving
...
Save system logs in functionsl tests if server crashed
2022-05-04 01:12:41 +03:00
Alexander Tokmakov
7a9c9da0bd
Update run.sh
2022-05-04 01:10:40 +03:00
Alexander Tokmakov
193a50a688
Update run.sh
2022-05-03 23:17:03 +03:00
Alexander Tokmakov
3baf72f1d4
save system logs in func tests if server crashed
2022-05-03 20:10:07 +02:00
Mikhail f. Shiryaev
6197934e14
Replace Timeout
with Tests not finished
2022-05-03 10:45:29 +02:00
jasperzhu
7f47e9b934
Merge branch 'master' into dev_intel_iaa_deflate
2022-05-03 15:47:57 +08:00
Alexey Milovidov
88826e2da5
Remove "preconditions" from performance tests (overengineering, unneeded feature)
2022-05-02 02:33:22 +02:00
alesapin
85dda249b8
Don't download stateful table
2022-05-02 00:11:05 +02:00
Mikhail Artemenko
6830b74925
fix ref after merge & change runner dockerfile
2022-05-01 23:57:44 +03:00
alesapin
51345fa25b
Trying stress on top of S3
2022-05-01 19:07:02 +02:00
Mikhail Artemenko
41f657d8ed
Merge branch 'master' into MeiliSearch
2022-05-01 10:01:56 +03:00
jinjunzh
34934b80a9
update qpl deflate supporting test script and docs
2022-04-29 11:40:08 -04:00
Alexey Milovidov
1dc56e39fc
black .
2022-04-29 04:39:21 +02:00
Alexey Milovidov
2a3a2184ec
Refinement
2022-04-29 04:37:57 +02:00
Alexey Milovidov
2d7d67e7bc
Remove special handling of "short" queries - the logic is too ad-hoc, it pollutes the code and is difficult to handle
2022-04-29 04:27:57 +02:00
Mikhail f. Shiryaev
a2dc780174
Make backward compatible integration tests runner
2022-04-25 21:16:02 +02:00
Mikhail f. Shiryaev
f53040b95e
Merge pull request #36559 from ClickHouse/performance-rebalance
...
Use just index to split performance tests by group
2022-04-25 14:15:23 +02:00
Alexey Milovidov
bdf86f3b7a
Merge pull request #36554 from ClickHouse/snyk-fixes
...
Snyk fixes
2022-04-23 22:51:56 +03:00
Mikhail f. Shiryaev
04a8955427
fixup! Update golang-mysql integration image
2022-04-23 15:24:42 +02:00
Mikhail f. Shiryaev
e434d78e68
fixup! Update golang-mysql integration image
2022-04-22 23:02:22 +02:00
alesapin
7380a71333
Merge pull request #31833 from ClickHouse/musl-check
...
Build clickhouse-keeper with Musl
2022-04-22 22:41:16 +02:00
Mikhail f. Shiryaev
74a755d170
Use just index to split tests by group
2022-04-22 20:34:34 +02:00
Mikhail f. Shiryaev
11694459f3
Update mysql_php_client php version
2022-04-22 18:22:14 +02:00
Mikhail f. Shiryaev
d4e8c6fb44
Update golang-mysql integration image
2022-04-22 18:22:12 +02:00
BoloniniD
a26acd3660
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-04-22 18:12:54 +03:00
alesapin
18d094d79d
Merge pull request #35865 from azat/clickhouse-test-left-queries
...
clickhouse-test: fix left-queries-check, to fix test log parser
2022-04-22 15:59:38 +02:00
Mikhail f. Shiryaev
382c717d09
Speed-up fetching submodules
2022-04-21 20:08:55 +02:00
olevino999
a32aa93b50
wyhash
2022-04-21 19:36:47 +03:00
BoloniniD
a353210e94
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-04-21 18:44:42 +03:00
tavplubix
06de1adebc
Merge pull request #36450 from ClickHouse/Avogar-patch-4
...
Fix stress test
2022-04-20 21:42:24 +03:00
tavplubix
2d34d46b28
Update entrypoint.sh
2022-04-20 21:38:49 +03:00
Azat Khuzhin
08e74b98f5
tests: do not check queries after tests for replicated database
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-20 21:34:31 +03:00
Kruglov Pavel
4e2b1cd981
Update run.sh
2022-04-20 16:48:54 +02:00
Kruglov Pavel
cd77f927b6
Fix putting logs into test_output
2022-04-20 15:06:09 +02:00
Kruglov Pavel
6bcdf21801
Fix stress test
2022-04-20 13:53:16 +02:00
alesapin
ba81816dc1
Better cmake
2022-04-20 12:11:55 +02:00
Azat Khuzhin
8d87e48cb4
Simplify perf scripts by using schema inference
2022-04-17 09:01:15 +03:00
Alexey Milovidov
b5c64244c9
Merge branch 'llvm-14' of github.com:ClickHouse/ClickHouse into llvm-14
2022-04-16 01:15:27 +02:00
Alexey Milovidov
73b52859df
Merge branch 'master' into llvm-14
2022-04-16 00:46:58 +02:00
tavplubix
5f31185125
Update stress
2022-04-14 14:35:46 +03:00
Mikhail f. Shiryaev
51685e0956
Dirty fix fasttest after addressing CVE-2022-24765
2022-04-13 13:36:28 +02:00
Mikhail Artemenko
2fd86cc564
Merge branch 'master' into MeiliSearch
2022-04-13 12:05:46 +03:00
BoloniniD
30712ead45
Merge branch 'master' into BLAKE3
2022-04-13 00:45:44 +03:00
Kruglov Pavel
5b46e9655a
Merge pull request #36067 from ClickHouse/Avogar-patch-4
...
Try to turn off always green backward compatibility checks
2022-04-12 16:20:07 +02:00
tavplubix
ccb45ae943
Update stress
2022-04-12 12:42:45 +03:00
tavplubix
48f9b61bdb
Update stress
2022-04-12 12:22:03 +03:00
tavplubix
f7c17a8e86
Update stress
2022-04-11 18:03:19 +03:00
mergify[bot]
df81e8d60c
Merge branch 'master' into Avogar-patch-4
2022-04-11 14:37:28 +00:00
Mikhail f. Shiryaev
08e518a821
Merge branch 'master' into llvm-14
2022-04-08 13:57:44 +02:00
Kruglov Pavel
eaad99bd48
Try to turn off always green backward compatibility checks
2022-04-08 13:55:10 +02:00
Mikhail f. Shiryaev
20aee231bd
Improve codebrowser image, use a temporary branch as source
2022-04-08 13:44:25 +02:00
Alexander Tokmakov
49c35f3261
Merge branch 'master' into mvcc_prototype
2022-04-08 13:34:40 +02:00
tavplubix
6868223af0
Merge pull request #36026 from ClickHouse/tavplubix-patch-2
...
Fix Backward comapatibility check
2022-04-08 13:10:59 +03:00
alesapin
8ec802bc62
Merge pull request #35475 from kssenii/remote-fs-cache-improvements
...
Allow to write remote fs cache on all write operations. Add `system.remote_filesystem_cache` table. Add `drop remote filesystem cache (<path>)` query. Add `system.remote_data_paths` table.
2022-04-08 12:06:26 +02:00
Alexander Tokmakov
6a46da93ae
Merge branch 'master' into mvcc_prototype
2022-04-07 23:22:19 +02:00
Kruglov Pavel
9fa6e6e7df
Make backward compatibility check always green
2022-04-07 17:42:33 +02:00
Mikhail f. Shiryaev
5b69caf383
Update codebrowser clang to 14
2022-04-07 15:18:26 +02:00
Alexander Tokmakov
7f54e7b422
Merge branch 'master' into mvcc_prototype
2022-04-07 15:14:06 +02:00
Alexander Tokmakov
8290ffa88d
Merge branch 'master' into mvcc_prototype
2022-04-07 13:50:42 +02:00
tavplubix
b32800420c
Update stress
2022-04-07 13:30:11 +03:00
Mikhail Artemenko
151eeb1a27
Merge branch 'master' into MeiliSearch
2022-04-06 17:07:55 +03:00
Azat Khuzhin
2fb6d6acb4
stress: use more meaningful names for clickhouse-server.log
...
But note, that stderr.log/stdout.log/clickhouse-server.err.log still not separated.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:53 +03:00
Azat Khuzhin
058cde820f
test/stress: improve error checks for backward compatiblity check
...
Before the log was analyzed only after the server had been restarted
after stressing, and hence it cannot find anything in case of error,
like here [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/34355/acd48ebe2d51d20d0c2a5bc545d46d27f9bf7904/stress_test__thread__actions_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-06 14:09:52 +03:00
Kruglov Pavel
ab5c912ad4
Merge pull request #35613 from ClickHouse/Avogar-patch-3
...
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-04-06 12:58:37 +02:00
Kseniia Sumarokova
0e1637dfaf
Merge pull request #35354 from kssenii/enable-testmode-by-default
...
Remove testmode option, enable it unconditionally
2022-04-06 10:06:08 +02:00
kssenii
d59d4eda4f
Fix tests
2022-04-06 01:58:16 +02:00
Mikhail f. Shiryaev
4d7618585b
Fix WORKDIR issue after upgrading npm
2022-04-05 00:10:33 +02:00
snyk-bot
e78ff3ea7b
fix: docker/test/integration/mysql_js_client/Dockerfile to reduce vulnerabilities
...
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON27-341379
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-1063181
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-340072
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-453739
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-584435
2022-04-04 21:20:18 +00:00
Alexander Tokmakov
a2167f12b8
Merge branch 'master' into mvcc_prototype
2022-04-04 14:24:23 +02:00
kssenii
6c8e073a61
Merge master
2022-04-01 16:48:29 +02:00
Mikhail f. Shiryaev
4cc37ae9f3
Clean stale code
2022-04-01 11:59:44 +02:00
Alexey Milovidov
93edf05259
Merge branch 'master' into llvm-14
2022-04-01 04:49:03 +03:00
Alexander Tokmakov
307a2ca579
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-31 15:32:41 +02:00
Nikita Mikhaylov
5f27f690f4
Revert "Added support for schema inference for hdfsCluster
( #35602 )"
...
This reverts commit f6bfdcc0c9
.
2022-03-31 14:19:56 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3
2022-03-31 11:45:31 +00:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster
( #35602 )
2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3
Merge branch 'master' into mvcc_prototype
2022-03-31 11:35:04 +02:00
tavplubix
5680f53ed4
Merge pull request #35773 from azat/stateless-tests-artifacts
...
ci: replace directory system log tables artifacts with tsv
2022-03-31 12:16:48 +03:00
Azat Khuzhin
8b84829e93
ci: replace directory system log tables artifacts with tsv
...
Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
used, replace them with plain TSVWithNamesAndTypes, also note, that
after schema inference it is even pretty easy to use
- support replicated database env correctly
Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 21:50:55 +03:00
kssenii
0fc92fe2aa
Get rid of all "remote" mentions
2022-03-30 17:15:29 +02:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful
2022-03-30 09:40:12 +00:00
Nikolai Kochetov
3849e63ab1
Change database
2022-03-29 19:06:50 +00:00
Alexander Tokmakov
287d858fda
Merge branch 'master' into mvcc_prototype
2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8
run stateful tests in parallel
2022-03-29 15:24:29 +02:00
BoloniniD
2d2420c8a9
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-29 11:00:50 +03:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster
table function ( #35544 )
2022-03-29 00:46:35 +02:00
alesapin
a38f63af2d
Merge pull request #35676 from ClickHouse/remove_outdated_links
...
Remove outdated links from CI
2022-03-28 21:24:45 +02:00
Alexander Tokmakov
208b242188
Merge branch 'master' into mvcc_prototype
2022-03-28 19:58:06 +02:00
alesapin
b838a7dcb0
Remove outdated links from CI
2022-03-28 15:53:22 +02:00
Alexander Tokmakov
e795b83148
disable random settings in fast test
2022-03-28 14:56:23 +02:00
Mikhail Artemenko
1886d9c2ea
refactor parseTypeOfField & fix tests
2022-03-27 23:00:28 +03:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-03-25 11:59:50 +01:00
mergify[bot]
03c8a59a57
Merge branch 'master' into stress-test
2022-03-23 17:37:05 +00:00
Alexander Tokmakov
bcec53aadc
Merge branch 'master' into mvcc_prototype
2022-03-23 11:28:43 +01:00
Kruglov Pavel
5efad9699c
Update run.sh
2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh
2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files
2022-03-22 18:06:35 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo
2022-03-22 17:39:58 +01:00
Mikhail f. Shiryaev
5fea6d24fa
Add black formatting check
2022-03-22 17:38:48 +01:00
alesapin
0ab9a9c0f6
Merge pull request #33664 from ClickHouse/release-steps
...
Refactor releasing process
2022-03-22 14:43:18 +01:00
avogar
c5245c1ad1
Improve backward compatibility check and stress test
2022-03-22 12:00:20 +00:00
Mikhail f. Shiryaev
70945764e5
Fix a tiny typo
2022-03-22 11:10:00 +01:00
Alexander Tokmakov
3c762f566d
Merge branch 'master' into mvcc_prototype
2022-03-21 20:16:29 +01:00
avogar
288d08f3f2
Add retries in backward compatibility check
2022-03-21 17:26:24 +00:00
Alexander Tokmakov
5c760fd7ce
Merge branch 'master' into zookeeper_client_fault_injection
2022-03-21 11:57:40 +01:00
Alexey Milovidov
159a73b6d5
Merge branch 'master' into llvm-14
2022-03-20 22:50:20 +01:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test
2022-03-17 11:10:37 +00:00
Alexander Tokmakov
4b3e13a4fe
Merge branch 'master' into mvcc_prototype
2022-03-16 21:06:19 +01:00
Kruglov Pavel
fa6d963f83
Update run.sh
2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh
2022-03-15 17:15:17 +01:00
Alexander Tokmakov
9702b5177d
Merge branch 'master' into mvcc_prototype
2022-03-14 21:45:38 +01:00
alesapin
1edd4347fc
Hope I'll fix it
2022-03-14 21:43:51 +01:00
avogar
b9496af3b3
Fix tests
2022-03-14 16:40:17 +00:00
alesapin
2f8da04891
Fix timezones
2022-03-14 13:46:45 +01:00
BoloniniD
253afd032f
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-03-13 21:18:46 +03:00
Alexey Milovidov
d0716b035f
Revert "Change timezone in Docker"
2022-03-13 04:03:06 +03:00
Alexey Milovidov
6b9129c494
Change timezone in Docker
2022-03-11 23:21:45 +01:00
Kruglov Pavel
3d36eced2d
Update run.sh
2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server
2022-03-10 14:38:39 +03:00
mergify[bot]
78c8029aeb
Merge branch 'master' into stress-test
2022-03-09 16:22:45 +00:00
kssenii
5260822964
Merge master
2022-03-08 18:21:28 +01:00
Alexander Tokmakov
8acfb8d27f
Merge branch 'master' into mvcc_prototype
2022-03-07 17:40:15 +01:00
Kseniia Sumarokova
28b9ec01c0
Merge pull request #34945 from bigo-sg/hive_bug_fixed
...
unexpected result when use `in` in hive query
2022-03-07 17:13:11 +01:00
lgbo-ustc
68fb92edf2
update hive server image
2022-03-07 10:36:12 +08:00
Kruglov Pavel
dbba752398
Merge branch 'master' into stress-test
2022-03-04 18:33:37 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh
2022-03-04 14:24:24 +03:00
Azat Khuzhin
15bbc5537b
fasttest: add --print-time for "Test time" column in the results table
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-03 15:44:41 +03:00
Azat Khuzhin
b2ed5552cc
fasttest: use bash arrays over wrap lines with backslash
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-03 15:44:41 +03:00
lgbo-ustc
21c164ad2c
update tests
2022-03-02 14:20:59 +08:00
lgbo-ustc
2ff7ff90fa
update tests
2022-03-02 14:17:04 +08:00
Kruglov Pavel
8f6ba99fec
Update run.sh
2022-03-01 15:20:02 +03:00
kssenii
9983a5d802
Add test for profile events
2022-02-28 15:47:12 +01:00
lgbo-ustc
24caa70243
remove meaningless codes
2022-02-28 20:23:00 +08:00
lgbo-ustc
b8a2deba0f
update tests
2022-02-28 20:11:59 +08:00
Kruglov Pavel
6252588922
Update run.sh
2022-02-28 13:33:10 +03:00
lgbo-ustc
aa8db563d6
update test
2022-02-28 18:02:37 +08:00
lgbo-ustc
5885cfd869
fixed bug : unexpected result when using in clause for filtering partitions
2022-02-28 16:47:50 +08:00
kssenii
725f967ac6
Add stress test
2022-02-24 07:54:58 +01:00
Alexander Tokmakov
aa6b9a2abc
Merge branch 'master' into mvcc_prototype
2022-02-23 23:22:03 +03:00
kssenii
36a76d6a75
Fix test
2022-02-22 15:18:28 +01:00
kssenii
c637385dd0
Merge master
2022-02-22 13:17:51 +01:00
kssenii
26f58274b6
Fix stateful test
2022-02-22 12:05:43 +01:00
kssenii
4543513a5d
Add comments
2022-02-21 13:54:03 +01:00
kssenii
009e71e273
Fix tests
2022-02-21 11:43:03 +01:00
Alexey Milovidov
aa8f282ad9
Switch to clang/llvm 14
2022-02-19 18:43:02 +01:00
BoloniniD
3f149e88be
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-19 20:23:19 +03:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package
2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test
2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh
2022-02-18 12:52:56 +03:00
kssenii
353ffacca3
Add test
2022-02-17 19:57:04 +01:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test
2022-02-17 20:28:46 +03:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
...
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test
2022-02-17 12:59:47 +01:00
Alexander Tokmakov
dae044f86b
Merge branch 'master' into mvcc_prototype
2022-02-17 13:49:37 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type
...
Workaround for bug when AWS mistakenly set Content-Type to XML
2022-02-17 13:11:14 +03:00
alesapin
0b099b140f
Fix
2022-02-17 10:39:33 +03:00
kssenii
47f94120da
Merge master
2022-02-16 14:43:28 +01:00
kssenii
f9622d44f0
Try add stateful tests
2022-02-16 14:18:55 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
...
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
alesapin
3b531e43b7
Setup credentials
2022-02-15 16:12:08 +03:00
Yatsishin Ilya
bbe2c07a7b
remove clickhouse-test deb completely
2022-02-15 12:03:51 +00:00
alesapin
e1fb220bb7
Fix test
2022-02-15 13:31:41 +03:00
Alexander Tokmakov
1e4e569151
Merge branch 'master' into mvcc_prototype
2022-02-15 02:26:47 +03:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image
2022-02-13 22:01:45 +01:00
Mikhail f. Shiryaev
0ae948866a
Create symlink hadoop -> ./hadoop-2.7.0
2022-02-13 19:10:11 +01:00
alesapin
89373155fc
Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3
2022-02-13 21:07:54 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI ( #34517 )
...
* test/fuzzer: preserve core
This may help to capture things like in [1]:
Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: do not run 'info locals' since 'backtrace full' includes it
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test: try capture backtrace from all threads
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
* test/stress: fix path for core artifacts
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes : #33389
* test/fuzzer: store core file in artifacts
v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
BoloniniD
c8bb6fb38a
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-13 12:47:18 +03:00
BoloniniD
677b5ea6aa
Add MSan support for BLAKE3 lib
2022-02-13 12:46:20 +03:00
Mikhail f. Shiryaev
ac459dccd8
Force update kerberized hadoop
2022-02-11 18:26:49 +01:00
Mikhail f. Shiryaev
65e8605af1
Make testflows aarch64 compatible
2022-02-11 18:26:48 +01:00
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles
2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment
2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
c19d0a3494
Update performance-comparison, fix x86 hard-code
2022-02-11 18:26:41 +01:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz"
...
This reverts commit efd8044ab7
, reversing
changes made to 4bb69bcb15
.
2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
c7ba5204b3
Make testflows a multiarch image
2022-02-07 13:21:51 +01:00
Mikhail f. Shiryaev
4a1e84306a
Update performance comparison OS version
2022-02-07 12:57:58 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images
2022-02-07 12:35:32 +01:00
Alexander Tokmakov
45be75b4db
Merge branch 'master' into mvcc_prototype
2022-02-06 23:36:08 +03:00
alesapin
06499ce847
Revert "Remove docker change"
...
This reverts commit 3c80e0bff8
.
2022-02-04 14:32:11 +03:00
Alexander Tokmakov
fe30e0f162
fixes
2022-02-03 21:57:09 +03:00
Mikhail f. Shiryaev
a7325bbe32
Fix check-workflows in style check, iterate over checks
2022-02-03 18:36:01 +01:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck
2022-02-03 17:50:35 +01:00
BoloniniD
23e29e22a0
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-02-03 19:32:14 +03:00
Alexander Tokmakov
ca5f951558
Merge branch 'master' into mvcc_prototype
2022-02-03 18:56:44 +03:00
BoloniniD
a744378cc7
Fix performance test
2022-01-27 20:14:50 +03:00
Kruglov Pavel
e004dae25b
Update run.sh
2022-01-27 18:15:03 +03:00
BoloniniD
6f078c164d
Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3
2022-01-26 20:11:27 +03:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test
2022-01-25 14:35:42 +03:00
Yatsishin Ilya
3a55f7a7d6
Do not use clickhouse-test.deb in stateless
2022-01-24 11:53:42 +00:00
Kruglov Pavel
d5bde26bc1
Update run.sh
2022-01-20 15:22:00 +03:00
Alexander Tokmakov
e9a5a64a71
Merge branch 'master' into mvcc_prototype
2022-01-19 21:41:23 +03:00
mergify[bot]
e492fe0a0f
Merge branch 'master' into zookeeper_client_fault_injection
2022-01-17 15:26:16 +00:00
Alexander Tokmakov
d237099729
rebuild docker image
2022-01-15 22:38:25 +03:00
Alexander Tokmakov
9a518d789f
rebuild docker image
2022-01-15 16:21:43 +03:00
Alexander Tokmakov
5132411e00
rebuild docker image
2022-01-15 14:07:40 +03:00
Alexander Tokmakov
7feb014804
rebuild docker image
2022-01-14 23:26:18 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose
2022-01-14 18:36:37 +00:00
Alexander Tokmakov
c1c3f25c10
Merge branch 'master' into mvcc_prototype
2022-01-14 21:03:58 +03:00
Mikhail Artemenko
698364f7b0
add tests
2022-01-14 20:58:56 +03:00
Mikhail f. Shiryaev
fdb88b75ec
Don't build integration tests on arm64 yet
2022-01-14 15:48:43 +01:00
Alexander Tokmakov
4dd216ce8f
Merge branch 'master' into mvcc_prototype
2022-01-14 17:11:32 +03:00
Mikhail f. Shiryaev
73f06421b1
Use automatic architecture for docker repo
2022-01-14 15:03:43 +01:00
Alexander Tokmakov
e1a41fc694
add system log for introspection
2022-01-14 17:03:00 +03:00
Mikhail f. Shiryaev
97e4151aff
Remove broken editing of /etc/hosts
2022-01-14 14:46:14 +01:00
Yatsishin Ilya
2fe8f6c60b
Fix ports allocated for mongo2 that is w/o creds
2022-01-14 13:00:38 +00:00
alesapin
d7a7926610
Update version to 22.1 not 21.13
2022-01-14 15:10:45 +03:00
alesapin
5257b413d4
Merge pull request #33612 from ClickHouse/workflow-linting
...
Add actionlint configuration and fix all issues
2022-01-14 11:41:48 +03:00
Kseniia Sumarokova
5da673c3a5
Merge pull request #31104 from bigo-sg/hive_table
...
Implement hive table engine
2022-01-14 09:39:17 +03:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps
...
tests/stress: add core dumps into artifacts
2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
49fa1a1cd3
Add linter and checker for workflow files
2022-01-13 21:40:21 +01:00
Mikhail f. Shiryaev
55032a0286
Fix wrong variables in processing results
2022-01-13 21:36:34 +01:00
Mikhail f. Shiryaev
0edb80939f
Apply black to process_style_check_result.py
2022-01-13 20:59:36 +01:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master
2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI
2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
651b22f611
Add necessary MLIR dependency for codebrowser
2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
8779b6763d
Use architecture specific version of minio
2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
d1b14d5ee0
Use a library with proper architecture for mysql odbc
2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
7a369837c3
Improve integration tests image
...
- Order packages
- Add rpm2cpio package
- Clean cache
- Use apache CDN for zookeeper
2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
18a9aac61e
Use mysql-client-8.0 from ubuntu original repo
2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
565e469b19
Don't build image for arm64 pvs-sturio
2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version
2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
624dfda931
Fix dpkg-deb architecture-dependent artifact
2022-01-12 17:07:51 +01:00
taiyang-li
66813a3aa9
merge master
2022-01-12 16:56:29 +08:00
BoloniniD
620f6ca8c1
Fix performance tests Dockerfile
2022-01-11 22:14:18 +03:00
BoloniniD
82027176f1
Move BLAKE3 tests away from fasttest + add USE_BLAKE3 key to CMakeLists
2022-01-10 23:12:33 +03:00
BoloniniD
a50530f061
Add cargo to fasttest + fixes
2022-01-10 23:12:32 +03:00
BoloniniD
fc5cd6dd83
Start BLAKE3 integration
2022-01-10 23:12:32 +03:00
Azat Khuzhin
ebed6193b4
tests/stress: add core dumps into artifacts
...
gcore is used here because:
- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
and so to make it work you need to install apport into container and
configure it propertly -- to complex
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log
- kernel.core_pattern cannot be changed, since proc is mounted in
read-only mode in non --privileged containers [2]
[2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log
v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Alexey Milovidov
2c7a8db58c
Add test output and compare to reference
2022-01-03 03:36:23 +03:00
Alexey Milovidov
268842afa8
Add a comment
2022-01-03 03:07:25 +03:00
Alexey Milovidov
c3ab18d1b0
Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test
2022-01-03 03:00:01 +03:00
alexey-milovidov
f1b6bc1074
Update docker_compose_dotnet_client.yml
2022-01-03 02:55:49 +03:00
alexey-milovidov
7d52ba4576
Update Dockerfile
2022-01-03 02:54:43 +03:00
alexey-milovidov
817bb0ee6d
Update docker_compose_dotnet_client.yml
2022-01-03 02:46:08 +03:00
alexey-milovidov
57926cf366
Update Dockerfile
2022-01-03 02:45:46 +03:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
alesapin
333dfab6a6
Add retries to AST fuzzer
2021-12-28 16:12:51 +03:00
taiyang-li
9036b18c2f
merge master
2021-12-27 15:12:48 +08:00
alesapin
118004015a
Longer timeout for server start in fuzzer
2021-12-24 14:56:51 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test
2021-12-23 20:14:15 +03:00
alexey-milovidov
b248b69c3b
Merge pull request #32854 from ClickHouse/pvs-nproc
...
Use all available processors for checks
2021-12-23 08:00:12 +03:00
alesapin
bc03e5e10f
Merge pull request #32983 from ClickHouse/add_woboq_build
...
Trying to add woboq to new CI
2021-12-21 23:05:38 +03:00
Mikhail f. Shiryaev
1b623f6b71
Autodetect threads count for fast tests as half of CPUs
2021-12-21 15:43:09 +01:00
Mikhail f. Shiryaev
eefdeabff2
Delete code coverage image
2021-12-21 15:43:08 +01:00
Mikhail f. Shiryaev
b0e37b808e
Use all available processors for PVS sturio check
2021-12-21 15:43:04 +01:00
alesapin
a89a05c0da
Finally woboq is ready
2021-12-21 14:16:21 +03:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
alesapin
532b01c371
Followup
2021-12-21 10:49:22 +03:00
alesapin
62eb504029
Trying to add woboq
2021-12-20 22:43:37 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression
...
Improve gRPC compression support
2021-12-20 19:44:58 +03:00
Vitaly Baranov
708439b036
Support customized compression for input/output data in gRPC protocol.
2021-12-19 16:29:44 +03:00
alexey-milovidov
9c04901117
Merge pull request #32801 from ClickHouse/better_gdb_script
...
More diagnostics in gdb script
2021-12-19 08:00:12 +03:00
Azat Khuzhin
492fa98276
Add replxx/jemalloc into fasttest build of clickhouse
...
Both of the are pretty small, and so should not affect build time, but
will have additional bonus, since jemalloc is the production allocator
and replxx is just useful to use binary with completion (and later some
test can be enabled for fasttest with completion)
2021-12-17 22:09:05 +03:00
alesapin
d36f828b9c
Merge pull request #32910 from ClickHouse/performance_retry
...
More retries in perf tests.
2021-12-17 19:20:50 +03:00
alesapin
c2e8a73f14
Fix style
2021-12-17 16:43:58 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy
...
Add dockerhub proxy to CI
2021-12-17 14:31:50 +01:00
alesapin
1931726e15
Followup
2021-12-17 16:19:44 +03:00
alesapin
24480ac4de
More agressive retries in perf tests
2021-12-17 16:16:35 +03:00
alesapin
47c907d41a
Add dockerhub proxy
2021-12-17 13:20:48 +03:00
Vladimir C
fa011c66b7
Merge pull request #32846 from vdimir/flaky_test_s3_zero_copy_replication
2021-12-17 12:09:21 +03:00
vdimir
3f118f6734
Try fix flaky test: order for test_s3_zero_copy_replication
2021-12-17 12:08:39 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
alesapin
c9b03eaf64
Update entrypoint.sh
2021-12-15 22:28:21 +03:00
alesapin
6f2543b943
Better fix
2021-12-15 18:50:11 +03:00
alesapin
6799ce2162
Add retries to curl
2021-12-15 18:46:40 +03:00
Alexander Tokmakov
bd5931e5af
improve gdb script
2021-12-15 13:21:21 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2
...
Try to fix attaching gdb 2
2021-12-14 21:10:00 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests
2021-12-14 11:04:41 +00:00
taiyang-li
8234d1176f
merge master
2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
...
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
alesapin
3eb5e42972
Trying to allow bigger timeout for prewarm
2021-12-13 18:09:29 +03:00
alesapin
8e1fec39cd
Fix bash
2021-12-13 12:58:34 +03:00
alesapin
e2a2d1cdc3
Merge branch 'master' into add_performance_tests
2021-12-13 12:01:31 +03:00
alesapin
cf281b10dc
Split perf test into multiple checks
2021-12-13 11:59:58 +03:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Azat Khuzhin
44f366fd12
Cleanup perf test runner
...
Use subshell to:
- avoid change/restore of TIMEFORMAT
- grepping out trace output, by using set +x in a subshell
- use array for options to avoid extra backslashes
2021-12-12 13:58:00 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests
2021-12-12 01:01:13 +03:00
Azat Khuzhin
8a89b8e395
perf: do not fail in case of slow queries (to avoid hiding possible issues)
...
Do not stop processing pathologically slow queries,
since this may hide errors in other queries,
i.e. when the test failed on one of servers (upstream or from PR)
and someone interpret this is as OK with the following comment:
"the failure was on the upstream server it is OK, PR should fix it"
Anyway there is almost zero such queries right now, and before merging
something this should be reviewed.
2021-12-12 00:15:25 +03:00
Azat Khuzhin
4e4837758a
Remove readline support
...
- it was not nested for a long time
- replxx is an upstream way for completion
2021-12-11 11:29:59 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
...
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Jakub Kuklis
e58f74d8dc
Connecting to Azurite and invoking simple INSERTs works in the integration test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c
Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker
2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57
Code cleanup addressing PR remarks
2021-12-10 22:04:38 +01:00
Jakub Kuklis
850c9a7e7a
Reverting submodule changes to fast test docker and disabling Blob Storage support when files missing
2021-12-10 22:04:38 +01:00
Jakub Kuklis
37a23b402b
Add missing dependencies for azure for fast test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
024a3b4626
Fixing submodule update for clickhouse compilation in the fast test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38
Running Azurite docker in the integration test for Blob Storage support
2021-12-10 22:04:37 +01:00
Alexander Tokmakov
dfa31a6577
fix
2021-12-10 22:38:34 +03:00
alesapin
5a542516e6
Merge pull request #32515 from ClickHouse/revert-32514-revert-32496-smaller_checks
...
Revert "Revert "Split long tests into multiple checks""
2021-12-10 22:30:04 +03:00
Kseniia Sumarokova
2cd5a15193
Update docker_compose_mongo.yml
2021-12-10 22:02:28 +03:00
tavplubix
5079134ffd
Update run.sh
2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59
fix
2021-12-10 20:07:28 +03:00
alesapin
84bccb83bd
Trying to add debug info
2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks""
2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks"
2021-12-10 18:38:42 +03:00
Alexander Tokmakov
3ff8aff1b5
try to fix attaching gdb
2021-12-10 18:03:57 +03:00
kssenii
46356a34a3
Update pymongo
2021-12-10 14:58:17 +00:00
kssenii
b6b73ba5b2
pymongo
2021-12-10 14:54:55 +00:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
...
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
f655b43f5a
Merge branch 'master' into add_performance_tests
2021-12-10 12:32:43 +03:00
alesapin
4c1babee05
Split long functional tests to multiple checks
2021-12-10 12:07:24 +03:00
mergify[bot]
a07061ac84
Merge branch 'master' into update-mongo-contrb
2021-12-10 08:57:16 +00:00
alexey-milovidov
6ce2559078
Merge branch 'master' into feature/dotnet-integration-test
2021-12-10 01:25:47 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests ( #32448 )
...
* attach gdb with sudo
* fix
* Update run.sh
2021-12-10 00:12:45 +03:00
Kseniia Sumarokova
f2dfa89bc9
Update docker_compose_mongo.yml
2021-12-09 23:58:46 +03:00
kssenii
f5a77fca39
Done
2021-12-09 14:44:25 +00:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda
...
Fix 'APPLY lambda' parsing
2021-12-09 17:09:11 +03:00
alesapin
89ac8da76e
Fix build path
2021-12-09 16:02:29 +03:00
tavplubix
f4cbbfd8c0
Update run-fuzzer.sh
2021-12-09 14:17:55 +03:00
tavplubix
de0a9a84a9
Update run-fuzzer.sh
2021-12-09 13:51:39 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
Kruglov Pavel
1df2383d00
Update run-fuzzer.sh
2021-12-09 12:17:31 +03:00
alesapin
b62de9b2f4
Merge branch 'master' into add_performance_tests
2021-12-09 11:40:32 +03:00
robot-clickhouse
f2ccddb7be
Auto version update to [21.13.1.1] [54458]
2021-12-09 00:33:01 +03:00
kssenii
b6c1d1e72e
Use latest version for tests
2021-12-08 21:09:11 +00:00
avogar
51bb37715f
Fix fuzzer
2021-12-08 21:29:50 +03:00
tavplubix
523e23cfcd
Merge pull request #32164 from azat/stress-ignore-mem-limit
...
Fix stress tests
2021-12-07 13:10:17 +03:00
Azat Khuzhin
f8bf3b1993
stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded
...
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13
stress: allow memory overcommit for SELECT 1 query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961
stress: allow memory overcommit for one more query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2
stress: add make_query_command() helper
2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166
stress: SYSTEM DROP MARK CACHE
2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005
stress: tune memory_profiler_step too
2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0
stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE
...
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea
stress: ignore server memory limits for hung check
...
In [1] hung check failed because the server was under memory pressure.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
3e96b28843
perf: convert killall to pkill (since killall has some magic, see -e option)
2021-12-03 10:56:42 +03:00
Azat Khuzhin
fb0cc62509
perf: fix waiting of the server after running tests
...
killall requires strict match, i.e. "clickhouse-server" not
"clickhouse":
2021-12-03 05:24:56 + env kill -- -21700
2021-12-03 05:24:56 kill: (-21700): No such process
2021-12-03 05:24:56 + killall clickhouse
2021-12-03 05:24:56 clickhouse: no process found
2021-12-03 05:24:56 + echo Servers stopped.
2021-12-03 05:24:56 Servers stopped.
2021-12-03 05:24:56 + analyze_queries
$ tail -n1 *-server-log.log
==> left-server-log.log <==
2021.12.03 05:26:59.530647 [ 450 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 1668052
==> right-server-log.log <==
2021.12.03 05:27:20.873136 [ 466 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 9605
==> setup-server-log.log <==
2021.12.03 02:47:14.844395 [ 96 ] {} <Information> Application: Child process exited normally with code 0.
As you can see killall instantly fails with no such process, while this
cannot be true since it was there, and also according to logs there were
messages after running analyze_queries() from compare.sh
This should fix problems like in [1].
[1]: https://clickhouse-test-reports.s3.yandex.net/32080/344298f4037f88b114b8e798bb30036b24be8f16/performance_comparison/report.html#fail1
2021-12-03 10:55:35 +03:00
mergify[bot]
9c016d4e25
Merge branch 'master' into stress-test
2021-12-02 12:02:44 +00:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
Azat Khuzhin
e976cd8691
Provide clickhouse binary w/o debug symbols (stripped) in fasttest
...
- regular binary: 1.8G
- stripped: 343M (5x less)
- gzipped stripped: 92M (20x less)
This can be useful to check something fast.
2021-12-01 21:50:03 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test
2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16
Followup
2021-11-30 13:24:04 +03:00
alesapin
085a30b98e
Fixup
2021-11-30 13:22:50 +03:00
alesapin
bccd927aec
Make stress tests slightly more stable
2021-11-30 13:19:03 +03:00
Raúl Marín
6a04dcb492
Remove libc-headers
2021-11-29 19:55:57 +01:00
Mikhail f. Shiryaev
e97e172dd8
Merge pull request #31822 from ClickHouse/rollback-28016
...
Rollback changes from #28016 : ru.archive.ubuntu.com
2021-11-29 10:27:59 +01:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test
2021-11-26 12:48:03 +00:00
Mikhail f. Shiryaev
5408d6232f
Make archive.ubuntu.com mirror configurable for build
2021-11-26 10:55:41 +01:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
...
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
taiyang-li
d35e2a1c83
Merge branch 'master' into hive_table
2021-11-26 11:44:50 +08:00
alexey-milovidov
6b8f7ad03f
Merge pull request #31798 from ClickHouse/fix-31748
...
Fix stylecheck for tests/ci/push_to_artifactory.py
2021-11-26 00:11:32 +03:00
alexey-milovidov
6017b982d9
Merge pull request #31780 from Algunenano/fix_performance_report_queries
...
Improve how queries are output in the performance dashboard
2021-11-25 22:57:29 +03:00
alesapin
71ae890c59
Merge pull request #31544 from azat/ci-actions-fixes
...
Remove duplicated not compressed logs from CI (actions)
2021-11-25 18:43:44 +03:00
alesapin
5815429059
Shorter stress and fuzzer tests
2021-11-25 17:54:50 +03:00
Mikhail f. Shiryaev
16703c2824
Fix stylecheck for tests/ci/push_to_artifactory.py
2021-11-25 14:41:08 +01:00
alexey-milovidov
e8b29cab6e
Update report.py
2021-11-25 15:37:00 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test
2021-11-25 11:09:26 +00:00
Raúl Marín
a6c34fdbc9
Improve how queries are output in the performance dashboard
2021-11-25 11:22:47 +01:00
taiyang-li
72f60cceb9
Merge branch 'master' into hive_table
2021-11-25 17:33:26 +08:00
alesapin
c86b43c7ef
Merge pull request #31685 from ClickHouse/tavplubix-patch-5
...
Try fix OOMs with TSAN
2021-11-25 11:34:05 +03:00
alesapin
58fad90351
Merge branch 'master' into add_performance_tests
2021-11-25 10:53:10 +03:00
alesapin
cf2f019caa
Disable full run in perf tests
2021-11-24 23:05:27 +03:00
Alexey Milovidov
92031e6b31
Fix PVS-Studio
2021-11-24 20:25:11 +03:00
tavplubix
82e4f941a4
Update Dockerfile
2021-11-24 16:00:15 +03:00
tavplubix
556ccd0bc9
Update Dockerfile
2021-11-24 12:47:44 +03:00
taiyang-li
89dcef69d5
merge master
2021-11-24 14:38:04 +08:00
alexey-milovidov
61454ffbcb
Merge branch 'master' into hermetic-builds
2021-11-24 00:25:16 +03:00
alesapin
42c77323e8
Merge branch 'master' into add_performance_tests
2021-11-23 22:14:32 +03:00
Kruglov Pavel
18e60919c5
Update run.sh
2021-11-23 16:49:59 +03:00
alexey-milovidov
341f705419
Merge pull request #30599 from ClickHouse/zlib-ng-own-cmake
...
Use our own CMakeLists for `zlib-ng`, `cassandra`, `mariadb-connector-c` and `xz`, `re2`, `sentry`, `gsasl`, `arrow`, `protobuf`.
2021-11-23 13:33:29 +03:00
alesapin
2396f73e08
Fix performance tests comparison
2021-11-23 11:34:10 +03:00
alesapin
62b2eb6694
Merge branch 'master' into add_performance_tests
2021-11-23 11:26:45 +03:00
lgbo
996d7125c0
Merge branch 'master' into hive_table
2021-11-23 10:19:02 +08:00
Constantine Peresypkin
fd551ad94c
fix kerberized_hadoop image
...
current image uses non-existing centos6 repos
added direct fetch of actual rpm packages
fixed a typo in docker/images.json: duplicate entry
2021-11-22 17:32:19 +02:00
taiyang-li
d22854e82b
add compile swiych USE_HIVE
2021-11-22 10:52:10 +08:00
Alexey Milovidov
d604cf5573
Remove the infamous "unbundled" build
2021-11-21 13:58:26 +03:00
Azat Khuzhin
d0ecdb617e
Remove duplicated not compressed logs from CI (actions)
...
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
alesapin
9e440988cf
Add datasets
2021-11-19 16:10:49 +03:00
taiyang-li
ab64a17104
fix fasttest
2021-11-19 16:20:14 +08:00
taiyang-li
e8644807fe
merge master and solve conflict
2021-11-19 15:01:58 +08:00
alesapin
130c09f348
Fix search for old version
2021-11-18 13:38:59 +03:00
lgbo-ustc
9902ccefc5
Add integration tests for hive query
2021-11-18 16:17:49 +08:00
alesapin
d0ec0c5dc8
Merge branch 'master' into add_performance_tests
2021-11-18 10:17:20 +03:00
alesapin
b74f9e7047
Merge branch 'master' into add_performance_tests
2021-11-18 10:12:46 +03:00
Nikolay Degterinsky
fc9ef14a73
Merge pull request #29219 from evillique/log_lz4_streaming
...
Add LZ4 stream compression of logs
2021-11-17 21:22:57 +03:00
mergify[bot]
66f7b81b5e
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-17 09:41:12 +00:00
Nikolay Degterinsky
eafd3ddfac
Add lz4 stream compression
2021-11-16 22:30:29 +00:00
tavplubix
b1079ae309
Update run.sh
2021-11-16 20:03:50 +03:00
mergify[bot]
923874060a
Merge branch 'master' into stress-test
2021-11-16 16:42:50 +00:00
tavplubix
224a4c1b6b
Update run.sh
2021-11-16 17:45:37 +03:00
alesapin
7f09941c72
Add performance comparison check
2021-11-16 14:16:10 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release
2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix
2021-11-15 15:03:48 +03:00
alexey-milovidov
f4fda976ef
Merge pull request #31063 from azat/perf-spikes
...
perf: switch *_log tables to Memory engine (attempt to reduce cache misses)
2021-11-14 05:13:12 +03:00
Azat Khuzhin
48b1b7b7ec
Fix test_kafka_insert_avro by pinning avro version
...
New avro version has a code that does not allow to use BytesIO [1].
[1]: https://github.com/apache/avro/commit/e8c61ba4f0#diff-ca721cc66db80ff81dcd7b8ad1bb0e83b2e5c2de80c207ebec79f5495d38db98R318-R319
2021-11-13 12:01:13 +03:00
Azat Khuzhin
40be97c1dd
Improve fuzzer report in case of fuzzer killed
...
This will avoid Exception from fuzzer in description like in [1], that
someone may think that is related to the failure, which is obviously
don't in case it was KILLed.
[1]: https://clickhouse-test-reports.s3.yandex.net/31259/a49e10c78860a451ff9cc39df6049c88234d507a/fuzzer_ubsan/report.html#fail1
2021-11-12 01:01:10 +03:00
mergify[bot]
045bd40070
Merge branch 'master' into perf-spikes
2021-11-11 07:07:28 +00:00
taiyang-li
af78116c3f
Merge branch 'master' into hive_table
2021-11-11 11:52:28 +08:00
Kseniia Sumarokova
5f9b35b982
Update docker_compose_postgres.yml
2021-11-10 10:36:59 +03:00
taiyang-li
26988ab757
Merge branch 'master' into hive_table
2021-11-10 11:01:03 +08:00
Kruglov Pavel
08af98b4a1
Update download_previous_release
2021-11-09 16:34:13 +03:00
Kseniia Sumarokova
5eef7e0e45
Update docker_compose_postgres.yml
2021-11-09 15:13:01 +03:00
taiyang-li
5dbbe4b9c5
fix build error
2021-11-09 13:14:53 +08:00
Kruglov Pavel
03f1e3c67d
Update run.sh
2021-11-08 14:02:36 +03:00
Azat Khuzhin
9e622b5add
perf: switch *_log tables to Memory engine (attempt to reduce cache misses)
...
trace_log/query_log from performance tests shows (for
cases when prewarm query fails with timeout, 15sec) excessive
writeTraceInfo() in trace_log and QueryProfilerRuns in query_log, but
this is not the root cause of the timeout, but consequence.
Also query_log shows that on failures the following profile events has
significantly higher values:
- PerfLocalMemoryMisses (6.3x more)
- PerfLocalMemoryReferences (7x more)
- PerfDataTLBMisses (6.9x more)
- PerfInstructionTLBMisses (6.4x more)
During looking at performance tests logs I noticed that once the prewarm
query fails other server (left/right) was merging (MergeTree) something
in *_log tables.
But, using MergeTree for *_log in performance tests is useless, since
anyway environment for performance tests uses ramdrive.
And so MergeTree merges just increase overhead.
Eventually I expect that this should decrease extra memory referencing
and so this should decrease cache/TLB misses.
CI: https://clickhouse-test-reports.s3.yandex.net/30886/c504e0c08df7a926bb479a1d297f326f5c48a32f/performance_comparison/report.html#fail1
v2: <partition_by remove="remove"/>
2021-11-04 09:26:46 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test
2021-11-03 08:28:43 +00:00
Azat Khuzhin
ff19d22305
perf: remove over *_log tables that does not exported into artifacts
2021-11-03 08:29:18 +03:00
Azat Khuzhin
837fe8554f
perf: remove zookeeper to avoid configuring DDLWorker
2021-11-03 08:29:18 +03:00
Azat Khuzhin
acef85b17d
perf: cleanup server overrides
2021-11-03 08:29:18 +03:00
Azat Khuzhin
afd960db4e
perf: remove redundant query profiler set queries
2021-11-03 08:09:43 +03:00
mergify[bot]
063ba2302c
Merge branch 'master' into zookeeper_client_fault_injection
2021-11-02 14:29:35 +00:00
robot-clickhouse
4289336c27
Auto version update to [21.12.1.1] [54457]
2021-11-02 00:56:45 +03:00
Kruglov Pavel
9a1275cb10
Merge pull request #30178 from Avogar/tsv-csv
...
Refactor and improve TSV, CSV, JSONCompactEachRow, RowBinary formats. Fix bugs in formats
2021-11-02 00:38:30 +03:00
alesapin
dbfa17aabf
Add correct S3
2021-11-01 13:32:56 +03:00
avogar
4e63311bb6
Try fix perf test
2021-11-01 12:13:29 +03:00
alexey-milovidov
15b9d65221
Merge pull request #30662 from azat/conf-clickhouse
...
Switch everything left from `<yandex>` to `<clickhouse>`
2021-10-31 14:56:51 +03:00
tavplubix
059c1ebf36
Merge pull request #30847 from ClickHouse/fix_30802
...
Disable check for ZooKeeper session uptime by default
2021-10-29 20:18:25 +03:00
Alexander Tokmakov
d095cfe4c1
disable check for zk session uptime by default
2021-10-29 14:45:09 +03:00
alesapin
4eca493ab8
Fix fuzzer on master
2021-10-29 13:47:29 +03:00
alesapin
11b70a285c
Merge pull request #30795 from ClickHouse/make_fuzzer_check_less_hardcoded
...
Trying to make fuzzer check less hardcoded
2021-10-29 10:21:36 +03:00
alesapin
ddac7a51e2
Merge pull request #30729 from ClickHouse/trying_actions
...
Add functional tests to github actions
2021-10-29 09:49:31 +03:00
mergify[bot]
65df198e9b
Merge branch 'master' into conf-clickhouse
2021-10-28 22:19:42 +00:00
alesapin
ffc8dbd085
Update run-fuzzer.sh
2021-10-28 23:06:04 +03:00
alesapin
313584e553
Update run-fuzzer.sh
2021-10-28 19:12:47 +03:00
mergify[bot]
a94b8902dd
Merge branch 'master' into trying_actions
2021-10-28 15:57:28 +00:00
alesapin
0651a1f0e9
Update run-fuzzer.sh
2021-10-28 17:03:40 +03:00
alesapin
542196128b
Trying to make fuzzer check less hardcoded
2021-10-28 12:29:50 +03:00
alesapin
c0b2f92123
Add stateful test
2021-10-28 12:26:59 +03:00
Azat Khuzhin
9eef2ad0c2
perf: reduce number of times the query will run
...
Before this patch:
- upstream/master and PR's *with* perf tests or pef scripts changes:
--runs=13 --max-queries=0
- PRs *without* perf changes:
--runs=7 --max-queries=20
- PRs w/ only perf tests changes:
--runs-13 --max-queries=0 <list of perf tests>
After:
- upstream/master and PR's *with* perf tests changes:
--runs=13 --max-queries=0
- PRs *without* perf changes:
--runs=7 --max-queries=10
- PRs w/ only perf tests changes:
--runs-13 --max-queries=0 <list of perf tests>
So to underline, now we will not look at perf scripts changes anymore,
and we will also decrease number of random queries to run to 10.
2021-10-27 23:20:51 +03:00
Azat Khuzhin
7957079f95
perf: disable query/memory profiling for non prewarm queries
2021-10-27 23:20:51 +03:00
Azat Khuzhin
190459db33
perf: add queries with errors during process too to the perf artifacts
...
Sometimes queries fails with timeout, and you will not get any perf
metrics for it before this patch.
Example: https://clickhouse-test-reports.s3.yandex.net/30611/5ff6c5536558821824d5fdf25a75729e5b82060d/performance_comparison/report.html#partial-queries.flat_dictionary.5
2021-10-27 23:20:51 +03:00
Azat Khuzhin
722d528218
perf: pin clickhouse-driver to 0.2.1 for tzlocal <0.3 to avoid warning
...
CI report [1]:
/usr/local/lib/python3.6/dist-packages/clickhouse_driver/columns/datetimecolumn.py:199: PytzUsageWarning: The zone attribute is specific to pytz's interface; please migrate to a new time zone provider. For more details on how to do so, see https://pytz-deprecation-shim.readthedocs.io/en/latest/migration.html
[1]: https://clickhouse-test-reports.s3.yandex.net/30626/dfc85841134aa96b4e04c401462898eb305e8657/performance_comparison/report.html#changes-in-performance.format_date_time.1
2021-10-27 23:20:51 +03:00
mergify[bot]
d9d9d38e4f
Merge branch 'master' into stress-test
2021-10-27 19:00:31 +00:00
Azat Khuzhin
90ea2de9bb
Add unidiff into style image
2021-10-27 10:03:24 +03:00
Azat Khuzhin
b41c77f4f8
Add boto3 to style image
2021-10-27 10:03:24 +03:00
Azat Khuzhin
944437caf6
Add PyGithub into style image
2021-10-27 10:03:23 +03:00
Azat Khuzhin
da90df5658
docker: switch <yandex> to <clickhouse>
2021-10-26 08:53:14 +03:00
Alexander Tokmakov
35b5cb9571
Merge branch 'master' into zookeeper_client_fault_injection
2021-10-25 19:03:37 +03:00
Azat Khuzhin
8f015764a7
Add metadata for *_log into tests artifacts
...
This will allow to use artifacts as-is, i.e.:
clickhouse-local --path /path/to/log/artifact
v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Alexander Tokmakov
27ca943863
add fault injection in ZooKeeper client
2021-10-22 18:59:38 +03:00
mergify[bot]
943a1cbba0
Merge branch 'master' into stress-test
2021-10-21 04:41:23 +00:00
alesapin
9e8dfdb089
Merge pull request #28851 from ClickHouse/trying_actions
...
Trying github actions
2021-10-20 12:55:53 +03:00
alesapin
6d8853698b
Merge branch 'master' into trying_actions
2021-10-19 17:45:37 +03:00
vdimir
acf416900d
Minor fix in clickhouse/kerberized-hadoop Dockerfile
2021-10-19 16:45:03 +03:00
vdimir
1d78f1c63b
Fix ca-bundle.crt in clickhouse/kerberized-hadoop
2021-10-19 16:40:06 +03:00
vdimir
36bb4033ba
Whitespace change in kerberized_hadoop/Dockerfile
2021-10-19 12:44:55 +03:00
Alexey Milovidov
2cef9983fa
Remove recursive submodules
2021-10-18 02:29:04 +03:00
Alexey Milovidov
f02b61e30f
Merge branch 'master' into hermetic-builds
2021-10-17 07:02:37 +03:00
mergify[bot]
f29ea07b1c
Merge branch 'master' into clickhouse-test-http-interface
2021-10-13 16:46:26 +00:00
tavplubix
a16ce6b54b
Merge pull request #30030 from ClickHouse/tavplubix-patch-3
...
Attach trace_log to stateless tests report as is
2021-10-13 13:21:39 +03:00
Alexey Milovidov
b420bc19fb
Merge branch 'master' into hermetic-builds
2021-10-13 01:08:23 +03:00
Dmitry Novik
fa9cdd5c5f
Use original whitespaces in test_results.tsv
2021-10-12 23:31:31 +03:00
Dmitry Novik
0507391010
Do not stop CI tests processing if clickhouse-test return 1
2021-10-12 23:30:07 +03:00
Dmitry Novik
a30573fc0a
Add FAIL message to test_results.tsv
2021-10-12 23:29:15 +03:00
Azat Khuzhin
071a5af96e
Revert "docker: add pandas/clickhouse_driver into test images"
...
This reverts commit e07a6f3fc0
.
2021-10-12 21:06:26 +03:00
tavplubix
f3c9f4be6c
Update run.sh
2021-10-12 14:38:41 +03:00
Alexey Milovidov
bdd06279a4
Fix PVS Studio
2021-10-12 05:43:53 +03:00
Alexey Milovidov
d0f7a10c6a
Fix fasttest
2021-10-12 03:34:07 +03:00
alesapin
3ae960e04b
Review fixes
2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a
More timeouts in stress test
2021-10-11 13:25:54 +03:00
alexey-milovidov
268c155b7d
Merge pull request #29856 from azat/clickhouse-test-python-client
...
Rewrite clickhouse-test to use python clickhouse_driver
2021-10-09 17:58:40 +03:00
alexey-milovidov
f6a0983068
Merge pull request #29781 from azat/fuzzer-server-pid-v2
...
Simplify obtaining of server pid in fuzzer tests
2021-10-08 00:35:25 +03:00
Azat Khuzhin
e07a6f3fc0
docker: add pandas/clickhouse_driver into test images
2021-10-08 00:09:37 +03:00
Kruglov Pavel
fd7d1131ec
Update run.sh
2021-10-06 13:17:48 +03:00
Azat Khuzhin
aeb670dbe0
Simplify obtaining of server pid in fuzzer tests
2021-10-05 21:05:49 +03:00
mergify[bot]
0910a8ec74
Merge branch 'master' into stress-test
2021-10-05 09:46:18 +00:00
Kseniia Sumarokova
ead99b5911
Update docker_compose_minio.yml
2021-10-05 11:39:08 +03:00
kssenii
4962677a8b
Update minio
2021-10-05 08:18:16 +00:00
Nikita Mikhaylov
731d6c5755
Merge pull request #29513 from azat/fuzzer-fix-server-pid
...
Fix server pid (hence exit code and attaching with gdb) in fuzzer tests
2021-10-04 19:59:24 +03:00
Kruglov Pavel
31302afe81
Update run.sh
2021-10-04 16:35:50 +03:00
avogar
821daa21da
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
6fc043026e
Update run.sh
2021-10-04 16:35:50 +03:00
Pavel Kruglov
2db11bc6c5
Add backward compatibility check in stress test
2021-10-04 16:34:14 +03:00
Azat Khuzhin
74a7a0603d
test/fuzzer: print stacktrace
...
To get the stacktrace for errors w/o it [1]:
SET max_parser_depth = 4000
Got boring AST
Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION)
[1]: https://clickhouse-test-reports.s3.yandex.net/29513/769bfbe71f22c392458eced655080a0bbd442e02/fuzzer_ubsan/fuzzer.log
2021-10-02 12:49:44 +03:00
Azat Khuzhin
769bfbe71f
Fix server pid in fuzzer tests
...
Previously it was the pid of the subshell 40 while it should be the pid
of the clickhouse-server 39:
Here we see that the server pid is 39:
2021-09-28 11:02:34 + pgrep -f clickhouse-server
2021-09-28 11:02:34 39
Here we see that the 40 is the pid of subshell:
2021-09-28 11:02:45 ch/docker/test/fuzzer/run-fuzzer.sh: line 90: 39 Killed clickhouse-server --config-file db/config.xml -- --path db 2>&1
2021-09-28 11:02:45 40 Done | tail -100000 > server.log
And here we see that server_pid variable is 40:
2021-09-28 11:02:45 + server_exit_code=0
2021-09-28 11:02:45 + wait 40
v2: wait in background to call wait in foreground and ensure that the
process is alive, since w/o job control this is the only way to obtain
the exit code
2021-10-01 21:05:30 +03:00
Alexey Milovidov
4271f8c738
Merge remote-tracking branch 'origin/master' into yandex-to-clickhouse-in-configs
2021-10-01 01:33:58 +03:00
Alexey Milovidov
2ec75b824b
Revert "repo.clickhouse.tech is not 100% ready"
...
This reverts commit 8616ba62e4
.
2021-09-29 02:43:20 +03:00
Dmitry Novik
29587c5013
Pass all parameters to process_functional_tests_result.py
2021-09-28 20:38:41 +03:00
Dmitry Novik
6b12869f6e
Fix path to executable
2021-09-28 15:11:18 +03:00
Dmitry Novik
4ce12a7685
Fixup
2021-09-28 11:50:28 +03:00
alesapin
8e25144bbb
Merge branch 'master' into trying_actions
2021-09-28 11:08:13 +03:00
Dmitry Novik
7755b3688f
Fix docker images build
2021-09-28 01:07:53 +03:00
Dmitry Novik
5418ea83fa
Fix clickhouse/test-util Dockerfile
2021-09-27 17:38:25 +03:00
Dmitry Novik
4e6c945fdf
Rename fasttest output file
2021-09-27 13:09:57 +03:00
mergify[bot]
dbb924171d
Merge branch 'master' into fasttest-tsv
2021-09-27 07:48:49 +00:00
mergify[bot]
64669a28ce
Merge branch 'master' into yandex-to-clickhouse-in-configs
2021-09-26 22:59:23 +00:00
Alexey Milovidov
dc7eb5c1ae
Fix ugly typo
2021-09-26 03:29:32 +03:00
Alexey Milovidov
fb7ce28198
Merge branch 'master' into yandex-to-clickhouse-in-configs
2021-09-26 02:10:11 +03:00
Alexey Milovidov
90e74aff70
Fix performance test
2021-09-26 02:08:46 +03:00
Dmitry Novik
98df97f5d9
Fix docker image
2021-09-24 13:48:28 +03:00
Dmitry Novik
77dfa44256
Generate test_results.tsv for fasttest
2021-09-24 12:16:08 +03:00
Alexey Milovidov
8616ba62e4
repo.clickhouse.tech is not 100% ready
2021-09-24 04:41:59 +03:00
mergify[bot]
88b7680eeb
Merge branch 'master' into trying_actions
2021-09-23 15:48:57 +00:00
Alexey Milovidov
e9e77b4403
.tech -> .com
2021-09-22 03:22:57 +03:00
alexey-milovidov
0880ae2883
Merge branch 'master' into yandex-to-clickhouse-in-configs
2021-09-21 20:17:28 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check ( #29167 )
...
* stop ThreadFuzzer before hung check
* fix
* fix
2021-09-20 17:23:10 +03:00
Alexey Milovidov
e513a5db32
Change <yandex> to <clickhouse> in configs
2021-09-20 01:38:53 +03:00
alesapin
00d9a62d6c
Missclick
2021-09-17 14:17:50 +03:00
alesapin
5d35ba7d93
One more time
2021-09-17 13:41:29 +03:00
alesapin
68c7f8638a
update docker image
2021-09-17 13:34:45 +03:00
alesapin
71dcf03a0f
Create changed image
2021-09-15 20:35:15 +03:00
Nikita Mikhaylov
4b3c0a95d1
Merge pull request #28046 from syominsergey/fix-build-clang-13-2
...
[WIP] Improve support for build with clang-13
2021-09-13 12:11:38 +03:00
Vitaly Baranov
512786346c
Merge pull request #28909 from vitlibar/convert-skip-list-into-first-line-comments
...
Convert skip_list .json into first line comments
2021-09-13 03:37:39 +03:00
Sergei Semin
12e24a23d3
Merge branch 'master' into fix-build-clang-13-2
2021-09-12 19:30:55 +03:00
Vitaly Baranov
daa5979347
Remove unnecessary files.
2021-09-12 17:15:28 +03:00
Vitaly Baranov
bbb192ee85
Convert skip_list.json into first line comments.
2021-09-12 17:15:23 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
...
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Mike Kot
c4385a2c40
Simplifying exception messages
2021-09-11 00:40:18 +02:00
mergify[bot]
e3b3439535
Merge branch 'master' into fix-build-clang-13-2
2021-09-10 12:05:54 +00:00
alesapin
6243b64ff5
Merge pull request #28656 from ClickHouse/move_docker_images_to_separate_repo
...
Move docker images to a separate repo
2021-09-10 10:24:21 +03:00
Sergei Semin
ffc529feb1
use clang-13 in pvs docker image
2021-09-09 23:51:47 +03:00
Sergei Semin
b739d1cc92
make changes analog to https://github.com/ClickHouse/ClickHouse/pull/20495/files but for clang-13
2021-09-09 23:51:47 +03:00
alesapin
2359a222ff
Fix more tests
2021-09-09 23:29:42 +03:00
robot-clickhouse
fc4f119417
Auto version update to [21.11.1.1] [54456]
2021-09-09 12:03:29 +03:00
alesapin
1297e95e4a
Revert "Revert jdbc-bridge image"
...
This reverts commit 63cc735b8f
.
2021-09-09 10:45:04 +03:00
alesapin
63cc735b8f
Revert jdbc-bridge image
2021-09-09 10:42:59 +03:00
alesapin
cbbc5b2ee5
Fix some broken images
2021-09-08 12:58:17 +03:00
alesapin
bdd26f2a19
Merge branch 'master' into move_docker_images_to_separate_repo
2021-09-08 12:36:36 +03:00
alesapin
3b9dae8718
Merge pull request #28616 from ClickHouse/qoega-try-llvm-12
...
Merging #20495
2021-09-08 11:43:46 +03:00
Vitaly Baranov
70c6623036
Merge branch 'master' into governance/session_log
2021-09-07 10:12:54 +03:00
alesapin
0eac4529e0
Preparation
2021-09-06 14:33:39 +03:00
alesapin
40d4d64a65
Fix PVS Image
2021-09-05 15:50:25 +03:00
alesapin
a879c907a2
Update PVS hashsum
2021-09-04 16:00:42 +03:00
mergify[bot]
6ccf905133
Merge branch 'master' into try-llvm-12
2021-09-03 16:13:13 +00:00
Nikolay Degterinsky
53b6d918eb
Merge pull request #25310 from bharatnc/ncb/import-export-lz4
...
LZ4 compression for import/export
2021-09-01 21:12:50 +03:00
alesapin
7e2cb7c8ac
Merge pull request #27538 from ClickHouse/stress-thread-fuzzer
...
Enable Thread Fuzzer in Stress test
2021-09-01 10:26:19 +03:00
Nikita Mikhaylov
a738b145ba
fix shellcheck
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
a5d4060df8
Better waiting for minio to start
2021-08-31 12:54:45 +00:00
vdimir
56a3675591
Adjust docker/test/stateless/setup_minio.sh for local run
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
c2c9bea19e
Update setup_minio.sh
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
5f7a1bab94
better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
cc73ca17d3
Debug
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
dbe13ffc0f
Fix tests
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
083ca0f283
Better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
4cdc978636
Move dowloading to dockerfile
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
92446b1b88
Better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
4a88e5f281
Better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
1adbb2db18
Update setup_minio.sh
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
daece09eab
chmod +x
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
c4bf47d4a3
Better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
26efa7184d
Added minio
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
e41d1cff1d
Fix test
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
eed958495f
Better
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
fcfda4b983
Fix tests and update ya.make
2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
d7a627e5a9
Added test to skip list
2021-08-31 12:54:06 +00:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer
2021-08-31 11:56:30 +00:00
Nikolay Degterinsky
e8713a7d7e
Merge branch 'master' into ncb/import-export-lz4
2021-08-31 13:32:39 +03:00
alesapin
525999145e
Merge pull request #26791 from ClickHouse/async-reads
...
Experiment with asynchronous readers
2021-08-31 13:17:45 +03:00
Vladimir C
3c2cee392a
Merge pull request #28350 from vdimir/fuzz-j2-sed-typo
2021-08-31 11:04:07 +03:00
Vladimir C
4cbc1aba19
Disable SC2001 shellcheck in docker/test/fuzzer/run-fuzzer.sh
2021-08-31 11:02:52 +03:00