Commit Graph

2897 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
c19d0a3494
Update performance-comparison, fix x86 hard-code 2022-02-11 18:26:41 +01:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz"
This reverts commit efd8044ab7, reversing
changes made to 4bb69bcb15.
2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
c7ba5204b3
Make testflows a multiarch image 2022-02-07 13:21:51 +01:00
Mikhail f. Shiryaev
4a1e84306a
Update performance comparison OS version 2022-02-07 12:57:58 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images 2022-02-07 12:35:32 +01:00
alesapin
06499ce847 Revert "Remove docker change"
This reverts commit 3c80e0bff8.
2022-02-04 14:32:11 +03:00
Mikhail f. Shiryaev
a7325bbe32
Fix check-workflows in style check, iterate over checks 2022-02-03 18:36:01 +01:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck 2022-02-03 17:50:35 +01:00
BoloniniD
23e29e22a0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-02-03 19:32:14 +03:00
Mikhail f. Shiryaev
75adf5d12d
Merge pull request #33948 from qoega/no-clickhouse-test-deb-in-stateless
Do not use clickhouse-test.deb in stateless CI checks
2022-02-02 10:23:33 +01:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3" 2022-02-01 05:46:13 +03:00
alesapin
b6828f1b4a Supress some tests for S3 2022-01-31 19:09:25 +03:00
BoloniniD
a744378cc7 Fix performance test 2022-01-27 20:14:50 +03:00
BoloniniD
44591b79ff Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-27 19:49:58 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
BoloniniD
6f078c164d Merge branch 'master' of github.com:ClickHouse/ClickHouse into BLAKE3 2022-01-26 20:11:27 +03:00
Constantine Peresypkin
f5787ff0a9 docker: fix root squashed data dirs
if we use some root squashed volume mappings in docker
uid=0 is actually uid=nobody
thus FS operations with uid=0 will fail miserably
and overall it's a strange idea to create dirs under root when
DO_NOT_CHOWN is in effect...
2022-01-26 14:29:27 +02:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
Azat Khuzhin
616fd5dda9 docker/packager/other/fuzzer: cleanup USE_INTERNAL_XXX 2022-01-20 10:02:01 +03:00
Azat Khuzhin
7496ed7fde Remove unbundled gtest support
v2: Fix unit tests (do not rely on USE_GTEST)
2022-01-20 10:01:54 +03:00
Yatsishin Ilya
e64351de37 Disable dh_update_autotools_config 2022-01-18 20:10:38 +00:00
mergify[bot]
23f09bd25a
Merge branch 'master' into fix-mongo2-compose 2022-01-17 11:52:48 +00:00
alexey-milovidov
e0d1b13402
Update Dockerfile 2022-01-16 00:15:19 +03:00
Alexey Milovidov
a967f90ef7 Add comments 2022-01-15 22:28:08 +03:00
Alexey Milovidov
dce1269b2a Merge branch 'master' of github.com:yandex/ClickHouse into merge-33563-2 2022-01-15 22:27:20 +03:00
Alexey Milovidov
7e266387b1 Merge #33563 2022-01-15 22:25:05 +03:00
mergify[bot]
17f17c13f5
Merge branch 'master' into fix-mongo2-compose 2022-01-15 13:50:03 +00:00
Alexey Milovidov
a4e8e61d57 Update "gosu" version 2022-01-15 02:59:28 +03:00
alexey-milovidov
c3972f000d
Merge pull request #33614 from ClickHouse/safe-names-in-blog
Use safe page URL for a blog post
2022-01-15 02:29:37 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Mikhail f. Shiryaev
fdb88b75ec
Don't build integration tests on arm64 yet 2022-01-14 15:48:43 +01:00
Mikhail f. Shiryaev
73f06421b1
Use automatic architecture for docker repo 2022-01-14 15:03:43 +01:00
Mikhail f. Shiryaev
97e4151aff
Remove broken editing of /etc/hosts 2022-01-14 14:46:14 +01:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
alesapin
d7a7926610 Update version to 22.1 not 21.13 2022-01-14 15:10:45 +03:00
Mikhail f. Shiryaev
cdb3a51438
Fix virtualenv in docker docks-builder 2022-01-14 09:54:23 +01:00
alesapin
5257b413d4
Merge pull request #33612 from ClickHouse/workflow-linting
Add actionlint configuration and fix all issues
2022-01-14 11:41:48 +03:00
Kseniia Sumarokova
5da673c3a5
Merge pull request #31104 from bigo-sg/hive_table
Implement hive table engine
2022-01-14 09:39:17 +03:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps
tests/stress: add core dumps into artifacts
2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
49fa1a1cd3
Add linter and checker for workflow files 2022-01-13 21:40:21 +01:00
Mikhail f. Shiryaev
55032a0286
Fix wrong variables in processing results 2022-01-13 21:36:34 +01:00
Mikhail f. Shiryaev
0edb80939f
Apply black to process_style_check_result.py 2022-01-13 20:59:36 +01:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master 2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI 2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
651b22f611
Add necessary MLIR dependency for codebrowser 2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
8779b6763d
Use architecture specific version of minio 2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
d1b14d5ee0
Use a library with proper architecture for mysql odbc 2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
7a369837c3
Improve integration tests image
- Order packages
- Add rpm2cpio package
- Clean cache
- Use apache CDN for zookeeper
2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
18a9aac61e
Use mysql-client-8.0 from ubuntu original repo 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
565e469b19
Don't build image for arm64 pvs-sturio 2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version 2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
624dfda931
Fix dpkg-deb architecture-dependent artifact 2022-01-12 17:07:51 +01:00
Anselmo D. Adams
f81dbfd09c
Update Dockerfile 2022-01-12 11:21:16 -03:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
BoloniniD
620f6ca8c1 Fix performance tests Dockerfile 2022-01-11 22:14:18 +03:00
BoloniniD
2dfdfa6720 Fix build tests Dockerfiles 2022-01-11 16:20:00 +03:00
BoloniniD
82027176f1 Move BLAKE3 tests away from fasttest + add USE_BLAKE3 key to CMakeLists 2022-01-10 23:12:33 +03:00
BoloniniD
a50530f061 Add cargo to fasttest + fixes 2022-01-10 23:12:32 +03:00
BoloniniD
fc5cd6dd83 Start BLAKE3 integration 2022-01-10 23:12:32 +03:00
alexey-milovidov
27dac209dc
Merge pull request #33368 from ClickHouse/dotnet-integration-test
Trying to merge #23230
2022-01-07 08:43:52 +03:00
Alexey Milovidov
adc577c52f Remove obsolete and unsupported Docker Builder #33345 2022-01-04 20:03:59 +03:00
Azat Khuzhin
ebed6193b4 tests/stress: add core dumps into artifacts
gcore is used here because:

- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
  and so to make it work you need to install apport into container and
  configure it propertly -- to complex

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log

- kernel.core_pattern cannot be changed, since proc is mounted in
  read-only mode in non --privileged containers [2]

  [2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log

v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
    in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Alexey Milovidov
2c7a8db58c Add test output and compare to reference 2022-01-03 03:36:23 +03:00
Alexey Milovidov
268842afa8 Add a comment 2022-01-03 03:07:25 +03:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
f1b6bc1074
Update docker_compose_dotnet_client.yml 2022-01-03 02:55:49 +03:00
alexey-milovidov
04a293a6ae
Update images.json 2022-01-03 02:55:30 +03:00
alexey-milovidov
7d52ba4576
Update Dockerfile 2022-01-03 02:54:43 +03:00
alexey-milovidov
817bb0ee6d
Update docker_compose_dotnet_client.yml 2022-01-03 02:46:08 +03:00
alexey-milovidov
57926cf366
Update Dockerfile 2022-01-03 02:45:46 +03:00
alexey-milovidov
3333c36df3
Update images.json 2022-01-03 02:45:20 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
alesapin
333dfab6a6 Add retries to AST fuzzer 2021-12-28 16:12:51 +03:00
taiyang-li
aa97634d9b merge master 2021-12-28 18:38:50 +08:00
peter279k
22b2d49d04 Add friendly message to notify user this instance 2021-12-28 09:42:49 +08:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
alesapin
118004015a Longer timeout for server start in fuzzer 2021-12-24 14:56:51 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test 2021-12-23 20:14:15 +03:00
alexey-milovidov
b248b69c3b
Merge pull request #32854 from ClickHouse/pvs-nproc
Use all available processors for checks
2021-12-23 08:00:12 +03:00
alesapin
bc03e5e10f
Merge pull request #32983 from ClickHouse/add_woboq_build
Trying to add woboq to new CI
2021-12-21 23:05:38 +03:00
Mikhail f. Shiryaev
1b623f6b71
Autodetect threads count for fast tests as half of CPUs 2021-12-21 15:43:09 +01:00
Mikhail f. Shiryaev
eefdeabff2
Delete code coverage image 2021-12-21 15:43:08 +01:00
Mikhail f. Shiryaev
b0e37b808e
Use all available processors for PVS sturio check 2021-12-21 15:43:04 +01:00
alesapin
a89a05c0da Finally woboq is ready 2021-12-21 14:16:21 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
alesapin
532b01c371 Followup 2021-12-21 10:49:22 +03:00
alesapin
62eb504029 Trying to add woboq 2021-12-20 22:43:37 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression
Improve gRPC compression support
2021-12-20 19:44:58 +03:00
Vitaly Baranov
708439b036 Support customized compression for input/output data in gRPC protocol. 2021-12-19 16:29:44 +03:00
alexey-milovidov
9c04901117
Merge pull request #32801 from ClickHouse/better_gdb_script
More diagnostics in gdb script
2021-12-19 08:00:12 +03:00
Azat Khuzhin
492fa98276 Add replxx/jemalloc into fasttest build of clickhouse
Both of the are pretty small, and so should not affect build time, but
will have additional bonus, since jemalloc is the production allocator
and replxx is just useful to use binary with completion (and later some
test can be enabled for fasttest with completion)
2021-12-17 22:09:05 +03:00
alesapin
d36f828b9c
Merge pull request #32910 from ClickHouse/performance_retry
More retries in perf tests.
2021-12-17 19:20:50 +03:00
alesapin
c2e8a73f14 Fix style 2021-12-17 16:43:58 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy
Add dockerhub proxy to CI
2021-12-17 14:31:50 +01:00
alesapin
1931726e15 Followup 2021-12-17 16:19:44 +03:00
alesapin
24480ac4de More agressive retries in perf tests 2021-12-17 16:16:35 +03:00
alesapin
47c907d41a Add dockerhub proxy 2021-12-17 13:20:48 +03:00
Vladimir C
fa011c66b7
Merge pull request #32846 from vdimir/flaky_test_s3_zero_copy_replication 2021-12-17 12:09:21 +03:00
vdimir
3f118f6734
Try fix flaky test: order for test_s3_zero_copy_replication 2021-12-17 12:08:39 +03:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
alexey-milovidov
e834d655a5
Merge pull request #32415 from ClickHouse/arm64_workers
Add arm64/aarch64 tests
2021-12-17 08:46:52 +03:00
Mikhail f. Shiryaev
d2d1f5aba7
Optimize binary packager container 2021-12-16 13:00:31 +01:00
Mikhail f. Shiryaev
91083bea21
Fix building of packager containers 2021-12-16 12:42:49 +01:00
Mikhail f. Shiryaev
eb5a26891f
Add aarch64 deb package 2021-12-16 12:42:49 +01:00
alesapin
c9b03eaf64
Update entrypoint.sh 2021-12-15 22:28:21 +03:00
alesapin
6f2543b943 Better fix 2021-12-15 18:50:11 +03:00
alesapin
6799ce2162 Add retries to curl 2021-12-15 18:46:40 +03:00
Alexander Tokmakov
bd5931e5af improve gdb script 2021-12-15 13:21:21 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2
Try to fix attaching gdb 2
2021-12-14 21:10:00 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests 2021-12-14 11:04:41 +00:00
taiyang-li
8234d1176f merge master 2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
alesapin
3eb5e42972 Trying to allow bigger timeout for prewarm 2021-12-13 18:09:29 +03:00
alesapin
8e1fec39cd Fix bash 2021-12-13 12:58:34 +03:00
alesapin
e2a2d1cdc3 Merge branch 'master' into add_performance_tests 2021-12-13 12:01:31 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
李扬
8675086104
Merge branch 'master' into hive_table 2021-12-12 09:01:46 -06:00
Azat Khuzhin
44f366fd12 Cleanup perf test runner
Use subshell to:
- avoid change/restore of TIMEFORMAT
- grepping out trace output, by using set +x in a subshell
- use array for options to avoid extra backslashes
2021-12-12 13:58:00 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
Azat Khuzhin
8a89b8e395 perf: do not fail in case of slow queries (to avoid hiding possible issues)
Do not stop processing pathologically slow queries,
since this may hide errors in other queries,
i.e. when the test failed on one of servers (upstream or from PR)
and someone interpret this is as OK with the following comment:

  "the failure was on the upstream server it is OK, PR should fix it"

Anyway there is almost zero such queries right now, and before merging
something this should be reviewed.
2021-12-12 00:15:25 +03:00
Azat Khuzhin
4e4837758a Remove readline support
- it was not nested for a long time
- replxx is an upstream way for completion
2021-12-11 11:29:59 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57 Code cleanup addressing PR remarks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
850c9a7e7a Reverting submodule changes to fast test docker and disabling Blob Storage support when files missing 2021-12-10 22:04:38 +01:00
Jakub Kuklis
37a23b402b Add missing dependencies for azure for fast test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
024a3b4626 Fixing submodule update for clickhouse compilation in the fast test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
alesapin
5a542516e6
Merge pull request #32515 from ClickHouse/revert-32514-revert-32496-smaller_checks
Revert "Revert "Split long tests into multiple checks""
2021-12-10 22:30:04 +03:00
Kseniia Sumarokova
2cd5a15193
Update docker_compose_mongo.yml 2021-12-10 22:02:28 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
Alexander Tokmakov
3ff8aff1b5 try to fix attaching gdb 2021-12-10 18:03:57 +03:00
kssenii
46356a34a3 Update pymongo 2021-12-10 14:58:17 +00:00
kssenii
b6b73ba5b2 pymongo 2021-12-10 14:54:55 +00:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
mergify[bot]
a07061ac84
Merge branch 'master' into update-mongo-contrb 2021-12-10 08:57:16 +00:00
alexey-milovidov
6ce2559078
Merge branch 'master' into feature/dotnet-integration-test 2021-12-10 01:25:47 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448)
* attach gdb with sudo

* fix

* Update run.sh
2021-12-10 00:12:45 +03:00