Mikhail f. Shiryaev
fdb88b75ec
Don't build integration tests on arm64 yet
2022-01-14 15:48:43 +01:00
Alexander Tokmakov
4dd216ce8f
Merge branch 'master' into mvcc_prototype
2022-01-14 17:11:32 +03:00
Mikhail f. Shiryaev
73f06421b1
Use automatic architecture for docker repo
2022-01-14 15:03:43 +01:00
Alexander Tokmakov
e1a41fc694
add system log for introspection
2022-01-14 17:03:00 +03:00
Mikhail f. Shiryaev
97e4151aff
Remove broken editing of /etc/hosts
2022-01-14 14:46:14 +01:00
Yatsishin Ilya
2fe8f6c60b
Fix ports allocated for mongo2 that is w/o creds
2022-01-14 13:00:38 +00:00
alesapin
d7a7926610
Update version to 22.1 not 21.13
2022-01-14 15:10:45 +03:00
alesapin
5257b413d4
Merge pull request #33612 from ClickHouse/workflow-linting
...
Add actionlint configuration and fix all issues
2022-01-14 11:41:48 +03:00
Kseniia Sumarokova
5da673c3a5
Merge pull request #31104 from bigo-sg/hive_table
...
Implement hive table engine
2022-01-14 09:39:17 +03:00
alexey-milovidov
438519aeec
Merge pull request #33389 from azat/stress-core-dumps
...
tests/stress: add core dumps into artifacts
2022-01-14 01:26:35 +03:00
Mikhail f. Shiryaev
49fa1a1cd3
Add linter and checker for workflow files
2022-01-13 21:40:21 +01:00
Mikhail f. Shiryaev
55032a0286
Fix wrong variables in processing results
2022-01-13 21:36:34 +01:00
Mikhail f. Shiryaev
0edb80939f
Apply black to process_style_check_result.py
2022-01-13 20:59:36 +01:00
Mikhail f. Shiryaev
c465593706
Force rebuild images once again in master
2022-01-13 19:03:34 +01:00
Mikhail f. Shiryaev
e314eed992
Force rebuild images in CI
2022-01-13 17:49:23 +01:00
Mikhail f. Shiryaev
651b22f611
Add necessary MLIR dependency for codebrowser
2022-01-12 17:07:58 +01:00
Mikhail f. Shiryaev
8779b6763d
Use architecture specific version of minio
2022-01-12 17:07:56 +01:00
Mikhail f. Shiryaev
d1b14d5ee0
Use a library with proper architecture for mysql odbc
2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
7a369837c3
Improve integration tests image
...
- Order packages
- Add rpm2cpio package
- Clean cache
- Use apache CDN for zookeeper
2022-01-12 17:07:54 +01:00
Mikhail f. Shiryaev
18a9aac61e
Use mysql-client-8.0 from ubuntu original repo
2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
565e469b19
Don't build image for arm64 pvs-sturio
2022-01-12 17:07:53 +01:00
Mikhail f. Shiryaev
2a83a1c05d
Build dependent images from the current version
2022-01-12 17:07:52 +01:00
Mikhail f. Shiryaev
624dfda931
Fix dpkg-deb architecture-dependent artifact
2022-01-12 17:07:51 +01:00
taiyang-li
66813a3aa9
merge master
2022-01-12 16:56:29 +08:00
Azat Khuzhin
ebed6193b4
tests/stress: add core dumps into artifacts
...
gcore is used here because:
- default kernel.core_pattern is "|/usr/share/apport/apport %p %s %c %d %P %E" [1]
and so to make it work you need to install apport into container and
configure it propertly -- to complex
[1]: https://s3.amazonaws.com/clickhouse-test-reports/33389/204e459d259570e6bc7fe2903f7e516094a916ca/stress_test__address__actions_/runlog.log
- kernel.core_pattern cannot be changed, since proc is mounted in
read-only mode in non --privileged containers [2]
[2]: https://s3.amazonaws.com/clickhouse-test-reports/33389/dab3afbd94558f9654bf0aa1e06e06e2962f3bb0/stress_test__address__actions_/runlog.log
v2: change kernel.core_pattern
v3: use gcore, since you are not allowed to change kernel.core_pattern
in container (only under --privileged)
2022-01-04 14:03:40 +03:00
Alexey Milovidov
2c7a8db58c
Add test output and compare to reference
2022-01-03 03:36:23 +03:00
Alexey Milovidov
268842afa8
Add a comment
2022-01-03 03:07:25 +03:00
Alexey Milovidov
c3ab18d1b0
Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test
2022-01-03 03:00:01 +03:00
alexey-milovidov
f1b6bc1074
Update docker_compose_dotnet_client.yml
2022-01-03 02:55:49 +03:00
alexey-milovidov
7d52ba4576
Update Dockerfile
2022-01-03 02:54:43 +03:00
alexey-milovidov
817bb0ee6d
Update docker_compose_dotnet_client.yml
2022-01-03 02:46:08 +03:00
alexey-milovidov
57926cf366
Update Dockerfile
2022-01-03 02:45:46 +03:00
taiyang-li
1e102bc1b2
merge master
2022-01-01 09:01:06 +08:00
alesapin
333dfab6a6
Add retries to AST fuzzer
2021-12-28 16:12:51 +03:00
taiyang-li
9036b18c2f
merge master
2021-12-27 15:12:48 +08:00
alesapin
118004015a
Longer timeout for server start in fuzzer
2021-12-24 14:56:51 +03:00
Kruglov Pavel
ffb6c5b37b
Merge branch 'master' into stress-test
2021-12-23 20:14:15 +03:00
alexey-milovidov
b248b69c3b
Merge pull request #32854 from ClickHouse/pvs-nproc
...
Use all available processors for checks
2021-12-23 08:00:12 +03:00
alesapin
bc03e5e10f
Merge pull request #32983 from ClickHouse/add_woboq_build
...
Trying to add woboq to new CI
2021-12-21 23:05:38 +03:00
Mikhail f. Shiryaev
1b623f6b71
Autodetect threads count for fast tests as half of CPUs
2021-12-21 15:43:09 +01:00
Mikhail f. Shiryaev
eefdeabff2
Delete code coverage image
2021-12-21 15:43:08 +01:00
Mikhail f. Shiryaev
b0e37b808e
Use all available processors for PVS sturio check
2021-12-21 15:43:04 +01:00
alesapin
a89a05c0da
Finally woboq is ready
2021-12-21 14:16:21 +03:00
taiyang-li
2597925724
merge master
2021-12-21 15:55:39 +08:00
alesapin
532b01c371
Followup
2021-12-21 10:49:22 +03:00
alesapin
62eb504029
Trying to add woboq
2021-12-20 22:43:37 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression
...
Improve gRPC compression support
2021-12-20 19:44:58 +03:00
Vitaly Baranov
708439b036
Support customized compression for input/output data in gRPC protocol.
2021-12-19 16:29:44 +03:00
alexey-milovidov
9c04901117
Merge pull request #32801 from ClickHouse/better_gdb_script
...
More diagnostics in gdb script
2021-12-19 08:00:12 +03:00
Azat Khuzhin
492fa98276
Add replxx/jemalloc into fasttest build of clickhouse
...
Both of the are pretty small, and so should not affect build time, but
will have additional bonus, since jemalloc is the production allocator
and replxx is just useful to use binary with completion (and later some
test can be enabled for fasttest with completion)
2021-12-17 22:09:05 +03:00
alesapin
d36f828b9c
Merge pull request #32910 from ClickHouse/performance_retry
...
More retries in perf tests.
2021-12-17 19:20:50 +03:00
alesapin
c2e8a73f14
Fix style
2021-12-17 16:43:58 +03:00
Mikhail f. Shiryaev
6f6b7c7bac
Merge pull request #32905 from ClickHouse/add_dockerhub_proxy
...
Add dockerhub proxy to CI
2021-12-17 14:31:50 +01:00
alesapin
1931726e15
Followup
2021-12-17 16:19:44 +03:00
alesapin
24480ac4de
More agressive retries in perf tests
2021-12-17 16:16:35 +03:00
alesapin
47c907d41a
Add dockerhub proxy
2021-12-17 13:20:48 +03:00
Vladimir C
fa011c66b7
Merge pull request #32846 from vdimir/flaky_test_s3_zero_copy_replication
2021-12-17 12:09:21 +03:00
vdimir
3f118f6734
Try fix flaky test: order for test_s3_zero_copy_replication
2021-12-17 12:08:39 +03:00
taiyang-li
d033fc4c24
merge master and fix conflict
2021-12-17 15:11:21 +08:00
alesapin
c9b03eaf64
Update entrypoint.sh
2021-12-15 22:28:21 +03:00
alesapin
6f2543b943
Better fix
2021-12-15 18:50:11 +03:00
alesapin
6799ce2162
Add retries to curl
2021-12-15 18:46:40 +03:00
Alexander Tokmakov
bd5931e5af
improve gdb script
2021-12-15 13:21:21 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2
...
Try to fix attaching gdb 2
2021-12-14 21:10:00 +03:00
mergify[bot]
68c96f4dd4
Merge branch 'master' into add_performance_tests
2021-12-14 11:04:41 +00:00
taiyang-li
8234d1176f
merge master
2021-12-14 10:39:21 +08:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
...
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
alesapin
3eb5e42972
Trying to allow bigger timeout for prewarm
2021-12-13 18:09:29 +03:00
alesapin
8e1fec39cd
Fix bash
2021-12-13 12:58:34 +03:00
alesapin
e2a2d1cdc3
Merge branch 'master' into add_performance_tests
2021-12-13 12:01:31 +03:00
alesapin
cf281b10dc
Split perf test into multiple checks
2021-12-13 11:59:58 +03:00
李扬
8675086104
Merge branch 'master' into hive_table
2021-12-12 09:01:46 -06:00
Azat Khuzhin
44f366fd12
Cleanup perf test runner
...
Use subshell to:
- avoid change/restore of TIMEFORMAT
- grepping out trace output, by using set +x in a subshell
- use array for options to avoid extra backslashes
2021-12-12 13:58:00 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests
2021-12-12 01:01:13 +03:00
Azat Khuzhin
8a89b8e395
perf: do not fail in case of slow queries (to avoid hiding possible issues)
...
Do not stop processing pathologically slow queries,
since this may hide errors in other queries,
i.e. when the test failed on one of servers (upstream or from PR)
and someone interpret this is as OK with the following comment:
"the failure was on the upstream server it is OK, PR should fix it"
Anyway there is almost zero such queries right now, and before merging
something this should be reviewed.
2021-12-12 00:15:25 +03:00
Azat Khuzhin
4e4837758a
Remove readline support
...
- it was not nested for a long time
- replxx is an upstream way for completion
2021-12-11 11:29:59 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
...
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Jakub Kuklis
e58f74d8dc
Connecting to Azurite and invoking simple INSERTs works in the integration test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c
Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker
2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57
Code cleanup addressing PR remarks
2021-12-10 22:04:38 +01:00
Jakub Kuklis
850c9a7e7a
Reverting submodule changes to fast test docker and disabling Blob Storage support when files missing
2021-12-10 22:04:38 +01:00
Jakub Kuklis
37a23b402b
Add missing dependencies for azure for fast test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
024a3b4626
Fixing submodule update for clickhouse compilation in the fast test
2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38
Running Azurite docker in the integration test for Blob Storage support
2021-12-10 22:04:37 +01:00
Alexander Tokmakov
dfa31a6577
fix
2021-12-10 22:38:34 +03:00
alesapin
5a542516e6
Merge pull request #32515 from ClickHouse/revert-32514-revert-32496-smaller_checks
...
Revert "Revert "Split long tests into multiple checks""
2021-12-10 22:30:04 +03:00
Kseniia Sumarokova
2cd5a15193
Update docker_compose_mongo.yml
2021-12-10 22:02:28 +03:00
tavplubix
5079134ffd
Update run.sh
2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59
fix
2021-12-10 20:07:28 +03:00
alesapin
84bccb83bd
Trying to add debug info
2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks""
2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks"
2021-12-10 18:38:42 +03:00
Alexander Tokmakov
3ff8aff1b5
try to fix attaching gdb
2021-12-10 18:03:57 +03:00
kssenii
46356a34a3
Update pymongo
2021-12-10 14:58:17 +00:00
kssenii
b6b73ba5b2
pymongo
2021-12-10 14:54:55 +00:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
...
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
f655b43f5a
Merge branch 'master' into add_performance_tests
2021-12-10 12:32:43 +03:00
alesapin
4c1babee05
Split long functional tests to multiple checks
2021-12-10 12:07:24 +03:00
mergify[bot]
a07061ac84
Merge branch 'master' into update-mongo-contrb
2021-12-10 08:57:16 +00:00
alexey-milovidov
6ce2559078
Merge branch 'master' into feature/dotnet-integration-test
2021-12-10 01:25:47 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests ( #32448 )
...
* attach gdb with sudo
* fix
* Update run.sh
2021-12-10 00:12:45 +03:00
Kseniia Sumarokova
f2dfa89bc9
Update docker_compose_mongo.yml
2021-12-09 23:58:46 +03:00
kssenii
f5a77fca39
Done
2021-12-09 14:44:25 +00:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda
...
Fix 'APPLY lambda' parsing
2021-12-09 17:09:11 +03:00
alesapin
89ac8da76e
Fix build path
2021-12-09 16:02:29 +03:00
tavplubix
f4cbbfd8c0
Update run-fuzzer.sh
2021-12-09 14:17:55 +03:00
tavplubix
de0a9a84a9
Update run-fuzzer.sh
2021-12-09 13:51:39 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas ( #29279 )
2021-12-09 13:39:28 +03:00
Kruglov Pavel
1df2383d00
Update run-fuzzer.sh
2021-12-09 12:17:31 +03:00
alesapin
b62de9b2f4
Merge branch 'master' into add_performance_tests
2021-12-09 11:40:32 +03:00
robot-clickhouse
f2ccddb7be
Auto version update to [21.13.1.1] [54458]
2021-12-09 00:33:01 +03:00
kssenii
b6c1d1e72e
Use latest version for tests
2021-12-08 21:09:11 +00:00
avogar
51bb37715f
Fix fuzzer
2021-12-08 21:29:50 +03:00
tavplubix
523e23cfcd
Merge pull request #32164 from azat/stress-ignore-mem-limit
...
Fix stress tests
2021-12-07 13:10:17 +03:00
Azat Khuzhin
f8bf3b1993
stress: use max_memory_usage_for_user as a soft limit to avoid memory limit exceeded
...
By using max_memory_usage_for_user as a soft limit, and after
max_server_memory_usage as a hard, we can allow normal overcommit, using
max_memory_usage_for_user=0 instead of relying on max_untracked_memory.
2021-12-06 09:05:34 +03:00
Azat Khuzhin
f9a95fce13
stress: allow memory overcommit for SELECT 1 query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
1167313961
stress: allow memory overcommit for one more query
2021-12-06 09:02:56 +03:00
Azat Khuzhin
7063ea3ee2
stress: add make_query_command() helper
2021-12-06 09:02:56 +03:00
Azat Khuzhin
adec690166
stress: SYSTEM DROP MARK CACHE
2021-12-06 09:02:56 +03:00
Azat Khuzhin
d3a7aed005
stress: tune memory_profiler_step too
2021-12-06 09:02:56 +03:00
Azat Khuzhin
169941c5d0
stress: allow 100MiB of memory to overcommit for SHOW/DROP DATABASE
...
CI: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__thread__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
445b0983ea
stress: ignore server memory limits for hung check
...
In [1] hung check failed because the server was under memory pressure.
[1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/b6290ae00223fc91d514b82de25e195ab34f8bca/stress_test__undefined__actions_.html
2021-12-06 09:02:56 +03:00
Azat Khuzhin
3e96b28843
perf: convert killall to pkill (since killall has some magic, see -e option)
2021-12-03 10:56:42 +03:00
Azat Khuzhin
fb0cc62509
perf: fix waiting of the server after running tests
...
killall requires strict match, i.e. "clickhouse-server" not
"clickhouse":
2021-12-03 05:24:56 + env kill -- -21700
2021-12-03 05:24:56 kill: (-21700): No such process
2021-12-03 05:24:56 + killall clickhouse
2021-12-03 05:24:56 clickhouse: no process found
2021-12-03 05:24:56 + echo Servers stopped.
2021-12-03 05:24:56 Servers stopped.
2021-12-03 05:24:56 + analyze_queries
$ tail -n1 *-server-log.log
==> left-server-log.log <==
2021.12.03 05:26:59.530647 [ 450 ] {} <Trace> SystemLog (system.asynchronous_metric_log): Flushed system log up to offset 1668052
==> right-server-log.log <==
2021.12.03 05:27:20.873136 [ 466 ] {} <Trace> SystemLog (system.metric_log): Flushed system log up to offset 9605
==> setup-server-log.log <==
2021.12.03 02:47:14.844395 [ 96 ] {} <Information> Application: Child process exited normally with code 0.
As you can see killall instantly fails with no such process, while this
cannot be true since it was there, and also according to logs there were
messages after running analyze_queries() from compare.sh
This should fix problems like in [1].
[1]: https://clickhouse-test-reports.s3.yandex.net/32080/344298f4037f88b114b8e798bb30036b24be8f16/performance_comparison/report.html#fail1
2021-12-03 10:55:35 +03:00
mergify[bot]
9c016d4e25
Merge branch 'master' into stress-test
2021-12-02 12:02:44 +00:00
taiyang-li
2f4e7e1d4e
merge master
2021-12-02 19:48:21 +08:00
Azat Khuzhin
e976cd8691
Provide clickhouse binary w/o debug symbols (stripped) in fasttest
...
- regular binary: 1.8G
- stripped: 343M (5x less)
- gzipped stripped: 92M (20x less)
This can be useful to check something fast.
2021-12-01 21:50:03 +03:00
mergify[bot]
b4f43c59a2
Merge branch 'master' into stress-test
2021-12-01 10:12:22 +00:00
alesapin
b4d4295c16
Followup
2021-11-30 13:24:04 +03:00
alesapin
085a30b98e
Fixup
2021-11-30 13:22:50 +03:00
alesapin
bccd927aec
Make stress tests slightly more stable
2021-11-30 13:19:03 +03:00
Raúl Marín
6a04dcb492
Remove libc-headers
2021-11-29 19:55:57 +01:00
Mikhail f. Shiryaev
e97e172dd8
Merge pull request #31822 from ClickHouse/rollback-28016
...
Rollback changes from #28016 : ru.archive.ubuntu.com
2021-11-29 10:27:59 +01:00
mergify[bot]
ae0b5df601
Merge branch 'master' into stress-test
2021-11-26 12:48:03 +00:00
Mikhail f. Shiryaev
5408d6232f
Make archive.ubuntu.com mirror configurable for build
2021-11-26 10:55:41 +01:00
alesapin
3562264404
Merge pull request #31803 from ClickHouse/faster_tests
...
Shorter stress and fuzzer tests
2021-11-26 10:17:26 +03:00
taiyang-li
d35e2a1c83
Merge branch 'master' into hive_table
2021-11-26 11:44:50 +08:00
alexey-milovidov
6b8f7ad03f
Merge pull request #31798 from ClickHouse/fix-31748
...
Fix stylecheck for tests/ci/push_to_artifactory.py
2021-11-26 00:11:32 +03:00
alexey-milovidov
6017b982d9
Merge pull request #31780 from Algunenano/fix_performance_report_queries
...
Improve how queries are output in the performance dashboard
2021-11-25 22:57:29 +03:00
alesapin
71ae890c59
Merge pull request #31544 from azat/ci-actions-fixes
...
Remove duplicated not compressed logs from CI (actions)
2021-11-25 18:43:44 +03:00
alesapin
5815429059
Shorter stress and fuzzer tests
2021-11-25 17:54:50 +03:00
Mikhail f. Shiryaev
16703c2824
Fix stylecheck for tests/ci/push_to_artifactory.py
2021-11-25 14:41:08 +01:00
alexey-milovidov
e8b29cab6e
Update report.py
2021-11-25 15:37:00 +03:00
mergify[bot]
ce0c112586
Merge branch 'master' into stress-test
2021-11-25 11:09:26 +00:00
Raúl Marín
a6c34fdbc9
Improve how queries are output in the performance dashboard
2021-11-25 11:22:47 +01:00
taiyang-li
72f60cceb9
Merge branch 'master' into hive_table
2021-11-25 17:33:26 +08:00
alesapin
c86b43c7ef
Merge pull request #31685 from ClickHouse/tavplubix-patch-5
...
Try fix OOMs with TSAN
2021-11-25 11:34:05 +03:00
alesapin
58fad90351
Merge branch 'master' into add_performance_tests
2021-11-25 10:53:10 +03:00
alesapin
cf2f019caa
Disable full run in perf tests
2021-11-24 23:05:27 +03:00
Alexey Milovidov
92031e6b31
Fix PVS-Studio
2021-11-24 20:25:11 +03:00
tavplubix
82e4f941a4
Update Dockerfile
2021-11-24 16:00:15 +03:00
tavplubix
556ccd0bc9
Update Dockerfile
2021-11-24 12:47:44 +03:00
taiyang-li
89dcef69d5
merge master
2021-11-24 14:38:04 +08:00
alexey-milovidov
61454ffbcb
Merge branch 'master' into hermetic-builds
2021-11-24 00:25:16 +03:00
alesapin
42c77323e8
Merge branch 'master' into add_performance_tests
2021-11-23 22:14:32 +03:00
Kruglov Pavel
18e60919c5
Update run.sh
2021-11-23 16:49:59 +03:00
alexey-milovidov
341f705419
Merge pull request #30599 from ClickHouse/zlib-ng-own-cmake
...
Use our own CMakeLists for `zlib-ng`, `cassandra`, `mariadb-connector-c` and `xz`, `re2`, `sentry`, `gsasl`, `arrow`, `protobuf`.
2021-11-23 13:33:29 +03:00
alesapin
2396f73e08
Fix performance tests comparison
2021-11-23 11:34:10 +03:00
alesapin
62b2eb6694
Merge branch 'master' into add_performance_tests
2021-11-23 11:26:45 +03:00
lgbo
996d7125c0
Merge branch 'master' into hive_table
2021-11-23 10:19:02 +08:00
Constantine Peresypkin
fd551ad94c
fix kerberized_hadoop image
...
current image uses non-existing centos6 repos
added direct fetch of actual rpm packages
fixed a typo in docker/images.json: duplicate entry
2021-11-22 17:32:19 +02:00
taiyang-li
d22854e82b
add compile swiych USE_HIVE
2021-11-22 10:52:10 +08:00
Alexey Milovidov
d604cf5573
Remove the infamous "unbundled" build
2021-11-21 13:58:26 +03:00
Azat Khuzhin
d0ecdb617e
Remove duplicated not compressed logs from CI (actions)
...
Right now we cannot remove that compression since non-github actions
check will upload non compressed files then, but once old CI will be
removed it seems to be possible to remove that manual compression.
2021-11-19 21:33:48 +03:00
alesapin
9e440988cf
Add datasets
2021-11-19 16:10:49 +03:00
taiyang-li
ab64a17104
fix fasttest
2021-11-19 16:20:14 +08:00
taiyang-li
e8644807fe
merge master and solve conflict
2021-11-19 15:01:58 +08:00
alesapin
130c09f348
Fix search for old version
2021-11-18 13:38:59 +03:00
lgbo-ustc
9902ccefc5
Add integration tests for hive query
2021-11-18 16:17:49 +08:00
alesapin
d0ec0c5dc8
Merge branch 'master' into add_performance_tests
2021-11-18 10:17:20 +03:00
alesapin
b74f9e7047
Merge branch 'master' into add_performance_tests
2021-11-18 10:12:46 +03:00
Nikolay Degterinsky
fc9ef14a73
Merge pull request #29219 from evillique/log_lz4_streaming
...
Add LZ4 stream compression of logs
2021-11-17 21:22:57 +03:00
Nikolay Degterinsky
eafd3ddfac
Add lz4 stream compression
2021-11-16 22:30:29 +00:00
tavplubix
b1079ae309
Update run.sh
2021-11-16 20:03:50 +03:00
mergify[bot]
923874060a
Merge branch 'master' into stress-test
2021-11-16 16:42:50 +00:00
tavplubix
224a4c1b6b
Update run.sh
2021-11-16 17:45:37 +03:00
alesapin
7f09941c72
Add performance comparison check
2021-11-16 14:16:10 +03:00
Kruglov Pavel
6180aedab6
Update download_previous_release
2021-11-15 23:16:35 +03:00
Kruglov Pavel
87df3c8272
Fix
2021-11-15 15:03:48 +03:00
alexey-milovidov
f4fda976ef
Merge pull request #31063 from azat/perf-spikes
...
perf: switch *_log tables to Memory engine (attempt to reduce cache misses)
2021-11-14 05:13:12 +03:00
Azat Khuzhin
48b1b7b7ec
Fix test_kafka_insert_avro by pinning avro version
...
New avro version has a code that does not allow to use BytesIO [1].
[1]: https://github.com/apache/avro/commit/e8c61ba4f0#diff-ca721cc66db80ff81dcd7b8ad1bb0e83b2e5c2de80c207ebec79f5495d38db98R318-R319
2021-11-13 12:01:13 +03:00
Azat Khuzhin
40be97c1dd
Improve fuzzer report in case of fuzzer killed
...
This will avoid Exception from fuzzer in description like in [1], that
someone may think that is related to the failure, which is obviously
don't in case it was KILLed.
[1]: https://clickhouse-test-reports.s3.yandex.net/31259/a49e10c78860a451ff9cc39df6049c88234d507a/fuzzer_ubsan/report.html#fail1
2021-11-12 01:01:10 +03:00
mergify[bot]
045bd40070
Merge branch 'master' into perf-spikes
2021-11-11 07:07:28 +00:00
taiyang-li
af78116c3f
Merge branch 'master' into hive_table
2021-11-11 11:52:28 +08:00
Kseniia Sumarokova
5f9b35b982
Update docker_compose_postgres.yml
2021-11-10 10:36:59 +03:00
taiyang-li
26988ab757
Merge branch 'master' into hive_table
2021-11-10 11:01:03 +08:00
Kruglov Pavel
08af98b4a1
Update download_previous_release
2021-11-09 16:34:13 +03:00
Kseniia Sumarokova
5eef7e0e45
Update docker_compose_postgres.yml
2021-11-09 15:13:01 +03:00
taiyang-li
5dbbe4b9c5
fix build error
2021-11-09 13:14:53 +08:00
Kruglov Pavel
03f1e3c67d
Update run.sh
2021-11-08 14:02:36 +03:00
Azat Khuzhin
9e622b5add
perf: switch *_log tables to Memory engine (attempt to reduce cache misses)
...
trace_log/query_log from performance tests shows (for
cases when prewarm query fails with timeout, 15sec) excessive
writeTraceInfo() in trace_log and QueryProfilerRuns in query_log, but
this is not the root cause of the timeout, but consequence.
Also query_log shows that on failures the following profile events has
significantly higher values:
- PerfLocalMemoryMisses (6.3x more)
- PerfLocalMemoryReferences (7x more)
- PerfDataTLBMisses (6.9x more)
- PerfInstructionTLBMisses (6.4x more)
During looking at performance tests logs I noticed that once the prewarm
query fails other server (left/right) was merging (MergeTree) something
in *_log tables.
But, using MergeTree for *_log in performance tests is useless, since
anyway environment for performance tests uses ramdrive.
And so MergeTree merges just increase overhead.
Eventually I expect that this should decrease extra memory referencing
and so this should decrease cache/TLB misses.
CI: https://clickhouse-test-reports.s3.yandex.net/30886/c504e0c08df7a926bb479a1d297f326f5c48a32f/performance_comparison/report.html#fail1
v2: <partition_by remove="remove"/>
2021-11-04 09:26:46 +03:00
mergify[bot]
8ef9e61e36
Merge branch 'master' into stress-test
2021-11-03 08:28:43 +00:00
Azat Khuzhin
ff19d22305
perf: remove over *_log tables that does not exported into artifacts
2021-11-03 08:29:18 +03:00
Azat Khuzhin
837fe8554f
perf: remove zookeeper to avoid configuring DDLWorker
2021-11-03 08:29:18 +03:00
Azat Khuzhin
acef85b17d
perf: cleanup server overrides
2021-11-03 08:29:18 +03:00
Azat Khuzhin
afd960db4e
perf: remove redundant query profiler set queries
2021-11-03 08:09:43 +03:00
robot-clickhouse
4289336c27
Auto version update to [21.12.1.1] [54457]
2021-11-02 00:56:45 +03:00
Kruglov Pavel
9a1275cb10
Merge pull request #30178 from Avogar/tsv-csv
...
Refactor and improve TSV, CSV, JSONCompactEachRow, RowBinary formats. Fix bugs in formats
2021-11-02 00:38:30 +03:00
alesapin
dbfa17aabf
Add correct S3
2021-11-01 13:32:56 +03:00
avogar
4e63311bb6
Try fix perf test
2021-11-01 12:13:29 +03:00
