Commit Graph

2491 Commits

Author SHA1 Message Date
vdimir
6f8561c084
Support jijna templates for sql files in clickhouse-test 2021-07-20 16:40:04 +03:00
Nikolai Kochetov
e0c5dc1449
Update entrypoint.sh 2021-07-20 16:10:29 +03:00
Nikolai Kochetov
4df50d3490
Update entrypoint.sh 2021-07-20 15:02:20 +03:00
vdimir
6dab3625ff
Handle empty testset in 'Functional stateless tests flaky check' 2021-07-20 12:29:21 +03:00
Ilya Yatsishin
c0e42d3ae1
Merge pull request #26375 from qoega/integration-6 2021-07-20 09:03:48 +03:00
Ky Li
9abd7e543c
Update entrypoint.sh
We build clickhouse cluster in k8s by clickhouse-operator. 
clickhouse-server.log is mounted by emptydir on the path `/var/log/clickhouse-server`.
It causes the file system error called `Necessary directory '/var/log/clickhouse-server' isn't owned by user with id '101' `  when  CLICKHOUSE_DO_NOT_CHOWN is set to true(1).
Because emptydir file and dir is owned by root when it started, it has to do the chown cmd.
But it will take a long time to run chown cmd when the cluster has much data (in table data dir), the cluster cannot even restart because of  `initialDelaySeconds`
So chown operation is necessary to check if the file owner and group is owned by user 101.
2021-07-20 12:16:51 +08:00
alesapin
7b10c06113
Merge pull request #26497 from vdimir/docker-fasttest-build
Update link to dpkg-deb in dockerfiles
2021-07-19 21:19:32 +03:00
vdimir
23423524c5
Update path to apache-arrow deb package in unbundled/Dockerfile
See 'Linux packages notes' https://arrow.apache.org/blog/2021/05/03/4.0.0-release/
2021-07-19 16:04:42 +03:00
vdimir
22d545133a
Update link to dpkg-deb in dockerfiles 2021-07-19 12:49:19 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Alexey Milovidov
da94ed8a87 Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-18 01:12:24 +03:00
Alexey Milovidov
9bef9d4f2d Revert "Auto version update to [21.10.1.1] [54455]"
This reverts commit f2b1395127.
2021-07-17 13:17:30 +03:00
alexey-milovidov
659fc2a8e2
Merge pull request #26393 from azat/stress-improvements
stress tests report improvements
2021-07-17 13:00:09 +03:00
robot-clickhouse
f2b1395127 Auto version update to [21.10.1.1] [54455] 2021-07-17 08:45:10 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alexey-milovidov
c73f13be93
Merge pull request #26294 from arenadata/ADQM-325
yandex/clickhouse-test-base Dockerfile fix (mysql connector moved)
2021-07-14 15:37:00 +03:00
Alexander Tokmakov
f0ed6be269 Merge branch 'master' into system_zookeeper_log 2021-07-13 20:49:37 +03:00
Ilya Golshtein
d7777c6127 yandex/clickhouse-test-base Dockerfile fix (mysql connector moved) 2021-07-13 18:49:03 +03:00
Nikita Mikhaylov
3679a14214 update fast test 2021-07-13 10:51:34 +00:00
Nikita Mikhaylov
8062b492c5 added tests to skip list 2021-07-13 10:51:08 +00:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
kssenii
d6967dbd2b Update test 2021-07-11 19:10:52 +00:00
kssenii
40281f9283 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into g-arslan-add-sqlite-support 2021-07-10 06:50:46 +00:00
robot-clickhouse
8ae8b26954 Auto version update to [21.9.1.1] [54454] 2021-07-10 08:22:52 +03:00
kssenii
46e9e21419 Fix build 2021-07-09 15:47:57 +00:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
alesapin
870f7eb716
Update Dockerfile 2021-07-08 15:33:12 +03:00
Nikolay Degterinsky
87eb76d51e Fix unbundled build 2021-07-08 12:16:53 +00:00
Vitaliy Zakaznikov
40a2fc8a18 Trying to fix collection of clickhouser server logs for TestFlows check. 2021-07-07 21:45:29 -04:00
alexey-milovidov
dfd9e1d737
Merge pull request #26011 from vzakaznikov/fix_and_enable_testflows_tests
Enabling all TestFlows modules and fixing some tests.
2021-07-07 22:46:25 +03:00
Vitaliy Zakaznikov
7f292c6006 Changing output back to new fails only. 2021-07-07 12:02:50 -04:00
alesapin
aa86fac4e7 Fix unbundled build 2021-07-07 14:07:20 +03:00
alesapin
f0fc12d0dd Merge branch 'master' into evillique-nlp 2021-07-07 12:14:49 +03:00
alexey-milovidov
80eaf85301
Merge pull request #24416 from elevankoff/system-metrics
Common system metrics collection
2021-07-07 03:21:49 +03:00
Vitaliy Zakaznikov
89f89e33d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_and_enable_testflows_tests 2021-07-06 14:42:46 -04:00
Vitaliy Zakaznikov
d32d8ceff6 Changing TestFlows output to use classic mode instead of just new fails. 2021-07-06 06:58:16 -04:00
Alexey Milovidov
7ae15fee31 Change performance test after adjusted the name of column 2021-07-05 22:08:29 +03:00
Maksim Kita
577e69898a Compile aggregate functions perf tests fix 2021-07-05 12:17:01 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Alexey Milovidov
e80a700cff More direct way to start ClickHouse 2021-07-04 02:13:32 +03:00
Alexey Milovidov
127455f15f Remove experimental ANTLR parser 2021-07-03 18:48:03 +03:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
mergify[bot]
892c67891a
Merge branch 'master' into fix-receive-time-metric 2021-07-01 21:40:09 +00:00
Maksim Kita
22491c8adc Compile AggregateFunctionCount 2021-07-01 22:56:36 +03:00
Azat Khuzhin
a471ebdabe Fix performance tests after converting ProfileEvents to Map type 2021-06-30 21:00:36 +03:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
alesapin
cdc95fa98a
Merge pull request #25428 from ClickHouse/zookeeper_snapshots
Tool for conversion of ZooKeeper data into clickhouse-keeper snapshot
2021-06-29 12:58:45 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
Maksim Kita
a020d58359
Merge pull request #25804 from ClickHouse/configs-are-not-necessary-for-clickhouse-binary-to-run
Edited bare Linux example: configs are not necessary for clickhouse binary to run
2021-06-29 10:41:29 +03:00
Alexey Milovidov
ed3d5d8d16 Edited bare Linux example: configs are not necessary for clickhouse binary to run 2021-06-29 04:28:42 +03:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge
Merging #23934
2021-06-29 04:19:53 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
mergify[bot]
04814114e7
Merge branch 'master' into zookeeper_snapshots 2021-06-28 14:17:32 +00:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
Maksim Kita
352e1f27ff Update using Map datatyle in system log tables before merge 2021-06-28 14:42:21 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
robot-clickhouse
648801760e Auto version update to [21.8.1.1] [54453] 2021-06-28 00:50:20 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00
kssenii
aa7133c239 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-27 20:08:00 +00:00
Alexey Milovidov
b11f9223de Merge branch 'master' into fix-receive-time-metric 2021-06-27 19:00:39 +03:00
Alexey Milovidov
45c4b62c3b Separate log files for separate runs in stress test 2021-06-27 18:41:25 +03:00
Alexey Milovidov
ebc2fbfd63 Performance test: be more generous 2021-06-27 03:14:42 +03:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560)
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
2021-06-25 18:21:56 +03:00
Alexey Milovidov
3ef23c4e22 Add pv to the test image 2021-06-24 00:33:22 +03:00
Alexey Milovidov
d3d3c4b686 Adjust fast test 2021-06-23 00:31:40 +03:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
9e77ca7182
Merge branch 'master' into nlp 2021-06-17 21:47:41 +03:00
Alexey Milovidov
7aacca94e3 Fix error in Fuzzer (CC @akuzm) 2021-06-17 09:16:34 +03:00
Alexander Tokmakov
c235539620 minor fixes 2021-06-17 00:20:35 +03:00
tavplubix
710546b9e8
Merge branch 'master' into improve_replicated_database_tests 2021-06-16 13:24:32 +03:00
Alexey Milovidov
779f5eca94 Relax max test time for performance test; fix comment 2021-06-16 11:26:00 +03:00
Alexander Tokmakov
c873714698 improve replicated database tests 2021-06-15 23:52:29 +03:00
Alexey Milovidov
19f8f0241d Fix strange typo 2021-06-14 04:11:16 +03:00
kssenii
603c06d02e Add test 2021-06-13 19:38:17 +00:00
alexey-milovidov
a293979353
Merge pull request #25210 from ClickHouse/database_replicated_tests_parallel
Try run tests with Replicated database in parallel
2021-06-13 16:40:21 +03:00
alexey-milovidov
16114c38c7
Merge pull request #24875 from ClickHouse/fix_woboq_build
Trying to resurrect woboq
2021-06-12 03:18:37 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries
Remove explicit enable_dictionaries files in integration tests
2021-06-12 02:45:25 +03:00
tavplubix
2a6b4a64f4
Merge pull request #25200 from vdimir/join-opts-stress-test
Add join related options to stress test
2021-06-12 00:03:41 +03:00
Alexander Tokmakov
9d8ebd5782 run tests with Replicated database in parallel 2021-06-11 15:28:27 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress 2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test 2021-06-11 12:36:59 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
alexey-milovidov
521284fc51
Merge pull request #25133 from vzakaznikov/trying_to_fix_docker_pull_error_in_testflows
Fix using Yandex dockerhub registries for TestFlows.
2021-06-10 01:59:00 +03:00
Alexander Kuzmenkov
c0e6aa97a6
Merge pull request #24734 from ClickHouse/aku/frame-expressions
support expressions in window frame
2021-06-10 00:25:32 +03:00
Alexander Kuzmenkov
22d3e40f89
Merge pull request #24938 from ClickHouse/aku/perf-test
some perf test script improvements
2021-06-10 00:23:04 +03:00
Vitaliy Zakaznikov
06a3fe99e4 Fix using Yandex dockerhub registries for TestFlows. 2021-06-09 12:19:40 -04:00
Alexander Kuzmenkov
f9f5b7945e
fix shellcheck 2021-06-09 14:40:38 +03:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Alexander Kuzmenkov
f4d7baaaff Merge remote-tracking branch 'origin/aku/perf-test' into HEAD 2021-06-08 18:10:19 +03:00
Alexander Kuzmenkov
07fceb667e fix 2021-06-08 17:12:47 +03:00
Ivan Lezhankin
82c78ba833 Update Dockerfile 2021-06-08 15:01:16 +03:00
alesapin
fba2d66042 Disable storage_kerberized_hdfs test 2021-06-07 12:25:13 +03:00
Nikolay Degterinsky
2053d8aa94 added submodules to fasttest 2021-06-06 22:55:57 +00:00
mergify[bot]
8e21c8edb3
Merge branch 'master' into aku/perf-test 2021-06-06 09:58:31 +00:00
alexey-milovidov
cd2ca76b24
Update compare.sh 2021-06-06 12:57:18 +03:00
Alexander Kuzmenkov
1c5e069d0d fixes 2021-06-04 18:27:21 +03:00
Nikita Mikhaylov
f1733a93e5
Merge pull request #24857 from kssenii/postgresql_protocol
Fix NULL values in postgresql protocol
2021-06-04 14:43:47 +03:00
filimonov
4766576a28
Fix error message to include file path 2021-06-04 10:00:01 +02:00
kssenii
e23bc14582 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-03 19:44:55 +00:00
Alexander Kuzmenkov
8554cb621e some perf test script improvements 2021-06-03 20:40:05 +03:00
alesapin
aeac53ac78 Update run script 2021-06-03 18:16:12 +03:00
alesapin
329380d6e5 Relaxed hung check in stress test 2021-06-03 18:13:29 +03:00
Ilya Yatsishin
e9fb162f65
Update Dockerfile 2021-06-03 16:05:12 +03:00
Yatsishin Ilya
46023c4b99 merge remote-tracking branch 'origin' into try-llvm-12 2021-06-03 15:32:22 +03:00
Alexander Kuzmenkov
23e66243e7 more fuzzer fixes... 2021-06-02 21:45:07 +03:00
Alexander Kuzmenkov
34509b26ba another fuzzer fix 2021-06-02 18:57:01 +03:00
Yatsishin Ilya
6efcbdc5b9 Merge remote-tracking branch 'origin' into integration-2 2021-06-02 18:08:31 +03:00
Alexander Kuzmenkov
ae79bbea7d Merge remote-tracking branch 'origin/master' into HEAD 2021-06-02 15:06:22 +03:00
Alexander Kuzmenkov
78fe7891b4 better messages in fuzzer status 2021-06-02 15:06:12 +03:00
alesapin
56951e2d61 Trying to resurrect woboq 2021-06-02 13:22:37 +03:00
mergify[bot]
e64fcab0bf
Merge branch 'master' into fix_stress_test 2021-06-01 19:07:27 +00:00
Ilya Yatsishin
8893f07b29
Touch to rebuild 2021-06-01 20:58:33 +03:00
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
kssenii
ccf5455624 Allow null values in postgresql protocol 2021-06-01 15:00:32 +00:00
alesapin
82c90ebc05 Some improvements in stress test 2021-06-01 12:45:01 +03:00
Yatsishin Ilya
cae1180f76 Merge remote-tracking branch 'origin' into integration-2 2021-05-31 18:45:48 +03:00
Ilya Yatsishin
2672d18da0
Touch to rebuild SQLancer 2021-05-31 12:41:36 +03:00
Yatsishin Ilya
b683f71ae6 Merge remote-tracking branch 'origin' into integration-2 2021-05-31 07:03:27 +03:00
Alexander Kuzmenkov
104f9bf6de Merge remote-tracking branch 'origin/master' into HEAD 2021-05-29 16:12:34 +03:00
Alexander Kuzmenkov
73c2ca7da5 fixes 2021-05-29 16:12:18 +03:00
Alexander Kuzmenkov
2116d0d53d
Update run-fuzzer.sh 2021-05-29 01:57:16 +03:00
Alexander Kuzmenkov
d33480ce84 fix failing grep 2021-05-28 20:47:06 +03:00
Alexander Kuzmenkov
1f1a77438b more fuzzer fixes 2021-05-28 15:55:58 +03:00
Alexander Kuzmenkov
d6afb55d87
Merge pull request #24584 from ClickHouse/aku/fuzzer-death
ast fuzzer: determine server death more robustly
2021-05-28 13:05:59 +03:00
Alexander Kuzmenkov
81d9c9ee30
Update docker/test/fuzzer/run-fuzzer.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-05-28 13:05:02 +03:00
Nikita Mikhaylov
c127c433c2 better 2021-05-27 23:43:00 +03:00
Alexander Kuzmenkov
ee71db564a ast fuzzer: determine server death more robustly 2021-05-27 21:26:47 +03:00
Yatsishin Ilya
438abac5fe Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-27 17:12:16 +03:00
Yatsishin Ilya
7d2f701e0a Merge remote-tracking branch 'origin/master' into integration-2 2021-05-27 16:34:30 +03:00
Alexander Kuzmenkov
5dc387d3bc
Merge pull request #24534 from ClickHouse/aku/green-check-mining-1
calculate perf test precision thresholds from historical data
2021-05-27 12:59:17 +03:00
alexey-milovidov
a7e95b4ee2
Merge pull request #24504 from vzakaznikov/testflows_check_add_saving_clickhouse_logs
Adding support to save clickhouse server logs in TestFlows check
2021-05-27 08:05:55 +03:00
Yatsishin Ilya
28af06f3d0 Merge remote-tracking branch 'origin' into integration-2 2021-05-27 07:01:22 +03:00
Vitaliy Zakaznikov
ba1c118f27 * Changing default testflows output format to be new fails only
* Removing debug changes
* Fixing folder structure inside clickhouse_logs.tar.gz archive
2021-05-26 18:28:47 -04:00
kssenii
e56b10f07c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-26 21:55:10 +00:00
Vitaliy Zakaznikov
7800f934ab Adding gzip compression of clickhouse logs. 2021-05-26 17:16:24 -04:00
Vitaliy Zakaznikov
774171c61c Another try to move clickhouse logs to /test_output folder. 2021-05-26 16:25:23 -04:00
Vitaliy Zakaznikov
3fb4ba3885 Fixing the way we move clickhouse logs to the /test_output folder. 2021-05-26 14:11:56 -04:00
Alexander Kuzmenkov
5da54c2745 calculate perf test precision thresholds from historical data 2021-05-26 16:30:43 +03:00
Vitaliy Zakaznikov
20687d540a Small change to re-trigger CI/CD pipeline. 2021-05-26 08:54:55 -04:00
Yatsishin Ilya
7659731e39 Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-26 14:38:18 +03:00
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
Ilya Yatsishin
1d5522af62
Merge pull request #24512 from qoega/shellcheck-fix
shellcheck fix
2021-05-26 09:43:33 +03:00
mergify[bot]
86f4e3aeaf
Merge branch 'master' into testflows_check_add_saving_clickhouse_logs 2021-05-26 06:34:10 +00:00
Yatsishin Ilya
d34bc32224 Merge remote-tracking branch 'origin' into integration-2 2021-05-26 07:38:43 +03:00
Yatsishin Ilya
3badb2afc9 shellcheck fix 2021-05-26 07:34:19 +03:00
Ilya Yatsishin
a05057ec6d
Merge pull request #24492 from qoega/integration-rm-in-entrypoint 2021-05-26 07:31:19 +03:00
Vitaliy Zakaznikov
e8d74250bf Trying another approach to copy logs to /test_output without sudo. 2021-05-25 21:34:46 -04:00
Vitaliy Zakaznikov
9dd9f221c1 Trying another fix to copy clickhouse logs to /test_output directory. 2021-05-25 21:29:43 -04:00
Vitaliy Zakaznikov
bcdb5a614a Fixing copying of clickhouse logs into /test_output directory for TestFlows check. 2021-05-25 20:07:54 -04:00
Vitaliy Zakaznikov
f6c47b6a0a Adding support to save clickhouse server logs in TestFlows check. 2021-05-25 17:45:10 -04:00
Maksim Kita
315994f686
Merge pull request #24442 from kitaisreal/actions-dag-compile-expressions-update
ActionsDAG compile expressions update
2021-05-25 21:44:23 +03:00
Yatsishin Ilya
0ca1ce8ab3 shellcheck fix 2021-05-25 19:55:53 +03:00
Yatsishin Ilya
0e83723eaa Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-25 15:53:21 +03:00
Yatsishin Ilya
1a97db544d rm containers in entrypooint 2021-05-25 15:30:20 +03:00
Yatsishin Ilya
10372b12b7 rm containers in entrypooint 2021-05-25 15:29:22 +03:00
Maksim Kita
ba43fe784c Updated tests 2021-05-25 11:50:40 +03:00
kssenii
cef509e5b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-24 17:39:34 +00:00
Yatsishin Ilya
2b02689213 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 18:31:21 +03:00
Alexander Kuzmenkov
f227020018
Merge pull request #24049 from ClickHouse/aku/perf-unstable
complain about unstable perf test queries
2021-05-24 12:59:12 +03:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
Yatsishin Ilya
d73d92ed7e revert some changes 2021-05-21 18:48:14 +03:00
Yatsishin Ilya
fe630a0139 Merge remote-tracking branch 'origin/master' into integration-2 2021-05-21 17:57:44 +03:00
Yatsishin Ilya
a2e107c0be Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-21 17:42:08 +03:00
Yatsishin Ilya
c6c180c35d fix shellcheck 2021-05-21 17:33:56 +03:00
Yatsishin Ilya
daf0b5ad2b rewrite zookeeper test 2021-05-21 16:29:43 +03:00
robot-clickhouse
471142043f Auto version update to [21.7.1.1] [54452] 2021-05-20 22:23:34 +03:00
Yatsishin Ilya
d07b3763ef Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:20 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
Alexander Kuzmenkov
1b0bcfe022 remove retries from fast test 2021-05-20 15:31:56 +03:00
Alexander Kuzmenkov
a1749cf5c3 fix 2021-05-20 15:05:20 +03:00
Alexander Kuzmenkov
0176aa1878 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-20 14:44:01 +03:00
Maksim Kita
25fe0e88f8 Compile expressions added partition by test 2021-05-20 11:16:15 +03:00
Alexander Kuzmenkov
6afd9f84f1 longer 2021-05-19 13:25:43 +03:00
alesapin
31181095e7 Review fixes 2021-05-18 17:08:56 +03:00
Yatsishin Ilya
3c804556fb fix 2021-05-18 14:02:23 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
kssenii
8a4711b716 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-16 20:55:18 +00:00
Alexander Kuzmenkov
91835369cf fixup 2021-05-15 09:44:14 +03:00
Alexander Kuzmenkov
7719c1d933 collect profiles during warmup 2021-05-15 09:43:56 +03:00
alesapin
18bf681a83 Fix pull 2021-05-14 18:35:30 +03:00
Yatsishin Ilya
ad706b0de4 Merge remote-tracking branch 'origin' into integration-2 2021-05-14 16:48:44 +03:00
alesapin
123715300a Use keeper in integration tests 2021-05-14 15:30:49 +03:00
Alexander Kuzmenkov
15564f32b2 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-14 13:16:31 +03:00
alesapin
f8ddf511c5 Merge branch 'master' into standalone_keeper 2021-05-14 13:05:55 +03:00
alexey-milovidov
f5e0189215
Merge pull request #23942 from vzakaznikov/testflows_modules_in_parallel
Enabling running of all TestFlows modules in parallel
2021-05-13 21:49:16 +03:00
Yatsishin Ilya
10b8587533 Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-13 14:13:56 +03:00
Yatsishin Ilya
783e9b3c1c more 2021-05-13 14:13:37 +03:00
Alexander Kuzmenkov
3e5f85ddd3 run short queries longer 2021-05-13 12:20:02 +03:00
Alexander Kuzmenkov
3aa919b498 fixes 2021-05-13 12:16:43 +03:00
alesapin
bfa23d7e02 Merge branch 'master' into standalone_keeper 2021-05-13 11:03:07 +03:00
Alexander Kuzmenkov
d7b726045a fixes 2021-05-13 01:32:53 +03:00
alesapin
dc55d19709 Fix fasttest image 2021-05-12 23:00:28 +03:00
Yatsishin Ilya
366a7fe45b linker path required to be specific one 2021-05-12 18:24:27 +03:00
kssenii
0955e5f0be Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-12 15:11:15 +00:00
Yatsishin Ilya
d3b59509b9 Merge remote-tracking branch 'origin' into try-llvm-12 2021-05-12 14:31:58 +03:00
Alexander Kuzmenkov
8629b29083 complain about unstable perf test queries
We don't want to introduce more of them. The old ones should be all marked by now.
2021-05-12 12:48:13 +03:00
Maksim Kita
d78c1f11d0 Performance tests disable compile expressions 2021-05-12 11:06:10 +03:00
Yatsishin Ilya
fe0194aa4b s3 catch up 2021-05-12 10:03:53 +03:00
Vitaliy Zakaznikov
9c2b30f9fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-11 17:17:53 -04:00
Yatsishin Ilya
9d159072ef mERGe remote-tracking branch 'origin' into integration-2 2021-05-11 13:32:44 +03:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again
Add uniqThetaSketch again
2021-05-11 11:24:43 +03:00
Vitaliy Zakaznikov
7a4ab5790e Fixing TestFlows docker file. 2021-05-10 18:20:46 -04:00
Vitaliy Zakaznikov
bce80f1256 Updating docker and docker-compose versions.
Updating and enabling datetime64 extended range tests.
2021-05-10 16:59:47 -04:00
Vitaliy Zakaznikov
d4cead19f4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:12:00 -04:00
Vitaliy Zakaznikov
c0a4770ee7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:11:48 -04:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
Vitaliy Zakaznikov
f04e077081 Updating TestFlows to 1.6.90 2021-05-10 13:02:13 -04:00
kssenii
993823bcc4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-09 21:26:41 +00:00
alexey-milovidov
a34c927fb2
Merge branch 'master' into tests_dt64_ext 2021-05-08 23:29:18 +03:00
alexey-milovidov
99dadfe3c4
Update run.sh 2021-05-08 22:53:07 +03:00
Maksim Kita
2a630b68a4 Fixed FunctionComparison with special edge case 2021-05-08 21:04:21 +03:00
Maksim Kita
6dc0dcdfa4 Fixed code review issues 2021-05-08 17:39:35 +03:00
Maksim Kita
e58e956092 Enable llvm in fast test 2021-05-08 17:39:34 +03:00
Maksim Kita
5792a2533f Enable compile_expressions in fuzzer 2021-05-08 17:39:34 +03:00
Vitaliy Zakaznikov
c8224636af Moving TestFlows version to 1.6.83 2021-05-07 18:24:35 -04:00
Vitaliy Zakaznikov
b64d0676ea Moving to TestFlows 1.6.82 2021-05-07 17:56:14 -04:00
hexiaoting
a1d521902c Merge remote-tracking branch 'origin/master' into dev-continue-sundyli 2021-05-07 14:22:53 +08:00
pingyu
46f809d07f Revert "Merge pull request #23334 from ClickHouse/revert-22609-datasketches-uniq"
This reverts commit af2499359b, reversing
changes made to db82e9e3d5.
2021-05-05 16:42:57 +08:00
Maksim Kita
bc6de947fb gcc-10 installation no-install-reccomends option fix 2021-05-01 16:17:42 +03:00
alexey-milovidov
f360e7c808
Merge pull request #23766 from kitaisreal/remove-unused-compilers
Remove unused compilers (fixed for the troublesome "unbundled" build)
2021-05-01 16:15:38 +03:00
kssenii
7643d84095 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-30 22:02:51 +00:00
Maksim Kita
939b940c29
Update Dockerfile 2021-05-01 00:47:34 +03:00
alexey-milovidov
7fa24d7b26
Merge pull request #23664 from azat/msan-dtor
Enable use-after-destruction detection in MSan
2021-04-30 21:51:28 +03:00
Yatsishin Ilya
a4e6a96c82 fasttest change 2021-04-30 19:02:23 +03:00
Maksim Kita
ecb05a5f40
Update Dockerfile 2021-04-30 17:36:05 +03:00
filimonov
66eaf210a0
Update Dockerfile 2021-04-30 15:29:40 +02:00
filimonov
87e5aa8c2b
autodetect arch of gosu in server dockerfile 2021-04-30 15:27:31 +02:00
Yatsishin Ilya
fddc72fb49 fixes 2021-04-30 15:22:37 +03:00
Yatsishin Ilya
aabf5307c4 more 2021-04-30 13:26:13 +03:00
Yatsishin Ilya
e523162eda Merge remote-tracking branch 'origin' into try-llvm-12 2021-04-30 13:11:18 +03:00
Yatsishin Ilya
744fb93945 Merge remote-tracking branch 'origin' into integration-2 2021-04-30 12:18:24 +03:00
alexey-milovidov
fab763f8fa
Revert "Fix CI build for gcc-10" 2021-04-29 20:43:08 +03:00
Maksim Kita
26068a4d28 Updated llvm.cmake 2021-04-29 20:10:01 +03:00
Yatsishin Ilya
a6c7e03aba merge remote-tracking branch 'origin' into integration-2 2021-04-29 17:30:54 +03:00
Maksim Kita
140a289f8e Remove unused compilers 2021-04-29 17:00:38 +03:00
Maksim Kita
5b4d2006aa Fix CI build for gcc-10 2021-04-29 14:29:55 +03:00
Azat Khuzhin
d83ea5844f Enable use-after-destruction detection in MSan
Refs: https://clang.llvm.org/docs/MemorySanitizer.html#use-after-destruction-detection
2021-04-28 23:02:52 +03:00
Maksim Kita
9bf96a278d
Merge pull request #23711 from ClickHouse/remove-old-compilers
Remove obsolete compilers
2021-04-28 22:51:21 +03:00
Yatsishin Ilya
a87fe5e1bc Merge remote-tracking branch 'origin' into integration-2 2021-04-28 17:23:33 +03:00
Ilya Yatsishin
8e67cab2a3
Merge pull request #23138 from qoega/add-dockerproxy-to-runner
Add dockerhub-proxy to runner
2021-04-28 17:10:28 +03:00
Alexander Kuzmenkov
0c1e897e80
Merge pull request #23707 from ClickHouse/aku/perf-stable-query-index
stable query indexes in perf test
2021-04-28 13:06:53 +03:00
Alexey Milovidov
eda56e52d8 Remove obsolete compilers 2021-04-28 07:16:48 +03:00
Alexander Kuzmenkov
cc0dd732d9 stable query indexes in perf test 2021-04-28 00:58:37 +03:00
Yatsishin Ilya
c59a11f798 Merge remote-tracking branch 'origin' into integration-2 2021-04-27 18:34:33 +03:00
Alexander Kuzmenkov
1e7fc204d8
Merge pull request #23554 from ClickHouse/aku/perf-numa-attributes
add numactl info to perf test run attributes
2021-04-27 14:09:57 +03:00
Ilya Yatsishin
a0003e6d42
Touch to rebuild 2021-04-27 13:41:39 +03:00
Yatsishin Ilya
edabf8f5c3 wip 2021-04-27 12:07:04 +03:00
Alexander Kuzmenkov
9bb4d8769f
Merge pull request #23550 from ClickHouse/aku/perf-more-info
add more info to perf test report
2021-04-27 01:15:54 +03:00
Alexander Kuzmenkov
bfa47f7c5f
Update compare.sh 2021-04-26 12:41:29 +03:00
Alexander Kuzmenkov
5d101336ff fix 2021-04-26 12:39:54 +03:00
mergify[bot]
68ee3ff70e
Merge branch 'master' into limit-gcc 2021-04-25 05:01:45 +00:00
Alexey Milovidov
1c2d16f608 Fix build 2021-04-25 06:11:54 +03:00
alexey-milovidov
bd70aabf5c
Merge pull request #23605 from ClickHouse/cleanup-release
Remove rotten parts of release script
2021-04-25 05:51:02 +03:00
alexey-milovidov
025d40ade6
Merge pull request #23553 from ClickHouse/aku/trace-fg
export trace log from stateless tests in flamegraph-friendly format
2021-04-25 02:30:35 +03:00
Alexey Milovidov
fe76b2242a Remove rotten parts of release script 2021-04-25 02:11:31 +03:00
alexey-milovidov
c489355357
Merge pull request #23561 from ClickHouse/stress-test-less-oom
Less chance of OOM in stress tests
2021-04-24 23:16:50 +03:00
alexey-milovidov
877d245d8f
Merge pull request #23462 from zhang2014/fix/ISSUE-23310
ISSUES-23310 Try fix MySQL 8.0 address already in use
2021-04-24 04:17:21 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Alexander Kuzmenkov
c40a300d03 add numactl info to perf run attributes 2021-04-23 23:52:18 +03:00
Alexander Kuzmenkov
77f0be25b6
Update run.sh 2021-04-23 23:03:53 +03:00
Alexander Kuzmenkov
5f1c825e1d
Update compare.sh 2021-04-23 22:01:24 +03:00
Alexander Kuzmenkov
5f23acfb47
Update Dockerfile 2021-04-23 21:58:37 +03:00
Alexander Kuzmenkov
9f187b594c
Update run.sh 2021-04-23 21:51:26 +03:00
Alexander Kuzmenkov
294dd3c6cc export trace log from stateless tests in flamegraph-friendly format 2021-04-23 21:50:02 +03:00
Alexander Kuzmenkov
e052edc7df
Update compare.sh 2021-04-23 20:32:30 +03:00
Alexander Kuzmenkov
bcc0744adb fix 2021-04-23 18:54:48 +03:00
Alexander Kuzmenkov
e51c844e2c add more info to perf test report 2021-04-23 16:47:33 +03:00
Alexander Kuzmenkov
0b990c9519
Merge pull request #23514 from ClickHouse/aku/perf-test-cpu-model
upload cpu model to perf test db
2021-04-23 09:25:51 +03:00
Alexander Kuzmenkov
1463d5089c
Update Dockerfile 2021-04-22 21:31:34 +03:00
Alexander Kuzmenkov
3f855cb714 more 2021-04-22 20:18:21 +03:00
Alexander Kuzmenkov
6a1414663f upload cpu model to perf test db 2021-04-22 19:48:32 +03:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
Alexey Milovidov
8cb0e5579a Remove gcc from docs 2021-04-22 04:20:03 +03:00
alexey-milovidov
9c649932bc
Merge pull request #23375 from ClickHouse/fix-read-in-order-with-collation
Fix read in order optimization of COLLATE is present #22379
2021-04-21 15:00:02 +03:00
Alexey Milovidov
f4926a525f Exclude from fasttest 2021-04-20 23:32:18 +03:00
alexey-milovidov
db51ef8012
Merge pull request #23264 from azat/tests-artifacts-trace_log
Add trace_log into stateless/stress test artifacts
2021-04-20 21:44:30 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
robot-clickhouse
db82e9e3d5 Auto version update to [21.6.1.1] [54451] 2021-04-20 01:48:20 +03:00
Azat Khuzhin
6fba6f7ddd Disable min_bytes_to_use_mmap_io by default
Reading files using mmap() does not have any significant benefits over
plain read() [1].

  [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574

And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].

  [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb

TL;DR;

Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).

And as an adddition to #23211 there was #23212, that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq
add uniqThetaSketch
2021-04-19 10:32:29 +03:00
kssenii
88b50621d4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-18 14:40:37 +00:00
Azat Khuzhin
7083d126f7 Disable postgresql_port in perf tests
To avoid port overlaps
2021-04-17 15:28:09 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Pavel Kruglov
ec83aed3eb Move long queries from 01798_uniq_theta_sketch to separate test 2021-04-16 11:44:32 +03:00