Commit Graph

2320 Commits

Author SHA1 Message Date
Ky Li
9abd7e543c
Update entrypoint.sh
We build clickhouse cluster in k8s by clickhouse-operator. 
clickhouse-server.log is mounted by emptydir on the path `/var/log/clickhouse-server`.
It causes the file system error called `Necessary directory '/var/log/clickhouse-server' isn't owned by user with id '101' `  when  CLICKHOUSE_DO_NOT_CHOWN is set to true(1).
Because emptydir file and dir is owned by root when it started, it has to do the chown cmd.
But it will take a long time to run chown cmd when the cluster has much data (in table data dir), the cluster cannot even restart because of  `initialDelaySeconds`
So chown operation is necessary to check if the file owner and group is owned by user 101.
2021-07-20 12:16:51 +08:00
alesapin
7b10c06113
Merge pull request #26497 from vdimir/docker-fasttest-build
Update link to dpkg-deb in dockerfiles
2021-07-19 21:19:32 +03:00
vdimir
23423524c5
Update path to apache-arrow deb package in unbundled/Dockerfile
See 'Linux packages notes' https://arrow.apache.org/blog/2021/05/03/4.0.0-release/
2021-07-19 16:04:42 +03:00
vdimir
22d545133a
Update link to dpkg-deb in dockerfiles 2021-07-19 12:49:19 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Alexey Milovidov
da94ed8a87 Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-18 01:12:24 +03:00
Alexey Milovidov
9bef9d4f2d Revert "Auto version update to [21.10.1.1] [54455]"
This reverts commit f2b1395127.
2021-07-17 13:17:30 +03:00
alexey-milovidov
659fc2a8e2
Merge pull request #26393 from azat/stress-improvements
stress tests report improvements
2021-07-17 13:00:09 +03:00
robot-clickhouse
f2b1395127 Auto version update to [21.10.1.1] [54455] 2021-07-17 08:45:10 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alexey-milovidov
c73f13be93
Merge pull request #26294 from arenadata/ADQM-325
yandex/clickhouse-test-base Dockerfile fix (mysql connector moved)
2021-07-14 15:37:00 +03:00
Alexander Tokmakov
f0ed6be269 Merge branch 'master' into system_zookeeper_log 2021-07-13 20:49:37 +03:00
Ilya Golshtein
d7777c6127 yandex/clickhouse-test-base Dockerfile fix (mysql connector moved) 2021-07-13 18:49:03 +03:00
Nikita Mikhaylov
3679a14214 update fast test 2021-07-13 10:51:34 +00:00
Nikita Mikhaylov
8062b492c5 added tests to skip list 2021-07-13 10:51:08 +00:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
kssenii
d6967dbd2b Update test 2021-07-11 19:10:52 +00:00
kssenii
40281f9283 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into g-arslan-add-sqlite-support 2021-07-10 06:50:46 +00:00
robot-clickhouse
8ae8b26954 Auto version update to [21.9.1.1] [54454] 2021-07-10 08:22:52 +03:00
kssenii
46e9e21419 Fix build 2021-07-09 15:47:57 +00:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
alesapin
870f7eb716
Update Dockerfile 2021-07-08 15:33:12 +03:00
Nikolay Degterinsky
87eb76d51e Fix unbundled build 2021-07-08 12:16:53 +00:00
Vitaliy Zakaznikov
40a2fc8a18 Trying to fix collection of clickhouser server logs for TestFlows check. 2021-07-07 21:45:29 -04:00
alexey-milovidov
dfd9e1d737
Merge pull request #26011 from vzakaznikov/fix_and_enable_testflows_tests
Enabling all TestFlows modules and fixing some tests.
2021-07-07 22:46:25 +03:00
Vitaliy Zakaznikov
7f292c6006 Changing output back to new fails only. 2021-07-07 12:02:50 -04:00
alesapin
aa86fac4e7 Fix unbundled build 2021-07-07 14:07:20 +03:00
alesapin
f0fc12d0dd Merge branch 'master' into evillique-nlp 2021-07-07 12:14:49 +03:00
alexey-milovidov
80eaf85301
Merge pull request #24416 from elevankoff/system-metrics
Common system metrics collection
2021-07-07 03:21:49 +03:00
Vitaliy Zakaznikov
89f89e33d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_and_enable_testflows_tests 2021-07-06 14:42:46 -04:00
Vitaliy Zakaznikov
d32d8ceff6 Changing TestFlows output to use classic mode instead of just new fails. 2021-07-06 06:58:16 -04:00
Alexey Milovidov
7ae15fee31 Change performance test after adjusted the name of column 2021-07-05 22:08:29 +03:00
Maksim Kita
577e69898a Compile aggregate functions perf tests fix 2021-07-05 12:17:01 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Alexey Milovidov
e80a700cff More direct way to start ClickHouse 2021-07-04 02:13:32 +03:00
Alexey Milovidov
127455f15f Remove experimental ANTLR parser 2021-07-03 18:48:03 +03:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
mergify[bot]
892c67891a
Merge branch 'master' into fix-receive-time-metric 2021-07-01 21:40:09 +00:00
Maksim Kita
22491c8adc Compile AggregateFunctionCount 2021-07-01 22:56:36 +03:00
Azat Khuzhin
a471ebdabe Fix performance tests after converting ProfileEvents to Map type 2021-06-30 21:00:36 +03:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
alesapin
cdc95fa98a
Merge pull request #25428 from ClickHouse/zookeeper_snapshots
Tool for conversion of ZooKeeper data into clickhouse-keeper snapshot
2021-06-29 12:58:45 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
Maksim Kita
a020d58359
Merge pull request #25804 from ClickHouse/configs-are-not-necessary-for-clickhouse-binary-to-run
Edited bare Linux example: configs are not necessary for clickhouse binary to run
2021-06-29 10:41:29 +03:00
Alexey Milovidov
ed3d5d8d16 Edited bare Linux example: configs are not necessary for clickhouse binary to run 2021-06-29 04:28:42 +03:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge
Merging #23934
2021-06-29 04:19:53 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
mergify[bot]
04814114e7
Merge branch 'master' into zookeeper_snapshots 2021-06-28 14:17:32 +00:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
Maksim Kita
352e1f27ff Update using Map datatyle in system log tables before merge 2021-06-28 14:42:21 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
robot-clickhouse
648801760e Auto version update to [21.8.1.1] [54453] 2021-06-28 00:50:20 +03:00
alexey-milovidov
f7663fe6eb
Update run.sh 2021-06-28 00:05:57 +03:00
kssenii
aa7133c239 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-27 20:08:00 +00:00
Alexey Milovidov
b11f9223de Merge branch 'master' into fix-receive-time-metric 2021-06-27 19:00:39 +03:00
Alexey Milovidov
45c4b62c3b Separate log files for separate runs in stress test 2021-06-27 18:41:25 +03:00
Alexey Milovidov
ebc2fbfd63 Performance test: be more generous 2021-06-27 03:14:42 +03:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
Ivan
14e43cfafa
Add CI check for darwin-aarch64 (#25560)
* Add support for darwin-aarch64

* Fix PVS warnings

* Add build configuration

* Fix packager args
2021-06-25 18:21:56 +03:00
Alexey Milovidov
3ef23c4e22 Add pv to the test image 2021-06-24 00:33:22 +03:00
Alexey Milovidov
d3d3c4b686 Adjust fast test 2021-06-23 00:31:40 +03:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
9e77ca7182
Merge branch 'master' into nlp 2021-06-17 21:47:41 +03:00
Alexey Milovidov
7aacca94e3 Fix error in Fuzzer (CC @akuzm) 2021-06-17 09:16:34 +03:00
Alexander Tokmakov
c235539620 minor fixes 2021-06-17 00:20:35 +03:00
tavplubix
710546b9e8
Merge branch 'master' into improve_replicated_database_tests 2021-06-16 13:24:32 +03:00
Alexey Milovidov
779f5eca94 Relax max test time for performance test; fix comment 2021-06-16 11:26:00 +03:00
Alexander Tokmakov
c873714698 improve replicated database tests 2021-06-15 23:52:29 +03:00
Alexey Milovidov
19f8f0241d Fix strange typo 2021-06-14 04:11:16 +03:00
alexey-milovidov
a293979353
Merge pull request #25210 from ClickHouse/database_replicated_tests_parallel
Try run tests with Replicated database in parallel
2021-06-13 16:40:21 +03:00
alexey-milovidov
16114c38c7
Merge pull request #24875 from ClickHouse/fix_woboq_build
Trying to resurrect woboq
2021-06-12 03:18:37 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries
Remove explicit enable_dictionaries files in integration tests
2021-06-12 02:45:25 +03:00
tavplubix
2a6b4a64f4
Merge pull request #25200 from vdimir/join-opts-stress-test
Add join related options to stress test
2021-06-12 00:03:41 +03:00
Alexander Tokmakov
9d8ebd5782 run tests with Replicated database in parallel 2021-06-11 15:28:27 +03:00
vdimir
e24ee509a4
Fix modulo division priority issue in test/stress/stress 2021-06-11 13:08:49 +03:00
vdimir
bf9df90296
Add join related options to stress test 2021-06-11 12:36:59 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
alexey-milovidov
521284fc51
Merge pull request #25133 from vzakaznikov/trying_to_fix_docker_pull_error_in_testflows
Fix using Yandex dockerhub registries for TestFlows.
2021-06-10 01:59:00 +03:00
Alexander Kuzmenkov
c0e6aa97a6
Merge pull request #24734 from ClickHouse/aku/frame-expressions
support expressions in window frame
2021-06-10 00:25:32 +03:00
Alexander Kuzmenkov
22d3e40f89
Merge pull request #24938 from ClickHouse/aku/perf-test
some perf test script improvements
2021-06-10 00:23:04 +03:00
Vitaliy Zakaznikov
06a3fe99e4 Fix using Yandex dockerhub registries for TestFlows. 2021-06-09 12:19:40 -04:00
Alexander Kuzmenkov
f9f5b7945e
fix shellcheck 2021-06-09 14:40:38 +03:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Alexander Kuzmenkov
f4d7baaaff Merge remote-tracking branch 'origin/aku/perf-test' into HEAD 2021-06-08 18:10:19 +03:00
Alexander Kuzmenkov
07fceb667e fix 2021-06-08 17:12:47 +03:00
Ivan Lezhankin
82c78ba833 Update Dockerfile 2021-06-08 15:01:16 +03:00
alesapin
fba2d66042 Disable storage_kerberized_hdfs test 2021-06-07 12:25:13 +03:00
Nikolay Degterinsky
2053d8aa94 added submodules to fasttest 2021-06-06 22:55:57 +00:00
mergify[bot]
8e21c8edb3
Merge branch 'master' into aku/perf-test 2021-06-06 09:58:31 +00:00
alexey-milovidov
cd2ca76b24
Update compare.sh 2021-06-06 12:57:18 +03:00
Alexander Kuzmenkov
1c5e069d0d fixes 2021-06-04 18:27:21 +03:00
Nikita Mikhaylov
f1733a93e5
Merge pull request #24857 from kssenii/postgresql_protocol
Fix NULL values in postgresql protocol
2021-06-04 14:43:47 +03:00
filimonov
4766576a28
Fix error message to include file path 2021-06-04 10:00:01 +02:00
kssenii
e23bc14582 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-03 19:44:55 +00:00
Alexander Kuzmenkov
8554cb621e some perf test script improvements 2021-06-03 20:40:05 +03:00
alesapin
aeac53ac78 Update run script 2021-06-03 18:16:12 +03:00
alesapin
329380d6e5 Relaxed hung check in stress test 2021-06-03 18:13:29 +03:00
Ilya Yatsishin
e9fb162f65
Update Dockerfile 2021-06-03 16:05:12 +03:00
Alexander Kuzmenkov
23e66243e7 more fuzzer fixes... 2021-06-02 21:45:07 +03:00
Alexander Kuzmenkov
34509b26ba another fuzzer fix 2021-06-02 18:57:01 +03:00
Yatsishin Ilya
6efcbdc5b9 Merge remote-tracking branch 'origin' into integration-2 2021-06-02 18:08:31 +03:00
Alexander Kuzmenkov
ae79bbea7d Merge remote-tracking branch 'origin/master' into HEAD 2021-06-02 15:06:22 +03:00
Alexander Kuzmenkov
78fe7891b4 better messages in fuzzer status 2021-06-02 15:06:12 +03:00
alesapin
56951e2d61 Trying to resurrect woboq 2021-06-02 13:22:37 +03:00
mergify[bot]
e64fcab0bf
Merge branch 'master' into fix_stress_test 2021-06-01 19:07:27 +00:00
Ilya Yatsishin
8893f07b29
Touch to rebuild 2021-06-01 20:58:33 +03:00
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
kssenii
ccf5455624 Allow null values in postgresql protocol 2021-06-01 15:00:32 +00:00
alesapin
82c90ebc05 Some improvements in stress test 2021-06-01 12:45:01 +03:00
Yatsishin Ilya
cae1180f76 Merge remote-tracking branch 'origin' into integration-2 2021-05-31 18:45:48 +03:00
Ilya Yatsishin
2672d18da0
Touch to rebuild SQLancer 2021-05-31 12:41:36 +03:00
Yatsishin Ilya
b683f71ae6 Merge remote-tracking branch 'origin' into integration-2 2021-05-31 07:03:27 +03:00
Alexander Kuzmenkov
104f9bf6de Merge remote-tracking branch 'origin/master' into HEAD 2021-05-29 16:12:34 +03:00
Alexander Kuzmenkov
73c2ca7da5 fixes 2021-05-29 16:12:18 +03:00
Alexander Kuzmenkov
2116d0d53d
Update run-fuzzer.sh 2021-05-29 01:57:16 +03:00
Alexander Kuzmenkov
d33480ce84 fix failing grep 2021-05-28 20:47:06 +03:00
Alexander Kuzmenkov
1f1a77438b more fuzzer fixes 2021-05-28 15:55:58 +03:00
Alexander Kuzmenkov
d6afb55d87
Merge pull request #24584 from ClickHouse/aku/fuzzer-death
ast fuzzer: determine server death more robustly
2021-05-28 13:05:59 +03:00
Alexander Kuzmenkov
81d9c9ee30
Update docker/test/fuzzer/run-fuzzer.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2021-05-28 13:05:02 +03:00
Nikita Mikhaylov
c127c433c2 better 2021-05-27 23:43:00 +03:00
Alexander Kuzmenkov
ee71db564a ast fuzzer: determine server death more robustly 2021-05-27 21:26:47 +03:00
Yatsishin Ilya
7d2f701e0a Merge remote-tracking branch 'origin/master' into integration-2 2021-05-27 16:34:30 +03:00
Alexander Kuzmenkov
5dc387d3bc
Merge pull request #24534 from ClickHouse/aku/green-check-mining-1
calculate perf test precision thresholds from historical data
2021-05-27 12:59:17 +03:00
alexey-milovidov
a7e95b4ee2
Merge pull request #24504 from vzakaznikov/testflows_check_add_saving_clickhouse_logs
Adding support to save clickhouse server logs in TestFlows check
2021-05-27 08:05:55 +03:00
Yatsishin Ilya
28af06f3d0 Merge remote-tracking branch 'origin' into integration-2 2021-05-27 07:01:22 +03:00
Vitaliy Zakaznikov
ba1c118f27 * Changing default testflows output format to be new fails only
* Removing debug changes
* Fixing folder structure inside clickhouse_logs.tar.gz archive
2021-05-26 18:28:47 -04:00
kssenii
e56b10f07c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-26 21:55:10 +00:00
Vitaliy Zakaznikov
7800f934ab Adding gzip compression of clickhouse logs. 2021-05-26 17:16:24 -04:00
Vitaliy Zakaznikov
774171c61c Another try to move clickhouse logs to /test_output folder. 2021-05-26 16:25:23 -04:00
Vitaliy Zakaznikov
3fb4ba3885 Fixing the way we move clickhouse logs to the /test_output folder. 2021-05-26 14:11:56 -04:00
Alexander Kuzmenkov
5da54c2745 calculate perf test precision thresholds from historical data 2021-05-26 16:30:43 +03:00
Vitaliy Zakaznikov
20687d540a Small change to re-trigger CI/CD pipeline. 2021-05-26 08:54:55 -04:00
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
Ilya Yatsishin
1d5522af62
Merge pull request #24512 from qoega/shellcheck-fix
shellcheck fix
2021-05-26 09:43:33 +03:00
mergify[bot]
86f4e3aeaf
Merge branch 'master' into testflows_check_add_saving_clickhouse_logs 2021-05-26 06:34:10 +00:00
Yatsishin Ilya
d34bc32224 Merge remote-tracking branch 'origin' into integration-2 2021-05-26 07:38:43 +03:00
Yatsishin Ilya
3badb2afc9 shellcheck fix 2021-05-26 07:34:19 +03:00
Ilya Yatsishin
a05057ec6d
Merge pull request #24492 from qoega/integration-rm-in-entrypoint 2021-05-26 07:31:19 +03:00
Vitaliy Zakaznikov
e8d74250bf Trying another approach to copy logs to /test_output without sudo. 2021-05-25 21:34:46 -04:00
Vitaliy Zakaznikov
9dd9f221c1 Trying another fix to copy clickhouse logs to /test_output directory. 2021-05-25 21:29:43 -04:00