thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-29 19:12:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
67,817 Commits 9,187 Branches 1,782 Tags 2.2 GiB
a4a960328e
Commit Graph

1706 Commits

Author SHA1 Message Date
Yatsishin Ilya
28af06f3d0 Merge remote-tracking branch 'origin' into integration-2 2021-05-27 07:01:22 +03:00
Vitaliy Zakaznikov
ba1c118f27 * Changing default testflows output format to be new fails only 
* Removing debug changes
* Fixing folder structure inside clickhouse_logs.tar.gz archive
 2021-05-26 18:28:47 -04:00
kssenii
e56b10f07c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-26 21:55:10 +00:00
Vitaliy Zakaznikov
7800f934ab Adding gzip compression of clickhouse logs. 2021-05-26 17:16:24 -04:00
Vitaliy Zakaznikov
774171c61c Another try to move clickhouse logs to /test_output folder. 2021-05-26 16:25:23 -04:00
Vitaliy Zakaznikov
3fb4ba3885 Fixing the way we move clickhouse logs to the /test_output folder. 2021-05-26 14:11:56 -04:00
Alexander Kuzmenkov
5da54c2745 calculate perf test precision thresholds from historical data 2021-05-26 16:30:43 +03:00
Vitaliy Zakaznikov
20687d540a Small change to re-trigger CI/CD pipeline. 2021-05-26 08:54:55 -04:00
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master 
Implement IDisk interface for HDFS
 2021-05-26 14:14:06 +03:00
Ilya Yatsishin
1d5522af62
Merge pull request #24512 from qoega/shellcheck-fix 
shellcheck fix
 2021-05-26 09:43:33 +03:00
mergify[bot]
86f4e3aeaf
Merge branch 'master' into testflows_check_add_saving_clickhouse_logs 2021-05-26 06:34:10 +00:00
Yatsishin Ilya
d34bc32224 Merge remote-tracking branch 'origin' into integration-2 2021-05-26 07:38:43 +03:00
Yatsishin Ilya
3badb2afc9 shellcheck fix 2021-05-26 07:34:19 +03:00
Ilya Yatsishin
a05057ec6d
Merge pull request #24492 from qoega/integration-rm-in-entrypoint 2021-05-26 07:31:19 +03:00
Vitaliy Zakaznikov
e8d74250bf Trying another approach to copy logs to /test_output without sudo. 2021-05-25 21:34:46 -04:00
Vitaliy Zakaznikov
9dd9f221c1 Trying another fix to copy clickhouse logs to /test_output directory. 2021-05-25 21:29:43 -04:00
Vitaliy Zakaznikov
bcdb5a614a Fixing copying of clickhouse logs into /test_output directory for TestFlows check. 2021-05-25 20:07:54 -04:00
Vitaliy Zakaznikov
f6c47b6a0a Adding support to save clickhouse server logs in TestFlows check. 2021-05-25 17:45:10 -04:00
Maksim Kita
315994f686
Merge pull request #24442 from kitaisreal/actions-dag-compile-expressions-update 
ActionsDAG compile expressions update
 2021-05-25 21:44:23 +03:00
Yatsishin Ilya
0ca1ce8ab3 shellcheck fix 2021-05-25 19:55:53 +03:00
Yatsishin Ilya
1a97db544d rm containers in entrypooint 2021-05-25 15:30:20 +03:00
Yatsishin Ilya
10372b12b7 rm containers in entrypooint 2021-05-25 15:29:22 +03:00
Maksim Kita
ba43fe784c Updated tests 2021-05-25 11:50:40 +03:00
kssenii
cef509e5b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-24 17:39:34 +00:00
Yatsishin Ilya
2b02689213 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 18:31:21 +03:00
Alexander Kuzmenkov
f227020018
Merge pull request #24049 from ClickHouse/aku/perf-unstable 
complain about unstable perf test queries
 2021-05-24 12:59:12 +03:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
Yatsishin Ilya
d73d92ed7e revert some changes 2021-05-21 18:48:14 +03:00
Yatsishin Ilya
fe630a0139 Merge remote-tracking branch 'origin/master' into integration-2 2021-05-21 17:57:44 +03:00
Yatsishin Ilya
c6c180c35d fix shellcheck 2021-05-21 17:33:56 +03:00
Yatsishin Ilya
daf0b5ad2b rewrite zookeeper test 2021-05-21 16:29:43 +03:00
robot-clickhouse
471142043f Auto version update to [21.7.1.1] [54452] 2021-05-20 22:23:34 +03:00
Yatsishin Ilya
d07b3763ef Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:20 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
Alexander Kuzmenkov
1b0bcfe022 remove retries from fast test 2021-05-20 15:31:56 +03:00
Alexander Kuzmenkov
a1749cf5c3 fix 2021-05-20 15:05:20 +03:00
Alexander Kuzmenkov
0176aa1878 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-20 14:44:01 +03:00
Maksim Kita
25fe0e88f8 Compile expressions added partition by test 2021-05-20 11:16:15 +03:00
Alexander Kuzmenkov
6afd9f84f1 longer 2021-05-19 13:25:43 +03:00
alesapin
31181095e7 Review fixes 2021-05-18 17:08:56 +03:00
Yatsishin Ilya
3c804556fb fix 2021-05-18 14:02:23 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
kssenii
8a4711b716 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-16 20:55:18 +00:00
Alexander Kuzmenkov
91835369cf fixup 2021-05-15 09:44:14 +03:00
Alexander Kuzmenkov
7719c1d933 collect profiles during warmup 2021-05-15 09:43:56 +03:00
alesapin
18bf681a83 Fix pull 2021-05-14 18:35:30 +03:00
Yatsishin Ilya
ad706b0de4 Merge remote-tracking branch 'origin' into integration-2 2021-05-14 16:48:44 +03:00
alesapin
123715300a Use keeper in integration tests 2021-05-14 15:30:49 +03:00
Alexander Kuzmenkov
15564f32b2 Merge remote-tracking branch 'origin/master' into HEAD 2021-05-14 13:16:31 +03:00
alesapin
f8ddf511c5 Merge branch 'master' into standalone_keeper 2021-05-14 13:05:55 +03:00
alexey-milovidov
f5e0189215
Merge pull request #23942 from vzakaznikov/testflows_modules_in_parallel 
Enabling running of all TestFlows modules in parallel
 2021-05-13 21:49:16 +03:00
Alexander Kuzmenkov
3e5f85ddd3 run short queries longer 2021-05-13 12:20:02 +03:00
Alexander Kuzmenkov
3aa919b498 fixes 2021-05-13 12:16:43 +03:00
alesapin
bfa23d7e02 Merge branch 'master' into standalone_keeper 2021-05-13 11:03:07 +03:00
Alexander Kuzmenkov
d7b726045a fixes 2021-05-13 01:32:53 +03:00
alesapin
dc55d19709 Fix fasttest image 2021-05-12 23:00:28 +03:00
kssenii
0955e5f0be Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-12 15:11:15 +00:00
Alexander Kuzmenkov
8629b29083 complain about unstable perf test queries 
We don't want to introduce more of them. The old ones should be all marked by now.
 2021-05-12 12:48:13 +03:00
Maksim Kita
d78c1f11d0 Performance tests disable compile expressions 2021-05-12 11:06:10 +03:00
Yatsishin Ilya
fe0194aa4b s3 catch up 2021-05-12 10:03:53 +03:00
Vitaliy Zakaznikov
9c2b30f9fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-11 17:17:53 -04:00
Yatsishin Ilya
9d159072ef mERGe remote-tracking branch 'origin' into integration-2 2021-05-11 13:32:44 +03:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again 
Add uniqThetaSketch again
 2021-05-11 11:24:43 +03:00
Vitaliy Zakaznikov
7a4ab5790e Fixing TestFlows docker file. 2021-05-10 18:20:46 -04:00
Vitaliy Zakaznikov
bce80f1256 Updating docker and docker-compose versions. 
Updating and enabling datetime64 extended range tests.
 2021-05-10 16:59:47 -04:00
Vitaliy Zakaznikov
d4cead19f4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:12:00 -04:00
Vitaliy Zakaznikov
c0a4770ee7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:11:48 -04:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions 
Enable "compile_expressions" by default
 2021-05-10 21:09:18 +03:00
Vitaliy Zakaznikov
f04e077081 Updating TestFlows to 1.6.90 2021-05-10 13:02:13 -04:00
kssenii
993823bcc4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-09 21:26:41 +00:00
alexey-milovidov
a34c927fb2
Merge branch 'master' into tests_dt64_ext 2021-05-08 23:29:18 +03:00
alexey-milovidov
99dadfe3c4
Update run.sh 2021-05-08 22:53:07 +03:00
Maksim Kita
2a630b68a4 Fixed FunctionComparison with special edge case 2021-05-08 21:04:21 +03:00
Maksim Kita
6dc0dcdfa4 Fixed code review issues 2021-05-08 17:39:35 +03:00
Maksim Kita
e58e956092 Enable llvm in fast test 2021-05-08 17:39:34 +03:00
Maksim Kita
5792a2533f Enable compile_expressions in fuzzer 2021-05-08 17:39:34 +03:00
Vitaliy Zakaznikov
c8224636af Moving TestFlows version to 1.6.83 2021-05-07 18:24:35 -04:00
Vitaliy Zakaznikov
b64d0676ea Moving to TestFlows 1.6.82 2021-05-07 17:56:14 -04:00
hexiaoting
a1d521902c Merge remote-tracking branch 'origin/master' into dev-continue-sundyli 2021-05-07 14:22:53 +08:00
pingyu
46f809d07f Revert "Merge pull request #23334 from ClickHouse/revert-22609-datasketches-uniq" 
This reverts commit af2499359b, reversing
changes made to db82e9e3d5.
 2021-05-05 16:42:57 +08:00
kssenii
7643d84095 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-30 22:02:51 +00:00
Yatsishin Ilya
fddc72fb49 fixes 2021-04-30 15:22:37 +03:00
Azat Khuzhin
d83ea5844f Enable use-after-destruction detection in MSan 
Refs: https://clang.llvm.org/docs/MemorySanitizer.html#use-after-destruction-detection
 2021-04-28 23:02:52 +03:00
Yatsishin Ilya
a87fe5e1bc Merge remote-tracking branch 'origin' into integration-2 2021-04-28 17:23:33 +03:00
Ilya Yatsishin
8e67cab2a3
Merge pull request #23138 from qoega/add-dockerproxy-to-runner 
Add dockerhub-proxy to runner
 2021-04-28 17:10:28 +03:00
Alexander Kuzmenkov
0c1e897e80
Merge pull request #23707 from ClickHouse/aku/perf-stable-query-index 
stable query indexes in perf test
 2021-04-28 13:06:53 +03:00
Alexander Kuzmenkov
cc0dd732d9 stable query indexes in perf test 2021-04-28 00:58:37 +03:00
Yatsishin Ilya
c59a11f798 Merge remote-tracking branch 'origin' into integration-2 2021-04-27 18:34:33 +03:00
Alexander Kuzmenkov
1e7fc204d8
Merge pull request #23554 from ClickHouse/aku/perf-numa-attributes 
add numactl info to perf test run attributes
 2021-04-27 14:09:57 +03:00
Ilya Yatsishin
a0003e6d42
Touch to rebuild 2021-04-27 13:41:39 +03:00
Yatsishin Ilya
edabf8f5c3 wip 2021-04-27 12:07:04 +03:00
Alexander Kuzmenkov
9bb4d8769f
Merge pull request #23550 from ClickHouse/aku/perf-more-info 
add more info to perf test report
 2021-04-27 01:15:54 +03:00
Alexander Kuzmenkov
bfa47f7c5f
Update compare.sh 2021-04-26 12:41:29 +03:00
Alexander Kuzmenkov
5d101336ff fix 2021-04-26 12:39:54 +03:00
alexey-milovidov
025d40ade6
Merge pull request #23553 from ClickHouse/aku/trace-fg 
export trace log from stateless tests in flamegraph-friendly format
 2021-04-25 02:30:35 +03:00
alexey-milovidov
c489355357
Merge pull request #23561 from ClickHouse/stress-test-less-oom 
Less chance of OOM in stress tests
 2021-04-24 23:16:50 +03:00
alexey-milovidov
877d245d8f
Merge pull request #23462 from zhang2014/fix/ISSUE-23310 
ISSUES-23310 Try fix MySQL 8.0 address already in use
 2021-04-24 04:17:21 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Alexander Kuzmenkov
c40a300d03 add numactl info to perf run attributes 2021-04-23 23:52:18 +03:00
Alexander Kuzmenkov
77f0be25b6
Update run.sh 2021-04-23 23:03:53 +03:00
Alexander Kuzmenkov
5f1c825e1d
Update compare.sh 2021-04-23 22:01:24 +03:00
Alexander Kuzmenkov
5f23acfb47
Update Dockerfile 2021-04-23 21:58:37 +03:00
Alexander Kuzmenkov
9f187b594c
Update run.sh 2021-04-23 21:51:26 +03:00
Alexander Kuzmenkov
294dd3c6cc export trace log from stateless tests in flamegraph-friendly format 2021-04-23 21:50:02 +03:00
Alexander Kuzmenkov
e052edc7df
Update compare.sh 2021-04-23 20:32:30 +03:00
Alexander Kuzmenkov
bcc0744adb fix 2021-04-23 18:54:48 +03:00
Alexander Kuzmenkov
e51c844e2c add more info to perf test report 2021-04-23 16:47:33 +03:00
Alexander Kuzmenkov
0b990c9519
Merge pull request #23514 from ClickHouse/aku/perf-test-cpu-model 
upload cpu model to perf test db
 2021-04-23 09:25:51 +03:00
Alexander Kuzmenkov
1463d5089c
Update Dockerfile 2021-04-22 21:31:34 +03:00
Alexander Kuzmenkov
3f855cb714 more 2021-04-22 20:18:21 +03:00
Alexander Kuzmenkov
6a1414663f upload cpu model to perf test db 2021-04-22 19:48:32 +03:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
Alexey Milovidov
8cb0e5579a Remove gcc from docs 2021-04-22 04:20:03 +03:00
alexey-milovidov
9c649932bc
Merge pull request #23375 from ClickHouse/fix-read-in-order-with-collation 
Fix read in order optimization of COLLATE is present #22379
 2021-04-21 15:00:02 +03:00
Alexey Milovidov
f4926a525f Exclude from fasttest 2021-04-20 23:32:18 +03:00
alexey-milovidov
db51ef8012
Merge pull request #23264 from azat/tests-artifacts-trace_log 
Add trace_log into stateless/stress test artifacts
 2021-04-20 21:44:30 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io 
Disable min_bytes_to_use_mmap_io by default
 2021-04-20 19:27:47 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
robot-clickhouse
db82e9e3d5 Auto version update to [21.6.1.1] [54451] 2021-04-20 01:48:20 +03:00
Azat Khuzhin
6fba6f7ddd Disable min_bytes_to_use_mmap_io by default 
Reading files using mmap() does not have any significant benefits over
plain read() [1].

  [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574

And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].

  [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb

TL;DR;

Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).

And as an adddition to #23211 there was #23212, that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
 2021-04-20 00:25:16 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount 
merging sumCount fusion PR #21337
 2021-04-19 16:47:13 +03:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq 
add uniqThetaSketch
 2021-04-19 10:32:29 +03:00
kssenii
88b50621d4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-18 14:40:37 +00:00
Azat Khuzhin
7083d126f7 Disable postgresql_port in perf tests 
To avoid port overlaps
 2021-04-17 15:28:09 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy 
Allow row policy in postgresql protocol
 2021-04-17 01:55:30 +03:00
Pavel Kruglov
ec83aed3eb Move long queries from 01798_uniq_theta_sketch to separate test 2021-04-16 11:44:32 +03:00
Andrey Z
3f9459071c Upd 2021-04-15 22:35:31 +03:00
Alexander Kuzmenkov
2489b6af96 cleanup 2021-04-15 19:40:49 +03:00
Yatsishin Ilya
4347f6ae43 Merge remote-tracking branch 'origin' into integration-2 2021-04-15 16:49:31 +03:00
Yatsishin Ilya
3288da2fcb fix 2021-04-15 15:56:02 +03:00
Yatsishin Ilya
647fd1b53b Add dockerhub-proxy to runner 2021-04-15 15:42:31 +03:00
Andrey Z
c564168df8 Upd dockerfile 2021-04-15 15:11:54 +03:00
Yatsishin Ilya
b520d28873 Add dockerhub-proxy to runner 2021-04-15 15:06:49 +03:00
Yatsishin Ilya
f6d455732e better 2021-04-14 19:04:17 +03:00
alesapin
f13eade50e Upload keeper logs from stateless tests 2021-04-14 18:04:57 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy 2021-04-14 14:50:28 +03:00
Yatsishin Ilya
10b7037d9c Merge remote-tracking branch 'origin' into integration-2 2021-04-14 14:21:40 +03:00
Nikita Mikhaylov
c0ed151239
Merge pull request #22012 from nikitamikhaylov/s3-distributed 
Table function `s3Cluster`
 2021-04-14 10:23:43 +03:00
tavplubix
5df608a11b
Merge pull request #23043 from ClickHouse/improve_hung_check 
Improve hung check in Stress tests
 2021-04-14 00:29:52 +03:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
4465a0627f better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
efef179b89 remove prints 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
05e04f792e disable func test in fast test 2021-04-13 22:39:42 +03:00
Kruglov Pavel
6350f734dc
Merge branch 'master' into datasketches-uniq 2021-04-13 19:34:15 +03:00
Pavel Kruglov
6ce9873a76 Move all uniqThetaSketch tests into one file, add it in fasttest and arcadia skip lists 2021-04-13 19:33:15 +03:00
Yatsishin Ilya
c2707a8154 better 2021-04-13 17:55:31 +03:00
Alexander Tokmakov
0739dde734 improve hung check 2021-04-13 16:45:08 +03:00
Ivan
fdbaf246fd
Fix typo 2021-04-13 16:10:02 +03:00