Commit Graph

1512 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
0c1e897e80
Merge pull request #23707 from ClickHouse/aku/perf-stable-query-index
stable query indexes in perf test
2021-04-28 13:06:53 +03:00
Alexander Kuzmenkov
cc0dd732d9 stable query indexes in perf test 2021-04-28 00:58:37 +03:00
Alexander Kuzmenkov
1e7fc204d8
Merge pull request #23554 from ClickHouse/aku/perf-numa-attributes
add numactl info to perf test run attributes
2021-04-27 14:09:57 +03:00
Ilya Yatsishin
a0003e6d42
Touch to rebuild 2021-04-27 13:41:39 +03:00
Alexander Kuzmenkov
9bb4d8769f
Merge pull request #23550 from ClickHouse/aku/perf-more-info
add more info to perf test report
2021-04-27 01:15:54 +03:00
Alexander Kuzmenkov
bfa47f7c5f
Update compare.sh 2021-04-26 12:41:29 +03:00
Alexander Kuzmenkov
5d101336ff fix 2021-04-26 12:39:54 +03:00
alexey-milovidov
025d40ade6
Merge pull request #23553 from ClickHouse/aku/trace-fg
export trace log from stateless tests in flamegraph-friendly format
2021-04-25 02:30:35 +03:00
alexey-milovidov
c489355357
Merge pull request #23561 from ClickHouse/stress-test-less-oom
Less chance of OOM in stress tests
2021-04-24 23:16:50 +03:00
alexey-milovidov
877d245d8f
Merge pull request #23462 from zhang2014/fix/ISSUE-23310
ISSUES-23310 Try fix MySQL 8.0 address already in use
2021-04-24 04:17:21 +03:00
Alexey Milovidov
e9e4ab3813 Less chance of OOM in stress tests 2021-04-24 03:27:23 +03:00
Alexander Kuzmenkov
c40a300d03 add numactl info to perf run attributes 2021-04-23 23:52:18 +03:00
Alexander Kuzmenkov
77f0be25b6
Update run.sh 2021-04-23 23:03:53 +03:00
Alexander Kuzmenkov
5f1c825e1d
Update compare.sh 2021-04-23 22:01:24 +03:00
Alexander Kuzmenkov
5f23acfb47
Update Dockerfile 2021-04-23 21:58:37 +03:00
Alexander Kuzmenkov
9f187b594c
Update run.sh 2021-04-23 21:51:26 +03:00
Alexander Kuzmenkov
294dd3c6cc export trace log from stateless tests in flamegraph-friendly format 2021-04-23 21:50:02 +03:00
Alexander Kuzmenkov
e052edc7df
Update compare.sh 2021-04-23 20:32:30 +03:00
Alexander Kuzmenkov
bcc0744adb fix 2021-04-23 18:54:48 +03:00
Alexander Kuzmenkov
e51c844e2c add more info to perf test report 2021-04-23 16:47:33 +03:00
Alexander Kuzmenkov
0b990c9519
Merge pull request #23514 from ClickHouse/aku/perf-test-cpu-model
upload cpu model to perf test db
2021-04-23 09:25:51 +03:00
Alexander Kuzmenkov
1463d5089c
Update Dockerfile 2021-04-22 21:31:34 +03:00
Alexander Kuzmenkov
3f855cb714 more 2021-04-22 20:18:21 +03:00
Alexander Kuzmenkov
6a1414663f upload cpu model to perf test db 2021-04-22 19:48:32 +03:00
zhang2014
81496b2e63 Try fix MySQL 8.0 address already in use 2021-04-22 11:04:30 +08:00
Alexey Milovidov
8cb0e5579a Remove gcc from docs 2021-04-22 04:20:03 +03:00
alexey-milovidov
9c649932bc
Merge pull request #23375 from ClickHouse/fix-read-in-order-with-collation
Fix read in order optimization of COLLATE is present #22379
2021-04-21 15:00:02 +03:00
Alexey Milovidov
f4926a525f Exclude from fasttest 2021-04-20 23:32:18 +03:00
alexey-milovidov
db51ef8012
Merge pull request #23264 from azat/tests-artifacts-trace_log
Add trace_log into stateless/stress test artifacts
2021-04-20 21:44:30 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
robot-clickhouse
db82e9e3d5 Auto version update to [21.6.1.1] [54451] 2021-04-20 01:48:20 +03:00
Azat Khuzhin
6fba6f7ddd Disable min_bytes_to_use_mmap_io by default
Reading files using mmap() does not have any significant benefits over
plain read() [1].

  [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574

And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].

  [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb

TL;DR;

Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).

And as an adddition to #23211 there was #23212, that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq
add uniqThetaSketch
2021-04-19 10:32:29 +03:00
Azat Khuzhin
7083d126f7 Disable postgresql_port in perf tests
To avoid port overlaps
2021-04-17 15:28:09 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Pavel Kruglov
ec83aed3eb Move long queries from 01798_uniq_theta_sketch to separate test 2021-04-16 11:44:32 +03:00
Andrey Z
3f9459071c Upd 2021-04-15 22:35:31 +03:00
Alexander Kuzmenkov
2489b6af96 cleanup 2021-04-15 19:40:49 +03:00
Yatsishin Ilya
3288da2fcb fix 2021-04-15 15:56:02 +03:00
Andrey Z
c564168df8 Upd dockerfile 2021-04-15 15:11:54 +03:00
Yatsishin Ilya
b520d28873 Add dockerhub-proxy to runner 2021-04-15 15:06:49 +03:00
alesapin
f13eade50e Upload keeper logs from stateless tests 2021-04-14 18:04:57 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy 2021-04-14 14:50:28 +03:00
Nikita Mikhaylov
c0ed151239
Merge pull request #22012 from nikitamikhaylov/s3-distributed
Table function `s3Cluster`
2021-04-14 10:23:43 +03:00
tavplubix
5df608a11b
Merge pull request #23043 from ClickHouse/improve_hung_check
Improve hung check in Stress tests
2021-04-14 00:29:52 +03:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
4465a0627f better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
efef179b89 remove prints 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
05e04f792e disable func test in fast test 2021-04-13 22:39:42 +03:00
Kruglov Pavel
6350f734dc
Merge branch 'master' into datasketches-uniq 2021-04-13 19:34:15 +03:00
Pavel Kruglov
6ce9873a76 Move all uniqThetaSketch tests into one file, add it in fasttest and arcadia skip lists 2021-04-13 19:33:15 +03:00
Alexander Tokmakov
0739dde734 improve hung check 2021-04-13 16:45:08 +03:00
Ivan
fdbaf246fd
Fix typo 2021-04-13 16:10:02 +03:00
kssenii
9089f44a50 Fix tests 2021-04-12 18:40:34 +00:00
Alexey Milovidov
6aad76b167 Adjust fast test 2021-04-12 13:43:33 +03:00
kssenii
792d57d630 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgresql-protocol-with-row-policy 2021-04-11 21:10:33 +00:00
Pavel Kruglov
eb4403c572 Enable datasketches 2021-04-09 19:14:52 +03:00
avogar
f17719d62e Add datasketches-cpp submodule in fasttest 2021-04-09 16:31:49 +03:00
Alexey Milovidov
a674188d39 Better diagnostics for OOM in stress test 2021-04-09 09:39:25 +03:00
kssenii
0270d1b84d Add test to parallel tests skip list 2021-04-08 16:38:31 +00:00
kssenii
80fc675258 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgresql-protocol-with-row-policy 2021-04-08 14:46:56 +00:00
Alexander Kuzmenkov
298cd01d90
Update run-fuzzer.sh 2021-04-08 14:53:52 +03:00
kssenii
10dcb73e9f Next try 2021-04-08 06:04:29 +00:00
kssenii
3709a0d68a Try help locate psql 2021-04-07 20:07:03 +00:00
kssenii
c43c157d2c Install postgresql client properly 2021-04-07 15:30:56 +00:00
kssenii
15ae912b56 Fix postgresql protocol with row policy 2021-04-07 12:56:09 +00:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
dc42d5189d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-05 15:36:35 +00:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
alesapin
76d0e60e26 Merge branch 'master' into jepsen_for_ci 2021-04-04 16:07:53 +03:00
alexey-milovidov
89db2b1ffc
Merge pull request #22542 from azat/fuzzer-fix
Filter removed/renamed tests from ci-changed-files.txt for fuzzer
2021-04-03 22:05:47 +03:00
Azat Khuzhin
2e8e116d4c Filter removed/renamed tests from ci-changed-files.txt for fuzzer 2021-04-03 12:30:27 +03:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
robot-clickhouse
39b5674bef Auto version update to [21.5.1.1] [54450] 2021-04-02 18:34:29 +03:00
Alexander Kuzmenkov
e7df8893df
Merge pull request #22300 from ClickHouse/trying_parallel_func_tests
Trying parallel func tests
2021-04-02 18:09:58 +03:00
alesapin
14a1344c62 Normal tests count 2021-04-02 11:26:10 +03:00
Alexander Kuzmenkov
b9fe91fcff fixup 2021-04-02 00:04:59 +03:00
Alexander Kuzmenkov
db2e9c870f cleanup 2021-04-02 00:04:46 +03:00
Alexander Kuzmenkov
95cd9b0b37 cleanup 2021-04-01 23:28:53 +03:00
Alexander Kuzmenkov
fda70f97c3 not so deep 2021-04-01 21:44:43 +03:00
Alexander Kuzmenkov
8e26998376 fixup 2021-04-01 21:05:09 +03:00
Alexander Kuzmenkov
bd7cc80d4b try clang 11 in fast test 2021-04-01 21:03:06 +03:00
Alexander Kuzmenkov
31c8edf06a disable parallel run for DatabaseReplicated 2021-04-01 20:57:31 +03:00
kssenii
99f0b08ac3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-01 13:48:33 +00:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
7dfcef9846 Add forgotten files 2021-03-31 21:46:07 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
alesapin
1c8717b042 Fix run 2021-03-31 18:19:38 +03:00
Alexander Kuzmenkov
b67f48999c Merge remote-tracking branch 'origin/master' into HEAD 2021-03-31 16:27:19 +03:00
alesapin
2de47d84d8 Some fixes 2021-03-31 15:30:28 +03:00
tavplubix
6c1e2a0d87
Merge pull request #21690 from ClickHouse/test_multiple_nodes
Run three nodes with Replicated database and NuKeeper in CI
2021-03-31 12:31:13 +03:00
alesapin
019d4b3ebd Run with ssh socket 2021-03-31 11:36:23 +03:00
alesapin
7c04b17ed0 Merge branch 'master' into jepsen_for_ci 2021-03-31 11:16:49 +03:00
alesapin
7172202bf5 More fixes 2021-03-30 23:51:41 +03:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
alesapin
41da6076b1 Json logging 2021-03-30 19:22:20 +03:00
alesapin
45c1ba8c69
Revert "quick fix for broken resolution of apt.llvm.org on Yandex infra" 2021-03-30 19:03:55 +03:00