Azat Khuzhin
6fba6f7ddd
Disable min_bytes_to_use_mmap_io by default
...
Reading files using mmap() does not have any significant benefits over
plain read() [1].
[1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574
And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].
[2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb
TL;DR;
Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211 ), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).
And as an adddition to #23211 there was #23212 , that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
...
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq
...
add uniqThetaSketch
2021-04-19 10:32:29 +03:00
Azat Khuzhin
7083d126f7
Disable postgresql_port in perf tests
...
To avoid port overlaps
2021-04-17 15:28:09 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
...
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Pavel Kruglov
ec83aed3eb
Move long queries from 01798_uniq_theta_sketch to separate test
2021-04-16 11:44:32 +03:00
Andrey Z
3f9459071c
Upd
2021-04-15 22:35:31 +03:00
Alexander Kuzmenkov
2489b6af96
cleanup
2021-04-15 19:40:49 +03:00
Yatsishin Ilya
3288da2fcb
fix
2021-04-15 15:56:02 +03:00
Andrey Z
c564168df8
Upd dockerfile
2021-04-15 15:11:54 +03:00
Yatsishin Ilya
b520d28873
Add dockerhub-proxy to runner
2021-04-15 15:06:49 +03:00
alesapin
f13eade50e
Upload keeper logs from stateless tests
2021-04-14 18:04:57 +03:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy
2021-04-14 14:50:28 +03:00
Nikita Mikhaylov
c0ed151239
Merge pull request #22012 from nikitamikhaylov/s3-distributed
...
Table function `s3Cluster`
2021-04-14 10:23:43 +03:00
tavplubix
5df608a11b
Merge pull request #23043 from ClickHouse/improve_hung_check
...
Improve hung check in Stress tests
2021-04-14 00:29:52 +03:00
Nikita Mikhaylov
a15757a9c9
better renaming
2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
4465a0627f
better
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
efef179b89
remove prints
2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
05e04f792e
disable func test in fast test
2021-04-13 22:39:42 +03:00
Kruglov Pavel
6350f734dc
Merge branch 'master' into datasketches-uniq
2021-04-13 19:34:15 +03:00
Pavel Kruglov
6ce9873a76
Move all uniqThetaSketch tests into one file, add it in fasttest and arcadia skip lists
2021-04-13 19:33:15 +03:00
Alexander Tokmakov
0739dde734
improve hung check
2021-04-13 16:45:08 +03:00
Ivan
fdbaf246fd
Fix typo
2021-04-13 16:10:02 +03:00
kssenii
9089f44a50
Fix tests
2021-04-12 18:40:34 +00:00
Alexey Milovidov
6aad76b167
Adjust fast test
2021-04-12 13:43:33 +03:00
kssenii
792d57d630
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgresql-protocol-with-row-policy
2021-04-11 21:10:33 +00:00
Pavel Kruglov
eb4403c572
Enable datasketches
2021-04-09 19:14:52 +03:00
avogar
f17719d62e
Add datasketches-cpp submodule in fasttest
2021-04-09 16:31:49 +03:00
Alexey Milovidov
a674188d39
Better diagnostics for OOM in stress test
2021-04-09 09:39:25 +03:00
kssenii
0270d1b84d
Add test to parallel tests skip list
2021-04-08 16:38:31 +00:00
kssenii
80fc675258
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgresql-protocol-with-row-policy
2021-04-08 14:46:56 +00:00
Alexander Kuzmenkov
298cd01d90
Update run-fuzzer.sh
2021-04-08 14:53:52 +03:00
kssenii
10dcb73e9f
Next try
2021-04-08 06:04:29 +00:00
Alexander Kuzmenkov
6acc92ffd9
remove debug
2021-04-07 23:38:48 +03:00
kssenii
3709a0d68a
Try help locate psql
2021-04-07 20:07:03 +00:00
kssenii
c43c157d2c
Install postgresql client properly
2021-04-07 15:30:56 +00:00
kssenii
15ae912b56
Fix postgresql protocol with row policy
2021-04-07 12:56:09 +00:00
Alexander Kuzmenkov
29cf5bd712
Merge remote-tracking branch 'origin/master' into HEAD
2021-04-06 14:31:19 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
...
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
dc42d5189d
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-05 15:36:35 +00:00
Alexey Milovidov
0501c025db
Remove OpenCL
2021-04-05 18:09:14 +03:00
kssenii
9dba529494
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge
2021-04-05 13:14:51 +00:00
alesapin
76d0e60e26
Merge branch 'master' into jepsen_for_ci
2021-04-04 16:07:53 +03:00
alexey-milovidov
89db2b1ffc
Merge pull request #22542 from azat/fuzzer-fix
...
Filter removed/renamed tests from ci-changed-files.txt for fuzzer
2021-04-03 22:05:47 +03:00
Azat Khuzhin
2e8e116d4c
Filter removed/renamed tests from ci-changed-files.txt for fuzzer
2021-04-03 12:30:27 +03:00
kssenii
13d1f17d3e
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-03 08:00:09 +00:00
Alexander Kuzmenkov
2c91fc55e9
Merge remote-tracking branch 'origin/master' into HEAD
2021-04-02 18:38:05 +03:00
robot-clickhouse
39b5674bef
Auto version update to [21.5.1.1] [54450]
2021-04-02 18:34:29 +03:00
Alexander Kuzmenkov
e7df8893df
Merge pull request #22300 from ClickHouse/trying_parallel_func_tests
...
Trying parallel func tests
2021-04-02 18:09:58 +03:00
Alexander Kuzmenkov
d5a7809873
add pixz
2021-04-02 16:37:44 +03:00
Alexander Kuzmenkov
e456e40232
show ccache config
2021-04-02 16:37:43 +03:00
Alexander Kuzmenkov
9ec0a9dd4c
more debug
2021-04-02 14:06:36 +03:00
alesapin
14a1344c62
Normal tests count
2021-04-02 11:26:10 +03:00
Alexander Kuzmenkov
b9fe91fcff
fixup
2021-04-02 00:04:59 +03:00
Alexander Kuzmenkov
db2e9c870f
cleanup
2021-04-02 00:04:46 +03:00
Alexander Kuzmenkov
95cd9b0b37
cleanup
2021-04-01 23:28:53 +03:00
Alexander Kuzmenkov
fda70f97c3
not so deep
2021-04-01 21:44:43 +03:00
Alexander Kuzmenkov
8e26998376
fixup
2021-04-01 21:05:09 +03:00
Alexander Kuzmenkov
bd7cc80d4b
try clang 11 in fast test
2021-04-01 21:03:06 +03:00
Alexander Kuzmenkov
13f3efcc88
typo
2021-04-01 21:02:35 +03:00
Alexander Kuzmenkov
31c8edf06a
disable parallel run for DatabaseReplicated
2021-04-01 20:57:31 +03:00
Alexander Kuzmenkov
28dd226004
remove extra option
2021-04-01 20:00:08 +03:00
Alexander Kuzmenkov
a255ab179f
typo
2021-04-01 17:29:51 +03:00
kssenii
99f0b08ac3
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-04-01 13:48:33 +00:00
Alexander Kuzmenkov
5f45199082
typo
2021-04-01 15:46:55 +03:00
Alexander Kuzmenkov
40dac7b678
more debug
2021-04-01 15:12:30 +03:00
Alexander Kuzmenkov
2b97587055
debug again
2021-04-01 02:53:22 +03:00
Alexander Kuzmenkov
026dab2b81
typo
2021-04-01 02:51:47 +03:00
kssenii
88df6afc84
More tests
2021-03-31 23:48:54 +00:00
Alexander Kuzmenkov
a91f505899
remove debug
2021-04-01 00:59:31 +03:00
kssenii
7dfcef9846
Add forgotten files
2021-03-31 21:46:07 +00:00
Alexander Kuzmenkov
8bd19ccad2
Update packager
2021-03-31 23:23:08 +03:00
Alexander Kuzmenkov
a55d03cb62
try to avoid conflict with prlimit
2021-03-31 22:41:53 +03:00
Alexander Kuzmenkov
c187dca12c
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-31 20:18:08 +03:00
kssenii
03ce320926
Add a separate docker-compose with multiple servers for postgres and mysql
2021-03-31 17:04:57 +00:00
Alexander Kuzmenkov
d0db789196
Update build.sh
2021-03-31 18:43:31 +03:00
Alexander Kuzmenkov
1683c3a10d
more debug
2021-03-31 18:38:36 +03:00
alesapin
1c8717b042
Fix run
2021-03-31 18:19:38 +03:00
Alexander Kuzmenkov
b67f48999c
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-31 16:27:19 +03:00
Alexander Kuzmenkov
1ccc162c86
stats
2021-03-31 15:59:45 +03:00
alesapin
2de47d84d8
Some fixes
2021-03-31 15:30:28 +03:00
tavplubix
6c1e2a0d87
Merge pull request #21690 from ClickHouse/test_multiple_nodes
...
Run three nodes with Replicated database and NuKeeper in CI
2021-03-31 12:31:13 +03:00
alesapin
019d4b3ebd
Run with ssh socket
2021-03-31 11:36:23 +03:00
alesapin
7c04b17ed0
Merge branch 'master' into jepsen_for_ci
2021-03-31 11:16:49 +03:00
alesapin
7172202bf5
More fixes
2021-03-30 23:51:41 +03:00
kssenii
ce05087b1b
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres
2021-03-30 17:27:10 +00:00
alesapin
41da6076b1
Json logging
2021-03-30 19:22:20 +03:00
alesapin
7f0df7d451
Update Dockerfile
2021-03-30 19:18:20 +03:00
alesapin
c7d733040c
Update Dockerfile
2021-03-30 19:17:35 +03:00
alesapin
82389ca03b
Update Dockerfile
2021-03-30 19:15:49 +03:00
alesapin
45c1ba8c69
Revert "quick fix for broken resolution of apt.llvm.org on Yandex infra"
2021-03-30 19:03:55 +03:00
Alexander Kuzmenkov
8d52292eb1
fix
2021-03-30 18:57:22 +03:00
alesapin
e221a9d577
Images file update
2021-03-30 18:44:54 +03:00
alesapin
132c2f6f22
Add jepsen docker image
2021-03-30 18:42:53 +03:00
Alexander Kuzmenkov
350546356a
debug dns in docker build
2021-03-30 18:09:58 +03:00
Alexander Kuzmenkov
5f8e88aca0
boop
2021-03-30 16:39:49 +03:00
Alexander Tokmakov
500a20f30d
Merge branch 'master' into test_multiple_nodes
2021-03-30 16:23:33 +03:00
Alexander Kuzmenkov
e5953f249d
Update build.sh
2021-03-30 15:34:24 +03:00
Alexander Kuzmenkov
0696ed390d
Merge pull request #22181 from ClickHouse/aku/flaky-stateless
...
less flaky functional tests
2021-03-30 14:40:07 +03:00
Alexander Kuzmenkov
b01897ebd7
check how ccache is used for contribs
2021-03-30 14:31:39 +03:00
Alexander Kuzmenkov
f2325b62f4
Merge remote-tracking branch 'origin/aku/flaky-stateless' into HEAD
2021-03-30 14:04:02 +03:00
Alexander Kuzmenkov
bd5ddf0524
fixes
2021-03-30 13:49:43 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper
...
Rename NuKeeper and TestKeeper to Keeper in all places
2021-03-30 10:39:22 +03:00
Alexander Tokmakov
9925110713
rename other occurrances
2021-03-29 23:04:50 +03:00
Alexander Kuzmenkov
750ff0c724
Merge branch 'master' into trying_parallel_func_tests
2021-03-29 22:53:09 +03:00
Alexander Tokmakov
ccd31d1b72
Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes
2021-03-29 22:44:40 +03:00
Alexander Tokmakov
a5b07f2f03
Merge branch 'master' into test_multiple_nodes
2021-03-29 22:43:25 +03:00
Alexander Kuzmenkov
653b930e54
random order in flaky check
2021-03-29 22:12:20 +03:00
Alexander Kuzmenkov
23198059f3
save query log
2021-03-29 22:12:20 +03:00
Mikhail Filimonov
da6ad09db6
Add suffixes for dockerfile arguments
2021-03-29 16:27:01 +02:00
alesapin
0cb85b9ea8
Trying parallel functional tests one more time
2021-03-29 17:26:48 +03:00
alesapin
a423540452
Merge remote-tracking branch 'origin/aku/flaky-stateless' into trying_parallel_func_tests
2021-03-29 17:25:23 +03:00
Mikhail Filimonov
32c27b45a6
Add possibility to customize the source for docker image builds.
...
Introduce 2 arguments for clickhouse-server image Dockerfile:
deb_location & single_binary_location
That enables to build docker images from CI build easily, also for non-standard
builds (with sanitizers / for arm64 etc).
2021-03-29 15:42:18 +02:00
alesapin
581ab43cfb
Merge pull request #22132 from devwout/fix-docker-entrypoint
...
Fix docker entrypoint in case http_port is not in the config
2021-03-29 16:31:18 +03:00
Alexander Kuzmenkov
7df765e4b4
save query log
2021-03-29 14:47:57 +03:00
alesapin
be132a32a2
More renames
2021-03-29 11:24:56 +03:00
kssenii
f40c582e7a
Replicas/shards for postgres storage
2021-03-27 20:11:48 +00:00
kssenii
f141f027f4
Make common class for external storages
2021-03-27 17:12:47 +00:00
kssenii
ae868208c2
Use pool with failover in mysql storage
2021-03-27 14:39:45 +00:00
Ilya Yatsishin
d01af5e9f8
touch to rebuild
2021-03-26 22:44:40 +03:00
alesapin
4c67e25152
Merge pull request #22102 from ClickHouse/filimonov-docker-empty-dirname
...
docker: avoid chown of .
2021-03-26 22:19:12 +03:00
Alexander Kuzmenkov
0675f9403c
Merge pull request #21895 from ClickHouse/aku/laglead
...
float RANGE OFFSET and lag/lead_in_frame
2021-03-25 23:00:22 +03:00
Ewout
6fe26493e9
Fix docker entrypoint in case http_port is not in config.
...
`http_port` can be removed from the configuration when serving HTTP is
not desired. When it is not present, `extract-from-config` will fail,
which will prevent the server from starting.
Only fetch it when it is required for database initialization.
2021-03-25 16:14:48 +01:00
alexey-milovidov
52396acba1
Merge pull request #22064 from ClickHouse/fix-overflow-aes
...
Fix missing check in decrypt for AEAD mode
2021-03-25 16:01:44 +03:00
kssenii
bc36baef26
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge
2021-03-25 07:48:07 +00:00
filimonov
4b6b1311ce
Update entrypoint.sh
2021-03-24 22:33:08 +01:00
filimonov
8121c52c53
Update entrypoint.sh
...
fix for #22100
2021-03-24 22:24:07 +01:00
alexey-milovidov
b6a0f2f4ad
Merge pull request #22000 from ClickHouse/docker-add-tzdata
...
Add tzdata to Docker
2021-03-24 23:10:54 +03:00
Alexey Milovidov
6341b083fb
Add test to skip list
2021-03-24 22:35:22 +03:00
kssenii
d9326cc229
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge
2021-03-24 18:28:55 +00:00
Ilya Yatsishin
4f8e3af0f7
Merge pull request #22015 from qoega/longer-sqlancer-run
...
Longer SQLancer run
2021-03-24 13:44:14 +03:00
Alexander Kuzmenkov
4c2278c215
Merge pull request #22047 from ClickHouse/aku/llvm-cloudflare-21.3
...
21.3: quick fix for broken resolution of apt.llvm.org on Yandex infra
(cherry picked from commit 12f5753e5f
2021-03-23 19:41:09 +03:00
filimonov
4cbf741e52
Update Dockerfile.alpine
2021-03-23 11:48:28 +01:00
filimonov
7793593112
Update Dockerfile.alpine
2021-03-23 10:21:51 +01:00
Yatsishin Ilya
c18018ae06
Longer SQLancer run
2021-03-23 07:26:30 +03:00
Alexey Milovidov
b824df2d3f
Add tzdata to Docker
2021-03-22 22:43:26 +03:00
Alexander Kuzmenkov
b0284f20c3
Merge branch 'master' into aku/laglead
2021-03-22 21:16:27 +03:00
Alexander Kuzmenkov
5ae5134147
Merge pull request #21846 from ClickHouse/aku/perf-test-error
...
more robust error handling in perf test
2021-03-22 17:18:37 +03:00
kssenii
8a650c4408
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge
2021-03-22 13:38:25 +00:00
alexey-milovidov
0bad6adc48
Merge pull request #21551 from vzakaznikov/testflows_use_yandex_docker_repo
...
Updating docker/test/testflows/runner/dockerd-entrypoint.sh to use Yandex dockerhub-proxy
2021-03-22 02:27:50 +03:00
Alexander Kuzmenkov
1beba597ca
Merge remote-tracking branch 'origin/master' into HEAD
2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d
float frames and lag/lead_in_frame
2021-03-19 02:05:43 +03:00
Alexander Kuzmenkov
8ab778e26a
Merge pull request #21754 from ClickHouse/aku/fuzzer-ci-sources
...
make the fuzzer use sources from the CI
2021-03-18 18:02:13 +03:00
Alexander Kuzmenkov
f2ac17cfba
Update compare.sh
2021-03-18 17:59:49 +03:00
Alexander Tokmakov
343b8c906d
Merge branch 'master' into test_multiple_nodes
2021-03-18 16:01:04 +03:00
Alexander Tokmakov
fdae70df6c
fix tests
2021-03-18 15:50:03 +03:00
Alexander Kuzmenkov
ebd20e6052
Update run-fuzzer.sh
2021-03-18 05:09:38 +03:00
Alexander Kuzmenkov
065faf1318
more robust error handling in perf test
2021-03-18 01:32:55 +03:00
Alexander Kuzmenkov
51cd10c8eb
Update run-fuzzer.sh
2021-03-18 00:22:36 +03:00
Alexander Kuzmenkov
a3c1096fdb
Update run-fuzzer.sh
2021-03-17 21:59:03 +03:00
