Commit Graph

8137 Commits

Author SHA1 Message Date
Azat Khuzhin
a963fba41a Update 00084_external_aggregation to avoid using mmap 2021-04-17 10:37:58 +03:00
Azat Khuzhin
1b367ee71d Update 01605_adaptive_granularity_block_borders to avoid using mmap 2021-04-17 10:37:58 +03:00
Azat Khuzhin
6064f3ef1d Fix memory tracking with min_bytes_to_use_mmap_io
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.

Also note, that this does not address all the issues with mmap()
regions.

v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]

  [1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
2021-04-17 10:37:38 +03:00
Alexey Milovidov
ecf8de7111 Add a test for #14610 2021-04-17 02:22:32 +03:00
alexey-milovidov
786f340256
Merge pull request #22755 from kssenii/postgresql-protocol-with-row-policy
Allow row policy in postgresql protocol
2021-04-17 01:55:30 +03:00
Alexander Kuzmenkov
2782b2a6b0 fix 2021-04-16 21:50:12 +03:00
alesapin
690045c67f Fix nasty bug 2021-04-16 21:31:23 +03:00
Nikolai Kochetov
abe84acc8c Update test. 2021-04-16 20:19:03 +03:00
Alexander Kuzmenkov
b991cbf9d6 more stable formatting for negate() 2021-04-16 19:28:33 +03:00
Pavel Kovalenko
760a2ccedf DiskS3 restore file format change and minor improvements. 2021-04-16 17:43:16 +03:00
Kruglov Pavel
deb86ee520
Merge pull request #22986 from azat/StorageBuffer-flush
[RFC] Add ability to flush buffer only in background for StorageBuffer
2021-04-16 15:14:24 +03:00
Anton Popov
b14798af2a Merge branch 'dev_nested_upadte' of git://github.com/hexiaoting/ClickHouse into nested-update 2021-04-16 14:41:19 +03:00
Nikolai Kochetov
a0c942c7d3 Update test 2021-04-16 14:32:59 +03:00
Alexander Kuzmenkov
74b4c56ba4
Merge pull request #21589 from dmalkr/dmalkr/arrayFold
Function `arrayFold` for folding over array with accumulator
2021-04-16 14:23:53 +03:00
Nikolai Kochetov
21e297b8a3 Update test 2021-04-16 14:18:55 +03:00
Nikolai Kochetov
23089a2fec Add special setting to show indexes. 2021-04-16 14:11:45 +03:00
Alexander Kuzmenkov
d4b8807016
Update fuse_sumcount.xml 2021-04-16 13:36:52 +03:00
Alexander Tokmakov
ebf0a3119e fix data_type_default_nullable on attach 2021-04-16 13:29:33 +03:00
Anton Ivashkin
dc442b90d0 Fix flapping tests test_s3_zero_copy_replication, test_s3_zero_copy_on_hybrid_storage 2021-04-16 13:23:38 +03:00
Nikolai Kochetov
6fe3470893 Update test. 2021-04-16 12:43:11 +03:00
tavplubix
b5cbbce314
Merge pull request #22706 from songenjie/fetch_part
[clickhouse][server][ddl]support fetch part
2021-04-16 12:26:51 +03:00
tavplubix
ae3dc3dfc0
Merge pull request #23161 from ClickHouse/logs_for_debuging_test_failures
More verbose logs for debuging test failures with Replicated and Keeper
2021-04-16 12:01:58 +03:00
Pavel Kruglov
ec83aed3eb Move long queries from 01798_uniq_theta_sketch to separate test 2021-04-16 11:44:32 +03:00
Maksim Kita
1797a67cf8
Merge pull request #22925 from kitaisreal/flat_dictionary_performance_test_fix
Dictionaries updated performance tests
2021-04-16 10:46:41 +03:00
Anton Popov
6ce875175b Merge remote-tracking branch 'upstream/master' into HEAD 2021-04-16 02:08:20 +03:00
alexey-milovidov
dcb5d1b395
Merge pull request #23096 from ClickHouse/markdown-bad-alignment
Fix unpleasant behaviour of `Markdown` format
2021-04-16 00:06:58 +03:00
alexey-milovidov
081bb6e275
Merge pull request #23000 from ClickHouse/speedup-intdiv
Dynamic dispatch for `intDiv`
2021-04-16 00:05:43 +03:00
Pavel Kovalenko
a73288972a Retrigger CI. 2021-04-15 23:00:44 +03:00
Alexander Tokmakov
0ad6205fa6 logs for debuging test failures with Replicated and Keeper 2021-04-15 21:34:53 +03:00
Azat Khuzhin
19e0439629 Add ability to flush buffer only in background for StorageBuffer
Add 3 new engine arguments:
- flush_time
- flush_rows
- flush_bytes

That will be checked only for background flush, this maybe useful if
INSERT latency is "crucial".
2021-04-15 21:22:13 +03:00
Alexander Kuzmenkov
2489b6af96 cleanup 2021-04-15 19:40:49 +03:00
Alexander Kuzmenkov
3b95b637a5 Merge remote-tracking branch 'origin/master' into HEAD 2021-04-15 18:19:53 +03:00
alexey-milovidov
02e77c3ef1
Merge pull request #23111 from ClickHouse/fix_test_name
Rename strange tests
2021-04-15 15:03:31 +03:00
alesapin
28577127a7 Fix style 2021-04-15 14:48:02 +03:00
alesapin
977ad747d9 ZooKeeper files 2021-04-15 14:46:11 +03:00
alexey-milovidov
ec97414d5a
Update 01598_memory_limit_zeros.sql 2021-04-15 14:45:05 +03:00
alexey-milovidov
0c097417a7
Merge pull request #22942 from ianton-ru/fix_flapping_test
Fix flapping test_merge_tree_s3 test
2021-04-15 14:38:36 +03:00
Maksim Kita
e361f5943f
Merge pull request #22999 from azat/no-optimize_skip_unused_shards-single-node
Do not perform optimize_skip_unused_shards for cluster with one node
2021-04-15 14:36:56 +03:00
alexey-milovidov
2a670fc495
Merge pull request #22359 from ClickHouse/remove-msan-suppressions-5
Remove old MSan suppressions (part 5)
2021-04-15 14:33:10 +03:00
alesapin
e5ac97a0a7 Now jepsen knows how to run zookeeper and perform same tests 2021-04-15 14:19:57 +03:00
Maksim Kita
b8a1ead3e9 Updated hashed_dictionary test 2021-04-15 13:51:40 +03:00
Pavel Kovalenko
06fc69a9bc Increase CH start/stop timeouts in integration tests. 2021-04-15 12:44:45 +03:00
Vladimir
8c7ffda676
Merge pull request #22753 from ClickHouse/revert-19685-dev_joinon 2021-04-15 12:42:50 +03:00
Dmitry Krylov
75036debf4 Check type match of lambda and accumulator 2021-04-15 19:25:30 +10:00
Pavel Kruglov
b909899cc9 Remove extra lines 2021-04-15 11:59:56 +03:00
Pavel Kruglov
8bd77e1c0c Change markdown format test 2021-04-15 11:58:14 +03:00
alesapin
50103ff0bc Merge branch 'master' into keeper_bench_mark 2021-04-15 11:30:33 +03:00
alesapin
c979287526 Rename strange tests 2021-04-15 11:28:22 +03:00
Pavel Kovalenko
e53fc635f6 Disk S3 restore test improvements. 2021-04-15 11:26:44 +03:00
alesapin
93215fa21a
Merge pull request #23077 from ClickHouse/logs_from_keeper_in_func_tests
Upload keeper logs from stateless tests
2021-04-15 11:08:11 +03:00
Vladimir Chebotarev
edd3931d4e Fixed tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
5b8a3831e6 Better tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
a63db53576 Improved tests. 2021-04-15 09:41:49 +03:00
Vladimir Chebotarev
ce6cf1630b Added tests. 2021-04-15 09:41:49 +03:00
alexey-milovidov
9b546f3b89
Merge pull request #22657 from amosbird/ctefix3
Fix CTE usage in view definition
2021-04-15 02:01:10 +03:00
Maksim Kita
c8bcfe89ad
Merge pull request #23078 from kitaisreal/ci-runner-intergation-logs-tar-fix
CI runner intergation tests logs update to tar.gz
2021-04-15 02:00:45 +03:00
Alexey Milovidov
076c746e6d Add perf test 2021-04-15 01:35:21 +03:00
Pavel Kovalenko
cad81e3742 Disk S3 possibility to restore parts to 'detached' directory. 2021-04-15 00:55:48 +03:00
Alexey Milovidov
64d91eb469 Merge branch 'master' into remove-msan-suppressions-5 2021-04-15 00:55:08 +03:00
Alexey Milovidov
346e16ce7f Fix test 2021-04-15 00:45:39 +03:00
Alexey Milovidov
17d04cbca9 Merge branch 'master' into protocol-compression-auto 2021-04-15 00:24:07 +03:00
tavplubix
2479c80fb7
Merge branch 'master' into fix_attach_mv 2021-04-15 00:07:48 +03:00
tavplubix
021cafff49
Merge pull request #23041 from ClickHouse/fix_testkeeper_multi_response
Fix multi response in TestKeeper
2021-04-14 23:25:40 +03:00
alesapin
b67cb5392b Missed setting 2021-04-14 22:48:52 +03:00
Ivan
57f61c954c
Another attempt to enable pytest (#22664)
* Fix some tests

* Fix tests
2021-04-14 19:35:17 +03:00
alesapin
e9e9a7d7d5 Upload binary via scp 2021-04-14 19:25:48 +03:00
Anton Ivashkin
68541ef315 Fix flapping test_merge_tree_s3 test 2021-04-14 19:07:22 +03:00
Maksim Kita
d885921100 CI runner intergation tests logs update to tar.gz 2021-04-14 18:15:35 +03:00
alesapin
f13eade50e Upload keeper logs from stateless tests 2021-04-14 18:04:57 +03:00
Maksim Kita
2c3abcaad1 Updated test 2021-04-14 16:49:38 +03:00
Alexey Milovidov
3b1adbfea4 Fix test 2021-04-14 16:48:12 +03:00
alesapin
c506e3218b Teaching jepsen to run external programs 2021-04-14 16:40:53 +03:00
Anton Popov
236ab68724 ColumnSparse: several fixes 2021-04-14 16:20:05 +03:00
songenjie
ffd3b3d445 fix some docs 2021-04-14 21:15:53 +08:00
alexey-milovidov
496c2e45d0
Merge pull request #23036 from Enmk/fix_extractAllGroupsHorizontal_max_matches
Fixed erroneus failure of extractAllGroupsHorizontal on large columns
2021-04-14 15:57:19 +03:00
songenjie
382f702f59 test add param date 2021-04-14 20:04:59 +08:00
Ivan
2b78765957
Merge branch 'master' into postgresql-protocol-with-row-policy 2021-04-14 14:50:28 +03:00
Christian
969b63d1ac
Excludes views from syncing in MaterializeMySQL (#22760)
* Excludes views from syncing in MaterializeMySQL

* Adds integration test for ignoring MySQL views on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Fixes bug in initial integration test for excluding views from replicating to ClickHouse on initial replication

* Replace assert with check_query

Co-authored-by: Christian Frøystad <christian@securepractice.no>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
2021-04-14 14:19:07 +03:00
alexey-milovidov
f8ce5547aa
Merge pull request #21318 from azat/servers-pool-wait
Fix SIGSEGV by waiting servers thread pool
2021-04-14 14:15:07 +03:00
Alexander Tokmakov
c34e27ed1c fix test 2021-04-14 14:07:56 +03:00
alexey-milovidov
d3f8a9c23a
Merge pull request #23044 from ClickHouse/array-has-any-all-generic
Fix unfinished code in GatherUtils #20272
2021-04-14 13:57:30 +03:00
alexey-milovidov
35260089e0
Merge pull request #23040 from ClickHouse/remove-useless-parts-from-suggest
Remove non-essential parts from Suggest
2021-04-14 13:55:25 +03:00
alexey-milovidov
86e20905e5
Merge pull request #23008 from ClickHouse/add-test-2719
Add a test for #2719
2021-04-14 13:54:36 +03:00
songenjie
2534ed84d5 test_fetch_partition_from_auxiliary_zookeeper 2021-04-14 18:40:15 +08:00
tavplubix
caf97d297b
Update arcadia_skip_list.txt 2021-04-14 12:17:41 +03:00
alesapin
a893cd3fe6 Integrating into jepsen 2021-04-14 12:01:33 +03:00
Nikita Mikhaylov
c0ed151239
Merge pull request #22012 from nikitamikhaylov/s3-distributed
Table function `s3Cluster`
2021-04-14 10:23:43 +03:00
songenjie
96a95b05db fix suggests 2021-04-14 10:14:13 +08:00
songenjie
f731739fab fix suggests 2021-04-14 10:05:41 +08:00
Alexey Milovidov
f2984beeac Merge branch 'master' into remove-msan-suppressions-5 2021-04-14 01:18:28 +03:00
Alexey Milovidov
311011caf8 Merge branch 'remove-useless-parts-from-suggest' of github.com:yandex/ClickHouse into remove-useless-parts-from-suggest 2021-04-14 01:08:32 +03:00
Alexey Milovidov
58281eadc0 Mark test as long 2021-04-14 01:08:09 +03:00
tavplubix
5df608a11b
Merge pull request #23043 from ClickHouse/improve_hung_check
Improve hung check in Stress tests
2021-04-14 00:29:52 +03:00
Vasily Nemkov
77bdb5b391 Fixed erroneus failure of extractAllGroupsHorizontal on large columns 2021-04-14 00:17:06 +03:00
Alexey Milovidov
4914860f91 Fix style 2021-04-13 22:41:07 +03:00
Nikita Mikhaylov
a15757a9c9 better renaming 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
507cb8514a review fixes 2021-04-13 22:39:43 +03:00
Nikita Mikhaylov
7c2b662e28 delete file 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
4465a0627f better 2021-04-13 22:39:42 +03:00
Nikita Mikhaylov
efef179b89 remove prints 2021-04-13 22:39:42 +03:00