Commit Graph

62349 Commits

Author SHA1 Message Date
alexey-milovidov
066a4daf5f
Update adopters.md 2021-04-20 22:48:03 +03:00
Kseniia Sumarokova
3b9e6dd978
Merge pull request #23352 from kssenii/fix-hdfs-virtual-columns
Add test for #12077
2021-04-20 22:02:42 +03:00
Kseniia Sumarokova
f9291d7624
Merge branch 'master' into fix-hdfs-virtual-columns 2021-04-20 22:01:32 +03:00
alexey-milovidov
4c1022ac03
Merge pull request #23318 from kssenii/fix-hdfs-with-spaces
Fix hdfs reading from files with spaces
2021-04-20 21:48:41 +03:00
alexey-milovidov
db51ef8012
Merge pull request #23264 from azat/tests-artifacts-trace_log
Add trace_log into stateless/stress test artifacts
2021-04-20 21:44:30 +03:00
tavplubix
70c89eeff6
Merge pull request #23200 from ClickHouse/fix_prewhere_in_materialize_mysql
Fix prewhere in MaterializeMySQL
2021-04-20 20:05:07 +03:00
tavplubix
738d8a757b
Merge pull request #23189 from ClickHouse/minor_fixes_in_attach_query
Minor fixes in ATTACH query
2021-04-20 20:04:26 +03:00
Nikita Mikhaylov
16e7715039
Merge pull request #23202 from nikitamikhaylov/with_names_use_header_bug
`CSVWithNames` with `input_format_with_names_use_header=0`
2021-04-20 20:00:57 +03:00
alexey-milovidov
632a5288fa
Merge pull request #23348 from azat/zero-streams
Fix LOGICAL_ERROR for max_distributed_connections=0
2021-04-20 19:48:21 +03:00
alexey-milovidov
cbbff1bc4b
Merge pull request #23319 from ClickHouse/mysql-insert-without-database
Allow to INSERT into remote MySQL storage with empty database #19281
2021-04-20 19:30:44 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Anton Popov
3d390b095a
regenerate ya.make 2021-04-20 18:58:53 +03:00
Nikita Mikhaylov
53ea92d89c better 2021-04-20 18:22:06 +03:00
Nikita Mikhaylov
fc01b5b951
Update 01818_input_format_with_names_use_header.sh 2021-04-20 16:46:18 +03:00
alexey-milovidov
733f9900fa
Merge pull request #23335 from ClickHouse/fix-flaky-test-1666
Fix flaky test 01666_merge_tree_max_query_limit.sh
2021-04-20 16:31:50 +03:00
alexey-milovidov
f99a58bfc3
Merge pull request #23317 from ClickHouse/fix-bad-test-max_distributed_connections
Fix bad test 01602_max_distributed_connections
2021-04-20 16:25:04 +03:00
Nikita Mikhaylov
08839bc203
Merge pull request #23197 from nikitamikhaylov/read-task-response
Fix logical error in stress tests
2021-04-20 16:09:25 +03:00
tavplubix
bef0ab182e
Merge branch 'master' into fix_prewhere_in_materialize_mysql 2021-04-20 15:38:48 +03:00
tavplubix
d9ef1a9368
Update src/Storages/StorageMaterializeMySQL.cpp
Co-authored-by: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2021-04-20 15:38:02 +03:00
alexey-milovidov
a25e6d96a5
Update quantiletdigest.md 2021-04-20 15:10:34 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
Anton Popov
8f57141fad
Merge pull request #23195 from CurtizJ/nested-update
Merging #22503
2021-04-20 14:57:47 +03:00
Alexander Tokmakov
4108a235f5 make separate functions 2021-04-20 14:22:02 +03:00
Maksim Kita
1bdd699f20
Merge pull request #23332 from ClickHouse/add-test-7815
Add test for #7815
2021-04-20 12:02:50 +03:00
kssenii
f4d663bc56 Add test 2021-04-20 08:38:14 +00:00
kssenii
da7a4ac1ea Better 2021-04-20 07:53:55 +00:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
Azat Khuzhin
86069ffb40 Fix LOGICAL_ERROR for max_distributed_connections=0 2021-04-20 09:05:44 +03:00
Azat Khuzhin
2575d03a33 Add trace_log into stateless/stress test artifacts 2021-04-20 08:03:29 +03:00
alexey-milovidov
82b6f49516
Merge pull request #23321 from den-crane/patch-15
add check that p.pruning works
2021-04-20 05:59:45 +03:00
Anton Popov
0a0c510aa2 minor fixes 2021-04-20 05:51:07 +03:00
Alexey Milovidov
e60af08ce3 Fix flaky test 01666_merge_tree_max_query_limit.sh 2021-04-20 04:29:19 +03:00
alexey-milovidov
218cb71552
Merge pull request #23302 from Algunenano/fix_keeper_bench_linkage
Link keeper-bench to clickhouse_common_zookeeper
2021-04-20 04:20:11 +03:00
alexey-milovidov
af2499359b
Merge pull request #23334 from ClickHouse/revert-22609-datasketches-uniq
Revert "add uniqThetaSketch"
2021-04-20 03:37:19 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
alexey-milovidov
3381d0dce9
Update 01602_max_distributed_connections.sh 2021-04-20 03:20:36 +03:00
Alexey Milovidov
8ef84eeaa1 Add test for #7815 2021-04-20 03:16:39 +03:00
robot-clickhouse
db82e9e3d5 Auto version update to [21.6.1.1] [54451] 2021-04-20 01:48:20 +03:00
robot-clickhouse
a584d78f19 Auto version update to [21.5.1.6601] [54450] 2021-04-20 01:45:38 +03:00
Alexey Milovidov
ac68dd8e97 Fix bad code; allow to INSERT into MySQL without database name 2021-04-20 00:29:37 +03:00
Azat Khuzhin
6fba6f7ddd Disable min_bytes_to_use_mmap_io by default
Reading files using mmap() does not have any significant benefits over
plain read() [1].

  [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574

And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].

  [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb

TL;DR;

Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).

And as an adddition to #23211 there was #23212, that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Denny Crane
1dbbe2d075
add check that p.pruning works 2021-04-19 18:06:54 -03:00
Alexey Milovidov
feae382273 Fix mistake 2021-04-19 23:39:25 +03:00
kssenii
bb767b66d5 Add integration test 2021-04-19 20:39:22 +00:00
Alexey Milovidov
f492495507 Allow to INSERT into remote MySQL storage with empty database #19281 2021-04-19 23:36:13 +03:00
Alexey Milovidov
4ad4dbbc09 Regenerate Arcadia 2021-04-19 23:26:23 +03:00
alexey-milovidov
c87f846816
Merge pull request #21938 from azat/connection-settings
Apply idle_connnection_timeout/poll_interval after each query
2021-04-19 22:58:21 +03:00
alexey-milovidov
5b66086bc9
Merge pull request #23219 from azat/optimize_skip_unused_shards_rewrite_in-fix
Add type conversion for optimize_skip_unused_shards_rewrite_in
2021-04-19 22:45:35 +03:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef
Add -Wundef for gcc builds
2021-04-19 22:45:22 +03:00
kssenii
cc5f49fbee Fix 2021-04-19 19:43:22 +00:00