Commit Graph

8119 Commits

Author SHA1 Message Date
Amos Bird
32c84f77c3
Resurrect indexHint function. 2021-04-20 19:27:23 +08:00
Maksim Kita
1bdd699f20
Merge pull request #23332 from ClickHouse/add-test-7815
Add test for #7815
2021-04-20 12:02:50 +03:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
alexey-milovidov
82b6f49516
Merge pull request #23321 from den-crane/patch-15
add check that p.pruning works
2021-04-20 05:59:45 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
Alexey Milovidov
8ef84eeaa1 Add test for #7815 2021-04-20 03:16:39 +03:00
Denny Crane
1dbbe2d075
add check that p.pruning works 2021-04-19 18:06:54 -03:00
alexey-milovidov
5b66086bc9
Merge pull request #23219 from azat/optimize_skip_unused_shards_rewrite_in-fix
Add type conversion for optimize_skip_unused_shards_rewrite_in
2021-04-19 22:45:35 +03:00
alexey-milovidov
f1706223be
Merge pull request #23275 from ClickHouse/fix-tests-hedged-requests
Fix integration tests for Hedged requests
2021-04-19 21:10:23 +03:00
Alexander Kuzmenkov
6f90fc449b
Merge pull request #23308 from ClickHouse/aku/fix-perf
fix broken perf test
2021-04-19 20:31:38 +03:00
Nikolai Kochetov
c59628846c
Merge pull request #22352 from ClickHouse/add-read-from-mt-step
Special query plan step for read from MergeTree
2021-04-19 17:38:40 +03:00
tavplubix
b61a24634f
Merge pull request #23304 from ClickHouse/test_print_errors_on_db_creation
Print errors on db creation in clickhouse-test
2021-04-19 17:10:23 +03:00
Alexander Kuzmenkov
d9d94752d1 fix broken perf test 2021-04-19 17:05:47 +03:00
Alexander Kuzmenkov
dd55fd8954
Merge pull request #23201 from ClickHouse/aku/negate-stable-formatting
more stable formatting for negate()
2021-04-19 16:48:43 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Alexander Tokmakov
51d2932fe8 print errors on db creation in clickhouse-test 2021-04-19 14:03:20 +03:00
Pavel Kruglov
8f1b507386 Fix test_secure_socket and remove redundant settings in hedged tests 2021-04-19 11:46:42 +03:00
alesapin
14800f0c52
Merge pull request #23038 from ClickHouse/keeper_bench_mark
Add tool for [Zoo]Keeper benchmark
2021-04-19 10:47:29 +03:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq
add uniqThetaSketch
2021-04-19 10:32:29 +03:00
Vladimir
e4e2b04c53
Merge pull request #23112 from Jokser/disk-s3-restore-to-detached 2021-04-19 10:29:00 +03:00
Nikolai Kochetov
4d86f51eff Merge branch 'master' into add-read-from-mt-step 2021-04-19 10:17:21 +03:00
Maksim Kita
2f56f8d040
Merge pull request #23278 from kitaisreal/to-date-time-decimal-overflow-ubsan-fix
Function toDateTime decimal overflow ubsan fix
2021-04-19 10:12:24 +03:00
TCeason
63403c709c modify settings name to external_xxx and rewrite Storage MySQL max_block_size 2021-04-19 10:51:50 +08:00
TCeason
472c131420 Add MySQL read history data bytes judgment 2021-04-19 10:51:50 +08:00
Maksim Kita
1bfd4f7568 Function toDateTime decimal overflow ubsan fix 2021-04-19 02:00:33 +03:00
alexey-milovidov
1d5a4cfa32
Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io" 2021-04-19 01:30:53 +03:00
Alexey Milovidov
3030db9043 Fix integration tests for Hedged requests 2021-04-19 01:28:03 +03:00
Maksim Kita
ca93987ae9
Merge pull request #23182 from kitaisreal/system-query-reload-model
Added system query reload model
2021-04-19 00:39:31 +03:00
Azat Khuzhin
d476a4a9bd Add type conversion for optimize_skip_unused_shards_rewrite_in
MSan reports [1]:

    2021.04.17 15:20:06.665152 [ 56 ] {2336bf92-0269-4acd-8b3f-f09623223d18} <Debug> executeQuery: (from [::1]:44744, using production parser) SELECT * FROM dist_01757 WHERE dummy IN ('255', 0) FORMAT Null
    ...
    0 0x305af885 in (anonymous namespace)::shardContains() obj-x86_64-linux-gnu/../src/Interpreters/OptimizeShardingKeyRewriteInVisitor.cpp:50:28
    ...
    Uninitialized value was created by an allocation of 'sharding_value' in the stack frame of function '_ZN12_GLOBAL__N_113shardContainsERKN2DB5FieldERKNSt3__112basic_stringIcNS4_11char_traitsIcEENS4_9allocatorIcEEEERKNS4_10shared_ptrINS0_17ExpressionActionsEEESC_RKNS0_7Cluster9ShardInfoERKNS4_6vectorImNS8_ImEEEE'
    0 0x305ae260 in (anonymous namespace)::shardContains() obj-x86_64-linux-gnu/../src/Interpreters/OptimizeShardingKeyRewriteInVisitor.cpp:42

  [1]: https://clickhouse-test-reports.s3.yandex.net/23212/d02eb3f6b7a8dc07bbed5605e1afcf7634436b3a/fuzzer_msan/report.html#fail1

P.S. fuzzers are great!
2021-04-19 00:03:38 +03:00
Maksim Kita
b26dfcd514 Simple key dictionary primary key wrong order fix 2021-04-18 15:19:44 +03:00
Maksim Kita
aa42150ebd Added integration test 2021-04-18 13:38:36 +03:00
alesapin
2035fb3edc Merge branch 'master' into keeper_bench_mark 2021-04-18 12:29:16 +03:00
alexey-milovidov
83038f84af
Revert "Function arrayFold for folding over array with accumulator" 2021-04-18 03:34:05 +03:00
alexey-milovidov
96fced4c3c
Merge pull request #23211 from azat/mmap-accounting
[RFC] Fix memory tracking with min_bytes_to_use_mmap_io
2021-04-18 03:17:30 +03:00
alexey-milovidov
7f3a40e1b0
Merge pull request #22237 from ClickHouse/protocol-compression-auto
Autodetect compression #22234
2021-04-18 03:13:54 +03:00
alexey-milovidov
75c4728787
Merge pull request #23229 from ClickHouse/unhex-case-insensitive1
Make function `unhex` case insensitive for compatibility
2021-04-17 23:32:03 +03:00
alexey-milovidov
212f68e279
Merge branch 'master' into fix-odbc 2021-04-17 21:29:03 +03:00
Kseniia Sumarokova
b0f6f214a2
Merge pull request #23216 from kssenii/test-odbc
Add test for fixed issue #9363
2021-04-17 21:27:50 +03:00
Alexey Milovidov
8ac953f459 Make function unhex case insensitive for compatibility 2021-04-17 19:31:35 +03:00
Alexey Milovidov
a790652029 Merge branch 'protocol-compression-auto' of github.com:yandex/ClickHouse into protocol-compression-auto 2021-04-17 16:47:13 +03:00
Alexey Milovidov
77e64b3ebd Merge branch 'master' into protocol-compression-auto 2021-04-17 16:46:51 +03:00
alexey-milovidov
572ba91593
Merge pull request #23184 from ianton-ru/fix_flapping_test
Fix flapping tests test_s3_zero_copy_replication
2021-04-17 16:14:42 +03:00
alexey-milovidov
138c6ae228
Merge pull request #23185 from ClickHouse/fix_22573
Fix data_type_default_nullable on ATTACH
2021-04-17 16:13:42 +03:00
alesapin
9fb3784f19 Merge branch 'master' into keeper_bench_mark 2021-04-17 15:58:33 +03:00
Azat Khuzhin
6bd32bd2cb Mark 01605_adaptive_granularity_block_borders as long 2021-04-17 13:50:52 +03:00
kssenii
5258cccdf7 Add test 2021-04-17 09:55:36 +00:00
kssenii
5dc2dfa437 Fix 2021-04-17 09:00:58 +00:00
Azat Khuzhin
a963fba41a Update 00084_external_aggregation to avoid using mmap 2021-04-17 10:37:58 +03:00
Azat Khuzhin
1b367ee71d Update 01605_adaptive_granularity_block_borders to avoid using mmap 2021-04-17 10:37:58 +03:00
Azat Khuzhin
6064f3ef1d Fix memory tracking with min_bytes_to_use_mmap_io
With min_bytes_to_use_mmap_io=1 memory regions for mmap() will not be
accounted. But this creates issues, since if you will run simple
"SELECT * FROM big_enough_table" it will mmap lot's of files and the
process RSS will grow at some point, and before the kernel will
understand that it needs to unmap physical pages the clickhouse-server
will sync total_memory_tracker with RSS of the process and the
allocations will fail by per-server memory limits.

Also note, that this does not address all the issues with mmap()
regions.

v2: move track/untrack into the MMapReadBufferFromFileWithCache to avoid
data-race [1]

  [1]: https://clickhouse-test-reports.s3.yandex.net/23211/6acf6cb9b22cee7db8d1aa523a6208f63e792f7a/functional_stateful_tests_(thread).html#fail1
2021-04-17 10:37:38 +03:00