Commit Graph

12950 Commits

Author SHA1 Message Date
Vladimir Chebotarev
3911ef40e1 Added singletons to quantileTDigest. 2021-04-26 10:21:05 +03:00
Vladimir Chebotarev
7cac69c9a2 Removed perfect aggregation in quantileTDigest. 2021-04-26 10:21:05 +03:00
tavplubix
fc2e2848bf
Merge pull request #23413 from TCeason/modify_MaterializeMySQL_var_check
modify MaterializeMySQL check MySQL var logical
2021-04-26 09:52:59 +03:00
Maksim Kita
6e3efee28c Updated HashMap functions 2021-04-26 01:36:47 +03:00
Maksim Kita
cac4a85286 Aggregator remove unused code 2021-04-26 01:17:24 +03:00
Azat Khuzhin
a4036a8199 Correctly stop ParallelFormattingOutputFormat from StorageS3BlockOutputStream 2021-04-25 12:49:57 +03:00
Azat Khuzhin
18575c4433 Avoid flushing of BlockOutputStream from destructor
That may lead to uncaught exception [1].

  [1]: https://github.com/ClickHouse/ClickHouse/pull/21624#issuecomment-808066747

v0: New method BlockOutputStream::finalize() -- bad (forgot some places
    and superfluous)
v2: Flush BlockOutputStream in QueryStatus::releaseQueryStreams()
    Safer query termination (report some uncaugh errors to user)
v3: Flush BlockOutputStream from TCPHandler only
    Other places uses different executeQuery() implementation
v4: Do not call writeSuffix() twice
2021-04-25 12:49:44 +03:00
Azat Khuzhin
6ebe4e7dbb Do not silently catch errors for writing to S3 2021-04-25 12:47:30 +03:00
Azat Khuzhin
7a8da84eee Respect lock_acquire_timeout_for_background_operations for OPTIMIZE 2021-04-25 10:12:15 +03:00
alexey-milovidov
3cf18d8a5f
Merge pull request #23610 from ClickHouse/bad-like
Fix error in LIKE (found by SQLancer)
2021-04-25 08:01:07 +03:00
alexey-milovidov
6191f30892
Merge pull request #23595 from azat/fuzzer-tupleElement-formatting
Fix inconsistent formatting for tupleElement (for fuzzer)
2021-04-25 04:03:39 +03:00
Alexey Milovidov
263378bb20 Fix error in LIKE (found by SQLancer) 2021-04-25 03:58:44 +03:00
alexey-milovidov
1ffa63b20a
Merge pull request #23598 from ClickHouse/paths-with-whitespaces
Somewhat better handling of paths in CMake (incomplete)
2021-04-25 01:58:28 +03:00
alexey-milovidov
d13d543811
Merge pull request #23600 from ClickHouse/reproducible-build-2
Avoid possible build dependency on locale and filesystem order
2021-04-25 01:55:28 +03:00
Azat Khuzhin
a5a8ecfe42 Fix inconsistent formatting for tupleElement (for fuzzer)
fuzzer sometimes [1] may inserts tupleElement() created from ASTLiteral:

    Function_tupleElement, 0xx
    -ExpressionList_, 0xx
    --Literal_Int64_255, 0xx
    --Literal_Int64_100, 0xx

And in this case it will be printed as "255.100", which
later will be parsed as float, and formatting will be
inconsistent.

So instead of printing it as regular tuple,
let's print it as ExpressionList instead (i.e. with ", " delimiter).

Simple reproducer:

    void ast()
    {
        auto arg1 = std::make_shared<ASTLiteral>(Field(255));
        auto arg2 = std::make_shared<ASTLiteral>(Field(100));

        auto func = makeASTFunction("tupleElement", arg1, arg2);

        auto ast = func;
        std::cerr << ast->formatForErrorMessage() << std::endl;
        std::cerr << ast->dumpTree() << std::endl;
    }

  [1]: https://clickhouse-test-reports.s3.yandex.net/23517/f1187aeb69109c88f0be978b8083080c7a843820/fuzzer_debug/report.html#fail1
2021-04-25 00:30:17 +03:00
Alexey Milovidov
2d3623b011 Remove build dependency on CMAKE_SYSTEM_NAME 2021-04-24 23:05:08 +03:00
Alexey Milovidov
3705dbfabc Avoid possible build dependency on locale and filesystem order 2021-04-24 23:01:07 +03:00
Alexey Milovidov
6f05c447ad Remove old trash 2021-04-24 22:54:44 +03:00
Alexey Milovidov
4ff812db7f Maybe better support for paths with whitespaces 2021-04-24 22:47:52 +03:00
alexey-milovidov
280c0666a5
Merge pull request #23559 from ClickHouse/reproducible-build
Reproducible build
2021-04-24 21:26:31 +03:00
alexey-milovidov
cae5260817
Update KeyCondition.cpp 2021-04-24 05:34:35 +03:00
alexey-milovidov
20e897bc5a
Merge pull request #23301 from ClickHouse/fix_race_in_deduplication
Deduplication: check block version on removal
2021-04-24 04:59:00 +03:00
alexey-milovidov
bcede10919
Merge pull request #23312 from vdimir/issue-23002
Correct sample_block in HashJoin for dict join with join_algorithm
2021-04-24 04:40:43 +03:00
alexey-milovidov
2cfc2c8825
Merge pull request #23397 from CurtizJ/better-move-to-prewhere
Allow to move more conditions to PREWHERE
2021-04-24 04:39:33 +03:00
mergify[bot]
a5da512e39
Merge branch 'master' into pid 2021-04-24 00:37:39 +00:00
alexey-milovidov
c66e715f49
Merge pull request #23433 from ClickHouse/tavplubix-patch-1
Fix `Cannot unlink file` in `dropIfEmpty()` with multidisk confuguration
2021-04-24 03:34:06 +03:00
alexey-milovidov
cd1f14ba61
Update MergeTreeData.cpp 2021-04-24 03:33:56 +03:00
alexey-milovidov
41ed8aab59
Merge pull request #23459 from CurtizJ/fix-replacing
Fix corner cases in vertical merges with ReplacingMergeTree
2021-04-24 03:30:44 +03:00
alexey-milovidov
ca230224cf
Merge pull request #23549 from vdimir/issue-17718
Remove clashed columns from totals for StorageJoin
2021-04-24 03:19:00 +03:00
Alexey Milovidov
4648782a05 Remove build date from system.build_options 2021-04-24 02:10:32 +03:00
kssenii
3a9b11e141 Add check for columns sizes match 2021-04-23 19:09:09 +00:00
kssenii
d032651aba Try fix 2021-04-23 17:29:22 +00:00
Alexander Kuzmenkov
9f50b1855f
Merge pull request #23520 from ClickHouse/aku/pvs
fix pvs warnings
2021-04-23 18:55:48 +03:00
Russ Frank
bc8581a4f0 fix style 2021-04-23 11:51:40 -04:00
Alexander Kuzmenkov
ab75f86ee9 add a comment 2021-04-23 18:45:45 +03:00
Alexander Kuzmenkov
6982ab5324 fix extra distinct 2021-04-23 15:44:46 +03:00
kssenii
7c3b074891 Better 2021-04-23 12:40:34 +00:00
vdimir
9460989721
Remove clashed columns from totals for StorageJoin 2021-04-23 15:37:05 +03:00
kssenii
8f34199538 Fixes 2021-04-23 12:36:40 +00:00
Alexander Kuzmenkov
9d95ac3d66 remove debug 2021-04-23 14:00:17 +03:00
Alexander Kuzmenkov
54ad086753 fix for distributed 2021-04-23 13:59:21 +03:00
kssenii
54a7a6ef0d Allow null to default convertion only if column has default 2021-04-23 09:55:57 +00:00
Alexander Kuzmenkov
1fe3fd864e Merge remote-tracking branch 'origin/master' into HEAD 2021-04-23 10:41:35 +03:00
Alexander Kuzmenkov
ce0a58f86f ignore empty input chunks generated by joins 2021-04-23 10:37:47 +03:00
Alexander Kuzmenkov
7ea5bd4a3f Merge remote-tracking branch 'origin/master' into HEAD 2021-04-23 09:26:43 +03:00
Kseniia Sumarokova
566db34cca
Merge pull request #23452 from kssenii/rabbitmq-allow-multiple-hosts
Allow rabbitmq vhost in table settings
2021-04-23 01:29:55 +03:00
kssenii
459612c895 Use a separate setting 2021-04-22 22:14:14 +00:00
kssenii
3176c24a8a Add test 2021-04-22 21:46:49 +00:00
kssenii
28c4436246 Better 2021-04-22 21:30:31 +00:00
Maksim Kita
2b822d896d
Merge pull request #23501 from kitaisreal/join-to-subqueries-columns-matcher-fix
JoinToSubqueriesVisitor ASTColumnsMatcher fix
2021-04-23 00:24:53 +03:00
Maksim Kita
f27002b1be
Merge pull request #23483 from hexiaoting/dev_alter_bugfix
Fix bug when modify column without type
2021-04-23 00:24:36 +03:00
Russ Frank
2e56bc2599 dont only add sum if edge difference is >0 2021-04-22 16:43:41 -04:00
Russ Frank
ce31a6e830 remove trailing whitespace 2021-04-22 16:41:20 -04:00
Alexander Kuzmenkov
59eb220886 fix 2021-04-22 23:27:51 +03:00
Alexander Kuzmenkov
06ca44a378 fix pvs warnings 2021-04-22 22:54:58 +03:00
Russ Frank
de0155cf27 finish merge 2021-04-22 15:46:22 -04:00
Alexander Kuzmenkov
35459a0228
Update FormatFactory.cpp 2021-04-22 21:48:06 +03:00
kssenii
ac55183d2e Null as default for insert select / with union 2021-04-22 18:11:36 +00:00
Russ Frank
41546e0d4f Merge branch 'master' of github.com:ClickHouse/ClickHouse into rf/deltasum-with-timestamp 2021-04-22 11:23:24 -04:00
Russ Frank
1041bce10f add allocates in arena method 2021-04-22 11:22:21 -04:00
Maksim Kita
7357c35197 Fixed code review issues 2021-04-22 17:19:47 +03:00
Maksim Kita
8fde34fc52 Updated tests 2021-04-22 16:23:42 +03:00
kssenii
5857abc844 Fix clang tidy 2021-04-22 12:46:03 +00:00
kssenii
b37479ce29 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into globs-for-url 2021-04-22 11:42:47 +00:00
Maksim Kita
ceaf6d57b7
Merge pull request #23393 from ClickHouse/revert-17359
Revert argMin/Max for single Tuple argument.
2021-04-22 13:32:04 +03:00
Maksim Kita
86ffa9fcfa JoinToSubqueriesVisitor ASTColumnsMatcher fix 2021-04-22 13:14:35 +03:00
Kruglov Pavel
f125db243e
Merge pull request #23437 from rf/rf/deltasum-condition-fix
`deltaSum` aggregate function counter reset bugfix & test
2021-04-22 10:37:41 +03:00
kssenii
06730743e6 Fix clang tidy 2021-04-22 07:37:20 +00:00
mergify[bot]
29b605b4ea
Merge branch 'master' into rabbitmq-allow-multiple-hosts 2021-04-22 07:32:43 +00:00
mergify[bot]
71bca99bbf
Merge branch 'master' into explain-output 2021-04-22 07:02:47 +00:00
hexiaoting
d24946f475 Fix bug when modify column without type 2021-04-22 14:48:57 +08:00
alexey-milovidov
3df3acc970
Merge pull request #23458 from kitaisreal/system-dictionaries-virtual-key-column
System dictionaries virtual key column
2021-04-22 08:42:15 +03:00
alexey-milovidov
8134c270a2
Merge pull request #23456 from kitaisreal/cast-to-array-from-empty-array
Cast to array from empty array
2021-04-22 08:41:35 +03:00
alexey-milovidov
1fcf198cec
Merge pull request #23415 from godliness/fix-kafka-with-arrow
Fix kafka storage does not work with arrow and arrowstream format messages
2021-04-22 04:59:31 +03:00
Anton Popov
3548e31afd fix corner cases in vertical merges with ReplacingMergeTree 2021-04-22 01:27:18 +03:00
Maksim Kita
7168b3a04c Table system.dictionaries added virtual key column 2021-04-22 01:16:03 +03:00
Maksim Kita
ddcffcb723 Fixed tests 2021-04-22 00:19:01 +03:00
kssenii
bb6bc61f22 Fix checks 2021-04-21 19:53:38 +00:00
Russ Frank
53f6a8f9a0 Merge remote-tracking branch 'origin/master' into rf/deltasum-with-timestamp 2021-04-21 13:52:50 -04:00
Maksim Kita
631d870ae3 Cast to array from empty array 2021-04-21 20:29:49 +03:00
kssenii
473903b396 Fix typos check 2021-04-21 17:09:01 +00:00
kssenii
b0bdb6b323 Fix build 2021-04-21 16:17:45 +00:00
kssenii
2e6c753add Allow separate vhost for each table 2021-04-21 15:51:05 +00:00
kssenii
8453c60200 Better check 2021-04-21 14:54:52 +00:00
kssenii
c1151cea23 Add failover 2021-04-21 14:39:51 +00:00
Russ Frank
822fc9b110 deltasum counter reset bugfix & test 2021-04-21 09:52:53 -04:00
Nikita Mikhaylov
d4e8f9676b
Merge pull request #21304 from amosbird/indexhint
Resurrect indexHint function.
2021-04-21 16:14:43 +03:00
mergify[bot]
7da7279390
Merge branch 'master' into fix_create_drop_replica_race 2021-04-21 13:03:29 +00:00
alexey-milovidov
34b30d80d4
Update StorageReplicatedMergeTree.cpp 2021-04-21 16:01:54 +03:00
tavplubix
1a776b47a7
Update MergeTreeData.cpp 2021-04-21 15:34:42 +03:00
kssenii
4c4f765aba Globs for url table function 2021-04-21 12:32:57 +00:00
alexey-milovidov
20a5fed53e
Merge pull request #23392 from ClickHouse/fix-4854
Keep default timezone on DateTime operations if it was not provided explicitly #4854
2021-04-21 15:00:59 +03:00
alexey-milovidov
9c649932bc
Merge pull request #23375 from ClickHouse/fix-read-in-order-with-collation
Fix read in order optimization of COLLATE is present #22379
2021-04-21 15:00:02 +03:00
Chao Ma
713eb9486c Fix kafka storage does not work with arrow and arrowstream format messages 2021-04-21 19:44:09 +08:00
Pavel Kovalenko
37c637cc34 Minor fixes. 2021-04-21 13:34:07 +03:00
Pavel Kovalenko
2ab8013455 DiskRestartProxy improvements and tests. 2021-04-21 12:53:46 +03:00
Nikolai Kochetov
9e943f4fad Fix ya.make 2021-04-21 08:50:42 +03:00
Nikolai Kochetov
44112587d4
Merge pull request #23309 from ClickHouse/try-fix-crash-with-unknown-packet
Fix crash in case of unknown packet
2021-04-21 08:47:17 +03:00
Nikolai Kochetov
9ec6fd1943
Merge pull request #23359 from ClickHouse/try-fix-23029
Fix #23029
2021-04-21 08:46:21 +03:00
Amos Bird
096d76627e
Skip unavaiable shards when writing to distributed tables 2021-04-21 10:30:40 +08:00
Amos Bird
50f2e488bd
Fix invalid virtual column expr 2021-04-21 10:29:03 +08:00
TCeason
51fe9fc771 modify MaterializeMySQL check MySQL var logical
Supprot for MySQL 5.7.9: https://github.com/ClickHouse/ClickHouse/issues/4006#issuecomment-817622685
2021-04-21 10:16:04 +08:00
Anton Popov
a83a07246e allow to move more conditions to PREWHERE 2021-04-21 01:03:58 +03:00
Maksim Kita
02515ff0a4
Merge pull request #23191 from kitaisreal/use-local-shard-if-no-remote-connections
Updated QueryAliasVisitor to prefer alias for aliases like _subquery
2021-04-21 00:58:47 +03:00
Alexey Milovidov
054da0ea34 Revert #17359 2021-04-21 00:23:47 +03:00
Alexey Milovidov
502bc3575c Revert #17359 2021-04-21 00:22:29 +03:00
Alexey Milovidov
416efbacbb Keep default timezone on DateTime operations if it was not provided explicitly #4854 2021-04-21 00:08:06 +03:00
Pavel Kovalenko
9272237c7e Update DiskRestartProxy.cpp 2021-04-20 23:47:21 +03:00
Pavel Kovalenko
10cf881a08 Add SYSTEM RESTART DISK command. 2021-04-20 22:23:54 +03:00
Pavel Kovalenko
016a9c674b DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Pavel Kovalenko
98f8cbbdb2 DiskRestartProxy refactoring. 2021-04-20 21:58:34 +03:00
Pavel Kovalenko
e8b4dd1e4b Introduce DiskRestartProxy. 2021-04-20 21:55:57 +03:00
alexey-milovidov
4c1022ac03
Merge pull request #23318 from kssenii/fix-hdfs-with-spaces
Fix hdfs reading from files with spaces
2021-04-20 21:48:41 +03:00
Alexey Milovidov
9bc0706d2f Fix read in order optimization of COLLATE is present #22379 2021-04-20 21:20:45 +03:00
tavplubix
70c89eeff6
Merge pull request #23200 from ClickHouse/fix_prewhere_in_materialize_mysql
Fix prewhere in MaterializeMySQL
2021-04-20 20:05:07 +03:00
tavplubix
738d8a757b
Merge pull request #23189 from ClickHouse/minor_fixes_in_attach_query
Minor fixes in ATTACH query
2021-04-20 20:04:26 +03:00
Nikita Mikhaylov
16e7715039
Merge pull request #23202 from nikitamikhaylov/with_names_use_header_bug
`CSVWithNames` with `input_format_with_names_use_header=0`
2021-04-20 20:00:57 +03:00
alexey-milovidov
632a5288fa
Merge pull request #23348 from azat/zero-streams
Fix LOGICAL_ERROR for max_distributed_connections=0
2021-04-20 19:48:21 +03:00
alexey-milovidov
cbbff1bc4b
Merge pull request #23319 from ClickHouse/mysql-insert-without-database
Allow to INSERT into remote MySQL storage with empty database #19281
2021-04-20 19:30:44 +03:00
alexey-milovidov
a311a5c0b5
Merge pull request #23322 from azat/disable-min_bytes_to_use_mmap_io
Disable min_bytes_to_use_mmap_io by default
2021-04-20 19:27:47 +03:00
Anton Popov
3d390b095a
regenerate ya.make 2021-04-20 18:58:53 +03:00
Nikolai Kochetov
6b264933b2 Fix style. 2021-04-20 17:51:48 +03:00
Nikolai Kochetov
c808ffb04c
Update Pipe.cpp 2021-04-20 17:36:45 +03:00
Nikolai Kochetov
ecb2a96af8 Revert "Enable async_socket_for_remote"
This reverts commit ff908baa06.
2021-04-20 17:14:54 +03:00
Nikolai Kochetov
bc5b34fb6b
Update Pipe.cpp
Add comment.
2021-04-20 16:53:28 +03:00
Nikolai Kochetov
942cd54f23 Fix copy paste thanks to PVS studio. 2021-04-20 16:41:37 +03:00
Nikolai Kochetov
9632b83bdf Support explain json = 1, indexes = 1. Added test. 2021-04-20 16:39:23 +03:00
Nikita Mikhaylov
08839bc203
Merge pull request #23197 from nikitamikhaylov/read-task-response
Fix logical error in stress tests
2021-04-20 16:09:25 +03:00
tavplubix
bef0ab182e
Merge branch 'master' into fix_prewhere_in_materialize_mysql 2021-04-20 15:38:48 +03:00
tavplubix
d9ef1a9368
Update src/Storages/StorageMaterializeMySQL.cpp
Co-authored-by: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2021-04-20 15:38:02 +03:00
Nikita Mikhaylov
f55eacee7d
Merge pull request #22988 from excitoon-favorites/s3connectionresetretries
Retries on HTTP connection drops during reads from S3
2021-04-20 14:59:21 +03:00
Anton Popov
8f57141fad
Merge pull request #23195 from CurtizJ/nested-update
Merging #22503
2021-04-20 14:57:47 +03:00
Nikolai Kochetov
5e589ca6b2 Try fix #23029 2021-04-20 14:55:23 +03:00
Amos Bird
32c84f77c3
Resurrect indexHint function. 2021-04-20 19:27:23 +08:00
Alexander Tokmakov
4108a235f5 make separate functions 2021-04-20 14:22:02 +03:00
Maksim Kita
457b75a196 Updated tests 2021-04-20 13:31:01 +03:00
Maksim Kita
cbc34afd55 Updated QueryAliasVisitor to set prefer_alias_to_column_name for aliases like _subquery 2021-04-20 13:16:29 +03:00
vdimir
3266bbb54c
TableJoin: forceHashJoin for dictionary_reader, add tests 2021-04-20 12:52:52 +03:00
Nikolai Kochetov
c0514f439c Fix spelling 2021-04-20 11:26:54 +03:00
kssenii
da7a4ac1ea Better 2021-04-20 07:53:55 +00:00
Kseniia Sumarokova
b43656bf89
Merge pull request #22697 from TCeason/feature/add_MaterializeMySQL_sync_bytes_judgment
Add MySQL read history data bytes judgment
2021-04-20 10:26:42 +03:00
Nikolai Kochetov
0c4e789900 Remove debug output 2021-04-20 10:08:35 +03:00
Amos Bird
d5f606c544
Another fix 2021-04-20 14:15:28 +08:00
Azat Khuzhin
86069ffb40 Fix LOGICAL_ERROR for max_distributed_connections=0 2021-04-20 09:05:44 +03:00
Nikolai Kochetov
17f7631878 Fix build. 2021-04-20 08:55:20 +03:00
Nikolai Kochetov
548fb52d24 Fix build. 2021-04-20 08:51:51 +03:00
Anton Popov
0a0c510aa2 minor fixes 2021-04-20 05:51:07 +03:00
alexey-milovidov
62899436db
Revert "add uniqThetaSketch" 2021-04-20 03:34:21 +03:00
robot-clickhouse
db82e9e3d5 Auto version update to [21.6.1.1] [54451] 2021-04-20 01:48:20 +03:00
Russ Frank
4a742a17be feedback on deltasumtimestamp 2021-04-19 18:28:31 -04:00
Alexey Milovidov
ac68dd8e97 Fix bad code; allow to INSERT into MySQL without database name 2021-04-20 00:29:37 +03:00
Azat Khuzhin
6fba6f7ddd Disable min_bytes_to_use_mmap_io by default
Reading files using mmap() does not have any significant benefits over
plain read() [1].

  [1]: https://gist.github.com/azat/3d6c8d82bdd91e7a38d997fd6bcfd574

And not only it does not have significant benefits, it also has some
issues, due to max_server_memory_usage (default to 90% of available
RAM), since when you read files with mmap() eventually process RSS may
exceed max_server_memory_usage, and in this case any allocation will
fail (with "Memory limit exceeded (total)") error (yes kernel will
unload pages, but likely it will happens after queries will starting to
fail), like in this test [2].

  [2]: https://gist.github.com/azat/4813489828162e6c2ce131963c6a1acb

TL;DR;

Note that there was also an idea to take those mmap()'ed regions in
memory tracking (#23211), but there are some drawbacks (since accounting
mmap() is tricky, first of all you need to account only once per inode
for file and plus kernel can unload some pages and those memory will not
be used by the server anymore).

And as an adddition to #23211 there was #23212, that adds
max_bytes_to_use_mmap_io, but since mmap is not a subject for memory
accounting there is no need in it.
2021-04-20 00:25:16 +03:00
Alexey Milovidov
feae382273 Fix mistake 2021-04-19 23:39:25 +03:00
Alexey Milovidov
f492495507 Allow to INSERT into remote MySQL storage with empty database #19281 2021-04-19 23:36:13 +03:00
Alexey Milovidov
4ad4dbbc09 Regenerate Arcadia 2021-04-19 23:26:23 +03:00
alexey-milovidov
c87f846816
Merge pull request #21938 from azat/connection-settings
Apply idle_connnection_timeout/poll_interval after each query
2021-04-19 22:58:21 +03:00
alexey-milovidov
5b66086bc9
Merge pull request #23219 from azat/optimize_skip_unused_shards_rewrite_in-fix
Add type conversion for optimize_skip_unused_shards_rewrite_in
2021-04-19 22:45:35 +03:00
alexey-milovidov
4cef8c68f7
Merge pull request #23258 from azat/wundef
Add -Wundef for gcc builds
2021-04-19 22:45:22 +03:00
kssenii
cc5f49fbee Fix 2021-04-19 19:43:22 +00:00
Nikolai Kochetov
08d1896950 Fix build. 2021-04-19 22:06:05 +03:00
Nikolai Kochetov
394cca2434 Fix build. 2021-04-19 21:36:45 +03:00
Nikolai Kochetov
f6bdd35943 Try fix tests. 2021-04-19 20:55:18 +03:00
vdimir
a95c4dcfff
Correct sample_block in HashJoin for dict join with join_algorithm = auto 2021-04-19 18:02:56 +03:00
Nikolai Kochetov
8c2d58333a Merge branch 'master' into explain-output 2021-04-19 17:40:27 +03:00
Nikolai Kochetov
c59628846c
Merge pull request #22352 from ClickHouse/add-read-from-mt-step
Special query plan step for read from MergeTree
2021-04-19 17:38:40 +03:00
Nikolai Kochetov
ff908baa06 Enable async_socket_for_remote 2021-04-19 17:31:46 +03:00
Nikolai Kochetov
0420b7bb33 Reset replica state in MultiplexedConnections in case of exception. 2021-04-19 17:25:43 +03:00
Amos Bird
aeff06d67d
Don't relax NOT conditions during partition pruning. 2021-04-19 22:15:53 +08:00
Nikolai Kochetov
0c23d44b99 Add test. 2021-04-19 17:12:08 +03:00
Alexander Kuzmenkov
dd55fd8954
Merge pull request #23201 from ClickHouse/aku/negate-stable-formatting
more stable formatting for negate()
2021-04-19 16:48:43 +03:00
Alexander Kuzmenkov
2a4bcb6e3f
Merge pull request #23159 from ClickHouse/aku/merge-fusecount
merging sumCount fusion PR #21337
2021-04-19 16:47:13 +03:00
Nikita Mikhaylov
648b941922 done 2021-04-19 13:37:02 +00:00
Nikita Mikhaylov
adc103e338
Merge pull request #21852 from excitoon-favorites/s3stscredentials
Added insecure IMDS credentials provider for S3
2021-04-19 14:47:44 +03:00
Nikita Mikhaylov
6b928c4b6a
Merge pull request #23102 from godliness/read-orc-stripe
Read ORC file by stripe to reduce memory cost
2021-04-19 14:45:40 +03:00
Alexander Tokmakov
ecc625692e fix build 2021-04-19 13:40:20 +03:00
tavplubix
c9ebc95faf
Update ReplicatedMergeTreeCleanupThread.cpp 2021-04-19 13:27:32 +03:00
Alexander Tokmakov
539356b441 check block version on removal 2021-04-19 12:52:37 +03:00
Alexander Tokmakov
9bc98771f7 fix race on replica creation 2021-04-19 11:21:42 +03:00
Vladimir Chebotarev
9d4295f261 Removed infinite retries. 2021-04-19 11:02:36 +03:00
alesapin
14800f0c52
Merge pull request #23038 from ClickHouse/keeper_bench_mark
Add tool for [Zoo]Keeper benchmark
2021-04-19 10:47:29 +03:00
TCeason
b4bf53dfc9 add some comment and modify a parameter type 2021-04-19 15:34:27 +08:00
Kruglov Pavel
995973bf1f
Merge pull request #22609 from pingyu/datasketches-uniq
add uniqThetaSketch
2021-04-19 10:32:29 +03:00
Vladimir
e4e2b04c53
Merge pull request #23112 from Jokser/disk-s3-restore-to-detached 2021-04-19 10:29:00 +03:00
Nikolai Kochetov
4d86f51eff Merge branch 'master' into add-read-from-mt-step 2021-04-19 10:17:21 +03:00
Maksim Kita
2f56f8d040
Merge pull request #23278 from kitaisreal/to-date-time-decimal-overflow-ubsan-fix
Function toDateTime decimal overflow ubsan fix
2021-04-19 10:12:24 +03:00
TCeason
63403c709c modify settings name to external_xxx and rewrite Storage MySQL max_block_size 2021-04-19 10:51:50 +08:00
TCeason
87aa904440 Modify according to review opinion 2021-04-19 10:51:50 +08:00
TCeason
472c131420 Add MySQL read history data bytes judgment 2021-04-19 10:51:50 +08:00
Chao Ma
6238028225 Fix integration test test_storage_kafka failed error 2021-04-19 01:38:29 +00:00
Chao Ma
8d7a53efda Fix test 00163_column_oriented_formats failed error 2021-04-19 01:38:29 +00:00
Chao Ma
2776772ac6 Read ORC file by stripe to reduce memory cost 2021-04-19 01:38:29 +00:00
Maksim Kita
1bfd4f7568 Function toDateTime decimal overflow ubsan fix 2021-04-19 02:00:33 +03:00
alexey-milovidov
1d5a4cfa32
Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io" 2021-04-19 01:30:53 +03:00
Maksim Kita
ca93987ae9
Merge pull request #23182 from kitaisreal/system-query-reload-model
Added system query reload model
2021-04-19 00:39:31 +03:00
Maksim Kita
1f67362843
Merge pull request #23262 from kitaisreal/simple-key-dictionary-primary-key-wrong-order-fix
Simple key dictionary primary key wrong order fix
2021-04-19 00:37:52 +03:00
Azat Khuzhin
d476a4a9bd Add type conversion for optimize_skip_unused_shards_rewrite_in
MSan reports [1]:

    2021.04.17 15:20:06.665152 [ 56 ] {2336bf92-0269-4acd-8b3f-f09623223d18} <Debug> executeQuery: (from [::1]:44744, using production parser) SELECT * FROM dist_01757 WHERE dummy IN ('255', 0) FORMAT Null
    ...
    0 0x305af885 in (anonymous namespace)::shardContains() obj-x86_64-linux-gnu/../src/Interpreters/OptimizeShardingKeyRewriteInVisitor.cpp:50:28
    ...
    Uninitialized value was created by an allocation of 'sharding_value' in the stack frame of function '_ZN12_GLOBAL__N_113shardContainsERKN2DB5FieldERKNSt3__112basic_stringIcNS4_11char_traitsIcEENS4_9allocatorIcEEEERKNS4_10shared_ptrINS0_17ExpressionActionsEEESC_RKNS0_7Cluster9ShardInfoERKNS4_6vectorImNS8_ImEEEE'
    0 0x305ae260 in (anonymous namespace)::shardContains() obj-x86_64-linux-gnu/../src/Interpreters/OptimizeShardingKeyRewriteInVisitor.cpp:42

  [1]: https://clickhouse-test-reports.s3.yandex.net/23212/d02eb3f6b7a8dc07bbed5605e1afcf7634436b3a/fuzzer_msan/report.html#fail1

P.S. fuzzers are great!
2021-04-19 00:03:38 +03:00
Azat Khuzhin
2561a67fd8 Replace !__clang__ with !defined(__clang) to fix gcc builds
$ gg 'if !__clang__' | cut -d: -f1 | sort -u | xargs sed -i 's/#if !__clang__/#if !defined(__clang__)/g'
2021-04-18 23:37:50 +03:00
alesapin
912db13d75 Merge branch 'master' into keeper_bench_mark 2021-04-18 21:46:20 +03:00
Maksim Kita
b26dfcd514 Simple key dictionary primary key wrong order fix 2021-04-18 15:19:44 +03:00
Alexey Milovidov
21ff5d85d9 Disable hedged requests 2021-04-18 15:13:57 +03:00