thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
55,913 Commits 9,319 Branches 1,783 Tags 2.1 GiB
1576800289
Commit Graph

9446 Commits

Author SHA1 Message Date
alexey-milovidov
a15092eeb7
Merge pull request #18264 from ucasFL/insert-cluster 
Support insert into table function cluster
 2021-01-16 13:22:49 +03:00
alexey-milovidov
a5a19de878
Update DistributedBlockOutputStream.cpp 2021-01-16 13:22:25 +03:00
alexey-milovidov
4efc7a7dc3
Update MergeTreeIOSettings.h 2021-01-16 13:07:58 +03:00
Azat Khuzhin
1b901b368f Add missing type check in dictHas for COMPLEX_KEY_SSD_CACHE layout 2021-01-16 12:33:36 +03:00
kssenii
2222741e33 Fix style check 2021-01-16 09:17:04 +00:00
alexey-milovidov
e32b1e3fe6
Update StorageTinyLog.cpp 2021-01-16 11:53:28 +03:00
Alexey Milovidov
69cafd4d7f Add suggestion from Kita 2021-01-16 11:48:50 +03:00
Alexey Milovidov
4ee9c57190 Add TODO 2021-01-16 11:43:59 +03:00
Alexey Milovidov
b25e334313 Add assert 2021-01-16 11:30:35 +03:00
alexey-milovidov
bf86d3bab8
Merge pull request #19153 from azat/async_socket_for_remote-fix-fd-leak 
Fix leaking of pipe fd for async_socket_for_remote
 2021-01-16 11:23:55 +03:00
Alexey Milovidov
45380d45c8 Fix potential (safe) SQL-injection 2021-01-16 11:15:43 +03:00
Alexey Milovidov
31593e2000 Fix Arcadia 2021-01-16 11:10:55 +03:00
alexey-milovidov
2e2988e5d8
Merge pull request #19146 from azat/server-memory-limit-blocking 
MemoryTracker: Do not ignore server memory limits during blocking by default
 2021-01-16 11:09:19 +03:00
alexey-milovidov
141b5e23b2
Merge pull request #19136 from amosbird/removeuseless 
Remove useless code
 2021-01-16 11:04:55 +03:00
kssenii
11ffa6293d Fix integration tests 2021-01-16 08:04:24 +00:00
alexey-milovidov
32ceafc038
Merge pull request #19007 from ClickHouse/add-tests-from-15889 
Add tests from #15889
 2021-01-16 11:03:39 +03:00
alexey-milovidov
6ed14ba0b6
Merge pull request #19134 from ClickHouse/fix-read-orc-from-fd 
Fix reading from fd for ORCBlockInputFormat.
 2021-01-16 11:03:26 +03:00
alesapin
67fd381034
Merge pull request #19123 from ClickHouse/additional_check_in_writer 
Fix max granules size in MergeTreeDataWriter
 2021-01-16 10:17:44 +03:00
Azat Khuzhin
ee45c122ea Fix leaking of pipe fd for async_socket_for_remote 2021-01-16 01:57:36 +03:00
Azat Khuzhin
cf085b0687 Split RemoteQueryExecutorReadContext into module part 2021-01-16 01:57:36 +03:00
Alexey Milovidov
593b6f5c83 Add assert 2021-01-16 00:25:58 +03:00
Alexey Milovidov
7705420220 Better 2021-01-16 00:23:58 +03:00
alexey-milovidov
5f189c5756
Merge pull request #19122 from ClickHouse/data-part-better-code 
Add metrics for part number in MergeTree in ClickHouse
 2021-01-16 00:20:15 +03:00
alexey-milovidov
e09ec9fed5
Merge pull request #18373 from amosbird/fix-18364 
Fix 2-arg functions with constant in PK analysis
 2021-01-16 00:20:03 +03:00
Alexey Milovidov
67f207d8ca More safe connection string 2021-01-16 00:18:51 +03:00
Alexey Milovidov
ef319bfa75 Slightly better 2021-01-15 23:33:04 +03:00
Alexander Kuzmenkov
765aa4d4e3 rewrote everything again 2021-01-15 23:30:44 +03:00
Alexey Milovidov
c16ecb0bdd It feels more correct 2021-01-15 23:18:55 +03:00
Alexey Milovidov
b1b09ed5ae Fix SQL injection 2021-01-15 23:14:51 +03:00
Alexey Milovidov
52cfc1d110 Minor changes 2021-01-15 23:09:31 +03:00
Alexey Milovidov
ba1921f380 Minor changes 2021-01-15 22:59:49 +03:00
Azat Khuzhin
61b2d0ce42 MemoryTracker: Do not ignore server memory limits during blocking by default 2021-01-15 22:46:58 +03:00
Alexey Milovidov
b293d56a63 Merge branch 'master' into kssenii-pg2ch 2021-01-15 22:32:03 +03:00
alesapin
184dbedb06 Fix stupid error 2021-01-15 21:50:30 +03:00
alexey-milovidov
b97beea22a
Merge pull request #19101 from ClickHouse/check_compression_codec_read 
Fix compression codec read for empty files
 2021-01-15 20:55:58 +03:00
alexey-milovidov
f8830e0f11
Merge pull request #19107 from ClickHouse/bar-nan 
Fix fuzz test for function `bar`.
 2021-01-15 20:38:02 +03:00
alexey-milovidov
971ff2ee0a
Merge pull request #19086 from ClickHouse/faster-parts-removal 
Faster parts removal, more safe and efficient interface of IDisk
 2021-01-15 20:37:35 +03:00
Ivan Lezhankin
066242c64d Print errors through LOG_ERROR 2021-01-15 19:57:44 +03:00
Amos Bird
8b079674a9
Remove useless code 2021-01-16 00:37:41 +08:00
feng lv
9829c09720 fix 2021-01-15 15:54:35 +00:00
Nikolai Kochetov
76495124cd Fix readign from fd for ORCBlockInputFormat. 2021-01-15 18:45:29 +03:00
feng lv
dbb3c89b50 Merge branch 'master' of github.com:ClickHouse/ClickHouse into insert-cluster 2021-01-15 15:37:56 +00:00
Alexey Milovidov
a19e7edd14 Merge branch 'master' into kssenii-pg2ch 2021-01-15 17:33:19 +03:00
alexey-milovidov
ca825f36f1
Merge pull request #18853 from azat/dist-send-checksums 
Improve checksum checks for async INSERT into Distributed on the sender
 2021-01-15 17:12:54 +03:00
Nikolai Kochetov
8af10c730b Merge branch 'master' into add-tests-from-15889 2021-01-15 16:21:33 +03:00
alesapin
8ccaa6ede9 Additional check for huge granules in MergeTreeDataWriter 2021-01-15 15:40:37 +03:00
Alexey Milovidov
e238fd64ac Add part metrics 2021-01-15 15:28:53 +03:00
Alexey Milovidov
6a2a5e53ed Slightly better code of IMergeTreeDataPart #18955 2021-01-15 15:15:13 +03:00
alexey-milovidov
78fff6bc39
Merge branch 'master' into multiple-nested 2021-01-15 14:54:27 +03:00
Alexey Milovidov
4bae04d500 Merge branch 'master' into amosbird/fix-18364 2021-01-15 14:37:35 +03:00
alexey-milovidov
4a71971b43
Update KeyCondition.cpp 2021-01-15 14:36:07 +03:00
alexey-milovidov
8d58ce532a
Merge pull request #19064 from CurtizJ/restrict-modify-ttl 
Restrict MODIFY TTL for tables created in old syntax
 2021-01-15 14:09:47 +03:00
tavplubix
fb6d1dc18e
Merge pull request #18979 from ClickHouse/fix_18690 
Remove unread data limit from PeekableReadBuffer
 2021-01-15 13:43:50 +03:00
Alexey Milovidov
d553e46a06 Merge branch 'master' into faster-parts-removal 2021-01-15 13:25:20 +03:00
alexey-milovidov
e914ef619f
Merge pull request #18818 from templarzq/master 
Implement ColumnAggregateFunction cloneResized method
 2021-01-15 13:21:21 +03:00
Alexey Milovidov
33d045b72e Fix issue in function "bar" 2021-01-15 13:17:09 +03:00
alexey-milovidov
461d370e8d
Merge pull request #19020 from ClickHouse/fix_18879 
Fix duplicate UUIDs of LiveView on server startup
 2021-01-15 13:04:08 +03:00
alexey-milovidov
80c937b64c
Merge pull request #19084 from ClickHouse/simplifuy-tuple-hamming-distance 
Simplify tupleHammingDistance
 2021-01-15 13:02:09 +03:00
alexey-milovidov
421dd1ca66
Merge pull request #18542 from nautaa/master 
add function to decode charaters for XML
 2021-01-15 12:28:01 +03:00
alesapin
d601faa669
Merge pull request #18935 from fastio/bugfix_attach_partition_does_not_reset_mutation 
Bugfix: attach partition should reset the mutation
 2021-01-15 12:21:16 +03:00
alesapin
e106df2ad0 Fix comment 2021-01-15 12:10:03 +03:00
alesapin
0662d6bd7d Fix compression codec read for empty files 2021-01-15 12:04:23 +03:00
Alexander Kuzmenkov
c9628386fc more fixes 2021-01-15 01:39:43 +03:00
Alexey Milovidov
9db1299f41 Improve code 2021-01-15 00:25:19 +03:00
Alexander Kuzmenkov
1abb554d2b test fixes 2021-01-14 23:47:52 +03:00
alesapin
1cc5be3b68 Compileable code 2021-01-14 23:43:52 +03:00
Alexey Milovidov
da9bd043d4 Merge branch 'master' into nautaa-master 2021-01-14 23:09:33 +03:00
Alexey Milovidov
522ccddbec Better code 2021-01-14 23:05:00 +03:00
Azat Khuzhin
ecae6c1c60 Avoid reading the distributed batch just to read the block header 
Before this patch batched mode of the DirectoryMonitor is 2x slower then
non-batched, after it should be more or less the same as non-batched.
 2021-01-14 22:38:46 +03:00
Alexey Milovidov
f60c5f8296 Merge branch 'master' into templarzq/master 2021-01-14 22:33:11 +03:00
alexey-milovidov
2760006415
Update gtest_peekable_read_buffer.cpp 2021-01-14 22:29:34 +03:00
Nikolai Kochetov
d120801df3 Fix style 2021-01-14 20:16:31 +03:00
Alexey Milovidov
ee13dd4fef Fix error 2021-01-14 19:58:44 +03:00
Alexander Kuzmenkov
f5d63c23a2 semicolon 2021-01-14 19:55:09 +03:00
Alexey Milovidov
8276a1c8d2 Faster parts removal, more safe and efficient interface of IDisk 2021-01-14 19:24:13 +03:00
alesapin
a2070bf130 Add some missed files 2021-01-14 19:20:33 +03:00
Nikolai Kochetov
4bb0bd16e1 Simplify tupleHammingDistance 2021-01-14 19:02:17 +03:00
alesapin
09e825e28c
Merge pull request #19040 from ClickHouse/fix_redundant_exception_while_dropping_part 
Avoid redundant exception while dropping part
 2021-01-14 18:59:59 +03:00
Alexander Kuzmenkov
828dea83cb Merge remote-tracking branch 'origin/master' into tmp 2021-01-14 18:50:34 +03:00
Alexander Kuzmenkov
d53da04e6f without debug 2021-01-14 18:38:27 +03:00
Alexander Kuzmenkov
8be081e3c0 with debug 2021-01-14 18:35:52 +03:00
Nikolai Kochetov
fc57ca5f50 Simplify tupleHammingDistance 2021-01-14 18:34:44 +03:00
Nikolai Kochetov
3ee4e9eda8 Simplify tupleHammingDistance 2021-01-14 18:29:42 +03:00
Alexander Tokmakov
547c7af1b1 fix checkpoint in PeekableReadBuffer over ConcatReadBuffer 2021-01-14 17:38:59 +03:00
Nikolai Kochetov
c65f79d69b Simplify tupleHammingDistance 2021-01-14 17:29:51 +03:00
Nikolai Kochetov
d8b9278193
Merge pull request #19016 from ClickHouse/fix-ignore-with-lc-arg 
Fix `ignore` function with LowCardinality argument
 2021-01-14 16:50:54 +03:00
Anton Popov
ac426c3da6 restrict MODIFY TTL for tables created in old syntax 2021-01-14 15:32:20 +03:00
Anton Popov
0e2d49f065 Merge remote-tracking branch 'upstream/master' into HEAD 2021-01-14 15:03:08 +03:00
Anton Popov
9c9e2a5936 support operations with views in antlr parser 2021-01-14 15:02:29 +03:00
Alexander Tokmakov
f9ee3f8178 update test 2021-01-14 14:09:13 +03:00
Nikita Mikhaylov
89c64cbdfc
Merge pull request #18982 from nikitamikhaylov/filtering-join-supertype 
Remove code from Join which materializes const columns
 2021-01-14 13:53:40 +03:00
Alexander Tokmakov
64975c08e7 fix 2021-01-14 13:33:39 +03:00
alexey-milovidov
bf8d58d2e8
Merge pull request #18723 from ucasFL/select-all 
add SELECT ALL syntax
 2021-01-14 11:53:09 +03:00
alexey-milovidov
49ad73b9bc
Merge pull request #19013 from ClickHouse/tavplubix-patch-2 
Fix misleading error message while inserting in a table function
 2021-01-14 11:42:06 +03:00
alexey-milovidov
2ca185c9f9
Merge pull request #16995 from sundy-li/alias_column_partition_prune 
Add optimize_respect_aliases
 2021-01-14 11:30:45 +03:00
alexey-milovidov
53299cc17b
Update ColumnAliasesVisitor.cpp 2021-01-14 11:26:04 +03:00
Nikolai Kochetov
7b33ad5e44
Merge pull request #19010 from ClickHouse/fix-insert-lc-to-tiny-log 
Fix insert LC to TinyLog
 2021-01-14 11:25:38 +03:00
alesapin
bfc27254b2 Avoid redundant exception while dropping part 2021-01-14 11:07:13 +03:00
alexey-milovidov
6d79068a0f
Merge pull request #18981 from ClickHouse/disable-optimize-out-of-any 
Disable optimize out of any
 2021-01-14 10:12:55 +03:00
alexey-milovidov
2c8ce7d94e
Merge pull request #19019 from ClickHouse/group-uniq-array-enum 
Fix return type of groupUniqArray
 2021-01-14 10:11:44 +03:00
alesapin
c1732ef1b5
Merge pull request #19011 from ClickHouse/fix_operators_escaping 
Fix manipulators for common string types
 2021-01-14 10:08:16 +03:00
Kruglov Pavel
fedfcb78e1
Merge pull request #18791 from sundy-li/bitmap64-contains 
Add [UInt8, UInt16, UInt32, UInt64] arguments types support for bitmapTransform, bitmapSubsetInRange, bitmapSubsetLimit, bitmapContains functions
 2021-01-14 02:18:42 +03:00
Anton Popov
4dd9165934
Merge pull request #18552 from spongedu/support_exists_view_v3 
support EXISTS VIEW syntax
 2021-01-14 01:23:50 +03:00
Anton Popov
e40f7df4d7
Update InterpreterExistsQuery.cpp 2021-01-14 01:22:15 +03:00
Alexander Kuzmenkov
48509a85d3 comment woes 2021-01-14 01:04:19 +03:00
alexey-milovidov
3b02a3ef02
Merge pull request #18976 from ClickHouse/fix_terminate_when_not_enough_memory 
Finally get rid of allocations in ThreadPool::worker(...)
 2021-01-13 23:48:46 +03:00
alexey-milovidov
ab15a936e4
Merge pull request #18998 from ucasFL/comment 
fix some wrong words in comment
 2021-01-13 23:46:53 +03:00
Alexander Kuzmenkov
c2a1373720 Merge remote-tracking branch 'origin/master' into tmp 2021-01-13 22:30:08 +03:00
Alexander Kuzmenkov
703731c547 something works 2021-01-13 22:29:52 +03:00
Nikolai Kochetov
b03f28f28c Update building sets. 2021-01-13 21:58:00 +03:00
Nikolai Kochetov
871ac3eeb7 Update building sets. 2021-01-13 21:37:54 +03:00
Alexey Milovidov
d27e04997d More tests 2021-01-13 21:13:52 +03:00
Alexander Tokmakov
5f0f8ae3cd fix duplicate UUIDs of LiveView on server startup 2021-01-13 21:13:46 +03:00
alesapin
2683bbc0f7 Disable lint for test 2021-01-13 18:35:35 +03:00
Nikita Mikhailov
ded35fe5b0 delete 2021-01-13 18:15:32 +03:00
Anton Popov
11f459ad03 Merge branch 'support_exists_view_v3' of git://github.com/spongedu/ClickHouse into exists-view 2021-01-13 18:08:43 +03:00
alesapin
294e8f095d I was able to replicate single number at localhost 2021-01-13 18:00:39 +03:00
Nikolai Kochetov
33d007dc46 Fix function ignore with LowCardinality argument. 2021-01-13 17:45:19 +03:00
tavplubix
94c0433d9f
Update InterpreterInsertQuery.cpp 2021-01-13 16:55:34 +03:00
Alexander Tokmakov
6c4be506fd add test 2021-01-13 16:43:42 +03:00
Nikolai Kochetov
da0cb8d47f Added comment. 2021-01-13 16:32:27 +03:00
ygrek
8f2a830d83
add zstd long range option (#17184) 
* add zstd long compression option

* tests: add zstd long read-write test

Co-authored-by: Joris Giovannangeli <joris.giovannangeli@ahrefs.com>
Co-authored-by: ip <igor@ahrefs.com>
 2021-01-13 16:22:59 +03:00
Alexey Milovidov
a18d5320ca Merge branch 'master' into disable-optimize-out-of-any 2021-01-13 15:51:10 +03:00
sundyli
e9a18fbd3a
Update FunctionsBitmap.h 2021-01-13 20:49:06 +08:00
sundyli
073379627c
Update FunctionsBitmap.h 2021-01-13 20:47:40 +08:00
alesapin
c84a8c4b16 Fix manipulators for common string types 2021-01-13 15:47:34 +03:00
Nikolai Kochetov
12f3b22623 Do not skip streams after serializeBinaryBulkStatePrefix. 2021-01-13 15:20:10 +03:00
Alexander Tokmakov
73e96250a8 add comments 2021-01-13 15:19:41 +03:00
Alexander Tokmakov
a6510cc4b7 Merge branch 'master' into fix_terminate_when_not_enough_memory 2021-01-13 14:05:54 +03:00
alesapin
d7e6c8393f Some useless code 2021-01-13 13:32:20 +03:00
alesapin
c97469773d
Merge pull request #18969 from ClickHouse/fix_drop_part_deduplication 
Fix DROP PART query break deduplication
 2021-01-13 11:50:26 +03:00
feng lv
d5181b984a fix some wrong words in comment 2021-01-13 08:38:19 +00:00
alesapin
07431a6494
Merge pull request #18980 from ClickHouse/fix-expressions-merge 
Fix expressions merge
 2021-01-13 11:16:01 +03:00
alesapin
73e536a074
Merge pull request #18928 from ClickHouse/more_checks_in_writer_wide 
More checks in merge tree writer wide
 2021-01-13 09:59:45 +03:00
alesapin
48ad4dad5b
Merge pull request #18964 from ClickHouse/more-info-for-polling-queue-exception 
Fix error Task was not found in task queue
 2021-01-13 09:58:18 +03:00
templarzq
8b98b467b6
Update ColumnAggregateFunction.cpp 2021-01-13 13:57:42 +08:00
templarzq
c310f69dc3
Update ColumnAggregateFunction.cpp 2021-01-13 10:35:33 +08:00
Anton Popov
d7200ee2ed minor changes 2021-01-13 02:20:32 +03:00
Nikita Mikhailov
e1afae4492 just test 2021-01-13 00:49:11 +03:00
alexey-milovidov
781a1110bc
Update ColumnAliasesVisitor.h 2021-01-12 23:24:18 +03:00
Alexey Milovidov
a6296912f3 Fix incomplete code 2021-01-12 22:58:54 +03:00
Nikolai Kochetov
74cdf98e8f Try to fix ActionsDAG::merge. 2021-01-12 21:58:05 +03:00
Alexander Tokmakov
111f4d49e3 remove unread data limit from PeekableReadBuffer 2021-01-12 21:55:12 +03:00
Nikolai Kochetov
1937659450 Add more info for ActionsDAG 2021-01-12 21:47:54 +03:00
Alexander Tokmakov
5db5700119 fix rare deadlock on shutdown of BackgroundSchedulePool 2021-01-12 21:47:01 +03:00
Nikolai Kochetov
1f2a90d321 Remove debug code. 2021-01-12 21:41:11 +03:00
Nikolai Kochetov
af79c6ca9b Remove debug code. 2021-01-12 21:40:07 +03:00
Alexander Kuzmenkov
e6c2d0219d window clause tmp 2021-01-12 21:34:35 +03:00
Alexey Milovidov
c51df126f1 Disable "optimize_move_functions_out_of_any" by default #18973 2021-01-12 19:46:18 +03:00
Alexander Tokmakov
ff6c3c75c2 add protection from unsafe allocations 2021-01-12 18:41:24 +03:00
Nikolai Kochetov
0aad1de330 Try fix Task was not found in task queue 2021-01-12 18:20:56 +03:00
alexey-milovidov
aa6e827d8b
Update TreeRewriter.cpp 2021-01-12 16:54:11 +03:00
Nikolai Kochetov
3b95ee8e60 Print log in case of exception in PollingQueue 2021-01-12 16:12:14 +03:00
Nikolai Kochetov
24503267d5 Print log in case of exception in PollingQueue 2021-01-12 15:42:18 +03:00
alesapin
dead1016d6 Fix deduplication block names parsing 2021-01-12 13:55:02 +03:00
sundy-li
ad01534bd5 Merge branch 'master' into alias_column_partition_prune 2021-01-12 18:28:30 +08:00
alexey-milovidov
2c71b997de
Merge pull request #18464 from hexiaoting/dev_fp_as_pk 
Disallow floating point as partition key
 2021-01-12 13:08:41 +03:00
Nikolai Kochetov
c61e9a655a Print log in case of exception in PollingQueue 2021-01-12 13:01:19 +03:00
sundy-li
7cfbc90fa5 Fix typo 2021-01-12 10:00:03 +00:00
sundy-li
e6351cf966 Add UInt64 Support for bitmapTransform/bitmapSubsetInRange/bitmapSubsetLimit 2021-01-12 17:13:43 +08:00
alesapin
f3e55183ad Better test and check 2021-01-12 11:46:31 +03:00
tavplubix
1d6bfe8ad7
Merge pull request #18944 from ClickHouse/fix_mutation_commands_escaping 
Fix mutations text serialization
 2021-01-12 11:29:24 +03:00
alesapin
5ae31b8068 Slightly relax check 2021-01-12 10:59:14 +03:00
alesapin
a7db584b36
Merge pull request #18953 from ClickHouse/try-to-remove-remove-from-actions-dag 
Try to remove ActionsDAG::removeColumn
 2021-01-12 10:22:09 +03:00
sundy-li
20ce82b86d Better exceptions 2021-01-12 14:52:31 +08:00
sundy-li
72e9484dac Fix a big bug 2021-01-12 14:52:31 +08:00
sundy-li
9c3c1d13ab Add bitmapContains support for all UInt types 2021-01-12 14:52:31 +08:00
templarzq
36381ce35e
Update ColumnAggregateFunction.cpp 2021-01-12 14:36:26 +08:00
Azat Khuzhin
05608687d6 Get back memory tracking blocker in calculateAndSerializePrimaryIndex() 
But reduce scope, to avoid leaking too much memory, since there are old
values in last_block_index_columns.

The scope of the MemoryTracker::BlockerInThread has been increased in #8290
 2021-01-12 01:00:37 +03:00
Azat Khuzhin
82edbfb581 Account query memory limits and sampling for OPTIMIZE TABLE/merges 2021-01-12 00:49:41 +03:00
Azat Khuzhin
bd05d9db2f Fix memory tracking for OPTIMIZE TABLE queries 
Because of BlockerInThread in
MergeTreeDataPartWriterOnDisk::calculateAndSerializePrimaryIndex memory
was accounted incorrectly and grows constantly.

And IIUC there is no need in that blocker, since INSERT SELECT shares
the same thread group.
 2021-01-12 00:49:40 +03:00
Nikolai Kochetov
5062823227
Merge pull request #18922 from ClickHouse/more-debug-info-for-polling-queue 
Add more debug info to PollingQueue exception.
 2021-01-11 21:49:23 +03:00
Nikolai Kochetov
24d462b018 Try to remove ActionsDAG::removeColumn 2021-01-11 19:15:03 +03:00
alexey-milovidov
f8473222c6
Merge pull request #18897 from azat/stress-tests-no-restart-replicas 
Drop RESTART REPLICAS from stateless tests to avoid locking lots of mutexes
 2021-01-11 18:53:01 +03:00
alesapin
e3a50d13a5 Add missed header 2021-01-11 17:51:23 +03:00
alesapin
b1c4e5b9f2 Fix mutations text escaping 2021-01-11 17:43:05 +03:00
tavplubix
6022311a37
Merge pull request #18285 from weeds085490/hotfix/abort_when_failed_to_init_ddlworker 
exit clickhouse when failing to initialize zookeeper with logical err…
 2021-01-11 17:04:33 +03:00
Nikolai Kochetov
ec70d7961b Try fix build. 2021-01-11 17:01:32 +03:00
fastio
8dde70b937 Bugfix: attach partition should reset the mutation 2021-01-11 21:26:43 +08:00
tavplubix
00d240853d
Merge pull request #18718 from zhang2014/fix/ISSUES-7690 
ISSUES-7690 try fix nullable string type convert to decimal type
 2021-01-11 16:18:56 +03:00
alesapin
c5df8f324c More checks in writer wide 2021-01-11 15:03:00 +03:00
tavplubix
213c653ef8
Merge pull request #17656 from bharatnc/ncb/ddl-worker-queue-table 
add  system.distributed_ddl_queue table
 2021-01-11 14:59:26 +03:00
Anton Popov
91dc347ff3 add some comments 2021-01-11 14:36:31 +03:00
alexey-milovidov
667dd0cf0c
Merge pull request #18912 from sundy-li/bitmapOrCardinality-nullfix 
Fix bitmapOrCardinality using wrong variable
 2021-01-11 14:28:46 +03:00
kssenii
38a9cba850 Fix 2021-01-11 10:55:38 +00:00
Anton Popov
36ae0e4d35 Merge remote-tracking branch 'upstream/master' into HEAD 2021-01-11 13:51:12 +03:00
Nikolai Kochetov
45b28a6374 Add more debug info to PollingQueue exception. 2021-01-11 13:09:40 +03:00
Nikolai Kochetov
496690896c Add more debug info to PollingQueue exception. 2021-01-11 12:08:13 +03:00
Alexey Milovidov
42f63e14b5 Revert "Auto version update to [21.2.1.1] [54446]" 
This reverts commit bc2593688e.
 2021-01-11 11:32:52 +03:00
Nikolai Kochetov
ee094ed7fd
Merge pull request #18896 from amosbird/keyconditionalias 
correct index analysis of WITH aliases
 2021-01-11 11:13:28 +03:00
robot-clickhouse
bc2593688e Auto version update to [21.2.1.1] [54446] 2021-01-11 11:12:11 +03:00
templarzq
8704136300
Update ColumnAggregateFunction.cpp 2021-01-11 14:38:21 +08:00
feng lv
5f962015ca fix 
fix style

fix build
 2021-01-11 04:28:22 +00:00
sundy-li
9aa7c7ef09 Fix same bug in another function 2021-01-11 11:35:56 +08:00
sundy-li
893efab7c3 Fix AggregateFunctionGroupBitmapData bitmapOrCardinality using wrong variable 2021-01-11 11:35:56 +08:00
templarzq
7d1842cb19
Update ColumnAggregateFunction.cpp 2021-01-11 10:49:18 +08:00
templarzq
bf90fcc98e
Update ColumnAggregateFunction.cpp 
fix warning
 2021-01-11 10:40:03 +08:00
Alexey Milovidov
c7d4d12f72 Auto version update to [21.1.0] [54445] 2021-01-11 03:51:08 +03:00
Azat Khuzhin
56475774d3 Fix readability-static-definition-in-anonymous-namespace in DirectoryMonitor 2021-01-10 23:57:40 +03:00
Azat Khuzhin
2565d2ac44 Verify compressed headers while sending distributed batches 
Before this patch the DirectoryMonitor was checking the compressed file
by reading it one more time (since w/o this receiver may stuck on
truncated file), while this is ineffective and we can just check the
checksums before sending.

But note that this may decrease batch size that is used for sending over
network.
 2021-01-10 21:23:42 +03:00
Azat Khuzhin
946a126799 Add CheckingCompressedReadBuffer 
Buffer for reading from a compressed file with just checking checksums
of the compressed blocks, without any decompression, so result can be
proxied.
 2021-01-10 21:23:42 +03:00
kssenii
6ec59f1304 Update libpq, tiny fix 2021-01-10 15:38:46 +00:00
Azat Khuzhin
819b9d7d56 Add more metadata into distributed .bin files to avoid doing the same on sending 
Before this patch StorageDistributedDirectoryMonitor reading .bin files
in batch mode, just to calculate number of bytes/rows, this is very
ineffective, let's just store them in the header (rows/bytes).
 2021-01-10 18:17:15 +03:00
Azat Khuzhin
fce8b6b5ef Refactoring distributed header parsing 2021-01-10 18:17:15 +03:00
Azat Khuzhin
676bc83c6d Check per-block checksum of the distributed batch on the sender before sending 
This is already done for distributed_directory_monitor_batch_inserts=1,
so let's do the same for the non batched mode, since otherwise in case
the file will be truncated the receiver will just stuck (since it will
wait for the block, but the sender will not send it).
 2021-01-10 18:17:14 +03:00
kssenii
c6c6b2d23c Fix style and types check 2021-01-10 13:01:15 +00:00
kssenii
d952b0897e Minor adjustments 2021-01-10 12:06:18 +00:00
alexey-milovidov
f7e7725b8e
Merge pull request #18884 from fuwhu/feature/fix-windowFunnel-inconsistency 
fix the inconsistent result of windowFunnel in case of same timestamp for different events
 2021-01-10 14:56:58 +03:00
alexey-milovidov
1921494bc9
Merge pull request #18864 from azat/dist-fsync 
Add fsync support for Distributed engine.
 2021-01-10 13:16:13 +03:00
alexey-milovidov
571e37188a
Merge pull request #18886 from ClickHouse/remove-useless-code-4 
Remove useless code
 2021-01-10 13:13:17 +03:00
alexey-milovidov
b95fae737a
Merge pull request #18892 from ClickHouse/remove-useless-headers-3 
Remove useless headers
 2021-01-10 13:12:51 +03:00
Azat Khuzhin
39cfffd4d2 Add log message for list of tables on RESTART REPLICAS 2021-01-10 12:44:56 +03:00
Amos Bird
44758935df
correct index analysis of WITH aliases 2021-01-10 17:40:47 +08:00
kssenii
fc9de76f7d Fix incorrect getCreateTableQueryImpl with multidim arrays 2021-01-10 09:00:35 +00:00
nautaa
a0982bfd55 update decodeXMLComponent.cpp 2021-01-10 16:21:21 +08:00
nautaa
d7456f8ddd update decodeXMLComponent.cpp 2021-01-10 16:18:26 +08:00
feng lv
09d71029c2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into insert-cluster 2021-01-10 03:47:14 +00:00
HuFuwang
833054251b update sorted logic in AggregateFunctionWindowFunnelData::add 2021-01-10 11:31:44 +08:00
Alexey Milovidov
c38dca155c Fix clang-tidy 2021-01-10 05:51:54 +03:00
Alexey Milovidov
76149947ef Remove useless headers 2021-01-10 05:48:57 +03:00
Alexey Milovidov
7e9120b34f Merge branch 'master' into chenziliang/feature/wildcard-dynamic-columns 2021-01-10 04:04:47 +03:00
Alexey Milovidov
6eb5a5f4d9 Remove useless code 2021-01-10 03:28:59 +03:00
HuFuwang
21659e8aa5 Merge branch 'master' into feature/fix-windowFunnel-inconsistency 2021-01-10 07:34:05 +08:00
kssenii
0088d66d59 Hopefully better array conversions for insert query 2021-01-09 22:42:42 +00:00
alexey-milovidov
fe1c153c6f
Merge pull request #18817 from ucasFL/wf 
replace PODArray with PODArrayWithStackMemory in AggregateFunctionWindowFunnelData
 2021-01-10 00:11:57 +03:00
alexey-milovidov
d593b1faf2
Merge pull request #18876 from ClickHouse/external-queries-in-with-table 
External queries: fix the case of expr IN table #9756
 2021-01-10 00:10:56 +03:00
feng lv
94e1bc05d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-09 16:07:52 +00:00
HuFuwang
8e63328221 refine naming. 2021-01-09 23:13:03 +08:00
Azat Khuzhin
471deab63a Rename fsync_tmp_directory to fsync_directories for Distributed engine 2021-01-09 17:51:30 +03:00
nautaa
445bc1c65c fix bug 2021-01-09 22:39:25 +08:00
HuFuwang
dd52f88e54 fix the inconsistent result of windowFunnel in case of same timestamp for different events. 2021-01-09 22:37:49 +08:00
Azat Khuzhin
ae0b15455f Add fsync_tmp_directory support into DirectoryMonitor 2021-01-09 16:31:52 +03:00
Azat Khuzhin
2e55bd2285 Accept IDisk in DirectoryMonitor (for further fsync) 2021-01-09 16:31:42 +03:00
Azat Khuzhin
dd669cb2b6 Add fsync support for Distributed/DirectoryMonitor 
Note that there is no fsync_tmp_directory support in DirectoryMonitor
since you cannot propagate the error to user anyway.
 2021-01-09 15:26:25 +03:00
nautaa
8359289283 add unicode decode 2021-01-09 19:08:19 +08:00
feng lv
378b10863e fix conflict 2021-01-09 09:07:20 +00:00
Azat Khuzhin
fbe5df809b Sync other temporary directories for Distributed fsync_tmp_directories 2021-01-09 11:36:04 +03:00
Azat Khuzhin
b5ace27014 Add fsync support for Distributed engine. 
Two new settings (by analogy with MergeTree family) has been added:

- `fsync_after_insert` - Do fsync for every inserted. Will decreases
  performance of inserts.

- `fsync_tmp_directory` - Do fsync for temporary directory (that is used
  for async INSERT only) after all part operations (writes, renames,
  etc.).

Refs: #17380 (p1)
 2021-01-09 11:31:32 +03:00
alexey-milovidov
b2577327f1
Merge pull request #18881 from ClickHouse/remove-useless-headers-2 
Remove useless headers
 2021-01-09 11:01:07 +03:00
alexey-milovidov
b60a37afc7
Merge pull request #18870 from azat/storage-features 
Storage features improvements
 2021-01-09 10:57:45 +03:00
alexey-milovidov
a7eccd2200
Merge pull request #18839 from fastio/expand_macros_for_fetchPartition 
Expand macros for fetchPartition
 2021-01-09 08:35:03 +03:00
Alexey Milovidov
8a57f8f42a Remove useless headers 2021-01-09 08:32:10 +03:00
alexey-milovidov
41fe290b2b
Update map.cpp 2021-01-09 07:15:28 +03:00
Alexey Milovidov
8fb64472f2 External queries: fix the case of expr IN table #9756 2021-01-09 06:28:54 +03:00
feng lv
8ab2832324 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-09 02:36:25 +00:00
alexey-milovidov
9c6d945afc
Merge pull request #18852 from azat/bit-flip-check 
Do not check bit flips for big buffers (since the size can be corrupted)
 2021-01-08 22:41:33 +03:00
alexey-milovidov
6be8338584
Update CompressedReadBufferBase.cpp 2021-01-08 22:41:24 +03:00
alexey-milovidov
6dcb887eed
Merge pull request #18857 from amosbird/fixmaxpartitionremotesetting 
Correctly override default settings remotely
 2021-01-08 22:25:43 +03:00
alexey-milovidov
f3fb2204d2
Merge pull request #18848 from ClickHouse/better-kill 
Better SYSTEM KILL
 2021-01-08 22:25:25 +03:00
Azat Khuzhin
714d5a067a Expose supports_parallel_insert via system.table_engines 2021-01-08 14:57:24 +03:00