Commit Graph

16002 Commits

Author SHA1 Message Date
Nikolai Kochetov
18fff141d1 Update max_threads for processors. 2019-08-30 17:21:22 +03:00
stavrolia
f51901bb3f fix comment 2019-08-30 16:27:05 +03:00
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
alexey-milovidov
e5a7f451f0
Merge pull request #6737 from vitlibar/improve-error-handling-in-cache-dictionary
Improve error handling in cache dictionaries
2019-08-30 16:06:07 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream
Reduced children_mutex lock scope in IBlockInputStream
2019-08-30 16:02:22 +03:00
chertus
e9c4f36586 Merge branch 'master' into some 2019-08-30 15:49:55 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries:
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
2019-08-30 12:50:38 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
2019-08-30 11:24:00 +03:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
stavrolia
011c752ed7 Add unit test 2019-08-29 18:38:33 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597)
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge
Fix for data race in StorageMerge
2019-08-29 18:25:48 +03:00
CurtizJ
d7a712e7ae update logic of 'with fill' modifier 2019-08-29 18:19:12 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json
Fix extracting a Tuple from JSON
2019-08-29 17:40:26 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexander Tokmakov
d6ca9fee63 unit test for PeekableReadBuffer 2019-08-29 16:30:43 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
zhang2014
275c0d88b3 fix build failure 2019-08-29 12:54:09 +08:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Alexey Milovidov
48dce81e61 Minor modifications after #6413 2019-08-28 21:54:30 +03:00
alexey-milovidov
33311a9bf1
Merge branch 'master' into atomic_zookeeper2 2019-08-28 21:34:42 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks
Avoid possible deadlock in TRUNCATE of Replicated table.
2019-08-28 21:05:26 +03:00
alexey-milovidov
6d2dca3242
Merge pull request #6705 from 4ertus2/bugs
JOINs with not nullable types and join_use_nulls=1
2019-08-28 21:05:16 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Nikolai Kochetov
d6e13cbb92 Update max_threads for processors. 2019-08-28 20:48:41 +03:00
Nikolai Kochetov
ca232cebfb Update max_threads for processors. 2019-08-28 20:30:48 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
chertus
5e27937227 fix RIGHT JOIN for Tuples 2019-08-28 18:44:18 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting
Formatting changes for StringHashMap PR #5417.
2019-08-28 18:30:59 +03:00
alexey-milovidov
819f1f2aa6
Merge pull request #6701 from yandex/aku/no-cache-low-cardinality
Disable consecutive key optimization for UInt8/16 LowCardinality columns.
2019-08-28 18:30:24 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
cced091881 Addition to prev. revision 2019-08-28 18:24:35 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
Alexey Milovidov
a9702aa6f2 Merge branch 'master' into remove-queue_max_wait_ms 2019-08-28 18:16:53 +03:00
chertus
90d5410aaa join_use_nulls with not nullable types 2019-08-28 17:14:09 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread
Fix live view no users thread
2019-08-28 16:33:36 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexander Kuzmenkov
0b5a7f5f4a Disable consecutive key optimization for UInt8/16 LowCardinality
columns.

A follow-up to #6298, this is as well a part of StringHashMap PR #5417
by Amos Bird.
2019-08-28 14:05:52 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Alexey Milovidov
32c7f9688a Removed extra quoting from Settings 2019-08-28 13:13:22 +03:00
Artem Zuikov
8fa4575a88
Merge pull request #6693 from 4ertus2/mjoin
Minor refactoring
2019-08-28 10:12:37 +03:00
Alexey Milovidov
f2d081a785 Addition to prev. revision 2019-08-28 03:42:45 +03:00
Alexey Milovidov
3db38c690e Changes to Benchmark after merge 2019-08-28 03:15:08 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
alexey-milovidov
44424651b0
Merge pull request #6343 from dimarub2000/benchmark_comparison_mode
[WIP] Clickhouse-benchmark comparison mode
2019-08-28 02:38:07 +03:00
alexey-milovidov
4782c1170c
Merge pull request #6691 from yandex/weiqxu-master
Merging "check free space when use external sort/aggerator"
2019-08-28 01:55:18 +03:00
Alexey Milovidov
e7cbd34a29 Improve table locks (incomplete) 2019-08-27 23:43:35 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381
Query transformation for external database fixed.
2019-08-27 23:11:39 +03:00
chertus
5208a70203 one less place with changed nullability columns 2019-08-27 22:41:51 +03:00
Alexey Milovidov
0add95b7d8 Set default value of "queue_max_wait_ms" to zero, because current value makes no sense 2019-08-27 22:21:53 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Nikolai Kochetov
4cb52cebea Update max_threads for processors. 2019-08-27 21:37:28 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts
TTL: Only drop altogether the expired parts and not partially prune them.
2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Nikolai Kochetov
d958316e58 Enable processors by default. Do not check block srtucture in SourceFromInutStream if not debug. 2019-08-27 11:17:42 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
Alexey Milovidov
66203973f2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-27 00:41:18 +03:00
Alexey Milovidov
7985270624 Disable processors by default 2019-08-27 00:41:10 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive
Implemented hasTokenCaseInsensitive function
2019-08-27 00:39:04 +03:00
alexey-milovidov
9fa5ee758d
Merge pull request #6670 from 4ertus2/bugs
Fix two vulnerabilities in Codecs
2019-08-27 00:38:09 +03:00
alexey-milovidov
9cdc434319
Merge pull request #6672 from yandex/aku/reverse-index
Separate the hash table interface for ReverseIndex.
2019-08-27 00:38:00 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper
Simplify shared_ptr_helper
2019-08-27 00:36:52 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
Alexander Kuzmenkov
c0bb52ca6d Separate the hash table interface for ReverseIndex.
It is significantly different from other uses of hash tables, and poses
the main obstacle to changing the hash table interface to the one that
can be easily supported by compound hash tables.

Make it explicitly separate, implement it only for a particular kind of
HashTable, and move this implementation to the ReverseIndex module.
2019-08-26 21:00:44 +03:00
Anton Popov
4cd376f587
fix table ttl after bad merge with master 2019-08-26 21:00:13 +03:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
chertus
12084270de fix build 2019-08-26 19:58:40 +03:00
Dmitry Rubashkin
34fefcfa2f Merge branch 'perfomance_test_help_size' of github.com:dimarub2000/ClickHouse into perfomance_test_help_size 2019-08-26 19:46:28 +03:00
Dmitry Rubashkin
1da261576e Try fix2 2019-08-26 19:42:20 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00
chertus
d17a64c28d fix vulnerabilities 2019-08-26 17:39:49 +03:00
alesapin
dff0cc1e1c Remove COW and add MultiVersion 2019-08-26 17:24:29 +03:00
Alexey Milovidov
479b4d81f3 Fixed error 2019-08-26 16:46:07 +03:00
alexey-milovidov
2f5e6158e7
Update TerminalSize.cpp 2019-08-26 16:27:12 +03:00
Alexey Milovidov
60d660e263 Merge branch 'master' into merge-constraints 2019-08-26 16:13:44 +03:00
Alexander Tokmakov
f9445626d1 better parsing of format string 2019-08-26 16:02:15 +03:00
Dmitry Rubashkin
4f89dcc80d Try to fix 2019-08-26 15:47:19 +03:00
alexey-milovidov
c2b6cffabc
Update IStorage.cpp 2019-08-26 15:39:35 +03:00
alesapin
8047aab684 Add const 2019-08-26 13:13:56 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Vasily Nemkov
d0d63d769e Implemented hasTokenCaseInsensitive function
And tests;
2019-08-26 11:00:48 +03:00
Alexey Milovidov
6e8b7b9c3b Fixed error 2019-08-26 05:53:42 +03:00
Alexey Milovidov
25635d1ab0 Fixed build of tests 2019-08-26 05:46:21 +03:00
Alexey Milovidov
2a3e0eb1f1 Merge branch 'master' into merge-constraints 2019-08-26 04:30:31 +03:00
Vitaliy Zakaznikov
7fb13b12f9 Reverting to previous no users thread functionality to avoid
keeping no users thread always alive for each live view.
2019-08-25 08:27:47 -04:00
Vitaliy Zakaznikov
2342d64d1b * Updating no users thread to sleep 3 times longer when users are present
to reduce the number of times thread wakes up.
* Updating startNoUsersThread to return if the thread is already running.
2019-08-25 07:36:08 -04:00
alexey-milovidov
d0555d8eab
Merge pull request #6653 from yandex/speed-up-memory-tracker
Speed up MemoryTracker by function inlining
2019-08-25 04:55:46 +03:00
Vitaliy Zakaznikov
62988800e6 Rewriting implementation of LIVE VIEW no users thread. 2019-08-24 21:40:24 -04:00
Alexey Milovidov
d798cbde2f Fixed double whitespaces 2019-08-25 01:28:06 +03:00
Alexey Milovidov
6d3250867c Fixed build of tests 2019-08-25 01:08:45 +03:00
Alexey Milovidov
32a44936e0 Merge branch 'master' into remove-compiler 2019-08-25 01:07:19 +03:00
Alexey Milovidov
7144a3f827 Speed up MemoryTracker by function inlining 2019-08-25 01:06:13 +03:00
Alexey Milovidov
ffbbb173c5 Addition to prev. revision 2019-08-25 01:04:58 +03:00
Alexey Milovidov
17a1938f0f Addition to prev. revision 2019-08-25 01:04:36 +03:00
Nikita Vasilev
2dbfabd08c fix Set index check useless (#6651)
* fixed useless detection

* fixed useless detection

* fix

* fix

* fix
2019-08-25 01:01:36 +03:00
Alexey Milovidov
9660a4db80 Better exception message 2019-08-25 00:35:07 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
alexey-milovidov
9a51e5e386
Merge pull request #6650 from weiqxu/master
fix HDFS HA can't work on DEBUG mode
2019-08-24 21:02:55 +03:00
alexey-milovidov
03deb642d5
Merge pull request #6647 from yandex/fix-trim
Fixed "trim" functions
2019-08-24 17:36:38 +03:00
Alexey Milovidov
a6997aa83f Modifications after merging constraints support 2019-08-24 16:00:04 +03:00
alexey-milovidov
95da4505f4
Merge pull request #6644 from 4ertus2/bugs
Fix crash in OptimizedRegularExpression
2019-08-24 15:09:04 +03:00
Weiqing Xu
b7fdfcc797 fix HDFS HA can't work on DEBUG mode
The Describe the bug
when the using HDFS HA nameserivce as the uri, the port will be 0.
hdfsBuilderSetNameNodePort will be called to set the port.
hdfsBuilderSetNameNodePort call asset to check if the port is greater
than 0.
So in Release mode, it works OK. In the Debug mode, the asset will fail.

How to reproduce
when compiler the Clickhouse, use DEBUG mode, it will throw error when
using HDFS HA nameservice url
2019-08-24 17:27:36 +08:00
Alexey Milovidov
cc0157b293 Added a test 2019-08-24 02:07:05 +03:00
Alexey Milovidov
cdd6dca517 Remove Compiler 2019-08-24 00:10:26 +03:00
Alexey Milovidov
d38e9ee229 Fixed "trim" functions (in progress) 2019-08-23 23:32:31 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces
Added a check for double whitespaces
2019-08-23 23:10:12 +03:00
Alexander Tokmakov
0136ef9a5f move formats to processors 2019-08-23 22:47:22 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
chertus
a21b43913f fix crash in OptimizedRegularExpression 2019-08-23 21:40:42 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexander Tokmakov
1572d0c5b6 Merge branch 'master' into merging_template_format 2019-08-23 20:34:14 +03:00
alexey-milovidov
c781e1c6a7
Update StringSearcher.h 2019-08-23 19:09:24 +03:00
alexey-milovidov
50b927a9d7
Update StringSearcher.h 2019-08-23 19:08:27 +03:00
dimarub2000
859d97e8fd Renaming 2019-08-23 18:47:27 +03:00
Dmitry Rubashkin
9e6c629134 Style fixed 2019-08-23 17:54:10 +03:00
dimarub2000
6e098eb953 New line added :) 2019-08-23 16:25:46 +03:00
dimarub2000
a367f94923 Fix after review 2019-08-23 16:19:12 +03:00
Alexander Tokmakov
734a0f23a9 Merge branch 'master' into merging_template_format 2019-08-23 15:32:35 +03:00
CurtizJ
dae5c650df 'read in order' optimization for processor 2019-08-23 14:39:22 +03:00
CurtizJ
1e1d4eb7c1 temporarily make a dummy for 'with fill' with processors 2019-08-23 14:20:53 +03:00
CurtizJ
5e6ea650eb update comments 2019-08-23 14:13:57 +03:00
CurtizJ
811dab72a8 fix limit with offset 2019-08-23 14:11:50 +03:00
Alexey Milovidov
dae2aa6138 Removed useless code 2019-08-23 08:11:11 +03:00
Alexey Milovidov
84b0f709aa Removed useless code 2019-08-23 08:08:06 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexey Milovidov
20b9af29f5 More tests 2019-08-23 07:34:59 +03:00
Alexey Milovidov
6685365ab8 Added optimized case 2019-08-23 07:25:32 +03:00
Alexey Milovidov
341e2e4587 Step 1: make it correct. 2019-08-23 06:00:06 +03:00
alexey-milovidov
7012a421c6
Merge branch 'master' into alter_table_drop_detached_part 2019-08-23 05:22:07 +03:00
Alexey Milovidov
1222973cb3 Function "neighbor": merging #5925 2019-08-23 05:02:14 +03:00
Alexey Milovidov
99f4c9c813 Moved settings that were in a wrong place 2019-08-23 05:01:24 +03:00
Alexey Milovidov
e3bd572fc7 Removed unused settings 2019-08-23 05:00:35 +03:00
Alexey Milovidov
cff8ec43f9 Rename neighbour -> neighbor 2019-08-23 04:31:04 +03:00
alexey-milovidov
49aa9384af
Merge pull request #5925 from alex-krash/function_next_prev_in_block
Implement neighbour() function
2019-08-23 04:28:36 +03:00
alexey-milovidov
3a237b4375
Merge pull request #6617 from yandex/fix_too_many_parts_while_mutation_6502
Fix too many parts while mutation
2019-08-23 04:27:43 +03:00
alexey-milovidov
66ff7cd43e
Merge pull request #6619 from yandex/live-view-code-quality
Basic code quality of LiveView
2019-08-23 04:27:12 +03:00
alexey-milovidov
5c99780b08
Merge pull request #6606 from yandex/processors-2
Enable processors by default.
2019-08-23 02:50:11 +03:00
CurtizJ
659d3857ab fix build for clang 2019-08-23 02:48:20 +03:00
Alexey Milovidov
78c3be175c Added experimental setting for LIVE VIEWs 2019-08-23 02:46:40 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
Alexander Tokmakov
81022bb3e9 Merge branch 'master' into alter_table_drop_detached_part 2019-08-22 23:38:58 +03:00
Alexander Tokmakov
acce56095f limit number of background threads for mutations 2019-08-22 22:35:46 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
Nikolai Kochetov
b3f91a717c Use ThreadFromGlobalPool in PipelineExecutor instead of ThreadPool. 2019-08-22 17:38:44 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
Dmitry Rubashkin
095124dcba setOptionsDescription() function added 2019-08-22 17:03:37 +03:00
Nikolai Kochetov
b93ffdd038 Fix MergingSortedTransform. 2019-08-22 13:16:56 +03:00
Nikolai Kochetov
11f8ec76df Fix CubeTransform. 2019-08-22 12:28:23 +03:00
Nikolai Kochetov
4f38b08481 Fix RollupTransform. 2019-08-22 11:53:34 +03:00
Nikolai Kochetov
8228871821 Fix RollupTransform. 2019-08-22 11:29:29 +03:00
Nikolai Kochetov
c3aaf583a0 Fix RollupTransform. 2019-08-22 11:26:50 +03:00
akonyaev
1683547b2d ADQM-34 fix style 2019-08-22 10:24:04 +03:00
akonyaev
01216e45b6 Merge branch 'master' of https://github.com/yandex/ClickHouse into ADQM-34
# Conflicts:
#	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp
2019-08-22 09:40:51 +03:00
alexey-milovidov
83104b3d5e
Merge pull request #6603 from amosbird/fix-dt-hash
Fix segfault when decoding symbol table.
2019-08-22 07:35:32 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric
Added a metric for the number of files to send in Distributed tables.
2019-08-22 07:34:09 +03:00
Amos Bird
78af6d793d Fix segfault when decoding symbol table. 2019-08-22 12:34:06 +08:00
Alexey Milovidov
c38a8cb755 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-22 05:32:00 +03:00
Alexey Milovidov
85d3ba099f Added a comment 2019-08-22 05:31:49 +03:00
alexey-milovidov
2ff8f3a5de
Merge pull request #6599 from CurtizJ/fix-order-by-optimization
Disable "read in order" optimization for aggregation without keys.
2019-08-22 05:10:14 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast
Added checks to static_cast of columns.
2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
Alexey Milovidov
e573b06373 Updated comment 2019-08-21 23:33:38 +03:00
Alexey Milovidov
93d380ddaa Fixed test 2019-08-21 23:32:58 +03:00
alexey-milovidov
4a54f3d7b6
Merge pull request #6583 from yandex/fix-false-race-condition-on-frozen-field
Fixed false data race in "MergeTreeDataPart::is_frozen" field
2019-08-21 23:12:34 +03:00
CurtizJ
d573c4ec3e fix wrong check for disabling "read in order" optimization 2019-08-21 20:42:44 +03:00
Nikolai Kochetov
6d81087bdc Remove _dummy column if it is not needed. 2019-08-21 19:53:40 +03:00
akonyaev
321233ddaa ADQM-34 fix hardcode for,at name in ArrowColumnToCHColumn class 2019-08-21 19:39:20 +03:00
Nikolai Kochetov
2e03ac09ec Fix MergingSortedTransform. 2019-08-21 19:38:27 +03:00
Nikolai Kochetov
e68775e3d0 Fix TotalsHavingTransform. 2019-08-21 17:51:32 +03:00
akonyaev
caf0d30a5f ADQM-34 add orc input format 2019-08-21 17:19:47 +03:00
Nikolai Kochetov
fe3221d0e4 Fix SortingAggregatedTransform. 2019-08-21 17:19:18 +03:00
Nikolai Kochetov
c27cada229 Fix ExpressionTransform. 2019-08-21 16:14:23 +03:00
Alexander Tokmakov
5cb8605f61 limit number of mutations in the queue 2019-08-21 16:10:33 +03:00
CurtizJ
9fdb9e5805 implement modifier 'with fill' for 'order by' clause 2019-08-21 15:59:03 +03:00
Nikolai Kochetov
2a0a051090 Enable processors by default. 2019-08-21 14:34:40 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
dimarub2000
086dd815ac T_test.h added, some fixes 2019-08-21 11:53:41 +03:00
Alexey Milovidov
3c3ca97218 Addition to prev. revision 2019-08-21 08:47:09 +03:00
alexey-milovidov
e6fd885c68
Merge pull request #6580 from yandex/fix-nullif
Fix nullIf function.
2019-08-21 06:36:47 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
d848009827 Fixed false data race in "MergeTreeDataPart::is_frozen" field 2019-08-21 06:16:59 +03:00
alexey-milovidov
0e896fb341
Merge pull request #6578 from yandex/disable-elf-on-macos
Disable ELF on Mac OS
2019-08-21 06:01:49 +03:00
Alexey Milovidov
40454aa7a0 Addition to prev. revision 2019-08-21 05:46:54 +03:00
Alexey Milovidov
6e26d8ccdf Addition to prev. revision 2019-08-21 05:42:50 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
b768bef4e3 Fixed nullIf function 2019-08-21 04:43:19 +03:00
Alexey Milovidov
69be2c4658 Fixed nullIf function 2019-08-21 04:28:55 +03:00
Alexey Milovidov
449dc4757a Fixed nullIf function 2019-08-21 04:20:06 +03:00
Alexey Milovidov
562bffb337 Fixed nullIf function 2019-08-21 04:14:25 +03:00
alexey-milovidov
2b31409332
Merge pull request #6579 from yandex/parquet-bool-fix
Parquet: Fix reading boolean columns
2019-08-21 04:01:28 +03:00
Alexey Milovidov
a6b64d6ba0 Parquet: Fix reading boolean columns 2019-08-21 04:00:13 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run
Try to remove dry run
2019-08-21 03:52:41 +03:00
Alexey Milovidov
17e93b8f2d Disable ELF on Mac OS #6429 2019-08-21 03:48:34 +03:00
Alexey Milovidov
f277d0ebbf Style 2019-08-21 03:37:55 +03:00
alex-zaitsev
1e6437e4ee WIP: Fix MacOS build (#6429)
* Fix broken MacOS build

* Fix MacOS build

* Update ReadBufferFromFile.cpp

* Update WriteBufferFromFile.cpp

* Update Elf.h

* Update Elf.h
2019-08-21 03:35:41 +03:00
alexey-milovidov
58358ec856
Merge pull request #6514 from yandex/added-test-for-race-conditions
Added a test for race conditions.
2019-08-21 01:33:34 +03:00
Alexey Milovidov
c1de51dc5b Better code 2019-08-20 22:53:27 +03:00
alexey-milovidov
f9968fbcfc
Merge pull request #6554 from yandex/add-table-finctions-number-mt
Add table function numbers_mt
2019-08-20 22:42:27 +03:00
alexey-milovidov
31a4b816fe
Merge pull request #6566 from yandex/filimonov-remove-duplicated-const
remove doubled const TABLE_IS_READ_ONLY
2019-08-20 22:24:40 +03:00
Alexey Milovidov
295aafb13f Parallel ALTER modify: don't use ThreadPool if the number of threads is one 2019-08-20 21:18:37 +03:00
Alexey Milovidov
c8859febcb Merge branch 'master' into added-test-for-race-conditions 2019-08-20 21:05:25 +03:00
Nikolai Kochetov
822fe63f3b Added comment. 2019-08-20 19:13:18 +03:00
Nikolai Kochetov
06bb0af386 Fix build. 2019-08-20 18:03:35 +03:00
Nikolai Kochetov
aef03fd9bf
Merge pull request #6425 from yandex/vzakaznikov-liveview
Merge LIVE VIEW
2019-08-20 17:13:42 +03:00
Nikolai Kochetov
7bd748c969 Renamed NumbersMtBlockInputStream to NumbersMultiThreadedBlockInputStream. 2019-08-20 17:13:06 +03:00
Nikolai Kochetov
0ab886ce9d Materialize constant in arrayWithConstant function. 2019-08-20 15:28:36 +03:00
BayoNet
e986d6ba53
DOCAPI-7459: skip_unavailable_shards docs (#6361)
* Link fix.

* DOCAPI-7459: skip_unavailable_shards docs

* Update dbms/src/Core/Settings.h

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* Update docs/en/operations/settings/settings.md

Co-Authored-By: Ivan Blinkov <github@blinkov.ru>

* DOCAPI-7459: Markup fixes.
2019-08-20 15:06:52 +03:00
filimonov
8d0c2eacfd
remove doubled const TABLE_IS_READ_ONLY 2019-08-20 13:18:08 +02:00
Ivan
a502424c33
Implement support for insertion into Kafka tables (#6012)
* Add write-callback on each row for RowOutputStream
* Fix build of new rdkafka library
* Poll messages if Kafka outgoing queue is full
* Add test
* Add test producer-consumer
* Truncate delimiter from last row in message
2019-08-20 14:17:57 +03:00
Nikolai Kochetov
0c0e5010dc Added NumbersMtBlockInputStream. 2019-08-20 13:29:04 +03:00
Nikolai Kochetov
7f31b8bf9c Added NumbersMtBlockInputStream. 2019-08-20 13:28:20 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
bfd0505d99 Fix tests. 2019-08-20 11:36:10 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
alexey-milovidov
c870cbce73
Merge pull request #6548 from achimbab/master
Added 'strict' parameter in windowFunnel() and added testcases.
2019-08-20 05:05:49 +03:00
Alexey Milovidov
b7cb55a06e Added a comment 2019-08-20 04:46:48 +03:00
Alexey Milovidov
a574727269 Attempt to fix deadlock 2019-08-20 04:24:53 +03:00
Alexey Milovidov
666029db6e Merge branch 'added-test-for-race-conditions' of github.com:yandex/ClickHouse into added-test-for-race-conditions 2019-08-20 03:50:40 +03:00
Alexey Milovidov
99aa5cce38 Fixed idiotic error in system.parts 2019-08-20 03:49:58 +03:00
Alexey Milovidov
f1fef3f169 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-20 03:48:24 +03:00
Alexey Milovidov
e594c344f5 Fixed idiotic error in system.parts 2019-08-20 03:48:08 +03:00
alexey-milovidov
3a909c54c5
Merge pull request #6523 from yandex/fix_inconsistent_parts_after_clone_replica
Fix inconsistent parts after clone replica
2019-08-20 02:25:00 +03:00
tavplubix
fa40dfb257
Merge pull request #6559 from yandex/fix_csv_6426
Fix csv input
2019-08-20 02:24:33 +03:00
Alexander Tokmakov
bca580653d fix csv input 2019-08-20 02:09:02 +03:00
alexey-milovidov
fe634d69fe
Merge pull request #6550 from yandex/fix_6125
Fix NPE when using IN clause with a subquery with a tuple
2019-08-20 01:39:02 +03:00
Alexander Kazakov
fe5cd47068
Process prewhere clause in "skip unused shards" optimization (#6521)
* Process prewhere clause in optimize_skip_unused_shards

* Better diagnostics and logging
2019-08-19 23:28:24 +03:00
Alexey Milovidov
5575be034d Whitespaces 2019-08-19 22:32:02 +03:00
Alexey Milovidov
22a11343e8 Attempt to fix race condition 2019-08-19 22:02:20 +03:00
Nikolai Kochetov
d359ff3d4a Fix build. 2019-08-19 21:34:12 +03:00
Nikolai Kochetov
56a9c3920f Fix build. 2019-08-19 21:28:48 +03:00
Nikolai Kochetov
8535ba9e47 Review fixes. 2019-08-19 21:23:37 +03:00
stavrolia
1190e866aa Fix 2019-08-19 21:12:50 +03:00
stavrolia
b3fd5bc141 Add tests, comments and fix 2019-08-19 21:12:50 +03:00
stavrolia
2f2bf953eb fix and add test for storage file version 2019-08-19 21:12:50 +03:00
stavrolia
32fad1e961 fix 2019-08-19 21:12:50 +03:00
stavrolia
229dd7c2b6 wip 2019-08-19 21:12:50 +03:00
stavrolia
f9037fee2c Fix File version 2019-08-19 21:12:50 +03:00
stavrolia
b386b3090c Impove HDFS version 2019-08-19 21:12:50 +03:00
stavrolia
95cb95105d Add recursive version for storage file 2019-08-19 21:12:50 +03:00
stavrolia
7addd50c16 recursive version for StorageHDFS and some tests for it 2019-08-19 21:12:50 +03:00
stavrolia
a3b35d5569 WIP 2019-08-19 21:12:50 +03:00
stavrolia
e6d85de79a wip small change 2019-08-19 21:12:50 +03:00
stavrolia
6055c61e7f wip hdfs 2019-08-19 21:12:50 +03:00
stavrolia
dbf1417bd6 Globs in storage file 2019-08-19 21:12:50 +03:00
Alexey Milovidov
d2e5789f82 Fixed strange code in mutations that may lead to memory corruption 2019-08-19 21:12:22 +03:00
Nikolai Kochetov
04c17c56c2 Review fixes. 2019-08-19 21:10:40 +03:00
Nikolai Kochetov
d4363768e6 Added IFunctonBase::getResultIfAlwaysReturnsConstantAndHasArguments 2019-08-19 20:48:19 +03:00
alexey-milovidov
a116fd7a69
Merge pull request #6477 from dimarub2000/quantileExact_improvement
QuantileExactExclusive & Inclusive function added.
2019-08-19 20:39:37 +03:00