Commit Graph

20965 Commits

Author SHA1 Message Date
Alexey Milovidov
bb0ca310ab Allow to ATTACH live views 2019-08-31 02:38:03 +03:00
Alexey Milovidov
fd85a862f0 Added a test just in case 2019-08-31 02:19:05 +03:00
Alexey Milovidov
2fd8f5c324 Removed code that I don't understand and that has no comments 2019-08-31 02:09:08 +03:00
Alexey Milovidov
cc118b3fed Added a test for RENAME / Merge table race condition 2019-08-31 01:43:15 +03:00
alesapin
2647d4ca15 Rename immutable to readonly 2019-08-30 23:12:26 +03:00
Alexander Tokmakov
cd5d733f75 rewrite unit test with gtest 2019-08-30 22:08:23 +03:00
alesapin
6f30338c08 Fixes 2019-08-30 21:31:35 +03:00
Ivan
cd5c0fc9ac
Fix build issues (#6744)
* libcxxabi uses exception handling library as public
* Don't set -stdlib for internal libc++ - it poisons the checks.
* Enable capnproto in unbundled build back
2019-08-30 20:40:27 +03:00
alexey-milovidov
6352c57afb
Merge pull request #6748 from yandex/fix_bad_size_of_marks
Fix bad size of marks with skip indices
2019-08-30 20:26:59 +03:00
Alexander Tokmakov
4c744af113 minor style fixes 2019-08-30 20:25:35 +03:00
alesapin
808f4d0b8a Intermediate refactoring 2019-08-30 19:50:59 +03:00
Alexey Milovidov
ace08fa344 Merge branch 'master' into time-zone-configuration 2019-08-30 19:27:08 +03:00
Alexey Milovidov
83c75ca2ad Added a test (but it doesn't reproduce the issue #6746) 2019-08-30 19:21:05 +03:00
alesapin
d4ea6a5234 Fix comment 2019-08-30 17:30:28 +03:00
alesapin
f6120558df Fix bad size of marks 2019-08-30 17:29:08 +03:00
Alexey Milovidov
4cb640717b Fixed test 2019-08-30 16:28:27 +03:00
Alexey Milovidov
da5e7f31c4 Updated README 2019-08-30 16:25:34 +03:00
Alexey Milovidov
48bf4abdf0 Fixed function name 2019-08-30 16:14:47 +03:00
Alexey Milovidov
3fdcc4ab30 Fixed typo in README.md 2019-08-30 16:14:20 +03:00
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
alexey-milovidov
e5a7f451f0
Merge pull request #6737 from vitlibar/improve-error-handling-in-cache-dictionary
Improve error handling in cache dictionaries
2019-08-30 16:06:07 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream
Reduced children_mutex lock scope in IBlockInputStream
2019-08-30 16:02:22 +03:00
chertus
e9c4f36586 Merge branch 'master' into some 2019-08-30 15:49:55 +03:00
Vitaly Baranov
da8f67123f Improve error handling in cache dictionaries:
allow using expired values while the source of a cache dictionary doesn't respond;
clone the source after an error to reset connections;
don't ask the source for a little time after error;
show the last exception in system.dictionaries for a cache dictionary too.
2019-08-30 12:50:38 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
2019-08-30 11:24:00 +03:00
Alexander Tokmakov
e3982704ea try to fix build 2019-08-30 00:46:36 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
Alexander Tokmakov
d95d53b4e4 better error messages 2019-08-29 22:35:59 +03:00
Alexey Milovidov
0bca68e50b Style 2019-08-29 21:55:20 +03:00
chertus
3ad43daae3 Merge branch 'master' into some 2019-08-29 21:50:47 +03:00
chertus
d5cfbcf6e1 subquery_requires_alias setting (disabled by default) 2019-08-29 21:45:34 +03:00
Dmitry Rubashkin
876847f3f7 Now stacked logs are received in appropriate way. 2019-08-29 20:30:16 +03:00
CurtizJ
a6e43c4119 merging with master 2019-08-29 19:48:02 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
Ivan
5851316742
Don't interrupt copyData() used inside Kafka materialized views (#6597)
* Print better offsets on commit
* Stop consumption on the read buffer level
* Don't use cancellation in the middle of copyData()
* Add test
* Disable squashing stream for Kafka materialized views
* Commit last read message, since rdkafka auto-modifies offset
2019-08-29 18:36:07 +03:00
alexey-milovidov
c19e5faf4c
Merge pull request #6717 from yandex/fix-data-race-in-storage-merge
Fix for data race in StorageMerge
2019-08-29 18:25:48 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json
Fix extracting a Tuple from JSON
2019-08-29 17:40:26 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Alexander Tokmakov
d6ca9fee63 unit test for PeekableReadBuffer 2019-08-29 16:30:43 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
Dmitry Rubashkin
4bd79c47dc Now send_logs_level won't affect catching exception. Test added. 2019-08-29 15:36:06 +03:00
alesapin
dac55278ad Better comments 2019-08-29 14:15:56 +03:00
alesapin
702b47ae5b Remove redundant changes 2019-08-29 13:56:43 +03:00
alesapin
0899b3818d Remove redundant changes 2019-08-29 13:49:26 +03:00
alesapin
67f9753775 Merge branch 'master' into bad_size_of_marks_skip_idx_bug 2019-08-29 11:07:56 +03:00
alesapin
d3b378ea10 Fix flappy test (descrease number of iterations) 2019-08-29 11:02:50 +03:00
zhang2014
275c0d88b3 fix build failure 2019-08-29 12:54:09 +08:00
zhang2014
74c9eea657 fix test failure 2019-08-29 11:34:00 +08:00
zhang2014
3c7405bdb0 move test to integration & refer max_expanded_ast_elements 2019-08-29 11:31:22 +08:00
zhang2014
92740212b5 fix build failure 2019-08-29 11:15:15 +08:00
zhang2014
7432845f60 add test case 2019-08-29 11:14:40 +08:00
zhang2014
6c3626b629 truncate should remove mutations 2019-08-29 11:14:40 +08:00
zhang2014
54b65bac50 fix max_ast_elements settings with merge mutation 2019-08-29 11:06:35 +08:00
Vitaly Baranov
4ec12c3d24 Add more tests for JSON functions. 2019-08-29 01:55:35 +03:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
Alexey Milovidov
d1a980fcdd Fix for data race in StorageMerge 2019-08-29 01:18:26 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
06ea75f9fd Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-28 23:15:28 +03:00
Alexey Milovidov
e9875950a4 Make test timeout to be more significant 2019-08-28 22:36:04 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Artem Zuikov
405f060f4f
Merge pull request #6708 from 4ertus2/some
Test for #4858
2019-08-28 21:57:46 +03:00
Alexey Milovidov
48dce81e61 Minor modifications after #6413 2019-08-28 21:54:30 +03:00
alexey-milovidov
33311a9bf1
Merge branch 'master' into atomic_zookeeper2 2019-08-28 21:34:42 +03:00
alesapin
b4d98f6e13 Trying to fix vertical merge 2019-08-28 21:23:20 +03:00
alexey-milovidov
44dd3bd792
Merge pull request #6692 from yandex/remove-queue_max_wait_ms
Set default value of "queue_max_wait_ms" to zero, because current value makes no sense
2019-08-28 21:06:09 +03:00
alexey-milovidov
7b9b67fd71
Merge pull request #6695 from yandex/improve-table-locks
Avoid possible deadlock in TRUNCATE of Replicated table.
2019-08-28 21:05:26 +03:00
alexey-milovidov
6d2dca3242
Merge pull request #6705 from 4ertus2/bugs
JOINs with not nullable types and join_use_nulls=1
2019-08-28 21:05:16 +03:00
alexey-milovidov
c72dffc591
Merge pull request #6706 from yandex/client-do-not-substitute-inside-query
Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client
2019-08-28 21:04:56 +03:00
Alexey Milovidov
eb15c9416a Fixed style 2019-08-28 21:00:40 +03:00
Dmitry Rubashkin
4b7f5f20c1 Exception check added when sending data by parts. 2019-08-28 20:52:17 +03:00
Alexey Milovidov
509717dea7 Added integration test 2019-08-28 20:18:19 +03:00
Alexey Milovidov
cf57a88495 Added a way to forbid static initialization of a class 2019-08-28 20:13:29 +03:00
Alexey Milovidov
30cc569845 Avoid initializing DateLUT in static constructors 2019-08-28 20:11:40 +03:00
chertus
91bc0eca11 add test for #4858 2019-08-28 20:00:20 +03:00
Alexander Tokmakov
c8096542bf more tests and fixes 2019-08-28 19:46:54 +03:00
chertus
5e27937227 fix RIGHT JOIN for Tuples 2019-08-28 18:44:18 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting
Formatting changes for StringHashMap PR #5417.
2019-08-28 18:30:59 +03:00
alexey-milovidov
819f1f2aa6
Merge pull request #6701 from yandex/aku/no-cache-low-cardinality
Disable consecutive key optimization for UInt8/16 LowCardinality columns.
2019-08-28 18:30:24 +03:00
Alexey Milovidov
b6a0dba2df Added a setting "connection_pool_max_wait_ms" 2019-08-28 18:27:26 +03:00
Alexey Milovidov
cced091881 Addition to prev. revision 2019-08-28 18:24:35 +03:00
Alexey Milovidov
d1c268c2ed Added setting "kafka_max_wait_ms" 2019-08-28 18:24:23 +03:00
Alexey Milovidov
06c0e35e46 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:21:57 +03:00
Alexey Milovidov
d06e350312 Added setting "replace_running_query_max_wait_ms" 2019-08-28 18:20:22 +03:00
Alexey Milovidov
a9702aa6f2 Merge branch 'master' into remove-queue_max_wait_ms 2019-08-28 18:16:53 +03:00
alexey-milovidov
24c8ee9fcd
Merge pull request #6703 from arenadata/ADQM-40
test for orc input format
2019-08-28 18:14:40 +03:00
Alexey Milovidov
f519234908 Added a test 2019-08-28 18:13:19 +03:00
Alexey Milovidov
10b878b30b Disable Poco::AbstractConfiguration substitutions in query in clickhouse-client 2019-08-28 18:06:30 +03:00
chertus
90d5410aaa join_use_nulls with not nullable types 2019-08-28 17:14:09 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
alexey-milovidov
696d505a1a
Merge pull request #6656 from vzakaznikov/fix_live_view_no_users_thread
Fix live view no users thread
2019-08-28 16:33:36 +03:00
akonyaev
9d0e5b925b ADQM-40 test for orc input format 2019-08-28 16:26:38 +03:00
Alexey Milovidov
a1101e5278 Fixed build 2019-08-28 16:21:19 +03:00
Alexey Milovidov
8b973fd9f2 Merge branch 'improve-table-locks' of github.com:yandex/ClickHouse into improve-table-locks 2019-08-28 15:59:23 +03:00
Alexey Milovidov
625e128770 Merge branch 'master' into improve-table-locks 2019-08-28 15:41:30 +03:00
Alexey Milovidov
99d62efb4d Added a test 2019-08-28 15:26:13 +03:00
Alexander Kuzmenkov
0b5a7f5f4a Disable consecutive key optimization for UInt8/16 LowCardinality
columns.

A follow-up to #6298, this is as well a part of StringHashMap PR #5417
by Amos Bird.
2019-08-28 14:05:52 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Alexey Milovidov
32c7f9688a Removed extra quoting from Settings 2019-08-28 13:13:22 +03:00
Artem Zuikov
8fa4575a88
Merge pull request #6693 from 4ertus2/mjoin
Minor refactoring
2019-08-28 10:12:37 +03:00
Alexey Milovidov
f2d081a785 Addition to prev. revision 2019-08-28 03:42:45 +03:00
Alexey Milovidov
3db38c690e Changes to Benchmark after merge 2019-08-28 03:15:08 +03:00
Alexey Milovidov
c8798b2ffa Slightly improve table locks 2019-08-28 02:47:30 +03:00
alexey-milovidov
44424651b0
Merge pull request #6343 from dimarub2000/benchmark_comparison_mode
[WIP] Clickhouse-benchmark comparison mode
2019-08-28 02:38:07 +03:00
alexey-milovidov
4782c1170c
Merge pull request #6691 from yandex/weiqxu-master
Merging "check free space when use external sort/aggerator"
2019-08-28 01:55:18 +03:00
Alexey Milovidov
e7cbd34a29 Improve table locks (incomplete) 2019-08-27 23:43:35 +03:00
Alexey Milovidov
285d66cee1 Improve table locks (incomplete) 2019-08-27 23:43:08 +03:00
Vitaliy Zakaznikov
e80ff65a0f Removing allow_experimental_live_view option from clickhouse-client.xml. 2019-08-27 16:23:12 -04:00
alexey-milovidov
c736d6b495
Merge pull request #6676 from dimarub2000/right_left_problem_#6381
Query transformation for external database fixed.
2019-08-27 23:11:39 +03:00
chertus
5208a70203 one less place with changed nullability columns 2019-08-27 22:41:51 +03:00
Alexey Milovidov
63c0070cd5 Fixed flacky test 2019-08-27 22:32:33 +03:00
Alexey Milovidov
0add95b7d8 Set default value of "queue_max_wait_ms" to zero, because current value makes no sense 2019-08-27 22:21:53 +03:00
Alexey Milovidov
25c53ccd9e Rename setting 2019-08-27 22:05:35 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
Alexander Tokmakov
93c672aa0b delete BlockInputStreamFromRowInputStream 2019-08-27 21:29:56 +03:00
Alexander Tokmakov
cf3a8b993b allow skipping fields in TemplateRowInputFormat 2019-08-27 19:53:26 +03:00
Alexey Milovidov
8ca00a26f6 Fixed build 2019-08-27 17:31:34 +03:00
Alexey Milovidov
c385c950ba Merge branch 'master' into replicate-merge-tree-minor-lock-improvement 2019-08-27 17:30:48 +03:00
alexey-milovidov
d12ced8099
Merge pull request #6191 from svladykin/ttldropparts
TTL: Only drop altogether the expired parts and not partially prune them.
2019-08-27 16:54:56 +03:00
alesapin
106b9717cd Refactoring of immutable settings 2019-08-27 16:14:19 +03:00
Dmitry Rubashkin
17f18e42c0 new line 2019-08-27 16:13:40 +03:00
Dmitry Rubashkin
f1f85a5a24 Fixed case with single subquery and added tests. 2019-08-27 16:09:58 +03:00
alexey-milovidov
8db93d392b
Merge pull request #6685 from yandex/merge_tree_settings_alter
Alter merge tree settings with other types of alter
2019-08-27 16:07:28 +03:00
alesapin
36472b14f9 Defend kafka storage from alters 2019-08-27 12:48:20 +03:00
alesapin
7851d8fe0a Add ability to alter settings with other types of alter 2019-08-27 12:34:53 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
Vitaliy Zakaznikov
5fb5c8dffc Updating all live view tests to set the allow_experimental_live_view option. 2019-08-26 19:50:37 -04:00
Alexey Milovidov
66203973f2 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-27 00:41:18 +03:00
Alexey Milovidov
7985270624 Disable processors by default 2019-08-27 00:41:10 +03:00
Alexey Milovidov
d654f2507e Fixed typo in test 2019-08-27 00:40:56 +03:00
Alexey Milovidov
57fa4e1dd7 Minor lock improvement for ReplicatedMergeTree 2019-08-27 00:40:29 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive
Implemented hasTokenCaseInsensitive function
2019-08-27 00:39:04 +03:00
alexey-milovidov
9fa5ee758d
Merge pull request #6670 from 4ertus2/bugs
Fix two vulnerabilities in Codecs
2019-08-27 00:38:09 +03:00
alexey-milovidov
9cdc434319
Merge pull request #6672 from yandex/aku/reverse-index
Separate the hash table interface for ReverseIndex.
2019-08-27 00:38:00 +03:00
alexey-milovidov
561b173ddc
Merge pull request #6675 from yandex/simplify-shared-ptr-helper
Simplify shared_ptr_helper
2019-08-27 00:36:52 +03:00
CurtizJ
5f25c2d7b4 merging with master 2019-08-26 22:49:52 +03:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Dmitry Rubashkin
5989b19684 Final 2019-08-26 22:16:28 +03:00
Alexey Milovidov
0eec226c9a Simplify shared_ptr_helper 2019-08-26 22:07:29 +03:00
Dmitry Rubashkin
0c75d5f42b Function transformQueryForExternalDatabase() fixed 2019-08-26 22:03:47 +03:00
alesapin
cf31187254 Resolve conflicts 2019-08-26 21:08:58 +03:00
Alexander Kuzmenkov
c0bb52ca6d Separate the hash table interface for ReverseIndex.
It is significantly different from other uses of hash tables, and poses
the main obstacle to changing the hash table interface to the one that
can be easily supported by compound hash tables.

Make it explicitly separate, implement it only for a particular kind of
HashTable, and move this implementation to the ReverseIndex module.
2019-08-26 21:00:44 +03:00
Anton Popov
4cd376f587
fix table ttl after bad merge with master 2019-08-26 21:00:13 +03:00
CurtizJ
fa5aeb757f fix clang build 2019-08-26 20:37:40 +03:00
chertus
12084270de fix build 2019-08-26 19:58:40 +03:00
Dmitry Rubashkin
34fefcfa2f Merge branch 'perfomance_test_help_size' of github.com:dimarub2000/ClickHouse into perfomance_test_help_size 2019-08-26 19:46:28 +03:00
Dmitry Rubashkin
1da261576e Try fix2 2019-08-26 19:42:20 +03:00
CurtizJ
4a7459f3b3 cleanup and update comments 2019-08-26 18:25:18 +03:00
CurtizJ
c63eeb8933 add FinishSortingTransform, refactor MergeSortingTransform 2019-08-26 17:54:29 +03:00
alesapin
0d0ebf885f Remove two redundant arguments from alter 2019-08-26 17:50:34 +03:00