Commit Graph

22906 Commits

Author SHA1 Message Date
Mikhail Filimonov
5228f5f2eb Test case for altering to LowCardinality when data part is empty 2019-12-02 16:11:28 +01:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master
Added lifetime to system.dictionaries #6820
2019-12-02 15:15:44 +03:00
chertus
0251f4e442 perf: move applyLazyDefaults() out of cycle for ALL JOIN 2019-12-02 14:45:21 +03:00
Maksim Fedotov
6381d33981 support clickhouse as mysql federated server. apply code review notes p4 2019-12-02 14:32:45 +03:00
Ivan Lezhankin
0e276ad887 Fix build 2019-12-02 14:29:52 +03:00
alesapin
08dfd1d1c4 Limit number of streams for read from StorageFile and StorageHDFS 2019-12-02 14:25:41 +03:00
Ivan Lezhankin
4f56e03729 Use SIGRTMIN instead of SIGPROF for user debugging purposes 2019-12-02 13:50:57 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE
Do not reload *all* dictionaries on CREATE DATABASE
2019-12-02 11:50:44 +03:00
Yuriy
211e1364f6 fixed style 2019-12-02 06:12:27 +03:00
Vladimir Chebotarev
03ec61fff3 Fixed 01030_storage_s3_syntax stateless test. 2019-12-01 15:35:04 +03:00
Yuriy
3677d1dcfa implemented ProtocolText 2019-12-01 15:17:49 +03:00
Vladimir Chebotarev
d0760bc169 Fixed tests and logic of authorization in S3. 2019-12-01 14:24:55 +03:00
Vladimir Chebotarev
0a19b4fbd6 Attempt to add S3 authentication. 2019-12-01 10:56:11 +03:00
Vladimir Chebotarev
94684c07bf Added syntax for access_key_id and secret_access_key in S3 table function and storage. 2019-12-01 10:56:11 +03:00
Артем Стрельцов
25aa2114b2 Deleted redundant empty lines 2019-12-01 03:49:11 +03:00
Артем Стрельцов
95124e910a Fixed test for lifetime 2019-12-01 03:40:59 +03:00
Nikolay Degterinsky
b0eabb690b Test added 2019-11-29 21:46:26 +03:00
Nikolay Degterinsky
6b39253b71 Fixed naming 2019-11-29 17:15:12 +03:00
Nikolay Degterinsky
59002ddb91 Merge branch 'master' of https://github.com/kekekekule/ClickHouse into dict_lifetime 2019-11-29 17:06:38 +03:00
Maksim Fedotov
13a1a33834 support clickhouse as mysql federated server. apply code review notes p3 2019-11-29 16:37:13 +03:00
Mikhail Filimonov
ad136ec62d get rid of cloneWithColumns in internal loop and some other trash 2019-11-29 11:46:25 +01:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
hcz
5e45a4f3cd Add comment on getValue() function 2019-11-29 14:50:36 +08:00
Mikhail Filimonov
4cc0d0ca5d make virtual_columns local 2019-11-29 07:21:31 +01:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
alexey-milovidov
2e34f02a36
Merge pull request #7936 from ClickHouse/branch-for-slightly-improvement-of-usability-of-exception-messages
The rest of PR #7897 about improvement of exception message
2019-11-28 22:07:29 +03:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00
Maksim Fedotov
6f0f9f855a support clickhouse as mysql federated server. fix code style 2019-11-28 18:02:02 +03:00
Maksim Fedotov
4844b9b230 support clickhouse as mysql federated server. apply code review notes p2 2019-11-28 17:43:52 +03:00
stavrolia
295633b7ef Another try 2019-11-28 17:31:35 +03:00
Anton Popov
9fe987c8e1
Merge pull request #7920 from excitoon-favorites/datetimettl
Removed check for using `Date` or `DateTime` column from TTL expressions
2019-11-27 19:55:57 +03:00
stavrolia
f23273fa80 Fix 2019-11-27 17:29:00 +03:00
Nikolai Kochetov
bd40c9cd13
Merge pull request #7933 from azat/dist-mon-codec-errors-mark-broken
DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
2019-11-27 16:03:44 +03:00
Nikolai Kochetov
f343803891
Merge pull request #7735 from amosbird/clientfix
fix utf-8 paste
2019-11-27 15:51:13 +03:00
Vladimir Chebotarev
4d1b0796e4 Minor fix (removed empty line). 2019-11-27 13:13:25 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
fa79b7cf7d Updated test checking that constant TTL expression works. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
stavrolia
f1e5e58480 Some rest of PR about improvement of exception message 2019-11-27 04:18:26 +03:00
stavrolia
4087d91563 Fix 2019-11-27 03:42:46 +03:00
Mikhail Filimonov
deec48a3e0 attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261 2019-11-27 00:46:19 +01:00
Azat Khuzhin
362505b129 DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
There is no point in retrying batch after those errors (for the same
reasons as CHECKSUM_DOESNT_MATCH is there).
2019-11-26 20:21:05 +03:00
Nikita Mikhaylov
ad2af03f98 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-11-26 20:05:15 +03:00
Nikita Mikhaylov
f6604fdf1a fix build 2019-11-26 20:04:46 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns
Fix union with diff columns
2019-11-26 19:40:45 +03:00
Nikita Mikhaylov
6f119d53f5 adding comments to strange functions used in parallel parsing 2019-11-26 19:33:43 +03:00
Maksim Fedotov
b768b0de55 support clickhouse as mysql federated server. apply code review notes. fix typo 2019-11-26 18:42:50 +03:00
Maksim Fedotov
5e40311266 support clickhouse as mysql federated server. apply code review notes 2019-11-26 18:39:36 +03:00
Olga Khvostikova
4d6214d33e
Merge pull request #7908 from CurtizJ/enum_conversion
Fix enum conversion in native format for backward compatibility.
2019-11-26 17:53:47 +03:00
Vladimir Chebotarev
e3f299e3c4 Fixed background pool logger name. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Nikolai Kochetov
c161a486f1 Added test. 2019-11-26 15:07:07 +03:00
Olga Khvostikova
0f517648b1
Merge pull request #7722 from ClickHouse/java-hash-non-bmp
Added a test of javaHashUTF16LE for non BMP code points
2019-11-26 13:30:18 +03:00
Olga Khvostikova
953f3a5ddf
Merge pull request #7897 from ClickHouse/better-exception-messages
Slightly better usability of exception messages
2019-11-26 13:20:56 +03:00
Nikolai Kochetov
f301e60ef5 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:14:56 +03:00
Nikolai Kochetov
a6a0b2dea3 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:01:02 +03:00
CurtizJ
6a1baefc47 add missing comment and rename 2019-11-26 12:59:31 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts
Added disk info to `system.detached_parts`
2019-11-26 11:56:50 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias
Fix reading empty set with prewhere dependent on alias column.
2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas
Fix prewhere with max_parallel_replicas.
2019-11-26 09:29:49 +03:00
alexey-milovidov
23f848993d
Update 01034_prewhere_max_parallel_replicas.sql 2019-11-26 09:27:25 +03:00
alexey-milovidov
a816887073
Merge pull request #7907 from ClickHouse/sample_final
FINAL SAMPLE
2019-11-26 09:21:38 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikolai Kochetov
f90a8cebfd Add test with remote, final and max_parallel_replicas. 2019-11-25 18:44:15 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
CurtizJ
c223281d5d fix enum coversion in native format for backward compatibility 2019-11-25 17:06:44 +03:00
Nikolai Kochetov
c97212d132 Remove unused variable. 2019-11-25 16:35:28 +03:00
Nikolai Kochetov
6587a87267 Added test with sample and final. 2019-11-25 16:09:44 +03:00
Nikolai Kochetov
d3118f0a76 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:57:14 +03:00
Nikolai Kochetov
9b42e9341d Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:49:05 +03:00
Nikolai Kochetov
f770934e60 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:05:29 +03:00
tavplubix
fde727c4eb Update Context.cpp 2019-11-25 14:42:09 +03:00
Pervakov Grigory
9fbc55c61a Change max_table_size_to_drop and max_partition_size_to_drop to atmoic. Update hint in default config. 2019-11-25 14:42:09 +03:00
Grigory Pervakov
64cb079186 Update dbms/tests/integration/test_reload_max_table_size_to_drop/test.py
Co-Authored-By: Alexander Burmak <Alex-Burmak@yandex-team.ru>
2019-11-25 14:42:09 +03:00
Grigory Pervakov
1f1e25dceb Update dbms/tests/integration/test_reload_max_table_size_to_drop/test.py
Co-Authored-By: Alexander Burmak <Alex-Burmak@yandex-team.ru>
2019-11-25 14:42:09 +03:00
Pervakov Grigory
4bebf34215 Complete test with sleep 2019-11-25 14:42:09 +03:00
Pervakov Grigory
ac1a92649c WIP: Add regression test on config reload 2019-11-25 14:42:09 +03:00
Pervakov Grigory
651e0f3a1c Update max_table_size_to_drop and max_partition_size_to_drop with config reload 2019-11-25 14:42:09 +03:00
Nikita Mikhaylov
7c59fd4795
Merge pull request #7894 from nikitamikhaylov/segmentating_functions
Returning back segmentation engines for JSONEachRow and CSV formats.
2019-11-25 13:12:18 +03:00
alexey-milovidov
8b4e12798e
Merge pull request #7879 from Akazz/doc/move_dev_instruction
[Documentation] Moved developer instruction
2019-11-23 19:20:55 +03:00
alexey-milovidov
eb7f48aaf6
Merge pull request #7816 from dingxiangfei2009/fix-copier-contention-master
Fix clickhouse-copier cleaning-tainting contention between concurrent workers
2019-11-23 06:49:03 +03:00
alexey-milovidov
0633f9f8db
Update CSVRowInputFormat.cpp 2019-11-23 03:24:25 +03:00
Alexey Milovidov
2d9d116267 Slightly better exception messages 2019-11-23 03:18:56 +03:00
tavplubix
f1afb3d0c8
Merge pull request #7880 from arenadata/fix_or_zero_and_or_null_conversion
Add exception for illegal types for conversion functions with -OrZero postfix
2019-11-22 21:03:58 +03:00
Nikita Mikhaylov
1d170ed607 use set from storage set for set in index 2019-11-22 18:45:03 +03:00
Nikita Mikhaylov
22a8e8efa7 better segmenating + move read functions to avoid linker errors 2019-11-22 16:53:26 +03:00
Nikita Mikhaylov
d495e282c7 returning back JSON and CSV 2019-11-22 13:38:08 +03:00
Nikita Mikhaylov
6f80b0fed4 move specific functions to ReadHelpers 2019-11-22 13:12:24 +03:00
Pavel Kovalenko
51848b87e0 Merge branch 'master' into minio-integration
# Conflicts:
#	dbms/tests/integration/helpers/cluster.py
2019-11-22 13:08:53 +03:00
Nikita Mikhaylov
728ede25f9
Merge pull request #7840 from apbodrov/read_write_gzip
Gzip read/write to file/s3/url/hdfs
2019-11-22 11:48:58 +03:00
Ding Xiang Fei
8330a09575
apply style guide and fix CI warnings 2019-11-22 09:48:58 +08:00
Ding Xiang Fei
608aa276ab
add safeguard against contention to check target partition row counts 2019-11-22 09:48:57 +08:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions
Fix Storage lifetime in table functions
2019-11-22 02:29:06 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing
Merging parallel format parsing
2019-11-22 01:54:47 +03:00
Nikita Mikhaylov
1d74aecda8 fix typo in asserts 2019-11-21 21:14:47 +03:00
akonyaev
6834dd5fd0 Add exception for illegal types for conversion functions with -OrZero or -OrNull postfixes.
Add docs for conversion functions with -OrZero and -OrNull postfixes.
2019-11-21 18:53:14 +03:00
akonyaev
78f13839ac Add exception for illegal types for conversion functions with -OrZero or -OrNull postfixes.
Add docs for conversion functions with -OrZero and -OrNull postfixes.
2019-11-21 18:46:25 +03:00
Alexander Tokmakov
ba3969527f move table locks to main pipeline 2019-11-21 18:37:59 +03:00
Alexander Kazakov
6f3791f507 Moved developer instruction 2019-11-21 18:03:19 +03:00
Alexander Kazakov
d3456b1a8c
Update supported versions of compilers 2019-11-21 17:31:53 +03:00
Alexander Kazakov
83af9abccd
Update supported versions of compilers 2019-11-21 17:30:36 +03:00
Nikita Mikhaylov
31cb69269b small fix 2019-11-21 16:44:11 +03:00
Pavel Kovalenko
586f60d2a0 Ensure multipart upload works in S3 storage tests. 2019-11-21 16:13:38 +03:00
alexey-milovidov
c9e005666b
Merge pull request #7873 from excitoon-favorites/fix-7558-7602
Fixed errors with space reservation introduced in #7558 and #7602
2019-11-21 15:31:21 +03:00
Pavel Kovalenko
01236a3e23 Prepare integration test runner to use Minio. 2019-11-21 15:10:06 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
alexey-milovidov
5878d1bd48
Merge pull request #7870 from ClickHouse/fix_bytes_count_in_peekable_buffer
Fix float parsing in Values
2019-11-21 11:46:34 +03:00
Alexander Tokmakov
61783e1e17 fix bytes count in PeekableReadBuffer 2019-11-21 01:04:57 +03:00
Andrei Bodrov
533cb088e6 std::forward in template 2019-11-20 23:57:34 +03:00
Alexander Kuzmenkov
c913155d95 Fix TSV segmentation. 2019-11-20 20:24:44 +03:00
Vitaly Baranov
6e2f9f6f6d Invert flags in Settings.h: IGNORABLE flag is replaced with IMPORTANT flag. 2019-11-20 19:37:04 +03:00
Andrei Bodrov
decdd7d476 fix typos 2019-11-20 18:40:42 +03:00
Andrei Bodrov
c2849d0864 move to helpers 2019-11-20 17:48:01 +03:00
Pavel Kovalenko
65ff10c81b Use Minio for S3 Storage integration tests. 2019-11-20 14:57:52 +03:00
tavplubix
5331bf4bcd
Merge pull request #7858 from patsevanton/master
fix propery to property
2019-11-20 13:35:18 +03:00
tavplubix
2439818c82
Merge pull request #7854 from den-crane/patch-7
fix order of elements in a confusing error message
2019-11-20 13:33:51 +03:00
Andrei Bodrov
53b02227ad virtual void 2019-11-20 13:11:26 +03:00
Andrei Bodrov
db1a86a94d typo 2019-11-20 11:27:59 +03:00
Alexander Kazakov
c90dc43b9f
Added EN translation of developer instructions (#7825)
* Added EN translation of developer instructions
2019-11-20 10:59:05 +03:00
Anton Patsev
72287b9abb fix propery to property 2019-11-20 13:07:27 +06:00
alexey-milovidov
420aeb25a4
Update MySQLHandler.cpp 2019-11-20 07:30:00 +03:00
Denis Zhuravlev
cf0c8392b3
fix error message
on the right , on the left -> on the left on the right #7853
2019-11-19 20:57:06 -04:00
Yuriy
5be62948bc merged master 2019-11-20 02:34:05 +03:00
Yuriy
1bf4d21c67 more precise error messages in MySQL protocol 2019-11-20 02:27:30 +03:00
Yuriy
21cc7ae25e enabled MySQL compatibility server when ClickHouse is compiled without SSL 2019-11-20 00:10:21 +03:00
Alexander Kuzmenkov
9a2b864940 Cleanup 2019-11-19 21:42:51 +03:00
Nikita Mikhaylov
6d60d10461
just to restart pending perf test 2019-11-19 21:22:32 +03:00
Andrei Bodrov
30ddf95998 another clang fix 2019-11-19 20:27:24 +03:00
Andrei Bodrov
245c3511f6 clang fix 2019-11-19 20:11:13 +03:00
alexey-milovidov
4d4de7da95
Merge pull request #7793 from DeifyTheGod/master
fix zero-access user creation
2019-11-19 20:04:07 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Andrei Bodrov
9296f652d2 old-style cast 2019-11-19 17:35:03 +03:00
Andrei Bodrov
a2b5989177 BrotliReadBuffer refactoring 2019-11-19 16:57:54 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Alexander Kuzmenkov
0d1933cb44 Calculate the number of parsing theads correctly 2019-11-19 16:11:45 +03:00
Andrei Bodrov
8cbc52e711 add gzip read/write to file/s3/url/hdfs 2019-11-19 15:46:07 +03:00
Mikhail Korotov
744a1ea774 Merge branch 'master' into fix_metric_suffix_in_settings_value 2019-11-19 14:43:34 +03:00
Vladimir Chebotarev
008e1efa75 Added test for disk name in system.detached_parts. 2019-11-19 14:43:33 +03:00
Vladimir Chebotarev
67d2703d30 Fixed tests to support disk name in system.detached_parts. 2019-11-19 14:29:52 +03:00
filimonov
87ac53f652
formatting (space added) 2019-11-19 09:56:18 +01:00
Mikhail Filimonov
76d38fe639 Fix build with Poco Redis 2019-11-19 09:50:57 +01:00
Vladimir Chebotarev
5cbbcd9cdb Added disk info to system.detached_parts. 2019-11-19 09:44:10 +03:00
Alexander Tokmakov
8562789059 Revert "add debug assert for Context"
This reverts commit 2f708c72be.
2019-11-19 01:36:03 +03:00
Alexander Kuzmenkov
f8f6de836a remove separate control for threads 2019-11-18 22:45:28 +03:00
Alexander Kuzmenkov
168e15b2ae chunk size -> chunk bytes 2019-11-18 22:45:26 +03:00