thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 10:52:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,835 Commits 9,328 Branches 1,783 Tags 2.1 GiB
3881a85c39
Commit Graph

5383 Commits

Author SHA1 Message Date
alesapin
3881a85c39 Review fixes 2019-12-07 01:22:12 +03:00
alesapin
772bb0b70b Fix collation locales 2019-12-05 18:35:09 +03:00
Nikolai Kochetov
26e415736a
Merge pull request #7665 from 4ertus2/joins 
New ANY, SEMI, ANTI JOIN (HashJoin only)
 2019-12-05 14:38:20 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends 
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
 2019-12-04 22:54:38 +03:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf 
[wip] attempt to improve kafka parsing performance
 2019-12-03 03:52:40 +03:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp 2019-12-03 03:52:02 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
alexey-milovidov
fe05565cec
Update StorageS3.cpp 2019-12-03 03:03:44 +03:00
Alexey Milovidov
fc174dce6e More simple 2019-12-03 02:50:53 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
e44dc0a6c8
Merge pull request #7981 from ClickHouse/fix_number_of_streams_for_storages_with_globs 
Limit number of streams for read from StorageFile and StorageHDFS
 2019-12-03 02:23:10 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master 
Added lifetime to system.dictionaries #6820
 2019-12-02 15:15:44 +03:00
alesapin
08dfd1d1c4 Limit number of streams for read from StorageFile and StorageHDFS 2019-12-02 14:25:41 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
Vladimir Chebotarev
94684c07bf Added syntax for access_key_id and secret_access_key in S3 table function and storage. 2019-12-01 10:56:11 +03:00
Артем Стрельцов
25aa2114b2 Deleted redundant empty lines 2019-12-01 03:49:11 +03:00
Nikolay Degterinsky
6b39253b71 Fixed naming 2019-11-29 17:15:12 +03:00
Nikolay Degterinsky
59002ddb91 Merge branch 'master' of https://github.com/kekekekule/ClickHouse into dict_lifetime 2019-11-29 17:06:38 +03:00
Mikhail Filimonov
ad136ec62d get rid of cloneWithColumns in internal loop and some other trash 2019-11-29 11:46:25 +01:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool 
Separated pool for background moves
 2019-11-29 11:08:51 +03:00
Mikhail Filimonov
4cc0d0ca5d make virtual_columns local 2019-11-29 07:21:31 +01:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
alexey-milovidov
2e34f02a36
Merge pull request #7936 from ClickHouse/branch-for-slightly-improvement-of-usability-of-exception-messages 
The rest of PR #7897 about improvement of exception message
 2019-11-28 22:07:29 +03:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00
stavrolia
295633b7ef Another try 2019-11-28 17:31:35 +03:00
Anton Popov
9fe987c8e1
Merge pull request #7920 from excitoon-favorites/datetimettl 
Removed check for using `Date` or `DateTime` column from TTL expressions
 2019-11-27 19:55:57 +03:00
stavrolia
f23273fa80 Fix 2019-11-27 17:29:00 +03:00
Nikolai Kochetov
bd40c9cd13
Merge pull request #7933 from azat/dist-mon-codec-errors-mark-broken 
DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
 2019-11-27 16:03:44 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
stavrolia
f1e5e58480 Some rest of PR about improvement of exception message 2019-11-27 04:18:26 +03:00
Mikhail Filimonov
deec48a3e0 attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261 2019-11-27 00:46:19 +01:00
Azat Khuzhin
362505b129 DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors 
There is no point in retrying batch after those errors (for the same
reasons as CHECKSUM_DOESNT_MATCH is there).
 2019-11-26 20:21:05 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts 
Added disk info to `system.detached_parts`
 2019-11-26 11:56:50 +03:00
Nikolai Kochetov
c97212d132 Remove unused variable. 2019-11-25 16:35:28 +03:00
Nikolai Kochetov
d3118f0a76 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:57:14 +03:00
Nikolai Kochetov
9b42e9341d Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:49:05 +03:00
Nikolai Kochetov
f770934e60 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:05:29 +03:00
Nikita Mikhaylov
728ede25f9
Merge pull request #7840 from apbodrov/read_write_gzip 
Gzip read/write to file/s3/url/hdfs
 2019-11-22 11:48:58 +03:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions 
Fix Storage lifetime in table functions
 2019-11-22 02:29:06 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing 
Merging parallel format parsing
 2019-11-22 01:54:47 +03:00