Commit Graph

17789 Commits

Author SHA1 Message Date
Yuriy
9d0a0d0db0 fixed type 2019-12-05 02:32:17 +03:00
Yuriy
dbe7dc1185 using SHA1 MySQL auth plugin for plaintext passwords 2019-12-05 02:30:06 +03:00
chertus
d3d2e39955 fix SEMI RIGHT JOIN 2019-12-04 23:23:07 +03:00
Azat Khuzhin
3a72e1c12a Add checksum for extra info/query in distributed sends
This extras includes:
- server revision
- query settings
- query

Otherwise the code can try to interpret data, and got for instance
std::length_error exception, which is not catched (to mark the part as
broken). Also this will protect from the corruptions on disk.

And add a simple test, since dbms/tests/integration/test_insert_into_distributed too complex.

Also simplify the code by using readStringBinary() over
readVarUInt()+b.readStrict() (this also gains additional checks that
string is not bigger then 1GB).

Refs: #4852 (8ef7f3589a)
v2: avoid ABI breakage (suggested by @vitlibar)
v3: minor code fixes (suggested by @vitlibar) and as a consequence clang-8 build fix
v4: drop DBMS_MIN_REVISION_WITH_EXTRAS_CHECKSUM_IN_DIST_BATCH and also
    revert some renames to make the patch cleaner
2019-12-04 22:54:38 +03:00
Nikolai Kochetov
715d7a6455 Disable processors by default. 2019-12-04 20:24:53 +03:00
alesapin
7b8443710d Better code 2019-12-04 19:20:24 +03:00
alesapin
40c6966223 Don't check dictionary modification if it's already have an exception. 2019-12-04 18:23:18 +03:00
alesapin
3128b62f0e Create dictionary if not exists 2019-12-04 18:11:36 +03:00
alesapin
a41764cccc Reload dictionary with invalidate query if it has exception 2019-12-04 17:45:56 +03:00
Nikolai Kochetov
3ac103f21c Fix the number of rows in MergingSortedTransform. 2019-12-04 16:45:42 +03:00
Nikolai Kochetov
901a6b4627 Style fix. 2019-12-04 12:56:08 +03:00
Nikolai Kochetov
efe1616fda Fix optimization for 'WHERE column in (empty set)' case. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
81b5b17828 Fix pvs studio varning. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
fa98587c19 Init update_info in port. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4337fc20b5 Enable processors by default. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
8524a75580 Check once if filter column can be always false in filter transform. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
9465183408 Add info about affected ports after prepare. 2019-12-04 12:55:01 +03:00
Nikolai Kochetov
4f2f474fde Add info about affected ports to IProcessor::prepare 2019-12-04 12:55:01 +03:00
alesapin
eb17d51dd4 Remove unused function 2019-12-04 12:49:54 +03:00
alesapin
d1d3bac744 Better 2019-12-04 12:48:08 +03:00
alesapin
9e5f13e7af Merge branch 'fix_metric_suffix_in_settings_value' of https://github.com/millb/ClickHouse into millb-fix_metric_suffix_in_settings_value 2019-12-04 12:22:29 +03:00
alesapin
8877129d60
Merge pull request #8012 from ClickHouse/millb-url_engine_problem
Merging [#7154]
2019-12-04 12:13:15 +03:00
Mikhail Filimonov
34275626de Fix for https://github.com/ClickHouse/ClickHouse/issues/8003 : old producers do not write timestamp, but column still should have enough rows 2019-12-03 23:03:43 +01:00
Mikhail Filimonov
3de3ba336a Fix Native format in Kafka 2019-12-03 22:12:47 +01:00
Mikhail Filimonov
6e426592a7 Make the formats like RowBinaryWithNamesAndTypes work in Kafka & do not try to parse buffer when it at eof 2019-12-03 22:03:22 +01:00
alesapin
fa4728d44f Fix style 2019-12-03 20:57:00 +03:00
Nikolai Kochetov
7b3c56990d
Merge pull request #8005 from ClickHouse/add-more-checks-to-chunk
Add forgotten rows number check to chunk constructor.
2019-12-03 20:26:19 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
chertus
3829df0e7b fix comment 2019-12-03 17:38:13 +03:00
chertus
e160d35e54 more Join.addJoinedBlock() refactoring 2019-12-03 17:30:51 +03:00
Nikolai Kochetov
31d5c66867 Fix num rows in IRowInputFormat 2019-12-03 16:43:40 +03:00
Alexander Burmak
108c792fd9 Fixed typos in ExternalLoader.h and CrossToInnerJoinVisitor.cpp 2019-12-03 16:39:42 +03:00
chertus
46b27e4dd1 perf: move heavy addJoinedBlock() operations out of lock 2019-12-03 16:31:52 +03:00
chertus
3dc6ef421e perf: do not make row filter if not needed 2019-12-03 15:55:20 +03:00
alexey-milovidov
1b2297bcee
Merge pull request #7999 from litao91/typo_fix
Fix a minor typo on formatting UNION ALL AST
2019-12-03 15:29:49 +03:00
alexey-milovidov
aadf7c689c
Merge pull request #7993 from ClickHouse/merge-great-circle-distance
Merging #7307
2019-12-03 15:23:38 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth
Merging #7623
2019-12-03 15:21:12 +03:00
Vasily Nemkov
37832c9497 Removed code duplication and cleaned up headers mess a bit 2019-12-03 15:14:07 +03:00
Nikolai Kochetov
448d755a3b Add forgotten rows number check to chunk constructor. 2019-12-03 14:56:51 +03:00
litao91
d9607c50fe
Fix a minor typo on formatting UNION ALL AST 2019-12-03 16:58:00 +08:00
Alexey Milovidov
40b0f12755 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 05:25:23 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal
Basic GatherUtils support for Decimals
2019-12-03 05:15:38 +03:00
alexey-milovidov
0734d4695b
Merge pull request #7724 from 4ertus2/some
Missing array functions for Decimals
2019-12-03 05:14:33 +03:00
alexey-milovidov
812df3aef3
Merge pull request #7755 from nikitamikhaylov/storage_set
Using the Set engine happen Exception: Method read is not supported by storage Set
2019-12-03 05:09:47 +03:00
alexey-milovidov
ef66c453c4
Update ExpressionAnalyzer.h 2019-12-03 05:09:05 +03:00
alexey-milovidov
cdaa913d1f
Update ExpressionAnalyzer.h 2019-12-03 05:08:41 +03:00
Alexey Milovidov
2474cdfa09 Removed tons of garbage from "greatCircleDistance" function. But algorithm is still unclear. 2019-12-03 04:55:46 +03:00
alexey-milovidov
f5e88f8cd5
Merge pull request #7307 from ClickHouse/new-branch-for-new-geodist
Speed up greatCircleDistance function with test
2019-12-03 04:34:35 +03:00
alexey-milovidov
dbc95e27be
Update greatCircleDistance.cpp 2019-12-03 04:33:36 +03:00
Alexey Milovidov
49d25e06a8 Added a test 2019-12-03 04:29:19 +03:00
Alexey Milovidov
93ef18501f Added a test 2019-12-03 04:27:48 +03:00
Alexey Milovidov
199a209c82 Added a test 2019-12-03 04:23:17 +03:00
Alexey Milovidov
8fa05a212b Fixed bug in #7623 2019-12-03 04:22:25 +03:00
alexey-milovidov
edede563c9
Merge pull request #7747 from hczhcz/patch-1113
Fix empty array handling in arraySplit
2019-12-03 04:00:31 +03:00
alexey-milovidov
87adf355e8
Merge pull request #7935 from filimonov/kafka_perf
[wip] attempt to improve kafka parsing performance
2019-12-03 03:52:40 +03:00
alexey-milovidov
b6edda194f
Update KafkaBlockInputStream.cpp 2019-12-03 03:52:02 +03:00
alexey-milovidov
6fdfdcfd4e
Update ValuesBlockInputFormat.cpp 2019-12-03 03:51:10 +03:00
alexey-milovidov
4d65ad4034
Update ValuesBlockInputFormat.cpp 2019-12-03 03:50:50 +03:00
alexey-milovidov
4a69082fbb
Update ProtobufRowInputFormat.h 2019-12-03 03:49:50 +03:00
alexey-milovidov
a7521b97f9
Update IInputFormat.cpp 2019-12-03 03:49:05 +03:00
Alexey Milovidov
d70b73f033 Merge branch 's3auth' of https://github.com/excitoon-favorites/ClickHouse into excitoon-favorites-s3auth 2019-12-03 03:06:01 +03:00
alexey-milovidov
fe05565cec
Update StorageS3.cpp 2019-12-03 03:03:44 +03:00
Alexey Milovidov
fc174dce6e More simple 2019-12-03 02:50:53 +03:00
Alexey Milovidov
9d099bde8e Merge branch 'master' into fix_check_table_with_empty_pk 2019-12-03 02:36:21 +03:00
alexey-milovidov
3355492f02
Merge pull request #7983 from ClickHouse/fix_dictionary_lifetime
Fix bug with minimal dictionary lifetime equals zero
2019-12-03 02:32:38 +03:00
Alexey Milovidov
e86047bd72 Merge branch 'sigrtmin' of https://github.com/abyss7/ClickHouse into abyss7-sigrtmin 2019-12-03 02:27:53 +03:00
alexey-milovidov
e44dc0a6c8
Merge pull request #7981 from ClickHouse/fix_number_of_streams_for_storages_with_globs
Limit number of streams for read from StorageFile and StorageHDFS
2019-12-03 02:23:10 +03:00
alexey-milovidov
41f1224d59
Merge pull request #7987 from achulkov2/dict-small-refactoring
Very small code refactoring for external dictionaries
2019-12-03 02:13:31 +03:00
alexey-milovidov
8338be47dd
Merge pull request #7975 from yurriy/mysql-protocol-text
Support more column types in MySQL compatibility server
2019-12-03 02:08:24 +03:00
chertus
a179c5025f Merge branch 'master' into joins 2019-12-02 21:08:39 +03:00
chertus
5ce65546e9 semi & anti join 2019-12-02 21:08:04 +03:00
Ivan Lezhankin
2118b33d9a Replace SIGRTMIN with SIGTSTP 2019-12-02 20:29:19 +03:00
achulkov2
6c6db598b1 Very small refactoring for external dictionaries 2019-12-02 18:59:45 +03:00
alesapin
7410d17892 Fix bug with minimal dictionary lifetime equals zero 2019-12-02 16:05:43 +03:00
Vitaly Baranov
b2685a3710
Merge pull request #7727 from kekekekule/master
Added lifetime to system.dictionaries #6820
2019-12-02 15:15:44 +03:00
chertus
0251f4e442 perf: move applyLazyDefaults() out of cycle for ALL JOIN 2019-12-02 14:45:21 +03:00
Ivan Lezhankin
0e276ad887 Fix build 2019-12-02 14:29:52 +03:00
alesapin
08dfd1d1c4 Limit number of streams for read from StorageFile and StorageHDFS 2019-12-02 14:25:41 +03:00
Ivan Lezhankin
4f56e03729 Use SIGRTMIN instead of SIGPROF for user debugging purposes 2019-12-02 13:50:57 +03:00
alesapin
a4ca30b5fd Fix bug in check table for tables without primary key 2019-12-02 13:30:04 +03:00
alesapin
af85eb8f80
Merge pull request #7916 from azat/dict-avoid-RELOAD-on-CREATE-DATABASE
Do not reload *all* dictionaries on CREATE DATABASE
2019-12-02 11:50:44 +03:00
Yuriy
211e1364f6 fixed style 2019-12-02 06:12:27 +03:00
Vladimir Chebotarev
8dbfcdb3c3 Fixed failing tests. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
ef5c4fb5a4 Remake of result_part_path. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
b23d411f84 Filling result_part_path column of system.merges during the merge. 2019-12-01 20:41:35 +03:00
Vladimir Chebotarev
41c965e4ba Attempt to add is_move, source_part_paths, result_part_path columns to system.merges. 2019-12-01 20:41:35 +03:00
Yuriy
3677d1dcfa implemented ProtocolText 2019-12-01 15:17:49 +03:00
Vladimir Chebotarev
d0760bc169 Fixed tests and logic of authorization in S3. 2019-12-01 14:24:55 +03:00
Vladimir Chebotarev
0a19b4fbd6 Attempt to add S3 authentication. 2019-12-01 10:56:11 +03:00
Vladimir Chebotarev
94684c07bf Added syntax for access_key_id and secret_access_key in S3 table function and storage. 2019-12-01 10:56:11 +03:00
Артем Стрельцов
25aa2114b2 Deleted redundant empty lines 2019-12-01 03:49:11 +03:00
Vasily Nemkov
70512f8289 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-30 21:49:15 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
Nikolay Degterinsky
6b39253b71 Fixed naming 2019-11-29 17:15:12 +03:00
Nikolay Degterinsky
59002ddb91 Merge branch 'master' of https://github.com/kekekekule/ClickHouse into dict_lifetime 2019-11-29 17:06:38 +03:00
Mikhail Filimonov
ad136ec62d get rid of cloneWithColumns in internal loop and some other trash 2019-11-29 11:46:25 +01:00
Nikolai Kochetov
7a32ca057d
Merge pull request #7670 from excitoon-favorites/move_pool
Separated pool for background moves
2019-11-29 11:08:51 +03:00
hcz
dd7051bd98 Merge remote-tracking branch 'origin/master' into patch-2 2019-11-29 15:07:53 +08:00
hcz
5e45a4f3cd Add comment on getValue() function 2019-11-29 14:50:36 +08:00
Mikhail Filimonov
4cc0d0ca5d make virtual_columns local 2019-11-29 07:21:31 +01:00
Mikhail Filimonov
07722dfa93 more progress - cleanup internal cycles 2019-11-29 00:06:03 +01:00
Alexander Burmak
9c60149042 Fixed implementation of DiskLocal::moveTo 2019-11-28 22:20:46 +03:00
alexey-milovidov
2e34f02a36
Merge pull request #7936 from ClickHouse/branch-for-slightly-improvement-of-usability-of-exception-messages
The rest of PR #7897 about improvement of exception message
2019-11-28 22:07:29 +03:00
Mikhail Filimonov
6217cb51f6 Get rid of InputStream layer for Kafka, use InputStream directly. Reopening port during reset. 2019-11-28 17:43:06 +01:00
stavrolia
295633b7ef Another try 2019-11-28 17:31:35 +03:00
Anton Popov
9fe987c8e1
Merge pull request #7920 from excitoon-favorites/datetimettl
Removed check for using `Date` or `DateTime` column from TTL expressions
2019-11-27 19:55:57 +03:00
Alexander Burmak
910ceb67b3 Fixed darwin buils 2019-11-27 18:49:15 +03:00
stavrolia
f23273fa80 Fix 2019-11-27 17:29:00 +03:00
Nikolai Kochetov
bd40c9cd13
Merge pull request #7933 from azat/dist-mon-codec-errors-mark-broken
DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
2019-11-27 16:03:44 +03:00
millb
3cfda0a9dd Merge branch 'master' into hashes_from_values_of_UUID_type 2019-11-27 15:52:06 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Vladimir Chebotarev
4d1b0796e4 Minor fix (removed empty line). 2019-11-27 13:13:25 +03:00
Vladimir Chebotarev
ecaa98e4e4 Allowed to use constant TTL expressions, updated tests. 2019-11-27 13:11:17 +03:00
Vladimir Chebotarev
c396af7c40 Removed check for using Date or DateTime column from TTL expressions. 2019-11-27 13:11:17 +03:00
stavrolia
f1e5e58480 Some rest of PR about improvement of exception message 2019-11-27 04:18:26 +03:00
stavrolia
4087d91563 Fix 2019-11-27 03:42:46 +03:00
Mikhail Filimonov
deec48a3e0 attempt to fix kafka parsing performance regression https://github.com/ClickHouse/ClickHouse/issues/7261 2019-11-27 00:46:19 +01:00
Azat Khuzhin
362505b129 DirectoryMonitor: mark batch as broken on UNKNOWN_CODEC/CANNOT_DECOMPRESS errors
There is no point in retrying batch after those errors (for the same
reasons as CHECKSUM_DOESNT_MATCH is there).
2019-11-26 20:21:05 +03:00
Nikita Mikhaylov
ad2af03f98 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2019-11-26 20:05:15 +03:00
Nikita Mikhaylov
f6604fdf1a fix build 2019-11-26 20:04:46 +03:00
Nikolai Kochetov
4f79476511
Merge pull request #7929 from ClickHouse/fix-union-with-diff-columns
Fix union with diff columns
2019-11-26 19:40:45 +03:00
Nikita Mikhaylov
6f119d53f5 adding comments to strange functions used in parallel parsing 2019-11-26 19:33:43 +03:00
Nikita Mikhaylov
013d839dcf cleanup 2019-11-26 19:18:50 +03:00
Nikita Mikhaylov
a4189b85e2 done 2019-11-26 17:57:33 +03:00
Olga Khvostikova
4d6214d33e
Merge pull request #7908 from CurtizJ/enum_conversion
Fix enum conversion in native format for backward compatibility.
2019-11-26 17:53:47 +03:00
Vladimir Chebotarev
e3f299e3c4 Fixed background pool logger name. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bc15779d Better logging of BackgroundMovePool. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
37bebd1370 Improved BackgroundProcessingPool to use with background moves task. 2019-11-26 16:09:57 +03:00
Vladimir Chebotarev
e96c24786b Separated pool for background moves. 2019-11-26 16:08:59 +03:00
Olga Khvostikova
953f3a5ddf
Merge pull request #7897 from ClickHouse/better-exception-messages
Slightly better usability of exception messages
2019-11-26 13:20:56 +03:00
Nikolai Kochetov
f301e60ef5 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:14:56 +03:00
Nikolai Kochetov
a6a0b2dea3 Fix InterpreterSelectWithUnionQuery::getCommonHeaderForUnion 2019-11-26 13:01:02 +03:00
CurtizJ
6a1baefc47 add missing comment and rename 2019-11-26 12:59:31 +03:00
Olga Khvostikova
47e499d71b
Merge pull request #7833 from excitoon-favorites/detachedparts
Added disk info to `system.detached_parts`
2019-11-26 11:56:50 +03:00
Azat Khuzhin
4530adee76 Do not reload *all* dictionaries on CREATE DATABASE
This ignores any lifetime, while dictionaries can be quite big.

Fixes: c7cd911305 ("Merge pull request #7360")
Refs: https://github.com/ClickHouse/ClickHouse/pull/7360#discussion_r345207682
2019-11-26 10:33:25 +03:00
alexey-milovidov
18a70ba70e
Merge pull request #7911 from ClickHouse/prewhere_alias
Fix reading empty set with prewhere dependent on alias column.
2019-11-26 09:38:47 +03:00
alexey-milovidov
fed4d56df8
Merge pull request #7913 from ClickHouse/prewhere_max_parallel_replicas
Fix prewhere with max_parallel_replicas.
2019-11-26 09:29:49 +03:00
alexey-milovidov
a816887073
Merge pull request #7907 from ClickHouse/sample_final
FINAL SAMPLE
2019-11-26 09:21:38 +03:00
Nikolai Kochetov
867fded9fd Fix prewhere with max_parallel_replicas. 2019-11-25 21:29:02 +03:00
Nikita Mikhaylov
ee0855be6d remove couts 2019-11-25 20:42:17 +03:00
Nikolai Kochetov
1a0f17cb2c Fix reading empty set with prewhere dependent on alias column. 2019-11-25 17:33:54 +03:00
CurtizJ
c223281d5d fix enum coversion in native format for backward compatibility 2019-11-25 17:06:44 +03:00
Nikolai Kochetov
c97212d132 Remove unused variable. 2019-11-25 16:35:28 +03:00
Nikolai Kochetov
d3118f0a76 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:57:14 +03:00
Nikolai Kochetov
9b42e9341d Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:49:05 +03:00
Nikolai Kochetov
f770934e60 Support SAMPLE and FINAL together in MergeTree. 2019-11-25 15:05:29 +03:00
tavplubix
fde727c4eb Update Context.cpp 2019-11-25 14:42:09 +03:00
Pervakov Grigory
9fbc55c61a Change max_table_size_to_drop and max_partition_size_to_drop to atmoic. Update hint in default config. 2019-11-25 14:42:09 +03:00
Nikita Mikhaylov
8f96118c14 useless 2019-11-25 14:14:27 +03:00
Nikita Mikhaylov
7c59fd4795
Merge pull request #7894 from nikitamikhaylov/segmentating_functions
Returning back segmentation engines for JSONEachRow and CSV formats.
2019-11-25 13:12:18 +03:00
alexey-milovidov
0633f9f8db
Update CSVRowInputFormat.cpp 2019-11-23 03:24:25 +03:00
Alexey Milovidov
2d9d116267 Slightly better exception messages 2019-11-23 03:18:56 +03:00
tavplubix
f1afb3d0c8
Merge pull request #7880 from arenadata/fix_or_zero_and_or_null_conversion
Add exception for illegal types for conversion functions with -OrZero postfix
2019-11-22 21:03:58 +03:00
Nikita Mikhaylov
1d170ed607 use set from storage set for set in index 2019-11-22 18:45:03 +03:00
Nikita Mikhaylov
22a8e8efa7 better segmenating + move read functions to avoid linker errors 2019-11-22 16:53:26 +03:00
Nikita Mikhaylov
d495e282c7 returning back JSON and CSV 2019-11-22 13:38:08 +03:00
Nikita Mikhaylov
6f80b0fed4 move specific functions to ReadHelpers 2019-11-22 13:12:24 +03:00
Nikita Mikhaylov
728ede25f9
Merge pull request #7840 from apbodrov/read_write_gzip
Gzip read/write to file/s3/url/hdfs
2019-11-22 11:48:58 +03:00
tavplubix
b75b6c294d
Merge pull request #7762 from ClickHouse/possible_segfaults_in_table_functions
Fix Storage lifetime in table functions
2019-11-22 02:29:06 +03:00
Nikita Mikhaylov
762d295ab0
Merge pull request #7780 from ClickHouse/aku/parallel-parsing
Merging parallel format parsing
2019-11-22 01:54:47 +03:00
Nikita Mikhaylov
1d74aecda8 fix typo in asserts 2019-11-21 21:14:47 +03:00
akonyaev
6834dd5fd0 Add exception for illegal types for conversion functions with -OrZero or -OrNull postfixes.
Add docs for conversion functions with -OrZero and -OrNull postfixes.
2019-11-21 18:53:14 +03:00
akonyaev
78f13839ac Add exception for illegal types for conversion functions with -OrZero or -OrNull postfixes.
Add docs for conversion functions with -OrZero and -OrNull postfixes.
2019-11-21 18:46:25 +03:00
Alexander Tokmakov
ba3969527f move table locks to main pipeline 2019-11-21 18:37:59 +03:00
Nikita Mikhaylov
31cb69269b small fix 2019-11-21 16:44:11 +03:00
alexey-milovidov
c9e005666b
Merge pull request #7873 from excitoon-favorites/fix-7558-7602
Fixed errors with space reservation introduced in #7558 and #7602
2019-11-21 15:31:21 +03:00
Vladimir Chebotarev
2b4f6af736 Fixed errors with space reservation introduced in #7558 and #7602. 2019-11-21 12:09:43 +03:00
alexey-milovidov
5878d1bd48
Merge pull request #7870 from ClickHouse/fix_bytes_count_in_peekable_buffer
Fix float parsing in Values
2019-11-21 11:46:34 +03:00
Vasily Nemkov
66d64e7100 PR-comment fixes: factored out std::is_same_v to a constexpt variable. 2019-11-21 01:05:09 +03:00
Alexander Tokmakov
61783e1e17 fix bytes count in PeekableReadBuffer 2019-11-21 01:04:57 +03:00
Vasily Nemkov
fa90406f25 Fixed bug in converting DateTime64 to string on large scale values 2019-11-21 01:04:18 +03:00
Vasily Nemkov
6dfe36479e Fixed type-support traits, put all of those to IDataType.h:
* IsDataTypeDateOrDateTime
 * IsDataTypeDecimal
 * IsDataTypeNumber
2019-11-21 01:02:49 +03:00
Andrei Bodrov
533cb088e6 std::forward in template 2019-11-20 23:57:34 +03:00
Alexander Kuzmenkov
c913155d95 Fix TSV segmentation. 2019-11-20 20:24:44 +03:00
Vitaly Baranov
6e2f9f6f6d Invert flags in Settings.h: IGNORABLE flag is replaced with IMPORTANT flag. 2019-11-20 19:37:04 +03:00
Andrei Bodrov
decdd7d476 fix typos 2019-11-20 18:40:42 +03:00
Andrei Bodrov
c2849d0864 move to helpers 2019-11-20 17:48:01 +03:00
tavplubix
5331bf4bcd
Merge pull request #7858 from patsevanton/master
fix propery to property
2019-11-20 13:35:18 +03:00
Andrei Bodrov
53b02227ad virtual void 2019-11-20 13:11:26 +03:00
Vasily Nemkov
23e9a582f2 Fixed using DecimalX and DateTime64 with ASOF JOIN
With tests
2019-11-20 12:00:10 +03:00
Vasily Nemkov
825b8d1160 Post-PR fixes
* value_type => ValueType for ColumnVector and ColumnDecimal
 * minor formatting fixes
 * removed `extern template`
2019-11-20 11:58:55 +03:00
Andrei Bodrov
db1a86a94d typo 2019-11-20 11:27:59 +03:00
Anton Patsev
72287b9abb fix propery to property 2019-11-20 13:07:27 +06:00
Denis Zhuravlev
cf0c8392b3
fix error message
on the right , on the left -> on the left on the right #7853
2019-11-19 20:57:06 -04:00
Alexander Kuzmenkov
9a2b864940 Cleanup 2019-11-19 21:42:51 +03:00
Nikita Mikhaylov
6d60d10461
just to restart pending perf test 2019-11-19 21:22:32 +03:00
Andrei Bodrov
30ddf95998 another clang fix 2019-11-19 20:27:24 +03:00
Andrei Bodrov
245c3511f6 clang fix 2019-11-19 20:11:13 +03:00
alexey-milovidov
4d4de7da95
Merge pull request #7793 from DeifyTheGod/master
fix zero-access user creation
2019-11-19 20:04:07 +03:00
Nikita Mikhaylov
e0e551c61d Merge branch 'master' of github.com:ClickHouse/ClickHouse into storage_set 2019-11-19 19:12:33 +03:00
Nikita Mikhaylov
02b0101fc8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into limit_with_ties 2019-11-19 18:00:16 +03:00
Nikita Mikhaylov
e0bfe17219 fix 2019-11-19 18:00:11 +03:00
Andrei Bodrov
9296f652d2 old-style cast 2019-11-19 17:35:03 +03:00
Nikita Mikhaylov
b9ad1fc79a better 2019-11-19 17:29:52 +03:00
Andrei Bodrov
a2b5989177 BrotliReadBuffer refactoring 2019-11-19 16:57:54 +03:00
Alexander Kuzmenkov
7e5731d64e Merge remote-tracking branch 'origin/master' into HEAD 2019-11-19 16:15:47 +03:00
Alexander Kuzmenkov
0d1933cb44 Calculate the number of parsing theads correctly 2019-11-19 16:11:45 +03:00
Andrei Bodrov
8cbc52e711 add gzip read/write to file/s3/url/hdfs 2019-11-19 15:46:07 +03:00
Mikhail Korotov
744a1ea774 Merge branch 'master' into fix_metric_suffix_in_settings_value 2019-11-19 14:43:34 +03:00
Vladimir Chebotarev
5cbbcd9cdb Added disk info to system.detached_parts. 2019-11-19 09:44:10 +03:00
Alexander Tokmakov
8562789059 Revert "add debug assert for Context"
This reverts commit 2f708c72be.
2019-11-19 01:36:03 +03:00
Alexander Kuzmenkov
f8f6de836a remove separate control for threads 2019-11-18 22:45:28 +03:00
Alexander Kuzmenkov
168e15b2ae chunk size -> chunk bytes 2019-11-18 22:45:26 +03:00
Alexander Kuzmenkov
17b4565c48 Cleanup 2019-11-18 22:44:45 +03:00
Alexander Tokmakov
b7e9c69768 distinguish table function with list of columns from an aggregate function with list of parameters 2019-11-18 19:49:23 +03:00
Alexander Tokmakov
a4d557f998 fix Context in interpretSubquery 2019-11-18 19:18:09 +03:00
Alexander Tokmakov
2f708c72be add debug assert for Context 2019-11-18 19:01:36 +03:00
Alexander Kuzmenkov
fbee4ca3ec
Fix typo in Memory: reuse buffer if capacity allows. (#7797) 2019-11-18 18:21:03 +03:00
Alexander Kuzmenkov
bb98328ad5 Make parser and read buffer local to parser thread 2019-11-18 17:19:29 +03:00
nonexistence
dea19a82f9 change to std::optional 2019-11-18 16:35:31 +03:00
Alexander Kuzmenkov
4ab7ac14bd Remove all segmentation engines except TSV 2019-11-18 16:12:28 +03:00
Alexander Kuzmenkov
83030b98a2 remove MemoryExt<> 2019-11-18 16:10:14 +03:00
Alexander Kuzmenkov
7084d090e8
Remove trailing space in modulo.cpp 2019-11-18 15:19:45 +03:00
Vitaly Baranov
681f03c625
Merge pull request #7653 from vitlibar/skip-unknown-settings-with-warnings
Skip unknown settings with warnings.
2019-11-18 13:50:52 +03:00
Nikita Mikhaylov
271734e709 better 2019-11-18 13:47:27 +03:00
Nikita Mikhaylov
8eebcad52d experiments 2019-11-18 13:14:37 +03:00
alexey-milovidov
3735a7e210
Merge pull request #7758 from 4ertus2/ast
Check if table has qualified column
2019-11-18 01:37:48 +03:00
alexey-milovidov
4dd66385b5
Merge pull request #7789 from zhang2014/fix/ISSUES-7784
ISSUES-7784 disabled predicate optimize for WITH FILL expression
2019-11-17 23:36:42 +03:00
alexey-milovidov
06b9466de0
Merge pull request #7791 from DimasKovas/fix_insert_in_pod_array
Fix PODArray.insert
2019-11-17 23:34:01 +03:00
alexey-milovidov
b598ae1e3e
Merge pull request #7750 from amosbird/moduleopt
const modulo optimization
2019-11-17 23:25:49 +03:00
alexey-milovidov
2fa5e4891f
Update modulo.cpp 2019-11-17 23:25:27 +03:00
alexey-milovidov
b8c718cc45
Merge pull request #7783 from amosbird/debugfixagain
fix ADL failure
2019-11-17 23:20:59 +03:00
Alexander Tokmakov
2173bf5f4a Merge branch 'master' into possible_segfaults_in_table_functions 2019-11-17 16:48:13 +03:00
Vitaly Baranov
e40c140982 Add the ignorable flag for the settings. 2019-11-17 03:56:18 +03:00
Vitaly Baranov
f3d72b9ec1 Skip unknown settings with warnings. 2019-11-17 03:51:58 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict().
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
2019-11-17 03:51:51 +03:00
Nikolai Kochetov
5cc14e6d66
Merge pull request #7777 from ClickHouse/fix-array-intersect-overflow
Fix array intersect overflow
2019-11-16 18:43:16 +03:00
alexey-milovidov
f813ca2845
Merge pull request #7725 from ClickHouse/minor-changes-in-regions-names
Minor changes in RegionsNames
2019-11-16 16:49:26 +03:00
Alexander Tokmakov
55f60a6bad hold shared pointers to table function Storage and Context from InterpreterSelectQuery 2019-11-15 21:42:32 +03:00
Alexander Kuzmenkov
5d5882d92b wip: a saner segmentation function for TSV 2019-11-15 21:08:17 +03:00
Alexander Kuzmenkov
723e02fef7
Merge pull request #7759 from CurtizJ/fix-order-by
Fix order by in case of sorting by primary key prefix and non primary key suffix.
2019-11-15 20:52:31 +03:00
Alexander Kuzmenkov
8f3bd8f546 Fix typo in Memory: reuse buffer if capacity allows. 2019-11-15 20:23:57 +03:00
Amos Bird
755904f51f
better INCLUDE_DEBUG_HELPERS 2019-11-16 00:34:43 +08:00
nonexistence
a460001bae fix zero-access user creation 2019-11-15 18:55:08 +03:00
alexey-milovidov
87c6a63b65
Update gtest_pod_array.cpp 2019-11-15 18:00:10 +03:00
Dmitrii Kovalkov
ea177061e8 Fix PODArray.insert 2019-11-15 17:36:52 +03:00
Nikolai Kochetov
2b5cb7d6b9 Small refactoring. 2019-11-15 17:19:54 +03:00
Nikolai Kochetov
6f0c287e41 Small refactoring. 2019-11-15 17:18:59 +03:00
zhang2014
15b20e0b96 ISSUES-7784 disabled predicate optimize for WITH FILL expression 2019-11-15 22:10:36 +08:00
Anton Popov
0318e6d820
Update dbms/src/Interpreters/InterpreterSelectQuery.cpp
Co-Authored-By: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2019-11-15 17:09:34 +03:00
CurtizJ
475356f2b7 more clarifying names to avoid mistakes 2019-11-15 17:03:42 +03:00
Nikolai Kochetov
618ecf4f60 use notEquals function in arrayIntersect 2019-11-15 16:58:43 +03:00
Boris Granveaud
a9160e908c fix "Sizes of columns doesn't match" error with SimpleAggregateFunction 2019-11-15 14:24:54 +01:00
Nikolai Kochetov
9c3fa44932 Do not check overflow for floats in arrayIntersect. 2019-11-15 16:01:57 +03:00
Артем Стрельцов
2a65b4818a Fixed bugs of last non-fictive commit 2019-11-15 11:33:27 +03:00
Amos Bird
29c2785ca5
const modulo optimization 2019-11-15 13:56:23 +08:00
Артем Стрельцов
5c46a8a7a8 Empty commit to restart tests 2019-11-14 22:36:31 +03:00
Alexander Kuzmenkov
ce92615add remove unused variable 2019-11-14 21:53:57 +03:00
Alexander Kuzmenkov
7f34c0089c Merge remote-tracking branch 'origin/master' into HEAD 2019-11-14 18:53:36 +03:00
Alexander Kuzmenkov
db81aae8f0 Cleaup 2019-11-14 18:53:20 +03:00
Alexander Kuzmenkov
5e789e4250 Some renames & remove weird logic from cancel() 2019-11-14 16:57:10 +03:00
Nikolai Kochetov
f8d10872c5 Fix integer overflow in arrayIntersect. 2019-11-14 16:37:24 +03:00
chertus
8286bbf913 Merge branch 'master' into joins 2019-11-14 16:16:52 +03:00
Nikolai Kochetov
c633c82928 Fix integer overflow in arrayIntersect. 2019-11-14 16:15:53 +03:00
Nikolai Kochetov
5440700299 Fix integer overflow in arrayIntersect. 2019-11-14 12:46:10 +03:00
chertus
31028b8f3b support nested column names 2019-11-13 19:49:29 +03:00
millb
1820ed187e Code style 2019-11-13 18:21:27 +03:00
Mikhail Korotov
5acbc82ff8
Update FunctionsHashing.h 2019-11-13 18:18:24 +03:00
chertus
d70904d7ee better column to table matching: check if table has qualified column 2019-11-13 18:00:21 +03:00
CurtizJ
f6b601cb9c fix order by with pk optimization 2019-11-13 17:57:45 +03:00
Nikita Mikhaylov
7c33041fad added usage top n and limit by together 2019-11-13 17:26:51 +03:00
millb
6b3d6d5dce Working commit 2019-11-13 17:21:28 +03:00
millb
532d055aa0 Working commit 2019-11-13 17:20:23 +03:00
millb
5110379d95 Working commit 2019-11-13 17:11:28 +03:00
millb
9e36c7c4e9 Working commit 2019-11-13 16:57:15 +03:00
Nikita Mikhaylov
b0e24b6c92 better naming 2019-11-13 16:52:08 +03:00
millb
0f73cc3090 Working commit 2019-11-13 16:38:30 +03:00
millb
642835b580 Working commit 2019-11-13 15:47:59 +03:00
Nikita Mikhaylov
c8bfa6db59 done 2019-11-13 15:43:55 +03:00
Nikolai Kochetov
caad7e636e Use shared_ptr for storage in StorageFileBlockInputStream. 2019-11-13 15:28:14 +03:00
Nikolai Kochetov
943dd12a96 Use shared_ptr for storage in StorageFileBlockInputStream. 2019-11-13 15:17:31 +03:00
millb
dcbc4332c1 Working project 2019-11-13 13:12:10 +03:00
Vasily Nemkov
f8d90af4ce Fixed regression of converting Date to DateTime (and vice versa) Field values on INSERT. 2019-11-13 12:46:53 +03:00
Vasily Nemkov
ac3c018d7e Fixed exception in debug builds on writing DateTime to protobuf 2019-11-13 12:46:37 +03:00
millb
e1c73f41de Working commit 2019-11-13 11:12:46 +03:00
millb
e1a48405a9 Working commit 2019-11-13 11:06:11 +03:00
millb
ddb4b6dfa5 Working commit 2019-11-13 11:03:01 +03:00
hcz
11960bbaf9 Fix empty array handling 2019-11-13 10:41:23 +08:00
millb
c0630ec3bc working commit 2019-11-12 20:02:04 +03:00
millb
7ed84fd464 working commit 2019-11-12 19:56:18 +03:00
millb
7bef7c259c Working commit 2019-11-12 19:52:23 +03:00
millb
8ad430e458 Working commit 2019-11-12 19:40:45 +03:00
millb
882b780d73 Working commit 2019-11-12 19:37:36 +03:00
millb
2b16da73d1 working commit 2019-11-12 18:44:23 +03:00
millb
386e41b437 Working commit 2019-11-12 18:33:17 +03:00
millb
1b76bf304e Working commit 2019-11-12 18:29:35 +03:00
millb
d617c443b0 working project 2019-11-12 16:50:31 +03:00
millb
14c0093a18 Added assertEOF 2019-11-12 16:42:37 +03:00
millb
fcbd37c662 Working commit 2019-11-12 14:56:22 +03:00
chertus
92fda25029 fix UB (attempt 2) 2019-11-12 03:18:13 +03:00
chertus
4411edeadd fix UB 2019-11-12 01:47:52 +03:00
Nikita Mikhaylov
c335c4f2dc empty 2019-11-12 01:42:21 +03:00
Артем Стрельцов
ec636e95cd Added lifetime to system.dictionaries 2019-11-12 00:34:28 +03:00
Alexey Milovidov
1c975a46e7 Fallback for unknown CPUs when using libcpuid #5239 2019-11-12 00:01:55 +03:00
Alexey Milovidov
47f577d963 Indent 2019-11-11 23:56:11 +03:00
Alexey Milovidov
f9362a241f Minor changes in RegionsNames 2019-11-11 23:54:57 +03:00
chertus
a8a283ffdc add missing array functions for Decimals 2019-11-11 23:46:36 +03:00
Nikolai Kochetov
28b195a0f1
Merge pull request #7672 from ClickHouse/processors-4-tmp
Processors 4
2019-11-11 21:22:06 +03:00
chertus
b2ae509030 fix gcc9 build 2019-11-11 21:02:44 +03:00
chertus
8321deefac Merge branch 'master' into joins 2019-11-11 20:54:45 +03:00
alexey-milovidov
44cf1483c8
Merge pull request #7710 from amosbird/batchreduce2
Better addBatchArray aggregator
2019-11-11 20:36:34 +03:00
chertus
03933a1039 gather utils for Decimals (no scale checks) 2019-11-11 19:18:37 +03:00
Nikita Mikhaylov
7dda8a902d fix stupid mistake 2019-11-11 16:42:07 +03:00
alesapin
c71e874a8c
Merge pull request #7709 from ClickHouse/fix_storage_odbc_parsing
Fix use of destroyed variable captured in lambda for storage XDBC
2019-11-11 15:39:54 +03:00
alexey-milovidov
0f6d476c41
Merge pull request #7703 from ClickHouse/substr-negative-size-arg
Allowed non-constant negative "size" argument for function "substring"
2019-11-11 15:35:21 +03:00
Nikita Mikhaylov
195708c169 remove redudant 2019-11-11 15:19:10 +03:00
chertus
b51e6f9fe3 trying to remove perf degradation 2019-11-11 14:42:10 +03:00
Nikita Mikhaylov
57663c395a processing unit added 2019-11-11 14:20:11 +03:00
Nikita Mikhaylov
8358b64872 comment 2019-11-11 13:32:25 +03:00
Nikolai Kochetov
18bc79ad21 Disable processors by default. 2019-11-11 12:59:41 +03:00
alexey-milovidov
e14f395001
Merge pull request #7506 from Enmk/odbc_bridge_nullable_fix
odbc table function now respects external_table_functions_use_nulls
2019-11-11 12:03:09 +03:00
millb
0ee1b46d40 Working test 2019-11-11 12:00:31 +03:00
Amos Bird
3707da4fbf
Better addBatchArray aggregator 2019-11-11 16:56:11 +08:00
millb
368bb5f217 Working project 2019-11-11 11:47:20 +03:00
Vasily Nemkov
1dae33753c Fixed compilation error on Apple Clang 2019-11-11 11:42:41 +03:00
alesapin
c74538153f Fix use of destroyed variable captured in lambda 2019-11-11 11:40:00 +03:00
millb
e15c636021 Working commit 2019-11-11 11:36:02 +03:00
Vasily Nemkov
07041d45c9 Merge remote-tracking branch 'upstream/master' into DateTime64 2019-11-11 09:19:13 +03:00
Vasily Nemkov
d227712f84 Fixed build errors for GCC-9 and Apple Clang. 2019-11-11 09:07:26 +03:00
Vasily Nemkov
5c125dff90 Fixed PVS error on sprintf and structure. 2019-11-11 08:34:39 +03:00
Vasily Nemkov
2d3cb9aeb7 Fixed compilation errors on Clang-8 2019-11-11 08:34:39 +03:00
Mikhail Korotov
8ad704969c
Update ReadHelpers.h 2019-11-11 07:49:26 +03:00
Mikhail Korotov
68433bf3c8
Update ReadHelpers.h 2019-11-11 07:48:36 +03:00
millb
f0dc80435a Style commit 2019-11-11 07:46:28 +03:00
millb
2920d0bce3 Working commit 2019-11-11 07:20:08 +03:00
Alexey Milovidov
f47415b7fa Allowed non-constant negative "size" argument for function "substring" 2019-11-11 04:45:03 +03:00
alexey-milovidov
1d910c5071
Merge pull request #7608 from amosbird/batchreduce
Optimize arrayReduce, -Array and -State combinators
2019-11-10 22:10:03 +03:00
Alexey Milovidov
6a5f042a7f Removed fixed index granularity from system logs 2019-11-10 17:04:29 +03:00
Vasily Nemkov
9ff70ff484 Fixed GCC-9 error of not returning a value from non-void function. 2019-11-10 16:13:26 +03:00
Vasily Nemkov
512932c0d2 Fixed regression: unable to determine timezone for certain cases. 2019-11-10 16:12:59 +03:00
Nikolai Kochetov
296a56407f Add thread name for pipeline threads. 2019-11-09 22:46:46 +03:00
Nikolai Kochetov
2233660fe6
Merge pull request #7689 from ClickHouse/constants-and-remote
Fix remote constants.
2019-11-09 16:38:15 +03:00
Nikolai Kochetov
6f70125798 Get constant values from remote source in RemoteBlockInputStream. 2019-11-09 15:16:00 +03:00
Nikolai Kochetov
cc16ac3c3c Return resize processor before aggregating. 2019-11-09 12:24:55 +03:00
alesapin
1e7cd999ae
Merge pull request #7686 from ClickHouse/remove_extra_space
Remove extra space
2019-11-08 23:52:34 +03:00
millb
efc531c953 Working commit 2019-11-08 21:07:22 +03:00
millb
044ee602e4 Working commit 2019-11-08 20:56:43 +03:00
millb
15932052c5 Working commit 2019-11-08 20:46:12 +03:00
Nikolai Kochetov
f909575196 Try fix test 2019-11-08 20:30:56 +03:00
Nikolai Kochetov
9fa8133a1f Try fix test 2019-11-08 20:18:25 +03:00
Nikolai Kochetov
86dfa807c2 Try fix test 2019-11-08 20:09:42 +03:00
alesapin
9305f04c9f Fix for fix 2019-11-08 19:54:13 +03:00
chertus
6f40bcfcee perf optimisation 2019-11-08 19:13:43 +03:00
millb
001e113ca6 Working commit 2019-11-08 19:12:19 +03:00
alesapin
cda502b247
Merge pull request #7685 from ClickHouse/fix_duplicate_insert_column
Forbidden to use column name more than once in insert query.
2019-11-08 19:09:27 +03:00
Nikolai Kochetov
dd7ed390f6 Merge branch 'master' into processors-4-tmp 2019-11-08 18:53:03 +03:00
millb
cabe917d7e Merge branch 'master' into fix_metric_suffix_in_settings_value 2019-11-08 18:40:14 +03:00