Commit Graph

10553 Commits

Author SHA1 Message Date
CurtizJ
8a72ddd94b wip on finish sorting 2018-10-19 15:02:31 +03:00
proller
abfe675097
Build fixes (#3419) 2018-10-18 22:28:05 +03:00
chertus
5aedca40c2 fix asan 2018-10-18 22:27:28 +03:00
Marek Vavruša
37e03bd938 StorageKafka: check dependencies recursively, add max_block setting
Changes:

* Check table dependencies recursively before starting streaming
* Use actual number of created consumers when streaming
* Add size limits hint to Kafka consumer stream
* Configurable `kafka_max_block_size` per table
2018-10-18 09:20:34 -07:00
chertus
a32e06d298 more ExpressionAnalyzer refactoring [CLICKHOUSE-3996] 2018-10-18 18:03:14 +03:00
VadimPE
f2db463ab0 fix bug with merge part, wich us inserted with quorum 2018-10-18 17:14:07 +03:00
VadimPE
451114c9a3 rename partition -> part 2018-10-18 15:16:53 +03:00
VadimPE
4a93d3b836 fix addedparts 2018-10-18 14:51:40 +03:00
alesapin
87bb06fdd8 CLICKHOUSE-2211: Add exception for impossible case 2018-10-18 12:24:16 +03:00
alesapin
fe6406eac1 CLICKHOUSE-2211: Fix accident delition 2018-10-17 19:18:14 +03:00
alesapin
d78d569d42 CLICKHOUSE-2211: Fix aio reading (with correct buffer size), reduce MergeTreeReader creation and add useless test 2018-10-17 17:56:15 +03:00
CurtizJ
f86b9d3983 add lock for .inner. table 2018-10-17 17:11:20 +03:00
CurtizJ
d81ed27004 add lock for .inner. table 2018-10-17 17:08:52 +03:00
Artem Zuikov
52e94ecc5a
Merge pull request #3368 from 4ertus2/joins
Extract visitors from ExpressionAnalyser [CLICKHOUSE-3996]
2018-10-17 15:48:42 +03:00
chertus
5d3f03a6d2 minor refactoring (function naming) 2018-10-17 14:06:46 +03:00
chertus
40f1805bf4 fix gcc build 2018-10-17 13:59:05 +03:00
zhang2014
133363e8e3 ISSUES-2312 fix nested view & joined view without database 2018-10-17 14:35:16 +08:00
alexey-milovidov
7566ffe751
Merge pull request #3398 from yandex/better-startup-time
Better server startup time
2018-10-17 08:58:23 +03:00
Alexey Milovidov
44f5c735aa Temporary disable "enable_optimize_predicate_expression" setting by default #1777 2018-10-17 06:46:06 +03:00
Alexey Milovidov
99a64d3b92 Presumably better #2278 2018-10-17 06:13:00 +03:00
Alexey Milovidov
427eba3451 Improved server startup time #2278 2018-10-17 05:34:14 +03:00
Alexey Milovidov
a7090f4fab Improved server startup time #2278 2018-10-17 04:59:24 +03:00
Alexey Milovidov
aa227795ef Improved server startup time #2278 2018-10-17 04:31:28 +03:00
Alexey Milovidov
7c4d24ce39 Added comment [#CLICKHOUSE-3901] 2018-10-17 00:25:45 +03:00
Alexey Milovidov
98543b7c41 Fixed vertical merge of multidimensional Nested structures [#CLICKHOUSE-3901] 2018-10-17 00:22:41 +03:00
chertus
27d66a45c3 extract more visitors from ExpressionAnalyzer [CLICKHOUSE-3996] 2018-10-16 22:00:05 +03:00
alesapin
457f8fd495
Merge pull request #3389 from yandex/CLICKHOUSE-4067
CLICKHOUSE-4067: Fixes in odbc dictionaries. Now dictionaries receive…
2018-10-16 15:37:23 +03:00
chertus
4071155043 better ActionsVisitor extraction [CLICKHOUSE-3996] 2018-10-16 15:34:20 +03:00
chertus
e6e28d2451 Merge branch 'master' into joins 2018-10-16 13:10:32 +03:00
Artem Zuikov
3359ba06c3
Merge pull request #3391 from 4ertus2/decimal
fix for Decimal128 group by [issue-3378]
2018-10-16 13:07:11 +03:00
chertus
29bd00f9f4 simple fix for Decimal128 group by [issue-3378] 2018-10-16 10:31:17 +03:00
chertus
465cb6d267 fix for Decimal128 group by [issue-3378] 2018-10-15 22:14:08 +03:00
proller
0cf72f9b26 clickhouse-odbc#125 : Make TIMESTAMP alias for DateTime type for allowing CAST(x AS TIMESTAMP) 2018-10-15 18:10:34 +03:00
alesapin
c951ec7bad CLICKHOUSE-4067: Fixes in odbc dictionaries. Now dictionaries receives bridge path from global config (as it was before). Quotation performed on table and schema independently. Add tests with postgres interaction. Update documentation 2018-10-15 17:49:23 +03:00
VadimPE
e331f15ffd CLICKHOUSE-1791 add modulo for nonIntegral divisor 2018-10-15 16:24:01 +03:00
VadimPE
7b6f0f5372 CLICKHOUSE-1791 add modulo for date 2018-10-15 15:53:05 +03:00
Alexey Milovidov
50234013b5 Whitespaces [#CLICKHOUSE-4016] 2018-10-14 11:23:21 +03:00
Kirill Shvakov
5600c35847 check drop type 2018-10-14 00:37:16 +03:00
Kirill Shvakov
0f509b9eb5 ReplicatedMergeTree: send drop request to the leader replica 2018-10-13 23:58:04 +03:00
Alexey Milovidov
f720a5bf95 Fixed typos in code #3373 2018-10-13 17:33:43 +03:00
Alexey Milovidov
72e2996e3e Fixed incompatibility when versions prior to 18.12.17 are used on remote servers and newer is used on initiating server, and GROUP BY both fixed and non-fixed keys, and when two-level group by method is activated [#CLICKHOUSE-4035] 2018-10-13 02:43:25 +03:00
Alexey Milovidov
98859f232b Merge branch 'master' into group_by_two_level_compatibility 2018-10-13 02:13:30 +03:00
alexey-milovidov
845e8b19d8
Merge pull request #3367 from yandex/CLICKHOUSE-4060
CLICKHOUSE-4060: Use individual context for each function
2018-10-12 22:08:16 +03:00
chertus
9120d5f38e extract visitor from ExpressionAnalyser [CLICKHOUSE-3996] 2018-10-12 18:41:28 +03:00
alesapin
72ef357a02 Fix typo assignment 2018-10-12 17:52:39 +03:00
alexey-milovidov
8b4e58460a
Merge pull request #3366 from 4ertus2/decimal
Conditional for UUID [CLICKHOUSE-4016]
2018-10-12 17:06:29 +03:00
alexey-milovidov
b1ceb4bfc8
Merge pull request #3362 from yandex/nullable-types-from-external-databases
Allow Nullable types in MySQL, ODBC and MongoDB external sources
2018-10-12 16:59:01 +03:00
alesapin
17150fd688 CLICKHOUSE-4060: Use individual context for each function 2018-10-12 16:03:57 +03:00
chertus
688b5aa8e4 Conditional for UUID [CLICKHOUSE-4016] 2018-10-12 14:23:05 +03:00
Alexey Milovidov
0573b80288 Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:41:54 +03:00
Alexey Milovidov
4bb8da039f Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:26:48 +03:00
Alexey Milovidov
d5bfe37879 Allow Nullable types in MySQL, ODBC and MongoDB external sources #3284 2018-10-12 05:09:47 +03:00
Alexey Milovidov
f8e5a22e03 Fixed "timeSlot" and "timeSlots" functions [#CLICKHOUSE-4016] 2018-10-12 03:40:19 +03:00
Alexey Milovidov
6e39e021f0 Disable "compile_expressions" setting by default because it is not production ready [#CLICKHOUSE-4060] 2018-10-12 03:21:24 +03:00
Alexey Milovidov
f650bde97d Merge branch 'master' into fix-function-if 2018-10-12 02:49:06 +03:00
alexey-milovidov
12772c2cd5
Merge pull request #3357 from yandex/check-for-array-join-in-prewhere
Added check for invalid PREWHERE
2018-10-12 01:32:44 +03:00
Alexey Milovidov
218366e17f Fixed error introduced in #3342 2018-10-12 00:31:36 +03:00
alexey-milovidov
27a07a9d90
Merge pull request #3356 from yandex/llvm-better-exception-messages
LLVM compiler: better exception messages.
2018-10-12 00:18:42 +03:00
Alexey Milovidov
e752271d99 Added check for invalid PREWHERE #3336 2018-10-11 23:52:25 +03:00
alexey-milovidov
42e18a4615
Merge pull request #3355 from 4ertus2/joins
Extract one more visitor from ExpressionAnalyzer [CLICKHOUSE-3996]
2018-10-11 23:33:35 +03:00
Alexey Milovidov
7d6365d139 LLVM compiler: better exception messages [#CLICKHOUSE-2] 2018-10-11 23:31:41 +03:00
chertus
c593d9a971 extract ExecuteScalarSubqueriesVisitor from ExpressionAnalyser [CLICKHOUSE-3996] 2018-10-11 22:28:59 +03:00
alexey-milovidov
9f494b0278
Merge pull request #3351 from CurtizJ/CLICKHOUSE-3974
Create client_info when it`s not initialized [CLICKHOUSE-3974]
2018-10-11 22:09:25 +03:00
CurtizJ
1f71a97881 create client_info when it`s not initialized 2018-10-11 19:57:21 +03:00
alexey-milovidov
150be189ac
Merge pull request #3348 from 4ertus2/decimal
SummingMergeTree for Decimal128 [issue-3282]
2018-10-11 19:54:29 +03:00
alesapin
e68f9d2193 CLICKHOUSE-4055: LibraryDictionarySource -- set null_value from config for absent values 2018-10-11 18:21:12 +03:00
chertus
5896e45dac SummingMergeTree for Decimal128 [issue-3282] 2018-10-11 17:33:01 +03:00
CurtizJ
c565c75350 fix style 2018-10-11 12:27:16 +03:00
Marek Vavruša
0652302d9a Common/MemoryTracker: fix metrics not being updated after MemoryTracker reset
The #3230 fixed a problem with memory accounting, but it introduces a regression
in which the memory tracker isn't reset until there are zero queries in process list.
This makes it difficult to see in tests as there's always just one query in-flight,
but in production it produces a sawtooth memory usage pattern that resets when
the allocated memory exceeds set memory limits and all queries are terminated.
2018-10-10 17:37:41 -07:00
Alexey Milovidov
e3773c5d0c Fixed code that was out of style #3145 2018-10-11 00:01:53 +03:00
Alexey Milovidov
55923011b5 Attempt to fix use-after-free, try 1 #3145 2018-10-10 23:44:50 +03:00
Alexey Milovidov
55bc2b812b Miscellaneous #3145 2018-10-10 23:44:19 +03:00
Alexey Milovidov
75221c478a Miscellaneous #3145 2018-10-10 23:37:01 +03:00
Alexey Milovidov
2c0ea27377 Miscellaneous #3145 2018-10-10 23:35:21 +03:00
Alexey Milovidov
5e50e6bfef Fixed strange code #3145 2018-10-10 23:26:04 +03:00
alexey-milovidov
b9ecc4b819
Merge pull request #3340 from CurtizJ/issue-3253
Fix unnecessarily preparations for join at initial server [ISSUE-3253]
2018-10-10 23:04:13 +03:00
alexey-milovidov
5795b559c6
Merge pull request #3342 from 4ertus2/decimal
Confitional for Decimal (without arrays) [CLICKHOUSE-3765]
2018-10-10 23:00:17 +03:00
alexey-milovidov
297f9cec38
Merge pull request #3341 from yandex/fix-point-in-poligon
Fix point in poligon
2018-10-10 22:09:13 +03:00
chertus
aa9f17b8df Merge branch 'master' into decimal 2018-10-10 21:39:57 +03:00
chertus
94c9a544f2 If for Decimal (basic support) [CLICKHOUSE-3765] 2018-10-10 21:37:54 +03:00
CurtizJ
16bea3d008 remove logs 2018-10-10 20:09:09 +03:00
CurtizJ
815380b8b2 fix unnecessarily preparations for join at initial server 2018-10-10 20:07:21 +03:00
Nikolai Kochetov
935030a94a Fixed precision issue. Repaced foat with auto. 2018-10-10 19:35:09 +03:00
Vadim
25b100c1f0
Update StorageReplicatedMergeTree.cpp 2018-10-10 19:23:50 +03:00
chertus
1b7354f809 disable AST logging 2018-10-10 19:23:27 +03:00
VadimPE
4db6eab5a3 ISSUES-2581 fix name 2018-10-10 19:20:15 +03:00
alexey-milovidov
34bd8568b6
Merge pull request #3339 from liuyimin-bytedance/master
Issue 3269 Fix incorrect OR evaluation when multiples ORs are optimized to IN
2018-10-10 16:42:24 +03:00
alexey-milovidov
fe79529627
Update LogicalExpressionsOptimizer.cpp 2018-10-10 16:41:44 +03:00
liuyimin
019677c55b Add fake range for tuple ASTFunction generated by Optimizer so that prepared set indexation works correctly 2018-10-10 21:31:18 +08:00
alexey-milovidov
4e6fd3e3fe
Merge pull request #3337 from VadimPE/CLICKHOUSE-3021
[CLICKHOUSE-3021] fix bug with unsupported value in CREATE TABLE
2018-10-10 16:23:17 +03:00
alexey-milovidov
2aa255f8b0
Update InterpreterCreateQuery.cpp 2018-10-10 16:23:06 +03:00
VadimPE
d4a56af660 ISSUES-2581 fix bug with new partition 2018-10-10 16:22:55 +03:00
Vadim
56bfc25d9a
Update InterpreterCreateQuery.cpp 2018-10-10 16:15:17 +03:00
Vadim
834267054e
Update InterpreterCreateQuery.cpp 2018-10-10 16:14:29 +03:00
VadimPE
779a178347 CLICKHOUSE-3021 fix bug with unsupported value in CREATE TABLE 2018-10-10 15:50:29 +03:00
alesapin
8591038748 Fix style and clang build 2018-10-10 11:38:54 +03:00
Alexey Milovidov
0b3a8cb489 Merge branch 'joins' of https://github.com/4ertus2/ClickHouse into 4ertus2-joins 2018-10-10 04:06:06 +03:00
alexey-milovidov
1472e3ae66
Merge pull request #3210 from alex-krash/jdbc-bridge
External database access unification (jdbc/odbc bridges)
2018-10-10 02:26:56 +03:00
alexey-milovidov
54e933f9dc
Update DictionarySourceFactory.cpp 2018-10-10 02:21:19 +03:00
alexey-milovidov
1dba31a313
Merge pull request #3332 from yandex/fix-performance-regression-while-parsing-jsoneachrow
Fix performance regression in parsing JSONEachRow format.
2018-10-10 02:09:22 +03:00
alexey-milovidov
a867009747
Merge pull request #3324 from 4ertus2/decimal
Decimal dictionaries support [CLICKHOUSE-4045]
2018-10-10 00:49:37 +03:00
alexey-milovidov
ab198e77d1
Merge pull request #3329 from 4ertus2/master
get64 for Decimal32/64; remove allow_experimental_decimal_type [issue-3282]
2018-10-10 00:40:29 +03:00
Alexey Milovidov
7b24ad570c Inline some functions #3223 2018-10-10 00:38:06 +03:00
Alexey Milovidov
681929cbda Attempt to fix performance regression while parsing JSONEachRow #3223 2018-10-10 00:32:15 +03:00
Alexey Milovidov
c014168c5f Attempt to fix performance regression while parsing JSONEachRow #3223 2018-10-10 00:21:52 +03:00
Alexey Milovidov
a432ff335e Attempt to fix performance regression while parsing JSONEachRow #3223 2018-10-10 00:09:48 +03:00
alexey-milovidov
b7766333ab
Merge pull request #3330 from CurtizJ/CLICKHOUSE-4005
Interpret empty null_value in external dictionaries as type default value [ClLICKHOUSE-4005]
2018-10-09 23:44:18 +03:00
Alexey Milovidov
798c3d2e4d Merge remote-tracking branch 'origin/master' into fix-performance-regression-while-parsing-jsoneachrow 2018-10-09 23:42:21 +03:00
alexey-milovidov
caaa7ff98e
Merge pull request #3331 from yandex/fix-point-in-poligon
Fix point in poligon
2018-10-09 23:41:35 +03:00
Alexey Milovidov
4a31c1c18a Attempt to fix performance regression while parsing JSONEachRow #3223 2018-10-09 22:46:35 +03:00
Nikolai Kochetov
1f348a09ca Fix calcLinestringRotation angle. #3309 2018-10-09 22:38:37 +03:00
Alexey Milovidov
9a50300e42 Minor modifications #3223 2018-10-09 21:14:30 +03:00
Alexey Milovidov
e4b4b5a4fc Better diagnostic for JSONEachRow format #3223 2018-10-09 21:06:52 +03:00
alexey-milovidov
052fc2b674
Merge pull request #3223 from veloman-yunkan/jsoneachrow_bugfix
Fix for issue #3297
2018-10-09 21:05:51 +03:00
CurtizJ
5f2f1f589f interpret empty null_value as default value 2018-10-09 20:43:25 +03:00
alesapin
32c6d0c699
Merge pull request #3182 from VadimPE/CLICKHOUSE-3947
CLICKHOUSE-3947 add LIKE and IN () for ODBC and MySQL
2018-10-09 20:12:32 +03:00
chertus
ee40c0cec9 undo changes from another pull request 2018-10-09 20:02:30 +03:00
chertus
c7bf0e77ea add get64() for Decimal32 and Decimal64; remove allow_experimental_decimal_type setting [issue-3282] 2018-10-09 19:50:42 +03:00
Alexandr Krasheninnikov
27f288641e Fix config reference, header inclusion and failed tests 2018-10-09 18:03:41 +03:00
chertus
b360fc895a comment for TranslateQualifiedNamesVisitor [CLICKHOUSE-4001] 2018-10-09 17:41:19 +03:00
chertus
ec8d3b388d move DumpASTNode to own file, style fixes [CLICKHOUSE-4001] 2018-10-09 17:32:11 +03:00
Alexey Milovidov
227ff8c606 Fixed comment [#CLICKHOUSE-2] 2018-10-09 17:30:05 +03:00
VadimPE
bcf8d5517e CLICKHOUSE-3947 fix const 2018-10-09 17:21:19 +03:00
VadimPE
da712d0036 CLICKHOUSE-3947 fix copy-paste and const 2018-10-09 17:13:08 +03:00
chertus
20b733aaf0 Merge branch 'master' into joins 2018-10-09 13:47:01 +03:00
alesapin
9946154908 CLICKHOUSE-3943: Rename FLUSH SYSTEM TABLES query to FLUSH LOGS, better tests 2018-10-09 13:05:27 +03:00
chertus
f21c4c898e Decimal dictionaries support [CLICKHOUSE-4045] 2018-10-08 22:45:17 +03:00
Alexey Milovidov
64c7e357e8 Fixed error #3230 2018-10-08 08:30:03 +03:00
Alexey Milovidov
80faec76e8 Merge remote-tracking branch 'origin/master' into fix-memory-tracker 2018-10-08 00:09:18 +03:00
alexey-milovidov
469243b33b
Merge pull request #3306 from yandex/length-aliases
Added compatibility aliases for "length" and "lengthUTF8"
2018-10-07 23:26:57 +03:00
alexey-milovidov
36c3feea80
Merge pull request #3270 from yandex/left-join-right-keys-fix
Left join right keys fix
2018-10-07 23:26:40 +03:00
Alexey Milovidov
964a6e5771 Make function "concat" case insensitive for compatibility [#CLICKHOUSE-20] 2018-10-05 22:58:01 +03:00
Alexey Milovidov
9e1c51aca4 Added compatibility aliases for "length" and "lengthUTF8" [#CLICKHOUSE-20] 2018-10-05 22:52:42 +03:00
Alexey Milovidov
a66beb5ec1 Fixed error #3230 2018-10-05 22:29:49 +03:00
Alexey Milovidov
5503822983 Merge branch 'master' into fix-memory-tracker 2018-10-05 18:15:50 +03:00
CurtizJ
5a01eb3d5e add test 2018-10-05 17:35:35 +03:00
Nikolai Kochetov
064facd8de Updated test. 2018-10-05 10:43:58 +03:00
Marek Vavruša
5d5c99ebee Formats/CapnProtoRowInputStream: fix column mismatch in list of structures
The fields are lexicographically sorted to make traversal easier,
but their order must be preserved when collecting fields from structures.

For example, a list with a structure like `{b @0 :Text, a @1 :Text}` would
read `a` first despite being second, which would cause a mismatch.
2018-10-04 15:59:27 -07:00
alexey-milovidov
47dd173007
Merge pull request #3281 from 4ertus2/summap
sumMap for number-based types
2018-10-05 00:12:57 +03:00
alexey-milovidov
ba62a24926
Merge pull request #3283 from yandex/FileOpenFixes_CLICKHOUSE-3943_
File open fixes clickhouse 3943
2018-10-05 00:00:47 +03:00
alexey-milovidov
b9d1eb4154
Merge pull request #3298 from yandex/fix-prewhere-with-altered-columns
Fix prewhere with altered columns
2018-10-04 23:57:11 +03:00
Nikolai Kochetov
b1fa3fab9d Fix prewhere whith final. #2827 2018-10-04 21:18:54 +03:00
CurtizJ
8c2060b48a wip on finish sorting 2018-10-04 17:55:02 +03:00
Alexandr Krasheninnikov
d94b574644 Removing destructor 2018-10-04 16:19:08 +03:00
CurtizJ
dd9516a810 wip on finish sorting 2018-10-04 13:24:51 +03:00
alesapin
5a218a7363 CLICKHOUSE-3943: Change naming 2018-10-04 11:52:56 +03:00
Nikolai Kochetov
a6d0094835 Fix readnig missing column with prewhere. #2827 2018-10-04 10:51:06 +03:00
alesapin
252f9d0080 CLICKHOUSE-3943: Style 2018-10-03 20:12:38 +03:00
alesapin
441069fc5c [WIP] CLICKHOUSE-3943: Store last_readed_mark in MergeTreeThreadBlockInputStream and don't recreate reader if it stopped in appropriate position 2018-10-03 20:10:23 +03:00
chertus
5b987f02d7 sumMap for number-based types [issue-3277] 2018-10-03 17:22:28 +03:00