Commit Graph

13981 Commits

Author SHA1 Message Date
alesapin
c7065b6bd8 CLICKHOUSE-3943: Add test for FileOpen metric 2018-10-08 18:55:55 +03:00
VadimPE
79b6b8476a CLICKHOUSE-3947 add tests 2018-10-08 18:05:23 +03:00
Alexey Milovidov
64c7e357e8 Fixed error #3230 2018-10-08 08:30:03 +03:00
Alexey Milovidov
80faec76e8 Merge remote-tracking branch 'origin/master' into fix-memory-tracker 2018-10-08 00:09:18 +03:00
Alexey Milovidov
84b3ba3464 Improved test #3230 2018-10-07 23:47:03 +03:00
alexey-milovidov
469243b33b
Merge pull request #3306 from yandex/length-aliases
Added compatibility aliases for "length" and "lengthUTF8"
2018-10-07 23:26:57 +03:00
alexey-milovidov
36c3feea80
Merge pull request #3270 from yandex/left-join-right-keys-fix
Left join right keys fix
2018-10-07 23:26:40 +03:00
Alexey Milovidov
964a6e5771 Make function "concat" case insensitive for compatibility [#CLICKHOUSE-20] 2018-10-05 22:58:01 +03:00
Alexey Milovidov
9e1c51aca4 Added compatibility aliases for "length" and "lengthUTF8" [#CLICKHOUSE-20] 2018-10-05 22:52:42 +03:00
Alexey Milovidov
45af805ccb Translated comments in test #3230 2018-10-05 22:45:01 +03:00
Alexey Milovidov
a66beb5ec1 Fixed error #3230 2018-10-05 22:29:49 +03:00
Alexey Milovidov
aed501e687 Translated comments in test #3230 2018-10-05 21:51:42 +03:00
Alexey Milovidov
5503822983 Merge branch 'master' into fix-memory-tracker 2018-10-05 18:15:50 +03:00
Nikolai Kochetov
064facd8de Updated test. 2018-10-05 10:43:58 +03:00
Marek Vavruša
5d5c99ebee Formats/CapnProtoRowInputStream: fix column mismatch in list of structures
The fields are lexicographically sorted to make traversal easier,
but their order must be preserved when collecting fields from structures.

For example, a list with a structure like `{b @0 :Text, a @1 :Text}` would
read `a` first despite being second, which would cause a mismatch.
2018-10-04 15:59:27 -07:00
alexey-milovidov
47dd173007
Merge pull request #3281 from 4ertus2/summap
sumMap for number-based types
2018-10-05 00:12:57 +03:00
alexey-milovidov
ba62a24926
Merge pull request #3283 from yandex/FileOpenFixes_CLICKHOUSE-3943_
File open fixes clickhouse 3943
2018-10-05 00:00:47 +03:00
alexey-milovidov
b9d1eb4154
Merge pull request #3298 from yandex/fix-prewhere-with-altered-columns
Fix prewhere with altered columns
2018-10-04 23:57:11 +03:00
alexey-milovidov
cf6f5b314c
Update 00726_materialized_view_concurrent.sql 2018-10-04 22:40:10 +03:00
Nikolai Kochetov
2f2c939446 Added tests. 2018-10-04 21:19:25 +03:00
Nikolai Kochetov
b1fa3fab9d Fix prewhere whith final. #2827 2018-10-04 21:18:54 +03:00
Alexandr Krasheninnikov
d94b574644 Removing destructor 2018-10-04 16:19:08 +03:00
alesapin
5a218a7363 CLICKHOUSE-3943: Change naming 2018-10-04 11:52:56 +03:00
Nikolai Kochetov
a6d0094835 Fix readnig missing column with prewhere. #2827 2018-10-04 10:51:06 +03:00
alesapin
252f9d0080 CLICKHOUSE-3943: Style 2018-10-03 20:12:38 +03:00
alesapin
441069fc5c [WIP] CLICKHOUSE-3943: Store last_readed_mark in MergeTreeThreadBlockInputStream and don't recreate reader if it stopped in appropriate position 2018-10-03 20:10:23 +03:00
chertus
9c4c72cde5 fix test 2018-10-03 17:33:47 +03:00
chertus
5b987f02d7 sumMap for number-based types [issue-3277] 2018-10-03 17:22:28 +03:00
Alexandr Krasheninnikov
82200bc16a Added error codes, bridge startup, fixed destructor in XDBC stuff 2018-10-03 15:10:57 +03:00
VadimPE
40350c47e1 CLICKHOUSE-3947 del unused result_string 2018-10-03 15:10:35 +03:00
VadimPE
8df97e32af CLICKHOUSE-3947 fix bug with query.clone() 2018-10-03 15:03:39 +03:00
Alexandr Krasheninnikov
c7fee9374c fix formatting errors according code review 2018-10-03 13:44:43 +03:00
VadimPE
4152c34fbb CLICKHOUSE-4021 fix build 2018-10-03 13:08:02 +03:00
Marek Vavruša
575fa7f25a PushingToViewsBlockOutputStream: add tests for parallel processing
This adds tests for a971a0bc07
2018-10-02 19:06:04 -07:00
Nikolai Kochetov
c4c14de02f Join aliases and duplicating columns fixes.
Join aliases and duplicating columns fixes. [#CLICKHOUSE-3994] #3145
2018-10-02 21:17:39 +03:00
Nikolai Kochetov
c470cf1e26 Fix joined keys from right column with left join. [#CLICKHOUSE-3994] 2018-10-02 21:16:47 +03:00
alesapin
7d79192ad7
Merge pull request #3267 from yandex/CLICKHOUSE-4025
Fix join of unjoinable thread
2018-10-02 18:39:53 +03:00
alesapin
c9880ad9c0 Fix join of unjoinable thread 2018-10-02 16:38:28 +03:00
robot-clickhouse
e1817e4814 Auto version update to [18.14.2] [54409] 2018-10-02 16:25:47 +03:00
alexey-milovidov
147a2a13c2
Merge pull request #3257 from amosbird/master
Correct wcwidth computation for pretty outputs.
2018-10-02 16:23:41 +03:00
Amos Bird
7df73088ab Correct wcwidth computation for pretty outputs. 2018-10-02 10:06:18 +08:00
Alexey Milovidov
78aaf537b1 Merge branch 'master' of github.com:yandex/ClickHouse 2018-10-02 00:50:18 +03:00
Alexey Milovidov
698be017e9 Changes after merge #3208 2018-10-02 00:49:56 +03:00
alexey-milovidov
94b0432faa
Merge pull request #3262 from proller/fix17
Arcadia sync
2018-10-01 22:00:01 +03:00
alexey-milovidov
7c6b08c21c
Merge pull request #3251 from CurtizJ/table-db-macros
Support {database} and {table} macros in ReplicatedMergeTree [CLICKHOUSE-3897]
2018-10-01 21:45:52 +03:00
alexey-milovidov
6432cff455
Update Macros.h 2018-10-01 21:45:39 +03:00
alesapin
6017be28f6 CLICKHOUSE-4007: Fix PerfTest substitution function 2018-10-01 19:30:12 +03:00
proller
ca03cd6606 Sync with arcadia 2018-10-01 18:43:48 +03:00
Vadim
0849e1e218
Update transformQueryForExternalDatabase.cpp 2018-10-01 17:06:36 +03:00
VadimPE
d0981b733d CLICKHOUSE-3947 add recursive search for constant expressions 2018-10-01 16:27:39 +03:00
CurtizJ
ed77e40dfe fix implicit macros 2018-10-01 12:01:50 +03:00
alexey-milovidov
a4736275c6
Merge pull request #3208 from vavrusa/master
PushingToViewsBlockOutputStream: process blocks concurrently
2018-10-01 04:42:55 +03:00
alexey-milovidov
c4939a1bec
Update PushingToViewsBlockOutputStream.cpp 2018-10-01 04:39:00 +03:00
alexey-milovidov
33578cb1b1
Merge pull request #3216 from vavrusa/capnproto-tuple-nested
Formats/CapnProtoRowInputStream: support Nested and Tuple, fix alignm…
2018-10-01 04:34:06 +03:00
alexey-milovidov
ff53aa4947
Update CapnProtoRowInputStream.cpp 2018-10-01 04:33:36 +03:00
alexey-milovidov
fac040c39a
Update CapnProtoRowInputStream.cpp 2018-10-01 04:31:48 +03:00
alexey-milovidov
fd04b2b89a
Merge pull request #3215 from vavrusa/fix-kafka-lockups
Storages/Kafka: fixed deadlocks, moved to background pool
2018-10-01 04:30:03 +03:00
alexey-milovidov
bb0f76dd25
Update StorageKafka.cpp 2018-10-01 04:29:17 +03:00
alexey-milovidov
b9e6b02719
Update StorageKafka.cpp 2018-10-01 04:26:52 +03:00
zhang2014
6778220ffd ISSUES-3232 remake interpreter_subquery when rewrite subqueries 2018-09-30 17:27:59 +08:00
Alexey Milovidov
e4ec8ffc49 Fixed test; tests that require server to listen something other than 127.0.0.1, must be tagged as "shard" in their names [#CLICKHOUSE-2] 2018-09-29 22:50:12 +03:00
Alexey Milovidov
85ca2006b0 Fixed bug in client (double whitespace) [#CLICKHOUSE-4038] 2018-09-29 22:33:23 +03:00
CurtizJ
d4de76346c fix test 2018-09-29 16:12:53 +03:00
CurtizJ
b7b7314ecb remove redundant code 2018-09-28 22:13:16 +03:00
CurtizJ
e0d3aed0c4 remove redundant code 2018-09-28 22:10:16 +03:00
CurtizJ
99b4536b2a add test 2018-09-28 22:07:29 +03:00
chertus
69b9c25801 Merge branch 'master' into joins 2018-09-28 20:09:05 +03:00
chertus
4c8112138c Merge branch 'master' into joins 2018-09-28 20:02:25 +03:00
alexey-milovidov
a149233d99
Merge pull request #3246 from yandex/low-cardinality-fixes
Low cardinality fixes
2018-09-28 19:50:53 +03:00
alexey-milovidov
c409c186b3
Merge pull request #3249 from CurtizJ/fix-thread-group
Add test for #3247
2018-09-28 19:48:13 +03:00
CurtizJ
a4fac09073 update test 2018-09-28 19:43:41 +03:00
chertus
be3b845baf add test for remote quantiles 2018-09-28 19:33:12 +03:00
CurtizJ
c2bec8b2c8 update test 2018-09-28 19:11:56 +03:00
CurtizJ
d0b2e58d61 add test 2018-09-28 19:05:58 +03:00
alexey-milovidov
c6ab6fa1a8
Merge pull request #3247 from CurtizJ/fix-thread-group
Fix distributed "CREATE TABLE AS SELECT" query.
2018-09-28 18:54:49 +03:00
Anton Popov
49438ed1a1
Update DDLWorker.cpp 2018-09-28 18:35:30 +03:00
CurtizJ
ed3c744055 fixes 2018-09-28 18:30:03 +03:00
chertus
292a885533 fix typo in quantiles func registration 2018-09-28 18:08:37 +03:00
chertus
59df909f87 more ast debug info 2018-09-28 18:01:13 +03:00
proller
ec11bef633
Build fixes (#3181) 2018-09-28 17:53:20 +03:00
CurtizJ
009c973312 remove redundant comment 2018-09-28 16:47:34 +03:00
CurtizJ
f9fb73ce2e fix distributed "create table as select" query 2018-09-28 16:44:39 +03:00
chertus
593b3ae338 one more minor fix 2018-09-28 15:13:01 +03:00
robot-clickhouse
6f96dfc7da Auto version update to [18.14.1] [54409] 2018-09-28 14:58:24 +03:00
alexey-milovidov
b84a499a93
Merge pull request #3231 from zhang2014/fix/ISSUES-3225
ISSUES-3225 fix alias conflict when predicate optimization
2018-09-28 14:46:54 +03:00
chertus
b4ea89e1f3 minor fix 2018-09-28 14:46:52 +03:00
chertus
669ab71502 rename files according to class name 2018-09-28 13:52:08 +03:00
Nikolai Kochetov
97add69825 Rename WithDictionary to LowCardinality. 2018-09-28 13:44:59 +03:00
Alexey Milovidov
138e70197e Fixed comments and docs #3241 2018-09-28 06:42:08 +03:00
Alexey Milovidov
169dbfe200 Fixed discrepancy between default values of "log_queries" and "log_query_threads" settings [#CLICKHOUSE-4030] 2018-09-28 06:40:39 +03:00
Alexander Krasheninnikov
ceea4b9b33 New bridge interaction, quote identifier via api 2018-09-28 05:46:33 +03:00
chertus
57d2c9db60 AST debug stuff: DumpASTNode, TranslateQualifiedNamesVisitor, hide AST explain command [CLICKHOUSE-4001] 2018-09-27 22:25:18 +03:00
Alexandr Krasheninnikov
4b431264db Implement quote getter from ODBC 2018-09-27 18:23:42 +03:00
Nikolai Kochetov
5a211b1ab7 More comments. 2018-09-27 18:16:47 +03:00
Nikolai Kochetov
65c8a00e51 Fix low cardinality functions result cache if function can't be executed on default arguments. 2018-09-27 17:45:35 +03:00
CurtizJ
90240cb64b support database and table macros 2018-09-27 13:01:10 +03:00
chertus
041cef5968 explain ast [CLICKHOUSE-4001] 2018-09-27 12:47:21 +03:00
zhang2014
b35ab511cb ISSUES-3225 fix alias conflict when predicate optimization 2018-09-27 14:29:38 +08:00
Marek Vavruša
a971a0bc07 PushingToViewsBlockOutputStream: process blocks concurrently
The current model is to process blocks for attached views in sequence.
This is not ideal when the processing time for each view varies, or is
blocking (for example with replicated tables), as processing of next-in-line
view is blocked by wait in it's predecessor.

This commit changes the behavior to process 2 or more attached views concurrently.
2018-09-26 15:22:06 -07:00
alexey-milovidov
03d85227d1
Merge pull request #3229 from yandex/fix-datetime-conversion-when-inserting-in-values-format
Fix conversion between Date and DateTime when inserting in VALUES format and "input_format_values_interpret_expressions" is true
2018-09-27 00:20:04 +03:00
Alexey Milovidov
30da8de1b6 Send log message about peak memory usage to client #3230 2018-09-27 00:19:49 +03:00
Alexey Milovidov
99927a3518 Returned logging peak memory usage in query scope #3230 2018-09-27 00:10:43 +03:00
Alexey Milovidov
0928acdf8a Removed dead code #3230 2018-09-27 00:02:54 +03:00
Alexey Milovidov
b1b53a4019 Added test #3143 2018-09-26 23:49:44 +03:00
Alexey Milovidov
dd88c092b7 Attempt to fix inconsistent values in total memory tracker #3143 2018-09-26 23:45:40 +03:00
Alexey Milovidov
836c20b2d3 \Merge branch 'master' of github.com:yandex/ClickHouse 2018-09-26 22:48:59 +03:00
Alexey Milovidov
721837efe9 Adapted test #3205 2018-09-26 22:48:47 +03:00
alexey-milovidov
28bd1e8eff
Merge pull request #3224 from 4ertus2/decimal
Supertypes for decimal and integers [issue-3218]
2018-09-26 22:47:10 +03:00
Alexey Milovidov
e90484db77 Fix conversion between Date and DateTime when inserting in VALUES format and "input_format_values_interpret_expressions" is true #3226 2018-09-26 22:43:10 +03:00
chertus
4442437396 minor fix 2018-09-26 18:34:53 +03:00
alexey-milovidov
b6e53d22e1
Merge pull request #3200 from yandex/low-cardinality-function-result-cache
Added cache for low cardinality function result.
2018-09-26 18:12:48 +03:00
alexey-milovidov
2471332dfc
Update IFunction.h 2018-09-26 18:02:56 +03:00
chertus
a564b05ec7 supertypes for decimal and ints [issue-3218] 2018-09-26 17:59:23 +03:00
alexey-milovidov
6374094f0c
Merge pull request #3202 from zhang2014/fix/ISSUES-3145
ISSUES-3145 support qualified asterisk
2018-09-26 17:41:01 +03:00
chertus
3ff2cfb4af fix div by zero in decimal var/stddev 2018-09-26 15:38:36 +03:00
chertus
b48402e871 intDiv, intDivOrZero for decimal [issue-3221] 2018-09-26 15:12:45 +03:00
alexey-milovidov
60000481e4
Merge pull request #3219 from topvisor/add_biz_to_insignificant_second_level_domains
Update firstSignificantSubdomain function
2018-09-26 14:54:43 +03:00
Veloman Yunkan
3e96f32833 Fixed the bug introduced by PR#3144
The pre-existing optimization in the function
JSONEachRowRowInputStream::readColumnName() (that was extracted
during the refactoring step of PR#3144) imposed a restriction
on its usage - reading from the input stream might invalidate the return
value of that function, and this is what happenned in readJSONObject()
after the call to skipColonDelimiter().

One way of fixing the problem while preserving the original optimization
intact would be to defer the call to skipColonDelimiter() until the
variable name_ref was fully consumed, however that would result in worse
code (skipColonDelimiter() would need to be called in three different
places where it doesn't really belong).

Therefore I preferred to slightly weaken the optimization by always
copying the key name into the current_column_name data member.
2018-09-26 11:27:04 +00:00
chertus
69dd660919 fix crash on decimal division by zero [issue-3221] 2018-09-26 14:25:50 +03:00
decaseal
963988ddf2
Update firstSignificantSubdomain function
Add "biz" domain to list of "insignificant" second-level domains
2018-09-26 12:39:04 +03:00
Marek Vavruša
cbbcb6d9df Formats/CapnProtoRowInputStream: support Nested and Tuple, fix alignment issues
This updated contrib/capnproto to a newer version that fixes problems with
unaligned access to message frames.

It also adds support for parsing Struct types as Tuple (named or unnamed),
and Nested array types.

The `struct X { a @0 :UInt64; b @1 :Text }` in Cap'nProto is equivalent to
`x Tuple(a UInt64, b String)` in ClickHouse.

Arrays of Struct types such as `y List(X)` are equivalent to `y Nested(a UInt64, b String)`.
2018-09-25 22:51:35 -07:00
Marek Vavruša
ea32434888 Storages/Kafka: fixed deadlocks, moved to background pool
This fixes two deadlocks in Kafka engine found previously:
* When exception is thrown before starting reading, consumer
  was never returned to the storage. Now it is claimed only
  when actually starting reading.
* Fixed lockup on deinitialization when consumer only unsubscribed,
  but didn't close, and the endine then timeouted when waiting for
  consumer destruction.

This also moves the stream thread to background worker pool.
The reason for that is that it will compete with other tasks for
time, so it will form a backpressure on insertion when the system
is busy.
2018-09-25 22:51:07 -07:00
Alexey Milovidov
33e4865240 Adjusted test #3205 2018-09-26 05:33:29 +03:00
Alexey Milovidov
57822ad592 Improvement #3205 2018-09-26 04:30:07 +03:00
Alexey Milovidov
042536177d Merge branch 'master' into order-by-remerge 2018-09-26 04:24:35 +03:00
Alexey Milovidov
b11a84b895 Merge branch 'master' of github.com:yandex/ClickHouse into every_function_in_own_file_5 2018-09-26 03:36:20 +03:00
Alexey Milovidov
0e7caa05fa Every function in its own file, part 5 [#CLICKHOUSE-2] 2018-09-26 03:32:38 +03:00
Alexey Milovidov
27b7654abc Every function in its own file, part 5 [#CLICKHOUSE-2] 2018-09-26 03:31:40 +03:00
chertus
96ceca6c05 fix decimal to int, int to decimal convertion [issue-3177] 2018-09-25 19:03:50 +03:00
Alexandr Krasheninnikov
647d1041f1 Implement jdbc/idbc bridge connectors 2018-09-25 17:29:44 +03:00
Nikolai Kochetov
d526859011 Added cache for low cardinality function result. [#CLICKHOUSE-3904] 2018-09-25 16:48:52 +03:00
zhang2014
b887ec8e98 ISSUES-3145 support qualified asterisk 2018-09-25 10:42:51 +08:00
Alexander Krasheninnikov
fe8affa1cf Initial 2018-09-25 03:21:20 +03:00
alexey-milovidov
002331be1b
Merge pull request #3204 from CurtizJ/CLICKHOUSE-3527
Better code in #3101.
2018-09-25 00:28:11 +03:00
Alexey Milovidov
5cc8e802d5 Added test #3205 2018-09-25 00:02:40 +03:00
Alexey Milovidov
9fbde09725 Memory tracker: added watermark logging #3205 2018-09-24 23:57:10 +03:00
Alexey Milovidov
81e2fe14e5 Better messages #3205 2018-09-24 23:30:02 +03:00
Alexey Milovidov
8e7c6598e8 Added remerge step to process ORDER BY with LIMIT when memory usage is high #3179 2018-09-24 23:07:30 +03:00
Alexey Milovidov
17b8e20922 Failover for hosts with missing DNS records while connecting to ZooKeeper #3201 2018-09-24 22:09:12 +03:00
CurtizJ
d0ed96aa04 better code 2018-09-24 22:08:11 +03:00
Alexey Milovidov
73f68b5ee4 Miscellaneous [#CLICKHOUSE-2] 2018-09-24 21:44:09 +03:00
Alexey Milovidov
5f6328646a utils/check-style/check-style -n #3101 2018-09-24 21:02:25 +03:00
alexey-milovidov
b6c7d71a03
Merge pull request #3101 from CurtizJ/CLICKHOUSE-3527
CLICKHOUSE-3527 Fix race while parallel ddl queries
2018-09-24 20:59:57 +03:00
robot-clickhouse
ca465cd20b Auto version update to [18.14.0] [54409] 2018-09-24 20:52:21 +03:00
zhang2014
f3dcc2ef41 ISSUES-3145 support qualified asterisk 2018-09-24 23:28:18 +08:00
chertus
f09970ff70 add test for inner join [CLICKHOUSE-4001] 2018-09-24 16:55:26 +03:00
alexey-milovidov
4185351c8d
Merge pull request #3197 from yandex/fix_odbc_table_function
Fix odbc table function
2018-09-23 18:48:02 +03:00
alesapin
7c47644f7b Reuse base class function 2018-09-23 12:16:16 +03:00
Alexey Milovidov
bb654ff307 Fixed trash #3195 2018-09-22 21:12:14 +03:00
Alexey Milovidov
b972742f9a Fixed bad code; updated docs #3195 2018-09-22 21:07:27 +03:00