Commit Graph

12455 Commits

Author SHA1 Message Date
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
Alexey Milovidov
8df4b8e270 Added comment #4409 2019-03-01 23:17:30 +03:00
Alexey Milovidov
3c2dd5257b Fixed typo #4409 2019-03-01 23:16:56 +03:00
Alexey Milovidov
bc25bedbd4 Implemented function "flatten" #4409 2019-03-01 23:07:58 +03:00
Alexey Milovidov
9d0adf40d2 Merge branch 'array-flatten-function' of https://github.com/kzon/ClickHouse into kzon-array-flatten-function 2019-03-01 19:42:06 +03:00
Alexey Milovidov
8f4b651679 Rewrite code and added a comment #4551 2019-03-01 19:38:52 +03:00
alexey-milovidov
9a62eb8d26
Merge pull request #4506 from yandex/quantile-timing-ubsan-fix
Fixed fuzz test in UBSan
2019-03-01 19:18:33 +03:00
alexey-milovidov
f74252cff9
Merge pull request #4551 from temoon/temoon-iss-4524
Set update_time on full executable dictionary update
2019-03-01 19:09:16 +03:00
alexey-milovidov
695a2dc35f
Merge pull request #4552 from 4ertus2/bugs
Fix crash on JOIN with array or tuple
2019-03-01 18:49:22 +03:00
chertus
83503df56a fix crach on JOIN with array or tuple 2019-03-01 18:32:32 +03:00
Alexey Milovidov
51ca51aa9e Merge branch 'master' into quantile-timing-ubsan-fix 2019-03-01 17:53:04 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Alexey Zatelepin
5b850bad47 fix build 2019-03-01 14:42:41 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
alexey-milovidov
137f800423
Update StorageSystemColumns.cpp 2019-03-01 04:08:12 +03:00
alexey-milovidov
e64cf60236
Merge pull request #4530 from hczhcz/patch-1
Fix readBinary linkage error in Field.cpp
2019-03-01 01:49:54 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd fix build 2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
BayoNet
455ca955e5 DOCAPI-5203: Added the descriptions for direct I/O settings for MergeTree merge and SELECT queries. 2019-02-28 14:20:27 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
liangqian
6757b112d1 change Sream into Stream 2019-02-28 15:27:30 +08:00
Tema Novikov
f92210d0fb
Set update_time on full executable dictionary update
This fixes issue #4524.
2019-02-28 09:47:48 +03:00
hcz
8f099af799
Fix readBinary linkage error in Field.cpp 2019-02-28 14:16:45 +08:00
proller
aad2856eba CLICKHOUSE-4179 : arrayEnumerateDenseRanked arrayEnumerateUniqRanked (#4475)
* Build fixes (clang 7.0.0+)

* better

* wip

* wip

* fix

* fix

* wip

* fix

* clean

* clean

* CLICKHOUSE-4179 WIP

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

*    wip

* wip

* wip

* wip

* wip

* cf

*    wip

* wip

* wip

* wip

* cf

* wip

* wip# Please enter the commit message for your changes. Lines starting

* wip# Please enter the commit message for your changes. Lines starting

* cf

* wip# Please enter the commit message for your changes. Lines starting

* wip

* cf

* wip

* wip

* clean

* clean

* clean

* clean

* wip

* wip

* wip

* cf

* wip

* wip

* wip

* cf

* clean

* wip

* clean

* cf

* clean

* clean

* test

* clean

* wip

* cf

* wip

* clean

* clean

* wip

* wip

* clean

* cf

* clean

* Requested changes

* cf

* no convertToFullColumnIfConst

* clean

* clean

* clean

* fix

* Remove comment
2019-02-28 01:18:58 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse
Fix column description parse. Now creation of replicated MT table wit…
2019-02-28 01:18:31 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Milovidov
3256b816be Merge branch 'master' of github.com:yandex/ClickHouse 2019-02-27 22:12:17 +03:00
Alexey Milovidov
141d9add39 Fixed error message 2019-02-27 22:12:08 +03:00
Alexey Zatelepin
df5ad1871a add comment [#CLICKHOUSE-3789] 2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Vitaly Baranov
6fbcc12674
Merge pull request #4493 from vitlibar/support-for-nested-messages-in-protobuf-output
Added support for nested messages in protobuf output format
2019-02-27 18:16:45 +03:00
Ivan Lezhankin
d66626a35a Revert "Move experimental join transformations to syntax analyzer"
This reverts commit 0e2316e0ac.
2019-02-27 16:35:43 +03:00
proller
211ec436c5
Build fixes (#4516) 2019-02-27 15:52:24 +03:00
Ivan Lezhankin
2a604d075a Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-4268 2019-02-27 15:08:36 +03:00
Vitaly Baranov
147a7a1458 Remove unused function ProtobufSchemas::getMessageTypeForColumns(). 2019-02-27 14:37:17 +03:00
Vitaly Baranov
e712a78cce Minor improvements of ProtobufReader. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
85ab57f179 Implement support of nested messages in Protobuf output format. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
4f46052f2e Optimize the class ProtobufWriter and prepare for implementing support of nested messages. 2019-02-27 14:37:14 +03:00
Vitaly Baranov
1cce1feac1 Move IConverter to header for allow inlining ProtobufWriter functions. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
2f0276503a Move ProtobufSimpleWriter to the internals of ProtobufWriter. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
65d997db94 Simplify excluding ProtobufWriter from compilation when USE_PROTOBUF=0. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
ba2efbae01 Make the interface IRowOutputStream more generic and use it for writing protobufs. 2019-02-27 00:53:13 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00
Nikita Vasilev
7a51928cad Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-02-26 23:35:57 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Alexey Milovidov
610f9523b0 Addition to prev. revision 2019-02-26 22:34:32 +03:00
Ivan Lezhankin
e9849ba8de Don't replace tables with compound names 2019-02-26 20:22:05 +03:00
chertus
d448d3e907 enable allow_experimental_multiple_joins_emulation and allow_experimental_cross_to_join_conversion by default 2019-02-26 20:00:33 +03:00
alesapin
507aa7b779
Merge pull request #4515 from yandex/fix_ub_in_cached_dictionary
Fix UB in IsIn function of cache dictionary and typo in integration test
2019-02-26 19:49:18 +03:00
alesapin
7ffd74ca74 Fix UB in IsIn function of cache dictionary and typo in integration test. 2019-02-26 17:52:55 +03:00
Ivan Lezhankin
7f130d2362 Don't replace aliased tables. 2019-02-26 17:12:25 +03:00
Alexey Milovidov
7179bb32b2 Balance 2019-02-26 15:31:17 +03:00
Alexey Milovidov
c80ad3b578 Removed useless includes 2019-02-26 15:30:36 +03:00
Ivan Lezhankin
09af5512b8 Implement push-down inside join-statement 2019-02-26 13:56:19 +03:00
Alexey Milovidov
8e59998dfa Added a comment 2019-02-26 13:53:35 +03:00
Alexey Milovidov
f542ba784b Merge branch 'fix-bad-parsing-error-message' of github.com:yandex/ClickHouse into fix-bad-parsing-error-message 2019-02-26 13:38:16 +03:00
Alexey Milovidov
ae28c46a46 Added workaround for compiler bug 2019-02-26 13:37:47 +03:00
Alexey Milovidov
3b20ecf36a Merge branch 'master' into fix-bad-parsing-error-message 2019-02-26 13:27:12 +03:00
Alexey Milovidov
497c0a9b8b Merge branch 'master' into quantile-timing-ubsan-fix 2019-02-26 13:26:30 +03:00
Ivan Lezhankin
0e2316e0ac Move experimental join transformations to syntax analyzer 2019-02-26 13:18:12 +03:00
Ivan Lezhankin
c8eefb3927 Always modify subqueries if modifying inplace
to support push-down while analyzing.
2019-02-26 13:18:12 +03:00
Ivan Lezhankin
fa273bb73b Improve push-down predicate tests. 2019-02-26 13:17:25 +03:00
Ivan Lezhankin
0a443399a0 Implement the debug query "ANALYZE"
that prints out the query after syntax analysis.
Should be helpful for tests.
2019-02-26 13:17:25 +03:00
Mikhail f. Shiryaev
88d63a0b3a Use pair of patterns to make combined RollupRules 2019-02-26 10:49:39 +01:00
Alexey Milovidov
34d480a7f4 Simplified test 2019-02-25 23:29:56 +03:00
Alexey Milovidov
c85dbe7610 Simplified test 2019-02-25 23:24:54 +03:00
Alexey Milovidov
c11a8d06ba Simplified test 2019-02-25 23:21:05 +03:00
Alexey Milovidov
a73f0ddcbb Added a test that reproduce the bug in gcc 7 2019-02-25 23:17:14 +03:00
Nikita Vasilev
e5a4ecfc84 fixed style 2019-02-25 21:46:54 +03:00
Nikita Vasilev
58446d5145 fix 2019-02-25 21:38:57 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Alexey Milovidov
126f4951db Merge branch 'master' of github.com:yandex/ClickHouse into fix-bad-parsing-error-message 2019-02-25 21:28:17 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
alexey-milovidov
bffe514efa
Merge pull request #4466 from danlark1/master
Function trigramDistance() added for string similarity search
2019-02-25 21:20:29 +03:00
Alexey Milovidov
fc08604cd1 Merge branch 'master' of github.com:yandex/ClickHouse into fix-bad-parsing-error-message 2019-02-25 21:10:12 +03:00
alexey-milovidov
b1812b3cbc
Merge pull request #4505 from yandex/fix-thread-pool-inactive-thread-exit
Fixed ThreadPool when there are too many inactive threads #4485
2019-02-25 21:10:05 +03:00
Nikita Vasilev
289a6cb3d3 support like 2019-02-25 21:04:25 +03:00
Alexey Milovidov
f02a834615 Fixed fuzz test in UBSan 2019-02-25 21:03:52 +03:00
Nikita Vasilev
69e6dea848 removed logs 2019-02-25 20:16:20 +03:00
Nikita Vasilev
72f5bdc485 tokenbf fix 2019-02-25 20:12:09 +03:00
Nikita Vasilev
4c3ed613e3 fix 2019-02-25 19:34:49 +03:00
Alexey Milovidov
02f25c22c6 Merge branch 'master' of github.com:yandex/ClickHouse into fix-bad-parsing-error-message 2019-02-25 19:16:53 +03:00
alexey-milovidov
864a81f1d5
Merge pull request #4502 from yandex/speedup-ddl-cleanup
Speedup ddl cleanup
2019-02-25 19:00:16 +03:00
Alexey Milovidov
467f9ce211 Fixed ThreadPool when there are too many inactive threads #4485 2019-02-25 18:45:07 +03:00
alexey-milovidov
a29ecdf11d
Merge pull request #4495 from orivej/xxhash
Support xxHash with external lz4
2019-02-25 18:03:31 +03:00
Nikita Vasilev
c9e4657aae tokenbf 2019-02-25 17:23:19 +03:00
Alexey Zatelepin
50dbfc8d50 clean distributed DDL queue in a separate thread [#CLICKHOUSE-3977] 2019-02-25 15:42:23 +03:00
alesapin
3b30b2f856
Merge pull request #4477 from yandex/external_dict_integration_test
External dict integration test
2019-02-25 15:27:22 +03:00
alesapin
9d91dbb7c5 Finally add mongo source 2019-02-25 13:45:22 +03:00
Nikita Vasilev
09e64be605 fix 2019-02-25 13:12:05 +03:00
Nikita Vasilev
c19a767433 fixed in 2019-02-25 11:43:19 +03:00
Георгий Кондратьев
b94de32423 Support xxHash with external lz4
xxhash.h does not exist in external lz4 because it is an implementation detail
and its symbols are namespaced with XXH_NAMESPACE macro.  When lz4 is external,
xxHash has to be external too, and the dependents have to link to it.

This find_xxhash.cmake is based on find_lz4.cmake.
2019-02-25 07:14:37 +00:00
Alexey Milovidov
15a7954b70 Removed double whitespace 2019-02-25 02:05:23 +03:00
Alexey Milovidov
f44316b39d Merge branch 'master' into fix-bad-parsing-error-message 2019-02-25 01:48:01 +03:00
Nikita Vasilev
d02e1c0cdb in 2019-02-25 00:17:52 +03:00
Nikita Vasilev
ed28340a4c fixed string 2019-02-24 22:26:42 +03:00
Nikita Vasilev
c656045f96 fix 2019-02-24 22:07:45 +03:00
Nikita Vasilev
c8e8f14bf9 4 args 2019-02-24 21:55:56 +03:00
alexey-milovidov
9d8b91b97a
Merge pull request #4483 from yandex/dont-create-part-log-if-not-defined
Do not create part_log if it is not defined in configuration file
2019-02-24 18:27:50 +03:00
alexey-milovidov
16225dff12
Merge pull request #4480 from 4ertus2/ast
Refactoring: simplify InDepthNodeVisitor
2019-02-24 02:32:42 +03:00
Danila Kutenin
6c50a55777 Faster hash function and one comment removed 2019-02-23 21:26:09 +03:00
Nikita Vasilev
c61d5c84c8 UInt64 in bloom filter 2019-02-23 18:56:48 +03:00
Nikita Vasilev
635b34c442 better bloom filter 2019-02-23 17:46:40 +03:00
Nikita Vasilev
bb5a5932b4 fix 2019-02-23 17:12:15 +03:00
Nikita Vasilev
ca4d1e137c fix like 2019-02-23 16:06:23 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Danila Kutenin
6736dcc96b A bit better performance, return old name to function 2019-02-22 22:43:47 +03:00
Alexey Zatelepin
46520e2887 protect zk variable with a mutex [#CLICKHOUSE-3977] 2019-02-22 22:41:33 +03:00
Alex Zatelepin
34346e37eb
Merge pull request #4472 from yandex/speedup-ddl-cleanup
Fix hangup on server shutdown if distributed DDLs were used.
2019-02-22 21:42:05 +03:00
Alexey Milovidov
0d9c438864 Added a test 2019-02-22 20:16:11 +03:00
chertus
14faa95c83 fix table functions & RequiredSourceColumnsVisitor 2019-02-22 20:08:10 +03:00
Alexey Milovidov
85c0ba1e70 Do not create part_log if it is not defined in configuration file 2019-02-22 19:10:14 +03:00
Alexey Milovidov
6c74807f9b Miscellaneous 2019-02-22 18:59:29 +03:00
chertus
8bff0d74c0 minor changes 2019-02-22 18:45:47 +03:00
chertus
9e2aa47478 simplify InDepthNodeVisitor 2019-02-22 16:33:56 +03:00
Nikita Vasilev
7f93057650 fix 2019-02-22 13:51:19 +03:00
Artem Zuikov
89f4cab025
Merge pull request #4474 from 4ertus2/joins
Multiple JOINS: correct result names for columns
2019-02-22 13:14:44 +03:00
Nikita Vasilev
16a1fd6692 fix 2019-02-22 11:15:52 +03:00
Nikita Vasilev
4ca9c02431 utf-8 2019-02-22 10:59:07 +03:00
Danila Kutenin
9ea1e948b3 better style in distance() 2019-02-22 06:50:06 +03:00
Danila Kutenin
3149eac681 some style 2019-02-22 06:07:35 +03:00
Danila Kutenin
ada849263b Optimize distance function, some allocation, hashmap tricks 2019-02-22 06:02:10 +03:00
Vitaly Baranov
dee7da9eb4
Merge branch 'master' into improve-performance-of-input-from-protobuf 2019-02-22 01:43:55 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
Nikita Vasilev
34e2e2623e like 2019-02-21 23:32:36 +03:00
proller
00e50f1502
Build fixes (#4471) 2019-02-21 23:11:21 +03:00
chertus
a14d955e9e mJOIN: correct names for right table 2019-02-21 22:43:14 +03:00
chertus
642ad05473 minor refactoring 2019-02-21 22:38:12 +03:00
Alexey Zatelepin
73f852ae82 manually reset DDLWorker in shared context to prevent reference cycles 2019-02-21 19:41:27 +03:00
Vitaly Baranov
4793ccb3fc Improve performance of ProtobufReader. 2019-02-21 18:49:42 +03:00
chertus
10b473bb24 mJOIN: correct names for left table columns 2019-02-21 15:45:31 +03:00
Danila Kutenin
3f636b3c34 Remove redundant include 2019-02-21 08:16:55 +03:00
Danila Kutenin
953d8c29a5 Remove redundant comment 2019-02-21 08:14:26 +03:00
Danila Kutenin
16b2e45586 Function trigramDistance added for string similarity search 2019-02-21 08:08:37 +03:00
Vitaly Baranov
31039056f5
Merge pull request #4174 from vitlibar/add-protobuf-input-format
Add protobuf input format.
2019-02-21 00:59:13 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
chertus
f028691eaa Merge branch 'master' into joins 2019-02-20 18:48:47 +03:00
chertus
1f2a5f9a91 disable asterisks in mJOIN, add some tests 2019-02-20 18:28:53 +03:00
chertus
d45d980716 support column names without aliases (make special ones) 2019-02-20 16:22:01 +03:00