Commit Graph

12455 Commits

Author SHA1 Message Date
Alexey Milovidov
842a9708e9 ExternalDictionaries: don't lock when checking if a dictionary is modified 2019-03-05 19:06:40 +03:00
chertus
049d49333d undo last change 2019-03-05 18:21:52 +03:00
chertus
22f699c8a0 fix CrossToInnerJoin (empty where crash & where for one table wrong result) 2019-03-05 18:16:59 +03:00
chertus
72fe0115d1 move join convertions to InterpreterSelectQuery 2019-03-05 16:53:39 +03:00
proller
718fd5b4ca Add exception code METRIKA_OTHER_ERROR 2019-03-05 16:03:11 +03:00
chertus
ea4d3ec661 some multiple join fixes 2019-03-05 15:34:48 +03:00
Nikolai Kochetov
4b18b7dcdc Support Nullable columns for Set index. #4486 2019-03-05 15:17:54 +03:00
Nikolai Kochetov
52c9d4e1ad (De)Serialize set index with multiple bulks. #4486 2019-03-05 15:17:37 +03:00
chertus
a8106360bd fix ASTIdentifier print (compound could be short) 2019-03-05 13:57:05 +03:00
proller
89014b5480
Build fixes (#4591) 2019-03-05 13:15:47 +03:00
alexey-milovidov
b311bfb11d
Merge pull request #4583 from yandex/fix-invalidate-query-for-clickhouse-dictionary-source
Fix invalidate query for clickhouse dictionary source
2019-03-05 01:27:22 +03:00
Vitaly Baranov
6edec1c63f Remove unnecessary 'this->'. 2019-03-04 22:46:05 +03:00
Vitaly Baranov
405a747ddc Fix compilation after changing SmallTable. 2019-03-04 22:45:51 +03:00
Vitaly Baranov
61e21d50e1
Merge pull request #4207 from andyyzh/bitmap_feature
Added bitmap function feature with roaring bitmap
2019-03-04 22:42:47 +03:00
chertus
339047fc40 fix multiple joins asterisks qualification 2019-03-04 22:40:58 +03:00
proller
154ea47156 Build fixes (#4582)
* Fix link in split mode

* clean

* Fix link validate-odbc-connection-string

* Fix includes
2019-03-04 22:37:50 +03:00
alexey-milovidov
aa54235d23
Merge pull request #4564 from yandex/better-string-comparison
Better string comparison
2019-03-04 22:36:41 +03:00
alexey-milovidov
d2d4f4a237
Merge pull request #4579 from yandex/disable_compile_expressions
Disable compile expressions by default
2019-03-04 22:31:08 +03:00
Alexey Milovidov
2e7db37cde Fixed issue with update time of dictionaries after checking that the dictionary is not modified #4581 2019-03-04 22:13:05 +03:00
Alexey Milovidov
bbaece6900 Fixed error 2019-03-04 22:04:35 +03:00
Alexey Milovidov
af5041532a Logging of internal queries 2019-03-04 21:28:42 +03:00
Alexey Milovidov
5bac476eb1 Make the value of invalidate_query human readable 2019-03-04 21:21:07 +03:00
Alexey Milovidov
e418e4da33 Added logging for invalidate query 2019-03-04 21:20:35 +03:00
Alexey Milovidov
d019ac7ec5 Avoid std::terminate when invalidate_query returned wrong resultset #4580 2019-03-04 21:19:48 +03:00
alesapin
05f187c122 Disable compile expressions by default 2019-03-04 19:36:52 +03:00
Alexey Milovidov
c3a2e73f32 Fixed build 2019-03-04 18:53:51 +03:00
Alexey Milovidov
3033d329eb Fixed error #4564 2019-03-04 18:50:23 +03:00
Alexey Milovidov
b29c24d3d9 Fixed error #4564 2019-03-04 18:13:33 +03:00
alexey-milovidov
b172ad4274
Merge pull request #4430 from zhang2014/feature/limit_execution
Add max_execution_speed & max_execution_bytes_speed & min_execution_bytes_speed settings
2019-03-04 17:09:12 +03:00
zhang2014
fb44b6692a rename setting name 2019-03-04 10:09:44 +08:00
Alexey Milovidov
c3fabfb93f Improvement #4564 2019-03-04 03:03:20 +03:00
Alexey Milovidov
2612bd892d Additions #4564 2019-03-04 02:16:38 +03:00
Alexey Milovidov
f018578595 Better code #4564 2019-03-04 02:12:50 +03:00
Alexey Milovidov
82cb9f51b0 Fixed error 2019-03-04 01:46:46 +03:00
Alexey Milovidov
ee9cfae7f9 Fixed build with gcc-8 2019-03-04 00:07:52 +03:00
Alexey Milovidov
084586a958 Fixed build with gcc-8 2019-03-04 00:07:38 +03:00
Alexey Milovidov
efe3d53894 Fixed build with gcc-8 2019-03-04 00:05:55 +03:00
Alexey Milovidov
315b6f3878 Better string comparison (development) 2019-03-03 23:08:39 +03:00
alexey-milovidov
3924207040
Merge pull request #4405 from yandex/move-to-prewhere-improvement
Move to prewhere improvement
2019-03-03 19:06:43 +03:00
Alexey Milovidov
865d54d9e3 Addition to prev. revision 2019-03-03 16:53:06 +03:00
Alexey Milovidov
d120fc788b NaN comparisons are implementation specific - remove them from tests 2019-03-03 04:18:35 +03:00
Alexey Milovidov
bcf8cd6297 NaN comparisons are implementation specific - remove them from tests 2019-03-03 04:17:33 +03:00
Alexey Milovidov
0dc576e44f Avoid performance degradation in few degenerate cases: added fast path for tautological compares #4405 2019-03-03 02:51:48 +03:00
alexey-milovidov
62d659b801
Merge pull request #4526 from yandex/fix-aio-threshold
Fixed error with underestimation of data size to read when choosing O_DIRECT mode
2019-03-02 15:31:19 +03:00
zhang2014
eae6406f34 Better method name 2019-03-02 15:08:02 +08:00
zhang2014
be158c145b fix divide by zero crash 2019-03-02 15:08:02 +08:00
zhang2014
b696ef34d2 Add max_execution_speed & min_execution_bytes_speed & max_execution_bytes_speed 2019-03-02 15:08:02 +08:00
Alexey Milovidov
b8ff976ee9 Merge branch 'master' into move-to-prewhere-improvement 2019-03-02 04:34:49 +03:00
Alexey Milovidov
e773b6d81d Added a test to build 2019-03-02 04:32:37 +03:00
alexey-milovidov
ee903886e6
Merge pull request #4387 from abyss7/CLICKHOUSE-4268
Improve push-down logic for joined statements
2019-03-02 04:19:50 +03:00
Alexey Milovidov
dbab34e21f Fixed error #4526 2019-03-02 04:05:36 +03:00
Alexey Milovidov
526e6488e0 Merge branch 'master' into fix-aio-threshold 2019-03-02 02:39:25 +03:00
Alexey Milovidov
8df4b8e270 Added comment #4409 2019-03-01 23:17:30 +03:00
Alexey Milovidov
3c2dd5257b Fixed typo #4409 2019-03-01 23:16:56 +03:00
Alexey Milovidov
bc25bedbd4 Implemented function "flatten" #4409 2019-03-01 23:07:58 +03:00
Alexey Milovidov
9d0adf40d2 Merge branch 'array-flatten-function' of https://github.com/kzon/ClickHouse into kzon-array-flatten-function 2019-03-01 19:42:06 +03:00
Alexey Milovidov
8f4b651679 Rewrite code and added a comment #4551 2019-03-01 19:38:52 +03:00
alexey-milovidov
9a62eb8d26
Merge pull request #4506 from yandex/quantile-timing-ubsan-fix
Fixed fuzz test in UBSan
2019-03-01 19:18:33 +03:00
alexey-milovidov
f74252cff9
Merge pull request #4551 from temoon/temoon-iss-4524
Set update_time on full executable dictionary update
2019-03-01 19:09:16 +03:00
alexey-milovidov
695a2dc35f
Merge pull request #4552 from 4ertus2/bugs
Fix crash on JOIN with array or tuple
2019-03-01 18:49:22 +03:00
chertus
83503df56a fix crach on JOIN with array or tuple 2019-03-01 18:32:32 +03:00
Alexey Milovidov
51ca51aa9e Merge branch 'master' into quantile-timing-ubsan-fix 2019-03-01 17:53:04 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Alexey Zatelepin
5b850bad47 fix build 2019-03-01 14:42:41 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
alexey-milovidov
137f800423
Update StorageSystemColumns.cpp 2019-03-01 04:08:12 +03:00
alexey-milovidov
e64cf60236
Merge pull request #4530 from hczhcz/patch-1
Fix readBinary linkage error in Field.cpp
2019-03-01 01:49:54 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd fix build 2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
BayoNet
455ca955e5 DOCAPI-5203: Added the descriptions for direct I/O settings for MergeTree merge and SELECT queries. 2019-02-28 14:20:27 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
liangqian
6757b112d1 change Sream into Stream 2019-02-28 15:27:30 +08:00
Tema Novikov
f92210d0fb
Set update_time on full executable dictionary update
This fixes issue #4524.
2019-02-28 09:47:48 +03:00
hcz
8f099af799
Fix readBinary linkage error in Field.cpp 2019-02-28 14:16:45 +08:00
proller
aad2856eba CLICKHOUSE-4179 : arrayEnumerateDenseRanked arrayEnumerateUniqRanked (#4475)
* Build fixes (clang 7.0.0+)

* better

* wip

* wip

* fix

* fix

* wip

* fix

* clean

* clean

* CLICKHOUSE-4179 WIP

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

*    wip

* wip

* wip

* wip

* wip

* cf

*    wip

* wip

* wip

* wip

* cf

* wip

* wip# Please enter the commit message for your changes. Lines starting

* wip# Please enter the commit message for your changes. Lines starting

* cf

* wip# Please enter the commit message for your changes. Lines starting

* wip

* cf

* wip

* wip

* clean

* clean

* clean

* clean

* wip

* wip

* wip

* cf

* wip

* wip

* wip

* cf

* clean

* wip

* clean

* cf

* clean

* clean

* test

* clean

* wip

* cf

* wip

* clean

* clean

* wip

* wip

* clean

* cf

* clean

* Requested changes

* cf

* no convertToFullColumnIfConst

* clean

* clean

* clean

* fix

* Remove comment
2019-02-28 01:18:58 +03:00
alexey-milovidov
40d8abbc34
Merge pull request #4523 from yandex/fix_column_description_parse
Fix column description parse. Now creation of replicated MT table wit…
2019-02-28 01:18:31 +03:00
Alexey Milovidov
62b246c5a4 Avoid excessive "stat" syscall\ 2019-02-27 23:02:48 +03:00
Alexey Milovidov
c3623f7bb6 Fixed error with underestimation of data size to read when choosing O_DIRECT mode 2019-02-27 22:32:54 +03:00
Alexey Milovidov
3256b816be Merge branch 'master' of github.com:yandex/ClickHouse 2019-02-27 22:12:17 +03:00
Alexey Milovidov
141d9add39 Fixed error message 2019-02-27 22:12:08 +03:00
Alexey Zatelepin
df5ad1871a add comment [#CLICKHOUSE-3789] 2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
alesapin
1909c87885 Fix column description parse. Now creation of replicated MT table with codecs and comments is possible without default 2019-02-27 19:41:51 +03:00
Vitaly Baranov
6fbcc12674
Merge pull request #4493 from vitlibar/support-for-nested-messages-in-protobuf-output
Added support for nested messages in protobuf output format
2019-02-27 18:16:45 +03:00
Ivan Lezhankin
d66626a35a Revert "Move experimental join transformations to syntax analyzer"
This reverts commit 0e2316e0ac.
2019-02-27 16:35:43 +03:00
proller
211ec436c5
Build fixes (#4516) 2019-02-27 15:52:24 +03:00
Ivan Lezhankin
2a604d075a Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-4268 2019-02-27 15:08:36 +03:00
Vitaly Baranov
147a7a1458 Remove unused function ProtobufSchemas::getMessageTypeForColumns(). 2019-02-27 14:37:17 +03:00
Vitaly Baranov
e712a78cce Minor improvements of ProtobufReader. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
85ab57f179 Implement support of nested messages in Protobuf output format. 2019-02-27 14:37:17 +03:00
Vitaly Baranov
4f46052f2e Optimize the class ProtobufWriter and prepare for implementing support of nested messages. 2019-02-27 14:37:14 +03:00
Vitaly Baranov
1cce1feac1 Move IConverter to header for allow inlining ProtobufWriter functions. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
2f0276503a Move ProtobufSimpleWriter to the internals of ProtobufWriter. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
65d997db94 Simplify excluding ProtobufWriter from compilation when USE_PROTOBUF=0. 2019-02-27 00:54:25 +03:00
Vitaly Baranov
ba2efbae01 Make the interface IRowOutputStream more generic and use it for writing protobufs. 2019-02-27 00:53:13 +03:00
Nikita Vasilev
0b20d634cd fix 2019-02-26 23:36:15 +03:00