Commit Graph

590 Commits

Author SHA1 Message Date
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Vitaly Baranov
2dfe73eefc
Merge pull request #5156 from vitlibar/settings-constraints-remove-thread-local
Get rid of thread_local in SettingsConstraints.cpp
2019-04-30 20:40:52 +03:00
Danila Kutenin
7a2e40da28 pragma once in header file 2019-04-30 19:48:33 +03:00
Danila Kutenin
3f1523a80a
Merge pull request #5070 from danlark1/master
Upgrade our LZ4 decompression with the new reference implementation optimizations
2019-04-30 19:29:24 +03:00
Vitaly Baranov
19259ab5e3 Get rid of thread_local in SettingsConstraints.cpp 2019-04-30 17:09:10 +03:00
Vitaly Baranov
28d9a80072 Rename macro APPLY_FOR_SETTINGS => LIST_OF_SETTINGS. 2019-04-29 03:22:59 +03:00
Vitaly Baranov
5beaf33a9f Get rid of code duplication, use templates. 2019-04-29 03:22:59 +03:00
Anastasiya Rodigina
747d2e0d3a Change pipeline + add optimize stuff into Settings.h 2019-04-27 12:39:03 +03:00
Vitaly Baranov
1b8c01e940 Transform comments for MergeTreeSettings into descriptions. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
738a49f534 Use iterators instead of macros APPLY_FOR_SETTINGS and others. 2019-04-27 01:09:16 +03:00
Vitaly Baranov
77e7838c30 Implemented iterators in the SettingsCollection template class 2019-04-26 19:11:05 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Danila Kutenin
f86cf7bd11 Correct cpu dispatch, nounroll for clang 2019-04-26 00:53:22 +03:00
Danila Kutenin
5c68881b72 Really faster LZ4 now, cpu dispatch in ClickHouse 2019-04-25 21:34:32 +03:00
alexey-milovidov
1de889c201
Merge pull request #5081 from Akazz/master
Support for header specified order of columns in TSVWithNames/CSVWithNames formats
2019-04-24 18:59:09 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Alexander Kazakov
d90bab5e33 In [T|C]SVWithNames formats start using column information from header 2019-04-22 16:31:17 +03:00
Alexey Milovidov
ee1a843609 COWPtr: improvements (C++ Russia 2019, suggested by Alexey Malov) 2019-04-19 23:22:06 +03:00
alesapin
214bf77b17
Merge pull request #5012 from nvartolomei/nv/lb-first-or-random
Add FIRST_OR_RANDOM Load Balancing policy
2019-04-18 18:54:04 +03:00
alexey-milovidov
ab27970fd7
Merge pull request #5028 from mhsekhavat/patch-1
Fix settings.max_partitions_per_insert_block type
2019-04-18 16:39:17 +03:00
proller
ad42179bec Remove rvo_test 2019-04-18 15:25:30 +03:00
Ivan
118bea2be6
Enable predicate push-down optimization by default. (#4846)
* Enable predicate push-down optimization by default.
* Forbid push-downs for some JOIN cases.
* Fix existing tests
* Forbid optimization if a select query has ARRAY JOIN on any side.
2019-04-18 13:39:25 +03:00
Vitaly Baranov
58a9105038 Fix ubsan error "outside the range of representable values" in convertFieldToType.cpp 2019-04-17 19:10:40 +03:00
Mohammad Hossein Sekhavat
322079e2af
Fix settings.max_partitions_per_insert_block type
The `max_partitions_per_insert_block` field is of `size_t` type, rather than `Boolean`
2019-04-17 10:16:02 +00:00
Nicolae Vartolomei
c2ec23c953
Add FIRST_OR_RANDOM Load Balancing policy
For cross-replication topology setups load_balancing=in_order works best
as nodes handle equal amount of load and usually they hit only 1/n of
data (n = number of replicas), which makes page cache usage more
efficient.

The problem is when one node of the shard goes down. If one replica goes
down, the next one in config will handle twice the usual load while
remaining ones will handle usual traffic.

Closes #4820.
2019-04-15 23:31:40 +01:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
07334ebad4 Fixed race condition in DNSCacheUpdater 2019-04-06 04:09:15 +03:00
alesapin
69b623c47c Return logic for cache 2019-04-01 14:09:30 +03:00
alesapin
37427077b8 Remove average granularity logic from code 2019-04-01 13:34:22 +03:00
Vitaly Baranov
37b904b8f5
Merge pull request #4808 from vitlibar/kafka-with-protobuf-format
Kafka with protobuf format
2019-03-30 19:00:57 +03:00
Vitaly Baranov
a78e067c70 Allow empty row_delimiter when using Kafka. 2019-03-29 17:38:52 +03:00
Alexey Milovidov
8cb1619607 Implement "max_partitions_per_insert_block" setting #4700 2019-03-29 12:34:07 +03:00
Alexey Milovidov
3c29b5f611 Fixed bad code 2019-03-28 21:17:44 +03:00
Alexey Milovidov
42dd521e45 Added a setting to disallow Hyperscan 2019-03-27 00:56:46 +03:00
chertus
0cc90cf2db rename insert_sample_with_metadata setting 2019-03-22 19:15:44 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
hcz
8f099af799
Fix readBinary linkage error in Field.cpp 2019-02-28 14:16:45 +08:00
proller
aad2856eba CLICKHOUSE-4179 : arrayEnumerateDenseRanked arrayEnumerateUniqRanked (#4475)
* Build fixes (clang 7.0.0+)

* better

* wip

* wip

* fix

* fix

* wip

* fix

* clean

* clean

* CLICKHOUSE-4179 WIP

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

*    wip

* wip

* wip

* wip

* wip

* cf

*    wip

* wip

* wip

* wip

* cf

* wip

* wip# Please enter the commit message for your changes. Lines starting

* wip# Please enter the commit message for your changes. Lines starting

* cf

* wip# Please enter the commit message for your changes. Lines starting

* wip

* cf

* wip

* wip

* clean

* clean

* clean

* clean

* wip

* wip

* wip

* cf

* wip

* wip

* wip

* cf

* clean

* wip

* clean

* cf

* clean

* clean

* test

* clean

* wip

* cf

* wip

* clean

* clean

* wip

* wip

* clean

* cf

* clean

* Requested changes

* cf

* no convertToFullColumnIfConst

* clean

* clean

* clean

* fix

* Remove comment
2019-02-28 01:18:58 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Alexey Milovidov
ae28c46a46 Added workaround for compiler bug 2019-02-26 13:37:47 +03:00
proller
263e69e861
Build fixes (FreeBSD port) (#4397) 2019-02-15 14:46:07 +03:00
Alexey Milovidov
62eb65774a Added suppression for libunwind 2019-02-13 16:42:01 +03:00
alesapin
af4c4dc1e5 Fix old clients insert query processing with embedded data 2019-02-13 15:54:22 +03:00