Commit Graph

1542 Commits

Author SHA1 Message Date
Danila Kutenin
ea53a0a85d Clang build is too annoying 2019-04-04 09:23:12 +03:00
proller
5b1bde2e80 CLICKHOUSE-4387 Add (official build) to version of yandex builds 2019-04-03 17:06:59 +03:00
Danila Kutenin
029dd107e4 Typos for many factories 2019-04-03 14:13:22 +03:00
chertus
d5ffbd9b6d fix multithreaded ASOF JOIN crash 2019-04-02 21:50:35 +03:00
chertus
04efcf2bdc asof refactoring (searching for the crash reason) 2019-04-02 19:22:14 +03:00
Danila Kutenin
f80fb09b81 Hyperscan better usage of scratch space and error handling 2019-03-31 23:19:22 +03:00
chertus
11997ed772 fix build 2019-03-31 13:56:54 +03:00
Artem Zuikov
f87e3ae4c8
Merge pull request #4863 from Gladdy/martijn-asof-nomap
Perform ASOF join with sorting PODArray once and support multiple column types
2019-03-31 13:40:15 +03:00
alexey-milovidov
cf492a4401
Merge pull request #4862 from danlark1/master
Optimize Volnitsky by inlining compare function
2019-03-31 02:24:33 +03:00
Martijn Bakker
6695e304af fix style 2019-03-30 21:55:40 +00:00
Martijn Bakker
4709b744bb address the code review issues 2019-03-30 21:30:21 +00:00
alexey-milovidov
14b8e64992
Disable usage of "mremap" when compiled with Thread Sanitizer. (#4859)
* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer
2019-03-30 13:47:25 +03:00
Danila Kutenin
18d3813ff9 Optimize Volnitsky by inlining compare function 2019-03-30 12:39:45 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join
Request for feedback on implementation of ASOF join
2019-03-29 13:19:31 +03:00
Martijn Bakker
46f4557944 Merge branch 'master' into martijn-asof-join 2019-03-28 20:20:17 +00:00
Alexey Milovidov
4aaf9eccce Fixed error 2019-03-28 22:12:37 +03:00
Martijn Bakker
b0fd915724 remove the ASOFSplit struct 2019-03-28 18:35:50 +00:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
proller
cbffebc22c Print with version 2019-03-28 16:08:38 +03:00
proller
ccd5db786c Merge remote-tracking branch 'upstream/master' into fix26 2019-03-28 13:39:03 +03:00
proller
7d1be03a16 CLICKHOUSE-4386 Version in exceptions 2019-03-27 18:46:46 +03:00
Alexey Milovidov
42dd521e45 Added a setting to disallow Hyperscan 2019-03-27 00:56:46 +03:00
Mikhail Fandyushin
c53b303bc2 HTTP Accept-Encoding: br; Added brotli errors codes 2019-03-27 00:32:29 +03:00
Danila Kutenin
62dde447ab Better type system in Volnitsky 2019-03-26 16:20:17 +03:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
Alexey Milovidov
af5193736a Attempt to make compositions with COWPtr more convenient 2019-03-24 05:22:39 +03:00
Alexey Milovidov
c76a4e9dd2 Attempt to make compositions with COWPtr more convenient 2019-03-24 05:21:01 +03:00
Alexey Milovidov
2dca389f20 Attempt to make compositions with COWPtr more convenient 2019-03-24 04:42:58 +03:00
Danila Kutenin
725139f0f5 Renamings, fixes to search algorithms, more tests 2019-03-24 01:49:38 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
Alexey Milovidov
1d1bedca3b Removed WTF code 2019-03-20 23:27:55 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Ivan Lezhankin
b67e79430d Fix style 2019-03-15 20:22:19 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
Ivan Lezhankin
61c24e0844 Overload template method |as<>()| with reference type.
Move promotion logic to a separate class
2019-03-15 16:12:11 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
Ivan Lezhankin
67eefa7b12 Revert wrong replacements of dynamic_cast.
dynamic_cast to intermediate type is not equivalent to typeid_cast
2019-03-12 15:41:57 +03:00
proller
b5efce5b8a Freebsd build fix (#4650)
* Update contrib/cppkafka

* Fix

* Freebsd build fix
2019-03-11 16:10:47 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Nikita Lapkov
1ea971ddd2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-10 01:56:41 +00:00
Nikita Lapkov
5b50026860 - remove memory allocations in signal handler
- revert ThreadStatus::getQueryId()
- refactor
2019-03-10 01:49:36 +00:00
Alexey Milovidov
56690070fa Merge branch 'master' of github.com:yandex/ClickHouse into debug-pod-array 2019-03-08 15:59:39 +03:00
Alexey Milovidov
4905cd2b0a Added missing include 2019-03-08 15:59:06 +03:00
Alexey Milovidov
73c571412c Fixed awful error after #3920 2019-03-08 06:32:43 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
alexey-milovidov
286d03de97
Merge pull request #4619 from yandex/fix-inconsistent-memory-tracker
Fixed inconsistency of MemoryTracker usage in Allocator (tnx. proller)
2019-03-07 22:08:39 +03:00
Alexey Milovidov
64897faf84 Fixed inconsistency of MemoryTracker usage in Allocator (tnx. proller) 2019-03-07 19:48:24 +03:00
proller
2c4dced9d2 Add functions used in arcadia 2019-03-07 19:27:03 +03:00
Alexey Milovidov
f49562bff3 Flush query metrics before joining thread #4612 2019-03-06 22:57:54 +03:00
Alexey Milovidov
47df38f7a0 Adapted test for TSan #4572 2019-03-06 21:09:25 +03:00
Alexey Milovidov
41469cc874 More simple #4572 2019-03-06 20:54:20 +03:00
Alexey Milovidov
89917ced9e Fixed undefined behaviour in ThreadPool #4572 2019-03-06 19:46:05 +03:00
Nikita Lapkov
12fe175385 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-06 10:30:47 +00:00
Alexey Milovidov
899b2548c7 Added comment #4572 2019-03-05 23:49:21 +03:00
proller
718fd5b4ca Add exception code METRIKA_OTHER_ERROR 2019-03-05 16:03:11 +03:00
Alexey Milovidov
3033d329eb Fixed error #4564 2019-03-04 18:50:23 +03:00
Nikita Lapkov
70b5aaafa6 remove circular dependency 2019-03-04 13:45:37 +00:00
Nikita Lapkov
6367e15e4e add cpu timer. add timer type to log. refactor 2019-03-04 13:03:32 +00:00
Alexey Milovidov
2612bd892d Additions #4564 2019-03-04 02:16:38 +03:00
Alexey Milovidov
f018578595 Better code #4564 2019-03-04 02:12:50 +03:00
Alexey Milovidov
82cb9f51b0 Fixed error 2019-03-04 01:46:46 +03:00
Alexey Milovidov
ee9cfae7f9 Fixed build with gcc-8 2019-03-04 00:07:52 +03:00
Alexey Milovidov
084586a958 Fixed build with gcc-8 2019-03-04 00:07:38 +03:00
Alexey Milovidov
efe3d53894 Fixed build with gcc-8 2019-03-04 00:05:55 +03:00
Alexey Milovidov
315b6f3878 Better string comparison (development) 2019-03-03 23:08:39 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Nikita Lapkov
ce4e48d6f4 Merge branch 'master' into query-poor-mans-profiler 2019-03-01 14:22:38 +00:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd fix build 2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
Alexey Zatelepin
df5ad1871a add comment [#CLICKHOUSE-3789] 2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
Alexey Milovidov
467f9ce211 Fixed ThreadPool when there are too many inactive threads #4485 2019-02-25 18:45:07 +03:00
Vitaly Baranov
9cd4c7495f Implement an utility class for reading protobuf messages. 2019-02-20 07:28:02 +03:00
Vitaly Baranov
74cc6f285c Implement an utility class to match columns and protobuf fields. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Danila Kutenin
35bfe7950e Pointer codestyle fix in Levenshtein distance 2019-02-18 04:21:18 +03:00
Danila Kutenin
ed57671948 Implement Levenstein distance with linear memory 2019-02-18 04:18:39 +03:00
Alexey Milovidov
21247ebfac Better replica repair logic: clearing obsolete queue 2019-02-14 17:04:28 +03:00
Alexey Milovidov
2efb4bdca2 Slightly raised up the limit on max string and array size received from ZooKeeper 2019-02-14 16:47:00 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field
Aggregate function state in field
2019-02-12 22:13:38 +03:00
alexey-milovidov
d8aa74bc64
Merge pull request #4367 from yandex/unified-sets-fix-lc-cache
Fix LowCardinality cache for ColumnsHashing
2019-02-12 21:24:52 +03:00
Nikolai Kochetov
a73f29ca2e Fix LowCardinality cache. 2019-02-12 17:38:29 +03:00
Nikolai Kochetov
c35439a5f0 Updated FieldVisitor. 2019-02-11 18:46:19 +03:00
Alexey Milovidov
7b312c6df2 Forbid to specify a database when creating a temporary table [#CLICKHOUSE-4294] 2019-02-11 17:46:09 +03:00
Danila Kutenin
985bb119c1 Fix comment 2019-02-11 15:44:18 +03:00
Danila Kutenin
6a1d1f5508 Better hints provider 2019-02-11 15:42:20 +03:00
Nikolai Kochetov
85318c0bfd Merge branch 'master' into aggregate-function-state-in-field 2019-02-11 15:41:11 +03:00
Nikolai Kochetov
9787b3a1ee Added Field type AggregateFunctionState. 2019-02-11 14:19:56 +03:00