Commit Graph

1529 Commits

Author SHA1 Message Date
Alexey Milovidov
f49562bff3 Flush query metrics before joining thread #4612 2019-03-06 22:57:54 +03:00
Alexey Milovidov
47df38f7a0 Adapted test for TSan #4572 2019-03-06 21:09:25 +03:00
Alexey Milovidov
41469cc874 More simple #4572 2019-03-06 20:54:20 +03:00
Alexey Milovidov
89917ced9e Fixed undefined behaviour in ThreadPool #4572 2019-03-06 19:46:05 +03:00
Alexey Milovidov
899b2548c7 Added comment #4572 2019-03-05 23:49:21 +03:00
proller
718fd5b4ca Add exception code METRIKA_OTHER_ERROR 2019-03-05 16:03:11 +03:00
Alexey Milovidov
3033d329eb Fixed error #4564 2019-03-04 18:50:23 +03:00
Alexey Milovidov
2612bd892d Additions #4564 2019-03-04 02:16:38 +03:00
Alexey Milovidov
f018578595 Better code #4564 2019-03-04 02:12:50 +03:00
Alexey Milovidov
82cb9f51b0 Fixed error 2019-03-04 01:46:46 +03:00
Alexey Milovidov
ee9cfae7f9 Fixed build with gcc-8 2019-03-04 00:07:52 +03:00
Alexey Milovidov
084586a958 Fixed build with gcc-8 2019-03-04 00:07:38 +03:00
Alexey Milovidov
efe3d53894 Fixed build with gcc-8 2019-03-04 00:05:55 +03:00
Alexey Milovidov
315b6f3878 Better string comparison (development) 2019-03-03 23:08:39 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd fix build 2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
Alexey Zatelepin
df5ad1871a add comment [#CLICKHOUSE-3789] 2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
Alexey Milovidov
467f9ce211 Fixed ThreadPool when there are too many inactive threads #4485 2019-02-25 18:45:07 +03:00
Vitaly Baranov
9cd4c7495f Implement an utility class for reading protobuf messages. 2019-02-20 07:28:02 +03:00
Vitaly Baranov
74cc6f285c Implement an utility class to match columns and protobuf fields. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Danila Kutenin
35bfe7950e Pointer codestyle fix in Levenshtein distance 2019-02-18 04:21:18 +03:00
Danila Kutenin
ed57671948 Implement Levenstein distance with linear memory 2019-02-18 04:18:39 +03:00
Alexey Milovidov
21247ebfac Better replica repair logic: clearing obsolete queue 2019-02-14 17:04:28 +03:00
Alexey Milovidov
2efb4bdca2 Slightly raised up the limit on max string and array size received from ZooKeeper 2019-02-14 16:47:00 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field
Aggregate function state in field
2019-02-12 22:13:38 +03:00
alexey-milovidov
d8aa74bc64
Merge pull request #4367 from yandex/unified-sets-fix-lc-cache
Fix LowCardinality cache for ColumnsHashing
2019-02-12 21:24:52 +03:00
Nikolai Kochetov
a73f29ca2e Fix LowCardinality cache. 2019-02-12 17:38:29 +03:00
Nikolai Kochetov
c35439a5f0 Updated FieldVisitor. 2019-02-11 18:46:19 +03:00
Alexey Milovidov
7b312c6df2 Forbid to specify a database when creating a temporary table [#CLICKHOUSE-4294] 2019-02-11 17:46:09 +03:00
Danila Kutenin
985bb119c1 Fix comment 2019-02-11 15:44:18 +03:00
Danila Kutenin
6a1d1f5508 Better hints provider 2019-02-11 15:42:20 +03:00
Nikolai Kochetov
85318c0bfd Merge branch 'master' into aggregate-function-state-in-field 2019-02-11 15:41:11 +03:00
Nikolai Kochetov
9787b3a1ee Added Field type AggregateFunctionState. 2019-02-11 14:19:56 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes
Removed duplicate includes
2019-02-10 22:31:37 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
alexey-milovidov
75c087bcf5
Merge branch 'master' into arbitrary-const-expressions-in-limit 2019-02-10 17:20:31 +03:00
proller
a95d2d153d Build ARM fix (#4306)
* Build ARM fix

* Fix warning: declaration shadows a local variable

* Add info about SPLIT_SHARED_LIBRARIES

* Fix cpuid on ARM

* release: better pbuilder autoinstall
2019-02-09 01:09:32 +03:00
Alexey Milovidov
94d43c4cb2 Fixed error with dangling pointer on stack to ThreadStatus 2019-02-08 16:23:10 +03:00
alexey-milovidov
7c830941a6
Merge pull request #4256 from zlobober/useful_what_in_exceptions
Make exception.what() less useless.
2019-02-07 12:15:43 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
Unified sets
2019-02-06 20:40:11 +03:00
alexey-milovidov
9a4c4964b2
Update ColumnsHashingImpl.h 2019-02-06 20:17:59 +03:00
alexey-milovidov
ba01f7fd77
Update ColumnsHashing.h 2019-02-06 19:58:27 +03:00
KochetovNicolai
063565265b
Update formatIPv6.cpp
Fix build.
2019-02-06 19:48:38 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
Maxim Akhmedov
6d5c0bdf91 Merge remote-tracking branch 'upstream/master' into useful_what_in_exceptions 2019-02-05 23:53:34 +03:00
Maxim Akhmedov
4dfce303fb Remove e.what() from exception message for DB::Exception. 2019-02-05 20:02:05 +03:00
Nikolai Kochetov
a249fc7788 Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate. 2019-02-05 14:14:09 +03:00
Nikolai Kochetov
daa051b1f8 Fix tests. 2019-02-05 13:55:34 +03:00
Nikolai Kochetov
264da7f9d3 Implemented sets using ColumnsHashing. 2019-02-05 13:55:15 +03:00
Nikolai Kochetov
8db4116464 Update HashMethodHashed. 2019-02-05 13:55:08 +03:00
Alexey Milovidov
5fcc02bab2 Fixed bad code for printing query_id in text logs 2019-02-04 18:39:08 +03:00
Maxim Akhmedov
d67a3a901e Make exception.what() less useless. 2019-02-04 17:36:09 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation.
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
Vitaliy Karnienko
d9da430982 add arbitrary const expressions in limit processing 2019-02-03 21:31:17 +03:00
Danila Kutenin
f6acd59929 fix brace 2019-02-02 18:15:53 +03:00
Danila Kutenin
9c7b62e95b fix function 2019-02-02 18:13:31 +03:00
Danila Kutenin
7d6e4083fa fix snake_case 2019-02-02 18:08:45 +03:00
Danila Kutenin
5e62a0825a produce hints for typo functions and types 2019-02-02 17:54:50 +03:00
Nikolai Kochetov
6a729e59ba Merged with master. 2019-02-01 11:36:57 +03:00
Nikolai Kochetov
d143a78419 Refactor ColumnsHashing 2019-02-01 11:23:38 +03:00
alesapin
95db9b4d76 Merge master 2019-01-29 23:17:52 +03:00
alesapin
4f97c291e6 Always run clickhouse-odbc-bridge; Integration tests now able to run odbc-bridge from separate binary; add symlink to clickhouse-odbc-bridge in dbms/programs folder; 2019-01-29 20:17:31 +03:00
Nikolai Kochetov
2c2932e185 Merged with master 2019-01-29 15:25:19 +03:00
proller
343b31af66 More link with Threads::Threads 2019-01-28 21:21:20 +03:00
Alexey Milovidov
9b2a5c3dec Merge branch 'master' into split-odbc-bridge 2019-01-28 18:15:18 +03:00
proller
2ab3138eb6 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 17:01:06 +03:00
proller
403d36a7f4 Fix 2019-01-28 16:24:55 +03:00
proller
a874945e0e Use cpuinfo if cpuid not available 2019-01-28 16:16:08 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
alexey-milovidov
4b8cf83de7
Merge pull request #4151 from ercolanelli-leo/fix/sumMap-overflow
Fix/sum map overflow
2019-01-27 21:11:51 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Nikolai Kochetov
f7b9059dad Merged with master 2019-01-24 18:06:11 +03:00
Nikolai Kochetov
5f1007a8df Refactor Join. 2019-01-24 17:56:04 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Nikolai Kochetov
e8aa41b6ac Merge branch 'master' into unified-sets 2019-01-21 13:40:47 +03:00
Nikolai Kochetov
6fce028b56 Refactor ColumnsHashing. 2019-01-21 13:39:53 +03:00
Nikolai Kochetov
d207498573 Added ColumnsHashing 2019-01-21 13:39:24 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
Danila Kutenin
12bcff48ee Miscellaneous and some optimizations 2019-01-16 20:41:08 +03:00
Alexey Zatelepin
be6a8d6118 fix clang build 2019-01-16 19:42:02 +03:00
Alexey Milovidov
7d03804d06 Miscellaneous #4053 2019-01-16 16:57:11 +03:00
Danila Kutenin
ce90ad32d1 some style 2019-01-15 19:26:14 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Danila Kutenin
a5669b6b7a MultiVolnitsky added with tests and some benchmark, many multiFunctions are added to support multistring search 2019-01-14 18:54:47 +03:00
Alexey Milovidov
35c35f1c77 Merge branch 'global-thread-pool' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-14 14:01:52 +03:00
Alexey Milovidov
aec5570b6e Attempt to implemnt global thread pool #4018 2019-01-14 13:59:58 +03:00
Alexey Milovidov
00a4b2cf8a Removing garbage, part 1 2019-01-13 21:51:57 +03:00
Alexey Milovidov
a6bf5a7e28 Addition to prev. revision 2019-01-13 20:49:21 +03:00
Alexey Milovidov
0afee1df23 Attempt to implemnt global thread pool #4018 2019-01-11 22:27:24 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
proller
7cefef6983
Fix linking in all modes (unbundled, split, ...) (#4037) 2019-01-11 19:52:46 +03:00
alesapin
6401628dc8 Fix clang-7 werrors 2019-01-10 14:25:59 +03:00
alexey-milovidov
6fabb5eb03
Merge pull request #4017 from yandex/netlink-sockets-pool
Don't use a pool for TaskStatsInfoGetters
2019-01-09 22:56:27 +03:00
alexey-milovidov
a739edc239
Merge pull request #4013 from yandex/pvs-studio-fixes-2
Fixed bugs found by PVS-Studio
2019-01-09 22:55:11 +03:00
proller
64c2c3650c
cmake: Dont cache version; macos: fix build; /release_lib.sh move to utils (#4016) 2019-01-09 21:32:43 +03:00
Alexey Zatelepin
006a764df9 don't use pool for TaskStatsInfoGetter [#CLICKHOUSE-4209]
Pool is not needed because creation of a TaskStatsInfoGetter takes
an order of 10us. Also pool is harmful because created sockets are
never closed.
2019-01-09 20:52:25 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
da449ff9d1 Little better #3920 2019-01-08 17:56:50 +03:00
Alexey Milovidov
0dfa553fca Added more warnings from clang's -Weverything, that are available in clang 8 2019-01-07 13:40:58 +03:00
Alexey Milovidov
06a8c3f02d Added some warnings from clang's -Weverything 2019-01-05 06:33:22 +03:00
Alexey Milovidov
445fc2bb43 Added some warnings from clang's -Weverything 2019-01-04 17:10:36 +03:00
Alexey Milovidov
cf1cacc366 Added some warnings from clang's -Weverything 2019-01-04 16:54:39 +03:00
Alexey Milovidov
4622f5dc7c Added some warnings from clang's -Weverything 2019-01-04 16:32:08 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
acb9696ddd Miscellaneous [#CLICKHOUSE-2] 2019-01-03 11:40:48 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
proller
0c78ef8573 Fix cyclic lib depend (make clickhouse_compression lib) 2018-12-28 20:27:53 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs
Custom compression codecs
2018-12-28 08:29:09 +03:00
Alexey Milovidov
ab85175e7f Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-4 2018-12-28 00:23:13 +03:00
alexey-milovidov
3455da0a97
Merge pull request #3947 from yandex/fix-config-reloader
Retry loading ZK substitutions after ZK errors
2018-12-28 00:22:48 +03:00
Alexey Milovidov
0d4e166db9 Fixed error: read one byte after buffer (this byte was unused) [#CLICKHOUSE-2] 2018-12-27 22:33:27 +03:00
Alexey Zatelepin
da00c6e918 retry loading ZK substitutions after ZK errors #2947 2018-12-27 21:12:38 +03:00
alesapin
3afa03d044 Merge branch 'master' into custom_compression_codecs 2018-12-27 11:23:00 +03:00
Alexey Milovidov
408f935754 Addition to prev. revision #3926 2018-12-27 03:03:18 +03:00
Alexey Milovidov
2e323192a2 Addition to prev. revision #3926 2018-12-27 03:02:11 +03:00
Alexey Milovidov
7509db544c Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-3 2018-12-26 22:38:11 +03:00
alexey-milovidov
cd00fc8b56
Merge pull request #3934 from yandex/fix-zk-node-cache
Fix ZooKeeperNodeCache becoming unusable after SessionExpired event
2018-12-26 22:15:32 +03:00
Alexey Zatelepin
601a6af0ec fix ZooKeeperNodeCache becoming unusable after SessionExpired event #2947 #3891
Previously after a SessionExpired event the context->zookeeper field was
reinitialized with the old expired ZooKeeper instance. This led to inability
to get new paths. Better not cache the ZooKeeper instance and get it at the
start of each request.
2018-12-26 20:27:25 +03:00
alesapin
8f82d5a687 Merge branch 'master' into custom_compression_codecs 2018-12-26 10:43:33 +03:00
Alexey Milovidov
5abb2d02b9 Fixed UB #3926 2018-12-26 08:34:25 +03:00
Alexey Milovidov
b7f085c525 Fixed UB #3926 2018-12-26 05:47:16 +03:00
Alexey Milovidov
897199c220 Fixed UB #3926 2018-12-26 04:29:48 +03:00
Alexey Milovidov
c858c144ef Fixed UB #3926 2018-12-26 02:39:40 +03:00
Alexey Milovidov
cfc1e207ab Fixed UB #3926 2018-12-26 02:27:52 +03:00
Alexey Milovidov
8f306e8b45 Small improvements #3920 2018-12-25 22:31:18 +03:00