Alexey Milovidov
f49562bff3
Flush query metrics before joining thread #4612
2019-03-06 22:57:54 +03:00
Alexey Milovidov
47df38f7a0
Adapted test for TSan #4572
2019-03-06 21:09:25 +03:00
Alexey Milovidov
41469cc874
More simple #4572
2019-03-06 20:54:20 +03:00
Alexey Milovidov
89917ced9e
Fixed undefined behaviour in ThreadPool #4572
2019-03-06 19:46:05 +03:00
Alexey Milovidov
899b2548c7
Added comment #4572
2019-03-05 23:49:21 +03:00
proller
718fd5b4ca
Add exception code METRIKA_OTHER_ERROR
2019-03-05 16:03:11 +03:00
Alexey Milovidov
3033d329eb
Fixed error #4564
2019-03-04 18:50:23 +03:00
Alexey Milovidov
2612bd892d
Additions #4564
2019-03-04 02:16:38 +03:00
Alexey Milovidov
f018578595
Better code #4564
2019-03-04 02:12:50 +03:00
Alexey Milovidov
82cb9f51b0
Fixed error
2019-03-04 01:46:46 +03:00
Alexey Milovidov
ee9cfae7f9
Fixed build with gcc-8
2019-03-04 00:07:52 +03:00
Alexey Milovidov
084586a958
Fixed build with gcc-8
2019-03-04 00:07:38 +03:00
Alexey Milovidov
efe3d53894
Fixed build with gcc-8
2019-03-04 00:05:55 +03:00
Alexey Milovidov
315b6f3878
Better string comparison (development)
2019-03-03 23:08:39 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
...
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7
A Proper lookup table that uses HashTable's API
...
This is the first step of allowing heterogeneous cells in hash tables.
performance test results are
```
1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>
ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124
ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998
ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130
ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191
ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279
ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441
ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564
ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378
ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157
ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041
```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
...
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
...
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd
fix build
2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42
Merge branch 'master' into fix-concurrent-alters
2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd
get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789]
2019-02-28 12:37:05 +03:00
Alexey Zatelepin
df5ad1871a
add comment [#CLICKHOUSE-3789]
2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e
rename LockHandler -> LockHolder [#CLICKHOUSE-3789]
2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea
allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
...
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE ( #4521 )
2019-02-27 19:52:08 +03:00
Alexey Milovidov
467f9ce211
Fixed ThreadPool when there are too many inactive threads #4485
2019-02-25 18:45:07 +03:00
Vitaly Baranov
9cd4c7495f
Implement an utility class for reading protobuf messages.
2019-02-20 07:28:02 +03:00
Vitaly Baranov
74cc6f285c
Implement an utility class to match columns and protobuf fields.
2019-02-20 05:32:29 +03:00
proller
e20c77e4c6
Add parquet support. Fixes, tests, ...
2019-02-19 23:51:44 +03:00
Danila Kutenin
35bfe7950e
Pointer codestyle fix in Levenshtein distance
2019-02-18 04:21:18 +03:00
Danila Kutenin
ed57671948
Implement Levenstein distance with linear memory
2019-02-18 04:18:39 +03:00
Alexey Milovidov
21247ebfac
Better replica repair logic: clearing obsolete queue
2019-02-14 17:04:28 +03:00
Alexey Milovidov
2efb4bdca2
Slightly raised up the limit on max string and array size received from ZooKeeper
2019-02-14 16:47:00 +03:00
proller
f5560660be
Fix brotli (unbundled, missing, ...)
2019-02-13 18:35:11 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field
...
Aggregate function state in field
2019-02-12 22:13:38 +03:00
alexey-milovidov
d8aa74bc64
Merge pull request #4367 from yandex/unified-sets-fix-lc-cache
...
Fix LowCardinality cache for ColumnsHashing
2019-02-12 21:24:52 +03:00
Nikolai Kochetov
a73f29ca2e
Fix LowCardinality cache.
2019-02-12 17:38:29 +03:00
Nikolai Kochetov
c35439a5f0
Updated FieldVisitor.
2019-02-11 18:46:19 +03:00
Alexey Milovidov
7b312c6df2
Forbid to specify a database when creating a temporary table [#CLICKHOUSE-4294]
2019-02-11 17:46:09 +03:00
Danila Kutenin
985bb119c1
Fix comment
2019-02-11 15:44:18 +03:00
Danila Kutenin
6a1d1f5508
Better hints provider
2019-02-11 15:42:20 +03:00
Nikolai Kochetov
85318c0bfd
Merge branch 'master' into aggregate-function-state-in-field
2019-02-11 15:41:11 +03:00
Nikolai Kochetov
9787b3a1ee
Added Field type AggregateFunctionState.
2019-02-11 14:19:56 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes
...
Removed duplicate includes
2019-02-10 22:31:37 +03:00
Alexey Milovidov
ba3cb83a84
Removed duplicate includes
2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5
Updated test #4246
2019-02-10 19:55:12 +03:00
Alexey Milovidov
c603d270f4
Cleanups #4246
2019-02-10 18:17:45 +03:00
alexey-milovidov
75c087bcf5
Merge branch 'master' into arbitrary-const-expressions-in-limit
2019-02-10 17:20:31 +03:00
proller
a95d2d153d
Build ARM fix ( #4306 )
...
* Build ARM fix
* Fix warning: declaration shadows a local variable
* Add info about SPLIT_SHARED_LIBRARIES
* Fix cpuid on ARM
* release: better pbuilder autoinstall
2019-02-09 01:09:32 +03:00
Alexey Milovidov
94d43c4cb2
Fixed error with dangling pointer on stack to ThreadStatus
2019-02-08 16:23:10 +03:00
alexey-milovidov
7c830941a6
Merge pull request #4256 from zlobober/useful_what_in_exceptions
...
Make exception.what() less useless.
2019-02-07 12:15:43 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
...
Unified sets
2019-02-06 20:40:11 +03:00
alexey-milovidov
9a4c4964b2
Update ColumnsHashingImpl.h
2019-02-06 20:17:59 +03:00
alexey-milovidov
ba01f7fd77
Update ColumnsHashing.h
2019-02-06 19:58:27 +03:00
KochetovNicolai
063565265b
Update formatIPv6.cpp
...
Fix build.
2019-02-06 19:48:38 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
...
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
Maxim Akhmedov
6d5c0bdf91
Merge remote-tracking branch 'upstream/master' into useful_what_in_exceptions
2019-02-05 23:53:34 +03:00
Maxim Akhmedov
4dfce303fb
Remove e.what() from exception message for DB::Exception.
2019-02-05 20:02:05 +03:00
Nikolai Kochetov
a249fc7788
Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate.
2019-02-05 14:14:09 +03:00
Nikolai Kochetov
daa051b1f8
Fix tests.
2019-02-05 13:55:34 +03:00
Nikolai Kochetov
264da7f9d3
Implemented sets using ColumnsHashing.
2019-02-05 13:55:15 +03:00
Nikolai Kochetov
8db4116464
Update HashMethodHashed.
2019-02-05 13:55:08 +03:00
Alexey Milovidov
5fcc02bab2
Fixed bad code for printing query_id in text logs
2019-02-04 18:39:08 +03:00
Maxim Akhmedov
d67a3a901e
Make exception.what() less useless.
2019-02-04 17:36:09 +03:00
Vasily Nemkov
2716df8ab2
IPv4 and IPv6 Domain implementation.
...
Added:
* IDataTypeDomain interface;
* method DataTypeFactory::registerDataTypeDomain for registering domains;
* DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
* Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;
Updated:
* IDataType text serialization/deserialization methods;
* IDataType implementation to use domain for text serialization/deserialization;
* Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;
Tests:
* Added test cases for IPv4 and IPv6 domains.
* Updated IPv4/v6 functions tests to validate more cases;
* Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
Vitaliy Karnienko
d9da430982
add arbitrary const expressions in limit processing
2019-02-03 21:31:17 +03:00
Danila Kutenin
f6acd59929
fix brace
2019-02-02 18:15:53 +03:00
Danila Kutenin
9c7b62e95b
fix function
2019-02-02 18:13:31 +03:00
Danila Kutenin
7d6e4083fa
fix snake_case
2019-02-02 18:08:45 +03:00
Danila Kutenin
5e62a0825a
produce hints for typo functions and types
2019-02-02 17:54:50 +03:00
Nikolai Kochetov
6a729e59ba
Merged with master.
2019-02-01 11:36:57 +03:00
Nikolai Kochetov
d143a78419
Refactor ColumnsHashing
2019-02-01 11:23:38 +03:00
alesapin
95db9b4d76
Merge master
2019-01-29 23:17:52 +03:00
alesapin
4f97c291e6
Always run clickhouse-odbc-bridge; Integration tests now able to run odbc-bridge from separate binary; add symlink to clickhouse-odbc-bridge in dbms/programs folder;
2019-01-29 20:17:31 +03:00
Nikolai Kochetov
2c2932e185
Merged with master
2019-01-29 15:25:19 +03:00
proller
343b31af66
More link with Threads::Threads
2019-01-28 21:21:20 +03:00
Alexey Milovidov
9b2a5c3dec
Merge branch 'master' into split-odbc-bridge
2019-01-28 18:15:18 +03:00
proller
2ab3138eb6
Merge remote-tracking branch 'upstream/master' into fix10
2019-01-28 17:01:06 +03:00
proller
403d36a7f4
Fix
2019-01-28 16:24:55 +03:00
proller
a874945e0e
Use cpuinfo if cpuid not available
2019-01-28 16:16:08 +03:00
Alexey Milovidov
4e3d9a0f15
Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool
2019-01-28 14:20:24 +03:00
alexey-milovidov
4b8cf83de7
Merge pull request #4151 from ercolanelli-leo/fix/sumMap-overflow
...
Fix/sum map overflow
2019-01-27 21:11:51 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka ( #4152 )
2019-01-25 23:02:03 +03:00
Alexey Milovidov
253ac93459
Addition to prev. revision #4150
2019-01-25 21:44:30 +03:00
Léo Ercolanelli
57104f81da
rename widen
to promote
for IDataType
2019-01-25 15:16:23 +01:00
Alexey Milovidov
65f8e4d4a8
Merge branch 'master' into global-thread-pool
2019-01-25 16:33:50 +03:00
Léo Ercolanelli
d9195cda99
implement getWidenType()
on IDataType
...
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
Alexey Milovidov
ef50601b5c
Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g'
2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96
Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
...
This reverts commit a28f0acf09
.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
a28f0acf09
Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'
2019-01-24 22:49:36 +03:00
Alexey Milovidov
04fa827e4b
Style
2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
...
Add protobuf output format
2019-01-24 22:05:23 +03:00
Nikolai Kochetov
f7b9059dad
Merged with master
2019-01-24 18:06:11 +03:00
Nikolai Kochetov
5f1007a8df
Refactor Join.
2019-01-24 17:56:04 +03:00
Vitaly Baranov
1e7a231c56
Implemented main class for writing protobufs.
2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d
Implemented storage for parsed protobuf schemas.
2019-01-24 17:32:10 +03:00
maiha
6c83beafdd
dbms: Fixed misspells in comments
2019-01-23 04:56:53 +09:00
Nikolai Kochetov
e8aa41b6ac
Merge branch 'master' into unified-sets
2019-01-21 13:40:47 +03:00
Nikolai Kochetov
6fce028b56
Refactor ColumnsHashing.
2019-01-21 13:39:53 +03:00
Nikolai Kochetov
d207498573
Added ColumnsHashing
2019-01-21 13:39:24 +03:00
Alexey Milovidov
a7c468da8e
Merge remote-tracking branch 'origin/master' into global-thread-pool
2019-01-17 21:57:01 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
...
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
Danila Kutenin
12bcff48ee
Miscellaneous and some optimizations
2019-01-16 20:41:08 +03:00
Alexey Zatelepin
be6a8d6118
fix clang build
2019-01-16 19:42:02 +03:00
Alexey Milovidov
7d03804d06
Miscellaneous #4053
2019-01-16 16:57:11 +03:00
Danila Kutenin
ce90ad32d1
some style
2019-01-15 19:26:14 +03:00
Alexey Milovidov
f6b9b06307
Attempt to implemnt global thread pool #4018
2019-01-14 22:22:09 +03:00
Danila Kutenin
a5669b6b7a
MultiVolnitsky added with tests and some benchmark, many multiFunctions are added to support multistring search
2019-01-14 18:54:47 +03:00
Alexey Milovidov
35c35f1c77
Merge branch 'global-thread-pool' of github.com:yandex/ClickHouse into global-thread-pool
2019-01-14 14:01:52 +03:00
Alexey Milovidov
aec5570b6e
Attempt to implemnt global thread pool #4018
2019-01-14 13:59:58 +03:00
Alexey Milovidov
00a4b2cf8a
Removing garbage, part 1
2019-01-13 21:51:57 +03:00
Alexey Milovidov
a6bf5a7e28
Addition to prev. revision
2019-01-13 20:49:21 +03:00
Alexey Milovidov
0afee1df23
Attempt to implemnt global thread pool #4018
2019-01-11 22:27:24 +03:00
Alexey Milovidov
abcd5a2a49
Attempt to implemnt global thread pool #4018
2019-01-11 22:12:36 +03:00
proller
7cefef6983
Fix linking in all modes (unbundled, split, ...) ( #4037 )
2019-01-11 19:52:46 +03:00
alesapin
6401628dc8
Fix clang-7 werrors
2019-01-10 14:25:59 +03:00
alexey-milovidov
6fabb5eb03
Merge pull request #4017 from yandex/netlink-sockets-pool
...
Don't use a pool for TaskStatsInfoGetters
2019-01-09 22:56:27 +03:00
alexey-milovidov
a739edc239
Merge pull request #4013 from yandex/pvs-studio-fixes-2
...
Fixed bugs found by PVS-Studio
2019-01-09 22:55:11 +03:00
proller
64c2c3650c
cmake: Dont cache version; macos: fix build; /release_lib.sh move to utils ( #4016 )
2019-01-09 21:32:43 +03:00
Alexey Zatelepin
006a764df9
don't use pool for TaskStatsInfoGetter [#CLICKHOUSE-4209]
...
Pool is not needed because creation of a TaskStatsInfoGetter takes
an order of 10us. Also pool is harmful because created sockets are
never closed.
2019-01-09 20:52:25 +03:00
Alexey Milovidov
19f4652959
Fixed bugs found by PVS-Studio
2019-01-09 18:44:20 +03:00
Alexey Milovidov
da449ff9d1
Little better #3920
2019-01-08 17:56:50 +03:00
Alexey Milovidov
0dfa553fca
Added more warnings from clang's -Weverything, that are available in clang 8
2019-01-07 13:40:58 +03:00
Alexey Milovidov
06a8c3f02d
Added some warnings from clang's -Weverything
2019-01-05 06:33:22 +03:00
Alexey Milovidov
445fc2bb43
Added some warnings from clang's -Weverything
2019-01-04 17:10:36 +03:00
Alexey Milovidov
cf1cacc366
Added some warnings from clang's -Weverything
2019-01-04 16:54:39 +03:00
Alexey Milovidov
4622f5dc7c
Added some warnings from clang's -Weverything
2019-01-04 16:32:08 +03:00
Alexey Milovidov
1d4701b0bc
Added some warnings from clang's -Weverything
2019-01-04 15:10:00 +03:00
Alexey Milovidov
acb9696ddd
Miscellaneous [#CLICKHOUSE-2]
2019-01-03 11:40:48 +03:00
Alexey Milovidov
e33e5150b7
Miscellaneous [#CLICKHOUSE-2]
2019-01-02 09:44:36 +03:00
proller
300bbdfb43
Fix cyclic lib depend ppart 2: clean
2018-12-28 21:15:26 +03:00
proller
0c78ef8573
Fix cyclic lib depend (make clickhouse_compression lib)
2018-12-28 20:27:53 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs
...
Custom compression codecs
2018-12-28 08:29:09 +03:00
Alexey Milovidov
ab85175e7f
Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-4
2018-12-28 00:23:13 +03:00
alexey-milovidov
3455da0a97
Merge pull request #3947 from yandex/fix-config-reloader
...
Retry loading ZK substitutions after ZK errors
2018-12-28 00:22:48 +03:00
Alexey Milovidov
0d4e166db9
Fixed error: read one byte after buffer (this byte was unused) [#CLICKHOUSE-2]
2018-12-27 22:33:27 +03:00
Alexey Zatelepin
da00c6e918
retry loading ZK substitutions after ZK errors #2947
2018-12-27 21:12:38 +03:00
alesapin
3afa03d044
Merge branch 'master' into custom_compression_codecs
2018-12-27 11:23:00 +03:00
Alexey Milovidov
408f935754
Addition to prev. revision #3926
2018-12-27 03:03:18 +03:00
Alexey Milovidov
2e323192a2
Addition to prev. revision #3926
2018-12-27 03:02:11 +03:00
Alexey Milovidov
7509db544c
Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-3
2018-12-26 22:38:11 +03:00
alexey-milovidov
cd00fc8b56
Merge pull request #3934 from yandex/fix-zk-node-cache
...
Fix ZooKeeperNodeCache becoming unusable after SessionExpired event
2018-12-26 22:15:32 +03:00
Alexey Zatelepin
601a6af0ec
fix ZooKeeperNodeCache becoming unusable after SessionExpired event #2947 #3891
...
Previously after a SessionExpired event the context->zookeeper field was
reinitialized with the old expired ZooKeeper instance. This led to inability
to get new paths. Better not cache the ZooKeeper instance and get it at the
start of each request.
2018-12-26 20:27:25 +03:00
alesapin
8f82d5a687
Merge branch 'master' into custom_compression_codecs
2018-12-26 10:43:33 +03:00
Alexey Milovidov
5abb2d02b9
Fixed UB #3926
2018-12-26 08:34:25 +03:00
Alexey Milovidov
b7f085c525
Fixed UB #3926
2018-12-26 05:47:16 +03:00
Alexey Milovidov
897199c220
Fixed UB #3926
2018-12-26 04:29:48 +03:00
Alexey Milovidov
c858c144ef
Fixed UB #3926
2018-12-26 02:39:40 +03:00
Alexey Milovidov
cfc1e207ab
Fixed UB #3926
2018-12-26 02:27:52 +03:00
Alexey Milovidov
8f306e8b45
Small improvements #3920
2018-12-25 22:31:18 +03:00