Commit Graph

2175 Commits

Author SHA1 Message Date
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
Alexey Milovidov
5fbe53b562 Speedup "symbolizeAddress" function 2019-07-29 04:08:52 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Alexey Milovidov
32a9b27876 Added a comment 2019-07-28 17:55:02 +03:00
Alexey Milovidov
98c3ff92ae Fixed non-standard build 2019-07-27 20:04:26 +03:00
Alexey Milovidov
da3806bf36 Add timer offset randomization 2019-07-26 03:51:19 +03:00
Alexey Milovidov
cf67765fc8 Reverted bad modification 2019-07-26 01:38:59 +03:00
Alexey Milovidov
5a47b0b990 Sanity and configuration checks 2019-07-26 01:35:47 +03:00
Alexey Milovidov
472a61c1fa Updating PHDRCache after dlopen 2019-07-25 22:56:51 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
chertus
50e3839157 NOT_UNBUNDLED -> UNBUNDLED 2019-07-25 13:35:57 +03:00
alexey-milovidov
f1f5cdc802
Merge pull request #6144 from yandex/fix-msan
Fixed MSan report
2019-07-25 04:29:11 +03:00
Alexey Milovidov
6b2810d346 Fixed error with non-SIMD implementation of memcmpSmall 2019-07-25 03:28:27 +03:00
Alexey Milovidov
5755c93d5c Fixed MSan report 2019-07-25 01:31:39 +03:00
Alexey Milovidov
cfb2066198 Added information about thread number to trace log 2019-07-24 23:10:23 +03:00
Alexey Milovidov
d9976abe18 Added ProfileEvents for signal handler overruns 2019-07-24 22:19:29 +03:00
Alexey Milovidov
63764af4fb Merge branch 'merge-profiler' of github.com:yandex/ClickHouse into merge-profiler 2019-07-24 22:04:13 +03:00
Alexey Milovidov
6e8258fa2f Added ProfileEvent for dropped traces due to pipe full 2019-07-24 22:04:07 +03:00
Alexey Milovidov
f031d064b6 Don't drop all traces if frequency is too high 2019-07-24 22:03:26 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexey Milovidov
56bb2956cd Addition to prev. revision 2019-07-24 05:07:16 +03:00
Alexey Milovidov
b9105e131f Avoid deadlock in TraceCollector 2019-07-24 05:02:10 +03:00
Alexey Milovidov
33ee957b5c Addition to prev. revision 2019-07-24 03:49:14 +03:00
Alexey Milovidov
378fff2990 Lower bound on profiler period 2019-07-24 03:46:37 +03:00
Alexey Milovidov
02fb67dc8a Simple protection from too frequent profiler signals 2019-07-23 21:45:54 +03:00
dimarub2000
752eccf2eb changes after review 2019-07-23 17:41:41 +03:00
Dmitry Rubashkin
13ef987361 Git commit fixes 2019-07-23 16:53:25 +03:00
Dmitry Rubashkin
4d43cf2a8d config exception when not corresponding root names 2019-07-23 16:53:25 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
Alexander Tokmakov
12e08417d6 Template format implementation 2019-07-22 00:57:57 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
Mikhail Filimonov
9c2ae4513d SensitiveDataMasker 2019-07-19 10:22:42 +02:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
Alexey Milovidov
1937623f18 Better test 2019-07-15 22:13:43 +03:00
alexey-milovidov
1597103107
Merge pull request #6017 from yandex/mimallocexceptions
Add OOM checks in mimalloc
2019-07-15 22:10:05 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Alexey Milovidov
a175c55136 Added a test that shows catastrophic behaviour of mimalloc 2019-07-15 21:49:30 +03:00
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
3c7178a8d1
Merge pull request #5923 from yandex/add-noreturn
Add two more warnings from -Weverything
2019-07-09 00:10:35 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
a5cce21ebd Addition to prev. revision 2019-07-08 19:53:49 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
e64e520e5b One more fix for PVS-Studio 2019-07-08 03:11:39 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
Nikita Lapkov
6b7f587156 cut large query_ids 2019-07-05 14:16:20 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
alexey-milovidov
101b317efa
Merge pull request #5850 from PerformanceVision/top_k_weighted_fix
Add element on SpaceSaving set if the last element has a lower value compared to the last one
2019-07-05 10:57:11 +03:00
Guillaume Tassery
53d67103e7 Add documentation about removing the lowest element for the SpaceSaving set 2019-07-05 09:20:27 +02:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Guillaume Tassery
85151b339b Add test on topKWeighted function 2019-07-04 15:15:08 +02:00
CurtizJ
f3ac23fd48 add logging about DNS resolution errors 2019-07-04 13:38:44 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
CurtizJ
8eda3b5de4 fix deadlock in getHostName 2019-07-04 02:05:59 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
c880e00ffa Start writing tests 2019-07-03 19:00:24 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
Guillaume Tassery
81e39744e2 Add element on the SpaceSavingSet if the last element has a smaller weight value compared to the new one 2019-07-03 13:49:03 +02:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
Alexander Kuzmenkov
90c40dccc8 Disable copy and move for AllocatorWithStackMemory.
Since this allocator uses its own buffer field for small allocations,
moving or copying it is ill-defined, because someone might already
use the pointers to its body.
2019-07-02 20:48:33 +03:00
Alexander Kuzmenkov
f6ee2ea4e4 Add asan integration to arenas. 2019-07-02 20:48:00 +03:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
33cff5ee0f Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-30 17:24:15 +03:00
Alexey Milovidov
f25b96bed2 Moved a few tests to gtest 2019-06-30 02:23:53 +03:00
Alexey Milovidov
b76d5a7cf0 Added a test (not gtest though) 2019-06-30 01:45:57 +03:00
Alexey Milovidov
299607a301 ThreadPool: more informative error message if exception is thrown before we schedule a next thread #5305 2019-06-30 01:37:46 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
alexey-milovidov
a0d3db8d9b
Merge pull request #5787 from yandex/aku/podarray-bytes
Fix initial size of some inline PODArray's.
2019-06-29 15:34:00 +03:00
Danila Kutenin
614ec98a42 Fix runtime of SPLIT_SHARED_LIBRARIES build 2019-06-28 21:26:24 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
Alexander Kuzmenkov
a719933c58 Fix initial size of some inline PODArray's.
A template parameter of PODArray named INITIAL_SIZE didn't make its
units clear, which made some callers to erroneously assume that it
specifies the number of elements and not the number of bytes.
Rename it, fix the wrong usages and, where possible, use the
PODArrayWithStackMemory typedef for arrays with inline memory.
2019-06-28 16:03:14 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
Danila Kutenin
407cf9a229 Comments 2019-06-28 00:43:50 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Alexey Milovidov
e33d482271 Fixed warning in gcc-9 2019-06-27 17:44:39 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding
Gorilla column encoding
2019-06-26 12:53:12 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
66b0ae52d5 Added StopwatchGuard 2019-06-25 19:41:06 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
proller
da1814c2a8
Fix shared build (#5702) 2019-06-20 23:57:01 +03:00
dmitry kuzmin
3b45ac8bb6 fix macos compile 2019-06-20 13:26:19 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
Vasily Nemkov
0b68f55ce0 Fixed UB in maskLowBits 2019-06-19 18:36:34 +03:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes:
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alexey-milovidov
36c0e1f4c5
Merge branch 'master' into sanych73-prepared_statements 2019-06-17 09:33:04 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00
Vitaliy Zakaznikov
d876f7f332 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-16 07:12:54 -04:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
Alexey Milovidov
ba18308080 Merge branch 'master' into levysh-testkeeper 2019-06-16 02:45:34 +03:00
Alexey Milovidov
6418018385 Added comment 2019-06-16 02:35:12 +03:00
Alexey Milovidov
777af5544b Removed tons of trash
Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash
2019-06-16 02:35:27 +03:00
levushkin aleksej
bc2789f9ad TestKeeper(mock ZooKeeper)
fix style

fix bug

one more fix style
2019-06-16 02:35:12 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug
Add database engine of MySQL type
2019-06-15 14:52:57 +03:00
zhang2014
ec8d73550b some review fixes 2019-06-15 11:39:04 +08:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
2019-06-13 11:58:58 +08:00
Vitaliy Zakaznikov
d50586d5a5 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-12 15:40:58 -04:00
Danila Kutenin
4fd85b4136 Clearer interfaces of Searchers 2019-06-12 05:35:25 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Konstantin Podshumok
eb31345224 add timeouts to ConnectionPoolWithFailover and use max_tries from settings 2019-06-02 12:43:20 +03:00
alexey-milovidov
4819a34394
Merge pull request #5448 from yandex/low-cardinality
Add setting suspicious type for low cardinality (fixed #4965)
2019-05-31 07:35:19 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Nikita Lapkov
3b54fde8a7 replace StackTrace with Backtrace 2019-05-30 10:30:24 +00:00
Alexey Milovidov
1607ec49ba Fixed linking with lld 2019-05-30 11:23:20 +03:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
comunodi
559628575a Merge branch 'master' into add-ext-dict-redis
# Conflicts:
#	dbms/tests/integration/image/Dockerfile
2019-05-28 23:20:41 +03:00
stavrolia
4cd595b450 Add setting allow suspicious types for low cardinality with long message about error (fixed #4965) 2019-05-28 19:10:55 +03:00
Vitaly Baranov
1364cdd057 Fix ErrorCodes. 2019-05-28 03:08:12 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
comunodi
5ea9bb228c Merge branch 'master' into add-ext-dict-redis 2019-05-26 15:49:35 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Nikita Lapkov
b12db6e0e8 fix data race on trace_pipe close 2019-05-19 20:22:44 +00:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions
Improve new json functions
2019-05-18 12:51:41 +03:00
alexey-milovidov
1707cd79c8
Merge pull request #5297 from github1youlc/xid_equal_to_close_xid_deadlock_fix
fix deadlock when xid equal to close_xid
2019-05-17 11:45:35 +03:00
Vitaly Baranov
8ab4e4dcfe Use rapidjson when AVX2 instructions are not available. 2019-05-16 20:40:24 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
linceyou
c6108eec73 fix possible deadlock 2019-05-16 14:42:56 +08:00
proller
0da7463a6b
CLICKHOUSE-4519 Support dictionaries in clickhouse-copier (#5270) 2019-05-15 12:16:09 +03:00
Nikita Lapkov
ab69128e1d introduce Backtrace class 2019-05-14 22:15:23 +00:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
Igor Mineev
b4b000bf84 Merge branch 'master' into feature_multiple_disks 2019-05-11 21:50:29 +03:00
Danila Kutenin
8be1bc009a move CpuId to Common 2019-05-09 13:33:56 +03:00
Vitaly Baranov
7ace113ac0 Use custom cmake file for simdjson and fix build 2019-05-08 16:20:25 +03:00
Danila Kutenin
ced9805cc1 Remove condition of prefixes first 2019-05-05 15:26:20 +03:00
Danila Kutenin
e531348e12 Better condition 2019-05-05 12:34:43 +03:00
Danila Kutenin
451407a829 Fix word extraction if prefix candidate is small 2019-05-05 12:32:26 +03:00
Alexey Milovidov
50a9d733b4 Attempt to fix race condition in recursive RWLock 2019-05-05 05:01:23 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
48e4dd9a9e Attach to current thread in threadpool. 2019-04-29 15:19:32 +03:00
Nikolai Kochetov
e6f86207c5 Attach to current thread in threadpool. 2019-04-29 15:11:01 +03:00
alexey-milovidov
0a88bcbb48
Merge pull request #5129 from kvinty/msd-radix-sort
[WIP] Add MSD radix sort
2019-04-29 04:50:27 +03:00
alexey-milovidov
8d2941fa60
Update RadixSort.h 2019-04-29 04:50:18 +03:00
Ivan
9edbbc637a
Fix segmentation fault on iterator double-free inside RWLock (#5127)
* Store the key instead of iterator, which may get invalidated by erasure from another instance.
* Add test
2019-04-27 22:12:35 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Guillaume Tassery
7c4541b127
Merge branch 'master' into top_level_domain 2019-04-26 12:30:23 +07:00
Guillaume Tassery
40db4551f2 Add USE_GPERF on configuration file 2019-04-26 12:01:02 +07:00
Alexey Milovidov
661c840fbe Code cleanups after #4439 2019-04-25 04:16:26 +03:00
alexey-milovidov
445f51c01e
Merge pull request #4439 from kvinty/kvinty-radix-sort
Use radixSort in ORDER BY + add performance test
2019-04-25 02:45:38 +03:00
Igor Mineev
8edcae5530 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-24 15:35:08 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
Yuriy
a4bf3621e3 merged with master 2019-04-23 21:58:29 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
dmitriiut
50c322bc6d WITH FILL version 2019-04-22 02:04:23 +03:00
Igor Mineev
79abe85328 New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor 2019-04-21 21:38:44 +03:00
dmitriiut
3c2922c406
Merge branch 'master' into dmitriiut-WITH_TIES_and_WITH_FILL 2019-04-21 19:37:38 +03:00
dmitriiut
e94575e1da fix progress 2019-04-21 19:16:25 +03:00
dmitriiut
8a7853b0a8 parser WITH FILL
some interpreter changes
2019-04-21 06:36:59 +03:00
alexey-milovidov
e62999d8b9
Fixed typo in comment. 2019-04-20 23:25:19 +03:00
Evgenii Pravda
5a773ed67c Fix nulls order 2019-04-20 02:04:17 +03:00
Evgenii Pravda
bc4eb309e2 Trying to defeat gcc 8 (2) 2019-04-20 02:04:17 +03:00
Evgenii Pravda
fecf0a3630 Some fixes 2019-04-20 02:04:17 +03:00
Evgenii Pravda
f1e842cdf6 Use radixSort when possible 2019-04-20 02:04:17 +03:00
Alexey Milovidov
ee1a843609 COWPtr: improvements (C++ Russia 2019, suggested by Alexey Malov) 2019-04-19 23:22:06 +03:00
dmitrii
100cee18c3 comments + fix naming 2019-04-19 18:45:42 +03:00
dmitrii
a130850e15 limit with ties 2019-04-19 16:38:25 +03:00
Nikolai Kochetov
cea6b10152 Undo add thread_group to ThreadPool 2019-04-18 21:43:08 +03:00
Nikolai Kochetov
b5e6c3bc2d Undo add thread_group to ThreadPool 2019-04-18 21:42:26 +03:00
Nikolai Kochetov
a07b592a95 Undo add thread_group to ThreadPool 2019-04-18 21:40:55 +03:00
Nikolai Kochetov
ff35e3876e Added thread_group argument to ThreadPool. 2019-04-18 17:58:46 +03:00
Nikolai Kochetov
8718b7bb40 Added thread_group argument to ThreadPool. 2019-04-18 17:55:43 +03:00
dmitrii
8d9105eb25 return false -> throw exception 2019-04-18 15:34:10 +03:00
proller
1b020827f0 Move Poco/Ext/ThreadNumber.h to common/getThreadNumber.h (#5016) 2019-04-17 17:53:54 +03:00
chertus
a519e7f01a Merge branch 'master' into asof 2019-04-16 15:48:28 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212)
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Danila Kutenin
18a6b3123f Randomization in lfalloc 2019-04-13 17:45:01 +03:00
Danila Kutenin
6cfe80ba90 style 2019-04-13 15:30:59 +03:00
Danila Kutenin
3fe3e4d8a3 Fix define definition 2019-04-13 15:14:56 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
chertus
4192deb5ad radix sort for asof join 2019-04-12 15:48:00 +03:00
Mikhail Fandyushin
7fc9b8c6fb Merge branch 'master' into brotli 2019-04-08 21:07:58 +03:00
alexey-milovidov
4ffb8372d2
Merge pull request #4928 from danlark1/master
MarkCache and UncompressedCache use different allocator to catch segfaults
2019-04-06 23:03:04 +03:00
Artem Zuikov
cbb0404d19
Merge pull request #4924 from Gladdy/martijn-asof-speedup
Significant speedup of ASOF join
2019-04-06 21:38:46 +03:00
Danila Kutenin
5635e3b01c Use inheritance, it is better 2019-04-06 20:25:54 +03:00
Danila Kutenin
50379e7cd3 Delete state from allocator because of alignment issues 2019-04-06 20:06:39 +03:00
comunodi
dd121eff06 Merge branch 'master' into add-ext-dict-redis
# Conflicts:
#	dbms/tests/integration/image/Dockerfile
2019-04-06 18:48:45 +03:00
Danila Kutenin
7e1e81c444 delete Allocator.cpp 2019-04-06 18:36:52 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Martijn Bakker
f96a7e401e remove the list lookup and prevent the global lock 2019-04-05 18:59:48 +01:00
proller
60bc13e619 Version to end of exception 2019-04-04 15:34:49 +03:00
proller
bebb4cd140 Merge remote-tracking branch 'upstream/master' into fix15 2019-04-04 14:50:14 +03:00
alexey-milovidov
38f2df7e97
Merge pull request #4891 from danlark1/master
Typos for other factories
2019-04-04 13:58:41 +03:00
Danila Kutenin
ea53a0a85d Clang build is too annoying 2019-04-04 09:23:12 +03:00
proller
5b1bde2e80 CLICKHOUSE-4387 Add (official build) to version of yandex builds 2019-04-03 17:06:59 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Danila Kutenin
029dd107e4 Typos for many factories 2019-04-03 14:13:22 +03:00
chertus
d5ffbd9b6d fix multithreaded ASOF JOIN crash 2019-04-02 21:50:35 +03:00
chertus
04efcf2bdc asof refactoring (searching for the crash reason) 2019-04-02 19:22:14 +03:00
Yuriy
107f33e888 added password check and changed packets serialization 2019-04-01 12:27:39 +03:00
Danila Kutenin
f80fb09b81 Hyperscan better usage of scratch space and error handling 2019-03-31 23:19:22 +03:00
chertus
11997ed772 fix build 2019-03-31 13:56:54 +03:00
Artem Zuikov
f87e3ae4c8
Merge pull request #4863 from Gladdy/martijn-asof-nomap
Perform ASOF join with sorting PODArray once and support multiple column types
2019-03-31 13:40:15 +03:00
alexey-milovidov
cf492a4401
Merge pull request #4862 from danlark1/master
Optimize Volnitsky by inlining compare function
2019-03-31 02:24:33 +03:00
Martijn Bakker
6695e304af fix style 2019-03-30 21:55:40 +00:00
Martijn Bakker
4709b744bb address the code review issues 2019-03-30 21:30:21 +00:00
FawnD2
dfed1579ac Merge branch 'master' into add-ext-dict-redis
# Conflicts:
#	ci/jobs/quick-build/run.sh
2019-03-30 16:42:42 +03:00
alexey-milovidov
14b8e64992
Disable usage of "mremap" when compiled with Thread Sanitizer. (#4859)
* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer

* Disable mremap under Thread Sanitizer
2019-03-30 13:47:25 +03:00
Danila Kutenin
18d3813ff9 Optimize Volnitsky by inlining compare function 2019-03-30 12:39:45 +03:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
Artem Zuikov
03cd41fbc7
Merge pull request #4774 from Gladdy/martijn-asof-join
Request for feedback on implementation of ASOF join
2019-03-29 13:19:31 +03:00
Martijn Bakker
46f4557944 Merge branch 'master' into martijn-asof-join 2019-03-28 20:20:17 +00:00
Alexey Milovidov
4aaf9eccce Fixed error 2019-03-28 22:12:37 +03:00
Martijn Bakker
b0fd915724 remove the ASOFSplit struct 2019-03-28 18:35:50 +00:00
Alexey Milovidov
4417705f32 Merge branch 'master' into cow-ptr-compositions 2019-03-28 17:47:59 +03:00
proller
cbffebc22c Print with version 2019-03-28 16:08:38 +03:00
proller
ccd5db786c Merge remote-tracking branch 'upstream/master' into fix26 2019-03-28 13:39:03 +03:00
proller
7d1be03a16 CLICKHOUSE-4386 Version in exceptions 2019-03-27 18:46:46 +03:00
Alexey Milovidov
42dd521e45 Added a setting to disallow Hyperscan 2019-03-27 00:56:46 +03:00
Mikhail Fandyushin
c53b303bc2 HTTP Accept-Encoding: br; Added brotli errors codes 2019-03-27 00:32:29 +03:00
Danila Kutenin
62dde447ab Better type system in Volnitsky 2019-03-26 16:20:17 +03:00
proller
1584fd4367
Fix hyperscan library find and use (#4798) 2019-03-26 00:31:00 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
Alexey Milovidov
af5193736a Attempt to make compositions with COWPtr more convenient 2019-03-24 05:22:39 +03:00
Alexey Milovidov
c76a4e9dd2 Attempt to make compositions with COWPtr more convenient 2019-03-24 05:21:01 +03:00
Alexey Milovidov
2dca389f20 Attempt to make compositions with COWPtr more convenient 2019-03-24 04:42:58 +03:00
Danila Kutenin
725139f0f5 Renamings, fixes to search algorithms, more tests 2019-03-24 01:49:38 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
Alexey Milovidov
1d1bedca3b Removed WTF code 2019-03-20 23:27:55 +03:00
FawnD2
1e014060c9 Merge branch 'master' into add-ext-dict-redis
# Conflicts:
#	dbms/tests/external_dictionaries/generate_and_test.py
#	dbms/tests/external_dictionaries/run.sh
2019-03-16 17:14:27 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Ivan Lezhankin
b67e79430d Fix style 2019-03-15 20:22:19 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
Ivan Lezhankin
61c24e0844 Overload template method |as<>()| with reference type.
Move promotion logic to a separate class
2019-03-15 16:12:11 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
Ivan Lezhankin
67eefa7b12 Revert wrong replacements of dynamic_cast.
dynamic_cast to intermediate type is not equivalent to typeid_cast
2019-03-12 15:41:57 +03:00
proller
b5efce5b8a Freebsd build fix (#4650)
* Update contrib/cppkafka

* Fix

* Freebsd build fix
2019-03-11 16:10:47 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Nikita Lapkov
1ea971ddd2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-10 01:56:41 +00:00
Nikita Lapkov
5b50026860 - remove memory allocations in signal handler
- revert ThreadStatus::getQueryId()
- refactor
2019-03-10 01:49:36 +00:00
Alexey Milovidov
56690070fa Merge branch 'master' of github.com:yandex/ClickHouse into debug-pod-array 2019-03-08 15:59:39 +03:00
Alexey Milovidov
4905cd2b0a Added missing include 2019-03-08 15:59:06 +03:00
Alexey Milovidov
73c571412c Fixed awful error after #3920 2019-03-08 06:32:43 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
alexey-milovidov
286d03de97
Merge pull request #4619 from yandex/fix-inconsistent-memory-tracker
Fixed inconsistency of MemoryTracker usage in Allocator (tnx. proller)
2019-03-07 22:08:39 +03:00
Alexey Milovidov
64897faf84 Fixed inconsistency of MemoryTracker usage in Allocator (tnx. proller) 2019-03-07 19:48:24 +03:00
proller
2c4dced9d2 Add functions used in arcadia 2019-03-07 19:27:03 +03:00
Alexey Milovidov
f49562bff3 Flush query metrics before joining thread #4612 2019-03-06 22:57:54 +03:00
Alexey Milovidov
47df38f7a0 Adapted test for TSan #4572 2019-03-06 21:09:25 +03:00
Alexey Milovidov
41469cc874 More simple #4572 2019-03-06 20:54:20 +03:00
Alexey Milovidov
89917ced9e Fixed undefined behaviour in ThreadPool #4572 2019-03-06 19:46:05 +03:00
Nikita Lapkov
12fe175385 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-06 10:30:47 +00:00
Alexey Milovidov
899b2548c7 Added comment #4572 2019-03-05 23:49:21 +03:00
proller
718fd5b4ca Add exception code METRIKA_OTHER_ERROR 2019-03-05 16:03:11 +03:00
Alexey Milovidov
3033d329eb Fixed error #4564 2019-03-04 18:50:23 +03:00
Nikita Lapkov
70b5aaafa6 remove circular dependency 2019-03-04 13:45:37 +00:00
Nikita Lapkov
6367e15e4e add cpu timer. add timer type to log. refactor 2019-03-04 13:03:32 +00:00
Alexey Milovidov
2612bd892d Additions #4564 2019-03-04 02:16:38 +03:00
Alexey Milovidov
f018578595 Better code #4564 2019-03-04 02:12:50 +03:00
Alexey Milovidov
82cb9f51b0 Fixed error 2019-03-04 01:46:46 +03:00
Alexey Milovidov
ee9cfae7f9 Fixed build with gcc-8 2019-03-04 00:07:52 +03:00
Alexey Milovidov
084586a958 Fixed build with gcc-8 2019-03-04 00:07:38 +03:00
Alexey Milovidov
efe3d53894 Fixed build with gcc-8 2019-03-04 00:05:55 +03:00
Alexey Milovidov
315b6f3878 Better string comparison (development) 2019-03-03 23:08:39 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Nikita Lapkov
ce4e48d6f4 Merge branch 'master' into query-poor-mans-profiler 2019-03-01 14:22:38 +00:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
alexey-milovidov
918750c3ba
Merge pull request #4535 from yandex/fix-concurrent-alters
Fix deadlock of concurrent SELECTs and DDL queries
2019-03-01 04:10:10 +03:00
Nicolae Vartolomei
602aeb3bb2
Enable taskstat accounting for versions >= 3
Previously if clickhouse was compiled under a kernel with higher
TASKSTATS_VERSION, but run under a kernel with older TASKSTAT_VERSION
extended and io accounting would be disabled.
2019-02-28 21:52:53 +00:00
Alex Zatelepin
cc92f41ddd fix build 2019-02-28 21:15:10 +03:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
Alexey Zatelepin
c5dde2c9fd get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789] 2019-02-28 12:37:05 +03:00
Alexey Zatelepin
df5ad1871a add comment [#CLICKHOUSE-3789] 2019-02-27 21:39:55 +03:00
Alexey Zatelepin
5ac1d4dd4e rename LockHandler -> LockHolder [#CLICKHOUSE-3789] 2019-02-27 21:34:38 +03:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
proller
23d70b2e04
Add Y_IGNORE (#4521) 2019-02-27 19:52:08 +03:00
Alexey Milovidov
467f9ce211 Fixed ThreadPool when there are too many inactive threads #4485 2019-02-25 18:45:07 +03:00
Nikolai Kochetov
e91a0a31b7 Merge branch 'master' into processors 2019-02-21 19:19:35 +03:00
Vitaly Baranov
9cd4c7495f Implement an utility class for reading protobuf messages. 2019-02-20 07:28:02 +03:00
Vitaly Baranov
74cc6f285c Implement an utility class to match columns and protobuf fields. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Danila Kutenin
35bfe7950e Pointer codestyle fix in Levenshtein distance 2019-02-18 04:21:18 +03:00
Danila Kutenin
ed57671948 Implement Levenstein distance with linear memory 2019-02-18 04:18:39 +03:00
Nikolai Kochetov
b6fd31865e Merged with master. 2019-02-15 19:22:29 +03:00
Nikolai Kochetov
6763b59ba9 Updated PipelineExecutor. 2019-02-15 19:18:25 +03:00
Alexey Milovidov
21247ebfac Better replica repair logic: clearing obsolete queue 2019-02-14 17:04:28 +03:00
Alexey Milovidov
2efb4bdca2 Slightly raised up the limit on max string and array size received from ZooKeeper 2019-02-14 16:47:00 +03:00
proller
f5560660be Fix brotli (unbundled, missing, ...) 2019-02-13 18:35:11 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field
Aggregate function state in field
2019-02-12 22:13:38 +03:00
alexey-milovidov
d8aa74bc64
Merge pull request #4367 from yandex/unified-sets-fix-lc-cache
Fix LowCardinality cache for ColumnsHashing
2019-02-12 21:24:52 +03:00
Nikolai Kochetov
a73f29ca2e Fix LowCardinality cache. 2019-02-12 17:38:29 +03:00
comunodi
b50625557b Merge remote-tracking branch 'origin/master' into add-ext-dict-redis 2019-02-12 12:35:29 +03:00
Nikolai Kochetov
c35439a5f0 Updated FieldVisitor. 2019-02-11 18:46:19 +03:00
Alexey Milovidov
7b312c6df2 Forbid to specify a database when creating a temporary table [#CLICKHOUSE-4294] 2019-02-11 17:46:09 +03:00
Danila Kutenin
985bb119c1 Fix comment 2019-02-11 15:44:18 +03:00
Danila Kutenin
6a1d1f5508 Better hints provider 2019-02-11 15:42:20 +03:00
Nikolai Kochetov
85318c0bfd Merge branch 'master' into aggregate-function-state-in-field 2019-02-11 15:41:11 +03:00
Nikolai Kochetov
9787b3a1ee Added Field type AggregateFunctionState. 2019-02-11 14:19:56 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes
Removed duplicate includes
2019-02-10 22:31:37 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
Alexey Milovidov
c603d270f4 Cleanups #4246 2019-02-10 18:17:45 +03:00
alexey-milovidov
75c087bcf5
Merge branch 'master' into arbitrary-const-expressions-in-limit 2019-02-10 17:20:31 +03:00
Nikita Lapkov
b8d78807fe Merge remote-tracking branch 'parent/master' into query-poor-mans-profiler 2019-02-09 21:45:34 +00:00
Nikita Lapkov
5f585948c1 review fix. stop TraceCollector gracefully 2019-02-09 21:40:10 +00:00
proller
a95d2d153d Build ARM fix (#4306)
* Build ARM fix

* Fix warning: declaration shadows a local variable

* Add info about SPLIT_SHARED_LIBRARIES

* Fix cpuid on ARM

* release: better pbuilder autoinstall
2019-02-09 01:09:32 +03:00
Alexey Milovidov
94d43c4cb2 Fixed error with dangling pointer on stack to ThreadStatus 2019-02-08 16:23:10 +03:00
alexey-milovidov
7c830941a6
Merge pull request #4256 from zlobober/useful_what_in_exceptions
Make exception.what() less useless.
2019-02-07 12:15:43 +03:00
alexey-milovidov
2686f64233
Merge pull request #4128 from yandex/unified-sets
Unified sets
2019-02-06 20:40:11 +03:00
alexey-milovidov
9a4c4964b2
Update ColumnsHashingImpl.h 2019-02-06 20:17:59 +03:00
alexey-milovidov
ba01f7fd77
Update ColumnsHashing.h 2019-02-06 19:58:27 +03:00
KochetovNicolai
063565265b
Update formatIPv6.cpp
Fix build.
2019-02-06 19:48:38 +03:00
KochetovNicolai
9f971c276f
Merge pull request #3669 from Enmk/ipv4_and_ipv6_domains
Ipv4 and ipv6 domains
2019-02-06 18:16:58 +03:00
Maxim Akhmedov
6d5c0bdf91 Merge remote-tracking branch 'upstream/master' into useful_what_in_exceptions 2019-02-05 23:53:34 +03:00
Maxim Akhmedov
4dfce303fb Remove e.what() from exception message for DB::Exception. 2019-02-05 20:02:05 +03:00
Nikolai Kochetov
8bcc9e580a Merged with master 2019-02-05 15:15:35 +03:00
Nikolai Kochetov
a249fc7788 Do nut use Arena in ColumnsHashing for string in functions arrayUniq and arrayEnumerate. 2019-02-05 14:14:09 +03:00
Nikolai Kochetov
daa051b1f8 Fix tests. 2019-02-05 13:55:34 +03:00
Nikolai Kochetov
264da7f9d3 Implemented sets using ColumnsHashing. 2019-02-05 13:55:15 +03:00
Nikolai Kochetov
8db4116464 Update HashMethodHashed. 2019-02-05 13:55:08 +03:00
Alexey Milovidov
5fcc02bab2 Fixed bad code for printing query_id in text logs 2019-02-04 18:39:08 +03:00
Maxim Akhmedov
d67a3a901e Make exception.what() less useless. 2019-02-04 17:36:09 +03:00
Vasily Nemkov
2716df8ab2 IPv4 and IPv6 Domain implementation.
Added:
 * IDataTypeDomain interface;
 * method DataTypeFactory::registerDataTypeDomain for registering domains;
 * DataTypeDomainWithSimpleSerialization domain base class with simple serialization/deserialization;
 * Concrete IPv4 and IPv6 domain implementations: DataTypeDomanIPv6 and DataTypeDomanIPv4;

Updated:
 * IDataType text serialization/deserialization methods;
 * IDataType implementation to use domain for text serialization/deserialization;
 * Refactored implementation of the IPv4/IPv6 functions to use formatIPv4/v6 and parseIPv4/v6 from Common/formatIPv6.h;

Tests:
 * Added test cases for IPv4 and IPv6 domains.
 * Updated IPv4/v6 functions tests to validate more cases;
 * Added performance tests for IPv4 and IPv6 related functions;
2019-02-04 12:37:46 +03:00
Nikita Lapkov
5c54bbb750 write traces to trace_log 2019-02-03 21:30:45 +00:00
Vitaliy Karnienko
d9da430982 add arbitrary const expressions in limit processing 2019-02-03 21:31:17 +03:00
Nikita Lapkov
89582cfef2 Merge branch 'master' into query-poor-mans-profiler 2019-02-03 10:06:05 +00:00
Nikita Lapkov
df3db1bff2 basic pipe 2019-02-03 09:57:12 +00:00
Danila Kutenin
f6acd59929 fix brace 2019-02-02 18:15:53 +03:00
Danila Kutenin
9c7b62e95b fix function 2019-02-02 18:13:31 +03:00
Danila Kutenin
7d6e4083fa fix snake_case 2019-02-02 18:08:45 +03:00
Danila Kutenin
5e62a0825a produce hints for typo functions and types 2019-02-02 17:54:50 +03:00
Nikolai Kochetov
6a729e59ba Merged with master. 2019-02-01 11:36:57 +03:00
Nikolai Kochetov
d143a78419 Refactor ColumnsHashing 2019-02-01 11:23:38 +03:00
alesapin
95db9b4d76 Merge master 2019-01-29 23:17:52 +03:00
alesapin
4f97c291e6 Always run clickhouse-odbc-bridge; Integration tests now able to run odbc-bridge from separate binary; add symlink to clickhouse-odbc-bridge in dbms/programs folder; 2019-01-29 20:17:31 +03:00
Nikolai Kochetov
2c2932e185 Merged with master 2019-01-29 15:25:19 +03:00
proller
343b31af66 More link with Threads::Threads 2019-01-28 21:21:20 +03:00
Alexey Milovidov
9b2a5c3dec Merge branch 'master' into split-odbc-bridge 2019-01-28 18:15:18 +03:00
proller
2ab3138eb6 Merge remote-tracking branch 'upstream/master' into fix10 2019-01-28 17:01:06 +03:00
proller
403d36a7f4 Fix 2019-01-28 16:24:55 +03:00
proller
a874945e0e Use cpuinfo if cpuid not available 2019-01-28 16:16:08 +03:00
Alexey Milovidov
4e3d9a0f15 Merge branch 'master' of github.com:yandex/ClickHouse into global-thread-pool 2019-01-28 14:20:24 +03:00
alexey-milovidov
4b8cf83de7
Merge pull request #4151 from ercolanelli-leo/fix/sumMap-overflow
Fix/sum map overflow
2019-01-27 21:11:51 +03:00
comunodi
cc5678f6cc Merge branch 'master' of https://github.com/yandex/ClickHouse into add-ext-dict-redis 2019-01-27 19:22:51 +03:00
proller
5328251ff1
Fix build without protobuf, gtest, cppkafka (#4152) 2019-01-25 23:02:03 +03:00
Alexey Milovidov
253ac93459 Addition to prev. revision #4150 2019-01-25 21:44:30 +03:00
Léo Ercolanelli
57104f81da rename widen to promote for IDataType 2019-01-25 15:16:23 +01:00
Alexey Milovidov
65f8e4d4a8 Merge branch 'master' into global-thread-pool 2019-01-25 16:33:50 +03:00
Léo Ercolanelli
d9195cda99 implement getWidenType() on IDataType
This is essentially to help implementing the `getReturnType` of
aggregation function susceptible to provoque overflow (such as
`sumMap`).
2019-01-25 14:25:25 +01:00
Alexey Milovidov
ef50601b5c Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /g' 2019-01-25 02:01:56 +03:00
Alexey Milovidov
5ccc42fd96 Revert "Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /'"
This reverts commit a28f0acf09.
2019-01-25 01:59:45 +03:00
Alexey Milovidov
a28f0acf09 Removed non-breaking spaces: find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xc2\xa0' | xargs sed -i -r -e 's/\xc2\xa0/ /' 2019-01-24 22:49:36 +03:00
Alexey Milovidov
04fa827e4b Style 2019-01-24 22:21:47 +03:00
alexey-milovidov
f96b8e4ed6
Merge pull request #4005 from vitlibar/add-protobuf-output-format
Add protobuf output format
2019-01-24 22:05:23 +03:00
Nikolai Kochetov
f7b9059dad Merged with master 2019-01-24 18:06:11 +03:00
Nikolai Kochetov
5f1007a8df Refactor Join. 2019-01-24 17:56:04 +03:00
Vitaly Baranov
1e7a231c56 Implemented main class for writing protobufs. 2019-01-24 17:54:52 +03:00
Vitaly Baranov
42d9d4e81d Implemented storage for parsed protobuf schemas. 2019-01-24 17:32:10 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Nikolai Kochetov
e8aa41b6ac Merge branch 'master' into unified-sets 2019-01-21 13:40:47 +03:00
Nikolai Kochetov
6fce028b56 Refactor ColumnsHashing. 2019-01-21 13:39:53 +03:00
Nikolai Kochetov
d207498573 Added ColumnsHashing 2019-01-21 13:39:24 +03:00
Alexey Milovidov
a7c468da8e Merge remote-tracking branch 'origin/master' into global-thread-pool 2019-01-17 21:57:01 +03:00
alexey-milovidov
0ec1fdef04
Merge pull request #3960 from yandex/zk-columns-compact-storage
Compact storage of the part header in ZooKeeper
2019-01-17 17:05:01 +03:00
Danila Kutenin
12bcff48ee Miscellaneous and some optimizations 2019-01-16 20:41:08 +03:00
Alexey Zatelepin
be6a8d6118 fix clang build 2019-01-16 19:42:02 +03:00
Alexey Milovidov
7d03804d06 Miscellaneous #4053 2019-01-16 16:57:11 +03:00
comunodi
51384fd691 Add basic functionality for dict 2019-01-16 01:08:56 +03:00
Danila Kutenin
ce90ad32d1 some style 2019-01-15 19:26:14 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Danila Kutenin
a5669b6b7a MultiVolnitsky added with tests and some benchmark, many multiFunctions are added to support multistring search 2019-01-14 18:54:47 +03:00