Commit Graph

1791 Commits

Author SHA1 Message Date
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
3c7178a8d1
Merge pull request #5923 from yandex/add-noreturn
Add two more warnings from -Weverything
2019-07-09 00:10:35 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
a5cce21ebd Addition to prev. revision 2019-07-08 19:53:49 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
e64e520e5b One more fix for PVS-Studio 2019-07-08 03:11:39 +03:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
Nikita Lapkov
6b7f587156 cut large query_ids 2019-07-05 14:16:20 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
alexey-milovidov
101b317efa
Merge pull request #5850 from PerformanceVision/top_k_weighted_fix
Add element on SpaceSaving set if the last element has a lower value compared to the last one
2019-07-05 10:57:11 +03:00
Guillaume Tassery
53d67103e7 Add documentation about removing the lowest element for the SpaceSaving set 2019-07-05 09:20:27 +02:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Guillaume Tassery
85151b339b Add test on topKWeighted function 2019-07-04 15:15:08 +02:00
CurtizJ
f3ac23fd48 add logging about DNS resolution errors 2019-07-04 13:38:44 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
CurtizJ
8eda3b5de4 fix deadlock in getHostName 2019-07-04 02:05:59 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
c880e00ffa Start writing tests 2019-07-03 19:00:24 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
Guillaume Tassery
81e39744e2 Add element on the SpaceSavingSet if the last element has a smaller weight value compared to the new one 2019-07-03 13:49:03 +02:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
Alexander Kuzmenkov
90c40dccc8 Disable copy and move for AllocatorWithStackMemory.
Since this allocator uses its own buffer field for small allocations,
moving or copying it is ill-defined, because someone might already
use the pointers to its body.
2019-07-02 20:48:33 +03:00
Alexander Kuzmenkov
f6ee2ea4e4 Add asan integration to arenas. 2019-07-02 20:48:00 +03:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
33cff5ee0f Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-30 17:24:15 +03:00
Alexey Milovidov
f25b96bed2 Moved a few tests to gtest 2019-06-30 02:23:53 +03:00
Alexey Milovidov
b76d5a7cf0 Added a test (not gtest though) 2019-06-30 01:45:57 +03:00
Alexey Milovidov
299607a301 ThreadPool: more informative error message if exception is thrown before we schedule a next thread #5305 2019-06-30 01:37:46 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
alexey-milovidov
a0d3db8d9b
Merge pull request #5787 from yandex/aku/podarray-bytes
Fix initial size of some inline PODArray's.
2019-06-29 15:34:00 +03:00
Danila Kutenin
614ec98a42 Fix runtime of SPLIT_SHARED_LIBRARIES build 2019-06-28 21:26:24 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
Alexander Kuzmenkov
a719933c58 Fix initial size of some inline PODArray's.
A template parameter of PODArray named INITIAL_SIZE didn't make its
units clear, which made some callers to erroneously assume that it
specifies the number of elements and not the number of bytes.
Rename it, fix the wrong usages and, where possible, use the
PODArrayWithStackMemory typedef for arrays with inline memory.
2019-06-28 16:03:14 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
Danila Kutenin
407cf9a229 Comments 2019-06-28 00:43:50 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Alexey Milovidov
e33d482271 Fixed warning in gcc-9 2019-06-27 17:44:39 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding
Gorilla column encoding
2019-06-26 12:53:12 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
66b0ae52d5 Added StopwatchGuard 2019-06-25 19:41:06 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
proller
da1814c2a8
Fix shared build (#5702) 2019-06-20 23:57:01 +03:00
dmitry kuzmin
3b45ac8bb6 fix macos compile 2019-06-20 13:26:19 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
Vasily Nemkov
0b68f55ce0 Fixed UB in maskLowBits 2019-06-19 18:36:34 +03:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes:
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alexey-milovidov
36c0e1f4c5
Merge branch 'master' into sanych73-prepared_statements 2019-06-17 09:33:04 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00
Alexey Milovidov
ba18308080 Merge branch 'master' into levysh-testkeeper 2019-06-16 02:45:34 +03:00
Alexey Milovidov
6418018385 Added comment 2019-06-16 02:35:12 +03:00
Alexey Milovidov
777af5544b Removed tons of trash
Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash

Removed tons of trash
2019-06-16 02:35:27 +03:00
levushkin aleksej
bc2789f9ad TestKeeper(mock ZooKeeper)
fix style

fix bug

one more fix style
2019-06-16 02:35:12 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug
Add database engine of MySQL type
2019-06-15 14:52:57 +03:00
zhang2014
ec8d73550b some review fixes 2019-06-15 11:39:04 +08:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
2019-06-13 11:58:58 +08:00
Danila Kutenin
4fd85b4136 Clearer interfaces of Searchers 2019-06-12 05:35:25 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Konstantin Podshumok
eb31345224 add timeouts to ConnectionPoolWithFailover and use max_tries from settings 2019-06-02 12:43:20 +03:00
alexey-milovidov
4819a34394
Merge pull request #5448 from yandex/low-cardinality
Add setting suspicious type for low cardinality (fixed #4965)
2019-05-31 07:35:19 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471)
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
2019-05-31 07:03:46 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Nikita Lapkov
3b54fde8a7 replace StackTrace with Backtrace 2019-05-30 10:30:24 +00:00
Alexey Milovidov
1607ec49ba Fixed linking with lld 2019-05-30 11:23:20 +03:00
stavrolia
4cd595b450 Add setting allow suspicious types for low cardinality with long message about error (fixed #4965) 2019-05-28 19:10:55 +03:00
Vitaly Baranov
1364cdd057 Fix ErrorCodes. 2019-05-28 03:08:12 +03:00
Yuriy
96c2bb383f using logging level from config.xml 2019-05-26 22:30:23 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Nikita Lapkov
b12db6e0e8 fix data race on trace_pipe close 2019-05-19 20:22:44 +00:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions
Improve new json functions
2019-05-18 12:51:41 +03:00
alexey-milovidov
1707cd79c8
Merge pull request #5297 from github1youlc/xid_equal_to_close_xid_deadlock_fix
fix deadlock when xid equal to close_xid
2019-05-17 11:45:35 +03:00
Vitaly Baranov
8ab4e4dcfe Use rapidjson when AVX2 instructions are not available. 2019-05-16 20:40:24 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
linceyou
c6108eec73 fix possible deadlock 2019-05-16 14:42:56 +08:00
proller
0da7463a6b
CLICKHOUSE-4519 Support dictionaries in clickhouse-copier (#5270) 2019-05-15 12:16:09 +03:00
Nikita Lapkov
ab69128e1d introduce Backtrace class 2019-05-14 22:15:23 +00:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
proller
cc3de4115f
Build fixes (#5261) 2019-05-14 12:58:33 +03:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
Danila Kutenin
8be1bc009a move CpuId to Common 2019-05-09 13:33:56 +03:00
Vitaly Baranov
7ace113ac0 Use custom cmake file for simdjson and fix build 2019-05-08 16:20:25 +03:00
Danila Kutenin
ced9805cc1 Remove condition of prefixes first 2019-05-05 15:26:20 +03:00
Danila Kutenin
e531348e12 Better condition 2019-05-05 12:34:43 +03:00
Danila Kutenin
451407a829 Fix word extraction if prefix candidate is small 2019-05-05 12:32:26 +03:00
Alexey Milovidov
50a9d733b4 Attempt to fix race condition in recursive RWLock 2019-05-05 05:01:23 +03:00
Alexey Milovidov
9537ff0594 Miscellaneous 2019-05-03 01:51:39 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
48e4dd9a9e Attach to current thread in threadpool. 2019-04-29 15:19:32 +03:00
Nikolai Kochetov
e6f86207c5 Attach to current thread in threadpool. 2019-04-29 15:11:01 +03:00
alexey-milovidov
0a88bcbb48
Merge pull request #5129 from kvinty/msd-radix-sort
[WIP] Add MSD radix sort
2019-04-29 04:50:27 +03:00
alexey-milovidov
8d2941fa60
Update RadixSort.h 2019-04-29 04:50:18 +03:00
Ivan
9edbbc637a
Fix segmentation fault on iterator double-free inside RWLock (#5127)
* Store the key instead of iterator, which may get invalidated by erasure from another instance.
* Add test
2019-04-27 22:12:35 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00