Commit Graph

2175 Commits

Author SHA1 Message Date
alexey-milovidov
ce73e17ff6
Merge pull request #6730 from yandex/fallback_o_direct
Fallback from O_DIRECT.
2019-08-30 16:08:19 +03:00
alesapin
d7e54d3c14 Merge branch 'master' of github.com:yandex/ClickHouse into ObjatieGroba-feature_multiple_disks 2019-08-30 12:53:24 +03:00
alexey-milovidov
358ad13930
Merge pull request #6715 from yandex/remove-mimalloc
Remove mimalloc
2019-08-30 00:41:33 +03:00
alesapin
1813b96f82 Finally build, possible trash. 2019-08-29 19:17:47 +03:00
Alexey Milovidov
a894288fa0 Fallback from O_DIRECT. 2019-08-29 18:48:00 +03:00
stavrolia
011c752ed7 Add unit test 2019-08-29 18:38:33 +03:00
Alexander Tokmakov
03c83169bd Merge branch 'master' into merging_template_format 2019-08-29 16:34:25 +03:00
Ivan
b4339f266d
Make a better build scheme (#6500)
* Fix shared build
* Major default libs refactor
* Fix build with gcc_eh
* Link all libraries as a big group.
* Use global interface library as a group
* Build capnproto using our cmake
* Use only internal libunwind
2019-08-28 23:49:37 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
alexey-milovidov
e2b05f6f9c
Merge pull request #6700 from yandex/aku/shm-5417-formatting
Formatting changes for StringHashMap PR #5417.
2019-08-28 18:30:59 +03:00
dimarub2000
6fe40a0d90
Merge branch 'master' into perfomance_test_help_size 2019-08-28 16:38:54 +03:00
Alexander Kuzmenkov
24a8755b82 Formatting changes for StringHashMap PR #5417. 2019-08-28 13:52:14 +03:00
Alexey Milovidov
f2d081a785 Addition to prev. revision 2019-08-28 03:42:45 +03:00
Alexey Milovidov
3db38c690e Changes to Benchmark after merge 2019-08-28 03:15:08 +03:00
alexey-milovidov
44424651b0
Merge pull request #6343 from dimarub2000/benchmark_comparison_mode
[WIP] Clickhouse-benchmark comparison mode
2019-08-28 02:38:07 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
stavrolia
f4e0dceddb some changes 2019-08-27 18:20:31 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive
Implemented hasTokenCaseInsensitive function
2019-08-27 00:39:04 +03:00
alexey-milovidov
9cdc434319
Merge pull request #6672 from yandex/aku/reverse-index
Separate the hash table interface for ReverseIndex.
2019-08-27 00:38:00 +03:00
Alexander Kuzmenkov
c0bb52ca6d Separate the hash table interface for ReverseIndex.
It is significantly different from other uses of hash tables, and poses
the main obstacle to changing the hash table interface to the one that
can be easily supported by compound hash tables.

Make it explicitly separate, implement it only for a particular kind of
HashTable, and move this implementation to the ReverseIndex module.
2019-08-26 21:00:44 +03:00
Dmitry Rubashkin
34fefcfa2f Merge branch 'perfomance_test_help_size' of github.com:dimarub2000/ClickHouse into perfomance_test_help_size 2019-08-26 19:46:28 +03:00
Dmitry Rubashkin
1da261576e Try fix2 2019-08-26 19:42:20 +03:00
alexey-milovidov
2f5e6158e7
Update TerminalSize.cpp 2019-08-26 16:27:12 +03:00
Dmitry Rubashkin
4f89dcc80d Try to fix 2019-08-26 15:47:19 +03:00
alesapin
062034dfd8 Eventually merged with master 2019-08-26 13:07:32 +03:00
Vasily Nemkov
d0d63d769e Implemented hasTokenCaseInsensitive function
And tests;
2019-08-26 11:00:48 +03:00
Alexey Milovidov
7144a3f827 Speed up MemoryTracker by function inlining 2019-08-25 01:06:13 +03:00
alexey-milovidov
95da4505f4
Merge pull request #6644 from 4ertus2/bugs
Fix crash in OptimizedRegularExpression
2019-08-24 15:09:04 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken
hasToken function implementation
2019-08-23 21:41:33 +03:00
chertus
a21b43913f fix crash in OptimizedRegularExpression 2019-08-23 21:40:42 +03:00
Alexander Tokmakov
1572d0c5b6 Merge branch 'master' into merging_template_format 2019-08-23 20:34:14 +03:00
alexey-milovidov
c781e1c6a7
Update StringSearcher.h 2019-08-23 19:09:24 +03:00
alexey-milovidov
50b927a9d7
Update StringSearcher.h 2019-08-23 19:08:27 +03:00
dimarub2000
859d97e8fd Renaming 2019-08-23 18:47:27 +03:00
Dmitry Rubashkin
9e6c629134 Style fixed 2019-08-23 17:54:10 +03:00
dimarub2000
6e098eb953 New line added :) 2019-08-23 16:25:46 +03:00
dimarub2000
a367f94923 Fix after review 2019-08-23 16:19:12 +03:00
Alexander Tokmakov
734a0f23a9 Merge branch 'master' into merging_template_format 2019-08-23 15:32:35 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
CurtizJ
659d3857ab fix build for clang 2019-08-23 02:48:20 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
2019-08-22 18:00:35 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
Dmitry Rubashkin
095124dcba setOptionsDescription() function added 2019-08-22 17:03:37 +03:00
alexey-milovidov
83104b3d5e
Merge pull request #6603 from amosbird/fix-dt-hash
Fix segfault when decoding symbol table.
2019-08-22 07:35:32 +03:00
alexey-milovidov
903601d3e3
Merge pull request #6600 from yandex/distributed-files-to-send-metric
Added a metric for the number of files to send in Distributed tables.
2019-08-22 07:34:09 +03:00
Amos Bird
78af6d793d Fix segfault when decoding symbol table. 2019-08-22 12:34:06 +08:00
Alexey Milovidov
c38a8cb755 Merge branch 'master' of github.com:yandex/ClickHouse 2019-08-22 05:32:00 +03:00
Alexey Milovidov
85d3ba099f Added a comment 2019-08-22 05:31:49 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast
Added checks to static_cast of columns.
2019-08-22 05:09:34 +03:00
Alexey Milovidov
6bbf3bd634 Added a metric for the number of files to send in Distributed tables 2019-08-22 04:30:49 +03:00
alesapin
eb5e052855 merge and fixes 2019-08-21 13:09:29 +03:00
alesapin
70ca7f4156 Merge with master 2019-08-21 11:57:35 +03:00
dimarub2000
086dd815ac T_test.h added, some fixes 2019-08-21 11:53:41 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
40454aa7a0 Addition to prev. revision 2019-08-21 05:46:54 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
17e93b8f2d Disable ELF on Mac OS #6429 2019-08-21 03:48:34 +03:00
Alexey Milovidov
f277d0ebbf Style 2019-08-21 03:37:55 +03:00
alex-zaitsev
1e6437e4ee WIP: Fix MacOS build (#6429)
* Fix broken MacOS build

* Fix MacOS build

* Update ReadBufferFromFile.cpp

* Update WriteBufferFromFile.cpp

* Update Elf.h

* Update Elf.h
2019-08-21 03:35:41 +03:00
alesapin
9c8ec6e4fc Fixes for replicated merge tree 2019-08-20 20:16:32 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
cdf1ce3171 Merge branch 'master' into vzakaznikov-liveview 2019-08-20 10:41:31 +03:00
stavrolia
2f2bf953eb fix and add test for storage file version 2019-08-19 21:12:50 +03:00
stavrolia
229dd7c2b6 wip 2019-08-19 21:12:50 +03:00
stavrolia
dbf1417bd6 Globs in storage file 2019-08-19 21:12:50 +03:00
alesapin
a85cdc91a6 Merge branch 'master' into ObjatieGroba-feature_multiple_disks 2019-08-19 11:34:02 +03:00
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alexey-milovidov
f36d20915b
Merge pull request #6529 from yandex/better-signals
Better debug-ability of fault signals.
2019-08-18 16:44:54 +03:00
alexey-milovidov
1b3f19abab
Update StackTrace.h 2019-08-18 03:03:19 +03:00
proller
d09c5c871b Build fixes (#6491)
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
2019-08-18 01:53:46 +03:00
Alexey Milovidov
306878c7a0 Write symbolized stack trace on failure one line at a time and uncached 2019-08-18 01:39:26 +03:00
Alexey Milovidov
081f1bedc2 Allowed to use SIGPROF to print stack traces for debugging purposes 2019-08-18 00:13:38 +03:00
Alexey Milovidov
2cd669fa1d Minor improvement 2019-08-17 23:33:50 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
alesapin
6333f4b074 Better 2019-08-16 12:20:44 +03:00
alesapin
f988ff538b Less code 2019-08-15 20:02:04 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
alesapin
1d22d98365 Less auto code 2019-08-14 18:31:19 +03:00
alesapin
bccf62100f Revert check 2019-08-14 18:25:57 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
CurtizJ
22d9bd06cc Merge branch 'dmitriiut-WITH_TIES_and_WITH_FILL' of https://github.com/dmitriiut/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 16:40:07 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
428c753ed7 Merge with master 2019-08-13 11:37:47 +03:00
alexey-milovidov
ed0411a414
Merge pull request #6456 from nikitamikhaylov/current_thread_init
CurrentThread initialization bug
2019-08-12 22:29:23 +03:00
Nikolai Kochetov
292758a321
Update CurrentThread.cpp 2019-08-12 19:33:21 +03:00
Nikolai Kochetov
ae18a6e438
Update CurrentThread.h 2019-08-12 19:07:53 +03:00
Nikolai Kochetov
1cab72450b
Update CurrentThread.cpp 2019-08-12 19:06:34 +03:00
Nikita Mikhaylov
ad5c7c0b65 done 2019-08-12 18:16:23 +03:00
chertus
2b47839a98 fix memory tracking under sanitizers 2019-08-12 15:21:07 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
5830526fa1 Slightly better information messages 2019-08-11 23:37:53 +03:00
alexey-milovidov
7c3632635d
Merge pull request #6404 from CurtizJ/fix-topk
Fix topK and topKWeighted functions.
2019-08-11 05:15:51 +03:00
alexey-milovidov
838c5e535f
Merge pull request #6433 from yandex/prevent-stack-overflow-in-parser
Fixed possible stack overflow in parser
2019-08-10 23:58:54 +03:00
Alexey Milovidov
afef5c6c70 Added stack protection; added a test 2019-08-10 20:51:47 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
CurtizJ
ead6336d2c function topK: fix merge stage and fix memory leaks 2019-08-09 13:11:50 +03:00
alexey-milovidov
b579692fe9
Merge pull request #6378 from 4ertus2/bugs
Fix crash in median over Nullable(Decimal128)
2019-08-08 22:32:11 +03:00
alexey-milovidov
0ece3708e7
Update PODArray.h 2019-08-08 19:07:58 +03:00
alesapin
e0d18c0fe8 Merge branch 'master' into merge_tree_settings_alter 2019-08-08 18:16:22 +03:00
CurtizJ
a56d897c2c better performance in topK function 2019-08-08 16:06:27 +03:00
chertus
d67abcf691 better alignment 2019-08-08 15:11:54 +03:00
CurtizJ
3c227dce13 fix topK and topKWeighted functions 2019-08-08 14:27:15 +03:00
Alexey Milovidov
a6a9eaef7c Fix for Mac OS build 2019-08-08 00:53:50 +03:00
alexey-milovidov
355b1e5594
Merge pull request #6352 from yandex/no_space_left_on_device_message
Print extra info in exception message for "no space left on device"
2019-08-07 22:28:38 +03:00
chertus
9c15e65dc9 alignment for AllocatorWithStackMemory 2019-08-07 21:43:06 +03:00
Alexander Tokmakov
5cf183cbe3 fixes after review 2019-08-07 15:55:27 +03:00
Alexander Tokmakov
0ee3e21fbc fix style 2019-08-06 23:39:07 +03:00
Alexander Tokmakov
aefc664819 refactor throwFromErrno 2019-08-06 21:54:06 +03:00
Alexander Tokmakov
c3039196da fixes 2019-08-06 17:51:27 +03:00
alesapin
52b9658bcf Merge with master 2019-08-06 15:55:12 +03:00
Alexander Tokmakov
c96b10be9f style fixes 2019-08-06 15:51:10 +03:00
Alexey Milovidov
eadb6ef1a4 Suppress PVS-Studio warning 2019-08-05 22:48:23 +03:00
Alexander Tokmakov
75d10f4160 print extra info in exception message 2019-08-05 22:41:20 +03:00
chertus
ef7d19e143 better JOIN exception messages #5565 2019-08-05 17:03:14 +03:00
Alexey Milovidov
ddf3466af3 Avoid using #N in logs, because it will link bogus issues and pull requests when posted on GitHub 2019-08-05 01:28:13 +03:00
proller
77bd2624ea Build fixes (#6016)
* Fix building without submodules

* Fix more gcc9 warnings

* was wrong!
../dbms/src/IO/WriteBufferAIO.cpp:277:54: error: result of comparison 'ssize_t' (aka 'long') > 9223372036854775807 is always false [-Werror,-Wtautological-type-limit-compare]
    if ((static_cast<ssize_t>(flush_buffer.offset()) > std::numeric_limits<off_t>::max()) ||
         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

* mimalloc off MI_OVERRIDE

* Fix freebsd build

* Fix shared build

* Fix build in gcc9

* Fix split build

* fix

* fix

* fix

* fix

* clean

* zstd

* Update CMakeLists.txt

* Update Defines.h

* Try fix -Wsign-compare

* Freebsd fix

* Add missing libs

* Fix double-conversion include for copy-headers

* Fix zlib link

* Fix includes for arcadia

* Fix includes for arcadia

* Fix includes for arcadia

* Freebsd fix

* Arcadia fixes

* Update QueryProfiler.cpp

* Freebsd fix

* clean

* 19.11: Fixes for arcadia porting (#6223)

* fix glibc-compatibility

* M_LIBRARY fix

* wip

* Fix

* Fix arm build

* unwind fix

* Update CMakeLists.txt
2019-08-04 03:19:03 +03:00
Alexey Milovidov
06b99e61aa Fixed "unbundled" build 2019-08-03 23:47:57 +03:00
Alexey Milovidov
9f6e26f14d Fixed tests 2019-08-03 04:10:13 +03:00
Alexey Milovidov
4f8d1872d2 Merge branch 'master' of github.com:yandex/ClickHouse into fix-thread-pool-hang-if-full 2019-08-03 02:51:46 +03:00
alexey-milovidov
9af4542230
Merge pull request #6278 from yandex/fix_bool_settings_parsing
Fix bool settings parsing
2019-08-03 01:55:42 +03:00
alexey-milovidov
f149e3b436
Merge pull request #6277 from yandex/aku/pairnoinit
Make PairNoInit a simple struct.
2019-08-02 22:56:12 +03:00
Alexey Milovidov
67d91c4b88 Fixed the possibility of hanging queries when server is overloaded 2019-08-02 20:14:04 +03:00
alesapin
46a6a78e7b Merge branch 'master' into fix_bool_settings_parsing 2019-08-02 10:51:42 +03:00
Alexey Milovidov
07273c7914 Instrumented ThreadPool 2019-08-01 23:09:38 +03:00
alesapin
7c37450c3d Better code and tests 2019-08-01 20:43:10 +03:00
Alexander Kuzmenkov
011150fa8a Make PairNoInit a simple struct. 2019-08-01 19:54:33 +03:00
Igr Mineev
0f1e8404dc Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-08-01 13:42:59 +03:00
alexey-milovidov
eeeab85bbe
Merge pull request #6247 from yandex/fix-malicious-replica
Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path.
2019-08-01 07:22:58 +03:00
Alexey Milovidov
591af05e57 Fixed error with searching debug info 2019-08-01 06:45:33 +03:00
Alexey Milovidov
49b6749280 Merge branch 'master' into fix-malicious-replica 2019-08-01 05:11:45 +03:00
alexey-milovidov
10d02cd2b9
Merge pull request #6250 from yandex/better-stack-traces
QueryProfiler: better stack traces: start outside of signal handler
2019-08-01 04:34:32 +03:00
Alexey Milovidov
f3921ce3e0 Changed boost::filesystem to std::filesystem 2019-08-01 01:37:41 +03:00
Alexey Milovidov
e3c342d893 Better stack traces: start outside of signal handler 2019-08-01 00:40:29 +03:00
Alexey Milovidov
bc9d620155 Fixed the case when malicious ClickHouse replica can force clickhouse-server to write to arbitrary path 2019-07-31 22:31:04 +03:00
BayoNet
cf746c3eed DOCAPI-3825: System tables. EN review, RU translation. (#6088) 2019-07-31 08:09:13 +03:00
alexey-milovidov
7fd6204114
Merge pull request #6197 from yandex/thread_local_rng
Less number of "clock_gettime" calls; fixed ABI compatibility between debug/release in Allocator.
2019-07-31 04:36:30 +03:00
Alexey Milovidov
a9b079c7ba Minor modifications 2019-07-30 19:18:06 +03:00
Igr Mineev
7f7b47fc0a Add check of RW access to paths on start. Add multiple disks tests. 2019-07-30 19:15:57 +03:00
Igr Mineev
31c36efa25 Merge branch 'master' of github.com:yandex/ClickHouse into feature_multiple_disks 2019-07-30 19:13:58 +03:00
Alexey Milovidov
72e0fbd861 Added support for splitted debug info; advancements 2019-07-30 19:12:53 +03:00
Alexey Milovidov
256e260693 Added one more function for introspection 2019-07-30 02:37:50 +03:00
Alexey Milovidov
372c4d89b2 Enabled line numbers in stack traces 2019-07-30 01:26:44 +03:00
Alexey Milovidov
15dc6d1818 Advancements 2019-07-29 21:38:04 +03:00
Alexey Milovidov
daa36650fb Imported Dwarf parser from Facebook folly 2019-07-29 21:06:39 +03:00
Alexey Milovidov
957b59f0d0 Cleanups 2019-07-29 20:14:53 +03:00
Alexey Milovidov
300d25256e Include private symbols in stack traces of QueryProfiler 2019-07-29 15:48:19 +03:00
alesapin
86831fe500 Add ability to create immutable settings 2019-07-29 14:03:50 +03:00
alesapin
d9a2ac123a Fix small typo and merge 2019-07-29 12:17:37 +03:00
Alexey Milovidov
5fbe53b562 Speedup "symbolizeAddress" function 2019-07-29 04:08:52 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Alexey Milovidov
32a9b27876 Added a comment 2019-07-28 17:55:02 +03:00
Alexey Milovidov
98c3ff92ae Fixed non-standard build 2019-07-27 20:04:26 +03:00
Alexey Milovidov
da3806bf36 Add timer offset randomization 2019-07-26 03:51:19 +03:00
Alexey Milovidov
cf67765fc8 Reverted bad modification 2019-07-26 01:38:59 +03:00
Alexey Milovidov
5a47b0b990 Sanity and configuration checks 2019-07-26 01:35:47 +03:00
Alexey Milovidov
472a61c1fa Updating PHDRCache after dlopen 2019-07-25 22:56:51 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
chertus
50e3839157 NOT_UNBUNDLED -> UNBUNDLED 2019-07-25 13:35:57 +03:00
alexey-milovidov
f1f5cdc802
Merge pull request #6144 from yandex/fix-msan
Fixed MSan report
2019-07-25 04:29:11 +03:00
Alexey Milovidov
6b2810d346 Fixed error with non-SIMD implementation of memcmpSmall 2019-07-25 03:28:27 +03:00
Alexey Milovidov
5755c93d5c Fixed MSan report 2019-07-25 01:31:39 +03:00
Alexey Milovidov
cfb2066198 Added information about thread number to trace log 2019-07-24 23:10:23 +03:00
Alexey Milovidov
d9976abe18 Added ProfileEvents for signal handler overruns 2019-07-24 22:19:29 +03:00
Alexey Milovidov
63764af4fb Merge branch 'merge-profiler' of github.com:yandex/ClickHouse into merge-profiler 2019-07-24 22:04:13 +03:00
Alexey Milovidov
6e8258fa2f Added ProfileEvent for dropped traces due to pipe full 2019-07-24 22:04:07 +03:00
Alexey Milovidov
f031d064b6 Don't drop all traces if frequency is too high 2019-07-24 22:03:26 +03:00
alesapin
8a00ce5ff1 Intermediate step 2019-07-24 15:56:39 +03:00
Alexey Milovidov
56bb2956cd Addition to prev. revision 2019-07-24 05:07:16 +03:00
Alexey Milovidov
b9105e131f Avoid deadlock in TraceCollector 2019-07-24 05:02:10 +03:00
Alexey Milovidov
33ee957b5c Addition to prev. revision 2019-07-24 03:49:14 +03:00
Alexey Milovidov
378fff2990 Lower bound on profiler period 2019-07-24 03:46:37 +03:00
Alexey Milovidov
02fb67dc8a Simple protection from too frequent profiler signals 2019-07-23 21:45:54 +03:00
dimarub2000
752eccf2eb changes after review 2019-07-23 17:41:41 +03:00
Dmitry Rubashkin
13ef987361 Git commit fixes 2019-07-23 16:53:25 +03:00
Dmitry Rubashkin
4d43cf2a8d config exception when not corresponding root names 2019-07-23 16:53:25 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks 2019-07-23 16:38:20 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
Alexander Tokmakov
12e08417d6 Template format implementation 2019-07-22 00:57:57 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
Mikhail Filimonov
9c2ae4513d SensitiveDataMasker 2019-07-19 10:22:42 +02:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
Alexey Milovidov
1937623f18 Better test 2019-07-15 22:13:43 +03:00
alexey-milovidov
1597103107
Merge pull request #6017 from yandex/mimallocexceptions
Add OOM checks in mimalloc
2019-07-15 22:10:05 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Alexey Milovidov
a175c55136 Added a test that shows catastrophic behaviour of mimalloc 2019-07-15 21:49:30 +03:00
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
3c7178a8d1
Merge pull request #5923 from yandex/add-noreturn
Add two more warnings from -Weverything
2019-07-09 00:10:35 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
a5cce21ebd Addition to prev. revision 2019-07-08 19:53:49 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
e64e520e5b One more fix for PVS-Studio 2019-07-08 03:11:39 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
Nikita Lapkov
6b7f587156 cut large query_ids 2019-07-05 14:16:20 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
alexey-milovidov
101b317efa
Merge pull request #5850 from PerformanceVision/top_k_weighted_fix
Add element on SpaceSaving set if the last element has a lower value compared to the last one
2019-07-05 10:57:11 +03:00
Guillaume Tassery
53d67103e7 Add documentation about removing the lowest element for the SpaceSaving set 2019-07-05 09:20:27 +02:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Guillaume Tassery
85151b339b Add test on topKWeighted function 2019-07-04 15:15:08 +02:00
CurtizJ
f3ac23fd48 add logging about DNS resolution errors 2019-07-04 13:38:44 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
CurtizJ
8eda3b5de4 fix deadlock in getHostName 2019-07-04 02:05:59 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
c880e00ffa Start writing tests 2019-07-03 19:00:24 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
Guillaume Tassery
81e39744e2 Add element on the SpaceSavingSet if the last element has a smaller weight value compared to the new one 2019-07-03 13:49:03 +02:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
Alexander Kuzmenkov
90c40dccc8 Disable copy and move for AllocatorWithStackMemory.
Since this allocator uses its own buffer field for small allocations,
moving or copying it is ill-defined, because someone might already
use the pointers to its body.
2019-07-02 20:48:33 +03:00
Alexander Kuzmenkov
f6ee2ea4e4 Add asan integration to arenas. 2019-07-02 20:48:00 +03:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
Alexey Milovidov
33cff5ee0f Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-30 17:24:15 +03:00
Alexey Milovidov
f25b96bed2 Moved a few tests to gtest 2019-06-30 02:23:53 +03:00
Alexey Milovidov
b76d5a7cf0 Added a test (not gtest though) 2019-06-30 01:45:57 +03:00
Alexey Milovidov
299607a301 ThreadPool: more informative error message if exception is thrown before we schedule a next thread #5305 2019-06-30 01:37:46 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
alexey-milovidov
a0d3db8d9b
Merge pull request #5787 from yandex/aku/podarray-bytes
Fix initial size of some inline PODArray's.
2019-06-29 15:34:00 +03:00
Danila Kutenin
614ec98a42 Fix runtime of SPLIT_SHARED_LIBRARIES build 2019-06-28 21:26:24 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
Alexander Kuzmenkov
a719933c58 Fix initial size of some inline PODArray's.
A template parameter of PODArray named INITIAL_SIZE didn't make its
units clear, which made some callers to erroneously assume that it
specifies the number of elements and not the number of bytes.
Rename it, fix the wrong usages and, where possible, use the
PODArrayWithStackMemory typedef for arrays with inline memory.
2019-06-28 16:03:14 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
Danila Kutenin
407cf9a229 Comments 2019-06-28 00:43:50 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Alexey Milovidov
e33d482271 Fixed warning in gcc-9 2019-06-27 17:44:39 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
alexey-milovidov
dca6d2947c
Merge pull request #5600 from Enmk/gorilla_column_encoding
Gorilla column encoding
2019-06-26 12:53:12 +03:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
66b0ae52d5 Added StopwatchGuard 2019-06-25 19:41:06 +03:00
alesapin
4a8a70a079
Merge pull request #5720 from coraxster/fix-5377
MergedColumnOnlyOutputStream. Skip empty blocks. Fix 5377
2019-06-25 13:35:09 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
proller
da1814c2a8
Fix shared build (#5702) 2019-06-20 23:57:01 +03:00
dmitry kuzmin
3b45ac8bb6 fix macos compile 2019-06-20 13:26:19 +03:00
proller
3d8c8ee83c
Build fixes. Split config.h (#5686) 2019-06-20 12:12:49 +03:00
Vasily Nemkov
0b68f55ce0 Fixed UB in maskLowBits 2019-06-19 18:36:34 +03:00
Vasily Nemkov
e79c3d0e22 Post-PR fixes stage 3
maskLowBits()
building for clang
more test cases for codecs.
2019-06-19 13:38:15 +03:00
alexey-milovidov
9bdbd84263
Merge pull request #5030 from PerformanceVision/top_level_domain
Changing how the function (cutTo)firstSignificantSubdomain detect the tld (proposal)
2019-06-19 02:08:43 +03:00
Vasily Nemkov
81f9055d81 Post-PR fixes #2
Fixed style issues and build for clang-7;
64-bit buffer for BitReader and BitWriter;
Fixed overflow and writing more bytes on flushing;
Added maskLowBits() and tests for it.
2019-06-17 21:49:01 +03:00
Vasily Nemkov
0ebb145d32 Post-PR fixes:
* BitHelpers.cpp was removed, corresponding code was moved to the header
* BitIO test as GTest-based test binary
* gtest-based unit test for DoubleDelta and Gorilla codecs
* getLeadingZeroBits from SFINAE to consexpr if
* removed couple of unneeded if's
* Fixed sql-test to use one table
2019-06-17 21:39:45 +03:00
Vasily Nemkov
dfd8ff7675 Gorilla column encoding
Added Gorilla column encoding for any fixed-width type;
Added tests for Float32 and Float64 values.
2019-06-17 21:39:42 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
alexey-milovidov
36c0e1f4c5
Merge branch 'master' into sanych73-prepared_statements 2019-06-17 09:33:04 +03:00
alexey-milovidov
5fd319d0e9
Merge pull request #5648 from yandex/remove-number-of-stat-calls
Reduce number of "stat" syscalls for MergeTree data parts
2019-06-17 09:30:29 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
801f34d325 Reduce number of "stat" syscalls for MergeTree data parts 2019-06-16 22:42:05 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00