Commit Graph

9010 Commits

Author SHA1 Message Date
Andrey Skobtsov
b0a3dc2b88 Moved static on top of thread_local 2020-05-19 01:15:04 +03:00
Andrey Skobtsov
e46cabe1d8 UInt64 numbers to track active counters instead of memory addresses 2020-05-19 01:13:55 +03:00
Andrey Skobtsov
979b357c05 Removed unused method 2020-05-19 00:46:46 +03:00
Artem Zuikov
97c7447130
Bitonic sort improvements (#10934) 2020-05-19 00:41:23 +03:00
Andrey Skobtsov
901f546aee Fixed 0 value of paranoid handling 2020-05-19 00:40:15 +03:00
Andrey Skobtsov
1edd29b3f8 Removed custom events as they don't work in an "increment" manner 2020-05-18 15:23:47 +03:00
Andrey Skobtsov
e7bea6e03a Renamed events 2020-05-18 14:44:40 +03:00
Andrey Skobtsov
182e4f2c0b Added running and enabled time for perf metrics 2020-05-18 13:40:01 +03:00
Artem Zuikov
0fe723acc9
Try to fix arcadia sync (#10959) 2020-05-18 13:26:23 +03:00
alesapin
07cb21ccb7
Merge branch 'master' into refactor-reservations 2020-05-18 11:43:48 +03:00
alexey-milovidov
a316184bef
Merge pull request #10990 from ClickHouse/odbc-bridge-wait-exp-backoff
Wait for odbc-bridge with exponential backoff
2020-05-18 10:17:59 +03:00
Nikolai Kochetov
cdb742dd4b Added comment. 2020-05-18 09:06:48 +03:00
Nikolai Kochetov
fcde0d36bd
Merge pull request #10978 from ClickHouse/static-mutate
Try fix performance after static mutate.
2020-05-18 09:02:24 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final
Parallel final
2020-05-18 05:20:18 +03:00
Alexey Milovidov
b0a5ce7743 Enable clang-tidy for programs and utils 2020-05-18 04:19:50 +03:00
Alexey Milovidov
7b5dfd9c00 Wait for odbc-bridge with exponential backoff 2020-05-18 04:06:04 +03:00
Nikolai Kochetov
aab2599fad Fix build. 2020-05-17 23:26:53 +03:00
alexey-milovidov
6f1d522b6a
Merge pull request #10980 from azat/database-atomic-fixes
Database atomic fixes
2020-05-17 23:25:56 +03:00
alexey-milovidov
8d3c37992a
Merge pull request #10533 from ClickHouse/alter-key-column-better-exception-message
Better exception message and error code for ALTER of key column #9078
2020-05-17 22:21:14 +03:00
Nikolai Kochetov
c8e7ea0d6c Try fix performance. 2020-05-17 21:55:49 +03:00
Azat Khuzhin
31035a3cd1 Allow relative path for renameat2 by using AT_FDCWD
Otherwise this will trigger logical error on CREATE TABLE with default
config.d overrides (path=./).
2020-05-17 17:02:03 +03:00
Andrey Skobtsov
40ad18be8e Fixed compilation namespace issue and formatting 2020-05-17 16:56:17 +03:00
alexey-milovidov
a3346e9331
Merge pull request #10912 from ClickHouse/static-mutate
Static mutate
2020-05-17 09:05:35 +03:00
Alexey Milovidov
9fcfe5fb14 Better exception message and error code for ALTER of key column #9078 2020-05-17 07:46:25 +03:00
Andrey Skobtsov
cae41826a8 Merge branch 'master' into perf_events_metrics
# Conflicts:
#	src/Common/ThreadProfileEvents.cpp
#	src/Common/ThreadProfileEvents.h
#	src/Common/ThreadStatus.cpp
#	src/Common/ThreadStatus.h
2020-05-17 00:21:22 +03:00
Gleb Novikov
1a25ac6e1f Merge branch 'master' into refactor-reservations 2020-05-16 23:34:45 +03:00
Azat Khuzhin
c059ee0085 Use is_trivial+is_standard_layout over is_pod (later is deprecated) 2020-05-16 00:00:38 +03:00
Vitaly Baranov
d92ac9ea47
Merge branch 'master' into RBAC-10 2020-05-15 14:12:43 +03:00
Nikolai Kochetov
70ce0149b1 Try fix build. 2020-05-15 13:10:13 +03:00
alexey-milovidov
985b83a228
Merge pull request #10903 from ClickHouse/lexer-unicode-whitespaces
Support for unicode whitespaces in queries.
2020-05-15 10:31:59 +03:00
Artem Zuikov
8e8a2a17d6 build fixes 2020-05-15 03:01:31 +03:00
Ri
fc7afaa639
Bitonic sort on GPU (OpenCL) (#10232) 2020-05-15 03:01:14 +03:00
Alexey Milovidov
81a5d02628 Fix annoying "Arcadia" build 2020-05-14 20:05:55 +03:00
Nikolai Kochetov
4d22374f24 Merged with master. 2020-05-14 12:06:15 +03:00
Nikolai Kochetov
d68c385d35 Remove old code. 2020-05-14 11:59:15 +03:00
Nikolai Kochetov
4d0503f021 Make IColumn::mutate() static. 2020-05-14 11:30:18 +03:00
Alexey Milovidov
770cc9e863 Fix "Arcadia" build that is using obsolete version of C++ standard 2020-05-14 02:12:16 +03:00
Alexey Milovidov
c3cea85b10 Support for unicode whitespaces in Lexer 2020-05-14 00:31:57 +03:00
alexey-milovidov
623b2e5a43
Merge pull request #10849 from ClickHouse/fix_optimize_and_alter_hangs
Fix mutations and OPTIMIZE hangs when replica becomes inactive
2020-05-13 23:41:13 +03:00
alexey-milovidov
63c6eb1a37
Update ZooKeeper.h 2020-05-13 23:40:54 +03:00
Vitaly Baranov
dd8b29b4fb Use enum Type instead of std::type_index to represent the type of IAccessEntity.
This change simplifies handling of access entities in access storages.
2020-05-13 19:40:48 +03:00
tavplubix
39518fe725
trigger CI 2020-05-13 16:45:39 +03:00
Alexander Tokmakov
032197b015 fix alter and optimize hangs when replica becomes inactive 2020-05-13 10:06:57 +03:00
Azat Khuzhin
e102ad373a Fix SIGSEGV in StringHashTable if such key is not exists 2020-05-13 03:40:05 +03:00
Dmitry
c4295d97f9 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-12 17:57:32 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final 2020-05-11 06:47:44 +03:00
Gleb Novikov
57b6fb6d80 Merge branch 'master' into refactor-reservations 2020-05-10 13:01:45 +03:00
Gleb Novikov
a961e049a2 VolumeType as class with enum member class 2020-05-10 09:26:33 +03:00
Alexey Milovidov
dda2151f71 Fix build 2020-05-10 02:35:20 +03:00
Alexey Milovidov
fb32dbe6ee Enable more warnings 2020-05-10 00:44:33 +03:00
Gleb Novikov
390b39b272 VolumePtr instead of DiskPtr in MergeTreeData* 2020-05-10 00:24:15 +03:00
Azat Khuzhin
150dd81e3b Fix build with unbundled Poco 2020-05-09 01:22:12 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396)
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Alexey Milovidov
dea8d366c9 Loose some limitation 2020-05-07 04:29:31 +03:00
alexey-milovidov
443c64abc0
Merge pull request #10638 from ClickHouse/fix-ubsan-hashtable
Fix UBSan report in HashTable
2020-05-04 04:50:25 +03:00
Alexey Milovidov
bb6eabd82d Fix HTTP response code for some parse errors #10636 2020-05-03 22:47:07 +03:00
Alexey Milovidov
8f7374c6de Fix another UBSan warning 2020-05-03 21:39:52 +03:00
Alexey Milovidov
9a344e681f Fix UBSan report in FixedHashTable 2020-05-03 21:24:11 +03:00
Alexey Milovidov
626b9a3ae9 Fix UBSan report in HashTable 2020-05-03 21:21:18 +03:00
Alexey Milovidov
600b396f1b Merge remote-tracking branch 'origin/master' into sampling-memory-profiler 2020-05-01 21:48:20 +03:00
Alexander Kazakov
e9baaa439b
Implementation of new system metrics provider (Procfs) (#10544)
* New metrics provider (Procfs) + Refactored TasksStatsCounters

* Trivial statless test that ProcFS is provided

* Trivial perf test for ProcfsMetricsProvider

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-05-01 21:47:41 +03:00
Alexey Milovidov
c4b64edc14 Merge branch 'master' into sampling-memory-profiler 2020-05-01 16:47:10 +03:00
Alexander Kuzmenkov
2ac26bd3a5 Disable mremap under MemorySanitizer. 2020-05-01 10:38:05 +03:00
Alexey Milovidov
293ae88e7f Add sampling memory profiler 2020-04-30 16:25:17 +03:00
Nikolai Kochetov
19dadb8c2d Add parallel final. 2020-04-30 12:59:08 +03:00
Alexey Milovidov
a7d7dc5034 Fix some bad code 2020-04-26 20:34:36 +03:00
alexey-milovidov
378d73d477
Merge pull request #10449 from azat/metrics-for-new-bg-schedule-pools
Add tasks/memory metrics for distributed/buffer schedule pools
2020-04-26 20:16:02 +03:00
Dmitry
d9ac0e8fef Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-26 14:44:06 +03:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic
DatabaseAtomic
2020-04-24 22:28:18 +03:00
Alexander Tokmakov
04d4130b0d update yamake 2020-04-24 20:14:10 +03:00
alexey-milovidov
79d531af87
Merge pull request #10466 from ClickHouse/aku/arena-infinite-loop
Work around a bug leading to an infinite loop in addressToLine
2020-04-24 10:38:07 +03:00
Alexander Kuzmenkov
2bedc82c18 Work around a bug leading to an infinite loop in addressToLine.
Fixing this is hopeless and would entail rewriting the entire
WriteBuffer thing, and also this hack is something we can backport.
2020-04-24 02:42:04 +03:00
Andrey Skobtsov
b6a5b1b12f Fix styling 2020-04-23 22:38:15 +03:00
Andrey Skobtsov
0cf949f1b5 A bit of reformatting code 2020-04-23 21:50:12 +03:00
Andrey Skobtsov
30a87a8a58 perf events' values are 64 bit unsigned; so, read them instead of the signed ones 2020-04-23 21:50:12 +03:00
Andrey Skobtsov
30e19c3abb Using the same file descriptors for all counters on the current thread (only one instance of PerfEventsCounters can be active at a given time for a thread) 2020-04-23 21:50:12 +03:00
Alexander Tokmakov
15e7ce0053 fixes 2020-04-23 21:00:43 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Alexander Kuzmenkov
9ed9475e46
boop the CI 2020-04-23 03:55:03 +03:00
Azat Khuzhin
d854049d21 Add tasks/memory metrics for distributed/buffer schedule pools
Follow-up-for: #10315
Follow-up-for: #10263
2020-04-23 02:18:37 +03:00
alexey-milovidov
fd27ce619b
Merge pull request #10444 from ClickHouse/server-memory-profiler
Simple server wide memory profiler
2020-04-23 00:34:23 +03:00
Alexey Milovidov
73dd78bac1 Merge branch 'master' into clang-tidy-8 2020-04-22 21:04:47 +03:00
Alexey Milovidov
07dcf40a6a Simple server wide memory profiler 2020-04-22 20:52:21 +03:00
Alexey Milovidov
d189375051 Fix Mac OS build 2020-04-22 17:56:31 +03:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Alexey Milovidov
03e17405cd Checkpoint 2020-04-22 10:03:43 +03:00
alexey-milovidov
7065a8ba9c
Merge pull request #10422 from azat/fallback_to_stale_replicas-over-skip_unavailable_shards
Prefer fallback_to_stale_replicas over skip_unavailable_shards
2020-04-22 09:20:25 +03:00
Alexey Milovidov
be22a4b94e Checkpoint 2020-04-22 08:39:31 +03:00
Alexey Milovidov
c805ed4dea Fixes for clang-tidy on clang-10 2020-04-22 03:29:38 +03:00
Azat Khuzhin
0cc9dbd35b Prefer fallback_to_stale_replicas over skip_unavailable_shards
Patch from: @alex-zaitsev
2020-04-22 01:42:23 +03:00
Ivan
555488a458
Fix build in Arcadia (#10413) 2020-04-21 23:23:44 +03:00
alexey-milovidov
2645dede2c
Merge pull request #10386 from palasonic1/palasonic-fix-read-hash-table
Fix reading HashTable from buffer
2020-04-21 02:26:47 +03:00
tavplubix
1a067484c8
Merge pull request #10137 from kekekekule/direct_queries
Add custom settings support for certain dictionary sources
2020-04-21 01:21:32 +03:00
alexey-milovidov
8c2839d3c9
Merge pull request #10308 from ClickHouse/shared-context-lifetime
Shared context lifetime
2020-04-21 00:12:45 +03:00
Maxim Serebryakov
a99a340b0b fix reading HashTable and HashSet 2020-04-20 23:19:03 +03:00
alexey-milovidov
faeab5f649
Merge pull request #10370 from amosbird/clang-10
clang-10 fix
2020-04-20 22:47:12 +03:00
Ivan
d5b0a7e691
Fix Arcadia build (#10380) 2020-04-20 15:21:25 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
Nikolai Kochetov
052598534a Try fix unit tests. 2020-04-20 12:42:56 +03:00
Amos Bird
2d08c8e4ab
clang-10 fix 2020-04-20 15:45:37 +08:00
Alexey Milovidov
acde587c75 Merge branch 'master' into fixed-string-compare-as-zero-padded 2020-04-20 06:49:21 +03:00
Alexey Milovidov
c893edf46f Fix style 2020-04-20 06:48:35 +03:00
Alexey Milovidov
d783162548 Compare with fixed string as smaller string is zero padded #9272 2020-04-20 04:01:31 +03:00
Alexey Milovidov
ec6b176f3b Rework total memory tracker #10293 2020-04-20 01:59:21 +03:00
Alexey Milovidov
1c00953b3e Added test tool 2020-04-19 23:57:34 +03:00
Alexey Milovidov
71c4418876 More memory statistics 2020-04-19 23:49:13 +03:00
alexey-milovidov
72dd453c3f
Merge pull request #10234 from vitlibar/show-columns-of-not-loaded-dictionary
Show information about not loaded dictionaries in system tables.
2020-04-18 15:06:08 +03:00
Dmitry
25cd4ce132 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-18 12:56:34 +03:00
Vitaly Baranov
d62345bbaa Show information about not loaded dictionaries in system.columns, system.tables
and in "SHOW TABLES" executed in any database with the "Dictionary" engine.
2020-04-18 12:50:54 +03:00
Alexander Kuzmenkov
6793cd7cca
More granular assertion in Arena.h 2020-04-18 00:36:07 +03:00
Артем Стрельцов
948efff076 Merge branch 'master' of github.com:yandex/ClickHouse into direct_queries 2020-04-17 23:11:10 +03:00
Артем Стрельцов
741775a12f fixed some remarks from review 2020-04-17 22:54:53 +03:00
Nikolai Kochetov
84faa9af26 Merge branch 'master' into shared-context-lifetime 2020-04-17 19:13:13 +03:00
Nikolai Kochetov
d51a9c551b Remove shared_ptr to SharedContext from Context. 2020-04-17 12:47:40 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4
Changes for auto-sync with Arcadia
2020-04-17 05:08:34 +03:00
Alexander Kazakov
d5b3b2c7b6
Updated RWLockImpl: Fixed suboptimacy (readers queuing up) + minor tweaks to names and comments (#10303)
* Readers queue correction
* Comments, renamings and cosmetics
2020-04-16 21:56:21 +03:00
alexey-milovidov
3de1a36b33
Update ya.make 2020-04-16 18:55:39 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
alexey-milovidov
2a48b0ecd7
Merge pull request #10184 from xzkostyan/feature-zookeeper-ssl
Optional secured communication between ClickHouse and Zookeeper
2020-04-15 07:09:14 +03:00
Andrey Skobtsov
396c9e4279 Fixed styling v2 2020-04-14 19:23:33 +03:00
Andrey Skobtsov
f4f43ee8ab Replaced some warnings with infos as perf events measurements are optional 2020-04-14 16:58:32 +03:00
Andrey Skobtsov
578faa01a7 Handle CAP_SYS_ADMIN permission accordingly 2020-04-14 16:55:46 +03:00
Andrey Skobtsov
2f708fec03 Fixed compilation issues 2020-04-14 15:17:59 +03:00
Konstantin Lebedev
a7c5f622ea Add string_utils for tests/zookeeper_impl.cpp 2020-04-14 00:27:54 +03:00
Andrey Skobtsov
8650c19967 Fixed styling 2020-04-14 00:10:31 +03:00
Andrey Skobtsov
afaa7eca51 Merge branch 'master' into perf_events_metrics
# Conflicts:
#	dbms/src/Common/ProfileEvents.cpp
2020-04-13 23:59:48 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
alexey-milovidov
f472535f54
Merge pull request #9968 from Enmk/SIMD_tokenization
Splitting string into Alpha-Num tokens with SIMD intrinsics.
2020-04-12 00:33:29 +03:00
Alexander Tokmakov
f0edb65e33 add test 2020-04-11 02:02:15 +03:00
Konstantin Lebedev
c9542b6601 Style fixes for communication between ClickHouse and Zookeeper over SSL 2020-04-11 01:09:14 +03:00
Alexander Tokmakov
033d7f9b32 Merge branch 'master' into database_atomic 2020-04-10 17:12:09 +03:00
Alexander Kazakov
497df3086f Merge branch 'master' into timed_rwlock
Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b
2020-04-10 11:38:20 +03:00
Alexander Tokmakov
58067438cd add fallback for renameat2 2020-04-10 01:23:03 +03:00
Vxider
a8cd174fc4 merged with master 2020-04-09 22:34:02 +08:00
Konstantin Lebedev
b666f60af8 Optional secured communication between ClickHouse and Zookeeper 2020-04-09 01:40:54 +03:00
alexey-milovidov
80b73a209b
Merge pull request #10107 from ClickHouse/fix-globs-test
Fix unit test in debug build.
2020-04-08 22:46:44 +03:00
alexey-milovidov
de2fb3ea17
Merge pull request #10108 from ClickHouse/thread-fuzzer-disable-under-thread-memory-sanitizer
ThreadFuzzer: do not wrap pthread functions under thread and memory sanitizers
2020-04-08 22:46:07 +03:00
Alexander Tokmakov
dd1590830b Merge branch 'master' into database_atomic 2020-04-08 22:00:46 +03:00
alexey-milovidov
6d80ab1eed
Merge pull request #9811 from vitlibar/RBAC-8
RBAC-8
2020-04-08 05:47:55 +03:00
Alexey Milovidov
97c2d17e99 ThreadFuzzer: do not wrap pthread functions under thread and memory sanitizers 2020-04-08 05:32:33 +03:00
Alexey Milovidov
f8500cf5d5 Fix unit test 2020-04-08 04:09:01 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
alexey-milovidov
7212efbfbf
Merge pull request #10103 from ClickHouse/fix-zk-multi-async-flacky
Make the test "zk_multi_async" less flacky
2020-04-08 02:15:43 +03:00
Vitaly Baranov
e573549945 Rework access rights for table functions. 2020-04-07 23:31:59 +03:00
Alexey Milovidov
ccec944ff4 Fix flacky test, take 3 2020-04-07 23:21:43 +03:00
Olga Khvostikova
834e458f26 Fix behaviour of globs in filepath with leading zeros 2020-04-07 16:46:12 +03:00
Alexander Kazakov
621d26bcf7 Better timeout diagnostics message 2020-04-07 14:34:35 +03:00
Alexander Kazakov
78f97a7a59 Build fixes 2020-04-07 12:23:08 +03:00
Ivan
f6b31f344d
Add cross-compile build for FreeBSD (#9643)
* Add toolchain to Docker image
2020-04-07 11:33:49 +03:00
Vasily Nemkov
ef07c6d06f Merge remote-tracking branch 'upstream/master' into SIMD_tokenization 2020-04-07 11:25:52 +03:00
Alexander Kazakov
081187dd1f Unit test for RWLock is set to use timeout for avoiding deadlocks 2020-04-07 03:06:48 +03:00
Alexander Kazakov
b98bc9afef Reworked RWLockImpl::getLock() + phase-fairness
Timeout param added to getLock() method
2020-04-07 02:44:45 +03:00
Alexander Tokmakov
a2101c9b1c better code 2020-04-07 02:22:44 +03:00
Alexander Kazakov
2951ed4f1d Corrected Common.RWLockDeadlock test 2020-04-07 00:35:20 +03:00
Vasily Nemkov
3d471556fb Merge commit '73b0f8db8c327a1d63cc7ebcc56087a3f9866dae' into SIMD_tokenization 2020-04-06 20:05:02 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Vxider
2fb9138505 merged with master 2020-04-06 17:36:44 +08:00
Alexey Milovidov
110eb599c1 Fix "check style" tool 2020-04-06 02:57:24 +03:00
Ivan Lezhankin
8a5a73e76d Merge branch 'master' into dbms2src 2020-04-03 18:20:05 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00