thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 10:52:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
63,062 Commits 9,328 Branches 1,783 Tags 2.1 GiB
e51cd90c6f
Commit Graph

1651 Commits

Author SHA1 Message Date
Alexey Milovidov
5f13fdddc0 Remove useless code from BigInt 2021-01-26 21:22:40 +03:00
Anton Popov
c7070da85a better abstractions in disk interface 2021-01-26 17:49:35 +03:00
alesapin
0ff05d2403 Fix deadlock in testkeeper 2021-01-26 17:30:29 +03:00
alesapin
dea4b5009b Some server initialization 2021-01-25 15:29:12 +03:00
Alexander Tokmakov
3bd4d97353 Merge branch 'master' into database_replicated 2021-01-25 14:19:04 +03:00
alesapin
173b6fefdf Merge branch 'master' into in_memory_raft 2021-01-25 12:03:28 +03:00
alexey-milovidov
ba3e064a63
Merge pull request #19371 from kssenii/test-coverage-with-factories 
test coverage with factories
 2021-01-25 07:11:09 +03:00
alexey-milovidov
636d4c41bb
Merge pull request #19520 from amosbird/fixbuildid 
Support new .debug location
 2021-01-24 20:06:13 +03:00
Amos Bird
366c75ed29
Ensure buildid length 2021-01-24 10:28:43 +08:00
Amos Bird
554663a533
Support new .debug location 2021-01-24 03:03:54 +08:00
alexey-milovidov
9818bd319a
Merge pull request #19381 from azat/parts-types-metrics 
Add metrics for MergeTree parts (Wide/Compact/InMemory) types
 2021-01-22 17:24:50 +03:00
alesapin
4a06bf1d79 Merge branch 'fix_one_more_tiny_race' into in_memory_raft 2021-01-22 15:56:43 +03:00
Alexey Milovidov
dcd03eb155 Remove useless file 2021-01-22 00:57:00 +03:00
alesapin
5037d3befd
Merge pull request #19355 from ClickHouse/fix_race_test_keeper 
Fix race condition in TestKeeperHandler on session finish
 2021-01-21 23:53:18 +03:00
Azat Khuzhin
cb951c2116 Add metrics for MergeTree parts types 
- PartsWide
- PartsCompact
- PartsInMemory
 2021-01-21 21:17:00 +03:00
kssenii
c1702f34ee Add factories info into system.query_log 2021-01-21 15:46:37 +00:00
alexey-milovidov
062f00aa5d
Merge pull request #19290 from azat/dist-broken-on-EOF-fix 
Do not mark file for distributed send as broken on EOF
 2021-01-21 17:00:36 +03:00
alesapin
7f32926a21 Fix race condition in TestKeeperHandler on session finish 2021-01-21 14:37:20 +03:00
alesapin
f7175819d5 Add storage simpliest serialization 2021-01-21 14:07:55 +03:00
Ivan
0cbbb84f24
Add missing header 2021-01-21 02:20:11 +03:00
Ivan Lezhankin
2129dc13f6 Fix style and build 2021-01-20 20:44:18 +03:00
alesapin
d5a3adffbd Replicate something in test keeper storage with raft 2021-01-20 19:25:30 +03:00
Ivan Lezhankin
2bb28fbc14 Print inline frames augmenting usual ones 2021-01-20 17:05:25 +03:00
alesapin
a241793a14 Merge branch 'decompose_test_keeper_storage' into in_memory_raft 2021-01-20 15:51:54 +03:00
Azat Khuzhin
e4350e078c Add ability to distinguish remote exceptions from local 2021-01-20 01:10:17 +03:00
Pavel Kruglov
97b5179e55 Implement HedgedRequests 2021-01-19 22:41:05 +03:00
alesapin
8cdfbd996b Fix header 2021-01-19 18:51:52 +03:00
alesapin
7e71a5b1b0 Fix new lines 2021-01-19 18:25:08 +03:00
alesapin
0ee5629527 Fix style 2021-01-19 18:10:49 +03:00
alesapin
ace6d906b0 Fix normal close scenario 2021-01-19 17:45:45 +03:00
alesapin
ac64a13392 Split storage and requests processing 2021-01-19 17:22:28 +03:00
Ivan Lezhankin
3fb50dfa1b Initial implementation of inline frames 2021-01-19 15:34:27 +03:00
alesapin
6883143994 Merge branch 'master' into in_memory_raft 2021-01-19 10:27:21 +03:00
alesapin
6896558424 Some code movements 2021-01-18 19:03:26 +03:00
Alexander Tokmakov
7f97a11c84 Merge branch 'master' into database_replicated 2021-01-18 17:09:39 +03:00
Alexey Milovidov
e482c5ea15 Fix TSan 2021-01-17 15:40:14 +03:00
Alexey Milovidov
950bfb3ec6 Allow change max_server_memory_usage without restart 2021-01-16 18:33:46 +03:00
alexey-milovidov
bf86d3bab8
Merge pull request #19153 from azat/async_socket_for_remote-fix-fd-leak 
Fix leaking of pipe fd for async_socket_for_remote
 2021-01-16 11:23:55 +03:00
alexey-milovidov
2e2988e5d8
Merge pull request #19146 from azat/server-memory-limit-blocking 
MemoryTracker: Do not ignore server memory limits during blocking by default
 2021-01-16 11:09:19 +03:00
Azat Khuzhin
cf085b0687 Split RemoteQueryExecutorReadContext into module part 2021-01-16 01:57:36 +03:00
alexey-milovidov
5f189c5756
Merge pull request #19122 from ClickHouse/data-part-better-code 
Add metrics for part number in MergeTree in ClickHouse
 2021-01-16 00:20:15 +03:00
Azat Khuzhin
61b2d0ce42 MemoryTracker: Do not ignore server memory limits during blocking by default 2021-01-15 22:46:58 +03:00
alexey-milovidov
f8830e0f11
Merge pull request #19107 from ClickHouse/bar-nan 
Fix fuzz test for function `bar`.
 2021-01-15 20:38:02 +03:00
Alexey Milovidov
e238fd64ac Add part metrics 2021-01-15 15:28:53 +03:00
Alexey Milovidov
33d045b72e Fix issue in function "bar" 2021-01-15 13:17:09 +03:00
Alexey Milovidov
8276a1c8d2 Faster parts removal, more safe and efficient interface of IDisk 2021-01-14 19:24:13 +03:00
Alexander Tokmakov
73e96250a8 add comments 2021-01-13 15:19:41 +03:00
Alexander Tokmakov
ff6c3c75c2 add protection from unsafe allocations 2021-01-12 18:41:24 +03:00
tavplubix
6022311a37
Merge pull request #18285 from weeds085490/hotfix/abort_when_failed_to_init_ddlworker 
exit clickhouse when failing to initialize zookeeper with logical err…
 2021-01-11 17:04:33 +03:00
Alexey Milovidov
6eb5a5f4d9 Remove useless code 2021-01-10 03:28:59 +03:00
alexey-milovidov
9e77f0faa3
Merge pull request #18774 from azat/memory-tracking-deallocation-respect-level 
Respect memory tracker blocker level during deallocations
 2021-01-08 07:58:14 +03:00
alexey-milovidov
45f53bacfa
Merge pull request #18845 from azat/fsync-fixes 
Fix never worked fsync_part_directory/fsync_after_insert/in_memory_parts_insert_sync
 2021-01-08 07:26:24 +03:00
alexey-milovidov
19ad9e7a51
Merge pull request #18832 from azat/altstack-fix 
Respect MINSIGSTKSZ for alternative stack to fix under aarch64
 2021-01-08 01:15:55 +03:00
Azat Khuzhin
7b9f670cc3 Fix DirectorySyncGuard under OSX 2021-01-07 23:34:08 +03:00
Azat Khuzhin
9a09044da6 Add DirectorySyncGuard.cpp into ya.make 2021-01-07 20:41:43 +03:00
Azat Khuzhin
b1f08f5c27 Rename FileSyncGuard to DirectorySyncGuard 2021-01-07 20:26:18 +03:00
Azat Khuzhin
52f56cd6ad Add support of F_FULLSYNC on osx 2021-01-07 19:25:26 +03:00
Azat Khuzhin
8d3ec1cce9 Fix fsync_part_directory (missing O_DIRECTORY) 
On linux you should pass O_DIRECTORY, otherwise open(2) will fail
 2021-01-07 19:25:26 +03:00
Azat Khuzhin
46c3266c6a Respect MINSIGSTKSZ for alternative stack to fix under aarch64 
And acording to sigaltstack(2) alignment is not required:

    When a signal handler is invoked on the alternate stack, the kernel
    automatically aligns the address given in ss.ss_sp to a suitable address
    boundary for the underlying hardware architecture.

Fixes: #18785
 2021-01-07 18:28:23 +03:00
alexey-milovidov
a08db94343
Revert "Add metrics for part number in MergeTree in ClickHouse" 2021-01-07 16:40:52 +03:00
Alexey Milovidov
b85bc3f5eb Fix Arcadia 2021-01-07 16:37:55 +03:00
Alexey Milovidov
cea1b7dba5 Fix build 2021-01-07 16:37:06 +03:00
alexey-milovidov
f91626e7ff
Merge pull request #17838 from weeds085490/dev/add_metrics_for_parts 
Add metrics for part number in MergeTree in ClickHouse
 2021-01-07 15:27:04 +03:00
Alexey Milovidov
dd42f91129 Fix style 2021-01-07 06:40:24 +03:00
Alexey Milovidov
15113a5e5f Add files 2021-01-07 06:01:15 +03:00
Alexey Milovidov
6f481d7512 Add integrity checks for ClickHouse binary 2021-01-07 05:56:57 +03:00
alexey-milovidov
13e4579052
Merge pull request #18712 from amosbird/limitpartition 
add max_partitions_to_read setting
 2021-01-06 21:29:58 +03:00
weeds085490
5f5b86b485 Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts 2021-01-06 17:32:45 +08:00
Azat Khuzhin
780b86982a Respect memory tracker blocker level during deallocations 
Introduced-in: #17646
 2021-01-06 02:44:06 +03:00
Alexey Milovidov
5368b20a71 Fix error 2021-01-05 04:49:15 +03:00
Amos Bird
a157a5b3b3
add max_partitions_to_read setting 2021-01-04 12:40:48 +08:00
Alexey Milovidov
8fb0034b62 Give up on lazy initialization of FileChecker 2021-01-04 00:07:26 +03:00
Alexey Milovidov
9d5b2023e8 Fix tests 2021-01-03 19:12:22 +03:00
Alexey Milovidov
da943ef95f Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2021-01-03 18:07:58 +03:00
Alexey Milovidov
ab83245b57 Addition to #18526 2021-01-03 18:07:18 +03:00
Alexey Milovidov
2881b3cf30 Fix errors 2021-01-03 00:29:49 +03:00
Alexey Milovidov
820af3a48d Simplify code of function "bar" 2021-01-02 23:40:15 +03:00
Alexey Milovidov
4012f9ef8b Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2021-01-02 17:35:10 +03:00
alexey-milovidov
aff724ea7d
PODArray: Avoid call to memcpy with (nullptr, 0) arguments (#18526) 
* Avoid call to memcpy with nullptr, 0 arguments

* Add assert to PODArray

* Fix build

* Fix build

* Minor fixes for min/sim hash

* Fix build

* Fix build

* Fix build

* Fix error

* Fix "not actually an error"

* Fix build

* Fix build

* Fix build
 2021-01-02 17:07:54 +03:00
Alexey Milovidov
1a90c569cb Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2021-01-01 21:39:08 +03:00
alexey-milovidov
19e0e1a403
Merge pull request #17646 from azat/Buffer-memory-tracking 
Do not ignore server memory limits during Buffer flush
 2021-01-01 18:58:52 +03:00
Nikita Mikhaylov
4165a58ce4
Merge pull request #11617 from nikitamikhaylov/parallel-parsing-input-format 
Parallel formatting
 2020-12-31 21:22:16 +04:00
alexey-milovidov
07411aafd2
Merge pull request #18647 from ClickHouse/remove-getservbyname 
Remove useless support for symbolic port names
 2020-12-31 14:46:10 +03:00
Nikita Mikhaylov
f27aa148e0
Merge branch 'master' into parallel-parsing-input-format 2020-12-31 06:16:43 +04:00
alexey-milovidov
81f8ee5fd8
Merge pull request #17569 from vdimir/speedup-apply-cidr-mask-v6 
Speedup applyCIDRMask for IPv6
 2020-12-31 03:31:43 +03:00
Alexey Milovidov
83cff84182 Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2020-12-30 22:52:12 +03:00
Alexey Milovidov
a530bad6ea Remove useless support for symbolic port names 2020-12-30 21:55:11 +03:00
Nikita Mikhailov
8e31ce4a5c Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-30 18:22:11 +03:00
Alexander Tokmakov
f2fca15393 try fix it better way 2020-12-30 15:25:00 +03:00
Nikita Mikhailov
2f04cb5ebe abort() instead of std::terminate() + cleanup 2020-12-30 08:31:45 +03:00
Alexey Milovidov
be884a89f8 Minor fixes for min/sim hash 2020-12-29 13:16:43 +03:00
Nikita Mikhailov
07e9a25bd8 style 2020-12-29 04:19:57 +03:00
Nikita Mikhailov
c0eef84c50 better 2020-12-29 04:15:26 +03:00
Nikita Mikhailov
c3288c3fbf Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-28 15:09:37 +03:00
alexey-milovidov
1e8b180e50
Merge pull request #18522 from ClickHouse/fix_concurrent_bounded_queue_timeout 
Fix usage of concurrent bounded queue in test keeper storage
 2020-12-27 11:49:13 +03:00
vdimir
b1d7778287 Merge remote-tracking branch 'upstream/master' into speedup-apply-cidr-mask-v6 2020-12-26 19:53:06 +00:00
Azat Khuzhin
a3ab429129 Split MemoryTracker header 
Allocator.h is included into almost everything (via PODArray.h), so keep
only small part of MemoryTracker.h for it.
 2020-12-25 23:49:22 +03:00
Azat Khuzhin
9d64ae2895 Extend BlockerInThread/LockExceptionInThread interface 
- Add level for BlockerInThread/LockExceptionInThread to make decisions
  based on the level
- Add block_fault_injections for LockExceptionInThread
 2020-12-25 23:49:22 +03:00
alesapin
d204ad7ef1 Fix usage of concurrent bounded queue 2020-12-25 19:54:13 +03:00
alesapin
a50615a22b More correct error code 2020-12-25 16:38:04 +03:00
Yatsishin Ilya
f36e8f13c0 more fixes after rebase 2020-12-24 13:48:10 +03:00
Yatsishin Ilya
ce1e2b18a3 Fix codespell warnings. Split style checks. Update style checks docker 2020-12-24 13:17:52 +03:00
Azat Khuzhin
7c76bd2def Fix ParsingException::displayText override (guard with POCO_CLICKHOUSE_PATCH) 2020-12-23 23:55:39 +03:00
Nikita Mikhaylov
c005dcdd26
Merge pull request #17641 from nikitamikhaylov/parallel_row_numbers 
Added an offset to exception message for parallel parsing
 2020-12-23 17:24:35 +03:00
alexey-milovidov
0f98fe3c0c
Merge pull request #18365 from CurtizJ/fix-group-by-distinct 
Fix race in aggregation with combinator distinct
 2020-12-23 15:41:20 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket 
Async read from socket
 2020-12-23 12:20:42 +03:00
alexey-milovidov
8e48a25607
Merge pull request #18299 from ClickHouse/enable_thread_fuzzer_for_flaky_check 
Trying to enable thread fuzzer in flaky check
 2020-12-23 05:32:19 +03:00
Nikita Mikhailov
dcfbe782c6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-23 05:20:22 +03:00
Nikita Mikhailov
84d0084c1a style 2020-12-23 01:33:07 +03:00
nikitamikhaylov
6f30fae34e final fix 2020-12-23 01:02:45 +03:00
nikitamikhaylov
a9bd177b2e fix 2020-12-23 01:02:45 +03:00
nikitamikhaylov
35dbd2bd77 style 2020-12-23 01:02:45 +03:00
nikitamikhaylov
0dafcc38a5 better 2020-12-23 01:02:45 +03:00
nikitamikhaylov
8d4465ddeb better 2020-12-23 01:02:01 +03:00
nikitamikhaylov
a285cb83df style 2020-12-23 01:02:01 +03:00
nikitamikhaylov
c60c161168 add ParsingException 2020-12-23 01:02:01 +03:00
alesapin
4b28d6d030 Merge branch 'master' into enable_thread_fuzzer_for_flaky_check 2020-12-22 16:36:51 +03:00
Anton Popov
57a1642035 fix race in aggregation with combinator distinct 2020-12-22 14:30:29 +03:00
徐炘
81f9623e2e
Merge branch 'master' into dev/add_metrics_for_parts 2020-12-22 19:04:28 +08:00
Alexey Milovidov
76dc88b674 Remove useless code 2020-12-22 11:18:37 +03:00
alesapin
7f590090f6 Remove logs 2020-12-22 10:28:02 +03:00
alexey-milovidov
69719f743d
Merge branch 'master' into revert-15259-revert-14962-log-avoid-deadlock 2020-12-22 00:41:52 +03:00
alesapin
b10f13f34a More thread fuzzer 2020-12-21 23:24:16 +03:00
alexey-milovidov
2222122f9f
Update ThreadFuzzer.cpp 2020-12-21 20:02:59 +03:00
alesapin
8f2d4f2d1e Fix user 2020-12-21 18:46:36 +03:00
alesapin
b760d7d7d1 Remove more changes 2020-12-21 15:23:02 +03:00
alesapin
5a5fbf9eae Remove logs from thread fuzzer 2020-12-21 15:22:07 +03:00
alesapin
643739df6b Trying to enable thread fuzzer in flaky check 2020-12-21 13:06:36 +03:00
Alexey Milovidov
571520964c Remove useless code 2020-12-21 10:48:15 +03:00
roverxu
8e72b6d31b Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts 2020-12-21 09:25:54 +08:00
Denis Glazachev
ea7e94f3eb Use 127.0.0.1 as a default listen-host for ODBC bridge 2020-12-21 03:26:31 +04:00
Nikolai Kochetov
855c4bc7d7 Added comments. 2020-12-18 18:12:31 +03:00
Nikolai Kochetov
01c8d5dccc Use replace fiber to callback in ReadBufferFromPocoSocket 2020-12-18 17:24:44 +03:00
Amos Bird
272311f6bd
Extensive information in system.query_log 2020-12-18 14:13:58 +08:00
alexey-milovidov
6ee2ada592
Merge pull request #18204 from ClickHouse/remove-strerror 
Do not use non thread-safe function `strerror`
 2020-12-18 08:07:46 +03:00
Nikita Mikhailov
d4ff611d75 build after merge 2020-12-18 02:31:01 +03:00
Nikita Mikhailov
6a55e018e4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into parallel-parsing-input-format 2020-12-18 02:25:32 +03:00
Nikita Mikhaylov
aa7793e38f
Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third 
Try to fix Arcadia
 2020-12-18 01:54:42 +03:00
alexey-milovidov
6fc3ca8b7b
Merge pull request #16724 from kitaisreal/added-function-accurate-cast-or-null 
Added function accurateCastOrNull, allow different types inside IN subquery
 2020-12-18 00:45:27 +03:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148 
HDFS configuration and Kerberos Authenticaiton
 2020-12-17 23:16:58 +03:00
alexey-milovidov
f82274a722
Merge pull request #16527 from kitaisreal/mmap-read-buffer-from-file-descriptor-use-getpagesize 
MMapReadBufferFromFileDescriptor use getpagesize
 2020-12-17 22:34:05 +03:00
Alexey Milovidov
f7f8ff8758 Merge branch 'master' into sigaltstack 2020-12-17 22:16:30 +03:00
Alexey Milovidov
fb3d235e84 Do not use strerror 2020-12-17 21:25:12 +03:00
alesapin
66228f4054
Merge pull request #18065 from ClickHouse/fix_watch_race_testkeeper 
Remove dead list watches from TestKeeperStorage
 2020-12-17 10:15:30 +03:00
Alexey Milovidov
7f280bef37 Merge branch 'master' into sigaltstack 2020-12-17 05:09:10 +03:00
nikitamikhaylov
d70f58a98f remove ryu 2020-12-17 00:52:04 +03:00
Alexander Tokmakov
6c8f844442 better exception message for unknown function 2020-12-17 00:42:14 +03:00
Maksim Kita
685099af7f Move getPageSize in common 2020-12-17 00:23:41 +03:00
alesapin
422467628a Merge branch 'master' into fix_watch_race_testkeeper 2020-12-16 19:45:57 +03:00
Maksim Kita
80dbbc7e58 Style check fix 2020-12-16 18:59:53 +03:00
Ilya Golshtein
d1d657335b USE_INTERNAL_HDFS3_LIBRARY + bash lint 2020-12-16 14:48:33 +03:00
Maksim Kita
7d23451e81 Replaced usages of 4096 constant with getPageSize 2020-12-16 13:46:28 +03:00
Maksim Kita
dbb2fbcdd5 Unified usages of getPageSize 
1. Introduced getPageSize function.
2. Replaced usages of getpagesize with getPageSize function.
3. Replaced usages of sysconf(_SG_PAGESIZE) with getPageSize function.
 2020-12-16 13:42:23 +03:00
Nikolai Kochetov
54efd830e6 Fixing build 2020-12-15 21:04:12 +03:00
Nikolai Kochetov
f3319cd06a Enlarge FiberStack size. 2020-12-15 18:18:08 +03:00
Nikolai Kochetov
5277b565a8 Fixing build. 2020-12-15 17:47:31 +03:00
Nikolai Kochetov
5cbe47301d Fix style 2020-12-15 15:56:14 +03:00
Nikolai Kochetov
d070920c72 Update FiberStack 2020-12-15 12:22:14 +03:00
Anton Popov
c78861e86e Merge remote-tracking branch 'upstream/master' into HEAD 2020-12-15 01:45:01 +03:00
Nikita Mikhaylov
9f127a46c7 first try 2020-12-15 00:56:47 +03:00
Nikita Mikhaylov
0a508c7b8a save 2020-12-15 00:56:46 +03:00
Maksim Kita
7b66dc374c Fixed clang compile issues 2020-12-14 22:12:15 +03:00
Maksim Kita
4435642e39 Fixed style issues 2020-12-14 22:12:15 +03:00
Maksim Kita
4cd5025e83 Added numeric limits for UInt128 2020-12-14 22:12:15 +03:00
alesapin
73780838a1 Remove dead list watches 2020-12-14 19:01:29 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
e295dfe6e3 Use ucontext for asan 2020-12-14 17:42:08 +03:00
Nikolai Kochetov
116bed2cfd Fixing build. 2020-12-14 17:42:00 +03:00
alexey-milovidov
8702809c9f
Merge pull request #17464 from amosbird/ddlworkermetric 
ddlworker max entry metric
 2020-12-13 21:28:03 +03:00
alexey-milovidov
cd5f827265
Merge pull request #18047 from kitaisreal/space-saving-remove-last-element-from-map-fix 
HashTable erase added tests
 2020-12-13 18:27:01 +03:00
Maksim Kita
06b047235a Fixed style issues 2020-12-13 14:35:52 +03:00
Maksim Kita
547f452ba9 HashTable erase added tests 2020-12-13 13:30:25 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix 
SpaceSaving remove last element from map fix
 2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
alexey-milovidov
987725f67b
Merge pull request #17935 from Jokser/disk-s3-remove-empty-metadata-files 
Forcibly removing empty or bad metadata files from FS for DiskS3
 2020-12-12 23:41:35 +03:00
alexey-milovidov
6f50a86025
Update gtest_hash_table.cpp 2020-12-12 18:57:07 +03:00
Pavel Kovalenko
3f2f663bfa Add [[maybe_unused]] for msg parameter in handle_error_code. 2020-12-12 17:43:11 +03:00
Azat Khuzhin
5b3ab48861 More forward declaration for generic headers 
The following headers are pretty generic, so use forward declaration as
much as possible:
- Context.h
- Settings.h
- ConnectionTimeouts.h
(Also this shows that some missing some includes -- this has been fixed)

And split ConnectionTimeouts.h into ConnectionTimeoutsContext.h (since
module part cannot be added for it, due to recursive build dependencies
that will be introduced)

Also remove Settings from the RemoteBlockInputStream/RemoteQueryExecutor
and just pass the context, since settings was passed only in speicifc
places, that can allow making a copy of Context (i.e. Copier).

Approx results (How much units will be recompiled after changing file X?):

- ConnectionTimeouts.h
  - mainline: 100

- Context.h:
  - mainline: ~800
  - patched:  415

- Settings.h:
  - mainline: 900-1K
  - patched:  440 (most of them because of the Context.h)
 2020-12-12 17:43:10 +03:00
Pavel Kovalenko
25df6bae78 Add nested exception when handle Disk S3 metadata file read error. 2020-12-12 17:11:47 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
Amos Bird
8d0e949462
ddlworker max entry metric 2020-12-12 14:20:49 +08:00
alexey-milovidov
c74011851a
Update HashTable.h 2020-12-12 04:58:07 +03:00
alexey-milovidov
d94d9aa8d7
Update HashTable.h 2020-12-12 04:17:32 +03:00
alexey-milovidov
9e48b9b656
Update HashTable.h 2020-12-12 03:47:43 +03:00
alexey-milovidov
eba1299845
Update HashTable.h 2020-12-12 03:38:55 +03:00
alexey-milovidov
245dea6f2e
Update HashTable.h 2020-12-12 03:33:57 +03:00
alexey-milovidov
7e2bc1e7a6
Update HashTable.h 2020-12-12 03:30:12 +03:00
alexey-milovidov
6e7366f921
Update HashTable.h 2020-12-12 03:28:41 +03:00
Alexander Kuzmenkov
a2886cdfa5 Merge remote-tracking branch 'origin/master' into HEAD 2020-12-11 18:57:47 +03:00
Nikita Mikhaylov
f1a145a2b2
Merge pull request #17984 from nikitamikhaylov/fix-arcadia-second 
Fix arcadia
 2020-12-11 17:56:19 +03:00
Maksim Kita
b70b98c415 Fix style issues 2020-12-11 16:54:08 +03:00
Maksim Kita
4ae5619714 Optimized erase in HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bf5d75853c Added erase into HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
d8b78682e1 SpaceSaving remove last element from map fix 2020-12-11 16:54:08 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD 
Add ability to use custom TLD list
 2020-12-11 12:42:19 +03:00
Alexander Kuzmenkov
d757f32300 Remove some redundant includes to speed up build 2020-12-11 02:58:11 +03:00
nikitamikhaylov
b6d69eb63b done 2020-12-11 02:16:21 +03:00
Azat Khuzhin
840a21d073 Add top_level_domains_path for easier overriding 2020-12-09 21:08:31 +03:00
Azat Khuzhin
c987be632f Switch TLDList to StringHashSet (to avoid errors on collisions) 2020-12-09 21:08:30 +03:00
Azat Khuzhin
89cb2185a8 Fix StringHashTable move constructor 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8a0487b1af Add StringHashSet 2020-12-09 21:08:30 +03:00
Azat Khuzhin
916cbd6610 Add ability to use custom TLD list 
v2: Add a note that top_level_domains_lists aren not applied w/o restart
v3: Remove ExtractFirstSignificantSubdomain{Default,Custom}Lookup.h headers
v4: TLDListsHolder: remove FIXME for dense_hash_map (this is not significant)
 2020-12-09 21:08:22 +03:00
Nikolai Kochetov
0e44a22f43 Fixing build. 2020-12-09 19:17:59 +03:00
Nikolai Kochetov
32b38f389e Merge branch 'master' into async-read-from-socket 2020-12-09 17:15:36 +03:00
Nikolai Kochetov
a1d4d92b54 Use poco from master. Fixing tests. 2020-12-09 17:12:42 +03:00
Nikolai Kochetov
156f44808f Fixing crash. 2020-12-09 17:11:45 +03:00
Nikolai Kochetov
088c128832 Fixing build and tests. 2020-12-09 17:11:20 +03:00
alesapin
7ff50fb352 Close requests without timeout 2020-12-09 11:19:52 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
alesapin
91e3162e09 More correct session close 2020-12-08 17:28:51 +03:00
alesapin
f4231d552e Banch of fixes 2020-12-08 16:28:39 +03:00
alesapin
0c43246216 Merge branch 'master' into complete_zk_api 2020-12-07 10:24:55 +03:00
Alexey Milovidov
c40d024915 Merge branch 'master' into vdimir-speedup-apply-cidr-mask-v6 2020-12-07 02:20:57 +03:00
Alexey Milovidov
a63d4f0db3 Merge branch 'master' into amosbird-buildid 2020-12-07 02:17:29 +03:00
alexey-milovidov
f0800a070d
Merge pull request #17700 from ClickHouse/tavplubix-patch-3 
Fix sequential number in TestKeeper
 2020-12-07 02:13:04 +03:00
Anton Popov
7aaa2c052f
Merge branch 'master' into merging-map 2020-12-05 22:41:46 +03:00
Alexander Tokmakov
9f3c77f62e add zk ops into task 2020-12-04 23:12:32 +03:00
alesapin
278bbf6d51 Merge branch 'master' into complete_zk_api 2020-12-04 16:48:19 +03:00
alesapin
ac118feef0 Merge branch 'master' into boringssl-2 2020-12-04 16:24:20 +03:00
roverxu
2a6c1463a1 Add metrics for part number in MergeTree 2020-12-04 11:42:58 +08:00
Alexander Tokmakov
39532f7d9e slightly better DDLWorker initialization and restarting 2020-12-03 21:14:27 +03:00
Nikolai Kochetov
082a496364 Add async read to RemoteQueryExecutor 2020-12-03 15:21:10 +03:00
alexey-milovidov
85f4045160
Merge pull request #17144 from fibersel/issue-16791 
introduce zstd compression (for data import/export)
 2020-12-02 22:41:07 +03:00
Nikolai Kochetov
0fae325d76 Add FiberStack 2020-12-02 14:18:46 +03:00
tavplubix
45b4b3648c
Merge pull request #17664 from ClickHouse/tavplubix-patch-2 
Fix renameat2 ENOSYS on WSL
 2020-12-02 13:55:50 +03:00
tavplubix
88bc73df3a fix seq number in TestKeeper 2020-12-02 12:38:55 +03:00
alesapin
93ea2f5b1f Merge branch 'master' into complete_zk_api 2020-12-02 11:30:09 +03:00
vdimir
9ce010e82c
Add comment for IPV6_MASKS_COUNT 2020-12-01 22:12:11 +03:00
vdimir
1aaff75d9a
Fix style in IPv6ToBinary.cpp 2020-12-01 20:38:49 +03:00
Alexander Tokmakov
1a4bd67736 fixes 2020-12-01 20:20:42 +03:00
Alexander Tokmakov
19c8399eb0 Merge branch 'master' into database_replicated 2020-12-01 17:33:07 +03:00
Anton Popov
12604ce0e6 Merge branch 'dev_map2' of git://github.com/hexiaoting/ClickHouse into merging-map 2020-12-01 14:52:30 +03:00
tavplubix
88133860d7
Update renameat2.cpp 2020-12-01 13:22:29 +03:00
Azat Khuzhin
0bf6ed2e94 Make LockExceptionInThread/BlockerInThread nested 2020-12-01 10:34:25 +03:00
Amos Bird
310918b06a
reload symbols and fix build-id 2020-11-30 22:30:55 +08:00
Alexey Milovidov
af5e2084ff Port ClickHouse code to BoringSSL 2020-11-30 09:59:35 +03:00
vdimir
cd8e7981e0
Speedup applyCIDRMask for IPv6 with compile-time generated mask array 2020-11-29 20:54:46 +03:00
a.palagashvili
502355922d added errors checking, removed redundant variables 2020-11-29 15:14:42 +03:00
Azat Khuzhin
99c447d3f5 Add ability to block MEMORY_LIMIT_EXCEEDED exception explicitly 2020-11-28 11:15:26 +03:00
Azat Khuzhin
5088668736 Do not allow to throw MEMORY_LIMIT_EXCEEDED if there is uncaught exception 
Since this will lead to std::terminate
 2020-11-28 11:15:26 +03:00
Alexander Tokmakov
9e3fd3c170 Merge branch 'master' into database_replicated 2020-11-27 17:08:34 +03:00
alesapin
d199a2bf76 Merge branch 'master' into complete_zk_api 2020-11-27 14:55:55 +03:00
alesapin
89c292f5b7 Fix response pipe read 2020-11-27 13:12:11 +03:00
Nikolai Kochetov
9291bbb04b
Merge pull request #16804 from vdimir/ip-dict-no-trie 
sorted-array based ip_dict
 2020-11-26 19:26:06 +03:00
alesapin
0c6ce276b2 Add dead watches cleaner 2020-11-26 17:57:32 +03:00
Nikita Mikhaylov
1724f182e6
Merge pull request #17412 from nikitamikhaylov/radix-malloc 
Replaced malloc with new in RadixSort
 2020-11-26 15:05:01 +03:00
hexiaoting
5b3a7f5c98 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 16:43:27 +08:00
hexiaoting
74d875c837 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-26 15:13:52 +08:00
alexey-milovidov
f3c12397c2
Update RadixSort.h 2020-11-26 03:20:43 +03:00
Nikolai Kochetov
729272391f
Merge branch 'master' into ip-dict-no-trie 2020-11-25 23:07:19 +03:00
nikitamikhaylov
78b510eaa1 naming 2020-11-25 20:12:14 +03:00
nikitamikhaylov
214b5b8649 better 2020-11-25 20:04:25 +03:00
nikitamikhaylov
8e53b80b89 done 2020-11-25 19:50:07 +03:00
alesapin
be80750ee7
Merge pull request #16899 from ClickHouse/query-profiler-minor-change 
Minor change in query profiler
 2020-11-25 17:14:11 +03:00
alesapin
fb86eaf6fc Better errors and better config 2020-11-25 16:19:09 +03:00
Alexander Kuzmenkov
edce1e636e
Merge pull request #16535 from ClickHouse/aku/opentelemetry 
OpenTelemetry improvements
 2020-11-25 14:10:17 +03:00
alesapin
4d40d9be3f Merge branch 'master' into complete_zk_api 2020-11-25 10:31:16 +03:00
alesapin
3a3860c776
Merge pull request #16837 from ClickHouse/correctly_send_close_request 
Set expire after we sent close in ZooKeeper client
 2020-11-25 10:21:41 +03:00
Vitaly Baranov
08b3707842
Merge pull request #15111 from vitlibar/grpc-protocol 
Implement GRPC protocol.
 2020-11-25 09:00:32 +03:00
Alexander Kuzmenkov
1d7dcef4a0 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-24 21:45:10 +03:00
Alexey Milovidov
828d27d801 Remove unused ProfileEvents 2020-11-24 20:45:24 +03:00
Vitaly Baranov
3c85165e60 Redirect stderr, stdout for clickhouse-odbc-bridge to files. 2020-11-24 17:55:02 +03:00
Vitaly Baranov
8146093794 Provide more information about errors. 2020-11-24 17:55:01 +03:00
alesapin
cfe7d853c1
Update ZooKeeperImpl.cpp 2020-11-24 17:42:31 +03:00
alesapin
821111e716
Update ZooKeeperImpl.cpp 2020-11-24 17:41:57 +03:00
alesapin
a800bff5d4
Update ZooKeeperImpl.cpp 2020-11-24 17:33:42 +03:00
alesapin
0d52cfb1be Less clumsy code with interruptable code 2020-11-24 17:02:55 +03:00
Alexander Tokmakov
5ccf975a4a Merge branch 'master' into database_replicated 2020-11-24 14:38:02 +03:00
Alexander Tokmakov
dad21ee684 maintain metadata in zk 2020-11-24 13:24:39 +03:00
Alexander Kuzmenkov
412c2fe079 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-23 19:51:18 +03:00
alesapin
2da250164e Fix clang tidy message 2020-11-23 17:03:57 +03:00
alesapin
b8fb44a7b9 Merge with master 2020-11-23 11:05:50 +03:00
vdimir
77ffd25cc0
Fixes for IP dictionary 
More meaningful parse errors

Code style fixes, more comments

Fix bytes_allocated calculation
 2020-11-21 17:56:58 +03:00
alesapin
63464df3eb Fix clang-tidy 2020-11-20 18:00:23 +03:00
alesapin
20eeab4502 Fix build #2 2020-11-20 15:36:10 +03:00
alesapin
ab5f3b0b41 Fix build 2020-11-20 15:31:40 +03:00
alesapin
29631aaf2e Fix build warnings 2020-11-20 14:48:48 +03:00
alesapin
73ed05492b More correct initialization 2020-11-20 11:37:16 +03:00
alesapin
fdf3b569f4 Fix bug 2020-11-19 19:48:49 +03:00
alesapin
5925760892 Fix handler 2020-11-19 19:31:55 +03:00
alesapin
8e3f7e4dbd Some non working code 2020-11-19 19:06:19 +03:00
vdimir
36544a45b7
Merge remote-tracking branch 'upstream/master' into ip-dict-no-trie 2020-11-19 18:56:24 +03:00
Alexander Kuzmenkov
f326536ef0 fixup 2020-11-19 15:30:44 +03:00
alesapin
87f7e0b399 More compatible watches in TestKeeper 2020-11-19 15:04:09 +03:00
Alexander Tokmakov
2283906a11 try support replica recovery 2020-11-19 13:34:45 +03:00
alesapin
00186ece72 Join processing thread 2020-11-18 23:36:25 +03:00
Alexander Kuzmenkov
1570320e20 fixes for context hierarchy 2020-11-18 20:43:18 +03:00
alesapin
24910a61be Fix stringstream 2020-11-18 18:25:59 +03:00
alesapin
6b25ba1097 Merge branch 'correctly_send_close_request' into complete_zk_api 2020-11-18 17:51:00 +03:00
alesapin
2cd66f23a3 Merge branch 'master' into complete_zk_api 2020-11-18 17:50:50 +03:00
alesapin
087bc462e8 Additional flag for finalization 2020-11-18 17:47:33 +03:00
alesapin
8e7f7b74d0 Merge branch 'master' into correctly_send_close_request 2020-11-18 17:05:57 +03:00
Alexander Kuzmenkov
b16c5a1748 Merge remote-tracking branch 'origin/master' into HEAD 2020-11-17 22:54:54 +03:00
a.palagashvili
6f5390cc70 introduce zstd compression 2020-11-17 19:02:10 +03:00
alexey-milovidov
b494b18748
Merge pull request #17108 from ClickHouse/ya-make-owners 
Add "OWNER" to ya.make files.
 2020-11-17 05:19:46 +03:00
Alexey Milovidov
24f4fa6edf Follow Arcadia ya.make rules 2020-11-17 00:16:50 +03:00
Alexey Milovidov
3df04ce0c2 Follow Arcadia ya.make rules 2020-11-16 21:24:58 +03:00
TCeason
45bacd6f74 Merge branch 'master' into add_sync_user_privs_exception 2020-11-16 12:59:44 +08:00
alexey-milovidov
11f56186db
Merge pull request #17048 from azat/build-fix 
Add missing <unique_ptr> for RadixSort.h
 2020-11-16 00:15:54 +03:00
Azat Khuzhin
01ec7aca68 Add missing <unique_ptr> for RadixSort.h 
Fails compiling quantile-t-digest.cpp test on:
- clang 11
- libstdc++
 2020-11-15 23:08:45 +03:00
Denis Glazachev
5c801c42c1
Fix ROCKSDB_ERROR value 2020-11-15 23:48:46 +04:00
alesapin
7ea147203b Merge branch 'master' into correctly_send_close_request 2020-11-13 14:00:05 +03:00
alesapin
bbd85c3b2d
Merge pull request #16390 from ClickHouse/add_separate_pool_for_fetches 
Add separate pool for fetches
 2020-11-12 22:42:28 +03:00
Alexander Tokmakov
0731bfb7be Merge branch 'master' into database_replicated 2020-11-12 21:04:18 +03:00
alexey-milovidov
75ba096e87
Merge pull request #16842 from ClickHouse/higher-mmap-threshold-in-debug 
Higher mmap threshold in debug build
 2020-11-12 19:46:08 +03:00
alexey-milovidov
c9c8f50683
Merge pull request #16903 from azat/no-trace-collector-without-trace_log 
Disable TraceCollector if trace_log is disabled
 2020-11-12 19:43:27 +03:00
alesapin
4aad6a597c Merge branch 'correctly_send_close_request' into complete_zk_api 2020-11-12 17:46:02 +03:00
alesapin
e19d1430db Fix livelock 2020-11-12 17:43:16 +03:00
alesapin
5e1c84e04f Fix segfault 2020-11-12 15:11:13 +03:00
TCeason
d16cd29c83
Merge branch 'master' into add_sync_user_privs_exception 2020-11-12 19:44:48 +08:00
feng lv
b1cc582668 fix conflict 2020-11-12 10:42:53 +00:00
alesapin
8e5dfa15fc Merge branch 'master' into correctly_send_close_request 2020-11-12 12:58:33 +03:00
alesapin
a8d466a645 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-12 12:51:02 +03:00
feng lv
b7e5c6ed4d fix conflict 2020-11-12 02:26:21 +00:00
TCeason
3912ed4965 Merge branch 'master' into add_sync_user_privs_exception 2020-11-12 09:34:08 +08:00
sundyli
5ef809931e
Merge branch 'master' into storage-rocksdb 2020-11-12 08:26:27 +08:00
alexey-milovidov
34b2a460ba
Merge pull request #16578 from fibersel/issue-8828 
add compression method for files: Xz
 2020-11-12 02:58:52 +03:00
vdimir
dbec289c9a
[wip] rewrite ip_dict data struct, fix bugs, add tests 2020-11-12 00:58:30 +03:00
Azat Khuzhin
8c482b978b Set thread name for the TraceCollector 2020-11-11 21:30:17 +03:00
Alexey Milovidov
57ac63ca34 Minor change in query profiler 2020-11-11 19:58:54 +03:00
alesapin
ade14da634 Remove some redundant files 2020-11-11 18:45:10 +03:00
alesapin
d57b57156e Fix style check 2020-11-11 17:22:11 +03:00
alesapin
d83c68fca8 Fix timeouts 2020-11-11 16:55:28 +03:00
Alexander Tokmakov
dbac7860b1 review suggestions 2020-11-11 16:27:54 +03:00
alesapin
66236d6ebb Refactored a little 2020-11-11 16:07:06 +03:00
taichong
d907afa77e throw exception when mysql sync user privs error. 2020-11-11 19:27:37 +08:00
alesapin
0388006ed6 Less garbage 2020-11-11 12:05:45 +03:00
alesapin
bb3b420057 Ugly working code 2020-11-11 11:51:54 +03:00
Alexey Milovidov
0001433b82 Better code 2020-11-11 09:08:53 +08:00
Alexey Milovidov
2e6ed2a880 Higher mmap threshold in debug build 2020-11-10 22:21:59 +03:00
Alexander Tokmakov
b94cc5c4e5 remove more stringstreams 2020-11-10 21:22:26 +03:00
alesapin
2129b9a53e Merge branch 'correctly_send_close_request' into complete_zk_api 2020-11-10 17:39:47 +03:00
alesapin
ec2c2ec576 Set expire after we set close 2020-11-10 17:09:32 +03:00
alesapin
d8f515c4f3 Almost watches 2020-11-10 16:43:10 +03:00
alesapin
932ea0ef8b Merge branch 'master' into complete_zk_api 2020-11-10 13:56:11 +03:00
feng lv
9194985d48 Merge branch 'master' of github.com:ClickHouse/ClickHouse into union-distinct 2020-11-10 06:09:39 +00:00
Alexander Kuzmenkov
0530c40cd8 fixes 2020-11-10 08:50:32 +03:00
a.palagashvili
f999ea2a6f renamed files, added new library, changed error codes, added tests for file() function 2020-11-10 01:52:22 +03:00
Alexander Tokmakov
5cdfcfb307 remove other stringstreams 2020-11-09 22:12:44 +03:00
alesapin
09fac0da9d Better 2020-11-09 21:16:02 +03:00
alesapin
45b0894252 Some fixes 2020-11-09 20:50:39 +03:00
a.palagashvili
6286775031 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into issue-8828 2020-11-09 19:53:20 +03:00
Alexander Kuzmenkov
26229ed231 tmp spans for threads 
(doesn't compile because of json metadata changes)
 2020-11-09 18:07:38 +03:00
alesapin
4e846d2197 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-09 10:00:21 +03:00
alesapin
456b0b94c1 Remove some debug 2020-11-09 09:54:35 +03:00
vdimir
a67f5b780f
Use sorted ip array instead of trie in TrieDictionary 2020-11-08 19:19:04 +03:00
alexey-milovidov
2d427eb1e8
Merge pull request #16496 from ClickHouse/register-formats 
Fix inconsistency in FormatFactory
 2020-11-08 14:27:33 +03:00
Alexey Milovidov
dba57529f8 Merge branch 'master' of github.com:yandex/ClickHouse into fix-stringstream 2020-11-07 22:03:38 +03:00
Alexey Milovidov
941ee1a214 Fix error 2020-11-07 22:02:22 +03:00
Alexey Milovidov
80fb30c06d Fix error 2020-11-07 19:09:15 +03:00
Alexey Milovidov
8b8383d375 Fix error 2020-11-07 19:08:19 +03:00
Alexey Milovidov
c3973123bd Fix error 2020-11-07 19:03:23 +03:00
a.palagashvili
268f289bd1 resolved conflict 2020-11-07 16:36:38 +03:00
feng lv
1ca7dcb0a8 fix conflict 2020-11-07 11:44:29 +00:00
alexey-milovidov
494c188559
Merge pull request #16757 from ClickHouse/tavplubix-patch-3 
Get rid of possible memory allocation in ThreadPool::worker(...)
 2020-11-07 13:40:31 +03:00
Alexey Milovidov
fd84d16387 Fix "server failed to start" error 2020-11-07 03:14:53 +03:00
Alexey Milovidov
57de99bcd9 More simple 2020-11-06 20:46:43 +03:00
Alexey Milovidov
ad52fceb83 Fix bad code in SmallObjectPool 2020-11-06 20:34:14 +03:00
tavplubix
044f143463
Update ThreadPool.cpp 2020-11-06 18:53:33 +03:00
hexiaoting
28e87da976 remove map literal and Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-06 15:07:41 +08:00
alexey-milovidov
6d5e852356
Merge pull request #16677 from ClickHouse/field-infinite-convert-to-int 
Fix UBSan report when trying to convert infinite floating point number to integer
 2020-11-05 23:20:25 +03:00
Alexey Milovidov
b56486510f Improve Arcadia 2020-11-05 12:55:01 +03:00
Alexey Milovidov
65aa226bcd Fix test 2020-11-05 12:26:51 +03:00
Alexander Kuzmenkov
2a0d9da5e4 cleanup 2020-11-05 12:25:42 +03:00
Alexander Kuzmenkov
faf1f1e0cd Merge remote-tracking branch 'origin/master' into HEAD 2020-11-05 11:09:11 +03:00
alesapin
a9529e8d65 Bad code but all events 2020-11-04 21:54:55 +03:00
alesapin
e2bce14aed Merge branch 'master' into complete_zk_api 2020-11-04 20:37:30 +03:00
Alexey Milovidov
22954cc123 Fix UBSan report when trying to convert infinite floating point number to integer 2020-11-04 19:48:36 +03:00
a.palagashvili
ceda5cb9c5 fix codestyle, resolvec conflict 2020-11-04 19:47:04 +03:00
Alexey Milovidov
ff8f80b6b6 Remove old file 2020-11-04 13:34:47 +03:00
Alexey Milovidov
f7c77b4a25 Fix unit tests 2020-11-04 13:14:23 +03:00
alexey-milovidov
4fede5b008
Merge pull request #16438 from azat/errorCode-v2 
Add errorCodeToName() and system.errors
 2020-11-04 12:40:47 +03:00
alexey-milovidov
973c1d7983
Merge pull request #16529 from azat/log_queries_min_time 
Add log_queries_min_query_duration_ms
 2020-11-04 01:47:18 +03:00
alexey-milovidov
8a3f38f332
Merge branch 'master' into errorCode-v2 2020-11-04 01:40:41 +03:00
alesapin
598532b582 Remove strange method 2020-11-03 18:01:56 +03:00
alesapin
5700e5e46d Fix response serialization 2020-11-03 17:57:40 +03:00
alesapin
93c2ad6034 Something work 2020-11-03 17:49:30 +03:00
Alexander Tokmakov
d8ae9fcdb4 fixes, add shard name 2020-11-03 14:30:53 +03:00
alesapin
a02b4322b6 Merge branch 'master' into complete_zk_api 2020-11-03 13:13:07 +03:00
Alexander Kuzmenkov
f10a5207f4
Merge pull request #16601 from ClickHouse/ban_aggregate_function_in_primary_key 
Restrict to use non-comparable types in primary key
 2020-11-02 23:27:46 +03:00
Azat Khuzhin
3be8a56f5c Add log_queries_min_query_duration_ms 
Only queries slower then the value of this setting will go to system.query_log,
i.e. something like slow_query_log in mysql.

v2: log_queries_min_time renamed to log_queries_min_query_duration_ms
v3: add current_database into system.query_thread_log
v4: rewrite test using current_database
v5: fix query_duration_ms in system.query_thread_log
 2020-11-02 21:34:54 +03:00
alexey-milovidov
bfa0ddcdfe
Merge pull request #16596 from ClickHouse/strange-cpp 
Add strange C++ code that actually does not change anything
 2020-11-02 20:02:28 +03:00
feng lv
4d722bc52c fix conflict 2020-11-02 12:52:12 +00:00
a.palagashvili
805bfd286c resolved git modules 2020-11-02 15:16:49 +03:00
alesapin
f3b3025719 Ban non comparable types in primary key 2020-11-02 14:39:27 +03:00
Alexey Milovidov
67daa37a7f Add strange C++ code that actually does not change anything 2020-11-02 13:42:47 +03:00
hexiaoting
66bca89001 Style error fix 2020-11-02 17:23:02 +08:00
alesapin
8b0d9fbc07 Merge branch 'no_background_pool_no_more' into add_separate_pool_for_fetches 2020-11-02 10:54:09 +03:00
hexiaoting
3a70cf3773 Merge remote-tracking branch 'origin/master' into dev_map2 2020-11-02 14:46:56 +08:00
hexiaoting
2ba68d7494 Add map function 2020-11-02 14:05:53 +08:00
a.palagashvili
be2b002ff4 fixed cmake for building, added test for compression method, added basic code for encoding 2020-11-01 21:40:05 +03:00
Azat Khuzhin
5363c62fc5 Fix overflow check in ErrorCodes 2020-11-01 09:00:19 +03:00
Azat Khuzhin
c8f756707f Swap name and value in ErrorCodes definition 2020-10-31 11:32:44 +03:00
Azat Khuzhin
fff6b5549e Hide getCurrentTimeNanoseconds() to avoid possible errors 
To avoid further errors like in:
- c0e15ba348 ("Fix RealTimeMicroseconds ProfileEvents")
- c856d02e0f4a519cd2a29ffbe1135196de0bc65a ("Fix query_thread_log.query_duration_ms unit")
 2020-10-31 11:15:27 +03:00
alexey-milovidov
022648a154
Merge pull request #16558 from azat/query_thread_log_current_database 
Add current_database into query_thread_log
 2020-10-31 06:36:10 +03:00
alesapin
1fc7633289 Heartbeats working 2020-10-30 22:57:30 +03:00
Azat Khuzhin
5bab7a5bc7 Add current_database into query_thread_log 2020-10-30 21:16:10 +03:00
alesapin
c2525ef211 Server and client pinging each other 2020-10-30 17:16:47 +03:00
Azat Khuzhin
3661769e1b Remove some absolute changes for errorCodeToName/system.errors 2020-10-30 09:04:22 +03:00
Azat Khuzhin
0cd79de632 Eliminate extra strlen() in errorCodeToName() 2020-10-29 21:53:09 +03:00
Azat Khuzhin
cb50886ef1 Fix ErrorCodes increment on error 2020-10-29 21:24:52 +03:00
Azat Khuzhin
04bff595d3 Make check-style happy (by not using DB::ErrorCodes:: in comments) 2020-10-29 21:10:20 +03:00
Azat Khuzhin
7e79769ae4 Fix readability-inconsistent-declaration-parameter-name in ErrorCodes.h 2020-10-29 21:08:09 +03:00
Maxim Akhmedov
3627fabfb9 Remove -g0 form Arcadia build settings. 2020-10-29 17:37:23 +03:00
alesapin
5e2a3d12d7 Split requests and responses part from zookeeper 2020-10-29 17:25:44 +03:00
Azat Khuzhin
b42f77a791 Covert error codes list to lookup table and drop generation of them. 2020-10-29 10:55:41 +03:00
Azat Khuzhin
b2e2322895 Add system.errors table 
Contains error codes with number of times they have been triggered.

Columns:

-   `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
-   `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
-   `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.

**Example**

``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1

┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │   76 │     1 │
└──────────────────┴──────┴───────┘
 2020-10-29 10:55:38 +03:00
alesapin
0931658c2f Merge branch 'master' into add_separate_pool_for_fetches 2020-10-28 14:20:56 +03:00
alesapin
8a6be1602b
Merge pull request #16364 from ClickHouse/fix_uuid_mapping_exists 
Minor improvements in DatabaseCatalog
 2020-10-28 10:54:39 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
alexey-milovidov
a591d1f32a
Update ThreadStatus.cpp 2020-10-26 22:46:25 +03:00
feng lv
9b95ed9ead fix 2020-10-26 12:21:04 +00:00
Alexander Tokmakov
636da1318b Merge branch 'master' into database_replicated 2020-10-26 15:00:43 +03:00
alesapin
77d350aaeb Bigger setting value 2020-10-26 14:23:59 +03:00
Alexey Milovidov
0ba2fa8105 Fix "Arcadia" 2020-10-26 11:56:30 +03:00
Alexey Milovidov
88e846b36d Fix build on Mac OS 2020-10-26 07:42:22 +03:00
Alexey Milovidov
068235c2d7 Disable alt stack for sanitizers 2020-10-26 05:18:36 +03:00
Alexander Tokmakov
f8f2d62d70 minor improvements in DatabaseCatalog 2020-10-25 20:27:21 +03:00
Alexey Milovidov
4e2c0ba226 Provide diagnostics on stack overflow 2020-10-25 03:10:05 +03:00
alexey-milovidov
e00f6c4a0d
Merge branch 'master' into total_memory_tracker-by-default 2020-10-24 21:17:53 +03:00
feng lv
15e4e03469 add union distinct and setting union_default_mode 2020-10-24 13:18:04 +00:00
Azat Khuzhin
114ea9b1eb Fix accounting for new/delete from different threads for VariableContext::Thread 
MemoryTracker assumes that for VariableContext::Thread new/delete may be
called from different threads, hence the amount of memory can go
negative.

However the MemoryTracker is nested, so even if the negative amount is
allowed for VariableContext::Thread it does not allowed for anything
upper, and hence the MemoryTracking will not be decremented properly.

Fix this, by passing initial size to the parent free.

This should fix memory drift for HTTP queries.
 2020-10-23 21:07:52 +03:00
Azat Khuzhin
72d7b6117e Use total_memory_tracker when there is no other MemoryTracker object. 
This should significantly reduce the MemoryTracking drift, test shows
that there is 0 drift after query storm (100 queries, via http/tcp/tcp
in one session).

TL;DR;

To track memory, clickhouse creates memory tracker object for each
thread **explicitly**, but until it is not created the memory
allocations are not under account.
There should not be lot of allocations w/o memory tracker, since most of
the time it is created early enough, but even this maybe enough to
trigger some problems.

Plus sometimes it is not possible to create it, for example some 3d
party library does not allow to do this explicitly:
- for example before #15740 allocations from librdkafka threads,
- or even worse, poco threads, they don't have any routines to do this.
This won't be a problem for `MemoryTracking` metric if the deallocation
will be done from the same thread w/o memory tracker (or vise versa),
but this is not always true.

NOTE, that this will slow down per-thread allocations w/o memory
tracker, since before this patch there were no memory tracking for them
while now they will be accounted in total_memory_tracker, and for
total_memory_tracker max_untracked_memory is always reached.
But this should not be significant.
 2020-10-23 21:07:52 +03:00
hexiaoting
483be134b2 Support MergeTree Engine 2020-10-23 16:36:17 +08:00
Amos Bird
ccf59c6412
Fix definitely wrong bug 2020-10-22 22:56:45 +08:00
alexey-milovidov
2ae32e3d5c
Merge pull request #16101 from azat/http-memory-tracking-fixes 
Fix memory tracker settings (for HTTP queries)
 2020-10-22 00:00:47 +03:00
Alexey Milovidov
2619efadc8 Fix multiple issues with memory tracking 2020-10-21 03:31:34 +03:00
Alexander Tokmakov
72dbb43235 Merge branch 'master' into fork-valbaturin-replication-db-engine 2020-10-20 19:14:54 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges option for volumes in multi-disk configuration (#13956) 
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
 2020-10-20 18:10:24 +03:00
Alexey Milovidov
448c87363c Style 2020-10-20 04:29:34 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets 
Minor improvements of stress test
 2020-10-19 16:12:30 +03:00
hexiaoting
fcd35b0619 Merge branch 'master' into dev_map2 2020-10-18 16:18:13 +08:00
hexiaoting
db8ba39c9c Implement Integer And Array for value type 2020-10-17 23:45:35 +08:00
Azat Khuzhin
082f30a3a1 Introduce ThreadStatus::applyQuerySettings() to reduce copy-paste 2020-10-17 15:01:53 +03:00
Alexander Tokmakov
026896835c fixes 2020-10-16 15:20:30 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Nikolai Kochetov
939d8edf33
Merge pull request #15999 from ClickHouse/fix-after-15437 
Continuation of 15437
 2020-10-15 18:20:48 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf 
ProtobufSingle format
 2020-10-15 16:58:39 +03:00
Nikolai Kochetov
963ce315b2
Merge pull request #15454 from azat/dict-prealloc 
Speedup hashed/sparse_hashed dictionary loading by preallocating the hash table
 2020-10-15 15:03:53 +03:00
Nikolai Kochetov
40f62719ff Move event to stack. 2020-10-15 13:24:18 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf 2020-10-14 16:26:57 +03:00
Anton Popov
7470ac98bb
Merge pull request #15855 from hexiaoting/dev_fetch 
Add Support for OFFSET_FETCH_CLAUSE
 2020-10-14 15:21:28 +03:00
hexiaoting
cdb4dd57a6 Add new DataType Map(key,value) 2020-10-14 14:35:14 +08:00
hexiaoting
dea965832a Fix error for previous offset test 2020-10-13 11:32:43 +08:00
Azat Khuzhin
2947eff878 Fix query hang with connections_with_failover_max_tries = 0 (endless loop) 2020-10-12 22:07:26 +03:00
Mikhail Filimonov
87a8ba63f7
Few more CR fixes 2020-10-12 15:05:40 +02:00
alexey-milovidov
10e9d14466
Merge pull request #15818 from ClickHouse/style-pragma-once 
Check for #pragma once in headers
 2020-10-11 13:14:09 +03:00
alexey-milovidov
39e58128cd
Merge pull request #15812 from ClickHouse/bigint-hash 
Minor changes in BigInt hash
 2020-10-11 01:11:30 +03:00
Alexey Milovidov
269b6383f5 Check for #pragma once in headers 2020-10-10 21:37:02 +03:00
Alexey Milovidov
9f15daf45c Remove useless metrics to avoid confusion 2020-10-10 18:52:44 +03:00