Commit Graph

13093 Commits

Author SHA1 Message Date
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
560606742c Cmake: fix readline test 2017-11-17 00:26:20 +03:00
Alexey Milovidov
596ea3fc7a Renamed and inverted option that has almost no sense [#CLICKHOUSE-2]. 2017-11-17 00:21:01 +03:00
Alexey Milovidov
c060e9b87a Removed useless file [#CLICKHOUSE-2]. 2017-11-17 00:11:46 +03:00
proller
7b417de0c7 format 2017-11-17 00:01:00 +03:00
proller
cf35323fc4 PerformanceTest fixes. 2017-11-17 00:01:00 +03:00
Orivej Desh
bedec3a0f4 Fix detection of the compatible libunwind
Broken since 07c964ef3b.
2017-11-16 23:59:43 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
Alexey Milovidov
a2b8ae3100 Fixed tiny error [#CLICKHOUSE-2]. 2017-11-16 23:17:57 +03:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
proller
ef1b559845 Check pid file contents inside clickhouse server (#1498)
* Check pid file contents inside clickhouse (allow run with exists pid file but not exists process)

* fix

* fix

* eol

* wip
2017-11-16 22:09:08 +03:00
Alexey Milovidov
28b5bd8821 Removed useless code [#CLICKHOUSE-3431]. 2017-11-16 22:04:07 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
2f0cbd2214 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-16 21:48:11 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
proller
16eb293b15 No more gcc-6 and clang 3.8 2017-11-16 20:47:54 +03:00
proller
6b17dbbe21 Add systemd service and use it by default on systemd-enabled systems (install .service) 2017-11-16 20:45:51 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
proller
95e3e916b0 release script: allow redefine DEB_CC DEB_CXX 2017-11-16 16:44:46 +03:00
proller
339424f5ea Fix realloc on freebsd and macos 2017-11-16 14:27:31 +03:00
Alexey Milovidov
ee48dea0d3 Attempt to improve performance of formatting Date and DateTime [#CLICKHOUSE-2]. 2017-11-16 05:07:19 +03:00
Alexey Milovidov
040b4bd47e Attempt to improve performance of parsing Dates [#CLICKHOUSE-2]. 2017-11-16 01:58:50 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Marek Vavruša
c07b48075b StorageKafka: fixed messages not showing when EOF is reached in current batch
This prevents messages from being read if there's less than 16 messages to read in Kafka.
Updated documentation with more detailed description.
2017-11-15 23:17:22 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
0342d785c9 add failing test [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
Alexander Makarov
5b113df16c Rewrote pieces of code with ambiguous '&pointer[offset]' semantics 2017-11-15 22:22:32 +03:00
Alexander Makarov
84b2f16913 fixed several UB-abusing places 2017-11-15 22:22:32 +03:00
robot-metrika-test
ebec370fa5 Auto version update to [54312] 2017-11-15 16:12:02 +03:00
Alexey Milovidov
1a50e733b2 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-15 05:24:22 +03:00
Alexey Milovidov
8d3da74aae Fixed error [#CLICKHOUSE-2]. 2017-11-15 05:24:05 +03:00
alexey-milovidov
19e0cd879d
Extended date parsing (#1495)
* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].

* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].
2017-11-15 05:08:55 +03:00
Alexey Milovidov
dfdc3ba680 Revert "Enable YYYY-mM-dD parsing."
This reverts commit e1fb55cc99.
2017-11-15 05:08:12 +03:00
Amos Bird
e1fb55cc99 Enable YYYY-mM-dD parsing.
This patch makes ClickHouse be able to parse DateTime string like '2017-2-3',
'2017-02-3' and '2017-2-03' correctly.
2017-11-15 05:07:52 +03:00
Alexey Milovidov
b19b476cc6 Accept part of pull request [#CLICKHOUSE-2]. 2017-11-15 00:13:23 +03:00
Alexey Milovidov
35aec21756 Updated instruction [#CLICKHOUSE-2]. 2017-11-14 22:46:11 +03:00
Alexey Milovidov
fb2d2d36e0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-14 20:08:55 +03:00
Alexey Milovidov
e6ccb9b662 Renamed function "runningIncome" to "runningDifferenceStartingWithFirstValue" for clarity [#CLICKHOUSE-2]. 2017-11-14 20:08:51 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
c4b4764a0a Fixed error after merge [#CLICKHOUSE-2]. 2017-11-14 03:11:33 +03:00
Alexey Milovidov
18cdec38bd Added comment [#CLICKHOUSE-2]. 2017-11-14 01:53:14 +03:00
Alexey Milovidov
c58ef28b60 Added test [#CLICKHOUSE-2]. 2017-11-14 01:34:14 +03:00
Alexey Milovidov
4c2ffbb315 Better implementations of isInfinite, isFinite, isNaN [#CLICKHOUSE-2]. 2017-11-14 00:47:49 +03:00