Commit Graph

9262 Commits

Author SHA1 Message Date
Alexey Milovidov
4f8009517c Thread name can be 15 bytes max [#CLICKHOUSE-2]. 2017-11-17 23:57:07 +03:00
Alexey Milovidov
f54e99490f Merge branch 'master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:48:16 +03:00
Alexey Milovidov
8e362ba641 Fixed build [#CLICKHOUSE-2]. 2017-11-17 23:48:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
18be706127 Merge remote-tracking branch 'origin/master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:30:51 +03:00
proller
5190325275 Allocator fix: nothing do when sizes equal, allow reallocate to smaller size (#1512)
* PerformanceTest fixes.

* format

* Allocator fix: nothing do when sizes equal, allow reallocate to smaller size

* Update Allocator.cpp
2017-11-17 23:27:12 +03:00
Alexey Milovidov
9264bc4013 Style [#CLICKHOUSE-2]. 2017-11-17 23:18:06 +03:00
proller
19d102cc4f fix 2017-11-17 22:53:02 +03:00
Alexey Milovidov
4ab2d4bc31 Added comment [#CLICKHOUSE-2]. 2017-11-17 22:49:17 +03:00
Alexey Milovidov
263e262413 Style [#CLICKHOUSE-2]. 2017-11-17 22:43:25 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
7b417de0c7 format 2017-11-17 00:01:00 +03:00
proller
cf35323fc4 PerformanceTest fixes. 2017-11-17 00:01:00 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
Alexey Milovidov
28b5bd8821 Removed useless code [#CLICKHOUSE-3431]. 2017-11-16 22:04:07 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
Alexey Milovidov
ee48dea0d3 Attempt to improve performance of formatting Date and DateTime [#CLICKHOUSE-2]. 2017-11-16 05:07:19 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Marek Vavruša
c07b48075b StorageKafka: fixed messages not showing when EOF is reached in current batch
This prevents messages from being read if there's less than 16 messages to read in Kafka.
Updated documentation with more detailed description.
2017-11-15 23:17:22 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
0342d785c9 add failing test [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
Alexander Makarov
5b113df16c Rewrote pieces of code with ambiguous '&pointer[offset]' semantics 2017-11-15 22:22:32 +03:00
Alexander Makarov
84b2f16913 fixed several UB-abusing places 2017-11-15 22:22:32 +03:00
robot-metrika-test
ebec370fa5 Auto version update to [54312] 2017-11-15 16:12:02 +03:00
Alexey Milovidov
1a50e733b2 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-15 05:24:22 +03:00
Alexey Milovidov
8d3da74aae Fixed error [#CLICKHOUSE-2]. 2017-11-15 05:24:05 +03:00
alexey-milovidov
19e0cd879d
Extended date parsing (#1495)
* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].

* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].
2017-11-15 05:08:55 +03:00
Alexey Milovidov
dfdc3ba680 Revert "Enable YYYY-mM-dD parsing."
This reverts commit e1fb55cc99.
2017-11-15 05:08:12 +03:00
Amos Bird
e1fb55cc99 Enable YYYY-mM-dD parsing.
This patch makes ClickHouse be able to parse DateTime string like '2017-2-3',
'2017-02-3' and '2017-2-03' correctly.
2017-11-15 05:07:52 +03:00
Alexey Milovidov
fb2d2d36e0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-14 20:08:55 +03:00
Alexey Milovidov
e6ccb9b662 Renamed function "runningIncome" to "runningDifferenceStartingWithFirstValue" for clarity [#CLICKHOUSE-2]. 2017-11-14 20:08:51 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
c4b4764a0a Fixed error after merge [#CLICKHOUSE-2]. 2017-11-14 03:11:33 +03:00
Alexey Milovidov
18cdec38bd Added comment [#CLICKHOUSE-2]. 2017-11-14 01:53:14 +03:00
Alexey Milovidov
c58ef28b60 Added test [#CLICKHOUSE-2]. 2017-11-14 01:34:14 +03:00
Alexey Milovidov
4c2ffbb315 Better implementations of isInfinite, isFinite, isNaN [#CLICKHOUSE-2]. 2017-11-14 00:47:49 +03:00
alexey-milovidov
855742ba4e
Merge pull request #1426 from yandex/catboost-models
Catboost models
2017-11-13 22:06:22 +03:00
Alexey Milovidov
dcd8355b81 Addition to prev. revision [#CLICKHOUSE-3396]. 2017-11-12 20:26:49 +03:00
Alexey Milovidov
0298243b46 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 20:08:52 +03:00
Alexey Milovidov
2029b38527 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 19:45:30 +03:00
Alexey Milovidov
1dd7568fc1 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:19:48 +03:00
Alexey Milovidov
c8dbea9d36 Merge branch 'embedded-compiler' 2017-11-12 16:09:56 +03:00
Alexey Milovidov
fd8c418416 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:09:08 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484)
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
2017-11-12 15:58:40 +03:00
Alexey Milovidov
22f06f3f7a Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 14:40:27 +03:00
Alexey Milovidov
cd25ecafb7 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 13:29:52 +03:00
Alexey Milovidov
07650e02c4 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 12:10:59 +03:00
Alexey Milovidov
037b7da2ae Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 11:44:22 +03:00
Alexey Milovidov
6d84a88629 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 09:46:42 +03:00
Alexey Milovidov
5074301f8d Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 08:14:39 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00
Alexey Milovidov
a3fa44e71a Miscellaneous [#CLICKHOUSE-2]. 2017-11-12 03:46:22 +03:00
Alexey Milovidov
d305f6190e Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-11 04:04:39 +03:00
Alexey Milovidov
726301572f Added 'format' mode of operation for clickhouse binary [#CLICKHOUSE-3]. 2017-11-11 04:04:14 +03:00
Silviu Caragea
b4f7bfaa02 Remove duplicate code from zookeeper.cpp 2017-11-11 03:36:29 +03:00
Nikolai Kochetov
14d2b830bb fix build 2017-11-10 14:44:32 +03:00
Nikolai Kochetov
cdd852902d Merge branch 'master' into catboost-models 2017-11-10 14:40:08 +03:00
Nikolai Kochetov
ad381f90e5 changed column names in catboost pool [#CLICKHOUSE-3305] 2017-11-10 14:31:02 +03:00
Nikolai Kochetov
2ae3f0b3b4 fixed tests [#CLICKHOUSE-3305]
added aliases for catboost pool [#CLICKHOUSE-3305]
2017-11-10 14:30:48 +03:00
Alexey Milovidov
afae2d7c67 Fixed incorrect test when no ZooKeeper configured [#CLICKHOUSE-2]. 2017-11-09 22:50:28 +03:00
Alexey Milovidov
d52595735d Renamed test [#CLICKHOUSE-2]. 2017-11-09 22:27:30 +03:00
Alexey Milovidov
ac1b69247c Addition to prev. revision [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
ec5720eb66 Auto version update to [54311] 2017-11-09 22:25:21 +03:00
Alexey Milovidov
62a5c882a9 Fixed error [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
2d1702f8e6 Added test for enhanced time zones support [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
60477a9aaa Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
90ca758522 Miscellaneous [#CLICKHOUSE-3]. 2017-11-09 16:44:08 +03:00
proller
f8032c47cb Tests: revert shard auto disabling 2017-11-05 23:17:43 +03:00
Alexey Zatelepin
1b6a5ca6ea add test [#CLICKHOUSE-3412] 2017-11-05 21:11:11 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Alexey Milovidov
8e4253ac73 Fixed error when Date argument can be passed to toStartOfDay function [#CLICKHOUSE-2]. 2017-11-05 08:17:48 +03:00
Alexey Milovidov
783e812eb7 Fixed error [#CLICKHOUSE-2] 2017-11-04 19:46:14 +03:00
Alexey Milovidov
1aaff5762c Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:20:18 +03:00
Alexey Milovidov
f3a43f1954 Merge branch 'master' into yurial-change-shared-ptr-helper 2017-11-04 05:12:18 +03:00
Alexey Milovidov
03b6aa5d21 Fixed bad translation [#CLICKHOUSE-2]. 2017-11-04 05:12:05 +03:00
Alexey Milovidov
fa8bcccdb9 Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 00:50:22 +03:00
Alexey Zatelepin
f0da2a96b8 fix use of uninitialized variable [#CLICKHOUSE-2] 2017-11-03 19:39:06 +03:00
Vitaliy Lyudvichenko
a4636f8656 Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2]
Resolves #1404
2017-11-03 00:32:59 +03:00
proller
d940d1713c Cmake: silent poco warnings, use compiler version defenition by cmake (#1440)
Cmake: silent poco warnings, use compiler version definition by cmake
2017-11-03 00:30:27 +03:00
alexey-milovidov
febfa9f476
Update Client.cpp 2017-11-03 00:27:12 +03:00
proller
542104a9af Client: Print server version on exception (#CLICKHOUSE-3407) 2017-11-02 17:45:23 +03:00
proller
c974f0e88e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko
9cf14d2c61 Remove obsolete code. [#CLICKHOUSE-2] 2017-11-02 17:35:12 +03:00
proller
8aafa3b042
Cmake: fix warnings (#1437)
* Cmake: fix warnings

* Tests: replace 127.0.0.1 -> localhost
2017-11-02 17:14:16 +03:00
proller
e671c48a6e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 14:50:47 +03:00
KochetovNicolai
bfb4e8f3fe zookeeper chroot fix (#1430)
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* moved root section in zookeeper configuration [#CLICKHOUSE-3031]

* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]

* added tests [#CLICKHOUSE-3031]

* replaced tabs to spaces in config files [#CLICKHOUSE-3031]

* fix build [#CLICKHOUSE-3031]

* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]

* added comments [#CLICKHOUSE-3031]

* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]

* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
proller
6da4f5a661 add locks 2017-11-01 22:56:07 +03:00