Commit Graph

9435 Commits

Author SHA1 Message Date
Alexey Milovidov
94d3b49e99 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:27:43 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Alexey Milovidov
69714f0671 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:55:53 +03:00
Alexey Milovidov
dfb4a92f5a BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:47:39 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
14e069f748 Allow to extract empty matches in "extractAll" function #1493. 2017-11-18 05:48:11 +03:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
8517251ebd Improved performance of toString function of Date and DateTime arguments [#CLICKHOUSE-2]. 2017-11-18 02:45:49 +03:00
Alexey Milovidov
655565466c Merge remote-tracking branch 'origin/master' into better-date-parsing-formatting 2017-11-18 02:45:17 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
8425c56c0f Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-18 00:00:29 +03:00
Alexey Milovidov
7cf5eaddc0 Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-17 23:59:31 +03:00
Alexey Milovidov
4f8009517c Thread name can be 15 bytes max [#CLICKHOUSE-2]. 2017-11-17 23:57:07 +03:00
Alexey Milovidov
f54e99490f Merge branch 'master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:48:16 +03:00
Alexey Milovidov
8e362ba641 Fixed build [#CLICKHOUSE-2]. 2017-11-17 23:48:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
18be706127 Merge remote-tracking branch 'origin/master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:30:51 +03:00
proller
5190325275 Allocator fix: nothing do when sizes equal, allow reallocate to smaller size (#1512)
* PerformanceTest fixes.

* format

* Allocator fix: nothing do when sizes equal, allow reallocate to smaller size

* Update Allocator.cpp
2017-11-17 23:27:12 +03:00
Alexey Milovidov
9264bc4013 Style [#CLICKHOUSE-2]. 2017-11-17 23:18:06 +03:00
proller
19d102cc4f fix 2017-11-17 22:53:02 +03:00
Alexey Milovidov
4ab2d4bc31 Added comment [#CLICKHOUSE-2]. 2017-11-17 22:49:17 +03:00
Alexey Milovidov
263e262413 Style [#CLICKHOUSE-2]. 2017-11-17 22:43:25 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
7b417de0c7 format 2017-11-17 00:01:00 +03:00
proller
cf35323fc4 PerformanceTest fixes. 2017-11-17 00:01:00 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
Alexey Milovidov
28b5bd8821 Removed useless code [#CLICKHOUSE-3431]. 2017-11-16 22:04:07 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
Alexey Milovidov
ee48dea0d3 Attempt to improve performance of formatting Date and DateTime [#CLICKHOUSE-2]. 2017-11-16 05:07:19 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Marek Vavruša
c07b48075b StorageKafka: fixed messages not showing when EOF is reached in current batch
This prevents messages from being read if there's less than 16 messages to read in Kafka.
Updated documentation with more detailed description.
2017-11-15 23:17:22 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
0342d785c9 add failing test [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
Alexander Makarov
5b113df16c Rewrote pieces of code with ambiguous '&pointer[offset]' semantics 2017-11-15 22:22:32 +03:00
Alexander Makarov
84b2f16913 fixed several UB-abusing places 2017-11-15 22:22:32 +03:00
robot-metrika-test
ebec370fa5 Auto version update to [54312] 2017-11-15 16:12:02 +03:00
Alexey Milovidov
1a50e733b2 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-15 05:24:22 +03:00
Alexey Milovidov
8d3da74aae Fixed error [#CLICKHOUSE-2]. 2017-11-15 05:24:05 +03:00
alexey-milovidov
19e0cd879d
Extended date parsing (#1495)
* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].

* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].
2017-11-15 05:08:55 +03:00
Alexey Milovidov
dfdc3ba680 Revert "Enable YYYY-mM-dD parsing."
This reverts commit e1fb55cc99.
2017-11-15 05:08:12 +03:00
Amos Bird
e1fb55cc99 Enable YYYY-mM-dD parsing.
This patch makes ClickHouse be able to parse DateTime string like '2017-2-3',
'2017-02-3' and '2017-2-03' correctly.
2017-11-15 05:07:52 +03:00
Alexey Milovidov
fb2d2d36e0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-14 20:08:55 +03:00
Alexey Milovidov
e6ccb9b662 Renamed function "runningIncome" to "runningDifferenceStartingWithFirstValue" for clarity [#CLICKHOUSE-2]. 2017-11-14 20:08:51 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
c4b4764a0a Fixed error after merge [#CLICKHOUSE-2]. 2017-11-14 03:11:33 +03:00
Alexey Milovidov
18cdec38bd Added comment [#CLICKHOUSE-2]. 2017-11-14 01:53:14 +03:00
Alexey Milovidov
c58ef28b60 Added test [#CLICKHOUSE-2]. 2017-11-14 01:34:14 +03:00
Alexey Milovidov
4c2ffbb315 Better implementations of isInfinite, isFinite, isNaN [#CLICKHOUSE-2]. 2017-11-14 00:47:49 +03:00
alexey-milovidov
855742ba4e
Merge pull request #1426 from yandex/catboost-models
Catboost models
2017-11-13 22:06:22 +03:00
Alexey Milovidov
dcd8355b81 Addition to prev. revision [#CLICKHOUSE-3396]. 2017-11-12 20:26:49 +03:00
Alexey Milovidov
0298243b46 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 20:08:52 +03:00
Alexey Milovidov
2029b38527 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 19:45:30 +03:00
Alexey Milovidov
1dd7568fc1 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:19:48 +03:00
Alexey Milovidov
c8dbea9d36 Merge branch 'embedded-compiler' 2017-11-12 16:09:56 +03:00
Alexey Milovidov
fd8c418416 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:09:08 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484)
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
2017-11-12 15:58:40 +03:00
Alexey Milovidov
22f06f3f7a Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 14:40:27 +03:00
Alexey Milovidov
cd25ecafb7 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 13:29:52 +03:00
Alexey Milovidov
07650e02c4 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 12:10:59 +03:00
Alexey Milovidov
037b7da2ae Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 11:44:22 +03:00
Alexey Milovidov
6d84a88629 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 09:46:42 +03:00
Alexey Milovidov
5074301f8d Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 08:14:39 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00
Alexey Milovidov
a3fa44e71a Miscellaneous [#CLICKHOUSE-2]. 2017-11-12 03:46:22 +03:00
Alexey Milovidov
d305f6190e Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-11 04:04:39 +03:00
Alexey Milovidov
726301572f Added 'format' mode of operation for clickhouse binary [#CLICKHOUSE-3]. 2017-11-11 04:04:14 +03:00
Silviu Caragea
b4f7bfaa02 Remove duplicate code from zookeeper.cpp 2017-11-11 03:36:29 +03:00
Nikolai Kochetov
14d2b830bb fix build 2017-11-10 14:44:32 +03:00
Nikolai Kochetov
cdd852902d Merge branch 'master' into catboost-models 2017-11-10 14:40:08 +03:00
Nikolai Kochetov
ad381f90e5 changed column names in catboost pool [#CLICKHOUSE-3305] 2017-11-10 14:31:02 +03:00
Nikolai Kochetov
2ae3f0b3b4 fixed tests [#CLICKHOUSE-3305]
added aliases for catboost pool [#CLICKHOUSE-3305]
2017-11-10 14:30:48 +03:00
Alexey Milovidov
afae2d7c67 Fixed incorrect test when no ZooKeeper configured [#CLICKHOUSE-2]. 2017-11-09 22:50:28 +03:00
Alexey Milovidov
d52595735d Renamed test [#CLICKHOUSE-2]. 2017-11-09 22:27:30 +03:00
Alexey Milovidov
ac1b69247c Addition to prev. revision [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
ec5720eb66 Auto version update to [54311] 2017-11-09 22:25:21 +03:00
Alexey Milovidov
62a5c882a9 Fixed error [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
2d1702f8e6 Added test for enhanced time zones support [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
60477a9aaa Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
90ca758522 Miscellaneous [#CLICKHOUSE-3]. 2017-11-09 16:44:08 +03:00
proller
f8032c47cb Tests: revert shard auto disabling 2017-11-05 23:17:43 +03:00
Alexey Zatelepin
1b6a5ca6ea add test [#CLICKHOUSE-3412] 2017-11-05 21:11:11 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Alexey Milovidov
8e4253ac73 Fixed error when Date argument can be passed to toStartOfDay function [#CLICKHOUSE-2]. 2017-11-05 08:17:48 +03:00
Alexey Milovidov
783e812eb7 Fixed error [#CLICKHOUSE-2] 2017-11-04 19:46:14 +03:00
Alexey Milovidov
1aaff5762c Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:20:18 +03:00
Alexey Milovidov
f3a43f1954 Merge branch 'master' into yurial-change-shared-ptr-helper 2017-11-04 05:12:18 +03:00
Alexey Milovidov
03b6aa5d21 Fixed bad translation [#CLICKHOUSE-2]. 2017-11-04 05:12:05 +03:00
Alexey Milovidov
fa8bcccdb9 Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 00:50:22 +03:00
Alexey Zatelepin
f0da2a96b8 fix use of uninitialized variable [#CLICKHOUSE-2] 2017-11-03 19:39:06 +03:00
Vitaliy Lyudvichenko
a4636f8656 Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2]
Resolves #1404
2017-11-03 00:32:59 +03:00
proller
d940d1713c Cmake: silent poco warnings, use compiler version defenition by cmake (#1440)
Cmake: silent poco warnings, use compiler version definition by cmake
2017-11-03 00:30:27 +03:00
alexey-milovidov
febfa9f476
Update Client.cpp 2017-11-03 00:27:12 +03:00
proller
542104a9af Client: Print server version on exception (#CLICKHOUSE-3407) 2017-11-02 17:45:23 +03:00
proller
c974f0e88e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko
9cf14d2c61 Remove obsolete code. [#CLICKHOUSE-2] 2017-11-02 17:35:12 +03:00
proller
8aafa3b042
Cmake: fix warnings (#1437)
* Cmake: fix warnings

* Tests: replace 127.0.0.1 -> localhost
2017-11-02 17:14:16 +03:00
proller
e671c48a6e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 14:50:47 +03:00
KochetovNicolai
bfb4e8f3fe zookeeper chroot fix (#1430)
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* moved root section in zookeeper configuration [#CLICKHOUSE-3031]

* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]

* added tests [#CLICKHOUSE-3031]

* replaced tabs to spaces in config files [#CLICKHOUSE-3031]

* fix build [#CLICKHOUSE-3031]

* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]

* added comments [#CLICKHOUSE-3031]

* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]

* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
proller
6da4f5a661 add locks 2017-11-01 22:56:07 +03:00
proller
3b58e9cd67 Fix atomic usage 2017-11-01 20:15:05 +03:00
proller
c5dcde0c78 fix atomic usage 2017-11-01 16:58:02 +03:00
proller
6e3ca916d9 Fix atomic usage 2017-11-01 16:35:34 +03:00
proller
9fb4e86270 Tests: fix bash usage;
Use ${CLICKHOUSE_LOCAL} in tests
add --testname options to tests
2017-11-01 14:46:58 +03:00
proller
9bc029ba17 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-01 14:43:48 +03:00
robot-metrika-test
748f3e796b Auto version update to [54310] 2017-11-01 08:03:17 +03:00
Alexey Milovidov
d3e3879de1 Fixed test [#CLICKHOUSE-2]. 2017-11-01 07:11:01 +03:00
Alexey Milovidov
3a6f42a8bd Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-01 06:09:15 +03:00
Alexey Milovidov
175af4b2e9 Removed copy-paste [#CLICKHOUSE-2]. 2017-11-01 06:09:06 +03:00
robot-metrika-test
e41e71ad8b Auto version update to [54309] 2017-11-01 04:49:28 +03:00
Alexey Milovidov
6aff58c747 Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2]. 2017-11-01 04:45:10 +03:00
proller
dadb32d042 Fix freebsd build (#1428)
* Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 )

* Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa)

* Fix freebsd build

* Fix build with installed system cityhash
2017-10-31 22:45:58 +03:00
alexey-milovidov
3f9d858df4
Merge pull request #1427 from yandex/running-income
runningIncome
2017-10-31 22:45:24 +03:00
robot-metrika-test
84d0c5adde Auto version update to [54308] 2017-10-31 22:32:28 +03:00
proller
47eae26d75 Fix build 2017-10-31 22:19:36 +03:00
proller
2dff8c6207 Tests: fix bash usage 2017-10-31 21:13:32 +03:00
proller
6ee58e1321 use ${CLICKHOUSE_LOCAL} in tests 2017-10-31 21:07:26 +03:00
proller
6debbf819a Merge remote-tracking branch 'origin/fix4' into fix4 2017-10-31 18:36:04 +03:00
proller
9e73e08269 wip 2017-10-31 17:40:44 +03:00
Nikolai Kochetov
c8d4a92cfb added runningIncome [#CLICKHOUSE-3395] 2017-10-31 17:27:02 +03:00
Nikolai Kochetov
554bb889ac merged with master 2017-10-31 15:04:13 +03:00
Nikolai Kochetov
18ef139e9d load features count from catboost model file [#CLICKHOUSE-3305] 2017-10-31 14:50:24 +03:00
Nikolai Kochetov
2bd2bc6191 renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305]
renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305]
2017-10-31 14:50:23 +03:00
Nikolai Kochetov
9baa5b9e14 add non-feature columns as materialized to StorageCatBoostPool [#CLICKHOUSE-3305] 2017-10-31 14:50:22 +03:00
Nikolai Kochetov
d54e27cdcb added TableFunctionCatBoostPool [#CLICKHOUSE-3305]
fix column descriptions parsing [#CLICKHOUSE-3305]
2017-10-31 14:50:22 +03:00
Nikolai Kochetov
8ebce6ef5d StorageCatBoostPool [#CLICKHOUSE-3305] 2017-10-31 14:50:21 +03:00
Nikolai Kochetov
f927491a47 decreased accuracy threshold for catboost python tests [#CLICKHOUSE-3305] 2017-10-31 14:50:21 +03:00
Nikolai Kochetov
cec9f90e1e added optional features count validation [#CLICKHOUSE-3305] 2017-10-31 14:50:13 +03:00
Nikolai Kochetov
e6d8c7bf31 changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-31 14:50:03 +03:00
proller
812ac4a738 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-31 13:57:22 +03:00
robot-metrika-test
67739ffa9b Auto version update to [54307] 2017-10-30 22:35:37 +03:00
proller
bd1d699441 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 22:30:28 +03:00
Alexey Zatelepin
f2ebffb7f0 save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2] 2017-10-30 21:39:39 +03:00
alexey-milovidov
7a6d31fa63
Update Connection.cpp 2017-10-30 21:22:56 +03:00
proller
723cbb310d Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 21:19:28 +03:00
proller
340c66f8e2 Fix build without openssl 2017-10-30 21:10:50 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
Catboost models
2017-10-30 19:16:41 +03:00
proller
3ad6ea54ea Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 17:48:18 +03:00
proller
5d137e22eb More atomics 2017-10-30 17:38:16 +03:00
Alexey Milovidov
4675e1e747 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-30 17:01:16 +03:00
Alexey Milovidov
7a876fddb9 Attempt to fix build with gcc 6 [#CLICKHOUSE-2]. 2017-10-30 17:00:47 +03:00
proller
cda6473668 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 16:45:22 +03:00
Alexey Zatelepin
141b85189e always allow attaching tables with extended storage definition syntax [#CLICKHOUSE-3000] 2017-10-30 16:44:43 +03:00
proller
8b3d3cf56f Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 16:19:19 +03:00
Vitaliy Lyudvichenko
4b9163c3cc Fix bash warning in the test. [#CLICKHOUSE-3385]
Also use 'clickhouse compressor' util instead of clickhouse-compressor binary.
2017-10-30 16:10:22 +03:00
Vitaliy Lyudvichenko
4a55e5f94b Hotfix of CREATE MATERIALIZED VIEW a TO b. [#CLICKHOUSE-2] 2017-10-30 15:14:36 +03:00
proller
b7dd5cd0ba Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 13:42:34 +03:00
proller
956e1513c5 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-30 13:22:20 +03:00
Alexey Milovidov
e29604b7f9 Updated test [#CLICKHOUSE-2099]. 2017-10-30 09:27:21 +03:00
Alexey Milovidov
b7e006213b Removed obsolete test [#CLICKHOUSE-2]. 2017-10-30 09:10:57 +03:00
Alexey Milovidov
1c50c65057 Fixed error [#CLICKHOUSE-3331]. 2017-10-30 09:02:17 +03:00
Alexey Milovidov
2690c920f9 Added test [#CLICKHOUSE-3393]. 2017-10-30 08:39:30 +03:00
Alexey Milovidov
ad8afcc022 Added functions to implement INTERVAL operations [#CLICKHOUSE-3393]. 2017-10-30 08:39:30 +03:00
Alexey Milovidov
bed7b531a1 INTERVAL operators: development [#CLICKHOUSE-3393]. 2017-10-30 08:39:30 +03:00
Alexey Milovidov
5c8c3bdde0 Fixed build on Mac OS X [#CLICKHOUSE-2]. 2017-10-29 08:52:41 +03:00
Alexey Milovidov
7ecc63fe71 Functions for interval arithmetic on DateTime and Date: development [#CLICKHOUSE-2]. 2017-10-29 07:18:48 +03:00
Alexey Milovidov
4236bcbfa2 Fixed year 2038 problem. Added support for timezones with fractional offset from UTC. [#CLICKHOUSE-2099] [#CLICKHOUSE-3392]. 2017-10-29 03:51:40 +03:00
Alexey Milovidov
c99f82538c Miscellaneous [#CLICKHOUSE-2]. 2017-10-28 08:43:20 +03:00
Alexey Milovidov
e36906cdf5 Fixed build [#CLICKHOUSE-2]. 2017-10-28 06:59:42 +03:00
Alexey Milovidov
9c96d5c2ab Updated cppcheck instruction a little [#CLICKHOUSE-2]. 2017-10-28 06:43:26 +03:00
Alexey Milovidov
ef36648f85 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-28 02:10:00 +03:00
Alexey Milovidov
7949994508 Changed tabs to spaces in test [#CLICKHOUSE-2]. 2017-10-28 02:09:50 +03:00
proller
ba49157f84 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-28 01:06:09 +03:00
Alexey Milovidov
9e3daca437 Fixed build [#CLICKHOUSE-2]. 2017-10-28 00:36:43 +03:00
Alexey Milovidov
f5d7eb4df0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-28 00:31:32 +03:00
Alexey Milovidov
b2892e058a Fixed bad file name [#CLICKHOUSE-2]. 2017-10-28 00:31:10 +03:00
robot-metrika-test
3a5ea17899 Auto version update to [54306] 2017-10-28 00:23:24 +03:00
Alexey Milovidov
5ab78c249d Fixed build after merge [#CLICKHOUSE-2]. 2017-10-28 00:18:06 +03:00
robot-metrika-test
ab490ec1fa Auto version update to [54305] 2017-10-28 00:00:03 +03:00
Alexey Zatelepin
514a4d4fba use stale local replica if all remote replicas are unavailable [#CLICKHOUSE-3377] 2017-10-27 23:46:19 +03:00
Alexey Milovidov
14fd5843c9 Merge branch 'materialized-view-to' of https://github.com/vavrusa/ClickHouse into vavrusa-materialized-view-to 2017-10-27 23:43:14 +03:00
Alexey Milovidov
6ca1b84929 Added function getSizeOfEnumType [#CLICKHOUSE-2]. 2017-10-27 23:39:49 +03:00
alexey-milovidov
9e200bdfd9
Merge branch 'master' into materialized-view-to 2017-10-27 23:21:27 +03:00
proller
c878af8740 Merge remote-tracking branch 'upstream/master' into fix4 2017-10-27 23:13:35 +03:00
Marek Vavruša
c44e3e76c8 Renamed CapnProtoInputStream to CapnProtoRowInputStream. 2017-10-27 23:03:51 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
2017-10-27 23:03:51 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
alexey-milovidov
b4bb6796c1
Merge pull request #1407 from yandex/CLICKHOUSE-3381
Ability to turn off deduplication, smart deduplication for MV
2017-10-27 23:03:25 +03:00
Vitaliy Lyudvichenko
cd5d1d5009 Fixed segfault in compare operators with Nullable types. #1416 [#CLICKHOUSE-3] 2017-10-27 23:03:12 +03:00
proller
4dd1634772 Print sizes in memory errors (#1413)
* Print sizes in memory errors

* use formatReadableSizeWithBinarySuffix

* Fix

* Requested changes

* fix alignment message
2017-10-27 22:18:39 +03:00
Alexey Milovidov
3a79095274 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-27 20:24:44 +03:00
Alexey Milovidov
1d8dc11f40 Fixed one of errors that cause abort when no space left on device with logs (now useless, as ClickHouse will instead refuse all connections) [#CLICKHOUSE-2] 2017-10-27 20:24:33 +03:00
proller
07009d5072 Bughunt tsan 2017-10-27 18:34:26 +03:00
proller
1736d7d312 Allow build with system lib rdkafka 2017-10-27 17:40:41 +03:00
Nikolai Kochetov
c1cbfdc2ad decreased accuracy threshold for catboost python tests [#CLICKHOUSE-3305] 2017-10-27 15:41:08 +03:00
Nikolai Kochetov
8f84d51a5d added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 15:23:26 +03:00
Nikolai Kochetov
fea2bed3da added optional features count validation [#CLICKHOUSE-3305] 2017-10-27 11:39:54 +03:00
Nikolai Kochetov
9c3c3231f4 added optional features count validation [#CLICKHOUSE-3305] 2017-10-26 23:12:40 +03:00
Nikolai Kochetov
0d356f9a6a fix build [#CLICKHOUSE-3305] 2017-10-26 22:14:25 +03:00
Nikolai Kochetov
46dfa7bf8d changed boost::dll to SharedLibrary; removed boost::dll [#CLICKHOUSE-3305] 2017-10-26 22:00:27 +03:00
Alexey Milovidov
41c05f22be Removed very old obsolete tests [#CLICKHOUSE-2]. 2017-10-26 21:49:48 +03:00
Nikolai Kochetov
3757c9682e style fixes [#CLICKHOUSE-3305] 2017-10-26 21:49:23 +03:00
Nikolai Kochetov
b66577e38a changed ExternalLoaderUpdateSettings [#CLICKHOUSE-3305] 2017-10-26 21:39:55 +03:00
Alexey Milovidov
6022201c26 Removed very old obsolete test [#CLICKHOUSE-2]. 2017-10-26 21:38:40 +03:00
Alexey Milovidov
a27981b4ef Get rid of double whitespaces [#CLICKHOUSE-2]. 2017-10-26 21:36:23 +03:00
Nikolai Kochetov
10bbf0871b added comments [#CLICKHOUSE-3305] 2017-10-26 21:30:28 +03:00
Alexey Milovidov
1f81797adc Don't use direct IO in test as it doesn't work in encrypted FS and is irrelevant for the test [#CLICKHOUSE-2]. 2017-10-26 21:11:09 +03:00
Alexey Milovidov
ac5062d592 Fixed incorrect usage of "toRelative" family of functions in tests [#CLICKHOUSE-2]. 2017-10-26 21:09:02 +03:00
Vitaliy Lyudvichenko
51265506f8 Convey session setting up to inner table creation for MV. [#CLICKHOUSE-3381] 2017-10-26 18:39:56 +03:00
Vitaliy Lyudvichenko
3b466ec57b Add deduplication test. [#CLICKHOUSE-3381] 2017-10-26 18:22:34 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Nikolai Kochetov
371e234f01 changed ExternalLoader::getObjectsMap return type [#CLICKHOUSE-3305] 2017-10-26 17:26:03 +03:00
Vitaliy Lyudvichenko
602560cb2e Update system.parts table. [#CLICKHOUSE-3178] 2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
483dfd1b44 Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
a5e29f2166 Add integration test. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf Fixed awful copypaste. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
71833a7f0f More correct procedure of parts deleting. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421 Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088 Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257 Add state for MergeTree parts. [#CLICKHOUSE-3178]
And Removed obsolete code.
2017-10-26 17:16:06 +03:00
Nikolai Kochetov
092567af39 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:10:51 +03:00
Nikolai Kochetov
4204a94b20 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:08:05 +03:00
Alexey Zatelepin
ec963e3397 save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000] 2017-10-26 17:07:15 +03:00
Nikolai Kochetov
2e6b1dfd92 renamed cloneObject to clone in IExternalLoadable [#CLICKHOUSE-3305] 2017-10-26 16:42:14 +03:00
Nikolai Kochetov
c3d104f53b changed IDictionary clone [#CLICKHOUSE-3305] 2017-10-26 16:41:51 +03:00
Alexey Zatelepin
f130d2df65 fix creation of system log tables [#CLICKHOUSE-2] 2017-10-26 15:44:47 +03:00
Nikolai Kochetov
fd8eb13dcc refactoring [#CLICKHOUSE-3305] 2017-10-26 15:18:37 +03:00
Alexey Zatelepin
88c4ea1ac3 allow specifying ENGINE for CREATE TEMPORARY TABLE (but only if it is Memory) [#CLICKHOUSE-2] 2017-10-26 15:15:33 +03:00
proller
9ccba5fad1 Fix includes 2017-10-26 14:46:57 +03:00
Alexey Zatelepin
6ada6d9aa5 remove dead code [#CLICKHOUSE-2] 2017-10-26 07:53:52 +03:00
Alexey Zatelepin
01c39dcf1c fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Milovidov
2cc3fdae9b Useless modifications for cppcheck [#CLICKHOUSE-2]. 2017-10-26 04:47:03 +03:00
Marek Vavruša
ee22253857 tests: added tests for sumWithOverflow(x) preserving input type 2017-10-25 22:21:59 +03:00
Marek Vavruša
c0458999f9 SummingSortedBlockInputStream: fix summing of multiple blocks
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066 AggregateFunctionSum: implemented sumWithOverflow(x)
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.

This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf SummingSortedBlockInputStream: fix explicitly configured columns to sum
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.

This also fixes summation of invalid maps with
with only one key column and no value columns.

Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
2017-10-25 22:21:59 +03:00
Marek Vavruša
fa098b469c AggregateFunctionSumMap: compact keys with zero value
This allows `sumMap(k, v)` to compact all keys
for which the values are all zero.
2017-10-25 22:21:59 +03:00
Alexey Milovidov
65982a1642 Fixed exception messages [#CLICKHOUSE-2]. 2017-10-25 22:17:37 +03:00
proller
4ffbca2d8c Fix warnings (#1406)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
Nikolai Kochetov
54786902c3 added test [#CLICKHOUSE-3305]
added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]
2017-10-25 20:08:46 +03:00
Marek Vavruša
d942ca0c0b Updated exceptions and added comments. 2017-10-24 17:57:03 -07:00
alexey-milovidov
b5155916a8 Merge branch 'master' into materialized-view-to 2017-10-24 22:39:24 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)"
This reverts commit fa2484ea90.
2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381)
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
2017-10-24 22:11:42 +03:00
alexey-milovidov
6d62a117a1 Merge pull request #1395 from proller/fix4
Fix stripping debug info from huge .o (-g0)
2017-10-24 22:04:21 +03:00