Commit Graph

1529 Commits

Author SHA1 Message Date
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714 2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7 CLICKHOUSE-3714 add max_partition_size_to_drop 2018-08-01 20:41:18 +03:00
Alexey Milovidov
c9ab39c8c6 Added validation of ODBC connection string [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
chertus
4a1b7cfebf Merge branch 'master' into decimal 2018-07-30 21:51:08 +03:00
alesapin
744258818e CLICKHOUSE-3852: Fix PR remarks 2018-07-29 04:58:05 +03:00
alesapin
1f32701665 CLICKHOUSE-3852: Remove useless newlines 2018-07-29 04:58:05 +03:00
alesapin
652e5ff9e2 CLICKHOUSE-3852: Add ability to set up config parameters from env variables. 2018-07-29 04:58:05 +03:00
chertus
b9fd87eff7 Merge branch 'master' into decimal 2018-07-27 20:31:33 +03:00
chertus
492875e0f7 decimal comparisons with other integers 2018-07-26 18:28:14 +03:00
chertus
c1c149d74b decimal comparisons 2018-07-25 22:38:21 +03:00
alexey-milovidov
dc2c22ffff
Update IFactoryWithAliases.h 2018-07-25 21:46:16 +03:00
alesapin
9adb251689 CLICKHOUSE-3857: Add table table_engines, alias factory base class and columns alias_to and case_insensitive to functions 2018-07-25 19:08:23 +03:00
Alexey Milovidov
7c07f46d50 Style [#CLICKHOUSE-2] 2018-07-24 21:46:23 +03:00
Nikolai Kochetov
bbd13a25e4 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:54:10 +03:00
chertus
5ec47b4a1c decimal (in progress) 2018-07-20 22:05:07 +03:00
proller
51cdec0bec CLICKHOUSE-3771: fixes 2018-07-18 12:48:45 +03:00
proller
c7848d2062 CLICKHOUSE-3771: Fixes 2018-07-17 21:22:32 +03:00
Alexey Milovidov
6a2d8d4f3f Added support for arbitary complex types in "uniq" family of aggregate functions #2010 2018-07-16 06:55:41 +03:00
Alexey Milovidov
215ec2be98 Tiny improvement [#CLICKHOUSE-3820] 2018-07-13 20:27:58 +03:00
Alexey Milovidov
c315200e64 Fixed rare error in ZooKeeper library: callback never called in case when network error happens after reading response header but before response body was read - that will lead to deadlock and readonly table [#CLICKHOUSE-3820] 2018-07-13 00:31:38 +03:00
Alexey Milovidov
d6a3cade18 Whitespaces [#CLICKHOUSE-3820] 2018-07-11 19:10:02 +03:00
Alexey Milovidov
f80081ca03 Fixed chroot prefix in information about exception for ZooKeeper multi transaction (variant 2) [#MDBSUPPORT-204] 2018-07-10 19:14:27 +03:00
Alexey Milovidov
a26a0f5331 Better exception message for KeeperMiltiException [#MDBSUPPORT-204] 2018-07-10 16:47:14 +03:00
Alexey Milovidov
8e0ae12b4e Miscellaneous [#CLICKHOUSE-2] 2018-07-10 16:43:01 +03:00
Simon Podlipsky
6c7ba03d0f
Add missing UInt128 (UUID) field visitors 2018-07-10 00:39:13 +03:00
Alexey Milovidov
7707b5a209 Improvement [#CLICKHOUSE-3810] 2018-07-08 02:53:49 +03:00
Alexey Milovidov
4b099e385b Fixed typo #2482 2018-07-04 20:28:06 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Mikhail Surin
c7a305eca3 fix float transform 2018-06-28 16:36:40 +03:00
Alexey Zatelepin
2447755700 BackgroundSchedulePool: remove task from delayed even it it is currently executing
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Alexey Zatelepin
7ce74d1730 ZooKeeper client: before the fix we waited 2x longer than necessary before the timeout 2018-06-22 18:30:29 +03:00
proller
a31adcfdea Allow use unbundled cpuid (#2543)
* Wait test server startup for 5s

* clean

* Allow use system libcpuid

* cpuid: move include/cpuid/ -> include/libcpuid/

* fix
2018-06-21 20:35:03 +03:00
proller
e1ae5233df Add // Y_IGNORE tags 2018-06-21 18:24:36 +03:00
Vitaliy Lyudvichenko
1a4157f2a9 clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910]
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488)
CONTRIB-254
2018-06-19 21:09:09 +03:00
Vitaliy Lyudvichenko
e031b5360a Minor enhancement. [#CLICKHOUSE-2910] 2018-06-18 16:50:20 +03:00
Vitaliy Lyudvichenko
392f6e0c6c Print query_id in logs. Add own logging interface. [#CLICKHOUSE-2910] 2018-06-18 16:41:13 +03:00
Alexey Milovidov
82102c6896 Fixed conflicting headers on Fedora Rawhide while using Linux native AIO #2520 2018-06-18 04:33:34 +03:00
Alexey Milovidov
2298f1c68b Fixed strange code #2501 2018-06-16 08:54:06 +03:00
Alexey Milovidov
e4776e8b5d Fixed build (no include path was specified) #2513 2018-06-16 05:31:41 +03:00
alexey-milovidov
d853b28543
Merge pull request #2513 from yandex/trim-exit-string
Trim exit string
2018-06-16 05:15:25 +03:00
alexey-milovidov
d578bcbd5c
Update StringUtils.h 2018-06-16 05:14:37 +03:00
alexey-milovidov
e6daa67beb
Merge pull request #1890 from yandex/lz4_experiments
Faster LZ4 decompression (experimental) + simple draft of data mutator.
2018-06-16 04:57:47 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
Alexey Milovidov
c375814e44 Added support for intHashCRC32 on AArch64 [#CLICKHOUSE-2] 2018-06-15 08:21:12 +03:00
Alexey Milovidov
af5875960f Fallback for non x86 [#CLICKHOUSE-2] 2018-06-14 23:09:05 +03:00
Alexey Milovidov
86053c754f Fixed warning on platforms where char is unsigned [#CLICKHOUSE-2] 2018-06-14 22:57:11 +03:00
Alexey Milovidov
a2fdda4231 Fixed warning on platforms where char is unsigned [#CLICKHOUSE-2] 2018-06-14 22:54:11 +03:00
Nikolai Kochetov
fd406f30ad Trim exit string before checking. #2510 2018-06-14 22:21:35 +03:00
Nikolai Kochetov
27c6df7e20 Trim exit string before checking. #2510 2018-06-14 22:15:35 +03:00
Vitaliy Lyudvichenko
e5e73d4a9b Add CAP_NET_ADMIN capability check. [#CLICKHOUSE-2910] 2018-06-14 17:58:39 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
alexey-milovidov
f123fce023
Merge pull request #2505 from yandex/use-zookeeper-session-timeout-from-server
Use zookeeper session timeout from zookeeper server.
2018-06-13 22:36:37 +03:00
Nikolai Kochetov
cedf7a309e Use zookeeper session timeout from zookeeper server. 2018-06-13 22:24:54 +03:00
Alexey Milovidov
397ac0fb24 Updated performance testing tool #1890 2018-06-13 05:52:03 +03:00
Alexey Milovidov
24b0f77a2c Revert "Added ASLR to aid debugging #1890"
This reverts commit 619225323d.
2018-06-12 06:33:26 +03:00
Alexey Milovidov
619225323d Added ASLR to aid debugging #1890 2018-06-11 08:02:20 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
d864f39ec7 Merge branch 'master' into zhang2014-feature/support_truncate 2018-06-09 19:10:06 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
alexey-milovidov
587189b211
Merge branch 'master' into clang-compliant 2018-06-07 17:43:20 +03:00
flow
c408854c3c Clang compliant on macosx 2018-06-07 12:21:38 +08:00
Alexey Milovidov
b6a6e391b8 Fixed minor security issue [#CLICKHOUSE-3758] 2018-06-06 21:05:35 +03:00
Alexey Milovidov
51044279e5 Squashed #2471 2018-06-05 23:09:51 +03:00
Alexey Milovidov
a6caf556ef Fixed potential issue found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:43:38 +03:00
Alexey Milovidov
ca52d96e09 Insignificant changes for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:22:27 +03:00
Alexey Milovidov
5fa1cdf49e Better code (preparation) [#CLICKHOUSE-3] 2018-06-04 18:44:29 +03:00
Vitaliy Lyudvichenko
89f2107c75 C++ify taskstats getter, periodic auto update of profile events. [#CLICKHOUSE-2910] 2018-06-04 17:50:35 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Vitaliy Lyudvichenko
b46f2ad946 Simplified code via introducing states. [#CLICKHOUSE-2910] 2018-06-01 22:39:32 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
alexey-milovidov
46cb408fd8
Update BackgroundSchedulePool.cpp 2018-06-01 16:35:16 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Vitaliy Lyudvichenko
549a6944d9 Better AsynchronousBlockInputStream in sync mode. [#CLICKHOUSE-2910] 2018-06-01 14:58:17 +03:00
Alexey Milovidov
3cb68784ad Miscellaneous [#CLICKHOUSE-3753] 2018-05-31 22:30:08 +03:00
Alexey Milovidov
515bd29df7 Better name [#CLICKHOUSE-3753] 2018-05-31 22:28:30 +03:00
Alexey Milovidov
5dbd5b6d68 Fixed error in ZK library [#CLICKHOUSE-3753] 2018-05-31 22:26:21 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
proller
0cd644f5ec Fix test (no zookeeper detection) 2018-05-29 15:48:36 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Vitaliy Lyudvichenko
7615f5a09a More detail dignostic when parse JSONEachRow. [#CLICKHOUSE-2] 2018-05-28 14:40:07 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
bd4d8a6766 Add profile events and settings logging. [#CLICKHOUSE-2910] 2018-05-17 19:01:41 +03:00
Alexey Milovidov
195f91f191 Merge branch 'master' of github.com:yandex/ClickHouse 2018-05-16 03:35:07 +03:00
Alexey Milovidov
fb91bba279 Miscellaneous [#CLICKHOUSE-2] 2018-05-16 03:34:56 +03:00
Vitaliy Lyudvichenko
abc73eb6ba Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-15 21:35:52 +03:00
Vitaliy Lyudvichenko
412c154045 Better configs for an integration test. [#CLICKHOUSE-2] 2018-05-15 21:25:54 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Alexey Milovidov
3a059b82d2 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-09 23:34:20 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2]
Add disable_internal_dns_cache main config option.
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15
Build fixes (gcc8)
2018-05-09 07:25:18 +03:00
Alexey Milovidov
b442cd9c64 Miscellaneous (no effect) [#CLICKHOUSE-2] 2018-05-09 07:22:30 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
Alexey Milovidov
6e2028d921 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-08 16:01:56 +03:00
alexey-milovidov
fd9938cc46 Update getNumberOfPhysicalCPUCores.cpp 2018-05-08 12:43:45 +03:00
Atri Sharma
14cc530833 Update based on comments 2018-05-08 12:43:45 +03:00
Atri Sharma
22530c38e4 Add Rounding to nearest number 2018-05-08 12:43:45 +03:00
Atri Sharma
9b5ecc83ac Fix quota issue 2018-05-08 12:43:45 +03:00
Atri Sharma
cbaf78df4f Implement CGroups Limit for CPU 2018-05-08 12:43:45 +03:00
Alexey Milovidov
43f0b419ea Removed useless code [#CLICKHOUSE-2] 2018-05-08 00:01:15 +03:00
Alexey Milovidov
089ef3277f Removed useless code [#CLICKHOUSE-2] 2018-05-07 19:30:47 +03:00
Alexey Milovidov
01bbf650f8 Build fixes #2277 2018-05-07 11:59:24 +03:00
Alexey Milovidov
d1b4b5c836 Fixed error; added ProfileEvent #2277 2018-05-07 09:23:18 +03:00
Alexey Milovidov
e06223cbb8 Style [#CLICKHOUSE-2] 2018-05-07 05:15:47 +03:00
Alexey Milovidov
b8a6261bbc Style [#CLICKHOUSE-2] 2018-05-07 05:15:47 +03:00
Alexey Milovidov
a916d2760e Style [#CLICKHOUSE-2] 2018-05-07 05:15:24 +03:00
Alexey Milovidov
fd0ee5c6b1 Style [#CLICKHOUSE-2] 2018-05-07 05:14:24 +03:00
Alexey Milovidov
e26abf0ab4 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:08:38 +03:00
Alexey Milovidov
598c7fddb7 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:06:00 +03:00
Alexey Milovidov
94369e55d3 Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:29 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
proller
634ba89f90 Build fixes 2018-05-05 15:34:17 +03:00
Vitaliy Lyudvichenko
63cc34d3f6 Fixed incorrect failed OP detection in ZooKeeper. [#CLICKHOUSE-2] 2018-05-03 16:34:19 +03:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master 2018-04-29 18:02:34 +02:00
Vitaliy Lyudvichenko
e152f223c9 Fix nodes leak in case of session expiration. [#CLICKHOUSE-2] 2018-04-26 22:46:45 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
Alexey Milovidov
5ba5e80846 Added correct code #2257 2018-04-20 22:45:23 +03:00
alexey-milovidov
60fade5de8 Revert "ISSUES-1885 UTF8 countCodePoints use SIMD" 2018-04-20 22:18:24 +03:00
alexey-milovidov
21a5d2dfde Update Macros.h 2018-04-20 19:10:26 +03:00
alexey-milovidov
c783a69d6b Update Macros.cpp 2018-04-20 19:10:26 +03:00
Kirill Shvakov
918dbc2902 #2249 allow macros while creating kafka engine 2018-04-20 19:10:26 +03:00
Vitaliy Lyudvichenko
a29a99b7d3 Add test for ZooKeeperImpl with watch and chroot. [#CLICKHOUSE-2] 2018-04-19 22:40:42 +03:00
Alexey Milovidov
9a05dd6161 ZooKeeperImpl: fixed error with watches and chroot [#CLICKHOUSE-2] 2018-04-19 22:21:37 +03:00
Alexey Milovidov
12e33cfd85 Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2] 2018-04-19 21:16:18 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
proller
5b19d89133 Add git hash to version info 2018-04-13 15:42:35 +03:00
Alexey Milovidov
2392f87dca ZooKeeper: Fixed error [#CLICKHOUSE-2] 2018-04-10 19:48:43 +03:00
Silviu Caragea
f1b8d4bc39 Merge remote-tracking branch 'github/master' into background-schedule-pool-fix 2018-04-10 16:27:17 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
proller
c26b3bdef1
Fix split shared build; fix build without system odbc libs (#2191)
* Fix split shared build

* Fix build without system odbc libs

* Move dbms/src/Common/iostream_debug_helpers.h -> libs/libcommon/include/common/iostream_debug_helpers.h

* Fix build with libiodbc
2018-04-09 06:52:39 -07:00
Alexey Milovidov
79e319a7b6 ZooKeeper: fixed error [#CLICKHOUSE-2] 2018-04-08 07:45:59 +03:00
Alexey Milovidov
86317fe0f9 ZooKeeper: Fixed error [#CLICKHOUSE-2] 2018-04-08 07:25:13 +03:00
Alexey Milovidov
f40817f851 Moved SessionPoolHelpers #2180 2018-04-07 06:07:26 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
9b3169a331 Fixed build with clang 5 (although it is Ok on clang 6) [#CLICKHOUSE-2] 2018-04-06 23:03:35 +03:00
Alexey Milovidov
708dc5ef82 ZooKeeper: fixed error [#CLICKHOUSE-2] 2018-04-06 22:54:18 +03:00
Alexey Zatelepin
3a8ca70d1f fix races in leader election [#CLICKHOUSE-3533] 2018-04-06 19:10:23 +03:00
Alexey Milovidov
9bbd8a968e ZooKeeper: clarifications [#CLICKHOUSE-2] 2018-04-06 09:22:59 +03:00
Alexey Milovidov
0771874695 ZooKeeper: Fixed error when exception is thrown while session expiration and not all callbacks are called [#CLICKHOUSE-2] 2018-04-06 09:19:53 +03:00
Alexey Milovidov
775daa0fe9 Little better [#CLICKHOUSE-2] 2018-04-06 08:49:03 +03:00
Alexey Milovidov
3884146d92 Little better [#CLICKHOUSE-2] 2018-04-06 08:44:17 +03:00
Alexey Milovidov
2ae9e719c6 Fixed warning [#CLICKHOUSE-2] 2018-04-06 07:48:48 +03:00
Alexey Milovidov
e655cb0bff Better debug helpers [#CLICKHOUSE-2] 2018-04-06 07:46:18 +03:00
Alexey Milovidov
d9b54a6aae Updated comment [#CLICKHOUSE-2] 2018-04-05 23:47:06 +03:00
Alexey Milovidov
a2ce515a84 ZooKeeper: Fixed potential issue [#CLICKHOUSE-2] 2018-04-05 19:42:54 +03:00
Alexey Milovidov
d3408d45a8 ZooKeeper: fixed error [#CLICKHOUSE-2] 2018-04-05 07:31:04 +03:00
Alexey Milovidov
e00e81c3e9 ZooKeeper: fixed error [#CLICKHOUSE-2] 2018-04-05 07:06:23 +03:00
Alexey Milovidov
403a2c62a2 Miscellaneous [#CLICKHOUSE-2] 2018-04-05 05:56:11 +03:00
Alexey Milovidov
d5c5a34049 Miscellaneous [#CLICKHOUSE-2] 2018-04-05 05:55:21 +03:00
Alexey Milovidov
0dbc8aa1a5 ZooKeeper: added comment [#CLICKHOUSE-2] 2018-04-05 03:53:27 +03:00
Alexey Milovidov
cde5d315f1 ZooKeeper: added comment [#CLICKHOUSE-2] 2018-04-05 03:46:26 +03:00
Alexey Milovidov
0c519c763b ZooKeeper: added comment [#CLICKHOUSE-2] 2018-04-05 03:44:58 +03:00
Alexey Milovidov
b8df381a97 ZooKeeper: changed operation timeout to 10s because some users run ZooKeeper on servers with HDD and high background load [#CLICKHOUSE-2] 2018-04-05 03:02:09 +03:00
Alexey Milovidov
8faea5437a ZooKeeper: Better metrics about active sessions [#CLICKHOUSE-2] 2018-04-05 02:59:37 +03:00
Alexey Milovidov
e4fe1ef4b3 ZooKeeper: Better connection loop [#CLICKHOUSE-2] 2018-04-05 02:43:11 +03:00
Alexey Milovidov
5a525605be ZooKeeper: thread names [#CLICKHOUSE-2] 2018-04-05 02:36:58 +03:00
Alexey Milovidov
ddc4e1e388 ZooKeeper: Better connection loop [#CLICKHOUSE-2] 2018-04-05 02:33:21 +03:00
Alexey Milovidov
e203457d55 Fixed metric ZooKeeperWaitMicroseconds [#CLICKHOUSE-2] 2018-04-04 05:07:12 +03:00
Alexey Milovidov
ba7a0ebf86 Better exception messages [#CLICKHOUSE-2] 2018-04-04 00:40:58 +03:00
Alexey Milovidov
c387b73f70 ZooKeeper: miscellaneous [#CLICKHOUSE-2] 2018-04-04 00:18:46 +03:00
Alexey Milovidov
b0eca318cf ZooKeeper: more instrumentation [#CLICKHOUSE-2] 2018-04-04 00:14:10 +03:00
Alexey Milovidov
8029a9b579 ZooKeeper: more instrumentation [#CLICKHOUSE-2] 2018-04-04 00:11:54 +03:00
Alexey Milovidov
788d8e740d ZooKeeper: more instrumentation [#CLICKHOUSE-2] 2018-04-04 00:07:22 +03:00
Alexey Milovidov
944748e7da Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 22:54:35 +03:00
Alexey Milovidov
f5652b4477 Modifications after removing libzookeeper; initialize ZooKeeper session lazily [#CLICKHOUSE-2] 2018-04-03 22:43:33 +03:00
Alexey Milovidov
08170d0d77 Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
proller
e58b0830e6
Prepare to new poco (PocoData renamed to PocoSQL) (#2158) 2018-04-03 04:48:40 -07:00
Alexey Milovidov
0d2c2ea3d4 Fixed error after removed libzookeeper [#CLICKHOUSE-2] 2018-04-03 03:39:58 +03:00
Alexey Milovidov
daa736700d Minor modification after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 00:48:39 +03:00
Alexey Milovidov
6364c49ad8 ZooKeeper: fixed chroot [#CLICKHOUSE-2] 2018-04-02 21:59:18 +03:00
Vitaliy Lyudvichenko
fb7e2cbd16 Fixed processConfig, skip temporary files. [#CLICKHOUSE-2] 2018-04-02 19:23:00 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite 2018-04-01 17:31:20 +03:00
Alexey Zatelepin
5fdd50c2a2 process included config node once more if include happened [#MTRSADMIN-3894] 2018-03-30 16:33:43 +03:00
Vitaliy Lyudvichenko
63eee94319
Add max_network_bandwidth_for_all_users setting. [#CLICKHOUSE-2] (#2137) 2018-03-29 16:24:36 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
alexey-milovidov
f48caff360
Update COWPtr.h 2018-03-28 05:27:25 +03:00
Silviu Caragea
0a057695aa Reduce the number of lock releases and reacquires in the BckSchPoolDelay thread 2018-03-27 16:29:41 +03:00
Silviu Caragea
438121e45b Renamed Zookeeper get method with getWatch for consistency 2018-03-26 23:08:14 +03:00
Silviu Caragea
4361df913b Remove exists and use existsWatch instead for WatchCallbacks 2018-03-26 22:46:14 +03:00
Silviu Caragea
7d6268c8a9 Fix bug in the exit predicate 2018-03-26 22:18:56 +03:00
KochetovNicolai
d25c244946
Merge pull request #1882 from zhang2014/support/simd_for_lengthUTF-8
ISSUES-1885 UTF8 countCodePoints use SIMD
2018-03-26 18:27:07 +03:00
Alexey Milovidov
5ac329c91c Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 07:34:33 +03:00
Alexey Milovidov
93307a82e6 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 07:20:31 +03:00
Alexey Milovidov
c2f40e8d41 Removed libzookeeper [#CLICKHOUSE-2] 2018-03-25 06:47:56 +03:00
Alexey Milovidov
2c4b28597e Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:57:04 +03:00
Alexey Milovidov
49045754d9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:56:08 +03:00
Alexey Milovidov
6721914041 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:36:35 +03:00
Alexey Milovidov
548c4b0adf Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:20:51 +03:00
Alexey Milovidov
522bf01db9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:15:52 +03:00
Alexey Milovidov
0714a217fe Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 02:13:05 +03:00
Alexey Milovidov
280a5f8e3f Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 02:01:21 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
Alexey Milovidov
87b4d8209a Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:28:43 +03:00
Alexey Milovidov
58f32f98d7 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Alexey Milovidov
6b684fc1a3 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 02:15:14 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
Nikolai Kochetov
cc2c1f5171 removed createImmutable 2018-03-23 22:24:55 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996)
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Silviu Caragea
23aee5ed5b Task cannot be scheduled and deactivated in the same time. 2018-03-23 10:05:58 +02:00
Silviu Caragea
24de8d624f Fix for corner case where executing task will occupy not one but two threads in the pool which are in short supply. 2018-03-22 22:26:03 +02:00
Silviu Caragea
a2dc16a582 Remove the link between TaskHandles and ZooKeeper 2018-03-22 17:21:14 +02:00
Silviu Caragea
6629b03af9 Fixed few of the observation of the code review 2018-03-22 17:09:30 +02:00
Silviu Caragea
f2479673d6 Fix BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
6d889da41e Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 15:15:23 +03:00
Alexey Milovidov
d690c24198 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 00:40:53 +03:00
Nikolai Kochetov
476d4b339c Immutable construction for columns 2018-03-20 22:45:10 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
Alexey Milovidov
76f9e0032d Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-20 00:34:56 +03:00
Alexey Milovidov
644c5e67b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:25:21 +03:00
Alexey Milovidov
c8f8dc429c Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:23:05 +03:00
Alexey Milovidov
831d38fd59 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:07:50 +03:00
Alexey Milovidov
72ededeab5 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 20:45:30 +03:00
Alexey Milovidov
1b0a43ce55 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 17:19:32 +03:00
Alexey Milovidov
c5ddbbb1ab Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 16:31:09 +03:00
Alexey Milovidov
5146ab8acc Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 03:32:59 +03:00
Alexey Milovidov
0d11b75def Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 02:11:57 +03:00
Alexey Milovidov
347a83029a Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 00:53:56 +03:00
Alexey Milovidov
c68af7f09a Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 23:25:40 +03:00
Alexey Milovidov
a4e1bd5bc4 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 21:31:18 +03:00
Alexey Milovidov
c1c5aa00ca Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 21:14:01 +03:00
Alexey Milovidov
30196169a1 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 18:23:06 +03:00
Alexey Milovidov
e272f6d79e Not a fix [#CLICKHOUSE-3650]. 2018-03-16 06:03:17 +03:00
Alexey Milovidov
b5e4d0692a Disallow PREWHERE, SAMPLE, FINAL in MATERIALIZED VIEWs [#CLICKHOUSE-2]. 2018-03-16 04:23:37 +03:00
Vitaliy Lyudvichenko
9e9739ce2d Fixed a test. [#CLICKHOUSE-2] 2018-03-14 23:54:16 +03:00
Alexey Milovidov
597160443a Fixed build after merge #2036 2018-03-14 21:58:40 +03:00
Vitaliy Lyudvichenko
f38dc334d6 Refactor of asyncMulti. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
22794bc93e ZooKeeper multi op is transparent with chroot prefixes. [#CLICKHOUSE-3639] 2018-03-14 16:27:16 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration 2018-03-14 05:35:50 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
alexey-milovidov
b5b1f7c8bd
Update ConfigReloader.h 2018-03-14 02:01:03 +03:00
Nikolai Kochetov
324cda232c fix clang build [#CLICKHOUSE-3591] 2018-03-13 14:53:27 +03:00
Nikolai Kochetov
632a2ecabc added SYSTEM RELOAD CONFIG query [#CLICKHOUSE-3591] 2018-03-13 13:41:47 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
Nikolai Kochetov
8b09e55102 added system.macros table [#CLICKHOUSE-3591] 2018-03-12 21:38:00 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
7577b1db14 Added function "throwIf" [#CLICKHOUSE-2543] 2018-03-10 03:18:57 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
e102ba5415 Fixed error #245 2018-03-10 01:11:42 +03:00
Alexey Milovidov
d0a15df011 Fixed non-harmful data race [#CLICKHOUSE-2] 2018-03-09 02:07:39 +03:00
Vitaliy Lyudvichenko
364f519eea Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910] 2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
proller
82a361d0e9 Show error to client if query was killed (#1989)
* Show error to client if query was killed

* Kill exception v2

* Use kill

* fix

* wip

* fix

* fxi

* try fix

* Revert "try fix"

This reverts commit eb76e4c040.

* QUERY_WASCANCELLED

* Fxi all cancel()

* fix
2018-03-06 00:09:39 +03:00
Alexey Milovidov
ff822f5d81 Modified comment [#CLICKHOUSE-2] 2018-03-05 21:26:43 +03:00
Alexey Milovidov
c897e5ca39 Better [#CLICKHOUSE-2] 2018-03-03 18:36:20 +03:00
Alexey Milovidov
1aad435d52 Fixed race condition at startup [#CLICKHOUSE-2] 2018-03-03 17:40:17 +03:00
Alexey Milovidov
cbb440e753 Execute table functions once for a query [#CLICKHOUSE-3615] 2018-03-03 04:01:14 +03:00
Alexey Milovidov
6017cb0355 Attempt to improve config load time [#CLICKHOUSE-3618] 2018-03-03 03:33:25 +03:00
Alexey Milovidov
bf924d1c9d Better name [#CLICKHOUSE-2] 2018-03-02 21:51:59 +03:00
Alexey Milovidov
7e7fe3c441 Execute table functions once for a query [#CLICKHOUSE-3615] 2018-03-02 08:44:17 +03:00
Alexey Milovidov
651a312896 Added ProfileEvent for table function executions [#CLICKHOUSE-3615] 2018-03-02 08:03:28 +03:00
Alexey Milovidov
28df0c3712 Removed unused constant #1947 2018-03-01 10:43:08 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973)
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
2018-02-28 23:34:25 +03:00
Alexey Milovidov
063facc769 Miscellaneous [#CLICKHOUSE-2] 2018-02-28 21:25:22 +03:00
Vitaliy Lyudvichenko
72bccacba5 Skip temporary editors' config files. [#CLICKHOUSE-3]
Resolves #1190
2018-02-28 16:25:13 +03:00
Vitaliy Lyudvichenko
9c889af882 Add allow_distributed_ddl setting. [#CLICKHOUSE-3611]
Clearer exception message.
Fixed Int64 settings parsing.
2018-02-28 16:23:40 +03:00
Vitaliy Lyudvichenko
f89d9dbfb9 Fixed segfault in an integration test. [#CLICKHOUSE-2] 2018-02-27 21:46:16 +03:00
proller
720a11fe4e Fix gcc "may be used uninitialized" warning 2018-02-26 22:38:06 +03:00
Alexey Milovidov
9219b3d600 Fixed build [#CLICKHOUSE-2] 2018-02-25 08:01:12 +03:00
Alexey Milovidov
f3f2b74676 Miscellaneous [#CLICKHOUSE-2] 2018-02-25 05:45:36 +03:00
Alexey Milovidov
722b6287ec Miscellaneous [#CLICKHOUSE-2] 2018-02-25 05:43:27 +03:00
Alexey Milovidov
c86fd31097 Addition to prev. revision [#CLICKHOUSE-2] 2018-02-25 05:23:04 +03:00
Alexey Milovidov
b326a111d5 Fixed bad code that may lead to race condition [#CLICKHOUSE-2] 2018-02-25 04:30:03 +03:00
Alexey Vasiliev
376f283b84 Sort ConfigProcessor files before use [#CLICKHOUSE-3436, #METRIQA-1971] 2018-02-20 11:50:11 +03:00
Alexey Milovidov
95d2d68c7d Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 05:22:32 +03:00
proller
db8ea9205c
LibraryDictionarySource: api v2 with strings (#1915)
* LibraryDictionarySource: Support numeric types, initial support for strings
2018-02-16 20:12:22 +03:00
zhang2014
eeae014a42 ISSUES-1885 use movemask & popcnt 2018-02-14 08:11:12 +08:00
zhang2014
0d8730c687 ISSUES-1885 fix signed problem 2018-02-13 13:46:16 +08:00
Alexey Milovidov
c104566eb8 Fixed performance regression in usage of COWPtr in complex cases [#CLICKHOUSE-3584]. 2018-02-12 23:10:24 +03:00
zhang2014
acb5b99195 ISSUES-1885 fix align bound 2018-02-12 16:05:24 +08:00
zhang2014
5f9292ac30 ISSUES-1885 resolve some opinions 2018-02-12 15:58:04 +08:00
zhang2014
73077e0245 ISSUES-1885 fix failed test 2018-02-12 15:31:54 +08:00
zhang2014
0f20952f2c ISSUES-1885 UTF8 countCodePoints use simd 2018-02-12 15:31:22 +08:00
alexey-milovidov
d3160393c5
Merge branch 'master' into CLICKHOUSE-3554 2018-02-08 23:07:50 +03:00
alexey-milovidov
b7d0ae49fd
Merge pull request #1844 from bocharov/master
Fix uniqHLL12 and uniqCombined for cardinalities 100M+.
2018-02-08 20:01:45 +03:00
Vitaliy Lyudvichenko
42754a5327 Add new virtual columns into system.tables. [#CLICKHOUSE-3554] 2018-02-08 17:15:40 +03:00
proller
0c00e47930 Fix tests 2018-02-02 20:29:45 +03:00
Alex Bocharov
9963e2f160 Fix uniqHLL12 and uniqCombined for cardinalities 100M+.
* Changing size() return type from UInt32 to UInt64 to prevent overflow (this shouldn't break back compatibility).
 * Removing "big cardinalities fix" for cardinalities >2^32/30 as it was very inaccurate and for estimates >2^32 it was trying to do 'log' of negative number which is NaN and it was casted to 0.
 * Adding python script to show that intHash32 is not a good choice for HyperLogLog algorithm when it's used for linear counting branch of it.
 * Adding bash script to test uniq, uniqHLL12, uniqCombined on different set cardinalities.
 * Altering documentation of uniq* aggregate functions with recommendations to use uniq instead of uniqHLL12 or uniqCombined.
2018-01-31 11:36:01 +00:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
alexey-milovidov
bea49ca136
Merge pull request #1741 from yandex/array-functions-hasAll-hasAny-intersect
Array functions hasAll hasAny arrayIntersect arrayResize
2018-01-26 12:06:48 +03:00
proller
63b3bccb04 Test and build fixes (#1822)
* Fix travis

* try

* try

* Disable macos

* Travis enable macos

* Fix

* fast_finish: true

* fix

*  fxi

* fix openssl

* fix

* fix

* Fix

* try travis

* fix

* fix

* Cmake: dont filter platform-depended files in cmake

* misc

* renamed:    tests/server_wrapper.sh -> tests/clickhouse-test-serve

* install clickhouse-test-server

* clickhouse-test-server wip

* wip
2018-01-26 12:03:38 +03:00
Vitaliy Lyudvichenko
4665201827 Add metric for duplicated inserts. [#CLICKHOUSE-2] 2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a Better system.part_log. [#CLICKHOUSE-3342] 2018-01-25 21:40:02 +03:00
alexey-milovidov
24ac18201c Update getFQDNOrHostName.cpp
Update isLocalAddress.cpp

Update IBlockOutputStream.h

Update users.xml
2018-01-24 17:14:21 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e Make early deduplication with block number creation. [#CLICKHOUSE-3545] 2018-01-23 18:50:29 +03:00
Vitaliy Lyudvichenko
0bd5f6a447 Merged ZooKeeper lib changes from CLICKHOUSE-3342. Part 1. [#CLICKHOUSE-3346] 2018-01-22 21:56:23 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Nikolai Kochetov
ff0328aee7 fix build [#CLICKHOUSE-2998] 2018-01-22 13:18:55 +03:00
Nikolai Kochetov
ba1bfb97c8 Merge branch 'array-function-resize' into array-functions-hasAll-hasAny-intersect 2018-01-19 22:33:43 +03:00
alexey-milovidov
0a3b1679ec
Update ClearableHashSet.h 2018-01-19 21:51:45 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
proller
76cf0ba5d0 Better tests (#1785)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge

* Travis optimize

* optimize

* Fix clickhouse-test --no-long

* no long

* Split too long test

* Better tests

* missing file

* Fix includes

* Added draft [#CLICKHOUSE-2].

* fix

* fix

* fix

* Fix test 281 under asan
2018-01-18 23:33:16 +03:00
Nikolai Kochetov
de274b317a added ArraySourceVisitor and ArraySinkVisitor [#CLICKHOUSE-2998] 2018-01-18 18:50:35 +03:00
Nikolai Kochetov
694b305036 added arrayIntersect [#CLICKHOUSE-3504] 2018-01-17 14:36:02 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
03bca2144d OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
Resolves #1753
2018-01-15 13:13:18 +03:00
proller
22e3695a47 More system.build_options 2018-01-12 19:50:10 +03:00
proller
364b8ec5ee Fix data in system.build_options 2018-01-12 19:04:18 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e996da050d Add copying check and retries. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f Minimal working example. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Alexey Milovidov
73460a5f86 Fixed error [#CLICKHOUSE-2]. 2018-01-11 21:55:31 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
proller
b026eb7797 Use submodule contrib/capnproto, remove include_directories (#1746)
* Add submodule contrib/capnproto

* Use contrib/capnproto, remove include_directories

* Fix include

* Clean

* Fix werror

* Update doc

* Fix

* Final fix

* Fxi
2018-01-11 21:39:52 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Alexey Milovidov
c4687b5fb9 Unification of Nested: development [#CLICKHOUSE-2]. 2018-01-02 08:54:34 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89 Merge branch 'aavdonkin-master' 2017-12-28 07:33:55 +03:00
Alexey Milovidov
4448766266 Merging [#CLICKHOUSE-3114] 2017-12-28 07:28:05 +03:00
Alexey Milovidov
104b09604a Merging [#CLICKHOUSE-3114] 2017-12-28 00:45:05 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
Alexey Milovidov
b2fcf06353 Merging [#CLICKHOUSE-3114] 2017-12-27 00:34:06 +03:00
Alexey Milovidov
203363ea73 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-26 20:53:36 +03:00
Alexey Milovidov
7a60d773ec Fixed strange code [#CLICKHOUSE-2]. 2017-12-26 20:53:31 +03:00
alexey-milovidov
9bf06a26cc Update PODArray.h 2017-12-26 20:52:22 +03:00
chenxing.xc
e7efee8f41 fix potential memory issue 2017-12-26 20:52:22 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
04eb0b896c Added proper support for Nullable arguments for function OR #1416 2017-12-25 09:33:51 +03:00
Alexey Milovidov
8ff93487e3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-25 07:01:46 +03:00
Alexey Milovidov
61174e9150 Better implementation for IDataType::equals method #1650 2017-12-23 04:05:29 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Roman Tsisyk
0e556c2b03 Fix compilation without SSE 4.2
Fixes "'hash64' was not declared in this scope" on aarch64.
2017-12-21 00:48:17 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
2017-12-21 00:46:50 +03:00
Nikolai Kochetov
39ec3f7d74 changed exception message, added comments 2017-12-19 22:51:59 +03:00
Silviu Caragea
b08463ed7b Fix for https://github.com/yandex/ClickHouse/issues/1648 2017-12-19 22:41:05 +03:00
Alexey Milovidov
d9732198ac Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:51:12 +03:00
Alexey Milovidov
61c2b55a57 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:43:04 +03:00
Alexey Milovidov
f9170190c6 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:17:56 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
5b32914089 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 07:29:34 +03:00
Alexey Milovidov
645f620873 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
01a0b91c83 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:20:14 +03:00
Alexey Milovidov
911d80ab51 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
9cc424b4b5 Fixed error: loading "preprocessed" files if dictionary/model config was specified with glob [#CLICKHOUSE-3501]. 2017-12-13 23:21:03 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
Alexey Milovidov
524d98c7fc More strict semantic on sharing columns (development) [#CLICKHOUSE-2]. 2017-12-11 05:59:56 +03:00
Alexey Milovidov
254030d6c3 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
00a7209607 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 04:34:52 +03:00
Alexey Milovidov
2c1d7ad343 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 03:31:46 +03:00
Alexey Milovidov
9996e15458 Allow to use values of AggregateFunction data type in groupArray aggregate function [#CLICKHOUSE-3485]. 2017-12-06 06:10:32 +03:00
Alexey Milovidov
5bb326de61 Allow to use values of AggregateFunction data type in groupArray aggregate function (incomplete) [#CLICKHOUSE-3485]. 2017-12-06 00:25:01 +03:00
Alexey Milovidov
2e652ffa1e Removed hopscotch hash (was used only in single test) [#CLICKHOUSE-2]. 2017-12-02 06:28:00 +03:00
Alexey Milovidov
668d88a359 Better [#CLICKHOUSE-2]. 2017-12-02 06:22:51 +03:00
Alexey Milovidov
d091789a09 Better [#CLICKHOUSE-2]. 2017-12-02 05:58:25 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
d932d615e7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-02 02:14:59 +03:00
Alexey Milovidov
790bda3b9a Whitespace [#CLICKHOUSE-2]. 2017-12-02 02:14:53 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata
[clickhouse-yt] separate geo dictionaries from data providers
2017-12-01 19:54:08 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index 2017-12-01 19:53:04 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
alexey-milovidov
33ddc5e0f5 Update ConfigProcessor.cpp 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
a6ee2125a4 ConfigProcessor: explicit ctor [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
827a5d0612 Fix warnings-errors in gtest 2017-11-24 23:40:14 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
f3b0f17d50 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 22:02:24 +03:00
proller
875ef9b5cf Fix allocator test 2017-11-22 17:54:12 +03:00
Alexey Milovidov
f9cd1e7afc Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-21 23:10:58 +03:00
proller
411202d5ad Zlib: as submodule, fix compile options; config: add logger options: logger.flush logger.rotateOnOpen 2017-11-21 23:10:37 +03:00
Alexey Milovidov
4aa520e7be Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-21 22:40:59 +03:00
proller
2778f35e48 Lib Parsers 2017-11-21 22:35:54 +03:00
Alexey Milovidov
2fd17a3072 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 09:01:05 +03:00
Alexey Milovidov
07d594c505 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:59:58 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
3403f68c3f Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:21:50 +03:00
Alexey Milovidov
e340511931 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:22:21 +03:00
Alexey Milovidov
a7d4fef0d2 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:21:14 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Alexey Milovidov
c0321ce752 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:59:57 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Alexey Milovidov
69714f0671 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:55:53 +03:00
Alexey Milovidov
dfb4a92f5a BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:47:39 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
8425c56c0f Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-18 00:00:29 +03:00
Alexey Milovidov
7cf5eaddc0 Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-17 23:59:31 +03:00
Alexey Milovidov
4f8009517c Thread name can be 15 bytes max [#CLICKHOUSE-2]. 2017-11-17 23:57:07 +03:00
Alexey Milovidov
f54e99490f Merge branch 'master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:48:16 +03:00
Alexey Milovidov
8e362ba641 Fixed build [#CLICKHOUSE-2]. 2017-11-17 23:48:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
18be706127 Merge remote-tracking branch 'origin/master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:30:51 +03:00
proller
5190325275 Allocator fix: nothing do when sizes equal, allow reallocate to smaller size (#1512)
* PerformanceTest fixes.

* format

* Allocator fix: nothing do when sizes equal, allow reallocate to smaller size

* Update Allocator.cpp
2017-11-17 23:27:12 +03:00
Alexey Milovidov
9264bc4013 Style [#CLICKHOUSE-2]. 2017-11-17 23:18:06 +03:00
Alexey Milovidov
4ab2d4bc31 Added comment [#CLICKHOUSE-2]. 2017-11-17 22:49:17 +03:00
Alexey Milovidov
263e262413 Style [#CLICKHOUSE-2]. 2017-11-17 22:43:25 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
proller
339424f5ea Fix realloc on freebsd and macos 2017-11-16 14:27:31 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484)
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
2017-11-12 15:58:40 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00
Alexey Milovidov
a3fa44e71a Miscellaneous [#CLICKHOUSE-2]. 2017-11-12 03:46:22 +03:00
Silviu Caragea
b4f7bfaa02 Remove duplicate code from zookeeper.cpp 2017-11-11 03:36:29 +03:00
Alexey Milovidov
4e04c4da5f Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:56:31 +03:00
KochetovNicolai
bfb4e8f3fe zookeeper chroot fix (#1430)
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* moved root section in zookeeper configuration [#CLICKHOUSE-3031]

* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]

* added tests [#CLICKHOUSE-3031]

* replaced tabs to spaces in config files [#CLICKHOUSE-3031]

* fix build [#CLICKHOUSE-3031]

* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]

* added comments [#CLICKHOUSE-3031]

* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]

* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
2017-10-27 23:03:51 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
proller
4dd1634772 Print sizes in memory errors (#1413)
* Print sizes in memory errors

* use formatReadableSizeWithBinarySuffix

* Fix

* Requested changes

* fix alignment message
2017-10-27 22:18:39 +03:00
Alexey Milovidov
1d8dc11f40 Fixed one of errors that cause abort when no space left on device with logs (now useless, as ClickHouse will instead refuse all connections) [#CLICKHOUSE-2] 2017-10-27 20:24:33 +03:00
Vitaliy Lyudvichenko
71833a7f0f More correct procedure of parts deleting. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Milovidov
2cc3fdae9b Useless modifications for cppcheck [#CLICKHOUSE-2]. 2017-10-26 04:47:03 +03:00
proller
4ffbca2d8c Fix warnings (#1406)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)"
This reverts commit fa2484ea90.
2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381)
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
2017-10-24 22:11:42 +03:00
Alexey Milovidov
d77686685a Using PODArray instead of std::vector in ZooKeeper library [#CLICKHOUSE-2]. 2017-10-23 18:08:31 +03:00
alexey-milovidov
91aa0713e5 Merge pull request #1371 from vavrusa/fix-zookeeper-stack-smashing
ZooKeeper: fixed stack smashing with tryGet()
2017-10-23 17:40:12 +03:00
alexey-milovidov
4f86ec9d58 Update ZooKeeper.cpp 2017-10-23 17:39:29 +03:00
alexey-milovidov
c5b5f2b4f8 Merge pull request #1374 from proller/fix4
Use c++11 thread_local instead of gcc's __thread
2017-10-22 12:43:11 +03:00
proller
8dd5c9dac2 Cmake: fix build without downloaded submodules (#1379) 2017-10-20 20:59:44 +03:00
proller
443088ce31 Use c++11 thread_local instaed of gcc's __thread 2017-10-19 22:36:37 +03:00
Marek Vavruša
e2a8526990 ZooKeeper: fixed stack smashing with tryGet()
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
2017-10-18 15:13:42 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
4c7850fdc2 Optional kafka (#1355)
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper

* Fix compile with external zookeeper

* Optional kafka

* fix

* Fix

* fix
2017-10-14 03:53:01 +03:00
Alexey Milovidov
f42c6014ce Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-14 02:06:11 +03:00
proller
20329ce794 Zookeeper include fix (#1353) 2017-10-13 23:30:55 +03:00
proller
49f8080e52 Small debud improvement 2017-10-13 21:44:26 +03:00
Alexey Milovidov
0ec218a853 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-13 04:09:51 +03:00
Alexey Milovidov
3a6705af0f Improvement [#CLICKHOUSE-2]. 2017-10-12 23:34:01 +03:00
alexey-milovidov
b7c1076df2 Update ActionBlocker.h 2017-10-12 23:26:54 +03:00
alexey-milovidov
96b603a023 Update ActionBlocker.h 2017-10-12 23:26:54 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
alexey-milovidov
44e6ecfe78 Update ShellCommand.cpp 2017-10-12 22:36:27 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Vitaliy Lyudvichenko
18af75a4f1 Add metrics for RWLockFIFO. [#CLICKHOUSE-3246] 2017-10-12 22:32:31 +03:00
Alexey Milovidov
1405415f94 Miscellaneous [#CLICKHOUSE-3]. 2017-10-09 01:53:38 +03:00
Marek Vavruša
28bb5e25cf AggregateFunctionTopK: read alphaMap for generic
* the alpha_map vector always (de)serialises
  the actual version (could empty sometimes)
* AggregateFunctionTopK generic variant deserialises
  it as well instead of ignoring it
* AggregateFunctionTopK generic variant clears the
  array before deserialising

refs #1283
2017-10-09 01:12:38 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
KochetovNicolai
e0efb7e8c1 Point in polygon (#1264)
* added FunctionPointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid with holes [#CLICKHOUSE-3201]

* added arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed shifted grid for PointInPolygonWithGrid, added test [CLICKHOUSE-3201]

* expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fix expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added pool to PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* fixed test [#CLICKHOUSE-3201]

* unified signature for PointInPolygon [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* supported Float64 for pointInPolygon [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fixed check for numeric tuple in PointInPolygon function [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* added profile events polygons pool [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* Update FunctionsGeo.cpp
2017-09-20 05:30:44 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
bc622c4c45 Better [#CLICKHOUSE-2]. 2017-09-17 03:13:26 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Alexey Milovidov
5e25c40a26 Fixed error found by Coverity [#CLICKHOUSE-2]. 2017-09-14 07:24:20 +03:00
Alexey Milovidov
9a58e26b8c Added comment [#CLICKHOUSE-2]. 2017-09-13 00:06:11 +03:00
Vadim Skipin
7576cb2c18 fix LRU cache definition 2017-09-11 14:41:47 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
253893bf4d Fixed insignificant error, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 07:06:54 +03:00
Alexey Milovidov
5a8f45c131 Fixed insignificant error, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 06:46:18 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
71d29acdfb Implemented some suggestions from clang-tidy (part 7) [#CLICKHOUSE-3301]. 2017-09-08 07:43:57 +03:00
Alexey Milovidov
4799f28dad Implemented some suggestions from clang-tidy (part 6) [#CLICKHOUSE-3301]. 2017-09-08 07:39:03 +03:00
Alexey Milovidov
b282c8fcbb Implemented some suggestions from clang-tidy (part 5) [#CLICKHOUSE-3301]. 2017-09-08 07:11:39 +03:00
Alexey Milovidov
8c9ec83a33 Implemented some suggestions from clang-tidy (part 4) [#CLICKHOUSE-3301]. 2017-09-08 07:10:43 +03:00
Alexey Milovidov
e9ae193870 Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301]. 2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vadim Skipin
4017622ffb CLICKHOUSE-3289: Do not use Application singleton 2017-09-07 20:55:33 +03:00
proller
d422777d9c ShellCommand: automatic wait call in destructor (#1210)
* ShellCommand: automatic wait call in destructor

* ShellCommand: tryWait in destructor

* Update ShellCommand.cpp

* Update ShellCommand.cpp
2017-09-07 03:12:39 +03:00
Alexey Milovidov
ff8940ddbe Fixed bad code [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Alexey Milovidov
24ac5a68e1 More uniform style [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Alexey Milovidov
31b598e1e3 Fixed bad code [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150)
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-09-05 04:08:26 +03:00
proller
1b3bc42586 Fix freebsd/macos compile (#1198)
* Header compile fixes

* Fix includes

* Update debian/.pbuilderrc description

* Fix freebsd/macos compile

* Fix freebsd/macos compile
2017-09-04 21:18:45 +03:00
alexey-milovidov
c1fdb785f0 Merge branch 'master' into CLICKHOUSE-3246 2017-09-04 20:06:18 +03:00
proller
39c1bf0984 Fix freebsd/macos compile (#1194)
* Header compile fixes

* Fix includes

* Update debian/.pbuilderrc description

* Fix freebsd/macos compile
2017-09-04 18:14:05 +03:00
Vitaliy Lyudvichenko
706d4db332 Made RWLockFIFO recursive. [#CLICKHOUSE-3246] 2017-09-04 15:54:13 +03:00
proller
aa1f27553e Header compile fixes 2017-09-01 22:05:29 +03:00
Alexey Milovidov
87fab3396e Fixed build [#CLICKHOUSE-2]. 2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
add3f920ff RWLockFIFO implementation. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
alexey-milovidov
897a9ad6b2 Merge pull request #1146 from yandex/array-functions-concat-slice-push-pop
Array functions concat slice push pop
2017-09-01 20:30:51 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Vitaliy Lyudvichenko
c32bf4f597 Use only one cache in DNSCache. Add requested changes. [#CLICKHOUSE-2931] 2017-09-01 20:05:24 +03:00
Nikolai Kochetov
7891596579 unified TypeList [#CLICKHOUSE-2090] 2017-09-01 15:05:19 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
proller
be7e082b35 Fix test simple_cache compile 2017-08-31 22:27:55 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Nikolai Kochetov
ec58bfae90 added comments [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1e08db938d added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
871a7cabc6 fix build [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
d4bf2bf102 replaced tabs to spaces in config files [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
5ff1669406 fixed root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1539648910 moved root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
fa2f0dfa4d added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
16103456e2 added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alexey Milovidov
738f1685b2 Fixed build after merge [#CLICKHOUSE-2]. 2017-08-25 19:35:10 +03:00
Marek Vavruša
3659caad7d ZooKeeper: use seeded random device to shuffle node list #1149
std::random_shuffle() may or may not use std::rand() which isn't
seeded, and since configuration parsing runs predictably as one
of the first things after server startup, the list of ZK nodes
is shuffled the same way on all replicas.
2017-08-25 18:37:27 +03:00
Nikolai Kochetov
239f4f2d36 merged with master 2017-08-25 15:05:18 +03:00
Nikolai Kochetov
c1479a5594 updated GatherUtils [#CLICKHOUSE-2090] 2017-08-24 19:46:15 +03:00
Alexey Milovidov
c34211e0c5 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
033b139288 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
003d2525e0 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f39db7ba1a More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
8085359518 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f8b2400a84 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
3748b7b332 Added hopscotch-map just for tests [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
e47a29fd4b More sophisticated test of hash tables with integer keys [#CLICKHOUSE-2]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
fc409f61e5 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 16:12:14 +03:00
Alexey Milovidov
2fb7a34f0d Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:07:11 +03:00
Alexey Milovidov
7dc4d6f7b3 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:05:59 +03:00
Alexey Zatelepin
e545777187 fix PoolWithFailoverBase::TryResult initialization 2017-08-18 15:38:43 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
628de0a3ea Fixed logging of DDL queries. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
736feab79f Add port field. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Vitaliy Lyudvichenko
1c8a280d63 Fixed escapeForFileName(). [#CLICKHOUSE-2] 2017-08-12 23:46:22 +03:00
Nikolai Kochetov
b7f8ac1f2d rewrote rewriting of SELECT query in StorageMerge with WITH statement 2017-08-12 00:01:28 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Alexey Milovidov
d7d6c4b962 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-11 02:26:51 +03:00
Alexey Milovidov
1e941a137e Better exception message [#CLICKHOUSE-2]. 2017-08-11 02:26:38 +03:00
Alexey Milovidov
ce4349b6cd Fixed error when huge sets for IN, JOIN, DISTINCT cannot be created with exception message "Cannot mremap... Bad address" [#CLICKHOUSE-2]. 2017-08-11 02:25:51 +03:00
alexey-milovidov
1626637a89 Update zkutil_test_multi_exception.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
e44614d017 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
5d3bff4802 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
23af9ddd5e Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
alexey-milovidov
0fbda791b5 Update iostream_debug_helpers.h 2017-08-10 06:29:06 +03:00
proller
7937903d56 Improve debug helpers 2017-08-10 06:29:06 +03:00
proller
139d9e5c19 Config: Allow multiple dictionaries_config 2017-08-10 06:17:19 +03:00
Alexey Milovidov
6edb14ba6b Fixed garbage [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
Alexey Milovidov
46be81bc88 Fixed error [#CLICKHOUSE-2]. 2017-08-07 11:03:23 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Vitaliy Lyudvichenko
003d2a9478 Add comprehensive exception message for ZooKeeper::multi(). [#CLICKHOUSE-2] 2017-08-03 15:42:23 +03:00
Alexey Milovidov
34ac4fa3b8 Added metric with revision number for better monitoring of deployment [#CLICKHOUSE-2]. 2017-08-01 17:34:06 +03:00
Alexey Milovidov
844990db27 Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 00:50:21 +03:00
Alexey Milovidov
f8a761fbd9 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:44:57 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
acf9c2fbd5 Miscellaneous [#CLICKHOUSE-2]. 2017-07-28 00:05:33 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
alexey-milovidov
b831d88162 Update ArenaAllocator.h 2017-07-25 20:06:24 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
ae3b1d8d3a Fix clang compilation. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
fefb4dad67 Get rid of old groupArray() implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
792faaa2db Add adaptive allocator. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c3a15da3f8 Add support of limit parameter into groupArray. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Alexey Milovidov
a6df2e7151 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
proller
eba5ad73ec clean 2017-07-24 18:04:49 +03:00
proller
57b9bcd354 Fix missing includes 2017-07-24 18:04:49 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
alexey-milovidov
6d47981e86 Update Collator.cpp 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
1b8a062e7b Issue #1000 - Returned some remote code in Collator.app 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
e85cd44e48 Issue #1000 - remove 'diagnostic ignored -Wunused-private-field' in Collator.app 2017-07-21 20:59:39 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
a8b6920eab Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Nikolai Kochetov
5ed5e8c75d moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5924b13f4c fixed unnecessary columns removing for merge table on distibuted 2017-07-12 21:51:51 +03:00
Alexey Milovidov
33c6e0b804 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Vitaliy Lyudvichenko
b843ea5b3f Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3] 2017-07-11 21:36:51 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master
Implement natively uuid type in Clickhouse
2017-07-10 07:00:45 +03:00
Vitaliy Lyudvichenko
b46a2a6eab Fixed infinite sleeping of low-priority queries. [#CLICKHOUSE-2] 2017-07-09 03:53:13 +03:00
Guillaume Tassery
c6a5083419 Fix comparison of UInt128 to Float64 2017-07-05 18:29:16 +02:00
Guillaume Tassery
b90734920e Adapt UInt128 operator 2017-07-05 12:09:24 +02:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Guillaume Tassery
d6ab06437a Remove mention of UUID type for dictonnary 2017-07-03 18:08:32 +02:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alexey Milovidov
2b67782845 Applied clang-format [#CLICKHOUSE-2]. 2017-06-28 15:30:23 +03:00
Alexey Milovidov
39ddcf1c74 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:24:49 +03:00
Alexey Milovidov
c6b83a1c60 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:22:07 +03:00
Marek Vavruša
e189c39056 SpaceSaving: internal storage for StringRef{}
The SpaceSaving has now specialised storage for
some keys, which only copies keys that
are to be retained in the structure, not all.

Most of the PODs implement this interface empty,
so there shouldn’t be any extra cost.
2017-06-26 21:16:13 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
324fc7ef3e Miscellaneous [#CLICKHOUSE-3094]. 2017-06-23 08:39:27 +03:00
proller
70d9fb06b4 PerformanceTest: use getMultiple*FromConfig, fix debug helpers (#915)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file
2017-06-22 21:56:40 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905)
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
2017-06-22 18:57:37 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Георгий Кондратьев
a736ef618a Put ClickHouse variant of CityHash into DB namespace [#DEVTOOLS-3381]
This avoids symbol conflict when linking external applications that use another
variant of CityHash in the global namespace with ClickHouse libraries.
2017-06-20 12:25:16 +03:00
alexey-milovidov
057b919f20 Update ArrayCache.h 2017-06-20 10:51:53 +03:00
alexey-milovidov
ec5d2c3914 Update Allocator.cpp 2017-06-20 10:51:53 +03:00
Георгий Кондратьев
4d57012c62 Fix older Darwin build [#DEVTOOLS-3381] 2017-06-20 10:51:53 +03:00
Alexey Milovidov
150d3bb60f Removed useless code [#CLICKHOUSE-2]. 2017-06-20 10:36:16 +03:00
Alexey Milovidov
1b17f6191b Addition to prev. revision [#DEVTOOLS-3381]. 2017-06-19 23:09:11 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Alexey Milovidov
401d922a4b Tiny modifications [#CLICKHOUSE-3044]. 2017-06-18 09:11:49 +03:00
Alexey Milovidov
f51db5e1f6 Fixed build [#CLICKHOUSE-3044]. 2017-06-18 08:55:46 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
proller
f6f85440d4 Fix compile with gcc7 2017-06-13 02:50:34 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
862a304db2 Small refinements [#CLICKHOUSE-2]. 2017-06-01 16:41:58 +03:00