Commit Graph

11506 Commits

Author SHA1 Message Date
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
proller
ab3ab7f52d clickhouse-test-server: use random ports (#2425)
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules

* pbuildeR: use random ports for testing

* critical fix

* clickhouse-test-server: use random ports

* fix

* fix
2018-05-25 23:52:20 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972 DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c execute mutation log entries [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782 don't select merges of parts with different mutation versions [#CLICKHOUSE-3747] 2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146 notify relevant events directly from queue [#CLICKHOUSE-3747] 2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7 load mutations from ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76 parts versioning [#CLICKHOUSE-3687] 2018-05-25 23:04:07 +03:00
Alexey Zatelepin
2ab50c1f13 add test with inserts into Replicated tables from multiple threads [#CLICKHOUSE-3732] 2018-05-25 23:04:04 +03:00
Alexey Zatelepin
17437a95bf merge selection based on checking current inserts [#CLICKHOUSE-3732] 2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master
Fix DateTime vs DateTime('UTC') inconsistency on data read.
2018-05-25 21:44:11 +03:00
proller
68ba523b23 Compile and doc fixes (#2410)
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap

* termcap fix

* Better llvm version detect

* fix

* Debian postinst fix
Tests: use /usr/local if exists

* Compile and doc fixes

* fix

* fix

* fix

* macos fixes

* fix

* wip

* Update demangle.h

* Update demangle.cpp
2018-05-25 21:13:48 +03:00
alexey-milovidov
ded9df1bed
Merge pull request #2423 from amosbird/fancy
Let's make it fancier (function try catch block).
2018-05-25 21:08:28 +03:00
proller
f1fdea74be pbuilder: use random ports for testing (#2424)
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules

* pbuildeR: use random ports for testing

* critical fix
2018-05-25 21:05:30 +03:00
Amos Bird
9eec14e9be Let's make it fancier (function try catch block). 2018-05-25 23:38:57 +08:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
proller
5665709bb9 Use copy-headers from cmake (#2412)
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules
2018-05-25 01:20:37 +03:00
proller
87e8d8be5a
Fix internal compiler includes with new clang (#2406) 2018-05-24 15:40:02 +03:00
Vitaliy Lyudvichenko
42d5c6925c Removed bad test. [#CLICKHOUSE-2] 2018-05-23 21:29:35 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Vitaliy Lyudvichenko
6cc7068c6b Supress dummy program_options assertions in Debug. [#CLICKHOUSE-2] 2018-05-23 19:14:00 +03:00
Alex Bocharov
3618842579 Fix DateTime vs DateTime('UTC') inconsistency on data read.
Original problem was described in PR #1650 and partially fixed by
b5af4c95, however one place was forgotten and it was causing query
exceptions when trying to read DateTime column across parts with
different DateTime and DateTime('UTC') data type.
2018-05-22 12:23:07 +01:00
alexey-milovidov
2b581ed2c3
Merge pull request #2293 from proller/fix19
`clickhouse-client`: option --ask-password for interactively ask for credentials #1044
2018-05-21 22:54:32 +03:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
2018-05-21 22:42:42 +03:00
proller
051395a761 clickhouse-client: option --ask-password for interactively ask for credentials #1044 2018-05-21 20:27:18 +03:00
Vitaliy Lyudvichenko
8349d2b9a0 Fixed gcc7 compilation. [#CLICKHOUSE-2] 2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7 Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo. 2018-05-21 14:18:11 +03:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5 Style #2387 2018-05-18 21:31:18 +03:00
Alexey Milovidov
74a6b0010f utils/check-style/fix-style #2387 2018-05-18 21:30:02 +03:00
Nikolai Kochetov
a4b04739c8 Renamed need_parents back to need_parens. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
Nikolai Kochetov
c932ce60c0 Added test with dummy recursive alias. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
Nikolai Kochetov
f739078ea5 Fixed IAST::clone() implementations which were without children deep copy. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
proller
22d6afd2ad Debian postinst fix
Tests: use /usr/local if exists
2018-05-18 21:26:44 +03:00
Nikolai Kochetov
5e22f19258 Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734] 2018-05-18 20:27:58 +03:00
Arsen Hakobyan
dfe65ba842 Now uses Poco::URI::addQueryParameter for "update_field" parameter 2018-05-18 19:22:28 +03:00
Arsen Hakobyan
ad9659574f Adds percent encoding for "update_field" parameter
Handles cases when url has fragment
2018-05-18 19:22:28 +03:00
Vitaliy Lyudvichenko
4b093e3e0a Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2]
This patch is very crucial in case of many replicas.
2018-05-18 02:01:36 +03:00
proller
445f8800c3
Build fixes [WIP] (#2374) 2018-05-17 20:55:07 +03:00
Nikolai Kochetov
d7ead51796 Added invalid FixedString size to the list of parse errors. 2018-05-17 18:29:59 +03:00