Alexey Milovidov
d8ca4345b6
Fixed style violations [#CLICKHOUSE-2]
2018-08-10 04:41:54 +03:00
Vadim
44cb046eb9
Update StorageReplicatedMergeTree.cpp
2018-08-09 19:25:19 +03:00
Vadim
434017d193
Update StorageReplicatedMergeTree.cpp
2018-08-09 18:09:05 +03:00
VadimPE
75900f494f
CLICKHOUSE-3847 add "is_lost". load() in Queue can check duplicate records
2018-08-09 18:06:39 +03:00
VadimPE
d5a6967fc4
CLICKHOUSE-3847 fix
2018-08-09 11:44:49 +03:00
alesapin
402815977f
Add new error in fetchPartition op
2018-08-08 21:01:25 +03:00
VadimPE
c16d876867
CLICKHOUSE-3847 fix race in set log_pointer in cloneReplica()
2018-08-08 18:25:07 +03:00
VadimPE
4c0bb93345
CLICKHOUSE-3847 fix UInt - UInt. del clearQueue()
2018-08-08 17:07:39 +03:00
VadimPE
8d28b9f6b4
CLICKHOUSE-3847 we can do pullToLog() after we mark replica is_active and before we calc delay.
2018-08-08 16:53:06 +03:00
VadimPE
32b6965cf2
CLICKHOUSE-3847 Update. Add new settings. Del is_lost
2018-08-07 18:21:42 +03:00
alexey-milovidov
0ef2a94d46
Merge pull request #2782 from VadimPE/CLICKHOUSE-3714
...
CLICKHOUSE-3714 add max_partition_size_to_drop
2018-08-06 20:20:59 +03:00
alesapin
425918afe1
CLICKHOUSE-3880: Fix replace partition logic inside replicated merge tree
2018-08-06 15:59:51 +03:00
VadimPE
490efebe62
CLICKHOUSE-3714 add size pf all part in partition
2018-08-06 11:27:59 +03:00
Alexey Milovidov
2016374d20
Merging #2226
2018-08-05 10:05:43 +03:00
Alexey Zatelepin
b6b54eea52
old mutations cleaner for ReplicatedMergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
VadimPE
b97fa2eb4d
CLICKHOUSE-3714 bool ckeck_CanBeDropped -> void ...
2018-08-03 12:39:01 +03:00
VadimPE
6142d9ae6a
CLICKHOUSE-3714 fix function names and get partition size
2018-08-03 11:33:57 +03:00
VadimPE
98c33de4e3
CLICKHOUSE-3714
2018-08-02 12:03:38 +03:00
VadimPE
08fe108ba8
CLICKHOUSE-3714 fix methods name
2018-08-02 11:48:57 +03:00
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714
2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7
CLICKHOUSE-3714 add max_partition_size_to_drop
2018-08-01 20:41:18 +03:00
alesapin
e81108b954
CLICKHOUSE-3863: Add more convinient exception message
2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1
CLICKHOUSE-3863: Add HTTPS support for interserver replication
2018-08-01 00:29:47 +03:00
Alexey Zatelepin
4863c5c178
fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862]
2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733
don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
...
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
alesapin
6abbfbce87
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 18:10:57 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alexey Milovidov
0a188389c0
Fixed error #2599
2018-07-05 21:56:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
0a46d231ed
speedup merge selection: async exists check for selected parts [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
116ed0a59e
add RestartingThread wakeup for faster session recovery
2018-07-05 19:30:52 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
4ee581117b
system.mutations table skeleton [#CLICKHOUSE-3747]
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
c5c601f662
save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747]
2018-06-13 17:14:08 +03:00
Alexey Milovidov
d864f39ec7
Merge branch 'master' into zhang2014-feature/support_truncate
2018-06-09 19:10:06 +03:00
Alexey Milovidov
d56c199f07
Merging: Fixed half of problems #2260
2018-06-09 18:48:22 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Zatelepin
3947f25365
add general comment about the mutation algorithm [#CLICKHOUSE-3747]
2018-06-05 17:55:35 +03:00
Alexey Milovidov
0f96a5c1c5
Suppressions for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:46:47 +03:00
Alexey Zatelepin
e55097b866
introduce constants for max level and max block number
2018-06-04 14:23:47 +03:00
Alexey Zatelepin
f63d2dc3c8
cannot take a number of unlocked abandonable lock
2018-05-31 20:28:17 +03:00
Alexey Zatelepin
c9bb986330
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Vitaliy Lyudvichenko
dc5de3bbec
More optimal conflicts check in future_parts. [#CLICKHOUSE-2]
2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24
Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
...
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15
part log and metrics [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed
support empty parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972
DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c
execute mutation log entries [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8
select and write part mutations to queue [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2721daf782
don't select merges of parts with different mutation versions [#CLICKHOUSE-3747]
2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146
notify relevant events directly from queue [#CLICKHOUSE-3747]
2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7
load mutations from ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2
write mutations to ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3
test getting abandonable lock in all partitions [#CLICKHOUSE-3747]
2018-05-25 23:05:10 +03:00
Alexey Zatelepin
17437a95bf
merge selection based on checking current inserts [#CLICKHOUSE-3732]
2018-05-25 23:03:56 +03:00
Alexey Milovidov
13762471da
Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3]
2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
...
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]
* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]
* Disable merges in the dropping range. [#CLICKHOUSE-3546]
* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]
* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]
SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]
* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]
* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]
* Add system.part_log logging. [#CLICKHOUSE-3546]
* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]
* Add requested changes. [#CLICKHOUSE-3546]
Fixed clickhouse-client bad return code.
* Add requested chenges. [#CLICKHOUSE-3546]
* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
zhang2014
fa865636ce
ISSUES-2259 add comment & move delete database metadata implementation
2018-05-21 11:38:46 +08:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
...
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
4b093e3e0a
Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2]
...
This patch is very crucial in case of many replicas.
2018-05-18 02:01:36 +03:00
Vitaliy Lyudvichenko
e152f223c9
Fix nodes leak in case of session expiration. [#CLICKHOUSE-2]
2018-04-26 22:46:45 +03:00
Silviu Caragea
1dd5a704fc
Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Alexey Milovidov
499b67642f
Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2]
2018-04-21 21:41:06 +03:00
Nikolai Kochetov
a6375d6155
merged with master
2018-04-20 17:15:03 +03:00
Alexey Milovidov
da94c7dd91
Exit from queueUpdatingThread when ZooKeeper session is expired (non-significant change) [#CLICKHOUSE-2]
2018-04-19 21:01:50 +03:00
Nikolai Kochetov
dd10c2073c
merged with master
2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675
added IStorage::getQueryProcessingStage
2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da
Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
...
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
bf832b3ea6
Fixed OPTIMIZE after RENAME of replicated table. [#CLICKHOUSE-2]
2018-04-17 20:59:42 +03:00
proller
27b4af9dd7
Change obsolete comment
2018-04-16 23:25:07 +03:00
proller
157067b127
CLICKHOUSE-3700: Fix empty password on replica query
2018-04-10 17:49:52 +03:00
Silviu Caragea
f1b8d4bc39
Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
2018-04-10 16:27:17 +03:00
Silviu Caragea
c547c5a7b0
Merge remote-tracking branch 'origin/background-schedule-pool-fix'
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Common/ZooKeeper/ZooKeeper.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
d3cf85057b
Removed useless code [#CLICKHOUSE-2]
2018-04-09 18:49:12 +03:00
Alexey Milovidov
0a4b349f73
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664
ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2]
2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
...
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
0d8d99e7a4
Fixed typo [#CLICKHOUSE-2]
2018-04-06 22:48:54 +03:00
Alexey Zatelepin
3a8ca70d1f
fix races in leader election [#CLICKHOUSE-3533]
2018-04-06 19:10:23 +03:00
Silviu Caragea
f811da7ed4
Move merge selection state into ReplicatedMergeTreeMergeSelectingThread
2018-04-02 15:45:55 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite
2018-04-01 17:31:20 +03:00
Silviu Caragea
1418e339e4
Rename merge_selecting_handle with merge_selecting_task_handle for consistency
2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6
)
2018-03-26 23:12:17 +03:00
Silviu Caragea
50992843c6
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle)
2018-03-26 22:59:58 +03:00
Silviu Caragea
31874ed172
Use consistent names for the task variables
2018-03-26 22:37:47 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Vitaliy Lyudvichenko
883de7a2a6
startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038
Add minimalistic checksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00