Alexey Milovidov
21247ebfac
Better replica repair logic: clearing obsolete queue
2019-02-14 17:04:28 +03:00
alexey-milovidov
9ff0edc203
Merge pull request #2971 from urykhy/zk-operation-timeout
...
Make ZK operation timeout configurable
2018-08-28 14:23:09 +03:00
Yury Stankevich
f3024d2fba
Make ZK operation timeout configurable
2018-08-27 20:26:19 +03:00
Alexey Milovidov
3475ef5304
Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2]
2018-08-25 04:58:14 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
4ca3bf65f3
test getting abandonable lock in all partitions [#CLICKHOUSE-3747]
2018-05-25 23:05:10 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
...
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
e8b94b89e9
Removed dbg output, fixed test. [#CLICKHOUSE-2]
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
e152f223c9
Fix nodes leak in case of session expiration. [#CLICKHOUSE-2]
2018-04-26 22:46:45 +03:00
Silviu Caragea
c547c5a7b0
Merge remote-tracking branch 'origin/background-schedule-pool-fix'
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Common/ZooKeeper/ZooKeeper.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
403a2c62a2
Miscellaneous [#CLICKHOUSE-2]
2018-04-05 05:56:11 +03:00
Alexey Milovidov
2310bd7947
Miscellaneous [#CLICKHOUSE-2]
2018-04-03 20:35:48 +03:00
Alexey Milovidov
0d2c2ea3d4
Fixed error after removed libzookeeper [#CLICKHOUSE-2]
2018-04-03 03:39:58 +03:00
Silviu Caragea
438121e45b
Renamed Zookeeper get method with getWatch for consistency
2018-03-26 23:08:14 +03:00
Silviu Caragea
4361df913b
Remove exists and use existsWatch instead for WatchCallbacks
2018-03-26 22:46:14 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352
Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite
2018-03-24 23:30:57 +03:00
Alexey Milovidov
6b684fc1a3
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 02:15:14 +03:00
proller
caf83a650e
libs: compiling with msvc2017 ( #1996 )
...
* Allow use bundled *ssl library
* fix
* Add submodule
* Fixes
* fix
* fixes
* fixes
* fix
* fix
* update poco
* fix warnings
* fix
* fix
* Build fixes
* Build fixes
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* add bat
* no zookeeper in dbms
* update boost
* fixes
* fixes
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* Better
* fix
* dh verbose
* fix
* dh verbose
* fix
* clean
* Update LocalDate.h
* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Silviu Caragea
a2dc16a582
Remove the link between TaskHandles and ZooKeeper
2018-03-22 17:21:14 +02:00
Silviu Caragea
b24a4b2111
Add back the buggy BackgroundSchedulePool
2018-03-22 17:07:12 +02:00
Alexey Milovidov
6d889da41e
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 15:15:23 +03:00
Alexey Milovidov
d690c24198
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 00:40:53 +03:00
Alexey Milovidov
76f9e0032d
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-20 00:34:56 +03:00
Alexey Milovidov
597160443a
Fixed build after merge #2036
2018-03-14 21:58:40 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
22794bc93e
ZooKeeper multi op is transparent with chroot prefixes. [#CLICKHOUSE-3639]
2018-03-14 16:27:16 +03:00
Vitaliy Lyudvichenko
f89d9dbfb9
Fixed segfault in an integration test. [#CLICKHOUSE-2]
2018-02-27 21:46:16 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e
Make early deduplication with block number creation. [#CLICKHOUSE-3545]
2018-01-23 18:50:29 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Milovidov
9b92c0fecd
BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].
2017-11-19 03:22:13 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
3ffb239185
add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
KochetovNicolai
bfb4e8f3fe
zookeeper chroot fix ( #1430 )
...
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* moved root section in zookeeper configuration [#CLICKHOUSE-3031]
* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]
* added tests [#CLICKHOUSE-3031]
* replaced tabs to spaces in config files [#CLICKHOUSE-3031]
* fix build [#CLICKHOUSE-3031]
* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]
* added comments [#CLICKHOUSE-3031]
* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]
* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
Nikolai Kochetov
ec58bfae90
added comments [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
d4bf2bf102
replaced tabs to spaces in config files [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
fa2f0dfa4d
added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
16103456e2
added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Vitaliy Lyudvichenko
e4785aeb4d
Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128]
2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
23af9ddd5e
Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Alexey Milovidov
cd4fef7767
Miscellaneous [#CLICKHOUSE-2].
2017-07-26 08:55:59 +03:00
Alexey Milovidov
05accbdcbe
Removed cyclic dependency [#DEVTOOLS-3381].
2017-06-19 23:06:35 +03:00