Alexey Milovidov
b8df381a97
ZooKeeper: changed operation timeout to 10s because some users run ZooKeeper on servers with HDD and high background load [#CLICKHOUSE-2]
2018-04-05 03:02:09 +03:00
Alexey Milovidov
ddc4e1e388
ZooKeeper: Better connection loop [#CLICKHOUSE-2]
2018-04-05 02:33:21 +03:00
Alexey Milovidov
944748e7da
Modifications after removing libzookeeper [#CLICKHOUSE-2]
2018-04-03 22:54:35 +03:00
Alexey Milovidov
2310bd7947
Miscellaneous [#CLICKHOUSE-2]
2018-04-03 20:35:48 +03:00
Alexey Milovidov
daa736700d
Minor modification after removing libzookeeper [#CLICKHOUSE-2]
2018-04-03 00:48:39 +03:00
Alexey Milovidov
93307a82e6
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 07:20:31 +03:00
Alexey Milovidov
2c4b28597e
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:57:04 +03:00
Alexey Milovidov
49045754d9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:56:08 +03:00
Alexey Milovidov
6721914041
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:36:35 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
280a5f8e3f
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 02:01:21 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Alexey Milovidov
6b684fc1a3
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 02:15:14 +03:00
Alexey Milovidov
6d889da41e
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 15:15:23 +03:00
Alexey Milovidov
d690c24198
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 00:40:53 +03:00
Alexey Milovidov
76f9e0032d
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-20 00:34:56 +03:00
Vitaliy Lyudvichenko
f38dc334d6
Refactor of asyncMulti. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
22794bc93e
ZooKeeper multi op is transparent with chroot prefixes. [#CLICKHOUSE-3639]
2018-03-14 16:27:16 +03:00
Vitaliy Lyudvichenko
f89d9dbfb9
Fixed segfault in an integration test. [#CLICKHOUSE-2]
2018-02-27 21:46:16 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e
Make early deduplication with block number creation. [#CLICKHOUSE-3545]
2018-01-23 18:50:29 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Silviu Caragea
b08463ed7b
Fix for https://github.com/yandex/ClickHouse/issues/1648
2017-12-19 22:41:05 +03:00
Alexey Milovidov
f5ecb2db5d
Better [#CLICKHOUSE-2].
2017-12-01 20:49:12 +03:00
Alexey Milovidov
9b92c0fecd
BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].
2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c
BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2].
2017-11-19 03:08:37 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
3ffb239185
add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
Silviu Caragea
b4f7bfaa02
Remove duplicate code from zookeeper.cpp
2017-11-11 03:36:29 +03:00
KochetovNicolai
bfb4e8f3fe
zookeeper chroot fix ( #1430 )
...
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* moved root section in zookeeper configuration [#CLICKHOUSE-3031]
* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]
* added tests [#CLICKHOUSE-3031]
* replaced tabs to spaces in config files [#CLICKHOUSE-3031]
* fix build [#CLICKHOUSE-3031]
* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]
* added comments [#CLICKHOUSE-3031]
* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]
* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
Alexey Milovidov
d77686685a
Using PODArray instead of std::vector in ZooKeeper library [#CLICKHOUSE-2].
2017-10-23 18:08:31 +03:00
alexey-milovidov
4f86ec9d58
Update ZooKeeper.cpp
2017-10-23 17:39:29 +03:00
Marek Vavruša
e2a8526990
ZooKeeper: fixed stack smashing with tryGet()
...
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.
This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
2017-10-18 15:13:42 -07:00
Alexey Milovidov
cd540c2674
Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2].
2017-09-10 02:17:38 +03:00
Alexey Milovidov
8b313ab99e
Fixed warnings found by cppcheck [#CLICKHOUSE-3300].
2017-09-08 00:04:48 +03:00
Nikolai Kochetov
ec58bfae90
added comments [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1e08db938d
added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
5ff1669406
fixed root section in zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1539648910
moved root section in zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
fa2f0dfa4d
added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Nikolai Kochetov
16103456e2
added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
2017-08-30 21:30:57 +03:00
Alexey Milovidov
738f1685b2
Fixed build after merge [#CLICKHOUSE-2].
2017-08-25 19:35:10 +03:00
Marek Vavruša
3659caad7d
ZooKeeper: use seeded random device to shuffle node list #1149
...
std::random_shuffle() may or may not use std::rand() which isn't
seeded, and since configuration parsing runs predictably as one
of the first things after server startup, the list of ZK nodes
is shuffled the same way on all replicas.
2017-08-25 18:37:27 +03:00
alexey-milovidov
e44614d017
Update ZooKeeper.cpp
2017-08-10 23:09:05 +03:00
alexey-milovidov
5d3bff4802
Update ZooKeeper.cpp
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
23af9ddd5e
Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00