Commit Graph

256 Commits

Author SHA1 Message Date
Alexey Milovidov
08170d0d77 Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
Alexey Milovidov
0d2c2ea3d4 Fixed error after removed libzookeeper [#CLICKHOUSE-2] 2018-04-03 03:39:58 +03:00
Alexey Milovidov
daa736700d Minor modification after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 00:48:39 +03:00
Alexey Milovidov
6364c49ad8 ZooKeeper: fixed chroot [#CLICKHOUSE-2] 2018-04-02 21:59:18 +03:00
Silviu Caragea
438121e45b Renamed Zookeeper get method with getWatch for consistency 2018-03-26 23:08:14 +03:00
Silviu Caragea
4361df913b Remove exists and use existsWatch instead for WatchCallbacks 2018-03-26 22:46:14 +03:00
Alexey Milovidov
5ac329c91c Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 07:34:33 +03:00
Alexey Milovidov
93307a82e6 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 07:20:31 +03:00
Alexey Milovidov
c2f40e8d41 Removed libzookeeper [#CLICKHOUSE-2] 2018-03-25 06:47:56 +03:00
Alexey Milovidov
2c4b28597e Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:57:04 +03:00
Alexey Milovidov
49045754d9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:56:08 +03:00
Alexey Milovidov
6721914041 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:36:35 +03:00
Alexey Milovidov
548c4b0adf Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:20:51 +03:00
Alexey Milovidov
522bf01db9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:15:52 +03:00
Alexey Milovidov
0714a217fe Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 02:13:05 +03:00
Alexey Milovidov
280a5f8e3f Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 02:01:21 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
Alexey Milovidov
87b4d8209a Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:28:43 +03:00
Alexey Milovidov
58f32f98d7 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Alexey Milovidov
6b684fc1a3 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 02:15:14 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996)
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Silviu Caragea
a2dc16a582 Remove the link between TaskHandles and ZooKeeper 2018-03-22 17:21:14 +02:00
Silviu Caragea
f2479673d6 Fix BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
6d889da41e Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 15:15:23 +03:00
Alexey Milovidov
d690c24198 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 00:40:53 +03:00
Alexey Milovidov
76f9e0032d Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-20 00:34:56 +03:00
Alexey Milovidov
644c5e67b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:25:21 +03:00
Alexey Milovidov
c8f8dc429c Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:23:05 +03:00
Alexey Milovidov
831d38fd59 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 22:07:50 +03:00
Alexey Milovidov
72ededeab5 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 20:45:30 +03:00
Alexey Milovidov
1b0a43ce55 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 17:19:32 +03:00
Alexey Milovidov
c5ddbbb1ab Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 16:31:09 +03:00
Alexey Milovidov
5146ab8acc Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 03:32:59 +03:00
Alexey Milovidov
0d11b75def Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 02:11:57 +03:00
Alexey Milovidov
347a83029a Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-19 00:53:56 +03:00
Alexey Milovidov
c68af7f09a Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 23:25:40 +03:00
Alexey Milovidov
a4e1bd5bc4 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 21:31:18 +03:00
Alexey Milovidov
c1c5aa00ca Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 21:14:01 +03:00
Alexey Milovidov
30196169a1 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-18 18:23:06 +03:00
Vitaliy Lyudvichenko
9e9739ce2d Fixed a test. [#CLICKHOUSE-2] 2018-03-14 23:54:16 +03:00
Alexey Milovidov
597160443a Fixed build after merge #2036 2018-03-14 21:58:40 +03:00
Vitaliy Lyudvichenko
f38dc334d6 Refactor of asyncMulti. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Vitaliy Lyudvichenko
22794bc93e ZooKeeper multi op is transparent with chroot prefixes. [#CLICKHOUSE-3639] 2018-03-14 16:27:16 +03:00
proller
d6a1f8470f CLICKHOUSE-3553 Rebuild loggers on every config change (#1973)
* Macos test fix

* Fix freebsd build

* CLICKHOUSE-3553 Rebuild loggers on every config change

* rename clickhouse_common_configprocessor -> clickhouse_common_config; move Server/ConfigReloader.cpp -> Common/Config/

* CLICKHOUSE-3553 Set new level to all loggers on reload

* Dont use hash

* Update BaseDaemon.h
2018-02-28 23:34:25 +03:00
Vitaliy Lyudvichenko
f89d9dbfb9 Fixed segfault in an integration test. [#CLICKHOUSE-2] 2018-02-27 21:46:16 +03:00
proller
0c00e47930 Fix tests 2018-02-02 20:29:45 +03:00
Vitaliy Lyudvichenko
0bd5f6a447 Merged ZooKeeper lib changes from CLICKHOUSE-3342. Part 1. [#CLICKHOUSE-3346] 2018-01-22 21:56:23 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f Minimal working example. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Silviu Caragea
b08463ed7b Fix for https://github.com/yandex/ClickHouse/issues/1648 2017-12-19 22:41:05 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
827a5d0612 Fix warnings-errors in gtest 2017-11-24 23:40:14 +03:00
proller
2778f35e48 Lib Parsers 2017-11-21 22:35:54 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Silviu Caragea
b4f7bfaa02 Remove duplicate code from zookeeper.cpp 2017-11-11 03:36:29 +03:00
KochetovNicolai
bfb4e8f3fe zookeeper chroot fix (#1430)
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* moved root section in zookeeper configuration [#CLICKHOUSE-3031]

* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]

* added tests [#CLICKHOUSE-3031]

* replaced tabs to spaces in config files [#CLICKHOUSE-3031]

* fix build [#CLICKHOUSE-3031]

* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]

* added comments [#CLICKHOUSE-3031]

* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]

* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
Vitaliy Lyudvichenko
71833a7f0f More correct procedure of parts deleting. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Milovidov
d77686685a Using PODArray instead of std::vector in ZooKeeper library [#CLICKHOUSE-2]. 2017-10-23 18:08:31 +03:00
alexey-milovidov
4f86ec9d58 Update ZooKeeper.cpp 2017-10-23 17:39:29 +03:00
Marek Vavruša
e2a8526990 ZooKeeper: fixed stack smashing with tryGet()
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
2017-10-18 15:13:42 -07:00
proller
20329ce794 Zookeeper include fix (#1353) 2017-10-13 23:30:55 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Nikolai Kochetov
ec58bfae90 added comments [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1e08db938d added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
871a7cabc6 fix build [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
d4bf2bf102 replaced tabs to spaces in config files [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
5ff1669406 fixed root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1539648910 moved root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
fa2f0dfa4d added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
16103456e2 added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Alexey Milovidov
738f1685b2 Fixed build after merge [#CLICKHOUSE-2]. 2017-08-25 19:35:10 +03:00
Marek Vavruša
3659caad7d ZooKeeper: use seeded random device to shuffle node list #1149
std::random_shuffle() may or may not use std::rand() which isn't
seeded, and since configuration parsing runs predictably as one
of the first things after server startup, the list of ZK nodes
is shuffled the same way on all replicas.
2017-08-25 18:37:27 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
alexey-milovidov
1626637a89 Update zkutil_test_multi_exception.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
e44614d017 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
5d3bff4802 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
23af9ddd5e Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Vitaliy Lyudvichenko
003d2a9478 Add comprehensive exception message for ZooKeeper::multi(). [#CLICKHOUSE-2] 2017-08-03 15:42:23 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
Alexey Milovidov
1b17f6191b Addition to prev. revision [#DEVTOOLS-3381]. 2017-06-19 23:09:11 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00