thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 20:02:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
16,649 Commits 9,330 Branches 1,783 Tags 2.1 GiB
035af6327b
Commit Graph

64 Commits

Author SHA1 Message Date
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293 CLICKHOUSE-3847 add support lost replica 2018-07-30 19:31:14 +03:00
Alexey Zatelepin
2447755700 BackgroundSchedulePool: remove task from delayed even it it is currently executing 
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
 2018-06-27 13:47:58 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-24 20:11:59 +03:00
Alexey Milovidov
12e33cfd85 Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2] 2018-04-19 21:16:18 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix' 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-10 16:20:14 +03:00
Alexey Milovidov
0a4b349f73 Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664 ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2] 2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race 
Fix races in leader election.
 2018-04-07 00:18:26 +03:00
Alexey Milovidov
ee7fe63b69 Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2] 2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2 Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2] 2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f fix races in leader election [#CLICKHOUSE-3533] 2018-04-06 19:10:23 +03:00
Alexey Milovidov
ae9633c1e5 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb Whitespace [#CLICKHOUSE-2]. 2017-12-21 20:43:32 +03:00
Alexey Milovidov
6c8b5e29d8 Additions after merge [#CLICKHOUSE-2]. 2017-11-20 00:17:58 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Silviu Caragea
64619c614f Basic idea is : 
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
 2017-11-17 10:58:35 +02:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Zatelepin
c61d4106e8 allow loading all MergeTree settings from a query [#CLICKHOUSE-3000] 2017-10-20 21:28:45 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc Less noisy logging. [#CLICKHOSUE-2] 2017-10-12 22:28:24 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175) 
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
 2017-09-01 20:21:03 +03:00
proller
175cd99288 Freebsd fixes: fix build with libc++, fix find system lib double-conversion (#1109) 
* Cmake: Don't detect and use -no-pie flag with clang

* Camke: find_unwind: Fix disable on arm

* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
 2017-08-17 00:01:43 +03:00
Vitaliy Lyudvichenko
8a14cc49ff asyncMulti() -> multi(). [#CLICKHOUSE-3221] 2017-08-15 19:18:02 +03:00
Vitaliy Lyudvichenko
cd3a696d8b Add requested changes. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
00ce8c9603 Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173] 2017-08-08 03:28:43 +03:00
Vitaliy Lyudvichenko
445608afec Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0 Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Alexey Milovidov
28e9e06992 Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091]. 2017-06-25 03:01:10 +03:00
alexey-milovidov
72822714c3 Merge branch 'master' into CLICKHOUSE-2989 2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9 Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989] 
It was happening during ALTERs.
TODO: stop fetches during ALTER.
 2017-05-25 13:08:52 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00