Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
zhang2014
fa865636ce
ISSUES-2259 add comment & move delete database metadata implementation
2018-05-21 11:38:46 +08:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
Silviu Caragea
1dd5a704fc
Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Alexey Milovidov
12e33cfd85
Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2]
2018-04-19 21:16:18 +03:00
Silviu Caragea
c547c5a7b0
Merge remote-tracking branch 'origin/background-schedule-pool-fix'
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Common/ZooKeeper/ZooKeeper.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
0a4b349f73
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664
ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2]
2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
...
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
ee7fe63b69
Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2]
2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2
Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2]
2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f
fix races in leader election [#CLICKHOUSE-3533]
2018-04-06 19:10:23 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Silviu Caragea
b24a4b2111
Add back the buggy BackgroundSchedulePool
2018-03-22 17:07:12 +02:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb
Whitespace [#CLICKHOUSE-2].
2017-12-21 20:43:32 +03:00
Alexey Milovidov
6c8b5e29d8
Additions after merge [#CLICKHOUSE-2].
2017-11-20 00:17:58 +03:00
Alexey Milovidov
7c9ba15ba1
Style [#CLICKHOUSE-2].
2017-11-17 23:42:03 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
99b2d135df
clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
Vitaliy Lyudvichenko
397b8bcf92
Smarter parts deletion. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc
Less noisy logging. [#CLICKHOSUE-2]
2017-10-12 22:28:24 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
proller
175cd99288
Freebsd fixes: fix build with libc++, fix find system lib double-conversion ( #1109 )
...
* Cmake: Don't detect and use -no-pie flag with clang
* Camke: find_unwind: Fix disable on arm
* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Vitaliy Lyudvichenko
8a14cc49ff
asyncMulti() -> multi(). [#CLICKHOUSE-3221]
2017-08-15 19:18:02 +03:00
Vitaliy Lyudvichenko
cd3a696d8b
Add requested changes. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
00ce8c9603
Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173]
2017-08-08 03:28:43 +03:00
Vitaliy Lyudvichenko
445608afec
Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921
Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0
Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Alexey Milovidov
28e9e06992
Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].
2017-06-25 03:01:10 +03:00
alexey-milovidov
72822714c3
Merge branch 'master' into CLICKHOUSE-2989
2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Milovidov
557c3dc7f4
Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].
2017-05-25 00:38:56 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
Alexey Milovidov
d605bfdc9d
Using internal boost library [#METR-2944].
2016-12-12 07:57:09 +03:00
Alexey Milovidov
74c3b30622
dbms: Simplified logic of selecting merges [#METR-21841].
2016-10-28 01:50:02 +03:00
