Alexey Milovidov
fa776b93c2
Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2]
2018-04-06 22:43:37 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb
Whitespace [#CLICKHOUSE-2].
2017-12-21 20:43:32 +03:00
Alexey Milovidov
6c8b5e29d8
Additions after merge [#CLICKHOUSE-2].
2017-11-20 00:17:58 +03:00
Alexey Milovidov
7c9ba15ba1
Style [#CLICKHOUSE-2].
2017-11-17 23:42:03 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
99b2d135df
clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
Vitaliy Lyudvichenko
397b8bcf92
Smarter parts deletion. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc
Less noisy logging. [#CLICKHOSUE-2]
2017-10-12 22:28:24 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
proller
175cd99288
Freebsd fixes: fix build with libc++, fix find system lib double-conversion ( #1109 )
...
* Cmake: Don't detect and use -no-pie flag with clang
* Camke: find_unwind: Fix disable on arm
* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Vitaliy Lyudvichenko
8a14cc49ff
asyncMulti() -> multi(). [#CLICKHOUSE-3221]
2017-08-15 19:18:02 +03:00
Vitaliy Lyudvichenko
cd3a696d8b
Add requested changes. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
00ce8c9603
Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173]
2017-08-08 03:28:43 +03:00
Vitaliy Lyudvichenko
445608afec
Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921
Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0
Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Alexey Milovidov
28e9e06992
Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].
2017-06-25 03:01:10 +03:00
alexey-milovidov
72822714c3
Merge branch 'master' into CLICKHOUSE-2989
2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Milovidov
557c3dc7f4
Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].
2017-05-25 00:38:56 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
Alexey Milovidov
d605bfdc9d
Using internal boost library [#METR-2944].
2016-12-12 07:57:09 +03:00
Alexey Milovidov
74c3b30622
dbms: Simplified logic of selecting merges [#METR-21841].
2016-10-28 01:50:02 +03:00
Alexey Milovidov
60252fed27
Removed old code as promised [#METR-2944].
2016-04-01 19:47:25 +03:00
Alexey Milovidov
bb122a2fa7
dbms: less locking while clearing old parts; better while loading parts [#METR-2944].
2016-02-14 14:02:47 +03:00
Alexey Milovidov
13c7d0983a
dbms: cutting dependency [#METR-2944]..
2016-01-12 00:46:36 +03:00
Alexey Milovidov
a5b8166541
dbms: better [#METR-19586].
2016-01-10 07:43:30 +03:00
Alexey Milovidov
1a16709162
dbms: fixed error [#METR-18170].
2015-09-25 10:51:00 +03:00
Alexey Milovidov
c757bf9063
dbms: setting thread names [#METR-2944].
2015-09-24 21:54:21 +03:00
Alexey Milovidov
3d817fe625
dbms: lowered data size in ZK [#METR-18170].
2015-09-24 08:47:17 +03:00
Alexey Milovidov
3b5a3e7325
dbms: quorum insert: development [#METR-16779].
2015-09-20 14:02:59 +03:00
Alexey Milovidov
09076b30d5
Merge
2014-12-12 23:50:32 +03:00
Alexey Milovidov
25b474bd81
dbms: fixed subtle error [#METR-13153].
2014-10-15 17:38:09 +04:00
Alexey Milovidov
3d7639e5f1
dbms: little better [#METR-13153].
2014-10-15 05:22:06 +04:00
