Commit Graph

121 Commits

Author SHA1 Message Date
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
3b58e9cd67 Fix atomic usage 2017-11-01 20:15:05 +03:00
proller
c5dcde0c78 fix atomic usage 2017-11-01 16:58:02 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Zatelepin
c61d4106e8 allow loading all MergeTree settings from a query [#CLICKHOUSE-3000] 2017-10-20 21:28:45 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
Alexey Zatelepin
df58949a68 make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259] 2017-09-20 06:05:20 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Alexey Zatelepin
4a98d83a3b introduce replicated_can_become_leader merge_tree setting [#CLICKHOUSE-3109] 2017-07-11 20:44:35 +03:00
Alexey Milovidov
061c214c16 Fixed error [#CLICKHOUSE-3074]. 2017-06-23 09:57:55 +03:00
alexey-milovidov
72822714c3 Merge branch 'master' into CLICKHOUSE-2989 2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9 Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
f1yegor
401425bb89 translate comments 2017-03-12 20:18:07 +01:00
Alexey Milovidov
d605bfdc9d Using internal boost library [#METR-2944]. 2016-12-12 07:57:09 +03:00
Alexey Milovidov
74c3b30622 dbms: Simplified logic of selecting merges [#METR-21841]. 2016-10-28 01:50:02 +03:00
Alexey Milovidov
15b369bd08 More instrumentation [#METR-23272]. 2016-10-24 16:47:15 +03:00
Alexey Milovidov
9a3deed1ea Added metric about leadership [#METR-23272]. 2016-10-24 15:46:54 +03:00
Alexey Milovidov
ea852bb9d8 Separate compilation of CurrentMetrics; Separated AsynchronousMetrics from CurrentMetrics; Comments [#METR-23237]. 2016-10-24 07:06:27 +03:00
Alexey Milovidov
9af5ce1e3b Separate compilation of ProfileEvents; comments [#METR-23237]. 2016-10-24 05:02:37 +03:00
Alexey Milovidov
4d9b3fd3ee Better [#METR-23198]. 2016-10-23 13:59:53 +03:00
Alexey Milovidov
afcd933237 Probably better [#METR-23198]. 2016-10-23 06:46:51 +03:00
Alexey Milovidov
15bf61c367 Fixed part of error [#METR-23198]. 2016-10-21 04:44:57 +03:00
Vitaliy Lyudvichenko
3120b06c02 Small enhancement and typos fixes. 2016-10-14 21:00:55 +03:00
Vitaliy Lyudvichenko
669e2982a5 Made merge_selecting_thread creation & deletion atomic. [#METR-22471] 2016-10-14 14:47:11 +03:00
Vitaliy Lyudvichenko
aa863ea7bb Fixed std::terminate on DROP of StorageReplicatedMergeTree. [#METR-22471] 2016-10-14 13:17:05 +03:00
Alexey Milovidov
6b2755bf2a Non significant change [#METR-2944]. 2016-09-23 23:33:06 +03:00
Alexey Milovidov
867b73b6b0 Fixed error with cancelling merges on ALTERs [#METR-22524]. 2016-08-26 22:50:04 +03:00
Alexey Milovidov
d5ad347532 Fixed probable source of race conditions [#METR-22327]. 2016-08-12 08:20:06 +03:00
Alexey Milovidov
6cf89fa915 Attempt to not interrupt merges when ZK session is reinitialized [#METR-22283]. 2016-08-02 21:33:55 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
c518abe882 Get rid of Poco::SharedPtr [#METR-21503]. 2016-05-28 20:31:50 +03:00
Alexey Milovidov
11df87ea54 Merge 2016-04-09 07:22:11 +03:00
Alexey Milovidov
d0365e9501 Separated code for checking parts [#METR-20803]. 2016-04-09 06:50:02 +03:00
Alexey Arno
32a38485e6 Merge 2016-03-25 14:48:45 +03:00
Alexey Arno
6efc98d1f3 Merge 2016-03-01 20:47:53 +03:00
Alexey Milovidov
67a07205b7 Merge 2016-01-28 04:00:27 +03:00
Alexey Milovidov
5c90d7d45c Merge 2016-01-26 05:00:25 +03:00
Alexey Arno
a3ea32b985 Merge 2016-01-21 19:30:05 +03:00
Alexey Milovidov
0f3e163c4e dbms: CurrentMetrics: development [#METR-19596]. 2016-01-21 04:47:28 +03:00
Alexey Milovidov
3f89d9e0f5 dbms: added profile event for yielding leadership [#METR-17573]. 2016-01-20 23:43:42 +03:00
Alexey Milovidov
82a96d22b1 dbms: tracking replicas delays [#METR-17573]. 2016-01-17 16:00:42 +03:00
Alexey Milovidov
13c7d0983a dbms: cutting dependency [#METR-2944].. 2016-01-12 00:46:36 +03:00
Alexey Milovidov
f1f3619df4 dbms: cancelling fetching of parts on table shutdown [#METR-19544]. 2015-12-25 00:28:18 +03:00
Alexey Milovidov
f8e58463a6 dbms: addition to prev. revision [#METR-17573]. 2015-11-10 00:07:22 +03:00
Alexey Milovidov
e78ed9f802 dbms: replication delays: development [#METR-17573]. 2015-11-09 23:30:54 +03:00
Alexey Milovidov
d7831a6317 dbms: fixed error [#METR-17573]. 2015-11-06 21:45:48 +03:00
Alexey Milovidov
4a35d9169f dbms: merges don't block ALTERs [#METR-18690]. 2015-11-06 20:34:48 +03:00
Alexey Milovidov
e29df2814c dbms: checking replication delays [#METR-17573]. 2015-11-05 22:44:19 +03:00
Alexey Milovidov
11447a4e1a dbms: accurate checking of replication delays (incomplete) [#METR-17573]. 2015-11-05 20:38:24 +03:00
Alexey Milovidov
b8c8662457 dbms: preparation [#METR-18167]. 2015-10-02 21:33:46 +03:00
Alexey Milovidov
c757bf9063 dbms: setting thread names [#METR-2944]. 2015-09-24 21:54:21 +03:00
Alexey Milovidov
1481d7f293 dbms: specifying port to send queries in ZK [#METR-18167]. 2015-09-24 07:50:53 +03:00
Alexey Milovidov
3b5a3e7325 dbms: quorum insert: development [#METR-16779]. 2015-09-20 14:02:59 +03:00
Alexey Milovidov
0c2e0b7304 dbms: fixed error with replication [#METR-14391]. 2014-12-21 04:20:07 +03:00
Alexey Milovidov
09076b30d5 Merge 2014-12-12 23:50:32 +03:00
Alexey Milovidov
dac2ff8920 dbms: addition to prev. revision [#METR-14238]. 2014-12-11 05:06:22 +03:00
Alexey Milovidov
03a21823db dbms: addition to prev. revision [#METR-14238]. 2014-12-11 05:04:13 +03:00
Alexey Milovidov
2aa2cb18c4 dbms: fixed error with re-initializing session in ZK [#METR-14238]. 2014-12-11 04:56:42 +03:00
Alexey Milovidov
f175ec58e0 dbms: tiny improvement [#METR-2944]. 2014-12-08 01:59:00 +03:00
Alexey Milovidov
b2696ffec1 dbms: fixed one of errors [#METR-13979]. 2014-11-28 23:45:33 +03:00
Alexey Milovidov
a7b4903f14 dbms: fixed error with replication when 'interserver_http_port' is not specified [#METR-13831]. 2014-11-19 23:40:51 +03:00
Alexey Milovidov
d3664eac89 dbms: added setting replication_alter_partitions_sync [#METR-13158]. 2014-10-18 23:14:09 +04:00
Alexey Milovidov
f26b265eed Merge 2014-10-18 21:37:55 +04:00
Alexey Milovidov
a097d24644 dbms: moved some code to separate file [#METR-13153]. 2014-10-17 05:05:51 +04:00