ClickHouse/programs/copier
Azat Khuzhin c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
..
Aliases.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
clickhouse-copier.cpp Remove dlopen 2022-09-17 03:02:34 +02:00
ClusterCopier.cpp Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
ClusterCopier.h Separate TaskShard and TaskTable 2022-10-20 14:00:20 +00:00
ClusterCopierApp.cpp Update programs/copier/ClusterCopierApp.cpp 2023-09-04 18:27:07 +08:00
ClusterCopierApp.h base should not depend on Common 2022-04-29 10:26:35 +08:00
ClusterPartition.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
CMakeLists.txt Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
Internals.cpp Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Internals.h Fix IBM 2023-04-21 12:38:45 +02:00
ShardPartition.cpp Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
ShardPartition.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
ShardPartitionPiece.cpp Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
ShardPartitionPiece.h Fixed tests 2023-06-20 11:42:22 +03:00
StatusAccumulator.cpp Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
StatusAccumulator.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
TaskCluster.cpp Rename directory monitor concept into background INSERT (#55978) 2023-11-01 15:09:39 +01:00
TaskCluster.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
TaskShard.cpp Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
TaskShard.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
TaskTable.cpp Fix IBM 2023-04-21 12:38:45 +02:00
TaskTable.h Un-clusterf$ck incomplete type errors 2022-10-20 14:48:46 +00:00
ZooKeeperStaff.h Fixes for clang-17 2023-05-13 02:57:31 +02:00