Commit Graph

4479 Commits

Author SHA1 Message Date
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
robot-clickhouse
3d2e295855 Update version_date.tsv and changelogs after v23.8.5.16-lts 2023-10-31 00:58:27 +00:00
Alexey Milovidov
0152908a10
Merge pull request #56113 from ClickHouse/unit-tests-remove-trash
Remove old trash from unit tests
2023-10-30 20:58:52 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown
Force shutdown in upgrade test
2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci
Randomize block_number column setting in ci
2023-10-30 12:30:51 +01:00
Raúl Marín
8e615e05f1 Merge remote-tracking branch 'blessed/master' into upgrade_test_force_shutdown 2023-10-30 10:29:42 +01:00
Alexey Milovidov
a1ef4e7d07 Remove old trash from unit tests 2023-10-30 03:26:18 +01:00
Alexey Milovidov
243499aad1
Merge pull request #55796 from ClickHouse/Fix_azurite_port
Fix azurite port issue
2023-10-28 00:40:24 +02:00
Raúl Marín
e93f64670b Force shutdown in upgrade test 2023-10-27 11:16:00 +02:00
Nikita Mikhaylov
f5890a5b4c
Added healthcheck for LDAP (#55571) 2023-10-27 10:53:59 +02:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont
Stress tests: Try to wait until server is responsive after gdb detach
2023-10-26 11:37:49 +02:00
Raúl Marín
62088772d2 Fuzzer: Use the known pid instead of reading the file
The file might not exists yet
2023-10-25 16:12:18 +02:00
Azat Khuzhin
ff7e9e16d5 Fix possible performance test error
CI [1]:

    2023-10-24 12:18:27	 ++ rg -c array_fill.xml changed-test-definitions.txt
    2023-10-24 12:18:27	 + '[' '' -gt 0 ']'
    2023-10-24 12:18:27	 right/scripts/compare.sh: line 288: [: : integer expression expected

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/performance_comparison_[2_4]/compare.log

v1: use --include-zero
v2: revert to grep
v3: check exit code
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-24 13:51:57 +02:00
Smita Kulkarni
7b1c0c471c Merge branch 'master' into Fix_azurite_port 2023-10-23 22:13:56 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Alexey Milovidov
7cd10e1c4b
Merge pull request #55780 from ClickHouse/correct-grep-fuzzer
Correctly grep fuzzer.log
2023-10-19 05:50:38 +02:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Mikhail f. Shiryaev
224edf26fe
Merge branch 'master' into speedup-images-enrich 2023-10-18 19:05:28 +02:00
Mikhail f. Shiryaev
8935c6ce5d
Merge pull request #55717 from ClickHouse/tune-dockerfiles
Improve Dockerfiles for keeper and server images
2023-10-18 19:04:27 +02:00
Mikhail f. Shiryaev
e4e1aac154
Move comment about created user to a proper place 2023-10-18 14:20:21 +02:00
Mikhail f. Shiryaev
8b49a94713
Check sha512 sums for alpine server and keeper images 2023-10-18 14:20:20 +02:00
Mikhail f. Shiryaev
726c370d08
Replace temporary REPORITORY url by a proper one 2023-10-18 14:20:11 +02:00
Antonio Andelic
2eabb260a7 Correctly grep fuzzer.log 2023-10-18 12:09:22 +00:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
4848baf302
Adjust performance artifacts prepare to the filtered checkout 2023-10-18 00:01:38 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
Mikhail f. Shiryaev
a4fb143413
Merge pull request #50724 from AlexNik/docker-initialization-once
Initialization of the database only once in Docker.
2023-10-16 13:12:17 +02:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
54fb9a836e
Merge pull request #55503 from hanfei1991/hanfei/fix-export-logs-structure-mismatch
fix lots of 'Structure does not match' warnings in ci
2023-10-12 16:15:00 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
slvrtrn
76da9cf780 Remove old Java client tests
Revert Java client docker image JDK bump (no AArch64 available)
2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
2023-10-10 19:51:09 +02:00
Mikhail f. Shiryaev
3ed7cffbb4
Merge branch 'master' into docker-initialization-once 2023-10-10 13:40:05 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
Azat Khuzhin
ce9cdc408c Upgrade MinIO to support accepting non signed requests
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.

The problem is in this place [1].

  [1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)

And this had been added only in [2].

  [2]: https://github.com/minio/minio/pull/16484

But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update
Fix deadlock in LDAP assigned role update
2023-10-08 00:38:10 +02:00
Ilya Yatsishin
262373c9ef
Merge pull request #51435 from qoega/sources-with-subs
Build artifact with sources with submodules in Darwin special build
2023-10-07 11:07:27 +02:00
Mikhail f. Shiryaev
f525f05598 Merge remote-tracking branch 'origin/master' into sources-with-subs 2023-10-03 14:42:24 +02:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch
Remove Meilisearch
2023-10-01 01:57:04 +03:00
Alexey Milovidov
6c408c7867
Merge pull request #55071 from ClickHouse/nikitamikhaylov-patch-1
Use `source` instead of `bash` for pre-build script
2023-09-30 08:58:27 +03:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
Fix broken test
2023-09-29 11:13:31 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Yatsishin Ilya
a78311bd8c Fix typo in packager when ccache is used 2023-09-28 14:40:13 +00:00
Nikita Mikhaylov
1f78755da2
Update build.sh 2023-09-28 11:47:23 +02:00