Commit Graph

4548 Commits

Author SHA1 Message Date
Alexey Milovidov
e073eaf5ce Try LowCardinality 2023-11-11 08:23:58 +01:00
Alexey Milovidov
0064872bc7 Apply LowCardinality in more places 2023-11-11 07:46:56 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
4460abafbe No idea why it did not work 2023-11-11 07:37:39 +01:00
Alexey Milovidov
629c5c0e45 Change tables version 2023-11-11 06:21:31 +01:00
Alexey Milovidov
fb0335efb0 What if I add some indices 2023-11-11 06:20:57 +01:00
Alexey Milovidov
6078ff20bb Symbolize trace_log for exporting 2023-11-11 05:52:44 +01:00
robot-clickhouse
9ac7159a93 Update version_date.tsv and changelogs after v23.10.3.5-stable 2023-11-10 21:07:22 +00:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol
Support compression for keeper protocol
2023-11-09 10:00:19 +01:00
robot-clickhouse
bc4de36e51 Update version_date.tsv and changelogs after v23.9.4.11-stable 2023-11-08 15:36:31 +00:00
tomtana
12a74986af
Update README.md 2023-11-04 16:53:22 +01:00
tomtana
841934ff49
Update README.md
Add details for the supported arm devices
2023-11-04 16:41:08 +01:00
robot-clickhouse
a8aa32fd3d Update version_date.tsv and changelogs after v23.10.1.1976-stable 2023-11-02 19:34:42 +00:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
robot-clickhouse
3d2e295855 Update version_date.tsv and changelogs after v23.8.5.16-lts 2023-10-31 00:58:27 +00:00
Alexey Milovidov
0152908a10
Merge pull request #56113 from ClickHouse/unit-tests-remove-trash
Remove old trash from unit tests
2023-10-30 20:58:52 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown
Force shutdown in upgrade test
2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci
Randomize block_number column setting in ci
2023-10-30 12:30:51 +01:00
Raúl Marín
8e615e05f1 Merge remote-tracking branch 'blessed/master' into upgrade_test_force_shutdown 2023-10-30 10:29:42 +01:00
Alexey Milovidov
a1ef4e7d07 Remove old trash from unit tests 2023-10-30 03:26:18 +01:00
Alexey Milovidov
243499aad1
Merge pull request #55796 from ClickHouse/Fix_azurite_port
Fix azurite port issue
2023-10-28 00:40:24 +02:00
Smita Kulkarni
13c90c0b86 Removed unwanted file and added chanegs to stress_test 2023-10-27 14:56:25 +02:00
Raúl Marín
e93f64670b Force shutdown in upgrade test 2023-10-27 11:16:00 +02:00
Nikita Mikhaylov
f5890a5b4c
Added healthcheck for LDAP (#55571) 2023-10-27 10:53:59 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont
Stress tests: Try to wait until server is responsive after gdb detach
2023-10-26 11:37:49 +02:00
Raúl Marín
62088772d2 Fuzzer: Use the known pid instead of reading the file
The file might not exists yet
2023-10-25 16:12:18 +02:00
Azat Khuzhin
ff7e9e16d5 Fix possible performance test error
CI [1]:

    2023-10-24 12:18:27	 ++ rg -c array_fill.xml changed-test-definitions.txt
    2023-10-24 12:18:27	 + '[' '' -gt 0 ']'
    2023-10-24 12:18:27	 right/scripts/compare.sh: line 288: [: : integer expression expected

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/performance_comparison_[2_4]/compare.log

v1: use --include-zero
v2: revert to grep
v3: check exit code
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-24 13:51:57 +02:00
Smita Kulkarni
7b1c0c471c Merge branch 'master' into Fix_azurite_port 2023-10-23 22:13:56 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
Smita Kulkarni
c98782bd2b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-20 14:47:17 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Smita Kulkarni
c39ca0b549 Fixed clang-tidy and updated to randomize compression for stress test 2023-10-19 11:59:22 +02:00
Alexey Milovidov
7cd10e1c4b
Merge pull request #55780 from ClickHouse/correct-grep-fuzzer
Correctly grep fuzzer.log
2023-10-19 05:50:38 +02:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Mikhail f. Shiryaev
224edf26fe
Merge branch 'master' into speedup-images-enrich 2023-10-18 19:05:28 +02:00
Mikhail f. Shiryaev
8935c6ce5d
Merge pull request #55717 from ClickHouse/tune-dockerfiles
Improve Dockerfiles for keeper and server images
2023-10-18 19:04:27 +02:00
Mikhail f. Shiryaev
e4e1aac154
Move comment about created user to a proper place 2023-10-18 14:20:21 +02:00
Mikhail f. Shiryaev
8b49a94713
Check sha512 sums for alpine server and keeper images 2023-10-18 14:20:20 +02:00
Mikhail f. Shiryaev
726c370d08
Replace temporary REPORITORY url by a proper one 2023-10-18 14:20:11 +02:00
Antonio Andelic
2eabb260a7 Correctly grep fuzzer.log 2023-10-18 12:09:22 +00:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
4848baf302
Adjust performance artifacts prepare to the filtered checkout 2023-10-18 00:01:38 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
Mikhail f. Shiryaev
a4fb143413
Merge pull request #50724 from AlexNik/docker-initialization-once
Initialization of the database only once in Docker.
2023-10-16 13:12:17 +02:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
54fb9a836e
Merge pull request #55503 from hanfei1991/hanfei/fix-export-logs-structure-mismatch
fix lots of 'Structure does not match' warnings in ci
2023-10-12 16:15:00 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
slvrtrn
76da9cf780 Remove old Java client tests
Revert Java client docker image JDK bump (no AArch64 available)
2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
2023-10-10 19:51:09 +02:00
Mikhail f. Shiryaev
3ed7cffbb4
Merge branch 'master' into docker-initialization-once 2023-10-10 13:40:05 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
Azat Khuzhin
ce9cdc408c Upgrade MinIO to support accepting non signed requests
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.

The problem is in this place [1].

  [1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)

And this had been added only in [2].

  [2]: https://github.com/minio/minio/pull/16484

But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update
Fix deadlock in LDAP assigned role update
2023-10-08 00:38:10 +02:00
Ilya Yatsishin
262373c9ef
Merge pull request #51435 from qoega/sources-with-subs
Build artifact with sources with submodules in Darwin special build
2023-10-07 11:07:27 +02:00
Mikhail f. Shiryaev
f525f05598 Merge remote-tracking branch 'origin/master' into sources-with-subs 2023-10-03 14:42:24 +02:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch
Remove Meilisearch
2023-10-01 01:57:04 +03:00
Alexey Milovidov
6c408c7867
Merge pull request #55071 from ClickHouse/nikitamikhaylov-patch-1
Use `source` instead of `bash` for pre-build script
2023-09-30 08:58:27 +03:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
Fix broken test
2023-09-29 11:13:31 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Yatsishin Ilya
a78311bd8c Fix typo in packager when ccache is used 2023-09-28 14:40:13 +00:00
Nikita Mikhaylov
1f78755da2
Update build.sh 2023-09-28 11:47:23 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh 2023-09-28 01:05:35 +02:00
Nikita Mikhaylov
5753c3e72f
bash -> source 2023-09-28 00:48:17 +02:00
Nikita Mikhaylov
8ac88645c8
Use different names for variables inside build.sh (#55067)
* Better

* Even better
2023-09-27 20:50:19 +02:00
Nikita Mikhaylov
02ac8d56ef
Fix prebuild scripts one more time (#55059)
* Better

* Update build.sh

I made it a little bit shorter. 
The main value here that you changed negative condition with positive one. That excludes the cases when some error occur in condition. Since some error during calculation a predicate does not mean that predicate is false logically. It means predicate is just failed. Bash is hard in distinguishing such cases.

* Update build.sh

---------

Co-authored-by: Sema Checherinda <104093494+CheSema@users.noreply.github.com>
2023-09-27 17:10:02 +02:00
kssenii
1f13e3ac92 Fix database replicated tests using the same paths for filesystem cache 2023-09-27 11:43:30 +02:00
Nikita Mikhaylov
f0b570d0c3
Fix pre-build scripts for old branches (#55032) 2023-09-26 21:59:51 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists
Implement `createIfNotExists` in Keeper natively
2023-09-26 16:04:51 +02:00
Nikita Mikhaylov
aff486dac1
Additional scripts for packager (#55000) 2023-09-26 15:59:57 +02:00
Antonio Andelic
ce583cb7fe Fix upgrade tests 2023-09-25 13:21:37 +00:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Antonio Andelic
3dbb6dcf4e Better 2023-09-22 13:47:28 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
16fc2739c6
Use xargs to parallel submodules 2023-09-20 19:09:06 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a review suggestions 2023-09-19 15:32:58 +00:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
eb3a7caa74 add zip to build docker 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
46fa7dbb80 add libFuzzer build on 'libFuzzer' label, build produces artifacts 2023-09-17 16:28:50 +00:00
Mikhail f. Shiryaev
850a6c99bf
Merge pull request #54675 from ClickHouse/disable-apk-packages
Do not build and upload apk packages, nobody uses them
2023-09-15 18:20:19 +02:00
Mikhail f. Shiryaev
c6e531ab27
Do not build and upload apk packages, nobody uses them 2023-09-15 16:48:45 +02:00