Commit Graph

127508 Commits

Author SHA1 Message Date
Nikolai Kochetov
e7fc16ea1f
Merge branch 'master' into remove-skip-unused-shards-tests 2023-11-01 16:45:25 +01:00
robot-ch-test-poll2
6ab509a5c7
Merge pull request #56197 from ClickHouse/watches_small_fix
Do less work when there lots of read requests and watches for same paths
2023-11-01 16:12:32 +01:00
Kruglov Pavel
e6f00d5e1d
Merge pull request #56117 from bigo-sg/fixed_struct_field_prune
Improve parquet struct fields reading
2023-11-01 15:32:50 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Alexander Tokmakov
65f3cf81dc
Merge pull request #55987 from ClickHouse/fix_lost_part_count
Avoid counting lost parts twice
2023-11-01 15:07:27 +01:00
Dorota Szeremeta
a702240783
Fixed spelling of "Continous" to "Continuous" (#56143) 2023-11-01 14:58:03 +01:00
Nikolai Kochetov
82f0898cd9 Fix 01651_bugs_from_15889 2023-11-01 13:51:11 +00:00
Kruglov Pavel
08971270aa
Merge pull request #56135 from Avogar/fix-json-exception-in-http
Fix wrong query result when http_write_exception_in_output_format=1
2023-11-01 14:36:28 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
MeenaRenganathan22
568e5d98d1 Update the libhdfs3 submodule 2023-11-01 06:19:19 -07:00
vdimir
2ca1a14ac4
Merge pull request #55741 from ClickHouse/vdimir/fix_analyzer_materialized_distributed_join
Analyzer: fix block stucture mismatch in matview with engine distributed
2023-11-01 14:16:33 +01:00
Nikolai Kochetov
e72b902902 Remove skip_unused_shards tests from analyzer skiplist 2023-11-01 13:07:58 +00:00
yokofly
6927a2cadf [Docs] Update cross-compilation guide for OSX
This commit addresses two primary changes:
1. Sync the cross-compilation code for use in the CI action docker:
   - Use `--depth=1` during cloning to reduce clone times.
   - Update to a newer version of the macOS SDK.
see:
eb3a7caa74/docker/packager/binary/Dockerfile (L82)

2. Intro cross-compilation support for aarch64 OSX. The key change involves replacing the `x86_64` phase with `aarch64`, which is the current configuration we use.
2023-11-01 05:46:18 -07:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00
Alexander Gololobov
78b9da692c Do less work when there a lots of watches 2023-11-01 12:27:10 +01:00
kssenii
f51f6d1357 Shard cache keys 2023-11-01 11:31:49 +01:00
vdimir
b0f6b18f6e
Merge pull request #56125 from bezik/patch-10
Update tutorial.md [en→ru]
2023-11-01 10:59:27 +01:00
Kseniia Sumarokova
7740fdf052
Merge pull request #56165 from ClickHouse/more-profile-events-for-cache
More metrics for fs cache
2023-11-01 10:46:00 +01:00
Kseniia Sumarokova
e8a3478a12
Merge pull request #56168 from ClickHouse/fs-cache-minor-refactoring
FileCache minor changes
2023-11-01 10:10:13 +01:00
lgbo-ustc
8334585eaf improve parquet struct field reading 2023-11-01 15:18:39 +08:00
Yakov Olkhovskiy
0c1849656a
add error handler 2023-11-01 01:18:08 -04:00
kothiga
849a515c08
Fixed style. 2023-10-31 19:02:49 -07:00
jsc0218
f1c7665feb
Merge pull request #56121 from lithiumlabcompany/fix-auto-configuration-queue-for-librdkafka
Correctly set queued.min.messages
2023-10-31 19:59:04 -04:00
Nikolay Degterinsky
cd779d4f50
Merge pull request #55856 from ClickHouse/rewrite-delete-docs
Rewrite DELETE docs
2023-11-01 00:10:01 +01:00
Nikolay Degterinsky
7738f3aecb
Update aspell-dict.txt 2023-10-31 23:29:27 +01:00
Michael Kolupaev
9c79c165b9
Re-fix 'Block structure mismatch' on concurrent ALTER and INSERTs in Buffer table (#56140)
* Fix 'Block structure mismatch' on concurrent ALTER and INSERTs in Buffer table

* Fix the test
2023-10-31 13:41:54 -07:00
kothiga
f570b85e25
Disambiguate crc32 from crc32c for s390x impl. 2023-10-31 11:21:37 -07:00
kothiga
0411f04dd3
Correct the Big Endian state serialization/deserialization for various aggregate functions. 2023-10-31 11:21:37 -07:00
Kseniia Sumarokova
7f71c8f07c
Fix build 2023-10-31 19:21:06 +01:00
yariks5s
6c4bf59021 fix suggestions and enhance tests 2023-10-31 18:10:55 +00:00
Alexander Tokmakov
c4c5defc37
Update 01414_mutations_and_errors_zookeeper.sh 2023-10-31 17:15:49 +01:00
Nikolai Kochetov
03843d4af0 Fix stupid bug 2023-10-31 16:07:10 +00:00
kssenii
30db41e053 Review fixes 2023-10-31 17:01:55 +01:00
Justin de Guzman
a011990fd7
Add clangd recommendation for VS Code (#56071)
* Add clangd recommendation for VS Code

* Edit docs for clarity and add links

* Adds new words to dictionary. Sorts dictionary.

---------

Co-authored-by: johnnymatthews <9611008+johnnymatthews@users.noreply.github.com>
2023-10-31 16:35:47 +01:00
Amos Bird
c75cd615c3
Fix flaky test of jbod balancer. 2023-10-31 23:03:55 +08:00
Robert Schulze
13b2946ae2
Merge pull request #55960 from rschu1ze/adddate-stringargs
Support string-encoded date arguments in `addDate()`
2023-10-31 15:37:34 +01:00
avogar
518e52473d Fix schema cache for fallback JSON->JSONEachRow with changed settings 2023-10-31 14:12:38 +00:00
Mikhail f. Shiryaev
b93bf06e86
Merge pull request #56160 from ClickHouse/fast_test_timeout
Fasttest timeout setting
2023-10-31 14:57:06 +01:00
Nikolai Kochetov
e885ea9257 Fix building sets. 2023-10-31 13:30:35 +00:00
Alexander Tokmakov
f39f0c6a74
Merge pull request #56083 from ClickHouse/fix_drop_range_commit_existing_part_race
Fix race condition between DROP_RANGE and committing existing block
2023-10-31 14:24:53 +01:00
yariks5s
8a2f95629f fixed suggestions 2023-10-31 13:16:02 +00:00
Alexander Tokmakov
4d437ca462
Merge pull request #56137 from ClickHouse/fix_unexpected_parts_handling
Do not try to activate covered parts when handilng unexpected parts
2023-10-31 14:00:47 +01:00
kssenii
eed15e5344 Get rid of public inheritance 2023-10-31 13:45:34 +01:00
AN
004593f808
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:39:54 +03:00
AN
5b834f31a6
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:39:03 +03:00
AN
5c1b9dc51b
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:27:11 +03:00
AN
5f390966c1
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:14:43 +03:00
AN
c2d2123af0
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:14:24 +03:00
AN
c518494f00
Update docs/ru/getting-started/tutorial.md
Co-authored-by: vdimir <vdimir@clickhouse.com>
2023-10-31 15:13:54 +03:00