Commit Graph

127566 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
28463cdcd3
Do not print --setup-plan to integration tests logs 2023-11-02 08:50:03 +01:00
Nikolay Degterinsky
0d6a0d04ae Do not remove parts if 'Too many open files' is thrown 2023-11-02 05:01:53 +00:00
jsc0218
f4690e63b9
Merge pull request #56229 from ClickHouse/fix/typo-in-readme
Fixes the tiniest typo in `README.md`
2023-11-01 21:49:28 -04:00
yokofly
46703bf7b9 Merge remote-tracking branch 'origin/master' into update-cross-compile-doc 2023-11-01 18:48:29 -07:00
yokofly
d2f9107889 clean blank 2023-11-01 18:47:56 -07:00
Johnny
dded427aad
Fixes the tiniest typo.
This PR wastes everybody's time by fixing the tiniest typo that literally no one is ever going to notice. I just really want my name in this releases' contributors list.
2023-11-01 20:56:00 -03:00
robot-ch-test-poll1
a5fb7b0a1e
Merge pull request #56213 from ttanay/sort-spill-to-disk-docs
Add `max_bytes_before_external_sort` setting to query complexity doc
2023-11-02 00:50:30 +01:00
Alexey Milovidov
697f2591b9 Merge with master 2023-11-02 00:33:33 +01:00
Alexey Milovidov
5dc02f0cce
Merge pull request #56128 from ClibMouse/HDFS_support
Changes to support the HDFS for s390x
2023-11-02 00:30:54 +01:00
robot-ch-test-poll2
96c0d5833e
Merge pull request #55044 from UnamedRus/optimizebitmap
add runOptimize call in bitmap write method( resubmit of #52842)
2023-11-02 00:30:34 +01:00
robot-ch-test-poll2
9039ff444a
Merge pull request #56224 from den-crane/patch-65
Doc. note how to enable OSIOWaitMicroseconds in new Linux kernels
2023-11-02 00:28:53 +01:00
Denny Crane
d145ddb293 fix asell 2023-11-02 00:01:42 +01:00
Igor Nikonov
823b62a55c
Merge pull request #56162 from ClickHouse/part-check-scheduling-monotonic-time
Use monotonic clock for part check scheduling
2023-11-01 23:15:27 +01:00
Igor Nikonov
8c768db8f5
Merge pull request #56123 from ClickHouse/fix-schedule-delayed-part-checks
Fix: schedule delayed part checks correctly
2023-11-01 23:07:24 +01:00
HarryLeeIBM
013e4b40c6 Add compression of posting lists for inverted index 2023-11-01 14:14:38 -07:00
Igor Nikonov
447386edd9
Merge branch 'master' into fix-schedule-delayed-part-checks 2023-11-01 21:26:06 +01:00
Tanay Tummalapalli
f1634bd7d9
Update docs/ru/operations/settings/query-complexity.md
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2023-11-02 01:51:26 +05:30
Denny Crane
71322bde3f
Update index.md 2023-11-01 17:07:27 -03:00
Alexander Sapin
abc1dfc203 Fix test 2023-11-01 20:38:09 +01:00
Kruglov Pavel
aa7c1f63ab
Merge pull request #56172 from Avogar/fix-schema-cache-for-json
Fix schema cache for fallback JSON->JSONEachRow with changed settings
2023-11-01 20:24:34 +01:00
Alexander Tokmakov
977380b171
Update DatabaseReplicated.cpp 2023-11-01 19:53:08 +01:00
Duc Canh Le
7d4c97e8f3
print broken part path before throw (#56181)
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-11-01 19:11:23 +01:00
Amos Bird
aea0c8dddc
Add wait_until_fully_merged. 2023-11-02 01:50:09 +08:00
Nikolai Kochetov
1f1453dba5
Merge pull request #53170 from ClickHouse/fix-row-policy-analyzer
Analyzer: fix row policy
2023-11-01 18:30:49 +01:00
Kruglov Pavel
754ab9fa6c
Merge pull request #55974 from Avogar/fix-protobuf-auto-schema
Fix autogenerated Protobuf schema with fields with underscore
2023-11-01 18:17:09 +01:00
Tanay Tummalapalli
6a3b2a04d8 Add max_bytes_before_external_sort setting to query complexity doc
The setting should be mentioned here along with
`max_bytes_before_external_group_by` setting.

Note: The russian translation is courtesy of Google Translate.
2023-11-01 22:33:25 +05:30
Dmitry Novik
f08634a0f6
Remove fixed test from the list 2023-11-01 17:56:53 +01:00
Kseniia Sumarokova
12d85ac697
Merge pull request #56194 from ClickHouse/add-sharing-for-cache-keys
Shard fs cache keys
2023-11-01 17:48:15 +01:00
Yakov Olkhovskiy
2ef10e82e6
Merge pull request #56185 from ClickHouse/fix-odbc-bridge-error-handler
Add error handler to odbc-bridge
2023-11-01 12:36:18 -04:00
robot-clickhouse
2a24d15204 Automatic style fix 2023-11-01 16:06:24 +00:00
Alexander Tokmakov
c01b848ef8
Merge pull request #56176 from ClickHouse/tavplubix-patch-9
Update 01414_mutations_and_errors_zookeeper.sh
2023-11-01 16:58:13 +01:00
Nikolai Kochetov
0f82706fb6 01786_explain_merge_tree 2023-11-01 15:54:47 +00:00
Alexander Sapin
1e0cab93f6 Satisfy tidy 2023-11-01 16:51:20 +01:00
Alexander Sapin
bfcd8b7de5 Better logging and tests 2023-11-01 16:50:02 +01:00
Nikolai Kochetov
817a4a6cab
Update analyzer_tech_debt.txt 2023-11-01 16:46:14 +01:00
Nikolai Kochetov
e7fc16ea1f
Merge branch 'master' into remove-skip-unused-shards-tests 2023-11-01 16:45:25 +01:00
robot-ch-test-poll2
6ab509a5c7
Merge pull request #56197 from ClickHouse/watches_small_fix
Do less work when there lots of read requests and watches for same paths
2023-11-01 16:12:32 +01:00
Kruglov Pavel
e6f00d5e1d
Merge pull request #56117 from bigo-sg/fixed_struct_field_prune
Improve parquet struct fields reading
2023-11-01 15:32:50 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978)
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-01 15:09:39 +01:00
Alexander Tokmakov
65f3cf81dc
Merge pull request #55987 from ClickHouse/fix_lost_part_count
Avoid counting lost parts twice
2023-11-01 15:07:27 +01:00
Dorota Szeremeta
a702240783
Fixed spelling of "Continous" to "Continuous" (#56143) 2023-11-01 14:58:03 +01:00
Nikolai Kochetov
82f0898cd9 Fix 01651_bugs_from_15889 2023-11-01 13:51:11 +00:00
Kruglov Pavel
08971270aa
Merge pull request #56135 from Avogar/fix-json-exception-in-http
Fix wrong query result when http_write_exception_in_output_format=1
2023-11-01 14:36:28 +01:00
Kruglov Pavel
5533258091
Merge pull request #55477 from Avogar/streaming-errors
Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines
2023-11-01 14:35:35 +01:00
Kruglov Pavel
bf77ce691c
Merge pull request #55982 from yariks5s/npy_input_format
New input format Npy
2023-11-01 14:26:22 +01:00
MeenaRenganathan22
568e5d98d1 Update the libhdfs3 submodule 2023-11-01 06:19:19 -07:00
vdimir
2ca1a14ac4
Merge pull request #55741 from ClickHouse/vdimir/fix_analyzer_materialized_distributed_join
Analyzer: fix block stucture mismatch in matview with engine distributed
2023-11-01 14:16:33 +01:00
Nikolai Kochetov
e72b902902 Remove skip_unused_shards tests from analyzer skiplist 2023-11-01 13:07:58 +00:00
yokofly
6927a2cadf [Docs] Update cross-compilation guide for OSX
This commit addresses two primary changes:
1. Sync the cross-compilation code for use in the CI action docker:
   - Use `--depth=1` during cloning to reduce clone times.
   - Update to a newer version of the macOS SDK.
see:
eb3a7caa74/docker/packager/binary/Dockerfile (L82)

2. Intro cross-compilation support for aarch64 OSX. The key change involves replacing the `x86_64` phase with `aarch64`, which is the current configuration we use.
2023-11-01 05:46:18 -07:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name
Implementing force_optimize_projection_name
2023-11-01 13:12:10 +01:00