Commit Graph

126812 Commits

Author SHA1 Message Date
Kruglov Pavel
6f61ccfe28
Merge branch 'master' into schema-inference-union 2023-10-20 22:54:11 +02:00
avogar
6934e27e8b Add union mode for schema inference to infer union schema of files with different schemas 2023-10-20 20:46:41 +00:00
Alexander Tokmakov
f899254e2c
Merge pull request #55430 from arthurpassos/properly_split_remote_proxy_http_https
Properly split remote proxy http https
2023-10-20 21:15:34 +02:00
Alexander Tokmakov
8c7973d655 trigger CI 2023-10-20 21:10:11 +02:00
Aleksei Filatov
0a1f3f205c
Add external HTTP Basic authenticator (#55199) 2023-10-20 19:24:19 +02:00
Alexey Milovidov
14c2900185
Merge pull request #55853 from ClickHouse/local-allow-drop-current-database
Allow querying inside a dropped database in clickhouse-local
2023-10-20 19:04:54 +02:00
Anton Popov
5819bcd07a
Support asynchronous inserts for native protocol (#54730)
* support async insert for native protocol

* use separate queue for async inserts via native protocol

* fix test

* better logging for async inserts and more tests

* disable mixed internal and external data in async inserts

* fix tests

* fix quota in async inserts

* disable async insert for secondary query of distributed
2023-10-20 18:39:48 +02:00
Mikhail f. Shiryaev
6a37546a6f
Merge pull request #55874 from ClickHouse/universal-diff-urls
One final leftover in diff_urls of PRInfo
2023-10-20 17:49:14 +02:00
Mikhail f. Shiryaev
849e44138a
One final leftover in diff_urls of PRInfo 2023-10-20 17:19:46 +02:00
Raúl Marín
d08ce13107
Merge pull request #51692 from Algunenano/parallel_replicas_row_estimation
Automatic decision of nº of parallel replicas
2023-10-20 15:50:43 +02:00
SmitaRKulkarni
4dcba9d97b
Merge pull request #54738 from ClickHouse/Fix_azure_test_by_using_unique_names
Fix azure test by using unique names
2023-10-20 15:04:01 +02:00
Raúl Marín
07e3f10958
Merge pull request #55860 from jrdi/filesystem-cache-docs
Add load_metadata_threads to the documentation
2023-10-20 14:59:47 +02:00
Robert Schulze
15a3a12ad9
Merge pull request #55835 from rschu1ze/checks-for-55401
Add diagnostic checks for issue #55041
2023-10-20 14:22:38 +02:00
Alexander Tokmakov
a0f14b6331
Merge pull request #55844 from ClickHouse/update_00002
Fix 00002_log_and_exception_messages_formatting
2023-10-20 13:37:33 +02:00
Sema Checherinda
6feac7bab7
Merge pull request #55850 from CheSema/fix_test
fix node setting in the test
2023-10-20 12:47:43 +02:00
helifu
57d60dc4f2
Add a new column xid for zookeeper_connection (#50702)
* Refactor the code

* Add a new column xid for zookeeper_connection

* Support hostnames in the configuration

* Fix a typo

* Fix a typo

* Fix a typo

* Fix a bug about connect_time

* Update test case

* Update test case

* Fix a special build check error

* Resolve conflicts caused by rebase.

* Update failed test case

* Refactor the code according to comment

* Fix two compilation errors
2023-10-20 11:38:44 +02:00
Antonio Andelic
4724c84dac
Merge pull request #55786 from azat/set-data-race
Fix data race in CreatingSetsTransform (v2)
2023-10-20 10:02:10 +02:00
Jordi Villar
01093d4698 Remove deprecated setting do_not_evict_index_and_mark_files 2023-10-20 09:27:46 +02:00
Jordi Villar
fe1df969a7 Add load_metadata_threads to the documentation 2023-10-20 09:04:39 +02:00
Alexey Milovidov
c6e998290d Allow querying inside a dropped database in clickhouse-local 2023-10-20 05:14:09 +02:00
Alexey Milovidov
5d1cc1425a
Merge pull request #55813 from Algunenano/test_dictionaries_redis
Attemp to fix test_dictionaries_redis flakiness
2023-10-20 03:43:38 +02:00
Alexey Milovidov
264df85eb8
Merge pull request #55848 from ClickHouse/auto/v23.9.2.56-stable
Update version_date.tsv and changelogs after v23.9.2.56-stable
2023-10-20 03:38:47 +02:00
Sema Checherinda
194eca91f8 fix node setting in the test 2023-10-20 00:35:35 +02:00
Robert Schulze
71faa8b198
Improve checks 2023-10-19 22:16:17 +00:00
Mikhail f. Shiryaev
8974b63d27
Merge pull request #55849 from ClickHouse/auto/v23.8.4.69-lts
Update version_date.tsv and changelogs after v23.8.4.69-lts
2023-10-19 21:06:27 +02:00
robot-clickhouse
66030152b0 Update version_date.tsv and changelogs after v23.8.4.69-lts 2023-10-19 18:38:56 +00:00
robot-clickhouse
21d3c51cde Update version_date.tsv and changelogs after v23.9.2.56-stable 2023-10-19 18:38:32 +00:00
Mikhail f. Shiryaev
141aeec203
Merge pull request #55847 from ClickHouse/auto/v23.3.14.78-lts
Update version_date.tsv and changelogs after v23.3.14.78-lts
2023-10-19 20:23:51 +02:00
robot-clickhouse
84f2d46642 Update version_date.tsv and changelogs after v23.3.14.78-lts 2023-10-19 18:18:34 +00:00
Robert Schulze
48cff2fcec
Add diagnostic checks for issue 55041 2023-10-19 18:04:49 +00:00
Mikhail f. Shiryaev
7878204828
Merge pull request #55845 from ClickHouse/changelog-fix
Fix caching objects in pygithub, and changelogs
2023-10-19 20:04:13 +02:00
Mikhail f. Shiryaev
fb5bc09535
Fix caching objects in pygithub, and changelogs 2023-10-19 19:45:16 +02:00
Alexander Tokmakov
30ae14b67f update the list of short messages 2023-10-19 19:43:39 +02:00
Raúl Marín
a4f5e9e045 Improvements based on PR review 2023-10-19 15:36:48 +00:00
Raúl Marín
4a53943926 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-19 15:20:50 +00:00
Kruglov Pavel
85e3c31f14
Merge pull request #55769 from AVMusorin/capn-proto-drop-cache
Added test to check CapnProto cache
2023-10-19 15:59:46 +02:00
Han Fei
448e178528
Merge pull request #55732 from canhld94/rocks_db_serialization
Do not re-create serialization for each row during rocksdb sinking
2023-10-19 15:54:50 +02:00
Robert Schulze
b476e5b444
Merge pull request #55811 from rschu1ze/bump-grpc-to-1.36.4
Bump gRPC to v1.36.4
2023-10-19 15:00:37 +02:00
Sema Checherinda
835d2dfcd6
Merge pull request #54770 from CheSema/increase-s3-retries-count
increase s3_retry_attempts
2023-10-19 14:17:56 +02:00
Raúl Marín
3873a935f4
Merge pull request #55739 from Algunenano/use_default_format_on_http_exception
Respect default format when using http_write_exception_in_output_format
2023-10-19 13:47:36 +02:00
Mikhail f. Shiryaev
170925cb3c
Merge pull request #55793 from ClickHouse/improve-enrich-image
Improve enrich image
2023-10-19 12:31:32 +02:00
Azat Khuzhin
d5c960ceb6 Fix data race in CreatingSetsTransform
The problem is that findOrPromiseToBuild() can also call
shared_future::get():

    (lldb) bt 10
    * thread 194, name = 'MergeMutate', stop reason = step over
      * frame 0: 0x0000564126046bd2 clickhouse`std::rethrow_exception(p=(__ptr_ = 0x00007b5000130c80)) at exception_pointer_cxxabi.ipp:68:39
        frame 1: 0x000056411c4c5ddd clickhouse`std::__1::__assoc_state<std::__1::shared_ptr<DB::Set>>::copy(this=<unavailable>) at future:701:9
        frame 2: 0x000056411c4c0e3f clickhouse`DB::PreparedSetsCache::findOrPromiseToBuild(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) [inlined] std::__1::shared_future<std::__1::shared_ptr<DB::Set>>::get[abi:v15000](this=0x00007b0c00154eb8) const at future:2243:46
        frame 3: 0x000056411c4c0e2e clickhouse`DB::PreparedSetsCache::findOrPromiseToBuild(this=0x00007b1c00077018, key="__set_10438532338982543705_15680061365857338647") at PreparedSets.cpp:349:116

Note, that my test did not find the problem because of #55261 had not
been merged yet.

Follow-up for: #55338
Fixes: #55279
v2: s/createDeprecated/createRuntime/

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-19 12:26:02 +02:00
Raúl Marín
297eda83fc Attemp to fix test_dictionaries_redis flakiness 2023-10-19 11:59:13 +02:00
Mikhail f. Shiryaev
d8b899d22b
Use a proper tag from default.checks for enriched images 2023-10-19 11:35:35 +02:00
Mikhail f. Shiryaev
d957d60a52
Use publicly available play.clickhouse.com to search built images 2023-10-19 11:35:10 +02:00
Robert Schulze
f18622b48b
Bump gRPC to 1v.36.4 2023-10-19 09:12:14 +00:00
Antonio Andelic
111c658385
Merge pull request #55718 from aalexfvk/use_pool_for_proxified_s3_sessions
Use pool for proxied S3 disk http sessions
2023-10-19 09:22:13 +02:00
Aleksandr Musorin
9a155ba747 Added test to check CapnProto cache
Since current getting schema for CapnProto doesn't use cache, the
integration test was for the future if someone add cache.

Also, I was curious how schema cache affects performance and I compared reading binary files
with Protobuf (I guess it works the same for CapnProto).

```
for i in {1..1000}; do clickhouse-client -q \
  "select * from test.simple format Protobuf settings format_schema='/format_schemas/simple:KeyValuePair'" > simple-protobuf${i}.bin; done

clickhouse-client --time -q "select * from file('simple-protobuf{1..999}.bin', 'Protobuf') format Null settings format_schema = 'simple:KeyValuePair'"
```

Protobuf with cache and without works with approximately the same
time.
2023-10-19 09:00:39 +02:00
Duc Canh Le
d8f73e7240 Merge branch 'master' into rocks_db_serialization
Fix a mysterious style check fail
2023-10-19 06:26:16 +00:00
Michael Kolupaev
70711b0898
Remove temporary debug logging in MultiplexedConnections (#55764) 2023-10-18 23:05:03 -07:00