Commit Graph

116317 Commits

Author SHA1 Message Date
Alexey Milovidov
d66962b864
Merge pull request #50252 from Avogar/fix-secure-async-read-write
Fix bugs in Poco sockets in non-blocking mode, use true non-blocking sockets
2023-06-05 06:44:22 +03:00
Alexey Milovidov
3617a14467
Merge pull request #50215 from arenadata/ADQM-830
Added --input_format_csv_trim_whitespaces option
2023-06-05 06:06:45 +03:00
Alexey Milovidov
4b1bb75a07
Merge pull request #50383 from bigo-sg/grace_hash_join_mismatch_right_block
Without applying `prepareRightBlock` will cause mismatch block structrue
2023-06-05 05:57:16 +03:00
Alexey Milovidov
881bdbf839
Merge pull request #50153 from amosbird/fix_44504
Fix invalid index analysis for date related keys
2023-06-05 05:00:20 +03:00
Alexey Milovidov
5fc8838b04
Update KeyCondition.cpp 2023-06-05 04:58:29 +03:00
Alexey Milovidov
f118cba17e
Merge pull request #50238 from azat/dist-pending-bytes
Add new metrics BrokenDistributedBytesToInsert/DistributedBytesToInsert
2023-06-05 04:50:42 +03:00
Alexey Milovidov
3b8c781b2c
Merge pull request #50448 from ClickHouse/rm_parts_from_zk_paranoid
Paranoid fix for removing parts from ZooKeeper
2023-06-05 04:42:15 +03:00
Alexey Milovidov
4bd39318c7
Merge pull request #50455 from ClickHouse/nulllogger
Don't crash if config doesn't have logger section
2023-06-05 04:41:34 +03:00
Alexey Milovidov
af1c025496
Merge pull request #50480 from Avogar/try-fix-flaky-test
Try fix flaky test test_async_query_sending
2023-06-05 04:40:17 +03:00
Alexey Milovidov
bed19aa792
Merge pull request #50483 from ClickHouse/fix-keeper-snapshot-install
Keeper fix: apply uncommitted state after snapshot install
2023-06-05 04:39:33 +03:00
Alexey Milovidov
112826a666
Merge pull request #50485 from ClickHouse/remove-keeper-test
Remove unneeded Keeper test
2023-06-05 04:37:03 +03:00
Alexey Milovidov
312fa7e637
Merge pull request #50491 from DanRoscigno/docs-parallel_view_processing
add docs for parallel view processing
2023-06-05 04:36:33 +03:00
Alexey Milovidov
091d6d02f7
Merge pull request #50536 from ClickHouse/fix-incorrect-constant-folding
Fix incorrect constant folding
2023-06-05 04:35:53 +03:00
Alexey Milovidov
6241ea3514
Merge pull request #50542 from azat/tests/fix-expect
Make 01565_query_loop_after_client_error slightly more robust
2023-06-05 04:03:15 +03:00
Alexey Milovidov
5048f24755
Merge pull request #50541 from azat/rust-msan
MSan support for Rust
2023-06-05 04:00:37 +03:00
robot-clickhouse-ci-1
21e3b6df57
Merge pull request #50556 from den-crane/patch-49
Doc. A note for first_value/last_value
2023-06-05 02:59:20 +02:00
robot-clickhouse
a27de9a054
Merge pull request #50555 from den-crane/patch-31
Doc. Example for -Map combinator
2023-06-05 02:59:15 +02:00
Alexey Milovidov
4a8edf1dcf
Merge pull request #50557 from den-crane/patch-50
Doc. Fix links datetime64.md
2023-06-05 03:56:35 +03:00
Alexey Milovidov
18817517ed
Merge pull request #50538 from ClickHouse/fix-generaterandom
Control memory usage in generateRandom
2023-06-05 02:50:24 +03:00
Alexey Milovidov
5072076082
Merge pull request #50495 from yerseg/remove_exception_handling_from_typeid_cast
Make typeid_cast for pointers noexcept
2023-06-05 02:40:40 +03:00
Denny Crane
136efd6825
Update datetime64.md 2023-06-04 18:58:24 -03:00
Alexey Gerasimchuk
9958731c27
Merge branch 'master' into ADQM-830 2023-06-05 07:46:47 +10:00
Denny Crane
045573e925
Update datetime64.md 2023-06-04 18:10:34 -03:00
Azat Khuzhin
bf127f4e1e MSan support for Rust
Previously you have to unpoison memory from the Rust, however Rust does
supports MSan, so let's simply use it.

But for this we need nightly Rust and recompile standard library.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 23:04:55 +02:00
Denny Crane
bcd89cbbf2
Update first_value.md 2023-06-04 17:38:38 -03:00
Denny Crane
fb21a6907a
Update last_value.md 2023-06-04 17:38:05 -03:00
Denny Crane
bd7a593dd3
Update first_value.md 2023-06-04 17:34:46 -03:00
Denny Crane
2e26e84909
Update last_value.md 2023-06-04 17:34:31 -03:00
Denny Crane
0d9728410f
Update first_value.md 2023-06-04 17:31:12 -03:00
Denny Crane
7ca719c73a
Update summap.md 2023-06-04 17:19:07 -03:00
Denny Crane
d93ee14e32
Update summap.md 2023-06-04 17:15:16 -03:00
Denny Crane
d81884be82
Update summap.md 2023-06-04 17:13:25 -03:00
Denny Crane
7c64b1f266
Update combinators.md 2023-06-04 16:32:22 -03:00
Denny Crane
424a043c32
Update map.md 2023-06-04 16:22:26 -03:00
Denny Crane
6fe0aa531e
Update summap.md 2023-06-04 16:18:53 -03:00
Sergey Kazmin
a3a1283467 remove try-catch from the impl of typeid_cast for refs 2023-06-04 16:22:58 +03:00
Sergey Kazmin
63eab2783e Make typeid_cast for pointers noexcept 2023-06-04 16:22:58 +03:00
robot-ch-test-poll
b8f9a57797
Merge pull request #50539 from ClickHouse/skim-msan
Disable skim (Rust library) under memory sanitizer
2023-06-04 15:03:14 +02:00
alesapin
4fd674a3b2
Merge pull request #50521 from ClickHouse/get_rid_of_strange_object_storage
Remove strange object storage methods
2023-06-04 12:09:09 +02:00
Azat Khuzhin
60c2245da4 Make 01565_query_loop_after_client_error slightly more robust
CI founds one failure of this test [1], which is quite interesting, the
test itself should not takes too long:

    2023.06.04 05:01:36.889144 [ 42287 ] {} <Trace> DynamicQueryHandler: Request URI: /?query=SELECT+%27Running+test+stateless%2F01565_query_loop_after_client_error.expect+from+pid%3D1053%27&database=system&connect_timeout=30&receive_timeout=30&send_timeout=30&http_connection_timeout=30&http_receive_timeout=30&http_send_timeout=30&output_format_parallel_formatting=0
    ...
    2023.06.04 05:01:37.364595 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Debug> executeQuery: (from [::1]:40264) (comment: 01565_query_loop_after_client_error.expect) INSERT INTO t01565(c0, c1) VALUES  (stage: Complete)
    2023.06.04 05:01:37.366485 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Information> TCPHandler: Change cancellation status from NOT_CANCELLED to FULLY_CANCELLED. Log message: Received 'Cancel' packet from the client, canceling the query.
    2023.06.04 05:01:37.366810 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Debug> TCPHandler: Processed in 0.002539914 sec.

But for the last INSERT the client itself works **very slow**, which
seems was the reason why "\r" had been sent too early and was never
interpreted:

    send: sending "INSERT INTO t01565(c0, c1) VALUES ('1', 1) ;\n" to { exp4 }

    expect: does " " (spawn_id exp4) match glob pattern "INSERT"? no
    I
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G" (spawn_id exp4) match glob pattern "INSERT"? no
    
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21G" (spawn_id exp4) match glob pattern "INSERT"? no
    INSERT INTO t
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21GINSERT INTO t\u001b[0m" (spawn_id exp4) match glob pattern "INSERT"? yes
    expect: set expect_out(0,string) "INSERT"
    expect: set expect_out(spawn_id) "exp4"
    expect: set expect_out(buffer) " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21GINSERT"
    send: sending "\r" to { exp4 }

    expect: does " INTO t\u001b[0m" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G\u001b[21G" (spawn_id exp4) match glob pattern "Ok."? no
    INSERT INTO t01565(c0, c1) VALUES ('1', 1) ;

    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G\u001b[21G\u001b[JINSERT INTO t01565\u001b[0;22;33m(\u001b[0mc0\u001b[0;1m,\u001b[0m c1\u001b[0;22;33m)\u001b[0m VALUES \u001b[0;22;33m(\u001b[0;22;36m'1'\u001b[0;1m,\u001b[0m \u001b[0;22;32m1\u001b[0;22;33m)\u001b[0m \u001b[0;1m;\u001b[0m\r\n\r\n\u001b[0m\u001b[1G" (spawn_id exp4) match glob pattern "Ok."? no
    expect: timed out

Here you can see that it matched "INSERT" and then expect receive data
from the client almost byte by byte.

So I hope that expecting the last part of the query should fix the
problem.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/50429/228ebab86db95dca1e29967061d245985bc86a0f/stateless_tests__release__s3_storage__[2_2].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 11:37:48 +02:00
Alexey Milovidov
07a6e49941
Merge pull request #50527 from ClickHouse/fix-bad-code-rocksdb
Fix low quality code around metadata in RocksDB (experimental feature never used in production)
2023-06-04 06:48:19 +03:00
Alexey Milovidov
640b758ab0
Merge pull request #50533 from kssenii/add-some-metrics
Add profile events for fs cache eviction
2023-06-04 06:03:29 +03:00
Alexey Milovidov
53ec091c8d Disable skim (Rust library) under memory sanitizer 2023-06-04 05:00:29 +02:00
Alexey Milovidov
7ceedbd180 Update tests 2023-06-04 04:45:55 +02:00
Alexey Milovidov
c62558f982 Control memory usage in generateRandom 2023-06-04 04:44:51 +02:00
Alexey Milovidov
8c1091dc58
Merge branch 'master' into fix-secure-async-read-write 2023-06-04 05:06:59 +03:00
Alexey Milovidov
c84c0be1a7
Merge branch 'master' into try-fix-flaky-test 2023-06-04 05:06:40 +03:00
pufit
e548e4b38c
Merge pull request #50278 from ClickHouse/roles_in_config
Specify roles in users.xml
2023-06-03 21:10:26 -04:00
Alexey Milovidov
28862129a5
Merge pull request #50385 from marising/add_boost_link
Link boost::context library to clickhouse_common_io
2023-06-04 04:02:31 +03:00
Alexey Milovidov
6f01e2ad9f Fix incorrect constant folding 2023-06-04 02:49:45 +02:00