Commit Graph

116360 Commits

Author SHA1 Message Date
Alexey Milovidov
18817517ed
Merge pull request #50538 from ClickHouse/fix-generaterandom
Control memory usage in generateRandom
2023-06-05 02:50:24 +03:00
Alexey Milovidov
5072076082
Merge pull request #50495 from yerseg/remove_exception_handling_from_typeid_cast
Make typeid_cast for pointers noexcept
2023-06-05 02:40:40 +03:00
Denny Crane
136efd6825
Update datetime64.md 2023-06-04 18:58:24 -03:00
Alexey Gerasimchuk
9958731c27
Merge branch 'master' into ADQM-830 2023-06-05 07:46:47 +10:00
Denny Crane
045573e925
Update datetime64.md 2023-06-04 18:10:34 -03:00
Azat Khuzhin
bf127f4e1e MSan support for Rust
Previously you have to unpoison memory from the Rust, however Rust does
supports MSan, so let's simply use it.

But for this we need nightly Rust and recompile standard library.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 23:04:55 +02:00
Denny Crane
bcd89cbbf2
Update first_value.md 2023-06-04 17:38:38 -03:00
Denny Crane
fb21a6907a
Update last_value.md 2023-06-04 17:38:05 -03:00
Denny Crane
bd7a593dd3
Update first_value.md 2023-06-04 17:34:46 -03:00
Denny Crane
2e26e84909
Update last_value.md 2023-06-04 17:34:31 -03:00
Denny Crane
0d9728410f
Update first_value.md 2023-06-04 17:31:12 -03:00
Denny Crane
7ca719c73a
Update summap.md 2023-06-04 17:19:07 -03:00
Denny Crane
d93ee14e32
Update summap.md 2023-06-04 17:15:16 -03:00
Denny Crane
d81884be82
Update summap.md 2023-06-04 17:13:25 -03:00
Denny Crane
7c64b1f266
Update combinators.md 2023-06-04 16:32:22 -03:00
Denny Crane
424a043c32
Update map.md 2023-06-04 16:22:26 -03:00
Denny Crane
6fe0aa531e
Update summap.md 2023-06-04 16:18:53 -03:00
cmsxbc
4bb44c7c72
1. skip extract darwin toolchain in builder when uncessary
2. update MacOSX SDK version in toolchain readme to match in builder
2023-06-04 23:06:21 +08:00
alesapin
0f4dd26ceb Add async iteration to object storage 2023-06-04 16:03:44 +02:00
Sergey Kazmin
a3a1283467 remove try-catch from the impl of typeid_cast for refs 2023-06-04 16:22:58 +03:00
Sergey Kazmin
63eab2783e Make typeid_cast for pointers noexcept 2023-06-04 16:22:58 +03:00
robot-ch-test-poll
b8f9a57797
Merge pull request #50539 from ClickHouse/skim-msan
Disable skim (Rust library) under memory sanitizer
2023-06-04 15:03:14 +02:00
Maksim Kita
46cbdeeb7e Fixed tests 2023-06-04 15:02:46 +03:00
alesapin
4fd674a3b2
Merge pull request #50521 from ClickHouse/get_rid_of_strange_object_storage
Remove strange object storage methods
2023-06-04 12:09:09 +02:00
auxten
db806bd394
Resize underlying vector only pos_offset == vector.size() 2023-06-04 17:44:29 +08:00
Azat Khuzhin
60c2245da4 Make 01565_query_loop_after_client_error slightly more robust
CI founds one failure of this test [1], which is quite interesting, the
test itself should not takes too long:

    2023.06.04 05:01:36.889144 [ 42287 ] {} <Trace> DynamicQueryHandler: Request URI: /?query=SELECT+%27Running+test+stateless%2F01565_query_loop_after_client_error.expect+from+pid%3D1053%27&database=system&connect_timeout=30&receive_timeout=30&send_timeout=30&http_connection_timeout=30&http_receive_timeout=30&http_send_timeout=30&output_format_parallel_formatting=0
    ...
    2023.06.04 05:01:37.364595 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Debug> executeQuery: (from [::1]:40264) (comment: 01565_query_loop_after_client_error.expect) INSERT INTO t01565(c0, c1) VALUES  (stage: Complete)
    2023.06.04 05:01:37.366485 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Information> TCPHandler: Change cancellation status from NOT_CANCELLED to FULLY_CANCELLED. Log message: Received 'Cancel' packet from the client, canceling the query.
    2023.06.04 05:01:37.366810 [ 42844 ] {fa79939f-1fa0-4f3b-b599-fd2269122d6a} <Debug> TCPHandler: Processed in 0.002539914 sec.

But for the last INSERT the client itself works **very slow**, which
seems was the reason why "\r" had been sent too early and was never
interpreted:

    send: sending "INSERT INTO t01565(c0, c1) VALUES ('1', 1) ;\n" to { exp4 }

    expect: does " " (spawn_id exp4) match glob pattern "INSERT"? no
    I
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G" (spawn_id exp4) match glob pattern "INSERT"? no
    
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21G" (spawn_id exp4) match glob pattern "INSERT"? no
    INSERT INTO t
    expect: does " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21GINSERT INTO t\u001b[0m" (spawn_id exp4) match glob pattern "INSERT"? yes
    expect: set expect_out(0,string) "INSERT"
    expect: set expect_out(spawn_id) "exp4"
    expect: set expect_out(buffer) " \u001b[21GI\u001b[0m\u001b[J\u001b[22G\u001b[21GINSERT"
    send: sending "\r" to { exp4 }

    expect: does " INTO t\u001b[0m" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G" (spawn_id exp4) match glob pattern "Ok."? no
    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G\u001b[21G" (spawn_id exp4) match glob pattern "Ok."? no
    INSERT INTO t01565(c0, c1) VALUES ('1', 1) ;

    
    expect: does " INTO t\u001b[0m\u001b[J\u001b[34G\u001b[21G\u001b[JINSERT INTO t01565\u001b[0;22;33m(\u001b[0mc0\u001b[0;1m,\u001b[0m c1\u001b[0;22;33m)\u001b[0m VALUES \u001b[0;22;33m(\u001b[0;22;36m'1'\u001b[0;1m,\u001b[0m \u001b[0;22;32m1\u001b[0;22;33m)\u001b[0m \u001b[0;1m;\u001b[0m\r\n\r\n\u001b[0m\u001b[1G" (spawn_id exp4) match glob pattern "Ok."? no
    expect: timed out

Here you can see that it matched "INSERT" and then expect receive data
from the client almost byte by byte.

So I hope that expecting the last part of the query should fix the
problem.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/50429/228ebab86db95dca1e29967061d245985bc86a0f/stateless_tests__release__s3_storage__[2_2].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 11:37:48 +02:00
Alexey Milovidov
07a6e49941
Merge pull request #50527 from ClickHouse/fix-bad-code-rocksdb
Fix low quality code around metadata in RocksDB (experimental feature never used in production)
2023-06-04 06:48:19 +03:00
Alexey Milovidov
640b758ab0
Merge pull request #50533 from kssenii/add-some-metrics
Add profile events for fs cache eviction
2023-06-04 06:03:29 +03:00
Alexey Milovidov
53ec091c8d Disable skim (Rust library) under memory sanitizer 2023-06-04 05:00:29 +02:00
Alexey Milovidov
7ceedbd180 Update tests 2023-06-04 04:45:55 +02:00
Alexey Milovidov
c62558f982 Control memory usage in generateRandom 2023-06-04 04:44:51 +02:00
Alexey Milovidov
8c1091dc58
Merge branch 'master' into fix-secure-async-read-write 2023-06-04 05:06:59 +03:00
Alexey Milovidov
c84c0be1a7
Merge branch 'master' into try-fix-flaky-test 2023-06-04 05:06:40 +03:00
pufit
e548e4b38c
Merge pull request #50278 from ClickHouse/roles_in_config
Specify roles in users.xml
2023-06-03 21:10:26 -04:00
Alexey Milovidov
28862129a5
Merge pull request #50385 from marising/add_boost_link
Link boost::context library to clickhouse_common_io
2023-06-04 04:02:31 +03:00
Alexey Milovidov
6f01e2ad9f Fix incorrect constant folding 2023-06-04 02:49:45 +02:00
Nikolay Degterinsky
aa19b2fc40
Merge pull request #50044 from azat/optimize_use_projections-alias
Preserve backward incompatibility for renamed settings by using aliases
2023-06-04 02:33:38 +02:00
robot-ch-test-poll4
b1de1d3ada
Merge pull request #50535 from kitaisreal/query-node-small-fix
QueryNode small fix
2023-06-04 02:20:15 +02:00
alesapin
57070227a8 Fxi 2023-06-03 23:44:19 +02:00
kssenii
009fe3d25e Add profile events for eviction 2023-06-03 21:35:27 +02:00
Azat Khuzhin
69aec7af9b Add new metrics BrokenDistributedBytesToInsert/DistributedBytesToInsert
Useful to see at the server status overall.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-03 20:49:19 +02:00
Azat Khuzhin
0f37be5492 Fix description for BrokenDistributedFilesToInsert
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-03 20:49:19 +02:00
Maksim Kita
e61131c4bb QueryNode small fix 2023-06-03 21:45:53 +03:00
Maksim Kita
e28dfb7ea8 Updated tests 2023-06-03 21:44:31 +03:00
pufit
1aaac69e13
Merge branch 'master' into roles_in_config 2023-06-03 14:42:10 -04:00
Azat Khuzhin
13a1226971 Fix nested distributed SELECT in WITH clause
For the CSE (common scalar expression, form of CTE) form of WITH it will
set max_result_rows to 1, since there should not be more rows, but this
will be applied for the DESC TABLE as well (service distributed query
that required to obtain the structure).

Note, that it is a problem only for nested distributed queries because
getSubqueryContext() from InterpreterSelectQuery.cpp resets those limits
as well, but this does not helps, for the nested DESC since it is
executed on the remote node that has max_result_rows=1.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-03 20:22:51 +02:00
alesapin
894457d6e1 Style fxi 2023-06-03 14:36:52 +02:00
Maksim Kita
7a7e03a2ff Function if constant folding 2023-06-03 14:16:59 +03:00
Sergei Trifonov
f1eba08eaf
Merge pull request #50379 from alekar/minor-cgroup-improvements
Minor improvements in CGroup awareness.
2023-06-03 12:36:39 +02:00
Sema Checherinda
2177e562b8
Merge pull request #50518 from CheSema/lesser-traces
less traces in logs
2023-06-03 10:57:45 +02:00