Commit Graph

115694 Commits

Author SHA1 Message Date
Azat Khuzhin
66cf16410d Preserve initial_query_id for ON CLUSTER queries
v2: add proper escaping
v3: set distributed_ddl_output_mode=none for test to fix replicated database build
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-21 23:04:54 +02:00
Azat Khuzhin
b6cc504717 Remove Common/OpenTelemetryTraceContext.h from Context.h
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-21 23:04:33 +02:00
Azat Khuzhin
0586a27432 Charge only server memory for dictionaries
Right now the memory will be counted for query/user for dictionary, but
only if it load by user (via SYSTEM RELOAD QUERY or via dictGet()), but
it could be also loaded in backgrounad (due to lifetime, or
update_field, so it is like Buffer, only server memory should be
charged.

v2: mark test as long
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Co-authored-by: Sergei Trifonov <svtrifonov@gmail.com>
2023-05-21 22:53:52 +02:00
serxa
372601d6df fix 2023-05-21 17:04:49 +00:00
serxa
cd11c25864 fix test + more testing for dynamic prioritization 2023-05-21 17:04:00 +00:00
serxa
c5765e71f9 requeue jobs w/o allocations and spawn workers during prioritization 2023-05-21 17:02:56 +00:00
Amos Bird
8a40a48a49
Fix python format 2023-05-22 00:44:17 +08:00
Alexander Tokmakov
8102fe3e21
Merge pull request #50047 from azat/tests/fix-02735_system_zookeeper_connection
Fix 02735_system_zookeeper_connection for DatabaseReplicated
2023-05-21 19:01:43 +03:00
Sergei Trifonov
e33455ed87
Merge branch 'master' into async-loader-workloads 2023-05-21 16:30:58 +02:00
serxa
128b8e5889 fix tests + add test for dynamic pools 2023-05-21 14:28:16 +00:00
Robert Schulze
2a9ff30a7f
Merge pull request #49380 from azat/dict/hashed-memory
Improve memory usage and speed of SPARSE_HASHED/HASHED dictionaries
2023-05-21 15:46:41 +02:00
Robert Schulze
491cf8b6e1
Fix minor mistakes 2023-05-21 13:43:05 +00:00
Robert Schulze
9d9d4e3d62
Some fixups 2023-05-21 13:40:52 +00:00
Robert Schulze
312f751503
Uppercase remaining SQL keywords 2023-05-21 13:08:55 +00:00
Amos Bird
0a3d986e42
Fix reporting projection broken part 2023-05-21 20:58:58 +08:00
serxa
44b1754ccf more profile events 2023-05-21 12:43:47 +00:00
robot-ch-test-poll3
0df785f8ba
Merge pull request #50049 from magurotuna/fix-broken-link
Fix broken link to async_insert_deduplicate in doc
2023-05-21 14:36:50 +02:00
serxa
c56e6a8b80 Add more profile events for distributconnections 2023-05-21 12:15:06 +00:00
Sergei Trifonov
3c002755e2
Merge pull request #50036 from ClickHouse/fix-load-balancing
Load balancing bugfixes
2023-05-21 11:21:55 +02:00
Yusuke Tanaka
2444e93ad7
Fix broken link to async_insert_deduplicate in doc 2023-05-21 14:42:17 +09:00
Azat Khuzhin
a9e834aea4 Fix 02735_system_zookeeper_connection for DatabaseReplicated
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-20 16:04:15 +02:00
kssenii
8924c17575 Fix build 2023-05-20 13:31:27 +02:00
vdimir
8b77e2096c
Merge pull request #49760 from arthurpassos/extract_kv_ignore_kv_delimiter_when_reading_value 2023-05-20 13:27:59 +02:00
Azat Khuzhin
82054d40a5 Add proper escaping for DDL OpenTelemetry context serialization
Before you was able to break the format by using "\n" or "\t", that will
simply lead to DDL hang, because DDLWorker will simply log the error and
do nothing more:

    <Error> DDLWorker: Cannot parse DDL task query-0000000056: Incorrect task format. Will try to send error status: Code: 27. DB::ParsingException: Cannot parse input: expected '\n' before: 'bar\n1\n'. (CANNOT_PARSE_INPUT_ASSERTION_FAILED) (version 23.5.1.1)

Fix this by adding proper escaping.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-20 13:15:49 +02:00
Azat Khuzhin
cd5413a12d Refactor test 02423_ddl_for_opentelemetry to use clickhouse-client
This will allow to add new line into tracestate to check the format
breakage

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-20 13:14:43 +02:00
Azat Khuzhin
52c5fd5cb9 Rewrite OpenTelemetry context serialization for DDL without IO/Operators.h
This is required to switch to escaped versions.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-20 13:14:40 +02:00
Kseniia Sumarokova
a0480daef3
Update waitServersToFinish.h 2023-05-20 12:43:24 +02:00
Igor Nikonov
fbcbd3ab90
Merge pull request #49846 from ClickHouse/clearable_hash_set_without_zero_storage
Clearable hash table and zero values
2023-05-20 11:19:44 +02:00
Igor Nikonov
148742ccd4
Merge pull request #49943 from ClickHouse/test-sorting-stream-properties-analyzer
Fix for analyzer: 02377_ optimize_sorting_by_input_stream_properties_e…
2023-05-20 11:14:44 +02:00
Alexey Milovidov
4e3188126f
Merge pull request #49050 from FFFFFFFHHHHHHH/dot_product
Add Function dotProduct for array
2023-05-20 03:07:13 +03:00
Alexey Milovidov
2c8c412835
Merge pull request #50013 from ClickHouse/mysql-compatibility-setting
Allow some settings for MySQL compatibility
2023-05-20 02:04:02 +03:00
Alexey Milovidov
2323542e47
Merge pull request #50022 from ClickHouse/geo-types-production-ready
Geo types are production ready
2023-05-20 02:02:23 +03:00
Alexey Milovidov
54f7b8e6ab
Merge pull request #50030 from kssenii/aws-client-save-provider
Add method getCredentials() to S3::Client
2023-05-20 01:59:58 +03:00
Alexey Milovidov
bd2f47591a
Merge pull request #49863 from alekar/fix-osx-setsockopt-errors
Fix error on OS X regarding resetting timeouts.
2023-05-20 01:55:41 +03:00
Dan Roscigno
d509d7277b
Merge pull request #50038 from ClickHouse/DanRoscigno-patch-5
Update grant.md
2023-05-19 17:40:47 -04:00
Igor Nikonov
c68a25a112
Merge branch 'master' into test-sorting-stream-properties-analyzer 2023-05-19 23:37:12 +02:00
Igor Nikonov
af80e29519
Merge branch 'master' into clearable_hash_set_without_zero_storage 2023-05-19 23:36:30 +02:00
Sergei Trifonov
14e8132ac4
Merge branch 'master' into fix-load-balancing 2023-05-19 23:05:27 +02:00
Dan Roscigno
1ded6d6409
Update grant.md 2023-05-19 16:53:26 -04:00
Dan Roscigno
f5713867a4
Merge pull request #49835 from DanRoscigno/allow_experimental_parallel_reading_from_replicas
add allow_experimental_parallel_reading_from_replicas docs
2023-05-19 15:15:05 -04:00
Michael Kolupaev
6fd5d8e8ba Add setting output_format_parquet_compliant_nested_types to produce more compatible Parquet files 2023-05-19 18:39:50 +00:00
Dan Roscigno
ceb9b8cbc8
Merge branch 'master' into allow_experimental_parallel_reading_from_replicas 2023-05-19 14:25:07 -04:00
Dan Roscigno
50919e0cc6
Update src/Core/Settings.h 2023-05-19 14:24:50 -04:00
Dan Roscigno
1ef93e85aa
Merge branch 'master' into hanfei/regexp-doc 2023-05-19 14:23:23 -04:00
Dan Roscigno
8745b8196d
Merge pull request #49987 from den-crane/patch-67
Doc. Fix in partition description, for consistency with other documentation.
2023-05-19 14:18:33 -04:00
Dan Roscigno
75727bf072
Merge pull request #49967 from DanRoscigno/docs-ddl-named-collections
Docs ddl named collections
2023-05-19 14:16:22 -04:00
alekar
de710209a7
Merge branch 'master' into fix-osx-setsockopt-errors 2023-05-19 11:15:01 -07:00
serxa
052d8aca71 limit max_tries value by max_error_cap to avoid unlimited number of retries 2023-05-19 18:13:29 +00:00
serxa
d69c35fcdd fix PoolWithFailover error_count integer overflow 2023-05-19 17:57:00 +00:00
serxa
086888b285 fix ConnectionPoolWithFailover::getPriority 2023-05-19 17:54:29 +00:00