Commit Graph

129509 Commits

Author SHA1 Message Date
Alexey Milovidov
ac1e742afa
Merge pull request #57108 from azat/build/large-objects
Allow HashedDictionary/FunctionsConversion as large TU
2023-11-23 15:00:59 +01:00
Alexey Milovidov
9c7b0f33fc Fix bad test 00002_log_and_exception_messages_formatting 2023-11-23 14:49:51 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-23 14:49:28 +01:00
Vitaly Baranov
5f461ff780 Change the default for "wait_dictionaries_load_at_startup" to true,
and use this setting only if "dictionaries_lazy_load" is false.
2023-11-23 14:45:42 +01:00
Aleksei Filatov
1a03f5f7f4 Merge remote-tracking branch 'upstream/master' into add_cancellation_point_for_moving_background_operation 2023-11-23 16:43:33 +03:00
Vitaly Baranov
2eca762c39
Merge pull request #57134 from vitlibar/check-dictionary-source-type-on-creation
Check dictionary source type on creation
2023-11-23 14:24:42 +01:00
Robert Schulze
4f10ad3f3c
Allow to disable reorder-functions-after-sorting optimization 2023-11-23 13:16:03 +00:00
Alexey Milovidov
05784b66c9 Fix test 2023-11-23 14:04:10 +01:00
robot-clickhouse
6545775bff
Merge pull request #57138 from luppx/patch-1
Fix wrong Chinese word order
2023-11-23 13:43:28 +01:00
Igor Nikonov
def4a62365 Remove DBMS_CONNECTION_POOL_WITH_FAILOVER_DEFAULT_MAX_TRIES 2023-11-23 12:22:44 +00:00
Kruglov Pavel
4ff15a01ec
Merge pull request #57104 from ClickHouse/Avogar-patch-2
Cancel PipelineExecutor properly in case of exception in spawnThreads
2023-11-23 13:22:09 +01:00
kssenii
ff3224e7f7 Load named collections in advance 2023-11-23 13:22:06 +01:00
kssenii
7b5b6eda3e Revert "Remove bad case"
This reverts commit dea4bbf4d6.
2023-11-23 13:19:34 +01:00
Antonio Andelic
c43b84c68d
Typo 2023-11-23 13:12:16 +01:00
vdimir
93a34b5067
Add 02918_analyzer_to_ast_crash 2023-11-23 12:08:42 +00:00
vdimir
db4aa19f90
Fix FunctionNode::toASTImpl 2023-11-23 12:08:41 +00:00
kssenii
dea4bbf4d6 Remove bad case 2023-11-23 12:44:35 +01:00
Antonio Andelic
953a8d774a Close interserver connection on exception that happened before first authentication 2023-11-23 11:43:03 +00:00
avogar
e3afb4182b Fix tests 2023-11-23 11:10:41 +00:00
serxa
663c8cd944 Merge branch 'master' into dashboards-table 2023-11-23 10:29:48 +00:00
vdimir
bbc577646f
Merge pull request #57123 from ClickHouse/vdimir/fix_logical_error_analyzer_or_optimize
Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor
2023-11-23 11:24:28 +01:00
slu
4ff41c7e30
fix wrong word order 2023-11-23 17:30:28 +08:00
robot-clickhouse-ci-2
7b0a40f2c3
Merge pull request #57131 from azat/tests/01600_parts_types_metrics
Resubmit 01600_parts_types_metrics test (possibly without flakiness)
2023-11-23 09:33:55 +01:00
Vitaly Baranov
e0c9661115 Check dictionary source type on creation even if "dictionaries_lazy_load" is enabled. 2023-11-23 01:45:08 +01:00
Andrej Hoos
f447c5418d
Optimize query uniqueness check in ProcessList - move after cancelled_cv.wait 2023-11-23 00:21:56 +01:00
Alexander Tokmakov
a0ce9f46cf fix 2023-11-22 23:15:20 +01:00
Azat Khuzhin
7a0d11ba93 Fix 01600_parts_types_metrics flakiness
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 22:40:53 +01:00
Azat Khuzhin
4fa1205b8a Resubmit 01600_parts_types_metrics test
This reverts commit c7eacbea62, reversing
changes made to d41bb831da.

Reverts: #56612
2023-11-22 22:40:53 +01:00
Alexey Milovidov
2ba2f48051 Merge branch 'master' of github.com:ClickHouse/ClickHouse into less-allocation-in-arenas 2023-11-22 22:11:59 +01:00
Alexey Milovidov
2983cdf53e Fix error 2023-11-22 22:09:57 +01:00
Alexey Milovidov
96410cee6a Fix error 2023-11-22 22:09:24 +01:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 21:00:51 +01:00
avogar
70f45c11bd Fix 2023-11-22 19:56:42 +00:00
Alexander Tokmakov
ef3e558a65 fix no such key for empty parts 2023-11-22 20:51:10 +01:00
Alexander Tokmakov
d9eb68ba35 fix unexpected outdated parts 2023-11-22 20:29:57 +01:00
Alexander Tokmakov
9f1a9826af fix replace/move partition 2023-11-22 20:04:14 +01:00
Alexander Tokmakov
86f7732c24
Update StorageReplicatedMergeTree.cpp 2023-11-22 19:41:27 +01:00
avogar
031f030102 Remove unused method 2023-11-22 18:27:32 +00:00
Kruglov Pavel
b84e3cf683
Merge branch 'master' into size-virtual-column 2023-11-22 19:25:00 +01:00
avogar
4a86f4a7b9 Fix style changes 2023-11-22 18:24:34 +00:00
avogar
6b64efb55a Add docs 2023-11-22 18:21:30 +00:00
avogar
193f8a5d23 Add test for azure 2023-11-22 18:12:50 +00:00
avogar
007353a2dd Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines 2023-11-22 18:12:36 +00:00
Azat Khuzhin
cf3cd099a5 Split HashedDictionary CU
Before HashedDictionary.cpp exceeds 50MiB, now:

    -rw-r--r-- 1 azat azat  37M Nov 22 17:56 SparseHashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat  34M Nov 22 17:56 HashedDictionary.cpp.o
    -rw-r--r-- 1 azat azat 716K Nov 22 17:56 registerHashedDictionary.cpp.o

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-22 19:00:40 +01:00
Julia Kartseva
753b22f64c
Merge pull request #56171 from ClibMouse/dev-seriesPeriodDetect
Implemented series period detect method using pocketfft lib
2023-11-22 09:49:58 -08:00
Alexander Tokmakov
d277bfb225 setActualPartName for executeReplaceRange 2023-11-22 18:48:25 +01:00
Nikolai Kochetov
ce0cd6a828 Add a test. 2023-11-22 17:41:56 +00:00
Nikolai Kochetov
1919ec723d Cancel executor in ~CreatingSetsTransform 2023-11-22 17:31:29 +00:00
Nikolay Degterinsky
761b55ccf4 Make overflow not possible 2023-11-22 16:37:30 +00:00
vdimir
7fb4a90d0b
Analyzer: Fix logical error in LogicalExpressionOptimizerVisitor 2023-11-22 16:34:31 +00:00