thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-24 16:42:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
150,448 Commits 9,168 Branches 1,781 Tags 2.1 GiB
086c0f03a6
Commit Graph

47 Commits

Author SHA1 Message Date
Nikolay Degterinsky
2e7a15df89
Update setup_export_logs.sh 2024-08-01 23:23:06 +02:00
Nikolay Degterinsky
89ca6aee4e Check for timeout when we stop logs replication 2024-07-31 20:00:37 +00:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
8c54a09e66 Fix error 2024-01-20 08:59:29 +01:00
Alexey Milovidov
639d7745d4 Fix error 2024-01-19 17:02:23 +01:00
Alexey Milovidov
f9ca4e3b85 Slightly better 2024-01-18 00:52:05 +01:00
Alexey Milovidov
f89803ebf6 Slightly better 2024-01-17 23:17:53 +01:00
Alexey Milovidov
c5024a5f6d Fix typo 2024-01-15 23:36:48 +01:00
Alexey Milovidov
71bef27abf Follow-up 2024-01-15 06:26:54 +01:00
Alexey Milovidov
c5dfae1bca Fix error 2024-01-15 05:07:23 +01:00
Alexey Milovidov
bf2e574857 Symbolization 2024-01-15 00:48:47 +01:00
Alexey Milovidov
97200e2c5d Symbolization 2024-01-15 00:46:01 +01:00
Alexey Milovidov
7662628393 Export coverage to the CI database 2024-01-15 00:41:14 +01:00
Alexey Milovidov
4c1860b9b4 Fix a mistake 2023-12-12 21:21:58 +01:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts 
Fix system.*_log in artifacts on CI
 2023-11-24 21:05:46 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud 
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-23 14:49:28 +01:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI 
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 21:00:51 +01:00
Alexey Milovidov
527ca9a1fc
Merge branch 'master' into symbolize-trace-log 2023-11-11 09:38:02 +01:00
Alexey Milovidov
e073eaf5ce Try LowCardinality 2023-11-11 08:23:58 +01:00
Alexey Milovidov
0064872bc7 Apply LowCardinality in more places 2023-11-11 07:46:56 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
4460abafbe No idea why it did not work 2023-11-11 07:37:39 +01:00
Alexey Milovidov
629c5c0e45 Change tables version 2023-11-11 06:21:31 +01:00
Alexey Milovidov
fb0335efb0 What if I add some indices 2023-11-11 06:20:57 +01:00
Alexey Milovidov
6078ff20bb Symbolize trace_log for exporting 2023-11-11 05:52:44 +01:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
Mikhail f. Shiryaev
d4f21704e4
Increase distributed_ddl_task_timeout 
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-09-01 11:29:33 +02:00
Mikhail f. Shiryaev
c611007694
The external logs have had colliding arguments 2023-09-01 11:25:42 +02:00
Mikhail f. Shiryaev
ab3e9df57f
Address review points 2023-08-30 22:06:32 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
a683d5e2f3
Replace defaul assingment by default usage 2023-08-30 22:04:34 +02:00
Alexander Tokmakov
9180c631aa
Update setup_export_logs.sh 2023-08-25 21:03:24 +03:00
Alexander Tokmakov
428810a5b2
Update setup_export_logs.sh 2023-08-18 13:37:29 +03:00
Alexander Tokmakov
fdca288a73 make sending logs less fragile 2023-08-17 16:49:50 +02:00
Alexey Milovidov
a1d3f1836e Fix shellcheck 2023-08-12 02:46:28 +02:00
Alexey Milovidov
3b85c5ed0e Put the script into the base Docker image 2023-08-12 02:14:58 +02:00