thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-01 12:01:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
149,513 Commits 9,191 Branches 1,782 Tags 2.2 GiB
71d47d2d07
Commit Graph

112 Commits

Author SHA1 Message Date
Nikolay Degterinsky
5d0c179ad1 Merge remote-tracking branch 'upstream/master' into fix-timeout-stateless-tests 2024-08-05 19:38:09 +00:00
Azat Khuzhin
dea95e6c33 Ensure that llvm-symbolizer is used for symbolizing sanitizer reports 
Since you don't want to fallback to addr2line:

    # addr2line
    $ time /bin/test
    set_flag_impl: Success
    set_flag_if: Success
    /usr/bin/addr2line: DWARF error: invalid or unhandled FORM value: 0x23
    ==================
    WARNING: ThreadSanitizer: data race (pid=18)
    ...
    real    3m8.580s
    user    0m21.967s
    sys     0m40.628s

    # llvm-symbolizer
    $ time ./test
    set_flag_impl: Success
    set_flag_if: Success
    ==================
    WARNING: ThreadSanitizer: data race (pid=24884)
    real    0m0.028s
    user    0m0.003s
    sys     0m0.006s

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-08-04 16:14:05 +02:00
Nikolay Degterinsky
2e7a15df89
Update setup_export_logs.sh 2024-08-01 23:23:06 +02:00
Nikolay Degterinsky
89ca6aee4e Check for timeout when we stop logs replication 2024-07-31 20:00:37 +00:00
János Benjamin Antal
e498b86f50 Add option for LSAN in shell also 2024-07-24 14:00:28 +00:00
János Benjamin Antal
c5d262c23b Increase max allocation size for sanitizers 2024-07-24 13:55:59 +00:00
Alexey Milovidov
fd430585e1 Merge remote-tracking branch 'origin/master' into fix-coverage 2024-05-07 09:34:00 +02:00
Alexey Milovidov
5f52cb43b4 Fix coverage. 2024-05-07 09:33:47 +02:00
Alexey Milovidov
98fb9f36a9 We are using Shared Catalog in the CI Logs cluster 2024-05-07 05:35:04 +02:00
Azat Khuzhin
5a400c181b Fix llvm symbolizer on CI 
In #61011 the whole toolchain installation had been removed from the
base image to reduce image sizes, and this is a good thing indeed.

However it also breaks the symbolizer for sanitizers, which makes
stacktraces unreadable, so let's fix this by getting back llvm package,
this should be OK, since it's size is not gigabytes, but only 48MiB (at
least for llvm-14):

    # dpkg -L llvm-14| xargs file | grep -v directory | cut -d: -f1 | xargs du -sch | grep total
    48M     total

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-03-11 20:36:15 +01:00
Alexey Milovidov
c8415ddc29 Speed up the CI 2024-02-18 09:29:34 +01:00
Alexey Milovidov
ed02154a4a Fix "Too many parts" 2024-02-10 07:31:54 +01:00
Alexey Milovidov
91c607f249 Fix a test 2024-02-08 22:11:37 +01:00
Alexey Milovidov
33401643a4 Fix error 2024-02-07 20:28:37 +01:00
Alexey Milovidov
d65a56d967
Merge branch 'master' into enable-coverage-for-debug-build 2024-02-07 04:58:21 +01:00
Mikhail f. Shiryaev
76c6dc51bf
Unify the apt cleaning part in Dockerfile's 2024-02-01 11:20:23 +01:00
Alexey Milovidov
8c54a09e66 Fix error 2024-01-20 08:59:29 +01:00
Alexey Milovidov
639d7745d4 Fix error 2024-01-19 17:02:23 +01:00
Alexey Milovidov
f9ca4e3b85 Slightly better 2024-01-18 00:52:05 +01:00
Alexey Milovidov
f89803ebf6 Slightly better 2024-01-17 23:17:53 +01:00
Alexey Milovidov
c5024a5f6d Fix typo 2024-01-15 23:36:48 +01:00
Alexey Milovidov
71bef27abf Follow-up 2024-01-15 06:26:54 +01:00
Alexey Milovidov
c5dfae1bca Fix error 2024-01-15 05:07:23 +01:00
Alexey Milovidov
bf2e574857 Symbolization 2024-01-15 00:48:47 +01:00
Alexey Milovidov
97200e2c5d Symbolization 2024-01-15 00:46:01 +01:00
Alexey Milovidov
7662628393 Export coverage to the CI database 2024-01-15 00:41:14 +01:00
Alexey Milovidov
4c1860b9b4 Fix a mistake 2023-12-12 21:21:58 +01:00
Alexey Milovidov
740ceea108 Docker 2023-12-11 03:10:17 +01:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts 
Fix system.*_log in artifacts on CI
 2023-11-24 21:05:46 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud 
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-23 14:49:28 +01:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI 
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 21:00:51 +01:00
Alexey Milovidov
527ca9a1fc
Merge branch 'master' into symbolize-trace-log 2023-11-11 09:38:02 +01:00
Alexey Milovidov
e073eaf5ce Try LowCardinality 2023-11-11 08:23:58 +01:00
Alexey Milovidov
0064872bc7 Apply LowCardinality in more places 2023-11-11 07:46:56 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
4460abafbe No idea why it did not work 2023-11-11 07:37:39 +01:00
Alexey Milovidov
629c5c0e45 Change tables version 2023-11-11 06:21:31 +01:00
Alexey Milovidov
fb0335efb0 What if I add some indices 2023-11-11 06:20:57 +01:00
Alexey Milovidov
6078ff20bb Symbolize trace_log for exporting 2023-11-11 05:52:44 +01:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
Mikhail f. Shiryaev
d4f21704e4
Increase distributed_ddl_task_timeout 
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-09-01 11:29:33 +02:00
Mikhail f. Shiryaev
c611007694
The external logs have had colliding arguments 2023-09-01 11:25:42 +02:00
Mikhail f. Shiryaev
ab3e9df57f
Address review points 2023-08-30 22:06:32 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
a683d5e2f3
Replace defaul assingment by default usage 2023-08-30 22:04:34 +02:00