Commit Graph

4000 Commits

Author SHA1 Message Date
Alexey Milovidov
7b7c4d008f Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-16 01:09:06 +02:00
Alexey Milovidov
3508667e6c
Merge pull request #52503 from ClickHouse/more-strict-tryparse
Stricter `tryParse`
2024-08-15 21:58:22 +00:00
Alexey Milovidov
da1c98a771 Update the limits 2024-08-14 04:54:33 +02:00
Alexey Milovidov
69893aaa25 Lower memory usage 2024-08-13 16:19:25 +02:00
Alexey Milovidov
9051cd103a Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-13 16:18:13 +02:00
Yarik Briukhovetskyi
086c0f03a6
Merge pull request #65997 from yariks5s/hive_style_partitioning
Implementing Hive-style partitioning
2024-08-13 10:04:21 +00:00
Alexey Milovidov
995b29cb07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into more-strict-tryparse 2024-08-13 02:38:40 +02:00
Alexey Milovidov
dea86ff20c Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-12 23:56:06 +02:00
Antonio Andelic
ea9b7d4c27
Merge pull request #67998 from ClickHouse/minio-audit-logs
Collect minio audit logs in stateless tests
2024-08-12 17:03:17 +00:00
Antonio Andelic
e9d16bc054 Use new mc restart 2024-08-12 13:39:53 +02:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning 2024-08-12 11:44:45 +02:00
Alexey Milovidov
2a12604cf5
Merge pull request #66494 from azat/gdb-image
Update gdb to 15.1 (by compiling from sources)
2024-08-12 05:04:57 +00:00
Alexey Milovidov
7e277d5656 Fix Upgrade check 2024-08-12 05:04:51 +02:00
Alexey Milovidov
59f45909eb Merge branch 'master' into tighten-limits-functional-tests 2024-08-12 02:28:53 +02:00
Azat Khuzhin
375de7ff65 ci: add more logs in the functional tests reports
Due to settings randomization 4096 is not enough even to show all
settings, like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/68139/c852bd9dbaa317423234d4f15f21d64e59be42b5/stateless_tests_flaky_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-11 07:15:10 +02:00
Antonio Andelic
2fc5734623 Merge branch 'master' into minio-audit-logs 2024-08-10 18:58:56 +02:00
Antonio Andelic
0a536cbf15 Add batch size 2024-08-10 18:58:28 +02:00
Alexey Milovidov
341f44a943 Merge branch 'master' into tighten-limits-functional-tests 2024-08-10 00:20:25 +02:00
Antonio Andelic
79cfffbaf8
Even bigger queue 2024-08-09 15:57:16 +01:00
Antonio Andelic
4ced1f37e8
Escape quote 2024-08-09 11:56:53 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
Antonio Andelic
34fb169aa7 Merge branch 'master' into update-minio-statless 2024-08-09 11:50:17 +02:00
Antonio Andelic
da907d5356
Better parsing 2024-08-09 10:37:48 +01:00
Antonio Andelic
54cd980e13 Increase queue size and fix tests 2024-08-09 09:44:30 +02:00
Alexey Milovidov
917920c59e
Merge pull request #67737 from azat/tests-processes-leftovers
Smart handling of processes leftovers in tests
2024-08-09 05:21:12 +00:00
Antonio Andelic
34bbf3d9c4 Use async inserts 2024-08-08 17:13:13 +02:00
Antonio Andelic
f4aac7bbd9
Another fix 2024-08-08 09:19:45 +01:00
Antonio Andelic
9d30b45dbe
Fix 2024-08-08 08:43:49 +01:00
Antonio Andelic
4059b45237 Merge branch 'master' into update-minio-statless 2024-08-08 09:00:27 +02:00
Antonio Andelic
bd3674e6e9 Add restart 2024-08-08 08:55:31 +02:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Alexey Milovidov
3244d447f2 Merge branch 'master' into tighten-limits-functional-tests 2024-08-07 22:34:31 +02:00
Antonio Andelic
d2e9833dba Add minio audit logs 2024-08-07 17:22:51 +02:00
Antonio Andelic
ddc058aa6f Update minio in stateless tests 2024-08-07 14:01:46 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index
added tests for page index in parquet files
2024-08-07 00:15:07 +00:00
Azat Khuzhin
5390d1b108 docker: use self-compiled gdb 15 from cctools
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 17:15:49 +02:00
Azat Khuzhin
72bd43a309 tests: do not capture client stacktraces in stress tests
They are too uncontrollable, and likely will leave some clients [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/9658be5eea8351655dd3ea77b8c1d4717bac7999/stress_test__ubsan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:42:19 +02:00
Azat Khuzhin
7c366a040f ci: use bash arrays to pass opts to clickhouse-test for stateless/stateful
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:39:16 +02:00
Nikolay Degterinsky
1126ae3e5a
Merge pull request #67560 from evillique/fix-timeout-stateless-tests
[CI] Check for timeout when we stop logs replication
2024-08-06 14:35:23 +00:00
Nikolay Degterinsky
103ff7d2f9 Merge remote-tracking branch 'upstream/master' into fix-timeout-stateless-tests 2024-08-06 10:23:57 +00:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Raúl Marín
25fa63f7e6 Merge remote-tracking branch 'blessed/master' into unit_test_asan 2024-08-06 11:19:57 +02:00
Michael Kolupaev
f344d833fd
Merge pull request #65253 from ClickHouse/reg
attach_gdb.lib: print more information before all stacks
2024-08-06 08:18:46 +00:00
Alexey Katsman
913bc8ab3a
Merge pull request #67869 from alexkats/misc-fixes
Misc fixes
2024-08-06 04:10:41 +00:00
Michael Kolupaev
93afcd16b0 Merge remote-tracking branch 'origin/master' into reg 2024-08-05 22:10:56 +00:00
Nikolay Degterinsky
5d0c179ad1 Merge remote-tracking branch 'upstream/master' into fix-timeout-stateless-tests 2024-08-05 19:38:09 +00:00
Alexey Milovidov
27a06f9eec Merge branch 'master' into tighten-limits-functional-tests 2024-08-05 19:57:21 +02:00
Alex Katsman
c8805fbced Misc fixes 2024-08-05 17:41:47 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Alexey Milovidov
a416d2bc4a
Merge pull request #67791 from azat/ci/stateless-v2
ci/stateless: fix artifacts post-processing and detect if something failed there
2024-08-05 14:46:58 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
Alexey Milovidov
5875900189
Merge pull request #67780 from ClickHouse/fix-small-diagnostic-in-test
Fix diagnostics in the test script
2024-08-05 12:27:37 +00:00
Alexey Milovidov
6b4353b910
Merge pull request #66495 from azat/ci-images-llvm-cleanup
Ensure that llvm-symbolizer is used for symbolizing sanitizer reports
2024-08-05 12:25:32 +00:00
Azat Khuzhin
b47f8a733f ci: fix basic errors collecting after stateless tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00
Alexey Milovidov
a573b2926e Fixes for the script 2024-08-04 23:59:44 +02:00
Alexey Milovidov
0bdaa57023 Fix diagnostics in the test script 2024-08-04 23:53:54 +02:00
Azat Khuzhin
43cf85ef28 ci: collect basic issues in stateless tests (dmesg, fatal and similar)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 23:19:33 +02:00
Azat Khuzhin
c200f43774 ci: fix stateless runner to correctly gather artifacts when server failed
Right now it simply does not work due to "set -e", with it you cannot
use "foo=$(false)" since bash will break execution after, rewrite it to
a plain shell, with "if".

Also use ZSTD everywhere (ugh)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 23:19:33 +02:00
Alexey Milovidov
f08b32d528 Merge branch 'master' into tighten-limits-functional-tests 2024-08-04 21:44:38 +02:00
Alexey Milovidov
a433115434 Fix typo 2024-08-04 19:18:00 +02:00
Azat Khuzhin
1f2bb6676f Remove outdated comments about workaround for #64086
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 16:14:05 +02:00
Azat Khuzhin
dea95e6c33 Ensure that llvm-symbolizer is used for symbolizing sanitizer reports
Since you don't want to fallback to addr2line:

    # addr2line
    $ time /bin/test
    set_flag_impl: Success
    set_flag_if: Success
    /usr/bin/addr2line: DWARF error: invalid or unhandled FORM value: 0x23
    ==================
    WARNING: ThreadSanitizer: data race (pid=18)
    ...
    real    3m8.580s
    user    0m21.967s
    sys     0m40.628s

    # llvm-symbolizer
    $ time ./test
    set_flag_impl: Success
    set_flag_if: Success
    ==================
    WARNING: ThreadSanitizer: data race (pid=24884)
    real    0m0.028s
    user    0m0.003s
    sys     0m0.006s

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-04 16:14:05 +02:00
Raúl Marín
86bab5a78a Unit test: Don't return ok if leaks are detected 2024-08-02 16:09:43 +02:00
Raúl Marín
e5cf376c4f Don't attach gdb in ASAN runs of fuzzer, stateless or stress checks 2024-08-02 12:56:49 +02:00
Raúl Marín
97f1f6e221 Don't hide errors on clickhouse local runs 2024-08-02 12:46:37 +02:00
Nikolay Degterinsky
2e7a15df89
Update setup_export_logs.sh 2024-08-01 23:23:06 +02:00
Raúl Marín
35b6112b7b Try to stop on leaks 2024-08-01 19:50:13 +02:00
Raúl Marín
c5a8653daf Playing with Docker and the CI 2024-08-01 19:27:12 +02:00
Raúl Marín
4e9761acf9 Don't run ASAN unit tests under gdb 2024-08-01 18:59:17 +02:00
maxvostrikov
928d5df3f0 added tests for https://github.com/ClickHouse/ClickHouse/pull/65475
Support writting page index into parquet file
2024-08-01 12:32:43 +02:00
Nikolay Degterinsky
89ca6aee4e Check for timeout when we stop logs replication 2024-07-31 20:00:37 +00:00
Alexey Milovidov
59b85fb788 Merge branch 'master' into tighten-limits-functional-tests 2024-07-30 23:19:38 +02:00
kssenii
bf25f1815e Merge remote-tracking branch 'origin' into add-no-distributed-cache-tag 2024-07-30 13:45:23 +02:00
Yarik Briukhovetskyi
f0da5c528f
Merge branch 'master' into hive_style_partitioning 2024-07-30 11:49:14 +02:00
kssenii
161e794618 Add no-distributed-cache tag 2024-07-29 14:03:22 +02:00
Antonio Andelic
6f2d25cc39 Merge branch 'master' into add-numactl 2024-07-28 11:29:26 +02:00
Alexey Milovidov
8dd0542fc1 Merge branch 'master' into tighten-limits-functional-tests 2024-07-27 13:19:59 +02:00
Alexey Milovidov
b8b6188cbf Merge branch 'master' into tighten-limits-functional-tests 2024-07-27 01:28:19 +02:00
Alexey Milovidov
c4d772557f
Merge pull request #66790 from ClickHouse/better-diagnostics-in-functional-tests
Better diagnostics in functional tests
2024-07-26 23:15:42 +00:00
Nikita Fomichev
c95c1a7232
Merge pull request #66901 from ClickHouse/stable-test-runs
Stateless tests: Change status of failed tests in case of server crash and add no-parallel to high-load tests
2024-07-26 18:42:42 +00:00
Alexey Milovidov
ffe15e2e37 Merge branch 'master' into tighten-limits-functional-tests 2024-07-26 14:11:59 +02:00
Nikita Fomichev
7f80dab692 CI push 2024-07-26 12:34:36 +02:00
Antonio Andelic
287cce7d21 Fixes 2024-07-26 09:20:15 +02:00
Alexey Milovidov
8f91fa8b78 Merge branch 'fix-unit-tests' into better-diagnostics-in-functional-tests 2024-07-26 04:51:46 +02:00
Ilya Yatsishin
638937674f Merge remote-tracking branch 'origin/master' into qoega-patch-6 2024-07-25 23:19:00 +02:00
Alexey Milovidov
6b56f427d3
Merge pull request #67145 from ClickHouse/lower-max-allocation-size-in-query-fuzzer
Lower max allocation size in query fuzzer
2024-07-25 21:00:58 +00:00
Alexey Milovidov
02461263f2 Merge branch 'master' into tighten-limits-functional-tests 2024-07-25 21:27:14 +02:00
Antonio Andelic
cba75018ee
Merge pull request #66847 from ClickHouse/dont-ignore-sigsegv
Stop ignoring SIGSEGV in GDB
2024-07-25 17:53:42 +00:00
Alexey Milovidov
1059c7b76e Merge branch 'master' into tighten-limits-functional-tests 2024-07-25 19:34:47 +02:00
Alexey Milovidov
ee193ffa01 Lower max allocation size in query fuzzer 2024-07-25 19:25:58 +02:00
Alexey Milovidov
782d829d87 Merge branch 'master' into better-diagnostics-in-functional-tests 2024-07-25 18:47:09 +02:00
Antonio Andelic
c5e01c91d2 Merge branch 'master' into dont-ignore-sigsegv 2024-07-25 11:23:39 +02:00
János Benjamin Antal
2def300631
Merge pull request #67049 from ClickHouse/fix-sanitizer-allocation-size-is-too-big
Increase max allocation size for sanitizers
2024-07-25 08:32:38 +00:00
János Benjamin Antal
e498b86f50 Add option for LSAN in shell also 2024-07-24 14:00:28 +00:00
János Benjamin Antal
c5d262c23b Increase max allocation size for sanitizers 2024-07-24 13:55:59 +00:00
Alexey Milovidov
e2c78844a0 Fix tests 2024-07-24 14:53:09 +02:00
Alexey Milovidov
036485a657 Fix error 2024-07-24 12:15:48 +02:00
Alexey Milovidov
878a340317 Fix tests 2024-07-24 11:47:07 +02:00