Commit Graph

5296 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
4bfad1ccd6
Improve reqgenerator a little bit 2024-10-01 11:47:59 +02:00
robot-clickhouse
7c6ce8611c Automatic style fix 2024-09-27 10:19:49 +00:00
robot-clickhouse
3a3145f3c6 Update version_date.tsv and changelogs after v24.9.1.3278-stable 2024-09-26 22:02:03 +00:00
Alexey Milovidov
47a1f7efdd
Merge pull request #69033 from filimonov/patch-11
alpine docker images - use ubuntu 22.04 as glibc donor
2024-09-25 15:12:52 +00:00
filimonov
8b5331fde4
Update Dockerfile.alpine 2024-09-24 16:56:37 +02:00
filimonov
633d27ec7f
Update Dockerfile.alpine 2024-09-24 16:54:39 +02:00
vdimir
f0ecb3ad73
Merge branch 'master' into prevent-dirty-working-tree 2024-09-23 17:00:59 +02:00
Mikhail f. Shiryaev
8a86cbf4fe
Multiple improvements of docs_check.py
- Run the script as a current user, not root
- Add `--no-pull-image` to use a local one
- Simplify logs analyze
2024-09-23 14:35:05 +02:00
Mikhail f. Shiryaev
1a1996f318
Build htmltest in docs-builder 2024-09-23 14:33:09 +02:00
Alexey Milovidov
e74e2ca9ff Prevent build from modifying the source code tree 2024-09-22 22:41:12 +02:00
János Benjamin Antal
d5c3adabde
Merge pull request #69301 from aohoyd/master
Add xml char escaping to docker's entrypoint
2024-09-13 10:11:30 +00:00
Mikhail f. Shiryaev
c1830bc041
Escape the \n in statements 2024-09-11 13:08:58 +02:00
Mikhail f. Shiryaev
3921f910f5
Another attempt to address EAGAIN "Resource unavailable" 2024-09-11 12:14:16 +02:00
Mikhail f. Shiryaev
7727b30f5c
Attempt to fix EAGAIN error 2024-09-10 18:06:32 +02:00
Mikhail f. Shiryaev
6e6e705486
Add a hostname to log; we need something to grep remote query_log 2024-09-10 12:56:19 +02:00
Mikhail f. Shiryaev
8b1f21e7dd
Hide exported logs statements in GH logs 2024-09-10 12:22:19 +02:00
robot-clickhouse
8be745e8c2 Update version_date.tsv and changelogs after v24.8.4.13-lts 2024-09-06 16:43:55 +00:00
Konstantin Bogdanov
cedddf6fa4
PoC 2024-09-06 00:22:46 +02:00
Alexey Olshanskiy
d17b20705a
Add char escaping to docker's entrypoint 2024-09-05 17:55:56 +03:00
robot-clickhouse
ff6a781dca Update version_date.tsv and changelogs after v24.8.3.59-lts 2024-09-03 11:37:16 +00:00
filimonov
cf1f3b4bd2
Dockerfile.alpine let's try to use ubuntu 22.04 as glibc donor
20.04 is coming to EOL in April 2025
https://ubuntu.com/about/release-cycle
2024-08-28 15:33:15 +02:00
vdimir
c884a2fb9d
perf tests set cgroups_memory_usage_observer_wait_time to zero 2024-08-27 13:26:20 +00:00
Kseniia Sumarokova
8b2db6276c
Merge pull request #68836 from ClickHouse/fix-delta-lake-bug-in-schema-parsing
Fix complex types metadata parsing in DeltaLake
2024-08-26 17:44:22 +00:00
kssenii
eb94847ed9 Fix 2024-08-23 18:14:02 +02:00
Max K.
894bbbf021
Merge pull request #68654 from ClickHouse/ci_fix_sqllogic
CI: Disable SQLLogic job
2024-08-23 09:29:02 +00:00
robot-clickhouse
4264fbc037 Update version_date.tsv and changelogs after v24.8.2.3-lts 2024-08-22 16:16:47 +00:00
Max Kainov
6e5465ae51 CI: SQLLogix job fix 2024-08-21 22:31:48 +02:00
robot-clickhouse
ccff8cef80 Update version_date.tsv and changelogs after v24.8.1.2684-lts 2024-08-21 14:27:49 +00:00
Max Kainov
9b55180184 CI: Move out scripts from dockers 2024-08-20 10:17:17 +02:00
Alexey Katsman
e9069723f8
Merge pull request #68153 from azat/ci/more-logs-in-report
ci: add more logs in the functional tests reports
2024-08-19 21:17:49 +00:00
Max K.
278cd9c828
Merge pull request #67944 from ClickHouse/ci_job_timeout_notice_support
CI: Job Timeout handling
2024-08-19 11:16:53 +00:00
Max Kainov
427016a450 CI: Functional tests to store artifacts on timeout 2024-08-18 15:54:23 +02:00
Alexey Milovidov
7b7c4d008f Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-16 01:09:06 +02:00
Alexey Milovidov
3508667e6c
Merge pull request #52503 from ClickHouse/more-strict-tryparse
Stricter `tryParse`
2024-08-15 21:58:22 +00:00
Alexey Milovidov
10e58a5cbb Merge branch 'master' into tighten-limits-functional-tests 2024-08-14 04:54:37 +02:00
Alexey Milovidov
da1c98a771 Update the limits 2024-08-14 04:54:33 +02:00
Yakov Olkhovskiy
3e8a177622
Merge pull request #61908 from ClickHouse/ci-fuzzer-enable
CI: enable libfuzzer (fixing build and docker)
2024-08-13 14:22:09 +00:00
Alexey Milovidov
69893aaa25 Lower memory usage 2024-08-13 16:19:25 +02:00
Alexey Milovidov
9051cd103a Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-13 16:18:13 +02:00
Yarik Briukhovetskyi
086c0f03a6
Merge pull request #65997 from yariks5s/hive_style_partitioning
Implementing Hive-style partitioning
2024-08-13 10:04:21 +00:00
Alexey Milovidov
995b29cb07 Merge branch 'master' of github.com:ClickHouse/ClickHouse into more-strict-tryparse 2024-08-13 02:38:40 +02:00
Alexey Milovidov
dea86ff20c Merge branch 'master' of github.com:ClickHouse/ClickHouse into tighten-limits-functional-tests 2024-08-12 23:56:06 +02:00
Antonio Andelic
ea9b7d4c27
Merge pull request #67998 from ClickHouse/minio-audit-logs
Collect minio audit logs in stateless tests
2024-08-12 17:03:17 +00:00
Robert Schulze
037a1006fd
Merge remote-tracking branch 'ClickHouse/master' into ci-fuzzer-enable 2024-08-12 12:28:32 +00:00
Antonio Andelic
e9d16bc054 Use new mc restart 2024-08-12 13:39:53 +02:00
Yarik Briukhovetskyi
8bc89ac8df
Merge branch 'master' into hive_style_partitioning 2024-08-12 11:44:45 +02:00
Alexey Milovidov
2a12604cf5
Merge pull request #66494 from azat/gdb-image
Update gdb to 15.1 (by compiling from sources)
2024-08-12 05:04:57 +00:00
Alexey Milovidov
7e277d5656 Fix Upgrade check 2024-08-12 05:04:51 +02:00
Alexey Milovidov
59f45909eb Merge branch 'master' into tighten-limits-functional-tests 2024-08-12 02:28:53 +02:00
Azat Khuzhin
375de7ff65 ci: add more logs in the functional tests reports
Due to settings randomization 4096 is not enough even to show all
settings, like here [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/68139/c852bd9dbaa317423234d4f15f21d64e59be42b5/stateless_tests_flaky_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-11 07:15:10 +02:00
Antonio Andelic
2fc5734623 Merge branch 'master' into minio-audit-logs 2024-08-10 18:58:56 +02:00
Antonio Andelic
0a536cbf15 Add batch size 2024-08-10 18:58:28 +02:00
Alexey Milovidov
341f44a943 Merge branch 'master' into tighten-limits-functional-tests 2024-08-10 00:20:25 +02:00
Antonio Andelic
79cfffbaf8
Even bigger queue 2024-08-09 15:57:16 +01:00
Antonio Andelic
4ced1f37e8
Escape quote 2024-08-09 11:56:53 +01:00
Yarik Briukhovetskyi
aebb07884b
Merge branch 'master' into hive_style_partitioning 2024-08-09 11:53:14 +02:00
Antonio Andelic
34fb169aa7 Merge branch 'master' into update-minio-statless 2024-08-09 11:50:17 +02:00
Antonio Andelic
da907d5356
Better parsing 2024-08-09 10:37:48 +01:00
Antonio Andelic
54cd980e13 Increase queue size and fix tests 2024-08-09 09:44:30 +02:00
Alexey Milovidov
917920c59e
Merge pull request #67737 from azat/tests-processes-leftovers
Smart handling of processes leftovers in tests
2024-08-09 05:21:12 +00:00
Alexey Milovidov
fd4ff1f621 Merge branch 'master' into tighten-limits-functional-tests 2024-08-08 18:31:04 +02:00
Yarik Briukhovetskyi
a5fcf85fb6
Merge branch 'master' into hive_style_partitioning 2024-08-08 17:54:53 +02:00
Antonio Andelic
34bbf3d9c4 Use async inserts 2024-08-08 17:13:13 +02:00
robot-clickhouse
9cf60214e1 Update version_date.tsv and changelogs after v24.7.3.42-stable 2024-08-08 13:43:12 +00:00
Antonio Andelic
f4aac7bbd9
Another fix 2024-08-08 09:19:45 +01:00
Antonio Andelic
9d30b45dbe
Fix 2024-08-08 08:43:49 +01:00
Antonio Andelic
4059b45237 Merge branch 'master' into update-minio-statless 2024-08-08 09:00:27 +02:00
Antonio Andelic
bd3674e6e9 Add restart 2024-08-08 08:55:31 +02:00
Yarik Briukhovetskyi
9e3a2931d2
Merge branch 'master' into hive_style_partitioning 2024-08-07 23:59:34 +02:00
Alexey Milovidov
3244d447f2 Merge branch 'master' into tighten-limits-functional-tests 2024-08-07 22:34:31 +02:00
Yakov Olkhovskiy
b246f7c17c merge master 2024-08-07 16:25:31 +00:00
Antonio Andelic
d2e9833dba Add minio audit logs 2024-08-07 17:22:51 +02:00
Antonio Andelic
ddc058aa6f Update minio in stateless tests 2024-08-07 14:01:46 +02:00
Raúl Marín
c9340cba32
Merge pull request #67622 from Algunenano/unit_test_asan
Don't run ASAN unit tests under gdb
2024-08-07 10:48:00 +00:00
max-vostrikov
0aed98f3f0
Merge pull request #67596 from ClickHouse/test_parquet_page_index
added tests for page index in parquet files
2024-08-07 00:15:07 +00:00
Alexey Milovidov
e3ead8a3ba
Merge pull request #65564 from azat/override-logs-in-keeper-image
[RFC] Do not pass logs for keeper explicitly in the image to allow overriding
2024-08-06 22:58:20 +00:00
Azat Khuzhin
5390d1b108 docker: use self-compiled gdb 15 from cctools
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 17:15:49 +02:00
Azat Khuzhin
72bd43a309 tests: do not capture client stacktraces in stress tests
They are too uncontrollable, and likely will leave some clients [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/67737/9658be5eea8351655dd3ea77b8c1d4717bac7999/stress_test__ubsan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:42:19 +02:00
Azat Khuzhin
7c366a040f ci: use bash arrays to pass opts to clickhouse-test for stateless/stateful
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:39:16 +02:00
Nikolay Degterinsky
1126ae3e5a
Merge pull request #67560 from evillique/fix-timeout-stateless-tests
[CI] Check for timeout when we stop logs replication
2024-08-06 14:35:23 +00:00
Azat Khuzhin
424f19d6c0 Move gdb into cctools
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:25:56 +02:00
Azat Khuzhin
459dd1ff2d Add a comment of the image name for cctools
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:25:56 +02:00
Azat Khuzhin
99b18d31db Update gdb to 15.1 (by compiling from sources)
Right now there are couple of gdb bugs that makes CI unstable:
- https://sourceware.org/bugzilla/show_bug.cgi?id=29185
- https://bugzilla.redhat.com/show_bug.cgi?id=1492496

But ubuntu 22.04 does not have 14+ anywhere, the
~ubuntu-toolchain-r/test contains only gdb 13, so there is no other
options except for compiling it from sources.

But there also other reasons to update it - optimizations, looks like
older gdb versions does not use index fully - 5.6sec vs 56sec:

    # 15.1
    $ time command gdb -batch -ex 'disas main' clickhouse
    ...
    real    0m5.692s
    user    0m29.948s
    sys     0m1.190s

    # 12.1 (from ubuntu 22.04)
    real    0m56.709s
    user    0m59.307s
    sys     0m0.585s

Also note, that we cannot compile gdb in the fasttest (that contains
compiler) since some images does not includes full toolchain, for
instance gdb is added in the following images:
- test-util -> test-base -> lots of other images (no toolchain)
- performance-comparison (no toolchain)
- integration-test (no toolchain)
- integration-tests-runner (no toolchain)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-06 16:25:56 +02:00
Nikolay Degterinsky
103ff7d2f9 Merge remote-tracking branch 'upstream/master' into fix-timeout-stateless-tests 2024-08-06 10:23:57 +00:00
Nikita Mikhaylov
b4a6f249ab
Merge pull request #66438 from ClickHouse/analyzer-beta
Analyzer is finally Beta
2024-08-06 09:39:29 +00:00
Raúl Marín
25fa63f7e6 Merge remote-tracking branch 'blessed/master' into unit_test_asan 2024-08-06 11:19:57 +02:00
Michael Kolupaev
f344d833fd
Merge pull request #65253 from ClickHouse/reg
attach_gdb.lib: print more information before all stacks
2024-08-06 08:18:46 +00:00
Alexey Katsman
913bc8ab3a
Merge pull request #67869 from alexkats/misc-fixes
Misc fixes
2024-08-06 04:10:41 +00:00
Michael Kolupaev
93afcd16b0 Merge remote-tracking branch 'origin/master' into reg 2024-08-05 22:10:56 +00:00
Nikolay Degterinsky
5d0c179ad1 Merge remote-tracking branch 'upstream/master' into fix-timeout-stateless-tests 2024-08-05 19:38:09 +00:00
Azat Khuzhin
618789d196 Do not pass logs for keeper explicitly in the image to allow overriding
Right now, if you will start keeper like this:

    $ cat /tmp/local.yaml
    ---
    logger:
        log:
            "@remove": remove
        errorlog:
            "@remove": remove
        console: 1
    $ docker run --name keeper -v /tmp/local.yaml:/etc/clickhouse-keeper/conf.d/local.yaml --rm -it clickhouse/clickhouse-keeper

This will still not work, because the --log-file/--errorlog-file passed
explicitly.

So this patch removes this in case config is valid, but, if keeper is
launched with embedded config, this had been left as-is, to keep
previous behavior.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 20:28:13 +02:00
Alexey Milovidov
27a06f9eec Merge branch 'master' into tighten-limits-functional-tests 2024-08-05 19:57:21 +02:00
Alex Katsman
c8805fbced Misc fixes 2024-08-05 17:41:47 +00:00
Nikita Mikhaylov
4e9c3baa25 Move analyzer to Beta stage 2024-08-05 15:29:14 +00:00
Yarik Briukhovetskyi
9b06753bb7
Merge branch 'master' into hive_style_partitioning 2024-08-05 17:02:27 +02:00
Alexey Milovidov
a416d2bc4a
Merge pull request #67791 from azat/ci/stateless-v2
ci/stateless: fix artifacts post-processing and detect if something failed there
2024-08-05 14:46:58 +00:00
Alexey Milovidov
f1a096e8f6
Merge pull request #67723 from ClickHouse/fix-log-and-exception-messages-formatting
Fix test `00002_log_and_exception_messages_formatting`
2024-08-05 12:34:33 +00:00
Alexey Milovidov
5875900189
Merge pull request #67780 from ClickHouse/fix-small-diagnostic-in-test
Fix diagnostics in the test script
2024-08-05 12:27:37 +00:00
Alexey Milovidov
6b4353b910
Merge pull request #66495 from azat/ci-images-llvm-cleanup
Ensure that llvm-symbolizer is used for symbolizing sanitizer reports
2024-08-05 12:25:32 +00:00
Azat Khuzhin
b47f8a733f ci: fix basic errors collecting after stateless tests
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-08-05 11:16:08 +02:00