Commit Graph

4959 Commits

Author SHA1 Message Date
Mikhail f. Shiryaev
e4e1aac154
Move comment about created user to a proper place 2023-10-18 14:20:21 +02:00
Mikhail f. Shiryaev
8b49a94713
Check sha512 sums for alpine server and keeper images 2023-10-18 14:20:20 +02:00
Mikhail f. Shiryaev
726c370d08
Replace temporary REPORITORY url by a proper one 2023-10-18 14:20:11 +02:00
Antonio Andelic
2eabb260a7 Correctly grep fuzzer.log 2023-10-18 12:09:22 +00:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Mikhail f. Shiryaev
4848baf302
Adjust performance artifacts prepare to the filtered checkout 2023-10-18 00:01:38 +02:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450)
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
2023-10-16 17:00:07 -07:00
Mikhail f. Shiryaev
a4fb143413
Merge pull request #50724 from AlexNik/docker-initialization-once
Initialization of the database only once in Docker.
2023-10-16 13:12:17 +02:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
54fb9a836e
Merge pull request #55503 from hanfei1991/hanfei/fix-export-logs-structure-mismatch
fix lots of 'Structure does not match' warnings in ci
2023-10-12 16:15:00 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
slvrtrn
76da9cf780 Remove old Java client tests
Revert Java client docker image JDK bump (no AArch64 available)
2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
2023-10-10 19:51:09 +02:00
Mikhail f. Shiryaev
3ed7cffbb4
Merge branch 'master' into docker-initialization-once 2023-10-10 13:40:05 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
Azat Khuzhin
ce9cdc408c Upgrade MinIO to support accepting non signed requests
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.

The problem is in this place [1].

  [1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)

And this had been added only in [2].

  [2]: https://github.com/minio/minio/pull/16484

But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update
Fix deadlock in LDAP assigned role update
2023-10-08 00:38:10 +02:00
Ilya Yatsishin
262373c9ef
Merge pull request #51435 from qoega/sources-with-subs
Build artifact with sources with submodules in Darwin special build
2023-10-07 11:07:27 +02:00
Mikhail f. Shiryaev
f525f05598 Merge remote-tracking branch 'origin/master' into sources-with-subs 2023-10-03 14:42:24 +02:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch
Remove Meilisearch
2023-10-01 01:57:04 +03:00
Alexey Milovidov
6c408c7867
Merge pull request #55071 from ClickHouse/nikitamikhaylov-patch-1
Use `source` instead of `bash` for pre-build script
2023-09-30 08:58:27 +03:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test
Fix broken test
2023-09-29 11:13:31 +02:00
robot-clickhouse
485422328d Update version_date.tsv and changelogs after v23.9.1.1854-stable 2023-09-29 07:04:45 +00:00
Yatsishin Ilya
a78311bd8c Fix typo in packager when ccache is used 2023-09-28 14:40:13 +00:00
Nikita Mikhaylov
1f78755da2
Update build.sh 2023-09-28 11:47:23 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh 2023-09-28 01:05:35 +02:00
Nikita Mikhaylov
5753c3e72f
bash -> source 2023-09-28 00:48:17 +02:00
Nikita Mikhaylov
8ac88645c8
Use different names for variables inside build.sh (#55067)
* Better

* Even better
2023-09-27 20:50:19 +02:00
Nikita Mikhaylov
02ac8d56ef
Fix prebuild scripts one more time (#55059)
* Better

* Update build.sh

I made it a little bit shorter. 
The main value here that you changed negative condition with positive one. That excludes the cases when some error occur in condition. Since some error during calculation a predicate does not mean that predicate is false logically. It means predicate is just failed. Bash is hard in distinguishing such cases.

* Update build.sh

---------

Co-authored-by: Sema Checherinda <104093494+CheSema@users.noreply.github.com>
2023-09-27 17:10:02 +02:00
kssenii
1f13e3ac92 Fix database replicated tests using the same paths for filesystem cache 2023-09-27 11:43:30 +02:00
Nikita Mikhaylov
f0b570d0c3
Fix pre-build scripts for old branches (#55032) 2023-09-26 21:59:51 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists
Implement `createIfNotExists` in Keeper natively
2023-09-26 16:04:51 +02:00
Nikita Mikhaylov
aff486dac1
Additional scripts for packager (#55000) 2023-09-26 15:59:57 +02:00
Antonio Andelic
ce583cb7fe Fix upgrade tests 2023-09-25 13:21:37 +00:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Antonio Andelic
3dbb6dcf4e Better 2023-09-22 13:47:28 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
16fc2739c6
Use xargs to parallel submodules 2023-09-20 19:09:06 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration
CI: libFuzzer integration
2023-09-20 10:01:39 +02:00
Yakov Olkhovskiy
b1b49f430a review suggestions 2023-09-19 15:32:58 +00:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
eb3a7caa74 add zip to build docker 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
0847889db6 libFuzzer infrastructure 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
Yakov Olkhovskiy
46fa7dbb80 add libFuzzer build on 'libFuzzer' label, build produces artifacts 2023-09-17 16:28:50 +00:00
Mikhail f. Shiryaev
850a6c99bf
Merge pull request #54675 from ClickHouse/disable-apk-packages
Do not build and upload apk packages, nobody uses them
2023-09-15 18:20:19 +02:00
Mikhail f. Shiryaev
c6e531ab27
Do not build and upload apk packages, nobody uses them 2023-09-15 16:48:45 +02:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter
Bugfix/local multiquery parameter
2023-09-15 11:46:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql
Implement the MySQL binary protocol implementation for initial support of Tableau Online
2023-09-14 12:27:11 +02:00
bakam412
c5c3833a80 fix tests 2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d Fix LowCardinality/Nullable columns issues 2023-09-13 23:40:31 +02:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
2023-09-11 06:18:47 +02:00
Joe Lynch
eed11c36a4
Add jq to fasttest container 2023-09-10 23:11:24 +02:00
Alexey Milovidov
aac645efdc
Merge pull request #54469 from ClickHouse/ci-instance-type
Add `instance_type` column to CI Logs and the `checks` table
2023-09-09 19:21:57 +03:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
Joe Lynch
a5b508d6c5
Fix json in header 2023-09-07 14:59:33 +02:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64
Closes #31643
2023-09-06 13:01:38 +00:00
Alexey Milovidov
12ff2d7cb1
Merge pull request #52721 from azat/musl-7
Fix calculating stack size under musl for the main thread
2023-09-05 18:37:40 +03:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 (#54246)
* Update run.sh

* Update run.sh
2023-09-05 14:55:41 +02:00
Alexey Milovidov
98f4541828
Merge pull request #54273 from ClickHouse/auto/v23.8.2.7-lts
Update version_date.tsv and changelogs after v23.8.2.7-lts
2023-09-05 01:11:40 +03:00
robot-clickhouse
926c5636dd
Merge pull request #42599 from ClickHouse/build-fuzzer-protocol
libFuzzer: add CI fuzzers build, add tcp protocol fuzzer, fix other fuzzers.
2023-09-04 22:41:54 +02:00
robot-clickhouse
0ca2c545e9 Update version_date.tsv and changelogs after v23.8.2.7-lts 2023-09-04 20:18:07 +00:00
Azat Khuzhin
d2b31f3447 Merge remote-tracking branch 'u/master' into musl-7 2023-09-04 22:01:02 +02:00
slvrtrn
4f4640ec90 Add DateTime64 support 2023-09-04 20:49:29 +02:00
Antonio Andelic
365bc584ec Merge branch 'master' into keeper-batch-flushes 2023-09-04 07:24:21 +00:00
Yakov Olkhovskiy
7afe9ca620 update build script 2023-09-03 19:57:39 +00:00
robot-clickhouse
c8e0b8267d Automatic style fix 2023-09-03 17:49:25 +00:00
Yakov Olkhovskiy
97317a07f1 remove oss-fuzz build, add fuzzers build 2023-09-03 17:28:44 +00:00
Alexander Tokmakov
b08e8940e2
Update run.sh 2023-09-02 13:34:05 +02:00
Alexander Tokmakov
d9438b176c save system tables from s3 in the report 2023-09-01 23:04:35 +02:00
robot-clickhouse
cc03880bbd Update version_date.tsv and changelogs after v23.8.1.2992-lts 2023-09-01 16:00:28 +00:00
Antonio Andelic
5f1a75ceae Fix tests 2023-09-01 12:13:33 +00:00
Mikhail f. Shiryaev
d4f21704e4
Increase distributed_ddl_task_timeout
Co-authored-by: alesapin <alesapin@clickhouse.com>
2023-09-01 11:29:33 +02:00
Mikhail f. Shiryaev
c611007694
The external logs have had colliding arguments 2023-09-01 11:25:42 +02:00
Kseniia Sumarokova
54a715da2d
Update Dockerfile 2023-08-31 14:34:41 +02:00
Kseniia Sumarokova
f4c3807547
Update Dockerfile
Better comment
2023-08-31 14:27:35 +02:00
Kseniia Sumarokova
b2c44d85c0
Update Dockerfile 2023-08-31 14:25:43 +02:00
slvrtrn
8483d1c701 Binary protocol tests 2023-08-31 13:26:27 +02:00
Mikhail f. Shiryaev
ab3e9df57f
Address review points 2023-08-30 22:06:32 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
a683d5e2f3
Replace defaul assingment by default usage 2023-08-30 22:04:34 +02:00
slvrtrn
8378441248 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-30 19:00:51 +02:00
slvrtrn
f4dd6be8a8 WIP prepared statements 2023-08-30 18:59:39 +02:00
Mikhail f. Shiryaev
c111adb7ce
Replace dlcdn.apache.org by archive domain 2023-08-30 18:40:36 +02:00
robot-clickhouse
0e277d4f90 Update version_date.tsv and changelogs after v23.7.5.30-stable 2023-08-28 10:06:28 +00:00
Alexander Tokmakov
9180c631aa
Update setup_export_logs.sh 2023-08-25 21:03:24 +03:00
Kseniia Sumarokova
4239154b44
Follow-up to #53611 2023-08-24 16:15:04 +02:00
Raúl Marín
333fc76300 Remove useless slow on client check 2023-08-22 16:30:57 +02:00
alesapin
a4ad63baa2
Merge pull request #53512 from canhld94/allow_non_standalone_keeper_integration_test
Allow non standalone keeper run in integration tests
2023-08-22 13:20:37 +02:00
kssenii
951081c8fb Merge remote-tracking branch 'upstream/master' into fix-upgrade-check 2023-08-21 19:28:19 +02:00
Maksim Kita
034ff13a05 CMake small refactoring 2023-08-21 12:51:39 +03:00
kssenii
307e5d6b9b Fix 2023-08-20 10:37:20 +02:00
Maksim Kita
21f2b10f56 Test 2023-08-19 17:38:14 +03:00
kssenii
5382442da0 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-19 08:44:36 +04:00
Alexander Tokmakov
428810a5b2
Update setup_export_logs.sh 2023-08-18 13:37:29 +03:00
Alexander Tokmakov
fdca288a73 make sending logs less fragile 2023-08-17 16:49:50 +02:00
Duc Canh Le
2406e9a987 allow non standalone keeper run in integration tests
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-08-17 11:10:35 +00:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker
Update style checker
2023-08-17 12:56:20 +02:00
Alexey Milovidov
c3e6f7e9ae Leave only simplifications 2023-08-17 03:59:15 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Mikhail f. Shiryaev
3c36af111d
Update style checker 2023-08-17 00:03:58 +02:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start 2023-08-16 01:03:29 +02:00
kssenii
164b4f0ae3 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-15 20:30:01 +04:00
Alexey Milovidov
e357702fd0 What will happen if I remove this? 2023-08-14 01:26:38 +02:00
Alexey Milovidov
e11e7c6218 Fix typos 2023-08-14 01:26:15 +02:00
Alexey Milovidov
3c6af254bc Remove something 2023-08-14 01:26:04 +02:00
Alexey Milovidov
957045c70b Maybe fix error 2023-08-13 20:15:30 +02:00
kssenii
c3b8bc0267 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-13 21:14:42 +04:00
Alexey Milovidov
d1e50b1cbf Simplification 2023-08-13 06:48:19 +02:00
Alexey Milovidov
d434e58eae Fix errors 2023-08-13 06:45:41 +02:00
Alexey Milovidov
748a65b2bb Fix error 2023-08-13 06:35:32 +02:00
Alexey Milovidov
645834ffb6 Fix errors 2023-08-13 04:54:20 +02:00
Alexey Milovidov
8dc0884099 Fix error 2023-08-13 04:20:06 +02:00
Alexey Milovidov
7132571375 Fix error 2023-08-13 04:18:07 +02:00
Alexey Milovidov
49485a6770 Fix shellcheck 2023-08-13 02:43:51 +02:00
Alexey Milovidov
fd3d0f7fa4 Merge branch 'master' into export-logs-in-ci-performance 2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2 Improvements 2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd Merge branch 'master' into export-logs-in-ci-fuzz 2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress
Export logs from CI in stress tests
2023-08-13 03:07:46 +03:00
Alexey Milovidov
ec779ca246 Export logs from CI in performance (part 2) 2023-08-13 00:32:55 +02:00
Alexey Milovidov
9f9b794feb Export logs from CI in performance (preparation) 2023-08-13 00:32:55 +02:00
Alexey Milovidov
a3ae62a1d1
Fix YAML 2023-08-13 01:18:08 +03:00
Alexey Milovidov
87a40fb02c Fix YAML 2023-08-13 00:16:40 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest
Add SQLTest
2023-08-13 00:35:46 +03:00
Alexey Milovidov
afbb91600e Export logs from CI in fuzzer 2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
f314c29386 Export logs to CI from stateful tests 2023-08-12 21:58:17 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci
Add a script to export logs in CI
2023-08-12 17:35:36 +03:00
Alexey Milovidov
0792d36415
Merge pull request #53286 from arthurpassos/pin_coredns_version_and_fix_tests
Bring back **garbage** dns tests
2023-08-12 17:24:38 +03:00
Yakov Olkhovskiy
fa7994de3b
Merge pull request #53181 from ClickHouse/ci-build-s390x
Add Linux s390x build to CI
2023-08-12 09:16:07 -04:00
Alexey Milovidov
a1d3f1836e Fix shellcheck 2023-08-12 02:46:28 +02:00
Alexey Milovidov
3b85c5ed0e Put the script into the base Docker image 2023-08-12 02:14:58 +02:00
Alexey Milovidov
9b7fcf17bc Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-11 22:54:24 +02:00
kssenii
44efd74c8d Change log level 2023-08-11 20:41:31 +02:00
Arthur Passos
1c3f926615
Merge branch 'master' into pin_coredns_version_and_fix_tests 2023-08-11 10:10:39 -03:00
Alexey Milovidov
a55f9eae84 Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-11 14:45:03 +02:00
Alexey Milovidov
736ff1c127 Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-11 01:25:49 +02:00
Yakov Olkhovskiy
ad7c60e216 fix 2023-08-10 21:08:47 +00:00
Mikhail f. Shiryaev
18a291a4c7
Upload cargo cache for rust to S3 and reuse 2023-08-10 22:41:55 +02:00
Mikhail f. Shiryaev
cbd81b3758
Partially revert changes from #52395 2023-08-10 22:09:19 +02:00
Yakov Olkhovskiy
18447022e6 add mold 2.0 to docker 2023-08-10 20:01:53 +00:00
Arthur Passos
9781a8cee9 bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query 2023-08-10 16:45:29 -03:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest 2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci 2023-08-10 16:56:14 +03:00
Alexey Milovidov
9adfcfae23
Merge pull request #53252 from ClickHouse/remove-outdated-docker
Remove outdated Dockerfile
2023-08-10 16:53:32 +03:00
Alexey Milovidov
e79c40981b
Merge pull request #53249 from ClickHouse/fix-performance-test
Remove unrecognizable garbage from the performance test
2023-08-10 16:51:56 +03:00
Alexey Milovidov
0ba3fea7fe Apply recommendations 2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a Protection if the repository is old 2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300 Address review comments 2023-08-10 04:32:39 +02:00
Alexey Milovidov
cfdccb95d5 Merge branch 'master' into export-logs-in-ci 2023-08-10 04:30:23 +02:00
Alexey Milovidov
fc3970e3ff Update readme 2023-08-10 04:30:03 +02:00
Alexey Milovidov
0b138fdf16 Remove outdated Dockerfile 2023-08-10 04:15:19 +02:00
Alexey Milovidov
f2621e70ae Remove unrecognizable garbage from the performance test 2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f Remove unrecognizable garbage from the performance test 2023-08-10 03:26:11 +02:00
Alexey Milovidov
53151610a0
Merge branch 'master' into sqltest 2023-08-10 03:47:26 +03:00
Mikhail f. Shiryaev
c7b045fdde
Process build profiles in the python script, not in docker 2023-08-09 21:48:05 +02:00
Mikhail f. Shiryaev
5341c5c8dd
Use CMAKE_FLAGS and args for cmake profiler 2023-08-09 18:26:25 +02:00
Alexey Milovidov
964c407d48
Revert "Revert "Upload build time-trace data to CI database"" 2023-08-09 16:11:17 +03:00
Alexander Gololobov
63183c56f1
Revert "Upload build time-trace data to CI database" 2023-08-09 13:58:05 +02:00
Yakov Olkhovskiy
c6c6d1ed9c fix 2023-08-09 02:42:04 +00:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Yakov Olkhovskiy
d8a231e0cb Add Linux s390x build to CI 2023-08-09 00:44:01 +00:00
Alexey Milovidov
3ffffb0b5e
Merge pull request #53100 from ClickHouse/upload-build-profile
Upload build time-trace data to CI database
2023-08-08 23:33:50 +03:00
robot-clickhouse
fe7168c1c3 Update version_date.tsv and changelogs after v23.7.4.5-stable 2023-08-08 19:16:27 +00:00
Alexey Milovidov
23eee8d10d Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-08 21:02:26 +02:00
Alexey Milovidov
8665f675c6 Investigation 2023-08-08 19:07:02 +02:00
Alexey Milovidov
65a9dd1d18 Fix style 2023-08-08 16:13:17 +02:00
Alexey Milovidov
7ce8266c8a Fix errors 2023-08-08 15:17:20 +02:00
Alexey Milovidov
a2001e15de Add jq 2023-08-08 02:32:57 +02:00
Alexey Milovidov
f1257e871d Correct the script 2023-08-08 01:46:03 +02:00
Alexey Milovidov
a38539ece0 Add missing argument 2023-08-08 00:16:22 +02:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072)
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
2023-08-07 23:25:16 +02:00
Alexey Milovidov
440424fd72 @felixoid said we do not need these 2023-08-07 21:23:39 +02:00
Alexey Milovidov
8ce4ff0f95 Merge branch 'master' of github.com:ClickHouse/ClickHouse into upload-build-profile 2023-08-07 21:18:30 +02:00
Alexey Milovidov
0bab88b7cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
Alexey Milovidov
5fa0edc3b2 Make mypy happy 2023-08-07 18:47:16 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15
Add `abort_on_error=1` to `TSAN_OPTIONS`
2023-08-07 17:17:04 +03:00
Alexey Milovidov
598a48fe22 Fix mypy 2023-08-07 14:56:50 +02:00
Alexey Milovidov
d977e221b4 Upload build time-trace data to CI database 2023-08-07 03:26:59 +02:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74 Maybe fix bash 2023-08-06 12:51:37 +02:00
Antonio Andelic
53a60ba37a Merge branch 'master' into add-reading-from-archives 2023-08-06 10:22:05 +00:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1 Fix shellcheck 2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7 YAML is mandatory 2023-08-06 02:52:36 +02:00
robot-clickhouse
f65fa627e7 Update version_date.tsv and changelogs after v23.7.3.14-stable 2023-08-05 19:26:13 +00:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2
tests: fix possible EADDRINUSE v2
2023-08-05 13:39:25 +03:00
Alexey Milovidov
39883f9373 Add missing targets 2023-08-05 02:35:44 +02:00
Nikita Taranov
555c90a50c add to integration tests 2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1 to TSAN_OPTIONS for stress tests 2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
Antonio Andelic
d4d93331dd Merge branch 'master' into add-reading-from-archives 2023-08-04 09:00:20 +00:00
Mikhail f. Shiryaev
a4185d9be0
Merge branch 'master' into sources-with-subs 2023-08-03 16:08:39 +02:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Alexey Milovidov
2c085955d1 Merge branch 'master' into sqltest 2023-08-03 15:20:22 +02:00
robot-clickhouse
659c907d38 Update version_date.tsv and changelogs after v23.7.2.25-stable 2023-08-03 09:55:00 +00:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb tests: use explicit address for console to avoid EADDRINUSE
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.

And even though this is a problem of MinIO I'm not a go developer to fix
it.

v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Mikhail f. Shiryaev
40cdfa2384
Merge branch 'master' into fix-packager 2023-08-02 11:21:54 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3 2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Mikhail f. Shiryaev
e5087d14ab
Merge branch 'master' into fix-packager 2023-08-01 12:04:06 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx
Replace kssenii/nginx-test by clickhouse/nginx-dav
2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc Disable for fasttest 2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49 Update dockerfile 2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd Merge branch 'allow-oom-stress-upgrade-checks' into move-regions 2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5 Allow OOM in Stress and Upgrade checks 2023-07-31 12:27:35 +02:00
Alexey Milovidov
9ba8bfd3b1
Merge branch 'master' into move-regions 2023-07-30 12:53:16 +03:00
Alexey Milovidov
8155659f87
Merge pull request #52775 from ClickHouse/remove-coverity-2
Remove Coverity (part 2)
2023-07-30 12:49:04 +03:00
Alexey Milovidov
6bff19bd82 Remove Coverity (part 2) 2023-07-30 10:27:33 +02:00
Alexey Milovidov
bc1f80dd82 Remove Coverity (part 2) 2023-07-30 10:25:44 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions 2023-07-30 10:34:10 +03:00
Alexey Milovidov
2a88c240ca
Merge branch 'master' into no-export-dynamic 2023-07-30 09:48:52 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile 2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6 Fix Docker 2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3 Change the default timezones in Docker test images 2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6 Fix Docker 2023-07-30 04:22:36 +02:00
Alexey Milovidov
abf058c87d Merge branch 'master' into no-export-dynamic 2023-07-30 01:49:12 +02:00
robot-clickhouse
28c49e3f20 Update version_date.tsv and changelogs after v23.7.1.2470-stable 2023-07-27 13:47:11 +00:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated
Make shutdown of `ReplicatedMergeTree` tables more soft
2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445)
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone
Randomize timezone in tests across non-deterministic around 1970 and default
2023-07-24 22:47:52 +03:00
Alexander Tokmakov
faca49a905 Merge branch 'master' into add_delay_for_replicated 2023-07-24 16:07:38 +02:00
Azat Khuzhin
2389e0f0b6 Randomize timezone in tests across non-deterministic around 1970 and default
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).

But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.

So to catch such issues in the PRs itself, let's randomize
session_timezone as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 06:13:12 +02:00
Alexey Milovidov
a17652a422 Merge branch 'master' into incbin 2023-07-24 05:33:52 +02:00
Alexey Milovidov
63659c55a1 Merge branch 'incbin' into no-export-dynamic 2023-07-23 21:34:12 +02:00
Alexey Milovidov
0f66d161d6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into no-export-dynamic 2023-07-23 21:33:51 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop 2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd Fix CI 2023-07-23 17:30:23 +02:00
Alexey Milovidov
43cf31a98e
Merge branch 'master' into no-export-dynamic 2023-07-23 07:26:33 +03:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b Sanitize compose files in integration-tests-runner 2023-07-22 15:45:47 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
de2016261e Get rid of it 2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests
Fix running integration tests with spaces in it's names
2023-07-22 03:38:51 +03:00
Alexey Milovidov
3398355e46 Add something with unclear purpose 2023-07-22 02:04:30 +02:00
Alexey Milovidov
999cce12b1 Merge branch 'master' into sqltest 2023-07-22 01:55:54 +02:00
Alexey Milovidov
fa44f84377 Fix style 2023-07-20 04:50:18 +02:00
Alexey Milovidov
f458108c44 Fix style 2023-07-19 22:15:23 +02:00
Alexey Milovidov
3c2fe6e716 Merge branch 'sqltest' of github.com:ClickHouse/ClickHouse into sqltest 2023-07-19 20:00:14 +02:00
Alexey Milovidov
29094a22cf Fix Docker 2023-07-19 20:00:00 +02:00
Yatsishin Ilya
bb4924ab63 Multiple sqllogictest improvements 2023-07-19 12:24:31 +00:00
Ilya Golshtein
4259176f24 test_for_basic_auth_registry - original zk configuration restored 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb test_for_basic_auth_registry - UnknownTopicOrPartitionException 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
robot-clickhouse
891c01e6ab Automatic style fix 2023-07-19 02:37:02 +00:00
Alexey Milovidov
9b10e0a5bc Improvement 2023-07-19 04:09:19 +02:00
Alexey Milovidov
fe59729537 Improvement 2023-07-19 04:01:00 +02:00
Alexey Milovidov
76677e009b Improvement 2023-07-19 04:00:50 +02:00
Alexey Milovidov
50dac21483 Improvement 2023-07-19 03:54:09 +02:00
Alexey Milovidov
2255307a47 Improvement 2023-07-19 03:49:47 +02:00
Alexey Milovidov
fcf4a6ea88 Fix error 2023-07-19 03:48:48 +02:00
Alexey Milovidov
174166b233 Fix error 2023-07-19 03:47:41 +02:00
Alexey Milovidov
df5abcf685 Update Docker 2023-07-19 03:45:43 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Antonio Andelic
3c2507ad7d
Merge branch 'master' into fix-packager 2023-07-18 09:18:03 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-17 17:17:21 +02:00
Mikhail f. Shiryaev
0ba38b4dde
Merge branch 'master' into sources-with-subs 2023-07-17 14:04:02 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-13 14:25:24 +02:00
John Spurlock
7c7a447fd2
Fix a few typos in docker readme. 2023-07-11 12:16:55 -05:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind
Force libunwind usage (removes gcc_eh support)
2023-07-09 05:38:34 +02:00
robot-clickhouse
45d36b736a Update version_date.tsv and changelogs after v23.6.2.18-stable 2023-07-08 23:14:02 +00:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support)
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720 Allow OOM in AST Fuzzer with Sanitizers 2023-07-08 05:57:23 +02:00
Alexey Milovidov
d15723997b
Merge pull request #51863 from ClickHouse/remove-useless-packages
Remove useless packages
2023-07-08 02:21:07 +03:00
Alexey Milovidov
f8eaa3e8e6
Merge pull request #51903 from azat/build/pin-rust
Pin rust nightly (to make it stable)
2023-07-07 20:28:57 +03:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages 2023-07-07 13:44:13 +03:00
Alexey Milovidov
6cfeef00d7
Merge pull request #31398 from ClickHouse/riscv-in-ci
Add Linux RISC-V 64 build to CI
2023-07-06 22:49:16 +03:00
Azat Khuzhin
ec5e26a017 Pin rust nightly (to make it stable)
Because of using Rust nightly, and without #49601 the Rust toolchain is
very unstable, and can be frequently failed.

So let's ping particular version.

Also I've looked and it seems that Rust archives stores this archive
without any TTL, since there is even a version for 2015 year.

Follow-up for: #50541
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-06 21:17:50 +02:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2 2023-07-06 21:10:41 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error 2023-07-06 16:09:52 +02:00
Antonio Andelic
f825c85c72
Merge branch 'master' into fix-packager 2023-07-06 08:36:43 +02:00
Antonio Andelic
085f7caccf Move config changes after configure 2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55 Remove useless packages 2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks
Fix disk config for upgrade tests
2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b Correctly move config 2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce 2023-07-05 10:28:57 +02:00
Alexey Milovidov
1eaa2e9d30
Merge branch 'master' into no-export-dynamic 2023-07-04 22:37:46 +03:00
Alexey Milovidov
1eafba60d2 Merge branch 'master' into riscv-in-ci 2023-07-04 21:28:05 +02:00
Antonio Andelic
5b31c714a0
Merge branch 'master' into fix-packager 2023-07-04 15:48:31 +02:00
Alexey Milovidov
aa2b8aa893
Merge pull request #51769 from ClickHouse/mypy-1.4.0
Version mypy=1.4.1 falsly reports unused ignore comment
2023-07-04 16:45:57 +03:00
Antonio Andelic
3277e4b5bd Fix build type in packager 2023-07-04 11:22:19 +00:00
Antonio Andelic
6d3dbae8aa Merge remote-tracking branch 'origin/docs-packaging' into fix-packager 2023-07-04 11:21:53 +00:00
Alexey Milovidov
463c2ba5ce
Revert "Add documentation for building in docker" 2023-07-04 14:07:10 +03:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment 2023-07-04 13:05:41 +02:00
Mikhail f. Shiryaev
c715ee5cef
Replace --build-type=debug by --debug-build 2023-07-03 19:58:47 +02:00
Mikhail f. Shiryaev
469da1831a
Replace --build-type=debug by --debug-build 2023-07-03 17:42:15 +02:00
Mikhail f. Shiryaev
d0c3847427
Fix source image for sqllogic 2023-07-03 12:29:12 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation
Fix a logical error on mutation
2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824 Add odbcinst dep to sqllogic docker 2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4 Make scripts backwards compatible 2023-07-02 09:57:06 +00:00
Antonio Andelic
d8238086c6
Merge branch 'master' into better-gdb-wait 2023-07-01 10:39:49 +02:00
robot-clickhouse
8ed1ec49d1 Update version_date.tsv and changelogs after v23.6.1.1524-stable 2023-06-30 15:21:13 +00:00
Antonio Andelic
00aeb407e5 Wait with retries 2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker
Update tests' docker containers
2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create 2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0 Retry chroot creation in ZK 2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
ef55e4e94d
Merge pull request #51561 from ClickHouse/ci-for-backports
Decoupled commits from #51180 for backports
2023-06-29 16:04:43 +02:00
robot-clickhouse
5656d18690 Update version_date.tsv and changelogs after v23.5.4.25-stable 2023-06-29 13:36:55 +00:00
Alexander Nikolaev
885136fce0 Fix missing / 2023-06-29 15:59:22 +03:00
Alexander Nikolaev
cffc1e058c Initialization of the database only once. 2023-06-29 15:57:55 +03:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests 2023-06-29 12:24:19 +02:00
Mikhail f. Shiryaev
92d7b067b0
Bring back lost /tmp cleanup in clickhouse-server docker image 2023-06-28 23:39:08 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker 2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
91dc6dfe34
Update mysql-php-client to the recent rolling version 2023-06-28 22:19:39 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too 2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
edcf981c48
Update mysql odbc connector 2023-06-28 22:19:31 +02:00
Mikhail f. Shiryaev
5a8ce1f2fe
Do not upload the binaries for fast-tests to tests-reports 2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images 2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
7b4e6faece
Speedup the submodules cloning 2023-06-28 22:19:28 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images 2023-06-28 22:11:48 +02:00
Mikhail f. Shiryaev
67a7bdbb3a
Rollback note about 22.04 in #50958 2023-06-28 10:45:07 +02:00
Ilya Yatsishin
92db3c0c70
Merge branch 'master' into sources-with-subs 2023-06-28 10:38:19 +02:00
Mikhail f. Shiryaev
1cd5ae36bd
Get rid of deprecated apt-key 2023-06-28 10:32:21 +02:00
Mikhail f. Shiryaev
6d2b5166b9
Update golang version in builder 2023-06-28 10:32:20 +02:00
Mikhail f. Shiryaev
a2c4546c00
Downgrade the base image to address issues on old dockerd 2023-06-28 10:32:19 +02:00
Mikhail f. Shiryaev
6145baade8
Upgrade OS only once
The ubuntu images are updated twice a month, it makes sense to do
upgrade
https://github.com/docker-library/official-images/commits/master/library/ubuntu
2023-06-28 10:32:19 +02:00
Mikhail f. Shiryaev
04a08b47f3
Reorganize installation of clickhouse to have separated layers 2023-06-28 10:32:18 +02:00
Ilya Yatsishin
a9cb4d1b3d Better tar 2023-06-27 12:32:32 +02:00
Alexey Milovidov
de58339c3b Merge branch 'fix-perf-tests-jemalloc' of github.com:azat/ClickHouse into many-fixes 2023-06-27 05:35:26 +02:00
Ilya Yatsishin
ed6bfd66fe Publish changes 2023-06-26 17:28:59 +02:00
Alexey Milovidov
4ee74ec213 Two tests are twice longer in average with Analyzer and sometimes failing 2023-06-26 02:19:52 +02:00
Azat Khuzhin
5871ca0836 Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled
jemalloc can show the following warning:

    Number of CPUs detected is not deterministic. Per-CPU arena disabled

It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()

And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:

    smpboot: Allowing 128 CPUs, 64 hotplug CPUs

And from sysfs:

    # grep . /sys/devices/system/cpu/{possible,online,offline}
    /sys/devices/system/cpu/possible:0-127
    /sys/devices/system/cpu/online:0-63
    /sys/devices/system/cpu/offline:64-127

From ACPI:

    # acpidump -o acpi
    # acpixtract -a acpi
    # iasl -d *.dat
    # grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
        64                            Processor Enabled : 0
        64                            Processor Enabled : 1

So I guess this is the same as what happened in this perf run [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html

P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-25 09:37:37 +02:00
Alexander Tokmakov
f973bd7516 suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling
Improve scheduling of background tasks in ReplicatedMergeTree
2023-06-20 16:25:19 +03:00
Alexander Tokmakov
5dd9b10c8e fix 2023-06-19 20:14:28 +02:00
Yatsishin Ilya
b472480d48 Fix branch name 2023-06-19 10:06:56 +00:00
robot-clickhouse
fbcec61aec Update version_date.tsv and changelogs after v22.8.19.10-lts 2023-06-17 14:01:58 +00:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log 2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main 2023-06-16 00:28:09 +02:00
Denny Crane
c142ed8a06
Merge branch 'master' into patch-51 2023-06-14 17:39:00 -03:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone
Fix 'Illegal column timezone' in stress tests
2023-06-14 17:56:57 +03:00
Denny Crane
404a52432c
Update README.md 2023-06-13 19:39:23 -03:00
Denny Crane
d8d5700810
Update README.md 2023-06-13 19:24:36 -03:00
Denny Crane
a570b00bdf
Update README.md 2023-06-13 19:19:34 -03:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits 2023-06-13 17:53:19 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests
Attach gdb in stateless tests
2023-06-13 17:04:17 +03:00
Alexander Tokmakov
3a2fa65075 fix 'Illegal column timezone' in stress tests 2023-06-13 16:02:54 +02:00
Mikhail f. Shiryaev
a7408170c8
Use H3 2023-06-12 11:21:43 +02:00
Robert Schulze
6b2c33b1e4
Document x86 / ARM prerequisites for Docker image 2023-06-12 09:16:22 +00:00
Alexey Milovidov
fef63351bb
Merge branch 'master' into no-export-dynamic 2023-06-11 19:56:00 +03:00
robot-clickhouse
296b11a1ae Update version_date.tsv and changelogs after v23.5.2.7-stable 2023-06-10 20:56:54 +00:00
alesapin
a614aa3b03 More leftovers 2023-06-10 16:06:37 +02:00
alesapin
20b66689f3 Fix test 2023-06-10 13:34:51 +02:00
robot-clickhouse
61a20468f7 Update version_date.tsv and changelogs after v23.5.1.3174-stable 2023-06-09 11:53:29 +00:00
Kruglov Pavel
5b3cece42e
Fix shellcheck 2023-06-06 12:23:00 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow
Fail perf tests when too many queries slowed down
2023-06-06 11:33:04 +02:00
avogar
e8c6c7967b Move attaching gdb to separate lib 2023-06-05 18:21:40 +00:00
Alexey Milovidov
5d26b0cf7c
Merge pull request #50550 from cmsxbc/misc-darwin-build
skip extracting darwin toolchain in builder when unncessary
2023-06-05 11:11:34 +03:00
Alexey Milovidov
47379ac039
Update build.sh 2023-06-05 03:58:42 +03:00
Azat Khuzhin
bf127f4e1e MSan support for Rust
Previously you have to unpoison memory from the Rust, however Rust does
supports MSan, so let's simply use it.

But for this we need nightly Rust and recompile standard library.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-06-04 23:04:55 +02:00
cmsxbc
4bb44c7c72
1. skip extract darwin toolchain in builder when uncessary
2. update MacOSX SDK version in toolchain readme to match in builder
2023-06-04 23:06:21 +08:00
Nikita Taranov
4506299d73 impl 2023-06-02 23:14:09 +02:00
avogar
8973259678 Test attach gdb in stateless tests 2023-06-02 15:00:24 +00:00
Alexander Tokmakov
1544067fb3
Update run.sh 2023-06-01 23:28:19 +03:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780)
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
2023-05-25 12:50:14 +03:00
Azat Khuzhin
73661c3a46 Move tunnings for woboq codebrowser to cmake out from build.sh
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-18 18:18:30 +02:00
Mikhail f. Shiryaev
e79c1cdb1a
Attempt to increas parallelism for codebrowser_generator 2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
65d1ae77ee
Use updated upstream woboq 2023-05-12 19:22:49 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary 2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
ec701d96c7
Rework the codebrowser build directories structure 2023-05-12 19:22:47 +02:00
Mikhail f. Shiryaev
7614c1c848
Move the command for codebrowser into a script 2023-05-12 19:22:45 +02:00
Azat Khuzhin
a0cc5b7e47 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu
support named fault injection and add a simple test
2023-05-10 15:51:51 +02:00
Han Fei
505d9be7b2 address comments 2023-05-10 13:56:17 +02:00
Azat Khuzhin
be39e8e566 Merge remote-tracking branch 'u/master' into build/llvm-16
Conflicts:
	docker/test/codebrowser/Dockerfile
2023-05-09 20:40:43 +02:00
Mikhail f. Shiryaev
780b5a6f97
Fix a wrong built generator removal, use depth=1 2023-05-09 12:36:02 +02:00
Azat Khuzhin
bf17c819c3 docker: fix path to clang builtin headers for woboq code browser
By default woboq uses $version.$minor.$patch, while clang simply uses
$version:

    CMake Error at generator/CMakeLists.txt:77 (message):
      Could not find any clang builtins headers in
      /usr/lib/llvm-16/lib/clang/16.0.4/include

    # ls -d /usr/lib/llvm-16/lib/clang/16/include
    /usr/lib/llvm-16/lib/clang/16/include

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:31:55 +02:00
Azat Khuzhin
08b8b7e587 docker: remove symlink for libclang (not required anymore)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:30:02 +02:00
Azat Khuzhin
82536fedde docker: install libclang-16-dev for woboq code browser
Otherwise you will get the following error:

    CMake Error at /usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake:792 (message):
      The imported target "clangBasic" references the file

         "/usr/lib/llvm-16/lib/libclangBasic.a"

      but this file does not exist.  Possible reasons include:

      * The file was deleted, renamed, or moved to another location.

      * An install or uninstall procedure did not complete successfully.

      * The installation package was faulty and contained

         "/usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake"

      but not all the files it references.

    Call Stack (most recent call first):
      /usr/lib/llvm-16/lib/cmake/clang/ClangConfig.cmake:20 (include)
      generator/CMakeLists.txt:7 (Find_Package)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-09 10:25:50 +02:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
Azat Khuzhin
c525d13272 Enable back thread fuzzuer under TSan
Since initial issue got resolved [1].

  [1]: https://github.com/google/sanitizers/issues/1540

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-08 22:35:09 +02:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Alexey Milovidov
8cd9fc4a2d Fix build 2023-05-06 23:52:16 +02:00
Alexey Milovidov
763c98bd70 Fix typo 2023-05-06 23:40:19 +02:00
Dmitry Novik
a3b3b78eb0 EXPECTED_TO_FAIL -> NOT_FAILED 2023-05-05 17:53:15 +00:00
Dmitry Novik
0baaaaba42 KNOWN_BROKEN -> BROKEN 2023-05-05 17:43:54 +00:00
Dmitry Novik
5422e3058f Use more specific test status 2023-05-05 16:19:01 +00:00
Dmitry Novik
b13e3abc4d Improve CI check for Analyzer 2023-05-05 15:17:16 +00:00
alesapin
08039024a2
Merge pull request #49492 from ClickHouse/add_server_jepsen_image
Fixes in server jepsen image
2023-05-04 12:02:27 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
2023-05-04 11:47:43 +02:00
alesapin
27f9384717 Followup 2023-05-03 23:33:19 +02:00
alesapin
c1d8fab2da Fxi 2023-05-03 21:05:19 +02:00
alesapin
6e8934f856 Improve image for local run 2023-05-03 14:40:18 +02:00
alesapin
fad187fa8a Add image for docker-server jepsen 2023-05-03 14:38:56 +02:00
robot-clickhouse
b7d641cebe Update version_date.tsv and changelogs after v23.4.2.11-stable 2023-05-02 16:39:28 +00:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Kseniia Sumarokova
d4aa96e262
Merge branch 'master' into better-local-object-storage 2023-04-28 21:05:05 +02:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage 2023-04-27 14:54:04 +02:00
robot-clickhouse
3448b112d8 Automatic style fix 2023-04-27 12:31:00 +00:00
Alexey Milovidov
8eae3ed3a5 Fix garbage #48719 2023-04-27 13:48:23 +02:00
robot-clickhouse
904461773d Update version_date.tsv and changelogs after v23.4.1.1943-stable 2023-04-26 23:50:52 +00:00
Kseniia Sumarokova
c4abe66d77
Update run.sh 2023-04-25 12:25:49 +02:00
Dmitry Novik
0d3e896f57
Merge pull request #48719 from ClickHouse/analyzer-ci
Add CI run with new analyzer enabled
2023-04-24 17:36:18 +02:00
Mikhail f. Shiryaev
055a72d54f
Remove the comment to rebuild the docker image 2023-04-24 11:21:09 +02:00
kssenii
f38dfc9206 Update run.sh 2023-04-23 12:49:22 +02:00
kssenii
24b75329f0 Merge remote-tracking branch 'origin/better-local-object-storage' into better-local-object-storage 2023-04-23 12:41:22 +02:00
kssenii
d8023806a9 Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-23 12:39:34 +02:00
robot-clickhouse
9a3600bda5 Update version_date.tsv and changelogs after v23.3.2.37-lts 2023-04-22 15:54:55 +00:00
Kseniia Sumarokova
370aa60159
Update run.sh 2023-04-21 22:10:06 +02:00
robot-clickhouse
eda1379180 Automatic style fix 2023-04-21 19:04:36 +00:00
Dmitry Novik
5fef967872 Make error message better 2023-04-21 18:11:54 +00:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci 2023-04-21 15:43:16 +02:00
kssenii
e58c16318f Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-21 12:49:40 +02:00
kssenii
88f412ad23 Fix upgrade check, fix integration test 2023-04-21 12:44:08 +02:00
Mikhail f. Shiryaev
634cf010b9
Merge pull request #48935 from ClickHouse/fasttests-build-time
Add building stage to the fasttests report, respect existing status on rerun
2023-04-20 15:50:18 +02:00
Mikhail f. Shiryaev
c80d8081d2
Add building stage to the fasttests report 2023-04-19 13:35:28 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS 2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup 2023-04-19 09:44:53 +02:00
Dmitry Novik
308970da83 Add logging 2023-04-18 13:53:13 +00:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
6197d3d55f Pass volume only for analyzer 2023-04-18 00:12:30 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Dmitry Novik
3df33d74f5 Get rid of another docker image 2023-04-13 17:22:12 +02:00
kssenii
4bf01c611c Fix 2023-04-13 16:56:11 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
robot-clickhouse
fa7b72570b Automatic style fix 2023-04-12 17:09:37 +00:00
Dmitry Novik
360fc59694 Handle known broken tests 2023-04-12 16:46:30 +00:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
Azat Khuzhin
61bf70be12 Add second_deadlock_stack=1 for TSan on CI
To improve TSan reports.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:05:57 +02:00
kssenii
00282483c9 Address remaining review comments 2023-04-07 18:29:55 +02:00
kssenii
c40f17a276 One more attempt 2023-04-06 20:09:06 +02:00
kssenii
4a94074f71 Try fix java errors in CI 2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91 Remove redundant from dockerd-entrypoint.sh 2023-04-05 14:40:30 +02:00
kssenii
8915f49b7d Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-03 17:43:42 +02:00
robot-clickhouse
0c9d7f73ce Update version_date.tsv and changelogs after v23.3.1.2823-lts 2023-03-31 10:35:58 +00:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
Mikhail f. Shiryaev
1c58a911eb
Push clickhouse-keeper as both w/ and w/o suffix -alpine 2023-03-30 18:07:40 +02:00
Mikhail f. Shiryaev
7ff582b963
Deprecate ENABLE_CCACHE and replace it by COMPILER_CACHE 2023-03-29 23:33:31 +02:00
Mikhail f. Shiryaev
def5ae851e
Use CTCACHE_DIR only with ccache 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
f1b1f30764
Make --ccache-dir equal to --ccache_dir 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
fcc14ae724
Enable s3 caching 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
6d8da8f88b
Add sccache and ctcache S3 parameters, don't use 2023-03-29 23:33:27 +02:00
Mikhail f. Shiryaev
df17a35410
Get rid of useless cache_maxsize parameter 2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
2d872ff23b
Add a function to parse arguments 2023-03-29 23:33:26 +02:00
Mikhail f. Shiryaev
419f234294
Fix logic for --force-build-image 2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
3b1291eb0e
Replace distcc with sccache in packager 2023-03-29 23:33:25 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests 2023-03-29 23:33:24 +02:00
Mikhail f. Shiryaev
c994c41e74
Fix logging formatting 2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
648697f085
Add main function, use specific exception in packager 2023-03-29 23:33:23 +02:00
Mikhail f. Shiryaev
cd5852f11a
Add typing and rewrite packager to pathlib.Path 2023-03-29 23:33:21 +02:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Raúl Marín
ff209db129
Merge branch 'master' into zk_inject_timeout 2023-03-27 19:46:10 +02:00
Raúl Marín
c47dcb0805 Enable ZK fault injection on new servers (but not during startup) 2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix
Artifacts s3 prefix
2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files
Apply black formatter to all python scripts
2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread
Fix terminate in parts check thread
2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix 2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX 2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe fix 2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 (#47858) 2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e apply black to all python scripts 2023-03-20 17:30:20 +00:00
Alexey Milovidov
0f7f620100 Update one more place 2023-03-19 01:07:11 +01:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad fix intersecting parts, better fault injections 2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881 ci/upgrade: remove obsolete function call
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7 ci/upgrade: fix creating system database with Ordinary engine
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-14 14:12:32 +01:00
robot-clickhouse
363989f3f8 Update version_date.tsv and changelogs after v23.2.4.12-stable 2023-03-10 17:56:29 +00:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper
Fix Keeper with `force_sync = false`
2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9 Use force_sync=true in upgrade check 2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880 suppress expected errors from test 01111 in Upgrade check 2023-03-08 15:27:43 +01:00
robot-clickhouse
e50fd6e1ef Update version_date.tsv and changelogs after v23.2.3.17-stable 2023-03-06 16:35:17 +00:00
Alexander Tokmakov
d34f00f437
Update run.sh 2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa Suppress "Cannot flush" for Distributed tables in upgrade check
CI reports [1]:

    2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
    2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Kruglov Pavel
4e0a4e56c9
Add upgrade check to stateful dependent field 2023-02-28 17:45:04 +01:00
avogar
cc02de69d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-27 19:49:33 +00:00
Julio Jimenez
76d0fb3cac
🐳 Update Ubuntu Image (#46784)
* 🐳 Update Ubuntu Image

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* Ready for testing

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

* add back wget

Signed-off-by: Julio Jimenez <julio@clickhouse.com>

---------

Signed-off-by: Julio Jimenez <julio@clickhouse.com>
2023-02-27 14:43:16 -05:00
Pradeep Chhetri
af3b8d5cbd
Revert "Add join_algorithm='grace_hash' to stress tests" 2023-02-28 02:15:15 +08:00
Kruglov Pavel
261c3aa86d
Update 2023-02-27 16:42:29 +01:00
Alexey Milovidov
44f9688fa4
Merge pull request #45607 from chhetripradeep/pchhetri/add-grace-hash-stress
Add join_algorithm='grace_hash' to stress tests
2023-02-27 08:32:03 +03:00
Pradeep Chhetri
389803ca62
Merge branch 'master' into pchhetri/fix-query-in-stress 2023-02-27 11:27:16 +08:00
Pradeep Chhetri
c8dcea9539
Merge branch 'master' into pchhetri/add-grace-hash-stress 2023-02-27 11:26:48 +08:00
avogar
ff67fc4b06 Remove llvm-9 from dependencies 2023-02-24 16:59:27 +00:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
robot-clickhouse
f2e71bc3b7 Update version_date.tsv and changelogs after v23.2.1.2537-stable 2023-02-23 19:46:46 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests (#46641)
* Avoid OOM in perf tests

At some point perf tests started to fail for one setup on CI [1]:

    /home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed                  python3 performance_comparison_check.py "$CHECK_NAME"
    Error: Process completed with exit code 137.

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-23 14:05:18 +01:00
Alexey Milovidov
4adbcd4beb
Merge pull request #46665 from ClickHouse/clean-docs-release
Get rid of legacy DocsReleaseChecks
2023-02-22 00:31:17 +03:00
Alexander Tokmakov
dcf8aeab8f
Update stress 2023-02-21 22:16:05 +03:00
Alexey Milovidov
bf5640a597
Merge pull request #46629 from ClickHouse/fix-coverity
Fix coverity
2023-02-21 21:04:20 +03:00
Mikhail f. Shiryaev
cd2ab02f22
Get rid of legacy DocsReleaseChecks 2023-02-21 17:34:16 +01:00
Alexander Tokmakov
97e9df0148
Update stress 2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests (#41534)
* Update stress

* fix

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2023-02-21 15:36:23 +03:00
Alexey Milovidov
d0d6306102 Fix coverity 2023-02-21 00:46:27 +01:00
Alexander Tokmakov
669c4e94d5
Update compare.sh 2023-02-20 17:35:30 +03:00
Mikhail f. Shiryaev
c64c3e3854
Merge pull request #46535 from ClickHouse/autoupdate-keeper-dockerfile
Autoupdate keeper dockerfile
2023-02-18 11:21:29 +01:00
Mikhail f. Shiryaev
ecf33b9059
Update the VERSION for clickhouse-keeper Dockerfile 2023-02-17 18:39:43 +01:00
Azat Khuzhin
5a5f99a27e Add CPU flamegraphs for perf tests
In Real profiler there is too much noise (polling, cond vars, ...)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress
Revert "Merge pull request #38212 from azat/no-stress"
2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Alexander Gololobov
d0f402fa5b
Merge pull request #46391 from ClickHouse/debug-docker
Easy debugging of clickhouse-server in Docker
2023-02-16 14:09:43 +01:00
alesapin
d08b2753e4
Merge pull request #46367 from ClickHouse/reduce-keeper-build-time
Do not build libclickhouse-keeper-lib.a for standalone keeper
2023-02-16 13:56:27 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress"
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Alexey Milovidov
c2660646fe
Merge branch 'master' into debug-docker 2023-02-15 15:59:49 +03:00
Mikhail f. Shiryaev
08ffb8f93d
Install only "programs" directory during build 2023-02-15 11:49:19 +01:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00