Commit Graph

3027 Commits

Author SHA1 Message Date
Alexey Milovidov
1d02f9e296
Merge pull request #35942 from ClickHouse/snyk-fix-d2de427965e212a701b47d65ca7642bc
[Snyk] Security upgrade node from 8 to 16.14.2
2022-04-05 19:21:43 +03:00
Alexander Tokmakov
1fe50ad201 Merge branch 'master' into mvcc_prototype 2022-04-05 14:38:02 +02:00
Alexander Tokmakov
da00beaf7f Merge branch 'master' into mvcc_prototype 2022-04-05 11:14:42 +02:00
Mikhail f. Shiryaev
12ac4cc731
Merge pull request #35945 from ClickHouse/keeper-docker-image
Fix keeper image for `arm64`
2022-04-05 10:48:37 +02:00
Nikita Mikhaylov
61183ac07b Done 2022-04-04 22:24:39 +00:00
Mikhail f. Shiryaev
4d7618585b
Fix WORKDIR issue after upgrading npm 2022-04-05 00:10:33 +02:00
snyk-bot
e78ff3ea7b
fix: docker/test/integration/mysql_js_client/Dockerfile to reduce vulnerabilities
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON27-341379
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-1063181
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-340072
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-453739
- https://snyk.io/vuln/SNYK-DEBIAN9-PYTHON35-584435
2022-04-04 21:20:18 +00:00
Mikhail f. Shiryaev
d475ce5d16
Fix building ubuntu image from deb-repo 2022-04-04 18:50:50 +02:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Nikita Mikhaylov
279defbe9f
Add clickhouse-keeper Dockerfile 2022-04-01 12:32:26 +02:00
Mikhail f. Shiryaev
b950b53156
Make multiarch clickhouse-server Dockerfiles 2022-04-01 11:59:49 +02:00
Mikhail f. Shiryaev
c053f1cb1d
Rewrite alpine building to pure Dockerfile 2022-04-01 11:59:46 +02:00
Mikhail f. Shiryaev
1b53993560
Make Dockerfile.ubuntu a default image definition 2022-04-01 11:59:46 +02:00
Mikhail f. Shiryaev
fbb6787a45
Rename Dockerfile to Dockerfile.ubuntu 2022-04-01 11:59:45 +02:00
Mikhail f. Shiryaev
4cc37ae9f3
Clean stale code 2022-04-01 11:59:44 +02:00
Nikita Mikhaylov
5f27f690f4 Revert "Added support for schema inference for hdfsCluster (#35602)"
This reverts commit f6bfdcc0c9.
2022-03-31 14:19:56 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster (#35602) 2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
tavplubix
5680f53ed4
Merge pull request #35773 from azat/stateless-tests-artifacts
ci: replace directory system log tables artifacts with tsv
2022-03-31 12:16:48 +03:00
Azat Khuzhin
8b84829e93 ci: replace directory system log tables artifacts with tsv
Changelog:
- remove query_thread_log (query_log should be enough)
- for s3 storage there /var/lib/clickhouse/data/system/*_log cannot be
  used, replace them with plain TSVWithNamesAndTypes, also note, that
  after schema inference it is even pretty easy to use
- support replicated database env correctly

Co-authored-by: tavplubix <tavplubix@clickhouse.com>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 21:50:55 +03:00
kssenii
0fc92fe2aa Get rid of all "remote" mentions 2022-03-30 17:15:29 +02:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8 run stateful tests in parallel 2022-03-29 15:24:29 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
alesapin
a38f63af2d
Merge pull request #35676 from ClickHouse/remove_outdated_links
Remove outdated links from CI
2022-03-28 21:24:45 +02:00
alesapin
7ab8d7178c
Merge pull request #35308 from ClickHouse/clickhouse-keeper
New package clickhouse-keeper
2022-03-28 21:23:17 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
tavplubix
239be83757
Merge pull request #35669 from ClickHouse/fast_test_disable_rand_settings
Disable random settings in Fast Test
2022-03-28 17:06:12 +03:00
alesapin
b838a7dcb0 Remove outdated links from CI 2022-03-28 15:53:22 +02:00
Alexander Tokmakov
e795b83148 disable random settings in fast test 2022-03-28 14:56:23 +02:00
Kruglov Pavel
18ab49e788
Check all logs for crashes, logical errors, etc in backward compatibility check 2022-03-25 11:59:50 +01:00
alesapin
c95a9971bc Merge branch 'master' into clickhouse-keeper 2022-03-25 11:22:57 +01:00
Mikhail f. Shiryaev
b2863d4cea
Rebuild docs-check for a test 2022-03-24 16:24:07 +01:00
mergify[bot]
03c8a59a57
Merge branch 'master' into stress-test 2022-03-23 17:37:05 +00:00
Alexander Tokmakov
bcec53aadc Merge branch 'master' into mvcc_prototype 2022-03-23 11:28:43 +01:00
Kruglov Pavel
5efad9699c
Update run.sh 2022-03-23 11:28:40 +01:00
Kruglov Pavel
8ef2f13524
Update run.sh 2022-03-23 11:26:31 +01:00
Kruglov Pavel
034d92d817
Fix removing empty files 2022-03-22 18:06:35 +01:00
Mikhail f. Shiryaev
e6f5a3f98b
Apply black formatter to all *.py files in the repo 2022-03-22 17:39:58 +01:00
Mikhail f. Shiryaev
5fea6d24fa
Add black formatting check 2022-03-22 17:38:48 +01:00
Mikhail f. Shiryaev
1e0ad94d67
Add a stand alone clickhouse-keeper package 2022-03-22 15:05:29 +01:00
alesapin
0ab9a9c0f6
Merge pull request #33664 from ClickHouse/release-steps
Refactor releasing process
2022-03-22 14:43:18 +01:00
avogar
c5245c1ad1 Improve backward compatibility check and stress test 2022-03-22 12:00:20 +00:00
Mikhail f. Shiryaev
b9cb64a4a1
Add apk package and reports 2022-03-22 11:11:38 +01:00
Mikhail f. Shiryaev
d55785156b
Fix always success builds by move ts to build.sh 2022-03-22 11:10:03 +01:00
Mikhail f. Shiryaev
9ad31e983c
Fix compiler interpolation 2022-03-22 11:10:02 +01:00
Mikhail f. Shiryaev
0dd1f4af76
Rename alien arguments and parameters 2022-03-22 11:10:01 +01:00
Mikhail f. Shiryaev
70945764e5
Fix a tiny typo 2022-03-22 11:10:00 +01:00
Mikhail f. Shiryaev
342f7ba567
Migrate to nfpm 2022-03-22 11:09:59 +01:00
Mikhail f. Shiryaev
04e9d1b9f6
Add default values for some arguments of packager 2022-03-22 11:09:58 +01:00
Mikhail f. Shiryaev
2bed5ba0ad
Fix pylint issues 2022-03-22 11:09:57 +01:00
Mikhail f. Shiryaev
f4f60311ce
Apply black to docker packager 2022-03-22 11:09:55 +01:00
Alexander Tokmakov
3c762f566d Merge branch 'master' into mvcc_prototype 2022-03-21 20:16:29 +01:00
avogar
288d08f3f2 Add retries in backward compatibility check 2022-03-21 17:26:24 +00:00
mergify[bot]
5295dd0ef2
Merge branch 'master' into stress-test 2022-03-17 11:10:37 +00:00
Alexander Tokmakov
4b3e13a4fe Merge branch 'master' into mvcc_prototype 2022-03-16 21:06:19 +01:00
Kruglov Pavel
fa6d963f83
Update run.sh 2022-03-16 12:30:45 +01:00
Kruglov Pavel
6b3a25e20d
Update run.sh 2022-03-15 17:15:17 +01:00
Alexander Tokmakov
9702b5177d Merge branch 'master' into mvcc_prototype 2022-03-14 21:45:38 +01:00
alesapin
1edd4347fc Hope I'll fix it 2022-03-14 21:43:51 +01:00
avogar
b9496af3b3 Fix tests 2022-03-14 16:40:17 +00:00
alesapin
2f8da04891 Fix timezones 2022-03-14 13:46:45 +01:00
Alexey Milovidov
d0716b035f
Revert "Change timezone in Docker" 2022-03-13 04:03:06 +03:00
Alexey Milovidov
6b9129c494 Change timezone in Docker 2022-03-11 23:21:45 +01:00
Kruglov Pavel
3d36eced2d
Update run.sh 2022-03-10 17:55:45 +03:00
Kruglov Pavel
91b9c11939
Increase the number of attempts to start server 2022-03-10 14:38:39 +03:00
mergify[bot]
78c8029aeb
Merge branch 'master' into stress-test 2022-03-09 16:22:45 +00:00
kssenii
5260822964 Merge master 2022-03-08 18:21:28 +01:00
Alexander Tokmakov
8acfb8d27f Merge branch 'master' into mvcc_prototype 2022-03-07 17:40:15 +01:00
Kseniia Sumarokova
28b9ec01c0
Merge pull request #34945 from bigo-sg/hive_bug_fixed
unexpected result when use `in` in hive query
2022-03-07 17:13:11 +01:00
Mikhail f. Shiryaev
ef4a969ed9
Merge pull request #34850 from ClickHouse/new-packages-url
New packages url
2022-03-07 13:34:58 +01:00
lgbo-ustc
68fb92edf2 update hive server image 2022-03-07 10:36:12 +08:00
Kruglov Pavel
dbba752398
Merge branch 'master' into stress-test 2022-03-04 18:33:37 +03:00
Kruglov Pavel
0f90996bb8
Update run.sh 2022-03-04 14:24:24 +03:00
Azat Khuzhin
15bbc5537b fasttest: add --print-time for "Test time" column in the results table
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-03 15:44:41 +03:00
Azat Khuzhin
b2ed5552cc fasttest: use bash arrays over wrap lines with backslash
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-03 15:44:41 +03:00
lgbo-ustc
21c164ad2c update tests 2022-03-02 14:20:59 +08:00
lgbo-ustc
2ff7ff90fa update tests 2022-03-02 14:17:04 +08:00
kssenii
a594f388a4 Merge master 2022-03-01 19:43:45 +01:00
Kruglov Pavel
8f6ba99fec
Update run.sh 2022-03-01 15:20:02 +03:00
kssenii
9983a5d802 Add test for profile events 2022-02-28 15:47:12 +01:00
lgbo-ustc
24caa70243 remove meaningless codes 2022-02-28 20:23:00 +08:00
lgbo-ustc
b8a2deba0f update tests 2022-02-28 20:11:59 +08:00
mergify[bot]
b4574a777f
Merge branch 'master' into mvcc_prototype 2022-02-28 11:24:39 +00:00
Kruglov Pavel
6252588922
Update run.sh 2022-02-28 13:33:10 +03:00
lgbo-ustc
aa8db563d6 update test 2022-02-28 18:02:37 +08:00
lgbo-ustc
5885cfd869 fixed bug : unexpected result when using in clause for filtering partitions 2022-02-28 16:47:50 +08:00
alexey-milovidov
c39efd8006
Update README.md 2022-02-25 16:13:32 +03:00
kssenii
725f967ac6 Add stress test 2022-02-24 07:54:58 +01:00
Alexander Tokmakov
aa6b9a2abc Merge branch 'master' into mvcc_prototype 2022-02-23 23:22:03 +03:00
Mikhail f. Shiryaev
dd37b237ab
Changing repository url to packages.clickhouse.com 2022-02-23 20:54:16 +01:00
kssenii
36a76d6a75 Fix test 2022-02-22 15:18:28 +01:00
kssenii
c637385dd0 Merge master 2022-02-22 13:17:51 +01:00
kssenii
26f58274b6 Fix stateful test 2022-02-22 12:05:43 +01:00
kssenii
4543513a5d Add comments 2022-02-21 13:54:03 +01:00
kssenii
009e71e273 Fix tests 2022-02-21 11:43:03 +01:00
Kruglov Pavel
500ed56061
Update docker/test/stress/run.sh
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:48 +03:00
Kruglov Pavel
de888db506
Update docker/test/stress/stress
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-02-18 16:36:38 +03:00
Kruglov Pavel
10c45bef67
Remove clickhouse-test package 2022-02-18 13:03:23 +03:00
Kruglov Pavel
71e7668fa6
Remove downloading clickhouse-test 2022-02-18 13:02:49 +03:00
Kruglov Pavel
74087470c2
Update run.sh 2022-02-18 12:52:56 +03:00
kssenii
353ffacca3 Add test 2022-02-17 19:57:04 +01:00
Kruglov Pavel
e77319bf01
Merge branch 'master' into stress-test 2022-02-17 20:28:46 +03:00
alesapin
8a0153b6d3
Merge pull request #34606 from qoega/no-clickhouse-test-deb
Remove clickhouse-test deb completely
2022-02-17 18:13:44 +03:00
Mikhail f. Shiryaev
c3bf9eb2f9
Remove PVS test 2022-02-17 12:59:47 +01:00
Alexander Tokmakov
dae044f86b Merge branch 'master' into mvcc_prototype 2022-02-17 13:49:37 +03:00
alesapin
6df2c9c2d8
Merge pull request #34433 from ClickHouse/s3-fix-content-type
Workaround for bug when AWS mistakenly set Content-Type to XML
2022-02-17 13:11:14 +03:00
alesapin
0b099b140f Fix 2022-02-17 10:39:33 +03:00
kssenii
47f94120da Merge master 2022-02-16 14:43:28 +01:00
kssenii
f9622d44f0 Try add stateful tests 2022-02-16 14:18:55 +01:00
alesapin
bc2d0ee7c7
Merge pull request #34215 from ClickHouse/revert-34211-revert-34153-add_func_tests_over_s3
Add func tests run with s3 and fix several bugs
2022-02-15 19:07:11 +03:00
alesapin
3b531e43b7 Setup credentials 2022-02-15 16:12:08 +03:00
Yatsishin Ilya
bbe2c07a7b remove clickhouse-test deb completely 2022-02-15 12:03:51 +00:00
alesapin
e1fb220bb7 Fix test 2022-02-15 13:31:41 +03:00
Alexander Tokmakov
1e4e569151 Merge branch 'master' into mvcc_prototype 2022-02-15 02:26:47 +03:00
Mikhail f. Shiryaev
23546ab825
Use the current kerberized-haddop image 2022-02-13 22:01:45 +01:00
Mikhail f. Shiryaev
0ae948866a
Create symlink hadoop -> ./hadoop-2.7.0 2022-02-13 19:10:11 +01:00
alesapin
89373155fc Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-13 21:07:54 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
Mikhail f. Shiryaev
ac459dccd8
Force update kerberized hadoop 2022-02-11 18:26:49 +01:00
Mikhail f. Shiryaev
65e8605af1
Make testflows aarch64 compatible 2022-02-11 18:26:48 +01:00
Mikhail f. Shiryaev
0f21981694
Add a flag for images architecture 2022-02-11 18:26:45 +01:00
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
c19d0a3494
Update performance-comparison, fix x86 hard-code 2022-02-11 18:26:41 +01:00
Mikhail f. Shiryaev
2d02eab750
Revert "Merge pull request #34373 from ClickHouse/docker-tz"
This reverts commit efd8044ab7, reversing
changes made to 4bb69bcb15.
2022-02-08 15:34:01 +01:00
Mikhail f. Shiryaev
c7ba5204b3
Make testflows a multiarch image 2022-02-07 13:21:51 +01:00
Mikhail f. Shiryaev
4a1e84306a
Update performance comparison OS version 2022-02-07 12:57:58 +01:00
Mikhail f. Shiryaev
4a857d7d18
Use UTC in docker images 2022-02-07 12:35:32 +01:00
Alexander Tokmakov
45be75b4db Merge branch 'master' into mvcc_prototype 2022-02-06 23:36:08 +03:00
alesapin
06499ce847 Revert "Remove docker change"
This reverts commit 3c80e0bff8.
2022-02-04 14:32:11 +03:00
Alexander Tokmakov
fe30e0f162 fixes 2022-02-03 21:57:09 +03:00
Mikhail f. Shiryaev
a7325bbe32
Fix check-workflows in style check, iterate over checks 2022-02-03 18:36:01 +01:00
Mikhail f. Shiryaev
37179bbc9c
Add verbosity to stylecheck 2022-02-03 17:50:35 +01:00
Alexander Tokmakov
ca5f951558 Merge branch 'master' into mvcc_prototype 2022-02-03 18:56:44 +03:00
Mikhail f. Shiryaev
75adf5d12d
Merge pull request #33948 from qoega/no-clickhouse-test-deb-in-stateless
Do not use clickhouse-test.deb in stateless CI checks
2022-02-02 10:23:33 +01:00
alexey-milovidov
cbfcd45be3
Revert "Add func tests run with s3" 2022-02-01 05:46:13 +03:00
alesapin
b6828f1b4a Supress some tests for S3 2022-01-31 19:09:25 +03:00
Alexander Tokmakov
fb9b2d5326 Merge branch 'master' into mvcc_prototype 2022-01-28 21:18:36 +03:00
Kruglov Pavel
e004dae25b
Update run.sh 2022-01-27 18:15:03 +03:00
Constantine Peresypkin
f5787ff0a9 docker: fix root squashed data dirs
if we use some root squashed volume mappings in docker
uid=0 is actually uid=nobody
thus FS operations with uid=0 will fail miserably
and overall it's a strange idea to create dirs under root when
DO_NOT_CHOWN is in effect...
2022-01-26 14:29:27 +02:00
Kruglov Pavel
b54bf18b27
Merge branch 'master' into stress-test 2022-01-25 14:35:42 +03:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
Alexander Tokmakov
0ea0a8ccc7 Merge branch 'master' into mvcc_prototype 2022-01-20 17:05:55 +03:00
Kruglov Pavel
d5bde26bc1
Update run.sh 2022-01-20 15:22:00 +03:00
Azat Khuzhin
616fd5dda9 docker/packager/other/fuzzer: cleanup USE_INTERNAL_XXX 2022-01-20 10:02:01 +03:00