Commit Graph

2046 Commits

Author SHA1 Message Date
Alexey Milovidov
f02b61e30f Merge branch 'master' into hermetic-builds 2021-10-17 07:02:37 +03:00
mergify[bot]
f29ea07b1c
Merge branch 'master' into clickhouse-test-http-interface 2021-10-13 16:46:26 +00:00
tavplubix
a16ce6b54b
Merge pull request #30030 from ClickHouse/tavplubix-patch-3
Attach trace_log to stateless tests report as is
2021-10-13 13:21:39 +03:00
Alexey Milovidov
b420bc19fb Merge branch 'master' into hermetic-builds 2021-10-13 01:08:23 +03:00
Dmitry Novik
fa9cdd5c5f Use original whitespaces in test_results.tsv 2021-10-12 23:31:31 +03:00
Dmitry Novik
0507391010 Do not stop CI tests processing if clickhouse-test return 1 2021-10-12 23:30:07 +03:00
Dmitry Novik
a30573fc0a Add FAIL message to test_results.tsv 2021-10-12 23:29:15 +03:00
Azat Khuzhin
071a5af96e Revert "docker: add pandas/clickhouse_driver into test images"
This reverts commit e07a6f3fc0.
2021-10-12 21:06:26 +03:00
tavplubix
f3c9f4be6c
Update run.sh 2021-10-12 14:38:41 +03:00
Alexey Milovidov
bdd06279a4 Fix PVS Studio 2021-10-12 05:43:53 +03:00
Alexey Milovidov
d0f7a10c6a Fix fasttest 2021-10-12 03:34:07 +03:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
alexey-milovidov
268c155b7d
Merge pull request #29856 from azat/clickhouse-test-python-client
Rewrite clickhouse-test to use python clickhouse_driver
2021-10-09 17:58:40 +03:00
alexey-milovidov
f6a0983068
Merge pull request #29781 from azat/fuzzer-server-pid-v2
Simplify obtaining of server pid in fuzzer tests
2021-10-08 00:35:25 +03:00
Azat Khuzhin
e07a6f3fc0 docker: add pandas/clickhouse_driver into test images 2021-10-08 00:09:37 +03:00
Azat Khuzhin
aeb670dbe0 Simplify obtaining of server pid in fuzzer tests 2021-10-05 21:05:49 +03:00
Kseniia Sumarokova
ead99b5911
Update docker_compose_minio.yml 2021-10-05 11:39:08 +03:00
kssenii
4962677a8b Update minio 2021-10-05 08:18:16 +00:00
Nikita Mikhaylov
731d6c5755
Merge pull request #29513 from azat/fuzzer-fix-server-pid
Fix server pid (hence exit code and attaching with gdb) in fuzzer tests
2021-10-04 19:59:24 +03:00
Azat Khuzhin
74a7a0603d test/fuzzer: print stacktrace
To get the stacktrace for errors w/o it [1]:

    SET max_parser_depth = 4000

    Got boring AST
    Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION)

  [1]: https://clickhouse-test-reports.s3.yandex.net/29513/769bfbe71f22c392458eced655080a0bbd442e02/fuzzer_ubsan/fuzzer.log
2021-10-02 12:49:44 +03:00
Azat Khuzhin
769bfbe71f Fix server pid in fuzzer tests
Previously it was the pid of the subshell 40 while it should be the pid
of the clickhouse-server 39:

Here we see that the server pid is 39:

    2021-09-28 11:02:34	 + pgrep -f clickhouse-server
    2021-09-28 11:02:34	 39

Here we see that the 40 is the pid of subshell:

    2021-09-28 11:02:45	 ch/docker/test/fuzzer/run-fuzzer.sh: line 90:    39 Killed                  clickhouse-server --config-file db/config.xml -- --path db 2>&1
    2021-09-28 11:02:45	         40 Done                    | tail -100000 > server.log

And here we see that server_pid variable is 40:

    2021-09-28 11:02:45	 + server_exit_code=0
    2021-09-28 11:02:45	 + wait 40

v2: wait in background to call wait in foreground and ensure that the
process is alive, since w/o job control this is the only way to obtain
the exit code
2021-10-01 21:05:30 +03:00
Alexey Milovidov
4271f8c738 Merge remote-tracking branch 'origin/master' into yandex-to-clickhouse-in-configs 2021-10-01 01:33:58 +03:00
Alexey Milovidov
2ec75b824b Revert "repo.clickhouse.tech is not 100% ready"
This reverts commit 8616ba62e4.
2021-09-29 02:43:20 +03:00
Dmitry Novik
29587c5013 Pass all parameters to process_functional_tests_result.py 2021-09-28 20:38:41 +03:00
Dmitry Novik
6b12869f6e Fix path to executable 2021-09-28 15:11:18 +03:00
Dmitry Novik
4ce12a7685 Fixup 2021-09-28 11:50:28 +03:00
alesapin
8e25144bbb Merge branch 'master' into trying_actions 2021-09-28 11:08:13 +03:00
Dmitry Novik
7755b3688f Fix docker images build 2021-09-28 01:07:53 +03:00
Dmitry Novik
5418ea83fa Fix clickhouse/test-util Dockerfile 2021-09-27 17:38:25 +03:00
Dmitry Novik
4e6c945fdf Rename fasttest output file 2021-09-27 13:09:57 +03:00
mergify[bot]
dbb924171d
Merge branch 'master' into fasttest-tsv 2021-09-27 07:48:49 +00:00
mergify[bot]
64669a28ce
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-26 22:59:23 +00:00
Alexey Milovidov
dc7eb5c1ae Fix ugly typo 2021-09-26 03:29:32 +03:00
Alexey Milovidov
fb7ce28198 Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-26 02:10:11 +03:00
Alexey Milovidov
90e74aff70 Fix performance test 2021-09-26 02:08:46 +03:00
Dmitry Novik
98df97f5d9 Fix docker image 2021-09-24 13:48:28 +03:00
Dmitry Novik
77dfa44256 Generate test_results.tsv for fasttest 2021-09-24 12:16:08 +03:00
Alexey Milovidov
8616ba62e4 repo.clickhouse.tech is not 100% ready 2021-09-24 04:41:59 +03:00
mergify[bot]
88b7680eeb
Merge branch 'master' into trying_actions 2021-09-23 15:48:57 +00:00
Alexey Milovidov
e9e77b4403 .tech -> .com 2021-09-22 03:22:57 +03:00
alexey-milovidov
0880ae2883
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-21 20:17:28 +03:00
tavplubix
8adfb9b593
Stop ThreadFuzzer before hung check (#29167)
* stop ThreadFuzzer before hung check

* fix

* fix
2021-09-20 17:23:10 +03:00
Alexey Milovidov
e513a5db32 Change <yandex> to <clickhouse> in configs 2021-09-20 01:38:53 +03:00
alesapin
00d9a62d6c Missclick 2021-09-17 14:17:50 +03:00
alesapin
5d35ba7d93 One more time 2021-09-17 13:41:29 +03:00
alesapin
68c7f8638a update docker image 2021-09-17 13:34:45 +03:00
alesapin
71dcf03a0f Create changed image 2021-09-15 20:35:15 +03:00
Nikita Mikhaylov
4b3c0a95d1
Merge pull request #28046 from syominsergey/fix-build-clang-13-2
[WIP] Improve support for build with clang-13
2021-09-13 12:11:38 +03:00
Vitaly Baranov
512786346c
Merge pull request #28909 from vitlibar/convert-skip-list-into-first-line-comments
Convert skip_list .json into first line comments
2021-09-13 03:37:39 +03:00
Sergei Semin
12e24a23d3
Merge branch 'master' into fix-build-clang-13-2 2021-09-12 19:30:55 +03:00
Vitaly Baranov
daa5979347 Remove unnecessary files. 2021-09-12 17:15:28 +03:00
Vitaly Baranov
bbb192ee85 Convert skip_list.json into first line comments. 2021-09-12 17:15:23 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Mike Kot
c4385a2c40 Simplifying exception messages 2021-09-11 00:40:18 +02:00
mergify[bot]
e3b3439535
Merge branch 'master' into fix-build-clang-13-2 2021-09-10 12:05:54 +00:00
alesapin
6243b64ff5
Merge pull request #28656 from ClickHouse/move_docker_images_to_separate_repo
Move docker images to a separate repo
2021-09-10 10:24:21 +03:00
Sergei Semin
ffc529feb1 use clang-13 in pvs docker image 2021-09-09 23:51:47 +03:00
Sergei Semin
b739d1cc92 make changes analog to https://github.com/ClickHouse/ClickHouse/pull/20495/files but for clang-13 2021-09-09 23:51:47 +03:00
alesapin
2359a222ff Fix more tests 2021-09-09 23:29:42 +03:00
robot-clickhouse
fc4f119417 Auto version update to [21.11.1.1] [54456] 2021-09-09 12:03:29 +03:00
alesapin
1297e95e4a Revert "Revert jdbc-bridge image"
This reverts commit 63cc735b8f.
2021-09-09 10:45:04 +03:00
alesapin
63cc735b8f Revert jdbc-bridge image 2021-09-09 10:42:59 +03:00
alesapin
cbbc5b2ee5 Fix some broken images 2021-09-08 12:58:17 +03:00
alesapin
bdd26f2a19 Merge branch 'master' into move_docker_images_to_separate_repo 2021-09-08 12:36:36 +03:00
alesapin
3b9dae8718
Merge pull request #28616 from ClickHouse/qoega-try-llvm-12
Merging #20495
2021-09-08 11:43:46 +03:00
Vitaly Baranov
70c6623036
Merge branch 'master' into governance/session_log 2021-09-07 10:12:54 +03:00
alesapin
0eac4529e0 Preparation 2021-09-06 14:33:39 +03:00
alesapin
40d4d64a65 Fix PVS Image 2021-09-05 15:50:25 +03:00
alesapin
a879c907a2 Update PVS hashsum 2021-09-04 16:00:42 +03:00
mergify[bot]
6ccf905133
Merge branch 'master' into try-llvm-12 2021-09-03 16:13:13 +00:00
Nikolay Degterinsky
53b6d918eb
Merge pull request #25310 from bharatnc/ncb/import-export-lz4
LZ4 compression for import/export
2021-09-01 21:12:50 +03:00
alesapin
7e2cb7c8ac
Merge pull request #27538 from ClickHouse/stress-thread-fuzzer
Enable Thread Fuzzer in Stress test
2021-09-01 10:26:19 +03:00
Nikita Mikhaylov
a738b145ba fix shellcheck 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
a5d4060df8 Better waiting for minio to start 2021-08-31 12:54:45 +00:00
vdimir
56a3675591 Adjust docker/test/stateless/setup_minio.sh for local run 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
c2c9bea19e Update setup_minio.sh 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
5f7a1bab94 better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
cc73ca17d3 Debug 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
dbe13ffc0f Fix tests 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
083ca0f283 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
4cdc978636 Move dowloading to dockerfile 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
92446b1b88 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
4a88e5f281 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
1adbb2db18 Update setup_minio.sh 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
daece09eab chmod +x 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
c4bf47d4a3 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
26efa7184d Added minio 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
e41d1cff1d Fix test 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
eed958495f Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
fcfda4b983 Fix tests and update ya.make 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
d7a627e5a9 Added test to skip list 2021-08-31 12:54:06 +00:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Nikolay Degterinsky
e8713a7d7e Merge branch 'master' into ncb/import-export-lz4 2021-08-31 13:32:39 +03:00
alesapin
525999145e
Merge pull request #26791 from ClickHouse/async-reads
Experiment with asynchronous readers
2021-08-31 13:17:45 +03:00
Vladimir C
3c2cee392a
Merge pull request #28350 from vdimir/fuzz-j2-sed-typo 2021-08-31 11:04:07 +03:00
Vladimir C
4cbc1aba19
Disable SC2001 shellcheck in docker/test/fuzzer/run-fuzzer.sh 2021-08-31 11:02:52 +03:00
Alexey Milovidov
143744f5a7 Fix perf test 2021-08-31 02:53:55 +03:00
Vasily Nemkov
c902afddde Added system.session_log table
Which logs all the info about LogIn, LogOut and LogIn Failure events.
Additional info that is logged:
- User name
- event type (LogIn, LogOut, LoginFailure)
- Event date\time\time with microseconds
- authentication type (same as for IDENTIFIED BY of CREATE USER statement)
- array of active settings profiles upon login
- array of active roles upon login
- array of changed settings with corresponding values
- client address and port
- interface (TCP\HTTP\MySQL\PostgreSQL, etc.)
- client info (name, version info)
- optional LoginFailure reason text message.

Added some tests to verify that events are properly saved with all necessary info via following interfaces:
- TCP
- HTTP
- MySQL

Known limitations
- Not tested against named HTTP sessions, PostgreSQL and gRPC, hence those are not guaranteed to work 100% properly.
2021-08-30 18:28:28 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
vdimir
bc785bff25
Fix sed argument in test/fuzzer/run-fuzzer.sh 2021-08-30 14:25:08 +03:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
Ilya Yatsishin
7f7ecb0c60
Merge branch 'master' into try-llvm-12 2021-08-26 18:58:49 +03:00
Nikita Mikhaylov
fc37817ada
Merge pull request #28150 from FArthur-cmd/fix_compression_26149
Fix `Attempt to read after eof with enabled data compression`
2021-08-26 17:17:09 +03:00
Nikita Mikhaylov
4a12a5fe91 Better 2021-08-25 21:29:28 +00:00
mergify[bot]
69d2a6080b
Merge branch 'master' into fix_compression_26149 2021-08-25 19:01:08 +00:00
Nikita Mikhaylov
fa95fa1517 Added a test 2021-08-25 17:42:57 +00:00
vdimir
92f073a435
Call generate-test-j2.py in run-fuzzer.sh before calculating NEW_TESTS_OPT 2021-08-25 16:05:16 +03:00
Nikolay Degterinsky
f722132f23 Merge branch 'master' into ncb/import-export-lz4 2021-08-25 14:59:17 +03:00
vdimir
b9b0b17ad0
chmod +x docker/test/fuzzer/generate-test-j2.py 2021-08-25 11:20:42 +03:00
vdimir
0e37203dcd
Use jinja template tests in fuzzer 2021-08-25 11:18:30 +03:00
mergify[bot]
39f8ee024a
Merge branch 'master' into stress-thread-fuzzer 2021-08-25 01:27:19 +00:00
alexey-milovidov
47cc6c5afe
Merge pull request #28063 from vitlibar/set-fixed-version-of-tzlocal
Set version of tzlocal to 2.1
2021-08-25 02:48:08 +03:00
alesapin
b274c2a90c
Update Dockerfile 2021-08-24 17:09:10 +03:00
Vitaly Baranov
8dc128f3d9 Set version of tzlocal to 2.1 2021-08-24 14:07:48 +03:00
Nikolay Degterinsky
d60f128a9a Merge branch 'master' into ncb/import-export-lz4 2021-08-24 11:47:10 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
mergify[bot]
51e98f747c
Merge branch 'master' into stress-thread-fuzzer 2021-08-23 19:16:28 +00:00
tavplubix
95be614664
Update Dockerfile 2021-08-23 21:01:19 +03:00
Ilya Yatsishin
4865f38f96
Merge pull request #28016 from qoega/ubuntu-archive-workaround
Use ru.archive.ubuntu.com as default one is not responding from CI
2021-08-23 13:51:49 +03:00
Nikolay Degterinsky
7f0d80dc9d Fix fast test 2021-08-23 13:10:38 +03:00
Yatsishin Ilya
91289983c6 Use ru.archive.ubuntu.com as default one is not responding from CI 2021-08-23 11:22:39 +03:00
vdimir
f02ceedd92 Add 01944_insert_partition_by to arcadia and fasttest skip list 2021-08-23 09:22:13 +03:00
mergify[bot]
14e9209ee2
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 19:44:23 +00:00
alexey-milovidov
40a4a6663e
Merge pull request #27830 from zhanglistar/master
Add sha512 hash functions
2021-08-21 22:38:06 +03:00
mergify[bot]
d75fbdf5f1
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 11:12:52 +00:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
alexey-milovidov
7127905909
Merge pull request #27884 from ClickHouse/aku/decimal-formatting
fix decimal formatting settings in perf test
2021-08-20 09:04:18 +03:00
Alexander Kuzmenkov
a7d405759c fix decimal formatting settings in perf test 2021-08-19 21:44:04 +03:00
mergify[bot]
bde834a8c0
Merge branch 'master' into try-llvm-12 2021-08-19 18:21:29 +00:00
Alexander Kuzmenkov
96a5c4b033
Merge pull request #27752 from ClickHouse/akuzm-patch-1
try to collect some core dumps in perf tests
2021-08-19 14:47:49 +03:00
listar
b9c7026079 1. add sha512 test to skip for fast test. 2021-08-19 11:29:40 +00:00
Alexander Kuzmenkov
c5fb6b3670 Revert "Revert "try to update version to 21.10 because 21.9 has a broken release PR and""
This reverts commit fce6eed2be.
2021-08-19 14:27:49 +03:00
Alexander Kuzmenkov
fce6eed2be Revert "try to update version to 21.10 because 21.9 has a broken release PR and"
This reverts commit 51d802b825.
2021-08-19 14:21:36 +03:00
Alexander Kuzmenkov
51d802b825 try to update version to 21.10 because 21.9 has a broken release PR and
branch
2021-08-19 14:16:28 +03:00
listar
b5f0693471 1. skip tests for sha512 function on fasttest. 2021-08-19 08:42:16 +00:00
Alexander Kuzmenkov
db53638a95
Update download.sh 2021-08-19 01:21:51 +03:00
Alexander Kuzmenkov
7f15c5c55e
Update entrypoint.sh 2021-08-19 01:21:23 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexander Kuzmenkov
59e3cb18f4
Update entrypoint.sh 2021-08-18 10:58:21 +03:00
Alexander Kuzmenkov
8199399159
Update entrypoint.sh 2021-08-18 07:00:51 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
tavplubix
491e69d10c
Revert "Mark tests for DatabaseReplicated as green" 2021-08-17 16:25:39 +03:00
Alexander Kuzmenkov
c9404c1fb8
Update entrypoint.sh 2021-08-17 13:30:51 +03:00
mergify[bot]
7995abf90d
Merge branch 'master' into stress-thread-fuzzer 2021-08-17 08:10:54 +00:00
Alexander Kuzmenkov
7bbbb19b48
try to collect some core dumps in perf tests 2021-08-16 20:05:50 +03:00
Alexander Kuzmenkov
43602a838a
Update compare.sh 2021-08-16 18:14:47 +03:00
kssenii
bec34531bc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-16 14:48:32 +00:00
Alexander Kuzmenkov
1f48166bfb
Update run-fuzzer.sh 2021-08-16 16:55:20 +03:00