Commit Graph

2476 Commits

Author SHA1 Message Date
Nikita Mikhaylov
92446b1b88 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
4a88e5f281 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
1adbb2db18 Update setup_minio.sh 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
daece09eab chmod +x 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
c4bf47d4a3 Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
26efa7184d Added minio 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
e41d1cff1d Fix test 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
eed958495f Better 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
fcfda4b983 Fix tests and update ya.make 2021-08-31 12:54:45 +00:00
Nikita Mikhaylov
d7a627e5a9 Added test to skip list 2021-08-31 12:54:06 +00:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Nikolay Degterinsky
e8713a7d7e Merge branch 'master' into ncb/import-export-lz4 2021-08-31 13:32:39 +03:00
alesapin
525999145e
Merge pull request #26791 from ClickHouse/async-reads
Experiment with asynchronous readers
2021-08-31 13:17:45 +03:00
Vladimir C
3c2cee392a
Merge pull request #28350 from vdimir/fuzz-j2-sed-typo 2021-08-31 11:04:07 +03:00
Vladimir C
4cbc1aba19
Disable SC2001 shellcheck in docker/test/fuzzer/run-fuzzer.sh 2021-08-31 11:02:52 +03:00
Alexey Milovidov
143744f5a7 Fix perf test 2021-08-31 02:53:55 +03:00
Vasily Nemkov
c902afddde Added system.session_log table
Which logs all the info about LogIn, LogOut and LogIn Failure events.
Additional info that is logged:
- User name
- event type (LogIn, LogOut, LoginFailure)
- Event date\time\time with microseconds
- authentication type (same as for IDENTIFIED BY of CREATE USER statement)
- array of active settings profiles upon login
- array of active roles upon login
- array of changed settings with corresponding values
- client address and port
- interface (TCP\HTTP\MySQL\PostgreSQL, etc.)
- client info (name, version info)
- optional LoginFailure reason text message.

Added some tests to verify that events are properly saved with all necessary info via following interfaces:
- TCP
- HTTP
- MySQL

Known limitations
- Not tested against named HTTP sessions, PostgreSQL and gRPC, hence those are not guaranteed to work 100% properly.
2021-08-30 18:28:28 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
vdimir
bc785bff25
Fix sed argument in test/fuzzer/run-fuzzer.sh 2021-08-30 14:25:08 +03:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
Ilya Yatsishin
7f7ecb0c60
Merge branch 'master' into try-llvm-12 2021-08-26 18:58:49 +03:00
Nikita Mikhaylov
fc37817ada
Merge pull request #28150 from FArthur-cmd/fix_compression_26149
Fix `Attempt to read after eof with enabled data compression`
2021-08-26 17:17:09 +03:00
Ilya Yatsishin
0a9feade3d
Merge pull request #28079 from vdimir/fuzz-j2
Use jinja template tests in fuzzer
2021-08-26 10:53:45 +03:00
Nikita Mikhaylov
4a12a5fe91 Better 2021-08-25 21:29:28 +00:00
mergify[bot]
69d2a6080b
Merge branch 'master' into fix_compression_26149 2021-08-25 19:01:08 +00:00
Nikita Mikhaylov
fa95fa1517 Added a test 2021-08-25 17:42:57 +00:00
Nikita Mikhaylov
0615bf27d6
Merge pull request #27990 from nikitamikhaylov/fix-clang-tidy
Build fuzzers in CI
2021-08-25 18:33:41 +03:00
vdimir
92f073a435
Call generate-test-j2.py in run-fuzzer.sh before calculating NEW_TESTS_OPT 2021-08-25 16:05:16 +03:00
Nikolay Degterinsky
f722132f23 Merge branch 'master' into ncb/import-export-lz4 2021-08-25 14:59:17 +03:00
Nikita Mikhaylov
b8ef09a1f8 Fix build 2021-08-25 11:18:57 +00:00
Nikita Mikhaylov
ab22fdaa80 Fix build 2021-08-25 11:17:45 +00:00
Nikita Mikhaylov
6cece7d1d9
Update build.sh 2021-08-25 11:22:16 +03:00
vdimir
b9b0b17ad0
chmod +x docker/test/fuzzer/generate-test-j2.py 2021-08-25 11:20:42 +03:00
vdimir
0e37203dcd
Use jinja template tests in fuzzer 2021-08-25 11:18:30 +03:00
mergify[bot]
39f8ee024a
Merge branch 'master' into stress-thread-fuzzer 2021-08-25 01:27:19 +00:00
alexey-milovidov
47cc6c5afe
Merge pull request #28063 from vitlibar/set-fixed-version-of-tzlocal
Set version of tzlocal to 2.1
2021-08-25 02:48:08 +03:00
Nikita Mikhaylov
b330cb855f Fix build 2021-08-24 23:11:48 +00:00
alesapin
b274c2a90c
Update Dockerfile 2021-08-24 17:09:10 +03:00
Nikita Mikhaylov
19fc723328 chmod +x 2021-08-24 11:14:37 +00:00
Vitaly Baranov
8dc128f3d9 Set version of tzlocal to 2.1 2021-08-24 14:07:48 +03:00
Nikolay Degterinsky
d60f128a9a Merge branch 'master' into ncb/import-export-lz4 2021-08-24 11:47:10 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
Nikita Mikhaylov
242ef3dcb5 Proper build 2021-08-24 00:09:19 +00:00
Nikita Mikhaylov
ac4a516152 Fix build 2021-08-23 21:45:48 +00:00
mergify[bot]
51e98f747c
Merge branch 'master' into stress-thread-fuzzer 2021-08-23 19:16:28 +00:00
Nikita Mikhaylov
afae867060 Fix build 2021-08-23 18:31:17 +00:00
tavplubix
95be614664
Update Dockerfile 2021-08-23 21:01:19 +03:00
Nikita Mikhaylov
77430a1baa better 2021-08-23 14:36:26 +00:00
Nikita Mikhaylov
1c956481a1 Updated deb/build.sh and fixed shellcheck 2021-08-23 13:21:39 +00:00
mergify[bot]
95e9d517ff
Merge branch 'master' into fix-clang-tidy 2021-08-23 10:54:36 +00:00
Ilya Yatsishin
4865f38f96
Merge pull request #28016 from qoega/ubuntu-archive-workaround
Use ru.archive.ubuntu.com as default one is not responding from CI
2021-08-23 13:51:49 +03:00
Nikolay Degterinsky
7f0d80dc9d Fix fast test 2021-08-23 13:10:38 +03:00
Yatsishin Ilya
91289983c6 Use ru.archive.ubuntu.com as default one is not responding from CI 2021-08-23 11:22:39 +03:00
vdimir
f02ceedd92 Add 01944_insert_partition_by to arcadia and fasttest skip list 2021-08-23 09:22:13 +03:00
mergify[bot]
3fdf1730a9
Merge branch 'master' into stress-thread-fuzzer 2021-08-22 22:08:53 +00:00
Nikita Mikhaylov
80ebc6ccea Done 2021-08-22 15:09:49 +00:00
Nikita Mikhaylov
e9979312dd Fixed 2021-08-22 10:38:36 +00:00
mergify[bot]
14e9209ee2
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 19:44:23 +00:00
alexey-milovidov
40a4a6663e
Merge pull request #27830 from zhanglistar/master
Add sha512 hash functions
2021-08-21 22:38:06 +03:00
Nikita Mikhaylov
cfa571cac4
Merge pull request #27895 from nikitamikhaylov/temporary_remove_yaml_fuzzer
Build fuzzers with clang-tidy
2021-08-21 16:51:31 +03:00
mergify[bot]
d75fbdf5f1
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 11:12:52 +00:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
Nikita Mikhaylov
c5779eb604 Fix build 2021-08-20 13:27:44 +00:00
Nikita Mikhaylov
c6f94e5016 better 2021-08-20 11:57:15 +00:00
Nikita Mikhaylov
0da15b9ece Fix build 2021-08-20 10:23:50 +00:00
alexey-milovidov
7127905909
Merge pull request #27884 from ClickHouse/aku/decimal-formatting
fix decimal formatting settings in perf test
2021-08-20 09:04:18 +03:00
Nikita Mikhaylov
d575f06dff better 2021-08-19 23:04:55 +00:00
Nikita Mikhaylov
06a0580db1 done 2021-08-19 23:02:01 +00:00
Alexander Kuzmenkov
a7d405759c fix decimal formatting settings in perf test 2021-08-19 21:44:04 +03:00
mergify[bot]
bde834a8c0
Merge branch 'master' into try-llvm-12 2021-08-19 18:21:29 +00:00
Alexander Kuzmenkov
96a5c4b033
Merge pull request #27752 from ClickHouse/akuzm-patch-1
try to collect some core dumps in perf tests
2021-08-19 14:47:49 +03:00
listar
b9c7026079 1. add sha512 test to skip for fast test. 2021-08-19 11:29:40 +00:00
Alexander Kuzmenkov
c5fb6b3670 Revert "Revert "try to update version to 21.10 because 21.9 has a broken release PR and""
This reverts commit fce6eed2be.
2021-08-19 14:27:49 +03:00
Alexander Kuzmenkov
fce6eed2be Revert "try to update version to 21.10 because 21.9 has a broken release PR and"
This reverts commit 51d802b825.
2021-08-19 14:21:36 +03:00
Alexander Kuzmenkov
51d802b825 try to update version to 21.10 because 21.9 has a broken release PR and
branch
2021-08-19 14:16:28 +03:00
listar
b5f0693471 1. skip tests for sha512 function on fasttest. 2021-08-19 08:42:16 +00:00
Alexander Kuzmenkov
db53638a95
Update download.sh 2021-08-19 01:21:51 +03:00
Alexander Kuzmenkov
7f15c5c55e
Update entrypoint.sh 2021-08-19 01:21:23 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexander Kuzmenkov
59e3cb18f4
Update entrypoint.sh 2021-08-18 10:58:21 +03:00
Alexander Kuzmenkov
8199399159
Update entrypoint.sh 2021-08-18 07:00:51 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
tavplubix
491e69d10c
Revert "Mark tests for DatabaseReplicated as green" 2021-08-17 16:25:39 +03:00
Alexander Kuzmenkov
c9404c1fb8
Update entrypoint.sh 2021-08-17 13:30:51 +03:00
mergify[bot]
7995abf90d
Merge branch 'master' into stress-thread-fuzzer 2021-08-17 08:10:54 +00:00
Alexander Kuzmenkov
7bbbb19b48
try to collect some core dumps in perf tests 2021-08-16 20:05:50 +03:00
Alexander Kuzmenkov
43602a838a
Update compare.sh 2021-08-16 18:14:47 +03:00
kssenii
bec34531bc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-16 14:48:32 +00:00
Alexander Kuzmenkov
1f48166bfb
Update run-fuzzer.sh 2021-08-16 16:55:20 +03:00
mergify[bot]
0bc96227e5
Merge branch 'master' into stress-thread-fuzzer 2021-08-16 08:14:47 +00:00
alexey-milovidov
3cdeb97147
Merge pull request #27688 from ClickHouse/database-replicated-no-red-cross
Mark tests for `DatabaseReplicated` as green
2021-08-15 15:30:07 +03:00
Alexey Milovidov
e28c9c0ba7 Mark tests for DatabaseReplicated as green 2021-08-15 11:54:28 +03:00
alexey-milovidov
c06f212bb5
Update packager 2021-08-15 09:55:54 +03:00
Alexey Milovidov
6ff43a614c Use only SSE2 in "unbundled" build 2021-08-15 09:52:55 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
kssenii
d767f6704f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-09 12:14:23 +00:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer 2021-08-08 17:03:05 +00:00
Amos Bird
a59ce96242
Skip test in fasttest 2021-08-08 22:30:08 +08:00
Nikolay Degterinsky
00301cf36a Ignore test in fasttest 2021-08-07 06:20:59 +00:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
Yatsishin Ilya
9145dd3fd0 Merge branch 'master' into try-llvm-12 2021-08-06 19:14:01 +03:00
tavplubix
3a453636e8
Update Dockerfile 2021-08-06 18:12:36 +03:00
Maksim Kita
aabb1d04bd
Merge pull request #27190 from ClickHouse/aku/perf-settings
properly check the settings in perf test
2021-08-05 10:56:39 +03:00
Alexander Kuzmenkov
cfcb0e4b22 properly check the settings in perf test 2021-08-04 19:41:21 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl
Support SSL connection in MongoDB engine
2021-08-03 08:29:34 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
Vitaliy Zakaznikov
bd1e2eda47 Moving to TestFlows 1.7.20 that has native support for parallel tests. 2021-07-31 15:50:27 -04:00
alesapin
f02b091aa7 Ignore test in fast test 2021-07-30 18:27:02 +03:00
alesapin
e20e88ece3 Relax fast test 2021-07-30 16:51:15 +03:00
alesapin
6d28892fbd Followup fix 2021-07-30 16:50:26 +03:00
alesapin
acc4e9e79d Merge remote-tracking branch 'evillique/nlp' into evillique-nlp 2021-07-30 16:46:58 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896)
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
2021-07-30 12:12:33 +03:00
alexey-milovidov
99849f94c0
Merge pull request #26959 from ClickHouse/fix_stress_client_options
Fix client options in stress test
2021-07-30 08:49:34 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
Alexander Tokmakov
fab4529c97 Merge branch 'master' into rename_materialize_mysql 2021-07-28 12:18:01 +03:00
alesapin
1277db4435
Merge pull request #26129 from ClickHouse/system_zookeeper_log
Add system.zookeeper_log table
2021-07-28 11:22:29 +03:00
Alexander Tokmakov
fc9ab2cda7 Merge branch 'master' into rename_materialize_mysql 2021-07-27 22:38:40 +03:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00
Kseniia Sumarokova
f2e599d8d1
Merge pull request #26826 from kssenii/rabbit-fix-tests
Try fix rabbitmq tests
2021-07-27 17:07:37 +03:00
Yatsishin Ilya
f8c7058bcf Better 2021-07-27 10:33:49 +03:00
kssenii
764615c48b Update rabbitmq conf 2021-07-27 07:14:41 +00:00
Alexander Tokmakov
63ab38ee09 rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
Alexey Milovidov
f56269243e Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-24 13:55:21 +03:00
Mikhail f. Shiryaev
64c35b2511
Disable watchdog in docker by default 2021-07-23 21:42:33 +02:00
Alexander Kuzmenkov
86b7701834
Merge pull request #26706 from ClickHouse/aku/server-exit-code
record server exit code in fuzzer
2021-07-22 19:42:12 +03:00
Alexander Kuzmenkov
cfb317a9a9
Update compare.sh 2021-07-22 18:37:20 +03:00
Alexander Kuzmenkov
dbf0ed31e8 record server exit code in fuzzer 2021-07-22 17:05:47 +03:00
Nikolai Kochetov
7745905cae
Merge pull request #26545 from Kylinrix/patch-3
Update entrypoint.sh
2021-07-20 21:20:11 +03:00
alexey-milovidov
772b18db8a
Merge pull request #26579 from vdimir/test-jinja-templates
Support jinja templates for sql files in clickhouse-test
2021-07-20 21:13:44 +03:00
Vladimir
d1eeb37cac
Merge pull request #26552 from vdimir/deleted-in-flaky-stateless-check
Handle empty testset in 'Functional stateless tests flaky check'
2021-07-20 16:42:55 +03:00
vdimir
6f8561c084
Support jijna templates for sql files in clickhouse-test 2021-07-20 16:40:04 +03:00
Nikolai Kochetov
e0c5dc1449
Update entrypoint.sh 2021-07-20 16:10:29 +03:00
Nikolai Kochetov
4df50d3490
Update entrypoint.sh 2021-07-20 15:02:20 +03:00
vdimir
6dab3625ff
Handle empty testset in 'Functional stateless tests flaky check' 2021-07-20 12:29:21 +03:00
Ilya Yatsishin
c0e42d3ae1
Merge pull request #26375 from qoega/integration-6 2021-07-20 09:03:48 +03:00
Ky Li
9abd7e543c
Update entrypoint.sh
We build clickhouse cluster in k8s by clickhouse-operator. 
clickhouse-server.log is mounted by emptydir on the path `/var/log/clickhouse-server`.
It causes the file system error called `Necessary directory '/var/log/clickhouse-server' isn't owned by user with id '101' `  when  CLICKHOUSE_DO_NOT_CHOWN is set to true(1).
Because emptydir file and dir is owned by root when it started, it has to do the chown cmd.
But it will take a long time to run chown cmd when the cluster has much data (in table data dir), the cluster cannot even restart because of  `initialDelaySeconds`
So chown operation is necessary to check if the file owner and group is owned by user 101.
2021-07-20 12:16:51 +08:00
alesapin
7b10c06113
Merge pull request #26497 from vdimir/docker-fasttest-build
Update link to dpkg-deb in dockerfiles
2021-07-19 21:19:32 +03:00
vdimir
23423524c5
Update path to apache-arrow deb package in unbundled/Dockerfile
See 'Linux packages notes' https://arrow.apache.org/blog/2021/05/03/4.0.0-release/
2021-07-19 16:04:42 +03:00
vdimir
22d545133a
Update link to dpkg-deb in dockerfiles 2021-07-19 12:49:19 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Alexey Milovidov
da94ed8a87 Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-18 01:12:24 +03:00
Alexey Milovidov
9bef9d4f2d Revert "Auto version update to [21.10.1.1] [54455]"
This reverts commit f2b1395127.
2021-07-17 13:17:30 +03:00
alexey-milovidov
659fc2a8e2
Merge pull request #26393 from azat/stress-improvements
stress tests report improvements
2021-07-17 13:00:09 +03:00
robot-clickhouse
f2b1395127 Auto version update to [21.10.1.1] [54455] 2021-07-17 08:45:10 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00