Commit Graph

1952 Commits

Author SHA1 Message Date
alesapin
525999145e
Merge pull request #26791 from ClickHouse/async-reads
Experiment with asynchronous readers
2021-08-31 13:17:45 +03:00
Vladimir C
3c2cee392a
Merge pull request #28350 from vdimir/fuzz-j2-sed-typo 2021-08-31 11:04:07 +03:00
Vladimir C
4cbc1aba19
Disable SC2001 shellcheck in docker/test/fuzzer/run-fuzzer.sh 2021-08-31 11:02:52 +03:00
Alexey Milovidov
143744f5a7 Fix perf test 2021-08-31 02:53:55 +03:00
Vasily Nemkov
c902afddde Added system.session_log table
Which logs all the info about LogIn, LogOut and LogIn Failure events.
Additional info that is logged:
- User name
- event type (LogIn, LogOut, LoginFailure)
- Event date\time\time with microseconds
- authentication type (same as for IDENTIFIED BY of CREATE USER statement)
- array of active settings profiles upon login
- array of active roles upon login
- array of changed settings with corresponding values
- client address and port
- interface (TCP\HTTP\MySQL\PostgreSQL, etc.)
- client info (name, version info)
- optional LoginFailure reason text message.

Added some tests to verify that events are properly saved with all necessary info via following interfaces:
- TCP
- HTTP
- MySQL

Known limitations
- Not tested against named HTTP sessions, PostgreSQL and gRPC, hence those are not guaranteed to work 100% properly.
2021-08-30 18:28:28 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
vdimir
bc785bff25
Fix sed argument in test/fuzzer/run-fuzzer.sh 2021-08-30 14:25:08 +03:00
Azat Khuzhin
fb311199ce test/stress: fix patterns for filtering out Raft messages 2021-08-28 19:21:07 +03:00
Ilya Yatsishin
7f7ecb0c60
Merge branch 'master' into try-llvm-12 2021-08-26 18:58:49 +03:00
Nikita Mikhaylov
fc37817ada
Merge pull request #28150 from FArthur-cmd/fix_compression_26149
Fix `Attempt to read after eof with enabled data compression`
2021-08-26 17:17:09 +03:00
Nikita Mikhaylov
4a12a5fe91 Better 2021-08-25 21:29:28 +00:00
mergify[bot]
69d2a6080b
Merge branch 'master' into fix_compression_26149 2021-08-25 19:01:08 +00:00
Nikita Mikhaylov
fa95fa1517 Added a test 2021-08-25 17:42:57 +00:00
vdimir
92f073a435
Call generate-test-j2.py in run-fuzzer.sh before calculating NEW_TESTS_OPT 2021-08-25 16:05:16 +03:00
Nikolay Degterinsky
f722132f23 Merge branch 'master' into ncb/import-export-lz4 2021-08-25 14:59:17 +03:00
vdimir
b9b0b17ad0
chmod +x docker/test/fuzzer/generate-test-j2.py 2021-08-25 11:20:42 +03:00
vdimir
0e37203dcd
Use jinja template tests in fuzzer 2021-08-25 11:18:30 +03:00
mergify[bot]
39f8ee024a
Merge branch 'master' into stress-thread-fuzzer 2021-08-25 01:27:19 +00:00
alexey-milovidov
47cc6c5afe
Merge pull request #28063 from vitlibar/set-fixed-version-of-tzlocal
Set version of tzlocal to 2.1
2021-08-25 02:48:08 +03:00
alesapin
b274c2a90c
Update Dockerfile 2021-08-24 17:09:10 +03:00
Vitaly Baranov
8dc128f3d9 Set version of tzlocal to 2.1 2021-08-24 14:07:48 +03:00
Nikolay Degterinsky
d60f128a9a Merge branch 'master' into ncb/import-export-lz4 2021-08-24 11:47:10 +03:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
mergify[bot]
51e98f747c
Merge branch 'master' into stress-thread-fuzzer 2021-08-23 19:16:28 +00:00
tavplubix
95be614664
Update Dockerfile 2021-08-23 21:01:19 +03:00
Ilya Yatsishin
4865f38f96
Merge pull request #28016 from qoega/ubuntu-archive-workaround
Use ru.archive.ubuntu.com as default one is not responding from CI
2021-08-23 13:51:49 +03:00
Nikolay Degterinsky
7f0d80dc9d Fix fast test 2021-08-23 13:10:38 +03:00
Yatsishin Ilya
91289983c6 Use ru.archive.ubuntu.com as default one is not responding from CI 2021-08-23 11:22:39 +03:00
vdimir
f02ceedd92 Add 01944_insert_partition_by to arcadia and fasttest skip list 2021-08-23 09:22:13 +03:00
mergify[bot]
14e9209ee2
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 19:44:23 +00:00
alexey-milovidov
40a4a6663e
Merge pull request #27830 from zhanglistar/master
Add sha512 hash functions
2021-08-21 22:38:06 +03:00
mergify[bot]
d75fbdf5f1
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 11:12:52 +00:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00
alexey-milovidov
7127905909
Merge pull request #27884 from ClickHouse/aku/decimal-formatting
fix decimal formatting settings in perf test
2021-08-20 09:04:18 +03:00
Alexander Kuzmenkov
a7d405759c fix decimal formatting settings in perf test 2021-08-19 21:44:04 +03:00
mergify[bot]
bde834a8c0
Merge branch 'master' into try-llvm-12 2021-08-19 18:21:29 +00:00
Alexander Kuzmenkov
96a5c4b033
Merge pull request #27752 from ClickHouse/akuzm-patch-1
try to collect some core dumps in perf tests
2021-08-19 14:47:49 +03:00
listar
b9c7026079 1. add sha512 test to skip for fast test. 2021-08-19 11:29:40 +00:00
Alexander Kuzmenkov
c5fb6b3670 Revert "Revert "try to update version to 21.10 because 21.9 has a broken release PR and""
This reverts commit fce6eed2be.
2021-08-19 14:27:49 +03:00
Alexander Kuzmenkov
fce6eed2be Revert "try to update version to 21.10 because 21.9 has a broken release PR and"
This reverts commit 51d802b825.
2021-08-19 14:21:36 +03:00
Alexander Kuzmenkov
51d802b825 try to update version to 21.10 because 21.9 has a broken release PR and
branch
2021-08-19 14:16:28 +03:00
listar
b5f0693471 1. skip tests for sha512 function on fasttest. 2021-08-19 08:42:16 +00:00
Alexander Kuzmenkov
db53638a95
Update download.sh 2021-08-19 01:21:51 +03:00
Alexander Kuzmenkov
7f15c5c55e
Update entrypoint.sh 2021-08-19 01:21:23 +03:00
alesapin
91995ca3a6 More tries 2021-08-18 17:57:36 +03:00
Alexander Kuzmenkov
59e3cb18f4
Update entrypoint.sh 2021-08-18 10:58:21 +03:00
Alexander Kuzmenkov
8199399159
Update entrypoint.sh 2021-08-18 07:00:51 +03:00
alexey-milovidov
eb3bbdfab5
Merge pull request #27680 from ClickHouse/decimal-no-trailing-zeros
Remove trailing zeros from Decimal serialization #15794
2021-08-18 05:24:13 +03:00
tavplubix
491e69d10c
Revert "Mark tests for DatabaseReplicated as green" 2021-08-17 16:25:39 +03:00
Alexander Kuzmenkov
c9404c1fb8
Update entrypoint.sh 2021-08-17 13:30:51 +03:00
mergify[bot]
7995abf90d
Merge branch 'master' into stress-thread-fuzzer 2021-08-17 08:10:54 +00:00
Alexander Kuzmenkov
7bbbb19b48
try to collect some core dumps in perf tests 2021-08-16 20:05:50 +03:00
Alexander Kuzmenkov
43602a838a
Update compare.sh 2021-08-16 18:14:47 +03:00
kssenii
bec34531bc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-16 14:48:32 +00:00
Alexander Kuzmenkov
1f48166bfb
Update run-fuzzer.sh 2021-08-16 16:55:20 +03:00
mergify[bot]
0bc96227e5
Merge branch 'master' into stress-thread-fuzzer 2021-08-16 08:14:47 +00:00
Alexey Milovidov
e28c9c0ba7 Mark tests for DatabaseReplicated as green 2021-08-15 11:54:28 +03:00
Alexey Milovidov
7a16f331dc Enable thread fuzzer in Stress test 2021-08-10 23:49:05 +03:00
kssenii
d767f6704f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-09 12:14:23 +00:00
mergify[bot]
bd313279e8
Merge branch 'master' into hyperscansanitizer 2021-08-08 17:03:05 +00:00
Amos Bird
a59ce96242
Skip test in fasttest 2021-08-08 22:30:08 +08:00
Nikolay Degterinsky
00301cf36a Ignore test in fasttest 2021-08-07 06:20:59 +00:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
Yatsishin Ilya
9145dd3fd0 Merge branch 'master' into try-llvm-12 2021-08-06 19:14:01 +03:00
tavplubix
3a453636e8
Update Dockerfile 2021-08-06 18:12:36 +03:00
Maksim Kita
aabb1d04bd
Merge pull request #27190 from ClickHouse/aku/perf-settings
properly check the settings in perf test
2021-08-05 10:56:39 +03:00
Alexander Kuzmenkov
cfcb0e4b22 properly check the settings in perf test 2021-08-04 19:41:21 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl
Support SSL connection in MongoDB engine
2021-08-03 08:29:34 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
Vitaliy Zakaznikov
bd1e2eda47 Moving to TestFlows 1.7.20 that has native support for parallel tests. 2021-07-31 15:50:27 -04:00
alesapin
f02b091aa7 Ignore test in fast test 2021-07-30 18:27:02 +03:00
alesapin
e20e88ece3 Relax fast test 2021-07-30 16:51:15 +03:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896)
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
2021-07-30 12:12:33 +03:00
alexey-milovidov
99849f94c0
Merge pull request #26959 from ClickHouse/fix_stress_client_options
Fix client options in stress test
2021-07-30 08:49:34 +03:00
tavplubix
888d096ede
Update stress 2021-07-29 16:21:29 +03:00
Alexander Tokmakov
381634960e fix client options in stress test 2021-07-29 15:16:34 +03:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
Alexander Tokmakov
fab4529c97 Merge branch 'master' into rename_materialize_mysql 2021-07-28 12:18:01 +03:00
alesapin
1277db4435
Merge pull request #26129 from ClickHouse/system_zookeeper_log
Add system.zookeeper_log table
2021-07-28 11:22:29 +03:00
Alexander Tokmakov
fc9ab2cda7 Merge branch 'master' into rename_materialize_mysql 2021-07-27 22:38:40 +03:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00
Kseniia Sumarokova
f2e599d8d1
Merge pull request #26826 from kssenii/rabbit-fix-tests
Try fix rabbitmq tests
2021-07-27 17:07:37 +03:00
Yatsishin Ilya
f8c7058bcf Better 2021-07-27 10:33:49 +03:00
kssenii
764615c48b Update rabbitmq conf 2021-07-27 07:14:41 +00:00
Alexander Tokmakov
63ab38ee09 rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
Alexey Milovidov
f56269243e Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-24 13:55:21 +03:00
Alexander Kuzmenkov
86b7701834
Merge pull request #26706 from ClickHouse/aku/server-exit-code
record server exit code in fuzzer
2021-07-22 19:42:12 +03:00
Alexander Kuzmenkov
cfb317a9a9
Update compare.sh 2021-07-22 18:37:20 +03:00
Alexander Kuzmenkov
dbf0ed31e8 record server exit code in fuzzer 2021-07-22 17:05:47 +03:00
alexey-milovidov
772b18db8a
Merge pull request #26579 from vdimir/test-jinja-templates
Support jinja templates for sql files in clickhouse-test
2021-07-20 21:13:44 +03:00
Vladimir
d1eeb37cac
Merge pull request #26552 from vdimir/deleted-in-flaky-stateless-check
Handle empty testset in 'Functional stateless tests flaky check'
2021-07-20 16:42:55 +03:00
vdimir
6f8561c084
Support jijna templates for sql files in clickhouse-test 2021-07-20 16:40:04 +03:00
vdimir
6dab3625ff
Handle empty testset in 'Functional stateless tests flaky check' 2021-07-20 12:29:21 +03:00
Ilya Yatsishin
c0e42d3ae1
Merge pull request #26375 from qoega/integration-6 2021-07-20 09:03:48 +03:00
alesapin
7b10c06113
Merge pull request #26497 from vdimir/docker-fasttest-build
Update link to dpkg-deb in dockerfiles
2021-07-19 21:19:32 +03:00
vdimir
22d545133a
Update link to dpkg-deb in dockerfiles 2021-07-19 12:49:19 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Alexey Milovidov
da94ed8a87 Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-18 01:12:24 +03:00
Alexey Milovidov
9bef9d4f2d Revert "Auto version update to [21.10.1.1] [54455]"
This reverts commit f2b1395127.
2021-07-17 13:17:30 +03:00
alexey-milovidov
659fc2a8e2
Merge pull request #26393 from azat/stress-improvements
stress tests report improvements
2021-07-17 13:00:09 +03:00
robot-clickhouse
f2b1395127 Auto version update to [21.10.1.1] [54455] 2021-07-17 08:45:10 +03:00
Azat Khuzhin
984e9f2f50 test/stress: cleanup tail of log so that it will contain useful messages 2021-07-16 22:39:14 +03:00
Azat Khuzhin
41a5609b81 test/stress: preserve stderr across runs, to preserve errors for final commands 2021-07-16 22:39:14 +03:00
Azat Khuzhin
39a62cc2ef test/stress: fix sanitizers errors detection 2021-07-16 22:39:14 +03:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Alexey Milovidov
c28f027b14 Fix error in stress test script 2021-07-15 10:24:35 +03:00
alexey-milovidov
c73f13be93
Merge pull request #26294 from arenadata/ADQM-325
yandex/clickhouse-test-base Dockerfile fix (mysql connector moved)
2021-07-14 15:37:00 +03:00
Alexander Tokmakov
f0ed6be269 Merge branch 'master' into system_zookeeper_log 2021-07-13 20:49:37 +03:00
Ilya Golshtein
d7777c6127 yandex/clickhouse-test-base Dockerfile fix (mysql connector moved) 2021-07-13 18:49:03 +03:00
Nikita Mikhaylov
3679a14214 update fast test 2021-07-13 10:51:34 +00:00
Nikita Mikhaylov
8062b492c5 added tests to skip list 2021-07-13 10:51:08 +00:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
kssenii
d6967dbd2b Update test 2021-07-11 19:10:52 +00:00
kssenii
40281f9283 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into g-arslan-add-sqlite-support 2021-07-10 06:50:46 +00:00
robot-clickhouse
8ae8b26954 Auto version update to [21.9.1.1] [54454] 2021-07-10 08:22:52 +03:00
kssenii
46e9e21419 Fix build 2021-07-09 15:47:57 +00:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
Vitaliy Zakaznikov
40a2fc8a18 Trying to fix collection of clickhouser server logs for TestFlows check. 2021-07-07 21:45:29 -04:00
alexey-milovidov
dfd9e1d737
Merge pull request #26011 from vzakaznikov/fix_and_enable_testflows_tests
Enabling all TestFlows modules and fixing some tests.
2021-07-07 22:46:25 +03:00
Vitaliy Zakaznikov
7f292c6006 Changing output back to new fails only. 2021-07-07 12:02:50 -04:00
alesapin
f0fc12d0dd Merge branch 'master' into evillique-nlp 2021-07-07 12:14:49 +03:00
alexey-milovidov
80eaf85301
Merge pull request #24416 from elevankoff/system-metrics
Common system metrics collection
2021-07-07 03:21:49 +03:00
Vitaliy Zakaznikov
89f89e33d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_and_enable_testflows_tests 2021-07-06 14:42:46 -04:00
Vitaliy Zakaznikov
d32d8ceff6 Changing TestFlows output to use classic mode instead of just new fails. 2021-07-06 06:58:16 -04:00
Alexey Milovidov
7ae15fee31 Change performance test after adjusted the name of column 2021-07-05 22:08:29 +03:00
Maksim Kita
577e69898a Compile aggregate functions perf tests fix 2021-07-05 12:17:01 +03:00
alexey-milovidov
fef7c557f6
Merge pull request #24789 from kitaisreal/compile-aggregation-functions
Compile aggregate functions
2021-07-05 02:57:49 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica
MaterializePostgreSQL table engine and database engine
2021-07-04 19:34:54 +03:00
Alexey Milovidov
e80a700cff More direct way to start ClickHouse 2021-07-04 02:13:32 +03:00
Alexey Milovidov
127455f15f Remove experimental ANTLR parser 2021-07-03 18:48:03 +03:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
mergify[bot]
892c67891a
Merge branch 'master' into fix-receive-time-metric 2021-07-01 21:40:09 +00:00
Maksim Kita
22491c8adc Compile AggregateFunctionCount 2021-07-01 22:56:36 +03:00
Azat Khuzhin
a471ebdabe Fix performance tests after converting ProfileEvents to Map type 2021-06-30 21:00:36 +03:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
alesapin
cdc95fa98a
Merge pull request #25428 from ClickHouse/zookeeper_snapshots
Tool for conversion of ZooKeeper data into clickhouse-keeper snapshot
2021-06-29 12:58:45 +03:00
alesapin
32bd94a84b
Merge pull request #25741 from ClickHouse/stress-test-separate-logs
Separate log files for separate runs in stress test
2021-06-29 10:47:39 +03:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge
Merging #23934
2021-06-29 04:19:53 +03:00
alexey-milovidov
350445c5f1
Update run.sh 2021-06-29 01:29:14 +03:00
mergify[bot]
04814114e7
Merge branch 'master' into zookeeper_snapshots 2021-06-28 14:17:32 +00:00
alexey-milovidov
1703bc91b0
Update run.sh 2021-06-28 16:21:17 +03:00
Maksim Kita
352e1f27ff Update using Map datatyle in system log tables before merge 2021-06-28 14:42:21 +03:00
alexey-milovidov
ee935a3733
Update run.sh 2021-06-28 14:28:49 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
Azat Khuzhin
f00a4668a4 Set follow-fork-mode child for gdb in stress/fasttest/fuzzer
Sometimes gdb does not catch SIGSEGV [1], let's try set this setting,
since maybe some code from contrib does fork.

  [1]: https://clickhouse-test-reports.s3.yandex.net/25605/cd5a3c8d7eb417f6df211b4507dc970933f8549a/stress_test_(thread).html#fail1
2021-06-28 10:04:08 +03:00
robot-clickhouse
648801760e Auto version update to [21.8.1.1] [54453] 2021-06-28 00:50:20 +03:00