Commit Graph

3019 Commits

Author SHA1 Message Date
Alexey Milovidov
e9e77b4403 .tech -> .com 2021-09-22 03:22:57 +03:00
Alexey Milovidov
04962e61ee Fix integration tests 2021-09-22 02:08:09 +03:00
alexey-milovidov
0880ae2883
Merge branch 'master' into yandex-to-clickhouse-in-configs 2021-09-21 20:17:28 +03:00
Yatsishin Ilya
c1f24cdd5e ro 2021-09-21 18:31:32 +03:00
Yatsishin Ilya
2f24a93dc1 Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-21 18:11:31 +03:00
alesapin
ac7579f187 Compressed logs for keeper 2021-09-21 17:29:05 +03:00
mergify[bot]
a8215b0436
Merge branch 'master' into test_send_crash_reports-fix 2021-09-21 10:21:34 +00:00
Anton Popov
55cf857aba
Merge pull request #28707 from azat/max_suspicious_broken_parts_bytes
Implement max_suspicious_broken_parts_bytes
2021-09-20 19:55:07 +03:00
tavplubix
922cf7ee20
Merge pull request #28373 from ClickHouse/tables_topsort
Resolve table dependencies on metadata loading
2021-09-20 14:46:47 +03:00
alesapin
a249dcc5f5
Merge pull request #28301 from kssenii/materialized-postgresql
MaterializedPostgreSQL: allow dynamically adding/deleting tables, altering settings
2021-09-20 14:16:29 +03:00
Yatsishin Ilya
cfa513c490 Merge remote-tracking branch 'origin' into improve-integration-1 2021-09-20 10:29:31 +03:00
Alexey Milovidov
147ef79670 Change website URL, part 1 2021-09-20 01:56:28 +03:00
Alexey Milovidov
f0925b3cf6 Changed substitution path name 2021-09-20 01:50:09 +03:00
Alexey Milovidov
e513a5db32 Change <yandex> to <clickhouse> in configs 2021-09-20 01:38:53 +03:00
Azat Khuzhin
f242b5e48c test_send_crash_reports: suppress Fatal messages check (due to explicit SIGSEGV)
CI: https://clickhouse-test-reports.s3.yandex.net/0/20d8523a2ebe22c93266e56fc097e273e4c8c68b/integration_tests_(asan).html#fail1
2021-09-19 00:15:35 +03:00
Azat Khuzhin
8f6cb9bd71 test_send_crash_reports: tiny pylint fixes 2021-09-19 00:15:34 +03:00
alexey-milovidov
20d8523a2e
Merge pull request #28888 from azat/mysql-in-fix
Fix queries to external databases (i.e. MySQL) with multiple columns in IN ( i.e. `(k,v) IN ((1, 2))` )
2021-09-18 15:53:40 +03:00
Azat Khuzhin
a613382d48 Cover max_suspicious_broken_parts/max_suspicious_broken_parts_bytes 2021-09-17 22:06:32 +03:00
mergify[bot]
c23f1fc160
Merge branch 'master' into fix_part_checker 2021-09-17 07:23:12 +00:00
Nikita Mikhaylov
c52b8ec083
Introduced MergeTask and MutateTask (#25165)
Introduced MergeTask and MutateTask
2021-09-17 00:19:58 +03:00
Kseniia Sumarokova
e9d44d0848
Merge pull request #28797 from kssenii/rabbit-fix
Rewrite StorageRabbitMQ a little
2021-09-16 23:58:51 +03:00
kssenii
432ca1ed93 Fix tests 2021-09-16 10:46:43 +00:00
kssenii
1650c92407 Better 2021-09-16 11:38:26 +03:00
Nikita Mikhaylov
6bf5b4cf2d
Merge pull request #28953 from vitlibar/allow-change-server-side-compression-from-client
gRPC: Allow change server-side compression from client.
2021-09-16 00:55:06 +03:00
alexey-milovidov
b6b0e442fe
Merge pull request #28723 from azat/test_distributed_load_balancing-fix
Increase number of iterations in test_distributed_load_balancing (fixes flakiness)
2021-09-16 00:25:54 +03:00
kssenii
84c8757049 Merge branch 'master' of github.com:ClickHouse/ClickHouse into named-collections 2021-09-15 12:28:31 +03:00
kssenii
710c8d12dd Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-15 12:28:09 +03:00
mergify[bot]
4993c7c527
Merge branch 'master' into fix_part_checker 2021-09-14 14:13:52 +00:00
Kseniia Sumarokova
d3e604e14b
Merge pull request #28603 from kssenii/fix-web-disk-2
Some fixes for static files disk
2021-09-14 08:24:24 +03:00
Alexander Tokmakov
8ac19caca9 Merge branch 'master' into tables_topsort 2021-09-13 16:58:39 +03:00
mergify[bot]
c54434084f
Merge branch 'master' into fix_part_checker 2021-09-13 13:19:34 +00:00
Filatenkov Artur
c23fe5baf6
Improve codec for encr 19896 (#27476)
* change syntax of encrypted command

* commit all encrypted changes

* correct encryption

* correct config for test

* add tests and correct code style and typos

* correct test

* fix unbundled build

* add log warning messages

* improve code according to review comments

* correct nonce

* correct errors found by fuzzing

* improve codec AES_128_GCM_SIV. Add AES_256_GCM_SIV. Add sections for last in tests. Improve documentation

* Update CompressionCodecEncrypted.h

* Update 01683_codec_encrypted.sql

* correct compression factory after changes in master

* correct behavior with wrong key in data

* correct fuzzer

* add connection for fuzzer with fix for compression_encrypted

* refactor code

* add load from config with throwing errors on server start

* fix typos and check style

* Update Server.cpp

* correct loading and reading

* refactor code. fix uninitialized value

* refactor code

* move defines from server to cpp file

* correct build

* remove repeated code

* correct namespace

* fix code style
2021-09-13 11:25:36 +03:00
alesapin
91e10adca5 Merge branch 'master' into fix_part_checker 2021-09-13 10:19:04 +03:00
Vitaly Baranov
113ddceabb gRPC: Allow change server-side compression from client. 2021-09-13 01:07:28 +03:00
mergify[bot]
267e56df8c
Merge branch 'master' into fix-web-disk-2 2021-09-11 15:45:43 +00:00
Azat Khuzhin
5ad9cb9b79 Add test_storage_mysql::test_mysql_in with multiple columns in IN 2021-09-11 14:15:27 +03:00
kssenii
ba1534f1df Fix checks 2021-09-10 14:16:01 +03:00
Alexander Tokmakov
3f8fb1e562 Merge branch 'master' into tables_topsort 2021-09-10 13:16:41 +03:00
alesapin
6243b64ff5
Merge pull request #28656 from ClickHouse/move_docker_images_to_separate_repo
Move docker images to a separate repo
2021-09-10 10:24:21 +03:00
alesapin
2359a222ff Fix more tests 2021-09-09 23:29:42 +03:00
alesapin
099c71f70b Add test 2021-09-09 19:45:42 +03:00
kssenii
0c013ed91b Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-web-disk-2 2021-09-09 15:26:36 +03:00
kssenii
904cf74159 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-09 15:26:20 +03:00
kssenii
00be148fce Merge branch 'master' of github.com:ClickHouse/ClickHouse into named-collections 2021-09-09 15:26:09 +03:00
tavplubix
341a6c51d6
Merging #24866 (#28691)
* Add StorageSystemISTables.cpp/.h

* Another attempt

* Columns and Views

* Add information schema db and fix information schema 'tables' table

* fix build

* remove copy-paste, add views to system tables

* add test

* fix

* fix_tests

Co-authored-by: Damir Petrov <petrovdamir2235@gmail.com>
Co-authored-by: Damir Petrov <0442a403@verstehen.sas.yp-c.yandex.net>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-09-09 12:37:51 +03:00
kssenii
e9721804b6 Fix tests 2021-09-09 12:34:47 +03:00
kssenii
f26da04cdf Fix checks 2021-09-09 09:53:58 +03:00
kssenii
bed2688dad Review fixes 2021-09-09 01:25:08 +03:00
kssenii
797f858bc6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-08 22:52:48 +03:00
kssenii
41bc68e82e Tests, url table function 2021-09-08 22:28:22 +03:00
kssenii
6108a4139c Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-web-disk-2 2021-09-08 20:54:07 +03:00
kssenii
ab6937ee45 Merge branch 'master' of github.com:ClickHouse/ClickHouse into named-collections 2021-09-08 20:43:37 +03:00
Nikita Mikhaylov
2b59fbacd3
Update tests/integration/test_MemoryTracking/test.py 2021-09-08 16:14:00 +03:00
mergify[bot]
9f0c50335f
Merge branch 'master' into tables_topsort 2021-09-08 10:55:11 +00:00
alesapin
3f11cbd31b Rename more images 2021-09-08 13:03:54 +03:00
Azat Khuzhin
4b10b978e8 Increase number of iterations in test_distributed_load_balancing (fixes flakiness)
Before there was some flakiness, because for 15 iterations it does
generate all unique values (3 unique nodes) [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/28604/9911b3ea368a7745934517747e62db3217cddb00/integration_tests_(thread).html#fail1

I've tried other techincs (cap random value to the maximum number of
nodes, other RNG, but these does not solve it either).
2021-09-08 10:49:01 +03:00
Azat Khuzhin
b243dec4b5 tests/integration/test_distributed_load_balancing: fix pylint warnings 2021-09-08 09:47:05 +03:00
Azat Khuzhin
e5d7791f87 Fix test_MemoryTracking integration test flakiness 2021-09-08 09:36:51 +03:00
kssenii
3deb9a0ecb s3, url, http headers 2021-09-07 14:17:25 +03:00
Maksim Kita
7a4a0b0ede
Merge pull request #28474 from azat/mysql-connection_no_block
Introduce connection_wait_timeout for MySQL engine.
2021-09-07 12:28:02 +03:00
Kseniia Sumarokova
9e496910a0
Merge pull request #28614 from kssenii/materialized-postgresql-2
MaterializedPostgreSQL: add solution to survive postgres primary failover
2021-09-06 22:31:15 +03:00
alesapin
8d67a34f93
Merge pull request #28526 from ClickHouse/add_test_for_two_nodes_configuration
Add test for keeper 2 node configuration
2021-09-06 13:44:38 +03:00
kssenii
76e49334fa Minor fixes 2021-09-05 01:59:44 +03:00
kssenii
d0113743c9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql 2021-09-05 01:07:31 +03:00
kssenii
28517e57fc Fix test 2021-09-04 23:55:59 +03:00
kssenii
5cb046dc10 Merge branch 'master' of github.com:ClickHouse/ClickHouse into named-collections 2021-09-04 21:40:42 +03:00
Maksim Kita
311110e36b
Merge pull request #28518 from kitaisreal/executable-pool-storage
Added ExecutablePool storage
2021-09-04 21:09:07 +03:00
mergify[bot]
5dfb3d683c
Merge branch 'master' into add_test_for_two_nodes_configuration 2021-09-04 12:45:55 +00:00
kssenii
ac2d9a73a8 User managed slots 2021-09-04 14:49:40 +03:00
kssenii
6ee94c923f Fix 2021-09-04 00:51:11 +03:00
kssenii
a4abcae97e Merge branch 'master' of github.com:ClickHouse/ClickHouse into named-collections 2021-09-03 16:33:26 +03:00
kssenii
a5f56bb588 Some other 2021-09-03 16:25:40 +03:00
alesapin
9345b3c45e Fixup flaky 2021-09-03 14:59:21 +03:00
Maksim Kita
af7220b6aa Updated ShellCommandSource 2021-09-03 13:00:40 +03:00
kssenii
f17d1bc7a5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into materialized-postgresql 2021-09-03 09:03:48 +00:00
alesapin
a182e621f0 Maybe it help 2021-09-03 11:53:26 +03:00
kssenii
6efbee320b Done MySQL 2021-09-03 11:30:28 +03:00
alesapin
36abf9f2f4 Fix broken kafka test 2021-09-03 10:51:37 +03:00
Azat Khuzhin
6d5f01a56b Cover MySQL setting connection_wait_timeout 2021-09-02 22:39:07 +03:00
Maksim Kita
027c531243
Merge pull request #28503 from kitaisreal/executable-multiple-pipes-added-test
Executable multiple pipes added test
2021-09-02 18:30:03 +03:00
alesapin
f1bc3d7720 Add test for keeper 2 node configuration 2021-09-02 16:54:30 +03:00
Alexander Tokmakov
666a3aee99 add another test 2021-09-02 16:34:46 +03:00
Yatsishin Ilya
1ea2dd4564 Improve work with iptables and services listing. 2021-09-02 15:43:15 +03:00
Maksim Kita
abda2a636e Added ExecutablePool storage 2021-09-02 14:53:20 +03:00
kssenii
7a45775f4f Complete postgres 2021-09-02 13:46:19 +03:00
alesapin
78a0cefafd
Merge pull request #28437 from ClickHouse/remove_some_tests
Remove some rename tests
2021-09-02 12:26:28 +03:00
Maksim Kita
3286b32499 Executable multiple pipes added test 2021-09-02 10:47:21 +03:00
Maksim Kita
befb82e441
Merge pull request #28433 from kssenii/fix-materialized-postgresql
Fix cannot use non-ordinary table names in materialized postgresql
2021-09-02 09:49:33 +03:00
kssenii
3423f8c984 Done postgres 2021-09-02 01:11:27 +03:00
Kseniia Sumarokova
e7dfb0e703
Update test.py 2021-09-01 17:32:09 +03:00
mergify[bot]
91ea6a8891
Merge branch 'master' into remove_some_tests 2021-09-01 14:07:07 +00:00
alesapin
68f6ecec62
Merge pull request #28184 from ClickHouse/trying_to_fix_fetches_test
Better detection of the default interface in replicated fetches tests
2021-09-01 12:21:50 +03:00
alesapin
4d94a72398 Remove some tests and make some of them lightweight 2021-09-01 10:31:45 +03:00
alexey-milovidov
77d085f264
Merge pull request #27527 from evillique/log_queries_probability
Add log_queries_probability setting
2021-09-01 00:51:23 +03:00
kssenii
445b6b34fc Fix 2021-08-31 20:58:00 +00:00
alexey-milovidov
307ae344db
Merge pull request #27934 from azat/integration-tests-improve-check
Improve server logs checking in integration tests
2021-08-31 23:08:51 +03:00
Ilya Yatsishin
8a269d64d2
Merge pull request #28354 from qoega/rework-kafka-topic-creation 2021-08-31 16:13:29 +03:00
alesapin
621dcfe84e Remove garbage 2021-08-31 14:36:24 +03:00
Maksim Kita
4ebd0ae941
Merge pull request #28102 from ClickHouse/executable-table-function
Merging #23192
2021-08-31 12:00:50 +03:00
alexey-milovidov
35d5957683
Merge pull request #28336 from ianton-ru/MDB-13951
Fix test_storage_s3/test_put_get_with_globs (cleanup after test)
2021-08-31 01:54:59 +03:00
Maksim Kita
c9a0b1e28e Updated tests 2021-08-30 21:41:36 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
Yatsishin Ilya
da4e688293 Improve kafka topic creation and deletion. Improve mongodb tests 2021-08-30 15:58:21 +03:00
Anton Ivashkin
2e33072469 Fix test_storage_s3/test_put_get_with_globs (cleanup after test) 2021-08-30 13:31:46 +03:00
Nikolay Degterinsky
2433d88b82 Merge branch 'master' into log_queries_probability 2021-08-30 12:55:33 +03:00
Nikolay Degterinsky
58773c9ef3 Add test 2021-08-30 12:53:56 +03:00
Maksim Kita
d88de46312 StorageExecutable added support for create 2021-08-29 23:19:05 +03:00
kssenii
f27f519aa2 Fix build and add example 2021-08-28 20:35:51 +00:00
Maksim Kita
4aa2479ca1 Added support for multiple pipes 2021-08-28 22:47:59 +03:00
kssenii
a2b0996ac3 Dynamically remove tables 2021-08-28 17:35:59 +03:00
kssenii
174340074c Dynamically add tables complete 2021-08-28 17:35:44 +03:00
tavplubix
c36fe210b8
Revert "Add test for #13398" 2021-08-27 21:07:10 +03:00
alesapin
cd389f12f6
Update network.py 2021-08-27 20:39:05 +03:00
alesapin
de96bd1be9
Update network.py 2021-08-27 10:25:28 +03:00
alesapin
b1d4967b88
Merge pull request #28190 from ClickHouse/fix_list_watches_semantics
More correct list watches semantics in ClickHouse Keeper
2021-08-27 10:13:25 +03:00
alesapin
1ff81b6678
Update network.py 2021-08-26 19:04:08 +03:00
alesapin
a6b4c28314
Update network.py 2021-08-26 18:27:14 +03:00
Kruglov Pavel
5bc332c40c
Merge pull request #28054 from kssenii/mysql
Add test for #13398
2021-08-26 16:39:43 +03:00
Kseniia Sumarokova
31afd7d09c
Merge pull request #28081 from kssenii/pg-conflict
Support `on conflict` for postgres engine
2021-08-26 16:30:30 +03:00
alesapin
ebfac8cfbb More correct list watches semantics in ClickHouse Keeper 2021-08-26 14:50:08 +03:00
alesapin
b34c0c5bd4 Better detection of the default interface 2021-08-26 13:42:04 +03:00
Maksim Kita
6ccdde4a88 Updated TableFunctionExecutable 2021-08-25 22:30:22 +03:00
Maksim Kita
dc852568c0
Merge pull request #27796 from ClickHouse/create-user-defined-lambda-function
Merging #23978
2021-08-25 10:08:20 +03:00
alexey-milovidov
47cc6c5afe
Merge pull request #28063 from vitlibar/set-fixed-version-of-tzlocal
Set version of tzlocal to 2.1
2021-08-25 02:48:08 +03:00
Maksim Kita
167d34051c
Merge pull request #28066 from ClickHouse/fix_zookeeper_secure_test
Fix zookeeper secure client test
2021-08-24 21:39:31 +03:00
Maksim Kita
82ba24cd10 Merge branch 'master' into create-user-defined-lambda-function 2021-08-24 19:12:32 +03:00
kssenii
0ec716292c Postgres ON CONFLICT 2021-08-24 12:37:32 +00:00
alexey-milovidov
739caf86d5
Merge pull request #27484 from excitoon/patch-10
Don't silently ignore errors and don't count delays in `ReadBufferFromS3`
2021-08-24 15:26:39 +03:00
Vitaly Baranov
8dc128f3d9 Set version of tzlocal to 2.1 2021-08-24 14:07:48 +03:00
alesapin
2d480b33b6 Fix zookeeper secure client test 2021-08-24 11:01:08 +03:00
kssenii
0d5000f917 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into mysql 2021-08-24 07:30:42 +00:00
kssenii
b536653851 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-24 07:29:50 +00:00
Vladimir C
98acccbdcc
Merge branch 'master' into s3partitionedwrite 2021-08-24 10:03:57 +03:00
kssenii
5307d31924 Throw for alter and silence for drop 2021-08-23 23:48:53 +00:00
kssenii
962f415740 Add test and settings 2021-08-23 22:18:04 +00:00
Vitaly Baranov
63e8bc1f20 Added new commands BACKUP and RESTORE. 2021-08-23 23:41:45 +03:00
Maksim Kita
010d72593f Fixed integration tests 2021-08-23 17:31:58 +03:00
alexey-milovidov
983aab8818
Merge pull request #27176 from excitoon-favorites/s3unstablereadstest
S3 disk unstable reads test
2021-08-23 13:27:55 +03:00
Maksim Kita
2a6aa50d49 Merge branch 'master' into create-user-defined-lambda-function 2021-08-23 11:08:49 +03:00
vdimir
6ba6577978 Do not allow slashes in bucket formatted from PARTITION BY 2021-08-23 09:22:15 +03:00
vdimir
c4c42b61c4 Validate uft8 in partition key from PARTITION BY for s3 2021-08-23 09:22:15 +03:00
Vladimir Chebotarev
2223ae4ddc Added integration test. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
f45dbd6cbc Fixed test. 2021-08-23 09:22:14 +03:00
Vladimir Chebotarev
b4484f4f21 Test fix. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
e99433e094 Better functionality. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
328213f5d9 Fixes. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
0879dbbfa7 Test. 2021-08-23 09:22:13 +03:00
Vladimir Chebotarev
f14f6cb4cc Fixed warning in test. 2021-08-23 05:05:49 +00:00
Azat Khuzhin
2785aca25d Improve server logs checking in integration tests
Since some dtors will be called only after SIGTERM, check after server
is exited.

Also Fatal messages does not fails tests before.
2021-08-21 23:34:36 +03:00
kssenii
945e2c4ce5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-20 18:01:23 +00:00