Commit Graph

2786 Commits

Author SHA1 Message Date
alexey-milovidov
0a26687115
Merge pull request #23864 from azat/dist-split-batch-and-retry
Add ability to split distributed batch on failures (i.e. due to memory limits)
2021-06-27 19:28:26 +03:00
kssenii
db998c3f6c More robust 2021-06-27 16:28:10 +00:00
alesapin
c977c33d6d Fix bug in execution of TTL GROUP BY 2021-06-27 19:18:15 +03:00
kssenii
159de92197 Uncomment test 2021-06-26 22:05:20 +00:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
alexey-milovidov
420839a4c0
Merge pull request #25697 from sundy-li/mysql-fix
[mysql] fix mysql select user() return empty
2021-06-26 03:31:46 +03:00
Kostiantyn Storozhuk
ca04b077ef Improved column comments support 2021-06-25 22:30:11 +08:00
Anton Popov
4a250dc14e
Merge pull request #25371 from CurtizJ/add-compatibility-setting
Add compatibility setting for name of tuple literals
2021-06-25 15:08:13 +03:00
Storozhuk Kostiantyn
4a3145f586 Materialize my sql support enum data type
* Implemented Enum for MaterializeMySQL
2021-06-25 16:42:25 +08:00
sundy-li
d423d07a87 [mysql] fix mysql select user() return empty 2021-06-25 10:20:22 +08:00
Anton Popov
a15ee72d0f Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-23 13:53:01 +03:00
Vitaly Baranov
c6d877d10b Add tests for checking access rights for SELECT. 2021-06-23 12:54:50 +03:00
Azat Khuzhin
353a770a87 Extend test_insert_distributed_async_send for distributed_directory_monitor_split_batch_on_failure 2021-06-23 02:48:47 +03:00
Azat Khuzhin
a0209178cc Add ability to split distributed batch on failures
Add distributed_directory_monitor_split_batch_on_failure setting (OFF by
default), that will split the batch and send files one by one in case of
retriable errors.

v2: more error codes
2021-06-23 02:48:47 +03:00
Azat Khuzhin
e148ef739d Drop replicas from dirname for internal_replication=true
Under use_compact_format_in_distributed_parts_names=1 and
internal_replication=true the server encodes all replicas for the
directory name for async INSERT into Distributed, and the directory name
looks like:

    shard1_replica1,shard1_replica2,shard3_replica3

This is required for creating connections (to specific replicas only),
but in case of internal_replication=true, this can be avoided, since
this path will always includes all replicas.

This patch replaces all replicas with "_all_replicas" marker.

Note, that initial problem was that this path may overflow the NAME_MAX
if you will have more then 15 replicas, and the server will fail to
create the directory.

Also note, that changed directory name should not be a problem, since:
- empty directories will be removed since #16729
- and replicas encoded in the directory name is also supported anyway.
2021-06-23 02:47:38 +03:00
alesapin
788e61f80e Snapshots test 2021-06-22 14:43:26 +03:00
alesapin
6b815b4f17 Merge branch 'master' into zookeeper_snapshots 2021-06-22 13:50:27 +03:00
alesapin
bf0a4864ac Add support for set/get ACL commands 2021-06-22 13:49:35 +03:00
alesapin
730554589f fix superdigest 2021-06-22 11:14:54 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests
Fix some bugs in integration tests
2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6
More integration tests improvements
2021-06-22 10:19:22 +03:00
Kseniia Sumarokova
155bb03239
Merge branch 'master' into pg-dix 2021-06-22 10:14:52 +03:00
alesapin
70f7959de2 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 23:02:42 +03:00
alesapin
8bbe65b4f4 Remove timeouts 2021-06-21 23:02:00 +03:00
alesapin
a356a9ca3d Merge branch 'fix_some_tests' into zookeeper_snapshots 2021-06-21 23:00:07 +03:00
Kseniia Sumarokova
41c65a9965
Merge pull request #25528 from kssenii/something
Fix convertion of datetime with timezone for mysql, odbc, etc..
2021-06-21 22:55:22 +03:00
alesapin
c9c22996d4 One more fixed test 2021-06-21 22:52:44 +03:00
Kseniia Sumarokova
f47dd116c4
Update test.py 2021-06-21 19:07:17 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
alesapin
731edc9a6d Fixes in ACLs 2021-06-21 18:45:45 +03:00
kssenii
ac0f86cdbf Truncate for s3 2021-06-21 15:44:36 +00:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
kssenii
4688f9e038 hdfs truncate table 2021-06-21 13:59:57 +00:00
alesapin
76cee4e3cf Debugging 2021-06-21 16:58:39 +03:00
kssenii
0f9fc33a4e Fix postgres arrays 2021-06-21 11:27:10 +00:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
Anton Popov
c2754c34f4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-21 12:42:48 +03:00
kssenii
c0732ddc12 Fix datetime with timezone 2021-06-21 08:22:12 +00:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option"
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option
Add run-id option to integration tests
2021-06-21 10:21:24 +03:00
Nikolay Degterinsky
8cb25c5757 Fixed lemmatize integration test 2021-06-20 11:28:35 +00:00
Mike Kot
4c391f8e99
SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652)
* initial commit: add setting and stub

* typo

* added test stub

* fix

* wip merging new integration test and code proto

* adding steps interpreters

* adding firstly proposed solution (moving parts etc)

* added checking zookeeper path existence

* fixing the include

* fixing and sorting includes

* fixing outdated struct

* fix the name

* added ast ptr as level of indirection

* fix ref

* updating the changes

* working on test stub

* fix iterator -> reference

* revert rocksdb submodule update

* fixed show privileges test

* updated the test stub

* replaced rand() with thread_local_rng(), updated the tests

updated the test

fixed test config path

test fix

removed error messages

fixed the test

updated the test

fixed string literal

fixed literal

typo: =

* fixed the empty replica error message

* updated the test and the code with logs

* updated the possible test cases, updated

* added the code/test milestone comments

* updated the test (added more testcases)

* replaced native assert with CH one

* individual replicas recursive delete fix

* updated the AS db.name AST

* two small logging fixes

* manually generated AST fixes

* Updated the test, added the possible algo change

* Some thoughts about optimizing the solution:

ALTER MOVE PARTITION .. TO TABLE -> move to detached/ + ALTER ... ATTACH

* fix

* Removed the replica sync in test as it's invalid

* Some test tweaks

* tmp

* Rewrote the algo by using the executeQuery instead of

hand-crafting the ASTPtr.

Two questions still active.

* tr: logging active parts

* Extracted the parts moving algo into a separate helper function

* Fixed the test data and the queries slightly

* Replaced query to system.parts to direct invocation,

started building the test that breaks on various parts.

* Added the case for tables when at least one replica is alive

* Updated the test to test replicas restoration by detaching/attaching

* Altered the test to check restoration without replica restart

* Added the tables swap in the start if the server failed last time

* Hotfix when only /replicas/replica... path was deleted

* Restore ZK paths while creating a replicated MergeTree table

* Updated the docs, fixed the algo for individual replicas restoration case

* Initial parts table storage fix, tests sync fix

* Reverted individual replica restoration to general algo

* Slightly optimised getDataParts

* Trying another solution with parts detaching

* Rewrote algo without any steps, added ON CLUSTER support

* Attaching parts from other replica on restoration

* Getting part checksums from ZK

* Removed ON CLUSTER, finished working solution

* Multiple small changes after review

* Fixing parallel test

* Supporting rewritten form on cluster

* Test fix

* Moar logging

* Using source replica as checksum provider

* improve test, remove some code from parser

* Trying solution with move to detached + forget

* Moving all parts (not only Committed) to detached

* Edited docs for RESTORE REPLICA

* Re-merging

* minor fixes

Co-authored-by: Alexander Tokmakov <avtokmakov@yandex-team.ru>
2021-06-20 11:24:43 +03:00
Nikolay Degterinsky
b1c15d9014 Fixed integration test 2021-06-19 20:27:26 +00:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
alesapin
b5dae909dd Add some tests 2021-06-18 21:36:19 +03:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
f0490ad7c1 Better formatting 2021-06-18 12:24:04 +03:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
alesapin
9e77ca7182
Merge branch 'master' into nlp 2021-06-17 21:47:41 +03:00
alexey-milovidov
66c0df99d4
Merge pull request #25323 from ClickHouse/try-to-change-signal-for-integration-rests
Use signal 15 in restart_with_latest_version
2021-06-17 20:56:00 +03:00
mergify[bot]
04adc58ba1
Merge branch 'master' into try-to-change-signal-for-integration-rests 2021-06-17 06:20:40 +00:00
mergify[bot]
41d007a1b3
Merge branch 'master' into MySQL-column-comments-support 2021-06-17 05:40:15 +00:00
alexey-milovidov
34891f5954
Merge pull request #25317 from ClickHouse/try-fix-ttl-repl
Update test_ttl_replicated
2021-06-17 01:46:13 +03:00
Kseniia Sumarokova
60d220bd14
Merge pull request #24413 from kssenii/postgres-fixes-schema
postgres non-default schema for insert query
2021-06-16 22:18:23 +03:00
Anton Popov
ea9b890618
Merge branch 'master' into add-compatibility-setting 2021-06-16 21:10:56 +03:00
Anton Popov
8bd7cbd925 add compatibility setting for name of columns 2021-06-16 21:10:07 +03:00
Yatsishin Ilya
1d6253b9dc hardening 2021-06-16 18:37:51 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
Nikolai Kochetov
7c3926ac57 Update test_ttl_replicated 2021-06-16 12:55:48 +03:00
Nikolai Kochetov
8bf55ae2b5
Merge pull request #25166 from ClickHouse/always-detach-parts-with-wrong-partition-id
Always detach parts with wrong partition ID
2021-06-16 11:06:07 +03:00
Kostiantyn Storozhuk
d96478c9ff Integration test added and small fixes 2021-06-15 21:45:30 +08:00
Nikolai Kochetov
b65c121a45
Update test_detach_part_wrong_partition_id.py 2021-06-15 13:38:11 +03:00
alexey-milovidov
77721734ed
Merge pull request #21267 from filimonov/kafka-failover
Kafka failover issue fix
2021-06-14 01:42:42 +03:00
alexey-milovidov
7c048a9dc8
Merge pull request #23976 from excitoon-favorites/s3unstablereads
Improved `test_storage_s3_get_unstable`
2021-06-12 04:04:29 +03:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries
Remove explicit enable_dictionaries files in integration tests
2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit
Add integration test for jdbc bridge
2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00
Yatsishin Ilya
fe712caa5c typo 2021-06-11 13:50:44 +03:00
Yatsishin Ilya
d7fca4a6f2 wait hdfs longer 2021-06-11 12:30:09 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
Yatsishin Ilya
fa0551a1a3 fix test_partition 2021-06-11 11:39:28 +03:00
alesapin
54f9db670f
Merge pull request #25079 from ClickHouse/debug_network_interfaces
Trying to debug fetches bandwith test failures
2021-06-11 10:30:14 +03:00
mergify[bot]
4eb2b33127
Merge branch 'master' into filter_tests_in_ci_runner 2021-06-10 16:15:43 +00:00
Nikolai Kochetov
3bfefa50e2 Add user arg to exec_in_container with cli 2021-06-10 15:15:07 +03:00
Nikolai Kochetov
2936fdd16c Always detach parts with wrong partition id. 2021-06-10 15:04:36 +03:00
Vladimir Chebotarev
f16dd06476 Review fixes. 2021-06-10 08:49:26 +03:00
Vladimir Chebotarev
591c556321 Improved test_storage_s3_get_unstable. 2021-06-10 08:49:26 +03:00
alexey-milovidov
77ab26e217
Merge branch 'master' into less_timeouts 2021-06-10 02:03:16 +03:00
filimonov
3f1d3f2e1d
Update test.py 2021-06-09 23:20:44 +02:00
Yatsishin Ilya
035df8ba28 fixed 2021-06-09 18:49:18 +03:00
Yatsishin Ilya
0c2380e4ac Merge remote-tracking branch 'qoega/better-hdfs-tests' into remove-enable-dictionaries 2021-06-09 17:08:02 +03:00
Mikhail Filimonov
3627ab7cbe
Fix kafka failover issue (#21118).
Distringuish lack of assignment vs lack of partitions. Bit better / clearer logging.
2021-06-09 16:02:56 +02:00
Yatsishin Ilya
dd3fd87e26 Fix kerberized hdfs and cleanup 2021-06-09 16:53:16 +03:00
alesapin
192210fea6 Consistent style 2021-06-09 16:42:20 +03:00
alesapin
46aee86d3a Fix flaky check report in CI runner 2021-06-09 16:40:28 +03:00
mergify[bot]
bc012b9c1a
Merge branch 'master' into recreate_kafka_table_case 2021-06-09 10:30:32 +00:00
filimonov
7469f054f0
Update test.py
Missed one of the refactorings which were merged in the meanwhile 872e36c207 (diff-8129a3b04ff2293c2d89b35395be9ef49918cdafd4420a745d05733b00979646L86-R100)
2021-06-09 12:27:42 +02:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Yatsishin Ilya
257b9c0731 typo 2021-06-09 12:03:03 +03:00
Yatsishin Ilya
8d6b5d52ab typo 2021-06-09 11:52:20 +03:00
Yatsishin Ilya
a9108e42c3 Better test_odbc_interaction 2021-06-09 11:46:01 +03:00
Yatsishin Ilya
df27e2754b resolve 2021-06-09 11:46:01 +03:00
Nikita Mikhaylov
82b8d45cd7
Merge pull request #23518 from nikitamikhaylov/copier-stuck
Bugfixes and improvements of `clickhouse-copier`
2021-06-09 11:36:42 +03:00
mergify[bot]
156592af95
Merge branch 'master' into debug_network_interfaces 2021-06-09 07:56:02 +00:00
alesapin
7179fafef0 Less timeouts in integration tests 2021-06-09 10:49:29 +03:00
kssenii
0521851afa Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgres-fixes-schema 2021-06-08 17:20:23 +00:00
alesapin
eeb75d15da Remove timeouts 2021-06-08 19:21:55 +03:00
alesapin
49b5b94187 Remove strange timeout in test 2021-06-08 19:15:04 +03:00
alesapin
fc805a1ece Trying to debug fetches bandwith test failures 2021-06-08 15:13:45 +03:00
Nikita Mikhaylov
c3f03e8f60 skip ttl_move_to_volume 2021-06-08 11:14:45 +00:00
Nikita Mikhaylov
22864aff23 delete files 2021-06-08 01:52:30 +00:00
Nikita Mikhaylov
c0238e839a another try to fix tests 2021-06-08 01:50:43 +00:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
Ilya Yatsishin
c453a84944
Merge pull request #24973 from qoega/cleanup-iptables-on-session-start 2021-06-07 15:43:13 +03:00
Nikita Mikhaylov
6f5997b0aa fix tests 2021-06-07 10:49:01 +00:00
Nikita Mikhaylov
652de7c9b0
Update test.py 2021-06-07 13:06:41 +03:00
alesapin
fba2d66042 Disable storage_kerberized_hdfs test 2021-06-07 12:25:13 +03:00
alexey-milovidov
344fc39e41
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-07 02:56:32 +03:00
alexey-milovidov
cc5755b1a4
Merge pull request #25002 from ClickHouse/compression-codecs-refactoring
Compression codecs refactoring
2021-06-07 02:54:24 +03:00
mergify[bot]
f84ac23951
Merge branch 'master' into compression-codecs-refactoring 2021-06-06 18:02:39 +00:00
mergify[bot]
e9d01d7e4f
Merge branch 'master' into fix-integration-test-s3 2021-06-06 18:02:34 +00:00
mergify[bot]
1172807442
Merge branch 'master' into recreate_kafka_table_case 2021-06-06 12:15:55 +00:00
alexey-milovidov
8b99fa049e
Merge pull request #24967 from filimonov/fix_port_in_kafka_test
Fix the test after #20393
2021-06-06 15:11:49 +03:00
Alexey Milovidov
b146524fdb Maybe Minio starts for too long in tests 2021-06-06 12:38:49 +03:00
Alexey Milovidov
8d85145725 Remove experimental compression codecs 2021-06-06 02:26:52 +03:00
Nikita Mikhaylov
b99350b50d
Update test.py 2021-06-06 02:19:17 +03:00
Alexey Milovidov
17962459f5 Merge branch 'master' into issue-16775 2021-06-06 02:18:28 +03:00
Ilya Yatsishin
f2eed22ebd
Merge pull request #24954 from ClickHouse/fix_integration_test 2021-06-05 20:18:33 +03:00
Ilya Yatsishin
3092ec7c7e
Merge pull request #24959 from qoega/no-more-subprocess-call 2021-06-05 19:41:52 +03:00
mergify[bot]
f56e7c6e3a
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-05 12:10:18 +00:00
Nikolay Degterinsky
1d6a01dd6f added tests 2021-06-05 02:52:18 +00:00
mergify[bot]
d8ed474062
Merge branch 'master' into copier-stuck 2021-06-05 01:40:23 +00:00
Yatsishin Ilya
df6e163976 fix 2021-06-04 18:46:11 +03:00
Yatsishin Ilya
9f6de5f764 opt-in for cleanup 2021-06-04 18:00:59 +03:00
Yatsishin Ilya
05232e7c40 Make tests great again 2021-06-04 17:33:22 +03:00
Nikita Mikhaylov
f6932026d5 delete partition from original table in case of errors while moving 2021-06-04 14:21:47 +00:00
tavplubix
19727ff753
Update test.py 2021-06-04 16:58:28 +03:00
Mikhail Filimonov
c8fe168a8d
Fix the test after #20393 2021-06-04 15:55:07 +02:00
filimonov
74ae079b19
Update test.py 2021-06-04 15:30:25 +02:00
Nikita Mikhaylov
cf8782faf3
Merge pull request #24311 from nikitamikhaylov/merging-s3-backoff
Merging #23461
2021-06-04 14:41:21 +03:00
kssenii
00e76ca372 Checking tests 2021-06-04 11:34:51 +00:00
alesapin
c03f54e2c3 Skip skipped tests 2021-06-04 13:15:44 +03:00
Yatsishin Ilya
e075130112 Remove subprocess_call from cluster.py 2021-06-04 13:14:32 +03:00
alesapin
a0eb45bfc3 More stable test 2021-06-04 12:12:35 +03:00
Yatsishin Ilya
e18343ce17 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-04 11:43:41 +03:00
alesapin
4d7170b557 Followup fixes for integration tests 2021-06-04 10:51:45 +03:00
alesapin
7ca31261b0
Merge pull request #24911 from ClickHouse/remove_some_tests
Remove some outdated integration tests
2021-06-04 10:15:39 +03:00
kssenii
e23bc14582 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-03 19:44:55 +00:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff 2021-06-03 18:58:24 +00:00
Mikhail Filimonov
e11f7db28b
Add test #23430 2021-06-03 20:41:01 +02:00
Nikita Mikhaylov
b978405f4a fix 2021-06-03 15:50:44 +00:00
Nikita Mikhaylov
6c583b0e36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-03 15:05:23 +00:00
Ilya Yatsishin
e0a683a407
Mute test_memory_consumption before #24784 2021-06-03 16:10:54 +03:00
tavplubix
1aff716f18
Merge pull request #24777 from ClickHouse/fix_intersection_with_lost_part
Do not crash on intersecting virtual parts
2021-06-03 15:42:46 +03:00
alesapin
31b27049b0 Followup 2021-06-03 15:42:12 +03:00
alesapin
6231a0d7d7 Merge branch 'master' into remove_some_tests 2021-06-03 15:41:50 +03:00
alesapin
f0f5aba3b1
Merge pull request #20393 from qoega/integration-2
Grand integration tests refactoring: Allow parallel run
2021-06-03 15:20:03 +03:00
alesapin
376b3872bf Remove some outdated integration tests 2021-06-03 14:49:59 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Yatsishin Ilya
ddddb761db more 2021-06-02 18:08:16 +03:00
Yatsishin Ilya
6a9b875b19 simplify test_backup_restore 2021-06-02 17:33:47 +03:00
Nikita Mikhaylov
4382aac25d support for ReplicatedTable creation without arguments 2021-06-02 15:46:37 +03:00
alesapin
f7babe5cd9 Fix build and better test 2021-06-02 11:22:44 +03:00
alesapin
feed2636f4 Add exponential smoothing to Throttler 2021-06-02 01:07:29 +03:00
Nikita Mikhaylov
312bb96eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-02 01:04:47 +03:00
Nikita Mikhaylov
f57863b974 fix tests 2021-06-02 01:03:08 +03:00
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
Yatsishin Ilya
d51a6a2c1f Merge remote-tracking branch 'origin' into integration-2 2021-06-01 17:23:01 +03:00
Yatsishin Ilya
ff7f7f6200 try 2021-06-01 17:18:35 +03:00
Nikita Mikhaylov
3f18bde246 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-s3-backoff 2021-06-01 13:39:09 +00:00
Alexander Tokmakov
7d7c5638a5 Merge branch 'master' into fix_intersection_with_lost_part 2021-06-01 16:32:59 +03:00
Nikita Mikhaylov
5dda97bef1
Merge pull request #24691 from nikitamikhaylov/debug_host_ip_change
Fix flaky integration tests
2021-06-01 15:55:51 +03:00
alesapin
c3321bef30 Merge branch 'master' into limited_fetches 2021-06-01 13:09:02 +03:00
Yatsishin Ilya
2983a9ba61 use cli for exec 2021-06-01 12:53:36 +03:00
Yatsishin Ilya
7656ab3c85 try tmpfs in runner 2021-06-01 11:44:09 +03:00
Yatsishin Ilya
739ff5fee7 increase docker client timeout 2021-06-01 11:43:44 +03:00
Yatsishin Ilya
aac97b6582 test_always_fetch_merged 2021-06-01 10:02:22 +03:00
Nikita Mikhaylov
0d8ede15a9
Merge branch 'master' into merging-s3-backoff 2021-05-31 21:07:00 +03:00
Yatsishin Ilya
7bb1709185 smaller pack 2021-05-31 18:46:32 +03:00
Nikita Mikhaylov
33dcebbb24 style 2021-05-31 17:41:35 +03:00
Nikita Mikhaylov
1c548058e6 add status json 2021-05-31 17:38:55 +03:00
Nikita Mikhaylov
ac072243d6 style + enable trivial test 2021-05-31 17:38:55 +03:00
Nikita Mikhaylov
b4895b1e72 better 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
6d19dea761 better 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
fa22b41d5a added allow_to_drop_target_partitions with test 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
267319ffeb added test with ttl move to volume 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
9022646633 support copying of tables with data skipping indices 2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
86c9373fb7 prettify tests 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
c41cc36046 support TTL on columns 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
90ab394769 better 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
2017d2f918 save 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
5bd6183e67 save 2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
f3c81f4c9b disable test under msan 2021-05-31 17:30:02 +03:00
Yatsishin Ilya
79501da420 typo 2021-05-31 07:17:08 +03:00
Yatsishin Ilya
5f0373dace lost in merge 2021-05-31 07:12:22 +03:00
Yatsishin Ilya
1cb3c43a1c Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-05-31 07:08:59 +03:00
Yatsishin Ilya
0c2318c59b tune runner for now 2021-05-31 07:07:32 +03:00
Yatsishin Ilya
80f07051f2 other path 2021-05-31 07:06:14 +03:00
Yatsishin Ilya
b683f71ae6 Merge remote-tracking branch 'origin' into integration-2 2021-05-31 07:03:27 +03:00
Alexander Tokmakov
16647fe8ce some unrelated fixes 2021-05-31 00:29:37 +03:00
alesapin
07afb42e79
Merge pull request #24448 from ClickHouse/keeper_auth
Add ACL system to Keeper
2021-05-30 16:17:40 +03:00
Nikita Mikhaylov
d9cc77c429 keep 2021-05-28 21:22:25 +03:00
Yatsishin Ilya
cb2277381f try remove 2021-05-28 18:45:56 +03:00
Nikita Mikhaylov
095f06c8a3 raise timeout for test_host_ip_change/test.py::test_user_access_ip_change 2021-05-28 17:37:05 +03:00
alesapin
a1efea20dc Better ACLs storage on disk (update snapshot version) 2021-05-28 14:52:19 +03:00
alesapin
764902c8d3 Remove print 2021-05-28 00:25:17 +03:00
Nikolai Kochetov
3d8e7c95c7
Merge pull request #24561 from ClickHouse/try-fix-test_reload_after_loading
Fix flaky test
2021-05-27 20:57:30 +03:00
Nikolai Kochetov
00628925eb
Merge pull request #24560 from ClickHouse/more-diagnostic-for-test_jbod_overflow
Update test_multiple_disks
2021-05-27 20:39:21 +03:00
Yatsishin Ilya
305134f037 fix 2021-05-27 18:20:50 +03:00
alesapin
a961100916 More stable test 2021-05-27 18:02:06 +03:00
alesapin
6860946d3c Cleanup in test 2021-05-27 16:00:08 +03:00
alesapin
2985def91d Add tests 2021-05-27 15:54:47 +03:00
Nikolai Kochetov
14756e5707 Update dict lifetime 2021-05-27 13:51:53 +03:00
Nikolai Kochetov
0ca38335a7 Update dict lifetime 2021-05-27 12:09:56 +03:00
Nikolai Kochetov
02ed069e81 Fix flaky test 2021-05-27 11:49:42 +03:00
Nikolai Kochetov
ec0f55d899 Update test_multiple_disks 2021-05-27 11:32:18 +03:00
Yatsishin Ilya
55dd173535 more 2021-05-27 10:58:12 +03:00
Yatsishin Ilya
ae60a3dd3a new tests from master 2021-05-27 07:24:16 +03:00
Yatsishin Ilya
28af06f3d0 Merge remote-tracking branch 'origin' into integration-2 2021-05-27 07:01:22 +03:00
kssenii
e56b10f07c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-26 21:55:10 +00:00
mergify[bot]
d1338230f4
Merge branch 'master' into keeper_auth 2021-05-26 13:55:00 +00:00
Yatsishin Ilya
99e3be018e better 2021-05-26 15:06:31 +03:00
Yatsishin Ilya
d17b46d69f fix mongo logging 2021-05-26 15:06:13 +03:00
Kseniia Sumarokova
cb8af0fd4c
Merge pull request #11058 from overshov/master
Implement IDisk interface for HDFS
2021-05-26 14:14:06 +03:00
alesapin
9e6a713f18
Merge pull request #24465 from ClickHouse/filimonov-kafka-flaky
Try to improve kafka flaky test
2021-05-26 11:52:44 +03:00
alesapin
069d45790f
Merge pull request #24157 from kssenii/modulo-partition-key
Adjust modulo function when used in partition key
2021-05-26 10:30:54 +03:00
Yatsishin Ilya
b26b97ec6c fix 2021-05-26 07:40:53 +03:00
Alexey Milovidov
374923ab90 Update integration test 2021-05-26 03:48:11 +03:00
Yatsishin Ilya
f5e584b6af fix 2021-05-25 19:56:03 +03:00
Yatsishin Ilya
b44c056fa4 lost file 2021-05-25 19:55:02 +03:00
Yatsishin Ilya
9282c7470c better 2021-05-25 19:53:55 +03:00
Yatsishin Ilya
53295f9b51 blacklist 2021-05-25 19:53:42 +03:00
Yatsishin Ilya
a667a1c032 better 2021-05-25 18:32:24 +03:00
mergify[bot]
400b74d186
Merge branch 'master' into merging-s3-backoff 2021-05-25 14:02:38 +00:00
Yatsishin Ilya
e9ccf906c4 improvements 2021-05-25 16:40:22 +03:00
Yatsishin Ilya
893cd47bd2 better 2021-05-25 15:40:59 +03:00
filimonov
88919080d5
Try to improve kafka flaky test 2021-05-24 22:37:16 +02:00
kssenii
cef509e5b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-24 17:39:34 +00:00
Anton Ivashkin
c936dab6d5 Fix part type in Fetcher::downloadPartToS3 2021-05-24 19:37:37 +03:00
Yatsishin Ilya
c191a631e8 touch 2021-05-24 18:30:51 +03:00
Anton Ivashkin
a98286b4c4 Merge master 2021-05-24 17:46:29 +03:00
Nicolae Vartolomei
700850a970 Add more tests and handle correctly missing include 2021-05-24 14:24:39 +01:00
Nicolae Vartolomei
4c3882f2f9 Config in-place include 2021-05-24 14:24:39 +01:00
Anton Ivashkin
6c4e4b751c Decrease iterations in test_s3_zero_copy_replication 2021-05-24 16:05:11 +03:00
alesapin
11ac483e12 Add tests 2021-05-24 15:18:04 +03:00
Yatsishin Ilya
8939daf7e7 more 2021-05-24 11:23:04 +03:00
Yatsishin Ilya
c32cea4dd2 Merge remote-tracking branch 'origin' into integration-2 2021-05-24 09:59:16 +03:00
Alexey Milovidov
273226de32 Remove string parameter for Density 2021-05-24 06:43:25 +03:00
Alexey Milovidov
6f70feed2f Merge branch 'master' into issue-16775 2021-05-24 05:56:57 +03:00
kssenii
659e57e60f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-23 22:46:00 +00:00
kssenii
ecd82213d1 Some clean up, more tests 2021-05-23 20:19:04 +00:00
alesapin
cd815efaee Merge branch 'master' into keeper_auth 2021-05-23 20:57:18 +03:00
Alexandra
2cf92050ab init retest 2021-05-23 13:31:48 +00:00
kssenii
da32f66122 More tests 2021-05-23 12:47:52 +00:00
Alexandra
0a5dc1fcf7 add optimize on encrypted disk integration test 2021-05-23 12:44:45 +00:00
kssenii
a78c9e63e7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-23 12:07:26 +00:00
Alexandra
45d8a63ff4 add disk_s3_encrypted to integration test 2021-05-23 08:43:29 +00:00
kssenii
0f98731c1f More integration tests 2021-05-23 07:33:31 +00:00
alesapin
6c0b683d3a
Merge pull request #17871 from nvartolomei/nv/parts-uuid-move-shard
Part movement between shards
2021-05-23 10:20:57 +03:00
mergify[bot]
3c6e6464a7
Merge branch 'master' into s3_zero_copy_replication 2021-05-23 07:09:17 +00:00
Alexey Milovidov
fff2f7b2be Fix style, fix typo and remove extra code 2021-05-23 03:21:21 +03:00
Alexandra
9029ca8c36 add test_encrypted_disk integration test 2021-05-23 00:18:59 +00:00
Alexandra
928c8bf1de update test_disk_types with encrypted disk 2021-05-22 19:19:23 +00:00
kssenii
b72f6ea78e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into modulo-partition-key 2021-05-22 16:15:15 +00:00
alexey-milovidov
1ed30f7246
Merge branch 'master' into issue-16775 2021-05-22 17:14:23 +03:00
kssenii
3e6d3d4ecb Postgres schema for insert 2021-05-22 08:50:23 +00:00
alesapin
6e593cda7b Working test 2021-05-22 10:38:50 +03:00
BoloniniD
33755f1f3d Implemented YAMLParser class 2021-05-21 21:56:22 +03:00
Yatsishin Ilya
d73d92ed7e revert some changes 2021-05-21 18:48:14 +03:00
Yatsishin Ilya
daf0b5ad2b rewrite zookeeper test 2021-05-21 16:29:43 +03:00
Yatsishin Ilya
70cb85a5d0 better 2021-05-21 12:09:10 +03:00
kssenii
074428264f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-21 08:26:54 +00:00
Yatsishin Ilya
b079ce5ee4 typo 2021-05-21 08:01:51 +03:00
Yatsishin Ilya
e9f7246d2a fixes 2021-05-21 07:59:16 +03:00
alesapin
deb784a321 Merge branch 'master' into nvartolomei-parts-move 2021-05-20 21:24:55 +03:00
Yatsishin Ilya
1f8d43235f better 2021-05-20 21:19:45 +03:00
Yatsishin Ilya
1d35da6882 Merge remote-tracking branch 'origin' into integration-2 2021-05-20 19:12:04 +03:00
alesapin
cf94bc9b8c
Merge pull request #24059 from ClickHouse/standalone_keeper
Standalone keeper server
2021-05-20 10:10:51 +03:00
mergify[bot]
29b3ed4551
Merge branch 'master' into modulo-partition-key 2021-05-20 05:45:11 +00:00
mergify[bot]
e762039db7
Merge branch 'master' into merging-s3-backoff 2021-05-19 21:57:10 +00:00
alesapin
301dc848f5 Merge branch 'master' into nvartolomei-parts-move 2021-05-19 17:17:01 +03:00
kssenii
ba41d01b78 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-19 11:47:05 +00:00
Yatsishin Ilya
8932f794aa Merge remote-tracking branch 'origin' into integration-2 2021-05-19 14:15:52 +03:00
alesapin
869aa49853 Even more lightweight test 2021-05-19 13:47:24 +03:00
Nikolai Kochetov
c6800c67f5
Merge pull request #24205 from ClickHouse/integration-server-restart-increase-tiomeout
Increase timeout for server restart in integration tests.
2021-05-19 13:38:51 +03:00
Yatsishin Ilya
1f4e28accb Merge remote-tracking branch 'origin' into integration-2 2021-05-19 13:25:30 +03:00
Yatsishin Ilya
7a5895815b remove tmpfs for now 2021-05-19 13:23:51 +03:00
mergify[bot]
230bec70fb
Merge branch 'master' into modulo-partition-key 2021-05-19 10:08:41 +00:00
alesapin
4d6c71801c
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-19 13:03:14 +03:00
Yatsishin Ilya
3ec8e779ba one more timeout 2021-05-19 08:54:48 +03:00
Kseniia Sumarokova
0ab15d0bc4
Merge branch 'master' into modulo-partition-key 2021-05-18 17:45:32 +03:00
alesapin
974f362e1c
Update cluster.py 2021-05-18 17:25:46 +03:00
alesapin
b390ebb083 Merge branch 'master' into standalone_keeper 2021-05-18 16:27:28 +03:00
alesapin
70e3ffc895 Speedup test 2021-05-18 14:46:45 +03:00
Yatsishin Ilya
3c804556fb fix 2021-05-18 14:02:23 +03:00
alesapin
36aeb59705 Fix lazy test 2021-05-18 11:03:38 +03:00
Nikolai Kochetov
e71387f509 Increase timeout for server restart in integration tests. 2021-05-18 10:38:32 +03:00
Nikolai Kochetov
e5aff8fe23 Increase timeout for server restart in integration tests. 2021-05-18 10:16:51 +03:00
Yatsishin Ilya
39f41ed9b9 less tests to commit 2021-05-18 07:47:51 +03:00
Yatsishin Ilya
83718a003d Merge remote-tracking branch 'origin/master' into integration-2 2021-05-18 07:46:07 +03:00
Nikolai Kochetov
118ebf0463 Increase timeout for server restart in integration tests. 2021-05-17 20:04:43 +03:00
Anton Ivashkin
6ce18124e2 Zero-copy replication - add test for TTL with large data 2021-05-17 19:27:44 +03:00
kssenii
15d1b8f397 Add test 2021-05-17 14:29:32 +00:00
Anton Ivashkin
8ed4a5de62 Fix Zero Copy after merge master 2021-05-17 16:01:08 +03:00
Yatsishin Ilya
40e63646ca more 2021-05-17 14:16:16 +03:00
alesapin
67d34c0136 merge with master 2021-05-17 14:13:18 +03:00
alesapin
17f229857c Merge branch 'master' into nvartolomei-parts-move 2021-05-17 13:52:48 +03:00
Anton Ivashkin
39a30b77fe Merge master 2021-05-17 11:47:48 +03:00
alesapin
33a6218a79 Make test more lightweight 2021-05-17 11:43:15 +03:00
Vladimir Chebotarev
752d0cb0b6 Fixed test. 2021-05-17 10:38:34 +03:00
alesapin
62004cf0d9 Merge branch 'master' into standalone_keeper 2021-05-17 10:14:58 +03:00
Yatsishin Ilya
e1176acc04 Merge remote-tracking branch 'origin' into integration-2 2021-05-17 09:53:00 +03:00
kssenii
8a4711b716 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-16 20:55:18 +00:00
kssenii
57da32472b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-16 18:39:51 +00:00
alesapin
5116f79441 Better configs and fix test 2021-05-16 17:18:21 +03:00
alesapin
29726b5510
Merge pull request #24122 from ClickHouse/fix_table_startup
Set readonly mode if restarting thread failed to activate replica
2021-05-16 16:45:51 +03:00
alesapin
852608c937 Don't abort on Auth request 2021-05-15 18:01:00 +03:00
alesapin
33e9f1bcf1 Better tests 2021-05-15 15:33:01 +03:00
mergify[bot]
d31021ea4f
Merge branch 'master' into fix-kafka-with-parquet 2021-05-14 21:10:12 +00:00
Yatsishin Ilya
cfb55c2cf6 fix 2021-05-14 19:38:40 +03:00
Yatsishin Ilya
aa4c91a2b3 disable parallel in flaky check 2021-05-14 17:15:08 +03:00
Yatsishin Ilya
f922ef4bbf Merge remote-tracking branch 'origin/fix_table_startup' into integration-2 2021-05-14 17:12:45 +03:00
Yatsishin Ilya
ad706b0de4 Merge remote-tracking branch 'origin' into integration-2 2021-05-14 16:48:44 +03:00
alesapin
de75d9c887 Revert accident changes 2021-05-14 16:44:32 +03:00
alesapin
123715300a Use keeper in integration tests 2021-05-14 15:30:49 +03:00
alesapin
340cd20274 Fix flaky TTL replicated test 2021-05-14 11:55:51 +03:00
alesapin
67e4393769 If table was not active set readonly mode 2021-05-14 11:32:41 +03:00
Mikhail Filimonov
dd619e1e37
Try to stabilize flapping test 2021-05-13 16:03:32 +02:00
kssenii
7115045317 Tiny changes 2021-05-13 09:39:57 +00:00
kssenii
85bbfd54e8 Fix bug 2021-05-13 08:53:48 +00:00
kssenii
0cb0bd48f7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-13 06:36:51 +00:00
Vladimir Chebotarev
1141872db2 Fix tests II. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
83dddb33db Better tests fix. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
8ba32fc935 Fix tests I. 2021-05-13 08:46:16 +03:00
kssenii
7c81103ea3 Add replication identifier, allow proper access to _version and _sign columns from nested 2021-05-12 22:48:42 +00:00
kssenii
0955e5f0be Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-12 15:11:15 +00:00
alesapin
ed3f89a7be
Merge pull request #23980 from kssenii/add-postgres-schema
Add missing table schema for postgres dictionary
2021-05-12 10:50:49 +03:00
Yatsishin Ilya
4311495243 Merge remote-tracking branch 'origin' into integration-2 2021-05-12 10:04:10 +03:00
Yatsishin Ilya
fe0194aa4b s3 catch up 2021-05-12 10:03:53 +03:00
Yatsishin Ilya
d0a1dcd6cc better name 2021-05-11 17:27:38 +03:00
kssenii
850b6f02cb Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-11 14:22:30 +00:00
Yatsishin Ilya
6aa7c0fafc fixes 2021-05-11 16:13:26 +03:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-11 15:36:40 +03:00
Yatsishin Ilya
9d159072ef mERGe remote-tracking branch 'origin' into integration-2 2021-05-11 13:32:44 +03:00
Amos Bird
dfa5629071
Remove projection type ast 2021-05-11 18:12:29 +08:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
Alexey Milovidov
2fcdc85dc7 Fix integration test 2021-05-11 01:54:52 +03:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
kssenii
bd4a0934e4 Add one more test 2021-05-10 14:51:17 +00:00
Alexey Milovidov
db4447d819 Fix integration test 2021-05-10 17:45:37 +03:00
kssenii
626e87bae5 Some fixes 2021-05-10 13:51:05 +00:00
kssenii
65c574db93 Add test 2021-05-10 11:31:06 +00:00