Commit Graph

1673 Commits

Author SHA1 Message Date
tavplubix
3e335c1e95
Merge pull request #17091 from zhang2014/fix/binlog_checksum
Fix MaterializeMySQL SYNC failure when modify binlog_checksum
2020-11-20 13:25:14 +03:00
Anton Ivashkin
a7d4f4be65 Add 's3_max_redirects' test 2020-11-20 11:18:44 +03:00
Pavel Kruglov
608722b6ab Fix integration tests 2020-11-20 02:59:58 +03:00
Nicolae Vartolomei
425dc4b11b Add unique identifiers IMergeTreeDataPart structure
For now uuids are not generated at all, they are present only if the
part is updated manually (as you can see in the integration test).

The only place where they can be seen today by an end user is in
`system.parts` table. I was looking for hiding this column behind an
option but couldn't find an easy way to do that.

Likely this is also required for WAL, but need to think how not to break
compatibility.

Relates to #13574, https://github.com/ClickHouse/ClickHouse/issues/13574

Next 1: In the upcoming PR the plan is to integrate de-duplication based on
these fingerprints in the query pipeline.

Next 2: We'll enable automatic generation of uuids and come up with a
way for conditionally sending uuids when processing distributed queries
only when part movement is in progress.
2020-11-19 13:14:25 +00:00
tavplubix
8b6fbea199
trigger CI 2020-11-19 12:47:24 +03:00
Peng Jian
3c86c8b3c9 fix test cases 2020-11-19 15:44:47 +08:00
Peng Jian
d8ae52118b add test 2020-11-19 15:44:47 +08:00
zhang2014
9df9691ccb Try fix integration test 2020-11-19 13:01:23 +08:00
nikitamikhaylov
13e711b27e rename back config 2020-11-18 16:38:14 +03:00
nikitamikhaylov
70a08608f8 add reload dictionary 2020-11-17 20:58:31 +03:00
nikitamikhaylov
663730c758 try to fix flaky test 2020-11-17 20:33:07 +03:00
nikitamikhaylov
9c6b896928 style + flaky test fix 2020-11-17 17:36:04 +03:00
nikitamikhaylov
31b1f644c1 better 2020-11-17 16:59:13 +03:00
nikitamikhaylov
fbd0d14dd6 save 2020-11-17 16:59:12 +03:00
nikitamikhaylov
9b46b53fa3 better defaults 2020-11-17 16:59:12 +03:00
nikitamikhaylov
028fc00166 fix tests 2020-11-17 16:59:12 +03:00
zhang2014
b4fc2ecc00 Try fix integration test 2020-11-17 09:41:35 +08:00
alesapin
5dd32819f5 Merge branch 'master' into fix_ddl_worker_non_leader 2020-11-16 22:34:16 +03:00
Winter Zhang
f6a205d64b
Merge branch 'master' into fix/binlog_checksum 2020-11-16 21:53:22 +08:00
zhang2014
6ef93ac73c Try fix MaterializeMySQL SYNC with modify binlog_checksum 2020-11-16 21:46:36 +08:00
alesapin
6759932c61 Remove accident changes 2020-11-16 15:49:08 +03:00
alesapin
f839742288 Add a test 2020-11-16 15:47:02 +03:00
TCeason
45bacd6f74 Merge branch 'master' into add_sync_user_privs_exception 2020-11-16 12:59:44 +08:00
ubuntu
f7b60c17f5 make test stable 2020-11-13 20:38:28 +08:00
alesapin
8d3858fc22
Merge pull request #16895 from CurtizJ/remove-empty-parts
Remove empty parts after they were pruned by TTL [2]
2020-11-13 10:00:18 +03:00
taichong
829037b487 Merge branch 'add_sync_user_privs_exception' of https://github.com/TCeason/ClickHouse into add_sync_user_privs_exception 2020-11-13 13:26:19 +08:00
Alexander Tokmakov
0731bfb7be Merge branch 'master' into database_replicated 2020-11-12 21:04:18 +03:00
Anton Popov
4cecd89e84 fix dropping of empty parts 2020-11-12 20:37:54 +03:00
Alexander Tokmakov
2a6c0b9180 try reuse DDLWorker in DatabaseReplicated 2020-11-12 20:35:29 +03:00
taichong
fefa2a2548 add log std out 2020-11-12 22:24:22 +08:00
Anton Popov
0aa35d53c7 Merge remote-tracking branch 'upstream/master' into HEAD 2020-11-12 14:31:58 +03:00
alesapin
a8d466a645 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-12 12:51:02 +03:00
taichong
091df85cdc modify test db name 2020-11-12 09:49:12 +08:00
TCeason
3912ed4965 Merge branch 'master' into add_sync_user_privs_exception 2020-11-12 09:34:08 +08:00
taichong
e2a9fe44b0 modify test error 2020-11-12 08:17:13 +08:00
Anton Popov
2497598a49 Remove empty parts after they were pruned by TTL 2020-11-11 19:19:43 +03:00
Pavel Kovalenko
e311759c5d
Abort multipart upload if no data was written to WriteBufferFromS3. (#16840) 2020-11-11 15:15:16 +03:00
taichong
f4f4379168 modify test case add precheck 2020-11-11 19:36:09 +08:00
taichong
6c8b5b573b modify test for Integration Tests Flaky Check 2020-11-11 19:36:09 +08:00
taichong
e5da2d4086 print mysql result for test 2020-11-11 19:35:39 +08:00
taichong
64acfea79c throw exception when mysql sync user privs error. 2020-11-11 19:32:28 +08:00
taichong
5c1a01897a Revise the code according to the review 2020-11-11 19:27:37 +08:00
taichong
aecb9716e1 print mysql result for test 2020-11-11 19:27:37 +08:00
taichong
2f6510d75b try to fix ci failed 2020-11-11 19:27:37 +08:00
taichong
d907afa77e throw exception when mysql sync user privs error. 2020-11-11 19:27:37 +08:00
alesapin
637e3dc2c2
Merge pull request #16627 from amosbird/zkc
reload auxiliary zookeepers configuration
2020-11-11 10:00:22 +03:00
alesapin
2e357516a6 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-10 13:53:08 +03:00
Vladimir Chebotarev
059357d51e
ALTER UPDATE/DELETE ... IN PARTITION with partition pruning in ReplicatedMergeTree (#13403)
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-11-10 13:23:46 +03:00
Amos Bird
aa8e6db786
reload auxiliary zookeepers configuration 2020-11-10 15:56:37 +08:00
alesapin
a056379ec1 Remove duplicate code 2020-11-09 12:25:50 +03:00
alesapin
cedaa938f3 Add simple integration test 2020-11-09 12:10:32 +03:00
alexey-milovidov
7acfa7d407
Merge pull request #16728 from azat/enable-use_compact_format_in_distributed_parts_names-by-default
Enable use_compact_format_in_distributed_parts_names by default
2020-11-07 13:40:54 +03:00
alexey-milovidov
712a35bb7b
Merge pull request #16762 from filimonov/kafka-protobuf-issue12615
Test for the issue #12615
2020-11-07 13:40:19 +03:00
Azat Khuzhin
ac8df08186 Set use_compact_format_in_distributed_parts_names=0 for some integration tests
To avoid depends from default.
2020-11-06 21:02:44 +03:00
Mikhail Filimonov
b072bc7d2b
Test for the issue #12615 2020-11-06 17:54:44 +01:00
alexey-milovidov
654d127ce6
Merge pull request #16630 from sundy-li/patch-6
better change the config
2020-11-04 11:36:07 +03:00
alexey-milovidov
09805399d9
Merge pull request #16560 from azat/test_input_format_parallel_parsing_memory_tracking-flackiness
Fix test_input_format_parallel_parsing_memory_tracking flackiness
2020-11-04 01:37:25 +03:00
sundy-li
dea4bd483e remove unused codes2 2020-11-03 19:40:45 +08:00
sundy-li
9cfeb9fd32 remove unused codes 2020-11-03 18:13:48 +08:00
sundy-li
72bde1c688 better change the config 2020-11-03 17:32:31 +08:00
Anton Ivashkin
1742fb3256 Merge master 2020-11-03 12:27:16 +03:00
Alexander Kuzmenkov
de3451d9a4
Merge pull request #16411 from excitoon-favorites/fixflappyafterasyncdrops
Remove redundant diagnostics and fixed `test_jbod_overflow`
2020-11-02 19:26:58 +03:00
tavplubix
2e5125739e
Update cluster.py 2020-11-02 17:58:06 +03:00
tavplubix
10a7a61da9
Update cluster.py 2020-11-02 16:50:59 +03:00
alesapin
7f8560e0c0
Merge pull request #16538 from amosbird/fp2
Allow fetching duplicate parts to detach
2020-11-02 16:10:42 +03:00
Amos Bird
643ee05288
add integration test 2020-11-01 16:02:09 +08:00
Azat Khuzhin
2832255164 Increase asynchronous_metrics_update_period_s to avoid syncing MemoryTracking with RSS 2020-10-30 22:02:02 +03:00
alesapin
b34960bffa Merge branch 'master' into system_fetches_table 2020-10-30 11:33:37 +03:00
Vladimir Chebotarev
4189d1f9c2 More attempt to fix test_jbod_overflow. 2020-10-29 16:15:19 +03:00
Vladimir Chebotarev
e9f5eefc8c Really fixed test_multiple_disks::test_background_move. 2020-10-29 08:28:43 +03:00
alexey-milovidov
bf3acecf6f
Merge pull request #16032 from Avogar/mysql_bug
Don't touch MySQL database if it's unnecessary
2020-10-29 04:14:26 +03:00
Kruglov Pavel
6eaba28e01
Trigger CI 2020-10-28 22:44:37 +03:00
alesapin
57c3935a26
Merge pull request #16426 from kssenii/rabbit-optimize
Optimize rabbitmq engine
2020-10-28 22:24:22 +03:00
alesapin
69b9190708
Merge pull request #16266 from ClickHouse/fix_flacky_test_multiple_disks
Add missing __init__.py
2020-10-28 18:18:19 +03:00
alesapin
8e8bdeb5d7
Merge pull request #16434 from ClickHouse/fix_fake_race_on_merges_list
Fix fake race condition on system.merges merge_algorithm
2020-10-28 15:51:53 +03:00
Alexander Tokmakov
ff68670029 add missing __init__.py 2020-10-28 13:22:10 +03:00
Vladimir Chebotarev
8154695aa2 Revert "Diagnostics (to be dropped)."
This reverts commit fd48d10029.
2020-10-28 13:05:48 +03:00
Vladimir Chebotarev
499b18c240 Revert "More diagnostics."
This reverts commit dd84fb572f.
2020-10-28 13:05:42 +03:00
Vladimir Chebotarev
a3b151ff5d Revert "Added redundant empty line."
This reverts commit 81a5f540d7.
2020-10-28 13:05:30 +03:00
alesapin
617e42ddb4
Merge branch 'master' into rabbit-optimize 2020-10-28 10:24:05 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
alesapin
2b26cbbc97 Add missed file 2020-10-28 10:01:57 +03:00
Alexander Kuzmenkov
6509f1eb39
Merge branch 'master' into minumum 2020-10-27 21:38:23 +03:00
alesapin
60f2d822d7 Fix fake race condition on system.merges merge_algorithm 2020-10-27 18:27:12 +03:00
Pavel Kruglov
2a26136c9e add __init__.py 2020-10-27 18:18:05 +03:00
Alexander Kuzmenkov
766560c138
Merge pull request #14195 from ClickHouse/aku/opentelemetry
[wip] add some opentelemetry support
2020-10-27 16:14:21 +03:00
alesapin
3d3d246bdc Rename table 2020-10-27 16:07:50 +03:00
alesapin
3824fcb076 Rename file and some tweaks 2020-10-27 15:47:42 +03:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Vladimir Chebotarev
791c1b6593 One more attempt to fix. 2020-10-27 14:55:57 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
kssenii
db03cd7dd7 Much more optimal queues setup 2020-10-27 11:00:01 +00:00
Vladimir Chebotarev
81a5f540d7 Added redundant empty line. 2020-10-27 01:44:34 +03:00
alexey-milovidov
cc5f15da29
Merge pull request #16235 from excitoon-favorites/fixflappyafterasyncdrops
Fixed flappy `test_multiple_disks`
2020-10-26 22:17:41 +03:00
Alexander Kuzmenkov
5a70e26c70 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-26 19:21:13 +03:00
Alexander Tokmakov
cd14f095ab fix tests 2020-10-26 18:12:16 +03:00
Alexander Tokmakov
636da1318b Merge branch 'master' into database_replicated 2020-10-26 15:00:43 +03:00
hchen9
c25a3e4e7b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into trivial_count_seq 2020-10-25 20:51:09 -07:00
Vladimir Chebotarev
dd84fb572f More diagnostics. 2020-10-26 04:33:28 +03:00
Alexey Milovidov
2e23fc242f Remove flaky LIVE VIEW test 2020-10-24 22:48:16 +03:00
alexey-milovidov
0f3caaffe4
Trigger CI 2020-10-24 07:48:15 +03:00
Azat Khuzhin
96da5f6534 Disable syncing MemoryTracking with RSS for test_MemoryTracking 2020-10-24 02:33:16 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
2020-10-24 02:27:29 +03:00
hchen9
feaab260d8 Fix conflict 2020-10-23 12:54:33 -07:00
Anton Ivashkin
1ffe0b1d03 S3 zero copy replication: fix tests 2020-10-23 15:00:01 +03:00
Alexander Kuzmenkov
5cbf645de4 Merge remote-tracking branch 'origin/master' into tmp 2020-10-22 19:48:02 +03:00
Anton Ivashkin
f833501c77 Merge branch 'master' into s3_zero_copy_replication 2020-10-22 11:17:21 +03:00
Vladimir Chebotarev
fd48d10029 Diagnostics (to be dropped). 2020-10-22 10:37:51 +03:00
Vladimir Chebotarev
fb0c7e80aa Fixed flappy test_background_move test. 2020-10-22 03:22:00 +03:00
Anton Ivashkin
fb178ef213 Zero copy replication over S3: base tests 2020-10-21 18:21:06 +03:00
Vladimir Chebotarev
847e9ca9f6 Fixed flappy test_multiple_disks. 2020-10-21 16:36:03 +03:00
alesapin
e090a119fc Simplify TTL move test 2020-10-21 13:11:26 +03:00
alexey-milovidov
a7098c2557
Merge pull request #16154 from nvartolomei/nv/max_concurrent_queries_for_all_users
Add max_concurrent_queries_for_all_users setting
2020-10-21 04:35:57 +03:00
Pavel Kruglov
cc91eb474e Add test 2020-10-20 21:12:37 +03:00
alexey-milovidov
75a02112bc
Merge pull request #15592 from sundy-li/readonly-metrics
sub ReadonlyReplica metric when detach readonly tables
2020-10-20 19:17:52 +03:00
Alexander Tokmakov
72dbb43235 Merge branch 'master' into fork-valbaturin-replication-db-engine 2020-10-20 19:14:54 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges option for volumes in multi-disk configuration (#13956)
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
2020-10-20 18:10:24 +03:00
alexey-milovidov
5e46e7c670
Merge pull request #15723 from Jokser/idempotent-part-move
Possibility to move part to another disk/volume if first attempt was failed
2020-10-20 04:26:50 +03:00
Alexander Kuzmenkov
41ac15a71c fix initial query id 2020-10-20 00:26:10 +03:00
Nicolae Vartolomei
5a665d1d42 Add max_concurrent_queries_for_all_users setting
Closes #6636.
2020-10-19 15:51:28 +01:00
Pavel Kovalenko
ad92127036 Fixed move part exception getting in test_merge_tree_s3_failover. 2020-10-16 17:30:34 +03:00
alesapin
dc1a5abea9 Remove cluster type check during alter 2020-10-16 14:59:58 +03:00
Pavel Kovalenko
a474bdcabf Merge remote-tracking branch 'origin/master' into idempotent-part-move 2020-10-16 13:02:40 +03:00
Nikita Mikhaylov
6512d84b31
Merge pull request #15985 from CurtizJ/redis-cached-dict
Add support of cache layout for Redis dictionaries with complex key
2020-10-15 22:35:36 +03:00
Kruglov Pavel
5aba639430 Update test 2020-10-15 22:01:18 +03:00
sundy-li
153be93544 sub ReadonlyReplica when detach readonly tables 2020-10-15 22:01:18 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf
ProtobufSingle format
2020-10-15 16:58:39 +03:00
Anton Popov
3050b2e67b add support of cache layout for redis dictionaries with complex key 2020-10-14 22:57:07 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf 2020-10-14 16:26:57 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata""
This reverts commit c65d1e5c70.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
Vitaly Baranov
13896cf4c9
Merge pull request #15875 from vitlibar/rbac-fix-deadlock
Fix possible deadlocks in RBAC
2020-10-13 12:58:57 +03:00
Vitaly Baranov
6a58bb5c23 Enable rbac tests with thread sanitizer. 2020-10-13 01:03:51 +03:00
alexey-milovidov
4798234002
Merge pull request #15843 from ClickHouse/check-executable-files
Check for executable bit on non-executable files
2020-10-12 23:54:00 +03:00
tavplubix
748b75ab1b
Merge pull request #15767 from ClickHouse/fix_materialize_mysql_count_v2
Try fix select count() for MaterializeMySQL (another way)
2020-10-12 14:41:38 +03:00
alesapin
106040a720 Disable rbac tests with thread sanitizer 2020-10-12 10:04:46 +03:00
Mikhail Filimonov
e17d4e1eeb
Tests and some docs 2020-10-12 07:51:46 +02:00
Mikhail Filimonov
b602d18dd8
ProtobufSingle input format
Allows to read Single protobuf message at once (w/o length-delemeters).
2020-10-12 07:51:36 +02:00
Alexey Milovidov
78c42d5dcd Remove executable bit from non-executable files 2020-10-11 19:21:29 +03:00
alexey-milovidov
2e3046991b
Merge pull request #15757 from filimonov/fix-kafka-no-holes-flap
fix flap in no_holes_when_write_suffix_failed
2020-10-11 14:38:45 +03:00
bharatnc
8739f219c6 Fix incorrect flag in Integration tests README 2020-10-10 17:52:50 -07:00
filimonov
1ce0d4dbc2
Update test.py
similar change for test_kafka_duplicates_when_commit_failed
2020-10-10 23:36:59 +02:00
Mikhail Filimonov
60f4e561fb
fix test_kafka_produce_key_timestamp 2020-10-10 17:01:22 +02:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master
Improvement of Quorum Inserts in ClickHouse
2020-10-09 22:43:53 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00
alesapin
7f3b9b1993 Fetch helper image before run 2020-10-09 17:42:03 +03:00
alesapin
3ac7b5aba8 Fetch helper image before run 2020-10-09 17:39:32 +03:00
alesapin
bdab187c45 Fetch helper image before run 2020-10-09 17:38:31 +03:00
alesapin
b82038b65b Add missed file 2020-10-09 14:20:54 +03:00
alesapin
f12382ad93 Fix race in openssl 2020-10-09 12:08:49 +03:00
alesapin
fbd7141fed Fix flaky tests 2020-10-09 10:19:17 +03:00
alesapin
66b7748b63
Merge pull request #15763 from ClickHouse/fix_race_condition_in_mysql_pool
Fix race condition in MySQL pool
2020-10-09 09:43:25 +03:00
Alexander Tokmakov
a6178cc876 try fix select count() for MaterializeMySQL 2020-10-08 23:39:24 +03:00
tavplubix
7b5f2b2bb0
Merge pull request #15701 from ClickHouse/better_clone_replica
Improvements in lost replica recovery
2020-10-08 23:19:23 +03:00
alesapin
de722cd57c Fix race condition in MySQL pool 2020-10-08 18:50:09 +03:00
alesapin
c6d8b94ad6 Add some tests 2020-10-08 16:29:13 +03:00
alesapin
f953c1be87 Disable cassandra tests with thread sanitizer 2020-10-08 13:48:53 +03:00
alesapin
3f5dc37095
Merge pull request #15681 from ClickHouse/improvement_in_test
Add stderr log to test_grant_and_revoke
2020-10-08 09:51:54 +03:00
alesapin
4fbe925490
Merge pull request #15686 from ClickHouse/fix_race_mariadb
Fix race in mariadb
2020-10-08 09:42:41 +03:00
hchen9
ed2ce4a6fc Resolve conflict in StorageMemory 2020-10-07 17:19:59 -07:00
alesapin
d093d4c535
Merge pull request #15675 from ClickHouse/fix_races_in_hdfs
Fix races in libhdfs
2020-10-07 20:39:40 +03:00
Pavel Kovalenko
69c126f1f1 Possibility to move part to another disk/volume if first attempt was failed. 2020-10-07 14:35:28 +03:00
Alexander Tokmakov
ea16370024 improvements in lost replica recovery 2020-10-07 02:29:33 +03:00
alesapin
ade916570b Add log config 2020-10-06 19:01:13 +03:00
alesapin
a453e8dbe1 Add stderr log to test_grant_and_revoke 2020-10-06 17:07:00 +03:00
alesapin
db03a894e5 Change test to run flaky check 2020-10-06 16:29:50 +03:00
Pavel Kovalenko
69b4bc6f33 Proper error handling during insert into MergeTree with S3. 2020-10-06 12:38:00 +03:00
hchen9
b96c1326fc Trigger test again 2020-10-04 00:18:43 -07:00
hchen9
ea10291758 Reformat code 2020-10-03 21:03:46 -07:00
alexey-milovidov
53ce5e3892
Merge pull request #15551 from azat/for-user-limits-over-distributed
Pass through *_for_user settings via Distributed with cluster-secure
2020-10-04 04:18:20 +03:00
hchen9
347f5c99b1 Set user_configs = configs/users.xml 2020-10-03 14:18:24 -07:00
hchen9
76182694b0 Fix integration test case test_reload_zookeeper 2020-10-03 14:07:21 -07:00
Azat Khuzhin
84583faa43 Fix test_distributed_inter_server_secret under ASAN
And also cover both cases:
- settings from DDL
- settings from TCP protocol
2020-10-03 11:16:31 +03:00
alexey-milovidov
75fb73956e
Merge pull request #15238 from ianton-ru/multi_delete_in_s3
Use S3 multi object delete
2020-10-03 03:48:06 +03:00
Azat Khuzhin
f25c1742b8 Pass through *_for_user settings via Distributed with cluster-secure
In cluster-secure case the user on shards (remote) is equal to the user
on the initiator, so those settings can be safely applied.
2020-10-03 02:04:47 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Alexander Tokmakov
5f6bbe8967 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-10-02 20:14:08 +03:00
Alexander Tokmakov
32776da69a Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-10-02 20:09:37 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
alexey-milovidov
9808d0be81
Merge pull request #15376 from excitoon-favorites/fixs3storage
Fixed compression in S3 storage
2020-10-01 04:30:32 +03:00
tavplubix
2f95609f98
Merge pull request #15448 from ClickHouse/allow_synchronous_drop_for_atomic_db
Allow synchronous DROP/DETACH TABLE for Atomic
2020-10-01 01:14:31 +03:00
tavplubix
34e4932c8f
Update test.py 2020-09-30 19:16:35 +03:00
Vladimir Chebotarev
b460024356 Fixed bug in GZIP compression in S3 storage. 2020-09-30 16:09:55 +03:00
Vladimir Chebotarev
a38c7ff2a8 Somehow uncompressed PUT works and gzipped PUT doesn't, in S3 storage. 2020-09-30 15:04:42 +03:00
Vladimir Chebotarev
b7a6f15f19 Added test for GZIP in S3 storage. 2020-09-30 13:55:44 +03:00
tavplubix
c9eeb149fd
Merge pull request #15384 from zhang2014/fix/ISSUES-15365
ISSUES-15365 fix attach mysql database database
2020-09-30 11:27:15 +03:00
tavplubix
a4b4895b26
Merge pull request #15435 from ClickHouse/ADQM-160-fix
Try merge #14265 again
2020-09-30 11:21:55 +03:00
alexey-milovidov
0c07c2d3a3
Merge pull request #15089 from ClickHouse/codecs_for_nested_types
Codecs for nested types
2020-09-30 07:18:19 +03:00
Alexander Tokmakov
5d19ed04f6 allow synchronous drop/detach table for Atomic 2020-09-29 16:47:08 +03:00
Alexander Tokmakov
6ebfd1aaf6 fix 2020-09-29 11:58:04 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
alesapin
bd531bb045
Merge pull request #15396 from ClickHouse/yet_another_retry
Fix some flaky tests: test_mysql_federated and 00652_replicated_mutations_zookeeper
2020-09-29 09:51:41 +03:00
zhang2014
a3bc152f73 ISSUES-15365 try fix integration test failure 2020-09-29 14:37:19 +08:00
zhang2014
18985645d9 ISSUES-15365 try fix integration test failure 2020-09-29 12:17:54 +08:00
zhang2014
9e94c077e7 IESSUES-15365 try fix integration test 2020-09-29 10:39:30 +08:00
tavplubix
4578d89819
Merge pull request #15348 from ClickHouse/replicate_default_args
Continuation of #14791
2020-09-28 18:53:02 +03:00
zhang2014
b14fb0e8d5 ISSUES-15365 try fix integration test 2020-09-28 23:00:01 +08:00
alesapin
a526a767df Fix some flaky tests 2020-09-28 14:17:07 +03:00
zhang2014
7e90e00f1a ISSUES-15365 add integration test 2020-09-28 18:27:02 +08:00
Nikita Mikhaylov
73573472e9
Merge pull request #15299 from CurtizJ/fix-mysql-hung
Fix hang of queries with a lot of subqueries to same mysql table
2020-09-28 12:51:35 +03:00
Anton Ivashkin
c2b692f2c7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into multi_delete_in_s3 2020-09-28 12:00:34 +03:00
Anton Ivashkin
c18cdec77c Use S3 multi object delete
Some strange with s3_with_proxy test
2020-09-28 11:47:04 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Tokmakov
aa5e5013f2 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-27 14:11:53 +03:00
Alexander Tokmakov
34addcf61f add review suggestions 2020-09-26 22:18:28 +03:00
alesapin
d1bb6b6555
Update test.py 2020-09-26 11:47:26 +03:00
alesapin
8f9ec30315 Delete flaky test 2020-09-25 19:23:57 +03:00
alesapin
af0bb5bd26 One more time 2020-09-25 19:15:34 +03:00
alesapin
ada193e7b7 Add diff 2020-09-25 16:33:33 +03:00
alesapin
54fa67838e Add flaky test 2020-09-25 16:32:00 +03:00
Anton Popov
085f63a9bf fix hang of queries with a lot of subqueries to same mysql table 2020-09-25 14:12:48 +03:00
tavplubix
b96157e32b
Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 13:42:39 +03:00
alesapin
9bf27fb42a
Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test
Splitting test_dictionaries_all_layouts_and_sources
2020-09-25 10:16:28 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
96c419974c Merge branch 'master' into codecs_for_nested_types 2020-09-24 10:28:20 +03:00
nikitamikhaylov
c64ac8596c better 2020-09-23 22:36:47 +03:00
nikitamikhaylov
2d4bdcfec0 file and executables 2020-09-23 22:31:47 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Alexander Tokmakov
a8266a3d3c fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Anton Popov
4b795c7b6a
temporarily run test with wide parts only 2020-09-22 18:58:14 +03:00
Alexander Tokmakov
7fcf20e48c enable more tests 2020-09-22 17:29:09 +03:00
nikitamikhaylov
c9cfdffcd7 mongo uri 2020-09-22 16:52:56 +03:00
alesapin
9b6b5ae08d More tests 2020-09-22 16:16:42 +03:00
Alexander Tokmakov
91cbd49e85 fix tests 2020-09-22 00:09:50 +03:00
nikitamikhaylov
d87f3660ee done 2020-09-21 23:19:46 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms
specific ReplicatedMergeTree settings
2020-09-21 01:36:33 +03:00
Vitaly Baranov
33efb36714 Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
alexey-milovidov
eb9ee723c3
Merge pull request #11913 from ClickHouse/compact-parts-by-default
Enable compact parts by default for small parts
2020-09-19 15:31:15 +03:00
tavplubix
6e0bdaf46d
Merge pull request #14535 from zhang2014/fix/datetime
ISSUES-4006 support decimal data type for MaterializedMySQL
2020-09-19 14:05:32 +03:00
alexey-milovidov
c1402d62db
Merge pull request #14892 from vzakaznikov/fix_test_distributed_over_live_view2
Fixing tests/integration/test_distributed_over_live_view/test.py
2020-09-19 13:59:05 +03:00
alexey-milovidov
1fcebce926
Merge pull request #15000 from Jokser/disable-ttl-move-on-insert
Option to disable TTL move on data part insert
2020-09-19 13:45:02 +03:00
alexey-milovidov
3463d97f8c
Merge pull request #14973 from amosbird/bm2
Ignore key constraints when doing mutations.
2020-09-19 13:44:30 +03:00
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl
Allow parallel execution of distributed DDL
2020-09-18 22:18:17 +03:00
Pavel Kovalenko
1fc3aa3ea8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 22:10:49 +03:00
Pavel Kovalenko
77be35a2b8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 21:59:56 +03:00
Amos Bird
d842cb704f
Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Pavel Kovalenko
da04a130ed Add option to disable ttl move on data part insert - minor fixes. 2020-09-18 20:45:30 +03:00
Pavel Kovalenko
0da19ab46d Add option to disable ttl move on data part insert 2020-09-18 18:30:00 +03:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
Alexander Tokmakov
41e99cf261 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-17 20:28:50 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure
Secure inter-cluster query execution (with initial_user as current query user) [v3]
2020-09-17 17:11:00 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6
Flaky tests fixes
2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories
Add 'params' column to system.user_directories table.
2020-09-15 18:25:50 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Alexander Tokmakov
5455068226 try fix flacky test 2020-09-15 17:17:30 +03:00
Alexander Tokmakov
0ecf8e595f cleanup code, add test 2020-09-15 16:41:53 +03:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Alexander Tokmakov
3671c91c37 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-15 12:43:01 +03:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Alexander Tokmakov
a812f7eb75 allow using Atomic database inside MaterializeMySQL 2020-09-14 22:25:02 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path
Skip access storages with same path while reading the main config.
2020-09-12 14:20:02 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash
Fix crashes in RabbitMQ tests
2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00
alesapin
2c4047b280 Revert accident changes 2020-09-11 20:07:00 +03:00
alesapin
c0dafb0283 Disable test 2020-09-11 20:04:55 +03:00
kssenii
31dbfd07e2 remove tests crash reason 2020-09-11 16:16:24 +00:00
Nikita Mikhaylov
468089a4cd
Merge pull request #14514 from bharatnc/ncb/event_time_microseconds_metric_logs
add event_time_microseconds field to asynchronous_metric_log & metric_log system tables
2020-09-11 16:14:00 +04:00
zhang2014
7ff7ee6aac ISSUES-4006 try fix integration test 2020-09-11 15:37:14 +08:00
Anton Popov
fa6d88b3b2 fix more tests 2020-09-10 21:43:02 +03:00
Anton Popov
6031e6bae9 fix tests 2020-09-10 20:09:19 +03:00
tavplubix
4581e3a18a
Merge pull request #14563 from bharatnc/ncb/zk-conn-fail-do-cleanup
ReplicatedMergeTree - cleanup data directory after Zookeeper exceptions
2020-09-10 19:19:57 +03:00
bharatnc
397ebdb855 remove sleep from unit test 2020-09-10 08:55:39 -07:00
Alexander Tokmakov
20b3823770 do not remove directory on attach 2020-09-10 13:21:13 +03:00
zhang2014
5b3e9eaaf0 Merge branch 'master' into fix/datetime 2020-09-10 17:26:26 +08:00
zhang2014
338b69201d ISSUES-4006 add test decimal when dump stage 2020-09-10 17:20:28 +08:00
bharatnc
31b0bd481c Integration tests - more accurate tests 2020-09-10 00:35:25 -07:00
bharatnc
05a80518a1 Merge remote-tracking branch 'upstream/master' into ncb/event_time_microseconds_metric_logs 2020-09-09 17:58:29 -07:00
bharatnc
2ad63d2b4d AsynchronousMetricLog - refactor integration test 2020-09-09 17:56:21 -07:00
bharatnc
0a3f7d0fcc AsynchronousMetricsLog - add improved tests
This adds integration tests to test the asynchronous_metric_log table
for event_time_microseconds field.

Asynchronous metrics are updated once every 60s, so this setting needs
to be overridden for having those metrics available in time so that the
tests can run. So the `asynchronous_metric_update_period_s` setting is
being overriden to be 2s.
2020-09-09 17:50:39 -07:00
Alexander Tokmakov
dee1fefeb4 add more tests 2020-09-09 20:39:49 +03:00
alesapin
cdb72add35
Merge pull request #14619 from ClickHouse/better_copy_dir
Better recursive database copy in integration tests
2020-09-09 19:38:55 +03:00
bharatnc
fe6d6f16ea Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-09 09:25:34 -07:00
bharatnc
d1d3af7501 StorageReplicatedMergeTree - more improvements to integration test 2020-09-09 09:24:18 -07:00
zhang2014
6ed3f7fb86 ISSUES-4006 try fix integration test failure when mysql 5.7 2020-09-09 23:42:03 +08:00
zhang2014
094897fe69 Merge branch 'master' into fix/datetime 2020-09-09 23:37:54 +08:00
alesapin
bd14c79b0b
Merge pull request #14494 from ClickHouse/recompression_in_background
Recompression TTL
2020-09-09 17:46:01 +03:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Vasily Nemkov
3973a17530
MySql datatypes dateTime64 and decimal (#11512) 2020-09-09 15:18:02 +03:00
alesapin
98f19a5d50 Better permissions 2020-09-09 14:29:53 +03:00
alesapin
f5bef34be6 Fix configs for test_default_database_on_cluster 2020-09-09 14:28:59 +03:00
alesapin
150d8d4e79 Better recursive copy in integration tests 2020-09-09 14:11:59 +03:00
Winter Zhang
3d1d64ec60
Fix currentDatabase function cannot be used in ON CLUSTER ddl query. (#14211) 2020-09-09 12:58:59 +03:00
alesapin
485b104898 Use max ttl and add introspection to system parts about recompression 2020-09-09 12:15:42 +03:00
alesapin
a696cf12f6 Merge branch 'master' into recompression_in_background 2020-09-09 10:12:03 +03:00
alesapin
9548d69792
Merge pull request #14581 from ClickHouse/fix_flaky_test_3
Add retries to several integration tests
2020-09-09 10:04:37 +03:00
bharatnc
f37814b367 Merge remote-tracking branch 'upstream/master' into ncb/zk-conn-fail-do-cleanup 2020-09-08 23:45:20 -07:00
bharatnc
48bf65d63d StorageReplicatedMergeTree - improve integration test 2020-09-08 23:45:04 -07:00
Winter Zhang
62ef728b2f
ISSUES-4006 try fix test failure 2020-09-09 10:52:14 +08:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
Anton Popov
53572b3783 add gitkeep 2020-09-08 19:37:16 +03:00
alesapin
f0f7f2b5d2 Merge branch 'master' into recompression_in_background 2020-09-08 15:43:37 +03:00
alesapin
6ad91d1018
Merge pull request #14490 from ClickHouse/control_ttl_merges_in_pool
Control ttl merges in pool
2020-09-08 15:42:20 +03:00
Ilya Yatsishin
37236e5923
Merge pull request #14553 from ClickHouse/fix-flacky-test-11
Handle host/network is unreachable in integration tests
2020-09-08 14:45:00 +03:00
alesapin
6e591d5dea Better retries 2020-09-08 14:20:35 +03:00
alesapin
cdfca04b42 Missed break 2020-09-08 14:07:41 +03:00
alesapin
43c17ff79e Add retries to test 2020-09-08 14:02:44 +03:00
alesapin
4364bff3bc
Merge pull request #12761 from kssenii/rabbitmq-improvements
RabbitMQ improvements
2020-09-08 09:38:25 +03:00
bharatnc
806334a642 StorageReplicatedMergeTree - add integration tests that test dir cleanup
This adds a integration test that tests if table directory is cleaned
up after a ZooKeeper connection failure for ReplicatedMergeTree tables.
2020-09-07 22:32:01 -07:00
Winter Zhang
18b4c5997d
Merge branch 'master' into fix/datetime 2020-09-08 11:32:48 +08:00
zhang2014
a150b1345b ISSUES-4006 add integration test 2020-09-08 11:29:18 +08:00
zhang2014
05bd0b7c28 ISSUES-4006 add integration test 2020-09-08 02:36:28 +08:00
alexey-milovidov
e1104135c8
Merge pull request #13939 from fastio/master
Multithreading implementation of Kafka engine
2020-09-07 20:12:06 +03:00
Alexey Milovidov
829049de2f Handle host/network is unreachable in integration tests 2020-09-07 19:43:35 +03:00
kssenii
40c8290dde Tiny fixes, better tests 2020-09-07 14:48:50 +00:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
alesapin
17650e803f Tiny improvements 2020-09-07 14:08:53 +03:00
alesapin
4ce975c512 Merge branch 'master' into kssenii-rabbitmq-improvements 2020-09-07 11:36:08 +03:00
alesapin
9703494f32 Less debug prints 2020-09-07 11:25:14 +03:00
alesapin
7f301eab63 Merge branch 'master' into recompression_in_background 2020-09-07 09:31:16 +03:00
Peng Jian
77420c82ea Add test case for Kafka engine with kafka_thread_per_consumer enabled. 2020-09-06 11:17:19 +08:00
alexey-milovidov
c4861155f7
Merge pull request #14498 from ClickHouse/add_retries_to_host_ip_change
Add retries to integration test_host_ip_change
2020-09-05 07:03:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
alesapin
3095c167ea Add retries 2020-09-04 18:22:43 +03:00
alesapin
de911aaabe Merge branch 'master' into recompression_in_background 2020-09-04 17:21:27 +03:00
alesapin
21de2f54f6 Fix tests 2020-09-04 17:13:57 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
Alexander Tokmakov
c233be29c5 fix 2020-09-04 16:29:43 +03:00
Nikolai Kochetov
40768593c3
Merge pull request #14469 from BohuTANG/mysql_set_@@var
Support MySQL handler 'set @@xx' settting
2020-09-04 14:18:57 +03:00
alesapin
4079636f81 Merge 2020-09-04 13:52:51 +03:00
alesapin
82c56349a5 Some comments 2020-09-04 13:08:09 +03:00
BohuTANG
c094ff7eca ISSUES-9336 support MySQL handler 'set @@xx' settting 2020-09-04 12:51:15 +08:00
Ilya Yatsishin
5ada30df96
Merge branch 'master' into integration-explicit-configs 2020-09-03 20:43:01 +03:00
Kseniia Sumarokova
4b7c303eaf
Merge branch 'master' into rabbitmq-improvements 2020-09-03 17:26:04 +03:00
alesapin
e48e4309b2 Better names 2020-09-03 16:29:18 +03:00
alesapin
5ccf78ccff Simplier test 2020-09-03 16:08:45 +03:00
alesapin
565555e55c Fix bug in parts selection 2020-09-03 16:04:28 +03:00
alesapin
4519b4308c Fix default tag for base image 2020-09-03 16:03:26 +03:00
Yatsishin Ilya
216436a221 mysql fix 2020-09-03 13:27:44 +03:00
Yatsishin Ilya
a4f0267709 pass katest if no DOCKER_BASE_TAG in env 2020-09-03 13:20:15 +03:00
Yatsishin Ilya
53cc50ae0a fix test_dictionaries_ddl 2020-09-03 12:55:07 +03:00
alesapin
aa47d0aabc Merge branch 'apply_ttl_if_not_calculated' into recompression_in_background 2020-09-03 12:07:03 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Ilya Yatsishin
2b8ad576cc
Merge pull request #14323 from qoega/try-dns-fix
Add tag pass for integration base image. Add explicit dns options for docker-compose.
2020-09-03 11:27:24 +03:00
alesapin
672f239f5b Add settings to test 2020-09-03 10:34:53 +03:00
alexey-milovidov
72417d2716
Merge pull request #14368 from BohuTANG/materialize_mysql_query_filter_1
change string.rfind to string starts_with and add some tests
2020-09-03 01:09:53 +03:00
alesapin
dcbddbb8d0 Add recompression ttls tests and fix bugs 2020-09-02 19:15:41 +03:00
Ilya Yatsishin
a5e9449bc3
Merge branch 'master' into try-dns-fix 2020-09-02 19:01:30 +03:00
Yatsishin Ilya
c2ab85f214 Split tag part from image 2020-09-02 17:36:25 +03:00
Yatsishin Ilya
fda89095cc Split tag part from image 2020-09-02 17:22:54 +03:00
Yatsishin Ilya
8f50a6769d Fix bad merge 2020-09-02 15:28:47 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
45e54f81c7 better resolv.conf, add DNSCacheUpdater logs 2020-09-02 11:07:46 +03:00
BohuTANG
13fdcfada9 Try to fix query_event_with_empty_transaction failed 2020-09-02 15:41:09 +08:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
alexey-milovidov
5a529f171c
Merge pull request #13988 from vitlibar/user-directories-mixed-style
Add storages from <user_directories> after ones from <users_config> and <access_control_path>.
2020-09-02 05:03:34 +03:00
BohuTANG
6dfab88156 ISSUES-14235 change string.rfind to string starts_with and add some tests 2020-09-02 08:31:51 +08:00
Alexander Kuzmenkov
fa04b39d32
Revert "Change query event filter and add integration test for empty GTID transaction" 2020-09-02 02:06:53 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
kssenii
6682c62a90 Fixes 2020-09-01 20:07:34 +00:00
Alexander Kuzmenkov
949a41f8b5
Merge pull request #14321 from BohuTANG/materialize_mysql_query_filter
Change query event filter and add integration test for empty GTID transaction
2020-09-01 17:44:58 +03:00
kssenii
15f735bb24 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-09-01 10:51:34 +00:00
Yatsishin Ilya
0af3f92bac Ignore unknown image names 2020-09-01 13:42:38 +03:00
BohuTANG
d604e84df3 ISSUES-14235 add mysql_5_7 and mysql_8_0 empty transaction tests 2020-09-01 16:37:58 +08:00
kssenii
c2fb72abf8 Better mv, more comments 2020-09-01 07:58:41 +00:00
alesapin
05b10048a6
Merge pull request #14116 from ClickHouse/parts_default_compression
Save parts default compression
2020-09-01 09:43:42 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
BohuTANG
49095e8169 ISSUES-14235 add one integration test for empty GTID transaction 2020-09-01 13:29:45 +08:00
alexey-milovidov
f5a38fa78d
Merge pull request #14203 from donge/master
fix issue #14202
2020-08-31 17:48:39 +03:00
kssenii
647cf5718e Better settings 2020-08-31 09:27:42 +00:00
Dongdong Yang
9651c36ceb testcase for issue 14202 2020-08-31 15:42:01 +08:00
alesapin
5b0822902b
Merge pull request #14155 from amosbird/fzk
Allow FETCH PARTITION from other zookeepers
2020-08-31 09:54:51 +03:00
alesapin
726f7f9823 Fix s3 tests 2020-08-28 23:38:44 +03:00
alesapin
ebc163c924 Merge branch 'master' into parts_default_compression 2020-08-28 23:11:42 +03:00
alesapin
10c7a6c45e
Add ability to specify Default codec for columns (#14049)
* Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml

* Fix style

* Rename DefaultCompression to simple Default

* Fix compression codec

* Better codec description representation

* Less strange code and one method

* Fix delta
2020-08-28 20:40:45 +03:00
alesapin
f1dc668136
Update test.py 2020-08-28 16:03:42 +03:00
alesapin
1ea00d5e7a Fix test and better messages 2020-08-28 14:12:51 +03:00
kssenii
4e0c619721 Global refactoring 2020-08-28 10:03:54 +00:00
alesapin
77faf9587f Better interface 2020-08-28 12:07:20 +03:00
Amos Bird
44364a5f59
add tests 2020-08-27 22:37:41 +08:00
Amos Bird
0c1cf22c00
Allow FETCH PARTITION from other zookeepers 2020-08-27 22:19:18 +08:00
alexey-milovidov
b54011bae2
Merge pull request #14161 from ClickHouse/fix_flaky_test_2
Disable several flaky tests for RabbitMQ
2020-08-27 16:58:36 +03:00
alesapin
0ff5e5412e Merge branch 'master' into parts_default_compression 2020-08-27 16:01:37 +03:00
alesapin
6a963f58da
Merge pull request #14158 from ClickHouse/fix_flaky_test_1
Wait for async mutation in test_version_update_after_mutation
2020-08-27 15:59:31 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
alesapin
3950afa3ae Disable several flaky tests for rabbitmq 2020-08-27 11:57:43 +03:00
alesapin
1f22ec5f7c Wait for async mutation in test 2020-08-27 10:16:07 +03:00
kssenii
4fecfdbe2f Better & cleaner 2020-08-26 18:52:45 +00:00
Alexey Milovidov
b27be98272 Increase timeout in test 2020-08-26 19:27:09 +03:00
alesapin
2fc80189af Add default compression codec to merge tree data part 2020-08-26 18:29:46 +03:00
tavplubix
cff92c8ad3
Merge pull request #13820 from BohuTANG/mysql_replica_gtid_issue_4006
ISSUES-4006 support MySQL GTID based replication #4006
2020-08-26 15:02:53 +03:00
Vitaly Baranov
7ac4bd7d1e Add storages from <user_directories> after ones from <users_config> and <access_control_path>. 2020-08-26 13:45:35 +03:00
alesapin
7428c46737 Merge branch 'master' into recompressing_in_background 2020-08-26 10:28:03 +03:00
alexey-milovidov
f40b80ed45
Merge pull request #12756 from sundy-li/hotfix/dict-access
Fix ClickHouseDictionarySource wrong access check
2020-08-26 03:33:42 +03:00
alexey-milovidov
75a3bbf5b2
Merge pull request #13722 from javisantana/fix/replicas_status_verbose
return 200 when replicas status is ok and verbose = 1
2020-08-26 00:35:47 +03:00
alesapin
9ca8c5e77a Rename DefaultCompression to simple Default 2020-08-25 18:53:06 +03:00
alesapin
1180bad3a7 Add ability to specify DefaultCompression codec which correspond to settings specified in config.xml 2020-08-25 18:02:32 +03:00
kssenii
31b1b6fe9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-08-25 14:47:03 +00:00
alesapin
f5730a3a5f Merge branch 'master' into fix_ddl_worker_timeouts 2020-08-24 11:50:11 +03:00
Vitaly Baranov
4c8a8d5e67 Add test. 2020-08-22 01:59:52 +03:00
alexey-milovidov
7b53a0ef33 Revert "Added allow_merges option for volumes in multi-disk configuration (#13402)"
This reverts commit 1e2616542a.
2020-08-21 18:44:29 +03:00
Vladimir Chebotarev
1e2616542a
Added allow_merges option for volumes in multi-disk configuration (#13402) 2020-08-21 12:04:13 +03:00
Alexander Tokmakov
be6af3881a remove retries 2020-08-19 13:05:40 +03:00
Yatsishin Ilya
e77ab608c8 fix typo 2020-08-19 10:45:16 +03:00
BohuTANG
26525a5eb1 Merge remote-tracking branch 'origin/master' into mysql_replica_gtid_issue_4006 2020-08-19 08:04:02 +08:00
Yatsishin Ilya
26020cdf68 typo 2020-08-18 17:38:16 +03:00
Yatsishin Ilya
adc2c117c8 fixes 2020-08-18 17:34:04 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Ivan
cd22abbfe3
Expect empty content on verbose response 2020-08-18 14:59:57 +03:00
zhang2014
cba1e3d568 ISSUES-4006 Add more times test 2020-08-18 10:51:05 +08:00
Alexander Tokmakov
790c420dcf run multiple times, print stacktraces 2020-08-17 22:55:27 +03:00
Alexander Tokmakov
51bb0412b1 enable the test 2020-08-17 21:48:55 +03:00
Alexander Tokmakov
f5c14a0766 Merge branch 'master' into fix/materialize_integration_test 2020-08-17 21:47:53 +03:00
Alexander Tokmakov
1eb36d6067 partially disable test with MaterializeMySQL 2020-08-17 21:17:29 +03:00
BohuTANG
b94a4a64d2 ISSUES-4006 enable GTID mode for materialize mysql database intergration tests 2020-08-17 22:16:51 +08:00
Javi Santana
ce64a73342 fixed tests and style 2020-08-17 09:46:38 +02:00
zhang2014
b11f4b45a0 ISSUES-4006 fix race condition in integeration test 2020-08-17 13:13:56 +08:00
Vitaly Baranov
e6c6f904bb Add test for user directories. 2020-08-16 19:33:50 +03:00
Vitaly Baranov
ad03ff3887 Rename storages users.xml=>users_xml, disk=>local_directory. 2020-08-16 16:42:57 +03:00
kssenii
1e7eb49481 Add one more mes property, support format_schema 2020-08-15 15:05:53 +00:00
Vladimir Chebotarev
cca417b058 Fixed flappy test_multiple_disks::test_start_stop_moves. 2020-08-15 16:00:53 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
kssenii
c6fdeb6c02 Better 2020-08-15 08:00:56 +00:00
kssenii
9a409db5c0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-improvements 2020-08-15 06:51:22 +00:00
Yatsishin Ilya
fac881a6f0 finally remove config_dir 2020-08-14 18:51:28 +03:00
Javi Santana
f04f984fb2 change response content for test 2020-08-14 15:31:54 +02:00
Javi Santana
cb80eba410 added tests 2020-08-14 15:16:07 +02:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Ilya Yatsishin
c90c06ceaf
Merge branch 'master' into integration-explicit-configs 2020-08-13 05:20:17 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
tavplubix
4aff48dc3f
Merge pull request #10851 from zhang2014/feature/materialize_mysql_database
ISSUES-4006 support MaterializeMySQL database engine
2020-08-12 15:59:28 +03:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Yatsishin Ilya
ad740fc7da copy dictionaries 2020-08-12 12:26:01 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Yatsishin Ilya
9767d96274 Fix names 2020-08-12 11:16:46 +03:00
Alexander Kuzmenkov
ef5882639b
Merge pull request #13459 from Jokser/s3-multithreaded-disk-copy
Move parts from DiskLocal to DiskS3 in parallel
2020-08-12 07:36:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexander Tokmakov
829f7e65de try fix sync, add experimetal flag 2020-08-12 00:59:46 +03:00
zhang2014
e3b51835ff ISSUES-4006 try fix ci 2020-08-11 21:35:50 +08:00
Yatsishin Ilya
75d0b8245f fix typo 2020-08-11 11:36:26 +03:00
Yatsishin Ilya
5d52c306c8 fix 2020-08-11 11:35:31 +03:00
Yatsishin Ilya
dd2449354a fix 2020-08-11 11:28:16 +03:00
Yatsishin Ilya
4c61a29a63 Add noop runner parameter to prepare actual changes 2020-08-10 16:44:04 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Pavel Kovalenko
f503273d41 Merge remote-tracking branch 'origin/master' into s3-multithreaded-disk-copy
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
2020-08-10 14:35:26 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
zhang2014
90b7628496 ISSUES-4006 try fix test failure & add some test 2020-08-10 10:25:08 +08:00
zhang2014
933f287db4 ISSUES-4006 resolve review comment & support alter renmae command 2020-08-09 20:10:30 +08:00
alexey-milovidov
aefa9b297b
Merge pull request #13449 from ClickHouse/mixed_granularity_parts_by_default
Enable mixed granularity parts by default
2020-08-09 01:36:59 +03:00
kssenii
139a19d583 Merge 2020-08-08 17:20:50 +00:00
kssenii
2ea32a710a More tests, better reconnect 2020-08-08 17:03:55 +00:00
Alexander Kuzmenkov
6a596d5c40
Merge pull request #13076 from Jokser/s3-file-cache
Ability to cache mark and index files for S3 disk
2020-08-08 01:04:53 +03:00
Vitaly Baranov
8d6e04835c
Merge pull request #13199 from vitlibar/fix-reading-row-policies-from-users-xml
Fix parsing row policies from users.xml
2020-08-07 23:32:28 +03:00
Vitaly Baranov
1a4a8a219c
Merge pull request #13305 from vitlibar/correct-error-message-if-setting-not-found-in-users_xml
Correct error message if setting not found in users.xml
2020-08-07 23:31:23 +03:00
alesapin
7d1283247f Fix tests 2020-08-07 20:16:59 +03:00
Pavel Kovalenko
a6ee09f696 Move parts to DiskS3 in parallel refactoring. 2020-08-07 14:40:19 +03:00
Yatsishin Ilya
222b06f4e9 Add lost import 2020-08-07 13:42:39 +03:00
alesapin
77b8c9e332 Fix DDL worker 2020-08-07 12:18:34 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
kssenii
24b032b378 Allow multiple consumers for same queues 2020-08-06 13:50:44 +00:00
alesapin
d387b97a69
Merge pull request #13285 from filimonov/kafka_fix_test_rdkafka_15
Fix for test_kafka_flush_by_block_size after rdkafka 1.5
2020-08-06 11:48:21 +03:00
Alexander Kuzmenkov
4417fb80e6
Merge pull request #13203 from oandrew/avro-confluent-skip-tombstone
AvroConfluent: skip Kafka tombstone records/skip broken records
2020-08-05 02:47:42 +03:00
kssenii
add698a86b Merge 2020-08-04 21:44:33 +00:00
Vitaly Baranov
b8b4bb331e Add test. 2020-08-04 20:50:29 +03:00
alesapin
61a8d9b137
Merge pull request #13278 from ClickHouse/kill_clickhouse_without_throw
Fix exception in integration tests during clickhouse restart
2020-08-04 11:28:28 +03:00
Nikolai Kochetov
389f895b43
Merge pull request #13290 from ClickHouse/fix-totals-for-delayed-replica
Fix totals for delayed replica
2020-08-04 11:26:09 +03:00
Andrew Onyshchuk
a46049f86d test_storage_kafka: test empty message when supported by format 2020-08-04 02:43:42 -05:00
Andrew Onyshchuk
e472c83601 Add AvroConfluent kafka test 2020-08-04 02:43:42 -05:00
zhang2014
c173bd391f ISSUES-4006 try fix build & test failure 2020-08-04 10:31:27 +08:00
zhang2014
6b452cf83d ISSUES-4006 try fix build failure & fix float 32 parser 2020-08-04 10:31:27 +08:00
zhang2014
b76f218d90 ISSUES-4006 add mysql dml test 2020-08-04 10:31:27 +08:00
zhang2014
9996166860 ISSUES-4006 try fix check style 2020-08-04 10:31:27 +08:00
zhang2014
7eb232e02d ISSUES-4006 add dml test after ddl 2020-08-04 10:31:27 +08:00
zhang2014
bd65a8f213 ISSUES-4006 try fix build failure 2020-08-04 10:31:27 +08:00
zhang2014
d57631210e ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
cfe2c42199 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
9d8234afd7 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
c5946f7697 ISSUES-4006 add mysql 8.0 integration test 2020-08-04 10:31:27 +08:00
zhang2014
0974f6c692 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
2fd0c95d79 ISSUES-4006 try fix integration test 2020-08-04 10:31:27 +08:00
zhang2014
db6220e52c ISSUES-4006 add mysql 5.7 ddl integration test 2020-08-04 10:31:27 +08:00
zhang2014
74f354d840 ISSUES-4006 add some check before create materialize mysql database 2020-08-04 10:31:27 +08:00
zhang2014
e471f805b5 ISSUES-4006 try fix build failure & update integration test 2020-08-04 10:31:26 +08:00
zhang2014
94a2a7791c ISSUES-4006 add some integration test 2020-08-04 10:31:26 +08:00
zhang2014
f5b66810ce ISSUES-4006 add integration test 2020-08-04 10:31:26 +08:00
Vitaly Baranov
5ef4b19471 Add test for custom settings in users.xml 2020-08-04 01:48:29 +03:00
alexey-milovidov
c43a27782e
Merge pull request #13153 from ClickHouse/merge-tree-settings-sanity-check
Sanity checks for MergeTreeSettings
2020-08-04 01:27:19 +03:00
alexey-milovidov
ef0097d326
Merge pull request #12343 from ClickHouse/database_atomic_improvements
DatabaseAtomic improvements
2020-08-03 21:45:41 +03:00
Nikolai Kochetov
11830343fa Update test. 2020-08-03 20:07:09 +03:00
Mikhail Filimonov
991c673870 Fix for test_kafka_flush_by_block_size after rdkafka 1.5
Since rdkafka 1.5 (https://github.com/edenhill/librdkafka/releases/tag/v1.5.0)
don't auto-create topics when subscribing, so test start failing
because it was intentionally time-limited to check if flushing by block size worked.

Since 20.5 it's possible to increase kafka_flush_interval_ms per table, so i've
adjusted the test using that feature to test if data is flushed by block size,
not by time.
2020-08-03 18:43:37 +02:00
kssenii
d5b1332b67 Stop publish untill batch is confirmed 2020-08-03 14:40:51 +00:00
alesapin
8ad6a68fad Add ability to execute commands in integration tests containers without exceptions. Supress exception during kill 2020-08-03 17:40:02 +03:00
Alexander Kuzmenkov
4049f23188
Merge pull request #13103 from filimonov/test_for_macros_in_kafka
Add test for macros usage in some kafka settings.
2020-08-03 17:16:12 +03:00
Alexander Tokmakov
392778d482 fix test 2020-08-03 15:19:41 +03:00
Alexander Tokmakov
5b92f43f12 Merge branch 'master' into database_atomic_improvements 2020-08-03 14:35:40 +03:00
alesapin
eb2236fe8b Fix configs 2020-08-03 14:13:43 +03:00
kssenii
60124b769c Merge 2020-08-03 09:17:23 +00:00
Alexey Milovidov
b232659439 Update tests 2020-08-03 00:39:51 +03:00
alesapin
75a9053511
Merge pull request #13150 from nvartolomei/nv/freeze-verbose-absolute-path
Use absolute paths to backup locations (shadow)
2020-08-02 19:25:24 +03:00
alexey-milovidov
5e0437eeac
Merge pull request #12442 from ClickHouse/deprecate-special-zero-datetime
Deprecate special printing of zero Date/DateTime
2020-08-02 00:36:34 +03:00
alexey-milovidov
566044f9c8
Merge pull request #12991 from ClickHouse/kafka-fix-msan
Fix MSan error in "rdkafka" library #12990
2020-08-02 00:22:44 +03:00
Alexey Milovidov
07f3662f6d Merge remote-tracking branch 'origin/master' into deprecate-special-zero-datetime 2020-07-31 23:49:06 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
alesapin
0c918c6137
Update tests/integration/runner 2020-07-31 15:08:19 +03:00
alexey-milovidov
9c9ef0db9b
Merge branch 'master' into database_atomic_improvements 2020-07-31 14:56:49 +03:00
Pavel Kovalenko
91ca5fa585 Added __init__.py to DiskS3 with cache test. 2020-07-31 14:43:50 +03:00
Nikita Mikhaylov
2e6edf5aa1
trigger 2020-07-31 14:38:15 +03:00
Pavel Kovalenko
fced8d04f2 DiskS3 with cache test fix. 2020-07-31 12:24:57 +03:00
alexey-milovidov
dc733e7c45
Fix Python 2020-07-31 01:23:16 +03:00
Alexey Milovidov
7722008988 Update tests 2020-07-31 00:26:04 +03:00
Alexey Milovidov
cfd4e9da3d Update tests 2020-07-31 00:24:14 +03:00
Alexey Milovidov
a354508b7f Update test 2020-07-31 00:21:00 +03:00
Alexey Milovidov
83c9d9ef45 Merge branch 'master' into deprecate-special-zero-datetime 2020-07-31 00:17:04 +03:00
Alexey Milovidov
362655fa43 Fix some bad tests 2020-07-30 22:59:49 +03:00
Nicolae Vartolomei
85174d64a0 Use absolute paths to backup locations (shadow)
Tests are frankenstain. Had to hide absolute path `/tmp/clickhouse.test..IP69I/data/shadow/test_01417_single_part_7/data/default/table_for_freeze/7_8_8_0` to make them deterministic and independend of the method they are run (local vs remote target)
2020-07-30 18:03:26 +01:00
Pavel Kovalenko
7a41fc1b9b DiskS3 with cache tests. 2020-07-30 17:49:56 +03:00
Mikhail Filimonov
0d55d364da Add test for macros usage in certain kafka setting.
https://github.com/ClickHouse/ClickHouse/issues/2249
918dbc2902
2020-07-30 11:28:52 +02:00
alesapin
724b7be555 Merge branch 'volumes-related-refactorings' of https://github.com/excitoon-favorites/ClickHouse into volumes-refactorings 2020-07-30 12:20:48 +03:00
Vladimir Chebotarev
bcc926fbb2 Returned max_data_part_size to system.storage_policies. 2020-07-30 04:19:32 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
libenwang
f6183559eb Add integration dictionaries tests 2020-07-29 13:57:46 +08:00
Ilya Yatsishin
70d6e70e68
Merge pull request #12953 from qoega/helper_container2
Do not build helper_container image inside integrational tests. Part 2: use pre-built helper_container
2020-07-28 18:20:08 +03:00
alesapin
585d9247ec
Merge pull request #12959 from ClickHouse/test_for_backup
Check backup restore in integration test.
2020-07-28 17:59:52 +03:00
Alexander Kazakov
2bde393499
Merging #12548 - Correction to merge_with_ttl_timeout logic by @excitoon (#12982)
* Fixed `merge_with_ttl_timeout` logic.
* Separate TTL-merge timers for each partition

Co-authored-by: Vladimir Chebotarev <vladimir.chebotarev@gmail.com>
2020-07-28 17:38:34 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
alexey-milovidov
7a22717180
Merge pull request #12760 from ClickHouse/sticky_mutations_bug
Sticking mutations bug
2020-07-28 14:42:54 +03:00
Yatsishin Ilya
c34b1b7db8 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:36:10 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
kssenii
0ee54c8a4a Fix build, async acks -> sync acks, fix tests 2020-07-28 10:43:25 +00:00
alesapin
1bece3de0a Remove strange code and test 2020-07-28 12:36:08 +03:00
alesapin
60dd38eab6
Merge pull request #12857 from ClickHouse/fix_range_hashed_dictionary
Fix columns duplication for range hashed dictionary (DDL)
2020-07-28 11:20:09 +03:00
alexey-milovidov
4d76f41449
Merge pull request #12658 from azat/kafka-unavail-broker-SIGSEGV
Fix SIGSEGV in StorageKafka when broker is unavailable
2020-07-28 00:03:54 +03:00
alesapin
1f8fe725ec Add test for ability to restore from backup 2020-07-27 22:35:38 +03:00
Yatsishin Ilya
4bd6261dc1 Use prebuilt helper_container for integration tests 2020-07-27 20:00:14 +03:00
alesapin
e73961dfe2 Fix columns duplication for range hashed dictionary created from DDL query 2020-07-27 17:06:44 +03:00
Gleb Novikov
ee07c74868 Fixed integration test_multiple_disks 2020-07-26 21:27:36 +03:00
alesapin
2d8e36ed5f Add test for sticking mutations 2020-07-26 18:58:03 +03:00
Alexander Tokmakov
6bfe88e83f Merge branch 'master' into database_atomic_improvements 2020-07-26 13:40:05 +03:00
kssenii
22b16060f6 More reliable publishing 2020-07-25 16:56:29 +00:00
kssenii
2b57857afc Add dl-exchange, commits 2020-07-25 16:56:12 +00:00
kssenii
f9a4bf9e61 Add queue resume read 2020-07-25 16:55:58 +00:00
kssenii
f0f6111655 Move exchange init, add bridge-exchange 2020-07-25 16:55:44 +00:00
kssenii
ac448db491 Add virtuals 2020-07-25 16:55:32 +00:00
kssenii
a88e391bd2 Fix bug with insert, simplify exchanges logic 2020-07-25 16:55:18 +00:00
Azat Khuzhin
0cb6669531 Add integration test for input_format_parallel_parsing memory tracking 2020-07-23 11:31:13 +03:00
Azat Khuzhin
cdb959ec8e Fix test_storage_kafka::test_kafka_unavailable 2020-07-22 11:42:30 +03:00
Azat Khuzhin
58ba72c7b6 Merge remote-tracking branch 'upstream/pr/12487' into kafka-unavail-broker-SIGSEGV
* upstream/pr/12487:
  add failing test with kafka
2020-07-22 11:07:06 +03:00
Alexander Tokmakov
9bcaaea3e0 Merge branch 'master' into database_atomic_improvements 2020-07-22 05:24:48 +03:00
Alexander Kuzmenkov
40ee6eba19
Merge pull request #12545 from ClickHouse/fix_load_part_without_checksums
Fix loading parts without checksums
2020-07-20 14:40:53 +03:00
Alexey Milovidov
a104934d2c Merge branch 'master' into deprecate-special-zero-datetime 2020-07-20 04:34:26 +03:00
tavplubix
5634482393
Merge pull request #12556 from azat/distributed-remove-files-on-drop
Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE
2020-07-17 19:29:57 +03:00
Alexey Milovidov
e207acf19a Merge branch 'master' into deprecate-special-zero-datetime 2020-07-17 17:06:31 +03:00
Alexander Tokmakov
c27de9b424 fixes 2020-07-17 16:11:44 +03:00
alexey-milovidov
0f6599c9e5
Merge pull request #12541 from BohuTANG/mysql_explain
Fix EXPLAIN format for MySQL client
2020-07-17 14:04:01 +03:00
alesapin
ac802a8e96
Merge pull request #12543 from ClickHouse/fix_marks_type_on_mutation
Fix incorrect adaptive granularity by default
2020-07-17 11:09:54 +03:00
Azat Khuzhin
6ea1b19476 Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE 2020-07-17 08:59:57 +03:00
Alexander Tokmakov
a612080df1 Merge branch 'master' into database_atomic_improvements 2020-07-17 00:43:59 +03:00
alesapin
b3ec3b1ed1 Fix loading parts without checksums 2020-07-16 13:54:49 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
42983c5416 Fix incorrect adaptive granularity by default 2020-07-16 12:10:15 +03:00
BohuTANG
bae11968de Fix EXPLAIN format for MySQL/PG client #12432 2020-07-16 16:29:17 +08:00
Alexey Milovidov
b0b0690e1c Fix Python 2020-07-16 06:56:46 +03:00
Alexey Milovidov
2753cb58b6 Fixup 2020-07-16 05:31:03 +03:00
Alexey Milovidov
8abcee3201 Add integration test 2020-07-16 05:27:46 +03:00
Alexey Milovidov
11f8e2d906 Remove strange empty file 2020-07-16 05:11:40 +03:00
Alexey Milovidov
126a94ab69 Update integration tests 2020-07-16 04:48:50 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Alexander Tokmakov
7f6a0a652f fix tests 2020-07-15 23:16:31 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
Anton Popov
890bb2f582 add failing test with kafka 2020-07-14 12:24:12 +03:00
Alexander Tokmakov
fdb02edc7c Merge branch 'master' into database_atomic_improvements 2020-07-13 17:28:48 +03:00
Alexander Tokmakov
04c3e7cab6 add implicit uuid macro 2020-07-13 16:18:38 +03:00
Denis Glazachev
f787702922 Merge branch 'master' into ldap-per-user-authentication
* master: (27 commits)
  Whitespaces
  Fix typo
  Fix UBSan report in base64
  Correct default secure port for clickhouse-benchmark #11044
  Remove test with bug #10697
  Update in-functions.md (#12430)
  Allow nullable key in MergeTree
  Update arithmetic-functions.md
  [docs] add rabbitmq docs (#12326)
  Lower block sizes and look what will happen #9248
  Fix lifetime_bytes/lifetime_rows for Buffer direct block write
  Retrigger CI
  Fix up  test_mysql_protocol failed
  Implement lifetime_rows/lifetime_bytes for Buffer engine
  Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp
  Add lifetime_rows/lifetime_bytes interface (exported via system.tables)
  Tiny IStorage refactoring
  Trigger integration-test-runner image rebuild.
  Delete log.txt
  Fix test_mysql_client/test_python_client error
  ...
2020-07-13 15:46:27 +04:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Denis Glazachev
a6a6f43422 Fix the test: auth_params is a JSON object 2020-07-12 01:40:24 +04:00
alexey-milovidov
160dcf715d
Merge pull request #12383 from BohuTANG/mysql_write_through_poco_exception
Write through Poco::Exception exception to MySQL protocol client
2020-07-11 23:56:22 +03:00
Vitaly Baranov
fe6122a1dd
Merge pull request #12394 from vitlibar/fix-calculating-implicit-access-rights
Fix calculating implicit access rights
2020-07-11 19:31:56 +03:00
BohuTANG
d6b3509664 Fix up test_mysql_protocol failed 2020-07-11 21:30:20 +08:00
alexey-milovidov
60bc8c8a8e
Delete log.txt 2020-07-11 05:33:41 +03:00
BohuTANG
beaf97f634 Fix test_mysql_client/test_python_client error 2020-07-11 09:17:12 +08:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Vitaly Baranov
c66433a472 Add tests for implicit access rights. 2020-07-10 17:16:47 +03:00
Vitaly Baranov
d036682ef1 Split test 'test_create_user_and_login' into two. 2020-07-10 17:16:47 +03:00
BohuTANG
86590d4aca Change the exception catch to the generic way 2020-07-10 17:18:00 +08:00
BohuTANG
dfd7c5300a Add test_mysql_client_exception integration test 2020-07-10 14:20:32 +08:00
alexey-milovidov
8d7e418617
Merge pull request #12314 from BohuTANG/mysql_select_database
Support MySQL 'SELECT DATABASE()'
2020-07-10 06:32:04 +03:00
BohuTANG
260bcb9d79 Add integration test for mysql replacement query 2020-07-09 22:20:54 +08:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 (#12026)
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
2020-07-09 17:09:17 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
Yatsishin Ilya
42894ecb27 wait more 2020-07-08 10:36:35 +03:00
alesapin
f04a49a114
Merge pull request #12256 from ianton-ru/redirect_limit_exception
throw exception on redirect limit in S3 request
2020-07-08 10:33:42 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
Anton Ivashkin
78ba9c986f throw exception on redirect limit in S3 request 2020-07-07 16:20:48 +03:00
alesapin
be85f9f98a
Merge pull request #12165 from vitlibar/fix-split-dictionary-source-table-name
Fix splitting table name of dictionary source
2020-07-07 11:49:36 +03:00
Alexander Kuzmenkov
dce7709405
Merge pull request #12152 from BohuTANG/mysql_kill_query
Support MySQL 'KILL QUERY [connection_id]'
2020-07-07 11:07:20 +03:00
Vitaly Baranov
4733504b51 Don't split dictionary source's table name into schema and table name itself
if ODBC driver doesn't support schema.
2020-07-06 23:41:39 +03:00
alesapin
3f90f65678 Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Nikita Mikhaylov
5c6d6bdf54
Merge pull request #11995 from azat/load_balancing-priority
Load balancing manual priority
2020-07-06 13:32:20 +04:00
BohuTANG
18c48ce12c Add integration test for mysql replacement query 2020-07-06 16:26:06 +08:00
alexey-milovidov
ea0fb005fb
Merge pull request #12116 from vitlibar/fix-table-dictionary-dependency
Fix handling dictionary-table dependency
2020-07-06 04:19:43 +03:00
alexey-milovidov
c696354dd4
Merge pull request #12115 from ianton-ru/disk-type-in-system-disks
Add type column in system.disks
2020-07-05 01:04:17 +03:00
Val
147fa9fed9 fix type error in zookeeper 2020-07-04 16:48:44 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Vitaly Baranov
dad96beb72 Add test. 2020-07-03 22:06:00 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
Vitaly Baranov
929d652297
Merge pull request #12083 from vitlibar/improve-revoke-command
Improve REVOKE command
2020-07-03 17:17:36 +03:00
Anton Ivashkin
23b44ca6fe Add type column in system.disks 2020-07-03 15:45:54 +03:00
alesapin
c57edd2018 Tiny fixes 2020-07-03 11:02:35 +03:00
Anton Popov
4422df2e37 Merge remote-tracking branch 'upstream/master' into HEAD 2020-07-02 20:18:21 +03:00
alesapin
ab54a96cc5 Reverse arguments 2020-07-02 17:38:09 +03:00
alesapin
96df2e6b71 Better shutdown and conversion 2020-07-02 17:35:10 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
Vitaly Baranov
03b36c262e Improve REVOKE command: now it requires only grant/admin option for only
access which will be revoked.
REVOKE ALL FROM user1 now revokes all granted roles.
2020-07-02 12:54:24 +03:00
Alexander Kazakov
cc2cadb7f5
Merge pull request #11893 from excitoon-favorites/autostartmoves
In *MergeTree: Parts moving task shall be started if new storage policy needs them
2020-07-02 10:44:38 +03:00
Vitaly Baranov
c39eb8f71b Fix partial revokes (complex cases). 2020-06-30 18:47:02 +03:00