thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
56,652 Commits 9,138 Branches 1,778 Tags 2 GiB
c715f0e2ed
Commit Graph

1323 Commits

Author SHA1 Message Date
tavplubix
7af89cba8a
Merge pull request #16715 from zhang2014/fix/ISSUES-16605 
ISSUES-16605 fix without returning affected rows when insert select query in MySQL handler
 2020-11-23 15:54:43 +03:00
Anton Ivashkin
aa208a9d9f Use only 's3_max_redirect' in params instead of all settings 2020-11-23 14:02:17 +03:00
Pavel Kovalenko
5f98d38689 Fixed flaky test_storage_s3::test_custom_auth_headers 2020-11-23 13:19:43 +03:00
taichong
a6c2a90756 modify integration test materialize mysql database 
1. fix asan test err

2. reset pymysql conn if ping err

3. finish mysql & ck killed test

4. modify check_query
 2020-11-23 17:55:07 +08:00
taichong
f99d6ea799 add ck & mysql killed while insert 2020-11-23 15:47:44 +08:00
taichong
122740767f add integration test err 2020-11-23 15:47:44 +08:00
taichong
714767f491 make it normal 2020-11-23 15:47:44 +08:00
taichong
5a50535abc add mysql kill sync id test 2020-11-23 15:47:44 +08:00
taichong
81bdf50085 add some except error test 2020-11-23 15:47:44 +08:00
taichong
e691b4a0d4 add network partition integration test for MaterializeMySQL 2020-11-23 15:47:44 +08:00
taichong
e8628f61e0 add mysql kill sync id test 2020-11-23 15:47:44 +08:00
taichong
3287f691ee add some except error test 2020-11-23 15:47:44 +08:00
taichong
5c3d4b2245 add network partition integration test for MaterializeMySQL 2020-11-23 15:47:44 +08:00
alesapin
9c8b0da382
Merge pull request #16033 from nvartolomei/nv/parts-uuid 
Add unique identifiers IMergeTreeDataPart structure
 2020-11-22 16:13:19 +03:00
zhang2014
e1e5eede86 ISSUES-16605 try fix integration failure 2020-11-22 20:13:56 +08:00
zhang2014
5b3154b298 ISSUES-16605 try fix integration test failure 2020-11-22 20:13:56 +08:00
zhang2014
a6dbba5932 ISSUES-16605 add integration test 2020-11-22 20:13:56 +08:00
Nicolae Vartolomei
7c8bc1c04e Use JSON metadata in WAL 2020-11-20 13:49:17 +00:00
Nicolae Vartolomei
94293ca3ce Assign UUIDs to parts only when configured to do so 
Avoid breaking backwards compatibility by default for now.
 2020-11-20 13:49:17 +00:00
Pavel Kruglov
e5588b94aa Fix style and tests 2020-11-20 13:38:53 +03:00
tavplubix
3e335c1e95
Merge pull request #17091 from zhang2014/fix/binlog_checksum 
Fix MaterializeMySQL SYNC failure when modify binlog_checksum
 2020-11-20 13:25:14 +03:00
Anton Ivashkin
a7d4f4be65 Add 's3_max_redirects' test 2020-11-20 11:18:44 +03:00
Pavel Kruglov
608722b6ab Fix integration tests 2020-11-20 02:59:58 +03:00
Nicolae Vartolomei
425dc4b11b Add unique identifiers IMergeTreeDataPart structure 
For now uuids are not generated at all, they are present only if the
part is updated manually (as you can see in the integration test).

The only place where they can be seen today by an end user is in
`system.parts` table. I was looking for hiding this column behind an
option but couldn't find an easy way to do that.

Likely this is also required for WAL, but need to think how not to break
compatibility.

Relates to #13574, https://github.com/ClickHouse/ClickHouse/issues/13574

Next 1: In the upcoming PR the plan is to integrate de-duplication based on
these fingerprints in the query pipeline.

Next 2: We'll enable automatic generation of uuids and come up with a
way for conditionally sending uuids when processing distributed queries
only when part movement is in progress.
 2020-11-19 13:14:25 +00:00
tavplubix
8b6fbea199
trigger CI 2020-11-19 12:47:24 +03:00
Peng Jian
3c86c8b3c9 fix test cases 2020-11-19 15:44:47 +08:00
Peng Jian
d8ae52118b add test 2020-11-19 15:44:47 +08:00
zhang2014
9df9691ccb Try fix integration test 2020-11-19 13:01:23 +08:00
nikitamikhaylov
13e711b27e rename back config 2020-11-18 16:38:14 +03:00
nikitamikhaylov
70a08608f8 add reload dictionary 2020-11-17 20:58:31 +03:00
nikitamikhaylov
663730c758 try to fix flaky test 2020-11-17 20:33:07 +03:00
nikitamikhaylov
9c6b896928 style + flaky test fix 2020-11-17 17:36:04 +03:00
nikitamikhaylov
31b1f644c1 better 2020-11-17 16:59:13 +03:00
nikitamikhaylov
fbd0d14dd6 save 2020-11-17 16:59:12 +03:00
nikitamikhaylov
9b46b53fa3 better defaults 2020-11-17 16:59:12 +03:00
nikitamikhaylov
028fc00166 fix tests 2020-11-17 16:59:12 +03:00
zhang2014
b4fc2ecc00 Try fix integration test 2020-11-17 09:41:35 +08:00
alesapin
5dd32819f5 Merge branch 'master' into fix_ddl_worker_non_leader 2020-11-16 22:34:16 +03:00
Winter Zhang
f6a205d64b
Merge branch 'master' into fix/binlog_checksum 2020-11-16 21:53:22 +08:00
zhang2014
6ef93ac73c Try fix MaterializeMySQL SYNC with modify binlog_checksum 2020-11-16 21:46:36 +08:00
alesapin
6759932c61 Remove accident changes 2020-11-16 15:49:08 +03:00
alesapin
f839742288 Add a test 2020-11-16 15:47:02 +03:00
TCeason
45bacd6f74 Merge branch 'master' into add_sync_user_privs_exception 2020-11-16 12:59:44 +08:00
ubuntu
f7b60c17f5 make test stable 2020-11-13 20:38:28 +08:00
alesapin
8d3858fc22
Merge pull request #16895 from CurtizJ/remove-empty-parts 
Remove empty parts after they were pruned by TTL [2]
 2020-11-13 10:00:18 +03:00
taichong
829037b487 Merge branch 'add_sync_user_privs_exception' of https://github.com/TCeason/ClickHouse into add_sync_user_privs_exception 2020-11-13 13:26:19 +08:00
Anton Popov
4cecd89e84 fix dropping of empty parts 2020-11-12 20:37:54 +03:00
taichong
fefa2a2548 add log std out 2020-11-12 22:24:22 +08:00
Anton Popov
0aa35d53c7 Merge remote-tracking branch 'upstream/master' into HEAD 2020-11-12 14:31:58 +03:00
alesapin
a8d466a645 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-12 12:51:02 +03:00
taichong
091df85cdc modify test db name 2020-11-12 09:49:12 +08:00
TCeason
3912ed4965 Merge branch 'master' into add_sync_user_privs_exception 2020-11-12 09:34:08 +08:00
taichong
e2a9fe44b0 modify test error 2020-11-12 08:17:13 +08:00
Anton Popov
2497598a49 Remove empty parts after they were pruned by TTL 2020-11-11 19:19:43 +03:00
Pavel Kovalenko
e311759c5d
Abort multipart upload if no data was written to WriteBufferFromS3. (#16840) 2020-11-11 15:15:16 +03:00
taichong
f4f4379168 modify test case add precheck 2020-11-11 19:36:09 +08:00
taichong
6c8b5b573b modify test for Integration Tests Flaky Check 2020-11-11 19:36:09 +08:00
taichong
e5da2d4086 print mysql result for test 2020-11-11 19:35:39 +08:00
taichong
64acfea79c throw exception when mysql sync user privs error. 2020-11-11 19:32:28 +08:00
taichong
5c1a01897a Revise the code according to the review 2020-11-11 19:27:37 +08:00
taichong
aecb9716e1 print mysql result for test 2020-11-11 19:27:37 +08:00
taichong
2f6510d75b try to fix ci failed 2020-11-11 19:27:37 +08:00
taichong
d907afa77e throw exception when mysql sync user privs error. 2020-11-11 19:27:37 +08:00
alesapin
637e3dc2c2
Merge pull request #16627 from amosbird/zkc 
reload auxiliary zookeepers configuration
 2020-11-11 10:00:22 +03:00
alesapin
2e357516a6 Merge branch 'master' into add_separate_pool_for_fetches 2020-11-10 13:53:08 +03:00
Vladimir Chebotarev
059357d51e
ALTER UPDATE/DELETE ... IN PARTITION with partition pruning in ReplicatedMergeTree (#13403) 
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
 2020-11-10 13:23:46 +03:00
Amos Bird
aa8e6db786
reload auxiliary zookeepers configuration 2020-11-10 15:56:37 +08:00
alesapin
a056379ec1 Remove duplicate code 2020-11-09 12:25:50 +03:00
alesapin
cedaa938f3 Add simple integration test 2020-11-09 12:10:32 +03:00
alexey-milovidov
7acfa7d407
Merge pull request #16728 from azat/enable-use_compact_format_in_distributed_parts_names-by-default 
Enable use_compact_format_in_distributed_parts_names by default
 2020-11-07 13:40:54 +03:00
alexey-milovidov
712a35bb7b
Merge pull request #16762 from filimonov/kafka-protobuf-issue12615 
Test for the issue #12615
 2020-11-07 13:40:19 +03:00
Azat Khuzhin
ac8df08186 Set use_compact_format_in_distributed_parts_names=0 for some integration tests 
To avoid depends from default.
 2020-11-06 21:02:44 +03:00
Mikhail Filimonov
b072bc7d2b
Test for the issue #12615 2020-11-06 17:54:44 +01:00
alexey-milovidov
654d127ce6
Merge pull request #16630 from sundy-li/patch-6 
better change the config
 2020-11-04 11:36:07 +03:00
alexey-milovidov
09805399d9
Merge pull request #16560 from azat/test_input_format_parallel_parsing_memory_tracking-flackiness 
Fix test_input_format_parallel_parsing_memory_tracking flackiness
 2020-11-04 01:37:25 +03:00
sundy-li
dea4bd483e remove unused codes2 2020-11-03 19:40:45 +08:00
sundy-li
9cfeb9fd32 remove unused codes 2020-11-03 18:13:48 +08:00
sundy-li
72bde1c688 better change the config 2020-11-03 17:32:31 +08:00
Alexander Kuzmenkov
de3451d9a4
Merge pull request #16411 from excitoon-favorites/fixflappyafterasyncdrops 
Remove redundant diagnostics and fixed `test_jbod_overflow`
 2020-11-02 19:26:58 +03:00
alesapin
7f8560e0c0
Merge pull request #16538 from amosbird/fp2 
Allow fetching duplicate parts to detach
 2020-11-02 16:10:42 +03:00
Amos Bird
643ee05288
add integration test 2020-11-01 16:02:09 +08:00
Azat Khuzhin
2832255164 Increase asynchronous_metrics_update_period_s to avoid syncing MemoryTracking with RSS 2020-10-30 22:02:02 +03:00
alesapin
b34960bffa Merge branch 'master' into system_fetches_table 2020-10-30 11:33:37 +03:00
Vladimir Chebotarev
4189d1f9c2 More attempt to fix test_jbod_overflow. 2020-10-29 16:15:19 +03:00
Vladimir Chebotarev
e9f5eefc8c Really fixed test_multiple_disks::test_background_move. 2020-10-29 08:28:43 +03:00
alexey-milovidov
bf3acecf6f
Merge pull request #16032 from Avogar/mysql_bug 
Don't touch MySQL database if it's unnecessary
 2020-10-29 04:14:26 +03:00
Kruglov Pavel
6eaba28e01
Trigger CI 2020-10-28 22:44:37 +03:00
alesapin
57c3935a26
Merge pull request #16426 from kssenii/rabbit-optimize 
Optimize rabbitmq engine
 2020-10-28 22:24:22 +03:00
alesapin
69b9190708
Merge pull request #16266 from ClickHouse/fix_flacky_test_multiple_disks 
Add missing __init__.py
 2020-10-28 18:18:19 +03:00
alesapin
8e8bdeb5d7
Merge pull request #16434 from ClickHouse/fix_fake_race_on_merges_list 
Fix fake race condition on system.merges merge_algorithm
 2020-10-28 15:51:53 +03:00
Alexander Tokmakov
ff68670029 add missing __init__.py 2020-10-28 13:22:10 +03:00
Vladimir Chebotarev
8154695aa2 Revert "Diagnostics (to be dropped)." 
This reverts commit fd48d10029.
 2020-10-28 13:05:48 +03:00
Vladimir Chebotarev
499b18c240 Revert "More diagnostics." 
This reverts commit dd84fb572f.
 2020-10-28 13:05:42 +03:00
Vladimir Chebotarev
a3b151ff5d Revert "Added redundant empty line." 
This reverts commit 81a5f540d7.
 2020-10-28 13:05:30 +03:00
alesapin
617e42ddb4
Merge branch 'master' into rabbit-optimize 2020-10-28 10:24:05 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
alesapin
2b26cbbc97 Add missed file 2020-10-28 10:01:57 +03:00
Alexander Kuzmenkov
6509f1eb39
Merge branch 'master' into minumum 2020-10-27 21:38:23 +03:00
alesapin
60f2d822d7 Fix fake race condition on system.merges merge_algorithm 2020-10-27 18:27:12 +03:00
Pavel Kruglov
2a26136c9e add __init__.py 2020-10-27 18:18:05 +03:00
Alexander Kuzmenkov
766560c138
Merge pull request #14195 from ClickHouse/aku/opentelemetry 
[wip] add some opentelemetry support
 2020-10-27 16:14:21 +03:00
alesapin
3d3d246bdc Rename table 2020-10-27 16:07:50 +03:00
alesapin
3824fcb076 Rename file and some tweaks 2020-10-27 15:47:42 +03:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Vladimir Chebotarev
791c1b6593 One more attempt to fix. 2020-10-27 14:55:57 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
kssenii
db03cd7dd7 Much more optimal queues setup 2020-10-27 11:00:01 +00:00
Vladimir Chebotarev
81a5f540d7 Added redundant empty line. 2020-10-27 01:44:34 +03:00
alexey-milovidov
cc5f15da29
Merge pull request #16235 from excitoon-favorites/fixflappyafterasyncdrops 
Fixed flappy `test_multiple_disks`
 2020-10-26 22:17:41 +03:00
Alexander Kuzmenkov
5a70e26c70 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-26 19:21:13 +03:00
hchen9
c25a3e4e7b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into trivial_count_seq 2020-10-25 20:51:09 -07:00
Vladimir Chebotarev
dd84fb572f More diagnostics. 2020-10-26 04:33:28 +03:00
Alexey Milovidov
2e23fc242f Remove flaky LIVE VIEW test 2020-10-24 22:48:16 +03:00
alexey-milovidov
0f3caaffe4
Trigger CI 2020-10-24 07:48:15 +03:00
Azat Khuzhin
96da5f6534 Disable syncing MemoryTracking with RSS for test_MemoryTracking 2020-10-24 02:33:16 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration 
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
 2020-10-24 02:27:29 +03:00
hchen9
feaab260d8 Fix conflict 2020-10-23 12:54:33 -07:00
Alexander Kuzmenkov
5cbf645de4 Merge remote-tracking branch 'origin/master' into tmp 2020-10-22 19:48:02 +03:00
Vladimir Chebotarev
fd48d10029 Diagnostics (to be dropped). 2020-10-22 10:37:51 +03:00
Vladimir Chebotarev
fb0c7e80aa Fixed flappy test_background_move test. 2020-10-22 03:22:00 +03:00
Vladimir Chebotarev
847e9ca9f6 Fixed flappy test_multiple_disks. 2020-10-21 16:36:03 +03:00
alesapin
e090a119fc Simplify TTL move test 2020-10-21 13:11:26 +03:00
alexey-milovidov
a7098c2557
Merge pull request #16154 from nvartolomei/nv/max_concurrent_queries_for_all_users 
Add max_concurrent_queries_for_all_users setting
 2020-10-21 04:35:57 +03:00
Pavel Kruglov
cc91eb474e Add test 2020-10-20 21:12:37 +03:00
alexey-milovidov
75a02112bc
Merge pull request #15592 from sundy-li/readonly-metrics 
sub ReadonlyReplica metric when detach readonly tables
 2020-10-20 19:17:52 +03:00
Vladimir Chebotarev
aa5f207fd4
Added disable_merges option for volumes in multi-disk configuration (#13956) 
Co-authored-by: Alexander Kazakov <Akazz@users.noreply.github.com>
 2020-10-20 18:10:24 +03:00
alexey-milovidov
5e46e7c670
Merge pull request #15723 from Jokser/idempotent-part-move 
Possibility to move part to another disk/volume if first attempt was failed
 2020-10-20 04:26:50 +03:00
Alexander Kuzmenkov
41ac15a71c fix initial query id 2020-10-20 00:26:10 +03:00
Nicolae Vartolomei
5a665d1d42 Add max_concurrent_queries_for_all_users setting 
Closes #6636.
 2020-10-19 15:51:28 +01:00
Pavel Kovalenko
ad92127036 Fixed move part exception getting in test_merge_tree_s3_failover. 2020-10-16 17:30:34 +03:00
alesapin
dc1a5abea9 Remove cluster type check during alter 2020-10-16 14:59:58 +03:00
Pavel Kovalenko
a474bdcabf Merge remote-tracking branch 'origin/master' into idempotent-part-move 2020-10-16 13:02:40 +03:00
Nikita Mikhaylov
6512d84b31
Merge pull request #15985 from CurtizJ/redis-cached-dict 
Add support of cache layout for Redis dictionaries with complex key
 2020-10-15 22:35:36 +03:00
Kruglov Pavel
5aba639430 Update test 2020-10-15 22:01:18 +03:00
sundy-li
153be93544 sub ReadonlyReplica when detach readonly tables 2020-10-15 22:01:18 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf 
ProtobufSingle format
 2020-10-15 16:58:39 +03:00
Anton Popov
3050b2e67b add support of cache layout for redis dictionaries with complex key 2020-10-14 22:57:07 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf 2020-10-14 16:26:57 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata"" 
This reverts commit c65d1e5c70.
 2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions 
Write structure of table functions to metadata
 2020-10-13 23:56:09 +03:00
Vitaly Baranov
13896cf4c9
Merge pull request #15875 from vitlibar/rbac-fix-deadlock 
Fix possible deadlocks in RBAC
 2020-10-13 12:58:57 +03:00
Vitaly Baranov
6a58bb5c23 Enable rbac tests with thread sanitizer. 2020-10-13 01:03:51 +03:00
alexey-milovidov
4798234002
Merge pull request #15843 from ClickHouse/check-executable-files 
Check for executable bit on non-executable files
 2020-10-12 23:54:00 +03:00
tavplubix
748b75ab1b
Merge pull request #15767 from ClickHouse/fix_materialize_mysql_count_v2 
Try fix select count() for MaterializeMySQL (another way)
 2020-10-12 14:41:38 +03:00
alesapin
106040a720 Disable rbac tests with thread sanitizer 2020-10-12 10:04:46 +03:00
Mikhail Filimonov
e17d4e1eeb
Tests and some docs 2020-10-12 07:51:46 +02:00
Mikhail Filimonov
b602d18dd8
ProtobufSingle input format 
Allows to read Single protobuf message at once (w/o length-delemeters).
 2020-10-12 07:51:36 +02:00
Alexey Milovidov
78c42d5dcd Remove executable bit from non-executable files 2020-10-11 19:21:29 +03:00
alexey-milovidov
2e3046991b
Merge pull request #15757 from filimonov/fix-kafka-no-holes-flap 
fix flap in no_holes_when_write_suffix_failed
 2020-10-11 14:38:45 +03:00
bharatnc
8739f219c6 Fix incorrect flag in Integration tests README 2020-10-10 17:52:50 -07:00
filimonov
1ce0d4dbc2
Update test.py 
similar change for test_kafka_duplicates_when_commit_failed
 2020-10-10 23:36:59 +02:00
Mikhail Filimonov
60f4e561fb
fix test_kafka_produce_key_timestamp 2020-10-10 17:01:22 +02:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master 
Improvement of Quorum Inserts in ClickHouse
 2020-10-09 22:43:53 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00
alesapin
7f3b9b1993 Fetch helper image before run 2020-10-09 17:42:03 +03:00
alesapin
3ac7b5aba8 Fetch helper image before run 2020-10-09 17:39:32 +03:00
alesapin
bdab187c45 Fetch helper image before run 2020-10-09 17:38:31 +03:00
alesapin
b82038b65b Add missed file 2020-10-09 14:20:54 +03:00
alesapin
f12382ad93 Fix race in openssl 2020-10-09 12:08:49 +03:00
alesapin
fbd7141fed Fix flaky tests 2020-10-09 10:19:17 +03:00
alesapin
66b7748b63
Merge pull request #15763 from ClickHouse/fix_race_condition_in_mysql_pool 
Fix race condition in MySQL pool
 2020-10-09 09:43:25 +03:00
Alexander Tokmakov
a6178cc876 try fix select count() for MaterializeMySQL 2020-10-08 23:39:24 +03:00
tavplubix
7b5f2b2bb0
Merge pull request #15701 from ClickHouse/better_clone_replica 
Improvements in lost replica recovery
 2020-10-08 23:19:23 +03:00
alesapin
de722cd57c Fix race condition in MySQL pool 2020-10-08 18:50:09 +03:00
alesapin
c6d8b94ad6 Add some tests 2020-10-08 16:29:13 +03:00
alesapin
f953c1be87 Disable cassandra tests with thread sanitizer 2020-10-08 13:48:53 +03:00
alesapin
3f5dc37095
Merge pull request #15681 from ClickHouse/improvement_in_test 
Add stderr log to test_grant_and_revoke
 2020-10-08 09:51:54 +03:00
alesapin
4fbe925490
Merge pull request #15686 from ClickHouse/fix_race_mariadb 
Fix race in mariadb
 2020-10-08 09:42:41 +03:00
hchen9
ed2ce4a6fc Resolve conflict in StorageMemory 2020-10-07 17:19:59 -07:00
alesapin
d093d4c535
Merge pull request #15675 from ClickHouse/fix_races_in_hdfs 
Fix races in libhdfs
 2020-10-07 20:39:40 +03:00
Pavel Kovalenko
69c126f1f1 Possibility to move part to another disk/volume if first attempt was failed. 2020-10-07 14:35:28 +03:00
Alexander Tokmakov
ea16370024 improvements in lost replica recovery 2020-10-07 02:29:33 +03:00
alesapin
ade916570b Add log config 2020-10-06 19:01:13 +03:00
alesapin
a453e8dbe1 Add stderr log to test_grant_and_revoke 2020-10-06 17:07:00 +03:00
alesapin
db03a894e5 Change test to run flaky check 2020-10-06 16:29:50 +03:00
Pavel Kovalenko
69b4bc6f33 Proper error handling during insert into MergeTree with S3. 2020-10-06 12:38:00 +03:00
hchen9
b96c1326fc Trigger test again 2020-10-04 00:18:43 -07:00
hchen9
ea10291758 Reformat code 2020-10-03 21:03:46 -07:00
alexey-milovidov
53ce5e3892
Merge pull request #15551 from azat/for-user-limits-over-distributed 
Pass through *_for_user settings via Distributed with cluster-secure
 2020-10-04 04:18:20 +03:00
hchen9
347f5c99b1 Set user_configs = configs/users.xml 2020-10-03 14:18:24 -07:00
hchen9
76182694b0 Fix integration test case test_reload_zookeeper 2020-10-03 14:07:21 -07:00
Azat Khuzhin
84583faa43 Fix test_distributed_inter_server_secret under ASAN 
And also cover both cases:
- settings from DDL
- settings from TCP protocol
 2020-10-03 11:16:31 +03:00
alexey-milovidov
75fb73956e
Merge pull request #15238 from ianton-ru/multi_delete_in_s3 
Use S3 multi object delete
 2020-10-03 03:48:06 +03:00
Azat Khuzhin
f25c1742b8 Pass through *_for_user settings via Distributed with cluster-secure 
In cluster-secure case the user on shards (remote) is equal to the user
on the initiator, so those settings can be safely applied.
 2020-10-03 02:04:47 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Alexander Tokmakov
5f6bbe8967 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-10-02 20:14:08 +03:00
Alexander Tokmakov
32776da69a Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-10-02 20:09:37 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
alexey-milovidov
9808d0be81
Merge pull request #15376 from excitoon-favorites/fixs3storage 
Fixed compression in S3 storage
 2020-10-01 04:30:32 +03:00
tavplubix
2f95609f98
Merge pull request #15448 from ClickHouse/allow_synchronous_drop_for_atomic_db 
Allow synchronous DROP/DETACH TABLE for Atomic
 2020-10-01 01:14:31 +03:00
tavplubix
34e4932c8f
Update test.py 2020-09-30 19:16:35 +03:00
Vladimir Chebotarev
b460024356 Fixed bug in GZIP compression in S3 storage. 2020-09-30 16:09:55 +03:00
Vladimir Chebotarev
a38c7ff2a8 Somehow uncompressed PUT works and gzipped PUT doesn't, in S3 storage. 2020-09-30 15:04:42 +03:00
Vladimir Chebotarev
b7a6f15f19 Added test for GZIP in S3 storage. 2020-09-30 13:55:44 +03:00
tavplubix
c9eeb149fd
Merge pull request #15384 from zhang2014/fix/ISSUES-15365 
ISSUES-15365 fix attach mysql database database
 2020-09-30 11:27:15 +03:00
tavplubix
a4b4895b26
Merge pull request #15435 from ClickHouse/ADQM-160-fix 
Try merge #14265 again
 2020-09-30 11:21:55 +03:00
alexey-milovidov
0c07c2d3a3
Merge pull request #15089 from ClickHouse/codecs_for_nested_types 
Codecs for nested types
 2020-09-30 07:18:19 +03:00
Alexander Tokmakov
5d19ed04f6 allow synchronous drop/detach table for Atomic 2020-09-29 16:47:08 +03:00
Alexander Tokmakov
6ebfd1aaf6 fix 2020-09-29 11:58:04 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka"" 
This reverts commit c298c633a7.
 2020-09-29 11:56:37 +03:00
alesapin
bd531bb045
Merge pull request #15396 from ClickHouse/yet_another_retry 
Fix some flaky tests: test_mysql_federated and 00652_replicated_mutations_zookeeper
 2020-09-29 09:51:41 +03:00
zhang2014
a3bc152f73 ISSUES-15365 try fix integration test failure 2020-09-29 14:37:19 +08:00
zhang2014
18985645d9 ISSUES-15365 try fix integration test failure 2020-09-29 12:17:54 +08:00
zhang2014
9e94c077e7 IESSUES-15365 try fix integration test 2020-09-29 10:39:30 +08:00
tavplubix
4578d89819
Merge pull request #15348 from ClickHouse/replicate_default_args 
Continuation of #14791
 2020-09-28 18:53:02 +03:00
zhang2014
b14fb0e8d5 ISSUES-15365 try fix integration test 2020-09-28 23:00:01 +08:00
alesapin
a526a767df Fix some flaky tests 2020-09-28 14:17:07 +03:00
zhang2014
7e90e00f1a ISSUES-15365 add integration test 2020-09-28 18:27:02 +08:00
Nikita Mikhaylov
73573472e9
Merge pull request #15299 from CurtizJ/fix-mysql-hung 
Fix hang of queries with a lot of subqueries to same mysql table
 2020-09-28 12:51:35 +03:00
Anton Ivashkin
c2b692f2c7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into multi_delete_in_s3 2020-09-28 12:00:34 +03:00
Anton Ivashkin
c18cdec77c Use S3 multi object delete 
Some strange with s3_with_proxy test
 2020-09-28 11:47:04 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Tokmakov
aa5e5013f2 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-27 14:11:53 +03:00
Alexander Tokmakov
34addcf61f add review suggestions 2020-09-26 22:18:28 +03:00
alesapin
d1bb6b6555
Update test.py 2020-09-26 11:47:26 +03:00
alesapin
8f9ec30315 Delete flaky test 2020-09-25 19:23:57 +03:00
alesapin
af0bb5bd26 One more time 2020-09-25 19:15:34 +03:00
alesapin
ada193e7b7 Add diff 2020-09-25 16:33:33 +03:00
alesapin
54fa67838e Add flaky test 2020-09-25 16:32:00 +03:00
Anton Popov
085f63a9bf fix hang of queries with a lot of subqueries to same mysql table 2020-09-25 14:12:48 +03:00
tavplubix
b96157e32b
Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 13:42:39 +03:00
alesapin
9bf27fb42a
Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test 
Splitting test_dictionaries_all_layouts_and_sources
 2020-09-25 10:16:28 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload 
Use previous users.xml if failed to reload
 2020-09-24 16:25:19 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
96c419974c Merge branch 'master' into codecs_for_nested_types 2020-09-24 10:28:20 +03:00
nikitamikhaylov
c64ac8596c better 2020-09-23 22:36:47 +03:00
nikitamikhaylov
2d4bdcfec0 file and executables 2020-09-23 22:31:47 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Alexander Tokmakov
a8266a3d3c fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160 
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
 2020-09-23 19:02:58 +03:00
Anton Popov
4b795c7b6a
temporarily run test with wide parts only 2020-09-22 18:58:14 +03:00
Alexander Tokmakov
7fcf20e48c enable more tests 2020-09-22 17:29:09 +03:00
nikitamikhaylov
c9cfdffcd7 mongo uri 2020-09-22 16:52:56 +03:00
alesapin
9b6b5ae08d More tests 2020-09-22 16:16:42 +03:00
Alexander Tokmakov
91cbd49e85 fix tests 2020-09-22 00:09:50 +03:00
nikitamikhaylov
d87f3660ee done 2020-09-21 23:19:46 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms 
specific ReplicatedMergeTree settings
 2020-09-21 01:36:33 +03:00
Vitaly Baranov
33efb36714 Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
alexey-milovidov
eb9ee723c3
Merge pull request #11913 from ClickHouse/compact-parts-by-default 
Enable compact parts by default for small parts
 2020-09-19 15:31:15 +03:00
tavplubix
6e0bdaf46d
Merge pull request #14535 from zhang2014/fix/datetime 
ISSUES-4006 support decimal data type for MaterializedMySQL
 2020-09-19 14:05:32 +03:00
alexey-milovidov
c1402d62db
Merge pull request #14892 from vzakaznikov/fix_test_distributed_over_live_view2 
Fixing tests/integration/test_distributed_over_live_view/test.py
 2020-09-19 13:59:05 +03:00
alexey-milovidov
1fcebce926
Merge pull request #15000 from Jokser/disable-ttl-move-on-insert 
Option to disable TTL move on data part insert
 2020-09-19 13:45:02 +03:00
alexey-milovidov
3463d97f8c
Merge pull request #14973 from amosbird/bm2 
Ignore key constraints when doing mutations.
 2020-09-19 13:44:30 +03:00
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl 
Allow parallel execution of distributed DDL
 2020-09-18 22:18:17 +03:00
Pavel Kovalenko
1fc3aa3ea8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 22:10:49 +03:00
Pavel Kovalenko
77be35a2b8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 21:59:56 +03:00
Amos Bird
d842cb704f
Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Pavel Kovalenko
da04a130ed Add option to disable ttl move on data part insert - minor fixes. 2020-09-18 20:45:30 +03:00
Pavel Kovalenko
0da19ab46d Add option to disable ttl move on data part insert 2020-09-18 18:30:00 +03:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
Alexander Tokmakov
41e99cf261 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-17 20:28:50 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure 
Secure inter-cluster query execution (with initial_user as current query user) [v3]
 2020-09-17 17:11:00 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper 
fix logic error && skip reload testkeeper
 2020-09-17 13:33:45 +08:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests 
Format and cleanup imports form all *.py integration test files
 2020-09-16 20:40:57 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6 
Flaky tests fixes
 2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files 
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
 2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809 
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
 2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories 
Add 'params' column to system.user_directories table.
 2020-09-15 18:25:50 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Alexander Tokmakov
5455068226 try fix flacky test 2020-09-15 17:17:30 +03:00
Alexander Tokmakov
0ecf8e595f cleanup code, add test 2020-09-15 16:41:53 +03:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Alexander Tokmakov
3671c91c37 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-15 12:43:01 +03:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3] 
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
 2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts 
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
 2020-09-15 01:36:28 +03:00
Alexander Tokmakov
a812f7eb75 allow using Atomic database inside MaterializeMySQL 2020-09-14 22:25:02 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests 
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
 2020-09-14 22:08:21 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path 
Skip access storages with same path while reading the main config.
 2020-09-12 14:20:02 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash 
Fix crashes in RabbitMQ tests
 2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00