thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-28 10:31:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
68,377 Commits 9,189 Branches 1,782 Tags 2.2 GiB
f0113a79d9
Commit Graph

2568 Commits

Author SHA1 Message Date
Anton Popov
a15ee72d0f Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-23 13:53:01 +03:00
Vitaly Baranov
c6d877d10b Add tests for checking access rights for SELECT. 2021-06-23 12:54:50 +03:00
Azat Khuzhin
353a770a87 Extend test_insert_distributed_async_send for distributed_directory_monitor_split_batch_on_failure 2021-06-23 02:48:47 +03:00
Azat Khuzhin
a0209178cc Add ability to split distributed batch on failures 
Add distributed_directory_monitor_split_batch_on_failure setting (OFF by
default), that will split the batch and send files one by one in case of
retriable errors.

v2: more error codes
 2021-06-23 02:48:47 +03:00
Azat Khuzhin
e148ef739d Drop replicas from dirname for internal_replication=true 
Under use_compact_format_in_distributed_parts_names=1 and
internal_replication=true the server encodes all replicas for the
directory name for async INSERT into Distributed, and the directory name
looks like:

    shard1_replica1,shard1_replica2,shard3_replica3

This is required for creating connections (to specific replicas only),
but in case of internal_replication=true, this can be avoided, since
this path will always includes all replicas.

This patch replaces all replicas with "_all_replicas" marker.

Note, that initial problem was that this path may overflow the NAME_MAX
if you will have more then 15 replicas, and the server will fail to
create the directory.

Also note, that changed directory name should not be a problem, since:
- empty directories will be removed since #16729
- and replicas encoded in the directory name is also supported anyway.
 2021-06-23 02:47:38 +03:00
alesapin
788e61f80e Snapshots test 2021-06-22 14:43:26 +03:00
alesapin
6b815b4f17 Merge branch 'master' into zookeeper_snapshots 2021-06-22 13:50:27 +03:00
alesapin
bf0a4864ac Add support for set/get ACL commands 2021-06-22 13:49:35 +03:00
alesapin
730554589f fix superdigest 2021-06-22 11:14:54 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests 
Fix some bugs in integration tests
 2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6 
More integration tests improvements
 2021-06-22 10:19:22 +03:00
Kseniia Sumarokova
155bb03239
Merge branch 'master' into pg-dix 2021-06-22 10:14:52 +03:00
alesapin
70f7959de2 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 23:02:42 +03:00
alesapin
8bbe65b4f4 Remove timeouts 2021-06-21 23:02:00 +03:00
alesapin
a356a9ca3d Merge branch 'fix_some_tests' into zookeeper_snapshots 2021-06-21 23:00:07 +03:00
Kseniia Sumarokova
41c65a9965
Merge pull request #25528 from kssenii/something 
Fix convertion of datetime with timezone for mysql, odbc, etc..
 2021-06-21 22:55:22 +03:00
alesapin
c9c22996d4 One more fixed test 2021-06-21 22:52:44 +03:00
Kseniia Sumarokova
f47dd116c4
Update test.py 2021-06-21 19:07:17 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
alesapin
731edc9a6d Fixes in ACLs 2021-06-21 18:45:45 +03:00
kssenii
ac0f86cdbf Truncate for s3 2021-06-21 15:44:36 +00:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
kssenii
4688f9e038 hdfs truncate table 2021-06-21 13:59:57 +00:00
alesapin
76cee4e3cf Debugging 2021-06-21 16:58:39 +03:00
kssenii
0f9fc33a4e Fix postgres arrays 2021-06-21 11:27:10 +00:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
Anton Popov
c2754c34f4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-21 12:42:48 +03:00
kssenii
c0732ddc12 Fix datetime with timezone 2021-06-21 08:22:12 +00:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option" 
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
 2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option 
Add run-id option to integration tests
 2021-06-21 10:21:24 +03:00
Mike Kot
4c391f8e99
SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652) 
* initial commit: add setting and stub

* typo

* added test stub

* fix

* wip merging new integration test and code proto

* adding steps interpreters

* adding firstly proposed solution (moving parts etc)

* added checking zookeeper path existence

* fixing the include

* fixing and sorting includes

* fixing outdated struct

* fix the name

* added ast ptr as level of indirection

* fix ref

* updating the changes

* working on test stub

* fix iterator -> reference

* revert rocksdb submodule update

* fixed show privileges test

* updated the test stub

* replaced rand() with thread_local_rng(), updated the tests

updated the test

fixed test config path

test fix

removed error messages

fixed the test

updated the test

fixed string literal

fixed literal

typo: =

* fixed the empty replica error message

* updated the test and the code with logs

* updated the possible test cases, updated

* added the code/test milestone comments

* updated the test (added more testcases)

* replaced native assert with CH one

* individual replicas recursive delete fix

* updated the AS db.name AST

* two small logging fixes

* manually generated AST fixes

* Updated the test, added the possible algo change

* Some thoughts about optimizing the solution:

ALTER MOVE PARTITION .. TO TABLE -> move to detached/ + ALTER ... ATTACH

* fix

* Removed the replica sync in test as it's invalid

* Some test tweaks

* tmp

* Rewrote the algo by using the executeQuery instead of

hand-crafting the ASTPtr.

Two questions still active.

* tr: logging active parts

* Extracted the parts moving algo into a separate helper function

* Fixed the test data and the queries slightly

* Replaced query to system.parts to direct invocation,

started building the test that breaks on various parts.

* Added the case for tables when at least one replica is alive

* Updated the test to test replicas restoration by detaching/attaching

* Altered the test to check restoration without replica restart

* Added the tables swap in the start if the server failed last time

* Hotfix when only /replicas/replica... path was deleted

* Restore ZK paths while creating a replicated MergeTree table

* Updated the docs, fixed the algo for individual replicas restoration case

* Initial parts table storage fix, tests sync fix

* Reverted individual replica restoration to general algo

* Slightly optimised getDataParts

* Trying another solution with parts detaching

* Rewrote algo without any steps, added ON CLUSTER support

* Attaching parts from other replica on restoration

* Getting part checksums from ZK

* Removed ON CLUSTER, finished working solution

* Multiple small changes after review

* Fixing parallel test

* Supporting rewritten form on cluster

* Test fix

* Moar logging

* Using source replica as checksum provider

* improve test, remove some code from parser

* Trying solution with move to detached + forget

* Moving all parts (not only Committed) to detached

* Edited docs for RESTORE REPLICA

* Re-merging

* minor fixes

Co-authored-by: Alexander Tokmakov <avtokmakov@yandex-team.ru>
 2021-06-20 11:24:43 +03:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
alesapin
b5dae909dd Add some tests 2021-06-18 21:36:19 +03:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
f0490ad7c1 Better formatting 2021-06-18 12:24:04 +03:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
alexey-milovidov
66c0df99d4
Merge pull request #25323 from ClickHouse/try-to-change-signal-for-integration-rests 
Use signal 15 in restart_with_latest_version
 2021-06-17 20:56:00 +03:00
mergify[bot]
04adc58ba1
Merge branch 'master' into try-to-change-signal-for-integration-rests 2021-06-17 06:20:40 +00:00
mergify[bot]
41d007a1b3
Merge branch 'master' into MySQL-column-comments-support 2021-06-17 05:40:15 +00:00
alexey-milovidov
34891f5954
Merge pull request #25317 from ClickHouse/try-fix-ttl-repl 
Update test_ttl_replicated
 2021-06-17 01:46:13 +03:00
Kseniia Sumarokova
60d220bd14
Merge pull request #24413 from kssenii/postgres-fixes-schema 
postgres non-default schema for insert query
 2021-06-16 22:18:23 +03:00
Anton Popov
ea9b890618
Merge branch 'master' into add-compatibility-setting 2021-06-16 21:10:56 +03:00
Anton Popov
8bd7cbd925 add compatibility setting for name of columns 2021-06-16 21:10:07 +03:00
Yatsishin Ilya
1d6253b9dc hardening 2021-06-16 18:37:51 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
Nikolai Kochetov
7c3926ac57 Update test_ttl_replicated 2021-06-16 12:55:48 +03:00
Nikolai Kochetov
8bf55ae2b5
Merge pull request #25166 from ClickHouse/always-detach-parts-with-wrong-partition-id 
Always detach parts with wrong partition ID
 2021-06-16 11:06:07 +03:00
Kostiantyn Storozhuk
d96478c9ff Integration test added and small fixes 2021-06-15 21:45:30 +08:00
Nikolai Kochetov
b65c121a45
Update test_detach_part_wrong_partition_id.py 2021-06-15 13:38:11 +03:00
alexey-milovidov
77721734ed
Merge pull request #21267 from filimonov/kafka-failover 
Kafka failover issue fix
 2021-06-14 01:42:42 +03:00
alexey-milovidov
7c048a9dc8
Merge pull request #23976 from excitoon-favorites/s3unstablereads 
Improved `test_storage_s3_get_unstable`
 2021-06-12 04:04:29 +03:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries 
Remove explicit enable_dictionaries files in integration tests
 2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit 
Add integration test for jdbc bridge
 2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00
Yatsishin Ilya
fe712caa5c typo 2021-06-11 13:50:44 +03:00
Yatsishin Ilya
d7fca4a6f2 wait hdfs longer 2021-06-11 12:30:09 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
Yatsishin Ilya
fa0551a1a3 fix test_partition 2021-06-11 11:39:28 +03:00
alesapin
54f9db670f
Merge pull request #25079 from ClickHouse/debug_network_interfaces 
Trying to debug fetches bandwith test failures
 2021-06-11 10:30:14 +03:00
mergify[bot]
4eb2b33127
Merge branch 'master' into filter_tests_in_ci_runner 2021-06-10 16:15:43 +00:00
Nikolai Kochetov
3bfefa50e2 Add user arg to exec_in_container with cli 2021-06-10 15:15:07 +03:00
Nikolai Kochetov
2936fdd16c Always detach parts with wrong partition id. 2021-06-10 15:04:36 +03:00
Vladimir Chebotarev
f16dd06476 Review fixes. 2021-06-10 08:49:26 +03:00
Vladimir Chebotarev
591c556321 Improved test_storage_s3_get_unstable. 2021-06-10 08:49:26 +03:00
alexey-milovidov
77ab26e217
Merge branch 'master' into less_timeouts 2021-06-10 02:03:16 +03:00
filimonov
3f1d3f2e1d
Update test.py 2021-06-09 23:20:44 +02:00
Yatsishin Ilya
035df8ba28 fixed 2021-06-09 18:49:18 +03:00
Yatsishin Ilya
0c2380e4ac Merge remote-tracking branch 'qoega/better-hdfs-tests' into remove-enable-dictionaries 2021-06-09 17:08:02 +03:00
Mikhail Filimonov
3627ab7cbe
Fix kafka failover issue (#21118). 
Distringuish lack of assignment vs lack of partitions. Bit better / clearer logging.
 2021-06-09 16:02:56 +02:00
Yatsishin Ilya
dd3fd87e26 Fix kerberized hdfs and cleanup 2021-06-09 16:53:16 +03:00
alesapin
192210fea6 Consistent style 2021-06-09 16:42:20 +03:00
alesapin
46aee86d3a Fix flaky check report in CI runner 2021-06-09 16:40:28 +03:00
mergify[bot]
bc012b9c1a
Merge branch 'master' into recreate_kafka_table_case 2021-06-09 10:30:32 +00:00
filimonov
7469f054f0
Update test.py 
Missed one of the refactorings which were merged in the meanwhile 872e36c207 (diff-8129a3b04ff2293c2d89b35395be9ef49918cdafd4420a745d05733b00979646L86-R100)
 2021-06-09 12:27:42 +02:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Yatsishin Ilya
257b9c0731 typo 2021-06-09 12:03:03 +03:00
Yatsishin Ilya
8d6b5d52ab typo 2021-06-09 11:52:20 +03:00
Yatsishin Ilya
a9108e42c3 Better test_odbc_interaction 2021-06-09 11:46:01 +03:00
Yatsishin Ilya
df27e2754b resolve 2021-06-09 11:46:01 +03:00
Nikita Mikhaylov
82b8d45cd7
Merge pull request #23518 from nikitamikhaylov/copier-stuck 
Bugfixes and improvements of `clickhouse-copier`
 2021-06-09 11:36:42 +03:00
mergify[bot]
156592af95
Merge branch 'master' into debug_network_interfaces 2021-06-09 07:56:02 +00:00
alesapin
7179fafef0 Less timeouts in integration tests 2021-06-09 10:49:29 +03:00
kssenii
0521851afa Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgres-fixes-schema 2021-06-08 17:20:23 +00:00
alesapin
eeb75d15da Remove timeouts 2021-06-08 19:21:55 +03:00
alesapin
49b5b94187 Remove strange timeout in test 2021-06-08 19:15:04 +03:00
alesapin
fc805a1ece Trying to debug fetches bandwith test failures 2021-06-08 15:13:45 +03:00
Nikita Mikhaylov
c3f03e8f60 skip ttl_move_to_volume 2021-06-08 11:14:45 +00:00
Nikita Mikhaylov
22864aff23 delete files 2021-06-08 01:52:30 +00:00
Nikita Mikhaylov
c0238e839a another try to fix tests 2021-06-08 01:50:43 +00:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
Ilya Yatsishin
c453a84944
Merge pull request #24973 from qoega/cleanup-iptables-on-session-start 2021-06-07 15:43:13 +03:00
Nikita Mikhaylov
6f5997b0aa fix tests 2021-06-07 10:49:01 +00:00
Nikita Mikhaylov
652de7c9b0
Update test.py 2021-06-07 13:06:41 +03:00
alesapin
fba2d66042 Disable storage_kerberized_hdfs test 2021-06-07 12:25:13 +03:00
alexey-milovidov
344fc39e41
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-07 02:56:32 +03:00
alexey-milovidov
cc5755b1a4
Merge pull request #25002 from ClickHouse/compression-codecs-refactoring 
Compression codecs refactoring
 2021-06-07 02:54:24 +03:00
mergify[bot]
f84ac23951
Merge branch 'master' into compression-codecs-refactoring 2021-06-06 18:02:39 +00:00
mergify[bot]
e9d01d7e4f
Merge branch 'master' into fix-integration-test-s3 2021-06-06 18:02:34 +00:00
mergify[bot]
1172807442
Merge branch 'master' into recreate_kafka_table_case 2021-06-06 12:15:55 +00:00
alexey-milovidov
8b99fa049e
Merge pull request #24967 from filimonov/fix_port_in_kafka_test 
Fix the test after #20393
 2021-06-06 15:11:49 +03:00
Alexey Milovidov
b146524fdb Maybe Minio starts for too long in tests 2021-06-06 12:38:49 +03:00
Alexey Milovidov
8d85145725 Remove experimental compression codecs 2021-06-06 02:26:52 +03:00
Nikita Mikhaylov
b99350b50d
Update test.py 2021-06-06 02:19:17 +03:00
Alexey Milovidov
17962459f5 Merge branch 'master' into issue-16775 2021-06-06 02:18:28 +03:00
Ilya Yatsishin
f2eed22ebd
Merge pull request #24954 from ClickHouse/fix_integration_test 2021-06-05 20:18:33 +03:00
Ilya Yatsishin
3092ec7c7e
Merge pull request #24959 from qoega/no-more-subprocess-call 2021-06-05 19:41:52 +03:00
mergify[bot]
f56e7c6e3a
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-05 12:10:18 +00:00
mergify[bot]
d8ed474062
Merge branch 'master' into copier-stuck 2021-06-05 01:40:23 +00:00
Yatsishin Ilya
df6e163976 fix 2021-06-04 18:46:11 +03:00
Yatsishin Ilya
9f6de5f764 opt-in for cleanup 2021-06-04 18:00:59 +03:00
Yatsishin Ilya
05232e7c40 Make tests great again 2021-06-04 17:33:22 +03:00
Nikita Mikhaylov
f6932026d5 delete partition from original table in case of errors while moving 2021-06-04 14:21:47 +00:00
tavplubix
19727ff753
Update test.py 2021-06-04 16:58:28 +03:00
Mikhail Filimonov
c8fe168a8d
Fix the test after #20393 2021-06-04 15:55:07 +02:00
filimonov
74ae079b19
Update test.py 2021-06-04 15:30:25 +02:00
Nikita Mikhaylov
cf8782faf3
Merge pull request #24311 from nikitamikhaylov/merging-s3-backoff 
Merging #23461
 2021-06-04 14:41:21 +03:00
kssenii
00e76ca372 Checking tests 2021-06-04 11:34:51 +00:00
alesapin
c03f54e2c3 Skip skipped tests 2021-06-04 13:15:44 +03:00
Yatsishin Ilya
e075130112 Remove subprocess_call from cluster.py 2021-06-04 13:14:32 +03:00
alesapin
a0eb45bfc3 More stable test 2021-06-04 12:12:35 +03:00
Yatsishin Ilya
e18343ce17 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-04 11:43:41 +03:00
alesapin
4d7170b557 Followup fixes for integration tests 2021-06-04 10:51:45 +03:00
alesapin
7ca31261b0
Merge pull request #24911 from ClickHouse/remove_some_tests 
Remove some outdated integration tests
 2021-06-04 10:15:39 +03:00
kssenii
e23bc14582 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-03 19:44:55 +00:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff 2021-06-03 18:58:24 +00:00
Mikhail Filimonov
e11f7db28b
Add test #23430 2021-06-03 20:41:01 +02:00
Nikita Mikhaylov
b978405f4a fix 2021-06-03 15:50:44 +00:00
Nikita Mikhaylov
6c583b0e36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-03 15:05:23 +00:00
Ilya Yatsishin
e0a683a407
Mute test_memory_consumption before #24784 2021-06-03 16:10:54 +03:00
tavplubix
1aff716f18
Merge pull request #24777 from ClickHouse/fix_intersection_with_lost_part 
Do not crash on intersecting virtual parts
 2021-06-03 15:42:46 +03:00
alesapin
31b27049b0 Followup 2021-06-03 15:42:12 +03:00
alesapin
6231a0d7d7 Merge branch 'master' into remove_some_tests 2021-06-03 15:41:50 +03:00
alesapin
f0f5aba3b1
Merge pull request #20393 from qoega/integration-2 
Grand integration tests refactoring: Allow parallel run
 2021-06-03 15:20:03 +03:00
alesapin
376b3872bf Remove some outdated integration tests 2021-06-03 14:49:59 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Yatsishin Ilya
ddddb761db more 2021-06-02 18:08:16 +03:00
Yatsishin Ilya
6a9b875b19 simplify test_backup_restore 2021-06-02 17:33:47 +03:00
Nikita Mikhaylov
4382aac25d support for ReplicatedTable creation without arguments 2021-06-02 15:46:37 +03:00
alesapin
f7babe5cd9 Fix build and better test 2021-06-02 11:22:44 +03:00
alesapin
feed2636f4 Add exponential smoothing to Throttler 2021-06-02 01:07:29 +03:00
Nikita Mikhaylov
312bb96eeb Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-02 01:04:47 +03:00
Nikita Mikhaylov
f57863b974 fix tests 2021-06-02 01:03:08 +03:00