thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-26 17:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
69,233 Commits 9,185 Branches 1,781 Tags 2.1 GiB
5d3abc14c7
Commit Graph

2646 Commits

Author SHA1 Message Date
Vitaly Baranov
b0a3a7180f Replace print() with logging.debug() in integration tests 2021-07-07 10:35:11 +03:00
Kseniia Sumarokova
7a7b774ba3
Merge pull request #25550 from kssenii/truncate 
Allow truncate in storages s3/hdfs
 2021-07-06 22:07:53 +03:00
Nicolae Vartolomei
3b5c41fc6d Test CTE with aggregation over distributed table 2021-07-06 14:04:49 +01:00
Nicolae Vartolomei
a5c195fefd Add test case for aggregation w/ alias columns 2021-07-06 13:26:58 +01:00
Vitaly Baranov
e7b1e9a2fb
Merge pull request #25986 from vitlibar/fix-flaky-test_dictionaries_all_layouts_separate_sources-test_https 
Fix parallel execution of integration tests
 2021-07-06 09:22:06 +03:00
Vitaly Baranov
cdcc735d83
Merge pull request #25899 from vitlibar/improve-logging-in-integration-tests 
Improve logging in integration tests.
 2021-07-06 08:22:21 +03:00
Vitaly Baranov
87f59ba670 Fix parallel execution of integration tests. 2021-07-05 23:50:04 +03:00
Alexander Tokmakov
0f377fc4d8 Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-05 22:07:56 +03:00
Kseniia Sumarokova
8b075e34e7
Merge pull request #25984 from kssenii/add-drops-in-tests 
Correct test
 2021-07-05 18:35:53 +03:00
Kseniia Sumarokova
c72a1be0be
Merge pull request #25064 from ucasfl/merge 
Database argument for StorageMerge support regular expression.
 2021-07-05 14:14:44 +03:00
Vitaly Baranov
72d751dc32 Add process id to pytest logs. 2021-07-05 11:25:58 +03:00
kssenii
c713ebe9c1 Add drops in tests 2021-07-05 11:20:58 +03:00
feng lv
b293f701b7 fix test 2021-07-05 03:34:19 +00:00
kssenii
32b7d7b750 More correct startup on create query 2021-07-04 19:53:05 +00:00
mergify[bot]
27d6a69f6a
Merge branch 'master' into truncate 2021-07-04 19:37:13 +00:00
Vitaly Baranov
618a77fafa Improve logging in integration tests. 2021-07-04 22:24:54 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica 
MaterializePostgreSQL table engine and database engine
 2021-07-04 19:34:54 +03:00
kssenii
b39888f199 Do not allow inconsistency in publication 2021-07-04 08:54:41 +00:00
mergify[bot]
9da1c98998
Merge branch 'master' into fix_aggregation_ttl 2021-07-03 15:07:44 +00:00
mergify[bot]
a2183dff39
Merge branch 'master' into better_remove_empty_parts 2021-07-03 15:01:11 +00:00
kssenii
a0623ddb08 Correct test 2021-07-03 13:35:11 +00:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
Ilya Yatsishin
523155a020
Merge pull request #25908 from arenadata/ADQM-320 2021-07-02 13:25:22 +03:00
Ilya Golshtein
63c71a7b4b kerberized HDFS test fix if run in parallel 2021-07-02 02:12:31 +03:00
alexey-milovidov
919cc10a3c
Merge pull request #25823 from azat/integration-tests-fixes 
tests/integration: use iptables --wait
 2021-07-02 00:58:33 +03:00
mergify[bot]
98fa9f7951
Merge branch 'master' into better_remove_empty_parts 2021-07-01 11:32:43 +00:00
kssenii
4ad0f45f0e Some more tests 2021-07-01 08:35:28 +00:00
kssenii
f01c8edbff Fix access to tables after restart 2021-07-01 07:33:58 +00:00
Kseniia Sumarokova
360f772762
Merge pull request #25795 from sand6255/MySQL-column-comments-support 
MySQL Engine column comments support
 2021-06-30 20:18:47 +03:00
Kseniia Sumarokova
ed687f45a1
Merge branch 'master' into truncate 2021-06-30 20:08:42 +03:00
Vitaly Baranov
27bc0caf53
Merge pull request #25861 from vitlibar/correct-messages-in-integration-tests 
Correct messages in integration tests.
 2021-06-30 14:45:02 +03:00
Vitaly Baranov
92ace627d2 Correct messages in integration tests. 2021-06-30 14:16:37 +03:00
alesapin
19aeb14dfd Small tuning in test 2021-06-30 12:39:09 +03:00
alesapin
b33391f4ec
Merge pull request #25816 from vitlibar/collect-stderr-in-integration-tests 
Collect stderr.log and stdout.log in all integration tests by default.
 2021-06-30 12:16:49 +03:00
mergify[bot]
1799804243
Merge branch 'master' into fix_aggregation_ttl 2021-06-30 09:15:46 +00:00
mergify[bot]
8182b6e890
Merge branch 'master' into better_remove_empty_parts 2021-06-30 08:42:26 +00:00
Kseniia Sumarokova
2f38b25ba6
Merge pull request #25834 from kssenii/fix-test 
Fix odbc test
 2021-06-30 10:29:42 +03:00
Storozhuk Kostiantyn
a279cf721d
Update test.py 2021-06-30 10:03:03 +03:00
kssenii
da70f85d4e More tests 2021-06-29 23:11:46 +00:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
kssenii
a8067fb3dd Update test 2021-06-29 20:29:21 +00:00
alexey-milovidov
3b5468d4a4
Merge pull request #25810 from ClickHouse/fix_version_update 
Better test_version_update_after_mutation
 2021-06-29 23:11:57 +03:00
alesapin
a6834213a1 Add tests 2021-06-29 22:47:54 +03:00
Azat Khuzhin
283ec54cbe tests/integration: use iptables --wait 
Since integration tests runs in parallel, this should fix:

  test_keeper_persistent_log_multinode/test.py::test_restart_multinode Another app is currently holding the xtables lock. Perhaps you want to use the -w option?

And similar errors.
 2021-06-29 21:07:39 +03:00
Alexander Tokmakov
fd914f3d97 fix 'Not found column' error in MaterializeMySQL 2021-06-29 20:47:41 +03:00
Vitaly Baranov
3a3cbeb7aa Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
Kostiantyn Storozhuk
a9fad56b7a Flaky test fixed 2021-06-29 18:07:18 +08:00
alesapin
cdc95fa98a
Merge pull request #25428 from ClickHouse/zookeeper_snapshots 
Tool for conversion of ZooKeeper data into clickhouse-keeper snapshot
 2021-06-29 12:58:45 +03:00
alesapin
44f1a96ad6 Better test_version_update_after_mutation 2021-06-29 12:49:40 +03:00
Kostiantyn Storozhuk
a9510f25f9 Style fix 2021-06-29 15:22:08 +08:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge 
Merging #23934
 2021-06-29 04:19:53 +03:00
Kseniia Sumarokova
d9c46003cb
Merge pull request #25781 from sand6255/MaterializeMySQL-Engine-column-comments-improvement 
MaterializeMySQL: Improved column comments support
 2021-06-28 21:57:24 +03:00
Kseniia Sumarokova
9d02af7d8b
Merge pull request #25676 from sand6255/MaterializeMySQL-Support-Enum-Data-Type 
MaterializeMySQL: support ENUM data type
 2021-06-28 19:15:00 +03:00
Kostiantyn Storozhuk
c2c78929cb Implemented MySQL column comments support 2021-06-28 22:44:38 +08:00
alesapin
f90cfae368
Merge pull request #25619 from vitlibar/new-tests-for-select-privilege 
Add tests for checking access rights for SELECT.
 2021-06-28 17:23:16 +03:00
mergify[bot]
04814114e7
Merge branch 'master' into zookeeper_snapshots 2021-06-28 14:17:32 +00:00
alexey-milovidov
05f4bb45a5
Merge pull request #25756 from kssenii/rabbit-test 
Try fix flacky rabbitmq test
 2021-06-28 14:27:07 +03:00
alesapin
b11254d191
Merge branch 'master' into fix_aggregation_ttl 2021-06-28 13:31:29 +03:00
alesapin
7e73762b48 Fix flaky test and wrong message 2021-06-28 11:28:45 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
kssenii
aa7133c239 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-27 20:08:00 +00:00
kssenii
c115c25e9c Some change 2021-06-27 22:52:24 +03:00
kssenii
c3a2fc0584 Review fixes 2021-06-27 19:17:17 +00:00
alexey-milovidov
fb89505656
Merge pull request #25538 from kssenii/pg-dix 
Fix postrges array conversion
 2021-06-27 19:35:24 +03:00
alexey-milovidov
0a26687115
Merge pull request #23864 from azat/dist-split-batch-and-retry 
Add ability to split distributed batch on failures (i.e. due to memory limits)
 2021-06-27 19:28:26 +03:00
kssenii
db998c3f6c More robust 2021-06-27 16:28:10 +00:00
alesapin
c977c33d6d Fix bug in execution of TTL GROUP BY 2021-06-27 19:18:15 +03:00
kssenii
159de92197 Uncomment test 2021-06-26 22:05:20 +00:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
alexey-milovidov
420839a4c0
Merge pull request #25697 from sundy-li/mysql-fix 
[mysql] fix mysql select user() return empty
 2021-06-26 03:31:46 +03:00
Kostiantyn Storozhuk
ca04b077ef Improved column comments support 2021-06-25 22:30:11 +08:00
Anton Popov
4a250dc14e
Merge pull request #25371 from CurtizJ/add-compatibility-setting 
Add compatibility setting for name of tuple literals
 2021-06-25 15:08:13 +03:00
Storozhuk Kostiantyn
4a3145f586 Materialize my sql support enum data type 
* Implemented Enum for MaterializeMySQL
 2021-06-25 16:42:25 +08:00
sundy-li
d423d07a87 [mysql] fix mysql select user() return empty 2021-06-25 10:20:22 +08:00
Anton Popov
a15ee72d0f Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-23 13:53:01 +03:00
Vitaly Baranov
c6d877d10b Add tests for checking access rights for SELECT. 2021-06-23 12:54:50 +03:00
Azat Khuzhin
353a770a87 Extend test_insert_distributed_async_send for distributed_directory_monitor_split_batch_on_failure 2021-06-23 02:48:47 +03:00
Azat Khuzhin
a0209178cc Add ability to split distributed batch on failures 
Add distributed_directory_monitor_split_batch_on_failure setting (OFF by
default), that will split the batch and send files one by one in case of
retriable errors.

v2: more error codes
 2021-06-23 02:48:47 +03:00
Azat Khuzhin
e148ef739d Drop replicas from dirname for internal_replication=true 
Under use_compact_format_in_distributed_parts_names=1 and
internal_replication=true the server encodes all replicas for the
directory name for async INSERT into Distributed, and the directory name
looks like:

    shard1_replica1,shard1_replica2,shard3_replica3

This is required for creating connections (to specific replicas only),
but in case of internal_replication=true, this can be avoided, since
this path will always includes all replicas.

This patch replaces all replicas with "_all_replicas" marker.

Note, that initial problem was that this path may overflow the NAME_MAX
if you will have more then 15 replicas, and the server will fail to
create the directory.

Also note, that changed directory name should not be a problem, since:
- empty directories will be removed since #16729
- and replicas encoded in the directory name is also supported anyway.
 2021-06-23 02:47:38 +03:00
alesapin
788e61f80e Snapshots test 2021-06-22 14:43:26 +03:00
alesapin
6b815b4f17 Merge branch 'master' into zookeeper_snapshots 2021-06-22 13:50:27 +03:00
alesapin
bf0a4864ac Add support for set/get ACL commands 2021-06-22 13:49:35 +03:00
alesapin
730554589f fix superdigest 2021-06-22 11:14:54 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests 
Fix some bugs in integration tests
 2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6 
More integration tests improvements
 2021-06-22 10:19:22 +03:00
Kseniia Sumarokova
155bb03239
Merge branch 'master' into pg-dix 2021-06-22 10:14:52 +03:00
alesapin
70f7959de2 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 23:02:42 +03:00
alesapin
8bbe65b4f4 Remove timeouts 2021-06-21 23:02:00 +03:00
alesapin
a356a9ca3d Merge branch 'fix_some_tests' into zookeeper_snapshots 2021-06-21 23:00:07 +03:00
Kseniia Sumarokova
41c65a9965
Merge pull request #25528 from kssenii/something 
Fix convertion of datetime with timezone for mysql, odbc, etc..
 2021-06-21 22:55:22 +03:00
alesapin
c9c22996d4 One more fixed test 2021-06-21 22:52:44 +03:00
Kseniia Sumarokova
f47dd116c4
Update test.py 2021-06-21 19:07:17 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
alesapin
731edc9a6d Fixes in ACLs 2021-06-21 18:45:45 +03:00
kssenii
ac0f86cdbf Truncate for s3 2021-06-21 15:44:36 +00:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
kssenii
4688f9e038 hdfs truncate table 2021-06-21 13:59:57 +00:00
alesapin
76cee4e3cf Debugging 2021-06-21 16:58:39 +03:00
kssenii
0f9fc33a4e Fix postgres arrays 2021-06-21 11:27:10 +00:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
Anton Popov
c2754c34f4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-21 12:42:48 +03:00
kssenii
c0732ddc12 Fix datetime with timezone 2021-06-21 08:22:12 +00:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option" 
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
 2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option 
Add run-id option to integration tests
 2021-06-21 10:21:24 +03:00
Nikolay Degterinsky
8cb25c5757 Fixed lemmatize integration test 2021-06-20 11:28:35 +00:00
Mike Kot
4c391f8e99
SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652) 
* initial commit: add setting and stub

* typo

* added test stub

* fix

* wip merging new integration test and code proto

* adding steps interpreters

* adding firstly proposed solution (moving parts etc)

* added checking zookeeper path existence

* fixing the include

* fixing and sorting includes

* fixing outdated struct

* fix the name

* added ast ptr as level of indirection

* fix ref

* updating the changes

* working on test stub

* fix iterator -> reference

* revert rocksdb submodule update

* fixed show privileges test

* updated the test stub

* replaced rand() with thread_local_rng(), updated the tests

updated the test

fixed test config path

test fix

removed error messages

fixed the test

updated the test

fixed string literal

fixed literal

typo: =

* fixed the empty replica error message

* updated the test and the code with logs

* updated the possible test cases, updated

* added the code/test milestone comments

* updated the test (added more testcases)

* replaced native assert with CH one

* individual replicas recursive delete fix

* updated the AS db.name AST

* two small logging fixes

* manually generated AST fixes

* Updated the test, added the possible algo change

* Some thoughts about optimizing the solution:

ALTER MOVE PARTITION .. TO TABLE -> move to detached/ + ALTER ... ATTACH

* fix

* Removed the replica sync in test as it's invalid

* Some test tweaks

* tmp

* Rewrote the algo by using the executeQuery instead of

hand-crafting the ASTPtr.

Two questions still active.

* tr: logging active parts

* Extracted the parts moving algo into a separate helper function

* Fixed the test data and the queries slightly

* Replaced query to system.parts to direct invocation,

started building the test that breaks on various parts.

* Added the case for tables when at least one replica is alive

* Updated the test to test replicas restoration by detaching/attaching

* Altered the test to check restoration without replica restart

* Added the tables swap in the start if the server failed last time

* Hotfix when only /replicas/replica... path was deleted

* Restore ZK paths while creating a replicated MergeTree table

* Updated the docs, fixed the algo for individual replicas restoration case

* Initial parts table storage fix, tests sync fix

* Reverted individual replica restoration to general algo

* Slightly optimised getDataParts

* Trying another solution with parts detaching

* Rewrote algo without any steps, added ON CLUSTER support

* Attaching parts from other replica on restoration

* Getting part checksums from ZK

* Removed ON CLUSTER, finished working solution

* Multiple small changes after review

* Fixing parallel test

* Supporting rewritten form on cluster

* Test fix

* Moar logging

* Using source replica as checksum provider

* improve test, remove some code from parser

* Trying solution with move to detached + forget

* Moving all parts (not only Committed) to detached

* Edited docs for RESTORE REPLICA

* Re-merging

* minor fixes

Co-authored-by: Alexander Tokmakov <avtokmakov@yandex-team.ru>
 2021-06-20 11:24:43 +03:00
Nikolay Degterinsky
b1c15d9014 Fixed integration test 2021-06-19 20:27:26 +00:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
alesapin
b5dae909dd Add some tests 2021-06-18 21:36:19 +03:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
f0490ad7c1 Better formatting 2021-06-18 12:24:04 +03:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
alesapin
9e77ca7182
Merge branch 'master' into nlp 2021-06-17 21:47:41 +03:00
alexey-milovidov
66c0df99d4
Merge pull request #25323 from ClickHouse/try-to-change-signal-for-integration-rests 
Use signal 15 in restart_with_latest_version
 2021-06-17 20:56:00 +03:00
mergify[bot]
04adc58ba1
Merge branch 'master' into try-to-change-signal-for-integration-rests 2021-06-17 06:20:40 +00:00
mergify[bot]
41d007a1b3
Merge branch 'master' into MySQL-column-comments-support 2021-06-17 05:40:15 +00:00
alexey-milovidov
34891f5954
Merge pull request #25317 from ClickHouse/try-fix-ttl-repl 
Update test_ttl_replicated
 2021-06-17 01:46:13 +03:00
Kseniia Sumarokova
60d220bd14
Merge pull request #24413 from kssenii/postgres-fixes-schema 
postgres non-default schema for insert query
 2021-06-16 22:18:23 +03:00
Anton Popov
ea9b890618
Merge branch 'master' into add-compatibility-setting 2021-06-16 21:10:56 +03:00
Anton Popov
8bd7cbd925 add compatibility setting for name of columns 2021-06-16 21:10:07 +03:00
Yatsishin Ilya
1d6253b9dc hardening 2021-06-16 18:37:51 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
Nikolai Kochetov
7c3926ac57 Update test_ttl_replicated 2021-06-16 12:55:48 +03:00
Nikolai Kochetov
8bf55ae2b5
Merge pull request #25166 from ClickHouse/always-detach-parts-with-wrong-partition-id 
Always detach parts with wrong partition ID
 2021-06-16 11:06:07 +03:00
Kostiantyn Storozhuk
d96478c9ff Integration test added and small fixes 2021-06-15 21:45:30 +08:00
Nikolai Kochetov
b65c121a45
Update test_detach_part_wrong_partition_id.py 2021-06-15 13:38:11 +03:00
alexey-milovidov
77721734ed
Merge pull request #21267 from filimonov/kafka-failover 
Kafka failover issue fix
 2021-06-14 01:42:42 +03:00
alexey-milovidov
7c048a9dc8
Merge pull request #23976 from excitoon-favorites/s3unstablereads 
Improved `test_storage_s3_get_unstable`
 2021-06-12 04:04:29 +03:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries 
Remove explicit enable_dictionaries files in integration tests
 2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit 
Add integration test for jdbc bridge
 2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00
Yatsishin Ilya
fe712caa5c typo 2021-06-11 13:50:44 +03:00
Yatsishin Ilya
d7fca4a6f2 wait hdfs longer 2021-06-11 12:30:09 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
Yatsishin Ilya
fa0551a1a3 fix test_partition 2021-06-11 11:39:28 +03:00
alesapin
54f9db670f
Merge pull request #25079 from ClickHouse/debug_network_interfaces 
Trying to debug fetches bandwith test failures
 2021-06-11 10:30:14 +03:00
mergify[bot]
4eb2b33127
Merge branch 'master' into filter_tests_in_ci_runner 2021-06-10 16:15:43 +00:00
Nikolai Kochetov
3bfefa50e2 Add user arg to exec_in_container with cli 2021-06-10 15:15:07 +03:00
Nikolai Kochetov
2936fdd16c Always detach parts with wrong partition id. 2021-06-10 15:04:36 +03:00
Vladimir Chebotarev
f16dd06476 Review fixes. 2021-06-10 08:49:26 +03:00
Vladimir Chebotarev
591c556321 Improved test_storage_s3_get_unstable. 2021-06-10 08:49:26 +03:00
alexey-milovidov
77ab26e217
Merge branch 'master' into less_timeouts 2021-06-10 02:03:16 +03:00