thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-17 21:24:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
72,639 Commits 9,139 Branches 1,774 Tags 2.1 GiB
510540c7d7
Commit Graph

2874 Commits

Author SHA1 Message Date
vdimir
f61ecee989
Remove tests/integration/test_foo 2021-07-22 13:33:43 +03:00
vdimir
d1b6274deb
Strip lines in runner output in _get_all_tests 2021-07-22 13:33:05 +03:00
vdimir
a8f986350c
Log errors on integration test listing error in ci-runner 2021-07-22 12:31:15 +03:00
Nikolai Kochetov
5ffd99dfd4
Merge pull request #25674 from amosbird/distributedreturnconnection 
Drain connection asynchronously
 2021-07-22 11:04:49 +03:00
vdimir
1d0ceff2dc
Fix mysql_kill_sync_thread_restore_test 2021-07-21 18:17:45 +03:00
ANDREI STAROVEROV
c3461ce99a Fix integration tests 2021-07-21 16:04:52 +03:00
ANDREI STAROVEROV
1c99253c6a Fix integration tests 2021-07-21 14:10:37 +03:00
ANDREI STAROVEROV
503d62cce1 Fix integration tests 2021-07-21 12:41:17 +03:00
Realist007
31e26862b5
Merge branch 'master' into feature/create-simple-lambda-function 2021-07-21 10:33:53 +03:00
ANDREI STAROVEROV
31f4fe9a4d Fix tests 2021-07-21 10:29:26 +03:00
ANDREI STAROVEROV
44e1c2bcf5 Fix test for check access rights for functions 2021-07-20 23:42:48 +03:00
ANDREI STAROVEROV
f4e2e552eb Add integration test for persistence 2021-07-20 23:42:23 +03:00
alexey-milovidov
3bcef76a9d
Merge pull request #26529 from kssenii/fixing-rabbitmq 
Fix rabbitmq shutdown in case rabbitmq setup was not started
 2021-07-20 16:41:25 +03:00
Nikita Mikhaylov
47c1bb3416
Merge pull request #25822 from ClickHouse/fix_no_column_materialized_mysql 
Fix 'Not found column' error in MaterializeMySQL
 2021-07-20 15:03:54 +03:00
ANDREI STAROVEROV
6ce203504b Add access rights 2021-07-20 02:34:04 +03:00
kssenii
63c05e6e14 Fix rabbitmq shutdown in case rabbitmq setup was not started 2021-07-19 21:06:10 +00:00
Amos Bird
dbfb699690
Asynchronously drain connections. 2021-07-19 21:53:29 +08:00
mergify[bot]
39f71f4a08
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-19 12:27:38 +00:00
Yatsishin Ilya
cdc8f2f743 fix new test 2021-07-19 11:32:20 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode 
Set encryption algorithm explicitly.
 2021-07-19 09:38:02 +03:00
Vitaly Baranov
81ea8521b1 Set encryption algorithm explicitly. 2021-07-18 10:29:42 +03:00
alexey-milovidov
7dda0da027
Merge pull request #26461 from azat/integration-tests-fixes-v21.9.1.7477 
Fix flaky test_replicated_mutations (due to lack of threads in pool)
 2021-07-17 19:22:30 +03:00
Azat Khuzhin
bb22615fad Fix flaky test_replicated_mutations (number_of_free_entries_in_pool_to_execute_mutation=0) 
CI reports [1]:

    2021.07.16 09:09:21.040944 [ 172 ] {} <Debug> DiskLocal: Reserving 1.00 MiB on disk `default`, having unreserved 18.00 GiB.
    ...
    2021.07.16 09:09:21.041200 [ 28 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000288 of type MUTATE_PART for part 200201_3_3_0_16 because source parts size (217.00 B) is greater than the current maximum (0.00 B).
    2021.07.16 09:09:21.041529 [ 171 ] {} <Debug> DiskLocal: Reserving 1.00 MiB on disk `default`, having unreserved 18.00 GiB.
    2021.07.16 09:09:21.041838 [ 34 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000288 of type MUTATE_PART for part 200201_3_3_0_16 because source parts size (217.00 B) is greater than the current maximum (0.00 B).
    2021.07.16 09:09:21.042359 [ 34 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000290 of type MUTATE_PART for part 200201_12_12_0_16 because source parts size (237.00 B) is greater than the current maximum (0.00 B).

  [1]: https://clickhouse-test-reports.s3.yandex.net/26336/a3653bd665bd59c7c05b0fcd58ea2246e0b69915/integration_tests_(thread).html#fail1
 2021-07-17 11:50:04 +03:00
mergify[bot]
89634ae224
Merge branch 'master' into estimates_for_select_query 2021-07-16 23:15:30 +00:00
alexey-milovidov
38dfe1fc0a
Merge pull request #26172 from ClickHouse/exception_id 
Add error id to exceptions
 2021-07-17 02:07:17 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements 
Add comments for encrypted disks; some improvements in code.
 2021-07-16 21:24:51 +03:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Yatsishin Ilya
e6b724ad3f postgres rework 2021-07-16 16:26:35 +03:00
alexey-milovidov
72ed5e0dfb
Merge pull request #26031 from nvartolomei/nv/test-cte-distributed 
Test CTE with aggregation over distributed table
 2021-07-16 12:24:29 +03:00
Vitaly Baranov
9cc258327e Add comments for encrypted disks; some improvements in code. 2021-07-16 12:04:25 +03:00
Vitaly Baranov
427813071d
Merge pull request #26363 from vitlibar/fix-crash-login-as-dropped-user 
Fix possible crash when login as dropped user
 2021-07-16 09:47:35 +03:00
Yatsishin Ilya
aa698f6c98 better 2021-07-15 15:49:52 +03:00
Yatsishin Ilya
be9a0a9ca2 better test_storage_s3, test_storage_s3_get_unstable still not OK 2021-07-15 15:49:25 +03:00
Yatsishin Ilya
51fcaa906c add sync for on cluster ddl 2021-07-15 15:48:09 +03:00
Vitaly Baranov
c2bb0a02a8 Add test. 2021-07-15 14:36:56 +03:00
Alexey Milovidov
d984fc4301 Fix flaky integration test 2021-07-15 13:35:37 +03:00
vdimir
dd3e1a8a4d
Adjust exception message in test_replicated_fetches_timeouts 2021-07-15 11:58:21 +03:00
alexey-milovidov
21f2b006cd
Update test_cte_distributed.py 2021-07-15 08:17:22 +03:00
Kseniia Sumarokova
e42a26a585
Merge pull request #26234 from jasine/master 
convert timestamp and  timestamptz data types to DateTime64 in postgres engine
 2021-07-14 23:42:51 +03:00
Peng Jian
eed01abf65 fix test case 2021-07-14 20:42:02 +08:00
vdimir
55d12a497c
Adjust integration test to exception messages 2021-07-14 14:50:27 +03:00
Zhichang Yu
fe5d17680e Merge remote-tracking branch 'origin/master' into zero_copy_hdfs 2021-07-14 02:12:28 +00:00
jasine
bd59ca22df
fix: style and MaterializedPostgreSQL test (#3) 
fix: style and MaterializedPostgreSQL test (#3)
 2021-07-14 08:51:14 +08:00
alexey-milovidov
c01497a80a
Merge pull request #26028 from nvartolomei/nv/aggregate-alias-column 
Add test case for aggregation w/ alias columns
 2021-07-14 03:30:14 +03:00
mergify[bot]
d5898ecba6
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-13 14:03:05 +00:00
alexey-milovidov
2dafd9d4a8
Update test_select_aggregate_alias_column.py 2021-07-13 11:39:15 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1 2021-07-13 11:28:41 +03:00
jasine
9832c48c33
fix postgres test and array of DateTime64 (#1) 
fix postgres test and array of DateTime64
 2021-07-13 15:28:15 +08:00
Zhichang Yu
a9028dbd7d try fix test_replicated_merge_tree_hdfs_zero_copy/test.py failures under tsan 2021-07-13 07:20:23 +00:00
Zhichang Yu
b4e6689bf9 fix test_hdfs_zero_copy_replication_move[tiered_copy-2] 2021-07-13 07:20:23 +00:00
Zhichang Yu
5047c758f4 fix per review 2021-07-13 07:20:20 +00:00
Zhichang Yu
fbd5eee8a1 hdfs zero copy 2021-07-13 07:19:12 +00:00
Anton Popov
313cd0077d
Fix output of TSV in integration tests 2021-07-12 20:23:19 +03:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
Alexey Milovidov
57b5c0e1e5 Adjust integration tests 2021-07-12 08:59:01 +03:00
alexey-milovidov
e0c095397d
Update test_select_aggregate_alias_column.py 2021-07-12 00:36:27 +03:00
Alexey Milovidov
9c0097cd9b Review fixes 2021-07-11 02:14:03 +03:00
Alexey Milovidov
78cde85ea8 Merge branch 'master' into estimates_for_select_query 2021-07-11 02:11:16 +03:00
alexey-milovidov
7a1a184c48
Merge pull request #24404 from nvartolomei/nv/config-in-place-include 
Support for multiple includes in XML based configuration
 2021-07-10 10:10:18 +03:00
Peng Jian
24f0c738df test case 2021-07-09 22:26:08 +08:00
Nikita Mikhaylov
334d5439c8 done 2021-07-08 20:29:25 +00:00
Maksim Kita
42e1844135
Merge pull request #26023 from vitlibar/replace-print-with-logging-in-integration-tests 
Replace print() with logging.debug() in integration tests.
 2021-07-07 21:00:15 +03:00
alesapin
aa86fac4e7 Fix unbundled build 2021-07-07 14:07:20 +03:00
alesapin
f0fc12d0dd Merge branch 'master' into evillique-nlp 2021-07-07 12:14:49 +03:00
alesapin
4c85dae572
Merge pull request #25743 from ClickHouse/fix_aggregation_ttl 
Fix bug in execution of TTL GROUP BY
 2021-07-07 10:49:16 +03:00
Vitaly Baranov
b0a3a7180f Replace print() with logging.debug() in integration tests 2021-07-07 10:35:11 +03:00
Kseniia Sumarokova
7a7b774ba3
Merge pull request #25550 from kssenii/truncate 
Allow truncate in storages s3/hdfs
 2021-07-06 22:07:53 +03:00
Nicolae Vartolomei
3b5c41fc6d Test CTE with aggregation over distributed table 2021-07-06 14:04:49 +01:00
Nicolae Vartolomei
a5c195fefd Add test case for aggregation w/ alias columns 2021-07-06 13:26:58 +01:00
Vitaly Baranov
e7b1e9a2fb
Merge pull request #25986 from vitlibar/fix-flaky-test_dictionaries_all_layouts_separate_sources-test_https 
Fix parallel execution of integration tests
 2021-07-06 09:22:06 +03:00
Vitaly Baranov
cdcc735d83
Merge pull request #25899 from vitlibar/improve-logging-in-integration-tests 
Improve logging in integration tests.
 2021-07-06 08:22:21 +03:00
Vitaly Baranov
87f59ba670 Fix parallel execution of integration tests. 2021-07-05 23:50:04 +03:00
Alexander Tokmakov
0f377fc4d8 Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-05 22:07:56 +03:00
Kseniia Sumarokova
8b075e34e7
Merge pull request #25984 from kssenii/add-drops-in-tests 
Correct test
 2021-07-05 18:35:53 +03:00
Kseniia Sumarokova
c72a1be0be
Merge pull request #25064 from ucasfl/merge 
Database argument for StorageMerge support regular expression.
 2021-07-05 14:14:44 +03:00
Vitaly Baranov
72d751dc32 Add process id to pytest logs. 2021-07-05 11:25:58 +03:00
kssenii
c713ebe9c1 Add drops in tests 2021-07-05 11:20:58 +03:00
feng lv
b293f701b7 fix test 2021-07-05 03:34:19 +00:00
kssenii
32b7d7b750 More correct startup on create query 2021-07-04 19:53:05 +00:00
mergify[bot]
27d6a69f6a
Merge branch 'master' into truncate 2021-07-04 19:37:13 +00:00
Vitaly Baranov
618a77fafa Improve logging in integration tests. 2021-07-04 22:24:54 +03:00
Kseniia Sumarokova
8351f1db99
Merge pull request #20470 from kssenii/pg-ch-replica 
MaterializePostgreSQL table engine and database engine
 2021-07-04 19:34:54 +03:00
kssenii
b39888f199 Do not allow inconsistency in publication 2021-07-04 08:54:41 +00:00
mergify[bot]
9da1c98998
Merge branch 'master' into fix_aggregation_ttl 2021-07-03 15:07:44 +00:00
mergify[bot]
a2183dff39
Merge branch 'master' into better_remove_empty_parts 2021-07-03 15:01:11 +00:00
kssenii
a0623ddb08 Correct test 2021-07-03 13:35:11 +00:00
kssenii
0ce4c565d1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-07-03 11:48:15 +00:00
Ilya Yatsishin
523155a020
Merge pull request #25908 from arenadata/ADQM-320 2021-07-02 13:25:22 +03:00
Ilya Golshtein
63c71a7b4b kerberized HDFS test fix if run in parallel 2021-07-02 02:12:31 +03:00
alexey-milovidov
919cc10a3c
Merge pull request #25823 from azat/integration-tests-fixes 
tests/integration: use iptables --wait
 2021-07-02 00:58:33 +03:00
mergify[bot]
98fa9f7951
Merge branch 'master' into better_remove_empty_parts 2021-07-01 11:32:43 +00:00
kssenii
4ad0f45f0e Some more tests 2021-07-01 08:35:28 +00:00
kssenii
f01c8edbff Fix access to tables after restart 2021-07-01 07:33:58 +00:00
Kseniia Sumarokova
360f772762
Merge pull request #25795 from sand6255/MySQL-column-comments-support 
MySQL Engine column comments support
 2021-06-30 20:18:47 +03:00
Kseniia Sumarokova
ed687f45a1
Merge branch 'master' into truncate 2021-06-30 20:08:42 +03:00
Vitaly Baranov
27bc0caf53
Merge pull request #25861 from vitlibar/correct-messages-in-integration-tests 
Correct messages in integration tests.
 2021-06-30 14:45:02 +03:00
Vitaly Baranov
92ace627d2 Correct messages in integration tests. 2021-06-30 14:16:37 +03:00
alesapin
19aeb14dfd Small tuning in test 2021-06-30 12:39:09 +03:00
alesapin
b33391f4ec
Merge pull request #25816 from vitlibar/collect-stderr-in-integration-tests 
Collect stderr.log and stdout.log in all integration tests by default.
 2021-06-30 12:16:49 +03:00
mergify[bot]
1799804243
Merge branch 'master' into fix_aggregation_ttl 2021-06-30 09:15:46 +00:00
mergify[bot]
8182b6e890
Merge branch 'master' into better_remove_empty_parts 2021-06-30 08:42:26 +00:00
Kseniia Sumarokova
2f38b25ba6
Merge pull request #25834 from kssenii/fix-test 
Fix odbc test
 2021-06-30 10:29:42 +03:00
Storozhuk Kostiantyn
a279cf721d
Update test.py 2021-06-30 10:03:03 +03:00
kssenii
da70f85d4e More tests 2021-06-29 23:11:46 +00:00
kssenii
9d5847a1a8 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-29 21:30:31 +00:00
kssenii
a8067fb3dd Update test 2021-06-29 20:29:21 +00:00
alexey-milovidov
3b5468d4a4
Merge pull request #25810 from ClickHouse/fix_version_update 
Better test_version_update_after_mutation
 2021-06-29 23:11:57 +03:00
alesapin
a6834213a1 Add tests 2021-06-29 22:47:54 +03:00
Azat Khuzhin
283ec54cbe tests/integration: use iptables --wait 
Since integration tests runs in parallel, this should fix:

  test_keeper_persistent_log_multinode/test.py::test_restart_multinode Another app is currently holding the xtables lock. Perhaps you want to use the -w option?

And similar errors.
 2021-06-29 21:07:39 +03:00
Alexander Tokmakov
fd914f3d97 fix 'Not found column' error in MaterializeMySQL 2021-06-29 20:47:41 +03:00
Vitaly Baranov
3a3cbeb7aa Collect stderr.log and stdout.log in all integration tests by default. 2021-06-29 17:30:47 +03:00
Kostiantyn Storozhuk
a9fad56b7a Flaky test fixed 2021-06-29 18:07:18 +08:00
alesapin
cdc95fa98a
Merge pull request #25428 from ClickHouse/zookeeper_snapshots 
Tool for conversion of ZooKeeper data into clickhouse-keeper snapshot
 2021-06-29 12:58:45 +03:00
alesapin
44f1a96ad6 Better test_version_update_after_mutation 2021-06-29 12:49:40 +03:00
Kostiantyn Storozhuk
a9510f25f9 Style fix 2021-06-29 15:22:08 +08:00
alexey-milovidov
878a159538
Merge pull request #25773 from ClickHouse/system-query-log-map-type-merge 
Merging #23934
 2021-06-29 04:19:53 +03:00
Kseniia Sumarokova
d9c46003cb
Merge pull request #25781 from sand6255/MaterializeMySQL-Engine-column-comments-improvement 
MaterializeMySQL: Improved column comments support
 2021-06-28 21:57:24 +03:00
Kseniia Sumarokova
9d02af7d8b
Merge pull request #25676 from sand6255/MaterializeMySQL-Support-Enum-Data-Type 
MaterializeMySQL: support ENUM data type
 2021-06-28 19:15:00 +03:00
Kostiantyn Storozhuk
c2c78929cb Implemented MySQL column comments support 2021-06-28 22:44:38 +08:00
alesapin
f90cfae368
Merge pull request #25619 from vitlibar/new-tests-for-select-privilege 
Add tests for checking access rights for SELECT.
 2021-06-28 17:23:16 +03:00
mergify[bot]
04814114e7
Merge branch 'master' into zookeeper_snapshots 2021-06-28 14:17:32 +00:00
alexey-milovidov
05f4bb45a5
Merge pull request #25756 from kssenii/rabbit-test 
Try fix flacky rabbitmq test
 2021-06-28 14:27:07 +03:00
alesapin
b11254d191
Merge branch 'master' into fix_aggregation_ttl 2021-06-28 13:31:29 +03:00
alesapin
7e73762b48 Fix flaky test and wrong message 2021-06-28 11:28:45 +03:00
Maksim Kita
294b937a39
Merge branch 'system-query-log-map-type-merge' into system-querylog-map-continue 2021-06-28 11:27:59 +03:00
kssenii
aa7133c239 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-27 20:08:00 +00:00
kssenii
c115c25e9c Some change 2021-06-27 22:52:24 +03:00
kssenii
c3a2fc0584 Review fixes 2021-06-27 19:17:17 +00:00
alexey-milovidov
fb89505656
Merge pull request #25538 from kssenii/pg-dix 
Fix postrges array conversion
 2021-06-27 19:35:24 +03:00
alexey-milovidov
0a26687115
Merge pull request #23864 from azat/dist-split-batch-and-retry 
Add ability to split distributed batch on failures (i.e. due to memory limits)
 2021-06-27 19:28:26 +03:00
kssenii
db998c3f6c More robust 2021-06-27 16:28:10 +00:00
alesapin
c977c33d6d Fix bug in execution of TTL GROUP BY 2021-06-27 19:18:15 +03:00
kssenii
159de92197 Uncomment test 2021-06-26 22:05:20 +00:00
kssenii
3d90f0710c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-26 22:04:47 +00:00
alexey-milovidov
420839a4c0
Merge pull request #25697 from sundy-li/mysql-fix 
[mysql] fix mysql select user() return empty
 2021-06-26 03:31:46 +03:00
Kostiantyn Storozhuk
ca04b077ef Improved column comments support 2021-06-25 22:30:11 +08:00
Anton Popov
4a250dc14e
Merge pull request #25371 from CurtizJ/add-compatibility-setting 
Add compatibility setting for name of tuple literals
 2021-06-25 15:08:13 +03:00
Storozhuk Kostiantyn
4a3145f586 Materialize my sql support enum data type 
* Implemented Enum for MaterializeMySQL
 2021-06-25 16:42:25 +08:00
sundy-li
d423d07a87 [mysql] fix mysql select user() return empty 2021-06-25 10:20:22 +08:00
Anton Popov
a15ee72d0f Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-23 13:53:01 +03:00
Vitaly Baranov
c6d877d10b Add tests for checking access rights for SELECT. 2021-06-23 12:54:50 +03:00
Azat Khuzhin
353a770a87 Extend test_insert_distributed_async_send for distributed_directory_monitor_split_batch_on_failure 2021-06-23 02:48:47 +03:00
Azat Khuzhin
a0209178cc Add ability to split distributed batch on failures 
Add distributed_directory_monitor_split_batch_on_failure setting (OFF by
default), that will split the batch and send files one by one in case of
retriable errors.

v2: more error codes
 2021-06-23 02:48:47 +03:00
Azat Khuzhin
e148ef739d Drop replicas from dirname for internal_replication=true 
Under use_compact_format_in_distributed_parts_names=1 and
internal_replication=true the server encodes all replicas for the
directory name for async INSERT into Distributed, and the directory name
looks like:

    shard1_replica1,shard1_replica2,shard3_replica3

This is required for creating connections (to specific replicas only),
but in case of internal_replication=true, this can be avoided, since
this path will always includes all replicas.

This patch replaces all replicas with "_all_replicas" marker.

Note, that initial problem was that this path may overflow the NAME_MAX
if you will have more then 15 replicas, and the server will fail to
create the directory.

Also note, that changed directory name should not be a problem, since:
- empty directories will be removed since #16729
- and replicas encoded in the directory name is also supported anyway.
 2021-06-23 02:47:38 +03:00
alesapin
788e61f80e Snapshots test 2021-06-22 14:43:26 +03:00
alesapin
6b815b4f17 Merge branch 'master' into zookeeper_snapshots 2021-06-22 13:50:27 +03:00
alesapin
bf0a4864ac Add support for set/get ACL commands 2021-06-22 13:49:35 +03:00
alesapin
730554589f fix superdigest 2021-06-22 11:14:54 +03:00
alesapin
66b7df1d03
Merge pull request #25525 from ClickHouse/fix_some_tests 
Fix some bugs in integration tests
 2021-06-22 10:52:07 +03:00
Ilya Yatsishin
d6bdde54d9
Merge pull request #25212 from qoega/integration-6 
More integration tests improvements
 2021-06-22 10:19:22 +03:00
Kseniia Sumarokova
155bb03239
Merge branch 'master' into pg-dix 2021-06-22 10:14:52 +03:00
alesapin
70f7959de2 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 23:02:42 +03:00
alesapin
8bbe65b4f4 Remove timeouts 2021-06-21 23:02:00 +03:00
alesapin
a356a9ca3d Merge branch 'fix_some_tests' into zookeeper_snapshots 2021-06-21 23:00:07 +03:00
Kseniia Sumarokova
41c65a9965
Merge pull request #25528 from kssenii/something 
Fix convertion of datetime with timezone for mysql, odbc, etc..
 2021-06-21 22:55:22 +03:00
alesapin
c9c22996d4 One more fixed test 2021-06-21 22:52:44 +03:00
Kseniia Sumarokova
f47dd116c4
Update test.py 2021-06-21 19:07:17 +03:00
alesapin
426710f8e3 Followup fix 2021-06-21 18:53:47 +03:00
alesapin
731edc9a6d Fixes in ACLs 2021-06-21 18:45:45 +03:00
kssenii
ac0f86cdbf Truncate for s3 2021-06-21 15:44:36 +00:00
Yatsishin Ilya
e04957ce82 more 2021-06-21 18:42:40 +03:00
kssenii
4688f9e038 hdfs truncate table 2021-06-21 13:59:57 +00:00
alesapin
76cee4e3cf Debugging 2021-06-21 16:58:39 +03:00
kssenii
0f9fc33a4e Fix postgres arrays 2021-06-21 11:27:10 +00:00
alesapin
743600a359 Merge branch 'update_buffer_size_in_nuraft' into zookeeper_snapshots 2021-06-21 13:46:22 +03:00
alesapin
8cf5f8e748 Followup fix 2021-06-21 13:30:39 +03:00
Anton Popov
c2754c34f4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-21 12:42:48 +03:00
kssenii
c0732ddc12 Fix datetime with timezone 2021-06-21 08:22:12 +00:00
alesapin
a63da94ae4 Revert "Merge pull request #25526 from ClickHouse/revert-25459-add_run_id_option" 
This reverts commit 7c7e96f26c, reversing
changes made to a54cbef5b7.
 2021-06-21 11:14:26 +03:00
alesapin
da0a3997f4 Merge branch 'master' into fix_some_tests 2021-06-21 11:14:22 +03:00
alesapin
feecf398fb
Revert "Add run-id option to integration tests" 2021-06-21 11:10:44 +03:00
alesapin
c7781e24d5 Fix some flaky tests 2021-06-21 11:02:27 +03:00
alesapin
65ce3929b8
Merge pull request #25459 from ClickHouse/add_run_id_option 
Add run-id option to integration tests
 2021-06-21 10:21:24 +03:00
Nikolay Degterinsky
8cb25c5757 Fixed lemmatize integration test 2021-06-20 11:28:35 +00:00
Mike Kot
4c391f8e99
SYSTEM RESTORE REPLICA replica [ON CLUSTER cluster] (#13652) 
* initial commit: add setting and stub

* typo

* added test stub

* fix

* wip merging new integration test and code proto

* adding steps interpreters

* adding firstly proposed solution (moving parts etc)

* added checking zookeeper path existence

* fixing the include

* fixing and sorting includes

* fixing outdated struct

* fix the name

* added ast ptr as level of indirection

* fix ref

* updating the changes

* working on test stub

* fix iterator -> reference

* revert rocksdb submodule update

* fixed show privileges test

* updated the test stub

* replaced rand() with thread_local_rng(), updated the tests

updated the test

fixed test config path

test fix

removed error messages

fixed the test

updated the test

fixed string literal

fixed literal

typo: =

* fixed the empty replica error message

* updated the test and the code with logs

* updated the possible test cases, updated

* added the code/test milestone comments

* updated the test (added more testcases)

* replaced native assert with CH one

* individual replicas recursive delete fix

* updated the AS db.name AST

* two small logging fixes

* manually generated AST fixes

* Updated the test, added the possible algo change

* Some thoughts about optimizing the solution:

ALTER MOVE PARTITION .. TO TABLE -> move to detached/ + ALTER ... ATTACH

* fix

* Removed the replica sync in test as it's invalid

* Some test tweaks

* tmp

* Rewrote the algo by using the executeQuery instead of

hand-crafting the ASTPtr.

Two questions still active.

* tr: logging active parts

* Extracted the parts moving algo into a separate helper function

* Fixed the test data and the queries slightly

* Replaced query to system.parts to direct invocation,

started building the test that breaks on various parts.

* Added the case for tables when at least one replica is alive

* Updated the test to test replicas restoration by detaching/attaching

* Altered the test to check restoration without replica restart

* Added the tables swap in the start if the server failed last time

* Hotfix when only /replicas/replica... path was deleted

* Restore ZK paths while creating a replicated MergeTree table

* Updated the docs, fixed the algo for individual replicas restoration case

* Initial parts table storage fix, tests sync fix

* Reverted individual replica restoration to general algo

* Slightly optimised getDataParts

* Trying another solution with parts detaching

* Rewrote algo without any steps, added ON CLUSTER support

* Attaching parts from other replica on restoration

* Getting part checksums from ZK

* Removed ON CLUSTER, finished working solution

* Multiple small changes after review

* Fixing parallel test

* Supporting rewritten form on cluster

* Test fix

* Moar logging

* Using source replica as checksum provider

* improve test, remove some code from parser

* Trying solution with move to detached + forget

* Moving all parts (not only Committed) to detached

* Edited docs for RESTORE REPLICA

* Re-merging

* minor fixes

Co-authored-by: Alexander Tokmakov <avtokmakov@yandex-team.ru>
 2021-06-20 11:24:43 +03:00
Nikolay Degterinsky
b1c15d9014 Fixed integration test 2021-06-19 20:27:26 +00:00
kssenii
babb11a887 Some fixes 2021-06-19 19:18:13 +00:00
kssenii
2031607642 Reimplement 2021-06-19 11:52:28 +00:00
alesapin
49cd16e74f Better 2021-06-18 22:08:12 +03:00
alesapin
b5dae909dd Add some tests 2021-06-18 21:36:19 +03:00
kssenii
f33387837e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-06-18 14:27:48 +00:00
kssenii
b30cb3f7da Test 2021-06-18 14:14:29 +00:00
alesapin
5a014cb1e1 Add sometest 2021-06-18 14:02:15 +03:00
alesapin
f0490ad7c1 Better formatting 2021-06-18 12:24:04 +03:00
alesapin
8a5bc2e7bc Add run-id option to integration tests 2021-06-18 12:23:22 +03:00
Latysheva Alexandra
48d3419160
Merge branch 'master' into alexelex-encryption-1 2021-06-18 11:28:08 +06:00
alesapin
9e77ca7182
Merge branch 'master' into nlp 2021-06-17 21:47:41 +03:00
alexey-milovidov
66c0df99d4
Merge pull request #25323 from ClickHouse/try-to-change-signal-for-integration-rests 
Use signal 15 in restart_with_latest_version
 2021-06-17 20:56:00 +03:00
mergify[bot]
04adc58ba1
Merge branch 'master' into try-to-change-signal-for-integration-rests 2021-06-17 06:20:40 +00:00
mergify[bot]
41d007a1b3
Merge branch 'master' into MySQL-column-comments-support 2021-06-17 05:40:15 +00:00
alexey-milovidov
34891f5954
Merge pull request #25317 from ClickHouse/try-fix-ttl-repl 
Update test_ttl_replicated
 2021-06-17 01:46:13 +03:00
Kseniia Sumarokova
60d220bd14
Merge pull request #24413 from kssenii/postgres-fixes-schema 
postgres non-default schema for insert query
 2021-06-16 22:18:23 +03:00
Anton Popov
ea9b890618
Merge branch 'master' into add-compatibility-setting 2021-06-16 21:10:56 +03:00
Anton Popov
8bd7cbd925 add compatibility setting for name of columns 2021-06-16 21:10:07 +03:00
Yatsishin Ilya
1d6253b9dc hardening 2021-06-16 18:37:51 +03:00
Yatsishin Ilya
f4d587a17a hardening 2021-06-16 15:31:19 +03:00
Nikolai Kochetov
ca66f655c8 Use signal 15 2021-06-16 14:15:08 +03:00
Nikolai Kochetov
7c3926ac57 Update test_ttl_replicated 2021-06-16 12:55:48 +03:00
Nikolai Kochetov
8bf55ae2b5
Merge pull request #25166 from ClickHouse/always-detach-parts-with-wrong-partition-id 
Always detach parts with wrong partition ID
 2021-06-16 11:06:07 +03:00
Kostiantyn Storozhuk
d96478c9ff Integration test added and small fixes 2021-06-15 21:45:30 +08:00
Nikolai Kochetov
b65c121a45
Update test_detach_part_wrong_partition_id.py 2021-06-15 13:38:11 +03:00
kssenii
a1f11f5178 Fixes 2021-06-14 09:37:33 +00:00
alexey-milovidov
77721734ed
Merge pull request #21267 from filimonov/kafka-failover 
Kafka failover issue fix
 2021-06-14 01:42:42 +03:00
kssenii
2cfcc9980c Better 2021-06-13 19:38:31 +00:00
kssenii
603c06d02e Add test 2021-06-13 19:38:17 +00:00
alexey-milovidov
7c048a9dc8
Merge pull request #23976 from excitoon-favorites/s3unstablereads 
Improved `test_storage_s3_get_unstable`
 2021-06-12 04:04:29 +03:00
alexey-milovidov
30f0124e77
Merge branch 'master' into always-detach-parts-with-wrong-partition-id 2021-06-12 02:55:55 +03:00
alexey-milovidov
f96b512ffb
Merge pull request #24728 from qoega/remove-enable-dictionaries 
Remove explicit enable_dictionaries files in integration tests
 2021-06-12 02:45:25 +03:00
alexey-milovidov
cad5cfacf1
Merge pull request #25047 from zhicwu/jdbc-bridge-sit 
Add integration test for jdbc bridge
 2021-06-11 23:07:43 +03:00
Yatsishin Ilya
cbbeb4001b more changes 2021-06-11 15:00:40 +03:00
Yatsishin Ilya
fe712caa5c typo 2021-06-11 13:50:44 +03:00
Yatsishin Ilya
d7fca4a6f2 wait hdfs longer 2021-06-11 12:30:09 +03:00
Zhichun Wu
7f2b444d6f Add integration test for jdbc bridge 2021-06-11 17:10:51 +08:00
Yatsishin Ilya
65074edba4 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-11 11:50:56 +03:00
Yatsishin Ilya
fa0551a1a3 fix test_partition 2021-06-11 11:39:28 +03:00
alesapin
54f9db670f
Merge pull request #25079 from ClickHouse/debug_network_interfaces 
Trying to debug fetches bandwith test failures
 2021-06-11 10:30:14 +03:00
mergify[bot]
4eb2b33127
Merge branch 'master' into filter_tests_in_ci_runner 2021-06-10 16:15:43 +00:00
Nikolai Kochetov
3bfefa50e2 Add user arg to exec_in_container with cli 2021-06-10 15:15:07 +03:00
Nikolai Kochetov
2936fdd16c Always detach parts with wrong partition id. 2021-06-10 15:04:36 +03:00
Vladimir Chebotarev
f16dd06476 Review fixes. 2021-06-10 08:49:26 +03:00
Vladimir Chebotarev
591c556321 Improved test_storage_s3_get_unstable. 2021-06-10 08:49:26 +03:00
alexey-milovidov
77ab26e217
Merge branch 'master' into less_timeouts 2021-06-10 02:03:16 +03:00
filimonov
3f1d3f2e1d
Update test.py 2021-06-09 23:20:44 +02:00
Yatsishin Ilya
035df8ba28 fixed 2021-06-09 18:49:18 +03:00
Yatsishin Ilya
0c2380e4ac Merge remote-tracking branch 'qoega/better-hdfs-tests' into remove-enable-dictionaries 2021-06-09 17:08:02 +03:00
Mikhail Filimonov
3627ab7cbe
Fix kafka failover issue (#21118). 
Distringuish lack of assignment vs lack of partitions. Bit better / clearer logging.
 2021-06-09 16:02:56 +02:00
Yatsishin Ilya
dd3fd87e26 Fix kerberized hdfs and cleanup 2021-06-09 16:53:16 +03:00
alesapin
192210fea6 Consistent style 2021-06-09 16:42:20 +03:00
alesapin
46aee86d3a Fix flaky check report in CI runner 2021-06-09 16:40:28 +03:00
mergify[bot]
bc012b9c1a
Merge branch 'master' into recreate_kafka_table_case 2021-06-09 10:30:32 +00:00
filimonov
7469f054f0
Update test.py 
Missed one of the refactorings which were merged in the meanwhile 872e36c207 (diff-8129a3b04ff2293c2d89b35395be9ef49918cdafd4420a745d05733b00979646L86-R100)
 2021-06-09 12:27:42 +02:00
Yatsishin Ilya
aba39d58f9 wip 2021-06-09 12:23:02 +03:00
Yatsishin Ilya
257b9c0731 typo 2021-06-09 12:03:03 +03:00
Yatsishin Ilya
8d6b5d52ab typo 2021-06-09 11:52:20 +03:00
Yatsishin Ilya
a9108e42c3 Better test_odbc_interaction 2021-06-09 11:46:01 +03:00
Yatsishin Ilya
df27e2754b resolve 2021-06-09 11:46:01 +03:00
Nikita Mikhaylov
82b8d45cd7
Merge pull request #23518 from nikitamikhaylov/copier-stuck 
Bugfixes and improvements of `clickhouse-copier`
 2021-06-09 11:36:42 +03:00
mergify[bot]
156592af95
Merge branch 'master' into debug_network_interfaces 2021-06-09 07:56:02 +00:00
alesapin
7179fafef0 Less timeouts in integration tests 2021-06-09 10:49:29 +03:00
kssenii
0521851afa Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgres-fixes-schema 2021-06-08 17:20:23 +00:00
alesapin
eeb75d15da Remove timeouts 2021-06-08 19:21:55 +03:00
alesapin
49b5b94187 Remove strange timeout in test 2021-06-08 19:15:04 +03:00
alesapin
fc805a1ece Trying to debug fetches bandwith test failures 2021-06-08 15:13:45 +03:00
Nikita Mikhaylov
c3f03e8f60 skip ttl_move_to_volume 2021-06-08 11:14:45 +00:00
Nikita Mikhaylov
22864aff23 delete files 2021-06-08 01:52:30 +00:00
Nikita Mikhaylov
c0238e839a another try to fix tests 2021-06-08 01:50:43 +00:00
Latysheva Alexandra
1a2cbe9275
Merge branch 'master' into alexelex-encryption-1 2021-06-07 21:18:54 +06:00
Ilya Yatsishin
c453a84944
Merge pull request #24973 from qoega/cleanup-iptables-on-session-start 2021-06-07 15:43:13 +03:00
Nikita Mikhaylov
6f5997b0aa fix tests 2021-06-07 10:49:01 +00:00
Nikita Mikhaylov
652de7c9b0
Update test.py 2021-06-07 13:06:41 +03:00
alesapin
fba2d66042 Disable storage_kerberized_hdfs test 2021-06-07 12:25:13 +03:00
alexey-milovidov
344fc39e41
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-07 02:56:32 +03:00
alexey-milovidov
cc5755b1a4
Merge pull request #25002 from ClickHouse/compression-codecs-refactoring 
Compression codecs refactoring
 2021-06-07 02:54:24 +03:00
mergify[bot]
f84ac23951
Merge branch 'master' into compression-codecs-refactoring 2021-06-06 18:02:39 +00:00
mergify[bot]
e9d01d7e4f
Merge branch 'master' into fix-integration-test-s3 2021-06-06 18:02:34 +00:00
mergify[bot]
1172807442
Merge branch 'master' into recreate_kafka_table_case 2021-06-06 12:15:55 +00:00
alexey-milovidov
8b99fa049e
Merge pull request #24967 from filimonov/fix_port_in_kafka_test 
Fix the test after #20393
 2021-06-06 15:11:49 +03:00
Alexey Milovidov
b146524fdb Maybe Minio starts for too long in tests 2021-06-06 12:38:49 +03:00
Alexey Milovidov
8d85145725 Remove experimental compression codecs 2021-06-06 02:26:52 +03:00
Nikita Mikhaylov
b99350b50d
Update test.py 2021-06-06 02:19:17 +03:00
Alexey Milovidov
17962459f5 Merge branch 'master' into issue-16775 2021-06-06 02:18:28 +03:00
Ilya Yatsishin
f2eed22ebd
Merge pull request #24954 from ClickHouse/fix_integration_test 2021-06-05 20:18:33 +03:00
Ilya Yatsishin
3092ec7c7e
Merge pull request #24959 from qoega/no-more-subprocess-call 2021-06-05 19:41:52 +03:00
mergify[bot]
f56e7c6e3a
Merge branch 'master' into cleanup-iptables-on-session-start 2021-06-05 12:10:18 +00:00
Nikolay Degterinsky
1d6a01dd6f added tests 2021-06-05 02:52:18 +00:00
mergify[bot]
d8ed474062
Merge branch 'master' into copier-stuck 2021-06-05 01:40:23 +00:00
Yatsishin Ilya
df6e163976 fix 2021-06-04 18:46:11 +03:00
Yatsishin Ilya
9f6de5f764 opt-in for cleanup 2021-06-04 18:00:59 +03:00
Yatsishin Ilya
05232e7c40 Make tests great again 2021-06-04 17:33:22 +03:00
Nikita Mikhaylov
f6932026d5 delete partition from original table in case of errors while moving 2021-06-04 14:21:47 +00:00
tavplubix
19727ff753
Update test.py 2021-06-04 16:58:28 +03:00
Mikhail Filimonov
c8fe168a8d
Fix the test after #20393 2021-06-04 15:55:07 +02:00
filimonov
74ae079b19
Update test.py 2021-06-04 15:30:25 +02:00
Nikita Mikhaylov
cf8782faf3
Merge pull request #24311 from nikitamikhaylov/merging-s3-backoff 
Merging #23461
 2021-06-04 14:41:21 +03:00
kssenii
00e76ca372 Checking tests 2021-06-04 11:34:51 +00:00
alesapin
c03f54e2c3 Skip skipped tests 2021-06-04 13:15:44 +03:00
Yatsishin Ilya
e075130112 Remove subprocess_call from cluster.py 2021-06-04 13:14:32 +03:00
alesapin
a0eb45bfc3 More stable test 2021-06-04 12:12:35 +03:00
Yatsishin Ilya
e18343ce17 Merge remote-tracking branch 'origin' into remove-enable-dictionaries 2021-06-04 11:43:41 +03:00
alesapin
4d7170b557 Followup fixes for integration tests 2021-06-04 10:51:45 +03:00
alesapin
7ca31261b0
Merge pull request #24911 from ClickHouse/remove_some_tests 
Remove some outdated integration tests
 2021-06-04 10:15:39 +03:00
kssenii
e23bc14582 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-03 19:44:55 +00:00
mergify[bot]
9e2c454db2
Merge branch 'master' into merging-s3-backoff 2021-06-03 18:58:24 +00:00
Mikhail Filimonov
e11f7db28b
Add test #23430 2021-06-03 20:41:01 +02:00
Nikita Mikhaylov
b978405f4a fix 2021-06-03 15:50:44 +00:00
Nikita Mikhaylov
6c583b0e36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-stuck 2021-06-03 15:05:23 +00:00
Ilya Yatsishin
e0a683a407
Mute test_memory_consumption before #24784 2021-06-03 16:10:54 +03:00
tavplubix
1aff716f18
Merge pull request #24777 from ClickHouse/fix_intersection_with_lost_part 
Do not crash on intersecting virtual parts
 2021-06-03 15:42:46 +03:00
alesapin
31b27049b0 Followup 2021-06-03 15:42:12 +03:00
alesapin
6231a0d7d7 Merge branch 'master' into remove_some_tests 2021-06-03 15:41:50 +03:00
alesapin
f0f5aba3b1
Merge pull request #20393 from qoega/integration-2 
Grand integration tests refactoring: Allow parallel run
 2021-06-03 15:20:03 +03:00
alesapin
376b3872bf Remove some outdated integration tests 2021-06-03 14:49:59 +03:00
alesapin
4a1bf51ad1
Merge branch 'master' into limited_fetches 2021-06-02 23:01:47 +03:00
Yatsishin Ilya
ddddb761db more 2021-06-02 18:08:16 +03:00
Yatsishin Ilya
6a9b875b19 simplify test_backup_restore 2021-06-02 17:33:47 +03:00
Nikita Mikhaylov
4382aac25d support for ReplicatedTable creation without arguments 2021-06-02 15:46:37 +03:00
alesapin
f7babe5cd9 Fix build and better test 2021-06-02 11:22:44 +03:00
alesapin
feed2636f4 Add exponential smoothing to Throttler 2021-06-02 01:07:29 +03:00