Commit Graph

3430 Commits

Author SHA1 Message Date
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Anton Popov
d8367334a3 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-08 18:26:19 +03:00
Mikhail f. Shiryaev
03927f5fc6
Revert "graphite: split tagged/plain rollup rules (for merges perfomance)"
This reverts commit 303552f515.
2021-12-08 15:49:21 +01:00
tavplubix
4f46ac6b30
Remove LeaderElection (#32140)
* remove LeaderElection

* try fix tests

* Update test.py

* Update test.py
2021-12-07 19:55:55 +03:00
Mikhail f. Shiryaev
5fc20b3e6a
Merge pull request #25122 from msaf1980/rollup_rules_type
GraphiteMergeTree Rollup rules type
2021-12-07 10:18:08 +01:00
Stig Bakken
bb521cd363 Add TABLE OVERRIDE feature for MaterializedMySQL databases 2021-12-07 09:45:02 +01:00
Kseniia Sumarokova
7e261245d3
Merge pull request #32256 from taiyang-li/default_for_hdfs
Support default expression for storage hdfs and optimize fetching when source is column oriented
2021-12-06 23:32:01 +03:00
msaf1980
303552f515
graphite: split tagged/plain rollup rules (for merges perfomance) 2021-12-06 16:49:08 +01:00
Alexander Tokmakov
7797a72907 fix false-positive ciclyc dependency with XML dict 2021-12-06 16:35:43 +03:00
mergify[bot]
52904a4973
Merge branch 'master' into default_for_hdfs 2021-12-06 13:19:49 +00:00
Vladimir C
c502454088
Merge pull request #32185 from kitaisreal/range-hashed-dictionary-added-update-field-support 2021-12-06 10:57:47 +03:00
Maksim Kita
b9718b8450
Merge pull request #32118 from kitaisreal/fix-test-executable-storage-input
Fix flacky test test_executable_storage_input
2021-12-06 10:39:30 +03:00
taiyang-li
9d1e63be0f 1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented 2021-12-06 11:54:45 +08:00
Maksim Kita
4bbb02bbae RangeHashedDictionary added update_field support 2021-12-03 14:06:58 +03:00
Kruglov Pavel
17d6f539b3
Merge pull request #32019 from azat/dist-desc
Fix excessive DESC TABLE for remote() over identifier
2021-12-03 12:15:05 +03:00
mergify[bot]
51b8148cc0
Merge branch 'master' into fix-test-executable-storage-input 2021-12-03 09:11:05 +00:00
Kseniia Sumarokova
a8dcbc988a
Merge pull request #32129 from kssenii/fix-postgres-tests
fixing postgres tests
2021-12-03 09:15:20 +03:00
Anton Popov
f6be3d16fd
Merge pull request #24820 from kssenii/versioning
Versioning of aggregate function states
2021-12-03 01:41:44 +03:00
kssenii
06312a2df9 Fix 2021-12-02 22:48:21 +03:00
alesapin
45021bd35c
Merge pull request #32121 from ClickHouse/add_assertion_in_keeper
Add check for duplicate hostnames and IDs in KeeperConfig
2021-12-02 22:24:46 +03:00
tavplubix
4d96d6ab77
Merge pull request #32052 from stigsb/fix-flaky-create-table-like-test
Fix flaky integration test for MaterializedMySQL CREATE TABLE LIKE
2021-12-02 21:28:00 +03:00
kssenii
64fcbe347e Update 2021-12-02 16:08:11 +03:00
alesapin
b8bffcb14c
Merge pull request #32115 from ClickHouse/fix_flaky_keeper_tests
Fix flaky keeper whitelist test
2021-12-02 15:41:17 +03:00
alesapin
437591f2fa Add check for duplicate hostnames and IDs in KeeperConfig 2021-12-02 14:46:33 +03:00
tavplubix
5400c5899d
Merge pull request #32063 from ClickHouse/fix_detach_dir_exists
Fix 'directory exists' error when detaching part
2021-12-02 14:04:21 +03:00
alesapin
ff6cc14df3 Fix one more test 2021-12-02 13:41:04 +03:00
Maksim Kita
492f9c3936 Fix flacky test test_executable_storage_input 2021-12-02 13:11:21 +03:00
alesapin
e704140d07 Fix flaky whitelist test 2021-12-02 12:37:08 +03:00
kssenii
8edf146687 Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-12-02 07:57:14 +00:00
Azat Khuzhin
b6290ae002 Update test_distributed_respect_user_timeouts after superfluous DESC had been removed 2021-12-01 22:52:20 +03:00
Kseniia Sumarokova
87574e8bf6
Merge pull request #31053 from kssenii/rabbit-kafka-select-commit
rabbitmq/kafka allow to commit on select only under setting
2021-12-01 18:23:08 +03:00
mergify[bot]
959fb1f4dd
Merge branch 'master' into fix-flaky-create-table-like-test 2021-12-01 15:17:28 +00:00
Alexander Tokmakov
57e4f3698c fix 'directory exists' error when detaching part 2021-12-01 17:24:26 +03:00
Anton Popov
54f51444c0 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-01 15:49:02 +03:00
Stig Bakken
f7578e7b9d Fix flaky test for MaterializedMySQL CREATE TABLE LIKE 2021-12-01 13:40:22 +01:00
tavplubix
b623a387af
Merge pull request #31887 from ClickHouse/fix_cannot_create_empty_part
Parse partition key value from `partition_id` when need to create part in empty partition
2021-12-01 15:38:46 +03:00
alexey-milovidov
6020188cc0
Merge pull request #31781 from havardk/tabletable
MaterializedMySQL: Fix issue with table named 'table'
2021-12-01 10:34:59 +03:00
kssenii
71bfc72e37 Fix 2021-11-30 14:42:37 +00:00
kssenii
28be1b12ad Avoid tests failing with oom 2021-11-30 15:26:57 +03:00
Alexander Tokmakov
231b906fe4 fix test 2021-11-30 13:22:37 +03:00
kssenii
69aa2da23e Update test 2021-11-30 09:56:10 +00:00
kssenii
0e24eebc80 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-30 12:26:10 +03:00
alesapin
438fa60902
Merge pull request #21326 from excitoon-favorites/flexiblemutations2
Skip mutations of unrelated partitions in `StorageMergeTree`
2021-11-30 12:15:29 +03:00
alesapin
ad4e6a1ebd
Merge pull request #31950 from ClickHouse/fix_integration_tests
Kill container in integration tests if it's already running
2021-11-30 10:17:19 +03:00
Kseniia Sumarokova
edf1ec776a
Merge pull request #31824 from azat/system-log-tables-recreate-different-engine
Recreate system.*_log tables in case of different engine/partition_by
2021-11-29 22:56:36 +03:00
kssenii
2ea4e7c4e7 Better 2021-11-29 15:05:02 +00:00
alesapin
0ac088367a Kill container in integration tests if it's already running 2021-11-29 16:38:12 +03:00
alesapin
525011db81
Merge pull request #31799 from ClickHouse/fix_default_keeper_port
Fix default keeper port
2021-11-29 16:31:36 +03:00
kssenii
2f0fe4a21f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbit-kafka-select-commit 2021-11-29 10:08:14 +00:00
kssenii
be3b4ca8fe Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-11-27 09:44:31 +00:00
kssenii
515261f5dd Better 2021-11-27 09:40:46 +00:00
Azat Khuzhin
5fafeea763 Recreate system.*_log tables in case of different engine/partition_by.
- Mark getCreateTableQuery() non virtual to call it from ctor
- Make check for CREATE TABLE simpler (by caching result)
- Extend error message.

v2: at SystemLog tables has not been initialized yet, so SHOW CREATE
cannot be obtained for the existing table, move the check to the
prepareTable() call.
v3: reset UUID and SETTINGS of MergeTree in CREATE TABLE query
v4: fix re-creating table with the same UUID
2021-11-26 10:05:20 +03:00
Vladimir Chebotarev
863f3565ad Test fixes. 2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
0da55ca03e Better tests. 2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
407c1aab9a Improved diagnostics in tests. 2021-11-25 17:11:28 +03:00
Vladimir Chebotarev
aa3eecbd6d Fixed bug with frozen mutations. 2021-11-25 17:11:27 +03:00
Vladimir Chebotarev
6599124dba Attempt to skip mutations of different partitions in StorageMergeTree. 2021-11-25 17:10:11 +03:00
Kruglov Pavel
b39c19399f
Merge pull request #31691 from kssenii/testing-1
Allow named_collections for kafka / rabbit
2021-11-25 14:06:31 +03:00
alesapin
dc6afadea3 Fix default keeper port 2021-11-25 14:01:30 +03:00
Kruglov Pavel
f28130193a
Merge branch 'master' into fix-whole-text-serialization 2021-11-25 14:00:20 +03:00
Haavard Kvaalen
fa7b547212 Always quote table name
This fixes an issue if the database contained a table named 'table'.
We would previously generate a query that ClickHouse could not parse.
2021-11-25 11:49:23 +01:00
Kseniia Sumarokova
93cf66df12
Merge pull request #30936 from kssenii/seekable-read-buffers
Reduce memory usage for some formats when reading with s3/url/hdfs
2021-11-25 11:19:24 +03:00
alesapin
02c238ba92
Merge pull request #31654 from ClickHouse/fixes_in_ci
Integration tests flaky check and small fixes
2021-11-25 10:29:51 +03:00
kssenii
46d2fdc5e6 Update 2021-11-24 21:53:53 +03:00
mergify[bot]
2ab091a85b
Merge branch 'master' into fix-whole-text-serialization 2021-11-24 12:44:53 +00:00
kssenii
980c87c466 Add named collection for kafka / rabbit 2021-11-24 14:53:01 +03:00
alesapin
646cf38213
Merge pull request #28981 from JackyWoo/add_4_letter_words_commands
Add four letter commands to keeper
2021-11-24 13:32:36 +03:00
alesapin
b13022b5fb Add some changes to test 2021-11-23 13:06:00 +03:00
tavplubix
7a43a87f5b
Use shard and replica name from Replicated database arguments (#31488)
* fix another issue

* use shard and replica name from Replicated database

* fix

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-11-23 12:41:54 +03:00
alesapin
35de9e42d9
Merge branch 'master' into add_4_letter_words_commands 2021-11-22 18:02:02 +03:00
alesapin
ef6079633d
Merge pull request #31605 from vitlibar/fix-cleanup-in-integration-tests
Fix cleanup in integration tests
2021-11-22 17:58:47 +03:00
avogar
f0a0c70528 Fix tests 2021-11-22 15:21:15 +03:00
tavplubix
dc6d48ff83
Merge pull request #31292 from stigsb/materialized-mysql-atomic-only
Drop support for DatabaseOrdinary in MaterializedMySQL
2021-11-22 14:03:50 +03:00
Vitaly Baranov
6f5f72738b Fix cleanup in integration tests. 2021-11-22 12:05:52 +03:00
kssenii
ff969b4605 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-20 15:03:13 +03:00
kssenii
f29ef7d18b Add one more test 2021-11-20 15:01:45 +03:00
alesapin
c2221b3462 Merge branch 'add_4_letter_words_commands' of github.com:JackyWoo/ClickHouse into JackyWoo_add_4_letter_words_commands 2021-11-19 16:03:26 +03:00
alesapin
587a1a622d Fix tests 2021-11-19 16:03:01 +03:00
JackyWoo
0c0aba5ed2 add new line to new xml file tail 2021-11-19 19:04:54 +08:00
tavplubix
9114bc8b9a
Update conftest.py 2021-11-19 12:48:08 +03:00
alesapin
dcec086573 Small refactoring 2021-11-18 23:17:22 +03:00
Stig Bakken
ff46e8bb51 Drop support for DatabaseOrdinary in MaterializedMySQL
1. Dropped support for DatabaseOrdinary for MaterializeMySQL. It
   is marked as experimental, and dropping support makes the code
   more maintaible, and speeds up integration tests by 50%.

2. Get rid of thread name logic for StorageMaterializeMySQL wrapping,
   use setInternalQuery instead (similar to MaterializedPostgreSQL).
2021-11-18 11:46:51 +01:00
Nikolay Degterinsky
fc9ef14a73
Merge pull request #29219 from evillique/log_lz4_streaming
Add LZ4 stream compression of logs
2021-11-17 21:22:57 +03:00
alesapin
31d4e16bd9
Merge pull request #31443 from ClickHouse/trying_to_debug_integration_tests
Trying to debug integration tests
2021-11-17 20:19:27 +03:00
Nikolay Degterinsky
15a8100be2 Try to fix test 2021-11-17 12:08:57 +00:00
alesapin
5f3eca4cd1 Merge branch 'master' into JackyWoo_add_4_letter_words_commands 2021-11-17 12:59:20 +03:00
alexey-milovidov
0ea843949e
Merge pull request #29806 from qoega/integration--7
Integration test improvements
2021-11-17 10:23:53 +03:00
Nikolay Degterinsky
ddef6d86ca Minor fixes 2021-11-16 23:02:47 +00:00
Nikolay Degterinsky
2ae79233e4 Better 2021-11-16 23:02:47 +00:00
Nikolay Degterinsky
eafd3ddfac Add lz4 stream compression 2021-11-16 22:30:29 +00:00
tavplubix
7a4c02b3c8
Merge pull request #31451 from ClickHouse/minor_improvement_test_replicated_fetches_bandwidth
Minor improvement for test_replicated_fetches_bandwidth
2021-11-16 21:45:10 +03:00
Alexander Tokmakov
d8a7ffaa65 minor improvement for test_replicated_fetches_bandwidth 2021-11-16 16:02:07 +03:00
tavplubix
33122597fe
Merge pull request #31410 from stigsb/materialized-mysql-create-table-like
Handle CREATE TABLE LIKE in MaterializedMySQL
2021-11-16 14:10:58 +03:00
Yatsishin Ilya
0811c0ef3a revert strange change 2021-11-16 12:23:46 +03:00
alesapin
e426078344 Trying to debug integration tests 2021-11-16 11:59:38 +03:00
Yatsishin Ilya
2f8b8596a2 better 2021-11-15 17:07:08 +03:00
Stig Bakken
3eac620d4d Handle CREATE TABLE LIKE in MaterializedMySQL 2021-11-15 14:43:50 +01:00
Alexander Tokmakov
416a82b99a Merge branch 'master' into check_dependencies_on_drop 2021-11-15 13:35:45 +03:00
kssenii
37f482d478 Merge branch 'master' of github.com:ClickHouse/ClickHouse into versioning 2021-11-15 07:31:11 +00:00
Kseniia Sumarokova
59d4eb99c2
Merge pull request #31291 from kssenii/update-async-reads-setting
Make remote_filesystem_read_method=threadpool by default
2021-11-13 19:19:35 +03:00
kssenii
f18dcd2287 Merge branch 'master' of github.com:ClickHouse/ClickHouse into seekable-read-buffers 2021-11-13 14:38:57 +03:00
kssenii
7c2315638c Remove checks for profile events because they are not updated the same way with async reads 2021-11-13 13:37:00 +03:00
Yatsishin Ilya
4d0a3ee283 better test_dictionaries_dependency 2021-11-12 22:42:23 +03:00
kssenii
6f895036e6 Disable for hdfs until tested, adjust tests with profile events 2021-11-12 14:09:19 +03:00
Vitaly Baranov
79a93c819f
Merge pull request #31262 from vitlibar/initial-user-role-row-policy
Initial user's roles are used now to find row policies
2021-11-12 13:51:20 +03:00
Kseniia Sumarokova
ccbe110857
Merge pull request #31316 from kssenii/debug-rabbit--test
Debug rabbitmq tests
2021-11-12 11:29:37 +03:00
kssenii
d346d3d92a Remove possible culprit 2021-11-11 20:33:50 +00:00
Yatsishin Ilya
cc109a7e4a fix 2021-11-11 16:36:10 +03:00
Yatsishin Ilya
d6048f0c18 fix 2021-11-11 16:28:50 +03:00
Yatsishin Ilya
9345b93486 fix killall. better test_different_user 2021-11-11 16:28:29 +03:00
kssenii
0dda1f280b Update setting remote_filesystem_read_method 2021-11-11 13:19:49 +03:00
Kseniia Sumarokova
e20cb0c10a
Merge branch 'master' into retriable-http 2021-11-11 11:52:06 +03:00
Yatsishin Ilya
ad2376c03b wip 2021-11-11 11:12:54 +03:00
Yatsishin Ilya
14c14dcd00 Merge remote-tracking branch 'origin' into integration--7 2021-11-11 10:41:50 +03:00
Yatsishin Ilya
b7c6a7bf8e wip 2021-11-11 10:41:48 +03:00
Kseniia Sumarokova
c916f24a06
Merge pull request #31224 from kssenii/rename-setting
Rename setting value read_threadpool to threadpool
2021-11-11 01:04:58 +03:00
Kseniia Sumarokova
852be4b6a8
Merge pull request #31250 from ClickHouse/kssenii-fix-test-1
Fix test
2021-11-11 01:03:21 +03:00
kssenii
62c70ce5cf Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-10 21:16:11 +00:00
Vitaly Baranov
b4791f1431 Add test. 2021-11-10 22:21:59 +03:00
Vitaly Baranov
1579bcfd20
Merge pull request #31178 from vitlibar/backup-engines-and-improvements
Backup engines and improvements
2021-11-10 18:20:41 +03:00
Yatsishin Ilya
52cc2fa547 Merge remote-tracking branch 'origin' into integration--7 2021-11-10 18:19:02 +03:00
Kseniia Sumarokova
f3dc7c0e5d
Update test.py 2021-11-10 17:21:25 +03:00
Kseniia Sumarokova
a18fd8bdfc
Fix 2021-11-10 17:20:25 +03:00
Vitaly Baranov
71359433dd Add parameters "backups.allowed_path" and "backups.allowed_disk" to config. 2021-11-10 11:03:09 +03:00
Vitaly Baranov
508fb6f54f Use external dirs in the integration test to make test not flaky. 2021-11-10 11:03:09 +03:00
Vitaly Baranov
606e94f4cc Fix backup of database. 2021-11-10 11:03:09 +03:00
kssenii
618c332f9c Rename read_threadpool to threadpool 2021-11-10 07:46:18 +00:00
Vitaly Baranov
cf77c0b3fc New syntax for BACKUP/RESTORE: set backup engine explicitly. 2021-11-09 23:16:40 +03:00
Alexander Tokmakov
4f542ab019 add test 2021-11-09 23:11:02 +03:00
Kruglov Pavel
17085183bf
Merge pull request #31042 from Avogar/hdfs-bad-url
Add additional hdfs url check
2021-11-09 16:23:59 +03:00
JackyWoo
c71fb3337f add more 4lwd commands 2021-11-09 17:39:28 +08:00
alesapin
3d8ef4ae95
Merge branch 'master' into trying_actions 2021-11-09 10:35:55 +03:00
Kseniia Sumarokova
581986c0d3
Merge pull request #30997 from kssenii/rabbitmq-fixes
RabbitMQ: fix one issue and add more tests
2021-11-09 10:15:01 +03:00
Anton Popov
66973a2a28 Merge remote-tracking branch 'upstream/master' into HEAD 2021-11-08 21:27:45 +03:00
Anton Popov
a7f219b3aa better sampling in ColumnSparse and fix alter rename column 2021-11-08 21:25:31 +03:00
alesapin
1fcd7cedf4 Restart docker 2021-11-08 16:23:14 +03:00
Yatsishin Ilya
660bfbd754 Merge remote-tracking branch 'origin' into integration--7 2021-11-08 15:41:12 +03:00
avogar
f10dfbe61a fix tests 2021-11-08 14:12:37 +03:00
Amr Alaa
ad81977ace
Skip max_partition_size_to_drop check in case of ATTACH PARTITION ... FROM (#30995)
* Skip checkPartitionCanBeDropped check in case of ATTACH PARTITION ... FROM

* Add integration test

* Fix syntax error

* Fix integration test

* Fix integration test

* Fix integration test

* Skip max_partition_size_to_drop for MOVE PARTITION
2021-11-08 13:07:14 +03:00
kssenii
be88441cd6 Much better 2021-11-06 18:46:39 +03:00
kssenii
03c16117b3 Tiny fix 2021-11-05 20:12:34 +00:00
alesapin
2a7e246021 Don't try to restart docker 2021-11-05 21:49:40 +03:00
alesapin
dd9446d8d3 Fix ci runner 2021-11-05 11:56:06 +03:00
Anton Popov
84e914e05a minor fixes near serializations 2021-11-05 01:46:00 +03:00
alesapin
a1a6d3876b Iptables fix 2021-11-04 23:22:13 +03:00
alesapin
2cc0b9723e Use temp path 2021-11-04 18:53:45 +03:00
kssenii
4bc2a29345 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into retriable-http 2021-11-04 14:41:24 +00:00
kssenii
b95f0738fb Fix 2021-11-04 14:39:53 +00:00
kssenii
26f6a697b5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into materialized-postgresql-fix 2021-11-04 13:25:48 +03:00