Commit Graph

972 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
d9073f27b7 Revert "Merge pull request #9025 from ClickHouse/revert-8303-cache-dictionary"
This reverts commit 24bdad3768, reversing
changes made to dad4f03a8f.
2020-02-06 15:18:19 +03:00
Alexander Tokmakov
180b5d409d fix poco secure sockets timeouts 2020-02-05 23:45:16 +03:00
Nikita Mikhaylov
c53053b103
Revert "Asynchronous updates in cache dictionaries " 2020-02-05 23:00:59 +03:00
Mikhail Filimonov
babd3ca34e Fixing test build, more review fixes 2020-02-05 08:05:55 +01:00
Mikhail Filimonov
cf35392433 Test for producer with _timestamp and _key 2020-02-04 23:12:26 +01:00
Nikita Mikhaylov
9c99498f2b Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-02-03 14:15:20 +03:00
Andrew Onyshchuk
15bad674a0 Add AvroConfluent integration test 2020-02-02 18:02:19 -06:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer 2020-02-02 03:54:50 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3
Added globs/wildcards for s3
2020-01-31 18:56:06 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2
Kafka fixes part2
2020-01-31 03:55:46 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Nikita Mikhaylov
c5e664a072 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-30 17:43:13 +03:00
Vladimir Chebotarev
4b2eff8551 Added passing ttl info between replicas. 2020-01-30 13:21:40 +03:00
CurtizJ
3144e81cb5 fix test prefer_localhost_replica 2020-01-28 21:54:25 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
alesapin
e27a3170bc Less flaps in tests 2020-01-28 13:58:37 +03:00
Vladimir Chebotarev
f98de4e098 Added tests for _file and _path in S3 storage. 2020-01-28 01:09:21 +03:00
Vladimir Chebotarev
11a5cab7bd Added some tests. 2020-01-28 00:44:18 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Nikita Mikhaylov
83cdc50ede Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-27 14:19:38 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete
"Atomically" remove parts on destroy.
2020-01-26 04:08:13 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration
Multiple disks/volumes for storing data for send in Distributed engine
2020-01-26 02:19:28 +03:00
Vladimir Chebotarev
fdef1d6935 Increased some timeouts in test_multiple_disks and test_ttl_move. 2020-01-26 00:27:46 +03:00
Azat Khuzhin
5c641b7485 Cover storage_configuration for Distributed engine 2020-01-25 20:52:31 +03:00
alexey-milovidov
cf2cd05906
Merge pull request #8824 from ClickHouse/fix_loading_live_view
Fix LiveView dependencies
2020-01-25 17:37:29 +03:00
alexey-milovidov
43230c9e5a
Merge pull request #8809 from azat/text_log.level
Add text_log.level to limit entries that goes to system.text_log table
2020-01-25 17:28:35 +03:00
Azat Khuzhin
3c6ce640b0 Cover text_log.level 2020-01-25 14:04:56 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
alesapin
47f8679810 Add test for constraints 2020-01-24 17:28:10 +03:00
alesapin
95fbef59c9 Fix prometheus test 2020-01-24 12:16:34 +03:00
alesapin
32783b3cea Fix integration test 2020-01-24 11:55:36 +03:00
Nikita Mikhaylov
9b63f28954 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-23 21:14:06 +03:00
Azat Khuzhin
c9cc1ef516 Cover tmp_policy 2020-01-23 20:31:19 +03:00
alesapin
e6958c0e49 Disable some flappy tests 2020-01-23 12:01:55 +03:00
Nikita Mikhaylov
97144cb645 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-22 14:51:05 +03:00
Alexey Milovidov
856962b290 Fixed test 2020-01-20 19:33:43 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove
Fixed a bug with double move which corrupt original part
2020-01-18 20:19:03 +03:00
Vladimir Chebotarev
87ac7c59df Added concurrent test for ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
89d74a599b Fixed test_ttl_move::test_ttls_do_not_work_after_alter a little bit. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
614c45df16 Improved test_ttl_move::test_ttls_do_not_work_after_alter test (so that it does not pass anymore). 2020-01-17 16:17:17 +03:00
Pervakov Grigory
36e5322320 Fix remove in memory disk, fix style, change s3 object naming 2020-01-17 14:44:16 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
Vladimir Chebotarev
451c8174c5 Added test for bug with double move which corrupt original part. 2020-01-17 12:46:44 +03:00
Vladimir Chebotarev
f758b1f6c6 Fixed deduplication issues in more test_multiple_disks tests. 2020-01-15 18:25:23 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489)
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
2020-01-15 10:52:45 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition
Alter command for move a specific partition from MergeTree table
2020-01-14 22:32:10 +04:00
alexey-milovidov
ffa5f714f3
Merge pull request #8642 from excitoon-favorites/fix_test_concurrent_alter_move
Fixed deduplication issue in `test_multiple_disks::test_concurrent_alter_move`
2020-01-14 14:25:26 +03:00
Vladimir Chebotarev
43570ba281 Fixed deduplication issue in test_multiple_disks::test_concurrent_alter_move. 2020-01-14 03:50:42 +03:00
alexey-milovidov
d78290b7ec
Merge pull request #8107 from excitoon-favorites/alterpolicy
Allow to change `storage_policy` to not less rich one
2020-01-13 21:02:47 +03:00
Guillaume Tassery
377d20185e Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-13 04:16:27 +01:00
alexey-milovidov
303b146a93
Merge branch 'master' into vfs_log 2020-01-12 20:16:30 +03:00
alexey-milovidov
c270830b0a
Merge pull request #8535 from ClickHouse/distributed-format
Distributed format
2020-01-11 19:19:11 +03:00
alexey-milovidov
b08a9e00a4
Merge pull request #8620 from chhetripradeep/pchhetri/spelling-mistakes
Fix some spelling mistakes
2020-01-11 16:19:48 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
Alexander Burmak
26511b7978 Added DiskMemory and tests 2020-01-11 00:43:42 +03:00
Alexey Milovidov
85f2f174b1 Merge branch 'CLICKHOUSE-7262' of https://github.com/kiransunkari/ClickHouse into kiransunkari-CLICKHOUSE-7262 2020-01-10 19:57:09 +03:00
Ivan
dec5a50033
Add new config syntax for table filters (#8381) 2020-01-10 19:53:47 +03:00
Ivan
fd55999398
Initialize set for index when table filter is presented (#8357) 2020-01-10 12:24:05 +03:00
Vladimir Chebotarev
5e1093faf8 Added changing of table policy. 2020-01-09 16:52:37 +03:00
Kiran
c87f74c637 added new integration test for clusterAllreplicas tabe function 2020-01-07 15:57:24 +05:30
Guillaume Tassery
8b2938a8fb
Merge branch 'master' into move_partition 2020-01-07 13:25:35 +07:00
Nikolai Kochetov
e4933eb6c6 Added tests 2020-01-05 22:36:14 +03:00
Nikita Mikhaylov
f0e4b0c013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2019-12-30 14:55:11 +03:00
alexey-milovidov
9d651526ca
Merge pull request #8343 from Felixoid/inherit_multiple_profiles
Inherit multiple profiles
2019-12-28 06:53:54 +03:00
alexey-milovidov
1d21286209
Merge pull request #8318 from excitoon-favorites/replicatedalterttl
Fixed ALTER TTL for replicated tables
2019-12-28 06:49:42 +03:00
Nikita Mikhaylov
c49eefda2c better integration tests 2019-12-28 05:39:03 +03:00
Nikita Mikhaylov
62f265576a integration test added 2019-12-27 23:31:40 +03:00
Alexey Milovidov
b17048f07a Remove sleep by Azat suggestion, https://github.com/ClickHouse/ClickHouse/pull/8288#pullrequestreview-336615781 2019-12-27 21:24:22 +03:00
Mikhail f. Shiryaev
06fb37dd42
Add tests and documentation for settings and constraints order 2019-12-27 18:15:55 +01:00
Vitaly Baranov
b75771be61
Merge pull request #7808 from vitlibar/RBAC-3
RBAC-3
2019-12-27 09:44:24 +07:00
Mikhail f. Shiryaev
e0f43e99e2
Add tests for multiple profiles inheritance 2019-12-26 23:18:59 +01:00
alexey-milovidov
d2e5827307
Merge pull request #8410 from excitoon-favorites/ttlcheckvaliddeestination
Added check for valid destination in a move TTL rule
2019-12-27 00:29:55 +03:00
Vladimir Chebotarev
cff368c1d1 Updated test_alter_multiple_ttls. 2019-12-26 22:34:15 +03:00
Vladimir Chebotarev
7ed19c2a2d Added test for ALTER TTL.
Co-authored-by: Vitaliy Zakaznikov <vzakaznikov@protonmail.com>
2019-12-26 22:34:08 +03:00
alexey-milovidov
1adc3cfb88
Merge pull request #8118 from excitoon-favorites/scan_all_disks
Check extra parts of `MergeTree` at different disks, in order to not allow to miss data parts at undefined disks
2019-12-26 22:10:53 +03:00
alexey-milovidov
6b997a0c61
Merge pull request #8288 from PerformanceVision/reload_dictionary
Implement ON CLUSTER syntax when we want to reload a dictionary
2019-12-26 22:05:41 +03:00
Vladimir Chebotarev
187d72d78d Improved test_ttl_move::test_rule_with_invalid_destination. 2019-12-26 18:04:51 +03:00
Vladimir Chebotarev
1236c8a09a Added test_ttl_move::test_rule_with_invalid_destination test. 2019-12-26 11:42:19 +03:00
Vladimir Chebotarev
a9c4127c9d Added test_ttl_move::test_ttls_do_not_work_after_alter test. 2019-12-26 09:57:27 +03:00
Vladimir Chebotarev
91b67af54f Better cleaning up in test_multiple_disks::test_freeze. 2019-12-25 23:32:15 +03:00
Nikita Mikhaylov
2545f66fe5 better 2019-12-23 19:51:01 +03:00
Guillaume Tassery
483d6287eb cosmetic 2019-12-23 07:22:51 +01:00
Guillaume Tassery
15fb9ad6de
Merge branch 'master' into reload_dictionary 2019-12-23 10:46:02 +07:00
VDimir
e301c1fe59 Fix test_prometheus_endpoint 2019-12-21 20:50:02 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary
Synchronous system reload dictionary
2019-12-20 20:00:03 +03:00
Guillaume Tassery
2977289b57 update test 2019-12-20 10:49:40 +01:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
alexey-milovidov
0b70706f04
Merge pull request #8241 from vitlibar/fix-allowed-client-hosts-checks
Fix checking if a client host is allowed.
2019-12-19 21:09:29 +03:00
Vitaly Baranov
c3161b7610 Add DCL to manage row policies. 2019-12-19 18:40:21 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
Vitaly Baranov
754fb40cc4 Transform stateless test for row policy into an integration test
with improvements.
2019-12-19 13:37:02 +03:00
Guillaume Tassery
1f5a11b384 Add test for ON CLUSTER on RELOAD DICTIONARY command 2019-12-19 09:01:57 +01:00
Vitaly Baranov
902d7860da Fix tests. 2019-12-19 03:38:30 +03:00
Vitaly Baranov
bfcd437e91 Add an integration test. 2019-12-19 03:15:14 +03:00
Vitaly Baranov
fa53f0c6ba Fix using a custom hostname for a node in the integrations tests.
See https://github.com/docker/compose/issues/2925
2019-12-19 03:15:08 +03:00
alexey-milovidov
993ed07e11
Merge pull request #8255 from ClickHouse/fix_flappy_test
More stable kill in integration tests
2019-12-18 01:59:22 +03:00
alexey-milovidov
c9887ccadc
Merge pull request #8250 from ClickHouse/no_mutation_number_by_default
No mutation number by default
2019-12-18 01:58:21 +03:00
alexey-milovidov
5afb518c47
Merge pull request #8253 from nvartolomei/nv/constraints-coverage
Improve settings constraints tests coverage
2019-12-18 01:56:50 +03:00
alesapin
30aa42784a More stable kill in integration tests 2019-12-17 21:07:13 +03:00
Nicolae Vartolomei
d1de5bb8d5 Improve settings constraints tests coverage 2019-12-17 17:20:15 +00:00
alesapin
1c09a8b8aa Revert tests 2019-12-17 16:03:23 +03:00
alesapin
3c4f12cb7f Fix config subst test 2019-12-17 15:41:22 +03:00
alesapin
937eee15fe Fix check_table test 2019-12-17 15:40:18 +03:00
Guillaume Tassery
bdcee8b382 Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2019-12-17 11:18:11 +01:00
alesapin
3ad6b482ab
Merge pull request #8127 from ClickHouse/restrictions_for_external_dictionaries_from_ddl
Add restrictions for several sources of external dictionaries
2019-12-17 12:18:39 +03:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177)
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
alesapin
a2180b0bb3 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-16 23:07:16 +03:00
Alexander Tokmakov
9e566d997e fix insert select from mysql(...) 2019-12-16 17:28:44 +03:00
alexey-milovidov
38353d1253
Merge pull request #8197 from filimonov/fix_kafka_mv_subqueries
Init query context for Kafka to make subqueries work
2019-12-16 02:40:00 +03:00
alexey-milovidov
d498e14ff8
Merge pull request #7900 from Vdimir/prometheus-metrics-7369
Prometheus endpoint
2019-12-16 01:16:52 +03:00
alexey-milovidov
39a8f1e9c7
Merge pull request #8202 from zhang2014/feature/support_drop_mysql_database
ISSUES-6063 support drop mysql database engine
2019-12-14 19:44:17 +03:00
VDimir
d413c4a7d5 Add test_prometheus_endpoint 2019-12-14 19:40:50 +03:00
Alexander Kuzmenkov
5b67c55ec6 Update containers for #6892. 2019-12-13 16:57:10 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
alesapin
d894d1df3d
Merge pull request #8135 from excitoon/patch-4
Fixed `test_multiple_disks::test_kill_while_insert` a little
2019-12-13 11:06:34 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
efb916c556
Merge pull request #8176 from ClickHouse/fix_tmp_drop_relative_path
Fix loading of partially dropped table
2019-12-13 02:28:13 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alexey-milovidov
5774078854
Merge pull request #8173 from excitoon/patch-5
Fixed flapping `test_ttl_move::test_moves_after_merges_work`
2019-12-12 18:22:34 +03:00
Alexander Tokmakov
1a6c973055 use absolute path and try to load table 2019-12-12 17:47:31 +03:00
Vladimir Chebotarev
3630b06cf9 Fixed flapping test_ttl_move::test_moves_after_merges_work 2019-12-12 16:42:03 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
065b681a8c Boosted test_ttl_move::test_moves_to_volume_work a little. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
164360e7ad Fixed test_ttl_move again. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
2e853e3211 Fixed more typos in test_ttl_move. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ae4b2b4ace Fixed some typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3250955b07 Refactored tests a little bit. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3427af0c1 Fixed typos in a test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3e261800d Fixes of tests for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e163ebb7f0 Fixed more typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc70f717ed Fixed typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
617bf4214f Added first version of tests for extended TTL expressions (still need refactoring). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
5a12986159 Updated ttl test according to new TTL syntax. 2019-12-11 13:24:20 +03:00
alesapin
4385aab4a1 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-11 12:29:55 +03:00
Vladimir Chebotarev
1ca9cefa1d
Fixed typo. 2019-12-11 11:58:53 +03:00
Vladimir Chebotarev
f5d162c5ed
Fixed test_multiple_disks::test_kill_while_insert a little. 2019-12-11 07:59:37 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
alesapin
ea8994b9e4 Add restrections for several sources of external dictionaries 2019-12-10 20:27:29 +03:00
Pavel Kovalenko
c4b3cce847 AWS SDK integration - move s3 storage syntax tests to integration. 2019-12-10 19:11:13 +03:00
Vladimir Chebotarev
ed719f38b2 Added test_multiple_disks::test_move_after_merge. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
ea44510b44 Minor fix of test. 2019-12-09 23:29:44 +03:00