Commit Graph

954 Commits

Author SHA1 Message Date
Vladimir Chebotarev
11a5cab7bd Added some tests. 2020-01-28 00:44:18 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Nikita Mikhaylov
83cdc50ede Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-27 14:19:38 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete
"Atomically" remove parts on destroy.
2020-01-26 04:08:13 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration
Multiple disks/volumes for storing data for send in Distributed engine
2020-01-26 02:19:28 +03:00
Vladimir Chebotarev
fdef1d6935 Increased some timeouts in test_multiple_disks and test_ttl_move. 2020-01-26 00:27:46 +03:00
Azat Khuzhin
5c641b7485 Cover storage_configuration for Distributed engine 2020-01-25 20:52:31 +03:00
alexey-milovidov
cf2cd05906
Merge pull request #8824 from ClickHouse/fix_loading_live_view
Fix LiveView dependencies
2020-01-25 17:37:29 +03:00
alexey-milovidov
43230c9e5a
Merge pull request #8809 from azat/text_log.level
Add text_log.level to limit entries that goes to system.text_log table
2020-01-25 17:28:35 +03:00
Azat Khuzhin
3c6ce640b0 Cover text_log.level 2020-01-25 14:04:56 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
alesapin
47f8679810 Add test for constraints 2020-01-24 17:28:10 +03:00
alesapin
95fbef59c9 Fix prometheus test 2020-01-24 12:16:34 +03:00
alesapin
32783b3cea Fix integration test 2020-01-24 11:55:36 +03:00
Nikita Mikhaylov
9b63f28954 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-23 21:14:06 +03:00
Azat Khuzhin
c9cc1ef516 Cover tmp_policy 2020-01-23 20:31:19 +03:00
alesapin
e6958c0e49 Disable some flappy tests 2020-01-23 12:01:55 +03:00
Nikita Mikhaylov
97144cb645 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-22 14:51:05 +03:00
Alexey Milovidov
856962b290 Fixed test 2020-01-20 19:33:43 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove
Fixed a bug with double move which corrupt original part
2020-01-18 20:19:03 +03:00
Vladimir Chebotarev
87ac7c59df Added concurrent test for ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
89d74a599b Fixed test_ttl_move::test_ttls_do_not_work_after_alter a little bit. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
614c45df16 Improved test_ttl_move::test_ttls_do_not_work_after_alter test (so that it does not pass anymore). 2020-01-17 16:17:17 +03:00
Pervakov Grigory
36e5322320 Fix remove in memory disk, fix style, change s3 object naming 2020-01-17 14:44:16 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
Vladimir Chebotarev
451c8174c5 Added test for bug with double move which corrupt original part. 2020-01-17 12:46:44 +03:00
Vladimir Chebotarev
f758b1f6c6 Fixed deduplication issues in more test_multiple_disks tests. 2020-01-15 18:25:23 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489)
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
2020-01-15 10:52:45 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition
Alter command for move a specific partition from MergeTree table
2020-01-14 22:32:10 +04:00
alexey-milovidov
ffa5f714f3
Merge pull request #8642 from excitoon-favorites/fix_test_concurrent_alter_move
Fixed deduplication issue in `test_multiple_disks::test_concurrent_alter_move`
2020-01-14 14:25:26 +03:00
Vladimir Chebotarev
43570ba281 Fixed deduplication issue in test_multiple_disks::test_concurrent_alter_move. 2020-01-14 03:50:42 +03:00
alexey-milovidov
d78290b7ec
Merge pull request #8107 from excitoon-favorites/alterpolicy
Allow to change `storage_policy` to not less rich one
2020-01-13 21:02:47 +03:00
Guillaume Tassery
377d20185e Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-13 04:16:27 +01:00
alexey-milovidov
303b146a93
Merge branch 'master' into vfs_log 2020-01-12 20:16:30 +03:00
alexey-milovidov
c270830b0a
Merge pull request #8535 from ClickHouse/distributed-format
Distributed format
2020-01-11 19:19:11 +03:00
alexey-milovidov
b08a9e00a4
Merge pull request #8620 from chhetripradeep/pchhetri/spelling-mistakes
Fix some spelling mistakes
2020-01-11 16:19:48 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
Alexander Burmak
26511b7978 Added DiskMemory and tests 2020-01-11 00:43:42 +03:00
Alexey Milovidov
85f2f174b1 Merge branch 'CLICKHOUSE-7262' of https://github.com/kiransunkari/ClickHouse into kiransunkari-CLICKHOUSE-7262 2020-01-10 19:57:09 +03:00
Ivan
dec5a50033
Add new config syntax for table filters (#8381) 2020-01-10 19:53:47 +03:00
Ivan
fd55999398
Initialize set for index when table filter is presented (#8357) 2020-01-10 12:24:05 +03:00
Vladimir Chebotarev
5e1093faf8 Added changing of table policy. 2020-01-09 16:52:37 +03:00
Kiran
c87f74c637 added new integration test for clusterAllreplicas tabe function 2020-01-07 15:57:24 +05:30
Guillaume Tassery
8b2938a8fb
Merge branch 'master' into move_partition 2020-01-07 13:25:35 +07:00
Nikolai Kochetov
e4933eb6c6 Added tests 2020-01-05 22:36:14 +03:00
Nikita Mikhaylov
f0e4b0c013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2019-12-30 14:55:11 +03:00
alexey-milovidov
9d651526ca
Merge pull request #8343 from Felixoid/inherit_multiple_profiles
Inherit multiple profiles
2019-12-28 06:53:54 +03:00
alexey-milovidov
1d21286209
Merge pull request #8318 from excitoon-favorites/replicatedalterttl
Fixed ALTER TTL for replicated tables
2019-12-28 06:49:42 +03:00
Nikita Mikhaylov
c49eefda2c better integration tests 2019-12-28 05:39:03 +03:00
Nikita Mikhaylov
62f265576a integration test added 2019-12-27 23:31:40 +03:00
Alexey Milovidov
b17048f07a Remove sleep by Azat suggestion, https://github.com/ClickHouse/ClickHouse/pull/8288#pullrequestreview-336615781 2019-12-27 21:24:22 +03:00
Mikhail f. Shiryaev
06fb37dd42
Add tests and documentation for settings and constraints order 2019-12-27 18:15:55 +01:00
Vitaly Baranov
b75771be61
Merge pull request #7808 from vitlibar/RBAC-3
RBAC-3
2019-12-27 09:44:24 +07:00
Mikhail f. Shiryaev
e0f43e99e2
Add tests for multiple profiles inheritance 2019-12-26 23:18:59 +01:00
alexey-milovidov
d2e5827307
Merge pull request #8410 from excitoon-favorites/ttlcheckvaliddeestination
Added check for valid destination in a move TTL rule
2019-12-27 00:29:55 +03:00
Vladimir Chebotarev
cff368c1d1 Updated test_alter_multiple_ttls. 2019-12-26 22:34:15 +03:00
Vladimir Chebotarev
7ed19c2a2d Added test for ALTER TTL.
Co-authored-by: Vitaliy Zakaznikov <vzakaznikov@protonmail.com>
2019-12-26 22:34:08 +03:00
alexey-milovidov
1adc3cfb88
Merge pull request #8118 from excitoon-favorites/scan_all_disks
Check extra parts of `MergeTree` at different disks, in order to not allow to miss data parts at undefined disks
2019-12-26 22:10:53 +03:00
alexey-milovidov
6b997a0c61
Merge pull request #8288 from PerformanceVision/reload_dictionary
Implement ON CLUSTER syntax when we want to reload a dictionary
2019-12-26 22:05:41 +03:00
Vladimir Chebotarev
187d72d78d Improved test_ttl_move::test_rule_with_invalid_destination. 2019-12-26 18:04:51 +03:00
Vladimir Chebotarev
1236c8a09a Added test_ttl_move::test_rule_with_invalid_destination test. 2019-12-26 11:42:19 +03:00
Vladimir Chebotarev
a9c4127c9d Added test_ttl_move::test_ttls_do_not_work_after_alter test. 2019-12-26 09:57:27 +03:00
Vladimir Chebotarev
91b67af54f Better cleaning up in test_multiple_disks::test_freeze. 2019-12-25 23:32:15 +03:00
Nikita Mikhaylov
2545f66fe5 better 2019-12-23 19:51:01 +03:00
Guillaume Tassery
483d6287eb cosmetic 2019-12-23 07:22:51 +01:00
Guillaume Tassery
15fb9ad6de
Merge branch 'master' into reload_dictionary 2019-12-23 10:46:02 +07:00
VDimir
e301c1fe59 Fix test_prometheus_endpoint 2019-12-21 20:50:02 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary
Synchronous system reload dictionary
2019-12-20 20:00:03 +03:00
Guillaume Tassery
2977289b57 update test 2019-12-20 10:49:40 +01:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
alexey-milovidov
0b70706f04
Merge pull request #8241 from vitlibar/fix-allowed-client-hosts-checks
Fix checking if a client host is allowed.
2019-12-19 21:09:29 +03:00
Vitaly Baranov
c3161b7610 Add DCL to manage row policies. 2019-12-19 18:40:21 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
Vitaly Baranov
754fb40cc4 Transform stateless test for row policy into an integration test
with improvements.
2019-12-19 13:37:02 +03:00
Guillaume Tassery
1f5a11b384 Add test for ON CLUSTER on RELOAD DICTIONARY command 2019-12-19 09:01:57 +01:00
Vitaly Baranov
902d7860da Fix tests. 2019-12-19 03:38:30 +03:00
Vitaly Baranov
bfcd437e91 Add an integration test. 2019-12-19 03:15:14 +03:00
Vitaly Baranov
fa53f0c6ba Fix using a custom hostname for a node in the integrations tests.
See https://github.com/docker/compose/issues/2925
2019-12-19 03:15:08 +03:00
alexey-milovidov
993ed07e11
Merge pull request #8255 from ClickHouse/fix_flappy_test
More stable kill in integration tests
2019-12-18 01:59:22 +03:00
alexey-milovidov
c9887ccadc
Merge pull request #8250 from ClickHouse/no_mutation_number_by_default
No mutation number by default
2019-12-18 01:58:21 +03:00
alexey-milovidov
5afb518c47
Merge pull request #8253 from nvartolomei/nv/constraints-coverage
Improve settings constraints tests coverage
2019-12-18 01:56:50 +03:00
alesapin
30aa42784a More stable kill in integration tests 2019-12-17 21:07:13 +03:00
Nicolae Vartolomei
d1de5bb8d5 Improve settings constraints tests coverage 2019-12-17 17:20:15 +00:00
alesapin
1c09a8b8aa Revert tests 2019-12-17 16:03:23 +03:00
alesapin
3c4f12cb7f Fix config subst test 2019-12-17 15:41:22 +03:00
alesapin
937eee15fe Fix check_table test 2019-12-17 15:40:18 +03:00
Guillaume Tassery
bdcee8b382 Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2019-12-17 11:18:11 +01:00
alesapin
3ad6b482ab
Merge pull request #8127 from ClickHouse/restrictions_for_external_dictionaries_from_ddl
Add restrictions for several sources of external dictionaries
2019-12-17 12:18:39 +03:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177)
* Fix segfault in table function file while inserting into it
2019-12-17 11:06:39 +03:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
alesapin
a2180b0bb3 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-16 23:07:16 +03:00
Alexander Tokmakov
9e566d997e fix insert select from mysql(...) 2019-12-16 17:28:44 +03:00
alexey-milovidov
38353d1253
Merge pull request #8197 from filimonov/fix_kafka_mv_subqueries
Init query context for Kafka to make subqueries work
2019-12-16 02:40:00 +03:00
alexey-milovidov
d498e14ff8
Merge pull request #7900 from Vdimir/prometheus-metrics-7369
Prometheus endpoint
2019-12-16 01:16:52 +03:00
alexey-milovidov
39a8f1e9c7
Merge pull request #8202 from zhang2014/feature/support_drop_mysql_database
ISSUES-6063 support drop mysql database engine
2019-12-14 19:44:17 +03:00
VDimir
d413c4a7d5 Add test_prometheus_endpoint 2019-12-14 19:40:50 +03:00
Alexander Kuzmenkov
5b67c55ec6 Update containers for #6892. 2019-12-13 16:57:10 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
alesapin
d894d1df3d
Merge pull request #8135 from excitoon/patch-4
Fixed `test_multiple_disks::test_kill_while_insert` a little
2019-12-13 11:06:34 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation
fix part mutation
2019-12-13 03:45:59 +03:00
alexey-milovidov
efb916c556
Merge pull request #8176 from ClickHouse/fix_tmp_drop_relative_path
Fix loading of partially dropped table
2019-12-13 02:28:13 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration
AWS SDK S3 integration
2019-12-12 20:43:16 +03:00
alexey-milovidov
5774078854
Merge pull request #8173 from excitoon/patch-5
Fixed flapping `test_ttl_move::test_moves_after_merges_work`
2019-12-12 18:22:34 +03:00
Alexander Tokmakov
1a6c973055 use absolute path and try to load table 2019-12-12 17:47:31 +03:00
Vladimir Chebotarev
3630b06cf9 Fixed flapping test_ttl_move::test_moves_after_merges_work 2019-12-12 16:42:03 +03:00
alesapin
e7f5b92b19 Add ability to create external dictionaries ON CLUSTER 2019-12-12 13:27:02 +03:00
Vladimir Chebotarev
7fd1668fde Review fixes. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
065b681a8c Boosted test_ttl_move::test_moves_to_volume_work a little. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
67aa268bbb Finally fixed tests and logic for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
164360e7ad Fixed test_ttl_move again. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
2e853e3211 Fixed more typos in test_ttl_move. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ae4b2b4ace Fixed some typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
3250955b07 Refactored tests a little bit. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3427af0c1 Fixed typos in a test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
b3e261800d Fixes of tests for extended TTL syntax. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
e163ebb7f0 Fixed more typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cc70f717ed Fixed typos in test_ttl_move test. 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
617bf4214f Added first version of tests for extended TTL expressions (still need refactoring). 2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
5a12986159 Updated ttl test according to new TTL syntax. 2019-12-11 13:24:20 +03:00
alesapin
4385aab4a1 Merge branch 'master' into restrictions_for_external_dictionaries_from_ddl 2019-12-11 12:29:55 +03:00
Vladimir Chebotarev
1ca9cefa1d
Fixed typo. 2019-12-11 11:58:53 +03:00
Vladimir Chebotarev
f5d162c5ed
Fixed test_multiple_disks::test_kill_while_insert a little. 2019-12-11 07:59:37 +03:00
Zhichang Yu
ff1b8d46e2 fixed part mutation, added test_backup_restore integration test case 2019-12-11 09:31:37 +08:00
alesapin
ea8994b9e4 Add restrections for several sources of external dictionaries 2019-12-10 20:27:29 +03:00
Pavel Kovalenko
c4b3cce847 AWS SDK integration - move s3 storage syntax tests to integration. 2019-12-10 19:11:13 +03:00
Vladimir Chebotarev
ed719f38b2 Added test_multiple_disks::test_move_after_merge. 2019-12-10 12:47:23 +03:00
Vladimir Chebotarev
ea44510b44 Minor fix of test. 2019-12-09 23:29:44 +03:00
Vladimir Chebotarev
6afd8d7805 Added test_multiple_disk::test_kill_while_insert, reworked log message and fixed logic of treating stale copies. 2019-12-09 23:29:44 +03:00
alexey-milovidov
cce78ef018
Merge pull request #8036 from yurriy/mysql
Compatibility with MySQL clients which don't support sha2_password auth plugin
2019-12-09 23:11:31 +03:00
Pavel Kovalenko
971c48e1cf AWS SDK integration - fixed test with remote host filter. 2019-12-09 15:05:16 +03:00
alexey-milovidov
9106b2854a
Merge pull request #8084 from azat/read-temporary-tables-on-failure
Read temporary tables on failure to avoid interpreting that bits as query
2019-12-09 13:49:09 +03:00
alexey-milovidov
624be3679b
Merge branch 'master' into mysql 2019-12-09 04:53:30 +03:00
alexey-milovidov
abb823af7f
Merge pull request #8079 from yurriy/mysql-types-test
Fixed Float64 conversion in MySQL protocol
2019-12-09 04:32:22 +03:00
alexey-milovidov
16754bfff5
Merge pull request #8043 from excitoon-favorites/systemmergespaths
Added information about paths to `system.merges`.
2019-12-08 23:30:39 +03:00
Azat Khuzhin
7b4fcc5fc5 Read temporary tables on failure to avoid interpreting that bits as query
Before this patch if the query failes (due to "Too many simultaneous
queries" for example) it will not read external tables info, and the
next request will interpret them as the query beginning at got:

  DB::Exception: Unknown packet 11861 from client

v2: reordering in the executeQuery() is not enough, since the query
    can fail in other places, before, i.e. quotas
v3: I cannot make non-intergration test (since there is no ability to
    receive "Unknown packet" via client, only from the server log),
    hence added one
2019-12-08 23:26:43 +03:00
Yuriy
e0796261aa mysql protocol: fixed Float32 conversion and added types test 2019-12-08 08:40:08 +03:00
Vladimir Chebotarev
bb0de2509a Fixed test_system_merges/test.py::test_mutation_simple[replicated] test. 2019-12-07 22:23:25 +03:00
Vladimir Chebotarev
c60493fe72 Fixed test_system_merges/test.py::test_merge_simple[replicated] test. 2019-12-07 22:02:01 +03:00
Vladimir Chebotarev
ed2ec2d15d Fixed test_system_merges to correctly check replicated node set. 2019-12-07 13:35:13 +03:00
Vladimir Chebotarev
1513e5a854 Added replicated tests for system.merges. 2019-12-07 13:15:01 +03:00
Vladimir Chebotarev
b64b2cff09 Added simple non-replicated tests for system.merges. 2019-12-07 11:40:49 +03:00
Pavel Kovalenko
dbcc06cc80 Removed CH docker image building in tests. 2019-12-06 17:57:43 +03:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
2019-12-06 17:52:29 +03:00
alexey-milovidov
3d279499d0
Merge pull request #7632 from hczhcz/patch-2
Allow relative user_files_path
2019-12-06 17:44:18 +03:00
Yuriy
5237e3c059 better exception text 2019-12-06 04:42:12 +03:00