Commit Graph

590 Commits

Author SHA1 Message Date
kssenii
a88e391bd2 Fix bug with insert, simplify exchanges logic 2020-07-25 16:55:18 +00:00
Azat Khuzhin
0cb6669531 Add integration test for input_format_parallel_parsing memory tracking 2020-07-23 11:31:13 +03:00
Azat Khuzhin
cdb959ec8e Fix test_storage_kafka::test_kafka_unavailable 2020-07-22 11:42:30 +03:00
Azat Khuzhin
58ba72c7b6 Merge remote-tracking branch 'upstream/pr/12487' into kafka-unavail-broker-SIGSEGV
* upstream/pr/12487:
  add failing test with kafka
2020-07-22 11:07:06 +03:00
Alexander Tokmakov
9bcaaea3e0 Merge branch 'master' into database_atomic_improvements 2020-07-22 05:24:48 +03:00
Alexander Kuzmenkov
40ee6eba19
Merge pull request #12545 from ClickHouse/fix_load_part_without_checksums
Fix loading parts without checksums
2020-07-20 14:40:53 +03:00
Alexey Milovidov
a104934d2c Merge branch 'master' into deprecate-special-zero-datetime 2020-07-20 04:34:26 +03:00
tavplubix
5634482393
Merge pull request #12556 from azat/distributed-remove-files-on-drop
Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE
2020-07-17 19:29:57 +03:00
Alexey Milovidov
e207acf19a Merge branch 'master' into deprecate-special-zero-datetime 2020-07-17 17:06:31 +03:00
Alexander Tokmakov
c27de9b424 fixes 2020-07-17 16:11:44 +03:00
alexey-milovidov
0f6599c9e5
Merge pull request #12541 from BohuTANG/mysql_explain
Fix EXPLAIN format for MySQL client
2020-07-17 14:04:01 +03:00
alesapin
ac802a8e96
Merge pull request #12543 from ClickHouse/fix_marks_type_on_mutation
Fix incorrect adaptive granularity by default
2020-07-17 11:09:54 +03:00
Azat Khuzhin
6ea1b19476 Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE 2020-07-17 08:59:57 +03:00
Alexander Tokmakov
a612080df1 Merge branch 'master' into database_atomic_improvements 2020-07-17 00:43:59 +03:00
alesapin
b3ec3b1ed1 Fix loading parts without checksums 2020-07-16 13:54:49 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
42983c5416 Fix incorrect adaptive granularity by default 2020-07-16 12:10:15 +03:00
BohuTANG
bae11968de Fix EXPLAIN format for MySQL/PG client #12432 2020-07-16 16:29:17 +08:00
Alexey Milovidov
b0b0690e1c Fix Python 2020-07-16 06:56:46 +03:00
Alexey Milovidov
2753cb58b6 Fixup 2020-07-16 05:31:03 +03:00
Alexey Milovidov
8abcee3201 Add integration test 2020-07-16 05:27:46 +03:00
Alexey Milovidov
11f8e2d906 Remove strange empty file 2020-07-16 05:11:40 +03:00
Alexey Milovidov
126a94ab69 Update integration tests 2020-07-16 04:48:50 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Alexander Tokmakov
7f6a0a652f fix tests 2020-07-15 23:16:31 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
Anton Popov
890bb2f582 add failing test with kafka 2020-07-14 12:24:12 +03:00
Alexander Tokmakov
fdb02edc7c Merge branch 'master' into database_atomic_improvements 2020-07-13 17:28:48 +03:00
Alexander Tokmakov
04c3e7cab6 add implicit uuid macro 2020-07-13 16:18:38 +03:00
Denis Glazachev
f787702922 Merge branch 'master' into ldap-per-user-authentication
* master: (27 commits)
  Whitespaces
  Fix typo
  Fix UBSan report in base64
  Correct default secure port for clickhouse-benchmark #11044
  Remove test with bug #10697
  Update in-functions.md (#12430)
  Allow nullable key in MergeTree
  Update arithmetic-functions.md
  [docs] add rabbitmq docs (#12326)
  Lower block sizes and look what will happen #9248
  Fix lifetime_bytes/lifetime_rows for Buffer direct block write
  Retrigger CI
  Fix up  test_mysql_protocol failed
  Implement lifetime_rows/lifetime_bytes for Buffer engine
  Add comment regarding proxy tunnel usage in PocoHTTPClient.cpp
  Add lifetime_rows/lifetime_bytes interface (exported via system.tables)
  Tiny IStorage refactoring
  Trigger integration-test-runner image rebuild.
  Delete log.txt
  Fix test_mysql_client/test_python_client error
  ...
2020-07-13 15:46:27 +04:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Denis Glazachev
a6a6f43422 Fix the test: auth_params is a JSON object 2020-07-12 01:40:24 +04:00
alexey-milovidov
160dcf715d
Merge pull request #12383 from BohuTANG/mysql_write_through_poco_exception
Write through Poco::Exception exception to MySQL protocol client
2020-07-11 23:56:22 +03:00
Vitaly Baranov
fe6122a1dd
Merge pull request #12394 from vitlibar/fix-calculating-implicit-access-rights
Fix calculating implicit access rights
2020-07-11 19:31:56 +03:00
BohuTANG
d6b3509664 Fix up test_mysql_protocol failed 2020-07-11 21:30:20 +08:00
alexey-milovidov
60bc8c8a8e
Delete log.txt 2020-07-11 05:33:41 +03:00
BohuTANG
beaf97f634 Fix test_mysql_client/test_python_client error 2020-07-11 09:17:12 +08:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
Vitaly Baranov
c66433a472 Add tests for implicit access rights. 2020-07-10 17:16:47 +03:00
Vitaly Baranov
d036682ef1 Split test 'test_create_user_and_login' into two. 2020-07-10 17:16:47 +03:00
BohuTANG
86590d4aca Change the exception catch to the generic way 2020-07-10 17:18:00 +08:00
BohuTANG
dfd7c5300a Add test_mysql_client_exception integration test 2020-07-10 14:20:32 +08:00
alexey-milovidov
8d7e418617
Merge pull request #12314 from BohuTANG/mysql_select_database
Support MySQL 'SELECT DATABASE()'
2020-07-10 06:32:04 +03:00
BohuTANG
260bcb9d79 Add integration test for mysql replacement query 2020-07-09 22:20:54 +08:00
Vladimir Chebotarev
faf6be6576
Implemented single part uploads for DiskS3 (#12026)
* Implemented single part uploads for DiskS3.
* Added `min_multi_part_upload_size` to disk configuration.
2020-07-09 17:09:17 +03:00
alesapin
84f8bf1e14
Merge pull request #10697 from CurtizJ/polymorphic-parts
Polymorphic parts (in-memory format)
2020-07-08 13:25:45 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
Yatsishin Ilya
42894ecb27 wait more 2020-07-08 10:36:35 +03:00
alesapin
f04a49a114
Merge pull request #12256 from ianton-ru/redirect_limit_exception
throw exception on redirect limit in S3 request
2020-07-08 10:33:42 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
Anton Ivashkin
78ba9c986f throw exception on redirect limit in S3 request 2020-07-07 16:20:48 +03:00
alesapin
be85f9f98a
Merge pull request #12165 from vitlibar/fix-split-dictionary-source-table-name
Fix splitting table name of dictionary source
2020-07-07 11:49:36 +03:00
Alexander Kuzmenkov
dce7709405
Merge pull request #12152 from BohuTANG/mysql_kill_query
Support MySQL 'KILL QUERY [connection_id]'
2020-07-07 11:07:20 +03:00
Vitaly Baranov
4733504b51 Don't split dictionary source's table name into schema and table name itself
if ODBC driver doesn't support schema.
2020-07-06 23:41:39 +03:00
alesapin
3f90f65678 Merge remote-tracking branch 'origin' into CurtizJ-polymorphic-parts 2020-07-06 21:34:17 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Nikita Mikhaylov
5c6d6bdf54
Merge pull request #11995 from azat/load_balancing-priority
Load balancing manual priority
2020-07-06 13:32:20 +04:00
BohuTANG
18c48ce12c Add integration test for mysql replacement query 2020-07-06 16:26:06 +08:00
alexey-milovidov
ea0fb005fb
Merge pull request #12116 from vitlibar/fix-table-dictionary-dependency
Fix handling dictionary-table dependency
2020-07-06 04:19:43 +03:00
alexey-milovidov
c696354dd4
Merge pull request #12115 from ianton-ru/disk-type-in-system-disks
Add type column in system.disks
2020-07-05 01:04:17 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Vitaly Baranov
dad96beb72 Add test. 2020-07-03 22:06:00 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
Vitaly Baranov
929d652297
Merge pull request #12083 from vitlibar/improve-revoke-command
Improve REVOKE command
2020-07-03 17:17:36 +03:00
Anton Ivashkin
23b44ca6fe Add type column in system.disks 2020-07-03 15:45:54 +03:00
alesapin
c57edd2018 Tiny fixes 2020-07-03 11:02:35 +03:00
Anton Popov
4422df2e37 Merge remote-tracking branch 'upstream/master' into HEAD 2020-07-02 20:18:21 +03:00
alesapin
ab54a96cc5 Reverse arguments 2020-07-02 17:38:09 +03:00
alesapin
96df2e6b71 Better shutdown and conversion 2020-07-02 17:35:10 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
Vitaly Baranov
03b36c262e Improve REVOKE command: now it requires only grant/admin option for only
access which will be revoked.
REVOKE ALL FROM user1 now revokes all granted roles.
2020-07-02 12:54:24 +03:00
Alexander Kazakov
cc2cadb7f5
Merge pull request #11893 from excitoon-favorites/autostartmoves
In *MergeTree: Parts moving task shall be started if new storage policy needs them
2020-07-02 10:44:38 +03:00
Vitaly Baranov
c39eb8f71b Fix partial revokes (complex cases). 2020-06-30 18:47:02 +03:00
alesapin
29c528235e Add ability to run any image version from packager and runner 2020-06-30 16:08:12 +03:00
Vladimir Chebotarev
288b407d32 Added test for automatic start of background move task. 2020-06-30 15:36:44 +03:00
Vitaly Baranov
ace9c99e14 Fix test_allow_introspection. 2020-06-30 12:20:00 +03:00
Azat Khuzhin
0eb9c8e430 Add a test with negative priority in test_distributed_load_balancing 2020-06-30 11:10:30 +03:00
Anton Popov
53e955c6dd several fixes 2020-06-29 23:36:18 +03:00
Azat Khuzhin
beb341275c Cover <replica> <priority> in test_distributed_load_balancing 2020-06-29 23:03:28 +03:00
Azat Khuzhin
72db50fe22 Drop TODO about possible failures from test_distributed_load_balancing
Fixed in: #11669 bd45592539 ("Fix
test_distributed_load_balancing flaps (due to config reload)")
2020-06-29 23:03:28 +03:00
Vitaly Baranov
f3f005d5b9
Merge pull request #12015 from vitlibar/fix-access-rights-allow-ddl-0
Fix calculation of access rights when allow_ddl = 0
2020-06-29 15:14:22 +03:00
alesapin
e72bc39654
Merge pull request #11983 from ClickHouse/storage_mongodb
Merging #10931 (Storage MongoDB)
2020-06-29 11:49:18 +03:00
Alexey Milovidov
b985584a09 Fix integration test 2020-06-28 23:03:45 +03:00
Vitaly Baranov
b230e74026 Add test test_allow_ddl. 2020-06-28 21:44:27 +03:00
alexey-milovidov
5a99cdb0d9
Merge pull request #11996 from BohuTANG/mysql_engine_enum
ISSUES-3985 Support MySQL engine reading Enums type
2020-06-27 22:18:25 +03:00
BohuTANG
f783a2976b Insert enum column values for test 2020-06-27 21:25:03 +08:00
BohuTANG
a13d201991 Add integration test for MySQL enums type 2020-06-27 17:46:19 +08:00
alesapin
4aea4c928e Add __init__.py 2020-06-26 19:31:00 +03:00
alesapin
4969da85d9 Fixes 2020-06-26 17:28:00 +03:00
alesapin
e9c47dc89c Merge branch 'master' into CurtizJ-polymorphic-parts 2020-06-26 14:27:19 +03:00
Nikita Mikhaylov
f90dfa3ef4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-ssh-cache 2020-06-26 13:56:21 +03:00
Nikita Mikhaylov
ff47c143f0 remove unused imports + bump tests 2020-06-26 12:53:02 +03:00
Nikita Mikhaylov
ea4192abc4 one more test 2020-06-25 19:09:34 +03:00
Nikita Mikhailov
15e09c8b2e add ssd to integration test 2020-06-25 18:35:33 +03:00
alexey-milovidov
a34032cace
Merge pull request #11300 from blinkov/sentry
Opt-in support for sending crash reports
2020-06-25 17:20:50 +03:00
Nikita Mikhaylov
e16f942197 save 2020-06-25 14:17:46 +03:00
alesapin
36eb2c3028 Simplify code around locks 2020-06-25 13:25:22 +03:00
alesapin
d5847d29d6 Avoid memory leaks 2020-06-25 12:44:39 +03:00
Ivan Blinkov
269fc138be rename test back to test.py 2020-06-25 11:11:29 +03:00
alesapin
addee61bcb Trying to do everything on top of libuv, add heartbeats 2020-06-25 00:14:49 +03:00
alesapin
3fc65b3269 Merge branch 'master' into kssenii-rabbit-mq 2020-06-24 20:14:28 +03:00
Vitaly Baranov
29a9d4187f Fix using current database while checking access rights. 2020-06-24 17:31:05 +03:00
Ivan Blinkov
3206ed832a add __init__.py 2020-06-24 15:54:04 +03:00
Ivan Blinkov
ea2d1856f3 try to rename py files to less common names 2020-06-24 15:35:22 +03:00
tavplubix
2401bc9143
Merge pull request #11896 from ClickHouse/merging_drop_replica
Merging #10679
2020-06-24 11:42:39 +03:00
Anton Popov
8c3f496826 add test with alters and in-memory parts 2020-06-24 01:16:29 +03:00
Ivan Blinkov
45d1ca2567 merge master 2020-06-24 00:18:16 +03:00
Alexander Tokmakov
7b5de16da9 minor improvements 2020-06-23 22:15:01 +03:00
alexey-milovidov
1c1e12f06b
Merge pull request #11826 from ClickHouse/send-logs-on-fatal-errors
Send logs to client on fatal errors if possible
2020-06-23 09:49:48 +03:00
amudong
7723dc4935 add drop relica database and the whole replica
fix removeReplicaByZKPath

fix bug: add zkpath empty judge

fix: rewrite code

delete useless code.

fix:ast fromat

fix bug

add test_drop_replica

add drop_replica doc

add drop databse checkAccess

refactor dropReplica

update tests

add static method StorageReplicatedMergeTree::dropReplicaByZkPath

update doc and delete useless code

fix conflict

fix doc

fix doc

fix StorageReplicatedMergeTree::dropReplica

fix bug

delete useless code
2020-06-23 12:12:30 +08:00
amudong
2e6a3eff8e fix: can not drop local table and replace ALTER with SYSTEM
fix test_drop_replica

fix drop replica '/path/to/zk/' ending in '/' and update doc
2020-06-23 12:12:30 +08:00
sundy-li
0a4af8f0a7 add SYSTEM DROP REPLICA 2020-06-23 12:12:30 +08:00
sundy-li
15ad830290 only drop inactive replica
update doc

Increase timeout to release the zookeeper Ephemeral nodes

Fix code comment

use PartitionManager

make integrations test passed
2020-06-23 12:12:30 +08:00
sundy-li
34df59baf8 Add tests and docs
Fix integration-tests
2020-06-23 12:12:30 +08:00
alexey-milovidov
d147cd646a
Merge pull request #11860 from ClickHouse/supress_mysql_test_under_tsan
Disable MySQL dictionaries integration tests under tsan
2020-06-23 02:50:05 +03:00
Alexander Kuzmenkov
e76941b52c
Merge pull request #11669 from azat/distributed_replica_error_ignore
Add number of errors to ignore while choosing replicas
2020-06-22 22:06:04 +03:00
alexey-milovidov
3e71b6ae07
Merge pull request #11845 from ClickHouse/loose-odbc-connection-string-validation
Slightly relax the validation of ODBC connection string
2020-06-22 21:19:30 +03:00
alesapin
ef89a6f728
Merge pull request #11786 from ClickHouse/fix_alter_with_materialized
Fix alter key when materialized column passed
2020-06-22 19:06:25 +03:00
alesapin
b4d89bd124 Fix comment 2020-06-22 16:31:16 +03:00
alesapin
afcf63ad89 Add alias for postgesql container 2020-06-22 16:29:35 +03:00
alesapin
588568f39c Disable MySQL tests under tsan 2020-06-22 16:10:25 +03:00
Alexey Milovidov
d3deed991e Fix bad test for LIVE VIEW 2020-06-22 15:49:38 +03:00
Alexander Kuzmenkov
ffc5b21bad Merge remote-tracking branch 'origin/master' into HEAD 2020-06-22 15:28:03 +03:00
alesapin
9612b3e32b Add data to test and simplify 2020-06-22 14:03:01 +03:00
Ivan Blinkov
2c0ff29c48 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-22 10:06:36 +03:00
Alexey Milovidov
8cce416921 Added a test with another hostname 2020-06-22 01:12:35 +03:00
Alexey Milovidov
e9fb277e6c Make LIVE VIEW test less wrong (it was depending on the timing of progress messages) 2020-06-21 23:37:55 +03:00
alexey-milovidov
4ee623ccac
Merge pull request #10242 from MovElb/movelb-postgresql-wire-protocol-impl
PostgreSQL wire protocol implementation
2020-06-21 14:39:22 +03:00
Azat Khuzhin
bd45592539 Fix test_distributed_load_balancing flaps (due to config reload)
At startup, server loads configuration files.

However ConfigReloader does not know about already loaded files (files
is empty()), hence it will always reload the configuration just after
server starts (+ 2 seconds, reload timeout).

And on configuration reload the clusters will be re-created, so some
internal stuff will be reseted:
- error_count
- last_used (round_robing)

And if the reload will happen during round_robin test it will start
querying from the beginning, so let's issue config reload just after
start to avoid reload in the middle of the test execution.
2020-06-21 12:01:15 +03:00
Alexey Milovidov
25af2d0b0a Fix bad integration test "always_fetch_merged" 2020-06-20 21:21:29 +03:00
Azat Khuzhin
9bfda65134 Add a test for distributed_replica_max_ignored_errors 2020-06-20 11:21:08 +03:00
alesapin
4b6db63fff Fix alter key when materialized column passed 2020-06-19 13:53:20 +03:00
Mikhail Filimonov
9609bd9dee Kafka better states, formats based on PeekableReadBuffer, and other minor fixes.
Add formats tests, fixes for JSONCompactEachRowWithNamesAndTypes, TSVWithNamesAndTypes. Some CR fixes
Add sanitizing for kafka_max_block_size and kafka_poll_max_batch_size
2020-06-19 10:49:05 +02:00
Azat Khuzhin
4572b1ede7 Cover re-parsing of metadata from zookeeper 2020-06-17 21:05:26 +03:00
Vitaly Baranov
7011401cd4
Merge pull request #11670 from vitlibar/rbac-improve-parser-multiple-entities
RBAC: improve syntax
2020-06-17 16:26:02 +03:00
Nikita Mikhaylov
ff0262626a
Merge pull request #11645 from azat/load-balancing-round-robin
Add round_robin load_balancing
2020-06-17 14:34:59 +04:00
Nikita Mikhaylov
edec79cf69
Merge pull request #11703 from nikitamikhaylov/merging-alter-query
Merging #11508
2020-06-17 12:47:34 +04:00
Nikita Mikhaylov
ab04a6bb62
Merge pull request #11615 from azat/SYSTEM-FLUSH-LOGS-force-table-creation-v2
Force table creation on SYSTEM FLUSH LOGS (v2)
2020-06-17 11:09:19 +04:00
alexey-milovidov
8eb811140a
Merge pull request #11717 from ClickHouse/fix-test-mysql-federated
Added retries to test_mysql_federated
2020-06-17 09:26:33 +03:00
Alexey Milovidov
3e7ac1f9ab Added retries to test_mysql_federated 2020-06-16 23:52:31 +03:00
Alexey Milovidov
2024d2de54 Update test 2020-06-16 22:10:25 +03:00
Alexey Milovidov
bf4c82dbd8 Update test 2020-06-16 22:04:19 +03:00
Nikita Mikhaylov
fc06f99476 build and test fixes 2020-06-16 21:07:41 +03:00
Ivan Blinkov
7e2bb1fd83 Merge branch 'master' of github.com:ClickHouse/ClickHouse into sentry 2020-06-16 16:02:55 +03:00
franklee
264e44ecef support distributed DDLs on cross replication clusters.
(cherry picked from commit fd09994d91)
2020-06-16 11:53:27 +03:00
Anton Popov
b19d48a11c Merge remote-tracking branch 'upstream/master' into HEAD 2020-06-16 06:37:55 +03:00
Alexey Milovidov
bd330cfeb6 Update test 2020-06-16 05:56:50 +03:00