Commit Graph

2817 Commits

Author SHA1 Message Date
tavplubix
e7290fb134
Merge pull request #27385 from BraulioVM/fix/27171
Do not fail if HTTP port is not set and user tries to send request to TCP port
2021-08-09 15:30:58 +03:00
kssenii
d767f6704f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-09 12:14:23 +00:00
kssenii
484c3a5d2e Update kafka test 2021-08-09 11:55:38 +00:00
Vitaly Baranov
5a7fe51532
Merge pull request #27431 from vitlibar/grpc-protocol-bytes-instead-of-strings
Use bytes instead of strings in the GRPC protocol.
2021-08-09 09:51:24 +03:00
kssenii
a5a60a0451 Fix tests 2021-08-09 05:20:41 +00:00
kssenii
7991bb6e83 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-08 21:30:17 +00:00
mergify[bot]
9869c8bb10
Merge branch 'master' into zero_copy_by_default 2021-08-07 16:53:44 +00:00
alexey-milovidov
6b6b4f114b
Merge pull request #27089 from ianton-ru/fix_test_merge_tree_s3_failover
Fix test_merge_tree_s3_failover with debug build
2021-08-07 19:46:37 +03:00
alexey-milovidov
ac3abb8fd2
Update test.py 2021-08-07 19:46:19 +03:00
alexey-milovidov
22bc7eb170
Merge pull request #27294 from Algunenano/better_kafka_errors
Improve kafka integration test error messages
2021-08-07 19:26:31 +03:00
Braulio Valdivielso
3fdc2aae19 test that the tcp handler returns correct http responses
I have added two tests. One checks the usual scenario where the
instance's config specifies a `http_port`. In that case, we expect the
`http_port` to be part of the response. The other scenario checks what
happens when the config doesn't specify a `http_port`. It's hard to
nail down the expectation there without hardcoding the error
response (which is not what we generally want) but I'm mainly checking
that no HTTP port is mentioned. This particular test would have failed
before my previous fix, because the TCP handler wouldn't have managed
to send back an HTTP response and `requests.post` would have thrown an
exception.
2021-08-07 11:56:05 +01:00
kssenii
bc7eaad5ca Fix 2021-08-07 12:35:59 +03:00
kssenii
9ca422f0c5 Introduce CAST for internal usage 2021-08-07 09:03:10 +00:00
kssenii
073d7fdd5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into disk-over-web-server 2021-08-06 19:42:29 +00:00
Vladimir C
9de16c5017
Merge pull request #27216 from ianton-ru/MDB-13990 2021-08-06 18:12:00 +03:00
Raúl Marín
b4e417e507 test_kafka_virtual_columns_with_materialized_view: Limit iterations and show better error 2021-08-06 13:39:33 +02:00
Raúl Marín
4f1b02426a test_storage_kafka: Remove duplicated code 2021-08-06 13:38:56 +02:00
Raúl Marín
226db3f6be Integration runner: Output longer errors 2021-08-06 13:38:30 +02:00
Vitaly Baranov
9a40ce87e9 Use bytes instead of strings in the GRPC protocol. 2021-08-06 13:55:49 +03:00
alexey-milovidov
1a3d8cebd2
Merge pull request #27197 from azat/nullable-index-fix
Fix on-disk format breakage for secondary indices over Nullable column
2021-08-05 21:52:18 +03:00
Anton Ivashkin
0e040ca40c Add 10 seconds cache for S3 proxy resolver 2021-08-05 18:52:04 +03:00
Kseniia Sumarokova
5edd9e0513
Merge pull request #27198 from kssenii/postgres-db-schema
Support schema for postgres database engine
2021-08-05 18:30:47 +03:00
Raúl Marín
479f053f2e Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-05 17:24:10 +02:00
Kruglov Pavel
59a94bd322
Merge pull request #27183 from ClickHouse/fix_detached_parts_name_partsing
Fix part name parsing in system.detached_parts
2021-08-05 18:21:03 +03:00
Maksim Kita
7fdf3cc263
Merge pull request #27180 from kitaisreal/storage-system-replicas-added-column-replica-is-active
Storage system replicas added column replica is active
2021-08-05 12:46:53 +03:00
kssenii
1e38d48364 Fixes 2021-08-05 07:25:47 +00:00
zhangxiao871
9fc4e42766 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_create_znode 2021-08-05 10:21:16 +08:00
Azat Khuzhin
f710f1e954 Cover data skipping indices on disk format (compare with 21.6) 2021-08-05 00:19:32 +03:00
kssenii
f06703a7c9 Support schema for postgres database engine 2021-08-04 20:52:45 +00:00
Alexander Tokmakov
23f8b3d07d fix part name parsing in system.detached_parts 2021-08-04 17:42:48 +03:00
Kseniia Sumarokova
f58727b50f
Merge pull request #27060 from kssenii/library-bridge-fixes
library bridge fixes
2021-08-04 17:12:09 +03:00
Anton Ivashkin
61016da2b1 Set allow_remote_fs_zero_copy_replication to true by default 2021-08-04 17:08:09 +03:00
Maksim Kita
3f48c85722 StorageSystemReplicas added column replica_is_active 2021-08-04 16:19:42 +03:00
kssenii
cc2c1b80df Fix tests 2021-08-03 19:47:59 +00:00
Raúl Marín
aad913291d test_distributed_directory_monitor_split_batch_on_failure: Track everything
Reverting the memory reduction and forcing max_untracked_memory to 0
which should be more reliable and closer to the original test
2021-08-03 14:38:59 +02:00
zhangxiao871
3d3b1658c5 Fix clickhouse-keeper create znode exists and empty condition. 2021-08-03 17:59:08 +08:00
Kseniia Sumarokova
98326ec028
Merge pull request #19526 from taiyang-li/disk_reload
Enable local disk config reload
2021-08-03 08:37:39 +03:00
Kseniia Sumarokova
5d3abc14c7
Merge pull request #22045 from OmarBazaraa/mongo-ssl
Support SSL connection in MongoDB engine
2021-08-03 08:29:34 +03:00
kssenii
087ddeb0dc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-08-02 15:16:09 +00:00
Raúl Marín
9f32ecca89 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-08-02 16:21:10 +02:00
kssenii
294695bb7d Review fixes 2021-08-02 13:40:58 +00:00
Anton Ivashkin
740c169396 Fix test_merge_tree_s3_failover with debug build 2021-08-02 16:08:27 +03:00
Nikolai Kochetov
6951e8147d
Merge pull request #27020 from amosbird/shardlevelconstness
Shard-level const column
2021-08-02 13:45:20 +03:00
alesapin
181f93c60a
Merge pull request #24997 from evillique/nlp
NLP functions
2021-08-02 10:50:40 +03:00
kssenii
5f5bbc1fca Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-08-02 07:20:14 +00:00
kssenii
2bdb97d5e0 Some small changes 2021-08-01 10:06:48 +00:00
kssenii
9c6a8b0059 Restore previous ids passing 2021-08-01 08:59:19 +00:00
kssenii
130253e3b9 Fix bridge-server interaction in case of metadata inconsistency 2021-08-01 08:59:16 +00:00
Amos Bird
c38403998e
Fix flaky 2021-07-31 23:00:10 +08:00
alexey-milovidov
7e5f25ea92
Merge pull request #27026 from excitoon-favorites/runner
Improved `runner` to use `pytest` keyword expressions
2021-07-31 00:09:07 +03:00
alesapin
02176fb4c7 Add experimental flag 2021-07-30 18:25:51 +03:00
Vladimir Chebotarev
1cf4da2df7 Improved runner to use pytest keyword expressions. 2021-07-30 15:59:27 +03:00
alesapin
66e675e54e
Merge pull request #26897 from qoega/test_distributed_respect_user_timeouts-tune
Try increase diff upper bound
2021-07-30 14:28:54 +03:00
Amos Bird
7b9e81742f
Shard level constness 2021-07-30 18:53:34 +08:00
alesapin
916594fe23 Merge branch 'master' into evillique-nlp 2021-07-30 13:03:10 +03:00
kssenii
f1e96dbc55 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into taiyang-li-disk-reload 2021-07-29 07:53:16 +00:00
Yatsishin Ilya
315c3f804c Try increase diff upper bound 2021-07-28 13:29:15 +03:00
Yatsishin Ilya
50ae1b3255 Better tests 2021-07-28 13:22:15 +03:00
OmarBazaraa
6b9e0f5a6f Fix 2021-07-28 09:38:34 +00:00
OmarBazaraa
8acc290bc5 Add integration tests 2021-07-28 09:38:34 +00:00
Alexander Tokmakov
fab4529c97 Merge branch 'master' into rename_materialize_mysql 2021-07-28 12:18:01 +03:00
Raúl Marín
4a09c54a04 Merge remote-tracking branch 'blessed/master' into materialization_log 2021-07-28 10:38:47 +02:00
Ilya Yatsishin
093384f90f
Merge pull request #26827 from qoega/jdbc-bridge-test 2021-07-28 09:34:13 +03:00
Alexander Tokmakov
fc9ab2cda7 Merge branch 'master' into rename_materialize_mysql 2021-07-27 22:38:40 +03:00
Kseniia Sumarokova
b5dce17707
Merge pull request #26821 from azat/rocksdb-improvements
Add system.rocksdb and read rocksdb/rocksdb_TABLE options from config
2021-07-27 17:31:12 +03:00
Raúl Marín
772cc1910a test_distributed_directory_monitor_split_batch_on_failure: Lower memory limit
With the changes, when running under the sanitizers, some of the internala arenas do not reach
the threshold to move from the stack to the heap, so the allocations aren't accounted
and the limit won't be reached

Testing with a lower limit to confirm it's enough to throw in remote queries
but not locally
2021-07-27 16:29:34 +02:00
Raúl Marín
145699d0c2 test_kafka_no_holes_when_write_suffix_failed: Fix expected error message
The old error message was incorrect (it said a failure happened when
pushing the prefix when it was happening while pushing the suffix.
2021-07-27 16:29:34 +02:00
Raúl Marín
ff249a14af Fix test_kafka_no_holes_when_write_suffix_failed 2021-07-27 16:29:34 +02:00
mergify[bot]
242efdd0f1
Merge branch 'master' into jdbc-bridge-test 2021-07-27 14:28:27 +00:00
Kseniia Sumarokova
f2e599d8d1
Merge pull request #26826 from kssenii/rabbit-fix-tests
Try fix rabbitmq tests
2021-07-27 17:07:37 +03:00
Vitaly Baranov
8e98cf7c4d
Merge pull request #26818 from vitlibar/fix-killing-unstopped-containers-in-integration-tests
Fix killing unstopped containers in integration tests.
2021-07-27 15:38:36 +03:00
Yatsishin Ilya
f8c7058bcf Better 2021-07-27 10:33:49 +03:00
Vitaly Baranov
72ab7f598c Fix killing unstopped containers in integration tests. 2021-07-27 09:31:04 +03:00
kssenii
1d50e9a3b9 Add retries 2021-07-27 06:16:40 +00:00
Azat Khuzhin
8ef677b15f Add ability to set any rocksdb option via config.xml
v2: Cover rocksdb options in ClickHouse config
v3: add missing __init__.py
v4: Rework rocksdb options from config
v5: add column_family_options support
2021-07-27 08:40:50 +03:00
Alexander Tokmakov
a7e644f774 support old name 2021-07-26 21:24:32 +03:00
Alexander Tokmakov
63ab38ee09 rename MaterializeMySQL to MaterializedMySQL 2021-07-26 21:17:28 +03:00
Vitaly Baranov
4862e9f80d
Merge pull request #26733 from vitlibar/support-multiple-keys
Support multiple keys for encrypted disk
2021-07-26 10:19:50 +03:00
Vitaly Baranov
51f882d8cc Support multiple keys for encrypted disk. Display error message if the key is probably wrong. 2021-07-24 23:45:12 +03:00
Vitaly Baranov
22728cbca0 Add new functions currentRoles(), enabledRoles(), defaultRoles(). 2021-07-24 23:20:40 +03:00
Vitaly Baranov
7b4e5f8e21
Merge pull request #26759 from vitlibar/changing-default-roles-affects-new-sessions
Changing default roles affects new sessions only.
2021-07-24 23:15:14 +03:00
alexey-milovidov
967fe89917
Merge pull request #26730 from vitlibar/set-profile-applies-constraints-too
SET PROFILE applies constraints too.
2021-07-24 18:53:36 +03:00
Vitaly Baranov
249ccd879e SET PROFILE applies constraints too. 2021-07-23 23:28:55 +03:00
Vitaly Baranov
db97921b5b Changing default roles affects new sessions only. 2021-07-23 23:23:14 +03:00
Vitaly Baranov
c68c74634d
Merge pull request #26707 from vitlibar/fix-set-role
Fix SET ROLE
2021-07-23 23:16:15 +03:00
Vladimir
817ed354ff
Merge pull request #26673 from vdimir/fix_test_materialize_mysql_database 2021-07-23 11:26:19 +03:00
ANDREI STAROVEROV
263c3f9ff3 Add __init__.py for test_access_for_functions 2021-07-23 10:27:35 +03:00
Vitaly Baranov
19d5a6ab2f
Merge pull request #26714 from vitlibar/new-function-current-profiles
New functions currentProfiles(), enabledProfiles(), defaultProfiles().
2021-07-23 09:10:29 +03:00
Vitaly Baranov
7afcc65060 Add new functions currentProfiles(), enabledProfiles(), defaultProfiles(). 2021-07-22 22:20:53 +03:00
ANDREI STAROVEROV
21c577d337 Rename __main__ to __init__ in tests 2021-07-22 20:13:19 +03:00
Vitaly Baranov
d0412994a2 Fix SET ROLE. 2021-07-22 17:41:52 +03:00
Vladimir
ecebd5c132
Merge pull request #26691 from vdimir/fix-ci-runner-listing-error 2021-07-22 15:43:06 +03:00
vdimir
45233666b6
Relax filter for information_schema.processlist in mysql_kill_sync_thread_restore_test 2021-07-22 14:05:23 +03:00
vdimir
f61ecee989
Remove tests/integration/test_foo 2021-07-22 13:33:43 +03:00
vdimir
d1b6274deb
Strip lines in runner output in _get_all_tests 2021-07-22 13:33:05 +03:00
vdimir
a8f986350c
Log errors on integration test listing error in ci-runner 2021-07-22 12:31:15 +03:00
Nikolai Kochetov
5ffd99dfd4
Merge pull request #25674 from amosbird/distributedreturnconnection
Drain connection asynchronously
2021-07-22 11:04:49 +03:00
vdimir
1d0ceff2dc
Fix mysql_kill_sync_thread_restore_test 2021-07-21 18:17:45 +03:00
ANDREI STAROVEROV
c3461ce99a Fix integration tests 2021-07-21 16:04:52 +03:00
ANDREI STAROVEROV
1c99253c6a Fix integration tests 2021-07-21 14:10:37 +03:00
ANDREI STAROVEROV
503d62cce1 Fix integration tests 2021-07-21 12:41:17 +03:00
Realist007
31e26862b5
Merge branch 'master' into feature/create-simple-lambda-function 2021-07-21 10:33:53 +03:00
ANDREI STAROVEROV
31f4fe9a4d Fix tests 2021-07-21 10:29:26 +03:00
ANDREI STAROVEROV
44e1c2bcf5 Fix test for check access rights for functions 2021-07-20 23:42:48 +03:00
ANDREI STAROVEROV
f4e2e552eb Add integration test for persistence 2021-07-20 23:42:23 +03:00
alexey-milovidov
3bcef76a9d
Merge pull request #26529 from kssenii/fixing-rabbitmq
Fix rabbitmq shutdown in case rabbitmq setup was not started
2021-07-20 16:41:25 +03:00
Nikita Mikhaylov
47c1bb3416
Merge pull request #25822 from ClickHouse/fix_no_column_materialized_mysql
Fix 'Not found column' error in MaterializeMySQL
2021-07-20 15:03:54 +03:00
ANDREI STAROVEROV
6ce203504b Add access rights 2021-07-20 02:34:04 +03:00
kssenii
63c05e6e14 Fix rabbitmq shutdown in case rabbitmq setup was not started 2021-07-19 21:06:10 +00:00
Amos Bird
dbfb699690
Asynchronously drain connections. 2021-07-19 21:53:29 +08:00
mergify[bot]
39f71f4a08
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-19 12:27:38 +00:00
Yatsishin Ilya
cdc8f2f743 fix new test 2021-07-19 11:32:20 +03:00
Yatsishin Ilya
2ae7d72dc9 merge remote-tracking branch 'origin' into integration-6 2021-07-19 09:49:17 +03:00
Vitaly Baranov
1fc822b19d
Merge pull request #26465 from vitlibar/explicit-encryption-mode
Set encryption algorithm explicitly.
2021-07-19 09:38:02 +03:00
Vitaly Baranov
81ea8521b1 Set encryption algorithm explicitly. 2021-07-18 10:29:42 +03:00
alexey-milovidov
7dda0da027
Merge pull request #26461 from azat/integration-tests-fixes-v21.9.1.7477
Fix flaky test_replicated_mutations (due to lack of threads in pool)
2021-07-17 19:22:30 +03:00
Azat Khuzhin
bb22615fad Fix flaky test_replicated_mutations (number_of_free_entries_in_pool_to_execute_mutation=0)
CI reports [1]:

    2021.07.16 09:09:21.040944 [ 172 ] {} <Debug> DiskLocal: Reserving 1.00 MiB on disk `default`, having unreserved 18.00 GiB.
    ...
    2021.07.16 09:09:21.041200 [ 28 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000288 of type MUTATE_PART for part 200201_3_3_0_16 because source parts size (217.00 B) is greater than the current maximum (0.00 B).
    2021.07.16 09:09:21.041529 [ 171 ] {} <Debug> DiskLocal: Reserving 1.00 MiB on disk `default`, having unreserved 18.00 GiB.
    2021.07.16 09:09:21.041838 [ 34 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000288 of type MUTATE_PART for part 200201_3_3_0_16 because source parts size (217.00 B) is greater than the current maximum (0.00 B).
    2021.07.16 09:09:21.042359 [ 34 ] {} <Debug> default.test_mutations (ReplicatedMergeTreeQueue): Not executing log entry queue-0000000290 of type MUTATE_PART for part 200201_12_12_0_16 because source parts size (237.00 B) is greater than the current maximum (0.00 B).

  [1]: https://clickhouse-test-reports.s3.yandex.net/26336/a3653bd665bd59c7c05b0fcd58ea2246e0b69915/integration_tests_(thread).html#fail1
2021-07-17 11:50:04 +03:00
mergify[bot]
89634ae224
Merge branch 'master' into estimates_for_select_query 2021-07-16 23:15:30 +00:00
alexey-milovidov
38dfe1fc0a
Merge pull request #26172 from ClickHouse/exception_id
Add error id to exceptions
2021-07-17 02:07:17 +03:00
Vitaly Baranov
958494b98e
Merge pull request #26377 from vitlibar/encrypted-disk-comments-and-improvements
Add comments for encrypted disks; some improvements in code.
2021-07-16 21:24:51 +03:00
Yatsishin Ilya
d11ec777c9 Merge remote-tracking branch 'origin' into integration-6 2021-07-16 16:28:02 +03:00
Yatsishin Ilya
e6b724ad3f postgres rework 2021-07-16 16:26:35 +03:00
alexey-milovidov
72ed5e0dfb
Merge pull request #26031 from nvartolomei/nv/test-cte-distributed
Test CTE with aggregation over distributed table
2021-07-16 12:24:29 +03:00
Vitaly Baranov
9cc258327e Add comments for encrypted disks; some improvements in code. 2021-07-16 12:04:25 +03:00
Vitaly Baranov
427813071d
Merge pull request #26363 from vitlibar/fix-crash-login-as-dropped-user
Fix possible crash when login as dropped user
2021-07-16 09:47:35 +03:00
Yatsishin Ilya
aa698f6c98 better 2021-07-15 15:49:52 +03:00
Yatsishin Ilya
be9a0a9ca2 better test_storage_s3, test_storage_s3_get_unstable still not OK 2021-07-15 15:49:25 +03:00
Yatsishin Ilya
51fcaa906c add sync for on cluster ddl 2021-07-15 15:48:09 +03:00
Vitaly Baranov
c2bb0a02a8 Add test. 2021-07-15 14:36:56 +03:00
Alexey Milovidov
d984fc4301 Fix flaky integration test 2021-07-15 13:35:37 +03:00
vdimir
dd3e1a8a4d
Adjust exception message in test_replicated_fetches_timeouts 2021-07-15 11:58:21 +03:00
alexey-milovidov
21f2b006cd
Update test_cte_distributed.py 2021-07-15 08:17:22 +03:00
Kseniia Sumarokova
e42a26a585
Merge pull request #26234 from jasine/master
convert timestamp and  timestamptz data types to DateTime64 in postgres engine
2021-07-14 23:42:51 +03:00
Peng Jian
eed01abf65 fix test case 2021-07-14 20:42:02 +08:00
vdimir
55d12a497c
Adjust integration test to exception messages 2021-07-14 14:50:27 +03:00
Zhichang Yu
fe5d17680e Merge remote-tracking branch 'origin/master' into zero_copy_hdfs 2021-07-14 02:12:28 +00:00
jasine
bd59ca22df
fix: style and MaterializedPostgreSQL test (#3)
fix: style and MaterializedPostgreSQL test (#3)
2021-07-14 08:51:14 +08:00
alexey-milovidov
c01497a80a
Merge pull request #26028 from nvartolomei/nv/aggregate-alias-column
Add test case for aggregation w/ alias columns
2021-07-14 03:30:14 +03:00
mergify[bot]
d5898ecba6
Merge branch 'master' into fix_no_column_materialized_mysql 2021-07-13 14:03:05 +00:00
alexey-milovidov
2dafd9d4a8
Update test_select_aggregate_alias_column.py 2021-07-13 11:39:15 +03:00
Vitaly Baranov
e086e5e384
Merge branch 'master' into alexelex-encryption-1 2021-07-13 11:28:41 +03:00
jasine
9832c48c33
fix postgres test and array of DateTime64 (#1)
fix postgres test and array of DateTime64
2021-07-13 15:28:15 +08:00
Zhichang Yu
a9028dbd7d try fix test_replicated_merge_tree_hdfs_zero_copy/test.py failures under tsan 2021-07-13 07:20:23 +00:00
Zhichang Yu
b4e6689bf9 fix test_hdfs_zero_copy_replication_move[tiered_copy-2] 2021-07-13 07:20:23 +00:00
Zhichang Yu
5047c758f4 fix per review 2021-07-13 07:20:20 +00:00
Zhichang Yu
fbd5eee8a1 hdfs zero copy 2021-07-13 07:19:12 +00:00
Anton Popov
313cd0077d
Fix output of TSV in integration tests 2021-07-12 20:23:19 +03:00
Yatsishin Ilya
a4a960328e Merge remote-tracking branch 'origin' into integration-6 2021-07-12 11:34:23 +03:00
Yatsishin Ilya
143368d8d6 wip 2021-07-12 11:32:20 +03:00
Alexey Milovidov
57b5c0e1e5 Adjust integration tests 2021-07-12 08:59:01 +03:00