Commit Graph

538 Commits

Author SHA1 Message Date
Arthur Passos
032a74ec3a make sure instance env variables override global ones 2023-10-03 10:33:55 -03:00
Arthur Passos
9695bf5db9 Revert "rename setting"
This reverts commit 0b97cd49e8.
2023-10-02 18:26:31 -03:00
Arthur Passos
0b97cd49e8 rename setting 2023-10-02 18:21:20 -03:00
Arthur Passos
3813e59b49 minor 2023-10-02 18:19:41 -03:00
Arthur Passos
e74e7ae19a more docs 2023-10-02 16:09:35 -03:00
Arthur Passos
23074c2c03 add comment 2023-10-02 16:04:02 -03:00
Arthur Passos
5eda3dfc39 add exclusive_environment_variables option to inte gtests 2023-10-02 15:59:15 -03:00
Julian Maicher
7db4023928 style: Apply black formatter 2023-09-30 07:04:05 +02:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
robot-clickhouse
87e434304c Automatic style fix 2023-09-28 15:47:24 +00:00
Nikolai Kochetov
1326d9935f Clean data dir and always start an old server version in aggregate functions compatibility test. 2023-09-28 15:28:26 +00:00
Antonio Andelic
1494eb3a86 Fix version parsing 2023-09-11 12:34:16 +00:00
Antonio Andelic
5f1a75ceae Fix tests 2023-09-01 12:13:33 +00:00
robot-clickhouse
3999994eb4 Automatic style fix 2023-08-31 15:07:26 +00:00
Antonio Andelic
7739dd7157 Fix integration tests 2023-08-31 14:52:42 +00:00
Antonio Andelic
322b53dd62 Merge branch 'master' into keeper-batch-flushes 2023-08-24 09:08:47 +00:00
robot-clickhouse
ee5d7b1d95 Automatic style fix 2023-08-23 08:22:54 +00:00
Antonio Andelic
cceb2b2d57 Disable integration with async replication 2023-08-23 08:12:05 +00:00
Konstantin Bogdanov
45856df18c
Remove time.sleep(1) 2023-08-23 08:08:01 +02:00
Antonio Andelic
ef3e0f7b83 Use async replication in tests 2023-08-09 06:25:47 +00:00
Nikolai Kochetov
8f5d0c0cd4 Revert "Merge pull request #52514 from azat/tests/fix-test_version_update_after_mutation"
This reverts commit dd491eeae2, reversing
changes made to b225f9c34b.
2023-07-31 13:03:04 +00:00
Azat Khuzhin
0401dc453e Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop
Since there can be some leftovers:

    2023.07.24 07:08:25.238066 [ 140 ] {} <Error> Application: Code: 219. DB::Exception: Cannot drop: filesystem error: in remove: Directory not empty ["/var/lib/clickhouse/data/system/"]. Probably database contain some detached tables or metadata leftovers from Ordinary engine. If you want to remove all data anyway, try to attach database back and drop it again with enabled force_remove_data_recursively_on_drop setting: Exception while trying to convert database system from Ordinary to Atomic. It may be in some intermediate state. You can finish conversion manually by moving the rest tables from system to .tmp_convert.system.9396432095832455195 (using RENAME TABLE) and executing DROP DATABASE system and RENAME DATABASE .tmp_convert.system.9396432095832455195 TO system. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000e68af57 in /usr/bin/clickhouse
    1. ? @ 0x000000000cab443c in /usr/bin/clickhouse
    2. DB::DatabaseOnDisk::drop(std::shared_ptr<DB::Context const>) @ 0x000000001328d617 in /usr/bin/clickhouse
    3. DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000013524a6c in /usr/bin/clickhouse
    4. DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000013bc05e4 in /usr/bin/clickhouse
    5. DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000013bbc6b8 in /usr/bin/clickhouse
    6. DB::InterpreterDropQuery::execute() @ 0x0000000013bbba22 in /usr/bin/clickhouse
    7. ? @ 0x00000000140b13a5 in /usr/bin/clickhouse
    8. DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x00000000140ad20e in /usr/bin/clickhouse
    9. ? @ 0x00000000140d2ef0 in /usr/bin/clickhouse
    10. DB::maybeConvertSystemDatabase(std::shared_ptr<DB::Context>) @ 0x00000000140d0aaf in /usr/bin/clickhouse
    11. DB::Server::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000e724e55 in /usr/bin/clickhouse
    12. Poco::Util::Application::run() @ 0x0000000017ead086 in /usr/bin/clickhouse
    13. DB::Server::run() @ 0x000000000e714a5d in /usr/bin/clickhouse
    14. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000017ec07b9 in /usr/bin/clickhouse
    15. mainEntryClickHouseServer(int, char**) @ 0x000000000e711a26 in /usr/bin/clickhouse
    16. main @ 0x0000000008cf13cf in /usr/bin/clickhouse
    17. __libc_start_main @ 0x0000000000021b97 in /lib/x86_64-linux-gnu/libc-2.27.so
    18. _start @ 0x00000000080705ae in /usr/bin/clickhouse
     (version 23.7.1.2012)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 10:34:50 +02:00
Nikolai Kochetov
e02a7c7382
Merge pull request #52375 from ClickHouse/disable-analyzer-bc-tests
Disable analyzer setting in backward_compatibility integration tests.
2023-07-21 13:39:06 +02:00
Alexander Tokmakov
a39ba00ec3
Merge pull request #52116 from aalexfvk/http_failover
Handle multiple resolved IPs for HTTP/HTTPS session connection
2023-07-20 18:25:45 +03:00
robot-clickhouse
a26de1b370 Automatic style fix 2023-07-20 15:12:55 +00:00
Nikolai Kochetov
ea252e2f61 Disable analyzer setting in backward_compatibility integration tests. 2023-07-20 15:05:07 +00:00
Ilya Golshtein
c550a532e6 test_for_basic_auth_registry - black formatter happy + some doc 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
Aleksei Filatov
801d0955ec Add tests 2023-07-15 08:18:35 +03:00
robot-ch-test-poll
93b40c490f
Merge pull request #51945 from arenadata/ADQM-950-B
Implement support of date/time format specifiers in log and error log file names
2023-07-14 18:54:27 +02:00
Dmitry Novik
ee2392bf8e Merge remote-tracking branch 'origin/master' into analyzer-integration-tests 2023-07-11 08:55:31 +00:00
Victor Krasnov
e592c7c353 Fix integration tests - recover clickhouse_stay_alive_command lost by incomplete copy-paste 2023-07-11 10:32:33 +08:00
Victor Krasnov
e311d31d87 Merge branch 'master' into ADQM-950-B 2023-07-10 15:50:09 +08:00
Alexey Milovidov
b5f9a170eb
Merge pull request #51848 from ClickHouse/many-fixes-3
Many fixes [3]
2023-07-07 13:29:49 +03:00
Victor Krasnov
63fbde41fe Reformat cluster.py (add empty line) 2023-07-07 11:01:39 +08:00
Alexander Tokmakov
fdbd59ec6c
Merge pull request #51135 from ClickHouse/fix_trash_in_disks
Try to fix some trash in Disks and part moves
2023-07-07 02:02:17 +03:00
Victor Krasnov
479efaa79a Add clickhouse_log_file and clickhouse_error_log_file args to add_instance() 2023-07-06 14:16:18 +08:00
Antonio Andelic
57ada39ccf Add retries and iptables rules dump 2023-07-04 09:31:15 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests 2023-06-29 12:24:19 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too 2023-06-28 22:19:32 +02:00
robot-clickhouse
fc5ed7ffd7 Automatic style fix 2023-06-21 18:45:28 +00:00
Alexander Tokmakov
9157314b2a fix 2023-06-21 20:29:32 +02:00
Dmitry Novik
49f88f5873 Fix ENV variable name 2023-06-15 14:15:01 +00:00
robot-clickhouse
5d54133248 Automatic style fix 2023-06-13 13:31:14 +00:00
Dmitry Novik
9e8ca5f5ae Add integration test check with enabled analyzer 2023-06-13 13:09:39 +00:00
Sema Checherinda
2c018f5261 do not call finalize after exception 2023-06-13 10:48:31 +02:00
Vitaly Baranov
6d45d0c374
Use fingerprints instead of key IDs in encrypted disks (#49882)
* Use fingerprints instead of key IDs to find keys in encrypted disks.
Always use little endian in the headers of encryption files.

* Add tests.

* Fix copying binary files to test containers.

* Fix ownership for copied files in test containers.

* Add comments after review.

---------

Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2023-05-31 13:11:10 +02:00
Alexander Tokmakov
6cf3e5b77a fix race on loading dictionaries 2023-05-05 15:25:18 +02:00
Alexey Milovidov
98ae9be734
Revert "Added tests for ClickHouse apps help and fixed help issues" 2023-04-21 01:54:34 +03:00
Kseniia Sumarokova
5a8efd3261
Update cluster.py 2023-04-19 17:35:57 +02:00
Ilya Yatsishin
ebb1b990f2
Merge pull request #45819 from qoega/clickhouse-help 2023-04-18 21:46:36 +02:00
Kseniia Sumarokova
9e7d8000a3
Update cluster.py 2023-04-15 13:00:38 +02:00
Vitaly Baranov
80d6b82ac9 Allow starting integration tests without spark. 2023-04-15 11:29:03 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
kssenii
b9811573be Better 2023-04-13 15:10:49 +02:00
kssenii
37691e573a Fix black check, add with_spark 2023-04-13 11:12:24 +02:00
kssenii
0c8d65b759 Fix java error 2023-04-12 23:12:49 +02:00
Alexey Milovidov
9a3030803e
Merge pull request #48596 from azat/ci/second_deadlock_stack
Add second_deadlock_stack=1 for TSan on CI and fix some lock-order-inversion problems
2023-04-12 22:11:06 +03:00
Yatsishin Ilya
514bb8aff5 Merge remote-tracking branch 'origin' into clickhouse-help 2023-04-12 06:45:22 +00:00
kssenii
e32c98e412 Close spark session 2023-04-11 17:25:32 +02:00
Yatsishin Ilya
b5b65d2149 Merge remote-tracking branch 'origin' into clickhouse-help 2023-04-11 11:24:48 +00:00
Azat Khuzhin
7cd4009c3d Fix flakiness of test_store_cleanup in case of image rebuild
The log level will be substituted from "test" to "trace" in case of the
tag is not "latest", the assumption behind this I guess is that it
should not try to use "test" log level for older versions.

But, it could have per-PR image in case of changes in the Dockerfile, so
it is better to check for self.with_installed_binary, since actually any
parameters except this will use new clickhouse binary anyway.

CI: https://s3.amazonaws.com/clickhouse-test-reports/48596/a1272e8536265929255fdf5020836f057859e425/integration_tests__tsan__[1/6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 20:31:06 +02:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:17:43 +02:00
Azat Khuzhin
bbee1a36be Add a comment for use_sigaltstack=0 ASan option
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-04-10 15:06:40 +02:00
Mikhail f. Shiryaev
5bcbdc958a
Reduce probability of reusing the same port 2023-04-04 17:18:24 +02:00
Mikhail f. Shiryaev
a42af5e4ac
Simplify get_free_port helper function 2023-04-04 16:56:42 +02:00
Yatsishin Ilya
26aacd3d2d Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-28 16:57:58 +00:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
kssenii
e48d8d12e7 Fixes for hudi 2023-03-17 19:44:30 +01:00
Yatsishin Ilya
d4304d2028 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-03-02 16:16:18 +00:00
Kruglov Pavel
ce8e49a9a0
Merge pull request #45693 from Avogar/fix-kafka-protobuf
Fix formats parser resetting, test processing bad messages in kafka
2023-03-02 11:50:45 +01:00
Yatsishin Ilya
76e7e15f67 black and tty 2023-02-24 13:36:43 +00:00
Yatsishin Ilya
80857638c1 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-22 13:58:17 +00:00
Kruglov Pavel
828a06b511
Merge branch 'master' into fix-kafka-protobuf 2023-02-20 21:45:43 +01:00
Alexander Tokmakov
9a664efeb6
Merge branch 'master' into fixes_for_993 2023-02-17 14:17:08 +03:00
Geoff Genz
33037334a5 Add raw content option to http helper methods 2023-02-15 07:17:28 -07:00
Kruglov Pavel
e56dead5aa
Merge branch 'master' into fix-kafka-protobuf 2023-02-15 15:16:25 +01:00
robot-clickhouse
dce8dca4e5 Automatic style fix 2023-02-13 23:53:15 +00:00
Alexander Tokmakov
e712fbecb2 fix race between drop and create 2023-02-14 00:45:28 +01:00
Kseniia Sumarokova
3977643b52
Update cluster.py 2023-02-13 13:42:21 +01:00
Kruglov Pavel
947923321c
Fix style 2023-02-09 14:55:21 +01:00
Kruglov Pavel
59c52c503d
Fix style 2023-02-09 14:09:46 +01:00
Kruglov Pavel
c3c0356fdd
Merge branch 'master' into fix-kafka-protobuf 2023-02-09 13:04:55 +01:00
Yatsishin Ilya
1baa15d603 Merge remote-tracking branch 'origin/master' into clickhouse-help 2023-02-07 15:46:59 +00:00
Yatsishin Ilya
ff4e10fdd4 print what is running when can't stop clickhouse 2023-02-07 15:46:55 +00:00
Azat Khuzhin
0a598c79f4 Remove misleading information that sanitizer errors are in the docker.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Azat Khuzhin
88dc85e13e Dump sanitizer errors in the integration tests logs
Previously you need to download the artifacts (0.5G+-), or reproduce the
problem.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-04 11:23:26 +01:00
Azat Khuzhin
e6695196aa tests/integration: add SYS_ADMIN capability for mount/remount
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
1e3f33ad4b tests/integration: fix --privileged passthrough
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
avogar
0a99d421f5 Fix formats parser resetting, test processing bad messages in kafka 2023-01-27 13:22:50 +00:00
Yatsishin Ilya
5ae72fe711 Improve failed kafka startup logging 2023-01-17 16:25:05 +00:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Azat Khuzhin
c03510cf6b tests/integration: add query_and_get_error_with_retry() helper
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-06 12:45:03 +01:00
Yatsishin Ilya
bbc02c0762 black 2023-01-03 21:28:54 +00:00
Yatsishin Ilya
14274d650b Rewrite test_postgres_protocol test 2023-01-03 19:30:14 +00:00