Commit Graph

3627 Commits

Author SHA1 Message Date
kssenii
55430feac9 Improve tests part 2 2022-01-09 15:12:46 +03:00
kssenii
6639a93735 Better 2022-01-09 12:16:12 +03:00
kssenii
61f85e9afc More fixes 2022-01-08 20:44:17 +03:00
alesapin
0860acb4ef
Merge pull request #33246 from nicelulu/fix_acl_map
Fix acl map num
2022-01-08 17:48:00 +03:00
kssenii
c94f4163f7 Merge remote-tracking branch 'upstream/master' into fix-materialized-postgresql-ddl-validation 2022-01-08 15:56:46 +03:00
kssenii
64538cf20f Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-08 00:49:08 +03:00
kssenii
b0530682e4 Improve tests 2022-01-08 00:47:29 +03:00
mergify[bot]
6fcd5a7d41
Merge branch 'master' into MDB-15474 2022-01-07 10:12:25 +00:00
zhangxiao871
3c7ad9a8e9 fix test 2022-01-07 18:09:23 +08:00
alesapin
b1d2bdf569
Merge pull request #33130 from kssenii/validate-config
Validate config keys for external dictionaries
2022-01-07 12:59:02 +03:00
zhangxiao871
ec75d23404 add test 2022-01-07 17:45:30 +08:00
JackyWoo
99e6812288 add tests 2022-01-07 15:53:20 +08:00
lgbo-ustc
6a6b6594c3 update test_hive_query 2022-01-07 12:22:57 +08:00
Alexey Milovidov
b7320ee5b1 Remove some garbage 2022-01-07 05:16:31 +03:00
Alexey Milovidov
2cdd8d321f Fix error 2022-01-06 22:07:12 +03:00
Mikhail f. Shiryaev
a52e6013b5
Fix wrong formatting for kerberos tag 2022-01-06 13:48:16 +01:00
lgbo-ustc
2bbd2939c6 try to fix integration test failures 2022-01-05 10:22:05 +08:00
mergify[bot]
327e9572bb
Merge branch 'master' into dotnet-integration-test 2022-01-04 16:35:28 +00:00
李扬
2df2442ad0
Merge branch 'master' into hive_table 2022-01-04 01:26:16 -06:00
Maksim Kita
c3521bfdf9
Merge pull request #33343 from azat/tests-new-kafka-formats
Cover CustomSeparated/Template formats for Kafka
2022-01-03 14:04:36 +03:00
Stig Bakken
4b109e5399 Add integration test for EXPLAIN TABLE OVERRIDE 2022-01-03 10:58:05 +01:00
Alexey Milovidov
53e3ecb90d Move to separate directory 2022-01-03 03:44:03 +03:00
Alexey Milovidov
2c7a8db58c Add test output and compare to reference 2022-01-03 03:36:23 +03:00
Alexey Milovidov
9678179ba0 Fix a typo 2022-01-03 03:03:49 +03:00
Alexey Milovidov
f790bcfe03 Add something to somewhere 2022-01-03 03:03:26 +03:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
d08b1231d7
Update runner 2022-01-03 02:56:23 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
Azat Khuzhin
63eac4b0cf tests/integration/test_storage_kafka: cover CustomSeparated 2021-12-31 12:02:21 +03:00
Azat Khuzhin
f1c726a675 tests/integration/test_storage_kafka: cover Template format 2021-12-31 11:25:08 +03:00
cmsxbc
c28fcd5a2f
support <secure/> for cluster 2021-12-30 23:51:05 +08:00
JackyWoo
569ce62e8d use session_timeout as session timeout uper bound 2021-12-30 17:18:51 +08:00
alesapin
cbdba89d65 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-30 11:21:19 +03:00
Azat Khuzhin
52ad7a4538 Fix test_storage_kafka failures by adjusting retention.ms
This test uses predefined timestamps, and default retention.ms is too
small:

    kafka1_1           | [2021-12-28 21:40:21,842] INFO Created log for partition virt2_0-0 in /var/lib/kafka/data with properties {compression.type -> producer, message.format.version -> 2.2-IV1, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. (kafka.log.LogManager)

    kafka1_1           | [2021-12-28 21:40:24,540] INFO [Log partition=virt2_0-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)

v2: fix tests with 0 timestamp_ms
    and this should be all tests that was left:

    $ fgrep 'Found deletable segments with base offsets' test_storage_kafka/_instances_0/docker.log
    kafka1_1           | [2021-12-29 09:46:15,610] INFO [Log partition=avro1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
    kafka1_1           | [2021-12-29 09:51:15,609] INFO [Log partition=virt1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
2021-12-30 10:25:10 +03:00
Nicolae Vartolomei
1868570920 Add test for broken connection 2021-12-29 20:11:37 +00:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
alesapin
7a3c874651 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-29 19:01:43 +03:00
Kseniia Sumarokova
3bb9da0286
Merge pull request #33266 from kssenii/rabbit-wait-container
Wait for RabbitMQ container to actually start when it was restarted in test on purpose
2021-12-29 18:45:34 +03:00
Mikhail f. Shiryaev
272ea7fc5b
Merge pull request #32609 from cmsxbc/query-kind-concurent_restriction
add settings: max_concurrent_select_queries and max_concurrent_insert_queries
2021-12-29 15:23:45 +01:00
JackyWoo
7e6cd4adbb add tests 2021-12-29 21:25:55 +08:00
JackyWoo
d35e5f8319 add lower bound session timeout to keeper 2021-12-29 20:59:01 +08:00
alesapin
7e1767542c
Merge pull request #33249 from nicelulu/fix_acl
clickhouse-keeper acl consistent with zookeeper, accept generated digest
2021-12-29 13:21:10 +03:00
kssenii
2279dd0c7f Reuse check_rabbitmq_is_available 2021-12-29 13:14:21 +03:00
alesapin
739297b169
Merge pull request #33268 from den-crane/patch-53
Mark max_alter_threads as obsolete
2021-12-29 13:01:57 +03:00
Kruglov Pavel
dd7f61b337
Merge branch 'master' into schema-inference 2021-12-29 12:59:05 +03:00
Maksim Kita
a5256e5b6e
Merge pull request #30957 from kitaisreal/executable-refactoring
Executable refactoring
2021-12-29 12:43:41 +03:00
avogar
e3dbfe6bf6 Better test url engine 2021-12-29 12:18:56 +03:00
avogar
bc5f428f97 Fix tests 2021-12-29 12:18:56 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
Denny Crane
8b46053e8a
fix test. Output is in another order 2021-12-28 19:50:55 -04:00
kssenii
c8dcde7843 Fix 2021-12-28 23:57:36 +03:00
Denny Crane
031451ed17 replace obsolete max_alter_threads with max_final_threads in documentation examples 2021-12-28 16:48:34 -04:00
Maksim Kita
b5698ea134 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
41437b72f1 Fixed integration tests 2021-12-28 22:55:31 +03:00
Maksim Kita
3386378050 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
fbe65658a1 Fixed tests 2021-12-28 22:55:31 +03:00
Maksim Kita
c2977dbf58 Updated test_executable_table_function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
de49a25185 Fixed build 2021-12-28 22:55:30 +03:00
Maksim Kita
cda8bd7f44 Added test_executable_dictionary source tests 2021-12-28 22:55:30 +03:00
Maksim Kita
04f5763f69 Added test_executable_dictionary tests 2021-12-28 22:55:30 +03:00
Maksim Kita
72909c67c2 Fix executable function tests 2021-12-28 22:55:30 +03:00
Maksim Kita
5590cfa3aa Updated executable function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
d3e507b9ef Added executable function integrations tests 2021-12-28 22:55:30 +03:00
kssenii
67c5b41a58 Fix 2021-12-28 22:16:16 +03:00
kssenii
e9b4439a47 Fix 2021-12-28 15:08:40 +03:00
taiyang-li
aa97634d9b merge master 2021-12-28 18:38:50 +08:00
zhangxiao871
daa4c9e33b clickhouse-keeper acl consistent with zookeeper, accept generated digest 2021-12-28 17:17:01 +08:00
kssenii
61a2516c8c Merge remote-tracking branch 'upstream/master' into validate-config 2021-12-28 11:30:30 +03:00
alesapin
90db762c87
Merge pull request #33215 from ClickHouse/fix_flaky_integration_tests
Fix some flaky integration tests
2021-12-28 11:27:46 +03:00
alesapin
875eb54754
Update test.py 2021-12-28 11:21:33 +03:00
Vladimir C
bb6fc853e3
Merge pull request #31442 from vdimir/cluster-discovery 2021-12-28 10:53:30 +03:00
Kseniia Sumarokova
0178fb5e0b
Merge pull request #33214 from kssenii/external-database-fix-where-false
Fix WHERE 1=0 for external databases query
2021-12-27 18:53:52 +03:00
kssenii
55dfaef4de Settings changes as key value 2021-12-27 17:45:00 +03:00
vdimir
d3b1058c40
cluster discovery configuration, support shards 2021-12-27 15:26:11 +03:00
vdimir
fbdb5c60bd
initial initialization of cluster discovery in main thread 2021-12-27 15:26:10 +03:00
vdimir
57cbbd9fcf
global option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
96a0371eca
add option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
ceec643f90
update config structure: remote_servers_discovery -> remote_servers.discovery 2021-12-27 15:26:09 +03:00
vdimir
1f460f05fe
add retry for first check in test_cluster_discovery_startup_and_stop 2021-12-27 15:26:07 +03:00
vdimir
43bfcacd61
Add test_cluster_discovery 2021-12-27 15:26:06 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
alesapin
48f0cee798 Merge branch 'master' into fix_flaky_integration_tests 2021-12-27 14:38:26 +03:00
alesapin
4eb8c11bb0
Merge pull request #33163 from azat/fix-test_input_format_parallel_parsing_memory_tracking
Make test_input_format_parallel_parsing_memory_tracking less flaky
2021-12-27 14:36:32 +03:00
alesapin
593dc6cf90 Fix some flaky integration tests 2021-12-27 12:24:19 +03:00
kssenii
a1aab3a82d Fix 2021-12-27 11:59:33 +03:00
Vladimir C
ea5f867289
Merge pull request #33179 from kssenii/materialized-postgresql-fix-detach-with-schema 2021-12-27 11:42:59 +03:00
Vladimir C
211a5a8d6b
Merge pull request #33159 from xuyatian/master 2021-12-27 11:40:59 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
568aeec0b3 Review fix 2021-12-27 09:51:29 +03:00
Yatian Xu
8dc07dff4a add Clarification for test case 2021-12-26 11:24:47 -08:00
kssenii
9f17e7bad0 Fix ddl validation 2021-12-26 20:56:31 +03:00
Azat Khuzhin
906ebc9fd4 test_input_format_parallel_parsing_memory_tracking: increase max_server_memory_usage
Even after disabling all system tables TSan build still not passed,
since it uses 2.8Gi of RAM just after start, so let's increase this
memory limit a little.
2021-12-26 16:50:35 +03:00
Azat Khuzhin
3f752c3acb Make test_input_format_parallel_parsing_memory_tracking less flaky
By disabling system tables, that may consume memory too.

Also note, that failures with "curl: (56) Recv failure: Connection reset
by peer" like [1] is due to memory, since the server was under memory
pressure, and was not able even to accept the connection:

<details>

    2021.12.25 00:22:02.957658 [ 54 ] {} <Error> ThreadStatus: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 2.81 GiB (attempt to allocate chunk of 2097182 bytes), maximum: 2.79 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

    0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:0: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x1addca1b in /usr/bin/clickhouse
    1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:57: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa0e993c in /usr/bin/clickhouse
    2. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1444: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*&&, char const*&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&) @ 0xa11344b in /usr/bin/clickhouse
    3. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:226: MemoryTracker::allocImpl(long, bool) @ 0xa11220c in /usr/bin/clickhouse
    4. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:258: MemoryTracker::allocImpl(long, bool) @ 0xa111faa in /usr/bin/clickhouse
    5. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:264: MemoryTracker::alloc(long) @ 0xa112bc6 in /usr/bin/clickhouse
    6. ./obj-x86_64-linux-gnu/../src/Common/ThreadStatus.cpp:152: DB::ThreadStatus::~ThreadStatus() @ 0xa10e182 in /usr/bin/clickhouse
    7. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:518: DB::TCPHandler::runImpl() @ 0x17c4192d in /usr/bin/clickhouse
    8. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1909: DB::TCPHandler::run() @ 0x17c55328 in /usr/bin/clickhouse
    9. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x1ac19f03 in /usr/bin/clickhouse
    10. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1397: Poco::Net::TCPServerDispatcher::run() @ 0x1ac1a773 in /usr/bin/clickhouse
    11. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x1ae7e796 in /usr/bin/clickhouse
    12. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:56: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x1ae7c930 in /usr/bin/clickhouse
    13. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/SharedPtr.h:277: Poco::ThreadImpl::runnableEntry(void*) @ 0x1ae7afa8 in /usr/bin/clickhouse
    14. __tsan_thread_start_func @ 0xa039dfd in /usr/bin/clickhouse
    15. ? @ 0x7f4c565cf609 in ?
    16. clone @ 0x7f4c564f6293 in ?
     (version 21.13.1.1305)

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html
2021-12-26 16:50:34 +03:00
kssenii
e663cb4574 Fix detaching-attaching table with schema 2021-12-25 19:51:55 +03:00
alexey-milovidov
f9d961d46d
Merge pull request #33164 from azat/fix-test_async_drain_connection
Fix test_async_drain_connection flakiness
2021-12-25 16:23:17 +03:00
Kruglov Pavel
22dbaec11a
Merge pull request #33142 from Avogar/fix-s3-write
Don't allow to write into S3 if path contains globs
2021-12-25 16:07:38 +03:00
kssenii
59dd5ba063 Validate config keys for external dictionaries 2021-12-25 14:26:35 +03:00
Azat Khuzhin
42ab02a810 Fix test_async_drain_connection flakiness
Sometimes [1] 5 seconds is not enough, since drain_timeout is 3 seconds,
and 2 seconds sometimes is not enough to do other things, especially
under sanitizers:

    E           Code: 159. DB::Exception: Received from 172.16.1.2:9000. DB::Exception: Timeout exceeded: elapsed 5.019254094 seconds, maximum: 5. Stack trace:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/826f7cb0f53e20e67ef52800cb735bb88a6de658/integration_tests__thread__actions__[4/4].html
2021-12-25 11:55:57 +03:00