Commit Graph

3854 Commits

Author SHA1 Message Date
mergify[bot]
65e940d55c
Merge branch 'master' into MaterializeMySQL_support_set_and_other_dataType 2022-01-21 11:37:22 +00:00
Maksim Kita
548a7bccee
Merge pull request #33804 from CurtizJ/redis-pool
Use connection pool for redis dictionary
2022-01-21 11:40:35 +01:00
zzsmdfj
f54d607b3b to MaterializeMySQL_support_set_and_other_dataType 2022-01-21 12:24:13 +08:00
zzsmdfj
e380e59b16 MaterializeMySQL support SET YEAR TIME GEOMETRY dataType 2022-01-21 12:24:11 +08:00
Kruglov Pavel
7bfb1231b9
Merge branch 'master' into formats-with-suffixes 2022-01-20 14:47:17 +03:00
Kseniia Sumarokova
064c3dd654
Merge pull request #33724 from liuneng1994/fix_ignore_hdfs_error
Throw exception when storage hdfs list directory failed
2022-01-20 11:59:09 +03:00
Anton Popov
4810d13aff use connection pool for redis dictionary 2022-01-20 03:12:28 +03:00
mergify[bot]
cbb87e762c
Merge branch 'master' into formats-with-suffixes 2022-01-19 17:21:18 +00:00
Amos Bird
62441f0a0f
Fix mutation when table contains projections (#33679) 2022-01-19 15:27:11 +03:00
Kruglov Pavel
3501b56587
Merge pull request #33730 from ianton-ru/MDB-16115-2
Fix restore S3 disk without detached directories
2022-01-19 12:31:59 +03:00
kssenii
a566099759 Local cache for remote filesystem 2022-01-19 00:42:11 +03:00
avogar
4efadfad3c Fix tests 2022-01-18 22:26:13 +03:00
alesapin
e5ec1aa446
Merge pull request #33642 from ClickHouse/add_integration_test_for_zero_duplication
Fix bug with background moves in zero copy replication
2022-01-18 18:32:16 +03:00
liuneng1994
15ea37c4ae ignore file not found exception
Signed-off-by: neng.liu <neng.liu@kyligence.io>
2022-01-18 12:49:40 +00:00
mergify[bot]
b318f9b5db
Merge branch 'master' into formats-with-suffixes 2022-01-18 12:17:07 +00:00
Anton Ivashkin
7c26a832f8 Fix restore S3 disk without detached directories 2022-01-18 12:31:31 +03:00
mergify[bot]
df869c5b9c
Merge branch 'master' into fix_ignore_hdfs_error 2022-01-18 07:05:24 +00:00
Ilya Yatsishin
601b6adaff
Merge pull request #33634 from qoega/fix-mongo2-compose 2022-01-18 09:47:25 +03:00
liuneng1994
c6e205b2ad add error check 2022-01-18 06:21:40 +00:00
Kseniia Sumarokova
232887ea6c
Update test.py 2022-01-17 16:39:53 +03:00
mergify[bot]
23f09bd25a
Merge branch 'master' into fix-mongo2-compose 2022-01-17 11:52:48 +00:00
alesapin
b2271cc2d9
Merge pull request #33288 from JackyWoo/add_lower_bound_session_timeout_to_keeper
Add lower bound session timeout to keeper
2022-01-17 14:06:15 +03:00
alesapin
ccf990e887 Merge branch 'master' into add_integration_test_for_zero_duplication 2022-01-17 13:33:39 +03:00
JackyWoo
a3cb2dd671 Trigger test 2022-01-17 12:00:40 +08:00
mergify[bot]
17f17c13f5
Merge branch 'master' into fix-mongo2-compose 2022-01-15 13:50:03 +00:00
alexey-milovidov
1e8e21570c
Merge pull request #33625 from ClickHouse/better_integration_tests
Fix two flaky integration tests
2022-01-15 02:32:54 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Kruglov Pavel
a7df9cd53a
Merge branch 'master' into formats-with-suffixes 2022-01-14 21:03:49 +03:00
alesapin
436ad63958 More retries 2022-01-14 20:05:55 +03:00
alesapin
bf803472b1 Add a tests for a TTL bug in zero copy replication 2022-01-14 18:44:10 +03:00
Kruglov Pavel
d2e9f37bee
Merge branch 'master' into format-by-extention 2022-01-14 18:36:23 +03:00
avogar
b127356e93 Fix s3 integration tests 2022-01-14 18:34:22 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes 2022-01-14 16:45:20 +03:00
avogar
8884c4a3fe Fix tests and build 2022-01-14 16:27:57 +03:00
Yatsishin Ilya
917ddcd4af better test 2022-01-14 13:08:31 +00:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
alesapin
32e40e9e6b Fixup 2022-01-14 14:28:44 +03:00
alesapin
54725bb289 Fix two flaky integration tests 2022-01-14 14:27:36 +03:00
avogar
2f000a178a Add more tests 2022-01-14 14:00:50 +03:00
Kseniia Sumarokova
10f0e44cc6
Merge pull request #33601 from ClickHouse/kssenii-patch-2
Fix flacky test_dictionaries_postgresql/
2022-01-14 09:44:10 +03:00
Kseniia Sumarokova
f1868114a6
Update test.py 2022-01-14 00:07:33 +03:00
Azat Khuzhin
ad86dad2d1 Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
Like here [1].

- test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR
- test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL

But test_jemalloc_percpu_arena is SKIPPED.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html

v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info"
    Otherwise they cannot be distinguished from ERRORS.
v3: tests/integration/ci-runner: improve report parser
v4: rewrite get_counters() to parse tests verbosity log instead of test
    short summary, since later does not provide test name for skipped
    tests
2022-01-13 22:07:40 +03:00
Kseniia Sumarokova
e2770c5093
Update test.py 2022-01-13 17:12:46 +03:00
mergify[bot]
085492614b
Merge branch 'master' into add_lower_bound_session_timeout_to_keeper 2022-01-13 12:21:46 +00:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
zhangxiao871
deebfd1e29 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-13 17:50:10 +08:00
lgbo-ustc
e1aecea30d try to fixed failure of test_hive_query for counting read bytes from cache 2022-01-13 10:47:11 +08:00
Alexander Tokmakov
25db53a3c5 add an integration test 2022-01-12 21:08:08 +03:00
lgbo-ustc
5c71d3687a fixed some bugs
1. interagtion test for test_hive_query failed
2. nullptr reference in arrowSchemaToCHHeader
2022-01-12 17:01:05 +08:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
Kseniia Sumarokova
6587cd0ec6
Merge pull request #33231 from kssenii/settings-changes-with-named-conf
Pass settings as key value or config for storage with settings
2022-01-11 12:30:41 +03:00
Kruglov Pavel
94cb98df28
Merge pull request #33177 from kssenii/materialized-postgresql-better-startup
materialized postgresql better startup
2022-01-11 12:18:29 +03:00
kssenii
2faad57dd3 More tests 2022-01-11 01:58:05 +03:00
Mikhail f. Shiryaev
1cf46f378f
Merge pull request #33494 from msaf1980/rollup_rules_type
GraphiteMergeTree Rollup rules type
2022-01-10 20:53:20 +01:00
msaf1980
780a1b2abe graphite: split tagged/plain rollup rules (for merges perfomance) 2022-01-10 16:34:16 +05:00
tavplubix
376709b249
Merge pull request #33305 from nvartolomei/nv/test-odbc
Add test for broken connection
2022-01-10 14:23:38 +03:00
kssenii
669c7bf571 Add one more test 2022-01-10 14:04:18 +03:00
kssenii
21c34ad59b Add support for dictionary source 2022-01-10 14:00:03 +03:00
Kseniia Sumarokova
e6ea7c361d
Merge pull request #32836 from stigsb/explain-table-override
Add `EXPLAIN TABLE OVERRIDE` for pre-validating overrides.
2022-01-10 09:58:16 +03:00
JackyWoo
e600fddffa add test_keeper_session/__init__.py 2022-01-10 14:14:57 +08:00
kssenii
5fbafed807 Update test 2022-01-09 21:56:24 +03:00
kssenii
1984a80750 Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-09 21:23:49 +03:00
Kseniia Sumarokova
d0a847befc
Merge pull request #33200 from kssenii/fix-materialized-postgresql-ddl-validation
materialized postgresql fix ddl validation
2022-01-09 21:12:13 +03:00
kssenii
bfaab1356f Merge remote-tracking branch 'upstream/master' into settings-changes-with-named-conf 2022-01-09 17:56:44 +03:00
kssenii
55430feac9 Improve tests part 2 2022-01-09 15:12:46 +03:00
kssenii
6639a93735 Better 2022-01-09 12:16:12 +03:00
kssenii
61f85e9afc More fixes 2022-01-08 20:44:17 +03:00
alesapin
0860acb4ef
Merge pull request #33246 from nicelulu/fix_acl_map
Fix acl map num
2022-01-08 17:48:00 +03:00
kssenii
c94f4163f7 Merge remote-tracking branch 'upstream/master' into fix-materialized-postgresql-ddl-validation 2022-01-08 15:56:46 +03:00
kssenii
64538cf20f Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-08 00:49:08 +03:00
kssenii
b0530682e4 Improve tests 2022-01-08 00:47:29 +03:00
mergify[bot]
6fcd5a7d41
Merge branch 'master' into MDB-15474 2022-01-07 10:12:25 +00:00
zhangxiao871
3c7ad9a8e9 fix test 2022-01-07 18:09:23 +08:00
alesapin
b1d2bdf569
Merge pull request #33130 from kssenii/validate-config
Validate config keys for external dictionaries
2022-01-07 12:59:02 +03:00
zhangxiao871
ec75d23404 add test 2022-01-07 17:45:30 +08:00
JackyWoo
99e6812288 add tests 2022-01-07 15:53:20 +08:00
lgbo-ustc
6a6b6594c3 update test_hive_query 2022-01-07 12:22:57 +08:00
Alexey Milovidov
b7320ee5b1 Remove some garbage 2022-01-07 05:16:31 +03:00
Alexey Milovidov
2cdd8d321f Fix error 2022-01-06 22:07:12 +03:00
zhangxiao871
377cc208d0 add time 2022-01-06 21:14:45 +08:00
Mikhail f. Shiryaev
a52e6013b5
Fix wrong formatting for kerberos tag 2022-01-06 13:48:16 +01:00
lgbo-ustc
2bbd2939c6 try to fix integration test failures 2022-01-05 10:22:05 +08:00
mergify[bot]
327e9572bb
Merge branch 'master' into dotnet-integration-test 2022-01-04 16:35:28 +00:00
李扬
2df2442ad0
Merge branch 'master' into hive_table 2022-01-04 01:26:16 -06:00
Maksim Kita
c3521bfdf9
Merge pull request #33343 from azat/tests-new-kafka-formats
Cover CustomSeparated/Template formats for Kafka
2022-01-03 14:04:36 +03:00
Stig Bakken
4b109e5399 Add integration test for EXPLAIN TABLE OVERRIDE 2022-01-03 10:58:05 +01:00
Alexey Milovidov
53e3ecb90d Move to separate directory 2022-01-03 03:44:03 +03:00
Alexey Milovidov
2c7a8db58c Add test output and compare to reference 2022-01-03 03:36:23 +03:00
Alexey Milovidov
9678179ba0 Fix a typo 2022-01-03 03:03:49 +03:00
Alexey Milovidov
f790bcfe03 Add something to somewhere 2022-01-03 03:03:26 +03:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
d08b1231d7
Update runner 2022-01-03 02:56:23 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
Azat Khuzhin
63eac4b0cf tests/integration/test_storage_kafka: cover CustomSeparated 2021-12-31 12:02:21 +03:00
Azat Khuzhin
f1c726a675 tests/integration/test_storage_kafka: cover Template format 2021-12-31 11:25:08 +03:00
cmsxbc
c28fcd5a2f
support <secure/> for cluster 2021-12-30 23:51:05 +08:00
JackyWoo
569ce62e8d use session_timeout as session timeout uper bound 2021-12-30 17:18:51 +08:00
alesapin
cbdba89d65 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-30 11:21:19 +03:00
Azat Khuzhin
52ad7a4538 Fix test_storage_kafka failures by adjusting retention.ms
This test uses predefined timestamps, and default retention.ms is too
small:

    kafka1_1           | [2021-12-28 21:40:21,842] INFO Created log for partition virt2_0-0 in /var/lib/kafka/data with properties {compression.type -> producer, message.format.version -> 2.2-IV1, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. (kafka.log.LogManager)

    kafka1_1           | [2021-12-28 21:40:24,540] INFO [Log partition=virt2_0-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)

v2: fix tests with 0 timestamp_ms
    and this should be all tests that was left:

    $ fgrep 'Found deletable segments with base offsets' test_storage_kafka/_instances_0/docker.log
    kafka1_1           | [2021-12-29 09:46:15,610] INFO [Log partition=avro1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
    kafka1_1           | [2021-12-29 09:51:15,609] INFO [Log partition=virt1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
2021-12-30 10:25:10 +03:00
Nicolae Vartolomei
1868570920 Add test for broken connection 2021-12-29 20:11:37 +00:00
avogar
97788b9c21 Allow to create new files on insert for File/S3/HDFS engines 2021-12-29 21:19:13 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference
Automatic schema inference for input formats
2021-12-29 21:03:48 +03:00
alesapin
7a3c874651 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-29 19:01:43 +03:00
Kseniia Sumarokova
3bb9da0286
Merge pull request #33266 from kssenii/rabbit-wait-container
Wait for RabbitMQ container to actually start when it was restarted in test on purpose
2021-12-29 18:45:34 +03:00
Mikhail f. Shiryaev
272ea7fc5b
Merge pull request #32609 from cmsxbc/query-kind-concurent_restriction
add settings: max_concurrent_select_queries and max_concurrent_insert_queries
2021-12-29 15:23:45 +01:00
JackyWoo
7e6cd4adbb add tests 2021-12-29 21:25:55 +08:00
JackyWoo
d35e5f8319 add lower bound session timeout to keeper 2021-12-29 20:59:01 +08:00
alesapin
7e1767542c
Merge pull request #33249 from nicelulu/fix_acl
clickhouse-keeper acl consistent with zookeeper, accept generated digest
2021-12-29 13:21:10 +03:00
kssenii
2279dd0c7f Reuse check_rabbitmq_is_available 2021-12-29 13:14:21 +03:00
alesapin
739297b169
Merge pull request #33268 from den-crane/patch-53
Mark max_alter_threads as obsolete
2021-12-29 13:01:57 +03:00
Kruglov Pavel
dd7f61b337
Merge branch 'master' into schema-inference 2021-12-29 12:59:05 +03:00
Maksim Kita
a5256e5b6e
Merge pull request #30957 from kitaisreal/executable-refactoring
Executable refactoring
2021-12-29 12:43:41 +03:00
avogar
e3dbfe6bf6 Better test url engine 2021-12-29 12:18:56 +03:00
avogar
bc5f428f97 Fix tests 2021-12-29 12:18:56 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
Denny Crane
8b46053e8a
fix test. Output is in another order 2021-12-28 19:50:55 -04:00
kssenii
c8dcde7843 Fix 2021-12-28 23:57:36 +03:00
Denny Crane
031451ed17 replace obsolete max_alter_threads with max_final_threads in documentation examples 2021-12-28 16:48:34 -04:00
Maksim Kita
b5698ea134 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
41437b72f1 Fixed integration tests 2021-12-28 22:55:31 +03:00
Maksim Kita
3386378050 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
fbe65658a1 Fixed tests 2021-12-28 22:55:31 +03:00
Maksim Kita
c2977dbf58 Updated test_executable_table_function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
de49a25185 Fixed build 2021-12-28 22:55:30 +03:00
Maksim Kita
cda8bd7f44 Added test_executable_dictionary source tests 2021-12-28 22:55:30 +03:00
Maksim Kita
04f5763f69 Added test_executable_dictionary tests 2021-12-28 22:55:30 +03:00
Maksim Kita
72909c67c2 Fix executable function tests 2021-12-28 22:55:30 +03:00
Maksim Kita
5590cfa3aa Updated executable function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
d3e507b9ef Added executable function integrations tests 2021-12-28 22:55:30 +03:00
kssenii
67c5b41a58 Fix 2021-12-28 22:16:16 +03:00
kssenii
e9b4439a47 Fix 2021-12-28 15:08:40 +03:00
taiyang-li
aa97634d9b merge master 2021-12-28 18:38:50 +08:00
zhangxiao871
daa4c9e33b clickhouse-keeper acl consistent with zookeeper, accept generated digest 2021-12-28 17:17:01 +08:00
kssenii
61a2516c8c Merge remote-tracking branch 'upstream/master' into validate-config 2021-12-28 11:30:30 +03:00
alesapin
90db762c87
Merge pull request #33215 from ClickHouse/fix_flaky_integration_tests
Fix some flaky integration tests
2021-12-28 11:27:46 +03:00
alesapin
875eb54754
Update test.py 2021-12-28 11:21:33 +03:00
Vladimir C
bb6fc853e3
Merge pull request #31442 from vdimir/cluster-discovery 2021-12-28 10:53:30 +03:00
Kseniia Sumarokova
0178fb5e0b
Merge pull request #33214 from kssenii/external-database-fix-where-false
Fix WHERE 1=0 for external databases query
2021-12-27 18:53:52 +03:00
kssenii
55dfaef4de Settings changes as key value 2021-12-27 17:45:00 +03:00
vdimir
d3b1058c40
cluster discovery configuration, support shards 2021-12-27 15:26:11 +03:00
vdimir
fbdb5c60bd
initial initialization of cluster discovery in main thread 2021-12-27 15:26:10 +03:00
vdimir
57cbbd9fcf
global option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
96a0371eca
add option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
ceec643f90
update config structure: remote_servers_discovery -> remote_servers.discovery 2021-12-27 15:26:09 +03:00
vdimir
1f460f05fe
add retry for first check in test_cluster_discovery_startup_and_stop 2021-12-27 15:26:07 +03:00
vdimir
43bfcacd61
Add test_cluster_discovery 2021-12-27 15:26:06 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload
Start/stop servers when `listen_host`/`*_port` changes
2021-12-27 14:51:00 +03:00
alesapin
48f0cee798 Merge branch 'master' into fix_flaky_integration_tests 2021-12-27 14:38:26 +03:00
alesapin
4eb8c11bb0
Merge pull request #33163 from azat/fix-test_input_format_parallel_parsing_memory_tracking
Make test_input_format_parallel_parsing_memory_tracking less flaky
2021-12-27 14:36:32 +03:00
alesapin
593dc6cf90 Fix some flaky integration tests 2021-12-27 12:24:19 +03:00
kssenii
a1aab3a82d Fix 2021-12-27 11:59:33 +03:00
Vladimir C
ea5f867289
Merge pull request #33179 from kssenii/materialized-postgresql-fix-detach-with-schema 2021-12-27 11:42:59 +03:00
Vladimir C
211a5a8d6b
Merge pull request #33159 from xuyatian/master 2021-12-27 11:40:59 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
568aeec0b3 Review fix 2021-12-27 09:51:29 +03:00
Yatian Xu
8dc07dff4a add Clarification for test case 2021-12-26 11:24:47 -08:00
kssenii
9f17e7bad0 Fix ddl validation 2021-12-26 20:56:31 +03:00
Azat Khuzhin
906ebc9fd4 test_input_format_parallel_parsing_memory_tracking: increase max_server_memory_usage
Even after disabling all system tables TSan build still not passed,
since it uses 2.8Gi of RAM just after start, so let's increase this
memory limit a little.
2021-12-26 16:50:35 +03:00
Azat Khuzhin
3f752c3acb Make test_input_format_parallel_parsing_memory_tracking less flaky
By disabling system tables, that may consume memory too.

Also note, that failures with "curl: (56) Recv failure: Connection reset
by peer" like [1] is due to memory, since the server was under memory
pressure, and was not able even to accept the connection:

<details>

    2021.12.25 00:22:02.957658 [ 54 ] {} <Error> ThreadStatus: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 2.81 GiB (attempt to allocate chunk of 2097182 bytes), maximum: 2.79 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

    0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:0: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x1addca1b in /usr/bin/clickhouse
    1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:57: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa0e993c in /usr/bin/clickhouse
    2. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1444: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*&&, char const*&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&) @ 0xa11344b in /usr/bin/clickhouse
    3. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:226: MemoryTracker::allocImpl(long, bool) @ 0xa11220c in /usr/bin/clickhouse
    4. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:258: MemoryTracker::allocImpl(long, bool) @ 0xa111faa in /usr/bin/clickhouse
    5. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:264: MemoryTracker::alloc(long) @ 0xa112bc6 in /usr/bin/clickhouse
    6. ./obj-x86_64-linux-gnu/../src/Common/ThreadStatus.cpp:152: DB::ThreadStatus::~ThreadStatus() @ 0xa10e182 in /usr/bin/clickhouse
    7. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:518: DB::TCPHandler::runImpl() @ 0x17c4192d in /usr/bin/clickhouse
    8. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1909: DB::TCPHandler::run() @ 0x17c55328 in /usr/bin/clickhouse
    9. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x1ac19f03 in /usr/bin/clickhouse
    10. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1397: Poco::Net::TCPServerDispatcher::run() @ 0x1ac1a773 in /usr/bin/clickhouse
    11. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x1ae7e796 in /usr/bin/clickhouse
    12. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:56: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x1ae7c930 in /usr/bin/clickhouse
    13. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/SharedPtr.h:277: Poco::ThreadImpl::runnableEntry(void*) @ 0x1ae7afa8 in /usr/bin/clickhouse
    14. __tsan_thread_start_func @ 0xa039dfd in /usr/bin/clickhouse
    15. ? @ 0x7f4c565cf609 in ?
    16. clone @ 0x7f4c564f6293 in ?
     (version 21.13.1.1305)

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html
2021-12-26 16:50:34 +03:00
kssenii
e663cb4574 Fix detaching-attaching table with schema 2021-12-25 19:51:55 +03:00
alexey-milovidov
f9d961d46d
Merge pull request #33164 from azat/fix-test_async_drain_connection
Fix test_async_drain_connection flakiness
2021-12-25 16:23:17 +03:00
Kruglov Pavel
22dbaec11a
Merge pull request #33142 from Avogar/fix-s3-write
Don't allow to write into S3 if path contains globs
2021-12-25 16:07:38 +03:00
kssenii
59dd5ba063 Validate config keys for external dictionaries 2021-12-25 14:26:35 +03:00
Azat Khuzhin
42ab02a810 Fix test_async_drain_connection flakiness
Sometimes [1] 5 seconds is not enough, since drain_timeout is 3 seconds,
and 2 seconds sometimes is not enough to do other things, especially
under sanitizers:

    E           Code: 159. DB::Exception: Received from 172.16.1.2:9000. DB::Exception: Timeout exceeded: elapsed 5.019254094 seconds, maximum: 5. Stack trace:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/826f7cb0f53e20e67ef52800cb735bb88a6de658/integration_tests__thread__actions__[4/4].html
2021-12-25 11:55:57 +03:00
Azat Khuzhin
da211909e9 tests/integration: refactor test_async_drain_connection 2021-12-25 11:55:57 +03:00
Yatian Xu
3fa78c5642 test case for metrics: StorageBufferBytes 2021-12-25 00:43:45 -08:00
Yatian Xu
2e151a278d correct table name 2021-12-25 00:03:23 -08:00
Yatian Xu
02362a35b4 add test case for metrics: StorageBufferBytes 2021-12-25 00:02:02 -08:00
avogar
58966e90e9 Don't allow to write into S3 if path contains globs 2021-12-24 17:13:35 +03:00
Nikita Mikhaylov
29fdc422d0
Merge pull request #32974 from nikitamikhaylov/hdfsCluster
Merging #32400
2021-12-24 16:02:54 +03:00
Kevin Michel
ffc1fca296
Start/stop servers when listen_host/*_port changes
This allows starting and stopping separately each protocol server
without restarting ClickHouse.

This also allows adding or removing `listen_host` entries, which
start and stops servers for all enabled ports.

When stopping a server, the listening socket is immediately closed
(and available for another server).

Protocols with persistent connections try to wait for any currently
running query to finish before closing the connection, but idle
connection are closed quickly (depending on how often the protocol
is polled).

An extra ProfileEvent is added, `MainConfigLoads`, it is
incremented every time the configuration is reloaded. This helps
when trying to assess whether the new configuration was applied.
2021-12-24 08:26:02 +01:00
mergify[bot]
d4ec469ed1
Merge branch 'master' into query-kind-concurent_restriction 2021-12-24 07:02:00 +00:00
Kseniia Sumarokova
f0434f21ce
Merge pull request #33039 from kssenii/fix-azure-exception
Fix exception in azure write buffer desctructor
2021-12-23 10:26:40 +03:00
alexey-milovidov
26e651eaf4
Merge pull request #32916 from azat/jemalloc-percpu-fix
Disable percpu arena in jemalloc in case of non deterministic CPU count
2021-12-23 08:05:43 +03:00
kssenii
182a065c9b Add test 2021-12-22 23:47:16 +03:00
Kseniia Sumarokova
764bb1181f
Merge pull request #33017 from stigsb/table-overrides-drop-add-column-support
Remove the possibility of adding columns with table overrides
2021-12-22 22:30:21 +03:00
Azat Khuzhin
b2d4520870 tests/integration/test_jemalloc_percpu_arena: cover explicit narenas 2021-12-22 21:06:21 +03:00
Azat Khuzhin
c82701b1ef tests/integration/test_jemalloc_percpu_arena: add support of fast-test binary 2021-12-22 21:05:11 +03:00
Azat Khuzhin
6efa3b3667 Add a test for jemalloc percpu arena with different number of online CPUs 2021-12-22 21:05:11 +03:00
Kseniia Sumarokova
01f2e4c00d
Merge pull request #33037 from kssenii/fix-s3-empty-file
Fix s3 table function reading empty file
2021-12-22 18:17:29 +03:00
tavplubix
85d49bf557
Merge pull request #33044 from ClickHouse/tavplubix-patch-5
Decrease default timeout for integration test
2021-12-22 17:26:23 +03:00
tavplubix
d8fb293d57
Merge pull request #32900 from zzsmdfj/issue/#15182_MaterializeMySQL_support_bit_type
Add support for BIT data type in MaterializedMySQL
2021-12-22 15:58:29 +03:00
tavplubix
8775afc25e
Update pytest.ini 2021-12-22 14:53:40 +03:00
kssenii
11731cde92 Fix test 2021-12-22 13:57:08 +03:00
tavplubix
4ba76dd8e3
Update materialize_with_ddl.py 2021-12-22 12:19:51 +03:00
kssenii
d8ed4db6d4 Fix 2021-12-22 11:42:23 +03:00
Stig Bakken
1cc70ad524 Remove the possibility of adding columns with table overrides
(except ALIAS columns)

Supporting this properly requires more comprehensive changes.
2021-12-22 08:20:14 +01:00
Kseniia Sumarokova
484a4d62dd
Merge pull request #32835 from kssenii/fising-s3
Fix optimization with lazy seek for async reads from remote fs
2021-12-22 09:38:23 +03:00
Kseniia Sumarokova
b8f6ca470a
Merge pull request #32985 from kssenii/rabbit-fix-tests
RabbitMQ tests fix
2021-12-21 21:32:39 +03:00
ianton-ru
e6fd4bfb50
Merge branch 'master' into MDB-15474 2021-12-21 17:38:36 +03:00
Anton Ivashkin
0c0bf66334 Merge master 2021-12-21 17:27:54 +03:00
Haavard Kvaalen
9a2b0680a1 Fix weird permission on log directories
Several log directories for integration tests were created with full
permissions for "others" but no permission for the owner of the
directory.  This caused issues when trying to run integration tests
again without manually wiping files from previous runs.  The test would
fail with "PermissionError: [Errno 13] Permission denied: 'logs'".

The intention may have been to do the equivalent of 'chmod o+rwx logs',
but it instead did the equivalent of 'chmod 007 logs'.
2021-12-21 11:50:54 +01:00
kssenii
ebcb66a361 Fix 2021-12-21 10:58:02 +03:00
taiyang-li
2597925724 merge master 2021-12-21 15:55:39 +08:00
Kseniia Sumarokova
e0f2fe457d
Update test.py 2021-12-21 10:29:27 +03:00
Kseniia Sumarokova
d51b101244
Update test.py 2021-12-21 00:06:24 +03:00
kssenii
a064410a39 Fix 2021-12-21 00:03:55 +03:00
Anton Ivashkin
c724b074ae Remove zero-copy version converter 2021-12-20 20:23:25 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression
Improve gRPC compression support
2021-12-20 19:44:58 +03:00
Anton Ivashkin
f0b9a4327a Use table UUID in zero-copy shared label in ZooKeeper 2021-12-20 16:19:00 +03:00
Zhichang Yu
869cdbeb44 added table function hdfsCluster 2021-12-20 13:14:44 +00:00
Nikolai Kochetov
2e62f086a1
Merge pull request #32751 from ClickHouse/fix-32668
Apply some more optimizations to NO_QUERY ast.
2021-12-20 15:47:25 +03:00
Kseniia Sumarokova
967738ff8f
Merge pull request #32749 from kssenii/table-override-pg
Support Table Override clause for MaterializedPostgreSQL too
2021-12-20 13:11:47 +03:00
lgbo-ustc
244a8b2cbf fixed typro 2021-12-20 11:50:38 +08:00
kssenii
0411fd6565 Better test 2021-12-19 21:24:52 +03:00
Vitaly Baranov
708439b036 Support customized compression for input/output data in gRPC protocol. 2021-12-19 16:29:44 +03:00
alexey-milovidov
d3a1ffd05d
Merge pull request #32529 from dmthuc/fix_groupBitmapAnd_function_distributed_table
fix groupBitmapAnd function on distributed table
2021-12-19 08:28:26 +03:00
alexey-milovidov
d4f3823f0e
Merge pull request #32885 from arenadata/ADQM-414
warm up for test_kafka_json_as_string_no_kdc
2021-12-19 07:54:30 +03:00
Azat Khuzhin
f93eb61946 tests/integration/cleanup_environment: fix obtaining PYTEST_CLEANUP_CONTAINERS 2021-12-18 13:21:18 +03:00
Dao
e3f16cb73f fix intergration test 2021-12-18 14:42:42 +08:00
Dao
5500d0e439 fix intergration test 2021-12-18 13:35:36 +08:00
Dao
21b8a11907 fix intergration test 2021-12-18 12:27:31 +08:00
Dao
8bbd006d42 enable zookeeper for integration test 2021-12-18 07:55:12 +08:00
Ilya Golshtein
587b663e56 a comment requested by reviewer 2021-12-17 22:49:40 +03:00
kssenii
dd902b6875 Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-17 22:03:58 +03:00
kssenii
dd9347263b Merge remote-tracking branch 'upstream/master' into update-test 2021-12-17 19:13:24 +03:00
Anton Popov
99ebabd822 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-17 19:02:29 +03:00
kssenii
40c266840c Fixes 2021-12-17 18:16:29 +03:00
minhthucdao
001900655e
Merge branch 'master' into fix_groupBitmapAnd_function_distributed_table 2021-12-17 23:03:47 +08:00
Dao
52af96627c introduce new version and add test 2021-12-17 22:59:02 +08:00
Kseniia Sumarokova
70937088e9
Merge pull request #32886 from kssenii/azure-rename
Rename files and code from BlobStorage to AzureBlobStorage
2021-12-17 16:59:08 +03:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization
Sparse serialization and ColumnSparse
2021-12-17 15:26:17 +03:00
Ilya Golshtein
2821e14492 typo fixed 2021-12-17 15:01:57 +03:00
kssenii
fcb0efcf7d Update test 2021-12-17 14:34:49 +03:00
zzsmdfj
4a0554c963 to #15182_MaterializeMySQL_support_bit_type-fix-flakey-test 2021-12-17 18:30:09 +08:00
kssenii
ed42620530 Rename BlobStorage to AzureBlobStorage 2021-12-17 12:24:05 +03:00
Vladimir C
fa011c66b7
Merge pull request #32846 from vdimir/flaky_test_s3_zero_copy_replication 2021-12-17 12:09:21 +03:00
vdimir
3f118f6734
Try fix flaky test: order for test_s3_zero_copy_replication 2021-12-17 12:08:39 +03:00
taiyang-li
d033fc4c24 merge master and fix conflict 2021-12-17 15:11:21 +08:00
zzsmdfj
e9eed1f927 to #15182_MaterializeMySQL_support_bit_type 2021-12-17 15:03:24 +08:00
tavplubix
db01e94f66
Merge pull request #32802 from ClickHouse/fix_restart_unavailable_mysql
Fix restarting with unavailable MySQL
2021-12-17 08:57:15 +03:00
kssenii
8199b24b80 Add test 2021-12-17 01:55:15 +03:00
Ilya Golshtein
faaed87945 warm up for test_kafka_json_as_string_no_kdc 2021-12-17 01:24:21 +03:00
kssenii
97222be3d9 Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-17 01:14:28 +03:00
Alexander Tokmakov
3a8b2b15fc fix 2021-12-16 19:01:04 +03:00
Azat Khuzhin
ba2c9405da Fix test_storage_s3 flakiness 2021-12-16 07:56:43 +03:00
kssenii
7583c8007e Some review fixes 2021-12-16 00:38:46 +03:00
kssenii
dc1f0c58fa Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-15 15:27:58 +03:00
Alexander Tokmakov
07bfbc26d6 fix restarting with unavailable mysql 2021-12-15 15:08:08 +03:00
mergify[bot]
3a7179756f
Merge branch 'master' into fix-32668 2021-12-15 08:31:10 +00:00
alexey-milovidov
4adf3b0285
Merge pull request #32740 from azat/integration-tests-fix-mysql-wait
tests/integration: fix waiting of mysql client container
2021-12-14 23:23:50 +03:00
tavplubix
2cf5456423
Merge pull request #32511 from ClickHouse/fix_attaching_gdb2
Try to fix attaching gdb 2
2021-12-14 21:10:00 +03:00
kssenii
47f549166d Table Override for PostgreSQL 2021-12-14 20:36:43 +03:00
Anton Popov
16312e7e4a Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-14 18:58:17 +03:00
Nikolai Kochetov
d394f0e753 Allpy some more optimizations to NO_QUERY ast. 2021-12-14 17:19:18 +03:00
alesapin
0d7bbc399b
Merge pull request #32739 from azat/integration-tests-fix-ch-wait
tests/integration: fix wait_start()/start_clickhouse()
2021-12-14 13:49:15 +03:00
alesapin
a02da27c6f
Merge pull request #32694 from ClickHouse/add-test_s3_zero_copy_concurrent_merge
Add test_s3_zero_copy_concurrent_merge
2021-12-14 12:49:21 +03:00
lgbo-ustc
248e933fc4 Add test for local cache 2021-12-14 16:06:30 +08:00