thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-25 17:12:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
85,246 Commits 9,174 Branches 1,781 Tags 2.1 GiB
22c9b54036
Commit Graph

3918 Commits

Author SHA1 Message Date
alexey-milovidov
fb9ed9acad
Merge pull request #34175 from kitaisreal/bitset-sort-performance-check 
bitsetsort peformance check
 2022-02-07 05:34:57 +03:00
mergify[bot]
8045598afe
Merge branch 'master' into fix-s3-schema-inference 2022-02-06 17:08:48 +00:00
Amos Bird
82f31e1abb
Fix tests when projection is enabled 
Avoid using count() in quota related tests

count() can subject to many optimization techniques, which is unstable
for testing quota usage.
 2022-02-06 16:46:10 +08:00
Vitaly Baranov
5dd49a44e6 Add test for propagating OpenTelemetry context via gRPC protocol. 2022-02-06 02:09:56 +07:00
Maksim Kita
bc6328e573 Fixed tests 2022-02-04 20:56:49 +00:00
Maksim Kita
7a6f282765 Fixed tests 2022-02-04 19:52:18 +00:00
alesapin
875e5413ad Revert "Merge pull request #34219 from ClickHouse/revert-34212-revert-33291-add-pool-to-s3-write-buffer" 
This reverts commit b92efed350, reversing
changes made to ecce006cb2.
 2022-02-04 14:30:33 +03:00
alesapin
2ed45b2a98 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-04 11:23:46 +03:00
Nikolai Kochetov
b92efed350
Merge pull request #34219 from ClickHouse/revert-34212-revert-33291-add-pool-to-s3-write-buffer 
Revert "Revert "Add pool to WriteBufferFromS3""
 2022-02-04 11:00:29 +03:00
alexey-milovidov
665fdc9187
Merge pull request #31257 from FArthur-cmd/merge_15765 
Merge #15765
 2022-02-04 00:39:57 +03:00
alesapin
2a9bc7cba8 Merge branch 'master' into revert-34211-revert-34153-add_func_tests_over_s3 2022-02-03 16:20:06 +03:00
alexey-milovidov
14811a357e
Merge pull request #34263 from azat/interserver-mode-fix 
Fix current_user/current_address for interserver mode
 2022-02-03 05:28:56 +03:00
Maksim Kita
02c6cfba6a
Merge pull request #34225 from vitlibar/fix-checking-grants-for-show-grants 
Fix checking grants for SHOW GRANTS
 2022-02-02 22:51:51 +01:00
alesapin
b9c118524f Fix race condition on hardlink/erase/read metadata 2022-02-02 19:40:21 +03:00
Azat Khuzhin
5472aef084 Fix current_user/current_address for interserver mode 
Before this patch current_user/current_address will be preserved from
the previous query.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-02-02 17:44:19 +03:00
Vitaly Baranov
1f81e43f1e Fix checking grants for SHOW GRANTS. 2022-02-01 19:55:24 +07:00
Anton Popov
836a348a9c Merge remote-tracking branch 'upstream/master' into HEAD 2022-02-01 15:23:07 +03:00
Nikolai Kochetov
2a6eb593be
Revert "Revert "Add pool to WriteBufferFromS3"" 2022-02-01 13:36:51 +03:00
alexey-milovidov
99392b5ca7
Merge pull request #13544 from amosbird/mdha 
Multi-Disk auto-recovery.
 2022-02-01 06:13:26 +03:00
alexey-milovidov
095d9bfa43
Revert "Add pool to WriteBufferFromS3" 2022-02-01 05:49:40 +03:00
mergify[bot]
e229487817
Merge branch 'master' into mdha 2022-02-01 01:22:16 +00:00
Amos Bird
ec7d367814
DiskLocal checker 
Add DiskLocal checker so that ReplicatedMergeTree can recover data when some of its disks are broken.
 2022-02-01 05:55:27 +08:00
alesapin
dd61d1c2de
Merge pull request #34172 from ClickHouse/fix_race_in_some_engines 
Fix benign race condition for storage HDFS, S3, URL
 2022-01-31 22:41:54 +03:00
alesapin
75d73d2785
Merge pull request #34139 from ClickHouse/fix_buf_s3_low_cardinality 
Fix bug with bounded S3 reads and LowCardinality
 2022-01-31 22:41:14 +03:00
avogar
058ef356ac Fix schema inference for table runction s3 2022-01-31 19:39:20 +03:00
Nikolai Kochetov
321fa4a9e8
Merge pull request #33291 from ClickHouse/add-pool-to-s3-write-buffer 
Add pool to WriteBufferFromS3
 2022-01-31 19:37:40 +03:00
alesapin
ace8169732 Fix kafka test 2022-01-31 19:18:34 +03:00
alesapin
c3f7dece5e
Update tests/integration/test_s3_low_cardinality_right_border/test.py 
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
 2022-01-31 12:36:58 +03:00
alesapin
cb45a348f1 Merge branch 'master' into fix_buf_s3_low_cardinality 2022-01-30 17:30:55 +03:00
Anton Popov
78b9f15abb Merge remote-tracking branch 'upstream/master' into HEAD 2022-01-30 03:24:37 +03:00
alesapin
7ada8227cf Fix bug with bounded S3 reads and LowCardinality 2022-01-29 18:28:40 +03:00
Anton Popov
96a506c6fa fix inserts to distributed tables in case of change of native protocol 2022-01-29 03:23:25 +03:00
FArthur-cmd
cb4ad97d45 add test 2022-01-28 17:37:52 +00:00
Anton Popov
26257bbde6 fix reading missed subcolumns from distributed 2022-01-28 19:24:17 +03:00
Nikolai Kochetov
1c9f026178 Merge branch 'master' into add-pool-to-s3-write-buffer 2022-01-28 16:01:42 +03:00
zhangxiao871
7b51e0b8b6 Better test 2022-01-28 18:00:52 +08:00
zhangxiao871
78e2794ada Fix START MERGES and add test 2022-01-28 14:30:57 +08:00
Nikolai Kochetov
7406721cb6 Try to fix race in test. 2022-01-27 18:38:39 +00:00
Raúl Marín
cb1524d4d9 Less flaky test_inconsistent_parts_if_drop_while_replica_not_active 2022-01-27 12:47:52 +01:00
zhangxiao871
74796c6e01 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-26 17:51:46 +08:00
tavplubix
9e91a9dfd1
Merge pull request #33429 from zzsmdfj/MaterializeMySQL_support_set_and_other_dataType 
MaterializeMySQL support SET YEAR TIME GEOMETRY dataType
 2022-01-26 11:29:46 +03:00
alesapin
b8c6481d4c Fix clickhouse server start when replicated access storage depend on keeper 2022-01-25 16:40:12 +03:00
Kruglov Pavel
9f12f4af13
Merge pull request #33302 from Avogar/formats-with-suffixes 
Allow to create new files on insert for File/S3/HDFS engines
 2022-01-25 10:56:15 +03:00
Azat Khuzhin
4a0facd341 Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES) 
There is no more MAKE_*, so remove this alias.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-01-24 17:28:33 +03:00
alesapin
48c19e88a5
Merge pull request #33926 from ClickHouse/fix_flaky_test 
Fix test_replica_is_active flaky test
 2022-01-24 10:19:10 +03:00
kssenii
710bba895e Fix partially downloaded no continuation case 2022-01-23 23:49:13 +03:00
alesapin
57dae1e308
Merge pull request #33162 from azat/integration-tests-status 
Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
 2022-01-23 21:46:59 +03:00
alesapin
51a6d08bff Fix test_replica_is_active flaky test 2022-01-23 19:31:09 +03:00
kssenii
690db142b9 Better 2022-01-23 02:12:33 +03:00
Kseniia Sumarokova
2c43e4eb57
Merge branch 'master' into local-cache-for-remote-fs 2022-01-22 22:53:55 +03:00
Mikhail f. Shiryaev
13f7f56c5b
Merge pull request #33342 from JaySon-Huang/get_cpu_cores_under_cgroup 
Fix cpu count with cgroup limits
 2022-01-22 11:32:08 +01:00
alexey-milovidov
844d5e59d3
Merge pull request #33880 from qoega/integration-stable-postgesql 
Improve postgresql integration test
 2022-01-22 12:57:46 +03:00
Anton Popov
e8ce091e68 Merge remote-tracking branch 'upstream/master' into HEAD 2022-01-21 20:11:18 +03:00
Yatsishin Ilya
23cb226904 fixes 2022-01-21 17:03:48 +00:00
JaySon-Huang
d71a31ba4b Fix typo 
Signed-off-by: JaySon-Huang <tshent@qq.com>
 2022-01-21 21:03:23 +08:00
JaySon-Huang
f01776d0af Add integration test 
Signed-off-by: JaySon-Huang <tshent@qq.com>
 2022-01-21 21:03:23 +08:00
mergify[bot]
65e940d55c
Merge branch 'master' into MaterializeMySQL_support_set_and_other_dataType 2022-01-21 11:37:22 +00:00
Maksim Kita
548a7bccee
Merge pull request #33804 from CurtizJ/redis-pool 
Use connection pool for redis dictionary
 2022-01-21 11:40:35 +01:00
zzsmdfj
f54d607b3b to MaterializeMySQL_support_set_and_other_dataType 2022-01-21 12:24:13 +08:00
zzsmdfj
e380e59b16 MaterializeMySQL support SET YEAR TIME GEOMETRY dataType 2022-01-21 12:24:11 +08:00
Kruglov Pavel
7bfb1231b9
Merge branch 'master' into formats-with-suffixes 2022-01-20 14:47:17 +03:00
Kseniia Sumarokova
064c3dd654
Merge pull request #33724 from liuneng1994/fix_ignore_hdfs_error 
Throw exception when storage hdfs list directory failed
 2022-01-20 11:59:09 +03:00
Anton Popov
4810d13aff use connection pool for redis dictionary 2022-01-20 03:12:28 +03:00
mergify[bot]
cbb87e762c
Merge branch 'master' into formats-with-suffixes 2022-01-19 17:21:18 +00:00
Amos Bird
62441f0a0f
Fix mutation when table contains projections (#33679) 2022-01-19 15:27:11 +03:00
Kruglov Pavel
3501b56587
Merge pull request #33730 from ianton-ru/MDB-16115-2 
Fix restore S3 disk without detached directories
 2022-01-19 12:31:59 +03:00
kssenii
a566099759 Local cache for remote filesystem 2022-01-19 00:42:11 +03:00
avogar
4efadfad3c Fix tests 2022-01-18 22:26:13 +03:00
alesapin
e5ec1aa446
Merge pull request #33642 from ClickHouse/add_integration_test_for_zero_duplication 
Fix bug with background moves in zero copy replication
 2022-01-18 18:32:16 +03:00
liuneng1994
15ea37c4ae ignore file not found exception 
Signed-off-by: neng.liu <neng.liu@kyligence.io>
 2022-01-18 12:49:40 +00:00
mergify[bot]
b318f9b5db
Merge branch 'master' into formats-with-suffixes 2022-01-18 12:17:07 +00:00
Anton Ivashkin
7c26a832f8 Fix restore S3 disk without detached directories 2022-01-18 12:31:31 +03:00
mergify[bot]
df869c5b9c
Merge branch 'master' into fix_ignore_hdfs_error 2022-01-18 07:05:24 +00:00
Ilya Yatsishin
601b6adaff
Merge pull request #33634 from qoega/fix-mongo2-compose 2022-01-18 09:47:25 +03:00
liuneng1994
c6e205b2ad add error check 2022-01-18 06:21:40 +00:00
Kseniia Sumarokova
232887ea6c
Update test.py 2022-01-17 16:39:53 +03:00
mergify[bot]
23f09bd25a
Merge branch 'master' into fix-mongo2-compose 2022-01-17 11:52:48 +00:00
alesapin
b2271cc2d9
Merge pull request #33288 from JackyWoo/add_lower_bound_session_timeout_to_keeper 
Add lower bound session timeout to keeper
 2022-01-17 14:06:15 +03:00
alesapin
ccf990e887 Merge branch 'master' into add_integration_test_for_zero_duplication 2022-01-17 13:33:39 +03:00
JackyWoo
a3cb2dd671 Trigger test 2022-01-17 12:00:40 +08:00
mergify[bot]
17f17c13f5
Merge branch 'master' into fix-mongo2-compose 2022-01-15 13:50:03 +00:00
alexey-milovidov
1e8e21570c
Merge pull request #33625 from ClickHouse/better_integration_tests 
Fix two flaky integration tests
 2022-01-15 02:32:54 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Kruglov Pavel
a7df9cd53a
Merge branch 'master' into formats-with-suffixes 2022-01-14 21:03:49 +03:00
alesapin
436ad63958 More retries 2022-01-14 20:05:55 +03:00
alesapin
bf803472b1 Add a tests for a TTL bug in zero copy replication 2022-01-14 18:44:10 +03:00
Kruglov Pavel
d2e9f37bee
Merge branch 'master' into format-by-extention 2022-01-14 18:36:23 +03:00
avogar
b127356e93 Fix s3 integration tests 2022-01-14 18:34:22 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes 2022-01-14 16:45:20 +03:00
avogar
8884c4a3fe Fix tests and build 2022-01-14 16:27:57 +03:00
Yatsishin Ilya
917ddcd4af better test 2022-01-14 13:08:31 +00:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
alesapin
32e40e9e6b Fixup 2022-01-14 14:28:44 +03:00
alesapin
54725bb289 Fix two flaky integration tests 2022-01-14 14:27:36 +03:00
avogar
2f000a178a Add more tests 2022-01-14 14:00:50 +03:00
Kseniia Sumarokova
10f0e44cc6
Merge pull request #33601 from ClickHouse/kssenii-patch-2 
Fix flacky test_dictionaries_postgresql/
 2022-01-14 09:44:10 +03:00
Kseniia Sumarokova
f1868114a6
Update test.py 2022-01-14 00:07:33 +03:00
Azat Khuzhin
ad86dad2d1 Fix status of SKIPPED integration tests (was incorrectly marked as ERROR) 
Like here [1].

- test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR
- test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL

But test_jemalloc_percpu_arena is SKIPPED.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html

v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info"
    Otherwise they cannot be distinguished from ERRORS.
v3: tests/integration/ci-runner: improve report parser
v4: rewrite get_counters() to parse tests verbosity log instead of test
    short summary, since later does not provide test name for skipped
    tests
 2022-01-13 22:07:40 +03:00
Kseniia Sumarokova
e2770c5093
Update test.py 2022-01-13 17:12:46 +03:00
mergify[bot]
085492614b
Merge branch 'master' into add_lower_bound_session_timeout_to_keeper 2022-01-13 12:21:46 +00:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
zhangxiao871
deebfd1e29 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-13 17:50:10 +08:00
lgbo-ustc
e1aecea30d try to fixed failure of test_hive_query for counting read bytes from cache 2022-01-13 10:47:11 +08:00
Alexander Tokmakov
25db53a3c5 add an integration test 2022-01-12 21:08:08 +03:00
lgbo-ustc
5c71d3687a fixed some bugs 
1. interagtion test for test_hive_query failed
2. nullptr reference in arrowSchemaToCHHeader
 2022-01-12 17:01:05 +08:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
Kseniia Sumarokova
6587cd0ec6
Merge pull request #33231 from kssenii/settings-changes-with-named-conf 
Pass settings as key value or config for storage with settings
 2022-01-11 12:30:41 +03:00
Kruglov Pavel
94cb98df28
Merge pull request #33177 from kssenii/materialized-postgresql-better-startup 
materialized postgresql better startup
 2022-01-11 12:18:29 +03:00
kssenii
2faad57dd3 More tests 2022-01-11 01:58:05 +03:00
Mikhail f. Shiryaev
1cf46f378f
Merge pull request #33494 from msaf1980/rollup_rules_type 
GraphiteMergeTree Rollup rules type
 2022-01-10 20:53:20 +01:00
msaf1980
780a1b2abe graphite: split tagged/plain rollup rules (for merges perfomance) 2022-01-10 16:34:16 +05:00
tavplubix
376709b249
Merge pull request #33305 from nvartolomei/nv/test-odbc 
Add test for broken connection
 2022-01-10 14:23:38 +03:00
kssenii
669c7bf571 Add one more test 2022-01-10 14:04:18 +03:00
kssenii
21c34ad59b Add support for dictionary source 2022-01-10 14:00:03 +03:00
Kseniia Sumarokova
e6ea7c361d
Merge pull request #32836 from stigsb/explain-table-override 
Add `EXPLAIN TABLE OVERRIDE` for pre-validating overrides.
 2022-01-10 09:58:16 +03:00
JackyWoo
e600fddffa add test_keeper_session/__init__.py 2022-01-10 14:14:57 +08:00
kssenii
5fbafed807 Update test 2022-01-09 21:56:24 +03:00
kssenii
1984a80750 Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-09 21:23:49 +03:00
Kseniia Sumarokova
d0a847befc
Merge pull request #33200 from kssenii/fix-materialized-postgresql-ddl-validation 
materialized postgresql fix ddl validation
 2022-01-09 21:12:13 +03:00
kssenii
bfaab1356f Merge remote-tracking branch 'upstream/master' into settings-changes-with-named-conf 2022-01-09 17:56:44 +03:00
kssenii
55430feac9 Improve tests part 2 2022-01-09 15:12:46 +03:00
kssenii
6639a93735 Better 2022-01-09 12:16:12 +03:00
kssenii
61f85e9afc More fixes 2022-01-08 20:44:17 +03:00
alesapin
0860acb4ef
Merge pull request #33246 from nicelulu/fix_acl_map 
Fix acl map num
 2022-01-08 17:48:00 +03:00
kssenii
c94f4163f7 Merge remote-tracking branch 'upstream/master' into fix-materialized-postgresql-ddl-validation 2022-01-08 15:56:46 +03:00
kssenii
64538cf20f Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-08 00:49:08 +03:00
kssenii
b0530682e4 Improve tests 2022-01-08 00:47:29 +03:00
mergify[bot]
6fcd5a7d41
Merge branch 'master' into MDB-15474 2022-01-07 10:12:25 +00:00
zhangxiao871
3c7ad9a8e9 fix test 2022-01-07 18:09:23 +08:00
alesapin
b1d2bdf569
Merge pull request #33130 from kssenii/validate-config 
Validate config keys for external dictionaries
 2022-01-07 12:59:02 +03:00
zhangxiao871
ec75d23404 add test 2022-01-07 17:45:30 +08:00
JackyWoo
99e6812288 add tests 2022-01-07 15:53:20 +08:00
lgbo-ustc
6a6b6594c3 update test_hive_query 2022-01-07 12:22:57 +08:00
Alexey Milovidov
b7320ee5b1 Remove some garbage 2022-01-07 05:16:31 +03:00
Alexey Milovidov
2cdd8d321f Fix error 2022-01-06 22:07:12 +03:00
zhangxiao871
377cc208d0 add time 2022-01-06 21:14:45 +08:00
Mikhail f. Shiryaev
a52e6013b5
Fix wrong formatting for kerberos tag 2022-01-06 13:48:16 +01:00
lgbo-ustc
2bbd2939c6 try to fix integration test failures 2022-01-05 10:22:05 +08:00
mergify[bot]
327e9572bb
Merge branch 'master' into dotnet-integration-test 2022-01-04 16:35:28 +00:00
李扬
2df2442ad0
Merge branch 'master' into hive_table 2022-01-04 01:26:16 -06:00
Maksim Kita
c3521bfdf9
Merge pull request #33343 from azat/tests-new-kafka-formats 
Cover CustomSeparated/Template formats for Kafka
 2022-01-03 14:04:36 +03:00
Stig Bakken
4b109e5399 Add integration test for EXPLAIN TABLE OVERRIDE 2022-01-03 10:58:05 +01:00
Alexey Milovidov
53e3ecb90d Move to separate directory 2022-01-03 03:44:03 +03:00
Alexey Milovidov
2c7a8db58c Add test output and compare to reference 2022-01-03 03:36:23 +03:00
Alexey Milovidov
9678179ba0 Fix a typo 2022-01-03 03:03:49 +03:00
Alexey Milovidov
f790bcfe03 Add something to somewhere 2022-01-03 03:03:26 +03:00
Alexey Milovidov
c3ab18d1b0 Merge branch 'feature/dotnet-integration-test' of github.com:DarkWanderer/ClickHouse into dotnet-integration-test 2022-01-03 03:00:01 +03:00
alexey-milovidov
d08b1231d7
Update runner 2022-01-03 02:56:23 +03:00
taiyang-li
1e102bc1b2 merge master 2022-01-01 09:01:06 +08:00
Azat Khuzhin
63eac4b0cf tests/integration/test_storage_kafka: cover CustomSeparated 2021-12-31 12:02:21 +03:00
Azat Khuzhin
f1c726a675 tests/integration/test_storage_kafka: cover Template format 2021-12-31 11:25:08 +03:00
cmsxbc
c28fcd5a2f
support <secure/> for cluster 2021-12-30 23:51:05 +08:00
JackyWoo
569ce62e8d use session_timeout as session timeout uper bound 2021-12-30 17:18:51 +08:00
alesapin
cbdba89d65 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-30 11:21:19 +03:00
Azat Khuzhin
52ad7a4538 Fix test_storage_kafka failures by adjusting retention.ms 
This test uses predefined timestamps, and default retention.ms is too
small:

    kafka1_1           | [2021-12-28 21:40:21,842] INFO Created log for partition virt2_0-0 in /var/lib/kafka/data with properties {compression.type -> producer, message.format.version -> 2.2-IV1, file.delete.delay.ms -> 60000, max.message.bytes -> 1000012, min.compaction.lag.ms -> 0, message.timestamp.type -> CreateTime, message.downconversion.enable -> true, min.insync.replicas -> 1, segment.jitter.ms -> 0, preallocate -> false, min.cleanable.dirty.ratio -> 0.5, index.interval.bytes -> 4096, unclean.leader.election.enable -> false, retention.bytes -> -1, delete.retention.ms -> 86400000, cleanup.policy -> [delete], flush.ms -> 9223372036854775807, segment.ms -> 604800000, segment.bytes -> 1073741824, retention.ms -> 604800000, message.timestamp.difference.max.ms -> 9223372036854775807, segment.index.bytes -> 10485760, flush.messages -> 9223372036854775807}. (kafka.log.LogManager)

    kafka1_1           | [2021-12-28 21:40:24,540] INFO [Log partition=virt2_0-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)

v2: fix tests with 0 timestamp_ms
    and this should be all tests that was left:

    $ fgrep 'Found deletable segments with base offsets' test_storage_kafka/_instances_0/docker.log
    kafka1_1           | [2021-12-29 09:46:15,610] INFO [Log partition=avro1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
    kafka1_1           | [2021-12-29 09:51:15,609] INFO [Log partition=virt1-0, dir=/var/lib/kafka/data] Found deletable segments with base offsets [0] due to retention time 604800000ms breach (kafka.log.Log)
 2021-12-30 10:25:10 +03:00
Nicolae Vartolomei
1868570920 Add test for broken connection 2021-12-29 20:11:37 +00:00
avogar
97788b9c21 Allow to create new files on insert for File/S3/HDFS engines 2021-12-29 21:19:13 +03:00
Kruglov Pavel
489a30859f
Merge pull request #32455 from Avogar/schema-inference 
Automatic schema inference for input formats
 2021-12-29 21:03:48 +03:00
alesapin
7a3c874651 Merge branch 'master' into ianton-ru-MDB-15474 2021-12-29 19:01:43 +03:00
Kseniia Sumarokova
3bb9da0286
Merge pull request #33266 from kssenii/rabbit-wait-container 
Wait for RabbitMQ container to actually start when it was restarted in test on purpose
 2021-12-29 18:45:34 +03:00
Mikhail f. Shiryaev
272ea7fc5b
Merge pull request #32609 from cmsxbc/query-kind-concurent_restriction 
add settings: max_concurrent_select_queries and max_concurrent_insert_queries
 2021-12-29 15:23:45 +01:00
JackyWoo
7e6cd4adbb add tests 2021-12-29 21:25:55 +08:00
JackyWoo
d35e5f8319 add lower bound session timeout to keeper 2021-12-29 20:59:01 +08:00
alesapin
7e1767542c
Merge pull request #33249 from nicelulu/fix_acl 
clickhouse-keeper acl consistent with zookeeper, accept generated digest
 2021-12-29 13:21:10 +03:00
kssenii
2279dd0c7f Reuse check_rabbitmq_is_available 2021-12-29 13:14:21 +03:00
alesapin
739297b169
Merge pull request #33268 from den-crane/patch-53 
Mark max_alter_threads as obsolete
 2021-12-29 13:01:57 +03:00
Kruglov Pavel
dd7f61b337
Merge branch 'master' into schema-inference 2021-12-29 12:59:05 +03:00
Maksim Kita
a5256e5b6e
Merge pull request #30957 from kitaisreal/executable-refactoring 
Executable refactoring
 2021-12-29 12:43:41 +03:00
avogar
e3dbfe6bf6 Better test url engine 2021-12-29 12:18:56 +03:00
avogar
bc5f428f97 Fix tests 2021-12-29 12:18:56 +03:00
avogar
9f30c17777 Fix tests 2021-12-29 12:18:56 +03:00
avogar
74f09d6476 Fix tests 2021-12-29 12:18:56 +03:00
avogar
aaf9f85c67 Add more tests and fixes 2021-12-29 12:18:56 +03:00
Denny Crane
8b46053e8a
fix test. Output is in another order 2021-12-28 19:50:55 -04:00
kssenii
c8dcde7843 Fix 2021-12-28 23:57:36 +03:00
Denny Crane
031451ed17 replace obsolete max_alter_threads with max_final_threads in documentation examples 2021-12-28 16:48:34 -04:00
Maksim Kita
b5698ea134 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
41437b72f1 Fixed integration tests 2021-12-28 22:55:31 +03:00
Maksim Kita
3386378050 Updated test_executable_table_function tests 2021-12-28 22:55:31 +03:00
Maksim Kita
fbe65658a1 Fixed tests 2021-12-28 22:55:31 +03:00
Maksim Kita
c2977dbf58 Updated test_executable_table_function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
de49a25185 Fixed build 2021-12-28 22:55:30 +03:00
Maksim Kita
cda8bd7f44 Added test_executable_dictionary source tests 2021-12-28 22:55:30 +03:00
Maksim Kita
04f5763f69 Added test_executable_dictionary tests 2021-12-28 22:55:30 +03:00
Maksim Kita
72909c67c2 Fix executable function tests 2021-12-28 22:55:30 +03:00
Maksim Kita
5590cfa3aa Updated executable function integration tests 2021-12-28 22:55:30 +03:00
Maksim Kita
d3e507b9ef Added executable function integrations tests 2021-12-28 22:55:30 +03:00
kssenii
67c5b41a58 Fix 2021-12-28 22:16:16 +03:00
kssenii
e9b4439a47 Fix 2021-12-28 15:08:40 +03:00
taiyang-li
aa97634d9b merge master 2021-12-28 18:38:50 +08:00
zhangxiao871
daa4c9e33b clickhouse-keeper acl consistent with zookeeper, accept generated digest 2021-12-28 17:17:01 +08:00
kssenii
61a2516c8c Merge remote-tracking branch 'upstream/master' into validate-config 2021-12-28 11:30:30 +03:00
alesapin
90db762c87
Merge pull request #33215 from ClickHouse/fix_flaky_integration_tests 
Fix some flaky integration tests
 2021-12-28 11:27:46 +03:00
alesapin
875eb54754
Update test.py 2021-12-28 11:21:33 +03:00
Vladimir C
bb6fc853e3
Merge pull request #31442 from vdimir/cluster-discovery 2021-12-28 10:53:30 +03:00
Kseniia Sumarokova
0178fb5e0b
Merge pull request #33214 from kssenii/external-database-fix-where-false 
Fix WHERE 1=0 for external databases query
 2021-12-27 18:53:52 +03:00
kssenii
55dfaef4de Settings changes as key value 2021-12-27 17:45:00 +03:00
vdimir
d3b1058c40
cluster discovery configuration, support shards 2021-12-27 15:26:11 +03:00
vdimir
fbdb5c60bd
initial initialization of cluster discovery in main thread 2021-12-27 15:26:10 +03:00
vdimir
57cbbd9fcf
global option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
96a0371eca
add option allow_experimental_cluster_discovery 2021-12-27 15:26:09 +03:00
vdimir
ceec643f90
update config structure: remote_servers_discovery -> remote_servers.discovery 2021-12-27 15:26:09 +03:00
vdimir
1f460f05fe
add retry for first check in test_cluster_discovery_startup_and_stop 2021-12-27 15:26:07 +03:00
vdimir
43bfcacd61
Add test_cluster_discovery 2021-12-27 15:26:06 +03:00
Vitaly Baranov
f80a3e3247
Merge pull request #30549 from aiven/kmichel-server-reload 
Start/stop servers when `listen_host`/`*_port` changes
 2021-12-27 14:51:00 +03:00
alesapin
48f0cee798 Merge branch 'master' into fix_flaky_integration_tests 2021-12-27 14:38:26 +03:00
alesapin
4eb8c11bb0
Merge pull request #33163 from azat/fix-test_input_format_parallel_parsing_memory_tracking 
Make test_input_format_parallel_parsing_memory_tracking less flaky
 2021-12-27 14:36:32 +03:00
alesapin
593dc6cf90 Fix some flaky integration tests 2021-12-27 12:24:19 +03:00
kssenii
a1aab3a82d Fix 2021-12-27 11:59:33 +03:00
Vladimir C
ea5f867289
Merge pull request #33179 from kssenii/materialized-postgresql-fix-detach-with-schema 2021-12-27 11:42:59 +03:00
Vladimir C
211a5a8d6b
Merge pull request #33159 from xuyatian/master 2021-12-27 11:40:59 +03:00
taiyang-li
9036b18c2f merge master 2021-12-27 15:12:48 +08:00
kssenii
568aeec0b3 Review fix 2021-12-27 09:51:29 +03:00
Yatian Xu
8dc07dff4a add Clarification for test case 2021-12-26 11:24:47 -08:00
kssenii
9f17e7bad0 Fix ddl validation 2021-12-26 20:56:31 +03:00
Azat Khuzhin
906ebc9fd4 test_input_format_parallel_parsing_memory_tracking: increase max_server_memory_usage 
Even after disabling all system tables TSan build still not passed,
since it uses 2.8Gi of RAM just after start, so let's increase this
memory limit a little.
 2021-12-26 16:50:35 +03:00
Azat Khuzhin
3f752c3acb Make test_input_format_parallel_parsing_memory_tracking less flaky 
By disabling system tables, that may consume memory too.

Also note, that failures with "curl: (56) Recv failure: Connection reset
by peer" like [1] is due to memory, since the server was under memory
pressure, and was not able even to accept the connection:

<details>

    2021.12.25 00:22:02.957658 [ 54 ] {} <Error> ThreadStatus: Code: 241. DB::Exception: Memory limit (total) exceeded: would use 2.81 GiB (attempt to allocate chunk of 2097182 bytes), maximum: 2.79 GiB. (MEMORY_LIMIT_EXCEEDED), Stack trace (when copying this message, always include the lines below):

    0. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/exception:0: Poco::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x1addca1b in /usr/bin/clickhouse
    1. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:57: DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa0e993c in /usr/bin/clickhouse
    2. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/string:1444: DB::Exception::Exception<char const*, char const*, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >(int, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, char const*&&, char const*&&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&, long&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&) @ 0xa11344b in /usr/bin/clickhouse
    3. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:226: MemoryTracker::allocImpl(long, bool) @ 0xa11220c in /usr/bin/clickhouse
    4. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:258: MemoryTracker::allocImpl(long, bool) @ 0xa111faa in /usr/bin/clickhouse
    5. ./obj-x86_64-linux-gnu/../src/Common/MemoryTracker.cpp:264: MemoryTracker::alloc(long) @ 0xa112bc6 in /usr/bin/clickhouse
    6. ./obj-x86_64-linux-gnu/../src/Common/ThreadStatus.cpp:152: DB::ThreadStatus::~ThreadStatus() @ 0xa10e182 in /usr/bin/clickhouse
    7. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:518: DB::TCPHandler::runImpl() @ 0x17c4192d in /usr/bin/clickhouse
    8. ./obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1909: DB::TCPHandler::run() @ 0x17c55328 in /usr/bin/clickhouse
    9. ./obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x1ac19f03 in /usr/bin/clickhouse
    10. ./obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1397: Poco::Net::TCPServerDispatcher::run() @ 0x1ac1a773 in /usr/bin/clickhouse
    11. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x1ae7e796 in /usr/bin/clickhouse
    12. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread.cpp:56: Poco::(anonymous namespace)::RunnableHolder::run() @ 0x1ae7c930 in /usr/bin/clickhouse
    13. ./obj-x86_64-linux-gnu/../contrib/poco/Foundation/include/Poco/SharedPtr.h:277: Poco::ThreadImpl::runnableEntry(void*) @ 0x1ae7afa8 in /usr/bin/clickhouse
    14. __tsan_thread_start_func @ 0xa039dfd in /usr/bin/clickhouse
    15. ? @ 0x7f4c565cf609 in ?
    16. clone @ 0x7f4c564f6293 in ?
     (version 21.13.1.1305)

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html
 2021-12-26 16:50:34 +03:00
kssenii
e663cb4574 Fix detaching-attaching table with schema 2021-12-25 19:51:55 +03:00
alexey-milovidov
f9d961d46d
Merge pull request #33164 from azat/fix-test_async_drain_connection 
Fix test_async_drain_connection flakiness
 2021-12-25 16:23:17 +03:00
Kruglov Pavel
22dbaec11a
Merge pull request #33142 from Avogar/fix-s3-write 
Don't allow to write into S3 if path contains globs
 2021-12-25 16:07:38 +03:00
kssenii
59dd5ba063 Validate config keys for external dictionaries 2021-12-25 14:26:35 +03:00
Azat Khuzhin
42ab02a810 Fix test_async_drain_connection flakiness 
Sometimes [1] 5 seconds is not enough, since drain_timeout is 3 seconds,
and 2 seconds sometimes is not enough to do other things, especially
under sanitizers:

    E           Code: 159. DB::Exception: Received from 172.16.1.2:9000. DB::Exception: Timeout exceeded: elapsed 5.019254094 seconds, maximum: 5. Stack trace:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/826f7cb0f53e20e67ef52800cb735bb88a6de658/integration_tests__thread__actions__[4/4].html
 2021-12-25 11:55:57 +03:00
Azat Khuzhin
da211909e9 tests/integration: refactor test_async_drain_connection 2021-12-25 11:55:57 +03:00
Yatian Xu
3fa78c5642 test case for metrics: StorageBufferBytes 2021-12-25 00:43:45 -08:00
Yatian Xu
2e151a278d correct table name 2021-12-25 00:03:23 -08:00
Yatian Xu
02362a35b4 add test case for metrics: StorageBufferBytes 2021-12-25 00:02:02 -08:00
avogar
58966e90e9 Don't allow to write into S3 if path contains globs 2021-12-24 17:13:35 +03:00
Nikita Mikhaylov
29fdc422d0
Merge pull request #32974 from nikitamikhaylov/hdfsCluster 
Merging #32400
 2021-12-24 16:02:54 +03:00
Kevin Michel
ffc1fca296
Start/stop servers when listen_host/*_port changes 
This allows starting and stopping separately each protocol server
without restarting ClickHouse.

This also allows adding or removing `listen_host` entries, which
start and stops servers for all enabled ports.

When stopping a server, the listening socket is immediately closed
(and available for another server).

Protocols with persistent connections try to wait for any currently
running query to finish before closing the connection, but idle
connection are closed quickly (depending on how often the protocol
is polled).

An extra ProfileEvent is added, `MainConfigLoads`, it is
incremented every time the configuration is reloaded. This helps
when trying to assess whether the new configuration was applied.
 2021-12-24 08:26:02 +01:00
mergify[bot]
d4ec469ed1
Merge branch 'master' into query-kind-concurent_restriction 2021-12-24 07:02:00 +00:00
Kseniia Sumarokova
f0434f21ce
Merge pull request #33039 from kssenii/fix-azure-exception 
Fix exception in azure write buffer desctructor
 2021-12-23 10:26:40 +03:00
alexey-milovidov
26e651eaf4
Merge pull request #32916 from azat/jemalloc-percpu-fix 
Disable percpu arena in jemalloc in case of non deterministic CPU count
 2021-12-23 08:05:43 +03:00
kssenii
182a065c9b Add test 2021-12-22 23:47:16 +03:00
Kseniia Sumarokova
764bb1181f
Merge pull request #33017 from stigsb/table-overrides-drop-add-column-support 
Remove the possibility of adding columns with table overrides
 2021-12-22 22:30:21 +03:00
Azat Khuzhin
b2d4520870 tests/integration/test_jemalloc_percpu_arena: cover explicit narenas 2021-12-22 21:06:21 +03:00
Azat Khuzhin
c82701b1ef tests/integration/test_jemalloc_percpu_arena: add support of fast-test binary 2021-12-22 21:05:11 +03:00
Azat Khuzhin
6efa3b3667 Add a test for jemalloc percpu arena with different number of online CPUs 2021-12-22 21:05:11 +03:00
Kseniia Sumarokova
01f2e4c00d
Merge pull request #33037 from kssenii/fix-s3-empty-file 
Fix s3 table function reading empty file
 2021-12-22 18:17:29 +03:00
tavplubix
85d49bf557
Merge pull request #33044 from ClickHouse/tavplubix-patch-5 
Decrease default timeout for integration test
 2021-12-22 17:26:23 +03:00
tavplubix
d8fb293d57
Merge pull request #32900 from zzsmdfj/issue/#15182_MaterializeMySQL_support_bit_type 
Add support for BIT data type in MaterializedMySQL
 2021-12-22 15:58:29 +03:00
tavplubix
8775afc25e
Update pytest.ini 2021-12-22 14:53:40 +03:00
kssenii
11731cde92 Fix test 2021-12-22 13:57:08 +03:00
tavplubix
4ba76dd8e3
Update materialize_with_ddl.py 2021-12-22 12:19:51 +03:00
kssenii
d8ed4db6d4 Fix 2021-12-22 11:42:23 +03:00
Stig Bakken
1cc70ad524 Remove the possibility of adding columns with table overrides 
(except ALIAS columns)

Supporting this properly requires more comprehensive changes.
 2021-12-22 08:20:14 +01:00
Kseniia Sumarokova
484a4d62dd
Merge pull request #32835 from kssenii/fising-s3 
Fix optimization with lazy seek for async reads from remote fs
 2021-12-22 09:38:23 +03:00
Kseniia Sumarokova
b8f6ca470a
Merge pull request #32985 from kssenii/rabbit-fix-tests 
RabbitMQ tests fix
 2021-12-21 21:32:39 +03:00
ianton-ru
e6fd4bfb50
Merge branch 'master' into MDB-15474 2021-12-21 17:38:36 +03:00
Anton Ivashkin
0c0bf66334 Merge master 2021-12-21 17:27:54 +03:00
Haavard Kvaalen
9a2b0680a1 Fix weird permission on log directories 
Several log directories for integration tests were created with full
permissions for "others" but no permission for the owner of the
directory.  This caused issues when trying to run integration tests
again without manually wiping files from previous runs.  The test would
fail with "PermissionError: [Errno 13] Permission denied: 'logs'".

The intention may have been to do the equivalent of 'chmod o+rwx logs',
but it instead did the equivalent of 'chmod 007 logs'.
 2021-12-21 11:50:54 +01:00