Commit Graph

3722 Commits

Author SHA1 Message Date
Nikolai Kochetov
2a6eb593be
Revert "Revert "Add pool to WriteBufferFromS3"" 2022-02-01 13:36:51 +03:00
alexey-milovidov
99392b5ca7
Merge pull request #13544 from amosbird/mdha
Multi-Disk auto-recovery.
2022-02-01 06:13:26 +03:00
alexey-milovidov
095d9bfa43
Revert "Add pool to WriteBufferFromS3" 2022-02-01 05:49:40 +03:00
mergify[bot]
e229487817
Merge branch 'master' into mdha 2022-02-01 01:22:16 +00:00
Amos Bird
ec7d367814
DiskLocal checker
Add DiskLocal checker so that ReplicatedMergeTree can recover data when some of its disks are broken.
2022-02-01 05:55:27 +08:00
alesapin
dd61d1c2de
Merge pull request #34172 from ClickHouse/fix_race_in_some_engines
Fix benign race condition for storage HDFS, S3, URL
2022-01-31 22:41:54 +03:00
alesapin
75d73d2785
Merge pull request #34139 from ClickHouse/fix_buf_s3_low_cardinality
Fix bug with bounded S3 reads and LowCardinality
2022-01-31 22:41:14 +03:00
avogar
058ef356ac Fix schema inference for table runction s3 2022-01-31 19:39:20 +03:00
Nikolai Kochetov
321fa4a9e8
Merge pull request #33291 from ClickHouse/add-pool-to-s3-write-buffer
Add pool to WriteBufferFromS3
2022-01-31 19:37:40 +03:00
alesapin
ace8169732 Fix kafka test 2022-01-31 19:18:34 +03:00
alesapin
c3f7dece5e
Update tests/integration/test_s3_low_cardinality_right_border/test.py
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2022-01-31 12:36:58 +03:00
alesapin
cb45a348f1 Merge branch 'master' into fix_buf_s3_low_cardinality 2022-01-30 17:30:55 +03:00
alesapin
7ada8227cf Fix bug with bounded S3 reads and LowCardinality 2022-01-29 18:28:40 +03:00
Anton Popov
96a506c6fa fix inserts to distributed tables in case of change of native protocol 2022-01-29 03:23:25 +03:00
FArthur-cmd
cb4ad97d45 add test 2022-01-28 17:37:52 +00:00
Nikolai Kochetov
1c9f026178 Merge branch 'master' into add-pool-to-s3-write-buffer 2022-01-28 16:01:42 +03:00
zhangxiao871
7b51e0b8b6 Better test 2022-01-28 18:00:52 +08:00
zhangxiao871
78e2794ada Fix START MERGES and add test 2022-01-28 14:30:57 +08:00
Nikolai Kochetov
7406721cb6 Try to fix race in test. 2022-01-27 18:38:39 +00:00
Raúl Marín
cb1524d4d9 Less flaky test_inconsistent_parts_if_drop_while_replica_not_active 2022-01-27 12:47:52 +01:00
tavplubix
9e91a9dfd1
Merge pull request #33429 from zzsmdfj/MaterializeMySQL_support_set_and_other_dataType
MaterializeMySQL support SET YEAR TIME GEOMETRY dataType
2022-01-26 11:29:46 +03:00
alesapin
b8c6481d4c Fix clickhouse server start when replicated access storage depend on keeper 2022-01-25 16:40:12 +03:00
Kruglov Pavel
9f12f4af13
Merge pull request #33302 from Avogar/formats-with-suffixes
Allow to create new files on insert for File/S3/HDFS engines
2022-01-25 10:56:15 +03:00
Azat Khuzhin
4a0facd341 Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES)
There is no more MAKE_*, so remove this alias.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-24 17:28:33 +03:00
alesapin
48c19e88a5
Merge pull request #33926 from ClickHouse/fix_flaky_test
Fix test_replica_is_active flaky test
2022-01-24 10:19:10 +03:00
alesapin
57dae1e308
Merge pull request #33162 from azat/integration-tests-status
Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
2022-01-23 21:46:59 +03:00
alesapin
51a6d08bff Fix test_replica_is_active flaky test 2022-01-23 19:31:09 +03:00
Mikhail f. Shiryaev
13f7f56c5b
Merge pull request #33342 from JaySon-Huang/get_cpu_cores_under_cgroup
Fix cpu count with cgroup limits
2022-01-22 11:32:08 +01:00
alexey-milovidov
844d5e59d3
Merge pull request #33880 from qoega/integration-stable-postgesql
Improve postgresql integration test
2022-01-22 12:57:46 +03:00
Yatsishin Ilya
23cb226904 fixes 2022-01-21 17:03:48 +00:00
JaySon-Huang
d71a31ba4b Fix typo
Signed-off-by: JaySon-Huang <tshent@qq.com>
2022-01-21 21:03:23 +08:00
JaySon-Huang
f01776d0af Add integration test
Signed-off-by: JaySon-Huang <tshent@qq.com>
2022-01-21 21:03:23 +08:00
mergify[bot]
65e940d55c
Merge branch 'master' into MaterializeMySQL_support_set_and_other_dataType 2022-01-21 11:37:22 +00:00
Maksim Kita
548a7bccee
Merge pull request #33804 from CurtizJ/redis-pool
Use connection pool for redis dictionary
2022-01-21 11:40:35 +01:00
zzsmdfj
f54d607b3b to MaterializeMySQL_support_set_and_other_dataType 2022-01-21 12:24:13 +08:00
zzsmdfj
e380e59b16 MaterializeMySQL support SET YEAR TIME GEOMETRY dataType 2022-01-21 12:24:11 +08:00
Kruglov Pavel
7bfb1231b9
Merge branch 'master' into formats-with-suffixes 2022-01-20 14:47:17 +03:00
Kseniia Sumarokova
064c3dd654
Merge pull request #33724 from liuneng1994/fix_ignore_hdfs_error
Throw exception when storage hdfs list directory failed
2022-01-20 11:59:09 +03:00
Anton Popov
4810d13aff use connection pool for redis dictionary 2022-01-20 03:12:28 +03:00
mergify[bot]
cbb87e762c
Merge branch 'master' into formats-with-suffixes 2022-01-19 17:21:18 +00:00
Amos Bird
62441f0a0f
Fix mutation when table contains projections (#33679) 2022-01-19 15:27:11 +03:00
Kruglov Pavel
3501b56587
Merge pull request #33730 from ianton-ru/MDB-16115-2
Fix restore S3 disk without detached directories
2022-01-19 12:31:59 +03:00
avogar
4efadfad3c Fix tests 2022-01-18 22:26:13 +03:00
alesapin
e5ec1aa446
Merge pull request #33642 from ClickHouse/add_integration_test_for_zero_duplication
Fix bug with background moves in zero copy replication
2022-01-18 18:32:16 +03:00
liuneng1994
15ea37c4ae ignore file not found exception
Signed-off-by: neng.liu <neng.liu@kyligence.io>
2022-01-18 12:49:40 +00:00
mergify[bot]
b318f9b5db
Merge branch 'master' into formats-with-suffixes 2022-01-18 12:17:07 +00:00
Anton Ivashkin
7c26a832f8 Fix restore S3 disk without detached directories 2022-01-18 12:31:31 +03:00
mergify[bot]
df869c5b9c
Merge branch 'master' into fix_ignore_hdfs_error 2022-01-18 07:05:24 +00:00
Ilya Yatsishin
601b6adaff
Merge pull request #33634 from qoega/fix-mongo2-compose 2022-01-18 09:47:25 +03:00
liuneng1994
c6e205b2ad add error check 2022-01-18 06:21:40 +00:00
Kseniia Sumarokova
232887ea6c
Update test.py 2022-01-17 16:39:53 +03:00
mergify[bot]
23f09bd25a
Merge branch 'master' into fix-mongo2-compose 2022-01-17 11:52:48 +00:00
alesapin
b2271cc2d9
Merge pull request #33288 from JackyWoo/add_lower_bound_session_timeout_to_keeper
Add lower bound session timeout to keeper
2022-01-17 14:06:15 +03:00
alesapin
ccf990e887 Merge branch 'master' into add_integration_test_for_zero_duplication 2022-01-17 13:33:39 +03:00
JackyWoo
a3cb2dd671 Trigger test 2022-01-17 12:00:40 +08:00
mergify[bot]
17f17c13f5
Merge branch 'master' into fix-mongo2-compose 2022-01-15 13:50:03 +00:00
alexey-milovidov
1e8e21570c
Merge pull request #33625 from ClickHouse/better_integration_tests
Fix two flaky integration tests
2022-01-15 02:32:54 +03:00
mergify[bot]
4ffc3bb589
Merge branch 'master' into fix-mongo2-compose 2022-01-14 18:36:37 +00:00
Kruglov Pavel
a7df9cd53a
Merge branch 'master' into formats-with-suffixes 2022-01-14 21:03:49 +03:00
alesapin
436ad63958 More retries 2022-01-14 20:05:55 +03:00
alesapin
bf803472b1 Add a tests for a TTL bug in zero copy replication 2022-01-14 18:44:10 +03:00
Kruglov Pavel
d2e9f37bee
Merge branch 'master' into format-by-extention 2022-01-14 18:36:23 +03:00
avogar
b127356e93 Fix s3 integration tests 2022-01-14 18:34:22 +03:00
Kruglov Pavel
5a908e8edd
Merge branch 'master' into formats-with-suffixes 2022-01-14 16:45:20 +03:00
avogar
8884c4a3fe Fix tests and build 2022-01-14 16:27:57 +03:00
Yatsishin Ilya
917ddcd4af better test 2022-01-14 13:08:31 +00:00
Yatsishin Ilya
2fe8f6c60b Fix ports allocated for mongo2 that is w/o creds 2022-01-14 13:00:38 +00:00
alesapin
32e40e9e6b Fixup 2022-01-14 14:28:44 +03:00
alesapin
54725bb289 Fix two flaky integration tests 2022-01-14 14:27:36 +03:00
avogar
2f000a178a Add more tests 2022-01-14 14:00:50 +03:00
Kseniia Sumarokova
10f0e44cc6
Merge pull request #33601 from ClickHouse/kssenii-patch-2
Fix flacky test_dictionaries_postgresql/
2022-01-14 09:44:10 +03:00
Kseniia Sumarokova
f1868114a6
Update test.py 2022-01-14 00:07:33 +03:00
Azat Khuzhin
ad86dad2d1 Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
Like here [1].

- test_jemalloc_percpu_arena/test.py::test_jemalloc_percpu_arena -- ERROR
- test_input_format_parallel_parsing_memory_tracking/test.py::test_memory_tracking_total -- FAIL

But test_jemalloc_percpu_arena is SKIPPED.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33140/b4420cfa3e834ab9026914978697ded3180122a0/integration_tests__thread__actions__[3/4].html

v2: tests/integration/ci-runner: include SKIPPED tests into "short test summary info"
    Otherwise they cannot be distinguished from ERRORS.
v3: tests/integration/ci-runner: improve report parser
v4: rewrite get_counters() to parse tests verbosity log instead of test
    short summary, since later does not provide test name for skipped
    tests
2022-01-13 22:07:40 +03:00
Kseniia Sumarokova
e2770c5093
Update test.py 2022-01-13 17:12:46 +03:00
mergify[bot]
085492614b
Merge branch 'master' into add_lower_bound_session_timeout_to_keeper 2022-01-13 12:21:46 +00:00
taiyang-li
82a3024712 Merge remote-tracking branch 'ck/master' into bigo_hive_table 2022-01-13 18:11:23 +08:00
lgbo-ustc
e1aecea30d try to fixed failure of test_hive_query for counting read bytes from cache 2022-01-13 10:47:11 +08:00
Alexander Tokmakov
25db53a3c5 add an integration test 2022-01-12 21:08:08 +03:00
lgbo-ustc
5c71d3687a fixed some bugs
1. interagtion test for test_hive_query failed
2. nullptr reference in arrowSchemaToCHHeader
2022-01-12 17:01:05 +08:00
taiyang-li
66813a3aa9 merge master 2022-01-12 16:56:29 +08:00
Kseniia Sumarokova
6587cd0ec6
Merge pull request #33231 from kssenii/settings-changes-with-named-conf
Pass settings as key value or config for storage with settings
2022-01-11 12:30:41 +03:00
Kruglov Pavel
94cb98df28
Merge pull request #33177 from kssenii/materialized-postgresql-better-startup
materialized postgresql better startup
2022-01-11 12:18:29 +03:00
kssenii
2faad57dd3 More tests 2022-01-11 01:58:05 +03:00
Mikhail f. Shiryaev
1cf46f378f
Merge pull request #33494 from msaf1980/rollup_rules_type
GraphiteMergeTree Rollup rules type
2022-01-10 20:53:20 +01:00
msaf1980
780a1b2abe graphite: split tagged/plain rollup rules (for merges perfomance) 2022-01-10 16:34:16 +05:00
tavplubix
376709b249
Merge pull request #33305 from nvartolomei/nv/test-odbc
Add test for broken connection
2022-01-10 14:23:38 +03:00
kssenii
669c7bf571 Add one more test 2022-01-10 14:04:18 +03:00
kssenii
21c34ad59b Add support for dictionary source 2022-01-10 14:00:03 +03:00
Kseniia Sumarokova
e6ea7c361d
Merge pull request #32836 from stigsb/explain-table-override
Add `EXPLAIN TABLE OVERRIDE` for pre-validating overrides.
2022-01-10 09:58:16 +03:00
JackyWoo
e600fddffa add test_keeper_session/__init__.py 2022-01-10 14:14:57 +08:00
kssenii
5fbafed807 Update test 2022-01-09 21:56:24 +03:00
kssenii
1984a80750 Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-09 21:23:49 +03:00
Kseniia Sumarokova
d0a847befc
Merge pull request #33200 from kssenii/fix-materialized-postgresql-ddl-validation
materialized postgresql fix ddl validation
2022-01-09 21:12:13 +03:00
kssenii
bfaab1356f Merge remote-tracking branch 'upstream/master' into settings-changes-with-named-conf 2022-01-09 17:56:44 +03:00
kssenii
55430feac9 Improve tests part 2 2022-01-09 15:12:46 +03:00
kssenii
6639a93735 Better 2022-01-09 12:16:12 +03:00
kssenii
61f85e9afc More fixes 2022-01-08 20:44:17 +03:00
alesapin
0860acb4ef
Merge pull request #33246 from nicelulu/fix_acl_map
Fix acl map num
2022-01-08 17:48:00 +03:00
kssenii
c94f4163f7 Merge remote-tracking branch 'upstream/master' into fix-materialized-postgresql-ddl-validation 2022-01-08 15:56:46 +03:00
kssenii
64538cf20f Merge remote-tracking branch 'upstream/master' into materialized-postgresql-better-startup 2022-01-08 00:49:08 +03:00