Commit Graph

2055 Commits

Author SHA1 Message Date
alesapin
cbd8a57fda Merge branch 'master' into ssl_keeper 2021-04-13 10:34:23 +03:00
songenjie
520f4f39ec [test][integration] fetch part 2021-04-13 15:17:03 +08:00
songenjie
564136ec46 [clickhouse][server][dll][alter]support fetch part 2021-04-13 12:40:33 +08:00
alexey-milovidov
7e867a26d7
Merge pull request #22647 from azat/integration-tests-pull-retries
Add retires for docker-compose pull in integration tests
2021-04-13 01:29:46 +03:00
alexey-milovidov
e2edecc8e2
Merge pull request #22434 from Avogar/catboost-reload
Update paths to the catboost model configs in config reloading
2021-04-13 01:21:04 +03:00
alesapin
56f0e290de
Merge pull request #22945 from ClickHouse/increase-fetches-pool-size
More conservative value of `background_fetches_pool_size` setting
2021-04-12 22:41:04 +03:00
alesapin
338ff1615c Simplier config 2021-04-12 15:40:01 +03:00
alesapin
ef34c95c7e Add SSL to keeper (both client and internal) 2021-04-12 15:25:52 +03:00
alesapin
abab3ba09f Fix lost comment 2021-04-12 11:07:28 +03:00
alesapin
5310c0c41d Proper config spec 2021-04-12 11:06:36 +03:00
kssenii
ab06ca3144 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-12 07:07:48 +00:00
kssenii
7a287e6fe9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-11 21:36:08 +00:00
Azat Khuzhin
fad42f8ac5 tests/integration: stop containers at start only if destroy_dirs is not set
Fixes tests with multiple clusters - test_zookeeper_config
2021-04-11 14:49:59 +03:00
Azat Khuzhin
3fa047bb0f tests/integration: run docker-compose commands after copying of compose files 2021-04-11 14:27:15 +03:00
Azat Khuzhin
d4bb4c5dd7 tests/integration: add docker-compose pull retries 2021-04-11 14:27:15 +03:00
Azat Khuzhin
c7bef49b37 tests/integration: drop --force-recreate since we have down/pull separately 2021-04-11 14:27:14 +03:00
Azat Khuzhin
dfcc9bdcb1 tests/integration: pull images in a separate step with --ignore-pull-failures 2021-04-11 14:27:14 +03:00
Azat Khuzhin
df2637e523 tests/integration: stops orphan contains too 2021-04-11 14:27:14 +03:00
alexey-milovidov
d21ffd83a7
Merge branch 'master' into catboost-reload 2021-04-11 13:29:36 +03:00
alexey-milovidov
9d08695ce1
Merge pull request #22441 from nikitamikhaylov/copier-copy-to-source
Add test for copier
2021-04-10 23:34:59 +03:00
alexey-milovidov
1c780b6673
Update test.py 2021-04-10 23:16:27 +03:00
alexey-milovidov
3016376818
Update test.py 2021-04-10 17:32:52 +03:00
alexey-milovidov
777fcc871f
Update test.py 2021-04-10 15:05:36 +03:00
Alexey Milovidov
68b6b3352c Adjust test 2021-04-10 15:03:45 +03:00
Alexander Kuzmenkov
e44b3822e3
Merge pull request #21850 from fastio/handle_errors_for_kafka_engine
Handle errors for Kafka engine
2021-04-09 22:59:40 +03:00
kssenii
2cff4f9409 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-09 11:14:44 +00:00
kssenii
72d89bc933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-09 11:13:01 +00:00
Anton Popov
30f2d839c3
Merge pull request #22868 from CurtizJ/prettify-logs
Prettify logs of integration tests
2021-04-09 13:10:00 +03:00
Anton Popov
00172f97da
Update ci-runner.py 2021-04-09 03:58:22 +03:00
Anton Popov
add4497502 prettify logs of integration tests 2021-04-09 00:08:49 +03:00
kssenii
7108ece268 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-08 19:14:07 +00:00
alesapin
1533f9b9aa
Merge pull request #14113 from johnskopis/dynamic-interserver-creds-v20
Support interserver credential rotation
2021-04-08 11:01:40 +03:00
alexey-milovidov
0d519d78ab
Merge pull request #22746 from Avogar/fix-flacky
Fix flacky hedged tests
2021-04-08 10:23:54 +03:00
Peng Jian
f73faf1578 fix test case 2021-04-08 14:26:32 +08:00
Peng Jian
16e971ee52 fix test case 2021-04-08 07:19:57 +08:00
alesapin
2987bbc948 Small improvements 2021-04-07 16:52:11 +03:00
Peng Jian
604ba9db60 add test case 2021-04-07 20:15:15 +08:00
Pavel Kruglov
19b147c7ac Allow more replica change events in hedged tests due to high server load during testing 2021-04-07 13:30:47 +03:00
kssenii
7a89948801 Fix 2021-04-07 07:16:50 +00:00
kssenii
0b39480d51 Better 2021-04-06 20:01:23 +00:00
kssenii
5a143a4d12 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-06 16:50:13 +00:00
alesapin
1c8e33414f Merge branch 'master' into johnskopis/dynamic-interserver-creds-v20 2021-04-06 16:28:46 +03:00
Kseniia Sumarokova
ad85467128
Merge pull request #22668 from kssenii/postgres-add-bool
Add bool type in postgres engine
2021-04-06 13:29:33 +03:00
Alexander Kuzmenkov
c7776fefc0
Merge pull request #22110 from excitoon-favorites/testfinalize
Better tests for finalize in nested writers
2021-04-06 12:49:14 +03:00
alesapin
86a843bb51
Merge pull request #21509 from kssenii/library-bridge
clickhouse-library-bridge for library dictionary source
2021-04-06 12:26:08 +03:00
kssenii
38f135ab39 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-05 15:37:53 +00:00
kssenii
dc42d5189d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-05 15:36:35 +00:00
kssenii
cc2fdc6c62 Add bool type 2021-04-05 14:49:52 +00:00
kssenii
89a2e94364 Fixes 2021-04-05 14:08:49 +00:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
kssenii
eeb4dd4f4c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-05 11:30:28 +00:00
kssenii
2f73dc254c Add integration test 2021-04-05 09:33:08 +00:00
kssenii
8cbfbb5de7 Small refactoring, add hdfs to test_disk_types 2021-04-03 12:02:29 +00:00
tavplubix
541b601317
Try fix flaky test 2021-04-03 13:25:40 +03:00
kssenii
90db0be8e9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-03 08:01:13 +00:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
kssenii
fdab1021f6 Add unpause container after test 2021-04-03 07:59:26 +00:00
tavplubix
93bd2c3b67
Merge pull request #18978 from myrrc/feature/attach-partition-local
Lookup parts/partitions in replica's own detached/ folder before downloading them from other replicas
2021-04-02 17:46:03 +03:00
alexey-milovidov
61d4794726
Merge pull request #22440 from ianton-ru/s3_zero_copy_replication
Fix flapping test_s3_zero_copy_replication
2021-04-02 10:08:39 +03:00
kssenii
bcc37cd587 Fix test 2021-04-01 23:12:08 +00:00
kssenii
c739176f7f Update test 2021-04-01 20:22:33 +00:00
Mike Kot
c947280dfc Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-04-01 21:38:51 +03:00
Pavel Kruglov
dfbe042bf1 Change test 2021-04-01 19:17:25 +03:00
Pavel Kruglov
1c30bc13cc Add model 2021-04-01 18:47:32 +03:00
Nikita Mikhaylov
81fceb38d9 add test 2021-04-01 17:14:54 +03:00
kssenii
99f0b08ac3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-01 13:48:33 +00:00
Anton Ivashkin
1b613d454f Fix flapping test_s3_zero_copy_replication 2021-04-01 16:40:52 +03:00
Kseniia Sumarokova
e3fac9ef32
Merge branch 'master' into nanodbc 2021-04-01 16:38:00 +03:00
kssenii
29db632d64 Update test 2021-04-01 13:36:37 +00:00
tavplubix
bbae136a1e
Merge pull request #22380 from kssenii/fix-rabbit-test
Try fix flaky rabbitmq test
2021-04-01 15:44:45 +03:00
Pavel Kruglov
187ecab467 Fix test 2021-04-01 15:12:34 +03:00
kssenii
8300a74f5a Fix 2021-04-01 12:09:44 +00:00
Pavel Kruglov
cc65a1db97 Update paths to the model configs in config reloading 2021-04-01 13:30:05 +03:00
kssenii
747967a9bb Better 2021-04-01 10:27:24 +00:00
kssenii
f6163bb51d Fix 2021-04-01 07:55:16 +00:00
alexey-milovidov
4fb6874c99
Merge pull request #22371 from vitlibar/fix-flaky-tests
Fix flaky tests test_row_policy* and test_quota*
2021-04-01 03:01:34 +03:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
tavplubix
1347154732
Merge pull request #22341 from zhang2014/fix/integration_test_for_materialize_mysql
MySQL is started only once with MaterializeMySQL integration test
2021-03-31 16:11:38 +03:00
kssenii
cb845731b0 Add connection pools 2021-03-31 12:41:12 +00:00
Peng Jian
e30c07db20 add test cases 2021-03-31 20:22:36 +08:00
tavplubix
5fa2244aa4
Merge pull request #21944 from azat/dist-stress-test
Add stress test for distributed queries
2021-03-31 14:54:43 +03:00
tavplubix
6c1e2a0d87
Merge pull request #21690 from ClickHouse/test_multiple_nodes
Run three nodes with Replicated database and NuKeeper in CI
2021-03-31 12:31:13 +03:00
Peng Jian
cc56302e8b fix test case 2021-03-31 17:16:51 +08:00
Peng Jian
17a5fc6e0e add test 2021-03-31 17:16:51 +08:00
Vladimir
57eb5f8772
Merge pull request #22070 from Jokser/disk-s3-migration 2021-03-31 11:06:40 +03:00
kssenii
da959d3c03 Merge branch 'fix-rabbit-test' of https://github.com/kssenii/ClickHouse into fix-rabbit-test 2021-03-31 07:39:51 +00:00
kssenii
f2a8e40012 Do not rely on time 2021-03-31 07:37:34 +00:00
alexey-milovidov
a21fe0b492
Merge pull request #22378 from ianton-ru/s3_zero_copy_replication
Fix S3 Zero-Copy replication for hybrid storage
2021-03-31 04:15:47 +03:00
tavplubix
5117de1a0e
Merge pull request #22343 from Avogar/secure-socket-timeouts
Remove setting same timeouts in secure socket
2021-03-30 23:10:33 +03:00
Kseniia Sumarokova
47431df7ce
Update test.py 2021-03-30 22:18:03 +03:00
kssenii
d82d3a9e65 Try fix flaky rabbitmq test 2021-03-30 18:48:33 +00:00
Anton Ivashkin
f87435213e Fix S3 Zero-Copy replication for hybrid storage 2021-03-30 20:38:04 +03:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
Vitaly Baranov
2162a19d35 Fix flaky tests. 2021-03-30 19:19:35 +03:00
kssenii
9b565b37b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-30 10:35:24 +00:00
Pavel Kruglov
5f3cb525ee Remove setting same timeouts in secure socket 2021-03-30 10:51:44 +03:00
Alexander Tokmakov
24fc120076 Merge branch 'master' into test_multiple_nodes 2021-03-30 10:40:38 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper
Rename NuKeeper and TestKeeper to Keeper in all places
2021-03-30 10:39:22 +03:00
zhang2014
6d2f4dd82e MySQL is started only once with MaterializeMySQL integration test 2021-03-30 14:51:19 +08:00
alexey-milovidov
b7b55ce61d
Merge pull request #20088 from nvartolomei/nv/replicated-fetches-timeouts
Replicated fetches timeouts
2021-03-30 03:46:09 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
Alexander Tokmakov
a5b07f2f03 Merge branch 'master' into test_multiple_nodes 2021-03-29 22:43:25 +03:00
tavplubix
3c0f5a57ec
Merge pull request #21535 from ClickHouse/distributed_ddl_improvements
Distributed DDL improvements
2021-03-29 22:40:11 +03:00
alexey-milovidov
1512ff832e
Merge branch 'master' into nv/replicated-fetches-timeouts 2021-03-29 19:25:13 +03:00
kssenii
7fdab046b5 Add test for cyrillic + varchar(n) from issue 2021-03-29 14:25:15 +00:00
Alexander Kuzmenkov
0171ab95fa
Merge pull request #21640 from vdimir/fix-join-where-database-engine
Remove unknown columns from joined table in where for queries to external database engines
2021-03-29 16:14:10 +03:00
alesapin
4ce81a91e5 Remove unused file 2021-03-29 12:16:58 +03:00
alesapin
4e18a5c241 Renames in integration tests 2021-03-29 11:35:26 +03:00
Vladimir Chebotarev
213a561e21 Improved test. 2021-03-29 10:07:41 +03:00
Vladimir Chebotarev
d157540254 Added test for put with compression and wrong credentials. 2021-03-29 10:07:41 +03:00
kssenii
364a6a5e7a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-28 21:19:49 +00:00
kssenii
ec4582ff83 Better test 2021-03-28 19:35:58 +00:00
kssenii
ef537b802f Better comments 2021-03-27 21:10:44 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
f141f027f4 Make common class for external storages 2021-03-27 17:12:47 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
alesapin
b8eab8cba9
Merge pull request #22170 from ClickHouse/fix_odbc_interaction
Fix some flaky order dependent integration tests.
2021-03-27 10:17:37 +03:00
kssenii
b3e5f5d8c6 Add support for datetime64 and Decimal* for odbc storage 2021-03-26 21:26:49 +00:00
Kruglov Pavel
c86202dd09
Merge pull request #22151 from azat/tests-sleep_in_send_ms
Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests
2021-03-26 21:22:32 +03:00
kssenii
97e6040cf1 Encode passed data 2021-03-26 16:11:02 +00:00
alesapin
aa2244bad5 Fix more 2021-03-26 18:59:14 +03:00
alesapin
9bb0dc48b2 Fix one more test 2021-03-26 18:37:26 +03:00
alesapin
1b0a9461f0 Fix more tests 2021-03-26 18:30:35 +03:00
Kruglov Pavel
5c0c6a9aec
Delete unused users.xml 2021-03-26 18:16:15 +03:00
alesapin
0fae73071c Fix flaky test 2021-03-26 18:14:42 +03:00
alesapin
8b08c0c3a6 Fix test_odbc_interaction 2021-03-26 17:45:52 +03:00
tavplubix
ae62bee939
Merge pull request #21913 from ClickHouse/fix_context_ref
Fix possibly dangling reference to Context
2021-03-26 10:39:13 +03:00
Azat Khuzhin
c36f147b16 Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests 2021-03-26 10:05:56 +03:00
Azat Khuzhin
9db74c4dc0 Add stress test for distributed queries
It may founds issue like in [1]:

    2021.03.18 19:05:38.783328 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> executeQuery: (from 127.0.0.1:40918, using production parser) select * from dist where key = 0;
    2021.03.18 19:05:38.783760 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> StorageDistributed (dist): Skipping irrelevant shards - the query will be sent to the following shards of the cluster (shard numbers): [1]
    2021.03.18 19:05:38.784012 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784410 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784488 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> StorageDistributed (dist): Disabling force_optimize_skip_unused_shards for nested queries (force_optimize_skip_unused_shards_nesting exceeded)
    2021.03.18 19:05:38.784572 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> InterpreterSelectQuery: Complete -> Complete
    2021.03.18 19:05:38.819063 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Information> executeQuery: Read 20 rows, 80.00 B in 0.035687783 sec., 560 rows/sec., 2.19 KiB/sec.
    2021.03.18 19:05:38.827842 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> MemoryTracker: Peak memory usage (for query): 0.00 B.

    2021.03.18 19:05:38.867752 [ 547 ] {} <Fatal> BaseDaemon: ########################################
    2021.03.18 19:05:38.867959 [ 547 ] {} <Fatal> BaseDaemon: (version 21.4.1.1, build id: A0ADEC175BD65E58EA012C47C265E661C32D23B5) (from thread 245) (query_id: 4b1f5ec0-bf2d-478c-a2e1-d312531db206) Received signal Aborted (6)
    2021.03.18 19:05:38.868733 [ 547 ] {} <Fatal> BaseDaemon:
    2021.03.18 19:05:38.868958 [ 547 ] {} <Fatal> BaseDaemon: Stack trace: 0x7fd1394be18b 0x7fd13949d859 0x10c4c99b 0xd434ee1 0xd434f1a
    2021.03.18 19:05:38.870135 [ 547 ] {} <Fatal> BaseDaemon: 3. gsignal @ 0x4618b in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.870383 [ 547 ] {} <Fatal> BaseDaemon: 4. abort @ 0x25859 in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.886783 [ 547 ] {} <Fatal> BaseDaemon: 5. /work3/azat/ch/clickhouse/.cmake/../contrib/libunwind/src/UnwindLevel1.c:396: _Unwind_Resume @ 0x10c4c99b in /usr/bin/clickhouse
    2021.03.18 19:05:47.200208 [ 547 ] {} <Fatal> BaseDaemon: 6. ? @ 0xd434ee1 in /usr/bin/clickhouse
    2021.03.18 19:05:47.348738 [ 547 ] {} <Fatal> BaseDaemon: 7.1. inlined from /work3/azat/ch/clickhouse/.cmake/../contrib/boost/boost/context/fiber_fcontext.hpp:253: boost::context::fiber::~fiber()
    2021.03.18 19:05:47.349118 [ 547 ] {} <Fatal> BaseDaemon: 7.2. inlined from ../contrib/boost/boost/context/fiber_fcontext.hpp:252: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine>::run(void*)
    2021.03.18 19:05:47.349163 [ 547 ] {} <Fatal> BaseDaemon: 7. ../contrib/boost/boost/context/fiber_fcontext.hpp:80: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine> >(boost::context::detail::transfer_t) @ 0xd434f1a in /usr/bin/clickhouse
    2021.03.18 19:05:47.618174 [ 547 ] {} <Fatal> BaseDaemon: Calculated checksum of the binary: FF3BA83D0CD648741EEEC242CB1966D9. There is no information about the reference checksum.

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/1b2ed51ff5e4a3dc45567d4967108f43f680c884/stress_test_(debug).html#fail1
2021-03-26 01:04:48 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage
Added specialized CacheDictionaryStorage
2021-03-25 21:29:01 +03:00
Kruglov Pavel
66b8431e71
Merge pull request #21429 from Avogar/secure-socket
Fix receive and send timeouts and non-blocking read in secure socket
2021-03-25 17:30:17 +03:00
Mike Kot
285af08949 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-24 22:34:20 +03:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
Pavel Kovalenko
7e462a77a7 Disk S3 possibility to migrate to restorable schema 2021-03-24 13:07:01 +03:00
Pavel Kovalenko
e378c0bf8a Disk S3 possibility to migrate to restorable schema 2021-03-24 12:20:33 +03:00
kssenii
1ef3c1f780 Use binary format for params 2021-03-24 07:55:21 +00:00
tavplubix
48b89a0ace
Merge pull request #21998 from Avogar/hedged-test
Update tests for hedged requests
2021-03-23 18:18:49 +03:00
Vitaly Baranov
090e558da4
Merge pull request #21844 from Avogar/catboost-deadlock
Fix deadlock in first catboost model execution
2021-03-23 15:01:04 +03:00
alesapin
36898bdc4a
Merge pull request #21142 from Jokser/unfreeze-partitions
Add ALTER TABLE UNFREEZE command.
2021-03-23 14:05:38 +03:00
Pavel Kruglov
dbc5018000 Update tests for hedged requests 2021-03-22 22:18:06 +03:00
Alexander Kuzmenkov
2f5dbf57b6
Merge pull request #21839 from kssenii/add-postgres-connection-pool
Add connection pool for postgres engine
2021-03-22 19:49:51 +03:00
tavplubix
5dfd0045a6
Merge branch 'master' into distributed_ddl_improvements 2021-03-22 18:13:19 +03:00
Mike Kot
da67e06aa0 Added another test case to handle missing part data 2021-03-22 17:52:21 +03:00
kssenii
472ce89b75 Small fixes 2021-03-22 14:39:17 +00:00
Mike Kot
c55a73b752 Added the solution to handle the corruption case
When the part data (e.g. data.bin) is corrupted, but the checksums.txt
is present -- explicitly deleting the checksums.txt.

Removed the extra logging, changes some exceptions message.
2021-03-22 17:23:43 +03:00
Mike Kot
5789507e8b Investigating, why the checksums may match when they shouldn't. 2021-03-22 17:23:43 +03:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
Vladimir
c8b5be636f
Merge pull request #21438 from arenadata/ADQM-170 2021-03-19 17:06:55 +03:00
Alexander Tokmakov
1845df25f3 fix possibly dangling reference to Context 2021-03-19 17:02:48 +03:00
Alexander Kuzmenkov
78c56b8913
Merge pull request #21886 from Avogar/hedged
Add profile event in hedged requests and change timeout from sec to ms.
2021-03-19 15:50:33 +03:00
tavplubix
4ec71c6897
Merge pull request #16608 from ClickHouse/tavplubix-patch-1
Add soft task timeout for Intergation tests
2021-03-19 15:25:21 +03:00
Kruglov Pavel
e45b44fe8c
Restart tests 2021-03-19 14:16:19 +03:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
Pavel Kruglov
2a24d4f295 Add init.py 2021-03-18 20:27:37 +03:00
Pavel Kruglov
d380454044 Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets 2021-03-18 20:16:17 +03:00
Alexander Tokmakov
d7482373d3 fix 2021-03-18 19:59:51 +03:00
tavplubix
93ee8cc78b
Merge pull request #21819 from TCeason/fix_integration_MaterializeMySQL
fix integration MaterializeMySQL test
2021-03-18 19:22:31 +03:00
Alexander Tokmakov
4ea3178efc fix 2021-03-18 17:51:09 +03:00
Alexander Tokmakov
343b8c906d Merge branch 'master' into test_multiple_nodes 2021-03-18 16:01:04 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
kssenii
b135b814fb less crazy test 2021-03-18 07:02:12 +00:00
TCeason
1f5904fea9 fix integration MaterializeMySQL test
https://github.com/ClickHouse/ClickHouse/pull/21759
2021-03-18 14:08:26 +08:00
tavplubix
0826004353
Merge branch 'master' into tavplubix-patch-1 2021-03-17 22:31:35 +03:00
Pavel Kruglov
53095bb6e4 Add model 2021-03-17 22:31:23 +03:00
Alexander Tokmakov
f0c930bf9d remove query timeouts 2021-03-17 22:28:18 +03:00
Pavel Kruglov
bf888b7e5f Fix deadlock in first catboost model execution 2021-03-17 21:57:40 +03:00
Alexander Tokmakov
91068b782b fix 2021-03-17 17:29:24 +03:00
kssenii
51cb89973d Add test 2021-03-17 13:57:55 +00:00
Mike Kot
2ccdb7ef5c Multiple small code and test updates
- Updated the docs to make everything clear.
- Multiple small logger fixes.
- Changed the attach_part command -- now it's after check for the
covering parts -- motivation is to do less work with the checksums
fetching.
- Better logging in the integration test.
2021-03-17 16:52:35 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities
Support replicas priority for postgres dictionary source
2021-03-17 16:02:00 +03:00
Pavel Kovalenko
7ba1b8dbd5 Fixed flaky test_merge_tree_s3::test_insert_same_partition_and_merge 2021-03-17 16:00:22 +03:00
kssenii
c17fe87eb8 Update test 2021-03-17 08:46:57 +00:00
alesapin
ef0ec22377
fix 2021-03-17 10:14:46 +03:00
tavplubix
d42b442b83
Update ci-runner.py 2021-03-17 03:57:33 +03:00
tavplubix
ccf46d8269
Update ci-runner.py 2021-03-17 02:16:03 +03:00
tavplubix
a093980767
Merge pull request #21711 from kssenii/non-default-schema
Support non-default table schema for postgres storage/table-function
2021-03-17 02:10:32 +03:00
tavplubix
5d73a96a51
Update ci-runner.py 2021-03-17 00:39:38 +03:00
Alexander Tokmakov
2d34bbb4b2 Merge branch 'master' into test_multiple_nodes 2021-03-16 21:29:26 +03:00
Alexander Tokmakov
5037d2c10d add timeout for the whole task 2021-03-16 20:48:45 +03:00
Alexander Tokmakov
3ba6dc2aee Merge branch 'master' into tavplubix-patch-1 2021-03-16 20:05:07 +03:00
Ilya Golshtein
518103f851 old Avro test data removed 2021-03-16 19:39:58 +03:00
kssenii
8b360a1dfb Try fix tests 2021-03-16 15:35:57 +00:00
kssenii
f8a99804c1 Add double quotes 2021-03-16 11:15:43 +00:00
alexey-milovidov
f52e29cfec
Merge pull request #21624 from vdimir/storage-s3-fail
Try to fix test_storage_s3: crash in WriteBufferFromS3
2021-03-16 13:38:48 +03:00
kssenii
4bdfc799f5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into non-default-schema 2021-03-16 10:05:10 +00:00
Pavel Kovalenko
39f3b17041 Merge remote-tracking branch 'origin/master' into unfreeze-partitions 2021-03-16 10:56:24 +03:00
alesapin
8fd3fbc5b3
Merge pull request #20387 from Avogar/optimize-on-insert
Don't create empty parts on INSERT
2021-03-16 10:20:34 +03:00
Anton Popov
840417c957
Merge pull request #21685 from Avogar/reload-cluster-config
Update clusters only if their configs were updated
2021-03-15 20:09:58 +03:00
Mike Kot
406d037ebb Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-15 18:41:47 +03:00
Vitaly Baranov
6153f52811
Merge pull request #21641 from vitlibar/allowed-grantees
Add new clause GRANTEES for CREATE/ALTER USER
2021-03-15 12:47:22 +03:00
Ilya Golshtein
abcf581005 avro bug with format_setting reference and a typo in kafka test 2021-03-15 12:19:33 +03:00
alesapin
caccc6da37 Add missing tests 2021-03-15 12:01:26 +03:00
tavplubix
6a265f468e
Merge branch 'master' into distributed_ddl_improvements 2021-03-15 11:24:14 +03:00
kssenii
bd38a7a021 Fix tests 2021-03-15 06:37:07 +00:00
kssenii
8688ae9346 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-14 19:32:21 +00:00
Vitaly Baranov
37ce6e26d3 Add a new clause GRANTEES to commands CREATE USER and ALTER USER. 2021-03-14 19:12:42 +03:00
alesapin
dad5238d7d
Merge pull request #16240 from ianton-ru/s3_zero_copy_replication
S3 zero copy replication
2021-03-14 18:19:37 +03:00
Ilya Golshtein
a579fcb424 kafka/avro works against table 2021-03-14 15:55:44 +03:00
kssenii
797063ae0f Support non-default table schema for postgres storage/table-function 2021-03-14 10:35:10 +00:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Pavel Kruglov
3e3b5c64bf add init file 2021-03-14 02:34:32 +03:00
alesapin
06eb2d8dfd
Merge branch 'master' into s3_zero_copy_replication 2021-03-13 22:32:54 +03:00
kssenii
5d953a4b86 Better 2021-03-12 21:48:52 +00:00
kssenii
886f9a5d9d More tests 2021-03-12 21:22:46 +00:00
Pavel Kruglov
58e415c7d4 Update clusters only if their configs were updated 2021-03-13 00:17:19 +03:00
Azat Khuzhin
2e99dad562 Tiny "machine" cleanup of test_replace_partition 2021-03-12 21:10:16 +03:00
Azat Khuzhin
5af5c90b8b Fix test_replace_partition flakiness
test_replace_partition/test.py::test_replace_after_replace_failover
statistics:

```sql
┌──────ymd─┬─success─┬─failure─┐
│ 20200613 │      40 │       2 │
│ 20200614 │      98 │       2 │
│ 20200615 │     126 │       9 │
│ 20200616 │     141 │      10 │
│ 20200617 │     119 │       7 │
│ 20200618 │      87 │      12 │
│ 20200619 │      81 │       9 │
...
│ 20210305 │      60 │      28 │
│ 20210306 │      69 │       7 │
│ 20210307 │      42 │       0 │
│ 20210308 │      53 │       8 │
│ 20210309 │     137 │      23 │
│ 20210310 │      84 │      14 │
│ 20210311 │      81 │      20 │
└──────────┴─────────┴─────────┘
```
2021-03-12 21:10:16 +03:00
kssenii
5602b82faa Fix test 2021-03-12 14:07:20 +00:00
Anton Ivashkin
ace628d565 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-12 12:58:32 +03:00
kssenii
4529b4792d Fix typo 2021-03-12 09:56:03 +00:00
kssenii
571590fcfb Update tests, dockerfile 2021-03-12 09:20:18 +00:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alexey-milovidov
9e0d53c0e6
Merge pull request #20058 from excitoon-favorites/remotehostfilterdisallowall
Fixed open behavior of remote host filter in case when there is `remote_url_allow_hosts` section in configuration but no entries there
2021-03-12 11:14:15 +03:00
alesapin
cca05da7fa
Merge pull request #16481 from amosbird/jbodbalance
Auto-balance big parts in JBOD array
2021-03-12 11:07:47 +03:00
alesapin
b98e27ba82
Merge branch 'master' into s3_zero_copy_replication 2021-03-12 11:07:20 +03:00
kssenii
9e0101e5fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-12 07:47:22 +00:00
kssenii
4acaee2f38 Fix config 2021-03-12 07:12:38 +00:00
kssenii
1c8ad914e6 Fix 2021-03-11 18:10:12 +00:00
kssenii
5ff95e615d Add tests 2021-03-11 18:05:08 +00:00
vdimir
2156401506
Remove unknown columns from joined table in where for queries to external database engines 2021-03-11 20:53:29 +03:00
Alexander Kuzmenkov
3e5447ccec
Merge pull request #21480 from Avogar/slowdown_count
Add slowdown_count and show actual errors_count in system.clusters
2021-03-11 17:18:05 +03:00
vdimir
1194d50e48
Try to fix test_storage_s3: crash in WriteBufferFromS3 2021-03-11 15:21:13 +03:00
Vladimir
08f312b1c4
Merge pull request #21457 from GrigoryPervakov/master
recreate S3 client if credentials changed
2021-03-11 15:18:39 +03:00
Nikita Mikhaylov
39b59e86b0
Merge pull request #21456 from nikitamikhaylov/zookeeper-secure-race
Fix race in SecureSocket
2021-03-10 20:49:56 +03:00
tavplubix
26ebd54eaf
Merge pull request #20961 from havardk/reconnect
MaterializeMySQL: Attempt to reconnect to MySQL if the connection is lost
2021-03-10 20:07:11 +03:00
Vitaly Baranov
7364fe4d4c
Merge pull request #21190 from vitlibar/quota-test-more-cases
Add more tests for quota consumption by the SHOW statement
2021-03-10 16:41:38 +03:00
Anton Ivashkin
cef0dda933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-10 14:10:29 +03:00
Pervakov Grigorii
eb87afc4d4 recreate S3 client if credentials changed 2021-03-10 13:36:57 +03:00
Alexander Tokmakov
ba3d51383c fix 2021-03-10 00:41:04 +03:00
Amos Bird
e52b2fb8ae
update 2021-03-10 02:56:46 +08:00
Alexander Tokmakov
4d19c84d90 Merge branch 'master' into distributed_ddl_improvements 2021-03-09 20:06:41 +03:00
tavplubix
5a6cc876e4
Merge pull request #20626 from ClickHouse/fix_force_drop_materialized_view
Make force_drop_table work with MaterializedView
2021-03-09 20:05:51 +03:00
Alexander Tokmakov
83b3e4e0f5 allow to use Cluster from Replicated db 2021-03-09 20:05:24 +03:00
alesapin
bcd073278d
Merge pull request #21425 from ClickHouse/persistent_nukeeper_snapshot_storage
Persistent nukeeper snapshot storage
2021-03-09 18:37:23 +03:00
Vitaly Baranov
25b88afa66 Add more tests for quota consumption by the SHOW statement. 2021-03-09 18:01:34 +03:00
Nikita Mikhaylov
9684fed32a better test 2021-03-09 16:24:53 +03:00
Nikita Mikhaylov
c38a690e8e add multithreaded test 2021-03-09 16:24:53 +03:00
tavplubix
18db0e5683
trigger CI 2021-03-09 14:58:07 +03:00
alesapin
c00c8c36b7 Merge branch 'master' into ianton-ru-s3_zero_copy_replication 2021-03-09 10:59:11 +03:00
alesapin
dcc6c9d378 More tries to wait server start 2021-03-09 10:19:14 +03:00
alexey-milovidov
0a3275e169
Merge pull request #21496 from Felixoid/rollup_grow
Add check for growing age AND precision in rollup config
2021-03-09 07:31:07 +03:00
Alexander Tokmakov
2022b90919 configurable output mode for distributed DDL 2021-03-08 23:35:09 +03:00
Alexander Tokmakov
2484781070 fix MV recovery in Replicated db 2021-03-08 20:26:38 +03:00
Amos Bird
2ec20c5d23
update and add tests 2021-03-08 17:38:07 +08:00
alesapin
ef192ec310 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-07 10:31:06 +03:00
Mikhail f. Shiryaev
efc04b29a6
Add check for growing age AND precision in rollup config 2021-03-06 18:35:53 +01:00