Commit Graph

1808 Commits

Author SHA1 Message Date
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
Vitaly Baranov
2162a19d35 Fix flaky tests. 2021-03-30 19:19:35 +03:00
Pavel Kruglov
5f3cb525ee Remove setting same timeouts in secure socket 2021-03-30 10:51:44 +03:00
Alexander Tokmakov
24fc120076 Merge branch 'master' into test_multiple_nodes 2021-03-30 10:40:38 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper
Rename NuKeeper and TestKeeper to Keeper in all places
2021-03-30 10:39:22 +03:00
zhang2014
6d2f4dd82e MySQL is started only once with MaterializeMySQL integration test 2021-03-30 14:51:19 +08:00
alexey-milovidov
b7b55ce61d
Merge pull request #20088 from nvartolomei/nv/replicated-fetches-timeouts
Replicated fetches timeouts
2021-03-30 03:46:09 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
Alexander Tokmakov
a5b07f2f03 Merge branch 'master' into test_multiple_nodes 2021-03-29 22:43:25 +03:00
tavplubix
3c0f5a57ec
Merge pull request #21535 from ClickHouse/distributed_ddl_improvements
Distributed DDL improvements
2021-03-29 22:40:11 +03:00
alexey-milovidov
1512ff832e
Merge branch 'master' into nv/replicated-fetches-timeouts 2021-03-29 19:25:13 +03:00
Alexander Kuzmenkov
0171ab95fa
Merge pull request #21640 from vdimir/fix-join-where-database-engine
Remove unknown columns from joined table in where for queries to external database engines
2021-03-29 16:14:10 +03:00
alesapin
4ce81a91e5 Remove unused file 2021-03-29 12:16:58 +03:00
alesapin
4e18a5c241 Renames in integration tests 2021-03-29 11:35:26 +03:00
Vladimir Chebotarev
213a561e21 Improved test. 2021-03-29 10:07:41 +03:00
Vladimir Chebotarev
d157540254 Added test for put with compression and wrong credentials. 2021-03-29 10:07:41 +03:00
kssenii
ec4582ff83 Better test 2021-03-28 19:35:58 +00:00
kssenii
ef537b802f Better comments 2021-03-27 21:10:44 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
f141f027f4 Make common class for external storages 2021-03-27 17:12:47 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
alesapin
b8eab8cba9
Merge pull request #22170 from ClickHouse/fix_odbc_interaction
Fix some flaky order dependent integration tests.
2021-03-27 10:17:37 +03:00
Kruglov Pavel
c86202dd09
Merge pull request #22151 from azat/tests-sleep_in_send_ms
Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests
2021-03-26 21:22:32 +03:00
kssenii
97e6040cf1 Encode passed data 2021-03-26 16:11:02 +00:00
alesapin
aa2244bad5 Fix more 2021-03-26 18:59:14 +03:00
alesapin
9bb0dc48b2 Fix one more test 2021-03-26 18:37:26 +03:00
alesapin
1b0a9461f0 Fix more tests 2021-03-26 18:30:35 +03:00
Kruglov Pavel
5c0c6a9aec
Delete unused users.xml 2021-03-26 18:16:15 +03:00
alesapin
0fae73071c Fix flaky test 2021-03-26 18:14:42 +03:00
alesapin
8b08c0c3a6 Fix test_odbc_interaction 2021-03-26 17:45:52 +03:00
tavplubix
ae62bee939
Merge pull request #21913 from ClickHouse/fix_context_ref
Fix possibly dangling reference to Context
2021-03-26 10:39:13 +03:00
Azat Khuzhin
c36f147b16 Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests 2021-03-26 10:05:56 +03:00
Azat Khuzhin
9db74c4dc0 Add stress test for distributed queries
It may founds issue like in [1]:

    2021.03.18 19:05:38.783328 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> executeQuery: (from 127.0.0.1:40918, using production parser) select * from dist where key = 0;
    2021.03.18 19:05:38.783760 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> StorageDistributed (dist): Skipping irrelevant shards - the query will be sent to the following shards of the cluster (shard numbers): [1]
    2021.03.18 19:05:38.784012 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784410 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784488 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> StorageDistributed (dist): Disabling force_optimize_skip_unused_shards for nested queries (force_optimize_skip_unused_shards_nesting exceeded)
    2021.03.18 19:05:38.784572 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> InterpreterSelectQuery: Complete -> Complete
    2021.03.18 19:05:38.819063 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Information> executeQuery: Read 20 rows, 80.00 B in 0.035687783 sec., 560 rows/sec., 2.19 KiB/sec.
    2021.03.18 19:05:38.827842 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> MemoryTracker: Peak memory usage (for query): 0.00 B.

    2021.03.18 19:05:38.867752 [ 547 ] {} <Fatal> BaseDaemon: ########################################
    2021.03.18 19:05:38.867959 [ 547 ] {} <Fatal> BaseDaemon: (version 21.4.1.1, build id: A0ADEC175BD65E58EA012C47C265E661C32D23B5) (from thread 245) (query_id: 4b1f5ec0-bf2d-478c-a2e1-d312531db206) Received signal Aborted (6)
    2021.03.18 19:05:38.868733 [ 547 ] {} <Fatal> BaseDaemon:
    2021.03.18 19:05:38.868958 [ 547 ] {} <Fatal> BaseDaemon: Stack trace: 0x7fd1394be18b 0x7fd13949d859 0x10c4c99b 0xd434ee1 0xd434f1a
    2021.03.18 19:05:38.870135 [ 547 ] {} <Fatal> BaseDaemon: 3. gsignal @ 0x4618b in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.870383 [ 547 ] {} <Fatal> BaseDaemon: 4. abort @ 0x25859 in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.886783 [ 547 ] {} <Fatal> BaseDaemon: 5. /work3/azat/ch/clickhouse/.cmake/../contrib/libunwind/src/UnwindLevel1.c:396: _Unwind_Resume @ 0x10c4c99b in /usr/bin/clickhouse
    2021.03.18 19:05:47.200208 [ 547 ] {} <Fatal> BaseDaemon: 6. ? @ 0xd434ee1 in /usr/bin/clickhouse
    2021.03.18 19:05:47.348738 [ 547 ] {} <Fatal> BaseDaemon: 7.1. inlined from /work3/azat/ch/clickhouse/.cmake/../contrib/boost/boost/context/fiber_fcontext.hpp:253: boost::context::fiber::~fiber()
    2021.03.18 19:05:47.349118 [ 547 ] {} <Fatal> BaseDaemon: 7.2. inlined from ../contrib/boost/boost/context/fiber_fcontext.hpp:252: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine>::run(void*)
    2021.03.18 19:05:47.349163 [ 547 ] {} <Fatal> BaseDaemon: 7. ../contrib/boost/boost/context/fiber_fcontext.hpp:80: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine> >(boost::context::detail::transfer_t) @ 0xd434f1a in /usr/bin/clickhouse
    2021.03.18 19:05:47.618174 [ 547 ] {} <Fatal> BaseDaemon: Calculated checksum of the binary: FF3BA83D0CD648741EEEC242CB1966D9. There is no information about the reference checksum.

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/1b2ed51ff5e4a3dc45567d4967108f43f680c884/stress_test_(debug).html#fail1
2021-03-26 01:04:48 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage
Added specialized CacheDictionaryStorage
2021-03-25 21:29:01 +03:00
Kruglov Pavel
66b8431e71
Merge pull request #21429 from Avogar/secure-socket
Fix receive and send timeouts and non-blocking read in secure socket
2021-03-25 17:30:17 +03:00
Mike Kot
285af08949 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-24 22:34:20 +03:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
Pavel Kovalenko
7e462a77a7 Disk S3 possibility to migrate to restorable schema 2021-03-24 13:07:01 +03:00
Pavel Kovalenko
e378c0bf8a Disk S3 possibility to migrate to restorable schema 2021-03-24 12:20:33 +03:00
kssenii
1ef3c1f780 Use binary format for params 2021-03-24 07:55:21 +00:00
tavplubix
48b89a0ace
Merge pull request #21998 from Avogar/hedged-test
Update tests for hedged requests
2021-03-23 18:18:49 +03:00
Vitaly Baranov
090e558da4
Merge pull request #21844 from Avogar/catboost-deadlock
Fix deadlock in first catboost model execution
2021-03-23 15:01:04 +03:00
alesapin
36898bdc4a
Merge pull request #21142 from Jokser/unfreeze-partitions
Add ALTER TABLE UNFREEZE command.
2021-03-23 14:05:38 +03:00
Pavel Kruglov
dbc5018000 Update tests for hedged requests 2021-03-22 22:18:06 +03:00
Alexander Kuzmenkov
2f5dbf57b6
Merge pull request #21839 from kssenii/add-postgres-connection-pool
Add connection pool for postgres engine
2021-03-22 19:49:51 +03:00
tavplubix
5dfd0045a6
Merge branch 'master' into distributed_ddl_improvements 2021-03-22 18:13:19 +03:00
Mike Kot
da67e06aa0 Added another test case to handle missing part data 2021-03-22 17:52:21 +03:00
kssenii
472ce89b75 Small fixes 2021-03-22 14:39:17 +00:00
Mike Kot
c55a73b752 Added the solution to handle the corruption case
When the part data (e.g. data.bin) is corrupted, but the checksums.txt
is present -- explicitly deleting the checksums.txt.

Removed the extra logging, changes some exceptions message.
2021-03-22 17:23:43 +03:00
Mike Kot
5789507e8b Investigating, why the checksums may match when they shouldn't. 2021-03-22 17:23:43 +03:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
Vladimir
c8b5be636f
Merge pull request #21438 from arenadata/ADQM-170 2021-03-19 17:06:55 +03:00
Alexander Tokmakov
1845df25f3 fix possibly dangling reference to Context 2021-03-19 17:02:48 +03:00
Alexander Kuzmenkov
78c56b8913
Merge pull request #21886 from Avogar/hedged
Add profile event in hedged requests and change timeout from sec to ms.
2021-03-19 15:50:33 +03:00
tavplubix
4ec71c6897
Merge pull request #16608 from ClickHouse/tavplubix-patch-1
Add soft task timeout for Intergation tests
2021-03-19 15:25:21 +03:00
Kruglov Pavel
e45b44fe8c
Restart tests 2021-03-19 14:16:19 +03:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
Pavel Kruglov
2a24d4f295 Add init.py 2021-03-18 20:27:37 +03:00
Pavel Kruglov
d380454044 Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets 2021-03-18 20:16:17 +03:00
Alexander Tokmakov
d7482373d3 fix 2021-03-18 19:59:51 +03:00
tavplubix
93ee8cc78b
Merge pull request #21819 from TCeason/fix_integration_MaterializeMySQL
fix integration MaterializeMySQL test
2021-03-18 19:22:31 +03:00
Alexander Tokmakov
4ea3178efc fix 2021-03-18 17:51:09 +03:00
Alexander Tokmakov
343b8c906d Merge branch 'master' into test_multiple_nodes 2021-03-18 16:01:04 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
kssenii
b135b814fb less crazy test 2021-03-18 07:02:12 +00:00
TCeason
1f5904fea9 fix integration MaterializeMySQL test
https://github.com/ClickHouse/ClickHouse/pull/21759
2021-03-18 14:08:26 +08:00
tavplubix
0826004353
Merge branch 'master' into tavplubix-patch-1 2021-03-17 22:31:35 +03:00
Pavel Kruglov
53095bb6e4 Add model 2021-03-17 22:31:23 +03:00
Alexander Tokmakov
f0c930bf9d remove query timeouts 2021-03-17 22:28:18 +03:00
Pavel Kruglov
bf888b7e5f Fix deadlock in first catboost model execution 2021-03-17 21:57:40 +03:00
Alexander Tokmakov
91068b782b fix 2021-03-17 17:29:24 +03:00
kssenii
51cb89973d Add test 2021-03-17 13:57:55 +00:00
Mike Kot
2ccdb7ef5c Multiple small code and test updates
- Updated the docs to make everything clear.
- Multiple small logger fixes.
- Changed the attach_part command -- now it's after check for the
covering parts -- motivation is to do less work with the checksums
fetching.
- Better logging in the integration test.
2021-03-17 16:52:35 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities
Support replicas priority for postgres dictionary source
2021-03-17 16:02:00 +03:00
Pavel Kovalenko
7ba1b8dbd5 Fixed flaky test_merge_tree_s3::test_insert_same_partition_and_merge 2021-03-17 16:00:22 +03:00
kssenii
c17fe87eb8 Update test 2021-03-17 08:46:57 +00:00
alesapin
ef0ec22377
fix 2021-03-17 10:14:46 +03:00
tavplubix
d42b442b83
Update ci-runner.py 2021-03-17 03:57:33 +03:00
tavplubix
ccf46d8269
Update ci-runner.py 2021-03-17 02:16:03 +03:00
tavplubix
a093980767
Merge pull request #21711 from kssenii/non-default-schema
Support non-default table schema for postgres storage/table-function
2021-03-17 02:10:32 +03:00
tavplubix
5d73a96a51
Update ci-runner.py 2021-03-17 00:39:38 +03:00
Alexander Tokmakov
2d34bbb4b2 Merge branch 'master' into test_multiple_nodes 2021-03-16 21:29:26 +03:00
Alexander Tokmakov
5037d2c10d add timeout for the whole task 2021-03-16 20:48:45 +03:00
Alexander Tokmakov
3ba6dc2aee Merge branch 'master' into tavplubix-patch-1 2021-03-16 20:05:07 +03:00
Ilya Golshtein
518103f851 old Avro test data removed 2021-03-16 19:39:58 +03:00
kssenii
8b360a1dfb Try fix tests 2021-03-16 15:35:57 +00:00
kssenii
f8a99804c1 Add double quotes 2021-03-16 11:15:43 +00:00
alexey-milovidov
f52e29cfec
Merge pull request #21624 from vdimir/storage-s3-fail
Try to fix test_storage_s3: crash in WriteBufferFromS3
2021-03-16 13:38:48 +03:00
kssenii
4bdfc799f5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into non-default-schema 2021-03-16 10:05:10 +00:00
Pavel Kovalenko
39f3b17041 Merge remote-tracking branch 'origin/master' into unfreeze-partitions 2021-03-16 10:56:24 +03:00
alesapin
8fd3fbc5b3
Merge pull request #20387 from Avogar/optimize-on-insert
Don't create empty parts on INSERT
2021-03-16 10:20:34 +03:00
Anton Popov
840417c957
Merge pull request #21685 from Avogar/reload-cluster-config
Update clusters only if their configs were updated
2021-03-15 20:09:58 +03:00
Mike Kot
406d037ebb Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-15 18:41:47 +03:00
Vitaly Baranov
6153f52811
Merge pull request #21641 from vitlibar/allowed-grantees
Add new clause GRANTEES for CREATE/ALTER USER
2021-03-15 12:47:22 +03:00
Ilya Golshtein
abcf581005 avro bug with format_setting reference and a typo in kafka test 2021-03-15 12:19:33 +03:00
alesapin
caccc6da37 Add missing tests 2021-03-15 12:01:26 +03:00
tavplubix
6a265f468e
Merge branch 'master' into distributed_ddl_improvements 2021-03-15 11:24:14 +03:00