thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 02:12:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
65,045 Commits 9,330 Branches 1,783 Tags 2.1 GiB
9915bd0a8b
Commit Graph

2055 Commits

Author SHA1 Message Date
kssenii
eeb4dd4f4c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-04-05 11:30:28 +00:00
kssenii
2f73dc254c Add integration test 2021-04-05 09:33:08 +00:00
kssenii
8cbfbb5de7 Small refactoring, add hdfs to test_disk_types 2021-04-03 12:02:29 +00:00
tavplubix
541b601317
Try fix flaky test 2021-04-03 13:25:40 +03:00
kssenii
90db0be8e9 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-04-03 08:01:13 +00:00
kssenii
13d1f17d3e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-03 08:00:09 +00:00
kssenii
fdab1021f6 Add unpause container after test 2021-04-03 07:59:26 +00:00
tavplubix
93bd2c3b67
Merge pull request #18978 from myrrc/feature/attach-partition-local 
Lookup parts/partitions in replica's own detached/ folder before downloading them from other replicas
 2021-04-02 17:46:03 +03:00
alexey-milovidov
61d4794726
Merge pull request #22440 from ianton-ru/s3_zero_copy_replication 
Fix flapping test_s3_zero_copy_replication
 2021-04-02 10:08:39 +03:00
kssenii
bcc37cd587 Fix test 2021-04-01 23:12:08 +00:00
kssenii
c739176f7f Update test 2021-04-01 20:22:33 +00:00
Mike Kot
c947280dfc Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-04-01 21:38:51 +03:00
Pavel Kruglov
dfbe042bf1 Change test 2021-04-01 19:17:25 +03:00
Pavel Kruglov
1c30bc13cc Add model 2021-04-01 18:47:32 +03:00
Nikita Mikhaylov
81fceb38d9 add test 2021-04-01 17:14:54 +03:00
kssenii
99f0b08ac3 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-01 13:48:33 +00:00
Anton Ivashkin
1b613d454f Fix flapping test_s3_zero_copy_replication 2021-04-01 16:40:52 +03:00
Kseniia Sumarokova
e3fac9ef32
Merge branch 'master' into nanodbc 2021-04-01 16:38:00 +03:00
kssenii
29db632d64 Update test 2021-04-01 13:36:37 +00:00
tavplubix
bbae136a1e
Merge pull request #22380 from kssenii/fix-rabbit-test 
Try fix flaky rabbitmq test
 2021-04-01 15:44:45 +03:00
Pavel Kruglov
187ecab467 Fix test 2021-04-01 15:12:34 +03:00
kssenii
8300a74f5a Fix 2021-04-01 12:09:44 +00:00
Pavel Kruglov
cc65a1db97 Update paths to the model configs in config reloading 2021-04-01 13:30:05 +03:00
kssenii
747967a9bb Better 2021-04-01 10:27:24 +00:00
kssenii
f6163bb51d Fix 2021-04-01 07:55:16 +00:00
alexey-milovidov
4fb6874c99
Merge pull request #22371 from vitlibar/fix-flaky-tests 
Fix flaky tests test_row_policy* and test_quota*
 2021-04-01 03:01:34 +03:00
kssenii
88df6afc84 More tests 2021-03-31 23:48:54 +00:00
kssenii
03ce320926 Add a separate docker-compose with multiple servers for postgres and mysql 2021-03-31 17:04:57 +00:00
tavplubix
1347154732
Merge pull request #22341 from zhang2014/fix/integration_test_for_materialize_mysql 
MySQL is started only once with MaterializeMySQL integration test
 2021-03-31 16:11:38 +03:00
kssenii
cb845731b0 Add connection pools 2021-03-31 12:41:12 +00:00
Peng Jian
e30c07db20 add test cases 2021-03-31 20:22:36 +08:00
tavplubix
5fa2244aa4
Merge pull request #21944 from azat/dist-stress-test 
Add stress test for distributed queries
 2021-03-31 14:54:43 +03:00
tavplubix
6c1e2a0d87
Merge pull request #21690 from ClickHouse/test_multiple_nodes 
Run three nodes with Replicated database and NuKeeper in CI
 2021-03-31 12:31:13 +03:00
Peng Jian
cc56302e8b fix test case 2021-03-31 17:16:51 +08:00
Peng Jian
17a5fc6e0e add test 2021-03-31 17:16:51 +08:00
Vladimir
57eb5f8772
Merge pull request #22070 from Jokser/disk-s3-migration 2021-03-31 11:06:40 +03:00
kssenii
da959d3c03 Merge branch 'fix-rabbit-test' of https://github.com/kssenii/ClickHouse into fix-rabbit-test 2021-03-31 07:39:51 +00:00
kssenii
f2a8e40012 Do not rely on time 2021-03-31 07:37:34 +00:00
alexey-milovidov
a21fe0b492
Merge pull request #22378 from ianton-ru/s3_zero_copy_replication 
Fix S3 Zero-Copy replication for hybrid storage
 2021-03-31 04:15:47 +03:00
tavplubix
5117de1a0e
Merge pull request #22343 from Avogar/secure-socket-timeouts 
Remove setting same timeouts in secure socket
 2021-03-30 23:10:33 +03:00
Kseniia Sumarokova
47431df7ce
Update test.py 2021-03-30 22:18:03 +03:00
kssenii
d82d3a9e65 Try fix flaky rabbitmq test 2021-03-30 18:48:33 +00:00
Anton Ivashkin
f87435213e Fix S3 Zero-Copy replication for hybrid storage 2021-03-30 20:38:04 +03:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
Vitaly Baranov
2162a19d35 Fix flaky tests. 2021-03-30 19:19:35 +03:00
kssenii
9b565b37b5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-30 10:35:24 +00:00
Pavel Kruglov
5f3cb525ee Remove setting same timeouts in secure socket 2021-03-30 10:51:44 +03:00
Alexander Tokmakov
24fc120076 Merge branch 'master' into test_multiple_nodes 2021-03-30 10:40:38 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper 
Rename NuKeeper and TestKeeper to Keeper in all places
 2021-03-30 10:39:22 +03:00
zhang2014
6d2f4dd82e MySQL is started only once with MaterializeMySQL integration test 2021-03-30 14:51:19 +08:00
alexey-milovidov
b7b55ce61d
Merge pull request #20088 from nvartolomei/nv/replicated-fetches-timeouts 
Replicated fetches timeouts
 2021-03-30 03:46:09 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
Alexander Tokmakov
a5b07f2f03 Merge branch 'master' into test_multiple_nodes 2021-03-29 22:43:25 +03:00
tavplubix
3c0f5a57ec
Merge pull request #21535 from ClickHouse/distributed_ddl_improvements 
Distributed DDL improvements
 2021-03-29 22:40:11 +03:00
alexey-milovidov
1512ff832e
Merge branch 'master' into nv/replicated-fetches-timeouts 2021-03-29 19:25:13 +03:00
kssenii
7fdab046b5 Add test for cyrillic + varchar(n) from issue 2021-03-29 14:25:15 +00:00
Alexander Kuzmenkov
0171ab95fa
Merge pull request #21640 from vdimir/fix-join-where-database-engine 
Remove unknown columns from joined table in where for queries to external database engines
 2021-03-29 16:14:10 +03:00
alesapin
4ce81a91e5 Remove unused file 2021-03-29 12:16:58 +03:00
alesapin
4e18a5c241 Renames in integration tests 2021-03-29 11:35:26 +03:00
Vladimir Chebotarev
213a561e21 Improved test. 2021-03-29 10:07:41 +03:00
Vladimir Chebotarev
d157540254 Added test for put with compression and wrong credentials. 2021-03-29 10:07:41 +03:00
kssenii
364a6a5e7a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into nanodbc 2021-03-28 21:19:49 +00:00
kssenii
ec4582ff83 Better test 2021-03-28 19:35:58 +00:00
kssenii
ef537b802f Better comments 2021-03-27 21:10:44 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
kssenii
f141f027f4 Make common class for external storages 2021-03-27 17:12:47 +00:00
kssenii
ae868208c2 Use pool with failover in mysql storage 2021-03-27 14:39:45 +00:00
alesapin
b8eab8cba9
Merge pull request #22170 from ClickHouse/fix_odbc_interaction 
Fix some flaky order dependent integration tests.
 2021-03-27 10:17:37 +03:00
kssenii
b3e5f5d8c6 Add support for datetime64 and Decimal* for odbc storage 2021-03-26 21:26:49 +00:00
Kruglov Pavel
c86202dd09
Merge pull request #22151 from azat/tests-sleep_in_send_ms 
Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests
 2021-03-26 21:22:32 +03:00
kssenii
97e6040cf1 Encode passed data 2021-03-26 16:11:02 +00:00
alesapin
aa2244bad5 Fix more 2021-03-26 18:59:14 +03:00
alesapin
9bb0dc48b2 Fix one more test 2021-03-26 18:37:26 +03:00
alesapin
1b0a9461f0 Fix more tests 2021-03-26 18:30:35 +03:00
Kruglov Pavel
5c0c6a9aec
Delete unused users.xml 2021-03-26 18:16:15 +03:00
alesapin
0fae73071c Fix flaky test 2021-03-26 18:14:42 +03:00
alesapin
8b08c0c3a6 Fix test_odbc_interaction 2021-03-26 17:45:52 +03:00
tavplubix
ae62bee939
Merge pull request #21913 from ClickHouse/fix_context_ref 
Fix possibly dangling reference to Context
 2021-03-26 10:39:13 +03:00
Azat Khuzhin
c36f147b16 Fix sleep_in_send_tables_status_ms/sleep_in_send_data_ms in integration tests 2021-03-26 10:05:56 +03:00
Azat Khuzhin
9db74c4dc0 Add stress test for distributed queries 
It may founds issue like in [1]:

    2021.03.18 19:05:38.783328 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> executeQuery: (from 127.0.0.1:40918, using production parser) select * from dist where key = 0;
    2021.03.18 19:05:38.783760 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> StorageDistributed (dist): Skipping irrelevant shards - the query will be sent to the following shards of the cluster (shard numbers): [1]
    2021.03.18 19:05:38.784012 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784410 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> ContextAccess (default): Access granted: SELECT(key) ON default.dist
    2021.03.18 19:05:38.784488 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> StorageDistributed (dist): Disabling force_optimize_skip_unused_shards for nested queries (force_optimize_skip_unused_shards_nesting exceeded)
    2021.03.18 19:05:38.784572 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Trace> InterpreterSelectQuery: Complete -> Complete
    2021.03.18 19:05:38.819063 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Information> executeQuery: Read 20 rows, 80.00 B in 0.035687783 sec., 560 rows/sec., 2.19 KiB/sec.
    2021.03.18 19:05:38.827842 [ 245 ] {4b1f5ec0-bf2d-478c-a2e1-d312531db206} <Debug> MemoryTracker: Peak memory usage (for query): 0.00 B.

    2021.03.18 19:05:38.867752 [ 547 ] {} <Fatal> BaseDaemon: ########################################
    2021.03.18 19:05:38.867959 [ 547 ] {} <Fatal> BaseDaemon: (version 21.4.1.1, build id: A0ADEC175BD65E58EA012C47C265E661C32D23B5) (from thread 245) (query_id: 4b1f5ec0-bf2d-478c-a2e1-d312531db206) Received signal Aborted (6)
    2021.03.18 19:05:38.868733 [ 547 ] {} <Fatal> BaseDaemon:
    2021.03.18 19:05:38.868958 [ 547 ] {} <Fatal> BaseDaemon: Stack trace: 0x7fd1394be18b 0x7fd13949d859 0x10c4c99b 0xd434ee1 0xd434f1a
    2021.03.18 19:05:38.870135 [ 547 ] {} <Fatal> BaseDaemon: 3. gsignal @ 0x4618b in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.870383 [ 547 ] {} <Fatal> BaseDaemon: 4. abort @ 0x25859 in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.03.18 19:05:38.886783 [ 547 ] {} <Fatal> BaseDaemon: 5. /work3/azat/ch/clickhouse/.cmake/../contrib/libunwind/src/UnwindLevel1.c:396: _Unwind_Resume @ 0x10c4c99b in /usr/bin/clickhouse
    2021.03.18 19:05:47.200208 [ 547 ] {} <Fatal> BaseDaemon: 6. ? @ 0xd434ee1 in /usr/bin/clickhouse
    2021.03.18 19:05:47.348738 [ 547 ] {} <Fatal> BaseDaemon: 7.1. inlined from /work3/azat/ch/clickhouse/.cmake/../contrib/boost/boost/context/fiber_fcontext.hpp:253: boost::context::fiber::~fiber()
    2021.03.18 19:05:47.349118 [ 547 ] {} <Fatal> BaseDaemon: 7.2. inlined from ../contrib/boost/boost/context/fiber_fcontext.hpp:252: boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine>::run(void*)
    2021.03.18 19:05:47.349163 [ 547 ] {} <Fatal> BaseDaemon: 7. ../contrib/boost/boost/context/fiber_fcontext.hpp:80: void boost::context::detail::fiber_entry<boost::context::detail::fiber_record<boost::context::fiber, FiberStack&, DB::RemoteQueryExecutorRoutine> >(boost::context::detail::transfer_t) @ 0xd434f1a in /usr/bin/clickhouse
    2021.03.18 19:05:47.618174 [ 547 ] {} <Fatal> BaseDaemon: Calculated checksum of the binary: FF3BA83D0CD648741EEEC242CB1966D9. There is no information about the reference checksum.

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/1b2ed51ff5e4a3dc45567d4967108f43f680c884/stress_test_(debug).html#fail1
 2021-03-26 01:04:48 +03:00
Maksim Kita
bbe1960eea
Merge pull request #21573 from kitaisreal/updated-cache-dictionary-storage 
Added specialized CacheDictionaryStorage
 2021-03-25 21:29:01 +03:00
Kruglov Pavel
66b8431e71
Merge pull request #21429 from Avogar/secure-socket 
Fix receive and send timeouts and non-blocking read in secure socket
 2021-03-25 17:30:17 +03:00
Mike Kot
285af08949 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-24 22:34:20 +03:00
kssenii
d9326cc229 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-24 18:28:55 +00:00
Pavel Kovalenko
7e462a77a7 Disk S3 possibility to migrate to restorable schema 2021-03-24 13:07:01 +03:00
Pavel Kovalenko
e378c0bf8a Disk S3 possibility to migrate to restorable schema 2021-03-24 12:20:33 +03:00
kssenii
1ef3c1f780 Use binary format for params 2021-03-24 07:55:21 +00:00
tavplubix
48b89a0ace
Merge pull request #21998 from Avogar/hedged-test 
Update tests for hedged requests
 2021-03-23 18:18:49 +03:00
Vitaly Baranov
090e558da4
Merge pull request #21844 from Avogar/catboost-deadlock 
Fix deadlock in first catboost model execution
 2021-03-23 15:01:04 +03:00
alesapin
36898bdc4a
Merge pull request #21142 from Jokser/unfreeze-partitions 
Add ALTER TABLE UNFREEZE command.
 2021-03-23 14:05:38 +03:00
Pavel Kruglov
dbc5018000 Update tests for hedged requests 2021-03-22 22:18:06 +03:00
Alexander Kuzmenkov
2f5dbf57b6
Merge pull request #21839 from kssenii/add-postgres-connection-pool 
Add connection pool for postgres engine
 2021-03-22 19:49:51 +03:00
tavplubix
5dfd0045a6
Merge branch 'master' into distributed_ddl_improvements 2021-03-22 18:13:19 +03:00
Mike Kot
da67e06aa0 Added another test case to handle missing part data 2021-03-22 17:52:21 +03:00
kssenii
472ce89b75 Small fixes 2021-03-22 14:39:17 +00:00
Mike Kot
c55a73b752 Added the solution to handle the corruption case 
When the part data (e.g. data.bin) is corrupted, but the checksums.txt
is present -- explicitly deleting the checksums.txt.

Removed the extra logging, changes some exceptions message.
 2021-03-22 17:23:43 +03:00
Mike Kot
5789507e8b Investigating, why the checksums may match when they shouldn't. 2021-03-22 17:23:43 +03:00
kssenii
8a650c4408 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-22 13:38:25 +00:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
Vladimir
c8b5be636f
Merge pull request #21438 from arenadata/ADQM-170 2021-03-19 17:06:55 +03:00
Alexander Tokmakov
1845df25f3 fix possibly dangling reference to Context 2021-03-19 17:02:48 +03:00
Alexander Kuzmenkov
78c56b8913
Merge pull request #21886 from Avogar/hedged 
Add profile event in hedged requests and change timeout from sec to ms.
 2021-03-19 15:50:33 +03:00
tavplubix
4ec71c6897
Merge pull request #16608 from ClickHouse/tavplubix-patch-1 
Add soft task timeout for Intergation tests
 2021-03-19 15:25:21 +03:00
Kruglov Pavel
e45b44fe8c
Restart tests 2021-03-19 14:16:19 +03:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
Pavel Kruglov
2a24d4f295 Add init.py 2021-03-18 20:27:37 +03:00
Pavel Kruglov
d380454044 Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets 2021-03-18 20:16:17 +03:00
Alexander Tokmakov
d7482373d3 fix 2021-03-18 19:59:51 +03:00
tavplubix
93ee8cc78b
Merge pull request #21819 from TCeason/fix_integration_MaterializeMySQL 
fix integration MaterializeMySQL test
 2021-03-18 19:22:31 +03:00
Alexander Tokmakov
4ea3178efc fix 2021-03-18 17:51:09 +03:00
Alexander Tokmakov
343b8c906d Merge branch 'master' into test_multiple_nodes 2021-03-18 16:01:04 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
kssenii
b135b814fb less crazy test 2021-03-18 07:02:12 +00:00
TCeason
1f5904fea9 fix integration MaterializeMySQL test 
https://github.com/ClickHouse/ClickHouse/pull/21759
 2021-03-18 14:08:26 +08:00
tavplubix
0826004353
Merge branch 'master' into tavplubix-patch-1 2021-03-17 22:31:35 +03:00
Pavel Kruglov
53095bb6e4 Add model 2021-03-17 22:31:23 +03:00
Alexander Tokmakov
f0c930bf9d remove query timeouts 2021-03-17 22:28:18 +03:00
Pavel Kruglov
bf888b7e5f Fix deadlock in first catboost model execution 2021-03-17 21:57:40 +03:00
Alexander Tokmakov
91068b782b fix 2021-03-17 17:29:24 +03:00
kssenii
51cb89973d Add test 2021-03-17 13:57:55 +00:00
Mike Kot
2ccdb7ef5c Multiple small code and test updates 
- Updated the docs to make everything clear.
- Multiple small logger fixes.
- Changed the attach_part command -- now it's after check for the
covering parts -- motivation is to do less work with the checksums
fetching.
- Better logging in the integration test.
 2021-03-17 16:52:35 +03:00
kssenii
34dea63248 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-17 13:32:43 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities 
Support replicas priority for postgres dictionary source
 2021-03-17 16:02:00 +03:00
Pavel Kovalenko
7ba1b8dbd5 Fixed flaky test_merge_tree_s3::test_insert_same_partition_and_merge 2021-03-17 16:00:22 +03:00
kssenii
c17fe87eb8 Update test 2021-03-17 08:46:57 +00:00
alesapin
ef0ec22377
fix 2021-03-17 10:14:46 +03:00
tavplubix
d42b442b83
Update ci-runner.py 2021-03-17 03:57:33 +03:00
tavplubix
ccf46d8269
Update ci-runner.py 2021-03-17 02:16:03 +03:00
tavplubix
a093980767
Merge pull request #21711 from kssenii/non-default-schema 
Support non-default table schema for postgres storage/table-function
 2021-03-17 02:10:32 +03:00
tavplubix
5d73a96a51
Update ci-runner.py 2021-03-17 00:39:38 +03:00
Alexander Tokmakov
2d34bbb4b2 Merge branch 'master' into test_multiple_nodes 2021-03-16 21:29:26 +03:00
Alexander Tokmakov
5037d2c10d add timeout for the whole task 2021-03-16 20:48:45 +03:00
Alexander Tokmakov
3ba6dc2aee Merge branch 'master' into tavplubix-patch-1 2021-03-16 20:05:07 +03:00
Ilya Golshtein
518103f851 old Avro test data removed 2021-03-16 19:39:58 +03:00
kssenii
8b360a1dfb Try fix tests 2021-03-16 15:35:57 +00:00
kssenii
f8a99804c1 Add double quotes 2021-03-16 11:15:43 +00:00
alexey-milovidov
f52e29cfec
Merge pull request #21624 from vdimir/storage-s3-fail 
Try to fix test_storage_s3: crash in WriteBufferFromS3
 2021-03-16 13:38:48 +03:00
kssenii
4bdfc799f5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into non-default-schema 2021-03-16 10:05:10 +00:00
Pavel Kovalenko
39f3b17041 Merge remote-tracking branch 'origin/master' into unfreeze-partitions 2021-03-16 10:56:24 +03:00
alesapin
8fd3fbc5b3
Merge pull request #20387 from Avogar/optimize-on-insert 
Don't create empty parts on INSERT
 2021-03-16 10:20:34 +03:00
Anton Popov
840417c957
Merge pull request #21685 from Avogar/reload-cluster-config 
Update clusters only if their configs were updated
 2021-03-15 20:09:58 +03:00
Mike Kot
406d037ebb Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-15 18:41:47 +03:00
Vitaly Baranov
6153f52811
Merge pull request #21641 from vitlibar/allowed-grantees 
Add new clause GRANTEES for CREATE/ALTER USER
 2021-03-15 12:47:22 +03:00
Ilya Golshtein
abcf581005 avro bug with format_setting reference and a typo in kafka test 2021-03-15 12:19:33 +03:00
alesapin
caccc6da37 Add missing tests 2021-03-15 12:01:26 +03:00
tavplubix
6a265f468e
Merge branch 'master' into distributed_ddl_improvements 2021-03-15 11:24:14 +03:00
kssenii
bd38a7a021 Fix tests 2021-03-15 06:37:07 +00:00
kssenii
8688ae9346 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-14 19:32:21 +00:00
Vitaly Baranov
37ce6e26d3 Add a new clause GRANTEES to commands CREATE USER and ALTER USER. 2021-03-14 19:12:42 +03:00
alesapin
dad5238d7d
Merge pull request #16240 from ianton-ru/s3_zero_copy_replication 
S3 zero copy replication
 2021-03-14 18:19:37 +03:00
Ilya Golshtein
a579fcb424 kafka/avro works against table 2021-03-14 15:55:44 +03:00
kssenii
797063ae0f Support non-default table schema for postgres storage/table-function 2021-03-14 10:35:10 +00:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Pavel Kruglov
3e3b5c64bf add init file 2021-03-14 02:34:32 +03:00
alesapin
06eb2d8dfd
Merge branch 'master' into s3_zero_copy_replication 2021-03-13 22:32:54 +03:00
kssenii
5d953a4b86 Better 2021-03-12 21:48:52 +00:00
kssenii
886f9a5d9d More tests 2021-03-12 21:22:46 +00:00
Pavel Kruglov
58e415c7d4 Update clusters only if their configs were updated 2021-03-13 00:17:19 +03:00
Azat Khuzhin
2e99dad562 Tiny "machine" cleanup of test_replace_partition 2021-03-12 21:10:16 +03:00
Azat Khuzhin
5af5c90b8b Fix test_replace_partition flakiness 
test_replace_partition/test.py::test_replace_after_replace_failover
statistics:

```sql
┌──────ymd─┬─success─┬─failure─┐
│ 20200613 │      40 │       2 │
│ 20200614 │      98 │       2 │
│ 20200615 │     126 │       9 │
│ 20200616 │     141 │      10 │
│ 20200617 │     119 │       7 │
│ 20200618 │      87 │      12 │
│ 20200619 │      81 │       9 │
...
│ 20210305 │      60 │      28 │
│ 20210306 │      69 │       7 │
│ 20210307 │      42 │       0 │
│ 20210308 │      53 │       8 │
│ 20210309 │     137 │      23 │
│ 20210310 │      84 │      14 │
│ 20210311 │      81 │      20 │
└──────────┴─────────┴─────────┘
```
 2021-03-12 21:10:16 +03:00
kssenii
5602b82faa Fix test 2021-03-12 14:07:20 +00:00
Anton Ivashkin
ace628d565 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-12 12:58:32 +03:00
kssenii
4529b4792d Fix typo 2021-03-12 09:56:03 +00:00
kssenii
571590fcfb Update tests, dockerfile 2021-03-12 09:20:18 +00:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
alexey-milovidov
9e0d53c0e6
Merge pull request #20058 from excitoon-favorites/remotehostfilterdisallowall 
Fixed open behavior of remote host filter in case when there is `remote_url_allow_hosts` section in configuration but no entries there
 2021-03-12 11:14:15 +03:00
alesapin
cca05da7fa
Merge pull request #16481 from amosbird/jbodbalance 
Auto-balance big parts in JBOD array
 2021-03-12 11:07:47 +03:00
alesapin
b98e27ba82
Merge branch 'master' into s3_zero_copy_replication 2021-03-12 11:07:20 +03:00
kssenii
9e0101e5fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-03-12 07:47:22 +00:00
kssenii
4acaee2f38 Fix config 2021-03-12 07:12:38 +00:00
kssenii
1c8ad914e6 Fix 2021-03-11 18:10:12 +00:00
kssenii
5ff95e615d Add tests 2021-03-11 18:05:08 +00:00
vdimir
2156401506
Remove unknown columns from joined table in where for queries to external database engines 2021-03-11 20:53:29 +03:00
Alexander Kuzmenkov
3e5447ccec
Merge pull request #21480 from Avogar/slowdown_count 
Add slowdown_count and show actual errors_count in system.clusters
 2021-03-11 17:18:05 +03:00
vdimir
1194d50e48
Try to fix test_storage_s3: crash in WriteBufferFromS3 2021-03-11 15:21:13 +03:00
Vladimir
08f312b1c4
Merge pull request #21457 from GrigoryPervakov/master 
recreate S3 client if credentials changed
 2021-03-11 15:18:39 +03:00
Nikita Mikhaylov
39b59e86b0
Merge pull request #21456 from nikitamikhaylov/zookeeper-secure-race 
Fix race in SecureSocket
 2021-03-10 20:49:56 +03:00
tavplubix
26ebd54eaf
Merge pull request #20961 from havardk/reconnect 
MaterializeMySQL: Attempt to reconnect to MySQL if the connection is lost
 2021-03-10 20:07:11 +03:00
Vitaly Baranov
7364fe4d4c
Merge pull request #21190 from vitlibar/quota-test-more-cases 
Add more tests for quota consumption by the SHOW statement
 2021-03-10 16:41:38 +03:00
Anton Ivashkin
cef0dda933 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-10 14:10:29 +03:00
Pervakov Grigorii
eb87afc4d4 recreate S3 client if credentials changed 2021-03-10 13:36:57 +03:00
Alexander Tokmakov
ba3d51383c fix 2021-03-10 00:41:04 +03:00
Amos Bird
e52b2fb8ae
update 2021-03-10 02:56:46 +08:00
Alexander Tokmakov
4d19c84d90 Merge branch 'master' into distributed_ddl_improvements 2021-03-09 20:06:41 +03:00
tavplubix
5a6cc876e4
Merge pull request #20626 from ClickHouse/fix_force_drop_materialized_view 
Make force_drop_table work with MaterializedView
 2021-03-09 20:05:51 +03:00
Alexander Tokmakov
83b3e4e0f5 allow to use Cluster from Replicated db 2021-03-09 20:05:24 +03:00
alesapin
bcd073278d
Merge pull request #21425 from ClickHouse/persistent_nukeeper_snapshot_storage 
Persistent nukeeper snapshot storage
 2021-03-09 18:37:23 +03:00
Vitaly Baranov
25b88afa66 Add more tests for quota consumption by the SHOW statement. 2021-03-09 18:01:34 +03:00
Nikita Mikhaylov
9684fed32a better test 2021-03-09 16:24:53 +03:00
Nikita Mikhaylov
c38a690e8e add multithreaded test 2021-03-09 16:24:53 +03:00
tavplubix
18db0e5683
trigger CI 2021-03-09 14:58:07 +03:00
alesapin
c00c8c36b7 Merge branch 'master' into ianton-ru-s3_zero_copy_replication 2021-03-09 10:59:11 +03:00
alesapin
dcc6c9d378 More tries to wait server start 2021-03-09 10:19:14 +03:00
alexey-milovidov
0a3275e169
Merge pull request #21496 from Felixoid/rollup_grow 
Add check for growing age AND precision in rollup config
 2021-03-09 07:31:07 +03:00
Alexander Tokmakov
2022b90919 configurable output mode for distributed DDL 2021-03-08 23:35:09 +03:00
Alexander Tokmakov
2484781070 fix MV recovery in Replicated db 2021-03-08 20:26:38 +03:00
Amos Bird
2ec20c5d23
update and add tests 2021-03-08 17:38:07 +08:00
alesapin
ef192ec310 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-07 10:31:06 +03:00
Mikhail f. Shiryaev
efc04b29a6
Add check for growing age AND precision in rollup config 2021-03-06 18:35:53 +01:00
alesapin
a8b7469857 Fix session timeout update 2021-03-06 17:14:38 +03:00
alesapin
00c0d75b60 More easy test 2021-03-06 10:10:51 +03:00
Pavel Kruglov
dbae58f30b Add slowdown_count and show actual information in system.clusters 2021-03-06 02:45:17 +03:00
alexey-milovidov
39bfcf220d
Merge pull request #21452 from ClickHouse/filimonov-patch-1 
avoid race in librdkafka
 2021-03-06 00:57:30 +03:00
Pavel Kruglov
19af94bad9 restart tests 2021-03-05 19:08:49 +03:00
Pavel Kruglov
c113af39f4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into secure-socket 2021-03-05 16:18:45 +03:00
Pavel Kruglov
ed6363b88b Increase allowed query time 2021-03-05 16:18:12 +03:00
Alexander Tokmakov
e8987f799e Merge branch 'fix_force_drop_materialized_view' into just_another_fix_for_ddl_worker 2021-03-05 15:59:27 +03:00
alesapin
c9c301e10c Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-05 10:12:09 +03:00
Pavel Kruglov
271398be61 add __init__.py 2021-03-04 23:15:33 +03:00
tavplubix
9244bc43ee
Merge pull request #21021 from zhang2014/fix/materialize_mysql_integration_test 
Try fix MaterializeMySQL integration test
 2021-03-04 22:22:20 +03:00
filimonov
bd8c3eb117
avoid race in librdkafka 
see https://github.com/edenhill/librdkafka/issues/3279
 2021-03-04 15:01:10 +01:00
alesapin
ad77de2a60 Enable snapshots in dangerous tests 2021-03-04 16:45:44 +03:00
alesapin
aa754a3ca8 Test restore from snapshot 2021-03-04 16:40:43 +03:00
Anton Ivashkin
e69124a0a6 Merge master 2021-03-04 13:26:40 +03:00
Ilya Golshtein
f11a8cd13c multimessage avro format for kafka test 2021-03-04 11:07:29 +03:00
Haavard Kvaalen
f96892d45c Speed up network partition test 
REJECT rather than DROP packets in network partition test.  This test
was already very slow and could get slower with the newly added
reconnection logic.
 2021-03-04 08:49:06 +01:00
Haavard Kvaalen
641b1b249e Attempt to reconnect to MySQL 
For MaterializeMySQL databases, attempt to reconnect if the connection
to MySQL is lost.  The existing setting
`max_wait_time_when_mysql_unavailable` is used to control how often we
attempt to reconnect.  This setting can now be set to a negative value
to disable reconnects.
 2021-03-04 08:49:06 +01:00
alesapin
76e10a4fb1 Missed files for tests 2021-03-03 23:05:33 +03:00
Pavel Kruglov
1c7f16e0ff Add test and move TimeoutSetter in IO/ 2021-03-03 20:47:27 +03:00
alesapin
eb5e416fd5 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-03 19:19:02 +03:00
alesapin
7e28bfeb9e Fix log store start 2021-03-03 18:37:31 +03:00
Mike Kot
6ea574525c Small fixes regarding the review 2021-03-03 16:51:41 +03:00
alesapin
869818d4ff Better test 2021-03-03 16:18:28 +03:00
alesapin
186b39f0d5 Followup fix 2021-03-03 15:31:21 +03:00
alesapin
37fc5faa6f Fix nasty serialization bug 2021-03-03 15:21:21 +03:00
alesapin
e615299ae6 Fix some bugs and add snapshots validation 2021-03-03 14:10:24 +03:00
Nikolai Kochetov
cb122160ae
Merge pull request #19291 from Avogar/hedged-requests 
Implementation of HedgedRequests
 2021-03-03 12:58:37 +03:00
Pavel Kruglov
d1524b749e Fix tests 2021-03-03 01:24:41 +03:00
Pavel Kovalenko
483e63ca45 ALTER TABLE UNFREEZE rework. 2021-03-03 00:10:09 +03:00
Pavel Kruglov
4269eaa252 Change tests 2021-03-02 17:05:33 +03:00
Pavel Kruglov
4166ae1f45 Restart timeout when we make progress 2021-03-02 15:40:24 +03:00
Nikolai Kochetov
ffbea93b10
Merge pull request #19576 from traceon/row-policy-with-prewhere 
Allow row policies with PREWHERE
 2021-03-02 13:51:37 +03:00
Pavel Kruglov
153bfbfc28 Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests 2021-03-02 11:59:32 +03:00
Mike Kot
4e1ac185b5 Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local 2021-03-01 20:58:07 +03:00
Mike Kot
6191580fe1 Added the PartitionManager to check that replica 1 attaches the local 
data
 2021-03-01 20:54:02 +03:00
Mike Kot
f3e340fcdf Fixing the tests 2021-03-01 20:41:31 +03:00
Mike Kot
f088dd445d Extended the test to check both the ALTER PARTITION and PART 
Added some notes about the SYSTEM SYNC REPLICA and ALTER ... DROP /
ATTACH.
 2021-03-01 20:41:31 +03:00
Mike Kot
5281314ac0 Finished the test draft for ATTACH PARTITION, 
Extracted the part data corruption function into the helper.
 2021-03-01 16:42:31 +03:00
Anton Ivashkin
98065ec56e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-03-01 13:33:40 +03:00
Denis Glazachev
eb80c189e4 Merge branch 'master' into row-policy-with-prewhere 2021-02-28 20:14:31 +04:00
Azat Khuzhin
d42d4cfd6b Improve test_distributed_ddl_parallel to cover more cases 
Refs: #21264
 2021-02-28 05:45:40 +03:00
Azat Khuzhin
a795db57f1 tests: decrease distributed_ddl_task_timeout to 60 in test_distributed_ddl_parallel 2021-02-28 05:45:11 +03:00
Azat Khuzhin
06e8bb955d tests: catch exceptions in threads in test_distributed_ddl_parallel 
Otherwise the test will not report an error.
 2021-02-28 05:45:11 +03:00
Azat Khuzhin
b899d8d919 tests: regression for test for invalid reference to zookeeper for distributed_ddl.pool_size > 1 2021-02-28 05:45:11 +03:00
alexey-milovidov
9f0400f015
Merge pull request #21171 from azat/tests-bump-zookeeper 
Bump zookeeper version to 3.6.2 in tests
 2021-02-28 02:35:58 +03:00
alexey-milovidov
b8fba768e5
Merge pull request #21264 from ClickHouse/fix_zookeeper_update 
Fix several bugs with ZooKeeper client
 2021-02-28 01:57:04 +03:00
Pavel Kruglov
197058dc12 Merge branch 'master' of github.com:ClickHouse/ClickHouse into hedged-requests 2021-02-27 00:36:33 +03:00
Azat Khuzhin
bc1a316b28 Bump zookeeper version to 3.6.2 in tests 
3.4.12 was released 1.05.2018
 2021-02-26 23:41:43 +03:00
alesapin
a48bb7e3a0 Fix redundant zookeeper reconnect and possibility of multiple zookeeper session for a single ClickHouse server 2021-02-26 22:05:25 +03:00
alexey-milovidov
5ecd9a9577
Merge pull request #21111 from filimonov/better-kafka-tests 
Better kafka tests
 2021-02-26 21:30:35 +03:00
Pavel Kruglov
91f6f9227b Small fixes and tests updates 2021-02-26 18:55:58 +03:00
tavplubix
09f62447af
Merge pull request #21060 from mxzlxy/fix-bug-for-replicated-engine-parameter 
fix default_replica_path and default_replica_name values are useless …
 2021-02-26 17:18:56 +03:00
Anton Ivashkin
5b267b7eec Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into s3_zero_copy_replication 2021-02-26 13:15:18 +03:00
Anton Ivashkin
c891cf4557 Fixes by review response 2021-02-26 12:48:57 +03:00
Mikhail Filimonov
9e3547681b
try to address python kafka client disconnects better 2021-02-26 07:17:31 +01:00
Mikhail Filimonov
60ede36068
simple fix for CI failure 2021-02-26 06:41:11 +01:00
Mikhail Filimonov
c4470ff283
proper placement for test 2021-02-26 06:38:14 +01:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
Alexander Tokmakov
f42beb4e6c add test 2021-02-25 20:09:39 +03:00
alexey-milovidov
6a5ab40988
Merge pull request #21119 from fastio/bugfix_drop_metadata_from_auxiliary 
fix the metadata leak when the Replicated*MergeTree with custom ZooKeeper cluster is dropped
 2021-02-25 19:24:58 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Mikhail Filimonov
2bcfff257c
Remove most of sleeps in tests 2021-02-25 17:02:59 +01:00
Mikhail Filimonov
6c6eaf2a60
Fixes 2021-02-25 17:02:57 +01:00
Mikhail Filimonov
a4c9e62d6d
Integration tests: introduce wait_for_log_line. 
It uses tail -f executed in container, this way i don't need to pull
the file many times, rememeber positions etc.
 2021-02-25 17:02:56 +01:00
Mikhail Filimonov
32fa3dbc99
Integration tests: add IPC_LOCK and SYS_NICE caps 
It is needed to make integration tests work with a installed binary (/usr/bin/clickhouse) mounted in.
Otherwise the binary mounted in have the capability, while the container is not allowing that
and you get cryptic message:
standard_init_linux.go:211: exec user process caused "operation not permitted"
 2021-02-25 17:02:54 +01:00
Pavel Kovalenko
cf8b105d42 Merge remote-tracking branch 'origin/master' into unfreeze-partitions 2021-02-25 15:24:43 +03:00
alesapin
8f81dce32f
Merge pull request #20585 from ClickHouse/persistent_nukeeper_log_storage 
Persistent coordination log storage
 2021-02-25 10:06:03 +03:00
Alexander Tokmakov
65384f43d8 fix 2021-02-25 10:02:45 +03:00
fastio
24321c28f6 add test case 2021-02-25 14:19:58 +08:00
Alexander Tokmakov
efd50a819b fix 2021-02-25 02:09:09 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
Pavel Kovalenko
078dfce038 Add ALTER TABLE UNFREEZE command. 2021-02-24 17:28:30 +03:00
Alexander Tokmakov
f41e68d118 fix style check 2021-02-23 23:15:11 +03:00
Alexander Tokmakov
7a6c9ceeef fix 2021-02-23 15:25:28 +03:00
Alexander Tokmakov
7bcec2947f fix 2021-02-23 13:48:06 +03:00
Kseniia Sumarokova
b2850ec94f
Merge branch 'master' into fix-postgres-numeric 2021-02-23 11:40:28 +03:00
alesapin
ddc9fb151e Fix tests 2021-02-23 11:37:27 +03:00
Alexander Tokmakov
d5ea345aa9 add integration tests runner 2021-02-23 10:26:23 +03:00
alesapin
5b888e1193 Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-22 23:52:26 +03:00
alesapin
74a07e406b Even more stable 2021-02-22 10:33:27 +03:00
Winter Zhang
521891edec
Update materialize_with_ddl.py 2021-02-22 12:47:38 +08:00
alexey-milovidov
e1c4ba0169
Merge pull request #21016 from azat/integration-test_materialize_mysql_database 
Preserve mysql logs in test_materialize_mysql_database
 2021-02-21 22:28:19 +03:00
Kruglov Pavel
815b4ff0d9
Merge branch 'master' into hedged-requests 2021-02-21 17:10:24 +03:00
Pavel Kruglov
dd5185c779 Refactor 4.0 2021-02-21 17:03:24 +03:00
alexey-milovidov
20a7ccf5b1
Merge pull request #20174 from amosbird/alias 
Normalized function names (lower-case case-insensitive names)
 2021-02-21 16:23:51 +03:00
Denis Glazachev
c1158b50f4 Merge branch 'master' into row-policy-with-prewhere 
* master: (155 commits)
  Update version_date.tsv after release 20.8.13.15
  Update version_date.tsv after release 20.12.7.3
  Update version_date.tsv after release 21.1.5.4
  Update version_date.tsv after release 21.2.4.6
  fix
  Add test to skip list
  Fix WriteBufferFromHTTPServerResponse usage in other places (add missing finalize())
  Fix WriteBufferFromHTTPServerResponse usage in odbc-bridge
  Update config.xml
  Suppress signed overflow in AggregateFunctionGroupArrayMoving 2
  Update BaseDaemon.cpp
  review suggestions
  Fix bash syntax in 01731_async_task_queue_wait
  Do not use view() in 01731_async_task_queue_wait to fix ANTLR parser
  Increase buffer for uncaught exception / std::terminate
  Even more better
  Fix uncaught exception when HTTP client goes away
  test for decimal ( p , s) in dictionaries
  Just little better
  Fixed style check
  ...
 2021-02-21 13:25:47 +04:00
Denis Glazachev
4f57b68563 Fix the test 2021-02-21 13:22:41 +04:00
Denis Glazachev
dda1eb1f00 Fix the test 2021-02-21 13:17:58 +04:00
zhang2014
4529cdac81 try fix MaterializeMySQL integration test 2021-02-21 14:38:29 +08:00
Azat Khuzhin
d343060dd5 tests/integration: add start_and_wait() in test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Azat Khuzhin
80f448a466 tests/integration: preserve mysql docker logs in test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Denis Glazachev
ce6d2ff724 Fix the test 2021-02-20 22:14:12 +04:00
tavplubix
103d569885
Merge branch 'master' into fix_force_drop_materialized_view 2021-02-20 20:41:03 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated 
DatabaseReplicated: continuation of #10485
 2021-02-20 19:39:34 +03:00
alesapin
c61769311e Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-20 10:22:22 +03:00
kssenii
f820047cc8 Fix 2021-02-20 06:52:10 +00:00
alexey-milovidov
b4196c8e68
Merge pull request #20168 from ClickHouse/in-memory-compression 
Compression for Memory tables
 2021-02-20 09:49:37 +03:00
Denis Glazachev
8361904b4d Add cases for throwIf() 2021-02-20 10:47:29 +04:00
Denis Glazachev
2ab643170d Add 'SETTINGS optimize_move_to_prewhere = 0' in WHERE-only SELECTs 2021-02-20 00:45:19 +04:00