Commit Graph

268 Commits

Author SHA1 Message Date
kssenii
12ea45e956 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-06-01 17:43:34 +00:00
kssenii
625377f553 Add backoff for reading replication messages, fix some checks 2021-05-26 23:38:53 +00:00
kssenii
da32f66122 More tests 2021-05-23 12:47:52 +00:00
Kseniia Sumarokova
9758e46c3c
Add TODO 2021-05-21 17:46:28 +03:00
kssenii
1ee77eae89 Better way to distinguish between user query and replication thread query 2021-05-16 21:35:37 +00:00
kssenii
85bbfd54e8 Fix bug 2021-05-13 08:53:48 +00:00
kssenii
7c81103ea3 Add replication identifier, allow proper access to _version and _sign columns from nested 2021-05-12 22:48:42 +00:00
kssenii
407db17e2e Remove setting, use native transaction 2021-05-12 22:33:15 +00:00
kssenii
626e87bae5 Some fixes 2021-05-10 13:51:05 +00:00
kssenii
65c574db93 Add test 2021-05-10 11:31:06 +00:00
kssenii
ae1191d0c0 Get rid of metadata file, rely only on lsn 2021-05-10 09:10:02 +00:00
kssenii
4ac023e511 Small fixes 2021-05-10 08:45:52 +00:00
kssenii
1b827ac424 Correct merge, finish refactoring 2021-05-09 14:45:33 +00:00
kssenii
5c24f0943c Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-05-08 14:54:44 +00:00
kssenii
912878ad7f Review fixes 2021-05-07 12:05:34 +00:00
kssenii
8662078b35 Review fixes 2021-05-07 09:55:18 +00:00
kssenii
660442a16c Review fixes 2021-05-06 12:48:48 +00:00
kssenii
8900e93bd8 New impl 2021-05-06 00:52:59 +00:00
kssenii
ed5c2321cc Some fixes 2021-05-04 10:57:05 +00:00
kssenii
89144ba843 Try adding lock for storage 2021-05-03 22:06:21 +00:00
kssenii
eff26f9d54 Add comments, small improvements 2021-05-03 21:42:06 +00:00
kssenii
19ecdceb6b Do not start sync startup in a separate thread in case of single storage 2021-05-03 18:38:44 +00:00
kssenii
6a06d72580 Fix background update 2021-05-03 17:28:54 +00:00
kssenii
3e3396bd9c Refactor code, add comments 2021-05-03 09:52:32 +00:00
kssenii
01adfb7b3d Fix single storage case 2021-05-02 13:49:28 +00:00
kssenii
14d355a6ac Fix background update 2021-05-02 11:53:03 +00:00
kssenii
14be3a0783 Better reload from snapshot 2021-05-01 11:49:45 +00:00
Benjamin Naecker
57fd59b73b Adds support for building on Solaris-derived systems
This commit adds a number of changes to platform-detection and
compile-time directives required to support building ClickHouse on
Solaris-derived systems, most notably illumos.
2021-04-28 16:32:41 -07:00
kssenii
01075677cf Better 2021-04-11 20:22:33 +00:00
kssenii
c968ccb391 Better dependent name for nested in case of single storage 2021-04-11 17:19:20 +00:00
kssenii
027f67affb Fix checks 2021-04-11 09:54:10 +00:00
kssenii
beae1c5fa4 Use ContextPtr 2021-04-11 08:08:32 +00:00
kssenii
820a32d939 Allow rename in case of single storage 2021-04-11 06:00:47 +00:00
kssenii
bc228f4010 Better way to drop nested table for single storage 2021-04-10 19:26:53 +00:00
kssenii
1c501e7d97 Support replica identity index 2021-04-10 16:10:28 +00:00
kssenii
dba1fe1989 Add doc draft 2021-04-10 08:20:20 +00:00
kssenii
f7361250b2 Fixes 2021-04-09 11:02:12 +00:00
kssenii
12f98e8b11 Much better 2021-04-09 10:22:06 +00:00
kssenii
bd207daa74 Use only atomic database 2021-04-08 22:38:46 +00:00
kssenii
093e53e65a Fix and test server restart 2021-04-08 20:39:56 +00:00
kssenii
b544c9fe9a Add default template 2021-04-08 13:08:51 +00:00
kssenii
8586565ce9 Move connection-related filed to Core/PostgreSQL 2021-04-08 12:43:02 +00:00
kssenii
9fa21a6272 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-04-08 12:18:54 +00:00
kssenii
747967a9bb Better 2021-04-01 10:27:24 +00:00
kssenii
4e849f3b77 Less logging 2021-03-31 14:06:24 +00:00
kssenii
ba5ddd5c32 Do not parse replicas in PoolWithFailover 2021-03-31 14:03:52 +00:00
kssenii
ce05087b1b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-03-30 17:27:10 +00:00
kssenii
1bd1a705ce Fix clang tidy 2021-03-28 12:45:49 +00:00
kssenii
c17748a0ba Add proper settings 2021-03-27 21:57:35 +00:00
kssenii
ef537b802f Better comments 2021-03-27 21:10:44 +00:00
kssenii
22b515fbc9 Add namespace, simplify names 2021-03-27 20:14:02 +00:00
kssenii
f40c582e7a Replicas/shards for postgres storage 2021-03-27 20:11:48 +00:00
PHO
1868ca34b8 Fix build on GCC where std::isinf() cannot be called without the namespace prefix 2021-03-26 12:11:22 +09:00
kssenii
99295c050a Better logging 2021-03-20 15:41:15 +00:00
kssenii
40e50e6b02 Add unhexN method 2021-03-20 15:12:46 +00:00
kssenii
ed158e2b77 Proper setting 2021-03-20 14:42:03 +00:00
kssenii
878292d341 Remove redundant rethrow 2021-03-20 14:26:36 +00:00
kssenii
8062a81ddd Separate common for materialize* storages 2021-03-20 14:13:57 +00:00
kssenii
4c37ff3fbc Less lambdas 2021-03-20 13:17:30 +00:00
kssenii
60fbeb8354 Better replica consumer code 2021-03-20 12:53:12 +00:00
kssenii
8091c8724d Fix metadata file 2021-03-20 12:15:32 +00:00
kssenii
caffccd73e Fixes 2021-03-20 11:53:41 +00:00
Kseniia Sumarokova
4e63b8e5dd
Update src/Storages/PostgreSQL/PostgreSQLReplicationHandler.cpp
Co-authored-by: tavplubix <tavplubix@gmail.com>
2021-03-20 13:50:16 +03:00
kssenii
6bb81630e5 Small fixes 2021-03-20 10:32:11 +00:00
kssenii
619f0f51fd Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into pg-ch-replica 2021-03-20 09:47:05 +00:00
kssenii
698b1b043c Fix typos check 2021-03-19 21:54:59 +00:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
kssenii
e066feb81c Slightly better 2021-03-19 18:50:41 +00:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
kssenii
f374a71165 Fix 2021-03-19 16:07:53 +00:00
kssenii
a0f717619c Remove initial filling 2021-03-19 08:33:04 +00:00
kssenii
9057aad798 Better version 2021-03-19 08:11:36 +00:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
kssenii
7847b78af9 Fix style, build 2021-03-17 20:49:56 +00:00
kssenii
3903d59d30 Better 2021-03-17 14:34:04 +00:00
kssenii
ae64a24844 Add connection pool 2021-03-17 13:55:47 +00:00
Kseniia Sumarokova
f8fc4281f2
Update PostgreSQLReplicaConnection.h 2021-03-17 15:56:47 +03:00
kssenii
87c740730b Rename to MaterializePostgreSQL 2021-03-17 10:52:12 +00:00
Kseniia Sumarokova
5b7ef512f5
Update PostgreSQLReplicaConnection.h 2021-03-15 09:14:30 +03:00
kssenii
6e69299191 Fix style 2021-03-14 10:43:23 +00:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
kssenii
28c0a64c07 Comment 2021-02-22 13:05:29 +00:00
kssenii
ace76bb7fa Better, remove debug logs 2021-02-22 12:35:53 +00:00
kssenii
8a48bb24ce Fix typos, comments 2021-02-21 23:13:58 +00:00
kssenii
2e3bdd662e Handle ddl part 2 2021-02-21 22:41:18 +00:00
kssenii
427aad80a1 Avoid table does not exist errors if nested is unavailable 2021-02-21 11:48:13 +00:00
kssenii
883cc2c0ef Fixes 2021-02-20 18:37:54 +00:00
kssenii
d0d90538ea Tiny fix 2021-02-20 18:04:10 +00:00
kssenii
0424770f68 Handle ddl part 1 2021-02-20 16:21:53 +00:00
kssenii
ff8b54ffd4 Make sure postgres table schema changes do not break replication 2021-02-18 23:33:01 +00:00
kssenii
3107f82a3b Fix clang tidy 2021-02-18 18:25:49 +00:00
kssenii
9cc63780de More correct update query 2021-02-18 18:14:05 +00:00
kssenii
1480e95179 Fix build, fix arcadia 2021-02-18 06:06:37 +00:00
kssenii
46dd137a5a Fix tests 2021-02-17 21:15:06 +00:00
kssenii
44c39d4609 better 2021-02-16 19:00:28 +00:00
kssenii
272431bcae Fix types check, better tests, try fix build 2021-02-15 23:18:53 +00:00
kssenii
95c93aca41 Better table sync 2021-02-13 21:03:25 +00:00
kssenii
44f4f1a412 Allow to replicate a subset of database tables 2021-02-13 20:09:01 +00:00
kssenii
219dece1d0 Slightly better 2021-02-12 21:15:00 +00:00
kssenii
010a640ed8 Fix and test different data types 2021-02-12 21:14:47 +00:00
kssenii
5bc0010f94 Better 2021-02-12 21:14:36 +00:00
kssenii
ed6d19b8a6 Add PostgreSQLReplica database engine 2021-02-12 21:14:24 +00:00
kssenii
9c2c7be4cf Separate replication interface from single storage 2021-02-12 21:14:10 +00:00
kssenii
7ceb784d1e Better slot usage, some fixes 2021-02-12 21:13:54 +00:00
kssenii
d87bfef890 Read up to max_block_size rows 2021-02-12 21:13:43 +00:00
kssenii
02e19f9422 Better 2021-02-12 21:13:13 +00:00
kssenii
d255b63364 Slightly better 2021-02-12 21:13:01 +00:00
kssenii
8d0c28d470 Replicate update queries 2021-02-12 21:12:41 +00:00
kssenii
0d19992128 Replicate delete queries 2021-02-12 21:12:27 +00:00
kssenii
4aadd0c3f2 Replicate insert queries 2021-02-12 21:11:55 +00:00
kssenii
179a558a04 Setup connection in the background, better drop table 2021-02-12 21:11:35 +00:00
kssenii
b842ce114b Initial sync into ReplacingMergeTree table, select via nested table 2021-02-12 21:11:09 +00:00
kssenii
60ebb86d97 Add stream and buffer classes 2021-02-12 21:10:40 +00:00
kssenii
a1bcc5fb39 Decode replication messages 2021-02-12 21:10:10 +00:00
kssenii
84ffd76853 Initial table sync and replication pre-startup 2021-02-12 21:09:43 +00:00
alexey-milovidov
e67e4588e7
Update PostgreSQLConnection.h 2021-01-16 15:26:21 +03:00
Alexey Milovidov
67f207d8ca More safe connection string 2021-01-16 00:18:51 +03:00
Alexey Milovidov
ba1921f380 Minor changes 2021-01-15 22:59:49 +03:00