Kruglov Pavel
f6f71ac5f1
Merge branch 'master' into fix_bug_in_copier
2022-12-01 12:29:50 +01:00
Alexey Milovidov
cf27a0cdeb
Fix log messages in clickhouse-copier
2022-11-25 22:29:02 +01:00
lzydmxy
0462132dd6
Ensure consistency when copier update status and current_partition_attach_is_done after partition attach is done
2022-11-24 11:15:44 +08:00
Yakov Olkhovskiy
2e34b384c1
update tcp protocol, add quota_key
2022-08-03 15:44:08 -04:00
Nikolai Kochetov
6e924cdc77
Fix some more tests.
2022-06-01 15:21:47 +00:00
Nikolai Kochetov
3d84aae0ab
Better.
2022-05-24 20:06:08 +00:00
Nikolai Kochetov
333fd09dbf
Fixing build.
2022-05-24 19:29:00 +00:00
Robert Schulze
118e94523c
Activate clang-tidy warning "readability-container-contains"
...
This check suggests replacing <Container>.count() by
<Container>.contains() which is more speaking and in case of
multimaps/multisets also faster.
2022-04-18 23:53:11 +02:00
vdimir
e7d3dbeebd
cluster discovery init only with zookeeper
2021-12-27 15:26:08 +03:00
Raúl Marín
b2cfa70541
Reduce dependencies on ASTFunction.h
...
481 -> 230
2021-11-26 18:21:54 +01:00
Nikolay Degterinsky
ba50e8387d
Merge branch 'master' into query_parameters
2021-11-15 19:55:54 +00:00
Azat Khuzhin
6274c7bfc2
Do not use global context for query execution in clickhouse-copier
2021-11-15 10:32:19 +03:00
Nikolay Degterinsky
d76976e272
Merge branch 'master' into query_parameters
2021-10-18 17:34:20 +03:00
Nikolai Kochetov
a08c98d760
Move some files.
2021-10-16 17:03:50 +03:00
Nikolay Degterinsky
49c1a52f34
Merge branch 'master' into query_parameters
2021-10-13 03:04:40 +03:00
Nikita Mikhaylov
32d77aafe2
Merge pull request #29921 from azat/copier-fixes
...
copier: add ability to configure retries and delays between them
2021-10-11 12:11:38 +03:00
Azat Khuzhin
452b3b443d
copier: add ability to configure retries and delays between them
...
The following options had been introduced:
- max-table-tries
- max-shard-partition-tries
- max-shard-partition-piece-tries-for-alter
- retry-delay-ms
2021-10-10 08:58:35 +03:00
Nikolai Kochetov
340b53ef85
Remove some more streams.
2021-10-08 17:03:54 +03:00
Nikolay Degterinsky
7f3d395bf3
Merge branch 'master' into query_parameters
2021-09-30 02:01:33 +03:00
Nikolai Kochetov
998d29ebc7
Merge branch 'master' into rewrite-pushing-to-views
2021-09-23 13:10:27 +03:00
Nikolay Degterinsky
1b1d90deb8
Merge branch 'master' into query_parameters
2021-09-22 13:53:56 +03:00
Dmitry Novik
fdd2e5d530
Update programs/copier/ClusterCopier.cpp
2021-09-21 01:19:40 +03:00
Eugene Konkov
130552330f
Fix error message
...
Fix typo in error message. Better wording.
2021-09-21 00:58:22 +03:00
Nikolai Kochetov
a790d391c0
Merge branch 'master' into rewrite-pushing-to-views
2021-09-20 19:43:15 +03:00
Nikolai Kochetov
341553febd
Fix build.
2021-09-16 20:40:42 +03:00
Nikolai Kochetov
b997214620
Rename QueryPipeline to QueryPipelineBuilder.
2021-09-14 20:48:18 +03:00
Azat Khuzhin
c99bd06195
copier: fix partition_key alias using WITH
...
After those changes it is not possible to add an alias for the tuple
element anymore, i.e.:
$ clickhouse-local -q 'select ((1,2) = (1,2) as foo), foo'
1 1
$ clickhouse-upstream local -q 'select ((1,2) = ((1,2) as foo)), foo'
1 (1,2)
But these can be done using WITH statement.
2021-09-12 00:15:31 +03:00
Nikolay Degterinsky
22f59e1714
Add support for table and database query parameters
2021-09-07 01:19:02 +03:00
Nikolai Kochetov
66a76ab70f
Rewrite PushingToViewsBlockOutputStream part 6
2021-09-03 20:29:36 +03:00
Amos Bird
dbfb699690
Asynchronously drain connections.
2021-07-19 21:53:29 +08:00
Maksim Kita
67e9b85951
Merge ext into common
2021-06-16 23:28:41 +03:00
Nikita Mikhaylov
f6932026d5
delete partition from original table in case of errors while moving
2021-06-04 14:21:47 +00:00
Nikita Mikhaylov
68c92cd93e
style
2021-06-03 23:58:47 +00:00
Nikita Mikhaylov
b978405f4a
fix
2021-06-03 15:50:44 +00:00
Nikita Mikhaylov
4382aac25d
support for ReplicatedTable creation without arguments
2021-06-02 15:46:37 +03:00
Nikita Mikhaylov
f57863b974
fix tests
2021-06-02 01:03:08 +03:00
Nikita Mikhaylov
33dcebbb24
style
2021-05-31 17:41:35 +03:00
Nikita Mikhaylov
01511d0cbe
better
2021-05-31 17:40:07 +03:00
Nikita Mikhaylov
1c548058e6
add status json
2021-05-31 17:38:55 +03:00
Nikita Mikhaylov
ac072243d6
style + enable trivial test
2021-05-31 17:38:55 +03:00
Nikita Mikhaylov
6d19dea761
better
2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
e9f66a0045
delete alter table optimize
2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
fa22b41d5a
added allow_to_drop_target_partitions with test
2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
9022646633
support copying of tables with data skipping indices
2021-05-31 17:38:20 +03:00
Nikita Mikhaylov
24af47063e
allow to copy materialized and alias
2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
c41cc36046
support TTL on columns
2021-05-31 17:37:10 +03:00
Nikita Mikhaylov
90ab394769
better
2021-05-31 17:37:10 +03:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
Nikita Mikhaylov
18dc213cee
Merge pull request #21912 from songenjie/clickhouse-copier-create-destination-once
...
[ClickHouse][Copier] Improve copier work
2021-03-30 14:42:00 +03:00
