kssenii
94b5763dbd
Revert "Different approach to fix modulo"
...
This reverts commit 665f1aa0f6
2021-05-21 16:14:01 +00:00
kssenii
665f1aa0f6
Different approach to fix modulo
2021-05-21 14:30:08 +00:00
kssenii
c7f51fe60e
Modulo adjustment for partition key
2021-05-15 19:51:02 +00:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr ( #22297 )
...
* Replace all Context references with std::weak_ptr
* Fix shared context captured by value
* Fix build
* Fix Context with named sessions
* Fix copy context
* Fix gcc build
* Merge with master and fix build
* Fix gcc-9 build
2021-04-11 02:33:54 +03:00
alesapin
e762d02e37
More const
2021-04-08 13:38:40 +03:00
alesapin
e17444757b
Fix rare case when quorum insert is not really quorum because of deduplication
2021-04-08 13:35:38 +03:00
alesapin
0204f5dd35
Merge branch 'master' into merge_tree_deduplication
2021-04-03 15:24:26 +03:00
alesapin
7c8f54e694
More changes
2021-04-01 11:07:56 +03:00
Mike Kot
285af08949
Merge remote-tracking branch 'upstream/master' into feature/attach-partition-local
2021-03-24 22:34:20 +03:00
Mike Kot
c55a73b752
Added the solution to handle the corruption case
...
When the part data (e.g. data.bin) is corrupted, but the checksums.txt
is present -- explicitly deleting the checksums.txt.
Removed the extra logging, changes some exceptions message.
2021-03-22 17:23:43 +03:00
Mike Kot
5789507e8b
Investigating, why the checksums may match when they shouldn't.
2021-03-22 17:23:43 +03:00
Mike Kot
831b90f272
Replaced the iteration algorithm in part finder
...
Now, instead of iterating through the directories, we iterate though
directories of on of the table disks (which doesn't give us a
substantial boost but is a bit neater to read).
- Updated the system.replication_queue command types.
- Fixed the part ptr being empty (added the checksum loading and
initialization).
- Removed extra logging.
2021-03-17 16:55:26 +03:00
Mike Kot
2ccdb7ef5c
Multiple small code and test updates
...
- Updated the docs to make everything clear.
- Multiple small logger fixes.
- Changed the attach_part command -- now it's after check for the
covering parts -- motivation is to do less work with the checksums
fetching.
- Better logging in the integration test.
2021-03-17 16:52:35 +03:00
Mike Kot
ca83775711
Multiple small hotfixes
...
Small fixes
Some fix for old bug
Another old code fix
2021-02-16 16:39:18 +03:00
Mike Kot
a1fafc47c6
Correct checksums pre-calculation for ATTACH_PART in ...OutputStream
2021-02-16 15:40:00 +03:00
Mike Kot
0a02fe913a
Add some code for the checksum pre-calculation in ...BlockOutputStream
...
Added the comment explaining the double-get for the zookeeper header for
the part.
2021-02-15 20:31:58 +03:00
Mike Kot
73f4740be5
Trying to re-write the solution by adding new command type
...
ATTACH_PART into the replicated log.
The LogEntry now also has the pre-calculated part checksum for this
entry type, which is later used while searching in the detached/ folder
2021-02-15 18:06:48 +03:00
Pavel Kruglov
f0163c2acf
Don't create empty parts on INSERT
2021-02-12 17:02:04 +03:00
fastio
8dde70b937
Bugfix: attach partition should reset the mutation
2021-01-11 21:26:43 +08:00
alesapin
8140fbd0fb
Merge pull request #18200 from ClickHouse/more_logs_during_quorum
...
More logs during quorum insert
2020-12-18 00:22:19 +03:00
alesapin
aecdd02be4
Better message
2020-12-17 19:14:42 +03:00
alesapin
f45993cd1e
More logs during quorum insert
2020-12-17 19:13:01 +03:00
Alexey Milovidov
9a017b77df
Merge branch 'master' into relax-too-many-parts-1
2020-12-17 04:40:39 +03:00
Pavel Kruglov
4b58528b9e
Rename getPos to getRow, change mergeBlock, pass setting instead of context
2020-12-04 19:25:30 +03:00
Pavel Kruglov
905ba78adc
Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert
2020-12-04 18:56:46 +03:00
Alexey Milovidov
2e6bedce91
Relax "Too many parts" threshold, part 1
2020-11-29 18:08:02 +03:00
Nicolae Vartolomei
746f8e45f5
All new parts must have uuids
2020-11-19 13:18:03 +00:00
Pavel Kruglov
6a57c0a8cf
Move merge in MergeTreeDataWriter
2020-11-13 10:55:56 +03:00
Alexandra Latysheva
6877f4aa9c
for parallel and non-parallel quorum insertion at the same time
2020-10-08 15:35:41 +00:00
Alexandra Latysheva
8f8872dc42
style check
2020-10-07 12:24:46 +00:00
Alexandra Latysheva
a43cac2c1a
changing the condition for updateQuorum, specialized it and reduced the number of calls to the zk
2020-10-07 11:28:48 +00:00
Alexandra Latysheva
f549ecf9d1
insert_quorum_parallel: status nodes in /quorum/parallel and allow merges
2020-10-06 21:49:48 +00:00
Alexandra Latysheva
ff8cbe6745
remove debug things
2020-10-04 20:19:05 +00:00
Alexandra Latysheva
8263e62298
working copy (with some debug info)
2020-10-04 19:55:39 +00:00
Alexandra Latysheva
e89a56969f
first part
2020-09-30 23:16:27 +00:00
alesapin
447205c525
More comments
2020-09-17 22:30:45 +03:00
alesapin
b07c00ef7c
Ugly, but probably working implementation
2020-09-17 18:33:50 +03:00
alesapin
d09fd8ca8b
Add comment
2020-09-17 17:01:17 +03:00
alesapin
6601f4f786
Better errors, fix merge
2020-09-17 15:10:06 +03:00
alesapin
6c369c8dc6
Fix merge error
2020-09-17 15:01:03 +03:00
alesapin
40b2f203b6
Merge branch 'master' into manual-write-duplicate-parts-to-replicas
2020-09-17 13:21:00 +03:00
Alexey Milovidov
26eb49b48d
Fix typo
2020-09-16 20:02:55 +03:00
Alexey Milovidov
ed1d120de0
Added another test; fixup
2020-08-28 03:28:37 +03:00
Alexey Milovidov
c4e8aaac16
Fixups
2020-08-28 03:07:51 +03:00
Alexey Milovidov
6082697c4d
Support for quorum
2020-08-28 02:39:12 +03:00
Alexey Milovidov
cdba5e727c
Fix mistake
2020-08-28 02:30:07 +03:00
Alexey Milovidov
88db4938f5
Fix error; refinements
2020-08-28 02:22:00 +03:00
Alexey Milovidov
5059d1f441
Merge branch 'master' into manual-write-duplicate-parts-to-replicas
2020-08-16 15:58:57 +03:00
Anton Popov
a43cb93be5
remove questionable functionality
2020-06-29 18:46:50 +03:00
