CurtizJ
2d7ff400ed
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-02-03 13:46:00 +03:00
CurtizJ
b5d8baee71
fix alters if ttl is set
2020-01-23 16:04:06 +03:00
CurtizJ
206cb1afa9
fix broken by refactoring functionality with wide parts
2019-12-25 01:49:39 +03:00
CurtizJ
ba2a630a13
merging with master
2019-12-19 16:10:57 +03:00
CurtizJ
9db2f2ccbc
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2019-12-19 14:46:43 +03:00
CurtizJ
258e8d61fb
polymorphic parts (development) cleanup
2019-12-18 19:41:11 +03:00
Alexander Burmak
1f69a7a015
Fixed merge issues
2019-12-12 14:10:18 +03:00
Vladimir Chebotarev
0ff0a52249
Missed review fixes.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
f72da4ab0c
Removing expired rows shall not be triggered on move TTL expiration.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
7407f7c39d
Placed move TTL rules to a vector.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
108e2b33eb
Fixed a bug with erasing columns with same name.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
0da7234d99
Added few FIXMEs to not forget.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ce851fc782
Fixed MergeTreeData::hasTableTTL() method according to extended TTLs.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
cb777f6c50
Removed redundant template from updateTTL() method.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
58e824b6a1
Refactored, added move enforcement on merges, fixed a bug with wrong disk selection in ReplicatedMergeTree.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
76c4ac9f60
Fixed ttl move logic in background move task and added ttl enforcement on inserts.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
575de5ada6
Attempt to add background moves by TTL expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
33ded274a3
First attempt to store min/max for move ttl expressions.
2019-12-11 13:24:20 +03:00
Vladimir Chebotarev
ecaa98e4e4
Allowed to use constant TTL expressions, updated tests.
2019-11-27 13:11:17 +03:00
CurtizJ
9e7adf4cbe
polymorphic parts (development)
2019-11-25 23:19:43 +03:00
CurtizJ
b54f1629ab
polymorphic parts (development)
2019-11-25 14:06:59 +03:00
CurtizJ
921d32485b
polymorphic parts (development)
2019-11-22 16:58:18 +03:00
CurtizJ
49982ad18c
polymorphic parts (development)
2019-11-22 15:51:00 +03:00
CurtizJ
94abf3691c
polymorphic parts (development)
2019-11-21 19:10:22 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface.
2019-11-06 00:08:04 +08:00
CurtizJ
7293841003
polymorphic parts (development)
2019-11-05 14:53:22 +03:00
CurtizJ
35b7363802
polymorphic parts (development)
2019-10-31 17:44:17 +03:00
CurtizJ
8df8bcea94
polymorphic parts (development)
2019-10-21 18:33:59 +03:00
CurtizJ
8ba37da2ef
polymorphic parts (development)
2019-10-16 21:27:53 +03:00
CurtizJ
b433add65c
polymorphic parts (development)
2019-10-10 19:30:30 +03:00
Alexander Kuzmenkov
f3bde19b74
Do not use iterators in find() and emplace() methods of hash tables.
...
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
2019-09-24 17:44:35 +03:00
alesapin
4702e40ed7
Fix bug with b_free and small refactoring
2019-09-10 11:56:27 +03:00
alesapin
189644e743
Better logging
2019-09-09 20:01:19 +03:00
alesapin
c003f443f9
Refactor
2019-09-04 20:26:53 +03:00
alesapin
1813b96f82
Finally build, possible trash.
2019-08-29 19:17:47 +03:00
Sergi Vladykin
c5a42a6948
TTL: Only drop altogether the expired parts and not partially prune them.
...
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
Igor Mineev
74466de6d8
Minor fixes.
2019-05-13 23:58:22 +03:00
Igor Mineev
af300c667b
Bugfix
2019-05-11 23:44:43 +03:00
Igor Mineev
8edcae5530
Merge remote-tracking branch 'upstream/master' into feature_multiple_disks
2019-04-24 15:35:08 +03:00
Igor Mineev
79abe85328
New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor
2019-04-21 21:38:44 +03:00
Anton Popov
7f93f9ad2f
TTL for columns and tables ( #4212 )
...
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Igor Mineev
563ab2a5ec
Merge remote-tracking branch 'upstream/master' into feature_multiple_disks
2019-04-05 23:07:24 +03:00
Igor Mineev
0441480502
Storage getDataPath -> getDataPaths
2019-04-04 16:13:59 +03:00
Igor Mineev
8047d16a96
Add Path chooser. Add DiskMonitort multiple disks support
2019-04-01 21:41:19 +03:00
Alexey Milovidov
72d021c3d7
Implement "max_partitions_per_insert_block" setting #4700
2019-03-29 12:45:55 +03:00
Alexey Milovidov
8cb1619607
Implement "max_partitions_per_insert_block" setting #4700
2019-03-29 12:34:07 +03:00
Amos Bird
26ab5dd7a7
A Proper lookup table that uses HashTable's API
...
This is the first step of allowing heterogeneous cells in hash tables.
performance test results are
```
1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>
ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124
ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998
ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130
ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191
ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279
ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441
ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564
ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378
ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157
ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041
```
2019-03-01 16:47:13 +08:00
Nikita Vasilev
a1b0dede07
Data Skipping Indices ( #4143 )
...
* made index parser
* added index parsing
* some fixes
* added index interface and factory
* fixed compilation
* ptrs
* added indexParts
* indextypes
* index condition
* IndexCondition
* added indexes in selectexecutor
* fix
* changed comment
* fix
* added granularity
* comments
* fix
* fix
* added writing indexes
* removed indexpart class
* fix
* added setSkipIndexes
* add rw for MergeTreeIndexes
* fixes
* upd error
* fix
* fix
* reading
* test index
* fixed nullptr error
* fixed
* fix
* unique names
* asts -> exprlist
* minmax index
* fix
* fixed select
* fixed merging
* fixed mutation
* working minmax
* removed test index
* fixed style
* added indexes to checkDataPart
* added tests for minmax index
* fixed constructor
* fix style
* fixed includes
* fixed setSkipIndexes
* added indexes meta to zookeeper
* added parsing
* removed throw
* alter cmds parse
* fix
* added alter
* fix
* alters fix
* fix alters
* fix "after"
* fixed alter
* alter fix + test
* fixes
* upd setSkipIndexes
* fixed alter bug with drop all indices
* fix metadata editing
* new test and repl fix
* rm test files
* fixed repl alter
* fix
* fix
* indices
* MTReadStream
* upd test for bug
* fix
* added useful parsers and ast classes
* fix
* fix comments
* replaced columns
* fix
* fixed parsing
* fixed printing
* fix err
* basic IndicesDescription
* go to IndicesDescr
* moved indices
* go to indicesDescr
* fix test minmax_index*
* fixed MT alter
* fixed bug with replMT indices storing in zk
* rename
* refactoring
* docs ru
* docs ru
* docs en
* refactor
* rename tests
* fix docs
* refactoring
* fix
* fix
* fix
* fixed style
* unique idx
* unique
* fix
* better minmax calculation
* upd
* added getBlock
* unique_condition
* added termForAST
* unique
* fixed not
* uniqueCondition::mayBeTrueOnGranule
* fix
* fixed bug with double column
* is always true
* fix
* key set
* spaces
* test
* tests
* fix
* unique
* fix
* fix
* fixed bug with duplicate column
* removed unused data
* fix
* fixes
* __bitSwapLastTwo
* fix
2019-02-05 17:50:25 +03:00
Alexey Zatelepin
8957e73681
a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231]
2019-01-30 16:51:39 +03:00
Alexey Milovidov
1d4701b0bc
Added some warnings from clang's -Weverything
2019-01-04 15:10:00 +03:00
