thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
26ab5dd7a7
ClickHouse/dbms/src/Storages/MergeTree
History
Amos Bird 26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
..
ActiveDataPartSet.cpp
ActiveDataPartSet.h Added functions "toISOWeek", "toISOYear", "toStartOfISOYear" [#CLICKHOUSE-3988] 2018-09-17 06:09:56 +03:00
AllMergeSelector.cpp
AllMergeSelector.h dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
BackgroundProcessingPool.cpp Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
BackgroundProcessingPool.h Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296] 2019-02-12 19:41:06 +03:00
BoolMask.h
checkDataPart.cpp r fix 2019-02-06 10:49:18 +03:00
checkDataPart.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
DataPartsExchange.cpp Remove redundant information from RWLock. 2018-11-28 18:50:52 +03:00
DataPartsExchange.h
DiskSpaceMonitor.cpp Fix macos build (#3861) 2018-12-18 16:37:00 +03:00
DiskSpaceMonitor.h Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
EphemeralLockInZooKeeper.cpp Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
EphemeralLockInZooKeeper.h Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
KeyCondition.cpp removed logs 2019-02-15 08:58:29 +03:00
KeyCondition.h Merge branch 'master' into mutations-fix-in 2019-01-23 14:47:53 +03:00
LevelMergeSelector.cpp CONTRIB-254 Arcadia fixes (#3475) 2018-11-01 20:07:20 +03:00
LevelMergeSelector.h
MarkRange.h
MergedBlockOutputStream.cpp fix 2019-02-14 19:59:26 +03:00
MergedBlockOutputStream.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeList.cpp kill ordinary MergeTree mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:10 +03:00
MergeList.h KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 21:09:15 +03:00
MergeSelector.h
MergeTreeBaseSelectBlockInputStream.cpp Fix macos build 2019-01-14 16:34:14 +03:00
MergeTreeBaseSelectBlockInputStream.h Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
MergeTreeBlockOutputStream.cpp Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
MergeTreeBlockOutputStream.h
MergeTreeBlockReadUtils.cpp dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
MergeTreeBlockReadUtils.h Rename MergeTree streams for select 2018-11-29 12:19:42 +03:00
MergeTreeData.cpp Merge pull request #4369 from yandex/fix-race-condition-merge-tree-clear-old-temporary-directories 2019-02-12 21:37:48 +03:00
MergeTreeData.h setting 2019-02-12 20:54:52 +03:00
MergeTreeDataFormatVersion.h Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
MergeTreeDataMergerMutator.cpp Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
MergeTreeDataMergerMutator.h Merge branch 'master' into mutations-introspection 2019-02-06 15:22:48 +03:00
MergeTreeDataPart.cpp Avoid "Memory limit exceeded" during ATTACH TABLE query 2019-02-14 16:05:44 +03:00
MergeTreeDataPart.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeDataPartChecksum.cpp Merge branch 'master' into zk-columns-compact-storage 2019-01-16 17:45:16 +03:00
MergeTreeDataPartChecksum.h introduce ReplicatedMergeTreePartHeader [#CLICKHOUSE-4024] 2018-12-29 17:11:16 +03:00
MergeTreeDataSelectExecutor.cpp fix 2019-02-14 19:59:26 +03:00
MergeTreeDataSelectExecutor.h Updated test #4246 2019-02-10 19:55:12 +03:00
MergeTreeDataWriter.cpp A Proper lookup table that uses HashTable's API 2019-03-01 16:47:13 +08:00
MergeTreeDataWriter.h Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
MergeTreeIndexReader.cpp Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeIndexReader.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeIndices.cpp unique -> set 2019-02-06 23:05:50 +03:00
MergeTreeIndices.h MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
MergeTreeMinMaxIndex.cpp MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
MergeTreeMinMaxIndex.h MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
MergeTreeMutationEntry.cpp
MergeTreeMutationEntry.h save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192] 2019-02-05 16:04:58 +03:00
MergeTreeMutationStatus.h save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192] 2019-02-05 16:04:58 +03:00
MergeTreePartInfo.cpp
MergeTreePartInfo.h Fixed build #3146 2018-09-17 06:44:29 +03:00
MergeTreePartition.cpp IPv4 and IPv6 Domain implementation. 2019-02-04 12:37:46 +03:00
MergeTreePartition.h a tool to convert an old month-partition part to the custom-partitioned format [#CLICKHOUSE-4231] 2019-01-30 16:51:39 +03:00
MergeTreeRangeReader.cpp Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
MergeTreeRangeReader.h Fixed comment [#CLICKHOUSE-2] 2018-10-09 17:30:05 +03:00
MergeTreeReader.cpp Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeReader.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeReaderStream.cpp Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
MergeTreeReaderStream.h fix 2019-02-06 11:24:16 +03:00
MergeTreeReadPool.cpp Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
MergeTreeReadPool.h Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
MergeTreeSelectBlockInputStream.cpp Updated test #4246 2019-02-10 19:55:12 +03:00
MergeTreeSelectBlockInputStream.h Updated test #4246 2019-02-10 19:55:12 +03:00
MergeTreeSequentialBlockInputStream.cpp Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
MergeTreeSequentialBlockInputStream.h Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
MergeTreeSetSkippingIndex.cpp MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
MergeTreeSetSkippingIndex.h MergingSortedBlockInputStream class constructor, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00
MergeTreeSettings.cpp Added some warnings from clang's -Weverything 2019-01-04 17:18:49 +03:00
MergeTreeSettings.h introduce ReplicatedMergeTreePartHeader [#CLICKHOUSE-4024] 2018-12-29 17:11:16 +03:00
MergeTreeThreadSelectBlockInputStream.cpp Updated test #4246 2019-02-10 19:55:12 +03:00
MergeTreeThreadSelectBlockInputStream.h Updated test #4246 2019-02-10 19:55:12 +03:00
MergeTreeWhereOptimizer.cpp add IdentifierSemantic and PredicateExpressionsOptimizer refactoring 2019-01-25 18:42:24 +03:00
MergeTreeWhereOptimizer.h add data types to the prepared_sets key for literals #4058 2019-01-23 14:20:01 +03:00
RangesInDataPart.h
registerStorageMergeTree.cpp setting 2019-02-12 20:54:52 +03:00
ReplicatedMergeTreeAddress.cpp
ReplicatedMergeTreeAddress.h CLICKHOUSE-3863: Add more convinient exception message 2018-08-01 00:29:47 +03:00
ReplicatedMergeTreeAlterThread.cpp Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
ReplicatedMergeTreeAlterThread.h apply changes in ReplicatedMergeTreeAlterThread [#CLICKHOUSE-3859] 2018-11-13 16:13:40 +03:00
ReplicatedMergeTreeBlockOutputStream.cpp Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
ReplicatedMergeTreeBlockOutputStream.h
ReplicatedMergeTreeCleanupThread.cpp Fixed thread names 2019-02-11 00:15:14 +03:00
ReplicatedMergeTreeCleanupThread.h Miscellaneous #2758 2018-08-28 02:59:49 +03:00
ReplicatedMergeTreeLogEntry.cpp Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
ReplicatedMergeTreeLogEntry.h Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
ReplicatedMergeTreeMutationEntry.cpp
ReplicatedMergeTreeMutationEntry.h try to get rid of IAST::range #4058 2019-01-23 14:19:22 +03:00
ReplicatedMergeTreePartCheckThread.cpp Fixed thread names 2019-02-11 00:15:14 +03:00
ReplicatedMergeTreePartCheckThread.h
ReplicatedMergeTreePartHeader.cpp Miscellaneous #3960 2019-01-17 17:45:02 +03:00
ReplicatedMergeTreePartHeader.h introduce ReplicatedMergeTreePartHeader [#CLICKHOUSE-4024] 2018-12-29 17:11:16 +03:00
ReplicatedMergeTreeQueue.cpp try executing other mutations immediately after KILL MUTATION [#CLICKHOUSE-3912] 2019-02-05 21:09:16 +03:00
ReplicatedMergeTreeQueue.h KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912] 2019-02-05 21:09:15 +03:00
ReplicatedMergeTreeQuorumAddedParts.h fix bug with merge part, wich us inserted with quorum 2018-10-18 17:14:07 +03:00
ReplicatedMergeTreeQuorumEntry.h
ReplicatedMergeTreeRestartingThread.cpp add info about replicated_can_become_leader to logs and system.replicas [#CLICKHOUSE-4309] 2019-02-13 16:08:34 +03:00
ReplicatedMergeTreeRestartingThread.h
ReplicatedMergeTreeTableMetadata.cpp Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
ReplicatedMergeTreeTableMetadata.h Data Skipping Indices (#4143) 2019-02-05 17:50:25 +03:00
SimpleMergeSelector.cpp CONTRIB-254 Arcadia fixes (#3475) 2018-11-01 20:07:20 +03:00
SimpleMergeSelector.h dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
StorageFromMergeTreeDataPart.h IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t. 2019-02-19 14:56:08 +03:00