Alexey Milovidov
c9d1b61ef7
Fixed build after merge #2029
2018-03-14 06:19:23 +03:00
Alexey Zatelepin
5906c9a988
rename for clarity
2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac
encapsulate ColumnsDeclaration [#CLICKHOUSE-3241]
2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Alexey Milovidov
c897e5ca39
Better [#CLICKHOUSE-2]
2018-03-03 18:36:20 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
...
Small enhancements
2018-01-16 22:07:43 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
5d5ed63e8c
Better error message. [#CLICKHOUSE-2]
2018-01-15 20:30:16 +03:00
Nikolai Kochetov
ea41197c51
merger with master
2017-12-28 21:20:53 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Milovidov
c4bbc1c963
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 23:48:46 +03:00
Alexey Milovidov
3def5f03f5
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
f5a06cee5b
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 11:47:13 +03:00
Nikolai Kochetov
de62ae6b1b
added system.parts_columns as a copy of system.parts [#CLICKHOUSE-3328]
2017-12-04 18:44:31 +03:00
Alexey Milovidov
5510bea3f8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 01:12:27 +03:00
Vitaliy Lyudvichenko
b738d1baed
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Vitaliy Lyudvichenko
9cf14d2c61
Remove obsolete code. [#CLICKHOUSE-2]
2017-11-02 17:35:12 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088
Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Alexey Zatelepin
b6b5d1cf25
store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000]
2017-10-24 17:11:53 +03:00
Vladimir Chebotarev
4e313f3732
dbms: Added compression level for ZSTD. [#METR-26742]
2017-10-13 04:08:23 +03:00
Alexey Zatelepin
1be62b567e
safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f
add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277
allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741
partition serialization into id and text [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a
absence of partitioning works [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e
encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932
load partition and minmax index from disk [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db
save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Milovidov
d82b87aaef
Fixed redundand code in better way [#CLICKHOUSE-3281].
2017-09-06 06:24:39 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
Alexey Zatelepin
d2847f22af
PR fixes [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876
remove unnecessary include [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53
generalize MinMax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8
split partition and minmax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a
Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Vitaliy Lyudvichenko
f28d0cff3c
Add more detailed exception message. [#CLICKHOUSE-3234]
2017-08-17 23:06:38 +03:00
Alexey Milovidov
164ad05ae1
Little better [#CLICKHOUSE-3231].
2017-08-16 22:22:49 +03:00
Alexey Milovidov
56a5bb53fa
Miscellaneous [#CLICKHOUSE-2].
2017-08-10 00:07:01 +03:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
Alexey Milovidov
8fb452e99a
Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175].
2017-07-29 00:25:24 +03:00
Alexey Milovidov
dd1f54bce2
Changed Poco::RWLock to std::shared_lock [#APRILDEV-91].
2017-07-28 20:34:02 +03:00
Nikolai Kochetov
985e449bd3
added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h
2017-07-13 19:49:09 +03:00
Alexey Milovidov
604de2bfeb
Better [#DEVTOOLS-3381].
2017-06-21 04:24:05 +03:00
Alexey Milovidov
153693cd4c
Non significant modifications [#CLICKHOUSE-3].
2017-06-05 23:43:23 +03:00
Alexey Milovidov
fa64d14f26
More readable temporary part names [#CLICKHOUSE-2].
2017-05-26 03:47:06 +03:00
Alexey Milovidov
ed44304c49
Removed obsolete commented code [#CLICKHOUSE-2].
2017-05-26 03:43:35 +03:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Vitaliy Lyudvichenko
d9637c2980
MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
...
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko
021e37943e
More clearer code and correct test. [#CLICKHOUSE-1993]
2017-05-12 16:44:11 +03:00
Vitaliy Lyudvichenko
0f1627691e
Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993]
2017-05-11 18:39:12 +04:00
alexey-milovidov
7fcf570c43
Update MergeTreeDataPart.cpp
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
56b00a110a
Removed debug code and add docs. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
82af2278fc
Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2]
...
Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902]
Make enums test more deterministic. [#CLICKHOUSE-2]
Refactored MergeTree readers.
Tabs -> spaces.
Move include/DB/ -> src/.
2017-04-15 06:48:24 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
f9b4b2012f
Removed zero-width spaces [#CLICKHOUSE-2].
2017-03-13 21:02:45 +03:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
Alexey Milovidov
354bed5bd7
Merge branch 'master' of github.com:yandex/ClickHouse
2017-02-13 19:12:46 +03:00
Alexey Milovidov
db9935337c
Misc [#CLICKHOUSE-2].
2017-02-13 19:12:34 +03:00
Alexey Milovidov
c9b4a163be
Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].
2017-02-12 01:31:22 +04:00
Alexey Milovidov
d95663865f
Miscellaneous [#CLICKHOUSE-2].
2017-02-09 02:56:40 +03:00
Alexey Milovidov
ffed6b1d5e
Added one more column to system.parts [#CLICKHOUSE-2757].
2017-01-17 23:54:32 +03:00
Alexey Milovidov
e407bf879c
system.parts: added a column for primary key size in bytes in RAM [#CLICKHOUSE-2757].
2017-01-17 23:49:16 +03:00
Alexey Milovidov
f7fa5b73b9
Changed names of files with NULL-related data to be more consistent [#METR-19266].
2017-01-04 07:15:38 +03:00
Alexey Milovidov
e97ecb6cf7
Merge branch 'master' into METR-19266
...
Conflicts:
dbms/CMakeLists.txt
dbms/include/DB/Functions/FunctionsArray.h
dbms/include/DB/Functions/FunctionsString.h
dbms/include/DB/Parsers/ExpressionListParsers.h
dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
dbms/src/Core/ErrorCodes.cpp
dbms/src/Parsers/ASTFunction.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/MergeTreeReader.cpp
dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Vitaliy Lyudvichenko
202ba912ce
Vertical merging algorithm for MergeTree engines. [#METR-23305]
2016-11-29 22:41:31 +03:00
alexey-milovidov
8c2e228856
Revert "New "vertical" algorithm for MergeTrees' parts merges"
2016-11-24 23:08:54 +04:00
Vitaliy Lyudvichenko
2cd5b8b604
Updated MergeInfo and progress callbacks with respect to vertical merge alg.
2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
ec9bcd8054
Vertical merging algorithm for ordinary MergeTreee.
2016-11-23 15:47:19 +03:00
Alexey Arno
7a4683140e
dbms: cleanup [#METR-19266]
2016-08-19 12:08:48 +03:00
Alexey Arno
22dc2f96a1
dbms: cleanup [#METR-19266]
2016-08-18 19:11:20 +03:00
Alexey Arno
531ff3d5ac
dbms: Merged with master [#METR-19266]
2016-08-05 18:44:19 +03:00
Alexey Arno
1fe6786b78
dbms: NULL support for MergeTree [#METR-19266]
2016-07-24 22:32:21 +03:00
Alexey Milovidov
55ed2904f4
Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087].
2016-07-14 08:22:09 +03:00
Alexey Milovidov
bf265e264a
Alter primary key: development [#METR-21119].
2016-05-17 02:04:03 +03:00
Alexey Milovidov
e1a80f5ded
Added support for case when merged data differs from data on another replicas [#METR-20670].
2016-03-31 04:25:16 +03:00
Alexey Milovidov
56b316bff7
Fixed error when symlinked part couldn't be removed [#METR-20080].
2016-02-19 23:13:54 +03:00
Alexey Milovidov
7af87e367f
Better diagnostics [#METR-20079].
2016-02-18 00:02:06 +03:00
Alexey Milovidov
5a78d4b0da
Lowered size of index in memory (experimental) [#METR-2944].
2016-02-14 08:43:03 +03:00
Alexey Milovidov
7a92c3cf1a
Preparation [#METR-2944].
2016-02-14 07:58:47 +03:00