alesapin
b5d6813604
Fix vertical merge again
2019-03-20 20:04:34 +03:00
alesapin
d8aa5c7c49
Slightly clearer debug and fix alter
2019-03-19 12:57:29 +03:00
alesapin
4ad4fc3f7b
Fix granule size less than row size
2019-03-18 19:21:52 +03:00
alesapin
05215b181f
More simpliest test
2019-03-18 19:09:31 +03:00
alesapin
2b2a637a38
Simpliest write/merge/select test works
2019-03-18 18:54:58 +03:00
alesapin
ce03636f05
Merge master
2019-03-18 15:02:33 +03:00
Alexey Milovidov
a459b2c298
Fixed insufficient type checking in hasAll, hasAny functions
2019-03-15 02:10:51 +03:00
Nikita Vasilev
a2480d7812
aggregation
2019-03-08 22:52:21 +03:00
Nikita Vasilev
610534e5ff
fix
2019-02-14 19:59:26 +03:00
Alexey Milovidov
c603d270f4
Cleanups #4246
2019-02-10 18:17:45 +03:00
Nikita Vasilev
a1b0dede07
Data Skipping Indices ( #4143 )
...
* made index parser
* added index parsing
* some fixes
* added index interface and factory
* fixed compilation
* ptrs
* added indexParts
* indextypes
* index condition
* IndexCondition
* added indexes in selectexecutor
* fix
* changed comment
* fix
* added granularity
* comments
* fix
* fix
* added writing indexes
* removed indexpart class
* fix
* added setSkipIndexes
* add rw for MergeTreeIndexes
* fixes
* upd error
* fix
* fix
* reading
* test index
* fixed nullptr error
* fixed
* fix
* unique names
* asts -> exprlist
* minmax index
* fix
* fixed select
* fixed merging
* fixed mutation
* working minmax
* removed test index
* fixed style
* added indexes to checkDataPart
* added tests for minmax index
* fixed constructor
* fix style
* fixed includes
* fixed setSkipIndexes
* added indexes meta to zookeeper
* added parsing
* removed throw
* alter cmds parse
* fix
* added alter
* fix
* alters fix
* fix alters
* fix "after"
* fixed alter
* alter fix + test
* fixes
* upd setSkipIndexes
* fixed alter bug with drop all indices
* fix metadata editing
* new test and repl fix
* rm test files
* fixed repl alter
* fix
* fix
* indices
* MTReadStream
* upd test for bug
* fix
* added useful parsers and ast classes
* fix
* fix comments
* replaced columns
* fix
* fixed parsing
* fixed printing
* fix err
* basic IndicesDescription
* go to IndicesDescr
* moved indices
* go to indicesDescr
* fix test minmax_index*
* fixed MT alter
* fixed bug with replMT indices storing in zk
* rename
* refactoring
* docs ru
* docs ru
* docs en
* refactor
* rename tests
* fix docs
* refactoring
* fix
* fix
* fix
* fixed style
* unique idx
* unique
* fix
* better minmax calculation
* upd
* added getBlock
* unique_condition
* added termForAST
* unique
* fixed not
* uniqueCondition::mayBeTrueOnGranule
* fix
* fixed bug with double column
* is always true
* fix
* key set
* spaces
* test
* tests
* fix
* unique
* fix
* fix
* fixed bug with duplicate column
* removed unused data
* fix
* fixes
* __bitSwapLastTwo
* fix
2019-02-05 17:50:25 +03:00
Alexey Milovidov
f7ecfc776b
Miscellaneous #4111
2019-01-21 21:04:08 +03:00
Alexey Milovidov
1d4701b0bc
Added some warnings from clang's -Weverything
2019-01-04 15:10:00 +03:00
alesapin
7c11455bd3
Remove compression settings
2018-12-21 15:17:30 +03:00
alesapin
aee6c0a606
Remove dump code
2018-12-20 20:37:02 +03:00
alesapin
512fe3c854
Refactoring (sanitizer failure)
2018-12-19 20:20:18 +03:00
alesapin
36a6121f75
Merge branch 'master' into custom_compression_codecs
2018-12-17 12:56:21 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff
2018-12-14 17:41:55 +03:00
zhang2014
6d0c4eaf89
ISSUES-838 add lz4、none、zstd codec
2018-12-13 12:10:34 +08:00
alesapin
a956efe0a8
Comment debug info
2018-12-04 19:33:35 +03:00
alesapin
7925abcd74
Deep debugging
2018-12-04 17:44:42 +03:00
alesapin
8c34386310
Some debug
2018-12-04 11:05:58 +03:00
alesapin
bf338b957f
Merge master
2018-12-03 12:10:06 +03:00
alesapin
3efb00b0ef
Some debug
2018-12-03 11:52:21 +03:00
alexey-milovidov
48b30edcf5
Merge branch 'master' into alter-order-by
2018-12-02 21:06:38 +03:00
alesapin
5524b77915
Compilable code!
2018-11-30 18:36:10 +03:00
alesapin
8e8bc6b1e0
Trash commits
2018-11-29 16:50:34 +03:00
alesapin
497a09c41b
Return to adaptive granularity
2018-11-29 16:12:20 +03:00
alesapin
b7cdd8fe7f
Trying to simplify merge reading logic
2018-11-28 18:05:28 +03:00
alesapin
6123993ec0
Load granularity to memroy
2018-11-15 17:06:54 +03:00
alesapin
b2b29815dd
Change fixed index granularity to adaptive
2018-11-14 10:49:20 +03:00
Alexey Zatelepin
2cc0aae82c
rearrange AST members in MergeTreeData [#CLICKHOUSE-3859]
2018-11-13 16:15:17 +03:00
Alexey Zatelepin
9a92c0a55c
sort key is distinct from primary key [#CLICKHOUSE-3859]
2018-11-13 16:12:49 +03:00
alesapin
0a64ef5de8
Add severals ifs for format_version, but have to move this routine to single class
2018-11-12 20:44:43 +03:00
alesapin
6f5fef5344
CLICKHOUSE-3971: Write data with adaptive index granularity
2018-11-12 19:14:37 +03:00
Alexey Milovidov
98543b7c41
Fixed vertical merge of multidimensional Nested structures [#CLICKHOUSE-3901]
2018-10-17 00:22:41 +03:00
Alexey Milovidov
fc9d335d41
Fixed error when empty part is generated after merge or mutation #2830
2018-08-22 06:33:46 +03:00
Alexey Milovidov
acb99b49df
Merge branch 'master' into CLICKHOUSE-2910
2018-08-14 23:29:42 +03:00
Nikolai Kochetov
ab10005af5
Renamed settings for LowCardinality type.
2018-08-09 13:52:46 +03:00
Nikolai Kochetov
f4d9d50168
Merged with master.
2018-08-08 15:01:18 +03:00
alexey-milovidov
4bfbe80d4f
Update MergedBlockOutputStream.cpp
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
72c4d8f064
add assert that MinMax index is correctly initialized [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
Alexey Milovidov
a2faa511cc
Less number of "stat" calls for each INSERT into MergeTree #2281
2018-07-08 06:56:24 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Alexey Zatelepin
aff6ad42ed
support empty parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Vitaliy Lyudvichenko
de6c48f4df
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-14 19:09:00 +03:00
Alexey Milovidov
956128a67a
Fixed style a bit [#CLICKHOUSE-2]
2018-05-07 05:01:11 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Vitaliy Lyudvichenko
efdda9cc9b
Introduced ThreadStatus. [#CLICKHOUSE-2910]
2018-03-07 14:35:10 +03:00
Alexey Milovidov
7ff1346685
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:30 +03:00
Alexey Milovidov
fa50fe80a0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 03:45:32 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
bcfde7c6c0
Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2].
2017-12-25 21:58:39 +03:00
Alexey Milovidov
c4bbc1c963
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 23:48:46 +03:00
Alexey Milovidov
f5a06cee5b
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 11:47:13 +03:00
Alexey Milovidov
5510bea3f8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 01:12:27 +03:00
Alexey Milovidov
8e6466454a
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-20 05:15:15 +03:00
Alexey Milovidov
2ca6952deb
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 02:16:18 +03:00
Alexey Zatelepin
b6b5d1cf25
store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000]
2017-10-24 17:11:53 +03:00
Alexey Zatelepin
e51f95872f
fix backward compatibility for new part format: [#CLICKHOUSE-3000]
...
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Vladimir Chebotarev
1e0241e262
dbms: CompressionSettingsSelector. [#METR-21516]
2017-10-13 04:08:23 +03:00
KochetovNicolai
83925f1d5e
Fix array writing ( #1314 )
...
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* added test [#CLICKHOUSE-3341]
* fixed test [#CLICKHOUSE-3341]
* refactoring and comments [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* Update ColumnArray.h
2017-10-12 23:13:26 +03:00
Alexey Zatelepin
71ebf67f2e
encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8
serialize partition and minmax index values [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Milovidov
4d97959e57
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-09-04 04:11:00 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
Alexey Milovidov
fb2aff4704
Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].
2017-08-07 10:31:16 +03:00
Nikolai Kochetov
75be0b81d8
removed typeid_cast from IColumn.h
2017-07-13 23:58:19 +03:00
Alexey Milovidov
80080f1ad6
Small refinements [#CLICKHOUSE-2].
2017-06-02 18:54:39 +03:00
Alexey Milovidov
a0b9bf5e97
Moved code to cpp [#CLICKHOUSE-2].
2017-04-08 04:32:05 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
e6a41a0256
Fixed error with NULLs [#CLICKHOUSE-2901].
2017-03-24 07:42:36 +03:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
alexey-milovidov
ed5b521110
Less dependencies 2 ( #378 )
...
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
Alexey Milovidov
f7fa5b73b9
Changed names of files with NULL-related data to be more consistent [#METR-19266].
2017-01-04 07:15:38 +03:00
Alexey Milovidov
1f3aeb066a
Renamed methods for bulk binary serialization (continued) [#METR-2944].
2017-01-03 02:08:09 +03:00
Alexey Milovidov
701ca28c85
Renamed methods for bulk binary serialization [#METR-2944].
2017-01-03 01:47:28 +03:00
Alexey Milovidov
ca37f28b5f
Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944].
2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34
Renamed method (less confusion) [#METR-2944].
2017-01-02 23:12:12 +03:00
Alexey Milovidov
baf29f5c48
NULLs support: fixed totally wrong code [#METR-19266].
2016-12-30 08:13:14 +03:00
Alexey Milovidov
8a69df19c4
Fixed error after merge [#METR-19266].
2016-12-12 09:00:37 +03:00
Alexey Milovidov
de82683197
Fixed build on clang [#METR-2944].[C
2016-12-12 08:56:34 +03:00
Alexey Milovidov
c937d75a78
Merging [#METR-19266].
2016-12-10 09:10:29 +03:00
Alexey Milovidov
e97ecb6cf7
Merge branch 'master' into METR-19266
...
Conflicts:
dbms/CMakeLists.txt
dbms/include/DB/Functions/FunctionsArray.h
dbms/include/DB/Functions/FunctionsString.h
dbms/include/DB/Parsers/ExpressionListParsers.h
dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
dbms/src/Core/ErrorCodes.cpp
dbms/src/Parsers/ASTFunction.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/MergeTreeReader.cpp
dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Alexey Arno
3792a9f302
dbms: Server: fixes [#METR-19266]
2016-10-20 13:13:07 +03:00
Alexey Arno
bd73b2d165
dbms: Server: Adding nullable type support to functions manipulating arrays. [#METR-19266]
2016-09-15 15:14:25 +03:00
Alexey Arno
443613c153
dbms: Fixed bug in ALTER TABLE ... MODIFY COLUMN. [#METR-19622]
2016-09-02 18:43:43 +03:00
