Alexey Zatelepin
5bc6bd55b1
allow PreCommitted parts to contain each other, clean up code
2018-02-20 16:33:28 +03:00
Alexey Milovidov
d0bfa15525
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:49 +03:00
Alexey Milovidov
7ff1346685
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:30 +03:00
Alexey Milovidov
fa50fe80a0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 03:45:32 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d
added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c
renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a
added MultiversionMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
27179b375a
removed prerequisites [#CLICKHOUSE-3550]
2018-02-08 20:18:52 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
...
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
Vitaliy Lyudvichenko
26e58271e9
Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2]
2018-01-25 17:42:39 +03:00
Vlad Arkhipov
6738d6a995
Add comments. Improve method names.
2018-01-23 11:18:12 +03:00
Vlad Arkhipov
be96cf5133
Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index.
2018-01-21 11:22:52 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
alexey-milovidov
2a7024ba5a
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
alexey-milovidov
1292d14185
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
zhang2014
517958ab09
ISSUES-1369 fix typo
2018-01-09 21:01:26 +03:00
zhang2014
be966015c9
ISSUES-1369 add check when create Replacing & Collapsing
2018-01-09 21:01:26 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0
Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2].
2017-12-25 21:58:39 +03:00
Alexey Zatelepin
c3348e27a4
shorter [#CLICKHOUSE-2]
2017-12-25 20:31:14 +03:00
Alexey Zatelepin
2340e55d0e
revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Milovidov
c5d5296889
Miscellaneous [#CLICKHOUSE-2].
2017-12-18 07:07:26 +03:00
Alexey Milovidov
6ad5be5eee
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 10:15:13 +03:00
Alexey Milovidov
ecd56de6a8
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 00:11:24 +03:00
Alexey Milovidov
c3015bece3
Miscellaneous [#CLICKHOUSE-2].
2017-12-11 01:44:04 +03:00
Alexey Milovidov
3def5f03f5
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
7e2100d7f7
Fixed exception message [#CLICKHOUSE-2].
2017-12-04 23:37:28 +03:00
Alexey Milovidov
06dfe7f562
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 08:55:49 +03:00
Alexey Milovidov
ab022d0882
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:59:59 +03:00
Alexey Milovidov
1aa99092c3
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:15:35 +03:00
Alexey Milovidov
a9ddaa2b19
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 04:49:54 +03:00
Alexey Milovidov
a813287afd
Rewrite MergeTreePartChecker [#CLICKHOUSE-2838].
2017-12-03 03:48:19 +03:00
Alexey Milovidov
464d962010
Rewrite MergeTreePartChecker [#CLICKHOUSE-2838].
2017-12-03 03:46:34 +03:00
Alexey Milovidov
5510bea3f8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 01:12:27 +03:00
Alexey Milovidov
54e601019c
Better [#CLICKHOUSE-2].
2017-12-02 00:40:58 +03:00
Vitaliy Lyudvichenko
b738d1baed
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Alexey Milovidov
01e8adbfff
Removed "experimental" namespace [#CLICKHOUSE-2].
2017-11-20 07:15:43 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4
2017-11-19 23:57:44 +03:00
Alexey Milovidov
729b114c15
Removed unsupported functionality [#CLICKHOUSE-2].
2017-11-18 05:34:00 +03:00
proller
6da4f5a661
add locks
2017-11-01 22:56:07 +03:00
Alexey Milovidov
6aff58c747
Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2].
2017-11-01 04:45:10 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
...
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
Vitaliy Lyudvichenko
602560cb2e
Update system.parts table. [#CLICKHOUSE-3178]
2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf
Fixed awful copypaste. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421
Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088
Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257
Add state for MergeTree parts. [#CLICKHOUSE-3178]
...
And Removed obsolete code.
2017-10-26 17:16:06 +03:00
Alexey Milovidov
65982a1642
Fixed exception messages [#CLICKHOUSE-2].
2017-10-25 22:17:37 +03:00
Alexey Zatelepin
b6b5d1cf25
store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000]
2017-10-24 17:11:53 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Alexey Zatelepin
a7c85e0c89
save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]
2017-10-20 21:28:44 +03:00
Alexey Zatelepin
75c65c7b59
use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Marek Vavruša
2ac5a743cc
dbms: fix build with OS X built-in clang
...
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:
```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
res.insert({elem.column, elem.type, rename[i].value()});
~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
value_type& value()
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
49f8080e52
Small debud improvement
2017-10-13 21:44:26 +03:00
Amos Bird
f30841d5ab
Fix SummingMergeTree argument checking logic.
...
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 15:42:32 +03:00
Vladimir Chebotarev
1e0241e262
dbms: CompressionSettingsSelector. [#METR-21516]
2017-10-13 04:08:23 +03:00
KochetovNicolai
83925f1d5e
Fix array writing ( #1314 )
...
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* added test [#CLICKHOUSE-3341]
* fixed test [#CLICKHOUSE-3341]
* refactoring and comments [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* Update ColumnArray.h
2017-10-12 23:13:26 +03:00
Alexey Milovidov
d468473d62
Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
2017-10-12 21:21:17 +03:00
Alexey Zatelepin
6e57272052
don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757
forbid ALTER of partition key columns for now [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e
safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e
allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91
serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f
add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277
allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741
partition serialization into id and text [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a
absence of partitioning works [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8
serialize partition and minmax index values [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db
save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Milovidov
40884640a1
Merge branch 'master' of github.com:yandex/ClickHouse
2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a
Merge pull request #1163 from yandex/CLICKHOUSE-2931
...
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Alexey Zatelepin
d2847f22af
PR fixes [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169
check alter of partition key columns [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53
generalize MinMax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46
generic partitioning of inserted blocks [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8
split partition and minmax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a
Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989
Merge branch 'master' into CLICKHOUSE-2931
2017-08-31 00:23:39 +03:00
Vitaliy Lyudvichenko
84660029ec
Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252]
2017-08-29 20:49:37 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3
Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931]
2017-08-28 20:27:16 +03:00
Alexey Milovidov
3a86673aea
Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232].
2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1
Little better [#CLICKHOUSE-3231].
2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0df4ae6b02
do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Alexey Zatelepin
f25f0cd759
reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
10c14cfccb
Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]
2017-08-04 17:35:36 +03:00
alexey-milovidov
ae8783aee3
Merge pull request #1045 from prog8/nocompression
...
Added compression NONE
2017-08-01 23:07:52 +03:00
Pawel Rog
d6a2056851
Applied changes requested by Alexey
2017-08-01 16:48:24 +02:00
Pawel Rog
9f799820d9
Applied changes requested by Alexey
2017-08-01 10:12:15 +02:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
alexey-milovidov
4877aa394c
Update MergeTreeData.cpp
2017-07-31 20:44:41 +03:00
Pawel Rog
3a6c444996
Merge branch 'master' into nocompression
2017-07-31 13:36:58 +02:00