Commit Graph

1866 Commits

Author SHA1 Message Date
Tsarkova Anastasia
938cb2b57a Considering set first. 2018-02-07 18:29:00 +03:00
Tsarkova Anastasia
c50ccabb0a Implement MergeTree index using for IN operator with tuple of columns. 2018-02-07 18:29:00 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
4665201827 Add metric for duplicated inserts. [#CLICKHOUSE-2] 2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a Better system.part_log. [#CLICKHOUSE-3342] 2018-01-25 21:40:02 +03:00
chenxing.xc
be85910088 fix endless query issue #1769 2018-01-26 00:44:47 +08:00
Vitaliy Lyudvichenko
26e58271e9 Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2] 2018-01-25 17:42:39 +03:00
alexey-milovidov
b8cb9267c7
Merge pull request #1804 from arkhipov/master
Replace subqueries and table expressions on the right side of the IN …
2018-01-23 22:31:49 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e Make early deduplication with block number creation. [#CLICKHOUSE-3545] 2018-01-23 18:50:29 +03:00
Vlad Arkhipov
6738d6a995 Add comments. Improve method names. 2018-01-23 11:18:12 +03:00
Vlad Arkhipov
be96cf5133 Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index. 2018-01-21 11:22:52 +03:00
Alexey Milovidov
9a02d4f5ff Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-01-20 04:20:40 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
f770156b0b
Update MergeTreeDataMerger.cpp 2018-01-19 21:42:22 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
Small enhancements
2018-01-16 22:07:43 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
5d5ed63e8c Better error message. [#CLICKHOUSE-2] 2018-01-15 20:30:16 +03:00
Vitaliy Lyudvichenko
03bca2144d OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
Resolves #1753
2018-01-15 13:13:18 +03:00
Alexey Milovidov
550053a0ca Merge branch 'master' into header-in-input-streams 2018-01-10 03:05:51 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Nikolai Kochetov
cbeeb84999 added http_*_timeout settings [#CLICKHOUSE-3440] 2018-01-09 21:41:01 +03:00
alexey-milovidov
890ad92f90
Merge pull request #1627 from yandex/table-system-parts_columns
Table system.parts_columns
2018-01-09 21:33:55 +03:00
alexey-milovidov
2a7024ba5a Update MergeTreeData.cpp 2018-01-09 21:01:26 +03:00
alexey-milovidov
1292d14185 Update MergeTreeData.cpp 2018-01-09 21:01:26 +03:00
zhang2014
517958ab09 ISSUES-1369 fix typo 2018-01-09 21:01:26 +03:00
zhang2014
be966015c9 ISSUES-1369 add check when create Replacing & Collapsing 2018-01-09 21:01:26 +03:00
Alexey Milovidov
5081f276d1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 04:51:08 +03:00
Alexey Milovidov
9996e181e1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-06 21:10:44 +03:00
Alexey Milovidov
ffca152c45 Inverted dependencies in StorageFactory [#CLICKHOUSE-2]. 2017-12-30 07:00:39 +03:00
Alexey Milovidov
7244514859 Less dependencies in StorageFactory: development [#CLICKHOUSE-2]. 2017-12-30 07:00:39 +03:00
Nikolai Kochetov
ea41197c51 merger with master 2017-12-28 21:20:53 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
4cde48fb20 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-28 01:40:42 +03:00
Alexey Milovidov
b79aa5db4e Update documentation about required ZK version; Miscellaneous #1458 2017-12-27 21:34:58 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
Alexey Zatelepin
280c147a89 remove dependency to StorageReplicatedMergeTree [#CLICKHOUSE-2] 2017-12-26 22:15:15 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0 Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2]. 2017-12-25 21:58:39 +03:00
Alexey Zatelepin
c3348e27a4 shorter [#CLICKHOUSE-2] 2017-12-25 20:31:14 +03:00
proller
fb7047bfe8 Fix 32bit build 2017-12-25 20:17:32 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb Whitespace [#CLICKHOUSE-2]. 2017-12-21 20:43:32 +03:00
Alexey Milovidov
584a263d79 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Alexey Zatelepin
c422b5b2e4 take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508] 2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95 add comments [#CLICKHOUSE-3508] 2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8 check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Milovidov
32fcc7b3f0 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 09:23:19 +03:00
Alexey Milovidov
11d3b9c710 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 08:37:20 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
6ad5be5eee Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 10:15:13 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
ecd56de6a8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:11:24 +03:00
Alexey Milovidov
c4bbc1c963 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 23:48:46 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
71116c4d82 Fixed error [#CLICKHOUSE-2]. 2017-12-09 20:16:24 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
8cc0bae1bc Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 02:07:41 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
e776a4fc67 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 07:26:30 +03:00
alexey-milovidov
b7f656d289
Merge pull request #1541 from yandex/fix-replica-queue-load
Add idempotent retries of updating the replica queue in ZooKeeper
2017-12-05 00:16:03 +03:00
Alexey Milovidov
7e2100d7f7 Fixed exception message [#CLICKHOUSE-2]. 2017-12-04 23:37:28 +03:00
proller
826936cf9b
Better fix of std::numeric_limits<__uint128_t> (#1585)
* Fix std::numeric_limits<__uint128_t>

* clean

* Better fix of std::numeric_limits<__uint128_t>
2017-12-04 19:12:56 +03:00
Nikolai Kochetov
de62ae6b1b added system.parts_columns as a copy of system.parts [#CLICKHOUSE-3328] 2017-12-04 18:44:31 +03:00
proller
4c3dfb97df
Clang: Fix std::numeric_limits<__uint128_t> (#1583)
Fix std::numeric_limits<__uint128_t>
2017-12-04 16:03:40 +03:00
Alexey Milovidov
06dfe7f562 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 08:55:49 +03:00
Alexey Milovidov
a80259d0cb Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:57:33 +03:00
Alexey Milovidov
418e5012e7 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:43:38 +03:00
Alexey Milovidov
3717d80017 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:40:21 +03:00
Alexey Milovidov
c472172fa8 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:25:41 +03:00
Alexey Milovidov
a597f3e7d9 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:23:03 +03:00
Alexey Milovidov
3786786aeb Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:19:46 +03:00
Alexey Milovidov
294c0ba5cf Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 06:43:48 +03:00
Alexey Milovidov
ab022d0882 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 05:59:59 +03:00
Alexey Milovidov
1aa99092c3 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 05:15:35 +03:00
Alexey Milovidov
a9ddaa2b19 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 04:49:54 +03:00
Alexey Milovidov
a813287afd Rewrite MergeTreePartChecker [#CLICKHOUSE-2838]. 2017-12-03 03:48:19 +03:00
Alexey Milovidov
464d962010 Rewrite MergeTreePartChecker [#CLICKHOUSE-2838]. 2017-12-03 03:46:34 +03:00
Alexey Milovidov
5510bea3f8 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 01:12:27 +03:00
Alexey Milovidov
b932a193e2 Better [#CLICKHOUSE-2]. 2017-12-02 06:25:52 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
a85773bdbc Fixed error [#CLICKHOUSE-2838]. 2017-12-02 00:30:43 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
1efef27af9 Better [#CLICKHOUSE-2] 2017-12-01 23:38:50 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index 2017-12-01 19:53:04 +03:00
Alexey Milovidov
98291f1a24 Cleanups [#CLICKHOUSE-2838]. 2017-12-01 17:21:24 +03:00
Alexey Milovidov
6fb18a7dc2 Added comments [#CLICKHOUSE-2838]. 2017-12-01 17:15:38 +03:00
Alexey Milovidov
d4089695ad Cleanups [#CLICKHOUSE-2838]. 2017-12-01 16:32:37 +03:00
Vitaliy Lyudvichenko
ddb02d8ccf Small enhancements. [#CLICKHOUSE-3452] 2017-11-29 14:54:37 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Alexey Milovidov
7b4bffe088 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-29 02:31:21 +03:00
Alexey Zatelepin
01d42242b1 mark queue as dirty if status of ZK operation is unknown [#CLICKHOUSE-3405] 2017-11-28 17:09:53 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
Alexey Milovidov
6266ecc5ed Miscellaneous [#CLICKHOUSE-2]. 2017-11-25 02:03:58 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
859bf86a43 Fixed error found by ASan with debug libc++ (actually not dangerous) [#CLICKHOUSE-2]. 2017-11-23 18:24:55 +03:00
Alexey Zatelepin
78aaa42ddd add idempotent retries of updating the replica queue in ZooKeeper [#CLICKHOUSE-3405] 2017-11-23 16:19:29 +03:00
Alexey Milovidov
e15d637714 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:12:09 +03:00
Alexey Milovidov
4bf120b285 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:11:16 +03:00
Alexey Milovidov
4bc98c9253 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:25:36 +03:00
Alexey Milovidov
63f79b7b4f Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:23:41 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:07 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
fd3239dd46 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 07:18:27 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
8e6466454a Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 05:15:15 +03:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
Alexey Milovidov
6c8b5e29d8 Additions after merge [#CLICKHOUSE-2]. 2017-11-20 00:17:58 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
Alexey Milovidov
94d3b49e99 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:27:43 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
ac1b69247c Addition to prev. revision [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
783e812eb7 Fixed error [#CLICKHOUSE-2] 2017-11-04 19:46:14 +03:00
proller
c974f0e88e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko
9cf14d2c61 Remove obsolete code. [#CLICKHOUSE-2] 2017-11-02 17:35:12 +03:00
proller
6da4f5a661 add locks 2017-11-01 22:56:07 +03:00
proller
3b58e9cd67 Fix atomic usage 2017-11-01 20:15:05 +03:00
proller
c5dcde0c78 fix atomic usage 2017-11-01 16:58:02 +03:00
Alexey Milovidov
6aff58c747 Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2]. 2017-11-01 04:45:10 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Vitaliy Lyudvichenko
602560cb2e Update system.parts table. [#CLICKHOUSE-3178] 2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
483dfd1b44 Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf Fixed awful copypaste. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421 Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088 Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257 Add state for MergeTree parts. [#CLICKHOUSE-3178]
And Removed obsolete code.
2017-10-26 17:16:06 +03:00
Alexey Milovidov
65982a1642 Fixed exception messages [#CLICKHOUSE-2]. 2017-10-25 22:17:37 +03:00
proller
4ffbca2d8c Fix warnings (#1406)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
Alexey Zatelepin
b6b5d1cf25 store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000] 2017-10-24 17:11:53 +03:00
Alexey Zatelepin
c61d4106e8 allow loading all MergeTree settings from a query [#CLICKHOUSE-3000] 2017-10-20 21:28:45 +03:00
Alexey Zatelepin
a7c85e0c89 save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000] 2017-10-20 21:28:44 +03:00
Alexey Zatelepin
75c65c7b59 use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Zatelepin
e51f95872f fix backward compatibility for new part format: [#CLICKHOUSE-3000]
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
49f8080e52 Small debud improvement 2017-10-13 21:44:26 +03:00
Amos Bird
f30841d5ab Fix SummingMergeTree argument checking logic.
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 15:42:32 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Vladimir Chebotarev
4e313f3732 dbms: Added compression level for ZSTD. [#METR-26742] 2017-10-13 04:08:23 +03:00
Alexey Milovidov
3a6705af0f Improvement [#CLICKHOUSE-2]. 2017-10-12 23:34:01 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
KochetovNicolai
83925f1d5e Fix array writing (#1314)
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* added test [#CLICKHOUSE-3341]

* fixed test [#CLICKHOUSE-3341]

* refactoring and comments [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* Update ColumnArray.h
2017-10-12 23:13:26 +03:00
alexey-milovidov
c1285c7d6b Update MergeTreeDataMerger.cpp 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
cabf6d7799 Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2] 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc Less noisy logging. [#CLICKHOSUE-2] 2017-10-12 22:28:24 +03:00
Alexey Milovidov
d468473d62 Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369]. 2017-10-12 21:21:17 +03:00
proller
19042816c4 Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) (#1325) 2017-10-06 19:26:32 +03:00
Alexey Zatelepin
6e57272052 don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1 add comments [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757 forbid ALTER of partition key columns for now [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91 serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741 partition serialization into id and text [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a absence of partitioning works [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932 load partition and minmax index from disk [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8 serialize partition and minmax index values [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Nikolai Kochetov
322e56c692 fix reading with preferred_block_size_bytes = 0 2017-09-24 02:16:30 +03:00
Alexey Zatelepin
df58949a68 make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259] 2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258] 2017-09-20 06:05:20 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Vitaliy Lyudvichenko
826c354ff5 Fixed merges progress bar. [#CLICKHOUSE-2] 2017-09-15 01:04:13 +03:00
proller
5054d50307 Remove too noisy message (#CLICKHOUSE-3304) 2017-09-11 21:26:43 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
6307661c35 Addition to prev. revision [#CLICKHOUSE-3300]. 2017-09-08 00:26:25 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Alexey Milovidov
d82b87aaef Fixed redundand code in better way [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
Alexey Milovidov
4d97959e57 Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-09-04 04:11:00 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Nikolai Kochetov
937f37c489 fixed reading of empty block in prewhere [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Nikolai Kochetov
a9e2a17f69 fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Alexey Zatelepin
d2847f22af PR fixes [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169 check alter of partition key columns [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
dc5809ed8d get rid of unneeded variable [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876 remove unnecessary include [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf rename partition -> partition_id for clarity [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53 generalize MinMax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8 split partition and minmax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Alexey Milovidov
e4eb6f0cfb Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 22:02:07 +03:00
Alexey Milovidov
709eba2a00 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-29 21:51:58 +03:00
Alexey Milovidov
04af7a3349 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko
84660029ec Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252] 2017-08-29 20:49:37 +03:00
Alexey Milovidov
8d7937cc30 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 17:08:25 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alexey Milovidov
e25f232b5a Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2] 2017-08-19 01:56:19 +03:00
Alexey Milovidov
e01c23267a Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-08-18 22:41:27 +03:00
Vitaliy Lyudvichenko
f28d0cff3c Add more detailed exception message. [#CLICKHOUSE-3234] 2017-08-17 23:06:38 +03:00
Nikolai Kochetov
850bc9f19d fixed reading const zero column in prewhere 2017-08-17 23:06:00 +03:00
proller
175cd99288 Freebsd fixes: fix build with libc++, fix find system lib double-conversion (#1109)
* Cmake: Don't detect and use -no-pie flag with clang

* Camke: find_unwind: Fix disable on arm

* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Alexey Milovidov
3a86673aea Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232]. 2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1 Little better [#CLICKHOUSE-3231]. 2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0185fd4542 fix parsing min-max dates from part name [#CLICKHOUSE-3000] 2017-08-15 23:03:59 +03:00
Alexey Zatelepin
372801c59b fix comments [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Alexey Zatelepin
0df4ae6b02 do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Alexey Zatelepin
f25f0cd759 reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
8a14cc49ff asyncMulti() -> multi(). [#CLICKHOUSE-3221] 2017-08-15 19:18:02 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Nikolai Kochetov
90940d8423 Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033] 2017-08-11 18:02:07 +03:00
Vitaliy Lyudvichenko
cd3a696d8b Add requested changes. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Alexey Milovidov
e86d0b4a74 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-10 00:07:10 +03:00
Alexey Milovidov
56a5bb53fa Miscellaneous [#CLICKHOUSE-2]. 2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko
27174d9dd2 Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2] 2017-08-09 23:57:42 +03:00
Vitaliy Lyudvichenko
00ce8c9603 Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173] 2017-08-08 03:28:43 +03:00
Alexey Milovidov
fb2aff4704 Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838]. 2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Nikolai Kochetov
0c15b2c6fc fixed number of rows to read from first granula in mergetree 2017-08-03 15:58:04 +03:00
alexey-milovidov
ae8783aee3 Merge pull request #1045 from prog8/nocompression
Added compression NONE
2017-08-01 23:07:52 +03:00
alexey-milovidov
2ae6f1ebdb Update MergeTreeDataWriter.cpp 2017-08-01 23:07:16 +03:00
Pawel Rog
d6a2056851 Applied changes requested by Alexey 2017-08-01 16:48:24 +02:00
Pawel Rog
9f799820d9 Applied changes requested by Alexey 2017-08-01 10:12:15 +02:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
alexey-milovidov
d174ebc5c9 Update MergeTreeDataWriter.cpp 2017-07-31 20:44:58 +03:00
alexey-milovidov
4877aa394c Update MergeTreeData.cpp 2017-07-31 20:44:41 +03:00
Pawel Rog
3a6c444996 Merge branch 'master' into nocompression 2017-07-31 13:36:58 +02:00
Pawel Rog
e1ab721d3d Use compression method from configs 2017-07-31 13:12:28 +02:00
Pawel Rog
a0cc54457e Added compression NONE 2017-07-31 12:44:45 +02:00
Nikolai Kochetov
78991b25ee fixed preferred_max_column_in_block_size_bytes disabling 2017-07-30 01:24:57 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
proller
700d4e0904 Fix boost 1.64 and gcc7+ compile errors (#1040)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153 Update MergeTreeBaseBlockInputStream.cpp 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514 fixed column size calculation for Array column in MergeTreeReader::readRows 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9 changed skipping rows for Array columns in MergeTreeBaseBlockInputStream 2017-07-28 22:29:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Vitaliy Lyudvichenko
515271544d Add detail comment. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0 Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Nikolai Kochetov
01a004050d fixed MergeTreeBlockSizePredictor updating from empy block while reading 2017-07-26 20:03:09 +03:00
Alexey Milovidov
4a4e863f9d Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Nikolai Kochetov
fcd50e3629 fixed comment 2017-07-24 18:06:32 +03:00
Nikolai Kochetov
b55dcc9f93 cnanged comments; fixed 00443_preferred_block_size_bytes test 2017-07-24 16:59:03 +03:00
Nikolai Kochetov
bc0921a64e added comments 2017-07-21 21:02:02 +03:00
Nikolai Kochetov
c64b65ee29 ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170] 2017-07-21 20:45:51 +03:00
Nikolai Kochetov
755d16b22d set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170] 2017-07-21 14:55:33 +03:00
Alexey Milovidov
c7b1e92522 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:40:05 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
alexey-milovidov
1a1112d8bb Update MergeTreeBlockReadUtils.h 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
0b7439469d fixed MergeTreeBlockSizePredictor initialization for sample block 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
00ae32c946 renamed approximate_number_of_rows_in_part to number_of_rows_in_part 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
e612152584 changed initialization in MergeTreeBlockSizePredictor 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
2afd84c40c fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 19:39:18 +03:00
Nikolai Kochetov
b5e94ede62 fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 16:44:46 +03:00
Alexey Milovidov
6e6e9f9d38 Removed useless variable [#CLICKHOUSE-3161]. 2017-07-19 04:05:39 +03:00
Nikolai Kochetov
7e293df9af merged with master 2017-07-17 22:48:22 +03:00
Nikolai Kochetov
eae94edd6b fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131] 2017-07-17 22:40:30 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Nikolai Kochetov
a13423e552 added vertical merge for ReplacingSortedBlockInputStream 2017-07-14 21:17:23 +03:00
Alexey Milovidov
1a0f5dd7cf Getting rid of ASTSet (incomplete) [#CLICKHOUSE-2] 2017-07-14 03:33:37 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
210f14aaba renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint 2017-07-13 21:54:17 +03:00
Nikolai Kochetov
f3f217b40a fixed tests 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
546012079c fixed reading with zero max block size setting 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
e2d032b883 fixed reading with zero max block size setting 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8ea812e669 better comment for MergeTreeRangeReader 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f232afd2f8 round number of rows to nearest mark in MergeTreeBaseBlockInputStream 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f1775af3f0 deleted commented code 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
30ed774bf7 refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
89386394aa refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8c65d6013e added preferred_max_column_in_block_size_bytes setting, added filtration ratio prediction [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
4470afc9a9 added estimateNumRowsMax to MergeTreeBlockSizePredictor based on max column size 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
6b29b3bd47 round number of rows to next mark in MergeTreeBaseBlockInputStream 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
d14f64af7b delected commented logging code 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
586dff9126 delay reading for granulas if prewhere column is false during partial granula reading 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
86680f5513 fixed partial granula reading for const columns in prewhere 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
609711b20c partial part reading with prewhere 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
c6d5ef6d30 added MergeTreeRangeReader 2017-07-13 21:45:09 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
de75fa000b Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
4b1eeee1a3 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Zatelepin
58d541b740 slightly more robust ReplicatedMergeTreePartCheckThread::TemporarilyStop [#CLICKHOUSE-3074] 2017-07-12 20:09:44 +03:00
Vitaliy Lyudvichenko
b843ea5b3f Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3] 2017-07-11 21:36:51 +03:00
Alexey Zatelepin
4a98d83a3b introduce replicated_can_become_leader merge_tree setting [#CLICKHOUSE-3109] 2017-07-11 20:44:35 +03:00
Alexey Milovidov
2bd84600d1 Miscellaneous [#CLICKHOUSE-2]. 2017-07-11 04:20:40 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master
Implement natively uuid type in Clickhouse
2017-07-10 07:00:45 +03:00
Alexey Zatelepin
89939a685a Stream row sources from disk for vertical merge [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Marek Vavruša
ff73394124 PKCondition: infer index use with pk subexpression
By default only constraints explicitly matching
primary key expression (or expression wrapped in
a monotonic function) are eligible for part and
range selection. So for example, if index is:

(toStartOfHour(dt), UserID)

Then a query such as this resorts to full scan:

SELECT count() FROM t WHERE dt = now()

Intuitively, only parts with toStartOfHour(now())
could be selected, but it is less trivial to prove.
The primary key currently can be wrapped in a chain
of monotonic functions, so following would work:

toStartOfHour(dt) = toStartOfHour(now()) AND dt = now()

It must be however explicitly stated, if we wanted
to infer that we’d have to know the inverse function,
and prove that the inverse function is monotonic
on given interval. This is not practical as
there is no inverse function that for example undos
rounding, it isn’t strictly monotonic.

There are however functions that don’t transform
output range and preserve monotonicity on the
complete input range, such as rounding or casts
to a same or wider numeric type. This eliminates
the need to find inverse function, as no check for monotonicity over arbitrary interval is needed,
and thus makes this optimisation possible.
2017-07-09 17:13:51 +03:00
Alexey Milovidov
032d12d431 Fixed translation error [#CLICKHOUSE-2]. 2017-07-04 15:46:31 +03:00
Guillaume Tassery
cba9815981 Change Uuid to UUID datatype and make UInt128 a generic type 2017-07-04 12:42:53 +02:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alexey Zatelepin
9de4d8facb allow loading missing setting from config [#CLICKHOUSE-3091] 2017-06-28 19:56:35 +03:00
Alexey Zatelepin
7cf413dea8 Revert "Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]."
This reverts commit 425156e32c.
2017-06-28 15:32:52 +03:00
Alexey Milovidov
a48a21f593 Merge branch 'master' into CLICKHOUSE-2896 2017-06-26 11:54:58 +03:00
Alexey Milovidov
8f145da1e8 Preparation [#CLICKHOUSE-2]. 2017-06-25 06:43:59 +03:00
Alexey Milovidov
275a1d4651 Improvement [#CLICKHOUSE-3091]. 2017-06-25 05:48:38 +03:00
Alexey Milovidov
90a1ae1062 Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-25 05:22:10 +03:00
Alexey Milovidov
8228acd3ea Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091]. 2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b Fixed translation errors [#CLICKHOUSE-3091]. 2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992 Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091]. 2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5 Removed unused variable [#CLICKHOUSE-2]. 2017-06-25 01:36:43 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
061c214c16 Fixed error [#CLICKHOUSE-3074]. 2017-06-23 09:57:55 +03:00
Alexey Milovidov
425156e32c Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]. 2017-06-22 21:29:40 +03:00
Alexey Milovidov
6eb06774d3 Addition to prev. revision [#CLICKHOUSE-3091]. 2017-06-22 19:29:15 +03:00
Alexey Milovidov
c96719685c Lowered max_delay_to_insert to one second, because higher values are non practical and could be harmful for usual failover logic in client apps [#CLICKHOUSE-3091]. 2017-06-22 19:17:01 +03:00
Vitaliy Lyudvichenko
eff3588f28 Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896] 2017-06-22 16:18:19 +03:00
Vitaliy Lyudvichenko
53adb891b3 Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896] 2017-06-22 00:56:38 +03:00
Alexey Milovidov
7bdc87adf0 Loosened threshold on broken parts in filesystem [#CLICKHOUSE-3076]. 2017-06-21 22:11:11 +03:00
Alexey Milovidov
5c322f5756 Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076]. 2017-06-21 22:07:08 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Vitaliy Lyudvichenko
63ac609e8b Avoid overestimation of avg. column element size. [#CLICKHOUSE-3058] 2017-06-15 20:33:03 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Vitaliy Lyudvichenko
49eab81d9a Fix: ReshardingWorker doesn't finish if ZooKeeper session expired. [#CLICKHOUSE-2] 2017-06-13 07:15:25 +03:00
Alexey Milovidov
43fedfecea Get rid of INSERT ID [#CLICKHOUSE-31]. 2017-06-13 07:13:20 +03:00
Alexey Milovidov
38885d00a3 Merge branch 'storage-startup-method' 2017-06-07 02:27:16 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
153693cd4c Non significant modifications [#CLICKHOUSE-3]. 2017-06-05 23:43:23 +03:00
Vitaliy Lyudvichenko
1e4906816c Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023] 2017-06-05 17:25:10 +03:00
Alexey Milovidov
ba499585cd Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6 Small refinements [#CLICKHOUSE-2]. 2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
3a2c1a195d Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
1a4b0eb355 Remove tmp part directories on server start. [#CLICKHOUSE-3044] 2017-05-31 18:01:25 +03:00
Alexey Milovidov
fa64d14f26 More readable temporary part names [#CLICKHOUSE-2]. 2017-05-26 03:47:06 +03:00
Alexey Milovidov
ed44304c49 Removed obsolete commented code [#CLICKHOUSE-2]. 2017-05-26 03:43:35 +03:00
alexey-milovidov
c79ebc586d Merge pull request #825 from yandex/CLICKHOUSE-2989
Separate dirs for different part sources, fix RC during replicated alters
2017-05-26 04:42:03 +04:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
alexey-milovidov
72822714c3 Merge branch 'master' into CLICKHOUSE-2989 2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9 Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Zatelepin
e9f8f99e06 Correct index comparisons in case constants cannot be precisely casted [#CLICKHOUSE-3002] 2017-05-25 05:34:26 +04:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko
d9637c2980 MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko
5618234ee8 Separate tmp part dirs for merges, fetches and inserts. [#CLICKHOUSE-2989] 2017-05-24 23:23:58 +03:00
Alexey Milovidov
0c416be381 More simple code; fixed translation error [#CLICKHOUSE-2]. 2017-05-23 04:09:47 +03:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
Alexey Milovidov
e0b141e3eb Do not remove temporary directory on fetch [#CLICKHOUSE-2894]. 2017-04-29 01:26:39 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
Alexey Milovidov
110defd56f Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960]. 2017-04-20 21:38:17 +03:00
Alexey Milovidov
ee6a7ee204 Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960]. 2017-04-20 21:37:01 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Milovidov
0b5645db1a Better code for parsing part names [#CLICKHOUSE-2]. 2017-04-18 23:38:07 +03:00
Alexey Milovidov
502f42a572 Fixed translation error [#CLICKHOUSE-3]. 2017-04-18 22:13:12 +03:00
Yuri Dyachenko
8fb2b7ee3d fix zookeeper format version 4 2017-04-17 21:15:14 +03:00
alexey-milovidov
9d3e3675fd Update ReplicatedMergeTreeLogEntry.h 2017-04-17 21:15:14 +03:00
alexey-milovidov
acd3c3d4ab Update MergeTreeDataMerger.cpp 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8792c4f3ca add 'deduplicate' flag into zookeeper 'merge' Entry 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4 support DEDUPLICATE option in OPTIMIZE query 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
5e61448f25 add support DEDUPLICATE to MergeTreeDataMerger 2017-04-17 21:15:14 +03:00
Alexey Zatelepin
2bd089d589 start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141] 2017-04-17 18:06:12 +03:00
f1yegor
0b243a8b01 translate comments 2017-04-16 23:17:32 +03:00
Alexey Milovidov
676192f16e Fixed errors on clang [#CLICKHOUSE-2902]. 2017-04-15 07:03:12 +03:00
alexey-milovidov
7fcf570c43 Update MergeTreeDataPart.cpp 2017-04-15 06:48:24 +03:00
alexey-milovidov
5a7a155ca1 Update MergeTreeBlockReadUtils.cpp 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
8b54e9fc65 Removed extra diagnostic log messages. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
848c927bb7 Fix race condition. Add test. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
56b00a110a Removed debug code and add docs. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
c78177a28a More accurate prediction. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
f519100946 Split base and derived class implementations. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
4b566304ca Tests are passed. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
82af2278fc Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2]
Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902]

Make enums test more deterministic. [#CLICKHOUSE-2]

Refactored MergeTree readers.

Tabs -> spaces.

Move include/DB/ -> src/.
2017-04-15 06:48:24 +03:00
Alexey Zatelepin
eb4f895ea5 fix integer overflow [#CLICKHOUSE-2927] 2017-04-12 19:10:06 +03:00
Alexey Zatelepin
0e6c38bd63 throw exception for invalid MergeTreeSettings config values [#CLICKHOUSE-2927] 2017-04-12 18:07:58 +03:00
Alexey Zatelepin
e1c9878c34 more descriptive exception message [#CLICKHOUSE-2927] 2017-04-12 18:07:58 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
proller
adba3b8e6d delete ReadBufferFromHTTP, use ReadWriteBufferFromHTTP instead 2017-04-06 22:39:25 +03:00
proller
1bc311eefd ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] (#656)
* ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878]

* fix

* better messages on client

* change code to 429 TOO_MANY_REQUESTS

* wip

* better message

* Update InterserverIOHandler.h

* Update InterserverIOHTTPHandler.cpp

* Update StorageReplicatedMergeTree.cpp
2017-04-06 16:03:23 +03:00
Vitaliy Lyudvichenko
74a92cb8d9 Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886] 2017-04-04 15:54:21 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
4f44445ff0 Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//' 2017-03-31 19:00:30 +03:00
Ravengg
a973e3898d Add remove for part log (#638)
* Add REMOVE_PART

* fix

* fix

* fix codestyle
2017-03-28 20:18:49 +03:00
Alexey Milovidov
e6a41a0256 Fixed error with NULLs [#CLICKHOUSE-2901]. 2017-03-24 07:42:36 +03:00
Alexey Milovidov
c21b4c52c5 Misc [#CLICKHOUSE-3]. 2017-03-21 21:39:07 +03:00
Ravengg
b47cc72701 Fix part log (#591)
* fix_part_log

* fixed language back

* add reset part_log back

* reset part_log when don't need more

* Fix header

* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
4e67e05835 Fixed error [#CLICKHOUSE-2]. 2017-03-14 03:14:19 +03:00
Alexey Milovidov
f9b4b2012f Removed zero-width spaces [#CLICKHOUSE-2]. 2017-03-13 21:02:45 +03:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
Alexey Milovidov
a6a18db6da Merge branch 'translate/comments' of https://github.com/f1yegor/ClickHouse into f1yegor-translate/comments 2017-03-13 20:51:22 +03:00
f1yegor
401425bb89 translate comments 2017-03-12 20:18:07 +01:00
Alexey Milovidov
65beb6f961 Added support for NULLS FIRST and LAST in ORDER BY (continued) [#CLICKHOUSE-2882]. 2017-03-12 16:03:07 +03:00
Alexey Milovidov
7532a1d564 Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882]. 2017-03-12 15:56:59 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
Ravengg
b079dacfd1 Added part_log with statistics scripts (#549)
* Added part_log

* first_test

* filter and hits_res

* Add renamer and drawer

* Add columns database and table into PartLog

* Add normal way to get table_name and database_name from part

* improve drawer

* add stats for random size parts

* Merge converter and drawer

* make drawer more informative

* add new data

* add new data

* new data

* add long range stats

* for checking best way

* Add add_parts script

* Good style for global merge

* delete commented code

* Fixed spaces to tabs

* Note that Stopwatch is started automatically.

* Style

* Update StorageMergeTree.cpp

* Update StorageReplicatedMergeTree.cpp

* Switch act_time_ms to duration_ms

* Added ability to disable part_log

* fixed getPartLog

* fix usage getPartLog

* fix
2017-03-07 21:13:54 +04:00
Alexey Zatelepin
7090d0861a reinitialize primary key after ALTER [#CLICKHOUSE-2853] 2017-02-21 21:32:04 +04:00
Vitaliy Lyudvichenko
8bcb1fe970 Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845] 2017-02-18 00:36:31 +04:00
Alexey Milovidov
354bed5bd7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-02-13 19:12:46 +03:00
Alexey Milovidov
db9935337c Misc [#CLICKHOUSE-2]. 2017-02-13 19:12:34 +03:00
Alexey Milovidov
bb7247993a Merge branch 'uncompressed-size-in-system-tables' 2017-02-13 01:08:31 +03:00
Alexey Milovidov
7bf5373390 Added comments [#CLICKHOUSE-2831]. 2017-02-13 01:07:38 +03:00
Alexey Milovidov
c9b4a163be Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831]. 2017-02-12 01:31:22 +04:00
alexey-milovidov
4593d363d1 Fix poor distributed insertion scalability (#481)
* Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791].

* Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791].

* Misc [#CLICKHOUSE-2791].

* Fixed error [#CLICKHOUSE-2791].
2017-02-12 00:20:57 +04:00
Alexey Milovidov
30737aa7a1 Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831]. 2017-02-11 20:43:28 +03:00
Alexey Zatelepin
9918965c5f Allow metadata-only ALTER of primary key columns [#CLICKHOUSE-2027] 2017-02-10 22:19:40 +04:00
Alexey Zatelepin
7b57402291 allow ALTERing Enum types in primary key columns [#CLICKHOUSE-2795] 2017-02-10 22:19:40 +04:00
Alexey Zatelepin
6b47ac1fc0 translate comments [#CLICKHOUSE-3] 2017-02-10 09:05:33 +04:00
Alexey Zatelepin
aace171ef6 forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803] 2017-02-10 09:05:33 +04:00
Alexey Zatelepin
8d001db5d5 forbid altering of date column in MergeTree engines 2017-02-10 09:05:33 +04:00
Alexey Milovidov
d95663865f Miscellaneous [#CLICKHOUSE-2]. 2017-02-09 02:56:40 +03:00
Alexey Zatelepin
4ecfd44015 [#CLICKHOUSE-2115] PR changes:
* do not insert produced value into the cache if the cache has been reset.
* less logging
* cosmetic fixes
2017-01-31 22:45:10 +04:00
Alexey Zatelepin
0fdcdd7bdb Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115] 2017-01-31 22:45:10 +04:00
Vitaliy Lyudvichenko
b1bccb0bb2 Query KILL QUERY. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
Alex Zatelepin
543b6ee757 ensure that all streams point to to_mark after reading even if max_rows_to_read is zero [#CLICKHOUSE-2775] (#396) 2017-01-25 23:16:31 +04:00
Alexey Zatelepin
281744667d use common cur_mark_idx for all streams [#CLICKHOUSE-2116] 2017-01-25 00:48:58 +04:00
Alexey Zatelepin
dc1f0d96bd add clarifying comment [#CLICKHOUSE-2116] 2017-01-25 00:48:58 +04:00
Alexey Zatelepin
f7ca39da77 translate comments [#CLICKHOUSE-3] 2017-01-25 00:48:58 +04:00
Alexey Zatelepin
32e5713822 do not load marks when reading the whole part [#CLICKHOUSE-2116] 2017-01-25 00:48:58 +04:00
Vitaliy Lyudvichenko
1c38a89785 Add source_part_names column into system.merges. [#CLICKHOUSE-2145] 2017-01-24 22:26:29 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
Alexey Milovidov
5c1ae060a4 Miscellaneous [#CLICKHOUSE-2761]. 2017-01-20 05:22:18 +03:00
Alexey Milovidov
ffed6b1d5e Added one more column to system.parts [#CLICKHOUSE-2757]. 2017-01-17 23:54:32 +03:00
Alexey Milovidov
e407bf879c system.parts: added a column for primary key size in bytes in RAM [#CLICKHOUSE-2757]. 2017-01-17 23:49:16 +03:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following:
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
2017-01-14 12:00:19 +03:00
artpaul
402f974fb7 fix where <const> in (<const>) expression; [#METR-24043] 2017-01-10 19:16:37 +05:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
f7fa5b73b9 Changed names of files with NULL-related data to be more consistent [#METR-19266]. 2017-01-04 07:15:38 +03:00
Alexey Milovidov
1f3aeb066a Renamed methods for bulk binary serialization (continued) [#METR-2944]. 2017-01-03 02:08:09 +03:00
Alexey Milovidov
701ca28c85 Renamed methods for bulk binary serialization [#METR-2944]. 2017-01-03 01:47:28 +03:00
Alexey Milovidov
3fbb597694 Addition to prev. revision [#METR-2944]. 2017-01-02 23:52:30 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930]
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e Added memory tracking events and columns for merges. [#METR-23911] 2016-12-31 02:39:53 +03:00
Alexey Milovidov
baf29f5c48 NULLs support: fixed totally wrong code [#METR-19266]. 2016-12-30 08:13:14 +03:00
Vitaliy Lyudvichenko
ba2b32b0ad Added vertical_merge_algorithm_min_columns_to_activate option. [#METR-23783] 2016-12-22 16:19:03 +03:00
Vitaliy Lyudvichenko
e2bd364844 Added whole block optimization. [#METR-23783] 2016-12-22 16:19:02 +03:00
Alexey Milovidov
536f88ea55 Adjusted coefficients [#METR-23916]. 2016-12-22 05:04:32 +03:00
Alexey Milovidov
7ebbf72ca6 Removed unused variable [#METR-23305]. 2016-12-22 04:27:41 +03:00
Alexey Milovidov
54587fec1b Tracking memory used in merges [#METR-23888]. 2016-12-20 05:29:35 +03:00
Vitaliy Lyudvichenko
e39b41e158 Typo and codestyle fix. 2016-12-18 22:38:30 +03:00
Vitaliy Lyudvichenko
5aa1822fb2 Consecutive optimization for vertical merge. [#METR-23783] 2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
8835275713 More detail log for merges. [#METR-23770] [#METR-23769] [#METR-23783] 2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
Alexey Milovidov
c1ecc41804 Fixed error after merge [#METR-19266]. 2016-12-12 10:25:31 +03:00
Alexey Milovidov
54af522de1 Preparation [#METR-2944]. 2016-12-12 10:24:56 +03:00
Alexey Milovidov
8a69df19c4 Fixed error after merge [#METR-19266]. 2016-12-12 09:00:37 +03:00
Alexey Milovidov
de82683197 Fixed build on clang [#METR-2944].[C 2016-12-12 08:56:34 +03:00
Alexey Milovidov
31c4636538 Using internal boost library [#METR-2944]. 2016-12-12 07:59:19 +03:00
Alexey Milovidov
d605bfdc9d Using internal boost library [#METR-2944]. 2016-12-12 07:57:09 +03:00
Alexey Milovidov
b3e85e6469 Addition to prev. revision [#METR-22442]. 2016-12-11 14:59:55 +03:00
Alexey Milovidov
436d2c43c9 Addition to prev. revision [#METR-22442]. 2016-12-11 14:47:09 +03:00
Alexey Milovidov
ce6556639e Fixed tests after merge [#METR-19266] [#METR-22442]. 2016-12-11 14:33:51 +03:00
Alexey Milovidov
c937d75a78 Merging [#METR-19266]. 2016-12-10 09:10:29 +03:00
Alexey Milovidov
e97ecb6cf7 Merge branch 'master' into METR-19266
Conflicts:
	dbms/CMakeLists.txt
	dbms/include/DB/Functions/FunctionsArray.h
	dbms/include/DB/Functions/FunctionsString.h
	dbms/include/DB/Parsers/ExpressionListParsers.h
	dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
	dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
	dbms/src/Core/ErrorCodes.cpp
	dbms/src/Parsers/ASTFunction.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/MergeTreeReader.cpp
	dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Vitaliy Lyudvichenko
ea11f61433 Added requested changes. [#METR-19372] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
855dc56598 Added treshold setting for Vertical merge algorithm. [#METR-23305] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
774eb01fd3 Added MergesTime metric. [#METR-23305] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
f8eb9028fd Refined query_log, processes and merges metrics.
Also, dbms/CMakeLists.txt was rewritten.
2016-12-09 13:11:25 +03:00
proller
76dc51aae5 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-12-07 22:08:09 +03:00
Alexey Milovidov
072f2fc7b8 Merges: start to lower maximum size of merge only when number of free entries in pool/queue is lower than specified threshold [#METR-21504]. 2016-12-06 06:09:07 +03:00
Alexey Milovidov
0717bfa4d2 Simplified LevelMergeSelector [#METR-21504]. 2016-12-06 00:34:46 +03:00
Alexey Milovidov
02eb36fd03 MergeSelector: attempt to make something better [#METR-21504]. 2016-12-05 09:31:48 +03:00
Vitaliy Lyudvichenko
202ba912ce Vertical merging algorithm for MergeTree engines. [#METR-23305] 2016-11-29 22:41:31 +03:00
proller
b529f29bb7 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-29 19:57:01 +03:00
Alexey Milovidov
0a2d1ebbb3 Attempt to improve merge selecting algorithm [#METR-23632]. 2016-11-28 06:46:08 +03:00
Alexey Milovidov
cac8f9216f MergeSelector: attempt to do something that has sense [#METR-23632]. 2016-11-28 06:17:31 +03:00
proller
4c90ffd61d Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-27 15:03:35 +03:00
Alexey Milovidov
6209092b15 Added heuristic for merge algorithm [#METR-23615]. 2016-11-26 07:08:49 +03:00
proller
26fe10a7b4 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-25 03:22:30 +03:00
Alexey Milovidov
8e5889cf0e Improved merge selecting algorithm for Replicated tables [#METR-23615]. 2016-11-25 01:41:27 +03:00
proller
3b335b5546 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 22:58:40 +03:00
alexey-milovidov
8c2e228856 Revert "New "vertical" algorithm for MergeTrees' parts merges" 2016-11-24 23:08:54 +04:00
proller
e855c16f4a Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 21:25:56 +03:00
alexey-milovidov
8544a8b852 Merge pull request #171 from ludv1x/METR-23305
New "vertical" algorithm for MergeTrees' parts merges
2016-11-24 22:07:41 +04:00
Vitaliy Lyudvichenko
544ef67c28 Fixed IN <Set> usage inside PK expressions.
Refactoring of type conversion functions convertFieldToType().
2016-11-24 15:32:04 +03:00
proller
8c07957e38 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 04:01:18 +03:00
Vitaliy Lyudvichenko
4f9064ca19 Fixed case when pk column is wrapped by functions. 2016-11-23 22:58:33 +03:00
Vitaliy Lyudvichenko
d27951b4a7 Added requested changes. [#METR-23473] 2016-11-23 16:33:05 +03:00
Vitaliy Lyudvichenko
e07fc7cea5 Fixed Enum usage in PK expressions. [#METR-23473]
Added check for duplicates of column names in CREATE query.
2016-11-23 16:19:15 +03:00
Vitaliy Lyudvichenko
ef593d1b01 Added merge_tree.enable_vertical_merge_algorithm setting. 2016-11-23 15:59:25 +03:00
Vitaliy Lyudvichenko
588add5a49 Added requested changes.
Also fixed single thread read from empty storage Log.
2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
2cd5b8b604 Updated MergeInfo and progress callbacks with respect to vertical merge alg. 2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
ec9bcd8054 Vertical merging algorithm for ordinary MergeTreee. 2016-11-23 15:47:19 +03:00
proller
4f39c04854 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-23 01:33:37 +03:00
proller
eeeacd0805 merge upstream 2016-11-23 01:33:02 +03:00
Alexey Milovidov
4cab31a60e Tiny improvement [#METR-2944]. 2016-11-22 23:55:45 +03:00
Alexey Milovidov
bba5dcbcfa Fixed deadlock [#METR-23557]. 2016-11-22 22:27:45 +03:00
Alexey Milovidov
94e344ee38 Part checks don't lock ALTERs [#METR-22214]. 2016-11-22 21:49:17 +03:00
Alexey Milovidov
886919a5c9 Removed excessive part checks [#METR-22214]. 2016-11-22 21:29:36 +03:00
proller
0b40a13ea7 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-22 14:56:57 +03:00
Alexey Milovidov
e2b8236cf4 Fixed error [#METR-2944]. 2016-11-20 16:17:51 +03:00
Alexey Milovidov
9018906e1a Better [#METR-2944]. 2016-11-20 15:43:20 +03:00
Alexey Milovidov
c38a9118b1 More tolerant to previous errors [#METR-22327]. 2016-11-20 12:17:30 +03:00
Alexey Milovidov
60c62055ba Added comment [#METR-22327]. 2016-11-20 12:13:06 +03:00
Alexey Milovidov
c8c86208aa Fixed error with ALTER of Enums in Nested fields [#METR-22442]. 2016-11-20 11:57:11 +03:00
proller
61e6ee9100 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-18 15:14:34 +03:00
Alexey Milovidov
ef85902daa Little better [#METR-22327]. 2016-11-18 06:15:49 +03:00
Alexey Milovidov
dfd7f54c1c Little improvement in case of too much parts [#METR-22327]. 2016-11-18 05:50:28 +03:00
Alexey Milovidov
a44e5193b0 Better backpressure for INSERT SELECT into MergeTree [#METR-22327]. 2016-11-18 05:05:25 +03:00
proller
881319c4ec Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-18 04:48:21 +03:00
Alexey Milovidov
cfcdb3f881 Added check [#METR-22327]. 2016-11-18 03:20:22 +03:00
Alexey Milovidov
0700f53665 Fixed error with 'intersects previous part' [#METR-22327]. 2016-11-18 03:19:35 +03:00
proller
278fbbb4da Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-17 00:02:25 +03:00
Alexey Milovidov
bee6183d35 Fixed error [#METR-2944]. 2016-11-16 08:05:14 +03:00
proller
8fec8e2ac4 simple get works 2016-11-16 02:55:45 +03:00
Alexey Milovidov
efa056fc77 Attempt to improve merge selecting algorithm [#METR-21840]. 2016-11-05 04:11:51 +03:00
Alexey Milovidov
8ba7a32410 Fixed error with BackgroundProcesssingPool [#METRIKASUPP-7484]. 2016-11-02 18:26:16 +03:00
Alexey Milovidov
22719b1114 MergeSelector: further [#METR-21840]. 2016-11-01 23:30:40 +03:00
Alexey Milovidov
aaec9d1db6 Attempt for improvement [#METR-21840]. 2016-11-01 22:20:24 +03:00
alexey-milovidov
d1f11af2c2 Merge pull request #151 from Civil/osx_compatibility
[WIP] Make it compilable on OS X
2016-11-01 21:09:48 +04:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
2016-11-01 17:59:21 +01:00
Alexey Milovidov
5d394a20a1 MergeSelector: changed logic of selection of parts for OPTIMIZE (more like it was before) [#METR-21841]. 2016-11-01 18:22:04 +03:00
Alexey Milovidov
a3a8b49e80 MergeSelector: development [#METR-21841]. 2016-11-01 14:26:36 +03:00
Alexey Milovidov
91dbf74ac0 MergeSelector: development [#METR-21841]. 2016-11-01 11:38:55 +03:00
Alexey Milovidov
933c8f3d68 MergeSelector: development [#METR-21841]. 2016-11-01 01:53:54 +03:00
Alexey Milovidov
573a84c89a MergeSelector: development [#METR-21841]. 2016-10-31 22:45:22 +03:00
Alexey Milovidov
49602c44a9 MergeSelector: development [#METR-21841]. 2016-10-31 22:32:08 +03:00
Alexey Milovidov
4fd7183049 MergeSelector: fixed error [#METR-21841]. 2016-10-31 22:11:09 +03:00
Alexey Milovidov
89328b498f MergeSelector: development [#METR-21841]. 2016-10-31 08:35:29 +03:00
Alexey Milovidov
bee00bfcfc MergeSelector: development [#METR-21841]. 2016-10-30 14:05:45 +03:00
Alexey Milovidov
a832a8cd71 MergeSelector: development [#METR-21840]. 2016-10-30 11:54:27 +03:00
Alexey Milovidov
4dec8babf1 MergeSelector: development [#METR-21840]. 2016-10-30 11:47:47 +03:00
Alexey Milovidov
bab6e9ea22 MergeSelector: development [#METR-21840]. 2016-10-30 11:32:05 +03:00
Alexey Milovidov
1b2bbcd359 MergeSelector: development [#METR-21840]. 2016-10-30 11:25:07 +03:00
Alexey Milovidov
ba48688f25 MergeSelector: development [#METR-21840]. 2016-10-30 11:15:55 +03:00
Alexey Milovidov
c5c63bdf5d MergeSelector: development [#METR-21840]. 2016-10-30 06:39:28 +03:00
Alexey Milovidov
3d48f9d34b MergeSelector: development [#METR-21840]. 2016-10-30 06:12:25 +03:00
Alexey Milovidov
b5156a115d Additions [#METR-21504]. 2016-10-28 02:28:35 +03:00
Alexey Milovidov
74c3b30622 dbms: Simplified logic of selecting merges [#METR-21841]. 2016-10-28 01:50:02 +03:00
Alexey Milovidov
15b369bd08 More instrumentation [#METR-23272]. 2016-10-24 16:47:15 +03:00
Alexey Milovidov
9a3deed1ea Added metric about leadership [#METR-23272]. 2016-10-24 15:46:54 +03:00
Alexey Milovidov
2dd43be6e6 Don't hold shared_ptr to zookeeper for long time, because it makes very difficult to remove ephemeral nodes in case of temporary communication errors and thus breaks leader election [#METR-23272]. 2016-10-24 15:34:08 +03:00
Alexey Milovidov
ea852bb9d8 Separate compilation of CurrentMetrics; Separated AsynchronousMetrics from CurrentMetrics; Comments [#METR-23237]. 2016-10-24 07:06:27 +03:00
Alexey Milovidov
9af5ce1e3b Separate compilation of ProfileEvents; comments [#METR-23237]. 2016-10-24 05:02:37 +03:00
Alexey Milovidov
4d9b3fd3ee Better [#METR-23198]. 2016-10-23 13:59:53 +03:00
Alexey Milovidov
afcd933237 Probably better [#METR-23198]. 2016-10-23 06:46:51 +03:00
Alexey Arno
a75cfb6df5 Merge branch 'master' into METR-19266 [#METR-19266] 2016-10-21 19:53:35 +03:00
Alexey Milovidov
15bf61c367 Fixed part of error [#METR-23198]. 2016-10-21 04:44:57 +03:00
Alexey Arno
3792a9f302 dbms: Server: fixes [#METR-19266] 2016-10-20 13:13:07 +03:00
Alexey Arno
6c40d9b51e dbms: Server: fixes [#METR-19266] 2016-10-19 21:18:02 +03:00
Yuri Dyachenko
297a1547c5 more usable settings for delayed insert. issue: #METR-22563 2016-10-19 20:58:27 +03:00
Alexey Arno
924402f33e dbms: Server: merged from master [#METR-19266] 2016-10-19 18:00:56 +03:00
Alexey Arno
b5ff08bce6 dbms: Server: semantic cleanup [#METR-19266] 2016-10-19 10:15:26 +03:00
alexey-milovidov
fad9272161 Merge pull request #137 from ludv1x/METR-22471
Fixed std::terminate on DROP of StorageReplicatedMergeTree
2016-10-14 23:28:39 +04:00
Vitaliy Lyudvichenko
3120b06c02 Small enhancement and typos fixes. 2016-10-14 21:00:55 +03:00
Vitaliy Lyudvichenko
669e2982a5 Made merge_selecting_thread creation & deletion atomic. [#METR-22471] 2016-10-14 14:47:11 +03:00
Vitaliy Lyudvichenko
aa863ea7bb Fixed std::terminate on DROP of StorageReplicatedMergeTree. [#METR-22471] 2016-10-14 13:17:05 +03:00
Alexey Milovidov
dce56bfeba Implemented TODO [#METR-23132]. 2016-10-14 05:51:03 +03:00
Alexey Milovidov
6b2755bf2a Non significant change [#METR-2944]. 2016-09-23 23:33:06 +03:00
Alexey Arno
bd73b2d165 dbms: Server: Adding nullable type support to functions manipulating arrays. [#METR-19266] 2016-09-15 15:14:25 +03:00
Alexey Milovidov
469eebe4f0 Investigation [#METR-2944]. 2016-09-04 20:12:07 +03:00
Alexey Arno
443613c153 dbms: Fixed bug in ALTER TABLE ... MODIFY COLUMN. [#METR-19622] 2016-09-02 18:43:43 +03:00
Alexey Milovidov
344e975a59 Temporarily improvement [#METR-22608]. 2016-09-02 03:58:18 +03:00
Alexey Arno
91b20fe7ad dbms: Disabled check because it is unreliable. A better solution is needed. [#METR-18510] 2016-09-01 17:40:02 +03:00
Alexey Arno
2b3a87b7c6 dbms: Catch missing parameter [#METR-18510] 2016-09-01 13:53:50 +03:00
Alexey Milovidov
0db84044e5 Better [#METR-22608]. 2016-09-01 05:26:45 +03:00
Alexey Arno
9528405fe4 dbms: Extended CAST to nullable types. Added ALTER TABLE ... MODIFY COLUMN ... for nullable types. A column with a nullable type can have a default value in CREATE TABLE. [#METR-19266] 2016-08-29 19:57:59 +03:00
Alexey Milovidov
867b73b6b0 Fixed error with cancelling merges on ALTERs [#METR-22524]. 2016-08-26 22:50:04 +03:00
Alexey Arno
cd0541134a dbms: post-testing fixes [#METR-19266] 2016-08-24 03:39:38 +03:00
Alexey Arno
2a5abb17be dbms: cleanup [#METR-19266] 2016-08-19 15:01:10 +03:00
Alexey Arno
7a4683140e dbms: cleanup [#METR-19266] 2016-08-19 12:08:48 +03:00
Alexey Arno
eb98892e61 dbms: cleanup [#METR-19266] 2016-08-18 20:08:05 +03:00
Alexey Arno
22dc2f96a1 dbms: cleanup [#METR-19266] 2016-08-18 19:11:20 +03:00
Alexey Arno
e513df2e5c dbms: reverted change (was bogus) [#METR-19266] 2016-08-15 20:26:06 +03:00
Alexey Milovidov
0cf32c8aed Renamed method [#METR-22400]. 2016-08-13 05:21:17 +03:00
Alexey Milovidov
d5ad347532 Fixed probable source of race conditions [#METR-22327]. 2016-08-12 08:20:06 +03:00
Alexey Arno
9896c8ce78 dbms: Merged from master [#METR-19266] 2016-08-11 17:15:27 +03:00
Alexey Arno
f5d9d0ebc9 Merge branch 'master' into METR-19266 [#METR-19266] 2016-08-10 22:13:15 +03:00
Alexey Arno
e2b6e10ec1 dbms: Various fixes + more comments [#METR-19266] 2016-08-10 22:12:29 +03:00
Alexey Milovidov
f129e94429 Fixed warnings on clang [#METR-2944]. 2016-08-07 19:17:57 +03:00
Alexey Arno
531ff3d5ac dbms: Merged with master [#METR-19266] 2016-08-05 18:44:19 +03:00
Alexey Milovidov
d7ce4dd410 Better grepability [#METR-22173]. 2016-08-03 23:25:09 +03:00
Alexey Milovidov
6cf89fa915 Attempt to not interrupt merges when ZK session is reinitialized [#METR-22283]. 2016-08-02 21:33:55 +03:00
Alexey Milovidov
9a07830dbb Removed useless code (experimental) [#METR-2944]. 2016-08-02 04:46:05 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Arno
1fe6786b78 dbms: NULL support for MergeTree [#METR-19266] 2016-07-24 22:32:21 +03:00
Alexey Milovidov
130ec8b58b Compatibility with new parser and AST of tables list [#METR-2944]. 2016-07-22 23:39:28 +03:00
Alexey Arno
beeeb0ab13 dbms: NULL support for MergeTree [#METR-19266] 2016-07-21 19:22:24 +03:00
Alexey Arno
252d7994e7 dbms: cleanup [#METR-19266] 2016-07-19 13:57:57 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Milovidov
5ded454986 Added 'WITH NAME' section to ALTER TABLE ... FREEZE PARTITION query [#METR-21884]. 2016-06-28 23:50:37 +03:00
Alexey Milovidov
b8ca97a891 Added check for constants in primary key [#METR-2944]. 2016-06-21 20:06:12 +03:00
Alexey Milovidov
e8ffd48e49 Loosen safety threshold on amount of ALTER changes [#METR-21615]. 2016-06-06 22:50:30 +03:00
Alexey Milovidov
168ca22435 Fixed error when too long merges cannot be successful [#METR-21616]. 2016-06-06 22:16:34 +03:00
Alexey Milovidov
a4a543f1c3 Merge branch 'master' of github.com:yandex/ClickHouse 2016-05-30 21:24:35 +03:00
Alexey Milovidov
d03d19ab57 Updated comment [#METR-2944]. 2016-05-30 21:24:19 +03:00
Alexey Milovidov
7651dcbc0a Fixed error after moving to non-recursive mutex [#METR-21503]. 2016-05-30 04:16:22 +03:00
Alexey Milovidov
c518abe882 Get rid of Poco::SharedPtr [#METR-21503]. 2016-05-28 20:31:50 +03:00
Alexey Milovidov
8c4abcdd43 Using std::shared_ptr for functions and AST [#METR-21503]. 2016-05-28 18:42:22 +03:00
Alexey Milovidov
3c1c9d46f7 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 15:22:22 +03:00
Alexey Milovidov
4c7eb03b63 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:35:44 +03:00
Alexey Milovidov
6863e72f3d Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:15:36 +03:00
Alexey Milovidov
be394f2c84 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 10:48:40 +03:00
Alexey Milovidov
4b7f461e46 Using std::shared_ptr for columns [#METR-21503]. 2016-05-28 08:31:36 +03:00
Alexey Milovidov
f2ccbc9802 Better exception message [#METR-21479]. 2016-05-26 00:35:57 +03:00
Vladimir Chebotarev
866c8929e2 dbms, contrib: GCC 6 build fixes [#METR-20000] 2016-05-23 03:41:26 +03:00
Alexey Milovidov
c4407306d5 Always materialize columns while merge [#METR-21119]. 2016-05-18 05:49:52 +03:00
Alexey Milovidov
8f50b30268 Alter primary key: development [#METR-21119]. 2016-05-18 00:07:10 +03:00
Alexey Milovidov
9a60b90941 Alter primary key: development [#METR-21119]. 2016-05-17 23:11:43 +03:00
Alexey Milovidov
bf265e264a Alter primary key: development [#METR-21119]. 2016-05-17 02:04:03 +03:00
Alexey Milovidov
2f1fead382 Merge 2016-05-16 21:47:34 +03:00
Alexey Milovidov
093f69c45d Added support for FINAL and PARTITION specification for OPTIMIZE query [#METR-21326]. 2016-05-16 21:43:38 +03:00
Alexey Milovidov
6942819013 Altering primary key [#METR-21119]. 2016-05-14 00:08:19 +03:00
Alexey Milovidov
e37ffe7c3d Tiny modification [#METR-2944]. 2016-05-13 06:23:23 +03:00
Alexey Milovidov
65de71b5a2 Added table function 'shardByHash' [#METR-21287]. 2016-05-13 06:22:16 +03:00
Alexey Milovidov
83df6fdf23 Merge 2016-05-04 22:01:26 +03:00
Alexey Milovidov
07f04d70d3 Merge 2016-04-24 12:44:47 +03:00
Alexey Milovidov
55b580f882 More profile events [#METR-2944]. 2016-04-23 05:39:40 +03:00
Alexey Arno
3d9dc30e8c dbms: Added more fault tolerance [#METR-18510] 2016-04-21 17:58:25 +03:00
Alexey Milovidov
cff1004f04 Lowered batch size in pullLogsToQueue [#METR-21013]. 2016-04-21 00:24:12 +03:00
Alexey Milovidov
c6722da2b2 Merge 2016-04-19 00:38:06 +03:00
Alexey Milovidov
c43b34d3f0 Added function 'indexHint' [#METR-20940]. 2016-04-16 02:10:29 +03:00
Alexey Milovidov
a5d7c41253 Addition [#METR-20644]. 2016-04-15 23:11:03 +03:00
Alexey Milovidov
9f3d9277af Addition to prev. revision [#METR-20644]. 2016-04-15 22:55:07 +03:00
Alexey Milovidov
d6ba48a610 Merge 2016-04-15 22:37:19 +03:00
Alexey Milovidov
2bb5a4749b Merge 2016-04-15 22:09:42 +03:00
Alexey Milovidov
3923c7abce Merge 2016-04-15 20:42:51 +03:00
Alexey Milovidov
d79174b2ce Preparation [#METR-20644]. 2016-04-15 20:13:51 +03:00
Alexey Arno
68f427398d dbms: server: Retry after a timeout issue. [#METR-20825] 2016-04-15 01:00:39 +03:00
Alexey Arno
b884690fbf dbms: server: Bug fix: avoid empty log entries. Also added missing logging. [#METR-20825] 2016-04-14 23:52:16 +03:00
Alexey Arno
1ed2615f7c dbms: Fixed minor issue with logging [#METR-20825] 2016-04-14 19:25:09 +03:00
Alexey Arno
35e16aed04 dbms: Bug fix: under certain circumstances, ClickHouse would fail to attach a partition whose name coincides with the name of another partition that was previously dropped [#METR-20825] 2016-04-14 19:21:17 +03:00
Alexey Milovidov
b1ee71c026 Fixed build [#METR-2944]. 2016-04-13 23:46:11 +03:00
Alexey Milovidov
8b9cf82c6c More checking [#METR-12588]. 2016-04-13 07:48:41 +03:00
Alexey Milovidov
edc561d6b5 Fixed error [#METR-20803]. 2016-04-10 03:28:44 +03:00
Alexey Milovidov
11df87ea54 Merge 2016-04-09 07:22:11 +03:00
Alexey Milovidov
d0365e9501 Separated code for checking parts [#METR-20803]. 2016-04-09 06:50:02 +03:00
Alexey Milovidov
86e19f1e87 Merge 2016-04-08 00:35:42 +03:00
Alexey Milovidov
f0844ecb66 Attempt to fix an error [#METR-20803]. 2016-04-08 00:35:01 +03:00
Alexey Arno
2a23271645 dbms: fixed typo that led to a bug [#METR-18510] 2016-04-06 18:08:28 +03:00
Alexey Milovidov
b0e9fd6da3 Improved exception message [#METR-20762]. 2016-04-06 03:31:22 +03:00
Alexey Milovidov
3973277936 Allowed to modify 'max_files_to_modify_in_alter_columns' [#METR-20763]. 2016-04-05 21:18:16 +03:00
Alexey Milovidov
eb5d905600 Added support for using index for LIKE expressions with fixed prefix [#METR-20706]. 2016-04-03 00:19:58 +03:00
Alexey Milovidov
60252fed27 Removed old code as promised [#METR-2944]. 2016-04-01 19:47:25 +03:00
Alexey Milovidov
f41bba57a5 Better [#METR-20691]. 2016-04-01 02:49:31 +03:00
Alexey Milovidov
4f597ed7c3 Fixed error [#METR-20679]. 2016-03-31 20:42:57 +03:00
Alexey Milovidov
e1a80f5ded Added support for case when merged data differs from data on another replicas [#METR-20670]. 2016-03-31 04:25:16 +03:00
Alexey Milovidov
2501af25e8 Cancelling checking parts on shutdown [#METR-20660]. 2016-03-31 03:09:12 +03:00
Alexey Milovidov
5c400d5c5c Better [#METR-20659]. 2016-03-30 02:03:15 +03:00
Alexey Milovidov
04875a022a Removed code for freezing partitions due to unacceptable implementation [#METR-20656]. 2016-03-29 22:39:44 +03:00
Alexey Arno
21ff6d9f94 dbms: Comment updates. Naming simplfications. Use better hashing. [#METR-18510] 2016-03-29 19:29:39 +03:00
Alexey Arno
09985be3ba dbms: Added more comments. Made some code more understandable. [#METR-18510] 2016-03-28 16:00:00 +03:00
Alexey Milovidov
605e9c4afb Addition to prev. revision [#METR-20607]. 2016-03-27 17:36:59 +03:00
Alexey Milovidov
702876f9f0 Fixed suboptimal index usage in point queries [#METR-20607]. 2016-03-27 14:37:25 +03:00
Alexey Arno
776a0e3041 dbms: Improved fault tolerance with regards to ZooKeeper. [#METR-18510] 2016-03-25 15:21:10 +03:00
Alexey Arno
32a38485e6 Merge 2016-03-25 14:48:45 +03:00
Alexey Arno
50bdb806b9 dbms: Code cleanup. [#METR-18510] 2016-03-09 16:59:34 +03:00
Alexey Arno
75f31de790 dbms: Code cleanup. [#METR-18510] 2016-03-09 16:40:47 +03:00
Alexey Arno
79d5c899b0 dbms: Fault tolerance improvement. Fixed a race condition. Some cleanup. [#METR-18510] 2016-03-09 15:03:39 +03:00
Evgeniy Gatov
6aa4d59400 Merge 2016-03-08 20:52:42 +03:00
Alexey Arno
e9718711d0 dbms: Code cleanup. [#METR-18510] 2016-03-08 18:38:06 +03:00
Alexey Arno
0f35ecc357 dbms: Code cleanup. [#METR-18510] 2016-03-08 16:46:00 +03:00
Alexey Milovidov
0194495b99 Fixed build [#METR-2807]. 2016-03-07 11:10:52 +03:00
Alexey Milovidov
85863529cf Fixing warnings on clang [#METR-2807]. 2016-03-07 10:47:41 +03:00
Alexey Milovidov
0536f42f8c Fixing build on clang [#METR-2807]. 2016-03-07 09:49:07 +03:00
Alexey Milovidov
fcbe00ce94 Fixing warnings on clang [#METR-2807]. 2016-03-07 07:53:17 +03:00
Alexey Milovidov
a75b6ca3dd Fixing warnings on clang [#METR-2807]. 2016-03-07 07:43:14 +03:00
Alexey Milovidov
ebf5b3afdd Merge 2016-03-07 05:21:16 +03:00
Alexey Arno
a1fd25865b dbms: Code cleanup. [#METR-18510] 2016-03-05 13:33:01 +03:00
Alexey Milovidov
f5247021b1 Fixed error [#METR-20296]. 2016-03-05 06:17:11 +03:00
Alexey Milovidov
36e4bcc125 Better diagnostics [#METR-19808]. 2016-03-05 05:30:20 +03:00
Alexey Arno
f5c520bde1 dbms: Improved locking. [#METR-18510] 2016-03-04 19:33:31 +03:00
Alexey Arno
860bfcf676 dbms: Code cleanup. [#METR-18510] 2016-03-04 13:04:01 +03:00
Alexey Arno
b44f3f4f5d dbms: Code cleanup. [#METR-18510] 2016-03-04 13:00:00 +03:00
Alexey Milovidov
42883fddc4 Added virtual column '_sample_factor' [#METR-20296]. 2016-03-04 07:54:10 +03:00
Alexey Milovidov
a8f423a74c Merge 2016-03-03 23:29:52 +03:00
Alexey Arno
3b9ea20c91 dbms: More locking improvements. [#METR-18510] 2016-03-03 19:20:19 +03:00
Alexey Arno
d21060c35b dbms: Locking performance and correctness improvements. [#METR-18510] 2016-03-03 17:37:15 +03:00
Alexey Arno
9efcf9d204 dbms: Code cleanup. [#METR-18510] 2016-03-03 11:40:21 +03:00
Alexey Arno
da03a011b2 dbms: Modified function implementation to make it cleaner. [#METR-18510] 2016-03-03 10:39:02 +03:00
Alexey Milovidov
e29eb14b79 dbms: attempt to fix an error [#METR-20273]. 2016-03-03 07:30:36 +03:00
Alexey Milovidov
0119de05bb DataPartsExchange: better [#METR-20273]. 2016-03-03 06:54:37 +03:00
Alexey Arno
aa10c8c87d dbms: Code cleanup. [#METR-18510] 2016-03-02 23:27:29 +03:00
Alexey Arno
514cf0fcba dbms: Code cleanup. [#METR-18510] 2016-03-02 17:12:04 +03:00
Alexey Arno
6232e1cf9a dbms: Added stricter checkings for coordinated requests originating from shards and a more reliable cluster naming scheme. [#METR-18510] 2016-03-02 16:35:30 +03:00
Alexey Arno
fc2c3c1f2e dbms: Server: Reverted old modification that found its way into master by error. It could have lead to deadlocks. [#METR-18510] 2016-03-01 22:16:27 +03:00
Alexey Arno
6efc98d1f3 Merge 2016-03-01 20:47:53 +03:00
Alexey Milovidov
56b316bff7 Fixed error when symlinked part couldn't be removed [#METR-20080]. 2016-02-19 23:13:54 +03:00
Alexey Milovidov
7af87e367f Better diagnostics [#METR-20079]. 2016-02-18 00:02:06 +03:00
Alexey Milovidov
8b3afeb60d Squashed commit of the following:
commit f968e7e7f0d84c89fd26dea1d541bd9f6041d7c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Feb 16 06:11:29 2016 +0300

    Addition [#METR-2944].

commit 7524981fa7c4f22929dd5009444a0ae28500f620
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Feb 16 06:08:43 2016 +0300

    Fixed error (incomplete) [#METR-2944].

commit 2f1e7bf9f46cd9ce958ade9041c00ce067940fd2
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Feb 16 05:37:43 2016 +0300

    Improving performance of row formats [#METR-2944].

commit 9848910f235863c9571ef1ebe0d87d4929ee283c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Feb 16 00:37:12 2016 +0300

    Improving performance of text formats [#METR-2944].

commit 3aedc7fd784af962e64ffdd10ec23ac53827d8e2
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Tue Feb 16 00:18:00 2016 +0300

    Improving performance of row formats [#METR-2944].

commit cb5932c2b0385604477e69c8262dc31a4bb4b23b
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Mon Feb 15 00:53:27 2016 +0300

    Fixed error.

commit 42863fd4eddeef594e846c598b92877b6ff86fa6
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sun Feb 14 23:13:46 2016 +0300

    Improving performance of row formats [#METR-2944].

commit 71c6fb19a85a79297433ceb486fdb97e551d964f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sun Feb 14 16:58:56 2016 +0300

    Improving performance of row formats [#METR-2944].
2016-02-16 19:39:39 +03:00
Alexey Milovidov
bb122a2fa7 dbms: less locking while clearing old parts; better while loading parts [#METR-2944]. 2016-02-14 14:02:47 +03:00
Alexey Milovidov
5a78d4b0da Lowered size of index in memory (experimental) [#METR-2944]. 2016-02-14 08:43:03 +03:00
Alexey Milovidov
7a92c3cf1a Preparation [#METR-2944]. 2016-02-14 07:58:47 +03:00
Alexey Milovidov
43c73cf7ee dbms: added support for CSV format [#METR-19957]. 2016-02-07 11:42:21 +03:00
Alexey Milovidov
563e410b72 Moved threadpool library to contrib [#METR-17973]. 2016-02-05 08:07:39 +03:00
Alexey Milovidov
3519c3cea2 dbms: separated mysqlxx::Date and mysqlxx::DateTime [#METR-17973]. 2016-02-03 04:17:58 +03:00
Alexey Milovidov
48a1fe182d dbms: attempt to fix an error [#METR-19866]. 2016-02-03 00:30:27 +03:00
Alexey Milovidov
a0e7a59ab1 dbms: fixing errors with ATTACHes [#METR-19399]. 2016-01-30 05:29:20 +03:00
Alexey Milovidov
f0a009bd70 dbms: attempt to fix an error [#METR-19399]. 2016-01-30 03:57:35 +03:00
Alexey Milovidov
061306d04b Merge 2016-01-29 05:24:50 +03:00
Alexey Milovidov
d5163b5060 Removed few old files [#METR-18510]. 2016-01-29 05:22:43 +03:00
Alexey Arno
113b592380 Merge 2016-01-28 19:06:57 +03:00
Alexey Milovidov
e5d4149ca4 Merge 2016-01-28 04:00:42 +03:00
Alexey Milovidov
67a07205b7 Merge 2016-01-28 04:00:27 +03:00
Alexey Milovidov
5c90d7d45c Merge 2016-01-26 05:00:25 +03:00
Alexey Milovidov
085dd9f90a Merge 2016-01-26 04:56:42 +03:00
Alexey Arno
ae2f7c7613 Merge 2016-01-26 03:30:18 +03:00
Alexey Milovidov
6d50fb4b44 dbms: fixed quorum inserts; improved performance of ordinary inserts [#METR-16779]. 2016-01-24 08:00:24 +03:00
Alexey Milovidov
409954428b dbms: using numeric constants while evaluating PKCondition [#METR-19758]. 2016-01-23 00:28:58 +03:00
Alexey Milovidov
e720a53cf2 dbms: return early on WHERE 0 [#METR-19758]. 2016-01-22 23:43:16 +03:00
Alexey Milovidov
a08281d2eb dbms: fixed error when replica has too large delay [#METR-19586]. 2016-01-21 22:43:00 +03:00
Alexey Arno
a3ea32b985 Merge 2016-01-21 19:30:05 +03:00
Alexey Milovidov
0f3e163c4e dbms: CurrentMetrics: development [#METR-19596]. 2016-01-21 04:47:28 +03:00
Alexey Milovidov
3f89d9e0f5 dbms: added profile event for yielding leadership [#METR-17573]. 2016-01-20 23:43:42 +03:00
Alexey Milovidov
82a96d22b1 dbms: tracking replicas delays [#METR-17573]. 2016-01-17 16:00:42 +03:00
Alexey Milovidov
d603d0a12d Merge 2016-01-17 11:12:48 +03:00
Alexey Milovidov
a30532594b dbms: fixed error [#METR-19586]. 2016-01-17 08:22:22 +03:00
Alexey Milovidov
d8e6b1dcf1 dbms: fixed error in prev. revision [#METR-19586]. 2016-01-13 05:36:11 +03:00
Alexey Milovidov
ab1b725779 dbms: less dependencies [#METR-2944]. 2016-01-13 03:32:59 +03:00
Alexey Milovidov
949ecc2070 dbms: optimized function pullLogsToQueue [#METR-19586]. 2016-01-12 22:45:51 +03:00
Alexey Milovidov
13c7d0983a dbms: cutting dependency [#METR-2944].. 2016-01-12 00:46:36 +03:00
Alexey Milovidov
1f7f7cd682 dbms: better [#METR-19586]. 2016-01-10 07:44:12 +03:00
Alexey Milovidov
a5b8166541 dbms: better [#METR-19586]. 2016-01-10 07:43:30 +03:00
Andrey Mironov
325107ad5a dbms: FunctionCast for Enums: allow changing names but not values for existing elements [#METR-19265] 2015-12-29 15:57:22 +03:00
Andrey Mironov
40e6f51370 dbms: allow cheap alter of Enums [#METR-19265] 2015-12-28 20:06:15 +03:00
Alexey Milovidov
0cf09f76f8 dbms: better [#METR-2944].. 2015-12-28 17:24:31 +03:00
Alexey Milovidov
43350f51bb dbms: don't thrash mark_cache on merges (and ALTER MODIFY TYPE) [#METR-19575]. 2015-12-26 03:59:09 +03:00
Andrey Mironov
13f56d4465 dbms: use CAST internally whenever a conversion is required [#METR-19265] 2015-12-25 15:06:16 +03:00
Alexey Milovidov
f1f3619df4 dbms: cancelling fetching of parts on table shutdown [#METR-19544]. 2015-12-25 00:28:18 +03:00
Alexey Milovidov
89c64fe863 dbms: removed unused field [#METR-2944]. 2015-12-24 21:35:01 +03:00
Alexey Milovidov
2aeb48be2d dbms: added backoff on slow reads [#METR-17579]. 2015-12-13 07:52:13 +03:00
Alexey Milovidov
6260ac34a3 dbms: fixed high CPU usage on shutdown [#METR-19056]. 2015-12-09 08:05:42 +03:00
Alexey Milovidov
78b560c846 dbms: fixed error [#METR-19283]. 2015-12-07 22:30:50 +03:00
Alexey Milovidov
39004c76f5 dbms: addition [#METR-19052]. 2015-11-29 15:54:58 +03:00
Alexey Milovidov
b6aaf1fe32 dbms: development; provided monotonicity properties for date-time functions [#METR-19052]. 2015-11-29 14:58:44 +03:00
Alexey Milovidov
d9bc972a59 dbms: allowed to use index if column is wrapped by piecewise-monotonic functions: initial implementation [#METR-19052]. 2015-11-29 11:06:29 +03:00
Alexey Milovidov
8314861690 dbms: improved performance of INSERT SELECT [#METR-19025]. 2015-11-21 18:47:32 +03:00
Alexey Milovidov
0713e4c592 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 06:08:12 +03:00
Alexey Milovidov
5e2499eb77 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 05:42:26 +03:00
Alexey Milovidov
4318712300 dbms: addition to prev. revision [#METR-18847]. 2015-11-20 05:29:16 +03:00
Alexey Milovidov
2d00e5d84f dbms: SAMPLE ... OFFSET development: using rational numbers [#METR-18847]. 2015-11-20 00:34:53 +03:00
Alexey Milovidov
1b08920e50 dbms: SAMPLE OFFSET: development [#METR-18847]. 2015-11-19 06:24:59 +03:00
Alexey Milovidov
09dd253636 dbms: added support for SAMPLE ... OFFSET [#METR-18847]. 2015-11-19 00:37:28 +03:00
Alexey Milovidov
f8e58463a6 dbms: addition to prev. revision [#METR-17573]. 2015-11-10 00:07:22 +03:00
Alexey Milovidov
e78ed9f802 dbms: replication delays: development [#METR-17573]. 2015-11-09 23:30:54 +03:00
Alexey Milovidov
d7831a6317 dbms: fixed error [#METR-17573]. 2015-11-06 21:45:48 +03:00
Alexey Milovidov
4a35d9169f dbms: merges don't block ALTERs [#METR-18690]. 2015-11-06 20:34:48 +03:00
Alexey Milovidov
e29df2814c dbms: checking replication delays [#METR-17573]. 2015-11-05 22:44:19 +03:00
Alexey Milovidov
11447a4e1a dbms: accurate checking of replication delays (incomplete) [#METR-17573]. 2015-11-05 20:38:24 +03:00
Alexey Milovidov
400588148c dbms: fixed error in PKCondition [#METR-18585]. 2015-10-29 00:00:44 +03:00
Andrey Mironov
d2188a1183 dbms: alter: allow altering between any default types. [#METR-18221]
add commentary about altering to FixedString(N) columns with existing files
2015-10-21 17:54:13 +03:00
Alexey Milovidov
bb283e6602 dbms: added support for different numeric types in function has [#METR-18382]. 2015-10-12 10:05:54 +03:00
Alexey Milovidov
0a7b4dd536 dbms: fixed little error [#METR-16457]. 2015-10-08 23:01:09 +03:00
Alexey Milovidov
4e75ccee03 Probably better [#METR-17973]. 2015-10-05 08:40:27 +03:00
Alexey Milovidov
918422ad48 Moved files [#METR-17973]. 2015-10-05 04:35:28 +03:00
Alexey Milovidov
f90c3003ea Moved files [#METR-17973]. 2015-10-05 04:11:12 +03:00
Alexey Milovidov
733324645f dbms: aggregation by arrays: preparation [#METR-13168]. 2015-10-04 06:17:36 +03:00
Alexey Milovidov
b8c8662457 dbms: preparation [#METR-18167]. 2015-10-02 21:33:46 +03:00
Alexey Milovidov
1f6def094f dbms: fixed build [#METR-18202]. 2015-09-29 22:19:54 +03:00
Alexey Milovidov
003cc854fd dbms: changed 'at most' to 'at least' for rows to read when specifying absolute SAMPLE size [#METRIKASUPP-5748]. 2015-09-28 22:10:07 +03:00
Alexey Milovidov
e96705ed44 dbms: fixed error [#METR-16779]. 2015-09-27 16:45:20 +03:00
Alexey Milovidov
88f8d02ae7 dbms: fixed error [#METR-16779]. 2015-09-27 16:35:14 +03:00
Alexey Milovidov
9a4a46af9b dbms: fixed error [#METR-16779]. 2015-09-27 16:03:41 +03:00
Alexey Milovidov
1a2f063fc8 dbms: addition to prev. revision [#METR-16779]. 2015-09-27 15:52:58 +03:00
Alexey Milovidov
87e1e69ff6 dbms: allowed to write block again after failed quorum write [#METR-16779]. 2015-09-27 13:45:49 +03:00
Andrey Mironov
07a3ea8eb1 Merge 2015-09-25 16:39:13 +03:00
Andrey Mironov
efc1f35c21 dbms: fix reverse order of ranges for FINAL with merge_tree_uniform_read_distribution = 1 [#METR-16457] 2015-09-25 14:35:58 +03:00
Alexey Milovidov
1a16709162 dbms: fixed error [#METR-18170]. 2015-09-25 10:51:00 +03:00
Alexey Milovidov
c757bf9063 dbms: setting thread names [#METR-2944]. 2015-09-24 21:54:21 +03:00