Alexey Milovidov
0a4b349f73
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664
ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2]
2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
...
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
0d8d99e7a4
Fixed typo [#CLICKHOUSE-2]
2018-04-06 22:48:54 +03:00
Alexey Zatelepin
3a8ca70d1f
fix races in leader election [#CLICKHOUSE-3533]
2018-04-06 19:10:23 +03:00
Silviu Caragea
f811da7ed4
Move merge selection state into ReplicatedMergeTreeMergeSelectingThread
2018-04-02 15:45:55 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite
2018-04-01 17:31:20 +03:00
Silviu Caragea
1418e339e4
Rename merge_selecting_handle with merge_selecting_task_handle for consistency
2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6
)
2018-03-26 23:12:17 +03:00
Silviu Caragea
50992843c6
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle)
2018-03-26 22:59:58 +03:00
Silviu Caragea
31874ed172
Use consistent names for the task variables
2018-03-26 22:37:47 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Vitaliy Lyudvichenko
883de7a2a6
startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038
Add minimalistic checksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00
Silviu Caragea
6629b03af9
Fixed few of the observation of the code review
2018-03-22 17:09:30 +02:00
Silviu Caragea
b24a4b2111
Add back the buggy BackgroundSchedulePool
2018-03-22 17:07:12 +02:00
Alexey Milovidov
3c16faaff0
Merge branch 'master' of github.com:yandex/ClickHouse
2018-03-14 21:57:15 +03:00
Alexey Milovidov
57279a87c7
Whitespaces [#CLICKHOUSE-2].
2018-03-14 19:40:08 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration
2018-03-14 05:35:50 +03:00
alexey-milovidov
04cc8a52f7
Merge pull request #2032 from yandex/system-table-macro
...
System table macro
2018-03-14 02:10:30 +03:00
Alexey Zatelepin
5906c9a988
rename for clarity
2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac
encapsulate ColumnsDeclaration [#CLICKHOUSE-3241]
2018-03-13 17:41:25 +03:00
Alexey Milovidov
b7475b1d2c
Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641]
2018-03-12 23:25:18 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Nikolai Kochetov
4dd7f47ad5
reload macros with config [#CLICKHOUSE-3591]
2018-03-12 21:16:51 +03:00
Alexey Milovidov
afbbd780e3
Fixed error with initialization of PartLog [#CLICKHOUSE-3354]
2018-03-10 22:57:13 +03:00
Alexey Milovidov
3f8ef38b41
Fixed wording #245
2018-03-10 02:23:15 +03:00
proller
d73fea5ab0
Fix macos compile ( #2006 )
...
* Fix macos compile
* rename cluster-copier -> copier
2018-03-07 21:17:17 +03:00
Alexey Milovidov
8c37547bfe
Fixed harmless data race [#CLICKHOUSE-2]
2018-03-03 18:35:24 +03:00
Alexey Milovidov
6e93635275
Better UNION ALL: development #1947
2018-02-25 09:35:24 +03:00
alexey-milovidov
82fa3883f8
Merge pull request #1930 from yandex/nonblocking-precommitted
...
Allow PreCommitted parts to contain each other
2018-02-22 23:35:16 +03:00
alexey-milovidov
ee41f7000f
Merge pull request #1940 from yandex/CLICKHOUSE-3571
...
Try to reduce false positive of sanity check
2018-02-22 01:59:33 +03:00
Vitaliy Lyudvichenko
47becc0b92
Try to reduce false positive of sanity check. More detail dignostics. [#CLICKHOUSE-3571]
2018-02-21 20:06:29 +03:00
Alexey Zatelepin
5bc6bd55b1
allow PreCommitted parts to contain each other, clean up code
2018-02-20 16:33:28 +03:00
Alexey Milovidov
fa50fe80a0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 03:45:32 +03:00
Alexey Milovidov
30b657a0da
Header in every stream: development [#CLICKHOUSE-2]
2018-02-15 21:54:12 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
...
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
Vitaliy Lyudvichenko
26e58271e9
Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2]
2018-01-25 17:42:39 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e
Make early deduplication with block number creation. [#CLICKHOUSE-3545]
2018-01-23 18:50:29 +03:00
Vitaliy Lyudvichenko
1000328571
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-22 20:31:08 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
...
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
6198fe4a1a
Update StorageReplicatedMergeTree.cpp
2018-01-19 21:46:22 +03:00
alexey-milovidov
e8ebf3b56a
Update StorageReplicatedMergeTree.cpp
2018-01-19 21:45:28 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
...
Small enhancements
2018-01-16 22:07:43 +03:00
Vitaliy Lyudvichenko
b68b60fb38
More detailed test. [#CLICKHOUSE-3]
...
Resolves #1553 .
2018-01-16 15:05:01 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
554ed52920
Avoid superflous pullLogsToQueue() calls. [#CLICKHOUSE-3432]
2018-01-15 13:30:31 +03:00
Vitaliy Lyudvichenko
03bca2144d
OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
...
Resolves #1753
2018-01-15 13:13:18 +03:00
Vitaliy Lyudvichenko
388d47bbbc
Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346
2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
c818beedcb
Make data_path creation for Databases optional. [#CLICKHOUSE-2]
2018-01-11 21:55:43 +03:00
Nikolai Kochetov
cbeeb84999
added http_*_timeout settings [#CLICKHOUSE-3440]
2018-01-09 21:41:01 +03:00
Chen Yufei
88ef42c222
Aggressive merge for ReplicatedMergeTree optimize.
2018-01-09 20:44:07 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89
Merge branch 'aavdonkin-master'
2017-12-28 07:33:55 +03:00
Alexey Milovidov
b2fcf06353
Merging [#CLICKHOUSE-3114]
2017-12-27 00:34:06 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Zatelepin
c3348e27a4
shorter [#CLICKHOUSE-2]
2017-12-25 20:31:14 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Zatelepin
835b957e95
add comments [#CLICKHOUSE-3508]
2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8
check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e
revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Milovidov
1aa99092c3
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:15:35 +03:00
Alexey Milovidov
54e601019c
Better [#CLICKHOUSE-2].
2017-12-02 00:40:58 +03:00
Alexey Milovidov
acd78e4891
Better [#CLICKHOUSE-2].
2017-12-02 00:13:25 +03:00
Alexey Milovidov
1a6cb2989b
Better [#CLICKHOUSE-2].
2017-12-01 21:36:55 +03:00
Vitaliy Lyudvichenko
b738d1baed
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
proller
0d3c4f4d67
Core/FieldVisitors.h -> Common/FieldVisitors.h
...
Core/Progress.h -> IO/Progress.h
tests: sudo --non-interactive
Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
f6f77f5f0b
Fixed linking [#CLICKHOUSE-2].
2017-11-20 08:22:07 +03:00
Alexey Milovidov
6c8b5e29d8
Additions after merge [#CLICKHOUSE-2].
2017-11-20 00:17:58 +03:00
Alexey Milovidov
9b92c0fecd
BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].
2017-11-19 03:22:13 +03:00
Silviu Caragea
dfecd0b2f2
Merge with master
2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15
Removed unsupported functionality [#CLICKHOUSE-2].
2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014
More clear [#CLICKHOUSE-2].
2017-11-18 00:20:28 +03:00
Alexey Milovidov
7c9ba15ba1
Style [#CLICKHOUSE-2].
2017-11-17 23:42:03 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Alexey Zatelepin
99b2d135df
clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
Alexey Milovidov
4e04c4da5f
Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].
2017-11-04 06:56:31 +03:00
KochetovNicolai
bfb4e8f3fe
zookeeper chroot fix ( #1430 )
...
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* moved root section in zookeeper configuration [#CLICKHOUSE-3031]
* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]
* added tests [#CLICKHOUSE-3031]
* replaced tabs to spaces in config files [#CLICKHOUSE-3031]
* fix build [#CLICKHOUSE-3031]
* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]
* added comments [#CLICKHOUSE-3031]
* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]
* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
...
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0
Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381]
2017-10-26 17:58:00 +03:00
Vitaliy Lyudvichenko
397b8bcf92
Smarter parts deletion. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
71833a7f0f
More correct procedure of parts deleting. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421
Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088
Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Alexey Milovidov
65982a1642
Fixed exception messages [#CLICKHOUSE-2].
2017-10-25 22:17:37 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Alexey Zatelepin
a7c85e0c89
save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]
2017-10-20 21:28:44 +03:00
Alexey Zatelepin
e51f95872f
fix backward compatibility for new part format: [#CLICKHOUSE-3000]
...
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Alexey Milovidov
d3d976a6fb
Misc [#CLICKHOUSE-2].
2017-10-12 23:45:55 +03:00
proller
b993667156
Try fix strange terminate ( #1329 )
...
* Tests: External: rename --use_http => --no_http and fix
* Try fix strange terminate
2017-10-12 23:42:58 +03:00
Vitaliy Lyudvichenko
62ea1133dd
Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]
2017-10-12 23:26:54 +03:00
Vitaliy Lyudvichenko
cabf6d7799
Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]
2017-10-12 22:28:24 +03:00
Alexey Zatelepin
728a23f60e
allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91
serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f
add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277
allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db
save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Milovidov
94b975e7f9
Removed function deprecated in C++ [#CLICKHOUSE-3174].
2017-09-09 02:31:18 +03:00
Alexey Milovidov
8b313ab99e
Fixed warnings found by cppcheck [#CLICKHOUSE-3300].
2017-09-08 00:04:48 +03:00
Alexey Milovidov
0dcee75180
Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300].
2017-09-07 22:13:37 +03:00
Vitaliy Lyudvichenko
d55d5eca46
Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117]
2017-09-06 04:18:07 +03:00
Vitaliy Lyudvichenko
566160c048
Use FIFO lock in IStorage. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
Alexey Zatelepin
d2847f22af
PR fixes [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf
rename partition -> partition_id for clarity [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53
generalize MinMax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46
generic partitioning of inserted blocks [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a
Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Milovidov
495daffa16
Miscellaneous [#CLICKHOUSE-2].
2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
5916d823ef
Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238]
2017-08-30 17:34:40 +03:00
Vitaliy Lyudvichenko
84660029ec
Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252]
2017-08-29 20:49:37 +03:00
Vitaliy Lyudvichenko
fd63277b15
Unified spelling. [#CLICKHOUSE-2]
2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko
37820f7f64
Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252]
2017-08-28 18:27:25 +03:00
Alexey Zatelepin
f25f0cd759
reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
8a14cc49ff
asyncMulti() -> multi(). [#CLICKHOUSE-3221]
2017-08-15 19:18:02 +03:00
Alexey Zatelepin
3f3b7f61e2
always send changed settings for remote connections [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
10c14cfccb
Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]
2017-08-04 17:35:36 +03:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
Alexey Milovidov
8fb452e99a
Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175].
2017-07-29 00:25:24 +03:00
Vitaliy Lyudvichenko
bc9ee54985
Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896]
2017-07-24 18:04:17 +03:00
alexey-milovidov
d4d266fa18
ColumnConst unification ( #1011 )
...
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Alexey Milovidov
9406b6a5aa
Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148].
2017-07-15 06:48:36 +03:00
Nikolai Kochetov
283810e8ab
merged with master
2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8
removed typeid_cast from IColumn.h
2017-07-13 23:58:19 +03:00
Alexey Milovidov
5b5795633e
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Zatelepin
bdc529645e
fix cyclical yielding of leadership at startup [#CLICKHOUSE-3074]
2017-07-12 20:09:44 +03:00
Vitaliy Lyudvichenko
97f7b46ebd
Fixed CLEAR COLUMN test in case of deduplication rollback. [#CLICKHOUSE-2]
2017-06-26 19:34:38 +03:00
Vitaliy Lyudvichenko
9c0da6e698
Addition to previous commit. Fix error code, rename test tables. [#CLICKHOUSE-2]
2017-06-26 17:35:26 +03:00
Vitaliy Lyudvichenko
49cbc33a6b
Fix ZK exception in case of concurrent INSERTs in new partition. [#CLICKHOUSE-2]
2017-06-26 17:21:25 +03:00
Vitaliy Lyudvichenko
b53d6976b3
Fix build after merge. [#CLICKHOUSE-2]
2017-06-26 15:47:15 +03:00
Alexey Milovidov
a48a21f593
Merge branch 'master' into CLICKHOUSE-2896
2017-06-26 11:54:58 +03:00
Alexey Milovidov
275a1d4651
Improvement [#CLICKHOUSE-3091].
2017-06-25 05:48:38 +03:00
Alexey Milovidov
516b095423
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-25 04:54:25 +03:00
Alexey Milovidov
8228acd3ea
Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091].
2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b
Fixed translation errors [#CLICKHOUSE-3091].
2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992
Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].
2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5
Removed unused variable [#CLICKHOUSE-2].
2017-06-25 01:36:43 +03:00
proller
4db8d09de9
Reorganize includes. part 1 ( #921 )
...
* Make libunwind optional. Allow use custom libcctz
* fix
* Fix
* fix
* Update BaseDaemon.cpp
* Update CMakeLists.txt
* Reorganize includes. part 1
* Update dbms_include.cmake
* Reorganize includes. part 2
* Reorganize includes. part 3
* dbms/src/Common/ThreadPool -> libs/libcommon
* Reorganize includes. part 4
* Fix print_include_directories
* Update thread_creation_latency.cpp
* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
f409cad0ac
Miscellaneous [#CLICKHOUSE-3091].
2017-06-23 09:18:00 +03:00
Alexey Milovidov
7d732343eb
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-22 22:52:06 +03:00
Alexey Milovidov
22e7070fb0
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-22 19:07:57 +03:00
Alexey Milovidov
bb7fc04e2b
Whitespaces [#CLICKHOUSE-2].
2017-06-22 19:07:52 +03:00
Vitaliy Lyudvichenko
d7db235269
Better names and log messages. [#CLICKHOUSE-2896]
2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0
Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2]
2017-06-22 18:01:08 +03:00
proller
51b41aa0e3
Fix build
2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko
eff3588f28
Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896]
2017-06-22 16:18:19 +03:00
Alexey Milovidov
db546dc827
Caching parts that cannot be merged for some time [#CLICKHOUSE-3091].
2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko
53adb891b3
Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896]
2017-06-22 00:56:38 +03:00
Alexey Milovidov
5c322f5756
Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076].
2017-06-21 22:07:08 +03:00
Vitaliy Lyudvichenko
a098fb170a
Avoid creating multiple global Context. [#CLICKHOUSE-3083]
2017-06-20 10:49:18 +03:00
Alexey Milovidov
05accbdcbe
Removed cyclic dependency [#DEVTOOLS-3381].
2017-06-19 23:06:35 +03:00
Alexey Milovidov
43fedfecea
Get rid of INSERT ID [#CLICKHOUSE-31].
2017-06-13 07:13:20 +03:00
Alexey Milovidov
38885d00a3
Merge branch 'storage-startup-method'
2017-06-07 02:27:16 +03:00
Alexey Milovidov
9c5ddce06d
Get rid of .hpp files [#CLICKHOUSE-2].
2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f
Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2].
2017-06-06 20:06:14 +03:00
Vitaliy Lyudvichenko
1e4906816c
Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023]
2017-06-05 17:25:10 +03:00
alexey-milovidov
147b2f62b2
Update StorageReplicatedMergeTree.cpp
2017-06-02 20:02:59 +04:00
Vitaliy Lyudvichenko
6bddd4c1c5
Clean incomplete part nodes in ZooKeeper. [#CLICKHOUSE-3040]
2017-06-02 20:02:59 +04:00
Alexey Milovidov
ba499585cd
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6
Small refinements [#CLICKHOUSE-2].
2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
1a4b0eb355
Remove tmp part directories on server start. [#CLICKHOUSE-3044]
2017-05-31 18:01:25 +03:00
alexey-milovidov
72822714c3
Merge branch 'master' into CLICKHOUSE-2989
2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Milovidov
a77369d082
Preparation: Storages do not modify query [#CLICKHOUSE-31].
2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4
Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].
2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097
Preparation: untangling [#CLICKHOUSE-31].
2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko
d9637c2980
MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
...
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Alexey Milovidov
0f252046ca
Preparations [#CLICKHOUSE-2]
2017-05-22 01:25:25 +03:00
Alexey Zatelepin
9c6829e982
Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141]
2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
1d00f45dd3
Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989]
2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
6262fc8650
Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2]
2017-05-15 10:34:40 +04:00
Alexey Milovidov
ee6a7ee204
Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960].
2017-04-20 21:37:01 +03:00
alexey-milovidov
512d86ceaf
Merge pull request #706 from yandex/lagging-replicas-failover
...
Check for stale replicas when performing distributed queries
2017-04-20 21:30:02 +03:00
Alexey Milovidov
2d3e09af82
Fixed error [#CLICKHOUSE-2960].
2017-04-20 05:22:17 +03:00
Alexey Zatelepin
ba254a082e
Merge branch 'master' into lagging-replicas-failover
...
Conflicts:
dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Milovidov
47d2ca4136
Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960].
2017-04-18 23:36:19 +03:00
Yuri Dyachenko
8fb2b7ee3d
fix zookeeper format version 4
2017-04-17 21:15:14 +03:00
alexey-milovidov
5a8344382b
Update StorageReplicatedMergeTree.cpp
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8792c4f3ca
add 'deduplicate' flag into zookeeper 'merge' Entry
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4
support DEDUPLICATE option in OPTIMIZE query
2017-04-17 21:15:14 +03:00
Alexey Zatelepin
2bd089d589
start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141]
2017-04-17 18:06:12 +03:00
f1yegor
0b243a8b01
translate comments
2017-04-16 23:17:32 +03:00
proller
1bc311eefd
ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] ( #656 )
...
* ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878]
* fix
* better messages on client
* change code to 429 TOO_MANY_REQUESTS
* wip
* better message
* Update InterserverIOHandler.h
* Update InterserverIOHTTPHandler.cpp
* Update StorageReplicatedMergeTree.cpp
2017-04-06 16:03:23 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
4423420c20
Merge branch 'master' of github.com:yandex/ClickHouse
2017-03-31 19:00:42 +03:00
Alexey Milovidov
4f44445ff0
Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//'
2017-03-31 19:00:30 +03:00