Commit Graph

2612 Commits

Author SHA1 Message Date
Nikita Vasilev
6a09340eed Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-17 12:34:51 +03:00
Nikita Vasilev
062819f0a2 new test and repl fix 2019-01-17 11:05:26 +03:00
Nikita Vasilev
62dde8c327 fixed alter bug with drop all indices 2019-01-16 22:31:04 +03:00
Nikita Vasilev
579832ff9b upd setSkipIndexes 2019-01-16 21:35:03 +03:00
Nikita Vasilev
2de2b6f32e fixed alter 2019-01-16 19:53:38 +03:00
Alexey Zatelepin
0f8e5f8522 Merge branch 'master' into zk-columns-compact-storage
Conflicts:
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2019-01-16 17:45:16 +03:00
Nikita Vasilev
8c35ccdd1d fix alters 2019-01-16 15:29:26 +03:00
Nikita Vasilev
b110738f61 alters fix 2019-01-15 22:14:47 +03:00
Nikita Vasilev
2f07e31903 fix 2019-01-15 20:39:10 +03:00
alexey-milovidov
8a251753be
Merge pull request #4056 from 4ertus2/ast
Helpers for ASTIdentifier (based on 'QueryNormalizer refactoring' changes)
2019-01-15 00:22:54 +03:00
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
chertus
dbb88e8cb4 helpers for ASTIdentifier (hide semantic and casts) 2019-01-14 21:15:04 +03:00
proller
4b6af5788a Fix macos build 2019-01-14 19:55:11 +03:00
proller
af0b875f57 Fix macos build 2019-01-14 17:17:43 +03:00
proller
c0b72492c0 Fix macos build 2019-01-14 16:34:14 +03:00
Nikita Vasilev
e197697b22 fix 2019-01-13 22:31:48 +03:00
Nikita Vasilev
89b831eaf7 added indexes meta to zookeeper 2019-01-10 20:48:04 +03:00
Nikita Vasilev
d310d1a5ec fixed setSkipIndexes 2019-01-10 19:51:49 +03:00
Nikita Vasilev
0c18e73871 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-10 17:55:08 +03:00
Nikita Vasilev
701627ec60 fixed includes 2019-01-10 16:50:41 +03:00
Nikita Vasilev
634d5eb516 fix style 2019-01-10 16:30:06 +03:00
Nikita Vasilev
3f8c2ad814 fixed constructor 2019-01-10 15:57:12 +03:00
alexey-milovidov
9b46678920
Merge pull request #4014 from 4ertus2/joins
minor SyntaxAnalyzer refactoring
2019-01-09 23:10:40 +03:00
Nikita Vasilev
d9b7f30245 added indexes to checkDataPart 2019-01-09 22:20:50 +03:00
Nikita Vasilev
0ba6f1421a fixed style 2019-01-09 20:05:52 +03:00
chertus
729ca697d9 minor SyntaxAnalyzer refactoring 2019-01-09 19:16:59 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Nikita Vasilev
10355ae555 Merge remote-tracking branch 'upstream/master' into nikvas0/index 2019-01-09 17:36:06 +03:00
Nikita Vasilev
d8f8b6352b removed test index 2019-01-09 17:30:25 +03:00
Nikita Vasilev
1e8fa5d9ea working minmax 2019-01-09 17:15:23 +03:00
Nikita Vasilev
91fb17f27f fixed mutation 2019-01-09 12:55:28 +03:00
Nikita Vasilev
e580180efc fixed merging 2019-01-09 12:54:18 +03:00
Nikita Vasilev
6eeed48e86 fixed select 2019-01-08 23:17:45 +03:00
Nikita Vasilev
ad4df16899 fix 2019-01-08 22:41:36 +03:00
Nikita Vasilev
49148ac3e9 minmax index 2019-01-08 20:27:44 +03:00
alexey-milovidov
2884b870b3
Merge pull request #3993 from yandex/weverything-2
Added more warnings from clang's -Weverything, that are available in clang 8
2019-01-08 17:54:43 +03:00
Nikita Vasilev
d1e2ab85e3 asts -> exprlist 2019-01-08 14:04:25 +03:00
Alexey Milovidov
0630e67a21 Addition to Amos Bird changes #3920 2019-01-08 13:07:33 +03:00
Nikita Vasilev
48e136f029 unique names 2019-01-08 12:38:46 +03:00
Nikita Vasilev
541c641b24 fix 2019-01-08 00:06:08 +03:00
Nikita Vasilev
76c25c2024 fixed 2019-01-07 22:21:51 +03:00
Nikita Vasilev
69c6e77d53 fixed nullptr error 2019-01-07 21:53:51 +03:00
Nikita Vasilev
6871665231 test index 2019-01-07 19:49:34 +03:00
Nikita Vasilev
11d37efa74 reading 2019-01-07 15:51:14 +03:00
Alexey Milovidov
0dfa553fca Added more warnings from clang's -Weverything, that are available in clang 8 2019-01-07 13:40:58 +03:00
Nikita Vasilev
17f6618fa3 fix 2019-01-06 18:22:04 +03:00
Nikita Vasilev
e95376e550 Merge branch 'master' into nikvas0/index 2019-01-06 16:21:00 +03:00
Nikita Vasilev
7e0e301067 fix 2019-01-06 15:12:42 +03:00
Nikita Vasilev
83368a4866 upd error 2019-01-06 15:10:22 +03:00
Nikita Vasilev
c3f1784dbc fixes 2019-01-05 22:27:31 +03:00
Nikita Vasilev
61b9c7735b add rw for MergeTreeIndexes 2019-01-05 21:33:30 +03:00
Nikita Vasilev
82cc39d441 added setSkipIndexes 2019-01-05 15:35:13 +03:00
Nikita Vasilev
1c806288bf fix 2019-01-05 12:26:02 +03:00
Alexey Milovidov
06a8c3f02d Added some warnings from clang's -Weverything 2019-01-05 06:33:22 +03:00
Nikita Vasilev
f92750223f removed indexpart class 2019-01-04 18:54:34 +03:00
Nikita Vasilev
92a850ceb0 added writing indexes 2019-01-04 17:33:38 +03:00
Alexey Milovidov
afda68d25c Added some warnings from clang's -Weverything 2019-01-04 17:18:49 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Nikita Vasilev
35dbb94312 fix 2019-01-03 19:47:42 +03:00
Nikita Vasilev
b2da3a34df comments 2019-01-02 21:47:07 +03:00
Nikita Vasilev
f704a32515 added granularity 2019-01-02 19:04:44 +03:00
Nikita Vasilev
1b7c0aeef1 fix 2019-01-02 17:24:26 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
Alexey Zatelepin
9bd09b44ed introduce ReplicatedMergeTreePartHeader [#CLICKHOUSE-4024]
Conflicts:
	dbms/src/Common/ErrorCodes.cpp
2018-12-29 17:11:16 +03:00
Nikita Vasilev
ad2a453919 changed comment 2018-12-29 16:11:30 +03:00
Nikita Vasilev
33cf4c96e6 fix 2018-12-29 16:04:22 +03:00
Nikita Vasilev
f90cdca498 added indexes in selectexecutor 2018-12-29 16:02:57 +03:00
Nikita Vasilev
5079330bdc IndexCondition 2018-12-29 15:04:00 +03:00
Nikita Vasilev
68c3879d95 index condition 2018-12-29 14:12:41 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
Nikita Vasilev
06d8416107 indextypes 2018-12-28 20:53:41 +03:00
Nikita Vasilev
9bf5b6b4aa added indexParts 2018-12-28 18:27:06 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs
Custom compression codecs
2018-12-28 08:29:09 +03:00
alesapin
3afa03d044 Merge branch 'master' into custom_compression_codecs 2018-12-27 11:23:00 +03:00
Alexey Milovidov
882531b9c0 Fixed UB #3926 2018-12-27 04:40:00 +03:00
Alexey Milovidov
589d07860f Fixed UB #3926 2018-12-27 04:12:18 +03:00
Alexey Milovidov
7509db544c Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-3 2018-12-26 22:38:11 +03:00
Nikita Vasilev
c89df916ab ptrs 2018-12-26 20:34:44 +03:00
alesapin
9342700ce1 Move processing pool to ternary logic 2018-12-26 20:03:29 +03:00
Nikita Vasilev
b62197b1ad fixed compilation 2018-12-26 15:49:05 +03:00
Nikita Vasilev
04a8ea85af added index interface and factory 2018-12-26 15:19:24 +03:00
Alexey Milovidov
985aa2c034 Fixed build #3926 2018-12-26 04:12:13 +03:00
Alexey Milovidov
4c0b95ac02 Less dependencies [#CLICKHOUSE-2] 2018-12-26 02:11:36 +03:00
alesapin
f7e06cf9ac Remove random changes 2018-12-24 19:03:22 +03:00
alesapin
29ad7f9fb1 Remove redundant changes and shift error codes 2018-12-24 16:19:24 +03:00
alesapin
6f7333840a Move header with compression info to another place 2018-12-21 16:25:39 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
alesapin
5b23210062 Merge branch 'master' into custom_compression_codecs 2018-12-21 11:57:21 +03:00
alexey-milovidov
b1602a5e62
Merge pull request #3887 from yandex/remove-alter-primary-key
Remove ALTER MODIFY PRIMARY KEY command
2018-12-20 22:21:08 +03:00
Alexey Zatelepin
b7afe46dfd remove ALTER MODIFY PRIMARY KEY command [#CLICKHOUSE-4214] 2018-12-20 21:57:20 +03:00
alesapin
aee6c0a606 Remove dump code 2018-12-20 20:37:02 +03:00
alexey-milovidov
3cefb27e56
Merge pull request #3851 from abyss7/issue-3592
Refactor constant folding
2018-12-20 19:26:02 +03:00
alesapin
0ae14be8d2 Fix codes 2018-12-20 13:44:20 +03:00
alesapin
512fe3c854 Refactoring (sanitizer failure) 2018-12-19 20:20:18 +03:00
proller
b213ee5e5d
Fix macos build (#3863) 2018-12-18 20:41:03 +03:00
proller
c63ca042ba
Fix macos build (#3861) 2018-12-18 16:37:00 +03:00
alesapin
6fe01af829 Merge branch 'master' into custom_compression_codecs 2018-12-18 14:06:11 +03:00
proller
b1234b86c3 Macos fix 2018-12-17 20:59:10 +03:00
Ivan Lezhankin
1a539b3a6d Merge remote-tracking branch 'upstream/master' into issue-3592 2018-12-17 19:30:20 +03:00
Ivan Lezhankin
6df757c6f7 Refactor constant folding and make it reusable for primary_key_expr 2018-12-17 17:59:01 +03:00
proller
3a9bd8a773 Fix macos build 2018-12-17 17:10:23 +03:00
alesapin
36a6121f75 Merge branch 'master' into custom_compression_codecs 2018-12-17 12:56:21 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff 2018-12-14 17:41:55 +03:00
alesapin
29e2bbaa94 Merge remote-tracking branch 'origin' into custom_compression_codecs 2018-12-14 11:24:23 +03:00
zhang2014
6d0c4eaf89 ISSUES-838 add lz4、none、zstd codec 2018-12-13 12:10:34 +08:00
Emmanuel Donin de Rosière
7d7acb92da Merge remote-tracking branch 'upstream/master' 2018-12-12 15:02:52 +01:00
KochetovNicolai
635b16ac4b
Update MergeTreeDataPart.cpp
Skip size check for LowCardinality column file.
2018-12-10 20:47:18 +03:00
Emmanuel Donin de Rosière
982cd749be Better management of DateTime partitionning #3786
Adding min_time and max_date in system.parts table
2018-12-10 11:20:19 +01:00
alexey-milovidov
0fdb3b9628
Merge branch 'master' into issue-3578 2018-12-07 23:53:34 +03:00
Alexey Milovidov
f3c72daf50 Fixed name [#CLICKHOUSE-2] 2018-12-07 06:21:17 +03:00
Alexey Zatelepin
c9b97ae86c fix unexpected modification of original ORDER BY ast [#CLICKHOUSE-3859] 2018-12-05 17:02:34 +03:00
chertus
3db00b7b98 Merge branch 'master' into issue-3578 2018-12-05 14:43:14 +03:00
alesapin
a956efe0a8 Comment debug info 2018-12-04 19:33:35 +03:00
alesapin
7925abcd74 Deep debugging 2018-12-04 17:44:42 +03:00
chertus
933c055104 CLICKHOUSE-3578 review proress 2018-12-04 17:09:47 +03:00
alesapin
8c34386310 Some debug 2018-12-04 11:05:58 +03:00
alesapin
bf338b957f Merge master 2018-12-03 12:10:06 +03:00
alesapin
3efb00b0ef Some debug 2018-12-03 11:52:21 +03:00
alexey-milovidov
48b30edcf5
Merge branch 'master' into alter-order-by 2018-12-02 21:06:38 +03:00
alexey-milovidov
af110b8202
Merge pull request #3693 from yandex/simplier_merge_read_logic
Simplify merge stream read logic
2018-12-02 20:59:43 +03:00
alesapin
5524b77915 Compilable code! 2018-11-30 18:36:10 +03:00
alesapin
f83ed167ac Merge branch 'simplier_merge_read_logic', remote-tracking branch 'origin' into adaptive_index_granularity 2018-11-29 18:21:46 +03:00
alesapin
51f73651dd Inject columns after creating header 2018-11-29 18:16:08 +03:00
alesapin
8e8bc6b1e0 Trash commits 2018-11-29 16:50:34 +03:00
alesapin
497a09c41b Return to adaptive granularity 2018-11-29 16:12:20 +03:00
alesapin
fc379c1d5c Inject column names before types 2018-11-29 15:03:58 +03:00
alesapin
b2fd3e804a Add special logic for alter 2018-11-29 14:55:34 +03:00
alesapin
e2e88324d0 Rename MergeTree streams for select 2018-11-29 12:19:42 +03:00
alesapin
d4059ba507 Inject default column 2018-11-28 20:21:27 +03:00
Ivan
448846fc0d
Merge branch 'master' into CLICKHOUSE-3936 2018-11-28 18:59:57 +03:00
Ivan Lezhankin
8b5a05947c Remove redundant information from RWLock.
And fix broken exception in some race conditions
2018-11-28 18:50:52 +03:00
Alexey Zatelepin
57f25e978a update comments and docs [#CLICKHOUSE-3859] 2018-11-28 18:12:44 +03:00
alesapin
23aa6595cd Missed file 2018-11-28 18:05:53 +03:00
alesapin
b7cdd8fe7f Trying to simplify merge reading logic 2018-11-28 18:05:28 +03:00
Alexey Zatelepin
1b27fb046d Merge branch 'master' into alter-order-by
Conflicts:
	dbms/programs/server/Server.cpp
2018-11-28 16:47:07 +03:00
Alexey Zatelepin
9ae79c60e8 get rid of (ASTPtr *) in AlterCommands::apply [#CLICKHOUSE-3859] 2018-11-28 16:34:57 +03:00
Alexey Zatelepin
ceea7bde2e better names in ZooKeeperNodeCache [#CLICKHOUSE-3859] 2018-11-28 14:40:59 +03:00
Alexey Zatelepin
e085bc9816 adapt code of #3609 [#CLICKHOUSE-3859] 2018-11-27 20:07:10 +03:00
Alexey Milovidov
dba43be6c8 Fixed race condition in BackgroundProcessingPool [#CLICKHOUSE-2] 2018-11-27 17:59:10 +03:00
alexey-milovidov
a7d75c527b
Merge pull request #3652 from yandex/unquote-partition
Don't quote single-field partition keys
2018-11-26 19:57:01 +03:00
Alexey Zatelepin
d3d9242462 Merge branch 'master' into alter-order-by
Conflicts:
	dbms/src/Parsers/ASTAlterQuery.h
	dbms/src/Parsers/ParserAlterQuery.cpp
	dbms/src/Storages/AlterCommands.cpp
	dbms/src/Storages/AlterCommands.h
2018-11-26 16:01:48 +03:00
Alexey Zatelepin
3a3dda5ec5 use standard Tuple serialization [#CLICKHOUSE-4054] 2018-11-26 15:41:17 +03:00
Alexey Milovidov
5a0feee45e Removed "conditional computations" feature, because it is not ready #2272 2018-11-26 04:39:04 +03:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
Alexey Milovidov
cc06488ddc Whitespace #2601 2018-11-24 03:10:51 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alexey-milovidov
c6bc4279ee
Merge pull request #3377 from s-mx/CLICKHOUSE-4032
Added support for column COMMENTs in table definition.
2018-11-23 16:43:58 +03:00
Alexey Milovidov
c0e97a97cd Resolved inconsistencies in documentation #3539 2018-11-23 01:00:03 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645)
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
2018-11-23 00:19:58 +03:00
Sabyanin Maxim
3a67b505c5 Merge branch 'master' of https://github.com/yandex/ClickHouse into CLICKHOUSE-4032 2018-11-22 16:54:10 +03:00
Alexey Milovidov
ab5d76fc42 Fixed error introduced in #3553 and prevent it happening 2018-11-21 23:56:37 +03:00
alexey-milovidov
5038f13b08
Merge pull request #3514 from abyss7/CLICKHOUSE-3766
Implement 'ALTER … FREEZE' command
2018-11-21 07:17:21 +03:00
Ivan Lezhankin
1e070a7c51 Move FREEZE_ALL command source code inside |PartitionCommand| 2018-11-20 20:13:59 +03:00
alesapin
2a4a8d180b Try to change stupid naming 2018-11-16 16:33:43 +03:00
alesapin
0266f058c9 Merge branch 'master' into CLICKHOUSE-4112 2018-11-16 16:21:27 +03:00
alesapin
d4ce674b93 Add http connection pool between replicas 2018-11-16 16:15:17 +03:00
proller
160ffb2283
Build fixes (clang 7.0.0+) (#3582) 2018-11-16 15:22:51 +03:00
alesapin
6123993ec0 Load granularity to memroy 2018-11-15 17:06:54 +03:00
Sabyanin Maxim
d9e6789f78 make MergeTree work with comments 2018-11-15 16:12:27 +03:00
Alexey Zatelepin
b071547b2d add checks for ALTER MODIFY ORDER BY [#CLICKHOUSE-3859] 2018-11-14 20:12:32 +03:00
alesapin
6b33008758 More fixed 2018-11-14 14:26:44 +03:00
alesapin
7ba11c8afc Add marks info 2018-11-14 10:49:45 +03:00
alesapin
b2b29815dd Change fixed index granularity to adaptive 2018-11-14 10:49:20 +03:00
Alexey Zatelepin
29b34365e6 Merge branch 'master' into alter-order-by
Conflicts:
	dbms/src/Interpreters/ExpressionAnalyzer.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
2018-11-13 16:27:19 +03:00
Alexey Zatelepin
2cc0aae82c rearrange AST members in MergeTreeData [#CLICKHOUSE-3859] 2018-11-13 16:15:17 +03:00
Alexey Zatelepin
7167bfd7b3 fix prewhere with FINAL for VersionedCollapsingMergeTree [#CLICKHOUSE-3859] 2018-11-13 16:15:12 +03:00
Alexey Zatelepin
8b85822192 store original key ASTs, and not extracted ASTExpressionLists [#CLICKHOUSE-3859] 2018-11-13 16:14:44 +03:00
Alexey Zatelepin
31a6a6b4fd calculate ReplicatedMergeTreeTableMetadata diff [#CLICKHOUSE-3859] 2018-11-13 16:13:55 +03:00
Alexey Zatelepin
74c48ed226 apply metadata changes on startup [#CLICKHOUSE-3859] 2018-11-13 16:13:50 +03:00
Alexey Zatelepin
106800b857 apply changes in ReplicatedMergeTreeAlterThread [#CLICKHOUSE-3859] 2018-11-13 16:13:40 +03:00
Alexey Zatelepin
4036ec83af write metadata znode in StorageReplicatedMergeTree::alter() [#CLICKHOUSE-3859] 2018-11-13 16:13:34 +03:00
Alexey Zatelepin
0c0c4fd28d add sorting_and_primary_keys_independent [#CLICKHOUSE-3859] 2018-11-13 16:13:19 +03:00
Alexey Zatelepin
c4bf38ef07 comments [#CLICKHOUSE-3859] 2018-11-13 16:13:06 +03:00
Alexey Zatelepin
f4c26e78d2 renames [#CLICKHOUSE-3859] 2018-11-13 16:13:01 +03:00
Alexey Zatelepin
0fa86162d9 separate sorting key and primary key, allow setting primary key separately [#CLICKHOUSE-3859] 2018-11-13 16:12:55 +03:00
Alexey Zatelepin
9a92c0a55c sort key is distinct from primary key [#CLICKHOUSE-3859] 2018-11-13 16:12:49 +03:00
Alexey Zatelepin
580146eedb add primary key syntax [#CLICKHOUSE-3859] 2018-11-13 16:12:14 +03:00
alesapin
0a64ef5de8 Add severals ifs for format_version, but have to move this routine to single class 2018-11-12 20:44:43 +03:00
alesapin
6f5fef5344 CLICKHOUSE-3971: Write data with adaptive index granularity 2018-11-12 19:14:37 +03:00
Ivan Lezhankin
baf9566413 Fix style 2018-11-12 15:26:15 +03:00
Ivan Lezhankin
5d3da110a8 Refactor |freezePartition()| and |freezeAll()| 2018-11-12 15:26:15 +03:00
Ivan Lezhankin
935615a647 Reimplement FREEZE command. 2018-11-12 15:26:14 +03:00
Ivan Lezhankin
a837060454 Lock table structure before freezing. 2018-11-12 15:26:14 +03:00
Ivan Lezhankin
03e6a29eb2 Implement 'ALTER … FREEZE' command.
Need some tests!
2018-11-12 15:26:14 +03:00
Nikolai Kochetov
1e9aeba603 Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-09 18:01:18 +03:00
Nikolai Kochetov
726ae0cb9a Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-08 19:47:12 +03:00
Sabyanin Maxim
dacd999d4f Merge branch 'master' into CLICKHOUSE-4032 2018-11-06 16:50:07 +03:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master
Flexible fields assignment
2018-11-01 20:22:28 +03:00
proller
f86d1a7034 CONTRIB-254 Arcadia fixes (#3475)
* Macos: set ENABLE_EMBEDDED_COMPILER=0 by default (because contrib/llvm temporary broken under macos)

* \n

* arcadia fix

* fix arcadia link

* wip

* wip

* wip

* fix

* wip

* wip

* fix

* try use users from server dir

* Revert "try use users from server dir"

This reverts commit 79b2c6fd9c.

* Fix logging

* fix

* Update ZooKeeperImpl.h
2018-11-01 20:07:20 +03:00
Artem Zuikov
eb535c4b9b
Merge pull request #3500 from 4ertus2/joins
refactoring: one place for db and table extraction from AST
2018-11-01 14:59:56 +03:00
alesapin
791a1422de Enable merge with DIRECT_IO when summary size of participating parts more than 10GB 2018-10-31 12:24:58 +03:00
chertus
d2518fdb3f more refactoring: funcs to extract database_and_table from AST 2018-10-29 22:04:28 +03:00
Sabyanin Maxim
65bd40e290 Merge branch 'master' of github.com:yandex/ClickHouse into CLICKHOUSE-4032 2018-10-27 22:33:52 +03:00
Amos Bird
3cf2177268 Flexible fields assignment
Field f;

before:

f = Int64(-42);

after:

f = -42;
2018-10-24 08:47:33 +08:00
alexey-milovidov
bb00bb8592
Merge pull request #3405 from yandex/CLICKHOUSE-2211
CLICKHOUSE-2211: Fix aio reading (with correct buffer size), reduce M…
2018-10-24 01:37:05 +03:00
alesapin
72e435893d Better comment 2018-10-23 14:19:01 +03:00
Alexey Milovidov
bac6b6f381 Fixed error #2863 2018-10-23 11:19:47 +03:00
alexey-milovidov
98c2ed582c
Merge pull request #2863 from VadimPE/ISSUES-2581
ISSUES-2581 fix SELECT with sequential consistency
2018-10-22 23:55:33 +03:00
VadimPE
31794b7a46 fix codestyle 2018-10-22 14:58:56 +03:00
proller
2659e94573 Fix use after pop_back() 2018-10-19 20:27:38 +03:00
proller
67eb30d192 CLICKHOUSE-4074 Fix merge_tree_uniform_read_distribution=0 2018-10-19 19:31:51 +03:00
proller
abfe675097
Build fixes (#3419) 2018-10-18 22:28:05 +03:00
VadimPE
f2db463ab0 fix bug with merge part, wich us inserted with quorum 2018-10-18 17:14:07 +03:00
VadimPE
4a93d3b836 fix addedparts 2018-10-18 14:51:40 +03:00
alesapin
87bb06fdd8 CLICKHOUSE-2211: Add exception for impossible case 2018-10-18 12:24:16 +03:00
alesapin
fe6406eac1 CLICKHOUSE-2211: Fix accident delition 2018-10-17 19:18:14 +03:00
alesapin
d78d569d42 CLICKHOUSE-2211: Fix aio reading (with correct buffer size), reduce MergeTreeReader creation and add useless test 2018-10-17 17:56:15 +03:00
Alexey Milovidov
99a64d3b92 Presumably better #2278 2018-10-17 06:13:00 +03:00
Alexey Milovidov
7c4d24ce39 Added comment [#CLICKHOUSE-3901] 2018-10-17 00:25:45 +03:00
Alexey Milovidov
98543b7c41 Fixed vertical merge of multidimensional Nested structures [#CLICKHOUSE-3901] 2018-10-17 00:22:41 +03:00
Sabyanin Maxim
ab050c8466 add comment section in column declaration.
add comment column type in alter method.
add comment section in system.columns.
2018-10-14 18:30:06 +03:00
VadimPE
4db6eab5a3 ISSUES-2581 fix name 2018-10-10 19:20:15 +03:00
Alexey Zatelepin
d9a0432c6c don't quote single-field partition keys #3109 [#CLICKHOUSE-4054] 2018-10-10 18:57:04 +03:00
VadimPE
d4a56af660 ISSUES-2581 fix bug with new partition 2018-10-10 16:22:55 +03:00
Alexey Milovidov
227ff8c606 Fixed comment [#CLICKHOUSE-2] 2018-10-09 17:30:05 +03:00
alexey-milovidov
ba62a24926
Merge pull request #3283 from yandex/FileOpenFixes_CLICKHOUSE-3943_
File open fixes clickhouse 3943
2018-10-05 00:00:47 +03:00
alexey-milovidov
b9d1eb4154
Merge pull request #3298 from yandex/fix-prewhere-with-altered-columns
Fix prewhere with altered columns
2018-10-04 23:57:11 +03:00
Nikolai Kochetov
b1fa3fab9d Fix prewhere whith final. #2827 2018-10-04 21:18:54 +03:00
alesapin
5a218a7363 CLICKHOUSE-3943: Change naming 2018-10-04 11:52:56 +03:00
Nikolai Kochetov
a6d0094835 Fix readnig missing column with prewhere. #2827 2018-10-04 10:51:06 +03:00
alesapin
252f9d0080 CLICKHOUSE-3943: Style 2018-10-03 20:12:38 +03:00
alesapin
441069fc5c [WIP] CLICKHOUSE-3943: Store last_readed_mark in MergeTreeThreadBlockInputStream and don't recreate reader if it stopped in appropriate position 2018-10-03 20:10:23 +03:00
Nikolai Kochetov
97add69825 Rename WithDictionary to LowCardinality. 2018-09-28 13:44:59 +03:00
alexey-milovidov
b6e53d22e1
Merge pull request #3200 from yandex/low-cardinality-function-result-cache
Added cache for low cardinality function result.
2018-09-26 18:12:48 +03:00
Nikolai Kochetov
d526859011 Added cache for low cardinality function result. [#CLICKHOUSE-3904] 2018-09-25 16:48:52 +03:00
VadimPE
28102bc3b5 ISSUES-2581 get pointer to max_blocls 2018-09-24 12:53:28 +03:00
Alexey Zatelepin
c2c12f22f7 try to immediately delete the part after checksums mismatch [#CLICKHOUSE-2837] 2018-09-21 19:07:21 +03:00
Vadim
8c413e3f1f
Update ReplicatedMergeTreeQuorumAddedParts.h 2018-09-21 18:20:31 +03:00
VadimPE
33545a41b6 fix style. And del getMaxBlock...() 2018-09-21 18:07:43 +03:00
VadimPE
8b8697bc5d Merge remote-tracking branch 'origin/master' into ISSUES-2581 2018-09-21 17:11:57 +03:00
Alexey Zatelepin
230a9fff2d Write the columns list of the resulting part in the same order as all_columns [#CLICKHOUSE-13] 2018-09-21 15:40:34 +03:00
alexey-milovidov
a2d8ee1caa
Merge pull request #3183 from 4ertus2/refactoring
refactoring: hide ASTIdentifier kind
2018-09-20 20:38:06 +03:00
Alexey Zatelepin
0ec0a24bc9 fix use of temp variable after it gets out of scope 2018-09-20 16:55:22 +03:00
chertus
6442b5b167 refactoring: hide ASTIdentifier kind 2018-09-20 16:13:33 +03:00
VadimPE
66b4a606d5 fix bug with add new partition in quorum 2018-09-19 17:34:41 +03:00
Alexey Zatelepin
b7cb8d1ae1 write correct columns list when UPDATEd part doesn't contain all columns [#CLICKHOUSE-13] 2018-09-19 16:04:52 +03:00
VadimPE
f05d93897b Del old class 2018-09-19 14:10:56 +03:00
VadimPE
17ffa8c310 fix class for added parts 2018-09-19 14:08:04 +03:00
VadimPE
96b117cb00 Revert "Update ReplicatedMergeTreeQuorumWriter.h"
This reverts commit e3add7f0c7.
2018-09-19 13:23:52 +03:00
Vadim
e3add7f0c7
Update ReplicatedMergeTreeQuorumWriter.h 2018-09-17 16:05:20 +03:00
Vadim
3fabac31f6
Update ReplicatedMergeTreeQuorumWriter.h 2018-09-17 16:02:30 +03:00
Vadim
3b155638a0
Update ReplicatedMergeTreeQuorumWriter.h 2018-09-17 15:54:20 +03:00
Vadim
df9a01585a
Update ReplicatedMergeTreeQuorumWriter.h 2018-09-17 15:51:42 +03:00
Vadim
4dee095b9d
Update MergeTreeDataSelectExecutor.cpp 2018-09-17 15:43:14 +03:00
Vadim
204e1d437f
Merge branch 'master' into ISSUES-2581 2018-09-17 15:30:08 +03:00
VadimPE
5defbadb4a Add new class for write new parts 2018-09-17 15:28:29 +03:00
Alexey Milovidov
7f27f0e4ca Fixed build #3146 2018-09-17 06:44:29 +03:00
Alexey Milovidov
5e3b507bd6 Added functions "toISOWeek", "toISOYear", "toStartOfISOYear" [#CLICKHOUSE-3988] 2018-09-17 06:09:56 +03:00
Alexey Milovidov
59f8313b83 utils/check-style/check-style 2018-09-13 06:34:58 +03:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update
ALTER UPDATE
2018-09-13 06:03:35 +03:00
alexey-milovidov
fd630179ec
Merge pull request #3103 from yandex/dont-fetch-unchanged-mutated-parts
Don't fetch parts not changed by mutations
2018-09-13 04:00:31 +03:00
alesapin
17a8fb86dc CLICKHOUSE-3970: Rename variable 2018-09-12 21:19:47 +03:00
alesapin
c38e3e7890 CLICKHOUSE-3970: Add logging 2018-09-12 20:28:59 +03:00
alesapin
1664bec008 CLICKHOUSE-3970: Add setting for O_DIRECT for big merges 2018-09-12 20:19:52 +03:00
alexey-milovidov
0751290dca
Merge pull request #3099 from VadimPE/CLICKHOUSE-3839
CLICKHOUSE-3839 add partition_id in system.merges
2018-09-12 07:38:43 +03:00
Alexey Zatelepin
6da58aedd8 don't fetch mutated part if we have local part with the same checksums [#CLICKHOUSE-3937] 2018-09-11 19:41:01 +03:00
VadimPE
5da1561e69 CLICKHOUSE-3839 2018-09-11 14:16:40 +03:00
alexey-milovidov
4793e620be
Merge pull request #3093 from yandex/fix-columns-ordering
Fix columns ordering in MergeTreeRangeReader
2018-09-10 20:26:45 +03:00
Nikolai Kochetov
2ea009bddc Fix columns ordering. 2018-09-10 18:28:03 +03:00
alexey-milovidov
20d5ddd58c
Merge branch 'master' into alter-update 2018-09-10 17:17:10 +03:00
alexey-milovidov
3054e62e00
Merge pull request #3089 from VadimPE/CLICKHOUSE-3839
CLICKHOUSE-3839 add virtual column "_partition_id"
2018-09-10 17:16:21 +03:00
VadimPE
10ab9587a2 CLICKHOUSE-3839 add virtual column _partition_id 2018-09-10 12:53:13 +03:00
alexey-milovidov
0b6e85e51d
Merge pull request #3073 from yandex/fix_prewhere_with_sampling
Fix prewhere with sampling
2018-09-08 00:34:06 +03:00
Nikolai Kochetov
8311c23d83 Fix test. 2018-09-07 23:23:28 +03:00
Alexey Zatelepin
133c9c7c37 Merge branch 'master' into alter-update
Conflicts:
	docs/en/query_language/alter.md
2018-09-07 19:11:02 +03:00
Nikolai Kochetov
6e41be3476 Avoid removing columns used in sample expression in prewhere actions. [#CLICKHOUSE-3969] 2018-09-07 19:01:21 +03:00
Alexey Zatelepin
1064d1d26b update MATERIALIZED columns when their dependencies are updated [#CLICKHOUSE-13] 2018-09-07 18:54:18 +03:00
chertus
0b35cdae69 refactoring: add some sugar in type checks [CLICKHOUSE-0002] 2018-09-07 17:37:26 +03:00
Alexander Sapin
03174e131d Merge remote-tracking branch 'upstream/master' 2018-09-06 12:39:42 +03:00
Alexey Zatelepin
6275bfd8cd fix CollapsingMergeTree + vertical merge [#CLICKHOUSE-3963]
don't skip writing to rows sources even if all rows have collapsed.
2018-09-05 20:19:51 +03:00
Alexey Zatelepin
acc1a84827 better name [#CLICKHOUSE-13] 2018-09-05 15:54:03 +03:00
Nikolai Kochetov
3c6db8ebc1 Fix prewhere with aliased columns. [#CLICKHOUSE-3944] 2018-09-04 21:28:01 +03:00
Alexey Zatelepin
4f91833e67 Merge branch 'master' into alter-update
Conflicts:
	dbms/src/Parsers/ASTIdentifier.cpp
2018-09-04 17:39:08 +03:00
Alexey Zatelepin
816b91e2e3 additional checks for UPDATEs of key columns [#CLICKHOUSE-13] 2018-09-04 17:34:50 +03:00
Alexey Zatelepin
dc0c731c10 later mutation stages now work with IN (SELECT ...) [#CLICKHOUSE-13] 2018-09-04 14:39:10 +03:00
Alexey Zatelepin
d4d1020798 execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13] 2018-09-03 22:34:49 +03:00
alesapin
83574eed7c Merge remote-tracking branch 'upstream/master' 2018-09-03 13:11:33 +03:00
alesapin
11d248ba10 Resolve conflict 2018-09-03 13:11:10 +03:00
VadimPE
6e78f576d7 ISSUES-2581 add comments, and fix 2018-09-03 11:25:35 +03:00
Alexey Milovidov
226a7f491e Whitespaces [#CLICKHOUSE-3944] 2018-09-03 08:06:19 +03:00
Alexey Milovidov
fc27be314b Avoid temporary nullptr references [#CLICKHOUSE-2] 2018-09-02 06:00:04 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
Alexey Zatelepin
e9493b3a5f use hard links to copy columns that didn't change [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
Alexey Zatelepin
dc2a4c21e9 execute ALTER UPDATE [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
Alexey Milovidov
9a4b4fbccd Miscellaneous #2758 2018-08-28 03:23:52 +03:00
Alexey Milovidov
236c3872b8 Miscellaneous #2758 2018-08-28 03:23:38 +03:00
Alexey Milovidov
32286484cd Miscellaneous #2758 2018-08-28 03:22:32 +03:00
Alexey Milovidov
52379be265 Miscellaneous #2758 2018-08-28 03:21:02 +03:00
Alexey Milovidov
4f8d324fa7 Miscellaneous #2758 2018-08-28 03:18:32 +03:00
Alexey Milovidov
fa0ffcf8dc Miscellaneous #2758 2018-08-28 03:17:27 +03:00
Alexey Milovidov
2a4b4eefd6 Miscellaneous #2758 2018-08-28 03:10:05 +03:00
Alexey Milovidov
ea643eeff9 Miscellaneous #2758 2018-08-28 03:03:10 +03:00
Alexey Milovidov
7c777c48d7 Miscellaneous #2758 2018-08-28 03:01:03 +03:00
Alexey Milovidov
0a7e288d70 Miscellaneous #2758 2018-08-28 02:59:49 +03:00
Alexey Milovidov
24bd803c07 Whitespaces #2758 2018-08-27 22:06:32 +03:00
Vadim
a246b913e0
Merge branch 'master' into ISSUES-2581 2018-08-27 19:45:35 +03:00
Vadim
2d8bffafa3
Update MergeTreeSettings.h 2018-08-27 19:38:54 +03:00
Vadim
4d9d80b271
Update MergeTreeSettings.h 2018-08-27 19:38:36 +03:00
VadimPE
418375aa1d Merge branch 'CLICKHOUSE-3847' of https://github.com/VadimPE/ClickHouse into CLICKHOUSE-3847 2018-08-27 19:23:08 +03:00
VadimPE
70ebb6a47d CLICKHOUSE-3847 fix code-style 2018-08-27 19:22:39 +03:00
Vadim
64a27e592b
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-27 19:00:40 +03:00
VadimPE
4d198f2bfe CLICKHOUSE-3847 fix build 2018-08-27 18:54:07 +03:00
VadimPE
0281678c3e CLICKHOUSE-3847 fix code style 2018-08-27 18:44:51 +03:00
VadimPE
a8974f8786 CLICKHOUSE-3847 add Coordinator 2018-08-27 16:51:22 +03:00
Vadim
be2d821669
Merge branch 'master' into CLICKHOUSE-3847 2018-08-27 15:26:41 +03:00
Vadim
c4e90d89f0
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-27 15:16:52 +03:00
VadimPE
22aa521884 CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted 2018-08-27 15:14:48 +03:00
VadimPE
cf0a7c1529 CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted 2018-08-27 15:09:22 +03:00
Alexey Milovidov
c193d15ef2 Merge branch 'master' into generalize-zookeeper 2018-08-26 03:32:15 +03:00
Alexey Milovidov
3475ef5304 Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2] 2018-08-25 04:58:14 +03:00
Alexey Milovidov
01082d03d2 Adopted logic in ReplicatedMergeTreeBlockOutputStream #2949 2018-08-25 01:55:02 +03:00
Alexey Milovidov
eec8af52f3 Fixed potential data loss [#CLICKHOUSE-3916] 2018-08-24 11:57:24 +03:00
alexey-milovidov
e1e6e316d9
Merge pull request #2930 from yandex/fix-empty-parts-vertical-merge
Fix vertical merge of empty parts
2018-08-24 01:47:11 +03:00
Vadim
1c596db7c0
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 20:19:05 +03:00
Vadim
5a129f5383
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 19:37:28 +03:00
Vadim
380452c933
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 19:36:54 +03:00
Alexey Zatelepin
08f6305dba add missed logging message 2018-08-23 19:33:25 +03:00
Vadim
e7d6bc3dbc
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 19:02:19 +03:00
VadimPE
ce217af78a CLICKHOUSE-3847 fix 2018-08-23 18:58:29 +03:00
Vadim
9271ea7a5f
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 17:20:13 +03:00
Vadim
94699b8f6a
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 17:08:24 +03:00
Vadim
234242dd2d
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-23 17:04:53 +03:00
VadimPE
9beb841406 CLICKHOUSE-3847 fix throw and del log 2018-08-23 16:55:59 +03:00
Alexey Zatelepin
f592aa84d1 fix vertical merge for empty parts [#CLICKHOUSE-3913] 2018-08-23 15:04:30 +03:00
Vadim
b8dd1cbdf2
Update ReplicatedMergeTreeQueue.cpp 2018-08-22 17:18:05 +03:00
Vadim
58fa299b0a
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-22 17:14:30 +03:00
Vadim
9bce62719f
Update ReplicatedMergeTreeQueue.cpp 2018-08-22 17:10:00 +03:00
Vadim
984d6b5db8
Update ReplicatedMergeTreeCleanupThread.cpp 2018-08-22 17:06:34 +03:00
VadimPE
d81d4dfc70 CLICKHOUSE-3847 change createReplica and change check in cloneReolica() 2018-08-22 17:01:54 +03:00
Alexey Zatelepin
66d49f0abc start and stop mutations_finalizing_task during replica restart [#CLICKHOUSE-3747] 2018-08-22 16:57:30 +03:00
Alexey Zatelepin
b6aa7542d0 add BackgroundSchedulePool::TaskInfo::activateAndSchedule() method
Almost always it (and not activate()) is precisely what is needed.
2018-08-22 16:43:27 +03:00
Alexey Zatelepin
5c748bfdce fix bug when MATERIALIZED columns were not selected during mutation #2900 [#CLICKHOUSE-3911] 2018-08-22 15:45:24 +03:00
Alexey Milovidov
ca5b83ac39 Fixed error when BackgroundSchedulePool is initialized in context of a query #2482 2018-08-22 06:58:19 +03:00
Alexey Milovidov
fc9d335d41 Fixed error when empty part is generated after merge or mutation #2830 2018-08-22 06:33:46 +03:00
Alexey Zatelepin
55d82dfc84 fix race in initialization of ReplicatedMergeTreeRestartingThread [#CLICKHOUSE-3899] 2018-08-21 18:22:55 +03:00
Vadim
e9954d3ab7
Update MergeTreeDataSelectExecutor.cpp 2018-08-21 17:53:16 +03:00
Vadim
79a089a996
Update MergeTreeDataSelectExecutor.h 2018-08-21 17:32:47 +03:00
Vadim
5f7117e6a2
Update MergeTreeDataSelectExecutor.cpp 2018-08-21 17:32:28 +03:00
Vadim
b96d15f266
Update MergeTreeDataSelectExecutor.cpp 2018-08-21 17:28:22 +03:00
Vadim
306c1b0b48
Update MergeTreeDataSelectExecutor.h 2018-08-21 17:27:51 +03:00
Vadim
3598f39f82
Merge branch 'master' into ISSUES-2581 2018-08-21 17:24:03 +03:00
Nikolai Kochetov
b291a9694e Force update dictionary when seek to new granule. #2896 2018-08-21 17:05:50 +03:00
Vadim
8f3350216f
Merge branch 'master' into CLICKHOUSE-3847 2018-08-21 13:27:18 +03:00
VadimPE
99a26f17f6 CLICKHOUSE-3847 fix settings 2018-08-21 13:23:48 +03:00
Alexey Milovidov
9287a63180 Removed useless headers [#CLICKHOUSE-3249] 2018-08-21 06:40:47 +03:00
Alexey Milovidov
3b39f6a4c3 Split ZooKeeperExceptions to three different metrics #2316 2018-08-21 04:27:22 +03:00
VadimPE
a49cc41279 CLICKHOUSE-3847 add support old version of CH server 2018-08-21 02:08:45 +03:00
VadimPE
4064ec0bc2 CLICKHOUSE-3847 add value '1' and '2' in is_lost 2018-08-20 20:15:04 +03:00
proller
91363760ea Merge remote-tracking branch 'upstream/master' into fix3 2018-08-20 19:34:09 +03:00
Alexey Zatelepin
765b908450 change the order in which the locks are taken to make TSan happy [#CLICKHOUSE-3892] 2018-08-20 19:07:07 +03:00
proller
159cdbbb3e Try fix build (link order) 2018-08-20 18:34:37 +03:00
VadimPE
0c119d7667 CLICKHOUSE-3847 fix bugs 2018-08-20 16:31:24 +03:00
Nikolai Kochetov
391b4b5927 Merged with master. 2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
Vadim
537a8f0240
Update MergeTreeDataSelectExecutor.cpp 2018-08-14 13:03:32 +03:00
VadimPE
3c0f6ce87b ISSUES-2581 fix SELECT with select_sequential_consistency 2018-08-14 12:57:18 +03:00
Nikolai Kochetov
4a62ab9d5c Merged with master. 2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Vadim
fad1e37605
Update ReplicatedMergeTreeQueue.h 2018-08-09 19:24:37 +03:00
Vadim
a133f20b33
Update ReplicatedMergeTreeQueue.cpp 2018-08-09 19:24:03 +03:00
VadimPE
75900f494f CLICKHOUSE-3847 add "is_lost". load() in Queue can check duplicate records 2018-08-09 18:06:39 +03:00
Nikolai Kochetov
4fd3d57e79 Less compiler warnings. 2018-08-09 13:52:54 +03:00
Nikolai Kochetov
ab10005af5 Renamed settings for LowCardinality type. 2018-08-09 13:52:46 +03:00
Vadim
61338697b0
Update MergeTreeSettings.h 2018-08-08 18:28:48 +03:00
VadimPE
3b9002dfc9 CLICKHOUSE-3847 fix 2018-08-08 17:31:56 +03:00
VadimPE
4c0bb93345 CLICKHOUSE-3847 fix UInt - UInt. del clearQueue() 2018-08-08 17:07:39 +03:00
VadimPE
8d28b9f6b4 CLICKHOUSE-3847 we can do pullToLog() after we mark replica is_active and before we calc delay. 2018-08-08 16:53:06 +03:00
Nikolai Kochetov
f4d9d50168 Merged with master. 2018-08-08 15:01:18 +03:00
VadimPE
01e9d15914 CLICKHOUSE-3847 Del restartLostReplica() 2018-08-07 18:28:12 +03:00
VadimPE
0be75baeda CLICKHOUSE-3847 Del markLosrTeplicas() 2018-08-07 18:26:27 +03:00
VadimPE
32b6965cf2 CLICKHOUSE-3847 Update. Add new settings. Del is_lost 2018-08-07 18:21:42 +03:00
alexey-milovidov
72af99fdd5
Merge pull request #2814 from alesapin/master
Fix REPLACE PARTITION logic inside replicated merge tree
2018-08-06 20:18:30 +03:00
alexey-milovidov
aa4b2b1782
Update ReplicatedMergeTreeQueue.h 2018-08-06 20:18:11 +03:00
alexey-milovidov
4bfbe80d4f Update MergedBlockOutputStream.cpp 2018-08-06 19:54:00 +03:00
Alexey Zatelepin
72c4d8f064 add assert that MinMax index is correctly initialized [#CLICKHOUSE-3879] 2018-08-06 19:54:00 +03:00
Alexey Zatelepin
1f2d4f90b9 allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879] 2018-08-06 19:54:00 +03:00
alesapin
425918afe1 CLICKHOUSE-3880: Fix replace partition logic inside replicated merge tree 2018-08-06 15:59:51 +03:00
Alexey Milovidov
2016374d20 Merging #2226 2018-08-05 10:05:43 +03:00
Alexey Zatelepin
b6b54eea52 old mutations cleaner for ReplicatedMergeTree engines [#CLICKHOUSE-3828] 2018-08-03 22:21:44 +03:00
Alexey Zatelepin
a0730d7696 old mutations cleaner for non-replicated MergeTree engines [#CLICKHOUSE-3828] 2018-08-03 22:21:44 +03:00
Alexey Zatelepin
94723bea63 add setting [#CLICKHOUSE-3828] 2018-08-03 22:21:44 +03:00
alesapin
e81108b954 CLICKHOUSE-3863: Add more convinient exception message 2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1 CLICKHOUSE-3863: Add HTTPS support for interserver replication 2018-08-01 00:29:47 +03:00
VadimPE
e2be3fd5ce CLICKHOUSE-3847 fix 2018-07-31 17:11:27 +03:00
VadimPE
3eaae23559 Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847 2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e CLICKHOUSE-3847 fix problems with empty entries 2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1 CLICKHOUSE-3847 fix comments. 2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa Compatibility with obsolete version of Poco for alternative build variants #2759 2018-07-30 23:21:45 +03:00
Alexey Zatelepin
4863c5c178 fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862] 2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733 don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293 CLICKHOUSE-3847 add support lost replica 2018-07-30 19:31:14 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
Alexey Milovidov
a10ebecc67 Enabled minimalistic checksums in ZooKeeper by default #2666 2018-07-24 22:29:40 +03:00
Alex Zatelepin
41d87fdb0a fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798] 2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147 don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0 create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090 Make DatsTypeWithDictionary independent from index type. 2018-07-20 13:16:27 +03:00
alexey-milovidov
f31b1236c1 Update MergeTreeDataSelectExecutor.cpp 2018-07-16 16:44:32 +03:00
proller
0b0a2838c8 Fix compile error with boost 1.68.0 2018-07-16 16:44:32 +03:00
alexey-milovidov
68b57e605a
Merge branch 'master' into background-processing-pool-backoff 2018-07-16 06:27:43 +03:00
alexey-milovidov
4d1c470469 Update MergeTreeData.cpp 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d save mutations to disk and load them on startup [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0 execute part mutations in a background pool [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e add OPTIMIZE FINAL support for ReplicatedMergeTree. 2018-07-09 18:03:23 +03:00
Alexey Milovidov
7dc1276afe Little better #2281 2018-07-08 08:26:51 +03:00
Alexey Milovidov
0947c7808d Avoid locking while reading config to check part_log #2281 2018-07-08 07:54:37 +03:00
Alexey Milovidov
a2faa511cc Less number of "stat" calls for each INSERT into MergeTree #2281 2018-07-08 06:56:24 +03:00
Alexey Milovidov
3445c78190 Added exponential backoff for BackgroundProcessingPool #2281 2018-07-08 05:57:41 +03:00
Alex Zatelepin
f7f4f220f1 Update MergeTreeData.cpp 2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6 Recreate format_version.txt when missing 2018-07-06 15:14:23 +03:00
Alexey Zatelepin
d5f8e4a1a5 load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7 switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465 Fixed half of bad code #2571 2018-07-04 20:28:52 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700 BackgroundSchedulePool: remove task from delayed even it it is currently executing
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface. 2018-06-26 17:12:21 +03:00
Nikolai Kochetov
4f7c284d34 Fixed build. 2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299 add comments [#CLICKHOUSE-3747] 2018-06-22 13:43:35 +03:00
Alexey Zatelepin
e78dc8142c factor out common code [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1 mutations finalizing task [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d use single mutex in ReplicatedMergeTreeQueue for simplicity 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca calculate and update parts_to_do for mutations [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Nikolai Kochetov
f88584d748 Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary. 2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488)
CONTRIB-254
2018-06-19 21:09:09 +03:00
alesapin
148cbe8058 Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring. 2018-06-15 00:20:39 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
b60a2a90fa rename method for clarity 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b system.mutations table skeleton [#CLICKHOUSE-3747] 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c store mutation entries in shared_ptr 2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
ebe5e3f9b6 Reverted unclear modification #2260 2018-06-09 21:35:51 +03:00
Alexey Milovidov
d864f39ec7 Merge branch 'master' into zhang2014-feature/support_truncate 2018-06-09 19:10:06 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Alexey Milovidov
267a69fe7e Better type for number of rows [#CLICKHOUSE-2] 2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5 add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747] 2018-06-06 16:22:30 +03:00
Alexey Zatelepin
3947f25365 add general comment about the mutation algorithm [#CLICKHOUSE-3747] 2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning
Fix pruning of parts by conditions on partition key columns
2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60 Per granula reading for ColumnWithDictionary in MergeTreeRangeReader. 2018-06-05 13:10:54 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19
Build fixes
2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio
Fixes according to PVS-Studio report.
2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5 Suppressions for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:46:47 +03:00
proller
9907388766 32bit Compile fix 2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7 Slightly better (preparation) [#CLICKHOUSE-3] 2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757] 2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541 calculate primary key when mutating a part [#CLICKHOUSE-3747] 2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942 Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad add comments [#CLICKHOUSE-3747] 2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866 introduce constants for max level and max block number 2018-06-04 14:23:47 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h 2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Vitaliy Lyudvichenko
dc5de3bbec More optimal conflicts check in future_parts. [#CLICKHOUSE-2] 2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24 Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972 DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c execute mutation log entries [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782 don't select merges of parts with different mutation versions [#CLICKHOUSE-3747] 2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146 notify relevant events directly from queue [#CLICKHOUSE-3747] 2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7 load mutations from ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76 parts versioning [#CLICKHOUSE-3687] 2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf merge selection based on checking current inserts [#CLICKHOUSE-3732] 2018-05-25 23:03:56 +03:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Vitaliy Lyudvichenko
8349d2b9a0 Fixed gcc7 compilation. [#CLICKHOUSE-2] 2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa ISSUES-2259 fix the test after the merge master 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Nikolai Kochetov
9a1c286ade Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734] 2018-05-17 17:54:43 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
864dc0546b Add requested changes. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688 Better #2328 2018-05-09 07:49:34 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name 2018-05-08 15:47:06 +03:00
Alexey Zatelepin
6047db7ea2 fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag) 2018-05-07 23:31:28 +03:00
Alexey Milovidov
94369e55d3 Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:29 +03:00
Tsarkova Anastasia
2c96b1c684 Add comments. Change projection restoring function. 2018-04-29 15:49:58 +02:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
Nikolai Kochetov
7a62bb9267 added comments and fixed tests build 2018-04-23 22:41:10 +03:00
Alexey Milovidov
958a3d7ee7 Fixed error with Arrays inside Nested data type; added a test #2066 2018-04-22 20:30:28 -07:00
Nikolai Kochetov
7e45661a38 merged with master 2018-04-20 22:51:21 +03:00
Alexey Milovidov
ac48e1e911 Fixed error #2246 2018-04-20 20:34:09 +03:00
Nikolai Kochetov
a6375d6155 merged with master 2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620 fix build 2018-04-20 17:06:01 +03:00
Alexey Milovidov
6b88a2a7a5 Better info in log #2246 2018-04-20 04:14:04 +03:00
Alexey Milovidov
70be882b64 Renamed PK to Key where it's appropriate #2246 2018-04-20 03:27:25 +03:00
Alexey Milovidov
d71b3a95ef Renamed PK to Key where it's appropriate #2246 2018-04-20 03:20:50 +03:00
Alexey Milovidov
ce0ac3f8f8 Fixed error with Sets, part 2 #2246 2018-04-20 00:34:04 +03:00
Alexey Milovidov
c0978919e3 Fixed error with partition key IN, part 1 #2246 2018-04-19 23:34:02 +03:00
Alexey Milovidov
12e33cfd85 Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2] 2018-04-19 21:16:18 +03:00
Nikolai Kochetov
dd10c2073c merged with master 2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675 added IStorage::getQueryProcessingStage 2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
a55abd0a25 Fixed test [#CLICKHOUSE-2] 2018-04-18 23:27:27 +03:00
Alexey Milovidov
3eff0184fa Added set size checking when set from subquery is used for index; removed harmful feature for special support of (a, b) IN (SELECT (a, b)) instead of (a, b) IN (SELECT a, b) [#CLICKHOUSE-2] 2018-04-18 22:38:40 +03:00
alexey-milovidov
22f7a3a545
Merge pull request #2223 from sundy-li/master
Fix:ignore the format_version check when the data is empty
2018-04-17 22:50:26 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
bf832b3ea6 Fixed OPTIMIZE after RENAME of replicated table. [#CLICKHOUSE-2] 2018-04-17 20:59:42 +03:00
Nikolai Kochetov
081f0feb56 fix test [#CLICKHOUSE-3694] #2156 2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a merged with master 2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34 minor fixes 2018-04-16 18:11:13 +03:00
sundy-li
12211ffc5b Fix:ignore the format_version check when the data is empty 2018-04-16 18:04:59 +08:00
Nikolai Kochetov
41229b201b Merge branch 'master' into fix-header-for-union-stream-in-distributed-2 2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5 fix perf 2018-04-13 23:09:13 +03:00
Nikolai Kochetov
42f9a4d773 added PrewhereInfo [#CLICKHOUSE-3694] #2156 2018-04-11 22:10:08 +03:00
Nikolai Kochetov
c9abeed3f5 remove unused columns from prewhere actions [#CLICKHOUSE-3694] #2156 2018-04-11 22:08:53 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
0a4b349f73 Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664 ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2] 2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
ee7fe63b69 Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2] 2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2 Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2] 2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f fix races in leader election [#CLICKHOUSE-3533] 2018-04-06 19:10:23 +03:00
Alexey Milovidov
f66d2fb780 Allow to use FINAL even in case of single part #2086 2018-04-06 00:36:55 +03:00
Nikolai Kochetov
b96039bafe added check for partition column in mayBenefitFromIndexForIn #2170 2018-04-05 00:03:16 +03:00
alexey-milovidov
e2a517db12 Update MergeTreeData.cpp 2018-04-04 00:17:22 +03:00
Nikolai Kochetov
2163977b2a mayBenefitFromIndexForIn returns true if at least one tuple element is in pk [#CLICKHOUSE-3680] 2018-04-04 00:17:22 +03:00
Alexey Milovidov
08170d0d77 Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
KochetovNicolai
62e6a1bde6
Update MergeTreeBaseBlockInputStream.cpp
Check is block is not empty before removing prewhere column
2018-04-02 17:08:05 +03:00
proller
440b0f33c7 Compile fixes 2018-04-02 15:31:49 +03:00
Alexey Milovidov
3fe743e2bd Fixed error after merge [#CLICKHOUSE-2] 2018-04-01 22:29:08 +03:00
alexey-milovidov
b07fb1ddda
Merge branch 'master' into better-range-reader 2018-04-01 22:16:39 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite 2018-04-01 17:31:20 +03:00
alexey-milovidov
2e15ce6791
Merge pull request #2132 from yandex/small-enhancements
Small enhancements
2018-03-29 03:07:49 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
Vitaliy Lyudvichenko
701b58b4ff Faster DROP PARTITION. [#CLICKHOUSE-2] 2018-03-28 15:48:40 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
Silviu Caragea
1418e339e4 Rename merge_selecting_handle with merge_selecting_task_handle for consistency 2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6) 2018-03-26 23:12:17 +03:00
Silviu Caragea
438121e45b Renamed Zookeeper get method with getWatch for consistency 2018-03-26 23:08:14 +03:00
Silviu Caragea
50992843c6 Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) 2018-03-26 22:59:58 +03:00
Silviu Caragea
4361df913b Remove exists and use existsWatch instead for WatchCallbacks 2018-03-26 22:46:14 +03:00
Silviu Caragea
31874ed172 Use consistent names for the task variables 2018-03-26 22:37:47 +03:00
Alex Zatelepin
c5b04f7f17 Add info about total uncompressed part size to system tables (#2052)
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]

* rename for clarity

* use more appropriate method for calculating table size

* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]

* rename columns for clarity [#CLICKHOUSE-2831]

* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Milovidov
522bf01db9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
Alexey Milovidov
58f32f98d7 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
KochetovNicolai
aacc0bee53
Merge pull request #2097 from yandex/CLICKHOUSE-3663
Clickhouse 3663
2018-03-23 14:56:08 +03:00
Nikolai Kochetov
2f468f1ae1 fix test [#CLICKHOUSE-3663] 2018-03-23 13:50:20 +03:00
alexey-milovidov
cf52c2840a
Merge branch 'master' into better-range-reader 2018-03-23 02:14:40 +03:00
Alexey Milovidov
0a06971e43 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-23 02:10:00 +03:00
alexey-milovidov
a75d5525e7 Update MergeTreeDataPartChecksum.h 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
883de7a2a6 startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2] 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038 Add minimalistic checksums. [#CLICKHOUSE-3660] 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
7c2a99c9b8 Introduced MinimalisticDataPartChecksums. [#CLICKHOUSE-3660] 2018-03-23 00:26:46 +03:00
Nikolai Kochetov
cbfd862fa3 fix reading with evaluated defaults [#CLICKHOUSE-3663] 2018-03-22 23:18:11 +03:00
Nikolai Kochetov
97624d7d78 fix reading with evaluated defaults [#CLICKHOUSE-3663] 2018-03-22 22:53:19 +03:00
Silviu Caragea
a2dc16a582 Remove the link between TaskHandles and ZooKeeper 2018-03-22 17:21:14 +02:00
Silviu Caragea
6629b03af9 Fixed few of the observation of the code review 2018-03-22 17:09:30 +02:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
d690c24198 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 00:40:53 +03:00
Nikolai Kochetov
476d4b339c Immutable construction for columns 2018-03-20 22:45:10 +03:00
Alexey Milovidov
02c67e2b13 Fixed error [#CLICKHOUSE-2] 2018-03-16 09:51:37 +03:00
alexey-milovidov
b9339e0ea1
Merge pull request #2053 from yandex/small-enhancements
Small enhancements
2018-03-15 22:10:29 +03:00
alexey-milovidov
1e88f2fe5c
Update AbandonableLockInZooKeeper.h 2018-03-15 22:06:53 +03:00
alexey-milovidov
e64b2df874
Update ReplicatedMergeTreeBlockOutputStream.cpp 2018-03-15 22:06:23 +03:00
alexey-milovidov
1554390bab
Update AbandonableLockInZooKeeper.h 2018-03-15 22:05:58 +03:00
Vitaliy Lyudvichenko
16dad209f7 Do not make extra ZK RTTs in inserts. [#CLICKHOUSE-3]
Resolves #2054
2018-03-15 21:40:59 +03:00
Vitaliy Lyudvichenko
f1b32e8982 Fixed ordinary MergeTree merges in case of empty ORDER BY key. [#CLICKHOUSE-2] 2018-03-14 23:49:18 +03:00
alexey-milovidov
e5836cf97f
Merge pull request #2036 from yandex/CLICKHOUSE-3639
Fixed ZooKeeper with chroot, refactoring of ZooKeeper::multi*
2018-03-14 21:56:22 +03:00
Vitaliy Lyudvichenko
7abbe093e9 Avoid magic constants in system.parts. [#CLICKHOUSE-3]
Resolves #2039
2018-03-14 19:04:19 +03:00
Vitaliy Lyudvichenko
56bfb05ebb Fix insane DateTime in system.parts. [#CLICKHOUSE-3] 2018-03-14 19:00:02 +03:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Alexey Milovidov
c9d1b61ef7 Fixed build after merge #2029 2018-03-14 06:19:23 +03:00
Alexey Zatelepin
5906c9a988 rename for clarity 2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac encapsulate ColumnsDeclaration [#CLICKHOUSE-3241] 2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
972db7b072 iterate over materialized columns where it makes sense 2018-03-12 22:07:48 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
Nikolai Kochetov
532b57aef8 perf. fixes 2018-03-07 01:05:36 +03:00
Alex Zatelepin
90ea45a397
better exception message [#CLICKHOUSE-3599] 2018-03-06 22:01:45 +03:00
Alexey Zatelepin
ec91d29d6a correct MergingParams columns check [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Nikolai Kochetov
b2b1588d5f added FilterWithZerosCounter 2018-03-05 17:25:20 +03:00
Nikolai Kochetov
8b01ec2225 Merge branch 'master' into better-range-reader 2018-03-05 15:55:06 +03:00
Alexey Milovidov
91a6a88102 Explicit semantic for TSan [#CLICKHOUSE-2] 2018-03-03 21:00:46 +03:00
Alexey Milovidov
07d8db9f2a Explicit semantic for TSan [#CLICKHOUSE-2] 2018-03-03 20:44:53 +03:00
Alexey Milovidov
368f46d764 Addition to prev. revision [#CLICKHOUSE-2] 2018-03-03 19:48:24 +03:00
Alexey Milovidov
2e371822ad Changed low level data race to high level data race [#CLICKHOUSE-2] 2018-03-03 19:46:32 +03:00
Alexey Milovidov
3b0d713120 Cleanup semantics [#CLICKHOUSE-2] 2018-03-03 19:26:06 +03:00
Alexey Milovidov
c897e5ca39 Better [#CLICKHOUSE-2] 2018-03-03 18:36:20 +03:00
Alexey Milovidov
bf924d1c9d Better name [#CLICKHOUSE-2] 2018-03-02 21:51:59 +03:00
Nikolai Kochetov
7851e71a2a fix continueReadingChain from several mark ranges 2018-03-02 16:05:33 +03:00
Alexey Milovidov
601ff1eee4 Simplification of AST #1947 2018-02-26 06:37:08 +03:00
Alexey Milovidov
2b974554e5 Fixed test [#CLICKHOUSE-2] 2018-02-24 04:55:43 +03:00
Alexey Milovidov
cae7f96f34 Simplification [#CLICKHOUSE-2] 2018-02-23 13:02:29 +03:00
alexey-milovidov
82fa3883f8
Merge pull request #1930 from yandex/nonblocking-precommitted
Allow PreCommitted parts to contain each other
2018-02-22 23:35:16 +03:00
Nikolai Kochetov
976d2a49fe merged with master 2018-02-22 14:54:26 +03:00
Nikolai Kochetov
733156438a fix continueReadingChain from several mark ranges 2018-02-22 14:35:06 +03:00
Nikolai Kochetov
39f16b66b5 fix continueReadingChain from several mark ranges 2018-02-22 14:31:15 +03:00
alexey-milovidov
ee41f7000f
Merge pull request #1940 from yandex/CLICKHOUSE-3571
Try to reduce false positive of sanity check
2018-02-22 01:59:33 +03:00
alexey-milovidov
d4dcb9412c
Merge pull request #1941 from yandex/unsorted-mergetree
Fix MergeTree idiosyncrasies
2018-02-22 00:36:59 +03:00
Alexey Zatelepin
610f70fbeb forbid non-deterministic functions in primary and partition keys [#CLICKHOUSE-3455] 2018-02-21 20:54:16 +03:00
Vitaliy Lyudvichenko
47becc0b92 Try to reduce false positive of sanity check. More detail dignostics. [#CLICKHOUSE-3571] 2018-02-21 20:06:29 +03:00
Alexey Zatelepin
6fdf82e452 allow the primary key and the partition key to use the same expression [#CLICKHOUSE-3455] 2018-02-21 18:43:24 +03:00
Alexey Zatelepin
e3422ea52e MergeTree without primary key [#CLICKHOUSE-3462] 2018-02-21 17:50:26 +03:00
Alexey Milovidov
aad0c62e67 Fixed error [#CLICKHOUSE-2] 2018-02-21 08:11:53 +03:00
Alexey Milovidov
652dfc8c36 Fixed error [#CLICKHOUSE-2] 2018-02-21 07:18:08 +03:00
Alexey Milovidov
a69bd2220a Merge branch 'master' into header-in-output-streams 2018-02-21 04:41:09 +03:00
Alexey Milovidov
3dd665179e Fixed error with components of Nested data structures without data and PREWHERE filtering [#CLICKHOUSE-3608] 2018-02-21 04:16:09 +03:00
Tsarkova Anastasia
d99d01ac3a Fix data types for key_ranges 2018-02-20 23:03:15 +03:00
Nikolai Kochetov
ba81835e58 fixed progress stats 2018-02-20 17:26:22 +03:00
Nikolai Kochetov
36fe36d003 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 16:59:19 +03:00
Alexey Zatelepin
da87abc422 fix condition for the 'intersects previous part' log message 2018-02-20 16:59:01 +03:00
Alexey Zatelepin
53b5c5f54c add check for intersecting parts when adding new parts 2018-02-20 16:58:41 +03:00
Nikolai Kochetov
2bf1931d86 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 16:37:04 +03:00
Alexey Zatelepin
5bc6bd55b1 allow PreCommitted parts to contain each other, clean up code 2018-02-20 16:33:28 +03:00
Nikolai Kochetov
dcd99860fe updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 16:30:47 +03:00
Nikolai Kochetov
3063c35429 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 16:23:56 +03:00
Nikolai Kochetov
d8b5f14dd7 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 15:26:09 +03:00
Nikolai Kochetov
d2d0d570d8 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 15:09:32 +03:00
Nikolai Kochetov
77a3989558 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 15:02:25 +03:00
Nikolai Kochetov
58b6b7570f updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 14:54:32 +03:00
Nikolai Kochetov
af6895ee6f updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 14:50:33 +03:00
Nikolai Kochetov
ce70d4faa9 updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader 2018-02-20 14:45:58 +03:00
Nikolai Kochetov
af9ac7b48b merged with master 2018-02-20 12:27:47 +03:00
Nikolai Kochetov
82c76d8467 added MergeTreePrewhereRangeReader 2018-02-20 12:23:02 +03:00
Alexey Milovidov
d0bfa15525 Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2] 2018-02-19 20:31:49 +03:00
Alexey Milovidov
7ff1346685 Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2] 2018-02-19 20:31:30 +03:00
Alexey Milovidov
74c56c2def Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 06:56:08 +03:00
Alexey Milovidov
fa50fe80a0 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 03:45:32 +03:00
alexey-milovidov
d73080640d
Merge pull request #1921 from yandex/header-in-input-streams
Header in input streams
2018-02-18 07:58:04 +03:00
Alexey Milovidov
afe09d3138 Removed unused code [#CLICKHOUSE-2] 2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2] 2018-02-18 06:23:48 +03:00
Alexey Milovidov
df4853a13a Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 03:37:22 +03:00
Alexey Milovidov
ff235fc506 Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 00:08:21 +03:00
Alexey Milovidov
dba529d674 Header in every stream: development [#CLICKHOUSE-2] 2018-02-17 07:13:49 +03:00
Alexey Milovidov
fb0920ff98 Whitespace [#CLICKHOUSE-2] 2018-02-17 01:33:46 +03:00
Alexey Milovidov
264e6cbc84 Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 00:31:09 +03:00
Alexey Milovidov
921e09b5f8 Merge branch 'master' into header-in-input-streams 2018-02-15 19:20:36 +03:00
Nikolai Kochetov
7c69ecb3ef fix test [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
90d67d4e8a added test for moving partition from collapsing to versioned collapsing merge tree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
36de8a2911 added secondary sort expression [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
64b3a8baa7 added secondary sort expression [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
40ef753992 added VersionedCollapsingMergeTree to help message [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a added MultiversionMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Alexey Milovidov
c104566eb8 Fixed performance regression in usage of COWPtr in complex cases [#CLICKHOUSE-3584]. 2018-02-12 23:10:24 +03:00
alexey-milovidov
8fb9967903
Merge pull request #1879 from yandex/lambdas-without-prerequisites
Lambdas without prerequisites
2018-02-09 22:22:58 +03:00
Nikolai Kochetov
e02ca10b9a merged with master 2018-02-08 20:46:22 +03:00
alexey-milovidov
2e115dff1b
Merge pull request #1823 from chenxing-xc/master
fix endless query issue
2018-02-08 20:41:52 +03:00
alexey-milovidov
bca723b06b
Update MergeTreeBaseBlockInputStream.cpp 2018-02-08 20:41:36 +03:00
alexey-milovidov
1d8cfa351d
Update MergeTreeBaseBlockInputStream.cpp 2018-02-08 20:40:23 +03:00
Nikolai Kochetov
27179b375a removed prerequisites [#CLICKHOUSE-3550] 2018-02-08 20:18:52 +03:00
Nikolai Kochetov
583ff32fe8 changed IFunction 2018-02-08 20:18:15 +03:00
Alexey Milovidov
953ab16cde Miscellaneous #1853 2018-02-08 18:31:37 +03:00
Alexey Milovidov
777b4404bd Fixed build #1853 2018-02-08 18:25:46 +03:00
Tsarkova Anastasia
5ecd50ff44 Adding comments. Reversing infinities. 2018-02-08 17:28:31 +03:00
Tsarkova Anastasia
938cb2b57a Considering set first. 2018-02-07 18:29:00 +03:00
Tsarkova Anastasia
c50ccabb0a Implement MergeTree index using for IN operator with tuple of columns. 2018-02-07 18:29:00 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
4665201827 Add metric for duplicated inserts. [#CLICKHOUSE-2] 2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a Better system.part_log. [#CLICKHOUSE-3342] 2018-01-25 21:40:02 +03:00
chenxing.xc
be85910088 fix endless query issue #1769 2018-01-26 00:44:47 +08:00
Vitaliy Lyudvichenko
26e58271e9 Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2] 2018-01-25 17:42:39 +03:00
alexey-milovidov
b8cb9267c7
Merge pull request #1804 from arkhipov/master
Replace subqueries and table expressions on the right side of the IN …
2018-01-23 22:31:49 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e Make early deduplication with block number creation. [#CLICKHOUSE-3545] 2018-01-23 18:50:29 +03:00
Vlad Arkhipov
6738d6a995 Add comments. Improve method names. 2018-01-23 11:18:12 +03:00
Vlad Arkhipov
be96cf5133 Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index. 2018-01-21 11:22:52 +03:00
Alexey Milovidov
9a02d4f5ff Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-01-20 04:20:40 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
f770156b0b
Update MergeTreeDataMerger.cpp 2018-01-19 21:42:22 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
Small enhancements
2018-01-16 22:07:43 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
5d5ed63e8c Better error message. [#CLICKHOUSE-2] 2018-01-15 20:30:16 +03:00
Vitaliy Lyudvichenko
03bca2144d OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
Resolves #1753
2018-01-15 13:13:18 +03:00
Alexey Milovidov
550053a0ca Merge branch 'master' into header-in-input-streams 2018-01-10 03:05:51 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Nikolai Kochetov
cbeeb84999 added http_*_timeout settings [#CLICKHOUSE-3440] 2018-01-09 21:41:01 +03:00
alexey-milovidov
890ad92f90
Merge pull request #1627 from yandex/table-system-parts_columns
Table system.parts_columns
2018-01-09 21:33:55 +03:00
alexey-milovidov
2a7024ba5a Update MergeTreeData.cpp 2018-01-09 21:01:26 +03:00
alexey-milovidov
1292d14185 Update MergeTreeData.cpp 2018-01-09 21:01:26 +03:00
zhang2014
517958ab09 ISSUES-1369 fix typo 2018-01-09 21:01:26 +03:00
zhang2014
be966015c9 ISSUES-1369 add check when create Replacing & Collapsing 2018-01-09 21:01:26 +03:00
Alexey Milovidov
5081f276d1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 04:51:08 +03:00
Alexey Milovidov
9996e181e1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-06 21:10:44 +03:00
Alexey Milovidov
ffca152c45 Inverted dependencies in StorageFactory [#CLICKHOUSE-2]. 2017-12-30 07:00:39 +03:00
Alexey Milovidov
7244514859 Less dependencies in StorageFactory: development [#CLICKHOUSE-2]. 2017-12-30 07:00:39 +03:00
Nikolai Kochetov
ea41197c51 merger with master 2017-12-28 21:20:53 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
4cde48fb20 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-28 01:40:42 +03:00
Alexey Milovidov
b79aa5db4e Update documentation about required ZK version; Miscellaneous #1458 2017-12-27 21:34:58 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
Alexey Zatelepin
280c147a89 remove dependency to StorageReplicatedMergeTree [#CLICKHOUSE-2] 2017-12-26 22:15:15 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0 Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2]. 2017-12-25 21:58:39 +03:00
Alexey Zatelepin
c3348e27a4 shorter [#CLICKHOUSE-2] 2017-12-25 20:31:14 +03:00
proller
fb7047bfe8 Fix 32bit build 2017-12-25 20:17:32 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb Whitespace [#CLICKHOUSE-2]. 2017-12-21 20:43:32 +03:00
Alexey Milovidov
584a263d79 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Alexey Zatelepin
c422b5b2e4 take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508] 2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95 add comments [#CLICKHOUSE-3508] 2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8 check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508] 2017-12-20 20:04:14 +03:00
Alexey Milovidov
32fcc7b3f0 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 09:23:19 +03:00
Alexey Milovidov
11d3b9c710 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 08:37:20 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
6ad5be5eee Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 10:15:13 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
ecd56de6a8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:11:24 +03:00
Alexey Milovidov
c4bbc1c963 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 23:48:46 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
71116c4d82 Fixed error [#CLICKHOUSE-2]. 2017-12-09 20:16:24 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
8cc0bae1bc Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 02:07:41 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
e776a4fc67 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 07:26:30 +03:00
alexey-milovidov
b7f656d289
Merge pull request #1541 from yandex/fix-replica-queue-load
Add idempotent retries of updating the replica queue in ZooKeeper
2017-12-05 00:16:03 +03:00
Alexey Milovidov
7e2100d7f7 Fixed exception message [#CLICKHOUSE-2]. 2017-12-04 23:37:28 +03:00
proller
826936cf9b
Better fix of std::numeric_limits<__uint128_t> (#1585)
* Fix std::numeric_limits<__uint128_t>

* clean

* Better fix of std::numeric_limits<__uint128_t>
2017-12-04 19:12:56 +03:00
Nikolai Kochetov
de62ae6b1b added system.parts_columns as a copy of system.parts [#CLICKHOUSE-3328] 2017-12-04 18:44:31 +03:00
proller
4c3dfb97df
Clang: Fix std::numeric_limits<__uint128_t> (#1583)
Fix std::numeric_limits<__uint128_t>
2017-12-04 16:03:40 +03:00
Alexey Milovidov
06dfe7f562 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 08:55:49 +03:00
Alexey Milovidov
a80259d0cb Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:57:33 +03:00
Alexey Milovidov
418e5012e7 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:43:38 +03:00
Alexey Milovidov
3717d80017 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:40:21 +03:00
Alexey Milovidov
c472172fa8 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:25:41 +03:00
Alexey Milovidov
a597f3e7d9 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:23:03 +03:00
Alexey Milovidov
3786786aeb Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 07:19:46 +03:00
Alexey Milovidov
294c0ba5cf Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 06:43:48 +03:00
Alexey Milovidov
ab022d0882 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 05:59:59 +03:00
Alexey Milovidov
1aa99092c3 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 05:15:35 +03:00
Alexey Milovidov
a9ddaa2b19 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 04:49:54 +03:00
Alexey Milovidov
a813287afd Rewrite MergeTreePartChecker [#CLICKHOUSE-2838]. 2017-12-03 03:48:19 +03:00
Alexey Milovidov
464d962010 Rewrite MergeTreePartChecker [#CLICKHOUSE-2838]. 2017-12-03 03:46:34 +03:00
Alexey Milovidov
5510bea3f8 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-12-03 01:12:27 +03:00
Alexey Milovidov
b932a193e2 Better [#CLICKHOUSE-2]. 2017-12-02 06:25:52 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
a85773bdbc Fixed error [#CLICKHOUSE-2838]. 2017-12-02 00:30:43 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
1efef27af9 Better [#CLICKHOUSE-2] 2017-12-01 23:38:50 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index 2017-12-01 19:53:04 +03:00
Alexey Milovidov
98291f1a24 Cleanups [#CLICKHOUSE-2838]. 2017-12-01 17:21:24 +03:00
Alexey Milovidov
6fb18a7dc2 Added comments [#CLICKHOUSE-2838]. 2017-12-01 17:15:38 +03:00
Alexey Milovidov
d4089695ad Cleanups [#CLICKHOUSE-2838]. 2017-12-01 16:32:37 +03:00
Vitaliy Lyudvichenko
ddb02d8ccf Small enhancements. [#CLICKHOUSE-3452] 2017-11-29 14:54:37 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Alexey Milovidov
7b4bffe088 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-29 02:31:21 +03:00
Alexey Zatelepin
01d42242b1 mark queue as dirty if status of ZK operation is unknown [#CLICKHOUSE-3405] 2017-11-28 17:09:53 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
Alexey Milovidov
6266ecc5ed Miscellaneous [#CLICKHOUSE-2]. 2017-11-25 02:03:58 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
859bf86a43 Fixed error found by ASan with debug libc++ (actually not dangerous) [#CLICKHOUSE-2]. 2017-11-23 18:24:55 +03:00
Alexey Zatelepin
78aaa42ddd add idempotent retries of updating the replica queue in ZooKeeper [#CLICKHOUSE-3405] 2017-11-23 16:19:29 +03:00
Alexey Milovidov
e15d637714 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:12:09 +03:00
Alexey Milovidov
4bf120b285 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:11:16 +03:00
Alexey Milovidov
4bc98c9253 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:25:36 +03:00
Alexey Milovidov
63f79b7b4f Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:23:41 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:07 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
fd3239dd46 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 07:18:27 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
8e6466454a Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 05:15:15 +03:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
Alexey Milovidov
6c8b5e29d8 Additions after merge [#CLICKHOUSE-2]. 2017-11-20 00:17:58 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
Alexey Milovidov
94d3b49e99 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:27:43 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
ac1b69247c Addition to prev. revision [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Milovidov
783e812eb7 Fixed error [#CLICKHOUSE-2] 2017-11-04 19:46:14 +03:00
proller
c974f0e88e Merge remote-tracking branch 'upstream/master' into fix4 2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko
9cf14d2c61 Remove obsolete code. [#CLICKHOUSE-2] 2017-11-02 17:35:12 +03:00
proller
6da4f5a661 add locks 2017-11-01 22:56:07 +03:00
proller
3b58e9cd67 Fix atomic usage 2017-11-01 20:15:05 +03:00
proller
c5dcde0c78 fix atomic usage 2017-11-01 16:58:02 +03:00
Alexey Milovidov
6aff58c747 Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2]. 2017-11-01 04:45:10 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Vitaliy Lyudvichenko
602560cb2e Update system.parts table. [#CLICKHOUSE-3178] 2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
483dfd1b44 Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf Fixed awful copypaste. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421 Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088 Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257 Add state for MergeTree parts. [#CLICKHOUSE-3178]
And Removed obsolete code.
2017-10-26 17:16:06 +03:00