thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-09 18:10:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
36,125 Commits 8,985 Branches 1,770 Tags 2.1 GiB
f54ade41f2
Commit Graph

227 Commits

Author SHA1 Message Date
alesapin
e7542810bb Merge with master 2019-08-19 11:20:48 +03:00
alesapin
defc1e30ca Some improvements 2019-08-16 18:57:19 +03:00
alesapin
6333f4b074 Better 2019-08-16 12:20:44 +03:00
alesapin
d81961c4ca Fix strange code 2019-08-15 12:43:31 +03:00
alesapin
e391ce813d refactoring 2019-08-14 18:20:52 +03:00
alesapin
949890ee90 Merged 2019-08-14 12:46:30 +03:00
alesapin
ad81c743c1 Buildable code 2019-08-13 13:29:31 +03:00
Nikita Vasilev
7b8c0f1750 experiment 2019-08-05 21:06:05 +03:00
Nikita Vasilev
4a39538625 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-08-04 16:58:21 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Igr Mineev
fc79ed86ef Ready for review 2019-08-01 13:29:14 +03:00
Nikita Vasilev
63fe714420 fix 2019-07-28 14:10:35 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them. 
Though in regular merges eviction of expired values still must happen.
 2019-07-28 13:30:46 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
Igr Mineev
e967c23adb Add Space interface for reservation. Add move to volume command 2019-07-23 16:34:17 +03:00
Igr Mineev
90fab48cd7 Stylefixes 2019-07-16 14:07:04 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default 
Enable adaptive index granularity by default
 2019-07-03 02:15:33 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits 
Ignore query execution limits and limits for max parts size for merge while executing mutations.
 2019-06-21 02:14:41 +03:00
Igr Mineev
23049ac9e8 Add mergetree part move in background. 2019-06-19 20:56:41 +03:00
alesapin
d1de7431e1 Compilable 2019-06-19 13:26:26 +03:00
alesapin
b544b62e44 A log of bugs 2019-06-19 13:07:56 +03:00
alesapin
4f98f875c3
Add ability to write final mark for *MergeTree engines family (#5624) 
Add the ability to write final mark to *MergeTree engines family.
 2019-06-18 15:54:27 +03:00
CurtizJ
e6dd92f9e1 ignore max part size for merge setting while executing mutations 2019-06-17 22:41:48 +03:00
Igr Mineev
842c72bb6d Merge branch 'master' into feature_multiple_disks 2019-06-09 15:38:54 +03:00
proller
1b0d1a4450 Info about frozen parts in system.parts (#5471) 
* wip

*    wip

* wip

* Clean

* fix test

* clean

* fix test

* fix test
 2019-05-31 07:03:46 +03:00
Igor Mineev
15ee6207ab Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables. 2019-05-24 22:03:07 +03:00
Igor Mineev
4f61c9d30f Const Schema fix 2019-05-22 22:20:10 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Igor Mineev
af300c667b Bugfix 2019-05-11 23:44:43 +03:00
Nikita Vasilev
6c0722db04 fix mutations with parts 2019-05-09 20:27:20 +03:00
Nikita Vasilev
18593391b4 materialize query 2019-05-05 21:53:48 +03:00
Nikita Vasilev
27aeb3a36d fix 2019-05-05 21:19:07 +03:00
Nikita Vasilev
87131d9e99 fix 2019-05-05 15:17:30 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
Nikita Vasilev
11d2785e8e parts drop 2019-05-05 10:59:07 +03:00
Igor Mineev
8edcae5530 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-04-24 15:35:08 +03:00
Igor Mineev
79abe85328 New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor 2019-04-21 21:38:44 +03:00
Nikita Vasilev
8e8c77a46b added indices to mutationsInterpreter 2019-04-17 20:07:07 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
Igor Mineev
7824aa528f Add Schemes to config. Parse scheme as default on MergeTreeData init 2019-04-04 20:19:11 +03:00
Igor Mineev
0441480502 Storage getDataPath -> getDataPaths 2019-04-04 16:13:59 +03:00
Igor Mineev
341e3f1c5b Add space reservation for each new MargeTreeDataPart. 2019-04-03 15:52:09 +03:00
Igor Mineev
8047d16a96 Add Path chooser. Add DiskMonitort multiple disks support 2019-04-01 21:41:19 +03:00
alesapin
78e09a221a Remove debug prints, little refactoring 2019-03-30 17:43:43 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
2dfd6779f6 Remove exception 2019-03-26 12:46:09 +03:00
alesapin
c0e29d3fb4 Fix first time read from mark 2019-03-25 19:55:48 +03:00
alesapin
aba51a11ba Large refactoring (only compilable) 2019-03-25 16:55:24 +03:00
alesapin
5aea16e2a0 Fix mutations bug 2019-03-22 15:56:58 +03:00
alesapin
ef5162e2e3 Some fixes 2019-03-20 23:01:15 +03:00
alesapin
fb555359e7 Read by block size only in case of Vertical merge 2019-03-20 20:20:10 +03:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
Alexey Milovidov
d558cf345c Faster calcelling of vertical merges 2019-02-12 22:04:13 +03:00
Alexey Zatelepin
3ec6f508f1 Merge branch 'master' into mutations-introspection 
Conflicts:
	dbms/src/Interpreters/InterpreterKillQueryQuery.cpp
 2019-02-06 15:22:48 +03:00
Alexey Zatelepin
ca93fd483a kill ordinary MergeTree mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:10 +03:00
Alexey Zatelepin
5832e474a4 is_mutation flag in system.merges [#CLICKHOUSE-3912] 2019-02-05 21:09:05 +03:00
Alexey Zatelepin
92a4342c31 system.merges element for mutations [#CLICKHOUSE-3912] 2019-02-05 21:09:00 +03:00
Nikita Vasilev
a1b0dede07 Data Skipping Indices (#4143) 
* made index parser

* added index parsing

* some fixes

* added index interface and factory

* fixed compilation

* ptrs

* added indexParts

* indextypes

* index condition

* IndexCondition

* added indexes in selectexecutor

* fix

* changed comment

* fix

* added granularity

* comments

* fix

* fix

* added writing indexes

* removed indexpart class

* fix

* added setSkipIndexes

* add rw for MergeTreeIndexes

* fixes

* upd error

* fix

* fix

* reading

* test index

* fixed nullptr error

* fixed

* fix

* unique names

* asts -> exprlist

* minmax index

* fix

* fixed select

* fixed merging

* fixed mutation

* working minmax

* removed test index

* fixed style

* added indexes to checkDataPart

* added tests for minmax index

* fixed constructor

* fix style

* fixed includes

* fixed setSkipIndexes

* added indexes meta to zookeeper

* added parsing

* removed throw

* alter cmds parse

* fix

* added alter

* fix

* alters fix

* fix alters

* fix "after"

* fixed alter

* alter fix + test

* fixes

* upd setSkipIndexes

* fixed alter bug with drop all indices

* fix metadata editing

* new test and repl fix

* rm test files

* fixed repl alter

* fix

* fix

* indices

* MTReadStream

* upd test for bug

* fix

* added useful parsers and ast classes

* fix

* fix comments

* replaced columns

* fix

* fixed parsing

* fixed printing

* fix err

* basic IndicesDescription

* go to IndicesDescr

* moved indices

* go to indicesDescr

* fix test minmax_index*

* fixed MT alter

* fixed bug with replMT indices storing in zk

* rename

* refactoring

* docs ru

* docs ru

* docs en

* refactor

* rename tests

* fix docs

* refactoring

* fix

* fix

* fix

* fixed style

* unique idx

* unique

* fix

* better minmax calculation

* upd

* added getBlock

* unique_condition

* added termForAST

* unique

* fixed not

* uniqueCondition::mayBeTrueOnGranule

* fix

* fixed bug with double column

* is always true

* fix

* key set

* spaces

* test

* tests

* fix

* unique

* fix

* fix

* fixed bug with duplicate column

* removed unused data

* fix

* fixes

* __bitSwapLastTwo

* fix
 2019-02-05 17:50:25 +03:00
Ivan Lezhankin
05ab15cc84 Merge IBlockInputStream and IProfilingBlockInputStream into one 2019-01-23 17:48:50 +03:00
maiha
6c83beafdd dbms: Fixed misspells in comments 2019-01-23 04:56:53 +09:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
alexey-milovidov
d16447c3f4
Merge pull request #3899 from yandex/custom_compression_codecs 
Custom compression codecs
 2018-12-28 08:29:09 +03:00
Alexey Milovidov
882531b9c0 Fixed UB #3926 2018-12-27 04:40:00 +03:00
Alexey Milovidov
589d07860f Fixed UB #3926 2018-12-27 04:12:18 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
alesapin
aee6c0a606 Remove dump code 2018-12-20 20:37:02 +03:00
proller
3a9bd8a773 Fix macos build 2018-12-17 17:10:23 +03:00
alesapin
7925abcd74 Deep debugging 2018-12-04 17:44:42 +03:00
alesapin
bf338b957f Merge master 2018-12-03 12:10:06 +03:00
alexey-milovidov
48b30edcf5
Merge branch 'master' into alter-order-by 2018-12-02 21:06:38 +03:00
alesapin
5524b77915 Compilable code! 2018-11-30 18:36:10 +03:00
alesapin
b2fd3e804a Add special logic for alter 2018-11-29 14:55:34 +03:00
alesapin
e2e88324d0 Rename MergeTree streams for select 2018-11-29 12:19:42 +03:00
alesapin
b7cdd8fe7f Trying to simplify merge reading logic 2018-11-28 18:05:28 +03:00
Alexey Zatelepin
d3d9242462 Merge branch 'master' into alter-order-by 
Conflicts:
	dbms/src/Parsers/ASTAlterQuery.h
	dbms/src/Parsers/ParserAlterQuery.cpp
	dbms/src/Storages/AlterCommands.cpp
	dbms/src/Storages/AlterCommands.h
 2018-11-26 16:01:48 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
Alexey Zatelepin
2cc0aae82c rearrange AST members in MergeTreeData [#CLICKHOUSE-3859] 2018-11-13 16:15:17 +03:00
Alexey Zatelepin
f4c26e78d2 renames [#CLICKHOUSE-3859] 2018-11-13 16:13:01 +03:00
Alexey Zatelepin
0fa86162d9 separate sorting key and primary key, allow setting primary key separately [#CLICKHOUSE-3859] 2018-11-13 16:12:55 +03:00
Alexey Zatelepin
9a92c0a55c sort key is distinct from primary key [#CLICKHOUSE-3859] 2018-11-13 16:12:49 +03:00
Alexey Milovidov
98543b7c41 Fixed vertical merge of multidimensional Nested structures [#CLICKHOUSE-3901] 2018-10-17 00:22:41 +03:00
Alexey Zatelepin
230a9fff2d Write the columns list of the resulting part in the same order as all_columns [#CLICKHOUSE-13] 2018-09-21 15:40:34 +03:00
Alexey Zatelepin
0ec0a24bc9 fix use of temp variable after it gets out of scope 2018-09-20 16:55:22 +03:00
Alexey Zatelepin
b7cb8d1ae1 write correct columns list when UPDATEd part doesn't contain all columns [#CLICKHOUSE-13] 2018-09-19 16:04:52 +03:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update 
ALTER UPDATE
 2018-09-13 06:03:35 +03:00
alesapin
17a8fb86dc CLICKHOUSE-3970: Rename variable 2018-09-12 21:19:47 +03:00
alesapin
c38e3e7890 CLICKHOUSE-3970: Add logging 2018-09-12 20:28:59 +03:00
alesapin
1664bec008 CLICKHOUSE-3970: Add setting for O_DIRECT for big merges 2018-09-12 20:19:52 +03:00
Alexey Zatelepin
133c9c7c37 Merge branch 'master' into alter-update 
Conflicts:
	docs/en/query_language/alter.md
 2018-09-07 19:11:02 +03:00
Alexey Zatelepin
6275bfd8cd fix CollapsingMergeTree + vertical merge [#CLICKHOUSE-3963] 
don't skip writing to rows sources even if all rows have collapsed.
 2018-09-05 20:19:51 +03:00
Alexey Zatelepin
acc1a84827 better name [#CLICKHOUSE-13] 2018-09-05 15:54:03 +03:00
Alexey Zatelepin
d4d1020798 execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13] 2018-09-03 22:34:49 +03:00
Alexey Zatelepin
e9493b3a5f use hard links to copy columns that didn't change [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
Alexey Zatelepin
dc2a4c21e9 execute ALTER UPDATE [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
Alexey Zatelepin
f592aa84d1 fix vertical merge for empty parts [#CLICKHOUSE-3913] 2018-08-23 15:04:30 +03:00
Alexey Zatelepin
5c748bfdce fix bug when MATERIALIZED columns were not selected during mutation #2900 [#CLICKHOUSE-3911] 2018-08-22 15:45:24 +03:00
Alexey Zatelepin
765b908450 change the order in which the locks are taken to make TSan happy [#CLICKHOUSE-3892] 2018-08-20 19:07:07 +03:00
Nikolai Kochetov
391b4b5927 Merged with master. 2018-08-20 15:25:06 +03:00
Alexey Zatelepin
1f2d4f90b9 allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879] 2018-08-06 19:54:00 +03:00
Alexey Milovidov
2016374d20 Merging #2226 2018-08-05 10:05:43 +03:00
Alexey Zatelepin
0fed05d25b use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147 don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0 create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Amos Bird
ea01a3b22e add OPTIMIZE FINAL support for ReplicatedMergeTree. 2018-07-09 18:03:23 +03:00
Alexey Zatelepin
a41ee1f0a7 switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Milovidov
e86f73e465 Fixed half of bad code #2571 2018-07-04 20:28:52 +03:00
Nikolai Kochetov
4f7c284d34 Fixed build. 2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Alexey Zatelepin
ec7446e541 calculate primary key when mutating a part [#CLICKHOUSE-3747] 2018-06-04 18:45:34 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
 2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00