alesapin
bca40a8608
Better name
2019-08-06 19:34:27 +03:00
alesapin
e62101b8e8
Better comment
2019-08-06 19:29:31 +03:00
alesapin
ca29343f54
Uniq settings
2019-08-06 17:09:36 +03:00
alesapin
84fd4906ca
Changes for engines
2019-08-06 16:04:29 +03:00
alesapin
52b9658bcf
Merge with master
2019-08-06 15:55:12 +03:00
Nikita Vasilev
4a39538625
Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate
2019-08-04 16:58:21 +03:00
CurtizJ
82f304f81e
add query 'SYSTEM STOP TTL MERGES'
2019-08-01 18:36:12 +03:00
CurtizJ
c30bdecf6d
add missing comments
2019-08-01 15:00:35 +03:00
CurtizJ
f224269d41
filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query
2019-08-01 14:10:42 +03:00
Igr Mineev
fc79ed86ef
Ready for review
2019-08-01 13:29:14 +03:00
Alexander Tokmakov
f0836553d4
drop detached partition
2019-07-31 18:27:21 +03:00
Alexander Tokmakov
c6717e0d3f
refactor attachPartition
2019-07-30 22:11:15 +03:00
Alexander Tokmakov
2f33df1b2e
rename all parts before attaching
2019-07-30 20:24:40 +03:00
Alexander Tokmakov
3c15b87003
Merge branch 'master' into alter_table_drop_detached_part
2019-07-29 14:29:23 +03:00
alesapin
86831fe500
Add ability to create immutable settings
2019-07-29 14:03:50 +03:00
Alexander Tokmakov
0fc47fbbe4
fixes
2019-07-29 13:27:37 +03:00
Guillaume Tassery
663ca03d6f
Fix style
2019-07-29 08:09:36 +02:00
Nikita Vasilev
7efb1bcb12
Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate
2019-07-27 10:30:43 +03:00
Guillaume Tassery
c633dfa5c0
Use to_database instead of from_database for move partition feature
2019-07-26 13:12:18 +02:00
Guillaume Tassery
6fdedfc0e5
Cosmetic change for move partition feature
2019-07-26 12:04:28 +02:00
Guillaume Tassery
f52fed5cea
Let the user able to move a partition to an another table
2019-07-26 10:42:17 +02:00
Alexander Tokmakov
3ba26aba43
tests
2019-07-25 19:28:08 +03:00
Alexander Tokmakov
1805ab5736
attach
2019-07-25 13:46:07 +03:00
Igr Mineev
549c62a18a
Fix build
2019-07-25 12:40:20 +03:00
alesapin
f7e0d17490
Fix some bugs
2019-07-24 18:22:16 +03:00
alesapin
8a00ce5ff1
Intermediate step
2019-07-24 15:56:39 +03:00
Alexander Tokmakov
6e4aabbb1a
draft for StorageMergeTree
2019-07-23 23:18:18 +03:00
Alexander Tokmakov
3c2172b750
parse and interpret query
2019-07-23 22:25:10 +03:00
Igr
3e017ec69c
Merge branch 'master' into feature_multiple_disks
2019-07-23 16:38:20 +03:00
Igr Mineev
e967c23adb
Add Space interface for reservation. Add move to volume command
2019-07-23 16:34:17 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp
2019-07-21 17:14:55 +03:00
Mikhail f. Shiryaev
15fd980d0b
Add description "unable to select parts" and logging
2019-07-21 00:39:40 +02:00
Igr Mineev
52bca488dc
Add alter move part command
2019-07-18 18:19:03 +03:00
Igr Mineev
21e0bec3d0
Merge remote-tracking branch 'upstream/master' into feature_multiple_disks
2019-07-16 13:45:07 +03:00
Gleb Novikov
c1d91222d5
Ranamed setPrimaryKeyIndicesAndColumns to setProperties
2019-07-13 13:42:52 +03:00
Ivan Lezhankin
befb3ce15b
Merge branch 'master' into fix-filter-table
2019-07-10 13:27:26 +03:00
Ivan Lezhankin
9f01fa7aaa
Implement getDatabaseName() and rename() for all storages
2019-07-09 18:40:21 +03:00
alesapin
9a17a461ea
Review fixes and better tests
2019-07-09 12:02:52 +03:00
Gleb Novikov
71c2ca0fe9
Merge branch 'master' into table-constraints
2019-07-04 22:40:00 +03:00
alesapin
a0496da05f
Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part
2019-07-04 12:46:54 +03:00
alesapin
477a7450fb
Add test for data corruption
2019-07-03 23:51:13 +03:00
alesapin
3925a3bd13
Generalize check query
2019-07-03 16:17:19 +03:00
alesapin
6b0498cd93
First version of check cmd
2019-07-03 11:49:52 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
...
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
Gleb Novikov
a146b7383e
Merge branch 'master' into table-constraints
2019-06-30 11:32:02 +02:00
Nikita Vasilev
7b7517ff85
Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate
2019-06-24 16:44:44 +03:00
Igr Mineev
23049ac9e8
Add mergetree part move in background.
2019-06-19 20:56:41 +03:00
alesapin
dd37370aab
Fix test and add one
2019-06-19 19:16:13 +03:00
CurtizJ
e6dd92f9e1
ignore max part size for merge setting while executing mutations
2019-06-17 22:41:48 +03:00
Igr Mineev
842c72bb6d
Merge branch 'master' into feature_multiple_disks
2019-06-09 15:38:54 +03:00
Gleb Novikov
e7293486bd
Added ALTER TABLE support to constraints (ADD CONSTRAINT, DROP CONSTRAINT)
2019-06-02 17:41:12 +03:00
Gleb Novikov
2b5cf46842
Merge branch 'master' into table-constraints
2019-06-02 08:33:36 +03:00
proller
1b0d1a4450
Info about frozen parts in system.parts ( #5471 )
...
* wip
* wip
* wip
* Clean
* fix test
* clean
* fix test
* fix test
2019-05-31 07:03:46 +03:00
Igor Mineev
15ee6207ab
Chg 'Schema' to 'StoragePolicy'. Add system.disks. Add system.storage_politics. Add disk to system.parts. Add policy to system.tables.
2019-05-24 22:03:07 +03:00
Igor Mineev
4f61c9d30f
Const Schema fix
2019-05-22 22:20:10 +03:00
Igor Mineev
430748bd54
Detach path fix
2019-05-21 18:42:13 +03:00
Gleb Novikov
ce93896608
Added constraints description to MergeTree and related storages
2019-05-18 11:05:52 +03:00
alexey-milovidov
88b34999fe
Merge pull request #5247 from zhang2014/fix/rename_data_race
...
fix data race in rename query
2019-05-14 22:07:52 +03:00
Igor Mineev
74466de6d8
Minor fixes.
2019-05-13 23:58:22 +03:00
zhang2014
2206ba464f
fix data race in rename query
2019-05-13 15:54:38 +08:00
Igor Mineev
6596c3f6e0
DataPartsExchange new protocol with data size. StorageReplicatedMergeTree::fetchPartition multipath fix. Choosing on mutate any disk to write mutation file.
2019-05-12 17:57:23 +03:00
Igor Mineev
af300c667b
Bugfix
2019-05-11 23:44:43 +03:00
Igor Mineev
b4b000bf84
Merge branch 'master' into feature_multiple_disks
2019-05-11 21:50:29 +03:00
ivan-kush
ab6558b8b4
add spaces amp
2019-05-10 17:34:02 +03:00
Nikita Vasilev
ad07dd2e1f
fix
2019-05-09 20:04:05 +03:00
Nikita Vasilev
8d2b32fda8
clear index
2019-05-09 17:25:18 +03:00
Ivan Kush
2a356791ab
Merge branch 'master' into feat/parallel-alter-modify
2019-05-07 23:53:14 +03:00
ivan-kush
5bde1c69ab
last try?
2019-05-07 23:41:15 +03:00
Alexey Milovidov
a6ca9f266f
Removed huge chunk of bad code
2019-05-03 05:00:57 +03:00
Alexey Milovidov
0a8e888671
Fixed bad code
2019-05-03 03:26:46 +03:00
ivan-kush
abfb681a04
hz
2019-05-03 00:43:24 +03:00
ivan-kush
d555a165a4
debug stress address
2019-05-02 21:48:38 +03:00
Alexey Milovidov
270a31abb5
Rename method for consistency
2019-05-02 19:07:23 +03:00
ivan-kush
ea82760463
add reset
2019-05-02 18:12:57 +03:00
ivan-kush
591325468b
make_unique
2019-05-02 14:54:34 +03:00
ivan-kush
4a3a1fc6d9
return transactions cleaning
2019-05-01 15:43:43 +03:00
Ivan Kushnarenko
e38f6e08d8
debug tsan refactor trash
2019-05-01 13:26:49 +03:00
Ivan Kushnarenko
bdbe97276c
remove groups
2019-04-27 23:15:10 +03:00
ivan-kush
26b3910b7d
tsan debug
2019-04-27 20:01:30 +03:00
Ivan Kushnarenko
cb51558bdf
check build clang7 splitted
2019-04-27 11:24:50 +03:00
ivan-kush
ba61e16093
style
2019-04-26 00:37:57 +03:00
ivan-kush
86af5fc0c2
Merge remote-tracking branch 'upstream/master' into feat/parallel-alter-modify
2019-04-25 22:48:44 +03:00
ivan-kush
af02fe4a96
Merge remote-tracking branch 'origin/feat/parallel-alter-modify' into feat/parallel-alter-modify
2019-04-25 22:33:09 +03:00
ivan-kush
33201fa9a8
rev
2019-04-25 21:57:43 +03:00
Igor Mineev
8edcae5530
Merge remote-tracking branch 'upstream/master' into feature_multiple_disks
2019-04-24 15:35:08 +03:00
Igor Mineev
79abe85328
New data path: disk_path + db_name + table_name. Removed default path from MergeTree Constructor
2019-04-21 21:38:44 +03:00
Anton Popov
7f93f9ad2f
TTL for columns and tables ( #4212 )
...
Add TTL for columns and tables.
2019-04-15 12:30:45 +03:00
Igor Mineev
563ab2a5ec
Merge remote-tracking branch 'upstream/master' into feature_multiple_disks
2019-04-05 23:07:24 +03:00
Igor Mineev
3a38b16da1
Add rename MergeTreeData function. Add shared_ptr to disks in Volumes.
2019-04-05 22:45:59 +03:00
Igor Mineev
968b7286e2
Stylefixes.
2019-04-05 20:37:27 +03:00
Igor Mineev
0b1a33c722
Format file moved to default. Add default Storage configuration
2019-04-05 15:30:26 +03:00
Igor Mineev
7824aa528f
Add Schemes to config. Parse scheme as default on MergeTreeData init
2019-04-04 20:19:11 +03:00
Igor Mineev
0441480502
Storage getDataPath -> getDataPaths
2019-04-04 16:13:59 +03:00
Igor Mineev
341e3f1c5b
Add space reservation for each new MargeTreeDataPart.
2019-04-03 15:52:09 +03:00
Igor Mineev
8047d16a96
Add Path chooser. Add DiskMonitort multiple disks support
2019-04-01 21:41:19 +03:00
alexey-milovidov
d10b256a8a
Merge pull request #4845 from yandex/max_partitions_per_insert_block
...
Implement "max_partitions_per_insert_block" setting
2019-03-29 16:20:46 +03:00
Alexey Milovidov
8cb1619607
Implement "max_partitions_per_insert_block" setting #4700
2019-03-29 12:34:07 +03:00
Alexey Milovidov
8d3ef5df19
Fixed data race in clearOldTemporaryDirectories
2019-03-29 12:28:16 +03:00
Ivan Lezhankin
61954d855d
More reverts
2019-03-15 20:09:14 +03:00
alexey-milovidov
fc3cb57881
Update StorageMergeTree.cpp
2019-03-12 16:26:26 +03:00
alexey-milovidov
72f785bd1d
Update StorageMergeTree.cpp
2019-03-12 16:24:56 +03:00
alexey-milovidov
6daee801fa
Update StorageMergeTree.cpp
2019-03-12 16:24:03 +03:00
ivan-kush
3f01882310
format2
2019-03-12 08:56:02 +03:00
ivan-kush
6acb39032f
format
2019-03-11 23:17:50 +03:00
Ivan Lezhankin
d1ead22073
Rename As<…> → as<…>
2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc
Merge remote-tracking branch 'upstream/master' into iast-as
2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328
Replace all other casts to method IAST::As<Derived>
...
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
ivan-kush
c3182d4ae6
fix erase
2019-03-10 23:29:58 +03:00
ivan-kush
521e897a92
init
2019-03-10 00:36:00 +03:00
Ivan Lezhankin
0e325c7a4a
Replace const typeid_casts with As<Derived>() method invocations
2019-03-08 12:48:20 +03:00
Alex Zatelepin
896b8b15f6
fix build
2019-03-07 23:52:25 +03:00
Alexey Zatelepin
3344955154
separate Read and Write lock holders, better method names
2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3
alter intention lock
2019-03-07 20:21:18 +03:00
Alexey Zatelepin
c5dde2c9fd
get rid of default query_id value in RWLock::getLock [#CLICKHOUSE-3789]
2019-02-28 12:37:05 +03:00
Alexey Zatelepin
0d7ab9e3ea
allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
...
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Vitaly Baranov
309df832ec
IStorage::read() function, "max_block_size" parameter: change type UInt64 -> size_t.
2019-02-19 14:56:08 +03:00
alexey-milovidov
48280074c4
Merge pull request #4369 from yandex/fix-race-condition-merge-tree-clear-old-temporary-directories
...
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
2019-02-12 21:37:48 +03:00
Nikita Vasilev
5279c7ff81
setting
2019-02-12 20:54:52 +03:00
Alexey Milovidov
7d1e755a7c
Fixed rare race condition on startup of non-replicated MergeTree tables: concurrent attempt to remove a temporary directory [#CLICKHOUSE-4296]
2019-02-12 19:41:06 +03:00
Alexey Milovidov
58a6accee5
Updated test #4246
2019-02-10 19:55:12 +03:00
alexey-milovidov
2777e54a57
Merge pull request #4287 from yandex/mutations-introspection
...
KILL MUTATION
2019-02-10 00:51:30 +03:00
Alexey Milovidov
2eb1876a7a
Slightly better message with reason for OPTIMIZE query with "optimize_throw_if_noop"
2019-02-06 18:44:27 +03:00
Alexey Zatelepin
3ec6f508f1
Merge branch 'master' into mutations-introspection
...
Conflicts:
dbms/src/Interpreters/InterpreterKillQueryQuery.cpp
2019-02-06 15:22:48 +03:00
Alexey Zatelepin
8e437b191e
try executing other mutations immediately after KILL MUTATION [#CLICKHOUSE-3912]
2019-02-05 21:09:16 +03:00
Alexey Zatelepin
d482f3e5d0
return CancellationCode from killMutation [#CLICKHOUSE-3912]
2019-02-05 21:09:15 +03:00
Alexey Zatelepin
e32f153328
KILL MUTATION for StorageReplicatedMergeTree [#CLICKHOUSE-3912]
2019-02-05 21:09:15 +03:00
Alexey Zatelepin
059c1b3589
write part_log.partition_id everywhere
2019-02-05 21:09:15 +03:00
Alexey Zatelepin
ca93fd483a
kill ordinary MergeTree mutations [#CLICKHOUSE-3912]
2019-02-05 21:09:10 +03:00
Alexey Zatelepin
5832e474a4
is_mutation flag in system.merges [#CLICKHOUSE-3912]
2019-02-05 21:09:05 +03:00
Alexey Zatelepin
92a4342c31
system.merges element for mutations [#CLICKHOUSE-3912]
2019-02-05 21:09:00 +03:00
Alexey Zatelepin
51017959f2
fix typo in calculation of part_log.rows_read
2019-02-05 21:09:00 +03:00
Alexey Zatelepin
67be566325
KILL MUTATION skeleton [#CLICKHOUSE-3912]
2019-02-05 21:08:41 +03:00
Nikita Vasilev
a1b0dede07
Data Skipping Indices ( #4143 )
...
* made index parser
* added index parsing
* some fixes
* added index interface and factory
* fixed compilation
* ptrs
* added indexParts
* indextypes
* index condition
* IndexCondition
* added indexes in selectexecutor
* fix
* changed comment
* fix
* added granularity
* comments
* fix
* fix
* added writing indexes
* removed indexpart class
* fix
* added setSkipIndexes
* add rw for MergeTreeIndexes
* fixes
* upd error
* fix
* fix
* reading
* test index
* fixed nullptr error
* fixed
* fix
* unique names
* asts -> exprlist
* minmax index
* fix
* fixed select
* fixed merging
* fixed mutation
* working minmax
* removed test index
* fixed style
* added indexes to checkDataPart
* added tests for minmax index
* fixed constructor
* fix style
* fixed includes
* fixed setSkipIndexes
* added indexes meta to zookeeper
* added parsing
* removed throw
* alter cmds parse
* fix
* added alter
* fix
* alters fix
* fix alters
* fix "after"
* fixed alter
* alter fix + test
* fixes
* upd setSkipIndexes
* fixed alter bug with drop all indices
* fix metadata editing
* new test and repl fix
* rm test files
* fixed repl alter
* fix
* fix
* indices
* MTReadStream
* upd test for bug
* fix
* added useful parsers and ast classes
* fix
* fix comments
* replaced columns
* fix
* fixed parsing
* fixed printing
* fix err
* basic IndicesDescription
* go to IndicesDescr
* moved indices
* go to indicesDescr
* fix test minmax_index*
* fixed MT alter
* fixed bug with replMT indices storing in zk
* rename
* refactoring
* docs ru
* docs ru
* docs en
* refactor
* rename tests
* fix docs
* refactoring
* fix
* fix
* fix
* fixed style
* unique idx
* unique
* fix
* better minmax calculation
* upd
* added getBlock
* unique_condition
* added termForAST
* unique
* fixed not
* uniqueCondition::mayBeTrueOnGranule
* fix
* fixed bug with double column
* is always true
* fix
* key set
* spaces
* test
* tests
* fix
* unique
* fix
* fix
* fixed bug with duplicate column
* removed unused data
* fix
* fixes
* __bitSwapLastTwo
* fix
2019-02-05 17:50:25 +03:00
Alexey Zatelepin
b8ee63fa3a
save information about failed parts for ordinary MergeTree mutations [#CLICKHOUSE-3192]
2019-02-05 16:04:58 +03:00
Alexey Milovidov
1d4701b0bc
Added some warnings from clang's -Weverything
2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7
Miscellaneous [#CLICKHOUSE-2]
2019-01-02 09:44:36 +03:00
alesapin
8bc00f4632
CLICKHOUSE-4229: Fix user forwarding for replicated queries which actually send queries to master node
2018-12-28 19:21:32 +03:00
Alexey Milovidov
7509db544c
Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-3
2018-12-26 22:38:11 +03:00
alesapin
9342700ce1
Move processing pool to ternary logic
2018-12-26 20:03:29 +03:00
Alexey Milovidov
bbbefe2c03
Less dependencies [#CLICKHOUSE-2]
2018-12-26 02:18:07 +03:00
Alexey Milovidov
3be55436bf
Less dependencies [#CLICKHOUSE-2]
2018-12-26 02:13:30 +03:00
Alexey Zatelepin
b7afe46dfd
remove ALTER MODIFY PRIMARY KEY command [#CLICKHOUSE-4214]
2018-12-20 21:57:20 +03:00
proller
b213ee5e5d
Fix macos build ( #3863 )
2018-12-18 20:41:03 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff
2018-12-14 17:41:55 +03:00
alexey-milovidov
48b30edcf5
Merge branch 'master' into alter-order-by
2018-12-02 21:06:38 +03:00
Ivan Lezhankin
8b5a05947c
Remove redundant information from RWLock.
...
And fix broken exception in some race conditions
2018-11-28 18:50:52 +03:00
Alexey Zatelepin
1b27fb046d
Merge branch 'master' into alter-order-by
...
Conflicts:
dbms/programs/server/Server.cpp
2018-11-28 16:47:07 +03:00
Alexey Zatelepin
9ae79c60e8
get rid of (ASTPtr *) in AlterCommands::apply [#CLICKHOUSE-3859]
2018-11-28 16:34:57 +03:00
Alexey Zatelepin
e085bc9816
adapt code of #3609 [#CLICKHOUSE-3859]
2018-11-27 20:07:10 +03:00
Ivan Lezhankin
73aa7f2027
Rename method partition() → alterPartition()
...
Also fix build with internal shared libraries.
2018-11-26 17:43:40 +03:00
Alexey Zatelepin
d3d9242462
Merge branch 'master' into alter-order-by
...
Conflicts:
dbms/src/Parsers/ASTAlterQuery.h
dbms/src/Parsers/ParserAlterQuery.cpp
dbms/src/Storages/AlterCommands.cpp
dbms/src/Storages/AlterCommands.h
2018-11-26 16:01:48 +03:00
Sabyanin Maxim
3a67b505c5
Merge branch 'master' of https://github.com/yandex/ClickHouse into CLICKHOUSE-4032
2018-11-22 16:54:10 +03:00
alexey-milovidov
5038f13b08
Merge pull request #3514 from abyss7/CLICKHOUSE-3766
...
Implement 'ALTER … FREEZE' command
2018-11-21 07:17:21 +03:00
Ivan Lezhankin
1e070a7c51
Move FREEZE_ALL command source code inside |PartitionCommand|
2018-11-20 20:13:59 +03:00
Ivan Lezhankin
74fe350451
Refactor partition commands handling into separate interface method.
2018-11-20 17:59:34 +03:00
Sabyanin Maxim
e3fc18fcb8
add getters of expressions names in StorageReplicatedMergeTree
2018-11-20 15:19:12 +03:00
Sabyanin Maxim
d9e6789f78
make MergeTree work with comments
2018-11-15 16:12:27 +03:00
Alexey Zatelepin
b071547b2d
add checks for ALTER MODIFY ORDER BY [#CLICKHOUSE-3859]
2018-11-14 20:12:32 +03:00
Alexey Zatelepin
29b34365e6
Merge branch 'master' into alter-order-by
...
Conflicts:
dbms/src/Interpreters/ExpressionAnalyzer.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataSelectExecutor.cpp
2018-11-13 16:27:19 +03:00
Alexey Zatelepin
2cc0aae82c
rearrange AST members in MergeTreeData [#CLICKHOUSE-3859]
2018-11-13 16:15:17 +03:00
Alexey Zatelepin
8b85822192
store original key ASTs, and not extracted ASTExpressionLists [#CLICKHOUSE-3859]
2018-11-13 16:14:44 +03:00
Alexey Zatelepin
0c0c4fd28d
add sorting_and_primary_keys_independent [#CLICKHOUSE-3859]
2018-11-13 16:13:19 +03:00
Alexey Zatelepin
07a22100cb
ALTER ORDER BY for ordinary MergeTree [#CLICKHOUSE-3859]
2018-11-13 16:13:14 +03:00
Alexey Zatelepin
f4c26e78d2
renames [#CLICKHOUSE-3859]
2018-11-13 16:13:01 +03:00
Alexey Zatelepin
0fa86162d9
separate sorting key and primary key, allow setting primary key separately [#CLICKHOUSE-3859]
2018-11-13 16:12:55 +03:00
Alexey Zatelepin
9a92c0a55c
sort key is distinct from primary key [#CLICKHOUSE-3859]
2018-11-13 16:12:49 +03:00
Ivan Lezhankin
4eb0f33ec2
Add some locks on freeze and support |freezeAll()| for replicated merge-tree.
2018-11-12 15:26:15 +03:00
Ivan Lezhankin
935615a647
Reimplement FREEZE command.
2018-11-12 15:26:14 +03:00
Ivan Lezhankin
03e6a29eb2
Implement 'ALTER … FREEZE' command.
...
Need some tests!
2018-11-12 15:26:14 +03:00
alexey-milovidov
98c2ed582c
Merge pull request #2863 from VadimPE/ISSUES-2581
...
ISSUES-2581 fix SELECT with sequential consistency
2018-10-22 23:55:33 +03:00
VadimPE
28102bc3b5
ISSUES-2581 get pointer to max_blocls
2018-09-24 12:53:28 +03:00
Alexey Zatelepin
c2c12f22f7
try to immediately delete the part after checksums mismatch [#CLICKHOUSE-2837]
2018-09-21 19:07:21 +03:00
Vadim
204e1d437f
Merge branch 'master' into ISSUES-2581
2018-09-17 15:30:08 +03:00
zhang2014
7a87da78d7
ISSUES-3110 fix merge and distributed engine query stage
2018-09-14 18:16:27 +08:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update
...
ALTER UPDATE
2018-09-13 06:03:35 +03:00
alesapin
ca2334f992
Fix build
2018-09-12 22:57:14 +03:00
alesapin
1664bec008
CLICKHOUSE-3970: Add setting for O_DIRECT for big merges
2018-09-12 20:19:52 +03:00
Alexey Zatelepin
d77037fec7
fix use after move
2018-09-07 18:54:34 +03:00
Alexey Zatelepin
1064d1d26b
update MATERIALIZED columns when their dependencies are updated [#CLICKHOUSE-13]
2018-09-07 18:54:18 +03:00
Alexey Zatelepin
816b91e2e3
additional checks for UPDATEs of key columns [#CLICKHOUSE-13]
2018-09-04 17:34:50 +03:00
VadimPE
6e78f576d7
ISSUES-2581 add comments, and fix
2018-09-03 11:25:35 +03:00
Vadim
3598f39f82
Merge branch 'master' into ISSUES-2581
2018-08-21 17:24:03 +03:00
Nikolai Kochetov
391b4b5927
Merged with master.
2018-08-20 15:25:06 +03:00
VadimPE
3c0f6ce87b
ISSUES-2581 fix SELECT with select_sequential_consistency
2018-08-14 12:57:18 +03:00
Alexey Milovidov
36db216abf
Preparation for extra warnings [#CLICKHOUSE-2]
2018-08-10 07:02:56 +03:00
Alexey Milovidov
d8ca4345b6
Fixed style violations [#CLICKHOUSE-2]
2018-08-10 04:41:54 +03:00
alexey-milovidov
0ef2a94d46
Merge pull request #2782 from VadimPE/CLICKHOUSE-3714
...
CLICKHOUSE-3714 add max_partition_size_to_drop
2018-08-06 20:20:59 +03:00
VadimPE
c15ba5e7d9
CLICKHOUSE-3714
2018-08-06 11:30:54 +03:00
VadimPE
490efebe62
CLICKHOUSE-3714 add size pf all part in partition
2018-08-06 11:27:59 +03:00
Alexey Milovidov
2016374d20
Merging #2226
2018-08-05 10:05:43 +03:00
Alexey Zatelepin
a0730d7696
old mutations cleaner for non-replicated MergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Vadim
d821f8a4cc
Update StorageMergeTree.cpp
2018-08-03 16:17:32 +03:00
VadimPE
b97fa2eb4d
CLICKHOUSE-3714 bool ckeck_CanBeDropped -> void ...
2018-08-03 12:39:01 +03:00
VadimPE
6142d9ae6a
CLICKHOUSE-3714 fix function names and get partition size
2018-08-03 11:33:57 +03:00
VadimPE
08fe108ba8
CLICKHOUSE-3714 fix methods name
2018-08-02 11:48:57 +03:00
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714
2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7
CLICKHOUSE-3714 add max_partition_size_to_drop
2018-08-01 20:41:18 +03:00
Alexey Zatelepin
c793277bcc
add forgotten sort [#CLICKHOUSE-3748]
2018-07-23 21:04:13 +03:00
alexey-milovidov
68b57e605a
Merge branch 'master' into background-processing-pool-backoff
2018-07-16 06:27:43 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88300258a7
info in system.mutations for nonreplicated MergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Milovidov
7dc1276afe
Little better #2281
2018-07-08 08:26:51 +03:00
Alexey Milovidov
4a35b57cea
Little better #2599
2018-07-05 21:45:18 +03:00
Amos Bird
78beacb3a5
Make OPTIMIZE be able to merge all parts with FINAL.
2018-07-05 21:32:54 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Milovidov
72af2b7b0f
Removed wrong modification #2260
2018-06-10 21:26:02 +03:00
Alexey Milovidov
6475ea98c7
Merging: Fixed most of problems, actualized test #2260
2018-06-09 21:17:27 +03:00
Alexey Milovidov
d56c199f07
Merging: Fixed half of problems #2260
2018-06-09 18:48:22 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
1147e052e8
select and write part mutations to queue [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
9a32c76e76
parts versioning [#CLICKHOUSE-3687]
2018-05-25 23:04:07 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
...
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]
* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]
* Disable merges in the dropping range. [#CLICKHOUSE-3546]
* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]
* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]
SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]
* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]
* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]
* Add system.part_log logging. [#CLICKHOUSE-3546]
* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]
* Add requested changes. [#CLICKHOUSE-3546]
Fixed clickhouse-client bad return code.
* Add requested chenges. [#CLICKHOUSE-3546]
* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
Nikolai Kochetov
a3308bf675
added IStorage::getQueryProcessingStage
2018-04-19 17:47:09 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Zatelepin
5906c9a988
rename for clarity
2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac
encapsulate ColumnsDeclaration [#CLICKHOUSE-3241]
2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Alexey Milovidov
afbbd780e3
Fixed error with initialization of PartLog [#CLICKHOUSE-3354]
2018-03-10 22:57:13 +03:00
Alexey Milovidov
601ff1eee4
Simplification of AST #1947
2018-02-26 06:37:08 +03:00
Alexey Milovidov
6e93635275
Better UNION ALL: development #1947
2018-02-25 09:35:24 +03:00
Alexey Milovidov
722b6287ec
Miscellaneous [#CLICKHOUSE-2]
2018-02-25 05:43:27 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
...
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
Vitaliy Lyudvichenko
26e58271e9
Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2]
2018-01-25 17:42:39 +03:00
Vitaliy Lyudvichenko
1000328571
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-22 20:31:08 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
...
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
...
Small enhancements
2018-01-16 22:07:43 +03:00
Vitaliy Lyudvichenko
b68b60fb38
More detailed test. [#CLICKHOUSE-3]
...
Resolves #1553 .
2018-01-16 15:05:01 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
03bca2144d
OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
...
Resolves #1753
2018-01-15 13:13:18 +03:00
Vitaliy Lyudvichenko
388d47bbbc
Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346
2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
c818beedcb
Make data_path creation for Databases optional. [#CLICKHOUSE-2]
2018-01-11 21:55:43 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Zatelepin
c3348e27a4
shorter [#CLICKHOUSE-2]
2017-12-25 20:31:14 +03:00
Alexey Milovidov
1aa99092c3
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:15:35 +03:00
Alexey Milovidov
acd78e4891
Better [#CLICKHOUSE-2].
2017-12-02 00:13:25 +03:00
Vitaliy Lyudvichenko
b738d1baed
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
proller
0d3c4f4d67
Core/FieldVisitors.h -> Common/FieldVisitors.h
...
Core/Progress.h -> IO/Progress.h
tests: sudo --non-interactive
Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
01e8adbfff
Removed "experimental" namespace [#CLICKHOUSE-2].
2017-11-20 07:15:43 +03:00
Vitaliy Lyudvichenko
e2a12d1088
Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00