Commit Graph

5982 Commits

Author SHA1 Message Date
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer
# Conflicts:
#	dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring.
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768 Another fix for tests. Better handling of MV. 2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:13:02 +03:00
Alexey Milovidov
a1f05d3a56 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 20:06:32 +03:00
Maxim Akhmedov
675d0f549f Add replication and deduplication properties. 2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b Fix segmentation fault. 2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016 Fix TablesBlockSource. 2020-01-27 16:00:18 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns
Fixed `StorageInput::StorageInput` a little bit
2020-01-27 15:26:10 +03:00
Vladimir Chebotarev
18804407aa Properly added _file and _path columns. 2020-01-27 13:22:49 +03:00
Vladimir Chebotarev
3d0d31f62a Fixed StorageInput::StorageInput a little bit. 2020-01-27 13:19:14 +03:00
Nikolai Kochetov
2c025a8bd1 Add progress. 2020-01-27 13:05:57 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Vladimir Chebotarev
a7d05211c5 Added _file and _path columns. 2020-01-26 17:05:51 +03:00
Vladimir Chebotarev
61e80e4872 Attempt to add S3 globbing to StorageS3::read. 2020-01-26 16:12:15 +03:00
Vladimir Chebotarev
d2ccbcfb32 Attempt to add S3 globbing function. 2020-01-26 16:03:47 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete
"Atomically" remove parts on destroy.
2020-01-26 04:08:13 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration
Multiple disks/volumes for storing data for send in Distributed engine
2020-01-26 02:19:28 +03:00
Maxim Akhmedov
382eed249f Fix style issue. 2020-01-26 00:33:32 +03:00
Vladimir Chebotarev
ca2d381743 Prettier removal of part data on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
b35a6d1ce3 Got rid of ugly relative paths while deleting on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
2d749630b7 Fixed temporary path for part being erased. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
3f11569d94 "Atomically" remove parts on destroy. 2020-01-26 00:27:46 +03:00
Maxim Akhmedov
338bd3e919 Remove commented line. 2020-01-25 23:39:53 +03:00
Maxim Akhmedov
d6f72dc2ce Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory. 2020-01-25 22:44:52 +03:00
Azat Khuzhin
e5a43d2751 Add ability to use multiple disks/volumes for Distributed engine
Now Distributed() has gain the 5-th argument -- policy name (for storing
data to send):

  CREATE TABLE foo (key Int) Engine=Distributed(test_shard_localhost, currentDatabase(), some_table, key%2, 'default');
2020-01-25 20:52:31 +03:00
alexey-milovidov
dc90d42e1e
Merge pull request #8305 from ClickHouse/Vxider-parallel-insert
Vxider parallel insert
2020-01-25 20:30:50 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards
force_optimize_skip_unused_shards setting to throw if skipping is not possible
2020-01-25 17:37:59 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
Nikolai Kochetov
302d6b55ca Fix build. 2020-01-24 21:33:47 +03:00
Nikolai Kochetov
7385d3f643 Processors for StorageSystemTables. 2020-01-24 21:25:21 +03:00
Nikolai Kochetov
d53aa80d83 Processors for StorageSystemStoragePolicies. 2020-01-24 21:17:02 +03:00
Azat Khuzhin
6939ffeabf force_optimize_skip_unused_shards setting to throw if skipping is not possible 2020-01-24 21:15:40 +03:00
Nikolai Kochetov
16106a03c6 Processors for StorageSystemReplicas. 2020-01-24 21:13:17 +03:00
Nikolai Kochetov
0e6362ef7f Processors for StorageSystemPartsBase. 2020-01-24 21:01:21 +03:00
Nikolai Kochetov
9a223a05a5 Processors for StorageSystemOne. 2020-01-24 20:57:27 +03:00
Nikolai Kochetov
ffa3b3c665 Processors for StorageSystemDisks and StorageSystemDetachedParts. 2020-01-24 20:49:14 +03:00
Mikhail Korotov
9e5a88ec89 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-24 19:48:17 +03:00
millb
3299db778b changes applied 2020-01-24 19:47:05 +03:00
Nikolai Kochetov
c3d0c26659 Processors for SystemColumns. 2020-01-24 19:13:46 +03:00
Nikolai Kochetov
dc49635ed4 Processors for IStorageSystemOneBlock. 2020-01-24 18:42:31 +03:00
Nikolai Kochetov
61154da744 Processors for IStorageSystemOneBlock. 2020-01-24 18:32:17 +03:00
Nikolai Kochetov
cab636cb62 Merged with master. 2020-01-24 18:10:24 +03:00
Anton Popov
9fe94ca5f7
fix confusing logic (addition to #8800) 2020-01-24 13:47:19 +03:00
alexey-milovidov
de32863f73
Merge pull request #8791 from excitoon-favorites/fixdestructeddatapart
Fixed bug with `MergeTreeReadPool`
2020-01-24 06:37:18 +03:00
alexey-milovidov
105b61b2af
Merge pull request #8800 from CurtizJ/fix-alter-with-ttl
Fix alters if there is set TTL for table.
2020-01-24 06:30:45 +03:00
Nikolai Kochetov
4a4de82648 Merged with master 2020-01-23 18:44:26 +03:00
CurtizJ
b5d8baee71 fix alters if ttl is set 2020-01-23 16:04:06 +03:00
Vladimir Chebotarev
a362664cc1 Better handling of per_part_columns_lock. 2020-01-23 13:08:35 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
Pavel Kovalenko
dce424fe11 SeekableReadBuffer initial implementation. IDisk readFile should return SeekableBuffer. 2020-01-22 19:17:25 +03:00
CurtizJ
771e429d35 fix tests 2020-01-22 17:10:35 +03:00
Anton Popov
8183a79100
make all parts wide by default 2020-01-22 13:37:16 +03:00
Alexey Milovidov
5d33bedf80 Whitespace 2020-01-21 22:18:40 +03:00
alesapin
bef1eaeb98
Merge pull request #8753 from ClickHouse/fix_database_memory_wrong_data_path
Fix wrong data path in DatabaseMemory
2020-01-21 20:21:10 +03:00
CurtizJ
9275225527 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-21 17:21:52 +03:00
CurtizJ
6a29525fa3 add some comments 2020-01-21 14:56:01 +03:00
Alexander Tokmakov
cdfc17e9b1 check path in constructor 2020-01-21 14:11:11 +03:00
Nikolai Kochetov
c28e224e24
Merge pull request #8735 from ClickHouse/processors-5.12
Processors 5.12
2020-01-21 11:51:07 +03:00
Alexander Tokmakov
05c4405b65 fix 2020-01-20 23:08:47 +03:00
CurtizJ
d0731878c9 fix mutations 2020-01-20 22:00:11 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
Nikolai Kochetov
76171c7afc Do not add resize transform for SystemNumbers. 2020-01-20 10:24:28 +03:00
alexey-milovidov
c711ce500b
Merge pull request #8422 from excitoon-favorites/bettertestalterttl
Fixed `ALTER MODIFY TTL`
2020-01-19 04:53:11 +03:00
Alexey Milovidov
db1bb630e0 Fixed configuration of replxx 2020-01-19 03:23:35 +03:00
Alexey Milovidov
2d39e5ad8c Merging DiskS3 2020-01-19 02:18:23 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr
Get rid of StorageWeakPtr
2020-01-18 20:28:53 +03:00
alexey-milovidov
3f3a9e69b0
Merge pull request #8672 from excitoon/patch-7
Fixed `MergeTreeData::areBackgroundMovesNeeded` according to move TTL feature
2020-01-18 20:20:00 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove
Fixed a bug with double move which corrupt original part
2020-01-18 20:19:03 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
CurtizJ
b0906abb0d code cleanup 2020-01-17 16:56:37 +03:00
Vladimir Chebotarev
e7fb7d1288 Improved areBackgroundMovesNeeded() method. 2020-01-17 16:30:54 +03:00
Vladimir Chebotarev
0ba869a1ca Fixed MergeTreeData::areBackgroundMovesNeeded according to move TTL feature. 2020-01-17 16:24:44 +03:00
Vladimir Chebotarev
cb416b0bfd Minor review fixes. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
4f1f9e7e42 Fixed concurrency problems in ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
585e0453a6 Added clearing of old DELETE expression during ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
17dfea217b Fixed errors with ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Pervakov Grigory
b0b3842b57 Add remove to IDisk interface, fix issues 2020-01-17 14:34:39 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
CurtizJ
2797873921 code cleanup 2020-01-16 19:19:03 +03:00
Vladimir Chebotarev
48855d9ba9 Added comment to cloned_part->renameTo(). 2020-01-16 14:52:43 +03:00
alexey-milovidov
f4dee9a76e
Merge pull request #8666 from ClickHouse/filimonov-typo-fix
typo fix
2020-01-16 13:24:00 +03:00
Vladimir Chebotarev
3e5a6aa83d Fixed a bug with double move which corrupt original part. 2020-01-16 10:11:55 +03:00
CurtizJ
7a549b2734 implement 'checkConsistency' method in compact parts 2020-01-15 22:16:56 +03:00
CurtizJ
3ff8f424ed remove almost useless columns sizes from compact parts 2020-01-15 21:24:10 +03:00
CurtizJ
b3bd306a5d improve performance of compact parts 2020-01-15 19:39:29 +03:00
CurtizJ
27750f0cd4 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-15 19:36:35 +03:00
filimonov
681f5df66f
typo fix 2020-01-15 14:30:21 +01:00
Alexander Tokmakov
5e2badd9b8 Merge branch 'master' into table_name_in_istorage 2020-01-15 14:55:20 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489)
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
2020-01-15 10:52:45 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition
Alter command for move a specific partition from MergeTree table
2020-01-14 22:32:10 +04:00
Alexander Tokmakov
9521b0ebe5 remove proxystorage 2020-01-14 20:10:19 +03:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
CurtizJ
ce914cbab8 refactor code near MergeTreeDataPart 2020-01-14 16:23:51 +03:00
robot-clickhouse
e8e820cfd4 Auto version update to [20.2.1.1] [54432] 2020-01-13 22:21:08 +03:00