thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
35,572 Commits 9,319 Branches 1,783 Tags 2.1 GiB
a576811c45
Commit Graph

6019 Commits

Author SHA1 Message Date
alesapin
75fe46523e Working sequential order 2020-01-31 22:30:33 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8 Check access rights via new interface. 2020-01-31 20:27:28 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3 
Added globs/wildcards for s3
 2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1 
ALTER <materialized view name> MODIFY QUERY <select_query>
 2020-01-31 18:44:32 +03:00
alesapin
01ff1c65e2 More flexible schema 2020-01-31 15:25:31 +03:00
Mikhail Korotov
14acdffb0e
Update DirectoryMonitor.cpp 2020-01-31 14:29:21 +03:00
Mikhail Korotov
5c5b76d2b0
Update DirectoryMonitor.cpp 2020-01-31 14:28:39 +03:00
millb
d05642575d fixed 2020-01-31 14:16:46 +03:00
millb
165afabdd2 second attempt 2020-01-31 12:22:30 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors 
Storage buffer processors
 2020-01-31 10:46:16 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader 
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
 2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2 
Kafka fixes part2
 2020-01-31 03:55:46 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d Fixed reading from StorageLog table. 2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839 StorageLog test with DiskLocal and DiskMemory. 2020-01-30 22:29:30 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions 
Extend KeyCondition interface so that it returns BoolMask.
 2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink 
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713) where that's not the case.

The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.

Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
 2020-01-30 15:40:48 +00:00
Nicolae Vartolomei
fd42d1ee87 ALTER <materialized view name> MODIFY QUERY <select_query> 
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533.
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
 2020-01-30 14:12:49 +00:00
alesapin
d0e5243ad8 Send updates in entry 2020-01-30 15:54:52 +03:00
Nikolai Kochetov
3c4fe4f20e Fix StorageBuffer/ 2020-01-30 13:30:48 +03:00
alesapin
453be4c587 Removed changed node struct 2020-01-30 13:30:35 +03:00
Nikolai Kochetov
00546498b6 Fix StorageBuffer/ 2020-01-30 13:26:25 +03:00
Nikolai Kochetov
9eb97e6db2 Fix StorageBuffer/ 2020-01-30 13:22:59 +03:00
Nikolai Kochetov
5fd9db4370 Fix BufferSource. 2020-01-30 10:32:54 +03:00
Nikolai Kochetov
a5b016eb61 Fix BufferSource. 2020-01-30 10:28:49 +03:00
millb
f7ab01b746 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-30 10:13:52 +03:00
millb
7e1a23d910 fixed 2020-01-30 10:13:09 +03:00
Vladimir Chebotarev
9706374066 Fixed error messages. 2020-01-30 09:17:55 +03:00
Azat Khuzhin
ca8d9ac7f8 Fix error message for force_optimize_skip_unused_shards 2020-01-30 09:01:54 +03:00
Maxim Akhmedov
fa16149e1a Fix style checks. 2020-01-30 02:36:39 +03:00
Maxim Akhmedov
2d3321e003 Extend KeyCondition interface so that it returns BoolMask. 2020-01-30 00:40:22 +03:00
Nikolai Kochetov
d1bc3513a2 Fix build. 2020-01-29 21:22:09 +03:00
Nikolai Kochetov
84a392402f Processors reading for StorageBuffer. 2020-01-29 21:14:40 +03:00
alesapin
0893f7d49c Mutate from alter metadata task 2020-01-29 20:28:39 +03:00
Nikolai Kochetov
57100fc962 Merge branch 'master' into storage-system-processors 2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3 
Processors and system.numbers
 2020-01-29 13:11:13 +03:00
Azat Khuzhin
60d63081da Fix min_marks_for_seek for the data skipping indexes 2020-01-28 23:10:06 +03:00
alesapin
974e9a6b7a Broke things 2020-01-28 20:15:22 +03:00
Pavel Kovalenko
e0cd6b1073 Formatting issues. 2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be StorageLog Gtest 2020-01-28 19:08:30 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
alesapin
736711d21c Merge branch 'master' into alter_on_top_of_mutations 2020-01-28 17:10:34 +03:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
Pavel Kovalenko
d4707ca911 Seek reworking. 2020-01-28 15:48:01 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened 
Issue 8865 unnamed tuples should not be flattened
 2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties 
Explicitly specify storage features
 2020-01-28 01:49:53 +03:00
achulkov2
b7c9075e53 Stop flattening unnamed nested tuples 2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer 
# Conflicts:
#	dbms/programs/server/config.xml
 2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring. 
Store size and multiple references for S3 metadata file.
Log engine support for S3.
 2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768 Another fix for tests. Better handling of MV. 2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:13:02 +03:00
Alexey Milovidov
a1f05d3a56 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 20:06:32 +03:00
Maxim Akhmedov
675d0f549f Add replication and deduplication properties. 2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b Fix segmentation fault. 2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016 Fix TablesBlockSource. 2020-01-27 16:00:18 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns 
Fixed `StorageInput::StorageInput` a little bit
 2020-01-27 15:26:10 +03:00
Vladimir Chebotarev
18804407aa Properly added _file and _path columns. 2020-01-27 13:22:49 +03:00
Vladimir Chebotarev
3d0d31f62a Fixed StorageInput::StorageInput a little bit. 2020-01-27 13:19:14 +03:00
Nikolai Kochetov
2c025a8bd1 Add progress. 2020-01-27 13:05:57 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Vladimir Chebotarev
a7d05211c5 Added _file and _path columns. 2020-01-26 17:05:51 +03:00
Vladimir Chebotarev
61e80e4872 Attempt to add S3 globbing to StorageS3::read. 2020-01-26 16:12:15 +03:00
Vladimir Chebotarev
d2ccbcfb32 Attempt to add S3 globbing function. 2020-01-26 16:03:47 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete 
"Atomically" remove parts on destroy.
 2020-01-26 04:08:13 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration 
Multiple disks/volumes for storing data for send in Distributed engine
 2020-01-26 02:19:28 +03:00
Maxim Akhmedov
382eed249f Fix style issue. 2020-01-26 00:33:32 +03:00
Vladimir Chebotarev
ca2d381743 Prettier removal of part data on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
b35a6d1ce3 Got rid of ugly relative paths while deleting on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
2d749630b7 Fixed temporary path for part being erased. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
3f11569d94 "Atomically" remove parts on destroy. 2020-01-26 00:27:46 +03:00
Maxim Akhmedov
338bd3e919 Remove commented line. 2020-01-25 23:39:53 +03:00
Maxim Akhmedov
d6f72dc2ce Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory. 2020-01-25 22:44:52 +03:00
Azat Khuzhin
e5a43d2751 Add ability to use multiple disks/volumes for Distributed engine 
Now Distributed() has gain the 5-th argument -- policy name (for storing
data to send):

  CREATE TABLE foo (key Int) Engine=Distributed(test_shard_localhost, currentDatabase(), some_table, key%2, 'default');
 2020-01-25 20:52:31 +03:00
alexey-milovidov
dc90d42e1e
Merge pull request #8305 from ClickHouse/Vxider-parallel-insert 
Vxider parallel insert
 2020-01-25 20:30:50 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards 
force_optimize_skip_unused_shards setting to throw if skipping is not possible
 2020-01-25 17:37:59 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
Nikolai Kochetov
302d6b55ca Fix build. 2020-01-24 21:33:47 +03:00
Nikolai Kochetov
7385d3f643 Processors for StorageSystemTables. 2020-01-24 21:25:21 +03:00
Nikolai Kochetov
d53aa80d83 Processors for StorageSystemStoragePolicies. 2020-01-24 21:17:02 +03:00
Azat Khuzhin
6939ffeabf force_optimize_skip_unused_shards setting to throw if skipping is not possible 2020-01-24 21:15:40 +03:00
Nikolai Kochetov
16106a03c6 Processors for StorageSystemReplicas. 2020-01-24 21:13:17 +03:00
Nikolai Kochetov
0e6362ef7f Processors for StorageSystemPartsBase. 2020-01-24 21:01:21 +03:00
Nikolai Kochetov
9a223a05a5 Processors for StorageSystemOne. 2020-01-24 20:57:27 +03:00
Nikolai Kochetov
ffa3b3c665 Processors for StorageSystemDisks and StorageSystemDetachedParts. 2020-01-24 20:49:14 +03:00
Mikhail Korotov
9e5a88ec89 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-24 19:48:17 +03:00
millb
3299db778b changes applied 2020-01-24 19:47:05 +03:00
Nikolai Kochetov
c3d0c26659 Processors for SystemColumns. 2020-01-24 19:13:46 +03:00
Nikolai Kochetov
dc49635ed4 Processors for IStorageSystemOneBlock. 2020-01-24 18:42:31 +03:00
Nikolai Kochetov
61154da744 Processors for IStorageSystemOneBlock. 2020-01-24 18:32:17 +03:00
Nikolai Kochetov
cab636cb62 Merged with master. 2020-01-24 18:10:24 +03:00
Anton Popov
9fe94ca5f7
fix confusing logic (addition to #8800) 2020-01-24 13:47:19 +03:00
alexey-milovidov
de32863f73
Merge pull request #8791 from excitoon-favorites/fixdestructeddatapart 
Fixed bug with `MergeTreeReadPool`
 2020-01-24 06:37:18 +03:00
alexey-milovidov
105b61b2af
Merge pull request #8800 from CurtizJ/fix-alter-with-ttl 
Fix alters if there is set TTL for table.
 2020-01-24 06:30:45 +03:00
Nikolai Kochetov
4a4de82648 Merged with master 2020-01-23 18:44:26 +03:00
CurtizJ
b5d8baee71 fix alters if ttl is set 2020-01-23 16:04:06 +03:00
Vladimir Chebotarev
a362664cc1 Better handling of per_part_columns_lock. 2020-01-23 13:08:35 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
Pavel Kovalenko
dce424fe11 SeekableReadBuffer initial implementation. IDisk readFile should return SeekableBuffer. 2020-01-22 19:17:25 +03:00
Alexey Milovidov
5d33bedf80 Whitespace 2020-01-21 22:18:40 +03:00
alesapin
bef1eaeb98
Merge pull request #8753 from ClickHouse/fix_database_memory_wrong_data_path 
Fix wrong data path in DatabaseMemory
 2020-01-21 20:21:10 +03:00
Alexander Tokmakov
cdfc17e9b1 check path in constructor 2020-01-21 14:11:11 +03:00
Nikolai Kochetov
c28e224e24
Merge pull request #8735 from ClickHouse/processors-5.12 
Processors 5.12
 2020-01-21 11:51:07 +03:00
Alexander Tokmakov
05c4405b65 fix 2020-01-20 23:08:47 +03:00
alesapin
47578b8dc1 Remove some garbage 2020-01-20 17:28:51 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
alesapin
3716d4f7e3 Merge with master 2020-01-20 12:21:05 +03:00
Nikolai Kochetov
76171c7afc Do not add resize transform for SystemNumbers. 2020-01-20 10:24:28 +03:00
alexey-milovidov
c711ce500b
Merge pull request #8422 from excitoon-favorites/bettertestalterttl 
Fixed `ALTER MODIFY TTL`
 2020-01-19 04:53:11 +03:00
Alexey Milovidov
db1bb630e0 Fixed configuration of replxx 2020-01-19 03:23:35 +03:00
Alexey Milovidov
2d39e5ad8c Merging DiskS3 2020-01-19 02:18:23 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr 
Get rid of StorageWeakPtr
 2020-01-18 20:28:53 +03:00
alexey-milovidov
3f3a9e69b0
Merge pull request #8672 from excitoon/patch-7 
Fixed `MergeTreeData::areBackgroundMovesNeeded` according to move TTL feature
 2020-01-18 20:20:00 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove 
Fixed a bug with double move which corrupt original part
 2020-01-18 20:19:03 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
alesapin
be5fb9a517 Less comments 2020-01-17 23:55:31 +03:00
alesapin
fa5aa5fe6a Remove debug print 2020-01-17 22:09:22 +03:00
alesapin
795f36b110 Better defaults 2020-01-17 18:46:26 +03:00
alesapin
d2e9ed3898 Commented tons of debug prints 2020-01-17 17:48:56 +03:00
alesapin
750b9d9e55 Fix very strange bug 2020-01-17 17:39:18 +03:00
alesapin
58b9e73a7a Better working on files names 2020-01-17 16:54:22 +03:00
Vladimir Chebotarev
e7fb7d1288 Improved areBackgroundMovesNeeded() method. 2020-01-17 16:30:54 +03:00
Vladimir Chebotarev
0ba869a1ca Fixed MergeTreeData::areBackgroundMovesNeeded according to move TTL feature. 2020-01-17 16:24:44 +03:00
Vladimir Chebotarev
cb416b0bfd Minor review fixes. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
4f1f9e7e42 Fixed concurrency problems in ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
585e0453a6 Added clearing of old DELETE expression during ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
17dfea217b Fixed errors with ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Pervakov Grigory
b0b3842b57 Add remove to IDisk interface, fix issues 2020-01-17 14:34:39 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
alesapin
d39f1a0fce Better nested handling 2020-01-16 17:18:09 +03:00
Vladimir Chebotarev
48855d9ba9 Added comment to cloned_part->renameTo(). 2020-01-16 14:52:43 +03:00
alexey-milovidov
f4dee9a76e
Merge pull request #8666 from ClickHouse/filimonov-typo-fix 
typo fix
 2020-01-16 13:24:00 +03:00
Vladimir Chebotarev
3e5a6aa83d Fixed a bug with double move which corrupt original part. 2020-01-16 10:11:55 +03:00
alesapin
2a8873a9b7 Better 2020-01-15 19:18:11 +03:00
alesapin
92648955c4 Almost working drop 2020-01-15 16:47:00 +03:00
filimonov
681f5df66f
typo fix 2020-01-15 14:30:21 +01:00
alesapin
2abf4bbc95 Not working state 2020-01-15 16:00:08 +03:00
Alexander Tokmakov
5e2badd9b8 Merge branch 'master' into table_name_in_istorage 2020-01-15 14:55:20 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489) 
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
 2020-01-15 10:52:45 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition 
Alter command for move a specific partition from MergeTree table
 2020-01-14 22:32:10 +04:00
Alexander Tokmakov
9521b0ebe5 remove proxystorage 2020-01-14 20:10:19 +03:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
alesapin
e7aa209bf3 Merge branch 'master' into alter_on_top_of_mutations 2020-01-14 11:26:27 +03:00
robot-clickhouse
e8e820cfd4 Auto version update to [20.2.1.1] [54432] 2020-01-13 22:21:08 +03:00
Nikolai Kochetov
bcc0cd8e47 Fix build. 2020-01-13 21:25:10 +03:00