thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 11:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
37,740 Commits 9,338 Branches 1,783 Tags 2.1 GiB
36383d83f1
Commit Graph

6521 Commits

Author SHA1 Message Date
Ilya Yatsishin
5b4b04e13b
Merge pull request #9050 from CurtizJ/fix-range-reader 
Fix order of ranges in MergeTreeDataSelectExecutor
 2020-02-11 18:31:34 +03:00
alesapin
9e0d4b0bd4 Seems to work 2020-02-11 17:54:46 +03:00
CurtizJ
b26a8b5622 choose part type while selecting parts to merge 2020-02-11 16:41:26 +03:00
Mikhail Korotov
f8db74fca6 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-11 13:51:37 +03:00
CurtizJ
c72c38aea9 require strict part type in MergeTreeReaders 2020-02-10 23:30:49 +03:00
alesapin
260a4687f0 Something working 2020-02-10 19:55:09 +03:00
CurtizJ
90a121cc1e remove useless line 2020-02-10 19:34:47 +03:00
CurtizJ
852772364e replace std::vector to std::deque for MarkRanges 2020-02-10 19:04:24 +03:00
Artem Zuikov
bd6d9a427b
Some InterpreterSelectQuery refactoring (#9035) 
move ExpressionActionsChain logic out of InterpreterSelectQuery
 2020-02-10 18:50:12 +03:00
Alexander Tokmakov
869e20d207 move databases from Context to DatabaseCatalog 2020-02-10 17:49:44 +03:00
alesapin
2a866043aa some trash 2020-02-10 16:32:59 +03:00
tavplubix
4543177931 Merge pull request #9048 from ClickHouse/fix_mutation_order 
Fix primary.idx corruption after delete mutation
 2020-02-09 19:21:23 +03:00
alesapin
19de74d5bd Remove redundant lock 2020-02-09 11:52:42 +03:00
alesapin
2dca542d2e Correctly accuire lock 2020-02-09 11:42:15 +03:00
alesapin
5a96eaf0e8 Add missed locks for ReplicatedMergeTree alter 2020-02-08 16:39:44 +03:00
CurtizJ
b9fc9b4569 fix order of ranges in MergeTreeDataSelectExecutor 2020-02-08 00:07:18 +03:00
alesapin
f9d70e741f
Merge pull request #9047 from ClickHouse/fix_unit_tests 
Fix unit tests
 2020-02-07 21:30:09 +03:00
Nikita Mikhaylov
1324f3946e
Merge pull request #8988 from nvartolomei/nv/alter-mv-modify-query 
Modify Materialized View query
 2020-02-07 21:28:27 +03:00
alesapin
1ada6e663c Missed change 2020-02-07 16:56:57 +03:00
alesapin
dcfe6524e5 Fix unit tests 2020-02-07 12:51:48 +03:00
CurtizJ
2780250d05 better code near data part writer 2020-02-06 18:32:00 +03:00
Nicolae Vartolomei
0939a9460f Modify Materialized View query 2020-02-06 08:57:54 +00:00
alesapin
29a26a87b4 Merge pull request #9022 from ClickHouse/mutations_parts_to_do_fix 
Fix mutations finalization task
 2020-02-06 11:26:13 +03:00
zhang2014
784230b7a8 ISSUES-8971 fix non from 2020-02-06 08:30:14 +08:00
CurtizJ
db47ef923c fix prewhere 2020-02-05 19:42:27 +03:00
alesapin
1923930379 Fix mutations finalization task 2020-02-05 19:30:02 +03:00
zhang2014
16bb4e975d ISSUES-8971 support explain & view storage 2020-02-05 19:40:18 +08:00
alesapin
f8f615dfdb Debugging 2020-02-05 14:18:11 +03:00
zhang2014
b9443c98fe ISSUES-8971 fix view with predicate optimizer 2020-02-05 16:00:06 +08:00
Mikhail Filimonov
babd3ca34e Fixing test build, more review fixes 2020-02-05 08:05:55 +01:00
Mikhail Filimonov
8c736e6c9f After review fixes 2020-02-04 22:19:34 +01:00
CurtizJ
2f9f5dfc7a better initialization of MergedBlockOutputStream 2020-02-04 19:15:28 +03:00
CurtizJ
31c39c8137 fix mutations 2020-02-04 15:11:32 +03:00
Nikolai Kochetov
bc757f6b24 Processors support for StorageS3 reading. 2020-02-03 21:01:41 +03:00
alesapin
d8be70d709 Fix bug 2020-02-03 19:39:36 +03:00
CurtizJ
1785b27ae5 fix build 2020-02-03 19:37:00 +03:00
CurtizJ
a0635ed390 better marks reading 2020-02-03 19:02:54 +03:00
CurtizJ
257bb3b599 add comments near DataPart code 2020-02-03 15:08:40 +03:00
Nikolai Kochetov
a029e49438 Processors support for StorageNull reading. 2020-02-03 14:23:52 +03:00
Nikolai Kochetov
eae2ce194d Processors support for StorageNull reading. 2020-02-03 14:22:21 +03:00
CurtizJ
2d7ff400ed Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-02-03 13:46:00 +03:00
Nikolai Kochetov
fde86203a7 Fix StorageJoin 2020-02-03 13:42:20 +03:00
Mikhail Korotov
bf3caa0373 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password 2020-02-03 13:08:20 +03:00
Mikhail Filimonov
24ff635435 draft implementation, wip 2020-02-03 11:02:52 +01:00
alesapin
5864cab472 Merge branch 'master' into alter_on_top_of_mutations 2020-02-03 12:09:19 +03:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id 
Use OS thread id everywhere instead of internal thread number.
 2020-02-03 03:57:35 +03:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt 
Rename ANY INNER to SEMI JOIN for partial merge join
 2020-02-03 01:53:52 +03:00
alexey-milovidov
bf4887a33d
Merge pull request #8822 from millb/Prohibition_secondary_index_with_old_format_merge_tree 
Prohibition secondary index with old syntax merge tree
 2020-02-03 00:04:04 +03:00
Alexey Milovidov
d11f3cb78f Changed thread_id to UInt64 to support more OS 2020-02-02 23:01:13 +03:00
chertus
d2e8b24970 better compatibility in EngineJoin 2020-02-02 19:12:48 +03:00
alesapin
0c37458b20 Add missed file 2020-02-02 11:45:09 +03:00
alexey-milovidov
55c5bdbace
Trigger CI 2020-02-02 05:49:36 +03:00
Alexey Milovidov
39b31907b5 Rename function #7477 2020-02-02 05:35:47 +03:00
Alexey Milovidov
f9eb4e79f6 Using OS tid everywhere #7477 2020-02-02 05:28:14 +03:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer 2020-02-02 03:54:50 +03:00
alexey-milovidov
eeacc97d2f
Merge pull request #8852 from vitlibar/RBAC-4 
RBAC-4
 2020-02-02 03:35:31 +03:00
alesapin
46e31cd643 Some trash code 2020-02-01 23:33:36 +03:00
alesapin
bf883e5a91 Fix bug 2020-02-01 15:46:22 +03:00
alesapin
85d94194c8 Add additional check for metadata in zookeeper 2020-02-01 14:47:09 +03:00
alexey-milovidov
d20bae03fb
Merge pull request #8908 from azat/fixes 
Tiny fixes
 2020-01-31 23:22:30 +03:00
alesapin
75fe46523e Working sequential order 2020-01-31 22:30:33 +03:00
Vitaly Baranov
10c912dab2 Rewrite the User class to be controlled by AccessControlManager. 2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8 Check access rights via new interface. 2020-01-31 20:27:28 +03:00
Nikolai Kochetov
cef9db809f Processors support for StorageMySQL reading. 2020-01-31 19:46:27 +03:00
Nikolai Kochetov
dd888f59a7 Fix MemorySource. 2020-01-31 19:36:57 +03:00
Nikolai Kochetov
dbffabfd46 Processors support for StorageMerge reading. 2020-01-31 19:31:08 +03:00
Nikolai Kochetov
7bedce40ea Processors support for StorageMerge reading. 2020-01-31 19:29:40 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3 
Added globs/wildcards for s3
 2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1 
ALTER <materialized view name> MODIFY QUERY <select_query>
 2020-01-31 18:44:32 +03:00
Nikolai Kochetov
dc96e6d1cf Processors support for StorageMemory reading. 2020-01-31 18:26:10 +03:00
Nikolai Kochetov
fc7839716f Processors support for StorageMaterializedView reading. 2020-01-31 18:16:06 +03:00
Nikolai Kochetov
046ff34525 Processors support for StorageLog reading. 2020-01-31 18:10:10 +03:00
Nikolai Kochetov
384e68d745 Processors support for StorageJoin reading. 2020-01-31 17:51:09 +03:00
Nikolai Kochetov
f9db37ebf7 Processors support for StorageInput reading. 2020-01-31 17:26:51 +03:00
Nikolai Kochetov
6870132713 Processors support for StorageHDFS reading. 2020-01-31 17:06:43 +03:00
Nikolai Kochetov
2d1f06a49f Processors support for StorageFile reading. 2020-01-31 16:12:11 +03:00
alesapin
01ff1c65e2 More flexible schema 2020-01-31 15:25:31 +03:00
Mikhail Korotov
14acdffb0e
Update DirectoryMonitor.cpp 2020-01-31 14:29:21 +03:00
Mikhail Korotov
5c5b76d2b0
Update DirectoryMonitor.cpp 2020-01-31 14:28:39 +03:00
millb
d05642575d fixed 2020-01-31 14:16:46 +03:00
millb
165afabdd2 second attempt 2020-01-31 12:22:30 +03:00
Nikolai Kochetov
0157de021a Processors support for StorageDistributed reading. 2020-01-31 11:54:57 +03:00
Nikolai Kochetov
240f1e3e96 Processors support for StorageDictionary. 2020-01-31 11:14:20 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors 
Storage buffer processors
 2020-01-31 10:46:16 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader 
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
 2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2 
Kafka fixes part2
 2020-01-31 03:55:46 +03:00
Mikhail Filimonov
a6e3265960 Kafka proper rebalances processing, controlled assignment, faster tests 2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d Fixed reading from StorageLog table. 2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839 StorageLog test with DiskLocal and DiskMemory. 2020-01-30 22:29:30 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions 
Extend KeyCondition interface so that it returns BoolMask.
 2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink 
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713) where that's not the case.

The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.

Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
 2020-01-30 15:40:48 +00:00
Nicolae Vartolomei
fd42d1ee87 ALTER <materialized view name> MODIFY QUERY <select_query> 
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533.
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
 2020-01-30 14:12:49 +00:00
alesapin
d0e5243ad8 Send updates in entry 2020-01-30 15:54:52 +03:00
Nikolai Kochetov
3c4fe4f20e Fix StorageBuffer/ 2020-01-30 13:30:48 +03:00
alesapin
453be4c587 Removed changed node struct 2020-01-30 13:30:35 +03:00
Nikolai Kochetov
00546498b6 Fix StorageBuffer/ 2020-01-30 13:26:25 +03:00
Nikolai Kochetov
9eb97e6db2 Fix StorageBuffer/ 2020-01-30 13:22:59 +03:00
Vladimir Chebotarev
4b2eff8551 Added passing ttl info between replicas. 2020-01-30 13:21:40 +03:00
Nikolai Kochetov
5fd9db4370 Fix BufferSource. 2020-01-30 10:32:54 +03:00
Nikolai Kochetov
a5b016eb61 Fix BufferSource. 2020-01-30 10:28:49 +03:00
millb
f7ab01b746 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-30 10:13:52 +03:00
millb
7e1a23d910 fixed 2020-01-30 10:13:09 +03:00
Vladimir Chebotarev
9706374066 Fixed error messages. 2020-01-30 09:17:55 +03:00
Azat Khuzhin
ca8d9ac7f8 Fix error message for force_optimize_skip_unused_shards 2020-01-30 09:01:54 +03:00
Maxim Akhmedov
fa16149e1a Fix style checks. 2020-01-30 02:36:39 +03:00
Maxim Akhmedov
2d3321e003 Extend KeyCondition interface so that it returns BoolMask. 2020-01-30 00:40:22 +03:00
Nikolai Kochetov
d1bc3513a2 Fix build. 2020-01-29 21:22:09 +03:00
Nikolai Kochetov
84a392402f Processors reading for StorageBuffer. 2020-01-29 21:14:40 +03:00
alesapin
0893f7d49c Mutate from alter metadata task 2020-01-29 20:28:39 +03:00
Nikolai Kochetov
57100fc962 Merge branch 'master' into storage-system-processors 2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3 
Processors and system.numbers
 2020-01-29 13:11:13 +03:00
Azat Khuzhin
60d63081da Fix min_marks_for_seek for the data skipping indexes 2020-01-28 23:10:06 +03:00
alesapin
974e9a6b7a Broke things 2020-01-28 20:15:22 +03:00
Pavel Kovalenko
e0cd6b1073 Formatting issues. 2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be StorageLog Gtest 2020-01-28 19:08:30 +03:00
Mikhail Filimonov
dc43728dea Test showing the problem with partial commit of polled batch + fix 2020-01-28 15:21:36 +01:00
alesapin
736711d21c Merge branch 'master' into alter_on_top_of_mutations 2020-01-28 17:10:34 +03:00
Mikhail Filimonov
5dafccf410 Test for flushing by time and by block size (+fix), one extra test for virual columns 2020-01-28 14:24:37 +01:00
Pavel Kovalenko
d4707ca911 Seek reworking. 2020-01-28 15:48:01 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened 
Issue 8865 unnamed tuples should not be flattened
 2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties 
Explicitly specify storage features
 2020-01-28 01:49:53 +03:00
achulkov2
b7c9075e53 Stop flattening unnamed nested tuples 2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5 Minor review and style fixes. 2020-01-27 23:08:43 +03:00
Pavel Kovalenko
07755ec8f7 Merge branch 'master' into idisk-seekable-readbuffer 
# Conflicts:
#	dbms/programs/server/config.xml
 2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc SeekableReadBuffer refactoring. 
Store size and multiple references for S3 metadata file.
Log engine support for S3.
 2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768 Another fix for tests. Better handling of MV. 2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 21:13:02 +03:00
Alexey Milovidov
a1f05d3a56 Fixed the issue with too many open files when using StorageFile with globs 2020-01-27 20:06:32 +03:00
Maxim Akhmedov
675d0f549f Add replication and deduplication properties. 2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b Fix segmentation fault. 2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016 Fix TablesBlockSource. 2020-01-27 16:00:18 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns 
Fixed `StorageInput::StorageInput` a little bit
 2020-01-27 15:26:10 +03:00
CurtizJ
a5d9975e37 better checking if table has TTL 2020-01-27 14:53:50 +03:00
Vladimir Chebotarev
18804407aa Properly added _file and _path columns. 2020-01-27 13:22:49 +03:00
Vladimir Chebotarev
3d0d31f62a Fixed StorageInput::StorageInput a little bit. 2020-01-27 13:19:14 +03:00
Nikolai Kochetov
2c025a8bd1 Add progress. 2020-01-27 13:05:57 +03:00
Alexey Milovidov
5d52261266 Remove useless files 2020-01-26 18:25:58 +03:00
Vladimir Chebotarev
a7d05211c5 Added _file and _path columns. 2020-01-26 17:05:51 +03:00
Vladimir Chebotarev
61e80e4872 Attempt to add S3 globbing to StorageS3::read. 2020-01-26 16:12:15 +03:00
Vladimir Chebotarev
d2ccbcfb32 Attempt to add S3 globbing function. 2020-01-26 16:03:47 +03:00
alexey-milovidov
066b4e745c
Merge pull request #8402 from excitoon-favorites/atomicdelete 
"Atomically" remove parts on destroy.
 2020-01-26 04:08:13 +03:00
alexey-milovidov
2df93a6d21
Merge pull request #8756 from azat/distributed_storage_configuration 
Multiple disks/volumes for storing data for send in Distributed engine
 2020-01-26 02:19:28 +03:00
Maxim Akhmedov
382eed249f Fix style issue. 2020-01-26 00:33:32 +03:00
Vladimir Chebotarev
ca2d381743 Prettier removal of part data on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
b35a6d1ce3 Got rid of ugly relative paths while deleting on destroy. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
2d749630b7 Fixed temporary path for part being erased. 2020-01-26 00:27:46 +03:00
Vladimir Chebotarev
3f11569d94 "Atomically" remove parts on destroy. 2020-01-26 00:27:46 +03:00
Maxim Akhmedov
338bd3e919 Remove commented line. 2020-01-25 23:39:53 +03:00
Maxim Akhmedov
d6f72dc2ce Specify supported features for each storage engine, expose them via system.table_engines table, properly check feature support in storage factory. 2020-01-25 22:44:52 +03:00
Azat Khuzhin
e5a43d2751 Add ability to use multiple disks/volumes for Distributed engine 
Now Distributed() has gain the 5-th argument -- policy name (for storing
data to send):

  CREATE TABLE foo (key Int) Engine=Distributed(test_shard_localhost, currentDatabase(), some_table, key%2, 'default');
 2020-01-25 20:52:31 +03:00
alexey-milovidov
dc90d42e1e
Merge pull request #8305 from ClickHouse/Vxider-parallel-insert 
Vxider parallel insert
 2020-01-25 20:30:50 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards 
force_optimize_skip_unused_shards setting to throw if skipping is not possible
 2020-01-25 17:37:59 +03:00
Alexander Tokmakov
f9cfc6be3a fix LiveView dependencies 2020-01-25 01:51:23 +03:00
Nikolai Kochetov
302d6b55ca Fix build. 2020-01-24 21:33:47 +03:00
Nikolai Kochetov
7385d3f643 Processors for StorageSystemTables. 2020-01-24 21:25:21 +03:00
Nikolai Kochetov
d53aa80d83 Processors for StorageSystemStoragePolicies. 2020-01-24 21:17:02 +03:00
Azat Khuzhin
6939ffeabf force_optimize_skip_unused_shards setting to throw if skipping is not possible 2020-01-24 21:15:40 +03:00
Nikolai Kochetov
16106a03c6 Processors for StorageSystemReplicas. 2020-01-24 21:13:17 +03:00
Nikolai Kochetov
0e6362ef7f Processors for StorageSystemPartsBase. 2020-01-24 21:01:21 +03:00
Nikolai Kochetov
9a223a05a5 Processors for StorageSystemOne. 2020-01-24 20:57:27 +03:00
Nikolai Kochetov
ffa3b3c665 Processors for StorageSystemDisks and StorageSystemDetachedParts. 2020-01-24 20:49:14 +03:00
Mikhail Korotov
9e5a88ec89 Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree 2020-01-24 19:48:17 +03:00
millb
3299db778b changes applied 2020-01-24 19:47:05 +03:00
Nikolai Kochetov
c3d0c26659 Processors for SystemColumns. 2020-01-24 19:13:46 +03:00
Nikolai Kochetov
dc49635ed4 Processors for IStorageSystemOneBlock. 2020-01-24 18:42:31 +03:00
Nikolai Kochetov
61154da744 Processors for IStorageSystemOneBlock. 2020-01-24 18:32:17 +03:00
Nikolai Kochetov
cab636cb62 Merged with master. 2020-01-24 18:10:24 +03:00
CurtizJ
14f0b9e137 add query 'ALTER ... MATERIALIZE TTL' 2020-01-24 13:53:14 +03:00
Anton Popov
9fe94ca5f7
fix confusing logic (addition to #8800) 2020-01-24 13:47:19 +03:00
alexey-milovidov
de32863f73
Merge pull request #8791 from excitoon-favorites/fixdestructeddatapart 
Fixed bug with `MergeTreeReadPool`
 2020-01-24 06:37:18 +03:00
alexey-milovidov
105b61b2af
Merge pull request #8800 from CurtizJ/fix-alter-with-ttl 
Fix alters if there is set TTL for table.
 2020-01-24 06:30:45 +03:00
Nikolai Kochetov
4a4de82648 Merged with master 2020-01-23 18:44:26 +03:00
CurtizJ
b5d8baee71 fix alters if ttl is set 2020-01-23 16:04:06 +03:00
Vladimir Chebotarev
a362664cc1 Better handling of per_part_columns_lock. 2020-01-23 13:08:35 +03:00
Ivan
b80e3dcd46
Refactoring of replxx (#8748) 2020-01-23 11:18:19 +03:00
Pavel Kovalenko
dce424fe11 SeekableReadBuffer initial implementation. IDisk readFile should return SeekableBuffer. 2020-01-22 19:17:25 +03:00
CurtizJ
771e429d35 fix tests 2020-01-22 17:10:35 +03:00
Anton Popov
8183a79100
make all parts wide by default 2020-01-22 13:37:16 +03:00
Alexey Milovidov
5d33bedf80 Whitespace 2020-01-21 22:18:40 +03:00
alesapin
bef1eaeb98
Merge pull request #8753 from ClickHouse/fix_database_memory_wrong_data_path 
Fix wrong data path in DatabaseMemory
 2020-01-21 20:21:10 +03:00
CurtizJ
9275225527 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-21 17:21:52 +03:00
CurtizJ
6a29525fa3 add some comments 2020-01-21 14:56:01 +03:00
Alexander Tokmakov
cdfc17e9b1 check path in constructor 2020-01-21 14:11:11 +03:00
Nikolai Kochetov
c28e224e24
Merge pull request #8735 from ClickHouse/processors-5.12 
Processors 5.12
 2020-01-21 11:51:07 +03:00
Alexander Tokmakov
05c4405b65 fix 2020-01-20 23:08:47 +03:00
CurtizJ
d0731878c9 fix mutations 2020-01-20 22:00:11 +03:00
alesapin
47578b8dc1 Remove some garbage 2020-01-20 17:28:51 +03:00
Alexey Milovidov
09f3890b20 Merge branch 'master' into GrigoryPervakov-vfs-s3 2020-01-20 15:39:15 +03:00
alesapin
3716d4f7e3 Merge with master 2020-01-20 12:21:05 +03:00
Nikolai Kochetov
76171c7afc Do not add resize transform for SystemNumbers. 2020-01-20 10:24:28 +03:00
alexey-milovidov
c711ce500b
Merge pull request #8422 from excitoon-favorites/bettertestalterttl 
Fixed `ALTER MODIFY TTL`
 2020-01-19 04:53:11 +03:00
Alexey Milovidov
db1bb630e0 Fixed configuration of replxx 2020-01-19 03:23:35 +03:00
Alexey Milovidov
2d39e5ad8c Merging DiskS3 2020-01-19 02:18:23 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
alexey-milovidov
7583f8744a
Merge branch 'master' into bettertestalterttl 2020-01-19 01:03:25 +03:00
alexey-milovidov
52e8252653
Merge pull request #8650 from ClickHouse/remove_istorage_weak_ptr 
Get rid of StorageWeakPtr
 2020-01-18 20:28:53 +03:00
alexey-milovidov
3f3a9e69b0
Merge pull request #8672 from excitoon/patch-7 
Fixed `MergeTreeData::areBackgroundMovesNeeded` according to move TTL feature
 2020-01-18 20:20:00 +03:00
alexey-milovidov
85f395a8ee
Merge pull request #8680 from excitoon-favorites/criticalbugwithmove 
Fixed a bug with double move which corrupt original part
 2020-01-18 20:19:03 +03:00
Alexey Milovidov
f7efa5e2c7 Merge branch 'replxx' of https://github.com/abyss7/ClickHouse into abyss7-replxx 2020-01-18 17:00:59 +03:00
alesapin
be5fb9a517 Less comments 2020-01-17 23:55:31 +03:00
alesapin
fa5aa5fe6a Remove debug print 2020-01-17 22:09:22 +03:00
alesapin
795f36b110 Better defaults 2020-01-17 18:46:26 +03:00
alesapin
d2e9ed3898 Commented tons of debug prints 2020-01-17 17:48:56 +03:00
alesapin
750b9d9e55 Fix very strange bug 2020-01-17 17:39:18 +03:00
CurtizJ
b0906abb0d code cleanup 2020-01-17 16:56:37 +03:00
alesapin
58b9e73a7a Better working on files names 2020-01-17 16:54:22 +03:00
Vladimir Chebotarev
e7fb7d1288 Improved areBackgroundMovesNeeded() method. 2020-01-17 16:30:54 +03:00
Vladimir Chebotarev
0ba869a1ca Fixed MergeTreeData::areBackgroundMovesNeeded according to move TTL feature. 2020-01-17 16:24:44 +03:00
Vladimir Chebotarev
cb416b0bfd Minor review fixes. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
4f1f9e7e42 Fixed concurrency problems in ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
585e0453a6 Added clearing of old DELETE expression during ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Vladimir Chebotarev
17dfea217b Fixed errors with ALTER MODIFY TTL. 2020-01-17 16:17:17 +03:00
Pervakov Grigory
b0b3842b57 Add remove to IDisk interface, fix issues 2020-01-17 14:34:39 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
CurtizJ
2797873921 code cleanup 2020-01-16 19:19:03 +03:00
alesapin
d39f1a0fce Better nested handling 2020-01-16 17:18:09 +03:00
Vladimir Chebotarev
48855d9ba9 Added comment to cloned_part->renameTo(). 2020-01-16 14:52:43 +03:00
alexey-milovidov
f4dee9a76e
Merge pull request #8666 from ClickHouse/filimonov-typo-fix 
typo fix
 2020-01-16 13:24:00 +03:00
Vladimir Chebotarev
3e5a6aa83d Fixed a bug with double move which corrupt original part. 2020-01-16 10:11:55 +03:00
CurtizJ
7a549b2734 implement 'checkConsistency' method in compact parts 2020-01-15 22:16:56 +03:00
CurtizJ
3ff8f424ed remove almost useless columns sizes from compact parts 2020-01-15 21:24:10 +03:00
CurtizJ
b3bd306a5d improve performance of compact parts 2020-01-15 19:39:29 +03:00
CurtizJ
27750f0cd4 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-15 19:36:35 +03:00
alesapin
2a8873a9b7 Better 2020-01-15 19:18:11 +03:00
alesapin
92648955c4 Almost working drop 2020-01-15 16:47:00 +03:00
filimonov
681f5df66f
typo fix 2020-01-15 14:30:21 +01:00
alesapin
2abf4bbc95 Not working state 2020-01-15 16:00:08 +03:00
Alexander Tokmakov
5e2badd9b8 Merge branch 'master' into table_name_in_istorage 2020-01-15 14:55:20 +03:00
Olga Khvostikova
53ae368d9c
Add virtual columns to hdfs and file table functions (#8489) 
* Add virtual column _path to hdfs and file table functions with test

* Fix const of headers

* Add column _file with tests

* Add docs

* Fix improper resolve conflicts

* Fix links in docs

* Better condition for virtual columns proccessing in StorageFile

* better condition for virtual columns processing in StorageHDFS
 2020-01-15 10:52:45 +03:00
Nikita Mikhaylov
0e0dd80abf
Merge pull request #6168 from PerformanceVision/move_partition 
Alter command for move a specific partition from MergeTree table
 2020-01-14 22:32:10 +04:00
Alexander Tokmakov
9521b0ebe5 remove proxystorage 2020-01-14 20:10:19 +03:00
Alexander Tokmakov
ff1b7e1386 get rid of StorageWeakPtr 2020-01-14 19:54:25 +03:00
CurtizJ
ce914cbab8 refactor code near MergeTreeDataPart 2020-01-14 16:23:51 +03:00
alesapin
e7aa209bf3 Merge branch 'master' into alter_on_top_of_mutations 2020-01-14 11:26:27 +03:00
robot-clickhouse
e8e820cfd4 Auto version update to [20.2.1.1] [54432] 2020-01-13 22:21:08 +03:00
Nikolai Kochetov
bcc0cd8e47 Fix build. 2020-01-13 21:25:10 +03:00
CurtizJ
18eacfe721 ignore compact parts in MergeTreeWhereOptimizer 2020-01-13 21:12:53 +03:00
alexey-milovidov
d78290b7ec
Merge pull request #8107 from excitoon-favorites/alterpolicy 
Allow to change `storage_policy` to not less rich one
 2020-01-13 21:02:47 +03:00
Nikolai Kochetov
a6fc528805 Merge branch 'master' into Vxider-parallel-insert 2020-01-13 20:59:42 +03:00
alesapin
a90ab99282 Maybe it will compile better 2020-01-13 19:40:30 +03:00
CurtizJ
f15696246e add part type to system.parts table 2020-01-13 19:40:24 +03:00
alesapin
bc59e473e8 Some thoughts on non blocking alter 2020-01-13 19:39:20 +03:00
CurtizJ
1011675b11 avoid errors with compact non-adaptive parts 2020-01-13 19:28:29 +03:00
CurtizJ
bae3aa3c6e simplify data part checking 2020-01-13 17:56:22 +03:00
alexey-milovidov
166e44922f
Merge pull request #8625 from Vxider/fix-liveview-timestamp 
fix liveview timestamp bug
 2020-01-13 17:55:10 +03:00
alexey-milovidov
192580b60f
Update MergeTreeData.h 2020-01-13 17:45:13 +03:00
Alexander Tokmakov
9389c83d4d Merge branch 'master' into table_name_in_istorage 2020-01-13 14:41:42 +03:00
Guillaume Tassery
377d20185e Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-13 04:16:27 +01:00
Guillaume Tassery
33698588d7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove_partition 2020-01-13 04:13:58 +01:00
alexey-milovidov
303b146a93
Merge branch 'master' into vfs_log 2020-01-12 20:16:30 +03:00
Vxider
1019cf42d8 fix timestamp 2020-01-13 00:12:11 +08:00
alexey-milovidov
f051844eb7
Merge branch 'master' into replxx 2020-01-11 19:59:33 +03:00
alexey-milovidov
c270830b0a
Merge pull request #8535 from ClickHouse/distributed-format 
Distributed format
 2020-01-11 19:19:11 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
alexey-milovidov
3567a09360 Update StorageTinyLog.cpp 2020-01-11 00:55:14 +03:00
Alexander Burmak
26511b7978 Added DiskMemory and tests 2020-01-11 00:43:42 +03:00
alesapin
b29fa1b143
Merge pull request #8614 from ClickHouse/fix_alter_codec 
Fix alter codec bug
 2020-01-10 23:15:45 +03:00
alexey-milovidov
5e29fe3425
Merge pull request #8475 from ClickHouse/aku/logical-error-assert 
In debug builds, treat LOGICAL_ERROR as an assertion failure.
 2020-01-10 19:58:39 +03:00
alexey-milovidov
6ef19d3630
Merge pull request #8549 from excitoon-favorites/mergedownwards 
Do not allow to merge data moving it against storage policy volume order
 2020-01-10 19:21:21 +03:00
alesapin
9d55de8aef Fix alter codec bug 2020-01-10 18:26:40 +03:00
Alexander Burmak
ec1a490935 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-10 15:04:20 +03:00
Alexander Tokmakov
902615a2f7 Merge branch 'master' into table_name_in_istorage 2020-01-10 14:51:21 +03:00
Guillaume Tassery
121d651914 remove local partition on replicated storage as well 2020-01-10 12:08:56 +01:00
Guillaume Tassery
5f8297b307 Remove outdated partition on shutdown 2020-01-10 10:46:24 +01:00
alexey-milovidov
5ec160f962
Merge pull request #8595 from ClickHouse/aku/merge-verbose-error 
Report a more verbose error when unable to select parts to merge.
 2020-01-10 10:12:04 +03:00
alesapin
fb4e2c9a53
Merge pull request #8588 from ClickHouse/fix_mutation_size_limit 
Fix mutation size limit
 2020-01-09 22:51:07 +03:00
CurtizJ
6f09b5fc28 fix reading of nested columns in compact format 2020-01-09 20:27:44 +03:00
CurtizJ
97521800f0 fix reading of nested columns in compact format 2020-01-09 20:06:34 +03:00
Alexander Kuzmenkov
3999675383 In debug builds, treat LOGICAL_ERROR as an assertion failure. 2020-01-09 19:58:32 +03:00
alexey-milovidov
8d9f85cf22
Merge pull request #8314 from javisantana/fix/no_wait_for_no_active_replicas 
check for active replicas when waiting for commands
 2020-01-09 19:54:07 +03:00
alexey-milovidov
58e6041477
Merge pull request #8503 from zhang2014/fix/some_predicate_bug 
try fix some predicate optimizer bug
 2020-01-09 19:48:16 +03:00
alexey-milovidov
7dcc00d996
Merge pull request #8572 from ClickHouse/full-text-index-useless-code 
Removed useless code, added comments
 2020-01-09 19:47:51 +03:00
Alexander Tokmakov
b54b46b057 fix build 2020-01-09 19:32:21 +03:00
Ivan Lezhankin
5950f6c081 Merge remote-tracking branch 'upstream/master' into replxx 2020-01-09 19:21:04 +03:00
Alexander Tokmakov
a1ff29b7e6 fix empty table name 2020-01-09 19:01:44 +03:00
CurtizJ
2495849cd8 fix reading of nested columns in compact format 2020-01-09 18:46:32 +03:00
Alexander Kuzmenkov
2c73233e82 Report a more verbose error when unable to select parts to merge. 2020-01-09 18:38:16 +03:00
Alexander Tokmakov
54a75269cb Merge branch 'master' into table_name_in_istorage 2020-01-09 17:46:23 +03:00
Alexander Tokmakov
9b75ee2378 Merge branch 'master' into table_name_in_istorage 2020-01-09 17:33:58 +03:00
Vladimir Chebotarev
99a5830f0a Added a check for existing data on new disk. 2020-01-09 16:53:04 +03:00
Vladimir Chebotarev
5e1093faf8 Added changing of table policy. 2020-01-09 16:52:37 +03:00
Alexander Burmak
c4f44bb06c Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-09 16:29:03 +03:00
Nikolai Kochetov
1b97cb3f95
Merge pull request #8519 from vzakaznikov/live_view_refactoring 
Live View storage engine refactoring of getNewBlocks() and writeIntoLiveView() methods.
 2020-01-09 16:25:23 +03:00
CurtizJ
33ae97894b Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-09 15:54:37 +03:00
Alexander Tokmakov
1d14d8b4a7 fix mutation size limit 2020-01-09 14:38:26 +03:00
Nikolai Kochetov
878351a732 merged with master. 2020-01-09 11:15:01 +03:00
Vladimir Chebotarev
75e2dbde36 Removed fallback behavior of reserving space on a volumes with smaller indices when volumes with greater or equal indices are full but left warnings about not being able to move data according to table-level TTL rules. 2020-01-08 23:12:36 +03:00
Alexey Milovidov
2084d26238 Removed useless code, added comments 2020-01-08 13:20:55 +03:00
Guillaume Tassery
d176abb7c0 Check the storage policy of table on the move partition table 2020-01-08 10:57:27 +01:00
Guillaume Tassery
4a04a1a2ec Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2020-01-08 08:11:53 +01:00
Vladimir Chebotarev
6f2a4bf5ce Added fallback behavior of reserving space on a volumes with smaller indices when volumes with greater or equal indices are full. 2020-01-07 22:26:14 +03:00
Javi santana bot
776ceeb427 Wait only on optimize commands 2020-01-07 19:16:37 +01:00
Alexey Milovidov
8432cbb5c6 Removed debug output 2020-01-07 15:26:44 +03:00
Vladimir Chebotarev
7de9eb4bdc Do not allow to merge data moving it against storage policy volume order. 2020-01-07 10:17:11 +03:00
Guillaume Tassery
8b2938a8fb
Merge branch 'master' into move_partition 2020-01-07 13:25:35 +07:00
Vitaliy Zakaznikov
f0d2ef5bf7 Removing tabs. 2020-01-06 08:23:05 -05:00
Alexey Milovidov
31f4fd0e4b Fixed test 2020-01-05 23:11:26 +03:00
Alexey Milovidov
5620fb1561 Added tests 2020-01-05 10:22:08 +03:00
Alexey Milovidov
9a6531fc1c Workaround for bug in zlib-ng; using zlib level 3 by default 2020-01-05 09:39:40 +03:00
Alexey Milovidov
ba6a56a485 Added a comment 2020-01-05 08:45:13 +03:00
Alexey Milovidov
ac163ce6c6 Added method "truncate" to StorageFile 2020-01-05 05:57:09 +03:00
Nikolai Kochetov
63014126c2 Support reading from DirectoryMonitor. 2020-01-04 21:37:31 +03:00
Nikolai Kochetov
f094e8f565 Support reading from DirectoryMonitor. 2020-01-04 21:33:16 +03:00
Nikolai Kochetov
cf7b16d333 Support reading from DirectoryMonitor. 2020-01-04 21:05:42 +03:00
Nikolai Kochetov
253c6cd59a Support reading from DirectoryMonitor. 2020-01-04 20:45:56 +03:00
Alexey Milovidov
46c37f2c94 Merge branch 'master' into general-compression-rework 2020-01-04 20:45:45 +03:00
alexey-milovidov
00ba767f5d Merge pull request #8318 from excitoon-favorites/replicatedalterttl 
Fixed ALTER TTL for replicated tables
 2020-01-04 20:42:39 +03:00
Nikolai Kochetov
5869d6708b Support reading from DirectoryMonitor. 2020-01-04 17:45:11 +03:00
Alexey Milovidov
0f4a58ecaa Removed bad code around general compression methods 2020-01-04 10:31:00 +03:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520) 
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
 2020-01-04 08:46:50 +03:00
Nikolai Kochetov
d884ab4318
Merge pull request #7792 from vzakaznikov/live_view_support_for_subquery 
Live view support for subquery
 2020-01-03 15:49:44 +03:00
Vitaliy Zakaznikov
25458a4865 Updates to make all live view tests to pass. 2020-01-03 02:48:15 +01:00
Vitaliy Zakaznikov
2c4bf0581f Fixing compilation errors. 2020-01-02 20:31:04 +01:00
Vitaliy Zakaznikov
d43eae2db8 First changes. 2020-01-02 12:24:55 -05:00
Alexander Burmak
70b3a1a0d8 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-02 18:01:41 +03:00
Alexander Burmak
05869e6049 Addressed review comments 2020-01-02 17:37:31 +03:00
zhang2014
9364397597 try fix some predicate optimizer bug 2020-01-02 21:14:48 +08:00
Alexey Milovidov
67afaa9d93 Stack trace for every exception (experimental) 2020-01-02 09:56:53 +03:00
Vitaliy Zakaznikov
d0f7a2f3da Fixing styling error. 2020-01-01 18:01:43 -05:00
Vitaliy Zakaznikov
aeeb4457ed Updates to simply extractDependentTable 2020-01-01 23:57:18 +01:00
Vitaliy Zakaznikov
00d5997612 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2020-01-01 17:59:59 +01:00
Vitaliy Zakaznikov
2e36fd417d Adding changes from https://github.com/ClickHouse/ClickHouse/pull/8217 2020-01-01 11:44:45 -05:00
alexey-milovidov
14563da602
Merge pull request #8447 from amosbird/c++20 
C++20
 2019-12-31 21:06:41 +03:00
alexey-milovidov
fdcf971dce
Merge pull request #8486 from amosbird/betterprewhere 
Add prewhere test
 2019-12-31 21:01:12 +03:00
alexey-milovidov
e712b22dda
Merge pull request #8484 from ClickHouse/obsolete-mark-cache-min-lifetime 
Make "mark_cache_min_lifetime" setting obsolete
 2019-12-31 20:56:54 +03:00
Amos Bird
05a420ab20
Add prewhere test 2019-12-31 16:09:37 +08:00
alexey-milovidov
3adf6853d5
Merge pull request #7769 from amosbird/betterprewhere 
Optimize PREWHERE
 2019-12-31 09:07:02 +03:00
alexey-milovidov
17b413fd2e
Merge pull request #8458 from vitlibar/separate-variables-for-database-and-name 
Separate variables for database and name in dictionaries.
 2019-12-31 07:39:01 +03:00
Alexey Milovidov
3339b8e0e5 Make "mark_cache_min_lifetime" setting obsolete 2019-12-31 05:47:10 +03:00
alexey-milovidov
fc41fc7b9d
Merge pull request #8479 from 4ertus2/joins 
Fix crash in StorageJoin (add restriction)
 2019-12-31 03:02:55 +03:00
Vitaly Baranov
037eb85972 Automatic removing of config repositories to simplify the code. 2019-12-31 06:30:27 +07:00
alexey-milovidov
6c10fc5578
Update StorageJoin.cpp 2019-12-31 00:30:25 +03:00
alexey-milovidov
96c9567449
Update StorageJoin.cpp 2019-12-30 23:24:02 +03:00
chertus
928057c71f better fix 2019-12-30 23:08:03 +03:00
chertus
6b80ba52be fix crash in StorageJoin (add restriction) 2019-12-30 22:43:40 +03:00
Alexander Tokmakov
3687900848 Merge branch 'master' into table_name_in_istorage 2019-12-30 21:30:24 +03:00
Alexander Tokmakov
f19bb041b4 add asserts on invalid StorageID 2019-12-30 21:20:43 +03:00
alesapin
55c47106d4
Merge pull request #8456 from ClickHouse/refactor_alter_addition 
Refactor alter addition
 2019-12-30 17:50:34 +03:00
Alexander Tokmakov
250f170a69 Merge branch 'master' into table_name_in_istorage 2019-12-30 14:08:09 +03:00
alexey-milovidov
458f596e18
Merge pull request #8455 from amosbird/perfformat 
Perf test format io without disk
 2019-12-30 02:45:52 +03:00
Amos Bird
84c7589c9a
whitelist /dev/null in StorageFile 2019-12-30 02:37:55 +08:00
Vitaly Baranov
1fa64a2a86 Use separate variables for the database and name in dictionaries. 2019-12-29 23:48:10 +07:00
alesapin
e95fbecf03 Lock structure by default for generic alter implementation 2019-12-29 19:34:32 +03:00
alexey-milovidov
1b47aec9b5
Merge branch 'master' into enable_use_minimalistic_part_header_in_zookeeper 2019-12-29 19:30:34 +03:00
alesapin
44370467f0 More comments 2019-12-29 14:25:26 +03:00
alesapin
247906a4d7 Move check alter to alter interpreter 2019-12-29 14:09:10 +03:00
alesapin
9ee7807f45 Remove redundant file 2019-12-29 14:04:42 +03:00
alexey-milovidov
15c67f0a0e
Merge branch 'master' into refactor_databases 2019-12-29 03:52:07 +03:00
alexey-milovidov
6830d7fa2d
Merge pull request #8440 from excitoon-favorites/bettercheckforpartsonanotherdisks 
Improved check for parts on different disks
 2019-12-29 00:10:47 +03:00
Amos Bird
bbc736f2d9
c++20! 2019-12-29 03:08:25 +08:00
alesapin
9c42801c94 Fix stupid bug 2019-12-28 12:21:09 +03:00
Vladimir Chebotarev
1ad0c92873 Fixed logic error introduced in previous commit. 2019-12-28 10:30:12 +03:00
CurtizJ
ccb15e6332 better granularity computing 2019-12-28 00:32:55 +03:00
CurtizJ
74d5c6edc7 better writer for compact parts 2019-12-28 00:17:53 +03:00
alesapin
c48f892e13 Merge with master 2019-12-27 23:12:54 +03:00
alesapin
fef681acfe Fix style 2019-12-27 23:10:30 +03:00
Alexander Tokmakov
94931f059d minor improvements 2019-12-27 22:30:22 +03:00
alesapin
5334103690 More usage of StorageInMemoryMetadata 2019-12-27 22:04:30 +03:00
Vladimir Chebotarev
3c2ddc5a81 Improved check for parts on different disks. 2019-12-27 21:58:59 +03:00
Alexey Milovidov
cb3a5b26f7 Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-27 21:12:30 +03:00
alesapin
2d40b33120 More usage of metadata 2019-12-27 19:34:50 +03:00
alesapin
fcf3552750 Better changes 2019-12-27 18:07:53 +03:00
alesapin
d610bb215a Remove cerr 2019-12-27 18:05:23 +03:00
alesapin
166c1da6c9 Removed redundat changes 2019-12-27 18:03:49 +03:00
alesapin
7ad59edf8f Slightly more comments 2019-12-27 18:01:41 +03:00
alesapin
6916ac08c2 Rename fields 2019-12-27 17:46:11 +03:00
alesapin
716648bfa4 Something working 2019-12-27 17:36:59 +03:00
Ivan Lezhankin
bf22e12e4e Initial replacement readline → replxx 2019-12-27 16:17:36 +03:00
Alexander Tokmakov
a2a155dcbd Merge branch 'master' into table_name_in_istorage 2019-12-27 15:47:29 +03:00
chertus
3e13157994 better engine Join tests 2019-12-27 15:41:55 +03:00
Alexander Tokmakov
8987b027ba fixes 2019-12-27 15:18:49 +03:00
Alexander Burmak
9df9983641 Added fileName and parentPath utility functions 2019-12-27 13:42:30 +03:00
alesapin
ccb4ad450c Merge branch 'master' into refactor_alter 2019-12-27 12:07:20 +03:00
Alexander Burmak
170bcf041a Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-27 09:55:54 +03:00
Vitaly Baranov
b75771be61
Merge pull request #7808 from vitlibar/RBAC-3 
RBAC-3
 2019-12-27 09:44:24 +07:00
alexey-milovidov
d021d5e0ec
Merge pull request #8419 from apbodrov/url_fix 
[ISSUE-8157] incorrect parsing of file extension in URL
 2019-12-27 02:25:39 +03:00
alexey-milovidov
d2e5827307
Merge pull request #8410 from excitoon-favorites/ttlcheckvaliddeestination 
Added check for valid destination in a move TTL rule
 2019-12-27 00:29:55 +03:00
alexey-milovidov
89eeaa50e9
Merge branch 'master' into enable-experimental-indices-and-make-settings-obsolete 2019-12-26 22:16:50 +03:00
alexey-milovidov
1adc3cfb88
Merge pull request #8118 from excitoon-favorites/scan_all_disks 
Check extra parts of `MergeTree` at different disks, in order to not allow to miss data parts at undefined disks
 2019-12-26 22:10:53 +03:00
alexey-milovidov
938100dbe2
Update MergeTreeData.cpp 2019-12-26 22:10:04 +03:00
alesapin
d341b648d2 Better alter 2019-12-26 21:17:05 +03:00
Alexander Tokmakov
42296cc80a remove separate getTableName() and getDatabaseName() 2019-12-26 21:11:49 +03:00
Alexander Tokmakov
ef129b4b7c use StorageID in views 2019-12-26 20:59:47 +03:00
Alexander Tokmakov
9319863a59 refactor table dependencies 2019-12-26 20:23:24 +03:00
Alexander Tokmakov
2e5d61cd81 better constructors of storages 2019-12-26 20:04:08 +03:00
Andrei Bodrov
1516a252ee one line 2019-12-26 19:51:17 +03:00
Alexander Burmak
682b72551f Fixed merge issues 2019-12-26 19:38:10 +03:00
Alexander Tokmakov
cf5c998b30 refactor storage name 2019-12-26 19:23:38 +03:00
Artem Zuikov
b282cbcc91
Merge pull request #8400 from 4ertus2/joins 
New ANY JOIN + SEMI, ANTI JOIN for StorageJoin
 2019-12-26 18:35:50 +03:00
Vladimir Chebotarev
64b2b18d5b Added a check for bad disk/volume as a destination of move TTL expression. 2019-12-26 18:04:55 +03:00
Alexander Burmak
3f1832355f Added WriteMode enumeration 2019-12-26 17:28:22 +03:00
Alexander Burmak
764b506fd5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-26 17:03:32 +03:00
Alexander Tokmakov
50200e245b Merge branch 'master' into refactor_databases 2019-12-26 15:00:07 +03:00
alesapin
6f28e69e97
Merge pull request #8345 from azat/fix-flaky-test--Buffer_and_max_memory_usage 
Fix buffer overcommit and 01019_Buffer_and_max_memory_usage flakiness
 2019-12-26 13:21:47 +03:00
alesapin
093d56f474
Merge pull request #8382 from ClickHouse/relative_paths_in_storages 
Use relative paths in Storages
 2019-12-26 13:05:37 +03:00
Vladimir Chebotarev
c4e9784464 Fixed skipping parts algorithm while checking parts on other disks. 2019-12-26 01:12:17 +03:00
Vladimir Chebotarev
ab5171f403 Fixed tests. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
29068663ea Fixed build. 2019-12-25 23:32:15 +03:00
Vladimir Chebotarev
80056551ce Check extra parts of MergeTree at different disks, in order to not allow to miss data parts at undefined disks. 2019-12-25 23:32:15 +03:00
CurtizJ
0b99df9aed better column initialization in data parts 2019-12-25 23:06:16 +03:00
CurtizJ
c298616eac reduce number of seeks in ReaderCompact 2019-12-25 20:34:23 +03:00
chertus
4fd7340416 New ANY JOIN for StorageJoin + SEMI, ANTI 2019-12-25 20:32:55 +03:00
CurtizJ
aadb948c09 temporarly store all parts in compact format 2019-12-25 20:08:12 +03:00
Alexander Tokmakov
7c48396689 refactor databases: inherit from DatabaseOnDisk 2019-12-25 16:23:38 +03:00
CurtizJ
c8393f2c8b fix mutations with mixed-granularity parts 2019-12-25 16:05:46 +03:00
alesapin
3b6e3db0c2 Remove redundant alter_lock, because parts cannot be altered concurrently. 2019-12-25 15:34:04 +03:00
alesapin
d4987f86d3 Merge branch 'master' into immutable_parts 2019-12-25 11:44:47 +03:00
Alexander Burmak
544bfd105b Corrected naming based on review feedback 2019-12-25 11:24:13 +03:00
CurtizJ
4bd4ac715c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-25 03:10:24 +03:00
CurtizJ
206cb1afa9 fix broken by refactoring functionality with wide parts 2019-12-25 01:49:39 +03:00
alesapin
34d2afa354 Fix obvious bug 2019-12-24 23:03:33 +03:00
Nikolai Kochetov
6a1dccd27c Change initialization order for StorageDistributedDirectoryMonitor members. 2019-12-24 21:25:00 +03:00
alesapin
05b933b1d3 Better 2019-12-24 21:07:51 +03:00
Alexander Tokmakov
6325f8507c fixes 2019-12-24 20:41:24 +03:00
Alexander Tokmakov
60a47c3453 Merge branch 'master' into relative_paths_in_storages 2019-12-24 19:58:34 +03:00
tavplubix
7c1a6c726d
Merge pull request #8359 from ClickHouse/more_readable_interpreter_create 
Refactor table creation
 2019-12-24 18:07:43 +03:00
Alexander Tokmakov
514868cebc use relative paths in IStorage::rename(...) 2019-12-24 16:35:50 +03:00
Alexander Burmak
97f03ab064 Fixed CI errors 2019-12-24 13:25:14 +03:00
alexey-milovidov
28c7e78d36
Merge pull request #8344 from ClickHouse/system-stack-trace 
Added system.stack_trace table.
 2019-12-24 12:15:48 +03:00
Alexander Tokmakov
ac3f53f300 refactor StorageFile construction 2019-12-23 23:07:31 +03:00
Alexey Milovidov
3b7f3b07cd Better handling of signals 2019-12-23 22:23:54 +03:00
Alexey Milovidov
e907ce103e Fixed warning 2019-12-23 21:58:42 +03:00
Alexey Milovidov
9da4b63fe9 Fixed Darwin build 2019-12-23 21:56:57 +03:00
Alexey Milovidov
56870c6b3b Fixed -Wshadow 2019-12-23 19:49:06 +03:00
alesapin
25ecc38615 More correct separation between metadata and data alters for non replicated MergeTree. 2019-12-23 19:44:50 +03:00
Alexander Tokmakov
5fab732408 use arbitrary relative path in *MergeTree 2019-12-23 18:37:55 +03:00
Alexander Tokmakov
4f58d662f7 make data path relative 2019-12-23 18:20:08 +03:00
alesapin
73c9f0e71c Remove redundant code 2019-12-23 17:46:00 +03:00
alesapin
f168977b9a Merge branch 'master' into synchronous_mutations 2019-12-23 16:24:50 +03:00
Alexander Burmak
0894ed9f33 Integration of log storages with IDisk interface 2019-12-23 16:11:56 +03:00
Azat Khuzhin
58055e6a94 Do not overcommit Buffer memory usage 
During INSERT the check against existing rows and rows from the INSERT
block is performed and if they exceeded threshold the Buffer should be
flushed to avoid overcommit, while before this patch the second check
(in flushBuffer()) will ignore rows from INSERT block.
 2019-12-23 01:39:37 +03:00
Alexey Milovidov
4d349e9ed0 Added TODO 2019-12-23 00:01:12 +03:00
Alexey Milovidov
ca25e2f30f Added query_id to "system.stack_trace" 2019-12-22 23:37:29 +03:00
Alexey Milovidov
9c868c910a Simplification 2019-12-22 23:17:16 +03:00
Alexey Milovidov
e0000bef98 Added "system.stack_trace" table (development) 2019-12-22 20:20:33 +03:00
alexey-milovidov
fee9fda34c
Merge pull request #8130 from CurtizJ/optimize-storage-merge 
Implement ORDER BY optimization for Storage Merge.
 2019-12-22 12:43:18 +03:00
alexey-milovidov
980cf16873
Merge pull request #8323 from ClickHouse/minor-improvements-backquote 
Added quoting of db and table names where appropriate
 2019-12-20 22:14:35 +03:00
alexey-milovidov
0d119a40eb
Merge pull request #8240 from vitlibar/sync-system-reload-dictionary 
Synchronous system reload dictionary
 2019-12-20 20:00:03 +03:00
Alexey Milovidov
41ed1ed471 Added quoting of db and table names where appropriate 2019-12-20 19:53:37 +03:00
proller
521e2e709e Build fixes. Arm, minimal build 2019-12-20 17:46:00 +03:00
CurtizJ
75c5e02ec2 improve input order analyzing and turn on order by optimization with left/inner joins 2019-12-20 16:15:17 +03:00
Alexander Tokmakov
10ad22faea refactor InterpreterCreateQuery::createTable(...) 2019-12-20 15:51:51 +03:00
alexey-milovidov
7f10630873
Merge pull request #8308 from ClickHouse/deprecate-merge_tree_uniform_read_distribution 
Deprecate "merge_tree_uniform_read_distribution" setting
 2019-12-20 15:28:34 +03:00
Javi santana bot
dd5435501a check for active replicas when waiting for commands 2019-12-20 11:04:16 +01:00
alexey-milovidov
de01dd12b5
Merge pull request #8306 from ClickHouse/fix_rename_distributed 
Fix rename distributed
 2019-12-20 04:38:21 +03:00
Alexey Milovidov
0ac868ed48 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 04:11:37 +03:00
Alexey Milovidov
371aef532c Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 02:49:41 +03:00
Alexey Milovidov
9ce8d5fe54 Deprecate "merge_tree_uniform_read_distribution" setting 2019-12-20 01:38:05 +03:00
chertus
b5658ef1a3 remove qualification in StorageJoin JOIN case 2019-12-19 23:37:10 +03:00
Alexander Tokmakov
d1568c1614 fix rename distributed 2019-12-19 22:51:12 +03:00
chertus
c72b0d4e2a fix engine join crash [wip] 2019-12-19 18:50:28 +03:00
Vitaly Baranov
6baccb963d Add functions currentRowPolicies() and system table 'system.row_policies'. 2019-12-19 18:40:15 +03:00
alesapin
0cc7ccfc2e Remove unintended diff 2019-12-19 18:30:52 +03:00
alesapin
9fea941009 Make wait endless 2019-12-19 18:27:56 +03:00
CurtizJ
ba2a630a13 merging with master 2019-12-19 16:10:57 +03:00
alesapin
88033a4333 Merge branch 'master' into synchronous_mutations 2019-12-19 15:44:02 +03:00
CurtizJ
9db2f2ccbc Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-19 14:46:43 +03:00
alexey-milovidov
f5a16b1229
Update KeyCondition.cpp 2019-12-18 22:04:33 +03:00
alexey-milovidov
b5cab7c721
Update KeyCondition.cpp 2019-12-18 22:03:57 +03:00
Alexey Milovidov
90795b7d4b Added asserts to KeyCondition while evaluating RPN 2019-12-18 22:00:09 +03:00
CurtizJ
258e8d61fb polymorphic parts (development) cleanup 2019-12-18 19:41:11 +03:00
CurtizJ
6f673407ff polymorphic parts (development) cleanup 2019-12-18 19:27:49 +03:00
CurtizJ
55b7db716a polymorphic parts (development) cleanup 2019-12-18 18:54:45 +03:00
CurtizJ
ae74d28f87 polymorphic parts (development) fix alter 2019-12-18 17:23:27 +03:00
CurtizJ
59faa4927b polymorphic parts (development) alter update 2019-12-18 16:09:58 +03:00
alesapin
f110b70ad8 Merge branch 'master' into synchronous_mutations 2019-12-18 12:00:14 +03:00
alexey-milovidov
a7384b4d07
Merge branch 'master' into MoreGCCWarnings 2019-12-18 02:01:39 +03:00
alesapin
9a005d27ea Merge branch 'master' into synchronous_mutations 2019-12-17 15:27:36 +03:00
alesapin
b2979546c3 Fix mutation number by default 2019-12-17 15:23:17 +03:00
Vitaly Baranov
d0d5c72e4d Reloading of a dictionary now waits for results and shows errors. 
Clearer names for load and reload functions in ExternalLoader.
 2019-12-17 13:45:47 +03:00
Guillaume Tassery
bdcee8b382 Merge branch 'master' of github.com:ClickHouse/ClickHouse into move_partition 2019-12-17 11:18:11 +01:00
Olga Khvostikova
b47863a0c6
Fix segfault in table function file while inserting into it (#8177) 
* Fix segfault in table function file while inserting into it
 2019-12-17 11:06:39 +03:00
Guillaume Tassery
de9ab66935 fix merge conflict 2019-12-17 08:20:54 +01:00
Guillaume Tassery
595815bdf5 Add table as part destination type 2019-12-17 07:51:40 +01:00
Guillaume Tassery
dca0c83809
Merge branch 'master' into move_partition 2019-12-17 13:49:18 +07:00
Vxider
f564d524e5 parallel insert support for ReplicatedMergeTree 2019-12-17 12:22:58 +08:00
Vxider
2a94832ef6 parallel INSERT in INSERT SELECT query 2019-12-17 12:22:58 +08:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alesapin
2695aa13c4 Add ability to execute mutations asynchronously 2019-12-16 18:51:15 +03:00
CurtizJ
831f39a3df polymorphic parts (development) alter 2019-12-16 17:51:19 +03:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
Vitaliy Zakaznikov
cf22cde702 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into live_view_support_for_subquery 2019-12-14 19:21:44 +01:00
Vitaliy Zakaznikov
0f9450433f * Reverting back to the old logic. 
* Removing redundant catch clauses.
* Updating createStorage function signature in StorageBlocks.h.
 2019-12-14 18:29:34 +01:00
Nikolai Kochetov
28fcc6902f Try to simplify code in StorageLiveView 2019-12-13 20:08:21 +03:00
Mikhail Filimonov
f3fa71c707 Init query context for Kafka to make subqueries work 2019-12-13 02:21:40 +01:00
alexey-milovidov
399995d60b
Merge pull request #7812 from infinivision/fix_part_mutation 
fix part mutation
 2019-12-13 03:45:59 +03:00
alexey-milovidov
d0cf282204
Merge pull request #8179 from ClickHouse/parts_to_do_names 
Add parts_to_do_names column to system.mutations.
 2019-12-13 02:30:03 +03:00
alexey-milovidov
69535078fd
Merge pull request #8192 from excitoon-favorites/better-logging-disks 
Better logging in background move task.
 2019-12-13 02:27:38 +03:00
alexey-milovidov
32f42c4e92
Merge pull request #8194 from excitoon-favorites/fixed-move-pool 
Fixed metrics in `BackgroundProcessingPool`
 2019-12-13 02:26:52 +03:00
Artem Zuikov
5783142f39
Merge pull request #8178 from 4ertus2/some 
Refactoring: extract getTableExpressions() variants into own file
 2019-12-13 01:09:47 +03:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Vladimir Chebotarev
9882c7c5ad Minor fix in logging. 2019-12-13 00:38:05 +03:00
Vladimir Chebotarev
9393bb0f12 Better logging in background move task. 2019-12-13 00:34:57 +03:00
CurtizJ
26d159e889 polymorphic parts (development) alter 2019-12-12 21:55:19 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL: 
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
 2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration 
AWS SDK S3 integration
 2019-12-12 20:43:16 +03:00
alesapin
b7622c8fd9 Add parts_to_do_names column to system.mutations 2019-12-12 19:24:03 +03:00
chertus
68a33863ab extract getTableExpressions variants into own file 2019-12-12 19:06:18 +03:00