Ivan Lezhankin
39ea079034
More clean-up
2020-02-17 17:27:09 +03:00
Alexey Milovidov
809b409426
Read the code
2020-02-17 15:44:58 +03:00
Nikolai Kochetov
34e32db810
Fix build.
2020-02-17 14:55:32 +03:00
Nikolai Kochetov
bbdac39d2d
Fix build.
2020-02-17 14:50:53 +03:00
Nikolai Kochetov
f4d5175a12
Fix build.
2020-02-17 14:26:09 +03:00
Pavel Kovalenko
f9965a7d29
Merge branch 'master' into storage-stripe-log-s3
...
# Conflicts:
# dbms/tests/config/disks.xml
2020-02-17 13:46:06 +03:00
Nikolai Kochetov
4599fbd798
Added force_tree_shaped_pipeline flag to SelectQueryInfo.
2020-02-17 13:42:14 +03:00
Nikolai Kochetov
9b2d03f58c
Fix StorageMerge.
2020-02-17 12:26:15 +03:00
Alexey Milovidov
b88238dffc
Added 9th reason why parts can appear to be non byte-identical after download
2020-02-17 08:16:48 +03:00
alexey-milovidov
41c883ace3
Merge pull request #8911 from millb/secure_password
...
Changed format for path in replicas
2020-02-16 07:17:12 +03:00
alexey-milovidov
6f51f089ec
Merge pull request #9138 from ClickHouse/system-replicas-add-zookeeper-exception-column
...
Add zookeeper_exception column to system.replicas table.
2020-02-16 06:14:22 +03:00
Alexey Milovidov
4ae404f794
Implement #9137
2020-02-15 03:13:00 +03:00
Alexey Milovidov
07479236d7
Implement #9137
2020-02-15 03:11:09 +03:00
alexey-milovidov
38c4f3ed84
Merge pull request #9131 from ClickHouse/better_temporary_live_view_syntax
...
Better CREATE syntax for temporary LIVE VIEW
2020-02-15 02:55:37 +03:00
alexey-milovidov
db1c67e3e3
Merge pull request #9100 from ClickHouse/issue-9094
...
Prevent abort on shutdown if the fs is readonly
2020-02-15 02:38:37 +03:00
CurtizJ
cb9936cbc4
better checking if we can use polymorphic parts
2020-02-15 00:33:02 +03:00
Alexander Tokmakov
6889951396
better syntax for temporary LIVE VIEW
2020-02-14 21:20:20 +03:00
Nikolai Kochetov
1685c4d689
Fix build.
2020-02-14 20:50:27 +03:00
Nikolai Kochetov
52a63275ea
Merge with master.
2020-02-14 20:47:39 +03:00
Pavel Kovalenko
06e203d004
StorageStripeLog S3 support.
2020-02-14 17:28:33 +03:00
Nikolai Kochetov
96b5ef8459
Processors support for StorageStripeLog reading.
2020-02-14 13:57:09 +03:00
Nikolai Kochetov
0766e46bcd
Fix StorageFile.
2020-02-14 13:22:05 +03:00
CurtizJ
ddb3a55f67
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-02-14 13:15:16 +03:00
CurtizJ
7041e28077
fix segfault in MergeTreeRangeReader
2020-02-14 00:20:35 +03:00
CurtizJ
6e1734f2d7
remove rarely used createPart overload
2020-02-13 17:42:48 +03:00
CurtizJ
64e1883c06
better replication with compact parts
2020-02-13 17:19:43 +03:00
Alexey Milovidov
b5c79201c3
Prevent abort on shutdown if the fs is readonly
2020-02-13 16:15:54 +03:00
Mikhail Korotov
5bd74b464d
Merge branch 'secure_password' of https://github.com/millb/ClickHouse into secure_password
2020-02-12 13:08:10 +03:00
millb
92fc1a9b2b
fixed bugs
2020-02-12 13:06:09 +03:00
Mikhail Korotov
01b03f9b1f
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password
2020-02-12 11:43:52 +03:00
CurtizJ
59c4f53fec
fix polymorphic parts fetching
2020-02-12 02:29:34 +03:00
Alexander Kuzmenkov
413cb601dd
Merge pull request #8969 from filimonov/kafka_producer_with_key_and_timestamp
...
key and timestamp in Kafka producer
2020-02-11 22:03:37 +03:00
Ilya Yatsishin
5b4b04e13b
Merge pull request #9050 from CurtizJ/fix-range-reader
...
Fix order of ranges in MergeTreeDataSelectExecutor
2020-02-11 18:31:34 +03:00
CurtizJ
b26a8b5622
choose part type while selecting parts to merge
2020-02-11 16:41:26 +03:00
Mikhail Korotov
f8db74fca6
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password
2020-02-11 13:51:37 +03:00
CurtizJ
c72c38aea9
require strict part type in MergeTreeReaders
2020-02-10 23:30:49 +03:00
CurtizJ
90a121cc1e
remove useless line
2020-02-10 19:34:47 +03:00
CurtizJ
852772364e
replace std::vector to std::deque for MarkRanges
2020-02-10 19:04:24 +03:00
Artem Zuikov
bd6d9a427b
Some InterpreterSelectQuery refactoring ( #9035 )
...
move ExpressionActionsChain logic out of InterpreterSelectQuery
2020-02-10 18:50:12 +03:00
tavplubix
4543177931
Merge pull request #9048 from ClickHouse/fix_mutation_order
...
Fix primary.idx corruption after delete mutation
2020-02-09 19:21:23 +03:00
alesapin
19de74d5bd
Remove redundant lock
2020-02-09 11:52:42 +03:00
alesapin
2dca542d2e
Correctly accuire lock
2020-02-09 11:42:15 +03:00
alesapin
5a96eaf0e8
Add missed locks for ReplicatedMergeTree alter
2020-02-08 16:39:44 +03:00
CurtizJ
b9fc9b4569
fix order of ranges in MergeTreeDataSelectExecutor
2020-02-08 00:07:18 +03:00
alesapin
f9d70e741f
Merge pull request #9047 from ClickHouse/fix_unit_tests
...
Fix unit tests
2020-02-07 21:30:09 +03:00
Nikita Mikhaylov
1324f3946e
Merge pull request #8988 from nvartolomei/nv/alter-mv-modify-query
...
Modify Materialized View query
2020-02-07 21:28:27 +03:00
alesapin
1ada6e663c
Missed change
2020-02-07 16:56:57 +03:00
alesapin
dcfe6524e5
Fix unit tests
2020-02-07 12:51:48 +03:00
CurtizJ
2780250d05
better code near data part writer
2020-02-06 18:32:00 +03:00
Nicolae Vartolomei
0939a9460f
Modify Materialized View query
2020-02-06 08:57:54 +00:00
alesapin
29a26a87b4
Merge pull request #9022 from ClickHouse/mutations_parts_to_do_fix
...
Fix mutations finalization task
2020-02-06 11:26:13 +03:00
zhang2014
784230b7a8
ISSUES-8971 fix non from
2020-02-06 08:30:14 +08:00
CurtizJ
db47ef923c
fix prewhere
2020-02-05 19:42:27 +03:00
alesapin
1923930379
Fix mutations finalization task
2020-02-05 19:30:02 +03:00
zhang2014
16bb4e975d
ISSUES-8971 support explain & view storage
2020-02-05 19:40:18 +08:00
zhang2014
b9443c98fe
ISSUES-8971 fix view with predicate optimizer
2020-02-05 16:00:06 +08:00
Mikhail Filimonov
babd3ca34e
Fixing test build, more review fixes
2020-02-05 08:05:55 +01:00
Mikhail Filimonov
8c736e6c9f
After review fixes
2020-02-04 22:19:34 +01:00
CurtizJ
2f9f5dfc7a
better initialization of MergedBlockOutputStream
2020-02-04 19:15:28 +03:00
CurtizJ
31c39c8137
fix mutations
2020-02-04 15:11:32 +03:00
Nikolai Kochetov
bc757f6b24
Processors support for StorageS3 reading.
2020-02-03 21:01:41 +03:00
CurtizJ
1785b27ae5
fix build
2020-02-03 19:37:00 +03:00
CurtizJ
a0635ed390
better marks reading
2020-02-03 19:02:54 +03:00
CurtizJ
257bb3b599
add comments near DataPart code
2020-02-03 15:08:40 +03:00
Nikolai Kochetov
a029e49438
Processors support for StorageNull reading.
2020-02-03 14:23:52 +03:00
Nikolai Kochetov
eae2ce194d
Processors support for StorageNull reading.
2020-02-03 14:22:21 +03:00
CurtizJ
2d7ff400ed
Merge remote-tracking branch 'upstream/master' into polymorphic-parts
2020-02-03 13:46:00 +03:00
Nikolai Kochetov
fde86203a7
Fix StorageJoin
2020-02-03 13:42:20 +03:00
Mikhail Korotov
bf3caa0373
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into secure_password
2020-02-03 13:08:20 +03:00
Mikhail Filimonov
24ff635435
draft implementation, wip
2020-02-03 11:02:52 +01:00
alexey-milovidov
c793f30873
Merge pull request #8954 from ClickHouse/os-thread-id
...
Use OS thread id everywhere instead of internal thread number.
2020-02-03 03:57:35 +03:00
alexey-milovidov
baf218b431
Merge pull request #8932 from 4ertus2/debt
...
Rename ANY INNER to SEMI JOIN for partial merge join
2020-02-03 01:53:52 +03:00
alexey-milovidov
bf4887a33d
Merge pull request #8822 from millb/Prohibition_secondary_index_with_old_format_merge_tree
...
Prohibition secondary index with old syntax merge tree
2020-02-03 00:04:04 +03:00
Alexey Milovidov
d11f3cb78f
Changed thread_id to UInt64 to support more OS
2020-02-02 23:01:13 +03:00
chertus
d2e8b24970
better compatibility in EngineJoin
2020-02-02 19:12:48 +03:00
alexey-milovidov
55c5bdbace
Trigger CI
2020-02-02 05:49:36 +03:00
Alexey Milovidov
39b31907b5
Rename function #7477
2020-02-02 05:35:47 +03:00
Alexey Milovidov
f9eb4e79f6
Using OS tid everywhere #7477
2020-02-02 05:28:14 +03:00
alexey-milovidov
3a1e3f612e
Merge branch 'master' into idisk-seekable-readbuffer
2020-02-02 03:54:50 +03:00
alexey-milovidov
eeacc97d2f
Merge pull request #8852 from vitlibar/RBAC-4
...
RBAC-4
2020-02-02 03:35:31 +03:00
alexey-milovidov
d20bae03fb
Merge pull request #8908 from azat/fixes
...
Tiny fixes
2020-01-31 23:22:30 +03:00
Vitaly Baranov
10c912dab2
Rewrite the User class to be controlled by AccessControlManager.
2020-01-31 20:27:32 +03:00
Vitaly Baranov
2aa58193c8
Check access rights via new interface.
2020-01-31 20:27:28 +03:00
Nikolai Kochetov
cef9db809f
Processors support for StorageMySQL reading.
2020-01-31 19:46:27 +03:00
Nikolai Kochetov
dd888f59a7
Fix MemorySource.
2020-01-31 19:36:57 +03:00
Nikolai Kochetov
dbffabfd46
Processors support for StorageMerge reading.
2020-01-31 19:31:08 +03:00
Nikolai Kochetov
7bedce40ea
Processors support for StorageMerge reading.
2020-01-31 19:29:40 +03:00
alexey-milovidov
c2c5b81b70
Merge pull request #8851 from excitoon-favorites/globss3
...
Added globs/wildcards for s3
2020-01-31 18:56:06 +03:00
alexey-milovidov
9eb01b16fd
Merge pull request #8913 from nvartolomei/nv/alter-mv-replace-v20.1
...
ALTER <materialized view name> MODIFY QUERY <select_query>
2020-01-31 18:44:32 +03:00
Nikolai Kochetov
dc96e6d1cf
Processors support for StorageMemory reading.
2020-01-31 18:26:10 +03:00
Nikolai Kochetov
fc7839716f
Processors support for StorageMaterializedView reading.
2020-01-31 18:16:06 +03:00
Nikolai Kochetov
046ff34525
Processors support for StorageLog reading.
2020-01-31 18:10:10 +03:00
Nikolai Kochetov
384e68d745
Processors support for StorageJoin reading.
2020-01-31 17:51:09 +03:00
Nikolai Kochetov
f9db37ebf7
Processors support for StorageInput reading.
2020-01-31 17:26:51 +03:00
Nikolai Kochetov
6870132713
Processors support for StorageHDFS reading.
2020-01-31 17:06:43 +03:00
Nikolai Kochetov
2d1f06a49f
Processors support for StorageFile reading.
2020-01-31 16:12:11 +03:00
Mikhail Korotov
14acdffb0e
Update DirectoryMonitor.cpp
2020-01-31 14:29:21 +03:00
Mikhail Korotov
5c5b76d2b0
Update DirectoryMonitor.cpp
2020-01-31 14:28:39 +03:00
millb
d05642575d
fixed
2020-01-31 14:16:46 +03:00
millb
165afabdd2
second attempt
2020-01-31 12:22:30 +03:00
Nikolai Kochetov
0157de021a
Processors support for StorageDistributed reading.
2020-01-31 11:54:57 +03:00
Nikolai Kochetov
240f1e3e96
Processors support for StorageDictionary.
2020-01-31 11:14:20 +03:00
Nikolai Kochetov
c5289212ca
Merge pull request #8902 from ClickHouse/storage-buffer-processors
...
Storage buffer processors
2020-01-31 10:46:16 +03:00
alexey-milovidov
d76d55335e
Merge pull request #8914 from bgiard/range_reader
...
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
2020-01-31 03:57:52 +03:00
alexey-milovidov
5d3c62cd52
Merge pull request #8917 from filimonov/kafka_fixes_part2
...
Kafka fixes part2
2020-01-31 03:55:46 +03:00
Mikhail Filimonov
a6e3265960
Kafka proper rebalances processing, controlled assignment, faster tests
2020-01-30 20:30:45 +01:00
Pavel Kovalenko
52db32fd5d
Fixed reading from StorageLog table.
2020-01-30 22:30:42 +03:00
Pavel Kovalenko
9efda05839
StorageLog test with DiskLocal and DiskMemory.
2020-01-30 22:29:30 +03:00
alexey-milovidov
8f75797801
Merge pull request #8906 from zlobober/key_conditions
...
Extend KeyCondition interface so that it returns BoolMask.
2020-01-30 18:52:47 +03:00
Baudouin Giard
9216c5761c
Fix crash in corner case of MergeTreeRangeReader::ReadResult::shrink
...
It looks like most times the original number of rows per granule is
pretty much consistent across all granules, except for the last one,
however there seems to be cases (Issue #7713 ) where that's not the case.
The only way I have to reproduce the crash involves using proprietary
data, and unfortunately I haven't been able to come up with a test case
that would highlight the problem - just like the person who opened issue
7713. I can't share my dataset.
Reading the code, it looks pretty obvious to me here - unless I'm
missing something, that the intention here is to copy the corresponding
granules to one another so it makes sense to index
rows_per_granule_original with the same variable as rows_per_granule.
Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-01-30 15:40:48 +00:00
Nicolae Vartolomei
fd42d1ee87
ALTER <materialized view name> MODIFY QUERY <select_query>
...
Trying to resurrect https://github.com/ClickHouse/ClickHouse/pull/7533 .
I'd like to get this PR in if we have an agreement on syntax and general
direction, after that I'll rebase actual alter functionality from above mentioned PR.
2020-01-30 14:12:49 +00:00
Nikolai Kochetov
3c4fe4f20e
Fix StorageBuffer/
2020-01-30 13:30:48 +03:00
Nikolai Kochetov
00546498b6
Fix StorageBuffer/
2020-01-30 13:26:25 +03:00
Nikolai Kochetov
9eb97e6db2
Fix StorageBuffer/
2020-01-30 13:22:59 +03:00
Vladimir Chebotarev
4b2eff8551
Added passing ttl info between replicas.
2020-01-30 13:21:40 +03:00
Nikolai Kochetov
5fd9db4370
Fix BufferSource.
2020-01-30 10:32:54 +03:00
Nikolai Kochetov
a5b016eb61
Fix BufferSource.
2020-01-30 10:28:49 +03:00
millb
f7ab01b746
Merge branch 'Prohibition_secondary_index_with_old_format_merge_tree' of https://github.com/millb/ClickHouse into Prohibition_secondary_index_with_old_format_merge_tree
2020-01-30 10:13:52 +03:00
millb
7e1a23d910
fixed
2020-01-30 10:13:09 +03:00
Vladimir Chebotarev
9706374066
Fixed error messages.
2020-01-30 09:17:55 +03:00
Azat Khuzhin
ca8d9ac7f8
Fix error message for force_optimize_skip_unused_shards
2020-01-30 09:01:54 +03:00
Maxim Akhmedov
fa16149e1a
Fix style checks.
2020-01-30 02:36:39 +03:00
Maxim Akhmedov
2d3321e003
Extend KeyCondition interface so that it returns BoolMask.
2020-01-30 00:40:22 +03:00
Nikolai Kochetov
d1bc3513a2
Fix build.
2020-01-29 21:22:09 +03:00
Nikolai Kochetov
84a392402f
Processors reading for StorageBuffer.
2020-01-29 21:14:40 +03:00
Nikolai Kochetov
57100fc962
Merge branch 'master' into storage-system-processors
2020-01-29 13:17:18 +03:00
Nikolai Kochetov
8ce6040306
Merge pull request #7796 from ClickHouse/processors-4.3
...
Processors and system.numbers
2020-01-29 13:11:13 +03:00
Azat Khuzhin
60d63081da
Fix min_marks_for_seek for the data skipping indexes
2020-01-28 23:10:06 +03:00
Pavel Kovalenko
e0cd6b1073
Formatting issues.
2020-01-28 19:09:24 +03:00
Pavel Kovalenko
efeb9e92be
StorageLog Gtest
2020-01-28 19:08:30 +03:00
Mikhail Filimonov
dc43728dea
Test showing the problem with partial commit of polled batch + fix
2020-01-28 15:21:36 +01:00
Mikhail Filimonov
5dafccf410
Test for flushing by time and by block size (+fix), one extra test for virual columns
2020-01-28 14:24:37 +01:00
Pavel Kovalenko
d4707ca911
Seek reworking.
2020-01-28 15:48:01 +03:00
alexey-milovidov
1f90d2f078
Merge pull request #8866 from achulkov2/issue-8865_unnamed_tuples_should_not_be_flattened
...
Issue 8865 unnamed tuples should not be flattened
2020-01-28 12:32:58 +03:00
alexey-milovidov
45dce57a8c
Merge pull request #8830 from zlobober/storage_properties
...
Explicitly specify storage features
2020-01-28 01:49:53 +03:00
achulkov2
b7c9075e53
Stop flattening unnamed nested tuples
2020-01-27 23:26:39 +03:00
Vladimir Chebotarev
533011a5f5
Minor review and style fixes.
2020-01-27 23:08:43 +03:00
Pavel Kovalenko
07755ec8f7
Merge branch 'master' into idisk-seekable-readbuffer
...
# Conflicts:
# dbms/programs/server/config.xml
2020-01-27 21:45:53 +03:00
Pavel Kovalenko
abfacdaadc
SeekableReadBuffer refactoring.
...
Store size and multiple references for S3 metadata file.
Log engine support for S3.
2020-01-27 21:44:30 +03:00
Maxim Akhmedov
2e9538f768
Another fix for tests. Better handling of MV.
2020-01-27 21:28:37 +03:00
Alexey Milovidov
390745cc81
Fixed the issue with too many open files when using StorageFile with globs
2020-01-27 21:26:58 +03:00
Alexey Milovidov
1ce32211cf
Fixed the issue with too many open files when using StorageFile with globs
2020-01-27 21:25:54 +03:00
Alexey Milovidov
59ef3c8034
Fixed the issue with too many open files when using StorageFile with globs
2020-01-27 21:13:02 +03:00
Alexey Milovidov
a1f05d3a56
Fixed the issue with too many open files when using StorageFile with globs
2020-01-27 20:06:32 +03:00
Maxim Akhmedov
675d0f549f
Add replication and deduplication properties.
2020-01-27 17:14:49 +03:00
Maxim Akhmedov
419f2c2c2b
Fix segmentation fault.
2020-01-27 16:04:01 +03:00
Nikolai Kochetov
ef268d7016
Fix TablesBlockSource.
2020-01-27 16:00:18 +03:00
alexey-milovidov
4613615b4a
Merge pull request #8850 from excitoon-favorites/fixcolumns
...
Fixed `StorageInput::StorageInput` a little bit
2020-01-27 15:26:10 +03:00
CurtizJ
a5d9975e37
better checking if table has TTL
2020-01-27 14:53:50 +03:00
Vladimir Chebotarev
18804407aa
Properly added _file and _path columns.
2020-01-27 13:22:49 +03:00
