Commit Graph

3163 Commits

Author SHA1 Message Date
alesapin
cec02d15ed
Merge pull request #12067 from excitoon-favorites/betters3logs
Moved useless S3 logging to TRACE level
2020-07-02 13:21:55 +03:00
Vitaly Baranov
03b36c262e Improve REVOKE command: now it requires only grant/admin option for only
access which will be revoked.
REVOKE ALL FROM user1 now revokes all granted roles.
2020-07-02 12:54:24 +03:00
Nikolai Kochetov
79cd33a567 Fix tests. 2020-07-02 10:44:47 +03:00
Alexander Kazakov
cc2cadb7f5
Merge pull request #11893 from excitoon-favorites/autostartmoves
In *MergeTree: Parts moving task shall be started if new storage policy needs them
2020-07-02 10:44:38 +03:00
zhang2014
9ed5c6d925 ISSUES-4006 support first for ALTER ADD|MODIFY COLUMN 2020-07-01 22:58:52 +08:00
Vitaly Baranov
811d124a82
Merge pull request #12002 from vitlibar/fix-partial-revokes
Fix partial revokes
2020-07-01 17:15:01 +03:00
Nicolae Vartolomei
3854ce6d84 Rewrite Set lookup to make it more readable 2020-07-01 15:05:54 +01:00
Nicolae Vartolomei
f8ceca6942 Remove const specifier to allow auto-move (clangtidy) 2020-07-01 15:04:08 +01:00
Vladimir Chebotarev
a541683efa Moved useless S3 logging to TRACE level. 2020-07-01 01:04:30 +03:00
alexey-milovidov
948af0bfc5
Merge pull request #12045 from ClickHouse/fix_loading_of_tables
Parse metadata in parallel when loading tables
2020-06-30 21:16:40 +03:00
Nikolai Kochetov
3585700506 Fix tests. 2020-06-30 19:41:43 +03:00
Vitaly Baranov
c39eb8f71b Fix partial revokes (complex cases). 2020-06-30 18:47:02 +03:00
Nicolae Vartolomei
8f1845185e Try fix pk in tuple performance
Possible approach for fixing #10574

The problem is that prepared sets are built correctly, it is a hash map of key -> set
where key is a hash of AST and list of data types (when we a list of
tuples of literals).

However, when the key is built from the index to try and find if there
exists a prepared set that would match it looks for data types of the
primary key (see how data_types is populated) because the primary key
has only one field (v in my example) it can not find the prepared set.

The patch looks for any prepared indexes where data types match for the
subset of fields found in primary key, we are not interested in other
fields anyway for the purpose of primary key pruning.
2020-06-30 16:33:38 +01:00
Vitaly Baranov
40942a2164
Merge pull request #12031 from vitlibar/fix-access-rights-if-allow_introspection_functions-is-0
Fix calculation of access rights when allow_introspection_functions = 0
2020-06-30 18:32:18 +03:00
Nikolai Kochetov
ddc231b088 Check type of filter for prewhere. 2020-06-30 17:58:11 +03:00
Nikolai Kochetov
e3aede57c6 Check type of filter for prewhere. 2020-06-30 17:48:00 +03:00
Nikolai Kochetov
18059e9289 Check type of filter for prewhere. 2020-06-30 17:44:49 +03:00
Nikolai Kochetov
66da0733ab Check type of filter for prewhere. 2020-06-30 17:20:27 +03:00
Nikita Mikhaylov
c45a054f65 fix clang-tidy 2020-06-30 16:06:35 +03:00
Vladimir Chebotarev
bb8da71eff Moves task shall be started if new storage policy needs them. 2020-06-30 15:36:44 +03:00
alexey-milovidov
81b43dc481
Merge pull request #12020 from ClickHouse/fix-collations-order-by-tuple-const
Fix ORDER BY tuple with COLLATE on const column
2020-06-30 15:09:57 +03:00
alexey-milovidov
08b6ca19d8
Merge pull request #12043 from ClickHouse/topk-enum
Make topK return Enum for Enum types
2020-06-30 15:08:42 +03:00
Nikita Mikhaylov
b74b27854a yet another try 2020-06-30 14:38:09 +03:00
Nikolai Kochetov
e8ee5176cd Fix defaultValueOfArgumentType 2020-06-30 14:29:50 +03:00
Artem Zuikov
29178e26da
fix low card types in merge join (#12035) 2020-06-30 14:13:43 +03:00
Nikolai Kochetov
820d2c63df Try fix labda tuple(LC) argument. 2020-06-30 13:51:17 +03:00
Nikolai Kochetov
be51741566 Try fix labda tuple(LC) argument. 2020-06-30 13:19:06 +03:00
Nikita Mikhaylov
7c828861da fix arcadia 2020-06-30 13:18:38 +03:00
Alexander Kuzmenkov
aa8461e996
Update ThreadProfileEvents.cpp 2020-06-30 10:47:19 +03:00
Alexander Kuzmenkov
1d838b7b3a
Update ThreadProfileEvents.cpp 2020-06-30 09:56:11 +03:00
Alexander Kuzmenkov
67a28971e8 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 09:09:36 +03:00
Vladimir Chebotarev
8128ca10f4 Switched paths in S3 metadata to relative. 2020-06-30 07:59:22 +03:00
kssenii
f797efb04c Fix build 2020-06-30 01:48:11 +00:00
Alexey Milovidov
a23df81dd5 Fix error 2020-06-30 03:53:30 +03:00
Alexander Tokmakov
987e64acfe parse metadata in parallel when loading tables 2020-06-30 03:12:16 +03:00
Alexey Milovidov
15cddc3c6e Make topK return Enum for Enum types 2020-06-30 02:17:20 +03:00
Alexey Milovidov
d97cb1e7b4 Fix constraints check for constant columns 2020-06-30 01:54:20 +03:00
Alexey Milovidov
5a35ff8938 Merge branch 'master' of github.com:yandex/ClickHouse into fix-collations-order-by-tuple-const 2020-06-30 01:51:04 +03:00
Alexey Milovidov
1194863b3d Fix error 2020-06-30 01:50:26 +03:00
Alexey Milovidov
0bf7a8c554 Add multiIf 2020-06-30 01:50:26 +03:00
Alexey Milovidov
6fa1204698 Fix function if with FixedString arguments of different sizes 2020-06-30 01:50:26 +03:00
alexey-milovidov
c1d2d2d7f7
Merge pull request #12039 from ClickHouse/fix-nullable-tuple-compare
Fix nullable tuple compare
2020-06-30 01:38:46 +03:00
Nikita Mikhaylov
b2712aa242 disable orc in arcadia at all 2020-06-29 23:48:18 +03:00
Azat Khuzhin
ebff4eae7d Add replica priority for load_balancing
Make default 1, to match with <weight>
2020-06-29 23:03:28 +03:00
Azat Khuzhin
03def348c8 Sync comments for <node>/<replica> in Cluster.h 2020-06-29 23:03:28 +03:00
Azat Khuzhin
177d699cde Do not check *optimize_skip_unused_shards_nesting w/o *optimize_skip_unused_shards
This will avoid supperior log message in case of
*optimize_skip_unused_shards_nesting already disables it.
And also it is logical.
2020-06-29 23:00:14 +03:00
Azat Khuzhin
9c94993f14 Fix "Sharding key is not deterministic" message 2020-06-29 23:00:14 +03:00
Nikita Mikhaylov
da26f6496f
Merge pull request #11857 from ClickHouse/better-distinct-for-query-plan
Update query plan traits for DISTINCT. Add more comments.
2020-06-29 23:06:22 +04:00
Nikita Mikhaylov
c057dd38c9
Update ITransformingStep.h 2020-06-29 22:04:10 +03:00
Nikita Mikhaylov
bfc815339f fix yandex sync 2020-06-29 20:54:35 +03:00
Nikolai Kochetov
c97d071b4b Fix test. 2020-06-29 19:28:14 +03:00
kssenii
fd9b416871 Fix and simplify code 2020-06-29 15:47:25 +00:00
Nikolai Kochetov
6bf9d670be Fix test. 2020-06-29 18:22:21 +03:00
alexey-milovidov
eeb9998d51
Merge pull request #12022 from oandrew/clickhouse-local-improvements
clickhouse-local improvements
2020-06-29 17:54:24 +03:00
Nikita Mikhaylov
33e627777b Merge branch 'master' of github.com:ClickHouse/ClickHouse into Avogar_orc_output_format 2020-06-29 17:25:33 +03:00
Alexander Kuzmenkov
877c10f5fa
Update ThreadProfileEvents.cpp 2020-06-29 17:13:16 +03:00
Vitaly Baranov
eb27814fbe Fix access rights: cannot grant INTROSPECTION when allow_introspection_functions=0. 2020-06-29 16:43:31 +03:00
Nikolai Kochetov
0a455fc0e1 Fix tuple nullable comparison. 2020-06-29 16:25:28 +03:00
Alexander Kuzmenkov
3223757808
Merge pull request #12019 from ClickHouse/fix-neighbor-overflow
Fix overflow in function "neighbor"
2020-06-29 16:06:05 +03:00
alesapin
718262e7ce
Merge pull request #11973 from ClickHouse/alter-enum-partition-key
Allow to perform "metadata-only" ALTER of partition key.
2020-06-29 16:01:07 +03:00
Alexander Kuzmenkov
9b9030caad
Update ThreadProfileEvents.cpp 2020-06-29 15:57:36 +03:00
Alexander Kuzmenkov
af8d62bbcb Add TLB misses perf counters. 2020-06-29 15:48:18 +03:00
kssenii
88ece429c9 Move writing to RabbitMQ into background task 2020-06-29 12:33:01 +00:00
Vitaly Baranov
f3f005d5b9
Merge pull request #12015 from vitlibar/fix-access-rights-allow-ddl-0
Fix calculation of access rights when allow_ddl = 0
2020-06-29 15:14:22 +03:00
kssenii
3d2cc9d4b2 Remove libevent library 2020-06-29 12:11:17 +00:00
tavplubix
99dfd33e71
Merge pull request #12007 from oandrew/avro-allow-missing-fields
Avro: allow_missing_fields setting
2020-06-29 14:40:27 +03:00
kssenii
5fc0b93400 Use ConcurentBoundedQueue instead of vector 2020-06-29 09:50:33 +00:00
alesapin
e72bc39654
Merge pull request #11983 from ClickHouse/storage_mongodb
Merging #10931 (Storage MongoDB)
2020-06-29 11:49:18 +03:00
Nikolai Kochetov
40b398c8c4 Merge branch 'master' into better-distinct-for-query-plan 2020-06-29 11:14:05 +03:00
alexey-milovidov
22de79846a
Merge pull request #12017 from ClickHouse/fix-integration-test-11996
Fix integration test
2020-06-29 03:39:12 +03:00
Andrew Onyshchuk
3c0ba8f9ad Limit /proc/cpuinfo metrics to linux only 2020-06-28 18:44:24 -05:00
Alexey Milovidov
4dcdad2f08 Fix ORDER BY tuple with COLLATE on const column 2020-06-28 23:55:45 +03:00
Alexey Milovidov
28c446e9a5 Whitespace 2020-06-28 23:51:14 +03:00
Alexey Milovidov
6a8659ab34 Whitespace 2020-06-28 23:49:13 +03:00
Alexey Milovidov
a838f86f7c Fix overflow in function "neighbor" 2020-06-28 23:43:26 +03:00
Alexey Milovidov
b6a57b162a Fix error in addMonths with floating point argument 2020-06-28 23:20:49 +03:00
alexey-milovidov
aaadc8addb
Merge pull request #12006 from ClickHouse/fix-error-geohash
Avoid floating point error in geohashesInBox #11369
2020-06-28 23:09:39 +03:00
Alexey Milovidov
cc597bb30b Implement for ReplicatedMergeTree 2020-06-28 22:39:31 +03:00
Alexey Milovidov
6aa89d9073 Typos 2020-06-28 22:39:31 +03:00
Alexey Milovidov
e3410ca617 Write partition key changes to ZooKeeper 2020-06-28 22:39:31 +03:00
Alexey Milovidov
e5f4a4b4b0 Whitespace 2020-06-28 22:39:31 +03:00
Alexey Milovidov
1f9c27de34 Fix clang-tidy 2020-06-28 22:39:31 +03:00
Alexey Milovidov
b6e31f0a5e Only allow Enum extension within the same width 2020-06-28 22:39:31 +03:00
Alexey Milovidov
e4d8cc2b44 Slightly more safe 2020-06-28 22:39:31 +03:00
Alexey Milovidov
97ad23b905 Allow to ALTER partition key in some cases 2020-06-28 22:39:31 +03:00
Alexey Milovidov
678d127503 Whitespace 2020-06-28 22:39:31 +03:00
Alexey Milovidov
c4d5ca485e Remove the usage of obsolete setting 2020-06-28 22:39:31 +03:00
Vitaly Baranov
bd72bd6e10 Fix access rights: cannot grant DDL when allow_ddl=0 2020-06-28 21:38:14 +03:00
kssenii
649eb8e348 Move reading from RabbitMQ into background task 2020-06-28 18:20:18 +00:00
Alexey Milovidov
306714f2d3 Merge remote-tracking branch 'origin/master' into fix-array-size-overflow-generate-random 2020-06-28 19:12:54 +03:00
Alexey Milovidov
78ee63e395 More hardening 2020-06-28 19:11:53 +03:00
Alexey Milovidov
4ec66545a3 More hardening 2020-06-28 19:07:19 +03:00
alexey-milovidov
7376f18467
Merge pull request #11923 from ucasFL/client-not-argue
client exit with unrecognized arguments
2020-06-28 17:38:25 +03:00
alexey-milovidov
86ef3e1d8c
Update ErrorCodes.cpp 2020-06-28 17:37:42 +03:00
Alexey Milovidov
d1f4a0e473 Fix array size overflow in generateRandom 2020-06-28 17:33:02 +03:00
Alexey Milovidov
305641ad3c Fix test 2020-06-28 17:31:57 +03:00
Alexey Milovidov
0a76ff118a Fix build 2020-06-28 16:18:14 +03:00
alexey-milovidov
d867dd8a65
Merge pull request #12005 from ClickHouse/fix-div-nontrivial-fpe
Fix potential FPE.
2020-06-28 16:16:26 +03:00
alexey-milovidov
935d2be826
Merge pull request #12003 from ClickHouse/fix-typos
Fix typos in code
2020-06-28 15:49:17 +03:00
Andrew Onyshchuk
9054862dde Avro: allow missing fields 2020-06-27 21:23:21 -05:00
Alexey Milovidov
c35841e4e1 Avoid floating point error in geohashesInBox #11369 2020-06-28 02:07:24 +03:00
Alexey Milovidov
ae67ea3ab3 Make it more correct 2020-06-28 01:37:46 +03:00
Alexey Milovidov
40e73b9134 Fix FPE, step 1 2020-06-28 01:32:43 +03:00
alexey-milovidov
5a99cdb0d9
Merge pull request #11996 from BohuTANG/mysql_engine_enum
ISSUES-3985 Support MySQL engine reading Enums type
2020-06-27 22:18:25 +03:00
Alexey Milovidov
1462a66d1e Fix typos 2020-06-27 22:05:00 +03:00
Alexey Milovidov
46caa211d5 Better diagnostics of "Replica {} appears to be already active" message 2020-06-27 16:55:00 +03:00
Nikita Mikhaylov
36549884f4
Merge pull request #11947 from nikitamikhaylov/merging-ssh-cache
Merging #8624 (ssd-cache)
2020-06-27 14:58:08 +04:00
BohuTANG
f609fd34f7 Support Enums type for MySQL engine #3985 2020-06-27 09:10:07 +08:00
Avogar
81d459a5a8 Small update ORCBlockOutputFormat and add ORC output format to performance test. 2020-06-26 23:17:28 +03:00
Alexander Kuzmenkov
58bf6f7adc
Merge pull request #11972 from ClickHouse/aku/cpu-freq
Add CPU frequencies to system.asynchronous_metrics
2020-06-26 20:45:58 +03:00
alesapin
6b3092290d Trying to fix ya.make 2020-06-26 19:33:51 +03:00
alesapin
b5f79bc28c Remove strange header 2020-06-26 19:32:15 +03:00
alesapin
6fc6422c4d Remove empty lines 2020-06-26 18:19:00 +03:00
alesapin
252706e956 Add comment 2020-06-26 17:34:37 +03:00
alesapin
4969da85d9 Fixes 2020-06-26 17:28:00 +03:00
alesapin
11f88340a5 Merge branch 'mongo' of https://github.com/ageraab/ClickHouse into storage_mongodb 2020-06-26 16:03:06 +03:00
Nikolai Kochetov
4f5be494c5
Merge pull request #11950 from 4ertus2/joins
Extract JOIN in own plan step
2020-06-26 15:52:58 +03:00
Nikolai Kochetov
7c47a964cf
Update ExpressionActions.h 2020-06-26 15:24:13 +03:00
tavplubix
dfdfc69df1
Merge pull request #11900 from bharatnc/ncb/fix-file-path
fix double slashed paths in DatabaseOrdinary by switching to std::filesystem::path
2020-06-26 15:05:15 +03:00
alexey-milovidov
751d36f7c7
Merge pull request #11954 from oandrew/avro-uuid
Avro UUID support
2020-06-26 14:09:54 +03:00
Nikita Mikhaylov
f90dfa3ef4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into merging-ssh-cache 2020-06-26 13:56:21 +03:00
Anton Popov
39fe7d6c3f
Merge pull request #11729 from CurtizJ/distinct-combinator
Merging #10930. (Distinct combinator)
2020-06-26 13:40:32 +03:00
feng lv
a159f1be54 Merge branch 'master' of github.com:ClickHouse/ClickHouse into client-not-argue 2020-06-26 17:34:24 +08:00
alesapin
b3c31370c2
Merge pull request #11970 from ClickHouse/fix-estimation-of-the-number-of-marks
Fix estimation of the number of marks while reading from MergeTree
2020-06-26 11:28:36 +03:00
Alexander Kuzmenkov
808713471c
Update AsynchronousMetrics.h 2020-06-26 05:18:57 +03:00
bharatnc
76938b40a4 use std::filesystem::path 2020-06-25 18:30:44 -07:00
Artem Zuikov
54fd9ce76b fix totals 2020-06-26 03:23:11 +03:00
Alexander Kuzmenkov
d77f397b38 review fixes 2020-06-26 03:18:33 +03:00
alexey-milovidov
2163716e45
Merge pull request #11955 from ClickHouse/revive-mmap-2
Allow to use direct_io and mmap_io for secondary indices.
2020-06-26 03:16:56 +03:00
alexey-milovidov
178a5217bc
Merge pull request #11953 from ClickHouse/revive-mmap
Revive mmap IO + add a test
2020-06-26 03:15:07 +03:00
Artem Zuikov
d573005b04 place left join keys in before_join actions 2020-06-26 02:10:37 +03:00
Anton Popov
685d14863b tests with distributed 2020-06-26 01:39:54 +03:00
alexey-milovidov
8f429f6027
Merge pull request #11935 from zlobober/allocated_bytes
Consider allocatedBytes() instead of bytes() in Storage{Buffer,Memory}.
2020-06-26 00:57:47 +03:00
alexey-milovidov
6a45f3e960
Merge pull request #11936 from ClickHouse/fix_11918
Fix query parameter visitor
2020-06-26 00:54:37 +03:00
alexey-milovidov
b041479d90
Merge pull request #11949 from ClickHouse/fix-race-condition-extract-all-groups
Fix race condition in extractAllGroups
2020-06-26 00:52:29 +03:00
Artem Zuikov
9637dad462 keep ArrayJoin optimisation 2020-06-25 23:59:10 +03:00
Alexander Kuzmenkov
477fbc70f8
Update AsynchronousMetrics.cpp 2020-06-25 23:46:18 +03:00
Alexander Kuzmenkov
059a2704d0 Add CPU frequencies to system.asynchronous_metrics 2020-06-25 23:43:57 +03:00
Alexander Kuzmenkov
7ee2e68f5b better error messages 2020-06-25 23:42:31 +03:00
Alexander Kuzmenkov
a8db0b40d0 add page fault perf events 2020-06-25 23:42:31 +03:00
Artem Zuikov
2d7d389b77 better ExpressionAction::execute() 2020-06-25 23:28:41 +03:00
Alexey Milovidov
8eed47857b Fix estimation of the number of marks for various thresholds 2020-06-25 23:20:22 +03:00
Andrew Onyshchuk
9364d42eb0 Add CANNOT_PARSE_UUID extern const 2020-06-25 14:50:07 -05:00
Alexey Milovidov
875369676f Added a comment #11949 2020-06-25 22:46:43 +03:00
Alexey Milovidov
8872417d00 Respect direct_io/mmap settings while reading secondary indices 2020-06-25 22:31:54 +03:00
Artem Zuikov
bfe30a9723 remove a trick with expression continuation 2020-06-25 22:26:03 +03:00
Andrew Onyshchuk
fc1ae85600 Avro UUID support 2020-06-25 14:25:45 -05:00
Alexey Milovidov
5608f15749 Revive mmap IO 2020-06-25 22:15:41 +03:00
Artem Zuikov
0e49a9ed4d fix crash 2020-06-25 21:44:05 +03:00
Artem Zuikov
ae5ed098f4 remove useless logic 2020-06-25 21:18:27 +03:00