Commit Graph

3979 Commits

Author SHA1 Message Date
Alexey Milovidov
2b85007af9 Update test 2021-01-23 15:15:03 +03:00
kssenii
0d940c6137 Add AggregateFunctionCombinatorFactory, better names 2021-01-23 12:07:37 +00:00
Alexey Milovidov
598952c243 Remove flawed variants of "encrypt" from tests 2021-01-23 12:32:30 +03:00
alexey-milovidov
c3fc1d83dc
Merge branch 'master' into aes-fix-strange-code 2021-01-23 12:14:17 +03:00
alexey-milovidov
1e42caa888
Merge pull request #19475 from ClickHouse/avg-weighted-ubsan
Fix UBSan report in avgWeighted
2021-01-23 12:13:28 +03:00
Alexey Milovidov
9983beed83 Remove Arcadia 2021-01-23 12:08:54 +03:00
Alexey Milovidov
d1bd4ef793 Merge branch 'master' of github.com:yandex/ClickHouse into blns 2021-01-23 12:08:38 +03:00
alexey-milovidov
7a10fbc9c3
Merge pull request #19479 from ClickHouse/columns-description-idiotic
Fix wrong serde of ColumnsDescription
2021-01-23 12:08:15 +03:00
Alexey Milovidov
ba7438a893 Remove Arcadia 2021-01-23 12:07:58 +03:00
alexey-milovidov
9baac1204e
Merge pull request #19472 from ClickHouse/date-lut-buffer-overflow
Fix buffer overflow in DateLUT
2021-01-23 12:05:10 +03:00
alexey-milovidov
40c9b0ae1b
Merge pull request #19461 from ClickHouse/great-circle-distance-ubsan
Avoid UBSan report in greatCircleDistance
2021-01-23 12:03:02 +03:00
alexey-milovidov
bbaa0786d9
Merge pull request #19460 from ClickHouse/running-difference-ubsan
Fix UBSan report in runningDifference
2021-01-23 12:02:48 +03:00
alexey-milovidov
474ff29ded
Merge pull request #19459 from ClickHouse/array-slice-ubsan
Fix UBSan report in arraySlice and substring
2021-01-23 12:02:34 +03:00
Maksim Kita
f5deb6d523
Merge pull request #19354 from kitaisreal/accurate-cast-or-null-fixed-unitialized-values
Function accurateCastOrNull fixed unitialized values for numeric cast
2021-01-23 10:58:52 +03:00
Azat Khuzhin
86ead0f0a9 Suppress UBsan for addMinutes/addHours/addWeeks with inf
https://clickhouse-test-reports.s3.yandex.net/19466/bb6f775b89da564cff9892a2443332a758e884c0/fuzzer_ubsan/report.html#fail1
2021-01-23 08:31:20 +03:00
alexey-milovidov
feebf64cb1
Merge pull request #19397 from ClickHouse/aes-msan
Fix MSan report in AES functions
2021-01-23 04:47:36 +03:00
Alexey Milovidov
b326a4b7f9 Integrate with Big List of Naughty Strings for better fuzzing 2021-01-23 04:42:04 +03:00
Alexey Milovidov
1b6ee55c6a More tests 2021-01-23 04:26:03 +03:00
Alexey Milovidov
7005e3a826 Fix wrong serde of ColumnsDescription 2021-01-23 04:11:18 +03:00
Alexey Milovidov
02d28c1f9b Fix UBSan report in avgWeighted 2021-01-23 03:17:58 +03:00
Alexey Milovidov
f7db6e10d3 Fix very strange code in AES functions 2021-01-23 02:35:40 +03:00
Alexey Milovidov
505898747e Fix buffer overflow in DateLUT 2021-01-23 01:58:41 +03:00
Alexey Milovidov
bbe3c54f34 Merge branch 'aes-msan' into aes-remove-complications 2021-01-23 00:48:45 +03:00
Azat Khuzhin
bb6f775b89 Fix UBsan report in arraySlice (with INT64_MIN as offset)
- arraySlice([], INT64_MIN) -- FunctionArraySlice::executeImpl

Found with fuzzer [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/19378/2c42600cf9bd8e9962b5b5a0ebb4bf11a10887ea/fuzzer_ubsan/report.html#fail1

v2: removed fixes that is already included into #19459
    - arraySlice(groupArray([]), INT64_MIN) -- sliceDynamicOffsetUnbounded
2021-01-23 00:25:50 +03:00
Azat Khuzhin
f2910deec2 Fix UBsan report in date functions
Found with fuzzer [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/19381/95c9e57ec13e450ec6535cf723f504a2e68e3e2c/fuzzer_ubsan/report.html#fail1
2021-01-23 00:25:49 +03:00
Alexey Milovidov
0528ca60d6 Avoid UBSan report in greatCircleDistance 2021-01-23 00:03:59 +03:00
alexey-milovidov
25ea281297
Merge pull request #19360 from vdimir/issue-18197
Fix default value in join types with non-zero default (close #18197)
2021-01-22 23:51:56 +03:00
Alexey Milovidov
4047542b61 Fix UBSan report in runningDifference 2021-01-22 23:46:51 +03:00
Alexey Milovidov
4afcb94a8a Fix Style check 2021-01-22 23:41:26 +03:00
Alexey Milovidov
ae8de8259f Fix UBSan report in substring 2021-01-22 23:40:04 +03:00
alexey-milovidov
a04360e6b2
Update 01664_array_slice_ubsan.sql 2021-01-22 23:36:10 +03:00
Alexey Milovidov
fb71a0704e Fix UBSan report in arraySlice 2021-01-22 23:35:16 +03:00
tavplubix
49e1321df4
Merge pull request #19072 from ClickHouse/fix_19021
Fix checkpoint in PeekableReadBuffer over ConcatReadBuffer
2021-01-22 21:00:04 +03:00
Nikolai Kochetov
290eadc121
Merge branch 'master' into split-actions-dag 2021-01-22 18:09:34 +03:00
tavplubix
9801bfc0ee
Merge branch 'master' into fix_18063 2021-01-22 17:28:05 +03:00
alexey-milovidov
f44f169aaa
Merge pull request #19385 from ClickHouse/sum-ubsan
Avoid UBSan report in aggregate function sum
2021-01-22 17:25:55 +03:00
alexey-milovidov
6e1d660e36
Merge pull request #19390 from ClickHouse/http_referer
Add http_referer to client info
2021-01-22 17:25:09 +03:00
alexey-milovidov
9818bd319a
Merge pull request #19381 from azat/parts-types-metrics
Add metrics for MergeTree parts (Wide/Compact/InMemory) types
2021-01-22 17:24:50 +03:00
alexey-milovidov
3431e39587
Merge pull request #19393 from ClickHouse/extract-all-groups-fail-fast
Fail fast in incorrect usage of extractAllGroups
2021-01-22 17:24:13 +03:00
alexey-milovidov
9add38f47b
Merge pull request #19394 from ClickHouse/quantile-weighted-overflow
Fix UBSan report in quantileExactWeighted
2021-01-22 17:18:01 +03:00
alexey-milovidov
7b62871765
Merge pull request #19383 from ClickHouse/h3-fix-buffer-overflow
Fix buffer overflow in Uber H3
2021-01-22 17:14:29 +03:00
Kruglov Pavel
b2d5370b36
Merge pull request #17359 from ildus/tuple_arg_for_argMinMax
Add tuple argument support for argMin and argMax
2021-01-22 17:11:01 +03:00
Nikolai Kochetov
70b4199869 Add test. 2021-01-22 16:30:01 +03:00
Maksim Kita
d712748304 Function accurateCastOrNull fixed unitialized values for numeric cast 2021-01-22 16:24:51 +03:00
tavplubix
2d988f6791
Update arcadia_skip_list.txt 2021-01-22 16:01:04 +03:00
kssenii
6dc32ae4cb More correct for functions and aggr. functions 2021-01-22 11:58:29 +00:00
Alexander Kuzmenkov
6296cc6b09
Merge pull request #19361 from ClickHouse/aku/reconnect
Reconnect after client errors
2021-01-22 13:32:56 +03:00
Alexander Kuzmenkov
8b9105bf39
Merge pull request #18446 from azat/constant-folding
Fix constant folding when the result is unknown
2021-01-22 13:26:24 +03:00
Nikolai Kochetov
2e95000d64 Update tests. 2021-01-22 13:25:59 +03:00
Nikolai Kochetov
b19316a2af Fix test. 2021-01-22 13:06:59 +03:00
Nikolai Kochetov
42d46e2a26 Update tests. 2021-01-22 12:39:33 +03:00
Alexey Milovidov
56d09886e2 Fix MSan report in AES functions 2021-01-22 04:08:10 +03:00
alexey-milovidov
4e11e7cfa9
Merge pull request #18772 from azat/optimize-memory-tracking-fix
[RFC] Fix memory tracking for OPTIMIZE TABLE/merges
2021-01-22 03:48:06 +03:00
Alexey Milovidov
14adc2d5f0 Fix UBSan report in quantileExactWeighted 2021-01-22 03:05:45 +03:00
Alexey Milovidov
e38ff3517d Fail fast in incorrect usage of extractAllGroups 2021-01-22 02:48:26 +03:00
Alexey Milovidov
79229ef25a Skip Arcadia 2021-01-22 02:01:17 +03:00
Alexey Milovidov
117708abc6 Skip Arcadia 2021-01-22 01:59:56 +03:00
Alexey Milovidov
afc6f2fd8e Add http_referer to client info 2021-01-22 01:55:45 +03:00
Alexey Milovidov
056b44b64f Add a test 2021-01-22 01:49:37 +03:00
kssenii
daab2c91bb Better 2021-01-21 21:15:11 +00:00
alexey-milovidov
1883bc546a
Merge pull request #19357 from ClickHouse/values-ubsan
Fix potential nullptr dereference in table function VALUES
2021-01-21 23:34:41 +03:00
alexey-milovidov
37c345f55e
Merge pull request #19347 from ClickHouse/array-element-ubsan
Avoid UBSan report in arrayElement
2021-01-21 23:34:19 +03:00
kssenii
1ec463b61f Fast test fix 2021-01-21 20:02:44 +00:00
Alexander Kuzmenkov
71e663701d update the tests 2021-01-21 22:56:28 +03:00
Alexey Milovidov
d9cb1c1bdd Avoid UBSan report in aggregate function sum 2021-01-21 22:52:00 +03:00
Pavel Kruglov
7706eb4f36 update test reference 2021-01-21 22:06:49 +03:00
Alexey Milovidov
cc160813ce Add a test 2021-01-21 21:44:48 +03:00
Azat Khuzhin
82e7e7d9cb Fix constant folding for expressions depends from subqueries result
Do not use subquery result, when value is unknown, for constant folding.

v2: fix simple subqueries, fixes 00597_push_down_predicate.
v3:
- use identity over introducing yet another cast analog (as suggested by @akuzm)
- simpler suitable_for_const_folding check
v4: use identity(cast()) since only cast() can provide corrent type (for
data types that does not have it's own type, i.e. DateTime)
v5: do not optimize consts if only_analyze isset, regardless the block
content
2021-01-21 21:26:50 +03:00
Azat Khuzhin
44011061b5 Add missing DROP TABLE at the beginning of 01268_mv_scalars test 2021-01-21 21:22:23 +03:00
Azat Khuzhin
95c9e57ec1 Add 01600_parts_types_metrics 2021-01-21 21:17:01 +03:00
Azat Khuzhin
974f0daeb9 Add set database_atomic_wait_for_drop_and_detach_synchronously=1 for 01600_parts_states_metrics
Without this setting the test will pass only when the table will be
actually removed by the background worker of the Atomic engine.

In CI this is not required since
database_atomic_wait_for_drop_and_detach_synchronously is set explicitly
in via tests/users.d.
2021-01-21 21:17:01 +03:00
Azat Khuzhin
926b0ddc59 Rename 01600_count_of_parts_metrics to 01600_parts_states_metrics 2021-01-21 21:17:00 +03:00
Nikita Mikhaylov
b93732e441
Merge pull request #18788 from hexiaoting/map_functions
Introduce mapContains, mapKeys, mapValues functions for Map data type
2021-01-21 21:02:03 +03:00
Alexander Kuzmenkov
eb7b87ee8d update tests 2021-01-21 21:01:32 +03:00
Pavel Kruglov
900580af02 Add parallel select when there is one part with level>0 in select final 2021-01-21 20:34:50 +03:00
kssenii
c1702f34ee Add factories info into system.query_log 2021-01-21 15:46:37 +00:00
Alexander Kuzmenkov
36a42a1f96 update tests 2021-01-21 18:30:51 +03:00
Alexander Kuzmenkov
ec8ff21526 Reconnect after client errors 2021-01-21 17:28:46 +03:00
vdimir
2f11fdf4df
Fix default value in join types with non-zero default (close #18197) 2021-01-21 16:49:44 +03:00
Alexey Milovidov
375db8ce7e Update reference 2021-01-21 16:42:47 +03:00
Anton Popov
ac3de63a71 fix several cases, while reading subcolumns 2021-01-21 15:34:11 +03:00
alexey-milovidov
7370335f87
Merge pull request #19339 from ClickHouse/fix-ipv4-formatting
Fix bad formatting of IPv4 addresses
2021-01-21 15:20:24 +03:00
Alexey Milovidov
56012402e2 Fix potential nullptr dereference in table function VALUES 2021-01-21 15:19:00 +03:00
alexey-milovidov
08dc5ebfa7
Merge pull request #19343 from ucasFL/sleep
fix sleep with infinite input
2021-01-21 15:04:30 +03:00
Ildus Kurbangaliev
47a0f4e162 Add tuple argument support for argMin and argMax 2021-01-21 16:47:51 +05:00
Alexey Milovidov
2cd04e8923 Fix UBSan report in arraySum 2021-01-21 14:43:33 +03:00
flynn
e75b116466
Rewrite sum(if()) and sumIf to countIf in special cases (#17041)
Co-authored-by: vdimir <vdimir@yandex-team.ru>
2021-01-21 12:01:35 +03:00
Alexey Milovidov
110089086b Fix UBSan report in GatherUtils #19287 2021-01-21 11:41:19 +03:00
Alexey Milovidov
1bb8cc5c9a Avoid UBSan report in arrayElement 2021-01-21 11:10:46 +03:00
Azat Khuzhin
5f3059555a Fix system.parts _state column
There was LOGICAL_ERROR when querying this column, due to incorrect order:

    SELECT
        *,
        _state
    FROM system.parts

    2021.01.21 10:22:57.731556 [ 22851 ] {02a07c6d-467d-4681-9203-4dc11cc6fbee} <Fatal> : Logical error: 'Invalid Field get from type String to type UInt64'.
2021-01-21 10:41:23 +03:00
feng lv
2094eae23d fix sleep with infinite input 2021-01-21 04:49:35 +00:00
Alexey Milovidov
2d87e52b3a Fix bad formatting of IPv4 addresses 2021-01-21 03:24:44 +03:00
Alexander Kuzmenkov
175404338d Merge remote-tracking branch 'origin/master' into tmp 2021-01-20 20:22:58 +03:00
Alexander Kuzmenkov
8663d04b7f
Merge pull request #19298 from ClickHouse/aku/parallel-tests
Avoid mixing output from parallel test runs
2021-01-20 20:22:42 +03:00
Alexander Tokmakov
6560ec3ed5 fix segfault on aggregation when MV has unexpected structure 2021-01-20 19:36:18 +03:00
Daniel Qin
25d8c047c5
Add a check to avoid exception when long alias equals to column (#18968)
* Add a check to avoid exception when long alias equas to column

* try fix with add an underlying table name, add function test

* format code

Co-authored-by: Ling Qin <lqin@freewheel.com>
2021-01-20 18:34:17 +03:00
Nikolai Kochetov
d0fc7098a7 Fix tests. 2021-01-20 15:58:23 +03:00
alesapin
ab325f5d0c Fix test 2021-01-20 13:31:47 +03:00
Nikolai Kochetov
1e4b32aa30
Merge pull request #19273 from CurtizJ/map-subcolumns
Support 'keys' and 'values' subcolumns in type Map
2021-01-20 13:13:01 +03:00
Nikolai Kochetov
67d880dc3a Update test. 2021-01-20 12:38:56 +03:00
Alexander Kuzmenkov
0526c55206 Merge remote-tracking branch 'origin/master' into tmp 2021-01-20 10:11:24 +03:00
Alexander Kuzmenkov
6e4b9aa862 don't use simple transform 2021-01-20 10:10:54 +03:00
Alexander Kuzmenkov
107d83b654 Avoid mixing output from parallel test runs.
Also mark some tests as sequential-only.
2021-01-20 08:31:41 +03:00
Alexander Kuzmenkov
4879adb527 Avoid mixing output from parallel test runs.
Also mark some tests as sequential-only.
2021-01-20 08:27:42 +03:00
Alexander Kuzmenkov
4d16dead0f Merge remote-tracking branch 'origin/master' into HEAD 2021-01-19 20:34:01 +03:00
Alexander Kuzmenkov
f5931a2289
Merge pull request #19236 from ClickHouse/aku/echo-leading
Make `-- { echo }` hint preserve leading comments
2021-01-19 20:20:58 +03:00
Nikolai Kochetov
df56590e21 Update test. 2021-01-19 18:35:32 +03:00
Nikolai Kochetov
17edf238e3 Added test. 2021-01-19 16:35:26 +03:00
Anton Popov
bc796ec391 support 'keys' and 'values' subcolumns in type Map 2021-01-19 14:05:21 +03:00
alexey-milovidov
ee4cc94e6c
Merge pull request #19235 from ClickHouse/redundant-test-for-banner-system
Add redundant test for Yandex banner system
2021-01-19 13:29:52 +03:00
Alexander Kuzmenkov
f346a9bf8b frame grammar tmp 2021-01-19 04:00:39 +03:00
Nikita Mikhaylov
b8fcd75de7
Merge pull request #19200 from den-crane/tests/18839_Expand_macros_for_fetchPartition
test for #18839 Expand_macros_for_fetchPartition
2021-01-19 02:54:20 +03:00
Anton Popov
dbc10b2024
Merge pull request #19063 from CurtizJ/exists-view
Support operations with views in ANTLR parser
2021-01-19 01:15:12 +03:00
Alexander Kuzmenkov
d0922e2985 Merge remote-tracking branch 'origin/master' into tmp 2021-01-18 23:23:49 +03:00
Alexander Kuzmenkov
c1b35da714 old flaky test 2021-01-18 23:22:20 +03:00
Alexander Kuzmenkov
b07d6c5132 old flaky test 2021-01-18 20:15:58 +03:00
Nikita Mikhaylov
8f5d5ebbff
Update arcadia_skip_list.txt 2021-01-18 16:14:30 +03:00
Alexander Kuzmenkov
c153268da7 Make -- { echo } hint preserve leading comments. 2021-01-18 15:15:46 +03:00
Alexey Milovidov
37a17752e8 Add redundant test for Yandex banner system 2021-01-18 15:03:26 +03:00
Alexander Kuzmenkov
f3e112766f cleanup 2021-01-18 12:49:56 +03:00
jianmei zhang
b90b38fd4e add a new line 2021-01-18 12:20:15 +08:00
jianmei zhang
e967b6bf49 add a %Q replacement for formatDateTime 2021-01-18 12:16:32 +08:00
hexiaoting
28436a73b7 Merge remote-tracking branch 'origin/master' into map_functions 2021-01-18 10:20:36 +08:00
alexey-milovidov
15f4ae26c2
Merge pull request #17310 from CurtizJ/multiple-nested
Allow nested with multiple nesting and subcolumns of complex types
2021-01-17 15:00:26 +03:00
Denis Zhuravlev
04dcc9523a test for #18839 Expand_macros_for_fetchPartition 2021-01-16 18:26:43 -04:00
alexey-milovidov
7de745ce77
Merge pull request #18554 from kssenii/pg2ch
Add PostgreSQL table function, dictionary source, database engine
2021-01-16 23:55:05 +03:00
alexey-milovidov
3737ef253f
Merge pull request #19164 from azat/COMPLEX_KEY_SSD_CACHE-dictHas-fix
Add missing type check in dictHas for COMPLEX_KEY_SSD_CACHE layout
2021-01-16 20:55:08 +03:00
Alexey Milovidov
24c8e53440 Merge branch 'master' into multiple-nested 2021-01-16 16:28:40 +03:00
alexey-milovidov
a15092eeb7
Merge pull request #18264 from ucasFL/insert-cluster
Support insert into table function cluster
2021-01-16 13:22:49 +03:00
Azat Khuzhin
1b901b368f Add missing type check in dictHas for COMPLEX_KEY_SSD_CACHE layout 2021-01-16 12:33:36 +03:00
alexey-milovidov
32ceafc038
Merge pull request #19007 from ClickHouse/add-tests-from-15889
Add tests from #15889
2021-01-16 11:03:39 +03:00
alexey-milovidov
6ed14ba0b6
Merge pull request #19134 from ClickHouse/fix-read-orc-from-fd
Fix reading from fd for ORCBlockInputFormat.
2021-01-16 11:03:26 +03:00
alesapin
67fd381034
Merge pull request #19123 from ClickHouse/additional_check_in_writer
Fix max granules size in MergeTreeDataWriter
2021-01-16 10:17:44 +03:00
Alexander Kuzmenkov
9d6730a846 small fixes 2021-01-16 00:33:53 +03:00
alexey-milovidov
5f189c5756
Merge pull request #19122 from ClickHouse/data-part-better-code
Add metrics for part number in MergeTree in ClickHouse
2021-01-16 00:20:15 +03:00
alexey-milovidov
e09ec9fed5
Merge pull request #18373 from amosbird/fix-18364
Fix 2-arg functions with constant in PK analysis
2021-01-16 00:20:03 +03:00
Alexander Kuzmenkov
765aa4d4e3 rewrote everything again 2021-01-15 23:30:44 +03:00
Alexey Milovidov
b293d56a63 Merge branch 'master' into kssenii-pg2ch 2021-01-15 22:32:03 +03:00
alesapin
184dbedb06 Fix stupid error 2021-01-15 21:50:30 +03:00
Nikolai Kochetov
142bcd4142 Update test 2021-01-15 20:44:16 +03:00
alexey-milovidov
83c5539df6
Update 01651_bugs_from_15889.sql 2021-01-15 20:39:32 +03:00
alexey-milovidov
f8830e0f11
Merge pull request #19107 from ClickHouse/bar-nan
Fix fuzz test for function `bar`.
2021-01-15 20:38:02 +03:00
feng lv
dbb3c89b50 Merge branch 'master' of github.com:ClickHouse/ClickHouse into insert-cluster 2021-01-15 15:37:56 +00:00
Alexey Milovidov
a19e7edd14 Merge branch 'master' into kssenii-pg2ch 2021-01-15 17:33:19 +03:00
Nikolai Kochetov
af44ff2390 Add test to arcadia skiplist 2021-01-15 16:22:53 +03:00
Nikolai Kochetov
8af10c730b Merge branch 'master' into add-tests-from-15889 2021-01-15 16:21:33 +03:00
Alexey Milovidov
16c3526864 Add a test 2021-01-15 15:34:37 +03:00
alexey-milovidov
78fff6bc39
Merge branch 'master' into multiple-nested 2021-01-15 14:54:27 +03:00
Alexey Milovidov
4bae04d500 Merge branch 'master' into amosbird/fix-18364 2021-01-15 14:37:35 +03:00
alexey-milovidov
3c1c30d15b
Update 01615_two_args_function_index_fix.sql 2021-01-15 14:32:42 +03:00
alexey-milovidov
49059e5cce
Update 01615_two_args_function_index_fix.sql 2021-01-15 14:31:41 +03:00
alexey-milovidov
8d58ce532a
Merge pull request #19064 from CurtizJ/restrict-modify-ttl
Restrict MODIFY TTL for tables created in old syntax
2021-01-15 14:09:47 +03:00
tavplubix
fb6d1dc18e
Merge pull request #18979 from ClickHouse/fix_18690
Remove unread data limit from PeekableReadBuffer
2021-01-15 13:43:50 +03:00
alexey-milovidov
e914ef619f
Merge pull request #18818 from templarzq/master
Implement ColumnAggregateFunction cloneResized method
2021-01-15 13:21:21 +03:00
Alexey Milovidov
55265db583 Add a test 2021-01-15 13:17:55 +03:00
alexey-milovidov
80c937b64c
Merge pull request #19084 from ClickHouse/simplifuy-tuple-hamming-distance
Simplify tupleHammingDistance
2021-01-15 13:02:09 +03:00
Alexander Kuzmenkov
c9628386fc more fixes 2021-01-15 01:39:43 +03:00
Alexander Kuzmenkov
1abb554d2b test fixes 2021-01-14 23:47:52 +03:00
Alexey Milovidov
da9bd043d4 Merge branch 'master' into nautaa-master 2021-01-14 23:09:33 +03:00
Alexey Milovidov
ffca270512 Fix Arcadia 2021-01-14 22:34:13 +03:00
Alexey Milovidov
f60c5f8296 Merge branch 'master' into templarzq/master 2021-01-14 22:33:11 +03:00
Nikolai Kochetov
39de699790 Added test. 2021-01-14 19:13:14 +03:00
Alexander Kuzmenkov
828dea83cb Merge remote-tracking branch 'origin/master' into tmp 2021-01-14 18:50:34 +03:00
Alexander Tokmakov
547c7af1b1 fix checkpoint in PeekableReadBuffer over ConcatReadBuffer 2021-01-14 17:38:59 +03:00
Nikolai Kochetov
9e08890f95
Update 01651_bugs_from_15889.sql 2021-01-14 16:53:42 +03:00
Nikolai Kochetov
d8b9278193
Merge pull request #19016 from ClickHouse/fix-ignore-with-lc-arg
Fix `ignore` function with LowCardinality argument
2021-01-14 16:50:54 +03:00
Anton Popov
ac426c3da6 restrict MODIFY TTL for tables created in old syntax 2021-01-14 15:32:20 +03:00
Anton Popov
0e2d49f065 Merge remote-tracking branch 'upstream/master' into HEAD 2021-01-14 15:03:08 +03:00
Anton Popov
9c9e2a5936 support operations with views in antlr parser 2021-01-14 15:02:29 +03:00
Nikita Mikhaylov
89c64cbdfc
Merge pull request #18982 from nikitamikhaylov/filtering-join-supertype
Remove code from Join which materializes const columns
2021-01-14 13:53:40 +03:00
Nikolai Kochetov
66fd760410 Update test. 2021-01-14 13:45:57 +03:00
alexey-milovidov
bf8d58d2e8
Merge pull request #18723 from ucasFL/select-all
add SELECT ALL syntax
2021-01-14 11:53:09 +03:00
Nikolai Kochetov
3194933788 Update test 2021-01-14 11:39:27 +03:00
Nikolai Kochetov
cefd941457 Update test 2021-01-14 11:38:24 +03:00
alexey-milovidov
2ca185c9f9
Merge pull request #16995 from sundy-li/alias_column_partition_prune
Add optimize_respect_aliases
2021-01-14 11:30:45 +03:00
Nikolai Kochetov
7b33ad5e44
Merge pull request #19010 from ClickHouse/fix-insert-lc-to-tiny-log
Fix insert LC to TinyLog
2021-01-14 11:25:38 +03:00
alexey-milovidov
6d79068a0f
Merge pull request #18981 from ClickHouse/disable-optimize-out-of-any
Disable optimize out of any
2021-01-14 10:12:55 +03:00
alexey-milovidov
7d7af00afb
Merge pull request #19015 from nikitamikhaylov/defaults-for-file-engine
Added tests for defaults in URL and File engine
2021-01-14 10:12:27 +03:00
alexey-milovidov
2c8ce7d94e
Merge pull request #19019 from ClickHouse/group-uniq-array-enum
Fix return type of groupUniqArray
2021-01-14 10:11:44 +03:00
centos7
8550fb813b fix cloneresize impl 2021-01-14 10:57:52 +08:00
Kruglov Pavel
fedfcb78e1
Merge pull request #18791 from sundy-li/bitmap64-contains
Add [UInt8, UInt16, UInt32, UInt64] arguments types support for bitmapTransform, bitmapSubsetInRange, bitmapSubsetLimit, bitmapContains functions
2021-01-14 02:18:42 +03:00
Nikita Mikhaylov
1d9a3a492a
Update 01622_defaults_for_url_engine.sh 2021-01-14 02:38:36 +04:00
Anton Popov
4dd9165934
Merge pull request #18552 from spongedu/support_exists_view_v3
support EXISTS VIEW syntax
2021-01-14 01:23:50 +03:00
Alexander Kuzmenkov
48509a85d3 comment woes 2021-01-14 01:04:19 +03:00
Alexander Kuzmenkov
c2a1373720 Merge remote-tracking branch 'origin/master' into tmp 2021-01-13 22:30:08 +03:00
Alexander Kuzmenkov
703731c547 something works 2021-01-13 22:29:52 +03:00
Nikita Mikhailov
e4dd7d949c better test 2021-01-13 22:26:37 +03:00
Alexey Milovidov
d27e04997d More tests 2021-01-13 21:13:52 +03:00
Alexey Milovidov
ec12a089f3 Fix return type of groupUniqArray 2021-01-13 21:11:56 +03:00
tavplubix
47000e7b55
Update 01184_insert_values_huge_strings.sh 2021-01-13 19:36:32 +03:00
Nikita Mikhailov
3d62d6503b better 2021-01-13 18:34:16 +03:00
Anton Popov
11f459ad03 Merge branch 'support_exists_view_v3' of git://github.com/spongedu/ClickHouse into exists-view 2021-01-13 18:08:43 +03:00
Nikolai Kochetov
a0874d93c3 Add test. 2021-01-13 17:47:08 +03:00
Nikita Mikhailov
9fc7b52732 done 2021-01-13 17:41:34 +03:00
Alexey Milovidov
5579e3876c Update test 2021-01-13 17:12:05 +03:00
Alexey Milovidov
ccbb11db8f Update test 2021-01-13 17:11:17 +03:00
Alexey Milovidov
ae9490883d Update test 2021-01-13 17:10:20 +03:00
Alexander Tokmakov
6c4be506fd add test 2021-01-13 16:43:42 +03:00
Nikolai Kochetov
c5cebbacb1 Update test. 2021-01-13 16:29:39 +03:00
ygrek
8f2a830d83
add zstd long range option (#17184)
* add zstd long compression option

* tests: add zstd long read-write test

Co-authored-by: Joris Giovannangeli <joris.giovannangeli@ahrefs.com>
Co-authored-by: ip <igor@ahrefs.com>
2021-01-13 16:22:59 +03:00
Alexey Milovidov
a18d5320ca Merge branch 'master' into disable-optimize-out-of-any 2021-01-13 15:51:10 +03:00
Nikolai Kochetov
35a3bdc1a6 Added test. 2021-01-13 15:42:30 +03:00
Nikolai Kochetov
e2a2ab6f67 Add tests from #15889 2021-01-13 13:34:58 +03:00
alesapin
c97469773d
Merge pull request #18969 from ClickHouse/fix_drop_part_deduplication
Fix DROP PART query break deduplication
2021-01-13 11:50:26 +03:00
alesapin
07431a6494
Merge pull request #18980 from ClickHouse/fix-expressions-merge
Fix expressions merge
2021-01-13 11:16:01 +03:00
alesapin
c12abcd481
Merge pull request #18970 from ClickHouse/fix_01459_manual_write_to_replicas_quorum
Fix rarely flaky test 01459_manual_write_to_replicas_quorum
2021-01-13 09:59:17 +03:00
Alexey Milovidov
d58a8c98aa More tests
(cherry picked from commit 235541a532)
2021-01-13 00:50:07 +03:00
Alexey Milovidov
7516f1460f Add a test for ANY JOIN and PREWHERE
(cherry picked from commit 92c5cfe243)
2021-01-13 00:49:49 +03:00
Alexey Milovidov
a6296912f3 Fix incomplete code 2021-01-12 22:58:54 +03:00
Alexey Milovidov
a5e14e9442 Add a test 2021-01-12 22:53:58 +03:00
Nikolai Kochetov
c79aa13fa9 Added test. 2021-01-12 22:13:06 +03:00
Anton Popov
15ead18673 Merge remote-tracking branch 'upstream/master' into HEAD 2021-01-12 19:46:10 +03:00
alesapin
56d0f10231 Remove hashes because they are not important 2021-01-12 15:08:13 +03:00
alesapin
e4639aea55 Fix rarely flaky test 01459_manual_write_to_replicas_quorum 2021-01-12 14:53:33 +03:00
alesapin
c02a937c53 Better test 2021-01-12 14:02:49 +03:00
alesapin
e43193c6bd Add test 2021-01-12 13:57:35 +03:00
sundy-li
ad01534bd5 Merge branch 'master' into alias_column_partition_prune 2021-01-12 18:28:30 +08:00
alexey-milovidov
2c71b997de
Merge pull request #18464 from hexiaoting/dev_fp_as_pk
Disallow floating point as partition key
2021-01-12 13:08:41 +03:00
sundy-li
e6351cf966 Add UInt64 Support for bitmapTransform/bitmapSubsetInRange/bitmapSubsetLimit 2021-01-12 17:13:43 +08:00
tavplubix
1d6bfe8ad7
Merge pull request #18944 from ClickHouse/fix_mutation_commands_escaping
Fix mutations text serialization
2021-01-12 11:29:24 +03:00
sundy-li
9c3c1d13ab Add bitmapContains support for all UInt types 2021-01-12 14:52:31 +08:00
Anton Popov
61d6a323dd multiple TTL with GROUP BY 2021-01-12 03:40:07 +03:00
Anton Popov
5822ee1f01 allow multiple rows TTL with WHERE expression 2021-01-12 02:07:21 +03:00
Azat Khuzhin
82edbfb581 Account query memory limits and sampling for OPTIMIZE TABLE/merges 2021-01-12 00:49:41 +03:00
Azat Khuzhin
bd05d9db2f Fix memory tracking for OPTIMIZE TABLE queries
Because of BlockerInThread in
MergeTreeDataPartWriterOnDisk::calculateAndSerializePrimaryIndex memory
was accounted incorrectly and grows constantly.

And IIUC there is no need in that blocker, since INSERT SELECT shares
the same thread group.
2021-01-12 00:49:40 +03:00
alexey-milovidov
c4094a8cab
Merge pull request #18624 from abyss7/antlr-test
Add ANTLR tests check
2021-01-11 23:27:07 +03:00
alexey-milovidov
f8473222c6
Merge pull request #18897 from azat/stress-tests-no-restart-replicas
Drop RESTART REPLICAS from stateless tests to avoid locking lots of mutexes
2021-01-11 18:53:01 +03:00
alesapin
b1c4e5b9f2 Fix mutations text escaping 2021-01-11 17:43:05 +03:00
tavplubix
00d240853d
Merge pull request #18718 from zhang2014/fix/ISSUES-7690
ISSUES-7690 try fix nullable string type convert to decimal type
2021-01-11 16:18:56 +03:00
Anton Popov
91dc347ff3 add some comments 2021-01-11 14:36:31 +03:00
alexey-milovidov
667dd0cf0c
Merge pull request #18912 from sundy-li/bitmapOrCardinality-nullfix
Fix bitmapOrCardinality using wrong variable
2021-01-11 14:28:46 +03:00
Anton Popov
36ae0e4d35 Merge remote-tracking branch 'upstream/master' into HEAD 2021-01-11 13:51:12 +03:00
Nikolai Kochetov
ee094ed7fd
Merge pull request #18896 from amosbird/keyconditionalias
correct index analysis of WITH aliases
2021-01-11 11:13:28 +03:00
hexiaoting
9e0389085b Adjust exsiting test case. 2021-01-11 14:52:23 +08:00
feng lv
5f962015ca fix
fix style

fix build
2021-01-11 04:28:22 +00:00
sundy-li
9aa7c7ef09 Fix same bug in another function 2021-01-11 11:35:56 +08:00
sundy-li
4865439130 Empty line after sql 2021-01-11 11:35:56 +08:00
sundy-li
893efab7c3 Fix AggregateFunctionGroupBitmapData bitmapOrCardinality using wrong variable 2021-01-11 11:35:56 +08:00
hexiaoting
9e3b4a67de Add mapValues test 2021-01-11 10:56:13 +08:00
Ivan Lezhankin
ab6371fbf5 More tests into skip-list 2021-01-10 22:07:23 +03:00
alexey-milovidov
f7e7725b8e
Merge pull request #18884 from fuwhu/feature/fix-windowFunnel-inconsistency
fix the inconsistent result of windowFunnel in case of same timestamp for different events
2021-01-10 14:56:58 +03:00
alexey-milovidov
95ac01ab82
Merge pull request #18893 from ClickHouse/fix-clickhouse-local
Fix hang at shutdown in clickhouse-local
2021-01-10 13:26:44 +03:00
Amos Bird
44758935df
correct index analysis of WITH aliases 2021-01-10 17:40:47 +08:00
Azat Khuzhin
ff16f68116 Add a smoke test for SYSTEM RESTART REPLICAS 2021-01-10 12:40:41 +03:00
Azat Khuzhin
30741232d2 Drop RESTART REPLICAS from stateless tests to avoid locking lots of mutexes
Under TSan you can lock only not more then 64 mutexes from one thread at
once [1] [2], while RESTART REPLICAS can acquire more (it depends on the
number of replicated tables).

  [1]: https://github.com/google/sanitizers/issues/950#issuecomment-386711603
  [2]: b02eab9058/compiler-rt/lib/sanitizer_common/sanitizer_deadlock_detector.h (L67)

And since stress tests run tests in parallel, you can have more then 64
ReplicatedMergeTree tables at once (even though it is unlikely).

Fix this by using RESTART REPLICA table over RESTART REPLICAS.
2021-01-10 12:39:27 +03:00
Alexey Milovidov
79a38c4c6e Fix hang at shutdown in clickhouse-local 2021-01-10 06:35:05 +03:00
HuFuwang
d0378395c5 add tests 01646_fix_window_funnel_inconistency. 2021-01-10 07:49:11 +08:00
feng lv
94e1bc05d2 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-09 16:07:52 +00:00
Azat Khuzhin
471deab63a Rename fsync_tmp_directory to fsync_directories for Distributed engine 2021-01-09 17:51:30 +03:00
nautaa
33996d41f5 add test cases reference 2021-01-09 19:15:09 +08:00
nautaa
8359289283 add unicode decode 2021-01-09 19:08:19 +08:00
feng lv
378b10863e fix conflict 2021-01-09 09:07:20 +00:00
Azat Khuzhin
b5ace27014 Add fsync support for Distributed engine.
Two new settings (by analogy with MergeTree family) has been added:

- `fsync_after_insert` - Do fsync for every inserted. Will decreases
  performance of inserts.

- `fsync_tmp_directory` - Do fsync for temporary directory (that is used
  for async INSERT only) after all part operations (writes, renames,
  etc.).

Refs: #17380 (p1)
2021-01-09 11:31:32 +03:00
feng lv
8ab2832324 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-09 02:36:25 +00:00
Azat Khuzhin
a24be01025 Drop Kafka storage from 01645_system_table_engines for fasttest 2021-01-09 00:59:03 +03:00
Azat Khuzhin
c312676368 Add a smoke test for system.table_engines 2021-01-08 14:57:24 +03:00
sundy-li
5dbda5d627 Update tests 2021-01-08 16:18:12 +08:00
alexey-milovidov
45f53bacfa
Merge pull request #18845 from azat/fsync-fixes
Fix never worked fsync_part_directory/fsync_after_insert/in_memory_parts_insert_sync
2021-01-08 07:26:24 +03:00
Alexey Milovidov
ffa5bbd5fd Add SYSTEM SUSPEND command #15979 2021-01-07 22:19:33 +03:00
Azat Khuzhin
798fb4e842 Smoke coverage of various fsync capabilities 2021-01-07 19:30:25 +03:00
Alexey Milovidov
afb4cc8d3a Merge branch 'master' of github.com:yandex/ClickHouse into kssenii-pg2ch 2021-01-07 18:40:12 +03:00
Alexey Milovidov
159891573f Merge branch 'master' into kssenii-pg2ch 2021-01-07 18:39:44 +03:00
alexey-milovidov
a08db94343
Revert "Add metrics for part number in MergeTree in ClickHouse" 2021-01-07 16:40:52 +03:00
alexey-milovidov
f91626e7ff
Merge pull request #17838 from weeds085490/dev/add_metrics_for_parts
Add metrics for part number in MergeTree in ClickHouse
2021-01-07 15:27:04 +03:00
alexey-milovidov
0f28473ec1
Merge pull request #18808 from ClickHouse/lld-build-id
Generate build id when ClickHouse is linked with lld
2021-01-07 15:26:26 +03:00
alexey-milovidov
b73722e587
Merge pull request #18806 from azat/If-combinator-Nullable-fix
Fix *If combinator with unary function and Nullable types
2021-01-07 15:25:54 +03:00
feng lv
1a47cf8611 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-07 10:26:28 +00:00
alexey-milovidov
65b4008d1f
Update 01600_count_of_parts_metrics.sh 2021-01-07 06:36:00 +03:00
Alexey Milovidov
6f75901ffb Update test 2021-01-07 04:09:18 +03:00
Azat Khuzhin
fdcfacda60 Fix *If combinator with Nullable types
sumIf(Nullable()) and similar unary functions (unary w/o If combinator)
was working incorrectly, since it returns "sum" from the getName()
helper, and so distributed query processing fails.

The problem is in the optimization in
AggregateFunctionIfNullUnary::add() for the unary functions. It pass
only one column to write result to, instead of all passed arguments +
result columns.
While AggregateFunctionIf::add() assumes that it accepts arguments  +
result columns, and use last column as a result.

Introduced-in: #16610
Fixes: #18210
2021-01-07 03:09:13 +03:00
alexey-milovidov
72b142a00a
Merge branch 'master' into pg2ch 2021-01-06 23:18:59 +03:00
Azat Khuzhin
6261d4135c Add sanity checks for Sim/Min hash arguments
Fixes: #18799
Fixes: #18524
2021-01-06 22:38:05 +03:00
alexey-milovidov
13e4579052
Merge pull request #18712 from amosbird/limitpartition
add max_partitions_to_read setting
2021-01-06 21:29:58 +03:00
alexey-milovidov
c944035f0b
Merge pull request #18699 from amosbird/exceptregex
column excepts with regex
2021-01-06 21:28:09 +03:00
alexey-milovidov
f84426ebef
Merge pull request #18771 from den-crane/tests/simple_aggregate_funcs2
more tests for simple aggregate functions in summingMT aggregatingMT try2
2021-01-06 21:26:06 +03:00
alexey-milovidov
49f70b3b5f
Merge pull request #18763 from azat/marks-corruption-test
Add a regression test for marks corruption
2021-01-06 21:20:55 +03:00
Alexey Milovidov
8ab40d2747 Newline 2021-01-06 21:06:34 +03:00
jianmei zhang
4950377fbf code changes according to reviewer's comments 2021-01-06 21:05:45 +03:00
jianmei zhang
2256227361 SQL compatibility: provide POSITION(needle IN haystack) syntax. 2021-01-06 21:05:45 +03:00
alexey-milovidov
417e685830
Merge pull request #18775 from ClickHouse/dont-insert-empty-blocks-distributed-sync
Do not insert empty blocks on sync Distributed INSERT
2021-01-06 20:06:35 +03:00
weeds085490
b2e4c0ee71 refine test 2021-01-06 19:29:51 +08:00
hexiaoting
31105670a8 Introduce mapContains, mapKeys, mapValues functions for Map data type 2021-01-06 18:53:14 +08:00
weeds085490
5f5b86b485 Merge remote-tracking branch 'origin' into dev/add_metrics_for_parts 2021-01-06 17:32:45 +08:00
Amos Bird
0260953a47
better 2021-01-06 17:18:48 +08:00
feng lv
beab4f98da Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-06 06:10:09 +00:00
Alexey Milovidov
438f0f971b Fix the issue with async Distributed INSERTs and network_compression_method #18741 2021-01-06 03:24:42 +03:00
Alexey Milovidov
d77dfeaafb Arcadia does not support distributed tables 2021-01-06 03:06:19 +03:00
Alexey Milovidov
7547aee66a Add a test 2021-01-06 03:05:45 +03:00
alexey-milovidov
d68fdd8798
Update 01640_marks_corruption_regression.sql 2021-01-06 02:05:02 +03:00
Denis Zhuravlev
d23409da50 more tests for simple aggregate functions in summingMT aggregatingMT 2021-01-05 16:25:35 -04:00
Alexey Milovidov
f8313a33aa Add test for some possible ambiguities in syntax 2021-01-05 23:10:10 +03:00
alexey-milovidov
202d1f2211
Merge pull request #18760 from spongedu/fix_#18701
[For #18707] MySQL compatibility: support DIV and MOD operators
2021-01-05 20:42:58 +03:00
alexey-milovidov
06143d73ca
Merge pull request #15260 from ClickHouse/revert-15259-revert-14962-log-avoid-deadlock
Avoid deadlocks in Log/TinyLog (part 2)
2021-01-05 20:12:17 +03:00
alexey-milovidov
2d1afa5dad
Merge pull request #18753 from ClickHouse/null-fuzz
Add a test from #15641
2021-01-05 19:58:57 +03:00
alexey-milovidov
06225f7910
Merge pull request #18749 from ClickHouse/uuid-fuzz
Don't allow conversion between UUID and numeric types
2021-01-05 19:57:33 +03:00
alexey-milovidov
2e98f6f4ee
Merge pull request #18745 from ClickHouse/dont-throw-from-parser
Do not throw from Parser
2021-01-05 19:57:17 +03:00
nautaa
ec8e3f2409 add decode numeric entities 2021-01-05 21:08:36 +08:00
Azat Khuzhin
6c50f537a0 Add a regression test for marks corruption
In #17120 (that was reverted in #17918 already) marks adjustemnt was
introduced, but it may lead to corruption of marks files, that may cause
two things:
1) Incorrect marks files, which lead to reading more rows than there are
   (can be reproduced with `max_threads`>1 or/and `PREWHERE`, and
    `optimize_move_to_prewhere`)
2) Can't adjust last granule because it has X rows, but try to subtract Y
   rows (#9260)

And 1) is pretty hard to diagnosis, since it does not throw any error,
it just may return wrong result.

Fortunately both problems can be fixed with `OPTIMIZE TABLE ... [ FINAL]`.

Cc: @alesapin
Refs: #17943
Refs: #18223
2021-01-05 15:41:54 +03:00
feng lv
421feb8cf9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into select-all 2021-01-05 07:47:11 +00:00
nautaa
2acecb010f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2021-01-05 14:12:36 +08:00