Commit Graph

49851 Commits

Author SHA1 Message Date
Julia Kartseva
ed65c26faf verbose exception messages for StorageFuzzJSON
Follow-up to https://github.com/ClickHouse/ClickHouse/pull/56490#discussion_r1409556111
2023-11-29 20:42:21 +00:00
Alexander Tokmakov
e40c71a74c
Merge pull request #56533 from ClickHouse/rmt_check_shutdown_flags_in_retry_loops
ReplicatedMergeTree: check shutdown flags in retry loops
2023-11-28 15:24:40 +01:00
János Benjamin Antal
4c2451f837
Merge pull request #56741 from ClickHouse/well-known-protos 2023-11-28 15:21:15 +01:00
Antonio Andelic
084ab75aa2
Merge pull request #57312 from ClickHouse/lower-level-annoying-log
Lower level for annoying S3 log
2023-11-28 15:05:15 +01:00
Antonio Andelic
6e8e4a6ca5 Lower level for annoying log 2023-11-28 12:41:35 +00:00
Raúl Marín
335e7bf7ef
Merge pull request #57183 from bigo-sg/opt_array_join
Trivial improvement on array join
2023-11-28 12:21:00 +01:00
Raúl Marín
fe1bbf9726
Merge pull request #57258 from Algunenano/cleanup_interval
Remove addBatchSinglePlaceFromInterval
2023-11-28 12:02:12 +01:00
Antonio Andelic
a61f32867e
Merge pull request #56488 from lingtaolf/feature/getHTTPHeader
add function getClientHTTPHeader
2023-11-28 11:41:56 +01:00
Robert Schulze
1448276bae
Merge pull request #55872 from azat/hour-no-leading-zero
Add ability to parse hours/months without leading zeros
2023-11-28 11:07:00 +01:00
Julia Kartseva
57a4492275
Merge pull request #56490 from jkartseva/fuzz_json
Fuzz JSON table function
2023-11-27 21:47:53 -08:00
Ubuntu
a85cf758b0 Fuzz JSON table function
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
2023-11-28 01:58:24 +00:00
Nikolay Degterinsky
eb6fba9f65
Merge pull request #57147 from evillique/fix-segfault-nullable-materialized-update
Fix segfault after ALTER UPDATE with Nullable MATERIALIZED column
2023-11-28 00:36:52 +01:00
Raúl Marín
a3ceafbbed Fix embarrasing bug number 2 2023-11-27 23:12:17 +01:00
Raúl Marín
0754ee4901 Fix embarrasing bug number 1 2023-11-27 23:12:17 +01:00
Raúl Marín
80cc1b3a17 Remove addBatchSinglePlaceFromInterval 2023-11-27 23:12:17 +01:00
Antonio Andelic
544f6081eb
Merge pull request #57259 from ClickHouse/ignore-column-comments
Ignore comments when comparing column descriptions
2023-11-27 20:43:39 +01:00
Raúl Marín
9bd54be6e0
Merge pull request #57190 from Algunenano/remove_optimize_move_functions_out_of_any
Remove optimize_move_functions_out_of_any optimization
2023-11-27 19:31:38 +01:00
lgbo
b38469ddf8
Optimization for getting value from map, arrayElement(2/2) (#55957) 2023-11-27 15:11:56 +01:00
Antonio Andelic
9707796869 Ignore comments when comparing column descriptions 2023-11-27 12:25:41 +00:00
Robert Schulze
4c236b34f0
Another small cleanup 2023-11-27 11:09:07 +00:00
vdimir
bbc202a891
Merge pull request #56816 from AVMusorin/improve-settings-rocksdb
Show total_bytes and total_rows in system tables for RocksDB storage
2023-11-27 11:42:15 +01:00
Kruglov Pavel
b10e46b2bc
Merge pull request #57126 from Avogar/size-virtual-column
Add _size virtual column to s3/file/hdfs/url/azureBlobStorage engines
2023-11-27 10:12:18 +01:00
Robert Schulze
a8671049e1
Various smaller fixups 2023-11-27 08:49:54 +00:00
Antonio Andelic
4c2de5219d
Merge pull request #57196 from amosbird/fix-57194
Fix incorrect JOIN plan optimization with partially materialized normal projection
2023-11-27 09:15:13 +01:00
taiyang-li
f33f231725 fix failed ut 2023-11-27 10:48:01 +08:00
Azat Khuzhin
315906b380 Add ability to parse hours/months without leading zeros
Recently I was looking into one dataset, that has such format.

So I've changed the meaning of the following formatters for
formatDateTime()/parseDateTime(), like in other implementations [1]:

- %l/%k - to handle hours without leading zeros
- %c - handle months without leading zeros

  [1]: https://www.php.net/strftime

And since this is kind of behaviour change (even though it is unlikely
will break something), there is a new setting to control this new
behaviour:
- parsedatetime_enable_format_without_leading_zeros=1 (default ON)
- formatdatetime_enable_format_without_leading_zeros=0 (default OFF, since this could change users output)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-26 19:10:17 +01:00
Alexey Milovidov
a9bb76378f
Merge pull request #56724 from canhld94/ch_replicated_column_mismatch
Do not allow tables on different replicas have different aggregate functions in SimpleAggregateFunction column
2023-11-26 17:20:10 +01:00
Alexey Milovidov
1cc33f3430
Merge pull request #56164 from azat/not-byte-identical-message
Add more details to "Data after merge is not byte-identical to data on another replicas"
2023-11-26 04:14:15 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
2023-11-26 04:03:41 +01:00
Alexey Milovidov
304d6375be
Merge pull request #56225 from azat/rocksdb-compact
Allow manual compaction of rocksdb via OPTIMIZE query
2023-11-26 03:59:54 +01:00
Alexey Milovidov
fde14f0daf
Merge pull request #57191 from azat/client-log_comment-file
[RFC] Set log_comment to the file name while processing files in client
2023-11-26 03:44:40 +01:00
Alexey Milovidov
f636dea879
Merge pull request #54327 from den-crane/background_fetches_pool_size
increase background_fetches_pool_size to 16, background_schedule_pool_size to 512
2023-11-26 02:50:38 +01:00
Alexey Milovidov
9fa112af9a
Merge pull request #53721 from takakawa/possible_wrong_type_conversion_bugfix
[bugfix] possible postgresql logical replication error: wrong type conversion
2023-11-26 02:48:24 +01:00
Alexey Milovidov
d29092f8af
Merge pull request #54909 from canhld94/revert-54893-revert-54819-ch_net_interfaces
Resubmit: Avoid excessive calls to getifaddrs in isLocalAddress
2023-11-25 23:00:18 +01:00
Alexey Milovidov
92e580997c
Update IDataType.h 2023-11-26 00:57:12 +03:00
Alexey Milovidov
c50f096200
Merge pull request #57227 from azat/client-INS-cursor
Change cursor style for overwrite mode (INS) to blinking in client
2023-11-25 22:53:09 +01:00
Azat Khuzhin
ced0bbd932 Change cursor style for overwrite mode (INS) to blinking in client
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-11-25 22:00:56 +01:00
Robert Schulze
5b7d2a903d
Merge pull request #57152 from rschu1ze/fine-granular-plan-opt-settings
Fine-granular enablement/disabling of plan-level optimizations
2023-11-25 20:44:23 +01:00
Vitaly Baranov
2e7f314599
Merge pull request #50209 from ilejn/merge_row_policy
Engine Merge obeys row policy
2023-11-25 10:34:22 +01:00
Alexey Milovidov
61c9d304f0
Merge pull request #57125 from ClickHouse/try-fix-57097
Cancel executor in ~CreatingSetsTransform
2023-11-25 03:02:39 +01:00
Alexey Milovidov
8877b7ce78
Merge pull request #57198 from ClickHouse/analyzer-fuzz-6
Analyzer fuzzer 6 (arrayJoin)
2023-11-25 03:00:48 +01:00
Alexey Milovidov
8325d04313
Merge pull request #57201 from myrrc/feature/elide-functional-stacktraces
Do not demangle stack frames from __functional
2023-11-25 02:59:49 +01:00
jsc0218
55e0a825b7
Merge pull request #57106 from BetterStackHQ/ah/uniq-id-check-master
Optimize query uniqueness check in ProcessList
2023-11-24 17:04:25 -05:00
Alexey Milovidov
685ad98652
Merge pull request #57122 from ClickHouse/fuzzer-disable-checksums
Disable checksums for builds with fuzzer
2023-11-24 23:03:04 +01:00
Alexey Milovidov
289df618f4
Merge pull request #57001 from arthurpassos/aws-s3-sign-any-x-amz-header-clean
Sign all aws headers
2023-11-24 21:12:10 +01:00
Sema Checherinda
bd36dce81b
Merge pull request #57129 from ClickHouse/fix_something
Fix something in ReplicatedMergeTree
2023-11-24 20:19:25 +01:00
Alexander Tokmakov
deda8483be
Merge pull request #56536 from ClickHouse/move-partition-inactive-replica
Fix race between REPLACE_RANGE and GET_PART (set actual part name when fetching)
2023-11-24 20:09:24 +01:00
Aleksandr Musorin
c3b617bd7b Move class functions upper 2023-11-24 19:00:00 +01:00
Nikolai Kochetov
0eb20620cd Fix type for arrayJoin(LC) 2023-11-24 16:42:59 +00:00
Alexey Milovidov
dfba02542d Merge branch 'master' of github.com:ClickHouse/ClickHouse into fuzzer-disable-checksums 2023-11-24 17:37:49 +01:00