kssenii
897811371d
Minor changes
2022-11-07 12:45:26 +01:00
kssenii
819be6bb32
Merge remote-tracking branch 'upstream/master' into hudi
2022-11-07 11:30:53 +01:00
Duc Canh Le
c880c1b406
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-07 18:23:13 +08:00
Duc Canh Le
bd2bd7149d
fix typo
2022-11-07 18:22:50 +08:00
Vladimir C
e8fb5f9afa
Merge pull request #42670 from bigo-sg/ascii_function
2022-11-07 10:33:56 +01:00
SmitaRKulkarni
c563e124c2
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode
2022-11-07 09:50:05 +01:00
Duc Canh Le
f7e65ebd72
make comments more clear
2022-11-07 16:25:36 +08:00
Robert Schulze
cdaf0becfe
Merge branch 'master' into bitcast
2022-11-07 09:24:52 +01:00
Antonio Andelic
9ac829d4c4
Merge pull request #41766 from JackyWoo/manual_snapshot_for_keeper
...
Manually snapshot creation for keeper
2022-11-07 09:18:58 +01:00
Robert Schulze
f3f50530d1
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-07 09:14:02 +01:00
Antonio Andelic
e08f94d0f8
Merge pull request #42659 from ClickHouse/optimize-entire-partition
...
Support for optimizing old parts for entire partition only
2022-11-07 09:06:11 +01:00
李扬
70fd664dd1
Merge branch 'master' into ascii_function
2022-11-07 10:30:10 +08:00
Igor Nikonov
503649a638
Merge branch 'master' into igor/insert_zk_retries_retry
2022-11-06 22:55:13 +01:00
Kseniia Sumarokova
cd5c6acbd2
Merge pull request #42960 from kssenii/fix-pg-db-datetime-table-attach
...
Fix postgres db engine attaching table with datetime
2022-11-06 22:39:15 +01:00
Alexey Milovidov
05b133fc8a
Merge pull request #42980 from evillique/fix-parser-2
...
Fix a bug in CAST function parser
2022-11-06 22:30:09 +01:00
Alexander Gololobov
cdf13cc6c0
Merge pull request #42926 from ClickHouse/keeper-faster-commit
...
Faster commit in Keeper
2022-11-06 20:46:59 +01:00
Duc Canh Le
69d6d42443
NOT LIKE only work for 'prefix%'
2022-11-06 15:26:19 +08:00
zhongyuankai
ade4173f00
Merge branch 'master' into optimze_ttl_merge
2022-11-06 13:40:32 +08:00
zhongyuankai
ef6065b331
fix test
2022-11-06 13:40:26 +08:00
Duc Canh Le
a8bce28c04
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-06 13:04:08 +08:00
Igor Nikonov
e94b9cd003
Fixes
...
+ enable retries in integration test
+ typo in fault injection traces
2022-11-05 22:28:32 +00:00
Alexey Milovidov
641f8576c6
Merge pull request #42003 from ClickHouse/write-progress-to-tty
...
Write progress directly to terminal
2022-11-05 16:51:37 +01:00
JackyWoo
73dfe4acd7
Add to default white list
2022-11-05 17:56:55 +08:00
JackyWoo
9404e089fc
Merge branch 'master' into manual_snapshot_for_keeper
2022-11-05 17:37:36 +08:00
Nikolay Degterinsky
fbf891d375
Merge pull request #42774 from alexon1234/add_format_redable_decimal_size
...
Published formatReadableDecimalSize so it can be used as function
2022-11-05 12:34:20 +03:00
Nikolay Degterinsky
ea4235d4ed
Try to fix lambda parsing
2022-11-05 01:30:07 +00:00
Nikolay Degterinsky
e3f5230822
Fix bug in CAST function parser
2022-11-05 01:10:51 +00:00
Igor Nikonov
859022660e
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-11-04 23:31:51 +00:00
Igor Nikonov
d5de68733a
Disable keeper retries during INSERT by default
2022-11-04 23:29:54 +00:00
Nikolay Degterinsky
3bcf151a9a
Merge remote-tracking branch 'upstream/master' into tuple-of-intervals
2022-11-04 23:09:43 +00:00
Nikolay Degterinsky
ccb2d2bc1c
Merge branch 'master' into fix_progress_bar
2022-11-05 01:50:27 +03:00
Igor Nikonov
3fad4131bf
Merge pull request #42937 from ClickHouse/fix_bad_cast_low_cardinality_to_string_column
...
Fix: bad cast from type DB::ColumnLowCardinality to DB::ColumnString
2022-11-04 23:34:37 +01:00
Nikita Taranov
2c7708a03e
Add bound check to lz4 decompression ( #42868 )
...
* impl
* add test
* fix bullshit tidy error
2022-11-04 22:12:36 +01:00
Daniil Rubin
7500cc38c0
Apply clang-format
2022-11-04 20:51:44 +00:00
Daniil Rubin
37048e986a
Add comments, fix review issues
2022-11-04 20:49:24 +00:00
Alexey Milovidov
ecd0c4260b
Merge pull request #42929 from Aaaaaaron/minor_fix01
...
minor fix error msg, replace outdated func name
2022-11-04 19:18:46 +01:00
Nikolai Kochetov
9043df56a8
Add comments, fix tests.
2022-11-04 17:31:20 +00:00
Nikolay Degterinsky
6995fa1afd
Merge pull request #42883 from zzsmdfj/fix_join_to_subqueries_null_pointer
...
Fix join to subqueries rewriter null pointer
2022-11-04 19:56:40 +03:00
Aleksandr Musorin
5cb69d8a22
changed type name for S3_Plain storage
...
renamed a disk for S3PlainObjectStorage in system.disks table from s3 to s3_plain
2022-11-04 17:35:51 +01:00
Nikolai Kochetov
2db1638b41
Disable optimize_in_window_order in case if read-in-order for query plan is enabled.
2022-11-04 16:18:35 +00:00
Daniil Rubin
d6bbd65dde
Fix broken include
2022-11-04 16:03:12 +00:00
Robert Schulze
9c066e964d
Less use of CH-specific bit_cast()
...
Converted usage of CH-custom bit_cast to std::bit_cast if possible, i.e.
when
sizeof(From) == sizeof(To).
(The CH-custom bit_cast is able to deal with sizeof(From) != sizeof(To).)
Motivation for this came from #42847 where it is not clear how the
internal bit_cast should behave on big endian systems, so we better
avoid that situation as much as possible.
2022-11-04 15:52:48 +00:00
Vladimir C
f359411668
Merge branch 'master' into optimze_ttl_merge
2022-11-04 16:52:20 +01:00
Nikolai Kochetov
79facdb4f2
Make query plan optimisation respect query settings in EXPLAIN
2022-11-04 15:44:31 +00:00
Vitaly Baranov
52b1f4aed9
Merge pull request #42484 from vitlibar/mask-sensitive-info-in-logs
...
Mask some information in logs
2022-11-04 14:09:38 +01:00
zhongyuankai
1345f7e73d
Merge branch 'master' into optimze_ttl_merge
2022-11-04 20:54:46 +08:00
zhongyuankai
ecf45bb216
fix test
2022-11-04 20:52:21 +08:00
Kruglov Pavel
a7a5a70189
Merge pull request #42814 from kgoralski/failed_metrics_for_async_inserts
...
Add `FailedAsyncInsertQuery` event metric for async inserts
2022-11-04 13:41:39 +01:00
alesapin
82729a88c8
Merge pull request #42833 from vitlibar/backup-s3-increase-upload-part-size-exponentially
...
Increase the size of upload part exponentially for backup to S3.
2022-11-04 13:41:10 +01:00
Kseniia Sumarokova
6ada8e9e39
Update src/Databases/PostgreSQL/DatabasePostgreSQL.cpp
...
Co-authored-by: Nikolay Degterinsky <43110995+evillique@users.noreply.github.com>
2022-11-04 13:37:10 +01:00
Nikolay Degterinsky
16fc05b734
Merge branch 'master' into add_format_redable_decimal_size
2022-11-04 15:02:01 +03:00
Robert Schulze
6df8f7ef25
Merge pull request #42907 from ClickHouse/cleanup-regexpreplace
...
Cleanup implementation of regexpReplace(All|One)
2022-11-04 12:49:44 +01:00
Filatenkov Artur
7afc714b06
Merge branch 'master' into UTC_timestamp
2022-11-04 14:32:44 +03:00
kssenii
c9b4bc66b5
Fiux
2022-11-04 12:19:30 +01:00
Kseniia Sumarokova
ed44b20694
Merge pull request #42224 from kssenii/fit-http-buffer-retries
...
Fix http buffer retries
2022-11-04 11:50:17 +01:00
Vladimir C
9d51119d57
Merge pull request #42905 from ClickHouse/vdimir/cluster-discovery-issue-42763
2022-11-04 11:15:30 +01:00
Kruglov Pavel
e9a01a1946
Merge branch 'master' into fix-slow-json-extract-with-low-cardinality
2022-11-04 11:13:46 +01:00
Vladimir C
69faede2b6
Merge pull request #42823 from ClickHouse/vdimir/fix_analysis_of_variance
2022-11-04 11:11:05 +01:00
Amos Bird
d901ead1bc
Done
2022-11-04 17:26:44 +08:00
zhongyuankai
049a593272
Merge branch 'master' into optimze_ttl_merge
2022-11-04 17:22:38 +08:00
zhongyuankai
e773eb2fd1
batter
2022-11-04 17:19:34 +08:00
Antonio Andelic
14dae6c6cf
Merge branch 'master' into optimize-entire-partition
2022-11-04 09:27:37 +01:00
Antonio Andelic
ca792c13ae
Merge branch 'master' into keeper-faster-commit
2022-11-04 09:15:53 +01:00
Azat Khuzhin
7032b2b98a
Attach thread pool for loading parts to the query
...
Detach should be done via CurrentThread::defaultThreadDeleter()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-04 09:06:12 +01:00
Azat Khuzhin
cdd09fd72a
Improve messages for loading data parts (add part type)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-04 09:05:06 +01:00
李扬
fccf6c037f
Merge branch 'master' into ascii_function
2022-11-03 22:48:55 -05:00
李扬
e65b0f1c2e
Merge branch 'master' into enable_max_splits
2022-11-03 22:47:15 -05:00
taojiatao
721e85a03e
minor fix error msg, repalce outdated func name
2022-11-04 11:27:10 +08:00
zzsmdfj
9d8840b8a7
Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix_join_to_subqueries_null_pointer
2022-11-04 10:05:12 +08:00
zzsmdfj
1a8568473c
update code style
2022-11-04 10:04:01 +08:00
Yakov Olkhovskiy
4012fcbf01
Merge pull request #42285 from ClibMouse/feature/base64-encode-fixed-string
...
Add support for FixedString input to base64 functions
2022-11-03 18:56:21 -04:00
Krzysztof Góralski
85d5cbbf19
Review: Failed queries metrics for Async Inserts
2022-11-03 22:26:24 +01:00
Krzysztof Góralski
f019c6b4a1
style check fix
2022-11-03 22:26:24 +01:00
Krzysztof Góralski
e2f35a01de
Failed queries metrics for Async Inserts
2022-11-03 22:26:24 +01:00
Krzysztof Góralski
98cc4535f0
Failed queries metrics for Async Inserts
2022-11-03 22:26:24 +01:00
Nikolai Kochetov
51ec95eb82
Try to fix #39157 in a different way.
2022-11-03 20:33:48 +00:00
Daniil Rubin
99d57325bb
Merge branch 'master' into hudi
2022-11-03 19:29:23 +00:00
Daniil Rubin
a573d8aef7
Apply clang-format
2022-11-03 18:17:39 +00:00
Daniil Rubin
7b57e94d9f
Fix StorageHudi
2022-11-03 18:14:10 +00:00
Nikolai Kochetov
d01ef8ca59
Merge branch 'master' into read-in-order-from-query-plan
2022-11-03 18:59:28 +01:00
Kruglov Pavel
83c5c44b11
Merge branch 'master' into improve-schema-inference-insert-select
2022-11-03 18:41:51 +01:00
Daniil Rubin
a9f8948c8d
Fix build
2022-11-03 17:28:41 +00:00
Nikolai Kochetov
280e609744
More fixes.
2022-11-03 16:42:26 +00:00
Amos Bird
7186898ffa
Experiment
2022-11-04 00:29:17 +08:00
Igor Nikonov
3b44ac0a1d
Fix: bad cast from type DB::ColumnLowCardinality to DB::ColumnString
2022-11-03 16:18:52 +00:00
Duc Canh Le
b481baf763
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-03 22:29:46 +08:00
Yakko Majuri
e68a3b0c7a
fix(typo): Passible -> Possible
2022-11-03 11:25:07 -03:00
vdimir
6d798cbc9d
Add checks in AggregateFunctionAnalysisOfVariance
2022-11-03 14:22:10 +00:00
Smita Kulkarni
d5b3184e86
Merge branch '42452_Bug_fix_parent_node_corrupted' of github.com:ClickHouse/ClickHouse into 42452_Bug_fix_parent_node_corrupted
2022-11-03 14:43:52 +01:00
Smita Kulkarni
4c70622202
Updated to check size of alias before cloning, so that we throw error early - 42452 Bug fix for parent node corrupted
2022-11-03 14:42:34 +01:00
SmitaRKulkarni
f8ce2b1413
Merge branch 'master' into 42452_Bug_fix_parent_node_corrupted
2022-11-03 14:12:56 +01:00
zzsmdfj
483861f4f9
Merge branch 'master' into MaterializedMySQL_improvement_bug_fix
2022-11-03 20:27:37 +08:00
zzsmdfj
eeb9c57c59
to fix issue 42856 and MaterializedMySQL improvement
2022-11-03 20:21:02 +08:00
Robert Schulze
43df3f9607
Merge branch 'master' into cleanup-regexpreplace
2022-11-03 13:13:10 +01:00
vdimir
b7fb500d5b
Fix incorrect saved_block_sample with multiple disjuncts in hash join
2022-11-03 13:00:37 +01:00
Smita Kulkarni
e6a387e7b2
Updated registerFunction factory method and removed table_functions_allowed_in_readonly_mode - 42414 Enable table functions in readonly mode
2022-11-03 12:31:07 +01:00
kssenii
4fe4a07600
Add test
2022-11-03 12:14:08 +01:00
Smita Kulkarni
9a002bd378
Removed finished_asts updation when alias is replaced and updated alias of the replaced ast it its initial name so that we don’t replace it further - 42452 Bug fix for parent node corrupted
2022-11-03 11:57:32 +01:00
Antonio Andelic
66ffdda973
Merge branch 'master' into optimize-entire-partition
2022-11-03 09:52:13 +01:00
taiyang-li
f39cb41d3e
change as requested
2022-11-03 16:44:57 +08:00
taiyang-li
0df7e95845
improve doc and uts
2022-11-03 16:12:19 +08:00
Alejandro
a1e158993d
Added docs in the function
2022-11-03 09:04:22 +01:00
Alejandro
16bf5458f5
Published formatReadableDecimalSize
2022-11-03 09:04:22 +01:00
Antonio Andelic
25b19e6ba0
Merge branch 'master' into manual_snapshot_for_keeper
2022-11-03 08:55:01 +01:00
Antonio Andelic
664690f9a9
Add comments
2022-11-03 07:38:43 +00:00
Antonio Andelic
a6c4204b0c
Don't iterate all cached nodes on commit
2022-11-03 07:36:25 +00:00
taiyang-li
a51a1b4394
rename alphaTokens to SplitByAlphaImpl
2022-11-03 15:06:58 +08:00
taiyang-li
5fa0968bd5
reset to original solution
2022-11-03 15:05:23 +08:00
Yakov Olkhovskiy
33f260f11f
fix stule
2022-11-03 07:00:42 +00:00
Yakov Olkhovskiy
8f6f0b26a0
do not post progress to redirected stderr, adjust tests
2022-11-03 06:49:50 +00:00
taiyang-li
e78861ad1c
Merge branch 'master' into enable_max_splits
2022-11-03 14:41:52 +08:00
taiyang-li
6770723027
modify as requested
2022-11-03 12:02:31 +08:00
Yakov Olkhovskiy
170670da59
fallback to stderr
2022-11-03 03:28:57 +00:00
Yakov Olkhovskiy
b30f2ac12d
allow '--progress err' to preserve old behavior, adjust tests
2022-11-03 03:16:55 +00:00
taiyang-li
aeea21e4d7
Merge branch 'master' into ascii_function
2022-11-03 11:13:20 +08:00
SmitaRKulkarni
f26d121f6d
Merge branch 'master' into 42452_Bug_fix_parent_node_corrupted
2022-11-02 22:40:10 +01:00
avogar
774a86021f
Fix datetime schema inference in case of empty string
2022-11-02 19:18:34 +00:00
Nikolai Kochetov
1f11c73dab
Another try.
2022-11-02 18:46:56 +00:00
Smita Kulkarni
816f2319f7
Updated finished_asts to fix fast test fails with Normalise AST is too deep and updated ConvertFunctionOrLikeData to merge conditions by aliasorColumnName instead of ASTPtr - 42452 Bug fix for parent node corrupted
2022-11-02 19:35:22 +01:00
Nikolai Kochetov
4641f12964
Another try.
2022-11-02 18:33:48 +00:00
Alexander Tokmakov
e67d05604c
Merge branch 'master' into fix_intersecting_parts2
2022-11-02 19:30:27 +01:00
Alexander Tokmakov
d8b3a2af84
fix race between INSERT and DROP
2022-11-02 19:26:50 +01:00
Nikolai Kochetov
d551161a29
Another one try.
2022-11-02 17:11:17 +00:00
Vitaly Baranov
32194c1200
Add max limitation for the size of an uploaded part.
2022-11-02 17:53:54 +01:00
Robert Schulze
494d6ca3df
Cleanup implementation of regexpReplace(All|One)
...
This is a pure refactoring, there are no semantic changes.
Cherry-picked from #42682 .
2022-11-02 15:49:53 +00:00
vdimir
503f71b285
Do not set treat_local_port_as_remote in ClusterDiscovery
2022-11-02 15:34:06 +00:00
Igor Nikonov
9a315b7899
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-11-02 15:32:54 +00:00
Vitaly Baranov
e0133688bc
Merge branch 'master' into mask-sensitive-info-in-logs
2022-11-02 16:26:13 +01:00
Alexander Tokmakov
00c9e50ee3
fix race between INSERT and ALTER PARTITION
2022-11-02 16:25:26 +01:00
Dmitry Novik
a860b25249
Improve ValidationChecker readability
2022-11-02 15:24:09 +00:00
Alexander Tokmakov
acbad99b24
remove abandonable_lock part 2
2022-11-02 14:28:49 +01:00
Kruglov Pavel
38124b6533
Merge pull request #42780 from Avogar/parallel-parsing
...
Support parallel parsing for LineAsString input format
2022-11-02 13:21:53 +01:00
ltrk2
14141c9071
Add support for FixedString input to base64 functions
2022-11-02 08:14:28 -04:00
Robert Schulze
8ec4c77352
Merge pull request #42855 from GoGoWen/fix_typo
...
Fix typo
2022-11-02 12:54:52 +01:00
Nikolai Kochetov
2766c550f6
Fix typos.
2022-11-02 10:38:32 +00:00
Antonio Andelic
c4b717b343
Update src/Storages/MergeTree/MergeTreeDataMergerMutator.cpp
...
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2022-11-02 08:24:54 +01:00
zzsmdfj
61123b7f54
to fix join to subqueries rewriter null pointer
2022-11-02 11:34:15 +08:00
Duc Canh Le
ec382d7903
add comment
2022-11-02 09:50:41 +08:00
Duc Canh Le
c6598dc66d
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-02 09:42:01 +08:00
Dmitry Novik
e06572cc27
Validate Query Tree in debug
2022-11-01 23:03:07 +00:00
Alexander Tokmakov
4f50a999bb
remove abandonable_lock part 1
2022-11-01 21:35:25 +01:00
Nikolai Kochetov
478d3079c8
Merge branch 'master' into read-in-order-from-query-plan
2022-11-01 21:02:22 +01:00
Nikolai Kochetov
30f7c04896
Remove some debug output.
2022-11-01 19:58:20 +00:00
Nikolai Kochetov
9ffebf4a0c
Fixing read-in-order for special storages.
2022-11-01 19:51:52 +00:00
Igor Nikonov
e76c3c381f
Better handling tables in read-only mode during insert
...
+ throw immediately if table has no metadata in zk
+ stop retries in case of shutdown
+ check if table is readonly at the begining of every retry
2022-11-01 18:47:51 +00:00
FArthur-cmd
84c88ddc91
fix typos
2022-11-01 17:29:15 +00:00
Azat Khuzhin
e58008b711
Fix rare possible hung on query cancellation
...
Some queries can hung after cancelling (because enough rows had been
read for Distributed queries) or after KILL. Example of such query is a
Distributed query that uses DelayedSource that uses ExpandPipeline to
add new processors, and in this case it is possible that all already
existing processes was cancelled but new had been added and now
PipelineExecutor will wait for them undefinitelly since nobody will read
from them and nobody will cancel them either.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-11-01 18:17:47 +01:00
Vitaly Baranov
53ae7aba9a
Merge pull request #42628 from azat/s3-plain-fixes
...
Implement ATTACH of MergeTree table for s3_plain disk
2022-11-01 18:00:46 +01:00
Vitaly Baranov
085fb80190
Spare stack in InDepthNodeVisitor.
2022-11-01 17:20:12 +01:00
Yakov Olkhovskiy
16159cc7a9
Merge pull request #42412 from ClibMouse/formatIpv6_s390x_support
...
format ipv6 in s390x, endianess support
2022-11-01 12:02:44 -04:00
Nikolai Kochetov
52204233e4
Fix some more tests.
2022-11-01 15:11:26 +00:00
FArthur-cmd
34a33d1821
add documentation for functions
2022-11-01 15:09:05 +00:00
Anton Popov
88674ef964
Merge pull request #42794 from CurtizJ/better-code-in-check-part
...
Slightly better code with projections
2022-11-01 16:05:27 +01:00
zhongyuankai
c1e2b2af74
Optimize TTL merge, completely expired parts can be removed in time
2022-11-01 22:58:15 +08:00
Anton Popov
876dca48da
Merge pull request #36969 from CurtizJ/dynamic-columns-14
...
Support `Object` type inside other types
2022-11-01 15:20:02 +01:00
Duc Canh Le
07d9720ed5
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-01 22:16:09 +08:00
Kruglov Pavel
c3a7211c1c
Merge pull request #41502 from marcioapm/coercing-json-extract
...
Add coercing in JSONExtract
2022-11-01 14:52:41 +01:00
Kruglov Pavel
7cbb534388
Merge pull request #42536 from ClickHouse/Avogar-patch-3
...
Fix typo in setting name that led to bad usage of schema inference cache
2022-11-01 14:03:47 +01:00
Kruglov Pavel
21d50f76ea
Merge pull request #41979 from Avogar/s3-cluster-schema-inference
...
Fix schema inference in s3Cluster and improve in hdfsCluster
2022-11-01 14:00:21 +01:00
Vitaly Baranov
b9f2f17331
Add test and logging.
2022-11-01 12:23:20 +01:00
Alexander Gololobov
f67f0183f6
Merge pull request #42812 from azat/utf8-fix-followup
...
Fix lowerUTF8()/upperUTF8() in case of symbol was in between 16-byte boundary
2022-11-01 12:01:00 +01:00
Maksim Kita
fe48a1ce7e
Merge pull request #42681 from kitaisreal/merge-tree-indexes-use-actions-dag
...
MergeTree indexes use ActionsDAG
2022-11-01 13:55:17 +03:00
Maksim Kita
27a72f096c
Merge pull request #42705 from kitaisreal/analyzer-small-improvements
...
Analyzer improve subqueries representation
2022-11-01 13:54:12 +03:00
GoGoWen2021
2b0cde9ef9
fix typo
2022-11-01 17:46:44 +08:00
Smita Kulkarni
b689f7ab70
Updated registerFunction method to take TableFunctionFactoryData as input , moved table_functions_allowed_in_readonly_mode inside TableFunctionFactory- 42414 Enable table functions in readonly mode
2022-11-01 10:13:10 +01:00
Duc Canh Le
3545db0a6c
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-11-01 16:54:26 +08:00
SmitaRKulkarni
a1a3eb4f10
Merge branch 'master' into 42452_Bug_fix_parent_node_corrupted
2022-11-01 09:46:05 +01:00
Vitaly Baranov
9d46547daa
Merge branch 'master' into session-log-support-sslcertificate-auth
2022-11-01 08:32:09 +01:00
Alexey Milovidov
1b3ef58b51
Merge branch 'master' into formatIpv6_s390x_support
2022-10-31 23:20:53 +01:00
Yakov Olkhovskiy
bab0e06e3d
Merge pull request #42458 from Clark0/match-func-use-index
...
match function can use index if it's a condition on string prefix #37333
2022-10-31 17:33:58 -04:00
Nikolai Kochetov
e99fd4ed25
Add test
2022-10-31 20:50:10 +00:00
Zhiguo Zhou
d18d08bcc7
Remove short-circuit evaluation in AssociativeApplierImpl::apply ( #42214 )
...
The short-circuit evaluation was implemented when applying the
saturable operators (and, or) on a vector of ColumnUInt8. However,
its control flow would be compiled as a series of conditional
branch instructions which are hard to predict by the hardware and
at the same time hinder the vectorization optimization by the
compiler. This commit removes the short-circuit and evaluates the
whole expression.
2022-10-31 21:36:15 +01:00
Igor Nikonov
9cc64a0fcc
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-10-31 18:21:21 +00:00
Igor Nikonov
2d5050ea66
Fix review comments
2022-10-31 18:20:58 +00:00
Vitaly Baranov
914ab51992
Increase the size of upload part exponentially for backup to S3.
2022-10-31 17:54:41 +01:00
Vitaly Baranov
d1c69a0753
Avoid changing query if it doesn't contain password.
2022-10-31 17:04:44 +01:00
Maksim Kita
f099bf63b3
Merge pull request #42809 from Gabriel39/comment_typo
...
Fix typo in comments
2022-10-31 18:30:32 +03:00
Anton Popov
2ae3cfa9e0
Merge branch 'master' into dynamic-columns-14
2022-10-31 16:15:19 +01:00
Alexander Tokmakov
226931229b
Merge pull request #42805 from ClickHouse/fix_some_races_in_merge_tree
...
Fix some races in MergeTree
2022-10-31 17:53:20 +03:00
Márcio Martins
399d024c2c
Fix array index argument type check for JSONExtract* functions
2022-10-31 15:08:34 +01:00
Márcio Martins
c33bd7794f
Merge branch 'master' into coercing-json-extract
2022-10-31 15:04:48 +01:00
Nikolai Kochetov
068ae90448
Comment debug code.
2022-10-31 14:01:51 +00:00
Nikolai Kochetov
375db5bd15
Use read-in-order from query plan by default.
2022-10-31 13:54:03 +00:00
Gabriel
22cf4b9457
Merge branch 'master' into comment_typo
2022-10-31 21:53:16 +08:00
Alexander Tokmakov
599ccb9939
Update MergeTreeData.h
2022-10-31 16:18:17 +03:00
Alexander Tokmakov
b2b9479afa
Update src/Storages/MergeTree/MergeTreeData.h
...
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2022-10-31 16:15:35 +03:00
SmitaRKulkarni
54035270b2
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode
2022-10-31 14:15:29 +01:00
SmitaRKulkarni
7e9dd825c0
Merge branch 'master' into 42452_Bug_fix_parent_node_corrupted
2022-10-31 14:03:44 +01:00
FArthur-cmd
81c1576e61
add tests
2022-10-31 13:03:13 +00:00
Smita Kulkarni
c97c78e3ff
Updated normaliser to clone the alias ast.
...
Implementation:
* Updated QueryNormalizer to clone alias ast, when its replaced. Previously just assigning the same leads to exception in LogicalExpressinsOptimizer as it would be the same parent being inserted again.
* This bug is not seen with new analyser (allow_experimental_analyzer), so no changes for it. I added a test for the same.
Testing:
* Added a test for or function with alias and const where 02475_or_function_alias_and_const_where.sql
2022-10-31 13:49:31 +01:00
Maksim Kita
bca22ec5f5
Fixed code review issues
2022-10-31 12:30:00 +01:00
Nikolay Degterinsky
d8d479a8c0
Merge pull request #42804 from evillique/fix-create-user-parser
...
Fix a bug in ParserCreateUserQuery
2022-10-31 12:29:06 +01:00
Sergei Trifonov
8c67257a1c
Merge pull request #42665 from ClickHouse/token-bucket-throttler
...
Replace throttler algorithm by token bucket
2022-10-31 12:28:18 +01:00
Azat Khuzhin
c93262170d
Remove ReadOnlyMetadataStorage
...
Throw exceptions from IMetadataStorage instead to avoid introducing
extra abstractions.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:30 +01:00
Azat Khuzhin
51bd0c2ac1
Make ReadOnlyMetadataStorage really readonly
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
bceca73f6f
Throw NOT_IMPLEMENTED form ReadOnlyMetadataStorage::getLastChanged()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
3b7abbbff4
Rename s/listPrefix/findAllFiles, s/listPrefixInPath/getDirectoryContents/
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
fa7535c90d
Slightly optimize MetadataStorageFromPlainObjectStorage::isDirectory()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
82ea67eb51
Slightly better MetadataStorageFromPlainObjectStorage::isFile()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
95fb2ad3cf
Implement ATTACH of MergeTree table for s3_plain disk
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
4e42521f44
Introduce ReadOnlyMetadataStorage
...
And use it for:
- MetadataStorageFromPlainObjectStorage
- MetadataStorageFromStaticFilesWebServer
This will allow to reduce ~100-200 lines of duplicated code, and plus
make the code less error prone.
Note, for now I tried to make this without behaviour changes.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
f8ba24f040
Implement S3ObjectStorage::listPrefixInPath()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:26 +01:00
Azat Khuzhin
18e4fdf40f
Introduce IObjectStorage::listPrefixInPath()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Azat Khuzhin
ee18140c48
Remove listPrefix() implementation for disks that does not support send_metadata
...
The reason for removing is it because not compatible with restoring
(with send_metadata set) anyway:
- HDFS - is not compatible with send_metadata, and besides it's
implementaion is not correct, since it is simply `ls -l`, while the
following is required: `find . -maxdepth 1 -type f`
- Web - is not compatible with send_metadata anyway
- Local - is not compatible with send_metadata anyway
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Azat Khuzhin
88db8ae7fa
Add a comment for IObjectStorage::listPrefix()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Azat Khuzhin
94d9600fb8
Implement MetadataStorageFromPlainObjectStorage::getLastChanged() (as for web)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Azat Khuzhin
b34ffda272
Implement MetadataStorageFromPlainObjectStorage::getLastModified() (used by MergeTree)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Azat Khuzhin
f6d0c03ee5
Fix path to files in MetadataStorageFromPlainObjectStorage
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 12:02:25 +01:00
Maksim Kita
d760c78754
Fixed code review issues
2022-10-31 11:45:12 +01:00
Nikolai Kochetov
742d9af397
Merge pull request #42582 from azat/memory-tracker/fixes
...
Fix frequent memory drift message and clarify things in comments
2022-10-31 11:43:20 +01:00
Maksim Kita
115fcaffc5
Fixed tests
2022-10-31 11:30:56 +01:00
Vitaly Baranov
c07fe6921f
Add comments.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
854e1e918f
Use assert_cast() instead of as() in some places.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
43efbad642
Wipe passwords from distributed queries too.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
a30bfada63
Wipe passwords from backup logs too.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
dcf8724adf
Move prepareQueryForLogging() to a separate header.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
f2bd560866
Fix IAST::clone() overrides for some queries.
2022-10-31 10:50:33 +01:00
Vitaly Baranov
c2cc2ccc99
Make as_table_function a child of ASTCreateQuery (to help writing visitors).
2022-10-31 10:50:33 +01:00
Vitaly Baranov
5d2a222fe4
Mask sensitive information in logs.
2022-10-31 10:50:33 +01:00
Alfonso Martinez
9e33b13737
Merge remote-tracking branch 'upstream/master' into fix-slow-json-extract-with-low-cardinality
2022-10-31 08:46:55 +01:00
Azat Khuzhin
5fe44f2736
Fix lowerUTF8()/upperUTF8() in case of symbol was in between 16-byte boundary
...
In lowerUTF8()/upperUTF8() there is an SSE optimization that handles
16 byte at a time, but only for ASCII, for UTF8 symbols converion will
be done by symbol.
Consider the following example:
КВ АМ И СЖ
^ - offset is 15, length of sequence is 2
so first byte of a symbol is in first 16 bytes
second byte of a symbol is not ther
And in this case it will be handled incorrectly because it will try to
process oly these 16 bytes w/o looking forward.
This had been broken by #41286 , before this patch it does not looks at
the row boundaries but only at the string end and so this sutation
wasn't possible.
Fixes : #42756
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 08:17:38 +01:00
Duc Canh Le
d309e8793a
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-10-31 15:13:39 +08:00
Azat Khuzhin
32febf5155
Remove dead code in LowerUpperUTF8Impl::array()
...
AFAICS it was there before since it was possible to overrun the
expected_end, since utf8.convert() was called with "src_end - src" not
"expected_end - src".
Refs: 5a21f3908b054a0efc90c65a12fbe151c74d90dc:dbms/include/DB/Functions/FunctionsString.h
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-31 08:00:29 +01:00
Gabriel
94866979c5
Merge branch 'master' into comment_typo
2022-10-31 13:29:53 +08:00
Gabriel
620caeb07c
Fix typo in comments
2022-10-31 13:20:58 +08:00
Nikolay Degterinsky
05e178b6d3
Merge pull request #42767 from azat/disks/web-sigsegv-fix
...
Fix possible SIGSEGV for web disks when file does not exists
2022-10-30 20:27:21 +01:00
Alexander Tokmakov
f53df7870c
fix race between drop and failed insert
2022-10-30 17:59:47 +01:00
Nikolay Degterinsky
978aa16e29
Fix a bug in ParserCreateUserQuery
2022-10-30 16:42:57 +00:00
Alexander Tokmakov
c68ab231f9
fix accessing part in Deleting state
2022-10-30 17:30:51 +01:00
Roman Vasin
24a4f4afe7
Merge branch 'master' into ADQM-605
2022-10-30 18:03:07 +03:00
Anton Popov
8de75bf29c
better code with projections
2022-10-29 14:39:59 +00:00
Nikolay Degterinsky
6d1b547586
Merge pull request #42724 from evillique/fix-parser-bug
...
Fix a bug in ParserFunction
2022-10-29 13:59:20 +02:00
clarkcaoliu
ca5dbe88db
match function can use index if prefix
2022-10-29 18:25:29 +08:00
FArthur-cmd
f5417da46b
merge
2022-10-29 08:33:05 +00:00
avogar
fe0aea2e3a
Support parallel parsing for LineAsString input format
2022-10-28 21:56:09 +00:00
FArthur-cmd
6cbf50a829
extract common part
2022-10-28 21:06:32 +00:00
Nikolai Kochetov
5d41e7a6d5
Read-in-order over query plan (continuation)
2022-10-28 20:03:23 +00:00
Miel Donkers
fb1623a5f8
Add SSL_CERTIFICATE auth method to all places missing
2022-10-28 21:17:59 +02:00
Igor Nikonov
d09deaf10f
Fix style check
2022-10-28 15:17:05 +00:00
Igor Nikonov
937dd44399
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-10-28 15:09:23 +00:00
Igor Nikonov
c53b96a11c
Add more comments
2022-10-28 15:09:01 +00:00
Sergei Trifonov
c948303fa0
Merge branch 'master' into token-bucket-throttler
2022-10-28 16:21:55 +02:00
Alexey Milovidov
f64e632707
Merge pull request #42469 from amosbird/issue_42456
...
Fix misbehavior of key analysis
2022-10-28 16:18:00 +02:00
Azat Khuzhin
7a5432feaa
Fix possible SIGSEGV for web disks when file does not exists
...
It can be triggered in multiple ways, either when file does not exists
and you are trying to create MergeTree table from web (that has special
code for UUID handling) or by simply OPTIMIZE TABLE FINAL for MergeTree
table that is located on web disk, in both cases you will get the
following:
<details>
<summary>stacktrace</summary>
2022.10.28 14:08:40.631226 [ 6043 ] {6165bf5f-e76b-4bca-941c-7c7ff5e3b46b} <Trace> ContextAccess (default): Access granted: OPTIMIZE ON default.data_from_web
2022.10.28 14:08:40.632017 [ 6043 ] {6165bf5f-e76b-4bca-941c-7c7ff5e3b46b} <Debug> default.data_from_web (a3e65e1f-5fd4-47ed-9dbd-307f2586b52d) (MergerMutator): Selected 1 parts from all_1_1_0 to all_1_1_0
2022.10.28 14:08:40.632496 [ 6043 ] {6165bf5f-e76b-4bca-941c-7c7ff5e3b46b} <Trace> default.data_from_web (a3e65e1f-5fd4-47ed-9dbd-307f2586b52d): Trying to reserve 1.00 MiB using storage policy from min volume index 0
2022.10.28 14:08:40.632752 [ 6043 ] {6165bf5f-e76b-4bca-941c-7c7ff5e3b46b} <Trace> DiskObjectStorage(DiskWebServer): Reserved 1.00 MiB on remote disk `web_disk`, having unreserved 16.00 EiB.
2022.10.28 14:08:40.634155 [ 6043 ] {a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1} <Debug> MergeTask::PrepareStage: Merging 1 parts: from all_1_1_0 to all_1_1_0 into Compact
2022.10.28 14:08:40.634498 [ 6043 ] {a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1} <Trace> WebObjectStorage: Loading metadata for directory: http://127.0.0.1:8080/store/a3e/a3e65e1f-5fd4-47ed-9dbd-307f2586b52d/tmp_merge_all_1_1_1
2022.10.28 14:08:40.635025 [ 6043 ] {a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1} <Trace> DiskWeb: Adding directory: store/a3e/a3e65e1f-5fd4-47ed-9dbd-307f2586b52d/tmp_merge_all_1_1_1/
2022.10.28 14:08:40.635355 [ 6043 ] {a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1} <Trace> ReadWriteBufferFromHTTP: Sending request to http://127.0.0.1:8080/store/a3e/a3e65e1f-5fd4-47ed-9dbd-307f2586b52d/tmp_merge_all_1_1_1/.index
2022.10.28 14:08:40.639618 [ 6043 ] {a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1} <Trace> DiskWeb: Cannot load disk metadata. Error: Code: 86. DB::Exception: Received error from remote server /store/a3e/a3e65e1f-5fd4-47ed-9dbd-307f2586b52d/tmp_merge_all_1_1_1/.index. HTTP status code: 404 Not Found, body: <!doctype html><html><head><title>404 Not Found</title><style>
body { background-color: #fcfcfc; color: #333333 ; margin: 0; padding:0; }
h1 { font-size: 1.5em; font-weight: normal; background-color: #9999cc; min-height:2em; line-height:2em; border-bottom: 1px inset black; margin: 0; }
h1, p { padding-left: 10px; }
code.url { background-color: #eeeeee; font-family:monospace; padding:0 2px;}
</style>
</head><body><h1>Not Found</h1><p>The requested resource <code class="url">/store/a3e/a3e65e1f-5fd4-47ed-9dbd-307f2586b52d/tmp_merge_all_1_1_1/.index</code> was not found on this server.</p></body></html>: while loading disk metadata. (RECEIVED_ERROR_FROM_REMOTE_IO_SERVER) (version 22.11.1.1)
2022.10.28 14:08:40.640527 [ 5488 ] {} <Trace> BaseDaemon: Received signal 11
2022.10.28 14:08:40.641529 [ 9027 ] {} <Fatal> BaseDaemon: ########################################
2022.10.28 14:08:40.642759 [ 9027 ] {} <Fatal> BaseDaemon: (version 22.11.1.1, build id: 12145DA78CE5E9EBB10A034177FAE5967EF81A4A) (from thread 6043) (query_id: a3e65e1f-5fd4-47ed-9dbd-307f2586b52d::all_1_1_1) (query: optimize table data_from_web final) Received signal Segmentation fault (11)
2022.10.28 14:08:40.643260 [ 9027 ] {} <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
2022.10.28 14:08:40.643769 [ 9027 ] {} <Fatal> BaseDaemon: Stack trace: 0x7ffff416c0f2 0x7ffff7cd1ca8 0x7ffff679ae5e 0x7fffd52e7906 0x7fffd50c65aa 0x7fffca7a0d42 0x7fffcaee79ec 0x7fffcaf242f8 0x7fffcaf242b5 0x7fffcaf2427d 0x7fffcaf24255 0x7fffcaf2421d 0x7ffff65c3686 0x7ffff65c2295 0x7fffcaeee2a9 0x7fffcaef2c43 0x7fffcaee3c0e 0x7fffcc4a7851 0x7fffcc4a768f 0x7fffcc4abb2d 0x7fffcfdce828 0x7fffd03e3eaa 0x7fffd03dfe3b 0x7fffc8ec42d4 0x7fffc8ed51d2 0x7ffff4bdd839 0x7ffff4bde0a8 0x7ffff48ab261 0x7ffff48a769a 0x7ffff48a6335 0x7ffff409f8fd 0x7ffff4121a60
2022.10.28 14:08:40.644411 [ 9027 ] {} <Fatal> BaseDaemon: 4. ? @ 0x7ffff416c0f2 in ?
2022.10.28 14:08:40.676390 [ 9027 ] {} <Fatal> BaseDaemon: 5. /src/ch/clickhouse/src/Common/StringUtils/StringUtils.cpp:9: detail::startsWith(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, char const*, unsigned long) @ 0x1ca8 in /src/ch/clickhouse/.cmake/src/Common/StringUtils/libstring_utilsd.so
2022.10.28 14:08:40.730727 [ 9027 ] {} <Fatal> BaseDaemon: 6. /src/ch/clickhouse/src/Common/StringUtils/StringUtils.h:19: startsWith(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) @ 0x59ae5e in /src/ch/clickhouse/.cmake/src/libclickhouse_common_iod.so
2022.10.28 14:08:40.923955 [ 9027 ] {} <Fatal> BaseDaemon: 7. /src/ch/clickhouse/src/Disks/ObjectStorages/Web/MetadataStorageFromStaticFilesWebServer.cpp:58: DB::MetadataStorageFromStaticFilesWebServer::exists(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const @ 0x6e7906 in /src/ch/clickhouse/.cmake/src/libdbmsd.so
2022.10.28 14:08:41.291996 [ 9027 ] {} <Fatal> BaseDaemon: 8. /src/ch/clickhouse/src/Disks/ObjectStorages/DiskObjectStorage.cpp:181: DB::DiskObjectStorage::exists(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&) const @ 0x4c65aa in /src/ch/clickhouse/.cmake/src/libdbmsd.so
2022.10.28 14:08:41.704697 [ 9027 ] {} <Fatal> BaseDaemon: 9. /src/ch/clickhouse/src/Storages/MergeTree/DataPartStorageOnDisk.cpp:74: DB::DataPartStorageOnDisk::exists() const @ 0xda0d42 in /src/ch/clickhouse/.cmake/src/libclickhouse_storages_mergetreed.so
2022.10.28 14:08:43.032459 [ 9027 ] {} <Fatal> BaseDaemon: 10. /src/ch/clickhouse/src/Storages/MergeTree/MergeTask.cpp:147: DB::MergeTask::ExecuteAndFinalizeHorizontalPart::prepare() @ 0x14e79ec in /src/ch/clickhouse/.cmake/src/libclickhouse_storages_mergetreed.so
...
Segmentation fault (core dumped)
</details>
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-28 15:15:49 +02:00
Roman Vasin
5755728b33
Add Date32 and DateTime64 into exception messages
2022-10-28 13:11:09 +00:00
Alexander Tokmakov
11f1f5ae4d
Merge pull request #42747 from jrdi/fix-implicit-cast-CaresPTRResolver
...
Minor fix implicit cast CaresPTRResolver
2022-10-28 15:50:11 +03:00
Roman Vasin
15f3f56812
Change 1 argument of function to first argument of function etc
2022-10-28 12:44:47 +00:00
Nikolai Kochetov
79b30fe133
Merge branch 'master' into read-in-order-from-query-plan
2022-10-28 11:53:51 +00:00
Antonio Andelic
5fae8b0cc9
Merge branch 'master' into optimize-entire-partition
2022-10-28 11:44:10 +00:00
Alfonso Martinez
c37b154254
Added reverted files and fixes for failing fuzzer tests
2022-10-28 12:37:59 +02:00
Sergei Trifonov
eda264b492
Merge branch 'master' into token-bucket-throttler
2022-10-28 11:38:13 +02:00
Maksim Kita
835daee0f3
Merge pull request #42728 from ucasfl/fix
...
Fix truncate table does not hold lock correctly
2022-10-28 11:44:24 +03:00
Maksim Kita
ba8b806957
Merge pull request #42704 from kitaisreal/order-by-limit-by-duplicate-elimination-improve-performance
...
OrderByLimitByDuplicateEliminationPass improve performance
2022-10-28 11:43:53 +03:00
Jordi Villar
534dbc159c
Merge branch 'master' into fix-implicit-cast-CaresPTRResolver
2022-10-28 08:00:22 +02:00
Duc Canh Le
848f5b5d65
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-10-28 13:40:17 +08:00
Duc Canh Le
c080964391
correct 'notLike' in key condition
2022-10-28 13:39:01 +08:00
Suzy Wang
6da80f4dcb
Merge branch 'master' into formatIpv6_s390x_support
2022-10-28 00:32:37 -04:00
Duc Canh Le
69311bd5cd
Merge branch 'master' into ch_canh_fix_prefix_not_like
2022-10-28 11:59:50 +08:00
Igor Nikonov
2b56bc4394
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-10-27 22:02:17 +00:00
Igor Nikonov
3682913172
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-10-27 22:01:53 +00:00
Igor Nikonov
a601c166ad
Add clean up for faults injected before zk request
...
+ for multi-op request, it create responses in multi response
+ some polishing
2022-10-27 21:35:13 +00:00
Igor Nikonov
a4ce0e344a
Fix build
...
src/Common/CaresPTRResolver.cpp:126:27
error: implicit conversion loses integer precision: 'int64_t' (aka
'long') to 'int' [-Werror,-Wshorten-64-to-32]
2022-10-27 21:11:41 +00:00
Sergei Trifonov
8892da3a4c
Merge branch 'master' into token-bucket-throttler
2022-10-27 22:40:59 +02:00
Anton Popov
7715afa595
Merge pull request #42618 from CurtizJ/refactor-data-part
...
Try to save `IDataPartStorage` interface
2022-10-27 22:20:44 +02:00
Jordi Villar
073d81c31f
Use nfds_t instead
2022-10-27 20:36:42 +02:00
Nikolai Kochetov
5106c24e88
Merge branch 'master' into read-in-order-from-query-plan
2022-10-27 18:12:20 +00:00
serxa
c4f25228f7
smaller burst to be closer to old behaviour
2022-10-27 17:18:50 +00:00
Jordi Villar
1fa24161e7
Minor fix implicit cast CaresPTRResolver
2022-10-27 18:34:37 +02:00
Alexander Tokmakov
86b81a2b6f
Merge pull request #42234 from arthurpassos/fix_ares_fd_process_race_condition
...
Fix c-ares crash
2022-10-27 17:17:22 +03:00
Igor Nikonov
f773436de5
Fix flaky test
2022-10-27 13:34:07 +00:00
Nikolai Kochetov
24e1aaf324
Merge pull request #42576 from ClickHouse/table-function-merge-invalid-where-type
...
Invalid type in where for Merge table (logical error)
2022-10-27 13:03:27 +02:00
Kruglov Pavel
e099817449
Merge branch 'master' into Avogar-patch-3
2022-10-27 12:46:18 +02:00
Vladimir C
31e8f92cd9
Merge pull request #42664 from ClickHouse/vdimir/followup-42274
2022-10-27 12:20:46 +02:00
Nikolay Degterinsky
b2ab692d87
Safer getResult()
2022-10-27 10:03:03 +00:00
Maksim Kita
275d076cb7
Fixed style check
2022-10-27 11:26:53 +02:00
Maksim Kita
5fcbc26800
OrderByLimitByDuplicateEliminationPass improve performance
2022-10-27 11:23:30 +02:00
flynn
2b08fe6963
Fix truncate table does not hold lock correctly
2022-10-27 08:56:18 +00:00
serxa
accf78f1ff
fix the first add() call
2022-10-27 08:39:08 +00:00
Robert Schulze
31ef6c66cb
Merge pull request #42513 from ClickHouse/update-libcxx-to-15
...
Build with libcxx(abi) 15
2022-10-27 10:30:36 +02:00
Sergei Trifonov
ec1389cbe7
Update src/Common/Throttler.cpp
...
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2022-10-27 10:30:00 +02:00
Márcio Martins
aaf71d157d
Use return type template parameter to select throwing behavior
2022-10-27 10:26:55 +02:00
Márcio Martins
1ca230ff6d
Allow coercing in JSONExtract* functions
2022-10-27 10:26:55 +02:00
Márcio Martins
40b572c23b
Remove redundant default case in switch statement
2022-10-27 10:26:55 +02:00
Márcio Martins
c3bcb1899d
Add convenience ctor to ReadBufferFromMemory
2022-10-27 10:26:55 +02:00
Márcio Martins
0fc0e81c0c
Add Element::type() to JSONParser
2022-10-27 10:26:55 +02:00
Vladimir Chebotaryov
d17b7387f9
Reworked changes to std::shared_ptr<const RowPolicyFilter>.
2022-10-27 10:42:55 +03:00
Vladimir Chebotaryov
6d5d31e49c
Removed UUID's.
2022-10-27 10:42:26 +03:00
Vladimir Chebotaryov
0707d88311
Removed extendQueryLogElemImplImpl.
2022-10-27 10:42:25 +03:00
Vladimir Chebotaryov
1ec199b539
Style fix.
2022-10-27 10:42:25 +03:00
Vladimir Chebotaryov
0c485d786c
Better includes.
2022-10-27 10:42:24 +03:00
Vladimir Chebotaryov
c28e439c33
Review fixes.
2022-10-27 10:42:22 +03:00
Vladimir Chebotaryov
4cabe1f57c
Added applied row-level policies to system.query_log.
2022-10-27 10:41:47 +03:00
Antonio Andelic
10aa7091ca
Merge pull request #42605 from ClickHouse/correctly-handle-prewhere-type
...
Correctly handle non-native integers in PREWHERE
2022-10-27 09:25:38 +02:00
SmitaRKulkarni
e860ecc80c
Merge branch 'master' into 42414_Enable_functions_in_readonly_mode
2022-10-27 08:26:44 +02:00
李扬
24ffaee18c
Merge branch 'master' into ascii_function
2022-10-26 21:43:46 -05:00
Nikolay Degterinsky
488c220046
Fix bug in ParserFunction
2022-10-27 01:56:25 +00:00
Suzy Wang
fd1281a34d
Merge branch 'master' into formatIpv6_s390x_support
2022-10-26 19:04:55 -04:00
Nikolai Kochetov
313cbb1058
Fix test.
2022-10-26 17:49:36 +00:00
Igor Nikonov
649e8d302c
Sync with retiring branch igor/insert_zk_retries
2022-10-26 17:41:44 +00:00
Igor Nikonov
8435cba352
Merge remote-tracking branch 'origin/master' into igor/insert_zk_retries_retry
2022-10-26 17:35:47 +00:00
Maksim Kita
f04f663818
Fixed tests
2022-10-26 18:55:14 +02:00
Smita Kulkarni
6a8fa2d4a5
Added new field allow_readonly in system.table_functions to allow using table functions in readonly mode.
...
Implementation:
* Added a new field allow_readonly to table system.table_functions.
* Updated to use new field allow_readonly to allow using table functions in readonly mode.
* Added TableFunctionProperties similar to AggregateFunctionProperties.
* The functions allowed in readonly mode are in this set table_functions_allowed_in_readonly_mode.
Testing:
* Added a test for filesystem tests/queries/0_stateless/02473_functions_in_readonly_mode.sh
Documentation:
* Updated the english documentation for Table Functions.
2022-10-26 18:45:23 +02:00
Roman Vasin
09fe9c3ed1
Use {} in exceptions
2022-10-26 16:07:56 +00:00
Nikolai Kochetov
1520bcd53c
Fix error code.
2022-10-26 15:50:10 +00:00
Anton Popov
ca4df62e37
Merge branch 'master' into refactor-data-part
2022-10-26 17:49:20 +02:00
Azat Khuzhin
7b69a70e82
Fix frequent memory drift message and clarify things in comments
...
Somethine like:
2022.09.28 06:33:34.001433 [ 3133669 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 562.20 MiB, peak 562.21 MiB, will set to 562.20 MiB (RSS), difference: -70.46 MiB
2022.09.28 06:33:35.001639 [ 3133669 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 562.20 MiB, peak 562.21 MiB, will set to 562.20 MiB (RSS), difference: -70.45 MiB
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-26 17:38:37 +02:00
Azat Khuzhin
2faefc0c09
Add amount of memory used by allocator into logs
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-26 17:38:37 +02:00
Azat Khuzhin
f5f6f1b593
Add profile events for jemalloc purge
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-26 17:38:36 +02:00
Maksim Kita
6a0e3fc31d
Subqueries remove unnecessary table expression modifiers
2022-10-26 17:19:29 +02:00
Maksim Kita
2b44a00fbc
UNION node remove unnecessary union modes
2022-10-26 16:47:40 +02:00
Mikhail f. Shiryaev
fdecac65b8
Merge pull request #42699 from ClickHouse/22.11-prepare
...
Update version after release
2022-10-26 16:31:48 +02:00
Maksim Kita
1c17e9d454
Fixed tests
2022-10-26 15:54:37 +02:00
Mikhail f. Shiryaev
d3461abd1f
Update version to 22.11.1.1
2022-10-26 15:27:09 +02:00
李扬
04f8f38580
Merge branch 'master' into ascii_function
2022-10-26 07:29:49 -05:00
Kruglov Pavel
b8ee5600be
Merge pull request #42579 from ucasfl/set
...
Fix create set with wrong header when data type is lowcardinality
2022-10-26 14:17:14 +02:00
Nikolai Kochetov
db422fa903
Merge pull request #42410 from ClickHouse/fix-multi-arg-monotonicity
...
Fix possible LOGICAL_ERROR in binary ariphmetics monotonicity.
2022-10-26 14:11:23 +02:00
Kruglov Pavel
219553df8d
Merge pull request #42580 from hanfei1991/fei/limit_max_rows
...
fix behaviour of max_rows_to_read for trival limit queries
2022-10-26 14:09:59 +02:00
Maksim Kita
c47ca522f4
Fixed style check
2022-10-26 13:27:14 +02:00
Antonio Andelic
35a9672704
Merge branch 'master' into optimize-entire-partition
2022-10-26 11:09:25 +00:00
vdimir
14d0f6457b
Add tests and doc for some url-related functions
2022-10-26 10:52:57 +00:00
Maksim Kita
1b6293f6db
MergeTree indexes use ActionsDAG
2022-10-26 12:44:37 +02:00
李扬
c7e5eb756b
Update src/Functions/ascii.cpp
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-10-26 18:18:15 +08:00
李扬
48c37c52e6
Update src/Functions/ascii.cpp
...
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-10-26 18:18:04 +08:00
Antonio Andelic
97aaebfa18
Address PR comments
2022-10-26 10:06:56 +00:00
Alfonso Martinez
348e153455
Merge branch 'fix-corner-case-low-cardinality-string-from-json' into fix-slow-json-extract-with-low-cardinality
2022-10-26 11:53:12 +02:00
Alfonso Martinez
241049763b
Fixed failing tests
2022-10-26 11:50:45 +02:00
SmitaRKulkarni
5df138da82
Merge pull request #42376 from ClickHouse/36316_Support_glob_for_recursive_directory_traversal
...
Added ** glob support for recursive directory traversal to filesystem…
2022-10-26 11:49:20 +02:00
Maksim Kita
6671c454de
Merge pull request #42651 from kitaisreal/analyzer-query-tree-node-remove-method
...
Analyzer IQueryTreeNode remove getName method
2022-10-26 12:36:38 +03:00
Maksim Kita
cd2a8966aa
Merge pull request #42649 from kitaisreal/analyzer-change-setting
...
Analyzer change setting into allow_experimental_analyzer
2022-10-26 12:26:15 +03:00
Antonio Andelic
979d180931
Merge branch 'master' into correctly-handle-prewhere-type
2022-10-26 11:13:16 +02:00
taiyang-li
05b77b3e34
fix comment
2022-10-26 16:25:25 +08:00
taiyang-li
fcbc217a7d
enable limits for functions using FunctionTokens
2022-10-26 16:18:32 +08:00
Azat Khuzhin
8db31beee6
Remove covered parts for fetched part
...
Here is an example that I found on production, simplified.
Consider the following queue (nothing of this had been processed on this
replica):
- GET_PART all_0_0_0 (queue-0000000001)
- GET_PART all_1_1_0 (queue-0000000002)
...
- GET_PART all_0_1_1 (queue-0000000003)
- GET_PART all_2_2_0 (queue-0000000004)
...
- MERGE_PARTS from [all_0_1_1, all_2_2_0] to all_0_2_2 (queue-0000000005)
And now queue-0000000005 started to executing (either because
of reording, or because at that time GET_PART fails), and it
does not have any required parts, so it will fetch them, but
not all_0_0_0 and all_1_1_0, so this replica delay will set to
the time of min(queue-0000000001, queue-0000000002), while it
is not true, since it already have parts that covers those
parts.
and since MERGE_PARTS takes 30min, it increased the replica delay
eventually to 30min, for the time range of 30min, which is pretty huge.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-26 11:10:50 +03:00
taiyang-li
add5360a1b
implement function ascii
2022-10-26 03:02:00 -05:00
Roman Vasin
3eca9ada3b
Add Date32 to formatDateTIme
2022-10-26 08:00:12 +00:00
Alexey Milovidov
011ae8675a
Merge pull request #42633 from ClickHouse/revert-41726-fix-slow-json-extract-with-low-cardinality
...
Revert "Low cardinality cases moved to the function for its corresponding type"
2022-10-26 08:10:27 +02:00
Nikolay Degterinsky
8c6d5cdbac
Merge pull request #42514 from evillique/fix-aliases
...
Fix aliases
2022-10-26 07:45:37 +02:00
serxa
471b391ab2
fix
2022-10-26 00:00:40 +00:00
serxa
27599ab70c
fix comment
2022-10-25 23:58:25 +00:00
serxa
fc223aa673
replace throttler algorithm by token bucket
2022-10-25 23:52:31 +00:00
Anton Popov
79889198b1
fix style check
2022-10-25 23:03:37 +00:00
Anton Popov
d8b09b430f
add comments
2022-10-25 22:27:11 +00:00
Anton Popov
c4d4f2dbed
better interface
2022-10-25 22:14:06 +00:00
Robert Schulze
728342ec7c
Un-inline stuff
2022-10-25 21:41:08 +00:00
Alexey Milovidov
2b4be633ff
Merge branch 'master' into revert-41726-fix-slow-json-extract-with-low-cardinality
2022-10-25 22:57:12 +02:00
ltrk2
2c902bbc65
Implement support for different UUID binary formats ( #42108 )
...
* Implement support for different UUID binary formats
* Declare error codes that the implementation uses
* Make single-argument constructor explicit
* Modernize parts of the solution
* Make improvements based on review comments
* Declare an error code being used
2022-10-25 21:57:50 +02:00
Alfonso Martinez
8ef07bac89
Failing case corrected and test added
2022-10-25 17:40:54 +02:00
Nikolai Kochetov
bfb5e6eae4
Fix logical error for invalid prewhere type in StorageMerge.
2022-10-25 13:58:29 +00:00
Antonio Andelic
611c2e2bd7
Support for optimizing old parts for entire partition only
2022-10-25 13:40:18 +00:00
Nikolai Kochetov
c4685f6994
Merge branch 'master' into fix-42575
2022-10-25 15:31:32 +02:00
