Commit Graph

51165 Commits

Author SHA1 Message Date
Alexey Milovidov
468b5e2813 Fix use-after-move 2023-12-23 08:23:15 +01:00
Alexey Milovidov
6a23fe034f Remove parallel parsing for JSONCompactEachRow 2023-12-23 06:17:47 +01:00
Alexey Milovidov
dc4b9a1013 Obfuscator: keep settings and timezones 2023-12-23 04:55:55 +01:00
Pradeep Chhetri
b5c8c4050b Add base backup name to system.backups and system.backup_log tables 2023-12-23 11:08:50 +08:00
Alexey Milovidov
ffca9bc564 Fix #58171 2023-12-23 02:04:35 +01:00
avogar
a5e0c45603 Fix possible PARAMETER_OUT_OF_BOUND error during subcolumns reading from wide part in MergeTree 2023-12-23 00:40:10 +00:00
Alexey Milovidov
aa69611781
Update ProfileEvents.cpp 2023-12-23 03:36:08 +03:00
Azat Khuzhin
17e21aa21e Pass throught exceptions for reading from S3
Reading from S3 has retries on almost any exception, except for
CANNOT_ALLOCATE_MEMORY, but the problem is that this exception may not
be even delivered to ReadBufferFromS3::processException(), due to
std::istream will hide it (see [1]).

  [1]: 1834e42289/libcxx/include/istream (L1059)

So let's pass throught them to see at least some information instead of
just:

    Message: Cannot read from istream at offset 0

And here as an example of exception:

<details>

    (lldb) bt
    * thread 244, name = 'MergeMutate', stop reason = breakpoint 6.1
      * frame 0: 0x000000001aa9c791 clickhouse`::__cxa_throw(thrown_object=0x00007fc3b68fdb00, tinfo=0x000000000548af50, dest=(clickhouse`Poco::Net::NetException::~NetException() at NetException.cpp:26))(void *)) at cxa_exception.cpp:258:33
        frame 1: 0x0000000017c55b2b clickhouse`Poco::Net::SocketImpl::error(code=-1232086272, arg=0x00007fc3be4f4d30) at SocketImpl.cpp:985:3
        frame 2: 0x0000000017c1f7ff clickhouse`Poco::Net::SecureSocketImpl::handleError(int) [inlined] Poco::Net::SocketImpl::error(code=<unavailable>) at SocketImpl.cpp:923:2
        frame 3: 0x0000000017c1f7e4 clickhouse`Poco::Net::SecureSocketImpl::handleError(this=0x00007fc35ae42b30, rc=-1) at SecureSocketImpl.cpp:531
        frame 4: 0x0000000017c208f9 clickhouse`Poco::Net::SecureSocketImpl::receiveBytes(this=0x00007fc35ae42b30, buffer=0x00007fc346e402c4, length=131068, flags=<unavailable>) at SecureSocketImpl.cpp:353:10
        frame 5: 0x0000000017c3b388 clickhouse`Poco::Net::HTTPSession::read(char*, long) [inlined] Poco::Net::StreamSocket::receiveBytes(buffer=<unavailable>, length=<unavailable>, flags=0) at StreamSocket.cpp:130:17
        frame 6: 0x0000000017c3b379 clickhouse`Poco::Net::HTTPSession::read(char*, long) [inlined] Poco::Net::HTTPSession::receive(this=<unavailable>, buffer=<unavailable>, length=<unavailable>) at HTTPSession.cpp:166
        frame 7: 0x0000000017c3b379 clickhouse`Poco::Net::HTTPSession::read(this=0x00007fc3973e9098, buffer=<unavailable>, length=<unavailable>) at HTTPSession.cpp:144
        frame 8: 0x0000000017c0f706 clickhouse`Poco::Net::HTTPSClientSession::read(this=<unavailable>, buffer=<unavailable>, length=<unavailable>) at HTTPSClientSession.cpp:195:23
        frame 9: 0x0000000017c32eb4 clickhouse`Poco::Net::HTTPFixedLengthStreamBuf::readFromDevice(this=0x00007fc361bd6708, buffer=<unavailable>, length=<unavailable>) at HTTPFixedLengthStream.cpp:53:16
        frame 10: 0x0000000017c2a368 clickhouse`Poco::BasicBufferedStreamBuf<char, std::__1::char_traits<char>, Poco::Net::HTTPBufferAllocator>::underflow(this=0x00007fc361bd6708) at BufferedStreamBuf.h:97:17
        frame 11: 0x0000000008b2abca clickhouse`std::__1::basic_streambuf<char, std::__1::char_traits<char> >::uflow(this=0x00007fc361bd6708) at streambuf:445:9
        frame 12: 0x0000000008b2ab5a clickhouse`std::__1::basic_streambuf<char, std::__1::char_traits<char> >::xsgetn(this=0x00007fc361bd6708, __s="P, __n=1048576) at streambuf:422:25
        frame 13: 0x0000000008b2ca0e clickhouse`std::__1::basic_istream<char, std::__1::char_traits<char> >::read(char*, long) [inlined] std::__1::basic_streambuf<char, std::__1::char_traits<char> >::sgetn[abi:v15000](this=<unavailable>, __s="!P, __n=1048576) at streambuf:204:14
        frame 14: 0x0000000008b2ca02 clickhouse`std::__1::basic_istream<char, std::__1::char_traits<char> >::read(this=0x00007fc35ae42d40, __s="!P, __n=1048576) at istream:1052
        frame 15: 0x0000000010de0b9f clickhouse`DB::ReadBufferFromIStream::nextImpl(this=0x00007fc3663d2380) at ReadBufferFromIStream.cpp:15:10

</details>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-22 23:29:28 +01:00
Jordi Villar
bff0b9c790 Fix mutations new part uncompressed bytes 2023-12-22 22:33:58 +01:00
Igor Nikonov
1deafa1a00 Profile event 'ParallelReplicasUsedCount' 2023-12-22 20:54:52 +00:00
Alexander Tokmakov
499984e57a
Merge pull request #58051 from ClickHouse/tavplubix-patch-10
Small improvement for SystemLogBase
2023-12-22 20:24:08 +01:00
Igor Nikonov
d3a0869119 Merge remote-tracking branch 'origin/master' into parallel-replicas-in-subquery 2023-12-22 17:54:45 +00:00
Igor Nikonov
ca1ddf0608 Fix style 2023-12-22 17:54:21 +00:00
Jordi Villar
b4c3969d3a Add bytes_uncompressed to system.part_log 2023-12-22 18:35:33 +01:00
yariks5s
50724f1b5d Merge branch 'fix_s3_regions' of github.com:yariks5s/ClickHouse into fix_s3_regions 2023-12-22 17:28:22 +00:00
yariks5s
a543048b5f review fix 2023-12-22 17:28:09 +00:00
Igor Nikonov
6f68696c14 Fix: for joins with old analyzer 2023-12-22 17:26:31 +00:00
Yarik Briukhovetskyi
2025f202fd
Merge branch 'ClickHouse:master' into fix_s3_regions 2023-12-22 17:50:54 +01:00
Dani Pozo
2be2486e94 Remove retryStrategy assignments overwritten in ClientFactory::create() 2023-12-22 17:28:43 +01:00
vdimir
9b137059a3
Better logging in hash join 2023-12-22 15:52:47 +00:00
vdimir
4309d45730
Reserve memory in AddedColums 2023-12-22 15:52:47 +00:00
vdimir
47e46e0c50
Fix race in GraceHashJoin::DelayedBlocks 2023-12-22 15:52:46 +00:00
vdimir
6c9aa2ced5
handle not_processed in GraceHashJoin 2023-12-22 15:52:45 +00:00
vdimir
8429162038
HashJoin respects max_joined_block_size_rows 2023-12-22 15:52:41 +00:00
Alexey Milovidov
08ff37f64e
Merge pull request #57682 from azat/system.stack_trace/analyzer
Add support for system.stack_trace filtering optimizations for analyzer
2023-12-22 16:28:28 +01:00
Yarik Briukhovetskyi
ab6cc0c9f0
Update Client.cpp 2023-12-22 14:59:21 +01:00
Andrey Zvonov
01eb9be18e
Merge branch 'ClickHouse:master' into zvonand-issue-53190 2023-12-22 14:33:18 +01:00
yariks5s
823abaa73e init 2023-12-22 13:27:03 +00:00
Nikolai Kochetov
3cbd895ce1
Merge pull request #57827 from ClickHouse/vdimir/merge_join_array_lowcard
Fix low-cardinality keys support in MergeJoin
2023-12-22 13:34:06 +01:00
vdimir
b06ae8bcee
Merge pull request #57139 from ClickHouse/vdimir/fix_logical_error_analyzer_and_optimize
Analyzer: Fix assert in tryReplaceAndEqualsChainsWithConstant
2023-12-22 13:15:24 +01:00
Yarik Briukhovetskyi
483a377834
Merge pull request #57995 from yariks5s/paste_join
Implementing PASTE JOIN
2023-12-22 12:56:06 +01:00
Azat Khuzhin
d29762f19f Do not send signals to threads that blocks SIGRTMIN for system.stack_trace
That way we can avoid superior timeouts during reading from
system.stack_trace.

Two known cases of such threads are:
- rdk: -- librdkafka threads
- iou-wrk -- io_uring threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-22 12:41:20 +01:00
Raúl Marín
24f952b2b8
Merge pull request #57986 from Algunenano/zk_retries_quorum
Support keeper failures in quorum check
2023-12-22 11:10:04 +01:00
Alexey Milovidov
ee199877d6
Update diskSettings.cpp 2023-12-22 07:27:48 +03:00
Bharat Nallan Chakravarthy
62b28d365c Merge with upstream/master 2023-12-21 17:04:25 -08:00
zvonand
c1705bc0c7 fix accurateCastOrNull 2023-12-21 22:30:51 +01:00
Alexey Milovidov
dc82aaef06
Merge pull request #58134 from Algunenano/clang_tidy_fix
Fix clang-tidy
2023-12-21 20:25:01 +01:00
Azat Khuzhin
aa5a6449f0 Fix system.stack_trace for threads with blocked SIGRTMIN
Some third-party libraries (i.e. librdkafka) could block it, and in this
case system.stack_trace will return stacktrace for the main process
(usually, basically it could be any thread with non blocked signal).

By replacing sigqueue() with more precise rt_tgsigqueueinfo(), other
threads will not respond to the signal.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit 106042cf41)
2023-12-21 19:41:56 +01:00
Raúl Marín
2e522b9405 Remove requestUnconditionalRetry
It's confusing, only me used it and I used it wrong
2023-12-21 19:19:50 +01:00
Igor Nikonov
b9f1039ac4 Fix log message 2023-12-21 17:09:49 +00:00
Igor Nikonov
81b8507cc1 New analyzer support 2023-12-21 17:04:03 +00:00
Raúl Marín
58d94c0ce0 Fix clang-tidy 2023-12-21 17:48:57 +01:00
Igor Nikonov
f0933d2714 Disable parallel replicas with IN with subquery 2023-12-21 16:21:02 +00:00
Raúl Marín
ceed935b30 Remove debug comment and fix unconditional_retry logic 2023-12-21 17:11:34 +01:00
Raúl Marín
6d9da8edd5 Merge remote-tracking branch 'blessed/master' into zk_retries_quorum 2023-12-21 17:03:29 +01:00
Raúl Marín
77efdf3a9e Merge remote-tracking branch 'blessed/master' into log_and_exception_verbose 2023-12-21 16:07:47 +01:00
Alexey Milovidov
e2c1230b00
Merge pull request #58118 from ClickHouse/fix-parallel-replicas-big-int
Fix parallel replicas in presence of a scalar subquery with a big integer value
2023-12-21 15:55:00 +01:00
vdimir
c08a490578
Fix nullability after tryReplaceOrEqualsChainWithIn 2023-12-21 14:30:54 +00:00
Raúl Marín
a0a1189302 More improvements 2023-12-21 13:50:53 +01:00
Nikolay Degterinsky
7aa2363b40 Merge remote-tracking branch 'upstream/master' into replicated-database-forbid-create-as-select 2023-12-21 12:38:44 +00:00
Alexey Milovidov
34fd555ee6
Merge pull request #58104 from ClickHouse/cleanup-replication-compatibility
Add compatibility in the replication protocol for a removed feature
2023-12-21 12:04:35 +01:00
Alexey Milovidov
eff69940d0 Fix parallel replicas in presense of a scalar subquery with a big integer value 2023-12-21 11:42:04 +01:00
Raúl Marín
ced9407cef Improve error messages 2023-12-21 10:29:05 +01:00
Robert Schulze
20c0347eef
Merge pull request #57885 from bigo-sg/if-opt
Branch-free evaluation in function `if()`
2023-12-21 10:24:06 +01:00
Alexey Milovidov
ab6a712ec6 Add compatibility in the replication protocol for a removed feature 2023-12-21 09:31:59 +01:00
Alexey Milovidov
3b1aa53460
Merge pull request #58100 from ClickHouse/optimize-cleanup-as-noop
Reintroduce OPTIMIZE CLEANUP as no-op
2023-12-21 09:27:10 +01:00
Antonio Andelic
b9466023ce
Merge pull request #58069 from ClickHouse/dont-preprocess-if-not-ready
Fix invalid preprocessing on Keeper
2023-12-21 09:08:56 +01:00
Alexey Milovidov
b57bc0e4ed
Merge pull request #58092 from Algunenano/cosmetic_changes
Minor cosmetic changes
2023-12-21 06:06:48 +01:00
Alexey Milovidov
411d1049dd Reintroduce OPTIMIZE CLEANUP as no-op 2023-12-21 06:02:46 +01:00
San
5b6d171145
Merge pull request #58060 from ClickHouse/non_post_request_shouldbe_readonly
Non post request should be readonly
2023-12-21 15:34:34 +11:00
zhanglistar
f0a51e5be5 Modify comments and merge master. 2023-12-21 09:55:26 +08:00
zhanglistar
408f9ea1ae
Merge branch 'ClickHouse:master' into if-opt 2023-12-21 09:50:23 +08:00
Alexey Milovidov
7be39a27cc
Revert "Consider lightweight deleted rows when selecting parts to merge" 2023-12-21 01:46:38 +03:00
Azat Khuzhin
6fd32d92d0 Add max/peak RSS into system.asynchronous_metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-12-20 20:36:05 +01:00
Raúl Marín
a581450567 Cosmetic 2023-12-20 18:44:09 +01:00
Nikolai Kochetov
4d7a5d47ee
Merge pull request #58045 from ClickHouse/make-windowInsertResultInto-constant
Make window insert result into constant
2023-12-20 17:42:34 +01:00
Nikita Taranov
d57ac6dfdb
Set replica number to its position in cluster definition (#57800)
* impl

* fix
2023-12-20 17:33:05 +01:00
Alexander Tokmakov
015225c629
Merge pull request #57906 from ClickHouse/create_index_normalize
Normalize function names in CREATE INDEX
2023-12-20 17:24:19 +01:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token
Feature/s3 session token
2023-12-20 17:22:09 +01:00
Alexander Tokmakov
858f2be6b5
Merge pull request #57337 from ClickHouse/drop_database_replica_no_throw
Don't throw if noop when dropping database replica in batch
2023-12-20 16:48:58 +01:00
vdimir
a78b00a854
Analyzer: Fix assert in tryReplaceAndEqualsChainsWithConstant 2023-12-20 15:44:05 +00:00
Anton Popov
87d0cec055
Merge pull request #57433 from CurtizJ/materialize-lightweight-delete
Add mutation command `APPLY DELETED MASK`
2023-12-20 14:44:11 +01:00
vdimir
ae4270465d
Merge pull request #57544 from ClickHouse/vdimir/dict_hashed_array_shard
Support SHARDS for HashedArrayDictionary
2023-12-20 13:02:26 +01:00
Nikolai Kochetov
b10183e7af
Merge pull request #58048 from ClickHouse/follow-up-57691
Follow up for #57691
2023-12-20 12:54:19 +01:00
Antonio Andelic
3cc8358b89 Avoid preprocessing if Keeper leader is not ready 2023-12-20 10:22:00 +00:00
Robert Schulze
ecb6f31211
Merge pull request #57969 from rschu1ze/punycode-is-cool
Implement punycode encoding/decoding
2023-12-20 10:20:34 +01:00
zhanglistar
810305fafe Fix if.xml. 2023-12-20 10:58:46 +08:00
santrancisco
1e86fb298a
Fixing check for HTTP POST request 2023-12-20 12:37:36 +11:00
Yakov Olkhovskiy
6830954cd3
Merge pull request #57988 from Chen768959/fix-literal-alias-misclassification
Fix literal alias misclassification
2023-12-19 19:36:59 -05:00
Alexey Milovidov
af32b33e93
Merge pull request #57648 from jewelzqiu/refine-lwd-merge
Consider lightweight deleted rows when selecting parts to merge
2023-12-20 01:10:32 +01:00
Alexey Milovidov
d190866fc0
Merge pull request #58031 from ClickHouse/revert-57766-fix-bug-window-functions
Revert "Fix bug window functions: revert #39631"
2023-12-20 01:08:08 +01:00
Alexey Milovidov
319a7e2911
Merge pull request #57994 from Algunenano/blake3_llvm
Replace rust's BLAKE3 with llvm's implementation
2023-12-20 01:06:35 +01:00
Yakov Olkhovskiy
43fcea64b6
Merge pull request #57186 from chenlx0/bytes_uncompressed
Show uncompressed data size in system.tables
2023-12-19 19:04:47 -05:00
Raúl Marín
ccff198265
Rename canUseParallelReplicas to canUseTaskBasedParallelReplicas (#58025) 2023-12-19 23:21:19 +01:00
Jordi Villar
7c281d9a6f
Allow max_size_to_drop settings in query time (#57452) 2023-12-19 23:16:03 +01:00
jsc0218
0a9475abc7
Merge pull request #57874 from joelynch/joelynch/host-psql
bugfix: addresses_expr ignored for psql named collections
2023-12-19 15:24:23 -05:00
Alexander Tokmakov
bbd7bc0dd9
Update SystemLogBase.cpp 2023-12-19 20:26:19 +01:00
Julia Kartseva
c7eff0e573
Merge pull request #58015 from jkartseva/fix-fuzzjson-segfault
Fix segfault in FuzzJSON engine
2023-12-19 11:19:20 -08:00
Julia Kartseva
2c32589949
Merge pull request #58019 from jkartseva/fix-build-errno-exception
fix freebsd build
2023-12-19 11:16:45 -08:00
Yarik Briukhovetskyi
6e816d45ae
Merge branch 'master' into paste_join 2023-12-19 20:02:24 +01:00
yariks5s
4e418a89d9 fixed suggestions 2023-12-19 19:00:37 +00:00
Julia Kartseva
58f75c9679
Update src/Storages/StorageFuzzJSON.cpp
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-12-19 10:17:15 -08:00
Sema Checherinda
802ad4ec47
Merge pull request #57523 from ClickHouse/remove-the-limit-for-connections-per-endpoint
Remove the limit for the number of connections per endpoint for background fetches + small refactoring
2023-12-19 19:16:01 +01:00
Nikolai Kochetov
9510b2ccfe Follow up for 57691 2023-12-19 17:57:52 +00:00
Nikolai Kochetov
ddb582c8b4 Make windowInsertResultInto constant 2023-12-19 16:52:50 +00:00
Bharat Nallan Chakravarthy
ecd2843b47 add a clarification to docs 2023-12-19 08:35:14 -08:00
Nikolai Kochetov
a69005525b Fix function ntile. 2023-12-19 16:15:39 +00:00
Nikita Taranov
a375b1eab8
Fix handling of unavailable replicas before first request happened (#57933) 2023-12-19 16:41:51 +01:00
Raúl Marín
b458c77340 Fix integration test 2023-12-19 14:36:03 +01:00
Raúl Marín
64247e9033 Try fix clang-tidy again 2023-12-19 14:28:41 +01:00
Kseniia Sumarokova
d4e71f96c1
Merge pull request #57897 from ClickHouse/allow-to-dynamically-change-fs-cache-size
Support dynamic reloading of filesystem cache size
2023-12-19 13:51:42 +01:00
Robert Schulze
952175ce39
Merge pull request #57875 from zhongyuankai/order_by_all
Support `ORDER BY ALL`
2023-12-19 13:38:07 +01:00
vdimir
252cb8a507
Merge pull request #54602 from fionera/issue-49028
Add setting http_make_head_request
2023-12-19 13:33:59 +01:00
Nikolai Kochetov
8ab6564538
Revert "Fix bug window functions: revert #39631" 2023-12-19 13:30:59 +01:00
Robert Schulze
f503aa7838
Merge pull request #57887 from canhld94/ch_fast_enum_default_serialization
More efficient constructor for SerializationEnum
2023-12-19 12:51:23 +01:00
Chen768959
c1f7de770d
Merge branch 'ClickHouse:master' into fix-literal-alias-misclassification 2023-12-19 19:48:25 +08:00
Raúl Marín
8bef92c92a Fix clang-tidy 2023-12-19 12:39:05 +01:00
Anton Popov
34cdecea70
Merge pull request #58013 from CurtizJ/fix-race-external-sort
Fix rare race in external sort/aggregation with temporary data in cache
2023-12-19 12:20:31 +01:00
Raúl Marín
3632688e55 Fix style 2023-12-19 11:48:15 +01:00
Antonio Andelic
52b3caec90
Revert "Add system.dropped_tables_parts table" 2023-12-19 10:36:22 +01:00
zhanglistar
59b049ce08 function if branch free fix tests. 2023-12-19 16:40:13 +08:00
Robert Schulze
a8845ba729
Reorganize the test (a bit) + whitespace fixes 2023-12-19 08:16:54 +00:00
Robert Schulze
1d9c0db1f6
Incorporate review feedback 2023-12-19 08:00:59 +00:00
ubuntu
a077ad4c15 support new analyzer 2023-12-19 15:18:27 +08:00
Robert Schulze
00c407ecc1
Merge remote-tracking branch 'rschu1ze/master' into punycode-is-cool 2023-12-19 06:27:23 +00:00
Shani Elharrar
679a0e1300 StorageS3 / TableFunctionS3: Allow passing session_token to AuthSettings
This can help users that want to pass temporary credentials that
issued by AWS in order to load data from S3 without changing
configuration or creating an IAM User.

Fixes #57848
2023-12-19 08:06:36 +02:00
zhanglistar
b252b7182c Function if performance improvment fix bug. 2023-12-19 12:09:00 +08:00
Julia Kartseva
31f04b66c5 fix freebsd build
https://github.com/ClickHouse/ClickHouse/actions/runs/7256640256/job/19769624432?pr=58015#step:8:5466
```
Dec 19 03:09:41 /build/src/IO/AIO.cpp:140:15: error: use of undeclared identifier 'ErrnoException'; did you mean 'DB::ErrnoException'?
Dec 19 03:09:41   140 |         throw ErrnoException(DB::ErrorCodes::CANNOT_IOSETUP, "io_setup failed");
```
2023-12-19 03:47:28 +00:00
Julia Kartseva
6014dca114 Allow multiple columns in StorageFuzzJSON 2023-12-19 02:34:23 +00:00
Julia Kartseva
0fc402c106 Fix segfault in FuzzJSON engine
Allow only String type for FuzzJSON engine table columns.

Fixes: https://github.com/ClickHouse/ClickHouse/issues/57858
2023-12-19 02:20:37 +00:00
Anton Popov
bfd403cc8c
Merge pull request #57996 from CurtizJ/better-trivial-count-merge
Better trivial count optimization for storage `Merge`
2023-12-19 02:25:58 +01:00
Yakov Olkhovskiy
fd460566f6
fix setting description 2023-12-18 19:34:08 -05:00
Han Fei
032fd08559
Merge pull request #57991 from hanfei1991/hanfei/refine-err-msg
refine error message
2023-12-19 01:14:18 +01:00
Nikita Mikhaylov
6360b76792 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-18 21:49:31 +00:00
pufit
36d1905881
Merge pull request #57752 from chizhonkova/refactor_sql_udf_loader
Refactoring for UserDefinedSQLObjectsLoader
2023-12-18 16:08:46 -05:00
Alexey Milovidov
1a7de9158f
Merge pull request #57979 from ClickHouse/add-test-49708
Add a test for #49708
2023-12-18 21:29:11 +01:00
Anton Popov
27d632f5e4 fix race in operations with external temporary data in cache 2023-12-18 20:02:53 +00:00
Alexey Milovidov
7178bd5c88
Merge pull request #57910 from Algunenano/log_message_string
Improvements for 00002_log_and_exception_messages_formatting
2023-12-18 21:02:23 +01:00
Alexander Tokmakov
de7a349f0d
Update MergeTreeData.cpp 2023-12-18 20:44:50 +01:00
Raúl Marín
5601f97e0c Move FunctionsStringHashFixedString template to single file 2023-12-18 19:14:47 +01:00
Nikolai Kochetov
34ca74878e
Merge pull request #57555 from ClickHouse/ft-dropped_tables_parts
Add system.dropped_tables_parts table
2023-12-18 18:56:57 +01:00
Bharat Nallan Chakravarthy
aef4e2e6ec Merge upstream/master into ncb/async-metrics-pri-key-size 2023-12-18 09:46:51 -08:00
Raúl Marín
80af5cb78a Always build the necessary LLVM modules if blake3 is enabled 2023-12-18 18:32:31 +01:00
Raúl Marín
46067adce8 Improve ZooKeeperRetriesControl so it's easier to reuse 2023-12-18 17:43:10 +01:00
Nikolai Kochetov
5290b3c9ce
Merge pull request #57855 from kitaisreal/interpreter-create-query-sample-block-fix
InterpreterCreateQuery sample block fix
2023-12-18 17:22:24 +01:00
yariks5s
975c954d1a style check 2023-12-18 15:42:50 +00:00
Yakov Olkhovskiy
8e39c61401 Merge remote-tracking branch 'origin/master' into ft-dropped_tables_parts 2023-12-18 15:40:07 +00:00
Anton Popov
7ebb7d2955 better trivial count optimization for storage Merge 2023-12-18 15:13:43 +00:00
yariks5s
6740316a88 init 2023-12-18 15:02:51 +00:00
Raúl Marín
99d1659b4c Replace rust's BLAKE3 with llvm's implementation 2023-12-18 15:29:01 +01:00
Anton Popov
10bc2db56d add setting 2023-12-18 13:57:07 +00:00
Raúl Marín
88dcaefde8 Style 2023-12-18 14:51:46 +01:00
Han Fei
028d1c9478 refine error message 2023-12-18 14:47:54 +01:00
Nikolay Degterinsky
bd17ee769e
Merge pull request #57938 from bharatnc/ncb/tablesloder-remove-cruft
remove cruft from TablesLoader
2023-12-18 14:46:36 +01:00
chen768959
fdda0cf8ac Literal aliases incorrectly classified as 'complex_aliases'. 2023-12-18 21:43:07 +08:00
Kseniia Sumarokova
f11fc650ee
Merge branch 'master' into allow-to-dynamically-change-fs-cache-size 2023-12-18 13:10:36 +01:00
Raúl Marín
0346850897 Support keeper failures in quorum check 2023-12-18 12:54:15 +01:00
Robert Schulze
414a2893d0
Merge pull request #57821 from rschu1ze/consolidate-substring-tests
Dumb down `substring()` tests
2023-12-18 12:32:20 +01:00
Robert Schulze
29d70c12f6
Fix CI checks 2023-12-18 10:47:40 +00:00
Raúl Marín
2639d0715f Merge remote-tracking branch 'blessed/master' into log_message_string 2023-12-18 10:40:18 +01:00
Raúl Marín
65728f14ce Review error codes 2023-12-18 10:40:02 +01:00
vdimir
f024e39e3b
Merge pull request #57888 from ucasfl/fix-transfer-external-query
Fix transform query for external database
2023-12-18 10:28:32 +01:00
Raúl Marín
f10dae4761
Merge pull request #56917 from Algunenano/backup_1
Prepare the introduction of more keeper faults
2023-12-18 10:27:48 +01:00
zhanglistar
aaf6564711 if performance code format 2023-12-18 16:47:25 +08:00
zhanglistar
ba34b80087 If improvement add comment and performance test. 2023-12-18 16:43:45 +08:00
Alexey Milovidov
69e6e59e96 Add a test for #49708 2023-12-18 08:34:53 +01:00
Bharat Nallan Chakravarthy
42dd7b47aa Merge with 'upstream/master' 2023-12-17 23:09:14 -08:00
Alexey Milovidov
afd506984d
Merge pull request #57879 from rschu1ze/fix-arrayfold
Resurrect `arrayFold()`
2023-12-18 07:57:40 +01:00
Duc Canh Le
b07cde5ebb use const reference instead for pointer to values
Co-authored-by: Robert Schulze <robert@clickhouse.com>
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
2023-12-18 05:35:38 +00:00
Alexey Milovidov
b07ee86cec
Merge branch 'master' into allow-to-dynamically-change-fs-cache-size 2023-12-18 05:50:31 +01:00
Pengyuan Bian
02311d1619 update. 2023-12-18 04:23:26 +00:00
Pengyuan Bian
32816d7e7e Add a setting to specify s3 disk is read only. 2023-12-18 04:07:54 +00:00
Alexey Milovidov
33cf8842bc
Merge branch 'master' into fix-arrayfold 2023-12-18 04:57:07 +01:00
Alexey Milovidov
52d7777b05 Merge branch 'remove-cpp-templates-3' of github.com:ClickHouse/ClickHouse into remove-cpp-templates-3 2023-12-18 04:53:06 +01:00
Alexey Milovidov
c05b0cf37f Merge branch 'master' into remove-cpp-templates-3 2023-12-18 04:52:50 +01:00
Alexey Milovidov
b0eb670776
Merge pull request #57974 from ClickHouse/revert-stack-trace-changes
Revert "Merge pull request #57907 from azat/system.stack_trace-rt_tgsigqueueinfo"
2023-12-18 04:50:12 +01:00
Alexey Milovidov
58396c5546
Merge pull request #57218 from tntnatbry/issue-43666
Issue 43666: Add skip_unavailable_shards as a setting for Distributed table.
2023-12-18 04:48:57 +01:00
Alexey Milovidov
2859ac08c9 Revert "Merge pull request #57907 from azat/system.stack_trace-rt_tgsigqueueinfo"
This reverts commit a33d6b0c96, reversing
changes made to cf031a1b8e.
2023-12-18 02:01:14 +01:00
Alexey Milovidov
168da20d51
Update executeQuery.cpp 2023-12-17 22:54:45 +03:00
Alexey Milovidov
dbd509417e
Merge pull request #57970 from ClickHouse/nickitat-patch-17
Always use `pread` for reading cache segments
2023-12-17 20:53:05 +01:00
Alexey Milovidov
ae003bcc43
Merge pull request #57414 from Algunenano/i48496
Add tests for #48496
2023-12-17 20:51:25 +01:00
Nikita Taranov
9c2ef4eae5
Add profile event for cache lookup in ThreadPoolRemoteFSReader (#57437) 2023-12-17 19:03:49 +01:00
Robert Schulze
af8b18707b
Fix style 2023-12-17 17:37:46 +00:00
Nikita Taranov
587f829eb8
Always use pread for reading cache segments 2023-12-17 18:37:07 +01:00
Robert Schulze
19c8ac567f
Implement punycodeEncode()/Decode() 2023-12-17 17:04:28 +00:00
Robert Schulze
69007b5f71
Fix another bug 2023-12-17 11:16:05 +00:00
Robert Schulze
41da561e3a
Fix crash 2023-12-17 10:16:25 +00:00
Robert Schulze
7f675ddf80
Merge pull request #57878 from Jpnock/master
Apply full-text skipping index when using `hasAny()`
2023-12-17 11:06:29 +01:00
Robert Schulze
fc67d2c0e9
Merge pull request #57867 from skyoct/read_code
Support trivial count optimization for `Merge`-engine tables
2023-12-17 10:45:21 +01:00
Robert Schulze
9033c96e29
Some fixups 2023-12-17 09:11:16 +00:00
Shani Elharrar
c696c0bfe7 S3Common.AuthSettings: Allow passing SESSION_TOKEN to AWSCredentials
This sets the infrastructure of loading session_token and passing it directly
to all AWSCredentials instances that are created using the AuthSettings.

The default SESSION_TOKEN is set to an empty string as documented in AWS SDK
reference: https://sdk.amazonaws.com/cpp/api/0.12.9/d4/d27/class_aws_1_1_auth_1_1_a_w_s_credentials.html
2023-12-17 10:29:15 +02:00
ubuntu
0e8b26d84f fix test 2023-12-17 11:21:46 +08:00
ubuntu
a5e4495ee5 Merge branch 'master' into order_by_all 2023-12-17 10:07:35 +08:00
Alexey Milovidov
6ada95ea00 Remove C++ templates (normalizeQuery) 2023-12-17 02:44:30 +01:00
serxa
ce51ef0e99 remove wrong test 2023-12-16 17:35:36 +00:00
Sergei Trifonov
3634b949a8
Merge pull request #57793 from ClickHouse/rename-system-table
Rename `system.async_loader` into `system.asynchronous_loader`
2023-12-16 17:33:04 +01:00
Nikolay Degterinsky
5a3f0e7a5b Forbid CREATE AS SELECT for Replicated storages only 2023-12-16 14:25:27 +00:00
Sergei Trifonov
37a01bc109
Merge branch 'master' into ft-dropped_tables_parts 2023-12-16 11:53:37 +01:00
zhongyuankai
5ccc5b4fd8 batter 2023-12-16 18:49:25 +08:00
zhongyuankai
01f5b20517 Support ORDER BY ALL 2023-12-16 18:48:23 +08:00
Kseniia Sumarokova
4279dd2bf1
Merge pull request #57687 from ClickHouse/make-system-filesystem-cache-query-no-memory-intensive
Make querying system.filesystem_cache not memory intensive
2023-12-16 11:28:28 +01:00
Bharat Nallan Chakravarthy
0a1a66fd18 remove cruft from TablesLoader 2023-12-15 22:54:47 -08:00
Alexey Milovidov
2d58dc512c
Merge pull request #57932 from ClickHouse/remove-shit-cleanup
Remove a feature
2023-12-16 06:04:59 +01:00
Anton Popov
5faf5e913e slightly faster and perf test 2023-12-16 03:35:59 +00:00
jsc0218
41873dc4a3
Merge pull request #57873 from ClickHouse/vdimir/hash_join_structure_equals_fix
Fix assertion in HashJoin
2023-12-15 21:35:08 -05:00
Alexey Milovidov
a18a61b34c Fix style 2023-12-15 23:36:50 +01:00
Alexey Milovidov
ee502ef6b9 Remove trash (OPTIMIZE CLEANUP) 2023-12-15 22:41:58 +01:00
Alexey Milovidov
d751561d44 Remove useless headers 2023-12-15 21:42:05 +01:00
Alexey Milovidov
a33d6b0c96
Merge pull request #57907 from azat/system.stack_trace-rt_tgsigqueueinfo
Fix system.stack_trace for threads with blocked SIGRTMIN
2023-12-15 20:28:05 +01:00
Raúl Marín
6cf8c9b607 Review improvements 2023-12-15 19:44:13 +01:00