thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-02 20:42:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
142,184 Commits 9,183 Branches 1,782 Tags 2.2 GiB
86c77b998d
Commit Graph

142184 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mikhail f. Shiryaev
dab1e5002e
Upgrade the runner version to the latest 2024-05-13 14:21:14 +02:00
Mikhail f. Shiryaev
599c512e0b
Patch runner helpers and check the exit code for attempts 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
cbf02f69d5
Add a fallback for autoupdate if GH actions runner fails to start 2024-05-13 14:21:13 +02:00
Mikhail f. Shiryaev
ee49e237da
Clean github runner's temporary _work derectory between runs 2024-05-13 14:21:12 +02:00
Mikhail f. Shiryaev
b74ce036fa
Make init-network.sh sourceable, tune runner's tailscale hostname 2024-05-13 14:21:11 +02:00
Maksim Kita
fefd071ec7 Fixed tests 2024-05-13 15:20:02 +03:00
divanik
faef8807d2 Resolve conflicts 2024-05-13 12:04:06 +00:00
divanik
d468a0a577 Add archives reading support to s3 2024-05-13 12:00:15 +00:00
Azat Khuzhin
599fce53e3 Fix compiling FunctionsConversion.cpp (by properly passing -g0) 
CI reports [1]:

    May 11 20:27:25 FAILED: src/CMakeFiles/dbms.dir/Functions/FunctionsConversion.cpp.o
    May 11 20:27:25 prlimit --as=10000000000 --data=5000000000 --cpu=1800 /usr/bin/sccache /usr/bin/clang++-17 --target=riscv64-linux-gnu --sysroot=/build/cmake/linux/../../contrib/sysroot/linux-riscv64 -DANNOYLIB_MULTITHREADED_BUILD -DBOOST_ASIO_HAS_STD_INVOKE_RESULT=1 -DBOOST_ASIO_STANDALONE=1 -DBOOST_TIMER_ENABLE_DEPRECATED=1 -DCONFIGDIR=\"\" -DDUMMY_BACKTRACE -DENABLE_ANNOY -DENABLE_MULTITARGET_CODE=1 -DENABLE_USEARCH -DHAVE_BZLIB_H=1 -DHAVE_CONFIG_H -DHAVE_FUTIMESAT=1 -DHAVE_ICONV=1 -DHAVE_LIBLZMA=1 -DHAVE_LIBZSTD=1 -DHAVE_LIBZSTD_COMPRESSOR=1 -DHAVE_LINUX_FS_H=1 -DHAVE_LINUX_TYPES_H=1 -DHAVE_LZMA_H=1 -DHAVE_STRUCT_STAT_ST_MTIM_TV_NSEC=1 -DHAVE_SYS_STATFS_H=1 -DHAVE_ZLIB_H=1 -DHAVE_ZSTD_H=1 -DINCBIN_SILENCE_BITCODE_WARNING -DLIBSASL_EXPORTS=1 -DLZ4_DISABLE_DEPRECATE_WARNINGS=1 -DLZ4_FAST_DEC_LOOP=1 -DMAJOR_IN_SYSMACROS=1 -DOBSOLETE_CRAM_ATTR=1 -DOBSOLETE_DIGEST_ATTR=1 -DPLUGINDIR=\"\" -DPOCO_ENABLE_CPP11 -DPOCO_HAVE_FD_EPOLL -DPOCO_OS_FAMILY_UNIX -DSASLAUTHD_CONF_FILE_DEFAULT=\"\" -DSNAPPY_CODEC_AVAILABLE -DSTD_EXCEPTION_HAS_STACK_TRACE=1 -DUSE_CLICKHOUSE_THREADS=1 -DWITH_COVERAGE=0 -DWITH_GZFILEOP -DZLIB_COMPAT -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -I/build/build_docker/includes/configs -I/build/src -I/build/build_docker/src -I/build/build_docker/src/Core/include -I/build/base/base/.. -I/build/build_docker/base/base/.. -I/build/contrib/cctz/include -I/build/contrib/re2 -I/build/base/pcg-random/. -I/build/contrib/libfiu/libfiu -I/build/contrib/libssh/include -I/build/build_docker/contrib/libssh/include -I/build/contrib/miniselect/include -I/build/contrib/zstd/lib -I/build/contrib/pocketfft -I/build/contrib/libarchive-cmake -I/build/contrib/libarchive/libarchive -I/build/build_docker/contrib/cyrus-sasl-cmake -I/build/contrib/lz4/lib -isystem /build/contrib/llvm-project/libcxx/include -isystem /build/contrib/llvm-project/libcxxabi/include -isystem /build/contrib/libunwind/include -isystem /build/contrib/libdivide-cmake/. -isystem /build/contrib/libdivide -isystem /build/contrib/jemalloc-cmake/include -isystem /build/contrib/llvm-project/llvm/include -isystem /build/build_docker/contrib/llvm-project/llvm/include -isystem /build/contrib/abseil-cpp -isystem /build/contrib/croaring/cpp -isystem /build/contrib/croaring/include -isystem /build/contrib/sparsehash-c11 -isystem /build/contrib/incbin -isystem /build/contrib/cityhash102/include -isystem /build/contrib/boost -isystem /build/base/poco/Net/include -isystem /build/base/poco/Foundation/include -isystem /build/base/poco/NetSSL_OpenSSL/include -isystem /build/base/poco/Crypto/include -isystem /build/contrib/openssl-cmake/linux_riscv64/include -isystem /build/contrib/openssl/include -isystem /build/base/poco/Util/include -isystem /build/base/poco/JSON/include -isystem /build/base/poco/XML/include -isystem /build/contrib/replxx/include -isystem /build/contrib/fmtlib-cmake/../fmtlib/include -isystem /build/contrib/magic_enum/include -isystem /build/contrib/double-conversion -isystem /build/contrib/dragonbox/include -isystem /build/contrib/zlib-ng -isystem /build/build_docker/contrib/zlib-ng-cmake -isystem /build/contrib/pdqsort -isystem /build/contrib/xz/src/liblzma/api -isystem /build/contrib/aws/src/aws-cpp-sdk-core/include -isystem /build/build_docker/contrib/aws-cmake/include -isystem /build/contrib/aws/generated/src/aws-cpp-sdk-s3/include -isystem /build/contrib/aws-c-auth/include -isystem /build/contrib/aws-c-common/include -isystem /build/contrib/aws-c-io/include -isystem /build/contrib/aws-crt-cpp/include -isystem /build/contrib/aws-c-mqtt/include -isystem /build/contrib/aws-c-sdkutils/include -isystem /build/contrib/azure/sdk/core/azure-core/inc -isystem /build/contrib/azure/sdk/identity/azure-identity/inc -isystem /build/contrib/azure/sdk/storage/azure-storage-common/inc -isystem /build/contrib/azure/sdk/storage/azure-storage-blobs/inc -isystem /build/contrib/snappy -isystem /build/build_docker/contrib/snappy-cmake -isystem /build/contrib/libbcrypt -isystem /build/contrib/msgpack-c/include -isystem /build/build_docker/contrib/liburing/src/include-compat -isystem /build/build_docker/contrib/liburing/src/include -isystem /build/contrib/liburing/src/include -isystem /build/contrib/fast_float/include -isystem /build/contrib/librdkafka-cmake/include -isystem /build/contrib/librdkafka/src -isystem /build/build_docker/contrib/librdkafka-cmake/auxdir -isystem /build/contrib/cppkafka/include -isystem /build/contrib/nats-io/src -isystem /build/contrib/nats-io/src/adapters -isystem /build/contrib/nats-io/src/include -isystem /build/contrib/nats-io/src/unix -isystem /build/contrib/libuv/include -isystem /build/contrib/krb5/src/include -isystem /build/build_docker/contrib/krb5-cmake/include -isystem /build/contrib/NuRaft/include -isystem /build/base/poco/MongoDB/include -isystem /build/base/poco/Redis/include -isystem /build/contrib/icu/icu4c/source/i18n -isystem /build/contrib/icu/icu4c/source/common -isystem /build/contrib/capnproto/c++/src -isystem /build/contrib/avro/lang/c++/api -isystem /build/contrib/google-protobuf/src -isystem /build/contrib/s2geometry/src -isystem /build/contrib/s2geometry-cmake -isystem /build/contrib/AMQP-CPP/include -isystem /build/contrib/AMQP-CPP -isystem /build/contrib/sqlite-amalgamation -isystem /build/contrib/rocksdb/include -isystem /build/contrib/libpqxx/include -isystem /build/contrib/libpq -isystem /build/contrib/libpq/include -isystem /build/contrib/libstemmer_c/include -isystem /build/contrib/wordnet-blast -isystem /build/contrib/lemmagen-c/include -isystem /build/contrib/ulid-c/include -isystem /build/contrib/simdjson/include -isystem /build/contrib/rapidjson/include -isystem /build/contrib/consistent-hashing -isystem /build/contrib/annoy/src -isystem /build/contrib/FP16/include -isystem /build/contrib/robin-map/include -isystem /build/contrib/SimSIMD-map/include -isystem /build/contrib/usearch/include --gcc-toolchain=/build/cmake/linux/../../contrib/sysroot/linux-riscv64 -fdiagnostics-color=always -Xclang -fuse-ctor-homing -Wno-enum-constexpr-conversion -fsized-deallocation  -gdwarf-aranges -pipe -fasynchronous-unwind-tables -ffile-prefix-map=/build=. -ftime-trace -falign-functions=32 -ffp-contract=off  -fdiagnostics-absolute-paths -fstrict-vtable-pointers -Wall -Wextra -Wframe-larger-than=65536 -Weverything -Wpedantic -Wno-zero-length-array -Wno-c++98-compat-pedantic -Wno-c++98-compat -Wno-c++20-compat -Wno-sign-conversion -Wno-implicit-int-conversion -Wno-implicit-int-float-conversion -Wno-ctad-maybe-unsupported -Wno-disabled-macro-expansion -Wno-documentation-unknown-command -Wno-double-promotion -Wno-exit-time-destructors -Wno-float-equal -Wno-global-constructors -Wno-missing-prototypes -Wno-missing-variable-declarations -Wno-padded -Wno-switch-enum -Wno-undefined-func-template -Wno-unused-template -Wno-vla -Wno-weak-template-vtables -Wno-weak-vtables -Wno-thread-safety-negative -Wno-enum-constexpr-conversion -Wno-unsafe-buffer-usage -Wno-switch-default -O2 -g -DNDEBUG -O3 -g  -fno-pie -std=c++23   -D OS_LINUX -Werror -Wno-deprecated-declarations -Wno-poison-system-directories -nostdinc++ -MD -MT src/CMakeFiles/dbms.dir/Functions/FunctionsConversion.cpp.o -MF src/CMakeFiles/dbms.dir/Functions/FunctionsConversion.cpp.o.d -o src/CMakeFiles/dbms.dir/Functions/FunctionsConversion.cpp.o -c /build/src/Functions/FunctionsConversion.cpp
    May 11 20:27:25 sccache: warning: The server looks like it shut down unexpectedly, compiling locally instead

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/63632/e795e0e028d45b654e099dee136a44e7ac5ed627/clickhouse_special_build_check/report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 13:53:44 +02:00
Mark Needham
13b2980761
Explain map insertion order 2024-05-13 11:59:47 +01:00
Yarik Briukhovetskyi
df9961f266
rename function 2024-05-13 12:46:21 +02:00
Maksim Kita
b8c719f866 Analyzer view read only necessary columns 2024-05-13 13:41:47 +03:00
Antonio Andelic
e65dd3d939 Cancel S3 reads properly when parallel reads are used 2024-05-13 12:36:29 +02:00
Vitaly Baranov
6c0450f8ff
Merge pull request #62685 from azat/yaml-cpp-merge-key 
Bump yaml-cpp for YAML Merge Key support
 2024-05-13 09:49:25 +00:00
vdimir
f0704624fc
fix test 2024-05-13 09:40:18 +00:00
Igor Nikonov
033155d8fa Parallel replicas: simple cleanup 2024-05-13 09:05:42 +00:00
Azat Khuzhin
a4e1ddc95a Link dbms to ZooKeeper examples 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
7261f924bb Exclude FunctionsConversion from the large objects check for now 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
5d7d9e9e34 Provide ThreadStatus::initGlobalProfiler() for standalone keeper build 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
44f77fe9f5 Link dbms for zookeeper examples 
Since it uses ZooKeeper, which has ThreadFromGlobalPool inside, which
requires THreadPool with enabled profiler, which requires
ThreadStatusExt.cpp, which included only into dbms, but not into
clickhouse_common_io (like ThreadStatus.cpp)

Error:

    FAILED: src/Common/ZooKeeper/examples/zkutil_test_commands_new_lib
    ld.lld-17: error: undefined symbol: DB::ThreadStatus::initGlobalProfiler(unsigned long, unsigned long)
    >>> referenced by ThreadPool.h:243 (./src/Common/ThreadPool.h:243)
    >>>               ZooKeeperImpl.cpp.o:(void std::__1::__function::__policy_invoker<void ()>::__call_impl<std::__1::__function::__default_alloc_func<ThreadFromGlobalPoolImpl<true, true>::ThreadFromGlobalPoolImpl<Coordination::ZooKeeper::ZooKeeper(std::__1::vector<Coordination::ZooKeeper::Node, std::__1::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::__1::shared_ptr<DB::ZooKeeperLog>)::$_0>(Coordination::ZooKeeper::ZooKeeper(std::__1::vector<Coordination::ZooKeeper::Node, std::__1::allocator<Coordination::ZooKeeper::Node>> const&, zkutil::ZooKeeperArgs const&, std::__1::shared_ptr<DB::ZooKeeperLog>)::$_0&&)::'lambda'(), void ()>>(std::__1::__function::__policy_storage const*)) in archive src/Common/ZooKeeper/libclickhouse_common_zookeeper_no_log.a

Another way of fixing it is to provide some define wich default value
for "is profiler enabled" for ThreadPool, should work, but will be
tricky.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
d743285417 Fix undefined symbol createFunctionBaseCast() during linking examples 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
4ad88d04b4 Move initGlobalProfiler() into ThreadStatusExt.cpp and fix examples 
To avoid undefined references in examples:

    May 11 01:58:40 ld.lld-17: error: undefined symbol: DB::Context::hasTraceCollector() const
    May 11 01:58:40 >>> referenced by ThreadStatus.cpp:132 (/build/src/Common/ThreadStatus.cpp:132)
    May 11 01:58:40 >>>               ThreadStatus.cpp.o:(DB::ThreadStatus::initGlobalProfiler(unsigned long, unsigned long)) in archive src/libclickhouse_common_iod.a
    May 11 01:58:40 clang++-17: error: linker command failed with exit code 1 (use -v to see invocation)

Move it firstly into ThreadStatusExt and then do not try to use it from
the ThreadPool.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
11f1d9a30e Remove extra includes of ThreadPool.h in tests 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
0b270a67cf Fix disabling global profilers for keeper standalone build 
CLICKHOUSE_KEEPER_STANDALONE_BUILD does not set while compiling
ThreadStatus.cpp, but it linked to the clickhouse-keeper standalone
build, and before this patch it simply leads to the linking error [1]:

    May 10 20:02:58 ld.lld-17: error: undefined symbol: DB::Context::hasTraceCollector() const
    May 10 20:02:58 >>> referenced by ThreadStatus.cpp:132 (./build_docker/./src/Common/ThreadStatus.cpp:132)
    May 10 20:02:58 >>>               lto.tmp:(DB::ThreadStatus::initGlobalProfiler(unsigned long, unsigned long))
    May 10 20:02:58 clang++-17: error: linker command failed with exit code 1 (use -v to see invocation)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/63632/643061bd9d7ef16641ea9537be868fc39d029726/clickhouse_build_check/report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:36 +02:00
Azat Khuzhin
90b8ae0f0b Ignore global profiler if system.trace_log is not enabled 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2024-05-13 11:05:35 +02:00
Alexey Milovidov
f27a0d6801
Merge pull request #60469 from ClickHouse/clang-18-ci 
Use clang-18 in CI
 2024-05-13 09:35:45 +02:00
Alexey Milovidov
4eb42bba8f Fix test 2024-05-13 07:16:26 +02:00
Alexey Milovidov
b3e6259a3c Fix test 2024-05-13 02:41:14 +02:00
Alexey Milovidov
2d138d3d7e
Merge pull request #63674 from nickitat/remove_monotonous_func_optimisation_leftovers 
Remove leftovers of `optimize_monotonous_functions_in_order_by`
 2024-05-12 22:29:52 +00:00
Alexey Milovidov
9c21066c9b Useless changes 2024-05-13 00:26:18 +02:00
Alexey Milovidov
034256b405 Fix test 2024-05-13 00:25:29 +02:00
Alexey Milovidov
c2caaf007c Merge branch 'master' into clang-18-ci 2024-05-13 00:24:06 +02:00
Alexey Milovidov
7cb10c19f9
Merge pull request #63672 from ClickHouse/fix-test-part_log_bytes_uncompressed 
Fix bad test `02950_part_log_bytes_uncompressed`
 2024-05-12 20:13:14 +00:00
Nikita Taranov
68d9e55302 impl 2024-05-12 20:38:43 +01:00
Alexey Milovidov
bf31d12dc8 Fix bad test 02950_part_log_bytes_uncompressed 2024-05-12 18:54:57 +02:00
Alexey Milovidov
bf0040f383 Debug a test 2024-05-12 18:48:05 +02:00
Alexey Milovidov
c44e42dd7a Useless changes 2024-05-12 18:22:41 +02:00
Alexey Milovidov
24bddeedf9 Useless changes 2024-05-12 18:22:09 +02:00
Alexey Milovidov
fdf092f6b9
Merge pull request #63663 from xogoodnow/master 
Update clickhouse-test help section
 2024-05-12 15:46:27 +00:00
p1rattttt
e1ff4efc1a
Merge branch 'ClickHouse:master' into external_cross_join 2024-05-12 14:43:10 +03:00
woodlzm
06409bf53d Fix styles for test.py. 2024-05-11 22:39:04 -07:00
Zimu Li
17ebbcab5e
Merge branch 'ClickHouse:master' into master 2024-05-11 22:26:26 -07:00
Alexey Milovidov
258eb72c8a Useless changes 2024-05-12 01:48:03 +02:00
Alexey Milovidov
23cf6d0d8b Useless changes 2024-05-11 22:51:57 +02:00
Ali
c86497831e
Merge pull request #1 from xogoodnow/xogoodnow-patch-1 
Update clickhouse-test
 2024-05-11 23:22:03 +03:30
Ali
65934b5651
Update clickhouse-test 
Fixed a typo
 2024-05-11 23:16:42 +03:30
KenL
0776037677
Merge branch 'ClickHouse:master' into master 2024-05-11 12:29:41 -07:00
woodlzm
7dca8c0f75 Fix styles for test.py. 2024-05-11 12:28:12 -07:00
Robert Schulze
3b49cccb7d
Merge pull request #63266 from Blargian/document_addXYZ 
[Docs] update `addXYZ` functions
 2024-05-11 19:21:10 +00:00
Robert Schulze
c9382252ae
Merge pull request #63520 from Blargian/document_isXYZ 
[Docs] add missing `isXYZ` functions
 2024-05-11 19:20:25 +00:00