Commit Graph

83028 Commits

Author SHA1 Message Date
Sergei Trifonov
c7cf14e743 fix style and darwin build 2022-03-23 19:15:01 +01:00
Sergei Trifonov
0f66743104 support determine available memory for FreeBSD 2022-02-15 13:59:00 +03:00
serxa
7ea3c003d5 fix style 2022-02-15 10:39:45 +00:00
Sergei Trifonov
a819cb7afe avoid unhandled exceptions on sanity checks at server startup 2022-02-15 12:56:21 +03:00
Sergei Trifonov
3d66acc56b
Apply suggestions from code review
Co-authored-by: alesapin <alesapin@clickhouse.com>
2022-02-14 17:16:05 +03:00
Sergei Trifonov
2b0b03276b add simple sanity checks for server startup 2022-02-13 19:58:38 +03:00
Azat Khuzhin
4965586e7e
More gdb introspection on CI (#34517)
* test/fuzzer: preserve core

This may help to capture things like in [1]:

    Failed assertion: "bin->low_bits_full > bin->low_bits_empty" Received signal 6 Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33057/19216f4c0ae0f72108c147f958a708b521ad27dc/fuzzer_astfuzzerdebug,actions//report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: do not run 'info locals' since 'backtrace full' includes it

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test: try capture backtrace from all threads

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* test/stress: fix path for core artifacts

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #33389

* test/fuzzer: store core file in artifacts

v2: fix report, because of undefined variable CORE_LINK
v3: fix case when there is no core file

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-13 15:02:15 +03:00
alexey-milovidov
1774836d4f
Merge pull request #34555 from kitaisreal/table-functions-insert-partition-by-refactoring
TableFunctionFile added performance test
2022-02-13 09:08:51 +03:00
Saad Ur Rahman
03f81c8685
[CH-34239] HTTP User-Agent header (#34330)
* [IO] HTTP User-Agent header

Added HTTP User-Agent Header to HTTP requests.

User-Agent: ClickHouse/VERSION_STRING
Input header vectors could potentially contain User-Agent. If so, do not set another.

* [Tests] HTTP User Agent

Added stateless functional test 02205_HTTP_user_agent.

Co-authored-by: Filatenkov Artur <58165623+FArthur-cmd@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-02-13 00:40:11 +03:00
alexey-milovidov
4a2c69c073
Merge pull request #34067 from Algunenano/mv_fixes
Fix  `parallel_view_processing=0` and `view_duration_ms` in views log
2022-02-12 22:36:41 +03:00
Maksim Kita
e2c8ba9ab2 Added performance test 2022-02-12 16:05:35 +00:00
Maksim Kita
3832c2109e
Merge pull request #34491 from cnmade/PR202202101717
Translate zh/engines/database-engines/materialized-mysql: translate t…
2022-02-12 17:03:31 +01:00
Maksim Kita
43eed317f9
Merge pull request #34547 from ClickHouse/remove-old-cruft
Remove very old cruft
2022-02-12 16:48:30 +01:00
Maksim Kita
8be2a8ec34
Merge pull request #34554 from azat/no-minizip-build-fix
Fix gtest_archive_reader_and_writer in case of !USE_MINIZIP
2022-02-12 16:43:52 +01:00
Azat Khuzhin
cc55c8b982 Fix gtest_archive_reader_and_writer in case of !USE_MINIZIP
Empty arrays/vectors are not supported by ValuesIn:

    /src/ch/clickhouse/src/IO/tests/gtest_archive_reader_and_writer.cpp:341:59: error: no matching function for call to 'ValuesIn'
    INSTANTIATE_TEST_SUITE_P(All, ArchiveReaderAndWriterTest, ::testing::ValuesIn(supported_archive_file_exts));
                                                              ^~~~~~~~~~~~~~~~~~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:459:43: note: expanded from macro 'INSTANTIATE_TEST_SUITE_P'
        return GTEST_EXPAND_(GTEST_GET_FIRST_(__VA_ARGS__, DUMMY_PARAM_));        \
                                              ^~~~~~~~~~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:453:38: note: expanded from macro 'GTEST_GET_FIRST_'
    #define GTEST_GET_FIRST_(first, ...) first
                                         ^~~~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:452:28: note: expanded from macro 'GTEST_EXPAND_'
    #define GTEST_EXPAND_(arg) arg
                               ^~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:301:29: note: candidate template ignored: substitution failure [with T = std::vector<std::string>, N = 0]: zero-length arrays are not permitted in C++
    internal::ParamGenerator<T> ValuesIn(const T (&array)[N]) {
                                ^                         ~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:306:58: note: candidate template ignored: substitution failure [with Container = std::vector<std::string> [0]]: type 'std::vector<std::string> [0]' cannot be used prior to '::' because it has no members
    internal::ParamGenerator<typename Container::value_type> ValuesIn(
                                      ~~~~~~~~~              ^
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:294:1: note: candidate function template not viable: requires 2 arguments, but 1 was provided
    ValuesIn(ForwardIterator begin, ForwardIterator end) {
    ^
    /src/ch/clickhouse/src/IO/tests/gtest_archive_reader_and_writer.cpp:341:59: error: no matching function for call to 'ValuesIn'
    INSTANTIATE_TEST_SUITE_P(All, ArchiveReaderAndWriterTest, ::testing::ValuesIn(supported_archive_file_exts));
                                                              ^~~~~~~~~~~~~~~~~~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:468:32: note: expanded from macro 'INSTANTIATE_TEST_SUITE_P'
          auto t = std::make_tuple(__VA_ARGS__);                                  \
                                   ^~~~~~~~~~~
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:301:29: note: candidate template ignored: substitution failure [with T = std::vector<std::string>, N = 0]
    internal::ParamGenerator<T> ValuesIn(const T (&array)[N]) {
                                ^
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:306:58: note: candidate template ignored: substitution failure [with Container = std::vector<std::string> [0]]: type 'std::vector<std::string> [0]' cannot be used prior to '::' because it has no members
    internal::ParamGenerator<typename Container::value_type> ValuesIn(
                                      ~~~~~~~~~              ^
    /src/ch/clickhouse/contrib/googletest/googletest/include/gtest/gtest-param-test.h:294:1: note: candidate function template not viable: requires 2 arguments, but 1 was provided
    ValuesIn(ForwardIterator begin, ForwardIterator end) {
    ^
    2 errors generated.
    ninja: build stopped: subcommand failed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-02-12 15:01:20 +03:00
Alexey Milovidov
dd4243ff18 Remove very old cruft 2022-02-12 11:05:01 +03:00
Alexey Milovidov
0ed56f0255 We don't use Uncrustify 2022-02-12 11:03:14 +03:00
alexey-milovidov
747b6b2058
Merge pull request #34528 from CurtizJ/key-condition-float
Fix comparison between integers and floats in index analysis
2022-02-12 10:19:09 +03:00
alexey-milovidov
ea71dc9d11
Merge pull request #34510 from kitaisreal/table-functions-insert-partition-by-refactoring
Improve performance of insert into table functions URL, S3, File, HDFS
2022-02-12 10:14:00 +03:00
alexey-milovidov
9bb2eba281
Merge pull request #34429 from ClickHouse/filimonov-SystemAsynchronousInserts
asynchronous_inserts engine AsynchronousInserts -> SystemAsynchronousInserts
2022-02-12 10:08:04 +03:00
Maksim Kita
d680a017e0
Merge pull request #34539 from ClickHouse/fix-query-cancelation
Fix cancelation for S3 and HDFS
2022-02-12 00:36:03 +01:00
Maksim Kita
c2f6d803f7
Merge pull request #34542 from den-crane/patch-10
Doc. Fix defaults for input_format_parallel_parsing / output_format_parallel_formatting
2022-02-12 00:35:42 +01:00
Mikhail f. Shiryaev
f4e5e15ebb
Merge pull request #34492 from ClickHouse/docker-performance
Rebuild all docker images nightly
2022-02-12 00:28:30 +01:00
Denny Crane
a66b30f21a
Update settings.md 2022-02-11 16:52:12 -04:00
Denny Crane
7beff9048c
Update settings.md 2022-02-11 16:50:53 -04:00
Maksim Kita
dfd7c90a70
Merge pull request #34540 from den-crane/patch-7
Doc. Virtual Columns MergeTree engine (RU)
2022-02-11 21:06:28 +01:00
Denny Crane
14f3a11c01
Update mergetree.md 2022-02-11 14:38:11 -04:00
Dmitry Novik
50131fd732 Fix cancelation for S3 and HDFS 2022-02-11 18:14:55 +00:00
Mikhail f. Shiryaev
ac459dccd8
Force update kerberized hadoop 2022-02-11 18:26:49 +01:00
Mikhail f. Shiryaev
65e8605af1
Make testflows aarch64 compatible 2022-02-11 18:26:48 +01:00
Mikhail f. Shiryaev
0f21981694
Add a flag for images architecture 2022-02-11 18:26:45 +01:00
Mikhail f. Shiryaev
7ca684aa9c
Revert checks for architectures in Dockerfiles 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
bd3812a462
Add a comment 2022-02-11 18:26:44 +01:00
Mikhail f. Shiryaev
dc9a22df00
Add nightly docker images rebuild 2022-02-11 18:26:42 +01:00
Mikhail f. Shiryaev
dcecbbaf81
Add argument --all for docker imabes builder 2022-02-11 18:26:42 +01:00
Mikhail f. Shiryaev
c19d0a3494
Update performance-comparison, fix x86 hard-code 2022-02-11 18:26:41 +01:00
Nikolai Kochetov
b7972d5ae0
Merge pull request #34456 from ClickHouse/allow_experimental_projection_optimization-by-default
Allow allow_experimental_projection_optimization by default
2022-02-11 17:52:15 +01:00
Maksim Kita
8f714b3a94
Merge pull request #34320 from gauravphoenix/patch-1
Provide important performance hint max_rows_in_set
2022-02-11 17:48:55 +01:00
Vladimir C
a1214aa84a
Merge pull request #34533 from vdimir/clang-format-before-lambda-body
add BeforeLambdaBody to .clang-format
2022-02-11 17:30:53 +01:00
vdimir
bc905d969b
add BeforeLambdaBody to .clang-format 2022-02-11 16:51:45 +01:00
Maksim Kita
ea47b3082e
Update in.md 2022-02-11 16:38:01 +01:00
Maksim Kita
1b1200f13a
Update in.md 2022-02-11 16:36:45 +01:00
Anton Popov
6a8e35930f fix comparison with integers and floats in index analysis 2022-02-11 18:20:37 +03:00
tavplubix
6d1fae834a
Merge pull request #34187 from qoega/default-table-engine
Default table engine
2022-02-11 18:14:29 +03:00
Vladimir C
a2b1900333
Merge pull request #34496 from Avogar/jsonl
Support .jsonl extension for JSONEachRow format
2022-02-11 15:44:31 +01:00
mergify[bot]
202ee3e1c9
Merge branch 'master' into patch-1 2022-02-11 14:43:14 +00:00
Anton Popov
2fcd69baf7 fix comparison with integers and floats in index analysis 2022-02-11 17:15:27 +03:00
Maksim Kita
c347438612
Merge pull request #34484 from bigo-sg/keepercleanopt
keeper SnapshotableHashTable clean optimization
2022-02-11 12:19:24 +01:00
Maksim Kita
daab09cf35
Merge pull request #34498 from ClickHouse/fix-insert-select-profiling
Fix ProfileEvents sending in INSERT SELECT
2022-02-11 12:14:52 +01:00
avogar
f423c035d9 Fix test 2022-02-11 14:10:39 +03:00