Commit Graph

75508 Commits

Author SHA1 Message Date
Azat Khuzhin
2b96433daf Replace estimated_size with optional<size> for IDisk::readFile()
v2: rebase to fix conflicts in DiskEncrypted.cpp
2021-10-24 18:58:11 +03:00
Vitaly Baranov
c0b01e7b0b
Merge pull request #30494 from vitlibar/fix-reading-from-empty-file-on-encrypted-disk
Fix reading from empty file on encrypted disk
2021-10-24 16:24:47 +03:00
Nickita Taranov
877e8b579b fix style 2021-10-24 14:45:12 +03:00
gyuton
984d6517c2
Apply suggestions from code review
Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
2021-10-24 11:10:00 +03:00
Kseniia Sumarokova
7383bdd5fa
Merge pull request #25969 from ucasfl/filelog-engine
Implementation of a table engine to consume application log files in ClickHouse
2021-10-24 10:14:05 +03:00
Azat Khuzhin
0eef5ee778 Relax minimal clang version (set it to 12, was 13)
ClickHouse compiled fine under clang-12, and also note that not a lot of
distros already switched to clang-13, so it may requires additional
steps to compile ClickHouse otherwise.

Follow-up for: #30597
2021-10-24 09:40:41 +03:00
alexey-milovidov
7911e6dd47
Merge pull request #30596 from ClickHouse/fix-perf-test-4
Adjust perf test for simdjson
2021-10-24 07:58:15 +03:00
alexey-milovidov
f1e96ee9ac
Merge pull request #30594 from azat/fix-logical-error-on-connection-drain
Fix LOGICAL_ERROR on connection draining in case of ECONNRESET
2021-10-24 05:34:27 +03:00
alexey-milovidov
6f944f7fbc
Merge pull request #30589 from azat/artifacts-metadata
Add metadata for *_log into tests artifacts
2021-10-24 03:15:42 +03:00
alexey-milovidov
830b83218e
Merge pull request #30579 from azat/tsan-recursion
Fix tests that relies on checking stack size under TSan
2021-10-24 03:14:07 +03:00
alexey-milovidov
14e891f07e
Merge pull request #30597 from ClickHouse/update-min-compiler-versions
Update minimum allowed compiler versions
2021-10-24 03:13:31 +03:00
Maksim Kita
de70cfb98c
Merge pull request #30595 from ClickHouse/revert-18488
Revert "Allow AppleClang builds"
2021-10-24 02:06:23 +03:00
alexey-milovidov
8c2413f6fe
Merge pull request #30562 from ClickHouse/fix-header-after-limit-push-down
Fix LimitStep header after limit push down optimization.
2021-10-24 00:19:02 +03:00
Alexey Milovidov
6d49e59016 Update compiler versions 2021-10-24 00:12:50 +03:00
Alexey Milovidov
f9529c9d78 Adjust perf test 2021-10-24 00:11:28 +03:00
Alexey Milovidov
df5739b39b Revert "Allow AppleClang builds"
This reverts commit 1ddea6d7ee.
2021-10-23 22:59:12 +03:00
Azat Khuzhin
83d68246c3 Fix LOGICAL_ERROR on connection draining in case of ECONNRESET
In case of ECONNRESET (Connection reset by peer) the "cancelled" will
not be set, and so drain() will fail with LOGICAL_ERROR:

<details>

    2021.10.16 04:10:55.054771 [ 7635 ] {882164e0-ca26-4955-8759-708ba1f6e85c} <Error> PullingAsyncPipelineExecutor: Code: 210. DB::NetException: Connection reset by peer, while writing to socket (127.0.0.2:9000). (NETWORK_ERROR), Stack trace (when copying this message, always include the lines below):

    ...
    4. ./obj-x86_64-linux-gnu/../src/Common/NetException.h:12: DB::NetException::NetException(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int) @ 0x20db5749 in /usr/bin/clickhouse
    5. ./obj-x86_64-linux-gnu/../src/IO/WriteBufferFromPocoSocket.cpp:56: DB::WriteBufferFromPocoSocket::nextImpl() @ 0x211d56bb in /usr/bin/clickhouse
    6. ./obj-x86_64-linux-gnu/../src/IO/WriteBuffer.h:47: DB::WriteBuffer::next() @ 0x14e4c874 in /usr/bin/clickhouse
    7. ./obj-x86_64-linux-gnu/../src/Client/Connection.cpp:560: DB::Connection::sendCancel() @ 0x227c0c22 in /usr/bin/clickhouse
    8. ./obj-x86_64-linux-gnu/../src/Client/HedgedConnections.cpp:242: DB::HedgedConnections::sendCancel() @ 0x227f1b53 in /usr/bin/clickhouse
    ...
    2021.10.16 04:12:35.555530 [ 5575 ] {} <Fatal> : Logical error: 'Cannot drain connections: cancel first.'.

</details>

Found by stress tests on CI [1].

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/d3cb99701d4aaec384fd183168d10e0f650ecc1d/stress_test_(debug).html#fail1
2021-10-23 22:44:32 +03:00
alexey-milovidov
2ecfe7068a
Merge pull request #30577 from azat/doc-distributed_push_down_limit
Update documentation for distributed_push_down_limit
2021-10-23 22:30:52 +03:00
alexey-milovidov
187d8b2196
Update settings.md 2021-10-23 22:30:42 +03:00
Vitaly Baranov
26cb62de32 Add more tests for the "encrypted" disk type. 2021-10-23 20:58:37 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
Vladimir Goncharov
37ee06d362
Update json-functions.md 2021-10-23 19:10:40 +03:00
Kseniia Sumarokova
00d0665bf2
Merge pull request #30477 from kssenii/postgres-fix-query
More reliable fetch query in postgres database
2021-10-23 19:07:34 +03:00
Vladimir Goncharov
1b2186b8ad
Update json-functions.md 2021-10-23 19:04:29 +03:00
kssenii
e04e37916e Review fixes 2021-10-23 18:20:31 +03:00
Anton Popov
cdfa36a181
Merge pull request #30266 from CurtizJ/aggregation-in-order-4
Improve performance of aggregation in order of primary key
2021-10-23 18:09:17 +03:00
Anton Popov
0c80ebe787
Update read_in_order_many_parts.xml 2021-10-23 18:08:08 +03:00
kssenii
36d0f67b38 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remote-connection 2021-10-23 17:12:46 +03:00
kssenii
d1e7a0122e Fix test 2021-10-23 13:32:07 +00:00
Maksim Kita
4ccc619bd5 Added performance tests 2021-10-23 15:01:30 +03:00
Azat Khuzhin
b73092c169 Fix tests that relies on checking stack size under TSan
Under TSan using too much stack requires too much RSS for shadow memory,
and neither of this TSAN_OPTIONS helps:
- history_size=2
- flush_memory_ms=2000
- memory_limit_mb=50000

So instead, decrease allowed limit of the stack size in checkStackSize()
under TSan, to address exessive memory usage for the server compiled
with TSan.

Note, that before this patch 01763_max_distributed_depth test can
increase RSS of the server to 70GiB.
2021-10-23 14:09:19 +03:00
feng lv
235339d530 fix 2021-10-23 09:35:33 +00:00
Kseniia Sumarokova
05150f151c
Update ExpressionAnalyzer.cpp 2021-10-23 12:19:40 +03:00
kssenii
0e3dbabd5a Update test 2021-10-23 09:15:52 +00:00
Vladimir C
410624749e
Merge pull request #30492 from vdimir/fix-alter-scalar-deadlock 2021-10-23 12:01:00 +03:00
Maksim Kita
84a29cfe9d
Merge pull request #30568 from kitaisreal/test-clickhouse-local-columns-description-fix-number
Test clickhouse local columns description fix number
2021-10-23 11:48:23 +03:00
Kseniia Sumarokova
f362d420b8
Update fetchPostgreSQLTableStructure.cpp 2021-10-23 11:38:18 +03:00
Azat Khuzhin
99ffa3b578 Update documentation for distributed_push_down_limit
After #26466 you cannot get inaccurate results anymore, since
distributed_push_down_limit changes query execution only if:
- `distributed_group_by_no_merge` > 0
- query **does not have `GROUP BY`/`DISTINCT`/`LIMIT BY`**, but it has `ORDER BY`/`LIMIT`.
- query **has `GROUP BY`/`DISTINCT`/`LIMIT BY`** with `ORDER BY`/`LIMIT` and:
  - `optimize_skip_unused_shards_limit` is enabled
  - `optimize_distributed_group_by_sharding_key` is enabled
2021-10-23 10:02:21 +03:00
alexey-milovidov
cee4744ba1
Merge pull request #30572 from thomoco/master
Add hardware benchmark on MacBook Pro M1 2020 + update Adopters list
2021-10-23 09:04:55 +03:00
alexey-milovidov
44ac1b76d1
Update build-osx.md 2021-10-23 07:05:24 +03:00
alexey-milovidov
cddd1b31af
Update adopters.md 2021-10-23 05:23:22 +03:00
kssenii
1fa123ee5c Properly done 2021-10-23 01:33:17 +03:00
Thom O'Connor
2efd25cfe6 Updated adopters: added 3 new adopters, plus sorted some entries for alphabetical order 2021-10-22 15:24:22 -06:00
Maksim Kita
613a2fc46c
Merge pull request #30409 from sevirov/sevirov-DOCSUP-16821-edit_and_translate_to_russian_hashedarray_dictionary
DOCSUP-16821: Edit and translate to Russian (HashedArray dictionary)
2021-10-23 00:15:35 +03:00
Maksim Kita
b9171157d3
Merge pull request #30567 from kitaisreal/ngrams-fix-tests
Function ngrams fixed tests
2021-10-23 00:05:52 +03:00
Anton Popov
74cf57b4b0 fix for empty chunks 2021-10-22 21:48:03 +03:00
gyuton
a2fb22a92e Little fix 2021-10-22 21:31:10 +03:00
Thom O'Connor
dc4b838b72 Add hardware benchmark on Macbook Pro M1 2020 2021-10-22 12:28:51 -06:00
gyuton
c46ff762c9 Translated functions 2021-10-22 21:14:01 +03:00
gyuton
c694ea97d5 Deleted extra line 2021-10-22 21:05:56 +03:00