Commit Graph

61550 Commits

Author SHA1 Message Date
Azat Khuzhin
27d4fbd13b Compare Block itself for distributed async INSERT batches
INSERT into Distributed with insert_distributed_sync=1 stores the
distributed batches on the disk for sending in background.

But types may be a little bit different for the Distributed and it's
underlying table, so the initiator need to know whether conversion is
required or not.

Before this patch those on disk distributed batches contains header,
which includes dumpStructure() for the block in that batch, however it
checks not only names and types and plus dumpStructure() is a debug
method.

So instead of storing string representation for the block header we
should store empty block in the file header (note, that we cannot store
the empty block not in header, since this will require reading all
blocks from file, due to some trickery of the readers interface).

Note, that this patch also contains tiny refactoring:
- s/header/distributed_header/

v1: dumpNamesAndTypes()
v2: dump empty block into the batch itself
v3: move empty block into the header
2021-04-06 10:05:21 +03:00
alexey-milovidov
cf2931384b
Update adopters.md 2021-04-06 02:07:36 +03:00
Anton Popov
8559958df4
try to fix perf test 2021-04-06 01:03:15 +03:00
Anton Popov
472662de80
skip test in arcadia 2021-04-06 00:45:28 +03:00
Anton Popov
c5354885a6
Merge pull request #22654 from azat/log-nested-fix
[RFC] Fix LOGICAL_ERROR for Log with nested types w/o columns in the SELECT clause
2021-04-06 00:34:58 +03:00
Kseniia Sumarokova
32cf4e378e
Merge pull request #22623 from olgarev/revolg-DOCSUP-8221-check_query_single_value_result
DOCSUP-8221: check_query_single_value_result setting
2021-04-06 00:22:37 +03:00
Anton Popov
dfb6890f27 fix flaky test 2021-04-06 00:04:13 +03:00
Alexey
e3610ac45d ru example fixed 2021-04-05 20:58:07 +00:00
Alexey
5aeda14f10 Active voice in the note. Article added. 2021-04-05 20:53:55 +00:00
Alexey
7fa672c519 Changed some words. Fixed typos 2021-04-05 20:34:10 +00:00
kssenii
68154fe10a Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into postgres-add-bool 2021-04-05 20:27:04 +00:00
alexey-milovidov
46bd8929a0
Merge pull request #22667 from ucasFL/build
fix build error 'always_inline' function might not be inlinable
2021-04-05 23:24:14 +03:00
Alexey
1024bff93f Russian translation. Format changed a bit in english. 2021-04-05 20:19:18 +00:00
Maksim Kita
de71553c9d
Merge pull request #22593 from zlobober/introduce_distributed_write
Introduce IStorage::distributedWrite method for distributed INSERT SELECTS
2021-04-05 22:59:57 +03:00
Alexey
0ac2277fac Example with url() added 2021-04-05 19:37:01 +00:00
kssenii
16d42f267e Bump CI 2021-04-05 18:34:11 +00:00
Anton Popov
1e7f3fd576
Update tests/queries/0_stateless/01670_log_comment.sql
Co-authored-by: Alexander Kuzmenkov <36882414+akuzm@users.noreply.github.com>
2021-04-05 20:17:26 +03:00
alesapin
be22ffa5a8 Fix mutation killers tests 2021-04-05 19:31:49 +03:00
kssenii
dc42d5189d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into replicas-shards-for-mysql-and-postgres 2021-04-05 15:36:35 +00:00
Anton Popov
700f4dabbd
Update 01670_log_comment.sql 2021-04-05 18:25:31 +03:00
Alexander Kuzmenkov
90a0b954e5 boop the CI 2021-04-05 18:22:51 +03:00
Alexander Kuzmenkov
8422774b35 boop the CI 2021-04-05 18:22:28 +03:00
Alexey Milovidov
0501c025db Remove OpenCL 2021-04-05 18:09:14 +03:00
alesapin
c830397317 Fix two stupid bugs in mutation wait 2021-04-05 18:08:43 +03:00
Anton Popov
1f1a01171f try fix one more test 2021-04-05 17:52:41 +03:00
kssenii
cc2fdc6c62 Add bool type 2021-04-05 14:49:52 +00:00
feng lv
ee6d1a6feb fix build 2021-04-05 14:37:04 +00:00
alexey-milovidov
6890d98114
Merge pull request #22633 from ClickHouse/clickhouse-test-better-zk-retries
Better retries on ZK errors in sh tests
2021-04-05 17:36:27 +03:00
alexey-milovidov
2f7ba1c7bb
Merge pull request #22665 from den-crane/patch-13
fix incorrect settitng name allow_experimental_window_functions
2021-04-05 17:17:50 +03:00
kssenii
b629f5c64d Add const 2021-04-05 14:15:10 +00:00
kssenii
89a2e94364 Fixes 2021-04-05 14:08:49 +00:00
feng lv
f6e4e13f89 fix conflict 2021-04-05 14:08:30 +00:00
Anton Popov
663b300ab2 remove test from parallel run 2021-04-05 17:02:42 +03:00
feng lv
56073db22d max distributed depth
Add settings max_distributed_depth

fix style

fix

fix

fix

fix test

fix

fix
2021-04-05 14:00:54 +00:00
Denny Crane
74eb0828b8
fix incorrect settitng name 2021-04-05 10:34:34 -03:00
kssenii
9dba529494 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into library-bridge 2021-04-05 13:14:51 +00:00
Alexander Kuzmenkov
bb48041fba once again 2021-04-05 13:53:58 +03:00
Vitaly Baranov
278ad443e4 Test 01294_create_settings_profile no longer changes settings of the default user. 2021-04-05 13:28:39 +03:00
Alexander Kuzmenkov
2d0de76375 fix 2021-04-05 13:03:29 +03:00
alesapin
156ba8a7fc Disable setting by default and ban for old-syntax MergeTree 2021-04-05 12:16:38 +03:00
Maksim Kita
d9cc03bc34 Fixed tests 2021-04-05 11:29:05 +03:00
alesapin
8d5a787f6b Merge branch 'master' into merge_tree_deduplication 2021-04-05 10:40:03 +03:00
mastertheknife
3c3da1f120 Skip compiling xz if we're using system xz (unbundled) 2021-04-05 09:16:08 +03:00
Azat Khuzhin
181cde0970 Fix impossible invalid-read for system.errors accounting
Simple reproducer is throw Exception(-1, "foo"), but there is no such
code, hence it is impossible.
2021-04-05 09:01:29 +03:00
alexey-milovidov
92f57fd669
Merge pull request #22634 from ClickHouse/client-improve-usability
Improve usability of clickhouse-client
2021-04-05 09:00:29 +03:00
Azat Khuzhin
42d858b7e5 Fix LOGICAL_ERROR for Log with nested types w/o columns in the SELECT clause
Found with fuzzer [1]:

<details>

    2021.04.04 10:25:46.762596 [ 135 ] {4b6b5de3-d242-4267-910a-76b235467356} <Fatal> : Logical error: 'Logical error: no information about file column%2Ename.size0 in StorageLog'.
    ...
    2021.04.04 10:25:46.763563 [ 44 ] {} <Trace> BaseDaemon: Received signal 6
    2021.04.04 10:25:46.765884 [ 165 ] {} <Fatal> BaseDaemon: 5. abort @ 0x25859 in /usr/lib/x86_64-linux-gnu/libc-2.31.so
    2021.04.04 10:25:46.901540 [ 165 ] {} <Fatal> BaseDaemon: 6. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:51: DB::handle_error_code() @ 0x11cc4f16 in /workspace/clickhouse
    2021.04.04 10:25:47.030755 [ 165 ] {} <Fatal> BaseDaemon: 7. ./obj-x86_64-linux-gnu/../src/Common/Exception.cpp:58: DB::Exception::Exception() @ 0x11cc5025 in /workspace/clickhouse
    2021.04.04 10:25:47.617201 [ 165 ] {} <Fatal> BaseDaemon: 8. ./obj-x86_64-linux-gnu/../src/Storages/StorageLog.cpp:183: DB::LogSource::readData()

</details>

  [1]: https://clickhouse-test-reports.s3.yandex.net/22583/69296876005c0fa171c755f8b224e4d58192c402/fuzzer_debug/report.html#fail1

The problem here is that there is no column%2Ename.size0 there is
column.size0 instead, and it seems that reading sizeX file is not enough
in other places, so just filter them out in
ExpressionActions::getSmallestColumn() (fallback method for storages w/o
getColumnSizes() implemented)
2021-04-05 08:48:04 +03:00
alexey-milovidov
74a3668ce4
Merge pull request #22645 from benbiti/docs-update-uniqhll
update docs uniqhll12 212 -> 2^12
2021-04-05 07:41:04 +03:00
alexey-milovidov
a16a09eb2f
Merge pull request #22596 from ClickHouse/fix-some-tests-aarch64
Fix some tests on AArch64
2021-04-05 07:40:33 +03:00
Azat Khuzhin
624b2632cc Add log_comment setting for DROP/CREATE DATABASE in clickhouse-test 2021-04-05 06:58:54 +03:00
benbiti
7ca70a5839 update docs uniqhll12 212 -> 2^12 2021-04-05 11:03:47 +08:00