Commit Graph

71577 Commits

Author SHA1 Message Date
alexey-milovidov
c6a754289b
Merge pull request #28361 from DimasKovas/block_ouput_streams_compats
Add compat between SinkToStorage and BlockOutputStream
2021-08-31 01:41:33 +03:00
Alexey Milovidov
2198548ead Remove unused header 2021-08-31 00:16:19 +03:00
Maksim Kita
c9a0b1e28e Updated tests 2021-08-30 21:41:36 +03:00
Azat Khuzhin
2c0390f326 Fix removing of parts in a Temporary state (v2 followup)
CI reports [1]:

    <Fatal> : Logical error: 'Deleting data part all_0_0_0_3 doesn't exist'.
    ...
    <Fatal> BaseDaemon: 8. ./obj-x86_64-linux-gnu/../src/Storages/MergeTree/MergeTreeData.cpp:1254: DB::MergeTreeData::removePartsFinally() @ 0x1f94dffa in /usr/bin/clickhouse

  [1]: https://clickhouse-test-reports.s3.yandex.net/0/855a53ff8160c4638fe345b0d26e062804ba790a/stress_test_(debug).html#fail1

Follow-up for: #28221
2021-08-30 21:07:26 +03:00
Azat Khuzhin
0828548b88 Fix intersecting parts due to new part had been replaced with an empty part
AFAICS the problem is that some parts may be replaced with empty parts
(after #25820), and removed by the cleanup thread, due to it is empty
[1] (while it should not be deleted since it can download source part):

    <details>

    ```
    2021.08.18 20:11:22.687933 [ 341 ] {} <Trace> test_dpefxp.alter_table_1 (0758ca24-90e7-452c-8758-ca2490e7252c): Created log entry for mutation -1_115_115_0_146
    ...
    2021.08.18 20:11:22.707609 [ 22825 ] {} <Trace> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Executing log entry to mutate part -1_115_115_0 to -1_115_115_0_146
    2021.08.18 20:11:22.707643 [ 22825 ] {} <Debug> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Source part -1_115_115_0 for -1_115_115_0_146 is not ready; will try to fetch it instead
    ...
    2021.08.18 20:11:22.709397 [ 333 ] {} <Trace> test_dpefxp.alter_table_6 (ReplicatedMergeTreeQueue): Not executing log entry queue-0000001579 for part -1_115_115_0 because it is covered by part -1_115_115_0_146 that is currently executing.
    2021.08.18 20:11:22.718861 [ 22825 ] {} <Information> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): DB::Exception: No active replica has part -1_115_115_0_146 or covering part
    ...
    2021.08.18 20:11:27.936829 [ 295 ] {} <Information> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Going to replace lost part -1_115_115_0_146 with empty part
    2021.08.18 20:11:27.957839 [ 295 ] {} <Information> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Created empty part -1_115_115_0_146 instead of lost part
    ...
    2021.08.18 20:11:28.731635 [ 257 ] {} <Trace> test_dpefxp.alter_table_6 (ReplicatedMergeTreeCleanupThread): Cleared 190 old blocks from ZooKeeper
    ...
    2021.08.18 20:11:28.734507 [ 257 ] {} <Trace> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Will try to insert a log entry to DROP_RANGE for part: -1_115_115_0_146
    2021.08.18 20:11:28.779373 [ 22837 ] {} <Debug> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Removed 1 parts inside -1_115_115_0_146.
    ...
    2021.08.18 20:11:28.792600 [ 273 ] {} <Trace> test_dpefxp.alter_table_6 (766ae414-e113-4965-b66a-e414e1137965): Created log entry /clickhouse/tables/00993_system_parts_race_condition_drop_zookeeper_test_dpefxp/alter_table/log/log-0000003459 for merge -1_111_118_1
    ...
    2021.08.18 20:11:28.910988 [ 354 ] {} <Error> test_dpefxp.alter_table_7 (ReplicatedMergeTreeQueue): Code: 49. DB::Exception: Part -1_111_118_1 intersects next part -1_115_115_0_146. It is a bug. (LOGICAL_ERROR), Stack trace (when copying this message, always include the lines below):
    2021.08.18 20:11:31.282160 [ 305 ] {} <Error> test_dpefxp.alter_table_2 (ReplicatedMergeTreeQueue): Code: 49. DB::Exception: Part -1_111_118_1 intersects next part -1_115_115_0_146. It is a bug. (LOGICAL_ERROR), Stack trace (when copying this message, always include the lines below):
    ```

    </details>

  [1]: https://clickhouse-test-reports.s3.yandex.net/27752/59e3cb18f4e53c453951267b5599afeb664290d8/functional_stateless_tests_(release,_wide_parts_enabled).html
2021-08-30 21:05:46 +03:00
Raúl Marín
d3d8d4eae6 PVS Studio 2021-08-30 19:37:54 +02:00
Raúl Marín
92799f6cff Make gcc happy 2021-08-30 19:09:04 +02:00
alexey-milovidov
ea84b939c2
Merge pull request #28333 from DimasKovas/try_to_fix_arcadia_2_30_08_2021
Try to fix arcadia build
2021-08-30 18:53:14 +03:00
Dmitrii Kovalkov
54eeeb7cf2 Add compat between SinkToStorage and BlockOutputStream 2021-08-30 16:58:40 +03:00
vdimir
943b71e4ff
Fix non joined rows from nullable column 2021-08-30 16:33:01 +03:00
vdimir
bb1d22aa19
Log join input and output structure 2021-08-30 16:33:01 +03:00
Kseniia Sumarokova
00bea71610
Merge pull request #25251 from kssenii/disk-over-web-server
ClickHouse over web server with static files
2021-08-30 16:18:59 +03:00
Yatsishin Ilya
da4e688293 Improve kafka topic creation and deletion. Improve mongodb tests 2021-08-30 15:58:21 +03:00
Nikolai Kochetov
ab45c412d0 Another try to fix BackgroundPoolTask decrement. 2021-08-30 15:45:32 +03:00
Raúl Marín
11d242cf7d If: Check if work is necessary and combine flags 2021-08-30 14:28:09 +02:00
Onehr7
87b026aa43
Update in.md 2021-08-30 20:08:33 +08:00
Raúl Marín
7fb57482c0 Fix bug in countBytesInFilterWithNull 2021-08-30 13:35:22 +02:00
Raúl Marín
d0f8e2d063 Remove memcpy and use the heap 2021-08-30 13:31:51 +02:00
vdimir
887ac96a19
Whitespace in 0_stateless/01015_empty_in_inner_right_join.sql.j2 2021-08-30 14:27:01 +03:00
vdimir
bc785bff25
Fix sed argument in test/fuzzer/run-fuzzer.sh 2021-08-30 14:25:08 +03:00
Nikita Mikhaylov
fb66ab75be
Merge pull request #25633 from Avogar/json-as-string
Allow data in square brackets in JSONAsString format
2021-08-30 14:06:28 +03:00
tavplubix
b47f34aa17
Merge pull request #28313 from amosbird/fastload
Fast data parts loading by delaying table startup process
2021-08-30 13:53:55 +03:00
tavplubix
855a53ff81
Merge pull request #28195 from ClickHouse/maybe_fix_livelock_in_zookeeper_client
Maybe fix livelock in ZooKeeper client
2021-08-30 13:40:00 +03:00
Anton Ivashkin
2e33072469 Fix test_storage_s3/test_put_get_with_globs (cleanup after test) 2021-08-30 13:31:46 +03:00
Kruglov Pavel
95fd6197dc
Merge pull request #27729 from ContentSquare/sequenceMatchQuickCheck
Sequence match quick check
2021-08-30 13:04:23 +03:00
alesapin
531079c452
Merge pull request #28221 from azat/remove-Temporary-part-fix
Fix removing of parts in a Temporary state
2021-08-30 12:39:08 +03:00
Dmitrii Kovalkov
2c8e2c6995 Fix arcadia build 2021-08-30 12:19:13 +03:00
Raúl Marín
5ad8e93458 Speedup sumIf with Nullable types 2021-08-30 10:54:49 +02:00
Raúl Marín
a5c8af1e1b Speed up sumIf 2021-08-30 10:54:49 +02:00
alexey-milovidov
af709ab9a0
Merge pull request #28326 from DimasKovas/generate_ya_make_30_08_2021
Try to fix arcadia build (generate ya.make)
2021-08-30 11:28:02 +03:00
Kseniia Sumarokova
15bdcdfc76
Merge pull request #28319 from kssenii/rename
Rename system.views columns
2021-08-30 11:19:30 +03:00
Dmitrii Kovalkov
9871ad70ff Exclude fuzzers 2021-08-30 11:12:25 +03:00
Dmitrii Kovalkov
8acf0fa16a run generate-ya-make 2021-08-30 10:57:40 +03:00
kssenii
378f4854da Rename 2021-08-30 05:50:08 +00:00
kssenii
ff776fd38d Ping CI 2021-08-30 05:36:25 +00:00
Amos Bird
de9e591619
Fast load by delaying table startup 2021-08-30 10:15:32 +08:00
Alexey Milovidov
9027a663f7 Minor fix in perf test 2021-08-30 00:18:38 +03:00
Maksim Kita
243b845dc0
Merge pull request #28314 from olgarev/revolg-DOCSUP-13934-kill_query_for_mysql
DOCSUP-13934: Support MySQL KILL QUERY
2021-08-29 23:20:30 +03:00
Maksim Kita
d88de46312 StorageExecutable added support for create 2021-08-29 23:19:05 +03:00
Maksim Kita
1324ed5292
Merge pull request #27986 from sevirov/sevirov-DOCSUP-13590-document_the_getserverport_function
DOCSUP-13590: Document the getServerPort function
2021-08-29 22:55:08 +03:00
alexey-milovidov
77f26e8673
Merge pull request #28299 from amosbird/fixtmprowsource
Use real tmp file instead of predefined “rows_sources" for vertical merges
2021-08-29 21:49:59 +03:00
alexey-milovidov
264c2a8b7b
Merge pull request #28303 from azat/stress-logs
test/stress: fix patterns for filtering out Raft messages
2021-08-29 21:48:27 +03:00
Alexey Milovidov
e4f3d97b52 Merge branch 'master' of github.com:yandex/ClickHouse into async-reads 2021-08-29 21:42:14 +03:00
olgarev
60d85d36bd
Update docs/en/interfaces/mysql.md 2021-08-29 21:24:52 +03:00
olgarev
d78dd54e16 Initial 2021-08-29 18:17:41 +00:00
alexey-milovidov
3d3afbdb35
Merge pull request #28193 from amosbird/alterprimarykey2
Reserve protocol number for ALTER PRIMARY KEY.
2021-08-29 20:37:19 +03:00
Dmitriy
c9db269569 Merge remote-tracking branch 'remotes/clickhouse/master' into sevirov-DOCSUP-13590-document_the_getserverport_function 2021-08-29 19:00:29 +03:00
kssenii
a930823518 Fix build 2021-08-29 14:18:04 +00:00
Kseniia Sumarokova
7784f4ebb0
Merge pull request #28268 from infinivision/hdfs_namenode_ha
configable LIBHDFS3_CONF, refers to #8159
2021-08-29 12:25:42 +03:00
Kseniia Sumarokova
e5bcfba89e
Merge pull request #28082 from zhongyuankai/add-system-of-table_views
Add system of table views
2021-08-29 12:08:05 +03:00