Commit Graph

107240 Commits

Author SHA1 Message Date
Alexander Tokmakov
7e4789b1a7
Merge pull request #46110 from ClickHouse/CheSema-patch-1
allow_drop_detached requires an argument
2023-02-08 18:55:59 +03:00
Alexander Tokmakov
aeb3586eaa
Merge branch 'master' into CheSema-patch-1 2023-02-08 18:52:57 +03:00
Antonio Andelic
45d4ba59dc
Merge pull request #46068 from bigo-sg/alloc_map_metrics
Add new metric to record allocations times and bytes using mmap
2023-02-08 15:49:20 +01:00
Vladimir C
247d6c1edd
Merge pull request #44730 from bigo-sg/optimize_aggregate_function_withif 2023-02-08 15:26:47 +01:00
Maksim Kita
77ec255d7c
Merge pull request #45396 from kitaisreal/hashed-dictionary-sharded-nullable-fix
HashedDictionary sharded fix nullable values
2023-02-08 17:15:10 +03:00
Anton Popov
f0b0eacbad
Merge pull request #45992 from CurtizJ/fix-type-object-analyzer
Fix basic functionality with type `Object` and new analyzer
2023-02-08 14:25:17 +01:00
Anton Popov
62dfac1425
Merge pull request #46103 from bigo-sg/improve_pad_string
Fix doc and enable int types for pad
2023-02-08 14:24:04 +01:00
robot-clickhouse-ci-1
99274f1db1
Merge pull request #46143 from ClickHouse/evillique-patch-2
Interpret `cluster_name` identifier in `s3Cluster` function as literal
2023-02-08 14:06:16 +01:00
Alexander Gololobov
a7c30eecf4
Merge pull request #46141 from ClickHouse/fix-assertion-in-statistics
Fix assertion in statistical functions
2023-02-08 13:42:02 +01:00
Kruglov Pavel
8bdb1c3453
Merge pull request #44728 from bigo-sg/improve_count_if
Improve count if rewrite
2023-02-08 12:21:29 +01:00
Kseniia Sumarokova
6160db6569
Merge pull request #44949 from ClibMouse/HDFS_PowerPC
Changes to support the HDFS in Power PC.
2023-02-08 12:17:15 +01:00
Kseniia Sumarokova
f6ebe11350
Merge pull request #46108 from azat/azure-fix
Fix test_merge_tree_azure_blob_storage::test_zero_copy_replication test
2023-02-08 12:04:46 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075)
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
2023-02-08 12:04:11 +01:00
Kseniia Sumarokova
693006ba42
Merge pull request #46083 from kssenii/simplify-storage-s3-configuration
Simplify code around storages s3/hudi/delta-lake
2023-02-08 12:02:38 +01:00
Kruglov Pavel
0e5ceae896
Merge pull request #45296 from bigo-sg/improve_multi_if
Improve performance of function multiIf by columnar executing
2023-02-08 11:33:12 +01:00
Igor Nikonov
72c393e7c4
Merge pull request #46014 from ClickHouse/inorder-optimization-update-sorting-properties
Update sorting properties after reading in order applied
2023-02-08 10:19:47 +01:00
robot-ch-test-poll
3de699d335
Merge pull request #46127 from ClickHouse/evillique-patch-1
Update liburing CMakeLists.txt
2023-02-08 09:50:07 +01:00
Alexey Milovidov
8e407899ef
Merge pull request #46149 from ClickHouse/fix-flaky-test-11
Remove flaky test
2023-02-08 09:30:43 +03:00
Alexey Milovidov
8d4a98113c
Merge pull request #46120 from azat/copier-fixes
Fix fault injection in copier and test_cluster_copier flakiness
2023-02-08 08:59:17 +03:00
Alexey Milovidov
a69f9c05a9 Remove flaky test 2023-02-08 05:35:19 +01:00
Alexey Milovidov
defe4896cc
Merge branch 'master' into fix-assertion-in-statistics 2023-02-08 07:34:01 +03:00
taiyang-li
51f565a470 fix ast fuzzer error 2023-02-08 12:13:29 +08:00
Alexey Milovidov
69d3575ce5 Fix style, remove trash 2023-02-08 05:12:23 +01:00
taiyang-li
d802116f51 add ut tests 2023-02-08 10:57:16 +08:00
Alexey Milovidov
a2df6e950e Whitespace 2023-02-08 03:38:23 +01:00
Alexey Milovidov
2dc014254e Update tests 2023-02-08 03:37:46 +01:00
Alexey Milovidov
a67eac20fb
Merge pull request #46090 from azat/clickhouse-test-logs
Add also last messages from stdout/stderr/debuglog in clickhouse-test
2023-02-08 05:28:43 +03:00
Alexey Milovidov
66e9dd3c94
Update README.md 2023-02-08 04:53:47 +03:00
Alexey Milovidov
da22a770a0
Merge pull request #46107 from kssenii/rabbit-test-overloaded-insert-fix
Fix flaky rabbitmq test
2023-02-08 04:14:03 +03:00
Alexey Milovidov
924f19e94a
Update AzureBlobStorageAuth.cpp 2023-02-08 04:12:00 +03:00
Nikolay Degterinsky
4040b9c91b
Interpret cluster_name identifier in s3Cluster function as literal 2023-02-08 00:39:19 +01:00
Alexey Milovidov
41722a6163 Fix assertion in statistical functions 2023-02-08 00:15:32 +01:00
Alexey Milovidov
55c3bbb739 Fix assertion in statistical functions 2023-02-08 00:09:41 +01:00
Alexey Milovidov
b10bc50c6a
Merge pull request #46137 from ClickHouse/tylerhannan-patch-1
Adding FOSDEM
2023-02-08 01:31:21 +03:00
Alexey Milovidov
d6af40a4b4
Merge pull request #46135 from DanRoscigno/add-mermaid
Use mermaid chart in dev architecture doc
2023-02-08 01:30:50 +03:00
Kseniia Sumarokova
a5d3b00699
Merge pull request #46010 from kssenii/named-collections-fix-access
Fix named collections access
2023-02-07 23:20:22 +01:00
Tyler Hannan
a60a3726e8
Adding FOSDEM 2023-02-07 23:06:32 +01:00
DanRoscigno
fe5bc01951 merged Mermaid support today 2023-02-07 14:43:36 -05:00
Nikolay Degterinsky
e5b5fce970
Update liburing CmakeLists.txt 2023-02-07 18:11:43 +01:00
Kseniia Sumarokova
41dbdcff67
Merge branch 'master' into simplify-storage-s3-configuration 2023-02-07 18:09:34 +01:00
Nikolai Kochetov
3912f5a333
Merge pull request #45681 from CurtizJ/compact-parts-vertical-merge
Allow vertical merges from compact to wide parts
2023-02-07 17:09:17 +01:00
Azat Khuzhin
ff324fe81a Fix fault injection in copier (wrong query syntax)
There are very frequent flakiness of `test_cluster_copier` test, here is
an example of copier failures on CI [1]:

    AssertionError: Instance: s0_1_0 (172.16.29.9). Info: {'ID': '5d68dcb46fdb4b0c54b7c7ba1ddde83b8f34d483bbb32abcb0c52b966444ce82', 'Running': False, 'ExitCode': 85, 'ProcessConfig': {'tty': False, 'entrypoint': '/usr/bin/clickhouse', 'arguments': ['copier', '--config', '/etc/clickhouse-server/config-copier.xml', '--task-path', '/clickhouse-copier/task_simple_4DFWYTDD49', '--task-file', '/task0_description.xml', '--task-upload-force', 'true', '--base-dir', '/var/log/clickhouse-server/copier', '--copy-fault-probability', '0.2', '--experimental-use-sample-offset', '1'], 'privileged': False, 'user': '0'}, 'OpenStdin': False, 'OpenStderr': True, 'OpenStdout': True, 'CanRemove': False, 'ContainerID': 'f356df6694b3cc09ee9830c623681626f8e8d999677c188b9fe911aa702784ca', 'DetachKeys': '', 'Pid': 84332}
    assert 85 == 0

But let's look what the error it is, apparently it is UNFINISHED:

    SELECT
        name,
        code
    FROM system.errors
    WHERE ((code % 256) = 85) AND (NOT remote)
    SETTINGS system_events_show_zero_values = 1

    ┌─name─────────────────────────────┬─code─┐
    │ FORMAT_IS_NOT_SUITABLE_FOR_INPUT │   85 │
    │ UNFINISHED                       │  341 │
    │ NO_SUCH_ERROR_CODE               │  597 │
    └──────────────────────────────────┴──────┘

Let's verify:

    $ grep -r UNFINISHED ./test_cluster_copier/_instances_0/s0_1_0/logs/copier/clickhouse-copier_*
    ./test_cluster_copier/_instances_0/s0_1_0/logs/copier/clickhouse-copier_20230206220846_368/log.log:2023.02.06 22:09:19.015251 [ 368 ] {} <Error> : virtual int DB::ClusterCopierApp::main(const std::vector<std::string> &): Code: 341. DB::Exception: Too many tries to process table cluster1.default.hits. Abort remaining execution. (UNFINISHED), Stack trace (when copying this message, always include the lines below):

And apparently that it is due to query error with fault injection:

    2023.02.06 22:09:15.654724 [ 368 ] {} <Error> Application: An error occurred while processing partition 0: Code: 62. DB::Exception: Syntax error (Query): failed at position 168 ('Native'): Native. Expected one of: token, Dot, OR, AND, BETWEEN, NOT BETWEEN, LIKE, ILIKE, NOT LIKE, NOT ILIKE, IN, NOT IN, GLOBAL IN, GLOBAL NOT IN, MOD, DIV, IS NULL, IS NOT NULL, alias, AS, Comma, OFFSET, WITH TIES, BY, LIMIT, SETTINGS, UNION, EXCEPT, INTERSECT, INTO OUTFILE, FORMAT, end of query. (SYNTAX_ERROR), Stack trace (when copying this message, always include the lines below):

Example:

    select x from x limit  1FORMAT Native

    Syntax error: failed at position 32 ('Native'):

So fixing this should fix test_cluster_copier flakiness.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/46045/bd4170e03c6af583a51d12d2c39fa775dcb9997b/integration_tests__release__[4/4].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-07 17:01:06 +01:00
Azat Khuzhin
18d2a99761 Use comments for variables that clang can parse
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-07 16:53:45 +01:00
Zhiguo Zhou
b43ffb98e8
Vectorize filter generation of ColumnNullable in FilterDescription (#45962)
This commit achieved the data parallelism for filter generations of
the nullable columns by replacing the logical AND operator with the
bitwise one, which could be auto-vectorized by the compiler.
2023-02-07 16:33:01 +01:00
kssenii
40deaf1661 Fix clang-tidy 2023-02-07 16:30:04 +01:00
MeenaRenganathan22
2445a391fb Updating the libhdfs3 to reflect the revert of PR#21 2023-02-07 09:05:12 -05:00
Sema Checherinda
52d4e78b7f
Merge pull request #45907 from CheSema/forbid-wal-on-s3
do not run wal on remote disks
2023-02-07 14:48:00 +01:00
Yakov Olkhovskiy
4e7dffafe4
Merge pull request #46087 from ClickHouse/fix-ip-bloom
Allow bloom filter for IPv4 and IPv6
2023-02-07 08:29:28 -05:00
Yakov Olkhovskiy
909a772701
Merge pull request #45375 from ClibMouse/window_view_fix
Window view functional test failed on platform s390x
2023-02-07 08:23:50 -05:00
Sema Checherinda
750e7bfcb9
allow_drop_detached requires an argument 2023-02-07 13:46:00 +01:00