Commit Graph

81443 Commits

Author SHA1 Message Date
alexey-milovidov
140d64f785
Merge pull request #33415 from kitaisreal/function-array-last
Added function arrayLast
2022-01-07 20:37:06 +03:00
Maksim Kita
6a89ca58e3
Merge pull request #33436 from usurai/master
Add MONTHNAME function
2022-01-07 20:36:53 +03:00
Azat Khuzhin
28e64020bd Fix query cancellation in case of allow_experimental_parallel_reading_from_replicas
CI found one hanged query [1], where the problem was that becase of
allow_experimental_parallel_reading_from_replicas the Cancel packet was
read by receivePartitionMergeTreeReadTaskResponseAssumeLocked() and so
the executor was not cancelled, while the code in
MergeTreeBaseSelectProcessor was not ready for this:

<details>

    {
        "is_initial_query": 0,
        "elapsed": 1727.714379573,
        "is_cancelled": 0,
        "read_rows": "196577",
        "read_bytes": "1179462",
        "written_rows": "0",
        "written_bytes": "0",
        "query": "SELECT `CounterID`, `EventDate` FROM `test`.`hits` ORDER BY `CounterID` DESC, `EventDate` ASC LIMIT 50",
        ...
     }

In logs:

    2021.12.31 12:11:55.384735 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> executeQuery: (from [::ffff:127.0.0.1]:58094, initial_query_id: e2966ca5-e836-44ef-8f8e-d1c1b32a>
    2021.12.31 12:11:55.454379 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Trace> ContextAccess (default): Access granted: SELECT(EventDate, CounterID) ON test.hits
    2021.12.31 12:11:55.457583 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Trace> datasets.hits_v1: Parallel reading from replicas enabled true
    2021.12.31 12:11:55.459739 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Trace> InterpreterSelectQuery: FetchColumns -> WithMergeableStateAfterAggregationAndLimit
    2021.12.31 12:11:55.471048 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> datasets.hits_v1 (SelectExecutor): Key condition: unknown
    2021.12.31 12:11:55.476514 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> datasets.hits_v1 (SelectExecutor): MinMax index condition: unknown
    2021.12.31 12:11:55.488302 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> datasets.hits_v1 (SelectExecutor): Selected 2/2 parts by partition key, 2 parts by primary key, >
    2021.12.31 12:11:55.494020 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> MergeTreeReverseSelectProcessor: Reading 1 ranges in reverse order from part 201403_20_20_0, app>
    2021.12.31 12:11:55.497644 [ 101532 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> MergeTreeReverseSelectProcessor: Reading 138 ranges in reverse order from part 201403_19_19_2, a>
    2021.12.31 12:11:55.536372 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Compact part, average mark size is 83886080
    2021.12.31 12:11:55.558783 [ 171701 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.563960 [ 171701 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.577512 [ 171701 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.585660 [ 171701 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.613694 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.730597 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.743554 [ 171701 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Debug> MergingSortedTransform: Merge sorted 3 blocks, 65567 rows in 0.243999671 sec., 268717.5754429603>
    2021.12.31 12:11:55.744196 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.890923 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069
    2021.12.31 12:11:55.891222 [ 170601 ] {7e5f551e-5960-4fda-9447-9bfdae4660c1} <Test> MergeTreeBaseSelectProcessor: Reading from Wide part, average mark size is 3069

</details>

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/33341/0685fd99855bacd0bce02507c00a3bd7709eea61/stress_test__address__actions_.html
2022-01-07 20:04:57 +03:00
Azat Khuzhin
e8c7e5e8f0 Fix typo in sendMergeTreeReadTaskRequestAssumeLocked() 2022-01-07 20:04:57 +03:00
Azat Khuzhin
c05dac89ee ReadFromRemote: Remove redundant ParallelReplicasReadingCoordinator 2022-01-07 20:04:57 +03:00
Ramazan Polat
dfe103cdbe
mention async insert 2022-01-07 19:48:01 +03:00
Maksim Kita
c6b2cd9d14
Merge pull request #33454 from kitaisreal/executable-udf-documentation-fix
Executable UserDefinedFunction documentation fix
2022-01-07 19:20:55 +03:00
Maksim Kita
af37eca3fb Executable UserDefinedFunction documentation fix 2022-01-07 19:19:18 +03:00
Maksim Kita
555c96d89f
Merge pull request #33442 from tekeri/patch-1
Fix typo: command_write_timeout
2022-01-07 19:17:51 +03:00
Maksim Kita
6db24e6cc6
Merge pull request #33452 from xiedeyantu/master
Update AsynchronousReadIndirectBufferFromRemoteFS.h
2022-01-07 19:16:10 +03:00
Maksim Kita
0cb4c71a53 Function arrayLast added documentation 2022-01-07 19:00:37 +03:00
Maksim Kita
fb179a45a1 Function arrayLast added tests 2022-01-07 19:00:27 +03:00
usurai
d4116d8de2 Fix case style 2022-01-07 23:47:21 +08:00
JackyWoo
679d18c5e1 reset last_latency when reset keeper stats 2022-01-07 22:17:03 +08:00
mergify[bot]
7486578465
Merge branch 'master' into master 2022-01-07 13:43:05 +00:00
Maksim Kita
6b9703446d Added function arrayLast 2022-01-07 16:37:21 +03:00
xiedeyantu
1edfc03825
Update AsynchronousReadIndirectBufferFromRemoteFS.h
update 1024 * 1024 to DBMS_DEFAULT_BUFFER_SIZE
2022-01-07 21:06:53 +08:00
cmsxbc
37349a9d0f
add function decodeURLFormComponent 2022-01-07 20:51:30 +08:00
DimaAmega
783b683cce better index.html 2022-01-07 14:59:07 +03:00
alexey-milovidov
d274c00ec7
Merge pull request #33445 from ClickHouse/untuple-exponential-growth
Fix exponential complexity in query analysis.
2022-01-07 14:23:42 +03:00
mergify[bot]
6fcd5a7d41
Merge branch 'master' into MDB-15474 2022-01-07 10:12:25 +00:00
zhangxiao871
3c7ad9a8e9 fix test 2022-01-07 18:09:23 +08:00
alesapin
b1d2bdf569
Merge pull request #33130 from kssenii/validate-config
Validate config keys for external dictionaries
2022-01-07 12:59:02 +03:00
zhangxiao871
ec75d23404 add test 2022-01-07 17:45:30 +08:00
zhangxiao871
30eb0921b0 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-07 17:30:32 +08:00
DimaAmega
4bfe85b2b0 better index.html 2022-01-07 12:26:17 +03:00
枢木
a6c1bd0935 Add config to enable ipv4 or ipv6. 2022-01-07 17:22:20 +08:00
alesapin
1831e84a98
Merge pull request #33447 from ClickHouse/rerun_docs_release
Rerun docs release check as well
2022-01-07 12:12:40 +03:00
alesapin
6a4d5a985b Rerun docs release check as well 2022-01-07 12:05:38 +03:00
IlyaTsoi
30ef16ab58
Update LDAPClient.cpp
refactoring of escapeForLDAPFilter function
2022-01-07 12:02:48 +03:00
JackyWoo
99e6812288 add tests 2022-01-07 15:53:20 +08:00
Alexey Milovidov
cc329c3bf9 Add a test 2022-01-07 09:18:13 +03:00
Alexey Milovidov
3787bf72c2 Fix potential exponential growth of untuple function 2022-01-07 09:15:10 +03:00
alexey-milovidov
bb000758df
Merge pull request #33422 from ClickHouse/maybe-improve-test
Maybe improve robustness of the "query profiler" test
2022-01-07 08:56:49 +03:00
alexey-milovidov
27dac209dc
Merge pull request #33368 from ClickHouse/dotnet-integration-test
Trying to merge #23230
2022-01-07 08:43:52 +03:00
Alexey Milovidov
dfb8f9d4fa Simplification 2022-01-07 08:34:33 +03:00
usurai
9fd8b99b7c Remove maybe_unused 2022-01-07 13:23:22 +08:00
tekeri
4e402baa84
Fix typo: command_write_timeout 2022-01-07 14:19:48 +09:00
Alexey Milovidov
96aa6060c1 Improve parser 2022-01-07 08:14:09 +03:00
usurai
76848e7a2a Use FunctionFactory to invoke dateName 2022-01-07 13:06:47 +08:00
Alexey Milovidov
4bfea5a83f Merge branch 'master' into parser-simplification 2022-01-07 08:03:33 +03:00
lgbo-ustc
6a6b6594c3 update test_hive_query 2022-01-07 12:22:57 +08:00
Alexey Milovidov
b7320ee5b1 Remove some garbage 2022-01-07 05:16:31 +03:00
usurai
aaa45beba1 Revert "Move dataName.cpp to dateName.h"
This reverts commit f919bb8664.
2022-01-07 09:45:34 +08:00
usurai
e849ea4294 Revert "Add monthName"
This reverts commit c0892f6e6c.
2022-01-07 09:45:27 +08:00
alexey-milovidov
3e416cbdd5
Merge pull request #33438 from ClickHouse/quick-start-freebsd
Fix quick start for FreeBSD
2022-01-07 02:04:03 +03:00
Alexey Milovidov
12c3130a6d Update reference 2022-01-07 02:03:44 +03:00
DimaAmega
2495b7c913 better index.html 2022-01-07 00:35:02 +03:00
Maksim Kita
4c1f61bd19
Merge pull request #33431 from bigo-sg/add_build_options
Add some building options in system.build_options
2022-01-07 00:02:57 +03:00
Alexey Milovidov
c1a44ca25a Fix quick start for FreeBSD 2022-01-06 22:56:32 +03:00