Commit Graph

48551 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
0e34955753 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 13:10:18 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Alexander Kuzmenkov
72c68a8746 boop the CI 2020-09-17 13:05:03 +03:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately.
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
2020-09-17 13:00:51 +03:00
Nikolai Kochetov
21bd45fb22
Update InterpreterSelectQuery.cpp 2020-09-17 12:57:48 +03:00
Nikolai Kochetov
fdeda8200b Revert debian/rules 2020-09-17 12:52:15 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
roman
b41421cb1c [settings]: introduce new query complexity settings for leaf-nodes
The new setting should allow to control query complexity on leaf nodes
excluding the final merging stage on the root-node. For example, distributed
query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`,
while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500`
this limit won't be reached and query will succeed since every shard reads
not more that ~1k rows.
2020-09-17 10:37:05 +01:00
Nikolai Kochetov
35e8ee5f85 Rollback inlining. 2020-09-17 12:20:23 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
Nikolai Kochetov
6d3e6dadfa Update has. 2020-09-17 11:18:00 +03:00
Nikolai Kochetov
225b85624e Merge branch 'master' into inline-gather-utils 2020-09-17 11:17:32 +03:00
alesapin
f104c382f8
Merge pull request #14887 from azat/StorageFile-write-to-fd
Fix SIGSEGV for an attempt to INSERT into StorageFile(fd)
2020-09-17 10:25:02 +03:00
alesapin
5f9e7ed169
Merge pull request #14834 from ClickHouse/fix_compression_codec_perf
Fix performance degradation during parts selection for merge
2020-09-17 10:09:41 +03:00
alesapin
4348dca960
Update ci_config.json 2020-09-17 10:07:58 +03:00
alesapin
73544a3781
Merge pull request #14845 from ClickHouse/fix_alias_array
Fix recursive column defaults
2020-09-17 10:02:39 +03:00
zhang2014
c5b56c24f8 ISSUES-14894 fix MaterializeMySQL temp metadata file exists 2020-09-17 14:44:05 +08:00
zhang2014
0c81a8777e Fix review comment 2020-09-17 14:21:38 +08:00
Nikolai Kochetov
7384733144 Fix style. 2020-09-17 09:01:35 +03:00
Nikolai Kochetov
a67986791f
Merge pull request #14848 from ClickHouse/test-gather-utils-build-time
Improve GatherUtils build time
2020-09-17 08:58:00 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
sundyli
9c2a8ea6d0 dynamic zookeeper config 2020-09-17 13:26:36 +08:00
Azat Khuzhin
13088d9bef Fix 00900_parquet_load (update exception message on INSERT failures) 2020-09-17 08:05:56 +03:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Azat Khuzhin
138e953429 Fix SIGSEGV for an attempt to INSERT into StorageFile(fd) 2020-09-17 01:26:34 +03:00
Alexey Milovidov
c37b55c3b1 Fix error in "extractAllGroups" function 2020-09-17 00:19:58 +03:00
Azat Khuzhin
7d046b24e6 Improve error message for INSERT via clickhouse-client
With '\n...' after the query [1] clickhouse-client prefer data from the
INSERT over from stdin, and produce very tricky message:

    Code: 27. DB::Exception: Cannot parse input: expected '\n' before: ' ': (at row 1)

Well for TSV it is ok, but for RowBinary:

    Code: 33. DB::Exception: Cannot read all data. Bytes read: 1. Bytes expected: 4.

So improve error message by adding the source of data for INSERT.

  [1]: clickhouse-client -q "INSERT INTO data FORMAT TSV\n " <<<2
2020-09-17 00:16:51 +03:00
damozhaeva
4a094491f2
DOCSUP-2038 Edit and translate to Russian (#14236)
* Editing and translation.

* Editing and translation v2.

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Russian changes.

* Changed links.

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Changed odbc link

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: emironyuk <em@don.ru>
Co-authored-by: Daria Mozhaeva <dmozhaeva@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2020-09-16 21:54:55 +03:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
9f5599858e
Merge pull request #14820 from vladimir-golovchenko/fix-sql-compatibility-doc
Fix SQL compatibility doc
2020-09-16 20:44:22 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
Nikolai Kochetov
9fc594a4c5 Fix tests. 2020-09-16 20:32:56 +03:00
alexey-milovidov
5f57b8c912
Merge pull request #14882 from monadbobo/clang_minimum_version
Modify the minimum version of the Clang compiler
2020-09-16 20:29:04 +03:00
Alexey Milovidov
26eb49b48d Fix typo 2020-09-16 20:02:55 +03:00
Nikolai Kochetov
d0debd51c0 Add sorting to fix test. 2020-09-16 20:00:44 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
Nikolai Kochetov
fe1056579f Fix tests. 2020-09-16 19:45:56 +03:00
Nikolai Kochetov
73ad505735 Fix tests. 2020-09-16 19:38:33 +03:00
Nikolai Kochetov
2f7ab2bca4 Fix tests. 2020-09-16 19:30:48 +03:00
Nikolai Kochetov
8a26251f94 Fix tests. 2020-09-16 19:11:16 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
2020-09-16 18:27:51 +03:00
alesapin
348125c226 Bump CI 2020-09-16 18:19:32 +03:00
tavplubix
faa5190f11
Update arcadia_skip_list.txt 2020-09-16 18:17:16 +03:00
Nikolai Kochetov
8fed50b1db Fix GenericSource 2020-09-16 18:03:47 +03:00
Nikolai Kochetov
42c543a64d Fix GenericSource 2020-09-16 17:58:54 +03:00
Nikolai Kochetov
8de76709fb Fix tests. 2020-09-16 17:41:01 +03:00
Amos Bird
96a202c0fb
Get rid of query settings after initialization. 2020-09-16 22:35:39 +08:00