Commit Graph

48001 Commits

Author SHA1 Message Date
Alexander Tokmakov
41e99cf261 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-09-17 20:28:50 +03:00
alexey-milovidov
9b6c62e82b
Merge pull request #14867 from amosbird/lbo
Explicit define what first replica is.
2020-09-17 19:37:15 +03:00
Alexander Tokmakov
06ff6d2eda better 01193_metadata_loading 2020-09-17 19:28:44 +03:00
tavplubix
a76d8fb96b
Merge pull request #14898 from zhang2014/fix/ISSUES-14894
ISSUES-14894 fix MaterializeMySQL temp metadata file exists
2020-09-17 19:18:10 +03:00
tavplubix
5a890d7377
Merge pull request #14852 from zhang2014/fix/mysql_protocol_parser
Fix parse MySQL binlog event for MaterializeMySQL
2020-09-17 19:17:30 +03:00
Alexander Kuzmenkov
652163c07c
Merge pull request #14883 from ClickHouse/aku/ignore-thresholds
Adjust ignore thresholds for unstable perf tests
2020-09-17 18:14:53 +03:00
alexey-milovidov
84eece69ba
Merge pull request #14876 from amosbird/ns
Get rid of query settings after initialization.
2020-09-17 17:49:25 +03:00
Alexander Kuzmenkov
5539c6ecaa
Merge pull request #14928 from ClickHouse/aku/special-builds
Move non-essential builds to special
2020-09-17 17:19:32 +03:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure
Secure inter-cluster query execution (with initial_user as current query user) [v3]
2020-09-17 17:11:00 +03:00
alexey-milovidov
496df5b3e9
Merge pull request #14678 from sundy-li/patch-2
dynamic zookeeper config when session expired
2020-09-17 17:05:22 +03:00
alexey-milovidov
2413caa7d5
Merge pull request #14889 from ClickHouse/extract-all-groups-empty-match
Fix error in "extractAllGroups" function
2020-09-17 16:02:30 +03:00
Nikolai Kochetov
000cd42d5e
Merge pull request #14917 from ClickHouse/revert-14607-lower-number-of-threads-in-binary-build
Revert "Lower number of threads in binary build"
2020-09-17 15:45:02 +03:00
Nikolai Kochetov
c2906e3871
Merge pull request #14918 from ClickHouse/revert-14362
Revert #14362
2020-09-17 15:41:08 +03:00
Nikolai Kochetov
959d755a1b
Update Visitor.h 2020-09-17 15:08:55 +03:00
Nikolai Kochetov
daf6e0aa84
Merge pull request #14813 from ClickHouse/inline-gather-utils
Inline gather utils
2020-09-17 14:44:25 +03:00
Alexander Kuzmenkov
946d364b10 Move non-essential builds to special
Special builds have lower CI priority and start later. If some tests
fail, they won't start at all, so we'll save some CI time.
2020-09-17 14:41:14 +03:00
Nikolai Kochetov
bd92284b4e Push ci. 2020-09-17 13:18:01 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately.
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
2020-09-17 13:00:51 +03:00
Nikolai Kochetov
fdeda8200b Revert debian/rules 2020-09-17 12:52:15 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
Nikolai Kochetov
35e8ee5f85 Rollback inlining. 2020-09-17 12:20:23 +03:00
Nikolai Kochetov
6d3e6dadfa Update has. 2020-09-17 11:18:00 +03:00
Nikolai Kochetov
225b85624e Merge branch 'master' into inline-gather-utils 2020-09-17 11:17:32 +03:00
alesapin
f104c382f8
Merge pull request #14887 from azat/StorageFile-write-to-fd
Fix SIGSEGV for an attempt to INSERT into StorageFile(fd)
2020-09-17 10:25:02 +03:00
alesapin
5f9e7ed169
Merge pull request #14834 from ClickHouse/fix_compression_codec_perf
Fix performance degradation during parts selection for merge
2020-09-17 10:09:41 +03:00
alesapin
4348dca960
Update ci_config.json 2020-09-17 10:07:58 +03:00
alesapin
73544a3781
Merge pull request #14845 from ClickHouse/fix_alias_array
Fix recursive column defaults
2020-09-17 10:02:39 +03:00
zhang2014
c5b56c24f8 ISSUES-14894 fix MaterializeMySQL temp metadata file exists 2020-09-17 14:44:05 +08:00
zhang2014
0c81a8777e Fix review comment 2020-09-17 14:21:38 +08:00
Nikolai Kochetov
a67986791f
Merge pull request #14848 from ClickHouse/test-gather-utils-build-time
Improve GatherUtils build time
2020-09-17 08:58:00 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
sundyli
9c2a8ea6d0 dynamic zookeeper config 2020-09-17 13:26:36 +08:00
Azat Khuzhin
138e953429 Fix SIGSEGV for an attempt to INSERT into StorageFile(fd) 2020-09-17 01:26:34 +03:00
Alexey Milovidov
c37b55c3b1 Fix error in "extractAllGroups" function 2020-09-17 00:19:58 +03:00
damozhaeva
4a094491f2
DOCSUP-2038 Edit and translate to Russian (#14236)
* Editing and translation.

* Editing and translation v2.

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Russian changes.

* Changed links.

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Changed odbc link

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: emironyuk <em@don.ru>
Co-authored-by: Daria Mozhaeva <dmozhaeva@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2020-09-16 21:54:55 +03:00
alexey-milovidov
9f5599858e
Merge pull request #14820 from vladimir-golovchenko/fix-sql-compatibility-doc
Fix SQL compatibility doc
2020-09-16 20:44:22 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
Nikolai Kochetov
9fc594a4c5 Fix tests. 2020-09-16 20:32:56 +03:00
alexey-milovidov
5f57b8c912
Merge pull request #14882 from monadbobo/clang_minimum_version
Modify the minimum version of the Clang compiler
2020-09-16 20:29:04 +03:00
Alexey Milovidov
26eb49b48d Fix typo 2020-09-16 20:02:55 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
2020-09-16 18:27:51 +03:00
alesapin
348125c226 Bump CI 2020-09-16 18:19:32 +03:00
tavplubix
faa5190f11
Update arcadia_skip_list.txt 2020-09-16 18:17:16 +03:00
Nikolai Kochetov
8fed50b1db Fix GenericSource 2020-09-16 18:03:47 +03:00
Nikolai Kochetov
42c543a64d Fix GenericSource 2020-09-16 17:58:54 +03:00
Amos Bird
96a202c0fb
Get rid of query settings after initialization. 2020-09-16 22:35:39 +08:00
Simon Liu
c41e230589 Modify the minimum version of the Clang compiler that Clickhouse can support (8 -> 9),
The main reason is that in Clang 8.0 "#pragma clang attribute" cannot be used in the namesapce scope.
2020-09-16 22:14:30 +08:00
Nikolai Kochetov
17ec88da84 Split has. 2020-09-16 17:02:28 +03:00
Nikolai Kochetov
9a6b4b3355 Split has. 2020-09-16 16:49:09 +03:00