thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-22 15:42:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
48,322 Commits 9,152 Branches 1,781 Tags 2.1 GiB
ddfd512241
Commit Graph

48322 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alexey Milovidov
a5560cd62d Better drop replicated tables 2020-09-17 14:27:17 +03:00
Alexander Kuzmenkov
4773bf57ea Use logical core id ('processor') for CPU freq metric 
See https://github.com/ClickHouse/ClickHouse/issues/14923
 2020-09-17 13:47:29 +03:00
alesapin
40b2f203b6 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-09-17 13:21:00 +03:00
Nikolai Kochetov
bd92284b4e Push ci. 2020-09-17 13:18:01 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11 
Move to clang-11 in CI builds
 2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
0e34955753 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 13:10:18 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately. 
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
 2020-09-17 13:00:51 +03:00
Nikolai Kochetov
21bd45fb22
Update InterpreterSelectQuery.cpp 2020-09-17 12:57:48 +03:00
Nikolai Kochetov
fdeda8200b Revert debian/rules 2020-09-17 12:52:15 +03:00
Nikolai Kochetov
d23244b3a5
Revert "Lower number of threads in binary build" 2020-09-17 12:45:06 +03:00
roman
b41421cb1c [settings]: introduce new query complexity settings for leaf-nodes 
The new setting should allow to control query complexity on leaf nodes
excluding the final merging stage on the root-node. For example, distributed
query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`,
while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500`
this limit won't be reached and query will succeed since every shard reads
not more that ~1k rows.
 2020-09-17 10:37:05 +01:00
Nikolai Kochetov
35e8ee5f85 Rollback inlining. 2020-09-17 12:20:23 +03:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
Nikolai Kochetov
6d3e6dadfa Update has. 2020-09-17 11:18:00 +03:00
Nikolai Kochetov
225b85624e Merge branch 'master' into inline-gather-utils 2020-09-17 11:17:32 +03:00
alesapin
f104c382f8
Merge pull request #14887 from azat/StorageFile-write-to-fd 
Fix SIGSEGV for an attempt to INSERT into StorageFile(fd)
 2020-09-17 10:25:02 +03:00
alesapin
5f9e7ed169
Merge pull request #14834 from ClickHouse/fix_compression_codec_perf 
Fix performance degradation during parts selection for merge
 2020-09-17 10:09:41 +03:00
alesapin
4348dca960
Update ci_config.json 2020-09-17 10:07:58 +03:00
alesapin
73544a3781
Merge pull request #14845 from ClickHouse/fix_alias_array 
Fix recursive column defaults
 2020-09-17 10:02:39 +03:00
zhang2014
c5b56c24f8 ISSUES-14894 fix MaterializeMySQL temp metadata file exists 2020-09-17 14:44:05 +08:00
zhang2014
0c81a8777e Fix review comment 2020-09-17 14:21:38 +08:00
Nikolai Kochetov
a67986791f
Merge pull request #14848 from ClickHouse/test-gather-utils-build-time 
Improve GatherUtils build time
 2020-09-17 08:58:00 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper 
fix logic error && skip reload testkeeper
 2020-09-17 13:33:45 +08:00
sundyli
9c2a8ea6d0 dynamic zookeeper config 2020-09-17 13:26:36 +08:00
Azat Khuzhin
13088d9bef Fix 00900_parquet_load (update exception message on INSERT failures) 2020-09-17 08:05:56 +03:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Azat Khuzhin
138e953429 Fix SIGSEGV for an attempt to INSERT into StorageFile(fd) 2020-09-17 01:26:34 +03:00
Alexey Milovidov
c37b55c3b1 Fix error in "extractAllGroups" function 2020-09-17 00:19:58 +03:00
Azat Khuzhin
7d046b24e6 Improve error message for INSERT via clickhouse-client 
With '\n...' after the query [1] clickhouse-client prefer data from the
INSERT over from stdin, and produce very tricky message:

    Code: 27. DB::Exception: Cannot parse input: expected '\n' before: ' ': (at row 1)

Well for TSV it is ok, but for RowBinary:

    Code: 33. DB::Exception: Cannot read all data. Bytes read: 1. Bytes expected: 4.

So improve error message by adding the source of data for INSERT.

  [1]: clickhouse-client -q "INSERT INTO data FORMAT TSV\n " <<<2
 2020-09-17 00:16:51 +03:00
damozhaeva
4a094491f2
DOCSUP-2038 Edit and translate to Russian (#14236) 
* Editing and translation.

* Editing and translation v2.

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Russian changes.

* Changed links.

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Update docs/ru/getting-started/playground.md

Co-authored-by: Ivan Blinkov <github@blinkov.ru>

* Changed odbc link

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
Co-authored-by: emironyuk <em@don.ru>
Co-authored-by: Daria Mozhaeva <dmozhaeva@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
 2020-09-16 21:54:55 +03:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
9f5599858e
Merge pull request #14820 from vladimir-golovchenko/fix-sql-compatibility-doc 
Fix SQL compatibility doc
 2020-09-16 20:44:22 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests 
Format and cleanup imports form all *.py integration test files
 2020-09-16 20:40:57 +03:00
Nikolai Kochetov
9fc594a4c5 Fix tests. 2020-09-16 20:32:56 +03:00
alexey-milovidov
5f57b8c912
Merge pull request #14882 from monadbobo/clang_minimum_version 
Modify the minimum version of the Clang compiler
 2020-09-16 20:29:04 +03:00
Alexey Milovidov
26eb49b48d Fix typo 2020-09-16 20:02:55 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests 
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
 2020-09-16 18:27:51 +03:00
alesapin
348125c226 Bump CI 2020-09-16 18:19:32 +03:00
tavplubix
faa5190f11
Update arcadia_skip_list.txt 2020-09-16 18:17:16 +03:00
Nikolai Kochetov
8fed50b1db Fix GenericSource 2020-09-16 18:03:47 +03:00
Nikolai Kochetov
42c543a64d Fix GenericSource 2020-09-16 17:58:54 +03:00
Amos Bird
96a202c0fb
Get rid of query settings after initialization. 2020-09-16 22:35:39 +08:00
Daria Mozhaeva
8dc3c9b239 Edit and translate. 2020-09-16 18:14:33 +04:00
Simon Liu
c41e230589 Modify the minimum version of the Clang compiler that Clickhouse can support (8 -> 9), 
The main reason is that in Clang 8.0 "#pragma clang attribute" cannot be used in the namesapce scope.
 2020-09-16 22:14:30 +08:00
Nikolai Kochetov
17ec88da84 Split has. 2020-09-16 17:02:28 +03:00
Nikolai Kochetov
9a6b4b3355 Split has. 2020-09-16 16:49:09 +03:00