Commit Graph

44610 Commits

Author SHA1 Message Date
Ivan Babrou
72622a9b00 Parallelize PK range and skipping index stages
This runs PK lookup and skipping index stages on parts
in parallel, as described in #11564.

While #12277 sped up PK lookups, skipping index stage
may still be a bottleneck in a select query. Here we
parallelize both stages between parts.

On a query that uses a bloom filter skipping index to pick
2,688 rows out of 8,273,114,994 on a two day time span,
this change reduces latency from 10.5s to 1.5s.
2020-07-19 21:49:41 -07:00
Alexey Milovidov
b8cc2bee53 Added a test from @ishirav #7404 2020-07-19 03:59:45 +03:00
alexey-milovidov
7aee5abb83
Merge pull request #12569 from ClickHouse/aku/numa-metric
Add perf metric for NUMA-local memory access
2020-07-19 03:21:24 +03:00
alexey-milovidov
504783fe2b
Update ProfileEvents.cpp 2020-07-19 03:20:45 +03:00
Alexander Kuzmenkov
37b3cef4cb
Update run-fuzzer.sh 2020-07-17 21:41:33 +03:00
Alexey Milovidov
0f102659c6 Added results from AWS c5.metal 2020-07-17 20:48:10 +03:00
alexey-milovidov
5775a8934a
Fix awful bug @blinkov 2020-07-17 20:34:43 +03:00
Alexander Kuzmenkov
ac01b8670e Correct the benchmark results for Pixel 3a and Dell XPS
I used a wrong data set, so the queries with the `CounterID = 62` filter
were completely off. Others are more or less the same.

Also fix the queries shown on web site to match the real queries.
2020-07-17 20:31:50 +03:00
alexey-milovidov
0e481ec0f8
Fix strange leading whitespaces @blinkov 2020-07-17 20:12:21 +03:00
Alexander Kuzmenkov
5a662ca48c Add perf metric for NUMA-local memory access 2020-07-17 20:10:59 +03:00
alexey-milovidov
4ac9a466c7
Fix data rot @blinkov 2020-07-17 20:04:19 +03:00
tavplubix
5634482393
Merge pull request #12556 from azat/distributed-remove-files-on-drop
Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE
2020-07-17 19:29:57 +03:00
Alexander Kuzmenkov
da5853f031
Update decimal_aggregates.xml 2020-07-17 18:27:05 +03:00
BayoNet
71e7b94aa4
DOCS-586: The validate_polygons setting (#12555)
* asiana21-DOCSUP-979-validate_polygons (#136)

* docs(validate_polygons): added the setting description

* Update docs/en/operations/settings/settings.md

Co-authored-by: BayoNet <da-daos@yandex.ru>

* docs(validate_polygons): added RU translation

Co-authored-by: asiana21 <asiana21@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>

* CLICKHOUSEDOCS-586: Minor text edit.

Co-authored-by: AsiaKorushkina <43650329+AsiaKorushkina@users.noreply.github.com>
Co-authored-by: asiana21 <asiana21@yandex-team.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-07-17 18:05:42 +03:00
BayoNet
cd621e4e63
DOCSUP-1315 Updated description of the 'parts' system table (#134) (#12535)
* Updated description of the 'parts' system table and 2 new settings for the MergeTree table

* Apply suggestions from code review

Co-authored-by: BayoNet <da-daos@yandex.ru>

* Data part format description moved to the data storage section.

* An error fixed in english version and russian version added.

* Minor bug fixed in russian version.

Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: BayoNet <da-daos@yandex.ru>

Co-authored-by: olgarev <56617294+olgarev@users.noreply.github.com>
Co-authored-by: Olga Revyakina <revolg@yandex-team.ru>
Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-07-17 18:05:07 +03:00
Alexander Kuzmenkov
e095d04553
Update read_in_order_many_parts.xml 2020-07-17 15:12:49 +03:00
Alexander Kuzmenkov
c306476f1b
Update redundant_functions_in_order_by.xml 2020-07-17 15:11:17 +03:00
Alexander Kuzmenkov
aa54101c21
Merge pull request #12553 from ClickHouse/aku/fuzzer-fixes
Minor fixes for query fuzzer
2020-07-17 14:52:32 +03:00
alexey-milovidov
51f539d3fb
Merge pull request #12480 from azat/fix-SETTINGS-parse-after-FORMAT
[RFC] Fix SETTINGS parse after FORMAT
2020-07-17 14:11:24 +03:00
alexey-milovidov
9fb40a3f7b
Merge pull request #12386 from fastio/master
COS (Tencent Cloud Object Storage) integration
2020-07-17 14:09:16 +03:00
alexey-milovidov
f3db2f3c3d
Update S3Common.cpp 2020-07-17 14:07:26 +03:00
alexey-milovidov
0f6599c9e5
Merge pull request #12541 from BohuTANG/mysql_explain
Fix EXPLAIN format for MySQL client
2020-07-17 14:04:01 +03:00
Ivan Blinkov
68eea963c2
[blog] add extra check to avoid unexpected files (#12560) 2020-07-17 14:01:32 +03:00
Artem Zuikov
c6e3e9b1ff
String convertion to enum in if() and transform() (#12515) 2020-07-17 12:28:51 +03:00
Ivan Blinkov
f514516fbd
Update README.md 2020-07-17 11:54:14 +03:00
Ivan Blinkov
20d90d8234
[website] more aggressive cache purge 2020-07-17 11:44:58 +03:00
alesapin
ac802a8e96
Merge pull request #12543 from ClickHouse/fix_marks_type_on_mutation
Fix incorrect adaptive granularity by default
2020-07-17 11:09:54 +03:00
Ivan Blinkov
0c903d3fdc
Delete pixel-bencmhark.md.orig 2020-07-17 11:02:15 +03:00
Azat Khuzhin
6ea1b19476 Remove data for Distributed tables (blocks from async INSERTs) on DROP TABLE 2020-07-17 08:59:57 +03:00
alexey-milovidov
10e12c32cb
Merge pull request #12549 from ClickHouse/fix_ci_fest_tests
Fix ci fest tests
2020-07-17 08:01:23 +03:00
Peng Jian
2fc58e8f10 Fix code sytle check & build check 2020-07-17 11:33:29 +08:00
Ivan Blinkov
9273f9c632
[benchmark page] make phones lighter grey as well 2020-07-17 01:45:19 +03:00
Azat Khuzhin
a5887ff735 Add 01401_FORMAT_SETTINGS to arcadia_skip_list (to fix yandex sync check)
And also to trigger CI, since looks like perf tests hanged
2020-07-17 00:29:17 +03:00
Azat Khuzhin
781f1597f2 Fix SETTINGS parsing after FORMAT for SELECT queries
There are two possible ways to pass the SETTINGS clause:

  - SELECT 1 FORMAT Null SETTINGS max_block_size = 1
  - SELECT 1 SETTINGS max_block_size = 1[ FORMAT Null]

And when the SETTINGS goes after FORMAT it is parsed in
ParserQueryWithOutput, and these settings are not applied for the query
from the ASTSelectQuery::initSettings()

So propagate settings from the ParserQueryWithOutput to the
ASTSelectQuery settings.
2020-07-17 00:28:52 +03:00
alexey-milovidov
fde8c87a1f
Merge pull request #12426 from ClickHouse/log-engine-rollback-on-insert-error
Rollback insertion error in Log engines
2020-07-16 22:50:48 +03:00
Alexander Kuzmenkov
95c6efbdc1
Merge pull request #12546 from ClickHouse/aku/pixel-benchmark
[draft] Pixel benchmark blog post
2020-07-16 21:28:24 +03:00
Alexander Kuzmenkov
039cf36acb Minor fixes for query fuzzer 2020-07-16 21:05:34 +03:00
Alexander Kuzmenkov
eb1596e363
Update pixel-benchmark.md 2020-07-16 20:40:44 +03:00
Alexander Kuzmenkov
49ca315e30 remove images 2020-07-16 20:10:20 +03:00
Alexander Kuzmenkov
dd2adad0ce
Update pixel-benchmark.md 2020-07-16 20:04:55 +03:00
Alexander Kuzmenkov
782f2179ce
Update pixel-benchmark.md 2020-07-16 19:42:05 +03:00
Anton Popov
97e8a88b30
Merge pull request #12277 from bobrik/ivan/exact-range-speedup
WIP: Optimize PK lookup for queries that match exact PK range
2020-07-16 19:17:50 +03:00
Alexander Kuzmenkov
abe45b76cd rename file 2020-07-16 19:07:15 +03:00
Alexander Kuzmenkov
b793f97c86 add 'em dashes 2020-07-16 19:06:33 +03:00
Ivan Blinkov
dcf6cdb91e
Update deploy-to-test.sh 2020-07-16 18:41:05 +03:00
Alexander Kuzmenkov
d2a327048e
Update pixel-bencmhark.md 2020-07-16 16:56:06 +03:00
Alexander Kuzmenkov
5883490268
Update pixel-bencmhark.md 2020-07-16 16:45:26 +03:00
alesapin
af5a9887e7 Better 1318 test 2020-07-16 16:20:38 +03:00
Alexander Kuzmenkov
2d9c110ebe
Apply suggestions from code review
Co-authored-by: Ivan Blinkov <github@blinkov.ru>
2020-07-16 16:08:52 +03:00
Ivan Blinkov
7f5b5fa6ad
Update deploy-to-test.sh 2020-07-16 15:05:03 +03:00