Commit Graph

40650 Commits

Author SHA1 Message Date
Alexey Milovidov
1fca0294fe Fix logical error in test 2020-05-21 13:48:48 +03:00
Alexey Milovidov
c816916fba Fix typo 2020-05-21 13:46:36 +03:00
Alexey Milovidov
38f36f6b58 Merge branch 'memory-tracking' of https://github.com/azat/ClickHouse into azat-memory-tracking-2 2020-05-21 13:00:04 +03:00
Nikolai Kochetov
986dfe79a5
Merge pull request #10858 from azat/min_mv_insert_block_size
[RFC] Introduce min_insert_block_size_{rows,bytes}_for_materialized_views (for MVs)
2020-05-21 12:52:58 +03:00
Alexey Milovidov
2fa264d83e Fix style #10591 2020-05-21 12:46:00 +03:00
alexey-milovidov
b6b62dbdbc
Merge pull request #10591 from excitoon-favorites/ttl_introspection
Added `move_ttl_info` to `system.parts`
2020-05-21 12:43:49 +03:00
alexey-milovidov
4a237faede
Merge pull request #11074 from Jokser/memory-leak-in-register-disk-s3
Fix memory leak in registerDiskS3
2020-05-21 12:42:46 +03:00
Ilya Yatsishin
913f28aeff
Merge pull request #11095 from BohuTANG/storage_typo
Fix Storages/MergeTree typo
2020-05-21 12:40:23 +03:00
BohuTANG
c9d315654c Fix Storages/MergeTree typo 2020-05-21 17:00:44 +08:00
Ivan Blinkov
72ef77e695
Merge pull request #11093 from ClickHouse/dependabot/pip/docs/tools/protobuf-3.12.1
Bump protobuf from 3.12.0 to 3.12.1 in /docs/tools
2020-05-21 11:00:28 +03:00
dependabot-preview[bot]
72ca56c43b
Bump protobuf from 3.12.0 to 3.12.1 in /docs/tools
Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.12.0 to 3.12.1.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.12.0...v3.12.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-05-21 07:28:30 +00:00
alexey-milovidov
8c2b7c31a5
Fix too long perf test. 2020-05-21 09:49:15 +03:00
Ilya Yatsishin
2f7fd3ccfe
Merge pull request #10908 from qoega/packager-add-bin
Allow to build binaries and tests from deb package build.
2020-05-21 09:40:03 +03:00
alexey-milovidov
117e73d48b
Merge pull request #11091 from ClickHouse/arcignore
Add .arcignore
2020-05-21 09:18:11 +03:00
Alexey Milovidov
4f9abad9dd Added .arcignore 2020-05-21 09:17:03 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Azat Khuzhin
77bdb5f462 Add a test for GROUP BY memory accounting
- GROUP BY
- GROUP BY LIMIT
- GROUP BY MEMORY_LIMIT_EXCEEDED
2020-05-21 02:06:55 +03:00
Azat Khuzhin
09474ebea5 Fix memory tracking for two-level GROUP BY when not all rows read from Aggregator (TCP)
Example of such cases:
- SELECT GROUP BY LIMIT
- SELECT GROUP BY with subsequent MEMORY_LIMIT_EXCEEDED error

And it should be two-level aggregation, since otherwise there will be
only one hashtable which will be cleared correctly, only if you have
two-level GROUP BY some of hashtables will not be cleared since nobody
consume rows.

Before this patch:
    09:39.015292 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.707 sec., 1413826 rows/sec., 10.79 MiB/sec.
    09:39.015348 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.015942 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <-- **problem**
    09:39.017057 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <--
    09:39.017961 [ 3070801 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.018029 [ 3070801 ] {} <Information> TCPHandler: Processed in 0.711 sec.

After this patch:
    16:24.544030 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.599 sec., 1670199 rows/sec., 12.74 MiB/sec.
    16:24.544084 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.544398 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.545485 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.547053 [ 3087333 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.547093 [ 3087333 ] {} <Information> TCPHandler: Processed in 0.603 sec.
2020-05-21 02:06:55 +03:00
Ivan Blinkov
7d0ac4e20f
trigger ci 2020-05-21 00:08:04 +03:00
Ivan Blinkov
ebef7b9a85
[website] ld+json for the front page (#11077)
* [website] ld+json for the front page

* Update index.html

* Update index.html
2020-05-21 00:01:18 +03:00
alexey-milovidov
07924f0ae1
Merge pull request #11029 from azat/system_tables_lazy_load
Disable system_tables_lazy_load by default
2020-05-20 21:15:09 +03:00
Ivan Blinkov
84fda62e2c
[docs] minor translation update (#11072) 2020-05-20 21:13:03 +03:00
alexey-milovidov
a62e1834d2
Fix data rot @blinkov 2020-05-20 19:30:27 +03:00
Pavel Kovalenko
d98c1589ed Better error handling in Proxy Resolver. 2020-05-20 19:01:05 +03:00
Pavel Kovalenko
138154ba6a Fix memory-leak in registerDiskS3 during config->createView invocations. 2020-05-20 18:42:45 +03:00
Ilya Yatsishin
555087512a
Update debian/rules
Co-authored-by: alesapin <alesapin@gmail.com>
2020-05-20 18:28:44 +03:00
Vitaly Baranov
06d18a4378
Merge pull request #11050 from vitlibar/amosbird_betterdictget
dictGet with table name
2020-05-20 14:18:24 +03:00
alexey-milovidov
da33858d39 Update StorageSystemParts.cpp 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
02b52df86d Added delete_ttl_info_min and delete_ttl_info_max to system.parts. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
6f68979662 Switched system.parts.move_ttl_info to separate arrays. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
3ed5d9434a Added move_ttl_info to system.parts. 2020-05-20 14:07:31 +03:00
Artem Zuikov
9b38324028
fix JOIN with PREWHERE with second analyze() (#11051) 2020-05-20 12:29:23 +03:00
alesapin
2673c985bd
Merge pull request #11002 from ClickHouse/zookeeper_in_tmpfs_intergration_tests
Add ability to run zookeeper in integration tests with tmpfs
2020-05-20 11:30:13 +03:00
alesapin
dc330ca7cb
Merge pull request #11037 from ClickHouse/alter_rename_and_modify
Fix alter rename with different types of alter
2020-05-20 11:28:13 +03:00
Ivan Blinkov
c450c0721d
Merge pull request #11064 from ClickHouse/dependabot/pip/docs/tools/mkdocs-macros-plugin-0.4.9
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools
2020-05-20 10:58:45 +03:00
dependabot-preview[bot]
2b8ccac084
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools
Bumps [mkdocs-macros-plugin](https://github.com/fralau/mkdocs_macros_plugin) from 0.4.7 to 0.4.9.
- [Release notes](https://github.com/fralau/mkdocs_macros_plugin/releases)
- [Commits](https://github.com/fralau/mkdocs_macros_plugin/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-05-20 07:33:10 +00:00
BayoNet
5e84769c74
DOCS-628: Stable versions of statistical functions v2 (#11047)
* CLICKHOUSEDOCS-628: Restore deleted changes.

* CLICKHOUSEDOCS-628: pillar

* CLICKHOUSEDOCS-628: Fixed grammar.

* CLICKHOUSEDOCS-628: Translated #8933

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-05-20 08:35:51 +03:00
Ivan Blinkov
8eac46c79f
[docs] mark submitting feedback as Metrika goal (#11046) 2020-05-20 00:49:43 +03:00
Ivan Blinkov
994884399c
trigger ci 2020-05-20 00:47:48 +03:00
Vitaly Baranov
57bd7afc03 Fix passing dictionary's name to dictGet() with alias. 2020-05-19 21:17:29 +03:00
Amos Bird
ce3c53a00a dictGet* with table name 2020-05-19 20:33:45 +03:00
Ivan Blinkov
f18eedc5e7
[website] set sentry environment 2020-05-19 19:11:00 +03:00
alesapin
7d382cc7b5 Return missed command 2020-05-19 19:03:10 +03:00
Ivan Blinkov
b5620c070c
[docs] preprocess single-page html as well (#11045) 2020-05-19 18:47:00 +03:00
Alexander Kuzmenkov
c3d9bb829b performance comparison 2020-05-19 18:28:03 +03:00
alesapin
a17f034271 Bump compose version to 2.3, and make tmpfs for zookeeper optional 2020-05-19 18:27:10 +03:00
Nikolai Kochetov
c147badf4f Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size 2020-05-19 18:24:21 +03:00
Ivan Blinkov
274a48c353
[website] parallel minify (#11043) 2020-05-19 18:11:23 +03:00
Ivan Blinkov
87e8288e96
trigger ci 2020-05-19 18:10:49 +03:00
Ivan Blinkov
a120fcb825
fix mistype 2020-05-19 18:09:49 +03:00