Commit Graph

40939 Commits

Author SHA1 Message Date
Alexey Milovidov
2fa264d83e Fix style #10591 2020-05-21 12:46:00 +03:00
alexey-milovidov
b6b62dbdbc
Merge pull request #10591 from excitoon-favorites/ttl_introspection
Added `move_ttl_info` to `system.parts`
2020-05-21 12:43:49 +03:00
alexey-milovidov
4a237faede
Merge pull request #11074 from Jokser/memory-leak-in-register-disk-s3
Fix memory leak in registerDiskS3
2020-05-21 12:42:46 +03:00
Ilya Yatsishin
913f28aeff
Merge pull request #11095 from BohuTANG/storage_typo
Fix Storages/MergeTree typo
2020-05-21 12:40:23 +03:00
Nikolai Kochetov
37e5da737c Fix ya.make. 2020-05-21 12:27:55 +03:00
BohuTANG
c9d315654c Fix Storages/MergeTree typo 2020-05-21 17:00:44 +08:00
Nikolai Kochetov
cfef21be86 Fix build. 2020-05-21 11:54:41 +03:00
Azat Khuzhin
111fa49df5 Add comment for enabling jemalloc percpu_arena 2020-05-21 11:43:29 +03:00
Azat Khuzhin
5da41d5cd6 Configure jemalloc options via cmake 2020-05-21 11:43:29 +03:00
Ivan Blinkov
72ef77e695
Merge pull request #11093 from ClickHouse/dependabot/pip/docs/tools/protobuf-3.12.1
Bump protobuf from 3.12.0 to 3.12.1 in /docs/tools
2020-05-21 11:00:28 +03:00
Nikolai Kochetov
adac47a845 Fix build. 2020-05-21 10:47:38 +03:00
Nikolai Kochetov
f6d5961915 Fix build. 2020-05-21 10:40:01 +03:00
Nikolai Kochetov
6efc51335a Fix build. 2020-05-21 10:31:43 +03:00
dependabot-preview[bot]
72ca56c43b
Bump protobuf from 3.12.0 to 3.12.1 in /docs/tools
Bumps [protobuf](https://github.com/protocolbuffers/protobuf) from 3.12.0 to 3.12.1.
- [Release notes](https://github.com/protocolbuffers/protobuf/releases)
- [Changelog](https://github.com/protocolbuffers/protobuf/blob/master/generate_changelog.py)
- [Commits](https://github.com/protocolbuffers/protobuf/compare/v3.12.0...v3.12.1)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-05-21 07:28:30 +00:00
alexey-milovidov
8c2b7c31a5
Fix too long perf test. 2020-05-21 09:49:15 +03:00
Ilya Yatsishin
2f7fd3ccfe
Merge pull request #10908 from qoega/packager-add-bin
Allow to build binaries and tests from deb package build.
2020-05-21 09:40:03 +03:00
alexey-milovidov
117e73d48b
Merge pull request #11091 from ClickHouse/arcignore
Add .arcignore
2020-05-21 09:18:11 +03:00
Alexey Milovidov
4f9abad9dd Added .arcignore 2020-05-21 09:17:03 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Azat Khuzhin
77bdb5f462 Add a test for GROUP BY memory accounting
- GROUP BY
- GROUP BY LIMIT
- GROUP BY MEMORY_LIMIT_EXCEEDED
2020-05-21 02:06:55 +03:00
Azat Khuzhin
09474ebea5 Fix memory tracking for two-level GROUP BY when not all rows read from Aggregator (TCP)
Example of such cases:
- SELECT GROUP BY LIMIT
- SELECT GROUP BY with subsequent MEMORY_LIMIT_EXCEEDED error

And it should be two-level aggregation, since otherwise there will be
only one hashtable which will be cleared correctly, only if you have
two-level GROUP BY some of hashtables will not be cleared since nobody
consume rows.

Before this patch:
    09:39.015292 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.707 sec., 1413826 rows/sec., 10.79 MiB/sec.
    09:39.015348 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.015942 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <-- **problem**
    09:39.017057 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <--
    09:39.017961 [ 3070801 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.018029 [ 3070801 ] {} <Information> TCPHandler: Processed in 0.711 sec.

After this patch:
    16:24.544030 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.599 sec., 1670199 rows/sec., 12.74 MiB/sec.
    16:24.544084 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.544398 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.545485 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.547053 [ 3087333 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.547093 [ 3087333 ] {} <Information> TCPHandler: Processed in 0.603 sec.
2020-05-21 02:06:55 +03:00
Azat Khuzhin
d93b9a57f6 Forward declaration for Context as much as possible.
Now after changing Context.h 488 modules will be recompiled instead of 582.
2020-05-21 01:53:18 +03:00
Azat Khuzhin
58ffa4c59c Enable percpu_arena:percpu for jemalloc
This will reduce memory fragmentation due to thread pool.
2020-05-21 01:01:28 +03:00
Ivan Blinkov
7d0ac4e20f
trigger ci 2020-05-21 00:08:04 +03:00
Ivan Blinkov
ebef7b9a85
[website] ld+json for the front page (#11077)
* [website] ld+json for the front page

* Update index.html

* Update index.html
2020-05-21 00:01:18 +03:00
Nikolai Kochetov
bcd38ac207 Fix build. 2020-05-20 22:08:20 +03:00
Nikolai Kochetov
1183bad4d0 Fix build. 2020-05-20 22:01:36 +03:00
Nikolai Kochetov
6f50700f35 Add PullingOutputFormat and PullingPipelineExecutor. 2020-05-20 21:53:18 +03:00
alexey-milovidov
07924f0ae1
Merge pull request #11029 from azat/system_tables_lazy_load
Disable system_tables_lazy_load by default
2020-05-20 21:15:09 +03:00
Ivan Blinkov
84fda62e2c
[docs] minor translation update (#11072) 2020-05-20 21:13:03 +03:00
alexey-milovidov
a62e1834d2
Fix data rot @blinkov 2020-05-20 19:30:27 +03:00
Pavel Kovalenko
d98c1589ed Better error handling in Proxy Resolver. 2020-05-20 19:01:05 +03:00
Pavel Kovalenko
138154ba6a Fix memory-leak in registerDiskS3 during config->createView invocations. 2020-05-20 18:42:45 +03:00
Ilya Yatsishin
555087512a
Update debian/rules
Co-authored-by: alesapin <alesapin@gmail.com>
2020-05-20 18:28:44 +03:00
Nikolai Kochetov
fcf58fa4a1 Fix clang build. 2020-05-20 17:04:24 +03:00
Anton Popov
d62fe980ef Merge remote-tracking branch 'upstream/master' into modify-ttl 2020-05-20 16:52:30 +03:00
Vitaly Baranov
06d18a4378
Merge pull request #11050 from vitlibar/amosbird_betterdictget
dictGet with table name
2020-05-20 14:18:24 +03:00
alexey-milovidov
da33858d39 Update StorageSystemParts.cpp 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
02b52df86d Added delete_ttl_info_min and delete_ttl_info_max to system.parts. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
6f68979662 Switched system.parts.move_ttl_info to separate arrays. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
3ed5d9434a Added move_ttl_info to system.parts. 2020-05-20 14:07:31 +03:00
Artem Zuikov
9b38324028
fix JOIN with PREWHERE with second analyze() (#11051) 2020-05-20 12:29:23 +03:00
Mikhail Filimonov
e8a13842af Better fix, previous fix was wrong (was leaving the cycle by eof condition) 2020-05-20 11:02:02 +02:00
alesapin
2673c985bd
Merge pull request #11002 from ClickHouse/zookeeper_in_tmpfs_intergration_tests
Add ability to run zookeeper in integration tests with tmpfs
2020-05-20 11:30:13 +03:00
alesapin
dc330ca7cb
Merge pull request #11037 from ClickHouse/alter_rename_and_modify
Fix alter rename with different types of alter
2020-05-20 11:28:13 +03:00
Ivan Blinkov
c450c0721d
Merge pull request #11064 from ClickHouse/dependabot/pip/docs/tools/mkdocs-macros-plugin-0.4.9
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools
2020-05-20 10:58:45 +03:00
dependabot-preview[bot]
2b8ccac084
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools
Bumps [mkdocs-macros-plugin](https://github.com/fralau/mkdocs_macros_plugin) from 0.4.7 to 0.4.9.
- [Release notes](https://github.com/fralau/mkdocs_macros_plugin/releases)
- [Commits](https://github.com/fralau/mkdocs_macros_plugin/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
2020-05-20 07:33:10 +00:00
BayoNet
5e84769c74
DOCS-628: Stable versions of statistical functions v2 (#11047)
* CLICKHOUSEDOCS-628: Restore deleted changes.

* CLICKHOUSEDOCS-628: pillar

* CLICKHOUSEDOCS-628: Fixed grammar.

* CLICKHOUSEDOCS-628: Translated #8933

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
2020-05-20 08:35:51 +03:00
Anton Popov
bd3e7307d0 fix integration test 2020-05-20 01:43:16 +03:00
Ivan Blinkov
8eac46c79f
[docs] mark submitting feedback as Metrika goal (#11046) 2020-05-20 00:49:43 +03:00