thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
40,785 Commits 9,319 Branches 1,783 Tags 2.1 GiB
3e87b5fe72
Commit Graph

40785 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ilya Yatsishin
2f7fd3ccfe
Merge pull request #10908 from qoega/packager-add-bin 
Allow to build binaries and tests from deb package build.
 2020-05-21 09:40:03 +03:00
alexey-milovidov
117e73d48b
Merge pull request #11091 from ClickHouse/arcignore 
Add .arcignore
 2020-05-21 09:18:11 +03:00
Alexey Milovidov
4f9abad9dd Added .arcignore 2020-05-21 09:17:03 +03:00
Alexander Kuzmenkov
34508b8f64 [wip] Add memory stats to performance test 2020-05-21 05:12:55 +03:00
Azat Khuzhin
77bdb5f462 Add a test for GROUP BY memory accounting 
- GROUP BY
- GROUP BY LIMIT
- GROUP BY MEMORY_LIMIT_EXCEEDED
 2020-05-21 02:06:55 +03:00
Azat Khuzhin
09474ebea5 Fix memory tracking for two-level GROUP BY when not all rows read from Aggregator (TCP) 
Example of such cases:
- SELECT GROUP BY LIMIT
- SELECT GROUP BY with subsequent MEMORY_LIMIT_EXCEEDED error

And it should be two-level aggregation, since otherwise there will be
only one hashtable which will be cleared correctly, only if you have
two-level GROUP BY some of hashtables will not be cleared since nobody
consume rows.

Before this patch:
    09:39.015292 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.707 sec., 1413826 rows/sec., 10.79 MiB/sec.
    09:39.015348 [ 3070801 ] {609a0610-e377-4132-9cf3-f49454cf3c96} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.015942 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <-- **problem**
    09:39.017057 [ 3070801 ] {} <Trace> Aggregator: Destroying aggregate states <--
    09:39.017961 [ 3070801 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 51.93 MiB.
    09:39.018029 [ 3070801 ] {} <Information> TCPHandler: Processed in 0.711 sec.

After this patch:
    16:24.544030 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Information> executeQuery: Read 1000000 rows, 7.63 MiB in 0.599 sec., 1670199 rows/sec., 12.74 MiB/sec.
    16:24.544084 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.544398 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.545485 [ 3087333 ] {79da208a-b3c0-48d4-9943-c974a3cbb6ea} <Trace> Aggregator: Destroying aggregate states
    16:24.547053 [ 3087333 ] {} <Debug> MemoryTracker: Peak memory usage (for query): 72.11 MiB.
    16:24.547093 [ 3087333 ] {} <Information> TCPHandler: Processed in 0.603 sec.
 2020-05-21 02:06:55 +03:00
Azat Khuzhin
d93b9a57f6 Forward declaration for Context as much as possible. 
Now after changing Context.h 488 modules will be recompiled instead of 582.
 2020-05-21 01:53:18 +03:00
Azat Khuzhin
58ffa4c59c Enable percpu_arena:percpu for jemalloc 
This will reduce memory fragmentation due to thread pool.
 2020-05-21 01:01:28 +03:00
Ivan Blinkov
7d0ac4e20f
trigger ci 2020-05-21 00:08:04 +03:00
Ivan Blinkov
ebef7b9a85
[website] ld+json for the front page (#11077) 
* [website] ld+json for the front page

* Update index.html

* Update index.html
 2020-05-21 00:01:18 +03:00
Nikolai Kochetov
bcd38ac207 Fix build. 2020-05-20 22:08:20 +03:00
Nikolai Kochetov
1183bad4d0 Fix build. 2020-05-20 22:01:36 +03:00
Nikolai Kochetov
6f50700f35 Add PullingOutputFormat and PullingPipelineExecutor. 2020-05-20 21:53:18 +03:00
alexey-milovidov
07924f0ae1
Merge pull request #11029 from azat/system_tables_lazy_load 
Disable system_tables_lazy_load by default
 2020-05-20 21:15:09 +03:00
Ivan Blinkov
84fda62e2c
[docs] minor translation update (#11072) 2020-05-20 21:13:03 +03:00
alexey-milovidov
a62e1834d2
Fix data rot @blinkov 2020-05-20 19:30:27 +03:00
Pavel Kovalenko
d98c1589ed Better error handling in Proxy Resolver. 2020-05-20 19:01:05 +03:00
Pavel Kovalenko
138154ba6a Fix memory-leak in registerDiskS3 during config->createView invocations. 2020-05-20 18:42:45 +03:00
Ilya Yatsishin
555087512a
Update debian/rules 
Co-authored-by: alesapin <alesapin@gmail.com>
 2020-05-20 18:28:44 +03:00
Nikolai Kochetov
fcf58fa4a1 Fix clang build. 2020-05-20 17:04:24 +03:00
Anton Popov
d62fe980ef Merge remote-tracking branch 'upstream/master' into modify-ttl 2020-05-20 16:52:30 +03:00
Vitaly Baranov
06d18a4378
Merge pull request #11050 from vitlibar/amosbird_betterdictget 
dictGet with table name
 2020-05-20 14:18:24 +03:00
alexey-milovidov
da33858d39 Update StorageSystemParts.cpp 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
02b52df86d Added delete_ttl_info_min and delete_ttl_info_max to system.parts. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
6f68979662 Switched system.parts.move_ttl_info to separate arrays. 2020-05-20 14:07:31 +03:00
Vladimir Chebotarev
3ed5d9434a Added move_ttl_info to system.parts. 2020-05-20 14:07:31 +03:00
Artem Zuikov
9b38324028
fix JOIN with PREWHERE with second analyze() (#11051) 2020-05-20 12:29:23 +03:00
Mikhail Filimonov
e8a13842af Better fix, previous fix was wrong (was leaving the cycle by eof condition) 2020-05-20 11:02:02 +02:00
alesapin
2673c985bd
Merge pull request #11002 from ClickHouse/zookeeper_in_tmpfs_intergration_tests 
Add ability to run zookeeper in integration tests with tmpfs
 2020-05-20 11:30:13 +03:00
alesapin
dc330ca7cb
Merge pull request #11037 from ClickHouse/alter_rename_and_modify 
Fix alter rename with different types of alter
 2020-05-20 11:28:13 +03:00
Ivan Blinkov
c450c0721d
Merge pull request #11064 from ClickHouse/dependabot/pip/docs/tools/mkdocs-macros-plugin-0.4.9 
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools
 2020-05-20 10:58:45 +03:00
dependabot-preview[bot]
2b8ccac084
Bump mkdocs-macros-plugin from 0.4.7 to 0.4.9 in /docs/tools 
Bumps [mkdocs-macros-plugin](https://github.com/fralau/mkdocs_macros_plugin) from 0.4.7 to 0.4.9.
- [Release notes](https://github.com/fralau/mkdocs_macros_plugin/releases)
- [Commits](https://github.com/fralau/mkdocs_macros_plugin/commits)

Signed-off-by: dependabot-preview[bot] <support@dependabot.com>
 2020-05-20 07:33:10 +00:00
BayoNet
5e84769c74
DOCS-628: Stable versions of statistical functions v2 (#11047) 
* CLICKHOUSEDOCS-628: Restore deleted changes.

* CLICKHOUSEDOCS-628: pillar

* CLICKHOUSEDOCS-628: Fixed grammar.

* CLICKHOUSEDOCS-628: Translated #8933

Co-authored-by: Sergei Shtykov <bayonet@yandex-team.ru>
 2020-05-20 08:35:51 +03:00
Anton Popov
bd3e7307d0 fix integration test 2020-05-20 01:43:16 +03:00
Ivan Blinkov
8eac46c79f
[docs] mark submitting feedback as Metrika goal (#11046) 2020-05-20 00:49:43 +03:00
Ivan Blinkov
994884399c
trigger ci 2020-05-20 00:47:48 +03:00
Nikolai Kochetov
7ba5419190 Update PipelineExecutor. 2020-05-19 23:24:06 +03:00
Alexander Kuzmenkov
bc34e0ff94 fixup 2020-05-19 23:12:10 +03:00
Vitaly Baranov
57bd7afc03 Fix passing dictionary's name to dictGet() with alias. 2020-05-19 21:17:29 +03:00
Amos Bird
ce3c53a00a dictGet* with table name 2020-05-19 20:33:45 +03:00
Mikhail Filimonov
34198336ed Style 2020-05-19 19:02:37 +02:00
Mikhail Filimonov
b50480cbde Fixes the potential missed data during termination of Kafka engine table 2020-05-19 18:55:37 +02:00
Ivan Blinkov
f18eedc5e7
[website] set sentry environment 2020-05-19 19:11:00 +03:00
alesapin
7d382cc7b5 Return missed command 2020-05-19 19:03:10 +03:00
Ivan Blinkov
b5620c070c
[docs] preprocess single-page html as well (#11045) 2020-05-19 18:47:00 +03:00
Nikolai Kochetov
6109e87aed Try fix compatibility. 2020-05-19 18:40:15 +03:00
Alexander Kuzmenkov
c3d9bb829b performance comparison 2020-05-19 18:28:03 +03:00
alesapin
a17f034271 Bump compose version to 2.3, and make tmpfs for zookeeper optional 2020-05-19 18:27:10 +03:00
Nikolai Kochetov
c147badf4f Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size 2020-05-19 18:24:21 +03:00
Ivan Blinkov
274a48c353
[website] parallel minify (#11043) 2020-05-19 18:11:23 +03:00