Anton Popov
d2a8cd3ed4
fix performance regression
2023-03-14 14:51:28 +00:00
Anton Popov
6f3e4d4137
Merge pull request #46118 from CurtizJ/fix-issues-with-sparse
...
Randomize setting `ratio_of_defaults_for_sparse_serialization`
2023-03-05 22:28:18 +01:00
LiuNeng
d4c5ab9dcd
Optimize one nullable key aggregate performance ( #45772 )
2023-03-02 21:01:52 +01:00
Anton Popov
d926713cf5
Merge remote-tracking branch 'upstream/master' into HEAD
2023-02-23 23:04:22 +00:00
Anton Popov
3730ea388f
fix issues with sparse columns
2023-02-15 21:46:26 +00:00
Nikita Taranov
581f31ad3d
better
2023-01-30 17:11:56 +00:00
Nikita Taranov
a18343773f
improve perf
2023-01-30 17:11:56 +00:00
Alexander Tokmakov
70d1adfe4b
Better formatting for exception messages ( #45449 )
...
* save format string for NetException
* format exceptions
* format exceptions 2
* format exceptions 3
* format exceptions 4
* format exceptions 5
* format exceptions 6
* fix
* format exceptions 7
* format exceptions 8
* Update MergeTreeIndexGin.cpp
* Update AggregateFunctionMap.cpp
* Update AggregateFunctionMap.cpp
* fix
2023-01-24 00:13:58 +03:00
Nikita Taranov
006fdd32d4
Apply preallocation optimisation more carefully ( #44455 )
...
* impl
* add perf test
* fix
* review fixes
2023-01-09 13:30:48 +01:00
Vladimir C
7482ea54ab
Merge pull request #43972 from ClickHouse/vdimir/tmp-data-in-fs-cache-2
2022-12-23 11:59:27 +01:00
vdimir
182b34c11e
Fixes
2022-12-22 10:22:57 +00:00
Dmitry Novik
3d2fccab87
Merge branch 'master' into refector-function-node
2022-12-12 21:36:39 +01:00
Nikita Taranov
9e2265a6ed
Improve hash table preallocation optimisation ( #43945 )
...
* do not preallocate if max_size_to_preallocate_for_aggregation is too small
* skip optimisation for aggr without key
* increase default for max_size_to_preallocate_for_aggregation
2022-12-08 00:05:15 +01:00
Dmitry Novik
25ecb75ca8
Merge remote-tracking branch 'origin/master' into refector-function-node
2022-12-07 18:36:50 +00:00
Nikolai Kochetov
0ed82f3cc0
Merge branch 'master' into aggregating-in-order-from-query-plan
2022-12-06 16:36:49 +01:00
Dmitry Novik
2c70dbc76a
Refactor FunctionNode
2022-12-02 19:15:26 +00:00
Alexander Tokmakov
e45105bf44
detach threads from thread group
2022-11-28 21:31:55 +01:00
Nikolai Kochetov
6d0646ed8f
Merge branch 'master' into aggregating-in-order-from-query-plan
2022-11-28 16:53:29 +01:00
Nikolai Kochetov
1dfa188c7a
Add order info for aggregating step in plan. Added test.
2022-11-28 15:15:36 +00:00
Nikita Taranov
7beb58b0cf
Optimize merge of uniqExact without_key ( #43072 )
...
* impl for uniqExact
* rm unused (read|write)Text methods
* fix style
* small fixes
* impl for variadic uniqExact
* refactor
* fix style
* more agressive inlining
* disable if max_threads=1
* small improvements
* review fixes
* Revert "rm unused (read|write)Text methods"
This reverts commit a7e7480584
.
* encapsulate is_able_to_parallelize_merge in Data
* encapsulate is_exact & argument_is_tuple in Data
2022-11-17 13:19:02 +01:00
taojiatao
721e85a03e
minor fix error msg, repalce outdated func name
2022-11-04 11:27:10 +08:00
Azat Khuzhin
4e76629aaf
Fixes for -Wshorten-64-to-32
...
- lots of static_cast
- add safe_cast
- types adjustments
- config
- IStorage::read/watch
- ...
- some TODO's (to convert types in future)
P.S. That was quite a journey...
v2: fixes after rebase
v3: fix conflicts after #42308 merged
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:19 +02:00
Duc Canh Le
c05429574d
add exception
2022-10-17 08:59:39 +08:00
Duc Canh Le
5526e05aac
remove junk log
2022-10-16 17:19:40 +08:00
Duc Canh Le
9e9e967f1f
choose correct aggregation method for lc128 and lc512
2022-10-16 16:57:15 +08:00
vdimir
0178307c27
Followup for TemporaryDataOnDisk
2022-10-12 15:25:23 +02:00
Alexander Tokmakov
4175f8cde6
abort instead of __builtin_unreachable in debug builds
2022-10-07 21:49:08 +02:00
Raúl Marín
adbaaca2f5
QOL log improvements ( #41947 )
...
* Uniformize disk reservation logs
* Remove log about destroying stuff that appears all the time
* More tweaks on disk reservation logs
* Reorder logs in hash join
* Remove log that provides little information
* Collapse part removal logs
Co-authored-by: Sergei Trifonov <sergei@clickhouse.com>
2022-10-06 14:22:44 +02:00
vdimir
0605f6ed7f
fix after rebase
2022-09-29 09:51:48 +00:00
vdimir
6f8e8b979d
Revert "wip"
...
This reverts commit 46e4f0236df9a6f7b03d40278e583bc93b96559a.
2022-09-29 09:51:47 +00:00
vdimir
74d45325b3
wip
2022-09-29 09:51:46 +00:00
vdimir
9f3f34548c
Allow to create temporaty streams on leaf TemporaryDataOnDisk
2022-09-29 09:51:45 +00:00
vdimir
a56a10f089
Do not require tmp_data in Aggregator
2022-09-29 09:51:42 +00:00
vdimir
15c7a3be34
Temp data on disk: build
2022-09-29 09:51:41 +00:00
vdimir
c0898ce289
Use abstraction for temporary data on disk in Sort and Aggregation
2022-09-29 09:51:41 +00:00
vdimir
ac39bbb3f1
[wip] Common interface for temporary data on disk
2022-09-29 09:51:40 +00:00
Alexey Milovidov
45afacdae4
Merge pull request #41186 from ClickHouse/fix-three-fourth-of-trash
...
Fix more than half of the trash
2022-09-22 07:28:26 +03:00
Nikita Taranov
100c055510
Prefetching in aggregation ( #39304 )
...
* impl
* stash
* clean up
* do not apply when HT is small
* make branch static
* also in merge
* do not hardcode look ahead value
* fix
* apply to methods with cheap key calculation
* more tests
* silence tidy
* fix build
* support HashMethodKeysFixed
* apply during merge only for cheap
* stash
* fixes
* rename method
* add feature flag
* cache prefetch threshold value
* fix
* fix
* Update HashMap.h
* fix typo
* 256KB as default l2 size
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2022-09-21 18:59:07 +02:00
Alexey Milovidov
45bd3cfc30
Merge branch 'master' into fix-three-fourth-of-trash
2022-09-20 21:27:41 +02:00
Alexey Milovidov
ab4db2d0c4
Fix 5/6 of trash
2022-09-19 08:50:53 +02:00
avogar
c9a9ef5b7e
Fix comments
2022-09-16 16:12:30 +00:00
avogar
f1a0501eb2
Fix memory leaks and segfaults in combinators
2022-09-14 18:01:49 +00:00
Alexey Milovidov
193cd1b3b2
Merge pull request #39138 from nickitat/control_block_size_in_aggregator
...
Control block size in aggregator
2022-09-04 04:51:00 +03:00
vdimir
91788f29e8
Upd TemporaryFileOnDisk
2022-08-24 16:15:54 +00:00
vdimir
7194df1184
Move back TemporaryFile -> TemporaryFileOnDisk
2022-08-24 16:14:11 +00:00
vdimir
51c44424cc
More metrics for temp files
2022-08-24 16:14:09 +00:00
vdimir
cd4038d511
Use TemporaryFileOnDisk instead of Poco::TemporaryFile
2022-08-24 16:14:08 +00:00
vdimir
1321ac87b5
Minor fixes
2022-08-24 16:14:07 +00:00
Nikita Taranov
b31342ec2c
fix
2022-08-22 19:29:48 +02:00
Nikita Taranov
a6c4f9218a
clean up
2022-08-16 18:56:22 +02:00