Commit Graph

297 Commits

Author SHA1 Message Date
Pavel Kruglov
7acd85d2b1 Fix style error 2020-10-02 22:20:35 +03:00
Pavel Kruglov
f6f4285348 Improve quantileTDigest performance 2020-10-02 20:13:55 +03:00
detailyang
6e70f2ce7a bugfix:aggregate:fix boundingratio args check 2020-09-28 19:56:42 +08:00
Artem Zuikov
51ba12c2c3
Try speedup build (#14809) 2020-09-15 12:55:57 +03:00
alexey-milovidov
1e300d9119
Merge pull request #14562 from CurtizJ/fix-fuzz
Fix segfault in combinator -Resample
2020-09-08 23:53:14 +03:00
alexey-milovidov
a5499ab9d6
Merge pull request #14555 from 4ertus2/some
Hide symbols in nameless namespace
2020-09-08 19:55:56 +03:00
Anton Popov
ee218c354e fix segfault in combinator -Resample 2020-09-08 02:21:12 +03:00
Alexey Milovidov
e3924b8057 Fix "Arcadia" 2020-09-08 01:14:13 +03:00
Artem Zuikov
b3eafc1106 hide symbols in nameless namespace 2020-09-07 21:00:37 +03:00
Nikita Mikhaylov
5d9367aea4
Merge pull request #14411 from nikitamikhaylov/rank-corr
Merging #11769 (Rank Correlation Spearman)
2020-09-07 21:18:19 +04:00
Alexey Milovidov
1cee6d5a31 Check for array size overflow in topK #14452 2020-09-04 04:05:57 +03:00
Nikita Mikhaylov
cdb1f30630 style + fast test 2020-09-02 16:49:47 +03:00
Nikita Mikhaylov
7021f6edc1 better
(cherry picked from commit 81481f26b5)
2020-09-02 15:47:23 +03:00
Nikita Mikhaylov
e9a1f4a383 update ya.make
(cherry picked from commit e62043e83b)
(cherry picked from commit a850388e62)
2020-09-02 15:47:17 +03:00
Nikita Mikhaylov
eee19dada4 fixes + test
(cherry picked from commit 5daee1cae1)
(cherry picked from commit c3dfb8e838)
2020-09-02 15:47:09 +03:00
antikvist
a695344434 rank corr
(cherry picked from commit 649e4dd913)
(cherry picked from commit ae17810201)
2020-09-02 15:46:42 +03:00
antikvist
efc59d6686 rank corr
(cherry picked from commit 11c94bee69)
(cherry picked from commit 483409f2e1)
2020-09-02 15:46:29 +03:00
antikvist
e32887d300 rank corr
(cherry picked from commit 2815397a19)
(cherry picked from commit d244797def)
2020-09-02 15:45:59 +03:00
antikvist
950094c233 rank correlation
(cherry picked from commit f9dda1e13e)
(cherry picked from commit 2a7026cb0c)
2020-09-02 15:45:51 +03:00
antikvist
098561def3 welch t-test
(cherry picked from commit 5cd118dcee)
(cherry picked from commit 8f19270f8d)
2020-09-02 15:45:37 +03:00
antikvist
df668d6297 Rank Correlation
(cherry picked from commit 3009c3885b)
(cherry picked from commit 024ff439e7)
2020-09-02 15:45:31 +03:00
Artem Zuikov
d304d522cc
Refactoring: rename types to allow change bigint library (#14219) 2020-09-01 12:54:50 +03:00
Alexander Kuzmenkov
134aae89f3
Merge pull request #14110 from 4ertus2/decimal
Fix Decimal to Float conversion and toDecimal256() function
2020-08-31 17:08:49 +03:00
alexey-milovidov
f6f8dc9b8a
Merge pull request #13964 from zhang2014/fix/agg_combinator
Try fix IfAggCombinator with NullAggCombinator
2020-08-26 23:47:29 +03:00
Artem Zuikov
fe5db661ce fix decimal to float conversion and toDecimal256() 2020-08-26 15:26:12 +03:00
Azat Khuzhin
99db9341a2 Fix -Werror=type-limits in AggregateFunctionTimeSeriesGroupSum.h (size_t() >= 0)
gcc10 reports:

    In file included from ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.cpp:1:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h: In instantiation of ‘void DB::AggregateFunctionTimeSeriesGroupSumData<rate>::add(DB::UInt64, DB::Int64, DB::Float64) [with bool rate = true; DB::UInt64 = long unsigned int; DB::Int64 = long int; DB::Float64 = double]’:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:246:34:   required from ‘void DB::AggregateFunctionTimeSeriesGroupSum<rate>::add(DB::AggregateDataPtr, const DB::IColumn**, size_t, DB::Arena*) const [with bool rate = true; DB::AggregateDataPtr = char*; size_t = long unsigned int]’
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:239:10:   required from here
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:113:71: error: comparison of unsigned expression in ‘>= 0’ is always true [-Werror=type-limits]
      113 |         while (result[i].first > it_ss->second.dps.front().first && i >= 0)
          |                                                                     ~~^~~~
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h: In instantiation of ‘void DB::AggregateFunctionTimeSeriesGroupSumData<rate>::add(DB::UInt64, DB::Int64, DB::Float64) [with bool rate = false; DB::UInt64 = long unsigned int; DB::Int64 = long int; DB::Float64 = double]’:
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:246:34:   required from ‘void DB::AggregateFunctionTimeSeriesGroupSum<rate>::add(DB::AggregateDataPtr, const DB::IColumn**, size_t, DB::Arena*) const [with bool rate = false; DB::AggregateDataPtr = char*; size_t = long unsigned int]’
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:239:10:   required from here
    ../src/AggregateFunctions/AggregateFunctionTimeSeriesGroupSum.h:113:71: error: comparison of unsigned expression in ‘>= 0’ is always true [-Werror=type-limits]
2020-08-25 21:20:04 +03:00
Nikita Mikhaylov
7209809e29 get rid of virtual call 2020-08-24 14:54:04 +03:00
Winter Zhang
75af61ea95
Try fix style failure 2020-08-24 18:51:54 +08:00
zhang2014
63868aaed3 Try fix CI 2020-08-24 13:05:59 +08:00
bharatnc
64d848f5c8 fix gcc-9 build check error 2020-08-23 10:09:41 -07:00
bharatnc
dd3068e2bb fix file formatting 2020-08-23 10:09:41 -07:00
bharatnc
e1bf87019c add quantileExactLow & quantileExactHigh functions
This PR adds the quantileExactLow and quantileExactHigh
implementations which are equivalent to how the `median_low`
and `median_high` functions are implemented in python.

`median_low`: https://github.com/python/cpython/blob/master/Lib/statistics.py#L438
`median_high`: https://github.com/python/cpython/blob/master/Lib/statistics.py#L460
2020-08-23 10:09:41 -07:00
zhang2014
0e8cb96eb1 Try fix IfAggCombinator with NullAggCombinator 2020-08-22 22:57:46 +08:00
alexey-milovidov
cda85a7828
Update AggregateFunctionResample.h 2020-08-21 15:05:58 +03:00
Mikhail f. Shiryaev
622c2d7e45
Increase limit in -Resample combinator to 1M 2020-08-21 13:35:19 +02:00
Artem Zuikov
becc186c91
Add support for extended precision integers and decimals (#13097) 2020-08-19 14:52:17 +03:00
Azat Khuzhin
0eac96972c Fix topK/topKWeighted merge (wtih non-default parameters) 2020-08-16 22:32:56 +03:00
Alexey Milovidov
8c85ab3753 Fix error with batch aggregation and -Array combinator 2020-08-14 09:52:28 +03:00
Alexey Milovidov
350b8e87a7 Merge branch 'master' into fixed-hash-map-implicit-zero-6 2020-08-09 01:48:12 +03:00
Alexey Milovidov
edd89a8610 Fix half of typos 2020-08-08 03:47:03 +03:00
Alexey Milovidov
e3235e5b6e Fix build 2020-08-07 22:06:31 +03:00
Alexey Milovidov
476da6c1fe Slightly better 2020-08-07 03:35:13 +03:00
Alexey Milovidov
cf618c1e23 Remove false statements 2020-08-07 03:33:17 +03:00
Alexey Milovidov
733bd0ecec Fix error 2020-08-07 03:29:52 +03:00
Alexey Milovidov
5c1703bd6c Merge branch 'master' into fixed-hash-map-implicit-zero-6 2020-08-07 02:58:57 +03:00
alesapin
2ef491bc53 Fix moving sum segfault 2020-08-04 22:45:39 +03:00
Alexey Milovidov
6d5b9c36e0 Lower unroll count 2020-08-04 01:40:55 +03:00
Alexey Milovidov
e241df5541 Add warning suppression for gcc 2020-08-04 01:40:55 +03:00
Alexey Milovidov
373cd918fb Remove warning suppression 2020-08-04 01:40:55 +03:00
Alexey Milovidov
eb534ebee3 Fix warning 2020-08-04 01:40:55 +03:00
Alexey Milovidov
f29c0af9aa Simpler code 2020-08-04 01:40:55 +03:00
Alexey Milovidov
a9998746ea Added fully unrolled method 2020-08-04 01:40:55 +03:00
Alexey Milovidov
ba6d5d00d9 Apply one of the variants 2020-08-04 01:40:55 +03:00
alexey-milovidov
71d8cab08c
Merge pull request #12622 from ClickHouse/fix-group-array-moving
Fix various code defects in groupArrayMoving functions
2020-08-03 20:35:24 +03:00
alexey-milovidov
3015503dc6
Merge pull request #13254 from ClickHouse/fix-hash-table-nan-key
Fix hash table with NaN keys
2020-08-03 19:37:17 +03:00
Alexey Milovidov
486a4b3a17 Merge branch 'master' into fixed-hash-map-implicit-zero-4 2020-08-03 04:19:22 +03:00
Alexey Milovidov
23c268e5ef Continue 2020-08-03 03:01:23 +03:00
alexey-milovidov
1e91238466
Merge pull request #13225 from ClickHouse/map-skip-null
Fix assert in *Map aggregate functions
2020-08-03 02:12:48 +03:00
Alexey Milovidov
4d55376a59 Fix style 2020-08-02 17:22:53 +03:00
Alexey Milovidov
6f690b7c0d Normalize ya.make files, fix "Arcadia" build 2020-08-02 16:57:38 +03:00
Alexey Milovidov
eb3422477e Fix assert in *Map aggregate functions 2020-08-02 04:29:52 +03:00
Alexey Milovidov
1088bfffb1 Special case for aggregation by 8bit field 2020-08-02 01:11:00 +03:00
Alexey Milovidov
e3946ef878 More sane 2020-07-30 23:41:14 +03:00
Alexey Milovidov
833e1ab4e8 Remove ridiculous trash 2020-07-30 23:24:54 +03:00
Alexey Milovidov
9898f89c1a Fix various code defects in groupArrayMoving functions #12568 2020-07-21 14:03:50 +03:00
Alexey Milovidov
83b2db4e5b Fixup 2020-07-16 05:09:02 +03:00
Alexey Milovidov
cb0b74af86 Fix AggregateFunctionAvg serialization backwards compatibility 2020-07-14 11:56:01 +03:00
Alexey Milovidov
70273725d5 Fix error 2020-07-10 08:30:54 +03:00
Alexey Milovidov
c610a4b0a8 Fix error with ownership of aggregate function states with nested states 2020-07-10 08:28:34 +03:00
Alexey Milovidov
12e00411b4 Fix TOTALS/ROLLUP/CUBE for aggregate functions with -State and Nullable arguments #12163 2020-07-10 06:23:42 +03:00
Alexey Milovidov
f252dd94c8 Miscellaneous 2020-07-10 05:17:15 +03:00
Alexey Milovidov
7f3a8f3eb9 Fix bad code in redundant ORDER BY optimization #10067 2020-07-06 02:50:20 +03:00
Alexey Milovidov
96e8e93c64 Fix warnings from CodeQL 2020-07-05 02:16:16 +03:00
Alexey Milovidov
15cddc3c6e Make topK return Enum for Enum types 2020-06-30 02:17:20 +03:00
Alexey Milovidov
1462a66d1e Fix typos 2020-06-27 22:05:00 +03:00
Anton Popov
685d14863b tests with distributed 2020-06-26 01:39:54 +03:00
Anton Popov
14e09e5650 Merge remote-tracking branch 'upstream/master' into HEAD 2020-06-25 14:59:15 +03:00
Anton Popov
faa5d7e0f1 fix arcadia build 2020-06-24 13:01:44 +03:00
Anton Popov
3f0f0ff5ad add perf test for distinct combinator 2020-06-22 16:31:37 +03:00
Alexander Kuzmenkov
fbecf42dfc report the number of errors 2020-06-20 01:41:15 +03:00
Anton Popov
7a76abeb2a distinct combinator for function of multiuple arguments 2020-06-19 23:13:23 +03:00
antikvist
4660da3e5e welch t-test 2020-06-18 22:18:52 +03:00
Azat Khuzhin
2bd05baa7a Move AggregateFunctionCount out from clickhouse_aggregate_functions to dbms
As suggested by @alexey-milovidov
2020-06-18 11:22:40 +03:00
Anton Popov
fb7f4c6369 fix build 2020-06-18 02:42:40 +03:00
Anton Popov
8ba5bd8530 Merge remote-tracking branch 'upstream/master' into distinct-combinator 2020-06-18 01:44:36 +03:00
Anton Popov
88b325dcdc rework distinct combinator 2020-06-17 22:36:27 +03:00
antikvist
ae8ee1cbfa welch t-test 2020-06-17 22:22:26 +03:00
antikvist
d92160e734 welch t-test 2020-06-17 18:59:58 +03:00
antikvist
d0f92b5492 welch t-test 2020-06-17 18:43:22 +03:00
Alexander Tokmakov
eebfc9d2da fix build with clang-9 2020-06-17 16:19:15 +03:00
Anton Popov
5abbaeecf5 distinct combinator for single numeric arguments 2020-06-17 15:01:47 +03:00
Alexey Milovidov
e720d78f23 Fix tests 2020-06-17 03:08:01 +03:00
Alexey Milovidov
a655765040 Merge branch 'master' into return-not-nullable-from-count-distinct-2 2020-06-17 01:15:57 +03:00
antikvist
21c5ecb597 welch t-test 2020-06-16 22:58:06 +03:00
Anton Popov
d92ba0b216 Merge remote-tracking branch 'upstream/master' into distinct-combinator 2020-06-16 21:13:20 +03:00
Alexander Kuzmenkov
be008cd186 remove some code 2020-06-16 13:44:23 +03:00
antikvist
a7f8d6b380 welch t-test 2020-06-16 12:45:46 +03:00
antikvist
51ff2f4e92 welch t-test 2020-06-16 09:14:54 +03:00
antikvist
965bf4bd65 welch t-test 2020-06-16 01:38:35 +03:00
antikvist
f2b9d42ad2 Merge remote-tracking branch 'upstream/master' into welch
update
2020-06-16 00:49:21 +03:00
Alexander Kuzmenkov
7cc54fd4f1 renames + perf test 2020-06-15 21:53:54 +03:00
antikvist
ccce2537f6 welch t-test 2020-06-15 21:21:48 +03:00
antikvist
2f073ab3f7 welch t-test 2020-06-15 21:18:22 +03:00
Alexander Kuzmenkov
0743e8c15d Merge remote-tracking branch 'origin/master' into minmap 2020-06-15 19:39:57 +03:00
Alexey Milovidov
303d1ebdaf Fix error; more tests 2020-06-15 01:17:06 +03:00
Alexey Milovidov
c4f18d2896 Fix tests 2020-06-15 00:39:22 +03:00
antikvist
3b30ea2f37 welch t-test 2020-06-14 23:00:02 +03:00
Alexey Milovidov
394fb64a9c Better way of implementation 2020-06-14 20:42:11 +03:00
antikvist
9638eb7490 welch t-test 2020-06-14 19:18:04 +03:00
Alexey Milovidov
3958a032ac Added a test 2020-06-14 08:15:29 +03:00
antikvist
cb8eec8def welch t-test 2020-06-14 00:55:01 +03:00
antikvist
13faa3d83f welch t-test 2020-06-13 19:23:17 +03:00
Ildus Kurbangaliev
01d903c60d add minMap and maxMap functions 2020-06-13 08:49:00 +00:00
antikvist
bbfccd491e welch t-test 2020-06-12 16:51:33 +03:00
antikvist
1903e6cec2 pray to ClickHouse gods 2020-06-12 02:43:55 +03:00
antikvist
31a2fbed8c
Merge pull request #2 from antikvist/master
update welch to master
2020-06-12 01:38:35 +03:00
Alexey Milovidov
e40ee1a173 Return non-Nullable results from COUNT(DISTINCT) 2020-06-11 06:45:12 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
Alexander Kuzmenkov
7db8edf402
Merge pull request #11446 from ClickHouse/aku/better-error-messages
Improve error messages
2020-06-05 13:11:02 +03:00
Alexander Kuzmenkov
435f53e05a Improve error messages
Also support fmt for exception messages, the same way we use it in
logging macros.
2020-06-04 20:50:29 +03:00
Alexander Kuzmenkov
07e4bb7050 Remove assorted synonyms of LOGICAL_ERROR.
We don't need any special handling for them on the client, and, on the
contrary, have to handle them as logical errors in tests.
2020-06-03 16:18:42 +03:00
Nikolai Kochetov
8b1b96bfd8 Fix build. 2020-06-01 19:32:56 +03:00
Nikolai Kochetov
35190e3f56 Fix arguments for AggregateFunctionQuantile/ 2020-06-01 19:12:15 +03:00
Sofia Antipushina
3543da3ca4 fix stylecheck 2020-05-31 17:44:49 +03:00
Dmitry
4b0d32f026 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-31 00:21:02 +03:00
Dmitry
38c585f867 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-26 21:27:50 +03:00
Alexander Kuzmenkov
7142e68d7a fixup 2020-05-26 08:54:04 +03:00
Sofia Antipushina
f206d74b63 fix align of data && add test 2020-05-25 17:02:55 +03:00
Sofia Antipushina
7135b8491c Base memory data storage 2020-05-25 15:12:50 +03:00
Alexander Kuzmenkov
8d5bbed2de Merge remote-tracking branch 'origin/master' into HEAD 2020-05-25 06:44:11 +03:00
Alexey Milovidov
73a3394b3d Clarifications #10981 2020-05-23 17:28:22 +03:00
alexey-milovidov
34eb533842
Merge pull request #10981 from g-arslan/master
Try to remove redundant data move in radix sort
2020-05-23 15:55:35 +03:00
Dmitry
47778c0259 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-21 23:45:12 +03:00
Alexey Milovidov
581b2358de Added comment 2020-05-21 15:07:12 +03:00
Alexey Milovidov
3c763908c3 Added comment 2020-05-21 15:04:15 +03:00
g-arslan
95668def24 Try to remove redundant data move in radix sort 2020-05-21 15:00:55 +03:00
Alexander Kuzmenkov
50df893dc6 Assert that allocator & container are consistent wrt. inline memory
There are lots of places where HashTable is used with
AllocatorWithStackMemory, but the size of allocator inline memory is set
incorrectly, and it's less than the initial HashTable buffer size.
Because of this, HashTable is always allocated on the heap, and the
inline memory becomes a useless dead weight.

For PODArray, we have previously added a helper template that makes sure
these values are in sync, so there was only one such discrepancy left,
in the unit test.
2020-05-20 22:37:13 +03:00
Sofia Antipushina
d2aa881345 Merge branch 'master' of github.com:ClickHouse/ClickHouse 2020-05-18 13:41:03 +03:00
Alexey Milovidov
f5072aab18 Fix error 2020-05-18 08:01:55 +03:00
Alexey Milovidov
719a3b5a2c Performance improvement for "sum" over nullable 2020-05-18 07:49:51 +03:00
Alexey Milovidov
6f0c78dfdd Vectorize "sum" function 2020-05-18 06:50:53 +03:00
antikvist
6069750b0e #WelchTTest aggregate function implementation
What's new:
-Main classes for aggreagate function added.
-Data class with needed mathods added.
-Registered function in registerAggregateFunctions.h
2020-05-17 14:15:49 +03:00
antikvist
f6e6c48d9c #WelchTTest aggregate function implementation
What's new:
-Main classes for aggreagate function added.
-Data class with needed mathods added.
-Registered function in registerAggregateFunctions.h
2020-05-17 12:25:41 +03:00
Alexey Milovidov
3320fdce57 Fix error 2020-05-17 05:39:02 +03:00
Alexey Milovidov
e0aaddb262 Fixed error 2020-05-16 22:55:38 +03:00
Alexey Milovidov
a9f64b4c1c Ensure that the variance is nonnegative 2020-05-16 22:55:38 +03:00
Anton Popov
f4369381c9
Fix build 2020-05-16 18:00:33 +03:00
Sofia Antipushina
aeb195950c Checkstyle fix 2020-05-16 03:15:44 +03:00
Sofia Antipushina
7c6322c5b0 Add support for many columns 2020-05-16 02:06:25 +03:00
Sofia Antipushina
13224c22ab Stylecheck fix 2020-05-15 05:02:57 +03:00