Commit Graph

747 Commits

Author SHA1 Message Date
hcz
f1e146d208 Fix parameter handling 2019-06-25 12:28:20 +08:00
alexey-milovidov
b43e75200e
Merge pull request #5595 from inv2004/moving-sum
movingSum/Avg window functions for numeric and decimals
2019-06-24 19:13:26 +03:00
alesapin
88b9bc6254 Merge branch 'patch-6' of https://github.com/hczhcz/ClickHouse into hczhcz-patch-6 2019-06-24 14:29:35 +03:00
proller
fa809de91f
Move all url functions to clickhouse_functions_url lib (#5696) 2019-06-20 18:49:54 +03:00
unknown
238c0e3b9b movingSum: uses template for groupArrayMovingSum and groupArrayMovingAvg 2019-06-18 10:18:33 -04:00
unknown
414bb21238 Merge remote-tracking branch 'upstream/master' into moving-sum 2019-06-17 19:09:58 -04:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
unknown
7dc95e17a4 movingSum : macros name + indent 2019-06-14 11:14:58 -04:00
hcz
0385e0923a Fix style 2019-06-14 21:20:21 +08:00
Alexey Milovidov
95c7537656 Merge branch 'lin_ref_perf' of https://github.com/Quid37/ClickHouse into Quid37-lin_ref_perf 2019-06-14 15:33:29 +03:00
unknown
0dab40404e movingSum format fix: trailing space 2019-06-13 12:18:32 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
2019-06-13 13:37:13 +03:00
unknown
1e56a5b7ac movingSum format 2019-06-12 20:03:55 -04:00
unknown
8028495f78 movingSum fix : deserialize restores sum field 2019-06-12 12:10:47 -04:00
hcz
45529d8489 Fix bugs 2019-06-12 16:25:29 +08:00
hcz
6b6f2293fc Change style 2019-06-12 15:48:40 +08:00
hcz
57db1fac59 Add aggregate function combinator Resample 2019-06-12 15:46:36 +08:00
unknown
d75c73ece2 movingSum with/or without window_size parameter for numeric and decimal types 2019-06-12 01:56:37 -04:00
alexey-milovidov
4ca476ec80
Merge pull request #5516 from yandex/fix-regression-models
Fix regression models
2019-06-05 08:07:18 +03:00
Георгий Кондратьев
2499cefdb9 DEVTOOLS-5507 Include roaring.h as roaring/roaring.h
This is needed to unbundle roaring. Its original cmake build system installs:

     /usr/include/roaring/roaring.h
     /usr/include/roaring/roaring.hh

and declares:

     set_target_properties(roaring::roaring PROPERTIES
       INTERFACE_INCLUDE_DIRECTORIES "/usr/include"
     )
2019-06-03 17:03:41 +00:00
Nikolai Kochetov
7cb3e3b251 Set default learnng_rate to 0.01. 2019-06-03 08:50:07 +03:00
Nikolai Kochetov
47f82dac72 Fix build. 2019-06-03 08:31:04 +03:00
Nikolai Kochetov
d224d3dcd2 Fix build. 2019-06-03 08:25:48 +03:00
Nikolai Kochetov
1034295f04 Fixed UInt32 overflow bug in linear models. Allow eval ML model for non-const model argument. 2019-06-03 08:11:15 +03:00
Alexander Kozhikhov
ba3d6c4b6c unique 2019-06-02 01:46:25 +03:00
Alexander Kozhikhov
dfea2dcd8f unique ptr 2019-06-02 01:44:25 +03:00
Alexander Kozhikhov
da8d49a67a shared to unique 2019-05-31 18:53:31 +03:00
Alexander Kozhikhov
73c07cb9d5 fix on lin_ref_perf 2019-05-31 18:39:17 +03:00
Alexander Kozhikhov
42f3ee2e2b conflict 2019-05-31 01:55:18 +03:00
Alexander Kozhikhov
0f222640d5 style 2019-05-31 01:53:56 +03:00
Alexander Kozhikhov
15fe367f83 few fixes 2019-05-31 01:48:44 +03:00
Alexander Kozhikhov
ef23528452 some changes and fixes on regression methods 2019-05-31 00:59:40 +03:00
Nikolai Kochetov
713ccd1f60 Added comment for IAggregateFunction::getReturnTypeToPredict(). Small code fixes. 2019-05-29 06:42:33 +03:00
Nikolai Kochetov
1c8b7dc96d
Merge pull request #5411 from Quid37/master
small changes on linear regression
2019-05-29 06:31:51 +03:00
Alexander Kozhikhov
b9c68cbf3a changes on return type of linearRegression 2019-05-27 23:18:14 +03:00
Alexander Kozhikhov
5cd85baec6 changes on return type of linearRegression 2019-05-27 23:14:23 +03:00
Sergi Vladykin
8c7b6137bc Code style fixed. 2019-05-26 13:02:48 +03:00
Sergi Vladykin
2be4721771 Merge branch 'master' of https://github.com/yandex/ClickHouse into bitmap1 2019-05-26 12:27:54 +03:00
Alexander Kozhikhov
dd259c408d Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-25 21:42:16 +03:00
Alexander Kozhikhov
0be0529b59 changes on lin reg 2019-05-25 21:41:58 +03:00
alexey-milovidov
6bb468b8c9
Merge pull request #5200 from hczhcz/patch-5
Add statistics functions: skewSamp, skewPop, kurtSamp, and kurtPop
2019-05-25 17:06:13 +03:00
alexey-milovidov
65957974b4
Update AggregateFunctionStatisticsSimple.h 2019-05-25 17:04:26 +03:00
Alexander Kozhikhov
7b235a312b Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-25 16:33:36 +03:00
alexey-milovidov
980c564db6
Merge pull request #5339 from sundy-li/feature/sequence64
Make sequenceMatch aggregate functions support other unsigned Integer types
2019-05-25 15:59:36 +03:00
Alexander Kozhikhov
464083803b redundant include 2019-05-25 12:44:11 +03:00
Alexander Kozhikhov
a63ad11ee7 LinearRegression without -State modifier now simply returns its weights 2019-05-25 02:18:44 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
alexey-milovidov
9d7754e332
Merge pull request #5391 from yandex/rename-regression-methods
Rename regression methods.
2019-05-24 13:01:50 +03:00
Nikolai Kochetov
54a52853e8 Remane regression methods. 2019-05-23 14:51:25 +03:00
sundy-li
ad539464b0 add empty judge 2019-05-22 14:11:27 +08:00
proller
6cb4485473
Rename aggregate functions TSgroup* to timeSeriesGroup* (#5307) 2019-05-21 18:33:54 +03:00
hcz
ba527dac20
Update AggregateFunctionStatisticsSimple.h 2019-05-21 16:17:12 +08:00
hcz
f7bad8c87b
Fix NaN 2019-05-21 16:10:49 +08:00
sundy-li
afcd60a0a4 add NO_SANITIZE_UNDEFINED 2019-05-21 10:16:46 +08:00
sundy-li
b55bf7cf83 whitespaces 2019-05-21 09:56:48 +08:00
sundy-li
66c60c2985 better tests 2019-05-20 12:31:52 +08:00
sundy-li
6843254ce4 Make sequenceMatch support other unsigned integer types 2019-05-20 12:02:54 +08:00
alexey-milovidov
02937294ce
Merge pull request #5311 from azat-archive/SimpleAggregateFunction-Arena-fix
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE
2019-05-19 13:12:38 +03:00
Azat Khuzhin
2f471d6ea3
Set allocatesMemoryInArena for SingleValueDataString to true
This includes next aggregate functions for String() type:
- *min*
- *max*
- *any*
2019-05-19 03:33:04 +03:00
alexey-milovidov
e73fc1bd0f
Merge pull request #5320 from sundy-li/feature/funnel64
Make windowFunnel support other Unsigned Integer Types
2019-05-18 23:47:12 +03:00
sundy-li
dcfdc09003 fix style 2019-05-18 09:34:55 +08:00
sundy-li
cbaca96926 remove spaces 2019-05-17 19:41:18 +08:00
sundy-li
4c95b9d007 modify createAggregateFunctionWindowFunnel 2019-05-17 19:31:29 +08:00
sundy-li
d3c4c1c255 modify createAggregateFunctionWindowFunnel 2019-05-17 19:30:09 +08:00
sundy-li
760bc5708d support unsigned integer type in windowFunnel Aggregate function 2019-05-17 19:17:52 +08:00
chertus
fdcbf509bb support quantile(s)ExactWeighted for Decimal 2019-05-16 17:33:13 +03:00
chertus
50c35a70db support quanitle, quantiles, median for Decimal 2019-05-16 15:53:33 +03:00
proller
0dd29e7c5b clang-format of AggregateFunctions/AggregateFunctionTSGroupSum.* 2019-05-15 19:27:44 +03:00
Yangkuan Liu
0760a3436f add AggregateFunction TSgroup{Rate}Sum (#4542) 2019-05-15 19:16:25 +03:00
proller
7cb8d46338
Fix build (move code from AggregateFunctionMLMethod.h) (#5266) 2019-05-14 22:52:29 +03:00
Alexander Kozhikhov
332a8a97ab style 2019-05-13 20:08:58 +03:00
Alexander Kozhikhov
9b4f322fd8 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-13 16:50:56 +03:00
Alexander Kozhikhov
79010b7c3c some review fixes 2019-05-13 16:49:53 +03:00
svladykin
22389d4eca Support for bitmapHasAny and bitmapHasAll functions. 2019-05-12 17:47:31 +03:00
hcz
cf95327cba Remove unused variables and add comment 2019-05-11 02:06:58 +08:00
hcz
4f3e164c73 Fix and add tests 2019-05-06 12:08:54 +08:00
hcz
d86d60297a Add skewness and kurtosis functions 2019-05-06 11:49:14 +08:00
alexey-milovidov
1d69a73424
Merge pull request #5119 from nicelulu/update_24
modification retention function
2019-04-29 04:51:18 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
821008736@qq.com
02e9cc8f2d fix retention function 2019-04-26 17:36:35 +08:00
alexey-milovidov
d2a4aa964d
Merge pull request #5026 from PerformanceVision/uniq_array
Add an optional max_size parameter to groupUniqArray
2019-04-24 14:34:39 +03:00
proller
ba4687e110
Cmake: dont use LINK_MODE (but use BUILD_SHARED_LIBS) (#5091) 2019-04-24 12:06:28 +03:00
alexey-milovidov
3db650861d
Update AggregateFunctionGroupUniqArray.h 2019-04-24 01:40:16 +03:00
hcz
3bbe57adac
Rename AggregateFunctionsStatisticsSimple.cpp to AggregateFunctionStatisticsSimple.cpp 2019-04-22 17:31:01 +08:00
Alexander Kozhikhov
6c7f2cbc37 asan 2019-04-21 19:08:55 +03:00
Alexander Kozhikhov
fd07c97097 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-21 18:43:29 +03:00
Alexander Kozhikhov
0bedabb5e4 review fixes 2019-04-21 17:44:39 +03:00
Alexander Kozhikhov
ef98afb6a6 review fixes 2019-04-21 17:42:37 +03:00
Alexander Kozhikhov
daf4690d37 review fixes 2019-04-21 17:32:42 +03:00
Alexander Kozhikhov
b6d2c9f4d2 some review fixes 2019-04-21 02:22:42 +03:00
Guillaume Tassery
a96e3c470e Reformate code for optional parameter for groupUniqArray 2019-04-17 17:24:02 +07:00
Guillaume Tassery
2a6ff2f240 Code refactoring for the new size parameter on the GroupUniqArray aggregation function 2019-04-15 18:32:43 +07:00
Guillaume Tassery
803675892b Handle merge operation for size parameter on groupUniqArray aggregation function 2019-04-15 16:09:52 +07:00
Alexander Kozhikhov
a2a9d4b513 style 2019-04-15 10:59:56 +03:00
Guillaume Tassery
857bccc981 Add a way to set a size parameter for groupUniqArray 2019-04-15 13:36:24 +07:00
Alexander Kozhikhov
9ed740e3ea style 2019-04-15 04:10:39 +03:00
Alexander Kozhikhov
19021e76bb style 2019-04-15 03:16:13 +03:00
Alexey Milovidov
985936995f Fixed Java programmer's error (found by PVS-Studio) 2019-04-10 23:15:44 +03:00
Alexander Kozhikhov
c93aae6741 linear regression 2019-04-09 01:40:37 +03:00
Alexander Kozhikhov
a9ae6d0681 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-09 00:01:28 +03:00
Alexander Kozhikhov
35a266c96a linear regression tests 2019-04-09 00:01:10 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Nikolai Kochetov
085c758dbd Avoid divizion by zero in leastSqr function. 2019-04-05 17:52:27 +03:00
Nikolai Kochetov
bb9958b0d7 Minor fixes for leastSqr. 2019-04-05 16:42:33 +03:00
Nikolai Kochetov
feb16eedd2 Merge branch 'master' of https://github.com/hczhcz/ClickHouse into hczhcz-master 2019-04-05 16:10:29 +03:00
Alexander Kozhikhov
f550304fa4 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-04-04 03:17:37 +03:00
Alexander Kozhikhov
b5f0414200 new test 2019-04-04 03:17:27 +03:00
Alexey Milovidov
67b6a8966b Attempt to make compositions with COWPtr more convenient 2019-03-25 20:56:18 +03:00
hcz
b74d3501e4
Fix style error 2019-03-23 20:20:40 +08:00
hcz
38ea75748c
Update AggregateFunctionLeastSqr.h 2019-03-22 15:57:33 +08:00
hcz
06bb9ad833
Update AggregateFunctionLeastSqr.cpp 2019-03-22 15:57:17 +08:00
olegkv
a4739c23fb
Update AggregateFunctionHistogram.h 2019-03-20 15:33:01 -04:00
Nikolai Kochetov
c166614173 Fix rare ubsan false positive error while deserializing empty array from StringRef with length = 0 and trash in data. 2019-03-19 14:11:05 +03:00
alexey-milovidov
93356b5190
Merge pull request #4702 from hczhcz/patch-3
Fix #4690
2019-03-16 20:55:24 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as
Implement and use method IAST::as<Derived>()
2019-03-15 23:22:46 +03:00
Ivan Lezhankin
61954d855d More reverts 2019-03-15 20:09:14 +03:00
hcz
c8dd9d2df9 Fix #4690 2019-03-15 16:33:59 +08:00
Alexey Milovidov
a459b2c298 Fixed insufficient type checking in hasAll, hasAny functions 2019-03-15 02:10:51 +03:00
Ivan Lezhankin
f64118030a Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-13 17:23:02 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
hcz
72bcbc76b1 Add aggregate function leastSqr 2019-03-13 15:22:57 +08:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived>
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
alexey-milovidov
edacebac21
Merge pull request #4634 from kirillDanshin/feature/topK-loadFactor
topK and topKWeighted now supports custom loadFactor
2019-03-11 03:41:55 +03:00
alexey-milovidov
86e7889622
Update AggregateFunctionTopK.h 2019-03-11 00:33:57 +03:00
alexey-milovidov
a16c16152d
Update AggregateFunctionTopK.cpp 2019-03-11 00:32:42 +03:00
Alexey Milovidov
ac4045c55d Fixed UB in topKWeighted aggregate function #4634 2019-03-11 00:31:10 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Kirill Danshin
698c022a52
topK and topKWeighted now supports custom loadFactor
Signed-off-by: Kirill Danshin <kirill@danshin.pro>
2019-03-09 08:27:40 +03:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Alexey Milovidov
9d89cc0fc1 Debugging PODArray 2019-03-08 06:23:02 +03:00
proller
89014b5480
Build fixes (#4591) 2019-03-05 13:15:47 +03:00
Vitaly Baranov
6edec1c63f Remove unnecessary 'this->'. 2019-03-04 22:46:05 +03:00
Vitaly Baranov
405a747ddc Fix compilation after changing SmallTable. 2019-03-04 22:45:51 +03:00
Vitaly Baranov
61e21d50e1
Merge pull request #4207 from andyyzh/bitmap_feature
Added bitmap function feature with roaring bitmap
2019-03-04 22:42:47 +03:00
Alexander Kozhikhov
6371b4021d changes in gradient_computer class 2019-03-03 13:21:12 +03:00
quid
3fa972e6b6 changes in weights updater 2019-03-03 11:46:36 +03:00
Alexey Milovidov
51ca51aa9e Merge branch 'master' into quantile-timing-ubsan-fix 2019-03-01 17:53:04 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Alexey Milovidov
610f9523b0 Addition to prev. revision 2019-02-26 22:34:32 +03:00
Masha
67b28c2240 Nesterov and Adam + tests 2019-02-26 08:12:16 +00:00
Alexey Milovidov
f02a834615 Fixed fuzz test in UBSan 2019-02-25 21:03:52 +03:00
Masha
e708983e9b Changed Linear Regression and test 2019-02-15 23:38:13 +00:00
Masha
d5753636bd Logistic Regression and new tests 2019-02-15 22:47:56 +00:00
Andy Yang
4d42a297ae Adjust to the latest IAggregateFunctionDataHelper 2019-02-14 19:51:13 +08:00
Andy Yang
4a4dbcd2c1 Merge remote-tracking branch 'origin' into bitmap_feature 2019-02-14 15:14:18 +08:00
Alexey Milovidov
a0b91077e7 Fixed -Wshadow-field-in-constructor (clang 8 warning) 2019-02-13 15:53:36 +03:00