thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-12 17:32:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
92,023 Commits 9,328 Branches 1,783 Tags 2.1 GiB
8ba3d405de
Commit Graph

772 Commits

Author SHA1 Message Date
Nikolai Kochetov
a8c3b02598 Merge branch 'master' into rewrite-pushing-to-views 2021-09-17 15:38:11 +03:00
Nikolai Kochetov
58bb5fe462 Fix some tests. 2021-09-17 14:40:03 +03:00
Nikolai Kochetov
341553febd Fix build. 2021-09-16 20:40:42 +03:00
Anton Popov
eef436fe22 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-16 18:07:42 +03:00
Anton Popov
3adc2a9aea fix distinct with sparse columns 2021-09-16 15:52:59 +03:00
Anton Popov
f6191b98e7 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-15 17:47:22 +03:00
Anton Popov
fc17936c12 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-14 23:02:30 +03:00
Nikolai Kochetov
0e267c50b4 Merge branch 'master' into rewrite-pushing-to-views 2021-09-14 16:13:54 +03:00
vdimir
1fdbb9509f
Add additional checkTypesOfKeys to JoiningTransform::transformHeader 2021-09-14 11:03:22 +03:00
mergify[bot]
d731bf6c4d
Merge branch 'master' into compressed_output_formats_3473 2021-09-13 09:14:35 +00:00
alexey-milovidov
aa5c42b7db
Merge pull request #28773 from azat/nth_value-ubsan-fix 
Fix signed integer overflow for nth_value() window function
 2021-09-12 15:57:19 +03:00
alexey-milovidov
f066edc43c
Merge pull request #28910 from ClickHouse/fix-trash-optimization 
Fix bad optimization of ORDER BY in subquery if it contains WITH FILL
 2021-09-12 15:27:53 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum 
Improving CH type system with concepts
 2021-09-12 15:26:29 +03:00
Alexey Milovidov
e3611cccce Fix yet another issue 2021-09-12 02:55:53 +03:00
Mike Kot
bce011cb33 Replacing IsDecimalNumber 2021-09-11 00:40:18 +02:00
Azat Khuzhin
a764d46f62 Eliminate int64_t > INT64_MAX checks (found by PVS) 
https://clickhouse-test-reports.s3.yandex.net/28773/b38311538979c0ffe27f6c8c5732b4afc18c4d35/pvs_check.html#fail1
 2021-09-10 23:31:41 +03:00
Azat Khuzhin
56ac032413 Use the same error for leadInFrame()/lagInFrame() as in nth_value() 2021-09-10 23:27:36 +03:00
Azat Khuzhin
b383115389 Allow values up to INT64_MAX for nth_value/lagInFrame/leadInFrame 2021-09-10 21:02:06 +03:00
Azat Khuzhin
62a29420bd Fix signed integer overflow for nth_value() window function 
CI report [1]:

    ../src/Processors/Transforms/WindowTransform.cpp:1699:54: runtime error: signed integer overflow: -9223372036854775808 - 1 cannot be represented in type 'long' Received signal -3 Received signal Unknown signal (-3)

In query:

    SELECT
        number,
        nth_value(number, 2147483648) OVER w,
        anyOrNull(number) OVER (ORDER BY -2147483648 - intDiv(number, 1024) DESC NULLS FIRST, number DESC ROWS BETWEEN 65535 FOLLOWING AND UNBOUNDED FOLLOWING),
        nth_value(number, 65537) OVER w AS firstValue,
        nth_value(number, -9223372036854775808) OVER w AS secondValue,
        nth_value(number, 1048576) OVER w AS thirdValue
    FROM numbers(1)
    WINDOW w AS (ORDER BY number DESC)
    ORDER BY number DESC

  [1]: https://clickhouse-test-reports.s3.yandex.net/28532/7623af5513e12aa8dfa1bee963caffe00185c31a/fuzzer_ubsan/report.html#fail1
 2021-09-10 21:02:04 +03:00
Filatenkov Artur
acccb24ffd
Update getSourceFromFromASTInsertQuery.cpp 2021-09-10 19:59:17 +03:00
Filatenkov Artur
e17353750c
Update src/Processors/Transforms/getSourceFromFromASTInsertQuery.cpp 
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2021-09-10 18:02:15 +03:00
Artur
a7c43c3e2d add compression key-word and some tests 2021-09-10 13:59:22 +00:00
Nikolai Kochetov
285cfb7fd5 Fix build and style. 2021-09-10 14:42:52 +03:00
Anton Popov
5cff615eca Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-10 13:40:48 +03:00
Anton Popov
29f327fa60 fix data race in async inserts 2021-09-10 13:24:09 +03:00
Nikolai Kochetov
f569a3e3f7 Merge branch 'master' into rewrite-pushing-to-views 2021-09-09 20:30:23 +03:00
Nikolai Kochetov
50562da6df More refactoring. 2021-09-09 20:08:49 +03:00
Anton Popov
8cb02a4b27 add some comments 2021-09-09 19:10:53 +03:00
Nikolai Kochetov
47b96add9a Refactor some code. 2021-09-09 16:59:15 +03:00
Nikolai Kochetov
aea1871755 Fix some more tests. 2021-09-09 14:16:03 +03:00
Anton Popov
4c388e3d84 Merge remote-tracking branch 'origin/sparse-serialization' into HEAD 2021-09-09 14:10:16 +03:00
Anton Popov
8203bd1ac6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-09 14:04:37 +03:00
Amos Bird
91293c7449
Fix crash on exception with projection aggregate 2021-09-09 10:43:56 +08:00
Nikolai Kochetov
999a4fe831 Fix other tests. 2021-09-08 21:29:38 +03:00
Nikolai Kochetov
f34cb097d8 Fix some tests. 2021-09-06 23:13:06 +03:00
Mike Kot
8e9aacadd1 Initial: replacing hardcoded toString for enums with magic_enum 2021-09-06 16:24:03 +02:00
Nikolai Kochetov
66a76ab70f Rewrite PushingToViewsBlockOutputStream part 6 2021-09-03 20:29:36 +03:00
Anton Popov
5e421ab272 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-02 02:42:50 +03:00
vdimir
bb1d22aa19
Log join input and output structure 2021-08-30 16:33:01 +03:00
Anton Popov
e8ac8e3454 execute asynchronous inserts separatly for each client 2021-08-27 06:00:12 +03:00
Anton Popov
6d3274c22c Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-26 03:31:46 +03:00
Anton Popov
61239343e3 Merge remote-tracking branch 'origin/sparse-serialization' into HEAD 2021-08-20 16:33:30 +03:00
Anton Popov
c3c3a06078 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-20 01:45:38 +03:00
Alexander Kuzmenkov
2f0d5c6f21
Merge pull request #27880 from ClickHouse/aku/window-case-insensitive 
make the sql-standard window functions case insensitive
 2021-08-20 00:20:30 +03:00
Alexander Kuzmenkov
9013892a96 make the sql-standard window functions case insensitive 2021-08-19 20:56:16 +03:00
Kruglov Pavel
7fe7103e53
Merge pull request #27299 from vdimir/issue-27091-v2 
Refactor NotJoined
 2021-08-19 19:16:32 +03:00
Nikolai Kochetov
3e44ef437e
Merge pull request #26639 from ClickHouse/fix-bad-cast 
Fix bad cast
 2021-08-19 11:17:26 +03:00
tavplubix
9b45b26dd6
Merge pull request #27655 from FArthur-cmd/import_from_infile_syntax 
Import `FROM INFILE`
 2021-08-18 15:36:32 +03:00
Nikolai Kochetov
a46fe11e2c Try fix test_mutations_with_merge_background_task 2021-08-18 13:30:02 +03:00
tavplubix
baaaf996c2
Update getSourceFromFromASTInsertQuery.cpp 2021-08-17 21:15:44 +03:00
Filatenkov Artur
3fc0e577e3
remove trailing whitespaces 2021-08-17 17:22:38 +03:00
vdimir
2dfbbe364b
Do not use BlockInputStream for NonJoined 2021-08-17 16:30:01 +03:00
Artur
e8e650b16b correct infile form local 2021-08-17 12:01:31 +00:00
vdimir
afa748c717
Refactor NotJoined pt1 2021-08-17 13:32:16 +03:00
Artur
ca65b819d3 correct error type 2021-08-16 16:09:12 +00:00
Artur
3591c3c8f4 correct code according to comments 2021-08-16 13:28:39 +00:00
Kseniia Sumarokova
b024c215af
Merge pull request #24757 from zdikov/subquery-operators 
Subquery operators
 2021-08-15 21:33:59 +03:00
kssenii
f66e8464f9 Some final fixes 2021-08-15 11:40:30 +03:00
kssenii
f125fb3fef Some fixes around any/all 2021-08-14 20:33:03 +03:00
kssenii
47fb923975 Some fixes, more tests 2021-08-13 15:07:44 +03:00
kssenii
a549e29bd4 Better 2021-08-12 16:35:46 +03:00
Nikolai Kochetov
beed4c21a5 Use processors in Storage::watch 2021-08-11 20:28:54 +03:00
kssenii
2306fbe9be Better 2021-08-10 10:23:18 +03:00
kssenii
4eb4dd97d4 Support not only 2 inputs, support any size sequence of intersect / except together 2021-08-10 09:24:12 +03:00
Alexander Kuzmenkov
2259387f0c make it possible to cancel window functions on ctrl+c 2021-08-09 20:04:42 +03:00
kssenii
5abe33e1a3 Better 2021-08-08 20:12:12 +03:00
Anton Popov
78dbcaea54 implement async inserts with processors 2021-08-08 06:30:14 +03:00
kssenii
729eba52ea Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into zdikov-subquery-operators 2021-08-07 15:59:58 +00:00
Mikhail Filimonov
31a9b6d5ca
Less clock_gettime calls 2021-08-06 17:38:55 +02:00
Anton Popov
3a0d4807a5 Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557 2021-08-06 16:20:02 +03:00
Anton Popov
e36736b50c Merge remote-tracking branch 'origin/sparse-serialization' into HEAD 2021-08-02 22:52:02 +03:00
Anton Popov
16ed0f6ed4 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 17:55:17 +03:00
Anton Popov
cc3ed12ed6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 02:56:00 +03:00
Alexander Kuzmenkov
4b9cf024f5
Merge pull request #26960 from ClickHouse/aku/window-partition-boundary 
fix window function partition boundary search
 2021-07-30 13:25:54 +03:00
kssenii
58b3a3f3fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into versioning 2021-07-29 19:56:27 +00:00
Alexander Kuzmenkov
7ba61f0bd8 more checks 2021-07-29 16:21:24 +03:00
Alexander Kuzmenkov
a37d7bc070 typo 2021-07-29 15:50:48 +03:00
Alexander Kuzmenkov
55e1d1b592 the reference was correct after all, I just confused the sides of the 
diff
 2021-07-29 15:49:37 +03:00
Alexander Kuzmenkov
7c9467d7a7 fix window function partition boundary search 
It was horribly broken and many test references were wrong. I'm
surprised I never noticed this.
 2021-07-29 15:18:10 +03:00
Nikolai Kochetov
97bc754dd8
Merge pull request #26758 from ClickHouse/output-streams-to-processors 
Remove some output streams
 2021-07-27 17:19:26 +03:00
Alexander Kuzmenkov
7e737d9568
Merge pull request #26334 from ryzuo/ryzuo 
Implementation of window function nth_value
 2021-07-27 15:02:29 +03:00
Nikolai Kochetov
9b5a816b43 Merge branch 'master' into output-streams-to-processors 2021-07-26 18:03:11 +03:00
ryzuo
0e742487f1 Remove unnecessary emtpy argument check for nth_value as code review suggested 2021-07-26 13:31:45 +08:00
alexey-milovidov
dab9cfb9c9
Merge pull request #26713 from ClickHouse/remove-more-and--more-streams 
Remove more streams.
 2021-07-24 02:24:10 +03:00
Nikolai Kochetov
9c92f43359 Update storages. 2021-07-23 22:33:59 +03:00
Alexander Kuzmenkov
9465e5d191
Merge pull request #26701 from ClickHouse/aku/window-debug 
more debug checks for window functions
 2021-07-22 23:09:29 +03:00
Nikolai Kochetov
3c17a62686
Merge pull request #26590 from ClickHouse/remove-some-more-streams 
Remove some streams.
 2021-07-22 21:28:50 +03:00
ryzuo
4d36d54c81 Update the implementaion of nth_value 
Make nth_value for nullable values for out of frame rows, as the same
fashion as lagInFrame just does.
 2021-07-23 00:34:08 +08:00
Nikolai Kochetov
f56a45155f Merge branch 'master' into remove-more-and--more-streams 2021-07-22 19:10:39 +03:00
Nikolai Kochetov
fd754430eb Remove more streams. 2021-07-22 19:05:52 +03:00
Alexander Kuzmenkov
19ee914e90 more debug checks for window functions 2021-07-22 15:17:49 +03:00
Alexander Kuzmenkov
60ca9990e5
Merge pull request #26668 from ClickHouse/aku/window-materialize 
materialize all columns in window transform
 2021-07-22 13:42:36 +03:00
ryzuo
94d4fb9dfc Cleanup the incomplete fix of nullability return value of lagInFrame/leadInFrame 2021-07-22 10:37:29 +08:00
ryzuo
df9ec5655c Add missing test back in 01591_window_function 2021-07-22 10:30:10 +08:00
ryzuo
4eb053a303 Implementaion of window function nth_value. 
1. Implemented the window function nth_value
2. Make the return type of lag/lead, and nth_value functions to be
ColumnNullable, thus the returned value can be null if it is out
of frame.
 2021-07-22 10:19:19 +08:00
Nikolai Kochetov
f38de35b14 Rename some constants. 2021-07-21 19:13:17 +03:00
Alexander Kuzmenkov
7f0fec6d5d materialize all columns in window transform 2021-07-21 16:06:50 +03:00
Alexander Kuzmenkov
94008b3199 remove print 2021-07-21 14:52:10 +03:00
Alexander Kuzmenkov
ff084e662c add more debug to window transform 
The idea of working with input chunks with different structures doesn't
seem sane. Assert that they are totally equal.
 2021-07-21 14:50:22 +03:00
Alexander Kuzmenkov
6ae4031723
Merge pull request #26521 from ClickHouse/aku/lag-in-frame-nullable 
fix lagInFrame for nullable types
 2021-07-21 14:10:16 +03:00
Alexander Kuzmenkov
a197511a96 fixes 2021-07-21 01:36:15 +03:00
Anton Popov
f99374cca6 Merge remote-tracking branch 'origin/sparse-serialization' into HEAD 2021-07-20 18:20:21 +03:00
Anton Popov
c4b454494f Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-20 15:41:01 +03:00
Alexander Kuzmenkov
61a01782a6 fix lagInFrame for nullable types 2021-07-19 19:31:57 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32 
Continuation of #25774
 2021-07-18 21:44:45 +03:00
Alexey Milovidov
261a220227 Remove some code 2021-07-17 21:06:46 +03:00
Anton Popov
c45a9e3bd6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-16 17:11:34 +03:00
Alexey Milovidov
58f2f344ad Whitespaces 2021-07-16 10:53:30 +03:00
Vladimir
c8ead44c23
Merge pull request #26374 from vdimir/infinite-pmj-fix 2021-07-16 09:50:44 +03:00
vdimir
398eb9f34a
Cleanup JoiningTransform::readExecute 2021-07-15 18:01:20 +03:00
kssenii
3ba2d114d5 Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32" 
This reverts commit 94a210650f, reversing
changes made to 0893b9ff8e.
 2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283" 2021-07-15 10:53:35 +03:00
alexey-milovidov
96030dc2d7
Merge pull request #26250 from vdimir/issue-26017-join-totals-key 
Fix block structure mismatch in join totals
 2021-07-15 08:03:37 +03:00
vdimir
b49e37aa07
Rewrite join totals, fix block structure mismatch 2021-07-14 13:02:23 +03:00
Anton Popov
19d0f1bbfc Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-13 16:12:08 +03:00
Anton Popov
072e65b728 Merge remote-tracking branch 'origin/sparse-serialization' into HEAD 2021-07-07 17:20:38 +03:00
Anton Popov
14168b11f2 Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-07 17:05:11 +03:00
NengLiu
dc0c65ef4f Merge remote-tracking branch 'origin/master' into datatype-date32 2021-07-05 10:15:08 +08:00
Anton Popov
fa8ad1a7c6 reduce memory usage in queries with 'ORDER BY primary_key' 2021-06-25 19:23:41 +03:00
Anton Popov
447fef702d fix fuzzer in query with 'WITH FILL' and 'WITH TOTALS' 2021-06-22 16:08:12 +03:00
Neng Liu
7ed1728a37 Merge branch 'master' into datatype-date32 
# Conflicts:
#	src/DataTypes/IDataType.h
#	src/Functions/CustomWeekTransforms.h
 2021-06-22 10:00:18 +08:00
Anton Popov
567043113c Merge remote-tracking branch 'upstream/master' into HEAD 2021-06-21 01:36:06 +03:00
Neng Liu
b6eab5fd2f add datetype32 function support 2021-06-17 16:05:30 +08:00
Maksim Kita
67e9b85951 Merge ext into common 2021-06-16 23:28:41 +03:00
Anton Popov
7e9b13199a dynamic columns: improve performance of parsing json data 2021-06-12 18:13:13 +03:00
Alexey Milovidov
885ce194e0 Making fundamentals correct 2021-06-07 00:49:55 +03:00
Anton Popov
018a303387 Merge remote-tracking branch 'upstream/master' into HEAD 2021-05-31 23:08:04 +03:00
kssenii
d18609467b First version 2021-05-30 13:57:30 +00:00
Kirill Ershov
42f6314c9a
Add INTERSECT and EXCEPT 2021-05-29 22:51:58 +03:00
Kirill Ershov
3f9e9a7025
Add INTERSECT and EXCEPT 2021-05-29 22:41:46 +03:00
Vladimir
fc15cad7e0
Pass Settings to aggregate function creator 2021-05-26 14:58:31 +03:00
Vladimir
7224e25156
Revert "Pass Settings to aggregate function creator" 2021-05-26 14:46:42 +03:00
Vladimir
6650c67b01
Merge pull request #22762 from vdimir/create-aggregate-func-settings 2021-05-26 14:32:14 +03:00
Anton Popov
3e92c7f61a Merge remote-tracking branch 'upstream/master' into HEAD 2021-05-25 21:45:19 +03:00
Anton Popov
de4afb0cb9 ColumnSparse: add comments 2021-05-21 03:57:11 +03:00
Amos Bird
07b1be5a76
Fix distributed processing when using projection 2021-05-16 22:40:06 +08:00
Anton Popov
5c7371333e fix bugs in serializations after merge 2021-05-15 02:20:00 +03:00
Anton Popov
d8df0903b9 Merge remote-tracking branch 'upstream/master' into HEAD 2021-05-14 23:38:16 +03:00
Amos Bird
a113acc40c
Fix empty key 2021-05-14 22:54:14 +08:00
Nikolai Kochetov
bc4ccdece6 Fix tests. 2021-05-13 21:07:47 +03:00
Nikolai Kochetov
d78be51fb4 Calculate header for ActionsDAG 2021-05-13 16:38:18 +03:00
Anton Popov
46ce4b7a88
Merge pull request #24016 from MaxWk/order-by-with-fill-datetime64 
support for order by fill with DateTime64
 2021-05-12 14:44:36 +03:00
万康
aa43d3cff9 fix tests and code style 2021-05-12 11:44:45 +08:00
万康
36fc6432ce support for order by fill with DateTime64 2021-05-11 21:03:32 +08:00
Nikolai Kochetov
a7d717d767 Remove unused code. 2021-05-11 14:59:56 +03:00
Amos Bird
51d685bb9c
Even more fixes 2021-05-11 18:12:29 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster. 2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage 2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections 
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
 2021-05-11 18:12:23 +08:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings 2021-05-11 11:18:24 +03:00
alexey-milovidov
1ea637d996
Merge pull request #23970 from ClickHouse/pvs-studio-fixes-6 
PVS-Studio fixes, part 6
 2021-05-09 21:45:19 +03:00
Alexey Milovidov
9753ddc8a0 Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint 2021-05-09 18:54:29 +03:00
Alexey Milovidov
aa25ffa9e3 Fix error 2021-05-08 21:15:23 +03:00
Alexey Milovidov
52bea2630b Fix error 2021-05-08 21:15:00 +03:00
Alexey Milovidov
3025f9e141 More fixes for PVS-Studio 2021-05-08 19:12:49 +03:00
Alexey Milovidov
022667a190 Fix some PVS-Studio warnings 2021-05-08 19:12:19 +03:00
Alexey Milovidov
8d62c42eb9 A bunch of changes for PVS-Studio 2021-05-08 19:11:50 +03:00
Alexey Milovidov
45dea86395 More fixes for PVS-Studio 2021-05-08 18:35:09 +03:00
Azat Khuzhin
69e395bede Round floats in AggregatingTransform log messages 2021-05-08 18:01:57 +03:00
Alexey Milovidov
3e8deef6fe Fix some PVS-Studio warnings 2021-05-08 17:54:08 +03:00
Alexey Milovidov
9e1a5f41fc A bunch of changes for PVS-Studio 2021-05-08 17:43:03 +03:00
Alexey Milovidov
86169cc36e Merge branch 'master' into normalize-bigint 2021-05-04 14:53:42 +03:00
Alexey Milovidov
02ce9cc725 Untangle UUID 2021-05-04 01:46:51 +03:00
Nikolai Kochetov
16bad2245d Better comment. 2021-04-30 16:06:17 +03:00
Nikolai Kochetov
6b79403cb5 Rename and fix fuild. 2021-04-30 11:25:39 +03:00
Nikolai Kochetov
25dc72eda7 Add comments. 2021-04-29 20:51:35 +03:00
Nikolai Kochetov
fcaa8a5073 Fix build 2021-04-29 18:55:20 +03:00
Nikolai Kochetov
bc2375044b Remove some code 2021-04-29 17:34:52 +03:00
Nikolai Kochetov
b500c420b9 Fix build and style. 2021-04-29 17:14:23 +03:00
Nikolai Kochetov
25fe5f63ee Fix other tests. 2021-04-29 12:08:49 +03:00
Nikolai Kochetov
abd8577ded Fix some tests 2021-04-28 21:21:26 +03:00
Nikolai Kochetov
69ddca1d73 Refactor join step, part 3 2021-04-28 20:32:12 +03:00
Nikolai Kochetov
3a25e46a8f Refactor join step, part 2 2021-04-27 20:30:33 +03:00
Nikolai Kochetov
a51a380645 Refactor join step, part 1 2021-04-27 17:00:16 +03:00
Vladimir
fd777bcd4b
Merge branch 'master' into create-aggregate-func-settings 2021-04-26 11:12:09 +03:00
Alexey Milovidov
649550c5ab Attempt to normalize big integers 2021-04-25 12:30:43 +03:00
Alexey Milovidov
8f01af62d9 Merge branch 'master' into normalize-bigint 2021-04-25 06:57:44 +03:00
Alexander Kuzmenkov
9f50b1855f
Merge pull request #23520 from ClickHouse/aku/pvs 
fix pvs warnings
 2021-04-23 18:55:48 +03:00
Alexander Kuzmenkov
1fe3fd864e Merge remote-tracking branch 'origin/master' into HEAD 2021-04-23 10:41:35 +03:00
Alexander Kuzmenkov
ce0a58f86f ignore empty input chunks generated by joins 2021-04-23 10:37:47 +03:00
Alexander Kuzmenkov
06ca44a378 fix pvs warnings 2021-04-22 22:54:58 +03:00
Anton Popov
aea93d9ae5 Merge remote-tracking branch 'upstream/master' into HEAD 2021-04-20 15:16:12 +03:00
Anton Popov
65aceaa668 ColumnSparse: fixes 2021-04-19 15:01:30 +03:00
Anton Popov
6ce875175b Merge remote-tracking branch 'upstream/master' into HEAD 2021-04-16 02:08:20 +03:00
Azat Khuzhin
d2cf03ea41 Change logging from trace to debug for messages with rows/bytes 2021-04-15 21:00:16 +03:00
Anton Popov
be6672a25e ColumnSparse: fixes 2021-04-15 17:34:55 +03:00
vdimir
a2f1bde5cc
Pass Settings to all aggregate function creator 2021-04-15 13:39:59 +03:00
Ivan
495c6e03aa
Replace all Context references with std::weak_ptr (#22297) 
* Replace all Context references with std::weak_ptr

* Fix shared context captured by value

* Fix build

* Fix Context with named sessions

* Fix copy context

* Fix gcc build

* Merge with master and fix build

* Fix gcc-9 build
 2021-04-11 02:33:54 +03:00
Maksim Kita
d9e9224188 IAggreagteFunction allocatesMemoryInArena removed default implementation 2021-04-09 20:12:06 +03:00
Anton Popov
4b8e90338d ColumnSparse: fixes 2021-04-08 05:08:37 +03:00
Alexander Kuzmenkov
d9ad06bd6d fix ubsan 2021-04-06 19:24:56 +03:00
Anton Popov
d7ca6ecc50 ColumnSparse: sorting and dummy aggregation 2021-04-06 03:02:48 +03:00
Anton Popov
0d03b8c0c4
Merge pull request #21889 from CurtizJ/fix-aggregation-in-order-1 
Fix bugs in aggregation by primary key
 2021-04-04 18:17:04 +03:00
Anton Popov
56320bcbfd minor refactoring 2021-04-02 01:16:54 +03:00
Anton Popov
88cd775f6a Merge remote-tracking branch 'upstream/master' into HEAD 2021-04-02 00:14:03 +03:00
Alexander Kuzmenkov
d006c5532e fix window frame offset check and add more tests 2021-04-01 18:56:58 +03:00
alexey-milovidov
c762fa2f75
Merge pull request #22129 from vdimir/issue-19303 
Shrink totals block to 1 row for JOIN with TOTALS and arrayJoin
 2021-03-29 05:26:17 +03:00
alexey-milovidov
c81d807dbc
Update JoiningTransform.cpp 2021-03-29 05:25:58 +03:00
Alexander Kuzmenkov
8ea697b7df use camelCase 2021-03-25 18:49:45 +03:00
vdimir
8f5c8f32df
Shrink totals block to 1 row for JOIN with TOTALS and arrayJoin 2021-03-25 17:32:36 +03:00
Alexander Kuzmenkov
e0d1f6d80f fixes 2021-03-24 01:52:16 +03:00
Alexander Kuzmenkov
0c70fe1a6d fix field get 2021-03-23 17:39:59 +03:00
Anton Popov
5de2b8512f fix destruction of aggregate states 2021-03-23 01:12:14 +03:00
Alexander Kuzmenkov
3166f0cbfc cleanup 2021-03-19 20:18:17 +03:00
Alexander Kuzmenkov
1beba597ca Merge remote-tracking branch 'origin/master' into HEAD 2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d float frames and lag/lead_in_frame 2021-03-19 02:05:43 +03:00
Anton Popov
6f7c8894e9 fix bugs in aggregation by primary key 2021-03-18 23:57:42 +03:00
Alexander Kuzmenkov
1cd9f28bd4 another way 2021-03-17 18:31:30 +03:00
Alexander Kuzmenkov
e5bef75728 fix 2021-03-16 19:15:31 +03:00
Alexander Kuzmenkov
2328d56827 fix 2021-03-16 04:19:33 +03:00
Alexander Kuzmenkov
3c16ea0bc8 fix incorrect number of rows for Chunks with no columns in PartialSortingTransform 2021-03-16 01:59:12 +03:00
Alexander Kuzmenkov
a2bedd592e
Merge pull request #21436 from azat/optimize_aggregation_in_order-log-fix 
Fix logging for optimize_aggregation_in_order=1 (with small max_block_size)
 2021-03-11 17:46:48 +03:00
Anton Popov
562065732d Merge remote-tracking branch 'upstream/master' into HEAD 2021-03-05 17:30:05 +03:00
Azat Khuzhin
45ca803973 Fix logging for optimize_aggregation_in_order=1 (with small max_block_size) 2021-03-04 10:34:41 +03:00
Alexander Kuzmenkov
824475b224 cleanup 2021-02-12 13:37:27 +03:00
Alexander Kuzmenkov
1275be58bf Merge remote-tracking branch 'origin/master' into HEAD 2021-02-11 19:49:37 +03:00
Alexander Kuzmenkov
ebb47595aa
Merge pull request #20293 from ClickHouse/aku/window-prototype-3 
make window functions faster
 2021-02-11 19:49:02 +03:00
Alexander Kuzmenkov
a77415781f reserve the result columns in advance 2021-02-11 19:48:27 +03:00
Alexander Kuzmenkov
62b3bf7b57 some tests and speedup 2021-02-11 19:20:57 +03:00
Alexander Kuzmenkov
a2943fd196 cleanpu 2021-02-11 18:47:52 +03:00
Alexander Kuzmenkov
d8f9a8d3cd first_value and last_value 2021-02-11 18:41:54 +03:00
Alexander Kuzmenkov
ecbcf47f28 lag/lead stubs + cleanup 2021-02-11 18:07:42 +03:00
Alexander Kuzmenkov
772073a0db
Update WindowTransform.cpp 2021-02-11 17:01:09 +03:00
Alexander Kuzmenkov
525400bc41 window function rank() and friends 2021-02-11 16:29:30 +03:00
Alexander Kuzmenkov
363007b964 fixes 2021-02-11 11:39:39 +03:00
alesapin
c2bb2c2902
Merge pull request #20097 from ClickHouse/remove-adding-missed-step 
Build actions dag to evaluate missing defaults.
 2021-02-11 10:51:21 +03:00
Alexander Kuzmenkov
467ff74814 Merge remote-tracking branch 'origin/master' into HEAD 2021-02-11 10:42:39 +03:00
Alexander Kuzmenkov
2571dac984
Merge pull request #20111 from ClickHouse/aku/window-prototype 
RANGE OFFSET window frame
 2021-02-11 10:39:21 +03:00
Alexander Kuzmenkov
695e3a797a some optimizations 2021-02-10 21:55:11 +03:00
Alexander Kuzmenkov
d5b0f30732 cache the block size in the block itself for some speedup 2021-02-10 15:44:07 +03:00
Alexander Kuzmenkov
a67a54e2a5 cleanup 2021-02-10 15:44:07 +03:00
Alexander Kuzmenkov
c18749a704 fix a bug and add some tests 2021-02-09 17:44:04 +03:00
Alexander Kuzmenkov
6e40b9fb6c fix for the DESC frame 2021-02-09 14:56:58 +03:00
Alexander Kuzmenkov
fe8b414a69 cleanup 2021-02-09 14:56:58 +03:00
Nikolai Kochetov
d7fa440356
Merge branch 'master' into remove-adding-const-column-transform 2021-02-08 15:49:23 +03:00
Alexander Kuzmenkov
4bb38f333b some simple cases 2021-02-05 18:34:03 +03:00
Nikolai Kochetov
9869f70a0d Remove AddMissed step and transform. 2021-02-05 14:41:44 +03:00
Alexander Kuzmenkov
6824f13a35 tmp 2021-02-05 12:13:19 +03:00
Nikolai Kochetov
e3d6ffd9dc Remove AddingConstColumn step and transform. 2021-02-04 17:25:11 +03:00
Alexander Kuzmenkov
c1c71fc8e9 ROWS OFFSET frame end 2021-02-04 10:41:09 +03:00
Alexander Kuzmenkov
4abbbae583 Merge remote-tracking branch 'origin/aku/window-prototype-3' into HEAD 2021-02-04 09:52:02 +03:00
Alexander Kuzmenkov
1b6262f874 cleanup 2021-02-04 09:51:46 +03:00
Alexander Kuzmenkov
d6372bd3d9 linker woes 2021-02-04 09:38:42 +03:00
Alexander Kuzmenkov
35754abb4a CURRENT ROW frame start for RANGE frame 2021-02-03 17:22:37 +03:00
Alexander Kuzmenkov
7c55ecf67d cleanup 2021-02-03 16:41:59 +03:00
Alexander Kuzmenkov
f31d2206a7 more fuzzing and less bugs 2021-02-03 15:50:25 +03:00
Alexander Kuzmenkov
bb45c5a8ff Merge remote-tracking branch 'origin/master' into HEAD 2021-02-03 12:13:23 +03:00
Alexander Kuzmenkov
3c0a5d2226 fix invalid iterator addition 2021-02-03 12:09:31 +03:00
Alexander Kuzmenkov
dad4f82e0e fix invalid iterator addition 2021-02-03 12:08:46 +03:00
Alexander Kuzmenkov
7e945bab03 fix the calculation for moving frame start 2021-02-03 08:53:21 +03:00
Alexander Kuzmenkov
264aea20be Merge remote-tracking branch 'origin/master' into HEAD 2021-02-02 19:12:46 +03:00
Alexander Kuzmenkov
d2a0e44a3a
Merge pull request #19299 from ClickHouse/aku/window-prototype 
[wip] support RANGE frame for window functions
 2021-02-02 17:59:16 +03:00
Alexander Kuzmenkov
8bd026271a more cleanup 2021-02-02 04:16:44 +03:00
Alexander Kuzmenkov
78a9624fc5 CURRENT ROW frame start for ROWS frame 2021-02-02 02:27:23 +03:00
Alexander Kuzmenkov
5e99b4461d cleanup 2 2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov
ef46c36317 start offset for ROWS frame 2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov
5e78105786 cleanup 3 2021-02-02 02:27:17 +03:00
Alexander Kuzmenkov
5519e4c134 unbounded following frame end 2021-01-30 04:16:44 +03:00
Alexander Kuzmenkov
2dd5062cc0 use current row as partition etalon 2021-01-28 23:46:22 +03:00
Alexander Kuzmenkov
09e192395a update comments and apply the setNeeded() advice from Nikolai 2021-01-28 23:39:27 +03:00
Alexander Kuzmenkov
1b891e042d fix a bug 2021-01-28 21:18:16 +03:00
Alexander Kuzmenkov
3ace39fbf7 simplify a loop and make RANGE frame the default 2021-01-28 20:05:01 +03:00
Alexander Kuzmenkov
e553eb112f cleanup 2021-01-28 16:47:06 +03:00
Alexander Kuzmenkov
629cb44d4c everything was wrong 2021-01-28 16:42:18 +03:00
Alexey Milovidov
093108bf81 Normalize BigInt implementation 2021-01-27 03:54:57 +03:00
Alexander Kuzmenkov
0d69249c56 typo 2021-01-27 03:27:40 +03:00
Alexander Kuzmenkov
83cfdde6d9 RANGE frame works in some cases 2021-01-27 03:08:15 +03:00
Anton Popov
666aab676e add comments to algorithm 2021-01-26 21:45:22 +03:00
Alexander Kuzmenkov
10a8831d8b partition by -- single loop 2021-01-26 20:59:38 +03:00
Alexander Kuzmenkov
b8a2a29f94 cleanup 2021-01-26 18:31:09 +03:00
kreuzerkrieg
29a2ef3089 Add IStoragePolicy interface 2021-01-26 10:55:28 +02:00
Alexander Kuzmenkov
574454c270 cleanup 2021-01-25 18:07:09 +03:00
Alexander Kuzmenkov
f8f79d5788 tmp -- the tests pass by some miracle 2021-01-23 02:03:07 +03:00
Anton Popov
573edbcd11 improve performance of aggregation in order of sorting key 2021-01-22 05:34:08 +03:00
Alexander Kuzmenkov
18c944257a cleanup 2021-01-20 20:23:15 +03:00
Alexander Kuzmenkov
6e4b9aa862 don't use simple transform 2021-01-20 10:10:54 +03:00
Alexander Kuzmenkov
d4e5d5fdb4
Merge pull request #18455 from ClickHouse/aku/window-prototype 
[wip] some window function fixes
 2020-12-29 19:23:19 +03:00
Alexander Kuzmenkov
844239b1c3 tmp fixes (split me) 2020-12-24 07:03:33 +03:00
Anton Popov
204a20fe29 remove unused code 2020-12-23 20:34:00 +03:00
Alexander Kuzmenkov
3f33e6b3e0 some review fixes 2020-12-22 20:46:31 +03:00
Alexander Kuzmenkov
dadfc76f8f fix the fuzzer 2020-12-22 07:02:39 +03:00
Alexander Kuzmenkov
abad6b9e49 clang-tidy is so annoying 2020-12-22 04:41:02 +03:00
Alexander Kuzmenkov
575d5c69ef fix partition boundaries for multiple window functions 2020-12-22 00:23:45 +03:00
Alexander Kuzmenkov
ac9fc15509 cleanup 2020-12-21 12:59:11 +03:00
Alexander Kuzmenkov
132a0b42eb cleanup 2020-12-18 20:13:28 +03:00
Alexander Kuzmenkov
a1326414ff Merge remote-tracking branch 'origin/master' into tmp 2020-12-17 00:46:14 +03:00
Alexander Kuzmenkov
e335074c39 works across the blocks 2020-12-16 15:57:47 +03:00
Alexander Kuzmenkov
fabb37d3c9 cleanup 2020-12-15 20:39:58 +03:00
Nikolai Kochetov
6defcbb662
Merge branch 'master' into optimize-data-on-insert 2020-12-15 16:50:42 +03:00
Alexander Kuzmenkov
a75ca3cb79 Merge remote-tracking branch 'origin/master' into tmp 2020-12-15 03:36:43 +03:00
Alexander Kuzmenkov
6d5b23de67 something works 2020-12-15 03:36:03 +03:00
Alexander Kuzmenkov
6f991725c3 forgot new files 2020-12-11 01:16:58 +03:00
Alexander Kuzmenkov
eb0c817bf2 expression analyzer part 2020-12-09 14:14:40 +03:00
Pavel Kruglov
4b58528b9e Rename getPos to getRow, change mergeBlock, pass setting instead of context 2020-12-04 19:25:30 +03:00
Pavel Kruglov
905ba78adc Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-12-04 18:56:46 +03:00
Alexander Kuzmenkov
8ee86e35d2 debug 2020-12-02 21:16:31 +03:00
Azat Khuzhin
ccd794a676 Add remerge_sort_lowered_memory_bytes_ratio setting 
Sometimes default ratio is not good enough (2), since it depends on lots
of factors:
- size of LIMIT
- max_memory_usage
- ...

So add a separate setting for it.

But note that it make sense to set
remerge_sort_lowered_memory_bytes_ratio only in range (1, 2]

Since <= 1 will just use more CPU, and > 2 will use more RAM and will
unlikely be faster.
 2020-11-29 21:16:42 +03:00
Pavel Kruglov
547ec19fb3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-11-18 12:01:59 +03:00
Nikolai Kochetov
13eceff55c Remove Converting transform and step. 2020-11-17 20:16:55 +03:00
Pavel Kruglov
8d5e0784d3 Add setting optimize_on_insert 2020-11-12 23:37:23 +03:00
Nikolai Kochetov
9b13d0e0eb Revert "Add ActionsDAG::updateHeader()" 
This reverts commit b78657656c.
 2020-11-11 20:17:26 +03:00
Nikolai Kochetov
b78657656c Add ActionsDAG::updateHeader() 2020-11-11 16:50:29 +03:00
Nikolai Kochetov
1846bb3cac Merge branch 'master' into actions-dag-f14 2020-11-11 13:08:57 +03:00
Nikolai Kochetov
1db8e77371 Add comments. Update ActionsDAG::Index 2020-11-10 17:54:59 +03:00
Nikolai Kochetov
c10f733587 Merge branch 'master' into storage-read-query-plan 2020-11-06 15:43:46 +03:00
Nikolai Kochetov
9aeb757da4 Merge branch 'master' into actions-dag-f14 2020-11-06 15:04:20 +03:00
nikitamikhaylov
aceb82ae6a better 2020-11-05 19:00:05 +03:00
Nikolai Kochetov
6767a226fc Merge branch 'master' into actions-dag-f14 2020-11-03 15:21:06 +03:00
Nikolai Kochetov
07a7c46b89 Refactor ExpressionActions [Part 3] 2020-11-03 14:28:28 +03:00
Alexey Milovidov
32ed8c9681 Fix trailing whitespace 2020-10-26 22:12:40 +03:00
Nikolai Kochetov
7fa045cff8 Merge branch 'master' into storage-read-query-plan 2020-10-22 13:31:10 +03:00
Amos Bird
ca7a5ccd0d
More resize 2020-10-13 09:56:35 +08:00
Nikolai Kochetov
7e58f99f64 Merge branch 'master' into storage-read-query-plan 2020-10-12 13:12:39 +03:00
Amos Bird
d2dcfc3f0d
Refactor processors. 2020-10-12 17:30:05 +08:00
Alexey Milovidov
269b6383f5 Check for #pragma once in headers 2020-10-10 21:37:02 +03:00
Nikolai Kochetov
f9bf1e3406 Merge branch 'master' into storage-read-query-plan 2020-10-06 09:50:10 +03:00
Azat Khuzhin
2a2f858365 Significantly reduce memory usage in AggregatingInOrderTransform 
Clean the aggregates pools (Arena's objects) between flushes, this will
reduce memory usage significantly (since Arena is not intended for
memory reuse in the already full Chunk's)

Before this patch you cannot run SELECT FROM huge_table GROUP BY
primary_key SETTINGS optimize_aggregation_in_order=1 (and the whole
point of optimize_aggregation_in_order got lost), while after, this
should be possible.
 2020-10-03 00:56:58 +03:00
alesapin
17b86dec96 Recursive defaults 2020-10-02 15:38:50 +03:00
Nikolai Kochetov
ec64def384 Use QueryPlan while reading from MergeTree. 2020-10-01 20:34:22 +03:00
Alexander Kuzmenkov
679c0988a5 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 16:25:52 +03:00
Alexander Kuzmenkov
fb64cf210a straighten the protocol version 2020-09-17 17:37:29 +03:00
Nikolai Kochetov
3cc89d467c Merge branch 'master' into query-plan-for-creating-sets 2020-09-15 20:15:41 +03:00
Nikolai Kochetov
118a8a513e Update mutations interpreter. 2020-09-15 20:13:13 +03:00
Nikolai Kochetov
6eac433c55 Review fixes. 2020-09-15 13:40:39 +03:00
Nikolai Kochetov
bcfc83022a Return query plan from storage. 2020-09-14 17:13:58 +03:00
alexey-milovidov
f2e9a09b11
Merge pull request #14585 from ClickHouse/join-processor 
Remove Join from ExpressionActions
 2020-09-08 23:56:09 +03:00
Nikolai Kochetov
b0cb5511a9 Fix build. 2020-09-08 14:17:39 +03:00
Nikolai Kochetov
39aad9979a Remove Join from ExpressionActions. 2020-09-08 13:40:53 +03:00
Nikolai Kochetov
c3eeb8f71e
Merge pull request #14412 from ClickHouse/pipes-and-creating-sets 
Pipes and creating sets
 2020-09-08 10:47:56 +03:00
Nikolai Kochetov
41a3fad1ea Allow many rows in totals. 2020-09-04 15:34:36 +03:00
Nikolai Kochetov
b7e53208d1 Fix tests. 2020-09-04 11:36:47 +03:00
Nikolai Kochetov
acfd35a908 Update QueryPipeline::addCreatingSetsTransform 2020-09-02 16:04:54 +03:00
Nikolai Kochetov
f82b799f12 Update CreatingSetsTransform. 2020-09-01 16:53:11 +03:00
Mark Papadakis
ff76790a59
Update AggregatingTransform.cpp 
Replaced redundant call to chunk.getNumRows() with local var.
 2020-08-28 16:08:06 +03:00
Nikolai Kochetov
7c0fcb2039
Merge pull request #13611 from ClickHouse/array-join-processor 
Refactor ARRAY JOIN
 2020-08-20 17:56:37 +03:00
Nikolai Kochetov
8e631a98ea Refactor ActionsChain. 2020-08-14 21:24:58 +03:00
Nikolai Kochetov
95bbda3667 Specify columns after ARRAY JOIN and JOIN. 
Add ArrayJoinTransform and ArrayJoinStep.
 2020-08-14 21:24:03 +03:00
Nikolai Kochetov
9b67cd9faf Merge branch 'master' into refactor-pipes-3 2020-08-10 10:50:17 +03:00
Alexey Milovidov
edd89a8610 Fix half of typos 2020-08-08 03:47:03 +03:00
Anton Popov
e7d3154d38 fix queries with order by prefix of primary key and constant columns 2020-08-06 02:37:39 +03:00
Nikolai Kochetov
9385f3de0e Refactor Pipe [part 4]. 2020-08-04 16:06:59 +03:00
alexey-milovidov
91156bef54
Merge pull request #13075 from ClickHouse/fix-11327 
Fix 11327
 2020-07-31 14:53:07 +03:00
Nikolai Kochetov
3306a24273
Update ConvertingTransform.h 2020-07-31 14:11:03 +03:00
Nikolai Kochetov
fdc49cadb7 Ignore constants for remote query from local replica. 2020-07-29 15:51:59 +03:00
Alexander Kuzmenkov
f6f2812f73 Block structure mismatch is a program error 2020-07-28 21:35:18 +03:00
Nikolai Kochetov
cc7ebfac78 Fix Pipeline stuck for external sort. 2020-07-21 12:23:54 +03:00
Alexey Milovidov
ef930df484 Avoid overflow in LIMIT #10470 #11372 2020-07-12 08:18:01 +03:00
Anton Popov
1122d99ba8 fix order of columns in WITH FILL modifier 2020-07-09 02:56:44 +03:00
Alexey Milovidov
9c53a90e3d Non-significant changes 2020-07-08 06:16:20 +03:00
Nikolai Kochetov
8587c2025d Merge branch 'master' into initial-explain 2020-06-29 23:35:56 +03:00