Commit Graph

2128 Commits

Author SHA1 Message Date
Nikolai Kochetov
c1f0ba1f92 Fix some tests. 2021-09-19 21:53:36 +03:00
Nikolai Kochetov
53e946ec25 Fix executors. 2021-09-19 19:18:38 +03:00
Anton Popov
db50a1027e
Merge pull request #29132 from Avogar/fix-avro
Fix segfault in Avro with LowCardinality(Nullable)
2021-09-19 16:13:11 +03:00
Pavel Kruglov
aba86b010b Update docs, tests and add some fixes 2021-09-17 17:32:23 +03:00
Pavel Kruglov
7bf13c4891 Remove extra space 2021-09-17 16:13:15 +03:00
Pavel Kruglov
48a3a2f75c Fix segfault in Avro with LowCardinality(Nullable) 2021-09-17 16:11:44 +03:00
Nikolai Kochetov
a8c3b02598 Merge branch 'master' into rewrite-pushing-to-views 2021-09-17 15:38:11 +03:00
Nikolai Kochetov
6e0ac024a2 Maybe fix some build. 2021-09-17 15:05:54 +03:00
Vladimir C
333fd323f5
Merge pull request #29062 from Avogar/orc-fixes 2021-09-17 14:48:19 +03:00
Nikolai Kochetov
58bb5fe462 Fix some tests. 2021-09-17 14:40:03 +03:00
Nikolai Kochetov
341553febd Fix build. 2021-09-16 20:40:42 +03:00
kssenii
c88dc460d4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-09-16 16:13:04 +00:00
Kruglov Pavel
50c0045e27
Remove unused header 2021-09-16 17:13:07 +03:00
Pavel Kruglov
96dba14213 Improve MsgPack input/output format 2021-09-16 17:05:07 +03:00
Pavel Kruglov
2b67d54d58 tmp 2021-09-16 14:25:45 +03:00
Kruglov Pavel
1b0da15291
Use detachColumns
Co-authored-by: Vladimir C <vdimir@yandex-team.ru>
2021-09-16 12:22:39 +03:00
Anton Popov
dfbb1ffec0
Merge pull request #27537 from CurtizJ/merging-20557
Merging #20557 (Asynchronous inserts)
2021-09-16 03:08:34 +03:00
Nikolai Kochetov
e616732743 Small refactoring. 2021-09-15 22:35:48 +03:00
Pavel Kruglov
2e9858172e Allow to input and output LowCardinality columns in ORC format 2021-09-15 22:04:36 +03:00
Vitaly Stoyan
9bbdd39efc initial commit 2021-09-15 18:07:18 +03:00
Anton Popov
f6191b98e7 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-15 17:47:22 +03:00
Anton Popov
8970dcdaf5 fix throwing exception for multiple clients in async inserts 2021-09-15 17:19:28 +03:00
Nikita Mikhaylov
2684d06b51
Merge pull request #27135 from FArthur-cmd/compressed_output_formats_3473
compress INTO OUTFILE with parameter compress
2021-09-15 16:25:13 +03:00
Anton Popov
9646edf3dc fix possible race in AsynchronousInsertQueue 2021-09-15 02:54:10 +03:00
Anton Popov
fc17936c12 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-14 23:02:30 +03:00
Vitaly Stoyan
a416fd52d8 initial commit 2021-09-14 21:22:18 +03:00
Nikolai Kochetov
b997214620 Rename QueryPipeline to QueryPipelineBuilder. 2021-09-14 20:48:18 +03:00
Nikolai Kochetov
7fc830ae2b Rename QueryPipeline to QueryPipelineBuilder. 2021-09-14 19:28:41 +03:00
Nikolai Kochetov
0e267c50b4 Merge branch 'master' into rewrite-pushing-to-views 2021-09-14 16:13:54 +03:00
vdimir
1fdbb9509f
Add additional checkTypesOfKeys to JoiningTransform::transformHeader 2021-09-14 11:03:22 +03:00
Nikolai Kochetov
95b00f8fd4 Fix some live view tests. 2021-09-13 19:23:56 +03:00
Nikolai Kochetov
b37168e86f Fix asan. 2021-09-13 14:27:15 +03:00
mergify[bot]
d731bf6c4d
Merge branch 'master' into compressed_output_formats_3473 2021-09-13 09:14:35 +00:00
kssenii
6fba81191f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-09-12 21:48:27 +00:00
Sergei Semin
12e24a23d3
Merge branch 'master' into fix-build-clang-13-2 2021-09-12 19:30:55 +03:00
alexey-milovidov
aa5c42b7db
Merge pull request #28773 from azat/nth_value-ubsan-fix
Fix signed integer overflow for nth_value() window function
2021-09-12 15:57:19 +03:00
alexey-milovidov
f066edc43c
Merge pull request #28910 from ClickHouse/fix-trash-optimization
Fix bad optimization of ORDER BY in subquery if it contains WITH FILL
2021-09-12 15:27:53 +03:00
alexey-milovidov
ea13a8b562
Merge pull request #28659 from myrrc/improvement/tostring_to_magic_enum
Improving CH type system with concepts
2021-09-12 15:26:29 +03:00
Alexey Milovidov
e3611cccce Fix yet another issue 2021-09-12 02:55:53 +03:00
Mike Kot
bce011cb33 Replacing IsDecimalNumber 2021-09-11 00:40:18 +02:00
Mike Kot
c4385a2c40 Simplifying exception messages 2021-09-11 00:40:18 +02:00
Azat Khuzhin
a764d46f62 Eliminate int64_t > INT64_MAX checks (found by PVS)
https://clickhouse-test-reports.s3.yandex.net/28773/b38311538979c0ffe27f6c8c5732b4afc18c4d35/pvs_check.html#fail1
2021-09-10 23:31:41 +03:00
Azat Khuzhin
56ac032413 Use the same error for leadInFrame()/lagInFrame() as in nth_value() 2021-09-10 23:27:36 +03:00
Azat Khuzhin
b383115389 Allow values up to INT64_MAX for nth_value/lagInFrame/leadInFrame 2021-09-10 21:02:06 +03:00
Azat Khuzhin
62a29420bd Fix signed integer overflow for nth_value() window function
CI report [1]:

    ../src/Processors/Transforms/WindowTransform.cpp:1699:54: runtime error: signed integer overflow: -9223372036854775808 - 1 cannot be represented in type 'long' Received signal -3 Received signal Unknown signal (-3)

In query:

    SELECT
        number,
        nth_value(number, 2147483648) OVER w,
        anyOrNull(number) OVER (ORDER BY -2147483648 - intDiv(number, 1024) DESC NULLS FIRST, number DESC ROWS BETWEEN 65535 FOLLOWING AND UNBOUNDED FOLLOWING),
        nth_value(number, 65537) OVER w AS firstValue,
        nth_value(number, -9223372036854775808) OVER w AS secondValue,
        nth_value(number, 1048576) OVER w AS thirdValue
    FROM numbers(1)
    WINDOW w AS (ORDER BY number DESC)
    ORDER BY number DESC

  [1]: https://clickhouse-test-reports.s3.yandex.net/28532/7623af5513e12aa8dfa1bee963caffe00185c31a/fuzzer_ubsan/report.html#fail1
2021-09-10 21:02:04 +03:00
Filatenkov Artur
acccb24ffd
Update getSourceFromFromASTInsertQuery.cpp 2021-09-10 19:59:17 +03:00
Filatenkov Artur
e17353750c
Update src/Processors/Transforms/getSourceFromFromASTInsertQuery.cpp
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
2021-09-10 18:02:15 +03:00
Nikolai Kochetov
05f533d462 Fix style. 2021-09-10 17:54:42 +03:00
Artur
a7c43c3e2d add compression key-word and some tests 2021-09-10 13:59:22 +00:00
Nikolai Kochetov
e6938127a6 Fix some resouces. 2021-09-10 15:38:30 +03:00
Nikolai Kochetov
285cfb7fd5 Fix build and style. 2021-09-10 14:42:52 +03:00
Anton Popov
5cff615eca Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-10 13:40:48 +03:00
Anton Popov
29f327fa60 fix data race in async inserts 2021-09-10 13:24:09 +03:00
Nikolai Kochetov
bc7c70f93f Try to fix build. 2021-09-10 12:03:45 +03:00
Sergei Semin
c01bf59805 ignore diagnostic -Wreserved-identifier in ArrowBufferedStreams.cpp 2021-09-09 23:51:47 +03:00
Sergei Semin
74f6ac8976 remove variable total_rows_in_lonely_parts that set but not used 2021-09-09 23:51:47 +03:00
Nikolai Kochetov
f569a3e3f7 Merge branch 'master' into rewrite-pushing-to-views 2021-09-09 20:30:23 +03:00
Nikolai Kochetov
50562da6df More refactoring. 2021-09-09 20:08:49 +03:00
Anton Popov
8cb02a4b27 add some comments 2021-09-09 19:10:53 +03:00
Anton Popov
abebce2f18 fix kafka 2021-09-09 17:48:01 +03:00
Nikolai Kochetov
47b96add9a Refactor some code. 2021-09-09 16:59:15 +03:00
Nikolai Kochetov
5c220d62b3 Update SinkToStorage.cpp 2021-09-09 15:46:06 +03:00
kssenii
1838a8672d Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-09-09 12:43:45 +00:00
Nikolai Kochetov
13eb93a9c0
Merge pull request #28700 from amosbird/projection-fix16
Fix crash on exception with projection aggregate
2021-09-09 15:24:05 +03:00
Anton Popov
8e5b3b2f6c Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-09 15:12:34 +03:00
Nikolai Kochetov
aea1871755 Fix some more tests. 2021-09-09 14:16:03 +03:00
Amos Bird
91293c7449
Fix crash on exception with projection aggregate 2021-09-09 10:43:56 +08:00
Nikolai Kochetov
999a4fe831 Fix other tests. 2021-09-08 21:29:38 +03:00
Anton Popov
f864c4252a support adding defaults in async inserts 2021-09-08 17:08:57 +03:00
Nikolai Kochetov
f34cb097d8 Fix some tests. 2021-09-06 23:13:06 +03:00
Mike Kot
8e9aacadd1 Initial: replacing hardcoded toString for enums with magic_enum 2021-09-06 16:24:03 +02:00
kssenii
1c20b223cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-09-04 20:01:31 +03:00
Nikolai Kochetov
66a76ab70f Rewrite PushingToViewsBlockOutputStream part 6 2021-09-03 20:29:36 +03:00
Anton Popov
c9a0cc5ce9 fix race on table schema in insert-select 2021-09-03 17:23:21 +03:00
Raúl Marín
09a9ad0dfe Improve [C|T]SV errors 2021-09-03 16:15:56 +02:00
Nikolai Kochetov
358babc31b Rewrite PushingToViewsBlockOutputStream part 5. 2021-09-02 14:29:20 +03:00
Anton Popov
5e421ab272 Merge remote-tracking branch 'upstream/master' into HEAD 2021-09-02 02:42:50 +03:00
Anton Popov
7c42ce8370 improvements of async inserts 2021-09-02 02:18:09 +03:00
Nikolai Kochetov
79ecb6667e Rewrite PushingToViewsBlockOutputStream part 4. 2021-09-01 21:41:50 +03:00
Anton Popov
5e694596c9 minor changes near async inserts 2021-09-01 18:06:11 +03:00
tavplubix
e55c0bc40a
Merging #27980 (#28413)
* fix: empty string convert to DecimalOrNumbeOrDateOrDateTime

* fix: ifnull convert to defaut value

* fix variable name

* fix cast args

* modify ifnull args

* use short circuit

Co-authored-by: liyang830 <liyang830@jd.com>
2021-09-01 12:12:23 +03:00
Vladimir C
94d5f3a87b
Merge pull request #28349 from vdimir/issue-27691-qf
Fix non joined rows from nullable column
2021-08-31 17:09:24 +03:00
Nikolai Kochetov
5be05c2ef9 Rewrite PushingToViewsBlockOutputStream part 3. 2021-08-31 16:50:07 +03:00
alesapin
525999145e
Merge pull request #26791 from ClickHouse/async-reads
Experiment with asynchronous readers
2021-08-31 13:17:45 +03:00
Anton Popov
36ac20681e refactor AsynchronousInsertQueue 2021-08-31 05:16:02 +03:00
Alexey Milovidov
ca6f6306f3 Merge branch 'master' into async-reads 2021-08-31 02:52:58 +03:00
alexey-milovidov
c6a754289b
Merge pull request #28361 from DimasKovas/block_ouput_streams_compats
Add compat between SinkToStorage and BlockOutputStream
2021-08-31 01:41:33 +03:00
Dmitrii Kovalkov
54eeeb7cf2 Add compat between SinkToStorage and BlockOutputStream 2021-08-30 16:58:40 +03:00
vdimir
bb1d22aa19
Log join input and output structure 2021-08-30 16:33:01 +03:00
Nikita Mikhaylov
fb66ab75be
Merge pull request #25633 from Avogar/json-as-string
Allow data in square brackets in JSONAsString format
2021-08-30 14:06:28 +03:00
Nikolai Kochetov
eccee47e72 Rewrite PushingToViewsBlockOutputStream part 2. 2021-08-30 14:03:39 +03:00
Dmitrii Kovalkov
9871ad70ff Exclude fuzzers 2021-08-30 11:12:25 +03:00
Dmitrii Kovalkov
8acf0fa16a run generate-ya-make 2021-08-30 10:57:40 +03:00
Anton Popov
9e67943878 add waiting for async inserts 2021-08-28 00:29:10 +03:00
kssenii
34f9983f14 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-27 09:35:23 +03:00
Anton Popov
e8ac8e3454 execute asynchronous inserts separatly for each client 2021-08-27 06:00:12 +03:00
mergify[bot]
401b2f3b8f
Merge branch 'master' into json-as-string 2021-08-26 15:03:59 +00:00
Anton Popov
6d3274c22c Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-26 03:31:46 +03:00
Alexey Milovidov
8f57216180 Progress on development 2021-08-25 00:45:58 +03:00
Nikolay Degterinsky
8295d8f2d7
Update src/Processors/Sinks/SinkToStorage.h 2021-08-24 16:25:01 +03:00
Vladimir Chebotarev
82ef8a2b7b
Fixed a typo in comments to SinkToStorage. 2021-08-24 14:59:29 +03:00
Nikolai Kochetov
d7e78f3ea9 Rewrite PushingToViewsBlockOutputStream part 1. 2021-08-23 13:46:52 +03:00
kssenii
0afc23bfa3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-21 18:23:14 +03:00
kssenii
39e80a47a3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-20 10:13:58 +03:00
Alexander Kuzmenkov
2f0d5c6f21
Merge pull request #27880 from ClickHouse/aku/window-case-insensitive
make the sql-standard window functions case insensitive
2021-08-20 00:20:30 +03:00
Alexander Kuzmenkov
9013892a96 make the sql-standard window functions case insensitive 2021-08-19 20:56:16 +03:00
Kruglov Pavel
7fe7103e53
Merge pull request #27299 from vdimir/issue-27091-v2
Refactor NotJoined
2021-08-19 19:16:32 +03:00
kssenii
b5f6a7cb97 Fix local 2021-08-19 14:07:47 +03:00
Nikolai Kochetov
7dcff5c90e
Merge pull request #27742 from amosbird/projection-improvement3
Improve projection analysis.
2021-08-19 12:11:20 +03:00
Nikolai Kochetov
3e44ef437e
Merge pull request #26639 from ClickHouse/fix-bad-cast
Fix bad cast
2021-08-19 11:17:26 +03:00
kssenii
8e36872685 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-19 10:34:48 +03:00
Vitaly Baranov
65ee9a1272
Merge pull request #26864 from vitlibar/refactor-sessions
Introduce sessions
2021-08-19 01:38:51 +03:00
kssenii
80cb5287d9 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-18 18:15:44 +03:00
tavplubix
9b45b26dd6
Merge pull request #27655 from FArthur-cmd/import_from_infile_syntax
Import `FROM INFILE`
2021-08-18 15:36:32 +03:00
Vasily Nemkov
51ffc33457 Introduce sessions.
This is required to add system.session_log table.
2021-08-18 14:24:52 +03:00
Nikolai Kochetov
a46fe11e2c Try fix test_mutations_with_merge_background_task 2021-08-18 13:30:02 +03:00
tavplubix
baaaf996c2
Update getSourceFromFromASTInsertQuery.cpp 2021-08-17 21:15:44 +03:00
Filatenkov Artur
3fc0e577e3
remove trailing whitespaces 2021-08-17 17:22:38 +03:00
vdimir
2dfbbe364b
Do not use BlockInputStream for NonJoined 2021-08-17 16:30:01 +03:00
Artur
e8e650b16b correct infile form local 2021-08-17 12:01:31 +00:00
vdimir
afa748c717
Refactor NotJoined pt1 2021-08-17 13:32:16 +03:00
Artur
ca65b819d3 correct error type 2021-08-16 16:09:12 +00:00
Amos Bird
90881aab09
Better code style 2021-08-16 22:17:07 +08:00
kssenii
cefd9b473e Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-16 16:41:24 +03:00
Artur
3591c3c8f4 correct code according to comments 2021-08-16 13:28:39 +00:00
Amos Bird
b162a2b699
Improve projection analysis.
Remove duplicate index analysis and avoid possible invalid limit checks
during projection analysis.
2021-08-16 20:11:57 +08:00
Kseniia Sumarokova
b024c215af
Merge pull request #24757 from zdikov/subquery-operators
Subquery operators
2021-08-15 21:33:59 +03:00
kssenii
f66e8464f9 Some final fixes 2021-08-15 11:40:30 +03:00
kssenii
f125fb3fef Some fixes around any/all 2021-08-14 20:33:03 +03:00
Nikolai Kochetov
6b1030c9b8 Rewrite PushingToViewsBIS part 1. 2021-08-13 19:32:29 +03:00
kssenii
47fb923975 Some fixes, more tests 2021-08-13 15:07:44 +03:00
Kseniia Sumarokova
0917488cec
Merge pull request #27382 from kssenii/cast-internal
add Cast internal function
2021-08-13 13:13:51 +03:00
kssenii
55650b1e67 Change behaviour of except, some fixes 2021-08-13 12:57:15 +03:00
Nikolai Kochetov
d207fbc699
Merge pull request #27152 from qoega/fix-access-gtest-in-arcadia
Fix arcadia src/Access gtest
2021-08-13 10:51:29 +03:00
alexey-milovidov
f20eae9a45
Merge pull request #27577 from ClickHouse/remove-streams-from-lv
Remove streams from lv
2021-08-13 03:01:33 +03:00
mergify[bot]
38d97ec52a
Merge branch 'master' into json-as-string 2021-08-12 17:18:38 +00:00
Nikita Mikhaylov
8c06abee73
Merge pull request #25902 from Avogar/arrow-nested
Refactor ArrowColumnToCHColumn, support inserting Nested as Array(Struct) in Arrow/ORC/Parquet
2021-08-12 20:02:01 +03:00
kssenii
a549e29bd4 Better 2021-08-12 16:35:46 +03:00
Nikolai Kochetov
c2f5a9d556 Fix ya.make 2021-08-12 16:13:53 +03:00
Nikolai Kochetov
9c066d476e Fix tests. 2021-08-12 13:46:58 +03:00
Nikolai Kochetov
5e5a6ff654 Merge branch 'master' into qoega-fix-access-gtest-in-arcadia 2021-08-12 12:02:15 +03:00
Nikolai Kochetov
beed4c21a5 Use processors in Storage::watch 2021-08-11 20:28:54 +03:00
Pavel Kruglov
188c7371f9 Remove unecessary code 2021-08-11 19:41:51 +03:00
Mikhail Filimonov
af6249c8ec
Less include <Common/Stopwatch.h> 2021-08-11 16:20:59 +02:00
kssenii
7d8b694a9f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-11 07:37:21 +00:00
Nikolai Kochetov
8613cfd4e2
Merge branch 'master' into fix-access-gtest-in-arcadia 2021-08-10 16:13:11 +03:00
Alexander Kuzmenkov
3f7b96e15b
Merge pull request #27487 from ClickHouse/aku/kill-window
make it possible to cancel window functions on ctrl+c
2021-08-10 14:17:34 +03:00
Maksim Kita
87fb75b272
Merge pull request #27191 from FArthur-cmd/memory-tracker-26043
Client with flag for memory tracker
2021-08-10 14:01:02 +03:00
Nikolai Kochetov
a1ec7f75c5 Merge branch 'master' into qoega-fix-access-gtest-in-arcadia 2021-08-10 11:31:47 +03:00
kssenii
2306fbe9be Better 2021-08-10 10:23:18 +03:00
kssenii
4eb4dd97d4 Support not only 2 inputs, support any size sequence of intersect / except together 2021-08-10 09:24:12 +03:00
Alexander Kuzmenkov
2259387f0c make it possible to cancel window functions on ctrl+c 2021-08-09 20:04:42 +03:00
Pavel Kruglov
7498a1eb38 Fix tests and style 2021-08-09 17:30:14 +03:00
kssenii
7991bb6e83 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into cast-internal 2021-08-08 21:30:17 +00:00
Kseniia Sumarokova
ba220c8e3a
Merge branch 'master' into subquery-operators 2021-08-08 20:18:41 +03:00
kssenii
5abe33e1a3 Better 2021-08-08 20:12:12 +03:00
Anton Popov
78dbcaea54 implement async inserts with processors 2021-08-08 06:30:14 +03:00
kssenii
30cc705464 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-07 22:53:50 +03:00
kssenii
729eba52ea Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into zdikov-subquery-operators 2021-08-07 15:59:58 +00:00
alexey-milovidov
fa5bcb2e30
Merge pull request #27301 from ClickHouse/fix-unknown-column-with-sampling
Fix unknown column with sampling
2021-08-07 18:39:19 +03:00
kssenii
9ca422f0c5 Introduce CAST for internal usage 2021-08-07 09:03:10 +00:00
Nikolai Kochetov
74dd3a6af6 More fixes. 2021-08-06 22:10:54 +03:00
Mikhail Filimonov
31a9b6d5ca
Less clock_gettime calls 2021-08-06 17:38:55 +02:00
Pavel Kruglov
0a06470b69 tmp 2021-08-06 18:12:31 +03:00
Nikolai Kochetov
eb4d7415a2 Fix unknown column bug in sampling. 2021-08-06 17:28:56 +03:00
Nikolai Kochetov
48eb995461 Fix unknown column bug in sampling. 2021-08-06 17:23:50 +03:00
Anton Popov
3a0d4807a5 Merge branch 'async-insert' of git://github.com/abyss7/ClickHouse into merging-20557 2021-08-06 16:20:02 +03:00
Artur
d2869d2e2b add test for memory tracker in client 2021-08-05 16:20:24 +00:00
Pavel Kruglov
a0c10b546f Small fixes 2021-08-05 18:18:33 +03:00
Pavel Kruglov
607d4dcc0b Resolve conflicts, fix build and tests 2021-08-05 18:09:48 +03:00
mergify[bot]
3201d90105
Merge branch 'master' into json-as-string 2021-08-05 14:18:35 +00:00
Alexander Kuzmenkov
d852207b0e
Merge pull request #25721 from CurtizJ/read-in-order-perf-2
Reduce memory usage in queries with `ORDER BY primary_key
2021-08-05 16:13:48 +03:00
Pavel Kruglov
e4c5d7e3b1 Support inserting nested as Array of structs, add some refactoring 2021-08-05 14:10:27 +03:00
kssenii
9f9be65ac7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into interactive-mode-for-clickhouse-local 2021-08-05 10:42:32 +03:00
Anton Popov
915ef50c2d optimize reading in order of key more 2021-08-04 18:18:03 +03:00
Yatsishin Ilya
6e74728714 more sync fixes 2021-08-04 10:58:39 +03:00
Anton Popov
ad65e3c17b slightly more optimize reading in order of key 2021-08-03 15:32:17 +03:00
Nikolai Kochetov
d63a5e1c96
Merge pull request #26675 from Algunenano/kill_better
Handle KILL requests while running pipeline executors
2021-08-02 17:37:54 +03:00
Nikolai Kochetov
6951e8147d
Merge pull request #27020 from amosbird/shardlevelconstness
Shard-level const column
2021-08-02 13:45:20 +03:00
Anton Popov
cc3ed12ed6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-08-02 02:56:00 +03:00
kssenii
c9e607f1e8 Progress for interactive clickhouse local 2021-07-31 15:08:30 +03:00
Amos Bird
479d4fa991
Add shardNum() and shardCount() functions 2021-07-31 15:45:39 +08:00
Alexander Kuzmenkov
4b9cf024f5
Merge pull request #26960 from ClickHouse/aku/window-partition-boundary
fix window function partition boundary search
2021-07-30 13:25:54 +03:00
kssenii
58b3a3f3fc Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into versioning 2021-07-29 19:56:27 +00:00
Alexander Kuzmenkov
7ba61f0bd8 more checks 2021-07-29 16:21:24 +03:00
Alexander Kuzmenkov
a37d7bc070 typo 2021-07-29 15:50:48 +03:00
Alexander Kuzmenkov
55e1d1b592 the reference was correct after all, I just confused the sides of the
diff
2021-07-29 15:49:37 +03:00
Alexander Kuzmenkov
7c9467d7a7 fix window function partition boundary search
It was horribly broken and many test references were wrong. I'm
surprised I never noticed this.
2021-07-29 15:18:10 +03:00
Raúl Marín
eda40ff987 Add running pipelineExecutors to the QueryStatus 2021-07-29 13:03:14 +02:00
Vitaly Stoyan
c1f71b2e6e
Merge branch 'ClickHouse:master' into arcadia_arrow2 2021-07-28 19:57:25 +03:00
Vitaly Stoyan
b2200913df fix build 2021-07-28 19:56:01 +03:00
Vitaly Stoyan
4e269ce2e4 initial commit 2021-07-28 14:09:17 +03:00
Nikolai Kochetov
421650dc68
Merge pull request #26828 from ClickHouse/flush-LazyOutputFormat-on-cancel
Flush LazyOutputFormat on query cancel.
2021-07-28 13:07:58 +03:00
Nikolai Kochetov
97bc754dd8
Merge pull request #26758 from ClickHouse/output-streams-to-processors
Remove some output streams
2021-07-27 17:19:26 +03:00
alexey-milovidov
d7b2404119
Merge pull request #15408 from ClickHouse/random_timezone_for_stateless_tests
Use random timezone in stateless and stateful tests
2021-07-27 16:18:14 +03:00
Nikita Mikhaylov
7bf0fc2ac1
Merge pull request #26703 from Algunenano/threadpool_safety
ParallelFormattingOutputFormat: Use mutex to handle the join to the collector_thread
2021-07-27 16:02:07 +03:00
Alexander Kuzmenkov
7e737d9568
Merge pull request #26334 from ryzuo/ryzuo
Implementation of window function nth_value
2021-07-27 15:02:29 +03:00
Nikolai Kochetov
a5ed26c393 Flush LazyOutputFormat on query cancel. 2021-07-27 11:55:19 +03:00
Nikolai Kochetov
61d8f880cd Rename some files. 2021-07-26 19:48:25 +03:00
Raúl Marín
61a90fa935 Use individual mutex to manage the collector_thread 2021-07-26 17:51:10 +02:00
Nikolai Kochetov
9b5a816b43 Merge branch 'master' into output-streams-to-processors 2021-07-26 18:03:11 +03:00
Nikolai Kochetov
0eb563dc1b Fix more tests. 2021-07-26 17:47:29 +03:00
Nikolai Kochetov
fa1c223269 Fix some tests. 2021-07-26 13:08:40 +03:00
ryzuo
0e742487f1 Remove unnecessary emtpy argument check for nth_value as code review suggested 2021-07-26 13:31:45 +08:00
Alexey Milovidov
8b4c49d931 Fix test 2021-07-25 22:09:42 +03:00
Alexey Milovidov
eba787ec57 Fix trash 2021-07-25 07:50:16 +03:00
Alexey Milovidov
650cbd2484 GraphiteMergeTree: respect timezone for rounding #5098 2021-07-25 04:27:40 +03:00
Alexey Milovidov
eab53d7a82 Fix trash 2021-07-25 04:13:22 +03:00
Alexey Milovidov
1c432d505a Fix style 2021-07-25 01:25:48 +03:00
Alexey Milovidov
d6c1593b22 Correct read of Date and UInt16 as DateTime in Arrow format 2021-07-24 17:36:21 +03:00
Alexey Milovidov
68df1b4564 Remove awful code by unresponsive developers 2021-07-24 14:56:29 +03:00
Alexey Milovidov
5e8a22c45c Remove more trash 2021-07-24 14:49:42 +03:00
Alexey Milovidov
01ab23b907 Remove another trash 2021-07-24 14:46:00 +03:00
Alexey Milovidov
2b03d54e94 Fix half of trash 2021-07-24 14:38:42 +03:00
alexey-milovidov
dab9cfb9c9
Merge pull request #26713 from ClickHouse/remove-more-and--more-streams
Remove more streams.
2021-07-24 02:24:10 +03:00
Nikolai Kochetov
9c92f43359 Update storages. 2021-07-23 22:33:59 +03:00
Nikolai Kochetov
2dc5c89b66 Update Storage::write 2021-07-23 17:25:35 +03:00
Alexander Kuzmenkov
9465e5d191
Merge pull request #26701 from ClickHouse/aku/window-debug
more debug checks for window functions
2021-07-22 23:09:29 +03:00
Nikolai Kochetov
3c17a62686
Merge pull request #26590 from ClickHouse/remove-some-more-streams
Remove some streams.
2021-07-22 21:28:50 +03:00
ryzuo
4d36d54c81 Update the implementaion of nth_value
Make nth_value for nullable values for out of frame rows, as the same
fashion as lagInFrame just does.
2021-07-23 00:34:08 +08:00
Nikolai Kochetov
f56a45155f Merge branch 'master' into remove-more-and--more-streams 2021-07-22 19:10:39 +03:00
Nikolai Kochetov
fd754430eb Remove more streams. 2021-07-22 19:05:52 +03:00
alexey-milovidov
c3206f6c85
Merge pull request #26470 from ClickHouse/fix-flaky-test-20
Fix flaky test `distributed_ddl_output_mode`
2021-07-22 15:32:22 +03:00
Alexander Kuzmenkov
19ee914e90 more debug checks for window functions 2021-07-22 15:17:49 +03:00
Alexander Kuzmenkov
60ca9990e5
Merge pull request #26668 from ClickHouse/aku/window-materialize
materialize all columns in window transform
2021-07-22 13:42:36 +03:00
Nikolai Kochetov
5ffd99dfd4
Merge pull request #25674 from amosbird/distributedreturnconnection
Drain connection asynchronously
2021-07-22 11:04:49 +03:00
ryzuo
94d4fb9dfc Cleanup the incomplete fix of nullability return value of lagInFrame/leadInFrame 2021-07-22 10:37:29 +08:00
ryzuo
df9ec5655c Add missing test back in 01591_window_function 2021-07-22 10:30:10 +08:00
ryzuo
4eb053a303 Implementaion of window function nth_value.
1. Implemented the window function nth_value
2. Make the return type of lag/lead, and nth_value functions to be
ColumnNullable, thus the returned value can be null if it is out
of frame.
2021-07-22 10:19:19 +08:00
Nikolai Kochetov
f38de35b14 Rename some constants. 2021-07-21 19:13:17 +03:00
Alexander Kuzmenkov
7f0fec6d5d materialize all columns in window transform 2021-07-21 16:06:50 +03:00
Alexander Kuzmenkov
94008b3199 remove print 2021-07-21 14:52:10 +03:00
Alexander Kuzmenkov
ff084e662c add more debug to window transform
The idea of working with input chunks with different structures doesn't
seem sane. Assert that they are totally equal.
2021-07-21 14:50:22 +03:00
Alexander Kuzmenkov
6ae4031723
Merge pull request #26521 from ClickHouse/aku/lag-in-frame-nullable
fix lagInFrame for nullable types
2021-07-21 14:10:16 +03:00
alexey-milovidov
f177898f5c
Merge pull request #26499 from arenadata/ADQM-326
SELECT String from ClickHouse as Avro string - PartialMatch
2021-07-21 02:04:04 +03:00
Alexander Kuzmenkov
a197511a96 fixes 2021-07-21 01:36:15 +03:00
Nikolai Kochetov
179ec05a72 Remove some streams. 2021-07-20 21:18:43 +03:00
Alexey Milovidov
72a76d34f5 Merge remote-tracking branch 'origin/master' into fix-flaky-test-20 2021-07-20 01:00:25 +03:00
Alexander Kuzmenkov
61a01782a6 fix lagInFrame for nullable types 2021-07-19 19:31:57 +03:00
Amos Bird
dbfb699690
Asynchronously drain connections. 2021-07-19 21:53:29 +08:00
Ilya Golshtein
8204516882 SELECT String from ClickHouse as Avro string - PartialMatch 2021-07-19 13:45:24 +03:00
Vitaly Baranov
4f1926550b
Merge pull request #26429 from vitlibar/remove-mysql-wire-context
Remove MySQLWireContext
2021-07-19 12:21:24 +03:00
Kseniia Sumarokova
b0ddc4fb30
Merge pull request #26364 from kssenii/fixing-date32
Continuation of #25774
2021-07-18 21:44:45 +03:00
Alexey Milovidov
e0d27da222 Rewrite distributed DDL to Processors 2021-07-18 00:45:07 +03:00
Alexey Milovidov
261a220227 Remove some code 2021-07-17 21:06:46 +03:00
mergify[bot]
89634ae224
Merge branch 'master' into estimates_for_select_query 2021-07-16 23:15:30 +00:00
alexey-milovidov
149c5a0e9b
Merge pull request #26381 from ClickHouse/separate-step-for-distributed
Add separate step to read from remote.
2021-07-17 01:29:43 +03:00
Vitaly Baranov
0f8b196682 Remove MySQLWireContext. 2021-07-16 22:21:20 +03:00
Anton Popov
03c785931a fix pushdown of limit to reading stage 2021-07-16 17:27:38 +03:00
Anton Popov
c45a9e3bd6 Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-16 17:11:34 +03:00
Nikolai Kochetov
a30b0eb542 Fix style. 2021-07-16 14:33:01 +03:00
Nikolai Kochetov
b31a4151de Fix build. 2021-07-16 14:30:07 +03:00
Nikolai Kochetov
d3099e0c89 Fix build and add comment. 2021-07-16 13:56:13 +03:00
alexey-milovidov
4103c22310
Merge pull request #26245 from arenadata/ADQM-322
Avro string for ClickHouse String
2021-07-16 12:23:50 +03:00
Alexey Milovidov
58f2f344ad Whitespaces 2021-07-16 10:53:30 +03:00
Vladimir
c8ead44c23
Merge pull request #26374 from vdimir/infinite-pmj-fix 2021-07-16 09:50:44 +03:00
Nikolai Kochetov
f36d14f68f Add separate step to read from remote. 2021-07-15 19:15:16 +03:00
vdimir
398eb9f34a
Cleanup JoiningTransform::readExecute 2021-07-15 18:01:20 +03:00
kssenii
3ba2d114d5 Revert "Merge pull request #26352 from ClickHouse/revert-25774-datatype-date32"
This reverts commit 94a210650f, reversing
changes made to 0893b9ff8e.
2021-07-15 11:41:52 +00:00
alexey-milovidov
9ba4064c86
Revert "Datatype Date32, support range 1925 to 2283" 2021-07-15 10:53:35 +03:00
alexey-milovidov
0893b9ff8e
Merge pull request #26218 from amosbird/projection-improve1
Aggressive IN index analysis for projections.
2021-07-15 08:13:45 +03:00
alexey-milovidov
96030dc2d7
Merge pull request #26250 from vdimir/issue-26017-join-totals-key
Fix block structure mismatch in join totals
2021-07-15 08:03:37 +03:00
Amos Bird
28b567a01b
Update 2021-07-14 23:09:17 +08:00
alexey-milovidov
f20a3c596a
Update ReadFromMergeTree.cpp 2021-07-14 22:56:52 +08:00
Amos Bird
0558ecdc3f
Aggressive IN index analysis for projections. 2021-07-14 22:56:52 +08:00
vdimir
b49e37aa07
Rewrite join totals, fix block structure mismatch 2021-07-14 13:02:23 +03:00
Ilya Golshtein
e1cc7387be Avro string for ClickHouse string make clang tidy happy 2021-07-13 20:03:01 +03:00
Ilya Golshtein
969458f043 Avro string for ClickHouse string minor fixes 2021-07-13 20:03:01 +03:00
Ilya Golshtein
020cce63b0 Avro string for ClickHouse string tests and doc 2021-07-13 20:03:00 +03:00
Ilya Golshtein
16532658c2 Avro string for ClickHouse string 2021-07-13 20:03:00 +03:00
Peng Jian
8522589483 Collect the amount of parts, rows and marks during the build query pipeline 2021-07-13 22:50:47 +08:00
Anton Popov
cb042afa9d pushdown limit while reading in order of primary key 2021-07-13 17:24:45 +03:00
Ivan Lezhankin
69e7f082fe Merge remote-tracking branch 'upstream/master' into async-insert 2021-07-13 17:15:32 +03:00
Anton Popov
19d0f1bbfc Merge remote-tracking branch 'upstream/master' into HEAD 2021-07-13 16:12:08 +03:00
Nikita Mikhaylov
c255f152aa
Merge pull request #26051 from ClickHouse/fix_21184
Fix sequence_id in MySQL protocol
2021-07-13 16:03:25 +03:00
Ivan Lezhankin
ab26aed6f9 Merge remote-tracking branch 'upstream/master' into async-insert 2021-07-13 13:54:09 +03:00
Kseniia Sumarokova
4a6b4d6c26
Merge pull request #25774 from liuneng1994/datatype-date32
Datatype Date32, support range 1925 to 2283
2021-07-12 20:33:39 +03:00
mergify[bot]
b7ae4e4ced
Merge branch 'master' into async-insert 2021-07-12 09:21:37 +00:00
Alexey Milovidov
9c0097cd9b Review fixes 2021-07-11 02:14:03 +03:00
Alexey Milovidov
78cde85ea8 Merge branch 'master' into estimates_for_select_query 2021-07-11 02:11:16 +03:00
kssenii
947bb4a942 Fix progress bar for local 2021-07-09 16:43:00 +03:00
Peng Jian
fb793696a1 Add bytes to result of EXPLAIN ESTIMATES 2021-07-09 19:17:03 +08:00
Peng Jian
b526aacd56 Show estimates for SELECT query 2021-07-09 18:29:45 +08:00
Alexey Milovidov
b264c3f192 Make graph pipeline rendering compatible with Dagre.JS 2021-07-09 06:26:35 +03:00
tavplubix
dd0ad58dee
Update MySQLOutputFormat.cpp 2021-07-08 13:20:06 +03:00
vdimir
9b09f215c4
Fix max parallel stream for joined pipeline 2021-07-07 20:44:30 +03:00
Alexander Tokmakov
1a470fb777 fix sequence_id in MySQL protocol 2021-07-07 20:03:28 +03:00
NengLiu
e36ce3e64e resolve conflicts 2021-07-05 13:57:49 +08:00
NengLiu
8b88988618 Merge branch 'master' into datatype-date32
# Conflicts:
#	src/DataStreams/PostgreSQLBlockInputStream.cpp
2021-07-05 10:18:38 +08:00
NengLiu
dc0c65ef4f Merge remote-tracking branch 'origin/master' into datatype-date32 2021-07-05 10:15:08 +08:00
neng.liu
b87814205d fix test error 2021-07-03 22:15:06 -07:00
alexey-milovidov
aca575cc85
Merge branch 'master' into refactor-pipeline-executor 2021-07-04 02:08:31 +03:00
neng.liu
17bbfd7722 fix some test error 2021-07-01 08:13:43 -07:00
NengLiu
00377e7c9b fix style error 2021-06-30 17:29:13 +08:00
Ivan Lezhankin
1bb41593d1 Merge remote-tracking branch 'upstream/master' into async-insert 2021-06-28 22:55:56 +03:00
neng.liu
ec7604b013 add parquet test and fix add interval error when type is date32 2021-06-28 16:36:54 +08:00
Anton Popov
fa8ad1a7c6 reduce memory usage in queries with 'ORDER BY primary_key' 2021-06-25 19:23:41 +03:00
Nikolai Kochetov
3544b059ce Merge branch 'master' into remove-PrewhereDAGInfo 2021-06-25 17:52:03 +03:00
Nikolai Kochetov
6bc0a628cd Remove PrewhereDAGInfo. 2021-06-25 17:49:28 +03:00
Kruglov Pavel
4913b18532
Merge pull request #25531 from Avogar/fix-arrow-decimal
Fix segfault in Arrow format, add arrow Decimal256 support in Arrow and Parquet.
2021-06-23 17:28:16 +03:00