Commit Graph

1769 Commits

Author SHA1 Message Date
Nikolai Kochetov
9c5ae5f536 Merge branch 'master' into processors-and-storages 2019-10-09 14:12:47 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes
Include Field.h and FieldVisitor.h into fewer files.
2019-10-08 22:40:30 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alexey-milovidov
bcc4e3f0ba
Merge branch 'master' into issue-6615 2019-10-07 22:12:25 +03:00
proller
594c535bd4 Build fixes (#7063)
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
2019-10-05 22:25:31 +03:00
Nikolai Kochetov
95ec0f7c2d Merged with master. 2019-10-04 20:53:21 +03:00
Nikolai Kochetov
23069ca6d0 Progress for MergeTreeSelectProcessor. 2019-10-04 20:50:07 +03:00
Nikolai Kochetov
627d48c19a Added ExecutionSpeedLimits. 2019-10-04 20:49:57 +03:00
Ivan
05b17976d1
Commit to Kafka explicitly after the writing is finalized (#7175) 2019-10-03 00:17:19 +03:00
Nikita Mikhaylov
5a34e39286 small changes after review 2019-10-02 17:26:15 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
chertus
038428bccf do not affect other SquashingBlockInputStream instances 2019-10-01 16:01:08 +03:00
Nikita Mikhaylov
d9c12f7f96 lost files 2019-10-01 13:51:17 +03:00
Nikita Mikhaylov
d47d4cd6c1 parallel parsing 2019-10-01 13:48:46 +03:00
root
bcc24d3cbc Fix code Style. 2019-09-27 22:56:40 +08:00
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950)
* Always read and insert Kafka messages as a whole.
2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin
PartialMergeJoin
2019-09-18 16:16:10 +03:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http
Low cardinality in native http
2019-09-13 09:01:08 +03:00
chertus
441faba0e3 materializeBlockInplace function 2019-09-12 15:59:53 +03:00
Nikolai Kochetov
d7596e51b7 Removed convert_types_to_low_cardinality from NativeBlockInputStream. 2019-09-12 14:33:46 +03:00
Nikolai Kochetov
959744fede Address header by name in NativeBlockInputStream. 2019-09-12 12:34:47 +03:00
Nikolai Kochetov
a59ae3826d Do not flush output stream in copy data. Add special flushing callback to Watch query. 2019-09-11 14:38:05 +03:00
Nikolai Kochetov
bcc764e2cd Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:45:53 +03:00
Nikolai Kochetov
7ddc8a6dde Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:41:05 +03:00
Nikolai Kochetov
8dd8ab7d1f Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:31:41 +03:00
Nikolai Kochetov
071b5dd514 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:30:13 +03:00
Nikolai Kochetov
30394113a1 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:16:31 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
2019-09-05 22:45:48 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
CurtizJ
ba98c038ab fix column ttl with user defaults 2019-09-03 13:27:02 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream
Reduced children_mutex lock scope in IBlockInputStream
2019-08-30 16:02:22 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
2019-08-30 11:24:00 +03:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
CurtizJ
d7a712e7ae update logic of 'with fill' modifier 2019-08-29 18:19:12 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Anton Popov
4cd376f587
fix table ttl after bad merge with master 2019-08-26 21:00:13 +03:00
Alexey Milovidov
ffbbb173c5 Addition to prev. revision 2019-08-25 01:04:58 +03:00
Alexey Milovidov
17a1938f0f Addition to prev. revision 2019-08-25 01:04:36 +03:00
Alexey Milovidov
9660a4db80 Better exception message 2019-08-25 00:35:07 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
a6997aa83f Modifications after merging constraints support 2019-08-24 16:00:04 +03:00
CurtizJ
5e6ea650eb update comments 2019-08-23 14:13:57 +03:00
CurtizJ
811dab72a8 fix limit with offset 2019-08-23 14:11:50 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
CurtizJ
9fdb9e5805 implement modifier 'with fill' for 'order by' clause 2019-08-21 15:59:03 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run
Try to remove dry run
2019-08-21 03:52:41 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
a4e2fcdd49 Remove recursiveMaterializeConstants. 2019-08-19 18:41:42 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
2019-08-16 02:39:53 +03:00
Nikolai Kochetov
a4be4da9b4 Added recursiveMaterializeConstants. 2019-08-15 10:55:59 +03:00
Nikolai Kochetov
6586f059b5 Added recursiveMaterializeConstants. 2019-08-15 10:54:39 +03:00
Nikolai Kochetov
37a88e1407 Added recursiveMaterializeConstants. 2019-08-15 10:28:33 +03:00
Gleb Novikov
5ee4238538 small change to run CI 2019-08-15 03:53:16 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
chertus
7c566f317c refactoring: extract SelectQueryExpressionAnalyzer from ExpressionAnalyzer 2019-08-14 22:30:30 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
CurtizJ
a785d4a435 Merge branch 'master' of https://github.com/yandex/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 20:24:47 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
8f55fdbd15 Wrap const columns in RemoteBlockInputStream. 2019-08-14 18:14:37 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
CurtizJ
22d9bd06cc Merge branch 'dmitriiut-WITH_TIES_and_WITH_FILL' of https://github.com/dmitriiut/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 16:40:07 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
CurtizJ
c3e0ceecde wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 21:28:18 +03:00
CurtizJ
7ae73befd6 wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 17:07:36 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
Gleb Novikov
0233f32f9b Fixed AddresSanitizer error 2019-08-11 12:28:15 +03:00
Ivan
cce3ab08bb
Do not convert columns by position when pushing to materialized views (#6415)
* Do not convert columns by position
* Update 00984_materialized_view_to_columns.reference
2019-08-11 00:00:13 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
40cc399037 Fix PushingToViewsBlockOutputStream. 2019-08-09 20:15:01 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
804a6fad8a Do not return extremes and totals for insert select. 2019-08-08 17:46:30 +03:00
Alexey Milovidov
a23813383d Attempt to fix performance test 2019-08-08 03:48:43 +03:00
Nikolai Kochetov
e361d336bb
Merge pull request #6239 from yandex/processors-and-output-formats
Processors and output formats
2019-08-05 19:45:17 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Amos Bird
39b8141418 Fix recursive materialized view 2019-08-05 02:01:16 +08:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang
Fix materialized view with column defaults.
2019-08-04 03:06:40 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
alexey-milovidov
149ed67462
Merge pull request #6281 from yandex/fix-low-cardinality-aggregate-arguments
Fix LowCardinality arguments conversion in AggregateFunctionFactory
2019-08-03 01:50:21 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts
TTL improvements.
2019-08-02 22:51:28 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
77ca4acf67 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:54:40 +03:00
Nikolai Kochetov
5a9a4b23c3 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:50:42 +03:00
Nikolai Kochetov
f71ce27a70 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:49:52 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Sergi Vladykin
662364b720 performance bug fix: never read the children if we are not going to return any data 2019-07-31 22:36:03 +03:00
Nikolai Kochetov
0e61ca79d0 Update FormatFactory. 2019-07-31 13:34:31 +03:00
alexey-milovidov
bfdfb7c814
Merge pull request #6232 from yandex/limit-sleep-time-in-max-execution-speed
Limit sleep time in max_execution_speed; fixed Estimated query execution time (inf seconds) is too long
2019-07-31 05:54:05 +03:00
alexey-milovidov
7fd6204114
Merge pull request #6197 from yandex/thread_local_rng
Less number of "clock_gettime" calls; fixed ABI compatibility between debug/release in Allocator.
2019-07-31 04:36:30 +03:00
Alexey Milovidov
2205a0097d Avoid false exceptions like "Estimated query execution time (inf seconds) is too long" 2019-07-31 03:05:31 +03:00
Alexey Milovidov
f75dff9be8 Limit maximum sleep time for "max_execution_speed" settings 2019-07-31 02:57:53 +03:00
CurtizJ
218de76285 fix rollup and cube modifiers with two-level aggregation 2019-07-30 19:36:52 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults.
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
2019-07-30 10:49:54 +08:00
Gleb Novikov
a3ebe31535 Brace style fix 2019-07-29 22:41:08 +03:00
Sergi Vladykin
915092515c revert the performance bug fix 2019-07-29 11:20:11 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Gleb Novikov
8f4883b0d2 Better constraint exception 2019-07-28 15:33:40 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them.
Though in regular merges eviction of expired values still must happen.
2019-07-28 13:30:46 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikolai Kochetov
079e41ac26 Use IInputFormat and IOutputFormat by default. 2019-07-25 13:51:32 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
Vitaliy Zakaznikov
c84fd80345 * Fixing clang build by converting old style cast (Int64) to static_cast<Int64>. 2019-07-09 22:06:29 -04:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00