thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-17 03:42:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
36,484 Commits 9,315 Branches 1,783 Tags 2.1 GiB
d4dcd1a2d5
Commit Graph

1903 Commits

Author SHA1 Message Date
root
0189945ad8 Optimize empty IN subquery and empty INNER/RIGHT JOIN. 2019-09-27 19:06:20 +08:00
chertus
10eaef1adc squash left-hand blocks in pmj (phase 2) 2019-09-26 21:51:17 +03:00
Ivan
cffc254922
Always read and insert Kafka messages as a whole (#6950) 
* Always read and insert Kafka messages as a whole.
 2019-09-20 15:12:32 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin 
PartialMergeJoin
 2019-09-18 16:16:10 +03:00
alexey-milovidov
12c26e6013
Merge pull request #6891 from yandex/low_cardinality_in_native_http 
Low cardinality in native http
 2019-09-13 09:01:08 +03:00
chertus
441faba0e3 materializeBlockInplace function 2019-09-12 15:59:53 +03:00
Nikolai Kochetov
d7596e51b7 Removed convert_types_to_low_cardinality from NativeBlockInputStream. 2019-09-12 14:33:46 +03:00
Nikolai Kochetov
959744fede Address header by name in NativeBlockInputStream. 2019-09-12 12:34:47 +03:00
Nikolai Kochetov
a59ae3826d Do not flush output stream in copy data. Add special flushing callback to Watch query. 2019-09-11 14:38:05 +03:00
Nikolai Kochetov
bcc764e2cd Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:45:53 +03:00
Nikolai Kochetov
7ddc8a6dde Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:41:05 +03:00
Nikolai Kochetov
8dd8ab7d1f Use header in native format created in InterpreterSelectQuery. Fill missed columns in Native format. 2019-09-10 19:31:41 +03:00
Nikolai Kochetov
071b5dd514 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:30:13 +03:00
Nikolai Kochetov
30394113a1 Add LowCardinality conversion to Native format if types of columns are not equals. 2019-09-10 17:16:31 +03:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Anton Popov
69da4f30b3
Merge branch 'master' into merging_input_function 2019-09-06 16:20:00 +03:00
Olga Khvostikova
f90642ce23
Merge pull request #6610 from CurtizJ/merging_with_ties_and_with_fill 
WITH TIES modifier for LIMIT and WITH FILL modifier for ORDER BY. (continuation of #5069)
 2019-09-05 22:45:48 +03:00
CurtizJ
b04cea7463 minor fixes of table function input 2019-09-05 16:17:01 +03:00
CurtizJ
7accc09066 Merge branch 'palasonic-add-input-function' of https://github.com/palasonic1/ClickHouse into merging_input_function 2019-09-04 15:25:20 +03:00
CurtizJ
9cfcbd6649 fix bug in FillingBlockInputStream 2019-09-04 01:01:09 +03:00
CurtizJ
ba98c038ab fix column ttl with user defaults 2019-09-03 13:27:02 +03:00
CurtizJ
6d821c4877 fix build 2019-09-03 13:07:31 +03:00
CurtizJ
e122d54dcb update comments 2019-09-02 18:22:27 +03:00
CurtizJ
de5e2b4d6b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-09-02 17:34:49 +03:00
CurtizJ
da11fb86b7 implement 'with fill' modifier with processors 2019-09-02 17:29:51 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
alexey-milovidov
b27f5a7390
Merge pull request #6740 from Enmk/reduced_locking_in_IBlockInputStream 
Reduced children_mutex lock scope in IBlockInputStream
 2019-08-30 16:02:22 +03:00
Vasily Nemkov
b66485a1d2 Reduced children_mutex lock scope in IBlockInputStream 
This is to fix TSan warning 'lock-order-inversion'.
Thread locks IBlockInputStream::children_mutex (A) and then subsequently locks
MergeTreeDataPart::columns_lock mutex (B), holding it for extended period of
time, surviving the unlock of the A. Then, while B is still locked, A
is locked again, causing a TSan warning.
 2019-08-30 11:24:00 +03:00
CurtizJ
048d3da9ab better types comparison and conversion in FillingBlockInputStream 2019-08-30 01:24:33 +03:00
CurtizJ
d7a712e7ae update logic of 'with fill' modifier 2019-08-29 18:19:12 +03:00
alesapin
549c61cad9
Update MarkInCompressedFile.h 2019-08-29 15:38:20 +03:00
Alexey Milovidov
39d50b5144 Remove mimalloc 2019-08-28 22:01:52 +03:00
Alexey Milovidov
b21fdff77e Merging #6678 2019-08-27 21:59:21 +03:00
Alexey Milovidov
5ca8f8d695 Merge branch 'master' of https://github.com/weiqxu/ClickHouse into weiqxu-master 2019-08-27 21:52:09 +03:00
CurtizJ
50d870705c limit with ties for processors 2019-08-27 20:48:42 +03:00
CurtizJ
42633c801b Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-27 17:11:57 +03:00
Weiqing Xu
2fbcd607f3 check free space when use external sort/aggerator 2019-08-27 08:23:07 +08:00
CurtizJ
1774ac4b9e Merge remote-tracking branch 'upstream/master' into HEAD 2019-08-26 22:29:12 +03:00
Anton Popov
4cd376f587
fix table ttl after bad merge with master 2019-08-26 21:00:13 +03:00
Alexey Milovidov
ffbbb173c5 Addition to prev. revision 2019-08-25 01:04:58 +03:00
Alexey Milovidov
17a1938f0f Addition to prev. revision 2019-08-25 01:04:36 +03:00
Alexey Milovidov
9660a4db80 Better exception message 2019-08-25 00:35:07 +03:00
Alexey Milovidov
3fef8e92ad Merging CONSTRAINTS support 2019-08-25 00:20:20 +03:00
Alexey Milovidov
a6997aa83f Modifications after merging constraints support 2019-08-24 16:00:04 +03:00
CurtizJ
5e6ea650eb update comments 2019-08-23 14:13:57 +03:00
CurtizJ
811dab72a8 fix limit with offset 2019-08-23 14:11:50 +03:00
Alexey Milovidov
4366791b63 Merge branch 'table-constraints' of https://github.com/NanoBjorn/ClickHouse into NanoBjorn-table-constraints 2019-08-23 07:49:10 +03:00
Alexey Milovidov
c4712f1e6e Make the code less bad 2019-08-23 02:22:57 +03:00
CurtizJ
5c2309132d Merge remote-tracking branch 'upstream/master' into merging_with_ties_and_with_fill 2019-08-23 02:18:45 +03:00
CurtizJ
e069fc495d fix limit with ties 2019-08-23 02:16:00 +03:00
Alexey Milovidov
859736d935 Basic code quality of Live View 2019-08-23 01:41:30 +03:00
CurtizJ
9a29c218ff improvents and fixes of modifier 'with fill' for 'order by' clause 2019-08-22 17:08:14 +03:00
CurtizJ
9fdb9e5805 implement modifier 'with fill' for 'order by' clause 2019-08-21 15:59:03 +03:00
alexey-milovidov
308baa182e
Merge branch 'master' into table-constraints 2019-08-21 06:33:08 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
alexey-milovidov
3f607b21fe
Merge pull request #6375 from yandex/try-to-remove-dry-run 
Try to remove dry run
 2019-08-21 03:52:41 +03:00
Gleb Novikov
86fecc7501 Merge branch 'master' into table-constraints 2019-08-20 12:17:56 +03:00
Nikolai Kochetov
a4e2fcdd49 Remove recursiveMaterializeConstants. 2019-08-19 18:41:42 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
18ad0e7e6b Merged with master. 2019-08-16 13:55:40 +03:00
alexey-milovidov
a466c7aebd
Merge pull request #6299 from CurtizJ/order-by-efficient 
Optimizations of ranges selection while reading with enabled optimize_read_in_order.
 2019-08-16 02:39:53 +03:00
Nikolai Kochetov
a4be4da9b4 Added recursiveMaterializeConstants. 2019-08-15 10:55:59 +03:00
Nikolai Kochetov
6586f059b5 Added recursiveMaterializeConstants. 2019-08-15 10:54:39 +03:00
Nikolai Kochetov
37a88e1407 Added recursiveMaterializeConstants. 2019-08-15 10:28:33 +03:00
Gleb Novikov
5ee4238538 small change to run CI 2019-08-15 03:53:16 +03:00
Gleb Novikov
ab1c4139de Added ReplicatedMergeTree support and test for constraints, also added VIOLATED_CONSTRAINT error 2019-08-14 22:51:03 +03:00
chertus
7c566f317c refactoring: extract SelectQueryExpressionAnalyzer from ExpressionAnalyzer 2019-08-14 22:30:30 +03:00
CurtizJ
0b3d7d8032 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 21:26:25 +03:00
CurtizJ
a785d4a435 Merge branch 'master' of https://github.com/yandex/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 20:24:47 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
8f55fdbd15 Wrap const columns in RemoteBlockInputStream. 2019-08-14 18:14:37 +03:00
chertus
ddde50c542 minor fixes in includes 2019-08-14 17:06:16 +03:00
CurtizJ
22d9bd06cc Merge branch 'dmitriiut-WITH_TIES_and_WITH_FILL' of https://github.com/dmitriiut/ClickHouse into merging_with_ties_and_with_fill 2019-08-14 16:40:07 +03:00
CurtizJ
94bca8315d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-14 01:41:38 +03:00
CurtizJ
c3e0ceecde wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 21:28:18 +03:00
CurtizJ
7ae73befd6 wait for finish calculations at underlying streams while cancelling AsynchronousBlockInputStream 2019-08-13 17:07:36 +03:00
Nikolai Kochetov
18939a5776 Fix build/ 2019-08-12 13:59:45 +03:00
Nikolai Kochetov
631bbde420 Merged with master. 2019-08-12 13:19:13 +03:00
Alexey Milovidov
2570907f44 Removed useless parameter 2019-08-12 00:45:18 +03:00
Gleb Novikov
381ea6cb6e Merge branch 'master' into table-constraints 2019-08-11 12:38:34 +03:00
Gleb Novikov
0233f32f9b Fixed AddresSanitizer error 2019-08-11 12:28:15 +03:00
Ivan
cce3ab08bb
Do not convert columns by position when pushing to materialized views (#6415) 
* Do not convert columns by position
* Update 00984_materialized_view_to_columns.reference
 2019-08-11 00:00:13 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Nikolai Kochetov
40cc399037 Fix PushingToViewsBlockOutputStream. 2019-08-09 20:15:01 +03:00
Nikolai Kochetov
2ae3db7920 Merged with master. 2019-08-09 18:32:44 +03:00
Nikolai Kochetov
804a6fad8a Do not return extremes and totals for insert select. 2019-08-08 17:46:30 +03:00
Alexey Milovidov
a23813383d Attempt to fix performance test 2019-08-08 03:48:43 +03:00
Nikolai Kochetov
e361d336bb
Merge pull request #6239 from yandex/processors-and-output-formats 
Processors and output formats
 2019-08-05 19:45:17 +03:00
CurtizJ
cfe32ad89b Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-08-04 21:43:00 +03:00
Amos Bird
39b8141418 Fix recursive materialized view 2019-08-05 02:01:16 +08:00
Nikolai Kochetov
599f3ddf6e Merged with master. 2019-08-04 15:35:21 +03:00
Alexey Milovidov
8b8c59d71b Simplification of #3796 2019-08-04 03:29:32 +03:00
Alexey Milovidov
224bc4df97 Minor modifications + a comment #3796 2019-08-04 03:12:17 +03:00
alexey-milovidov
b045e85469
Merge pull request #3796 from amosbird/hang 
Fix materialized view with column defaults.
 2019-08-04 03:06:40 +03:00
alexey-milovidov
d3e4249420
Merge branch 'master' into ttldropparts 2019-08-03 02:17:29 +03:00
alexey-milovidov
149ed67462
Merge pull request #6281 from yandex/fix-low-cardinality-aggregate-arguments 
Fix LowCardinality arguments conversion in AggregateFunctionFactory
 2019-08-03 01:50:21 +03:00
alexey-milovidov
f8980e691e
Merge pull request #6274 from CurtizJ/ttl-old-parts 
TTL improvements.
 2019-08-02 22:51:28 +03:00
CurtizJ
5f7ebb18ed more optimal ranges selection at reading in order 2019-08-02 19:16:18 +03:00
Nikolai Kochetov
0201cdf61a Merge branch 'master' into processors-and-output-formats 2019-08-02 15:29:19 +03:00
Nikolai Kochetov
77ca4acf67 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:54:40 +03:00
Nikolai Kochetov
5a9a4b23c3 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:50:42 +03:00
Nikolai Kochetov
f71ce27a70 Remove LowCardinality in AggregatingSortedBlockInputStream. 2019-08-02 13:49:52 +03:00
CurtizJ
82f304f81e add query 'SYSTEM STOP TTL MERGES' 2019-08-01 18:36:12 +03:00
CurtizJ
f224269d41 filter by ttl parts created before 'alter ... modify ttl' query with 'optimize ... final' query 2019-08-01 14:10:42 +03:00
Sergi Vladykin
662364b720 performance bug fix: never read the children if we are not going to return any data 2019-07-31 22:36:03 +03:00
Nikolai Kochetov
0e61ca79d0 Update FormatFactory. 2019-07-31 13:34:31 +03:00
alexey-milovidov
bfdfb7c814
Merge pull request #6232 from yandex/limit-sleep-time-in-max-execution-speed 
Limit sleep time in max_execution_speed; fixed Estimated query execution time (inf seconds) is too long
 2019-07-31 05:54:05 +03:00
alexey-milovidov
7fd6204114
Merge pull request #6197 from yandex/thread_local_rng 
Less number of "clock_gettime" calls; fixed ABI compatibility between debug/release in Allocator.
 2019-07-31 04:36:30 +03:00
Alexey Milovidov
2205a0097d Avoid false exceptions like "Estimated query execution time (inf seconds) is too long" 2019-07-31 03:05:31 +03:00
Alexey Milovidov
f75dff9be8 Limit maximum sleep time for "max_execution_speed" settings 2019-07-31 02:57:53 +03:00
CurtizJ
218de76285 fix rollup and cube modifiers with two-level aggregation 2019-07-30 19:36:52 +03:00
Amos Bird
6db1c02bfd Fix materialized view with column defaults. 
https://github.com/yandex/ClickHouse/issues/448
https://github.com/yandex/ClickHouse/issues/3484
https://github.com/yandex/ClickHouse/issues/3450
https://github.com/yandex/ClickHouse/issues/2878
https://github.com/yandex/ClickHouse/issues/2285
 2019-07-30 10:49:54 +08:00
Gleb Novikov
a3ebe31535 Brace style fix 2019-07-29 22:41:08 +03:00
Sergi Vladykin
915092515c revert the performance bug fix 2019-07-29 11:20:11 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Gleb Novikov
8f4883b0d2 Better constraint exception 2019-07-28 15:33:40 +03:00
Sergi Vladykin
c5a42a6948 TTL: Only drop altogether the expired parts and not partially prune them. 
Though in regular merges eviction of expired values still must happen.
 2019-07-28 13:30:46 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikolai Kochetov
079e41ac26 Use IInputFormat and IOutputFormat by default. 2019-07-25 13:51:32 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler 
Poor man's profiler on query level [Work in progress]
 2019-07-23 03:02:58 +03:00
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas 
Do not access shared arenas in aggregate function columns.
 2019-07-20 03:16:24 +03:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns. 
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
 2019-07-18 14:21:37 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem 
Report memory usage in performance tests.
 2019-07-16 18:09:44 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors 
Processors
 2019-07-11 19:22:02 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
Vitaliy Zakaznikov
c84fd80345 * Fixing clang build by converting old style cast (Int64) to static_cast<Int64>. 2019-07-09 22:06:29 -04:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00
Vitaliy Zakaznikov
a80af666ad * Updates that incorporate comments from the review 2019-07-09 08:41:55 -04:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4 
A few fixes for PVS-Studio
 2019-07-09 01:10:05 +03:00
Alexander Kuzmenkov
78df28f0e9 Cleanup. 2019-07-08 18:35:32 +03:00
Nikolai Kochetov
a2cdab2799 Fix build. 2019-07-08 16:07:46 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs 
Fix wrong ColumnConst.isColumnNullable()
 2019-07-03 02:06:07 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286 
Add virtual columns to Kafka Engine tables
 2019-07-01 21:30:09 +03:00
alexey-milovidov
bf8c154d3d
Merge pull request #5819 from CurtizJ/fix-segfault-ttl 
Fix segfault in TTL merge with non-physical columns in block.
 2019-07-01 20:28:26 +03:00
CurtizJ
ecf9feab9c remove extra semicolon 2019-07-01 17:09:22 +03:00
CurtizJ
c0a63801fc fix segfault in ttl merge with non-physical columns in block 2019-07-01 15:50:50 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
alexey-milovidov
106a2d0c0f
Merge pull request #4930 from yandex/tsan-miscellaneous 
Miscellaneous changes
 2019-07-01 11:11:53 +03:00
alexey-milovidov
5fb7bf6854
Update ParallelInputsProcessor.h 2019-07-01 03:15:14 +03:00
Gleb Novikov
bb78012cf9 Removed unused method and assertions 2019-06-30 12:09:06 +02:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Ivan Lezhankin
61750d09d2 Commit offsets for SELECTing from Kafka table too 2019-06-20 15:34:25 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
Ivan Lezhankin
d907d8e8ca Commit offsets for SELECTing from Kafka table too 2019-06-17 19:27:18 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
Vitaliy Zakaznikov
ea83a4cafa * Removing 'hash' column from WATCH [db.live_view] EVENTS query result 
as hash of the result are not usually provided in ClickHouse.
  This is also done to match the implementation of the SELECT query that only
  returns '_version' virtual column when using LIVE VIEW tables.
 2019-06-16 07:09:43 -04:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
8b87511e25 Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*\w+/}/'
 2019-06-13 13:37:13 +03:00
Vitaliy Zakaznikov
5983273694 Fixing bugs reported by sanitizers 
* data race condition on storage is_dropped access
* invalid reference to storage after it is deleted
* invalid reference to mutex after storage is deleted
 2019-06-12 09:11:44 -04:00
Vitaliy Zakaznikov
12060d8879 * Fixing errors that prevented clang build. 2019-06-11 08:27:47 -04:00
Vitaliy Zakaznikov
b6efd8599f * Trying again to fix style checks. Now running ./utils/check-style/check-style reports no errors. 2019-06-11 06:30:57 -04:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found 
* Trying to fix failed style checks
* Trying to fix clang build fail
 2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
fc4ea55b98 * Fixing bug in dbms/src/DataStreams/PushingToViewsBlockOutputStream.cpp 
that was introduced when trying to fix a clang error.
 2019-06-10 08:11:43 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Vitaliy Zakaznikov
87b58e4150 * Fixing clang errors 
* Fixing LIVE VIEW tests
 2019-06-10 07:18:33 -04:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Vitaliy Zakaznikov
2930965938 * Renaming live_view_heartbeat_delay setting to live_view_heartbeat_interval 
and making the setting to be in seconds instead of usec
* Updated LIVE VIEW table to keep version consistent as long as the server is up
* Removed calculation of hash in writeIntoLiveView method as it is recalculated
  in the LiveViewBlockOutputStream
* Changed to using values from the local context for live_view_heartbeat_interval and
  temporary_live_view_timeout instead of the global context
* Updated LIVE VIEW tests to match the changes
 2019-06-06 21:10:56 -04:00
Gleb Novikov
375e464086 Fixed exception text 2019-06-06 00:25:48 +03:00
Vitaliy Zakaznikov
5f3be8134d * Disallowing writes into LIVE VIEW tables 
* Adding support for watching live views via HTTPHandler
* Small fix to WriteBufferValidUTF8.cpp to propagate next() call
* Updated copyData.cpp to treat block with no rows as
  "flush block"
* Updated PushingToViewsBlockOutputStream.cpp to directly use
  LIVE VIEW output stream instead of calling its write method
 2019-06-05 07:30:29 -04:00
Gleb Novikov
f413b1e346 Implemented memoryIsByte, replaced memoryIsZero with it, implemented memory check in CheckConstraintsBlockOutputStream 2019-06-05 11:05:46 +03:00
Gleb Novikov
b63623d014 Extended constraint exception with constraint name and expression 2019-06-05 10:33:34 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Konstantin Podshumok
f993ea6127 add timeouts to remote streams 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
palasonicq
ea86a758a1 Added some improvements after code review 2019-05-30 23:12:44 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT 
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
 2019-05-29 17:52:13 -04:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
palasonicq
0823e397ea Added missed modifications 2019-05-28 21:30:10 +03:00
Ivan Lezhankin
1eccbc39c5 Don't add virtual column to empty block 2019-05-28 00:01:24 +03:00
Anastasiya Rodigina
21e27cb854 Make custom upper_bound - probably will change it 2019-05-27 10:50:37 +00:00
Gleb Novikov
1aaab07459 Fixed exception handling in 00952 test 2019-05-27 02:57:18 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Anastasiya Rodigina
cd5b3e60c5 Try 2 to fix tests 2019-05-26 21:41:12 +00:00
Anastasiya Rodigina
abec62bc5d Try 1 to fix tests - edit tabs 2019-05-26 20:47:48 +00:00
Anastasiya Rodigina
1c3f6ee6f0 Try 1 to fix tests - edit tabs 2019-05-26 20:43:46 +00:00
Anastasiya Rodigina
99f1aa65b3 Try 1 to fix tests 2019-05-26 20:41:51 +00:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Yuriy
96e3574a06 Improvements of MySQL Wire Protocol 2019-05-26 09:52:29 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Nikita Lapkov
30c31bc85a Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-24 13:28:42 +00:00
Ivan Lezhankin
646d6f3fb5 Fix order of destruction 2019-05-23 16:54:11 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
alexey-milovidov
02937294ce
Merge pull request #5311 from azat-archive/SimpleAggregateFunction-Arena-fix 
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE
 2019-05-19 13:12:38 +03:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Gleb Novikov
9e6625441c Returned context to CheckConstraintsBlockOutputStream constructor 2019-05-19 10:19:44 +03:00
Gleb Novikov
d1492fc05d Removed context from CheckConstraintsBlockOutputStream 2019-05-19 10:17:06 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
Azat Khuzhin
db274bf516
Allocates arena for SimpleAggregateFunction only if IAggregateFunction requires 2019-05-19 03:33:04 +03:00
Azat Khuzhin
4e8370b0b0
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE 
SimpleAggregateFunction do not pass arena to the
add_function -> getAddressOfAddFunction(), hence next crash happens:
  (gdb) bt
  #0  DB::Arena::alloc (size=64, this=0x0) at ../dbms/src/Common/Arena.h:124
  #1  DB::SingleValueDataString::changeImpl (this=0x7f97424a27d8, value=..., arena=0x0) at ../dbms/src/AggregateFunctions/AggregateFunctionMinMaxAny.h:274
  #2  0x0000000005ea5319 in DB::AggregateFunctionNullUnary<true>::add (arena=<optimized out>, row_num=<optimized out>, columns=<optimized out>, place=<optimized out>, this=<optimized out>) at ../dbms/src/AggregateFunctions/AggregateFunctionNull.h:43
  #3  DB::IAggregateFunctionHelper<DB::AggregateFunctionNullUnary<true> >::addFree (that=<optimized out>, place=<optimized out>, columns=<optimized out>, row_num=<optimized out>, arena=<optimized out>) at ../dbms/src/AggregateFunctions/IAggregateFunction.h:131
  #4  0x000000000679772f in DB::AggregatingSortedBlockInputStream::addRow (this=this@entry=0x7f982de19c00, cursor=...) at ../dbms/src/Common/AlignedBuffer.h:31
  #5  0x0000000006797faa in DB::AggregatingSortedBlockInputStream::merge (this=this@entry=0x7f982de19c00, merged_columns=..., queue=...) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:140
  #6  0x0000000006798979 in DB::AggregatingSortedBlockInputStream::readImpl (this=0x7f982de19c00) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:78
  #7  0x000000000622db55 in DB::IBlockInputStream::read (this=0x7f982de19c00) at ../dbms/src/DataStreams/IBlockInputStream.cpp:56
  #8  0x0000000006613bee in DB::MergeTreeDataMergerMutator::mergePartsToTemporaryPart (this=this@entry=0x7f97ec65e1a0, future_part=..., merge_entry=..., time_of_merge=<optimized out>, disk_reservation=<optimized out>, deduplicate=<optimized out>) at /usr/include/c++/8/bits/shared_ptr_base.h:1018
  #9  0x000000000658f7a4 in DB::StorageReplicatedMergeTree::tryExecuteMerge (this=0x7f97ec65b810, entry=...) at /usr/include/c++/8/bits/unique_ptr.h:342
  #10 0x00000000065940ab in DB::StorageReplicatedMergeTree::executeLogEntry (this=0x7f97ec65b810, entry=...) at ../dbms/src/Storages/StorageReplicatedMergeTree.cpp:910
  <snip>

  (gdb) f 1
  (gdb) p MAX_SMALL_STRING_SIZE
  $1 = 48
  (gdb) p capacity
  $2 = 64
  (gdb) p value
  $3 = {data = 0x7f97242fcbd0 "HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH", size = 61}

v2: avoid leaking of allocated by Arena memory on the intermediate step

Fixes: 8f8d2c048e ("Merge pull request #4629 from bgranvea/simple_aggregate_function")
 2019-05-19 03:32:55 +03:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
alexey-milovidov
fa4a7eb3d1
Merge branch 'master' into merge-itable-istorage 2019-05-18 00:37:12 +03:00
Ivan Lezhankin
dcff73c8d4 Fix build 2019-05-17 21:45:42 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Artem Zuikov
4eee10d788
Merge pull request #5271 from 4ertus2/some 
Cache ExpressionBlockInputStream header
 2019-05-17 13:14:22 +03:00
chertus
927557b0f8 move caching to ctor 2019-05-16 20:16:25 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
4ee84810b0 including information about query execution in response 2019-05-16 08:36:08 +03:00
Yuriy
459ec05828 fixed style 2019-05-16 06:45:17 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
chertus
4a5e2dfd3c cache ExpressionBlockInputStream header 2019-05-14 21:26:19 +03:00
Ivan
4a5832b18a
Check the time limit every (flush_interval / poll_timeout) number of rows from Kafka (#5249) 2019-05-14 18:52:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
Anastasiya Rodigina
af4fff970b Revert "Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery" 
This reverts commit 61d49e1e5f.
 2019-05-10 23:22:45 +03:00
Anastasiya Rodigina
61d49e1e5f Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery 2019-05-10 22:09:15 +03:00
alexey-milovidov
8f8d2c048e
Merge pull request #4629 from bgranvea/simple_aggregate_function 
SimpleAggregateFunction data type
 2019-05-09 18:45:59 +03:00
alexey-milovidov
b611bc0695
Update ReverseBlockInputStream.h 2019-05-05 23:25:49 +03:00
alexey-milovidov
00753506dc
Update ReverseBlockInputStream.cpp 2019-05-05 23:24:05 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Alexey Milovidov
1be21e3cb6 Removed bad and useless code in ColumnsDescription 2019-05-02 00:43:05 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Anastasiya Rodigina
87b49f13b7 Edit review issues 2019-04-27 15:43:28 +03:00
Anastasiya Rodigina
e750755f8f Add comments and edit style 2019-04-27 14:59:08 +03:00
dmitriiut
a2c3fd2057 bug fixes 2019-04-23 04:48:51 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
dmitriiut
50c322bc6d WITH FILL version 2019-04-22 02:04:23 +03:00
dmitriiut
3c2922c406
Merge branch 'master' into dmitriiut-WITH_TIES_and_WITH_FILL 2019-04-21 19:37:38 +03:00
dmitriiut
e94575e1da fix progress 2019-04-21 19:16:25 +03:00
dmitrii
100cee18c3 comments + fix naming 2019-04-19 18:45:42 +03:00
dmitrii
a130850e15 limit with ties 2019-04-19 16:38:25 +03:00
Anastasiya Rodigina
a11fcffd0e fix style (removed whitespace) 2019-04-18 02:07:36 +03:00
Anastasiya Rodigina
ef0be2a721 Fix build and style issues 2019-04-18 01:58:24 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
alesapin
faeb95cfd7
Merge branch 'master' into adaptive_index_granularity 2019-04-15 19:36:36 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Danila Kutenin
622b2c8472 Enable LFAlloc for MarkCache and UncompressedCache 2019-04-13 15:07:43 +03:00
Nikolai Kochetov
54b15385bd Calculate rows_before_limit_at_least. 2019-04-08 17:55:20 +03:00
bgranvea
42b07c5ee9 refactor to avoid dynamic_cast in data type serialization 2019-04-08 15:39:42 +02:00
bgranvea
faa7d38cb5 fix for style 2019-04-08 15:39:42 +02:00
bgranvea
9d9d16e1ea support for SimpleAggregateFunction data type 2019-04-08 15:39:41 +02:00
alesapin
a53b002973 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-08 14:29:33 +03:00
Alexey Milovidov
879d746abd Miscellaneous changes 2019-04-07 01:20:09 +03:00
Danila Kutenin
1c030e4ed1 Fix allocations for a while 2019-04-06 23:53:25 +03:00
Danila Kutenin
37d70ac558 MarkCache and UncompressedCache use different allocator to catch segfaults more reliable 2019-04-06 18:27:39 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Ivan Lezhankin
34cf495db8 Fix BlockIO::operator= 2019-04-05 19:21:46 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
alesapin
da19254fa9 Remove useless code 2019-04-01 14:29:31 +03:00
alesapin
7b67200258 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-04-01 11:54:19 +03:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792) 
For detailed description see the related PR
 2019-03-29 23:31:06 +03:00
zhang2014
aab314f154 const insert interpreter 2019-03-29 23:47:16 +08:00
Alexey Milovidov
c8bc4d6e26 Fixed error 2019-03-28 19:48:14 +03:00
Alexey Milovidov
fa598d427d Fixed error 2019-03-28 19:28:54 +03:00
alesapin
c139c801f8 Better stop condition 2019-03-28 14:12:59 +03:00
alesapin
1b12d0219c Fix build 2019-03-28 12:31:57 +03:00
alesapin
1b8392a3d0 Style fixed 2019-03-28 12:02:56 +03:00
alesapin
5332642fee CI Fails fixes and little performance improvement 2019-03-28 11:52:09 +03:00
alesapin
e449760fde Remove debug print 2019-03-27 19:50:01 +03:00
alesapin
48fb090cda Small fixes 2019-03-26 15:37:42 +03:00
alesapin
0378400972 Move all vertically possible streams to stopcondition 2019-03-26 14:37:32 +03:00
alesapin
2d0224aab4 Add average blocks size for ReplacingBlockInputStream 2019-03-26 13:23:14 +03:00
alesapin
673a72eac6 Merge remote-tracking branch 'origin' into adaptive_index_granularity 2019-03-25 11:41:38 +03:00
Alexey Milovidov
fb19cf1eec Attempt to make compositions with COWPtr more convenient 2019-03-25 04:43:54 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
alesapin
b5d6813604 Fix vertical merge again 2019-03-20 20:04:34 +03:00
alesapin
95a8be569d Check marks for adaptive granularity 2019-03-20 19:18:13 +03:00
alesapin
ec474472e4 Make avg block size for stream optional 2019-03-19 17:36:42 +03:00
alesapin
2f037bad58 Fix bug in merging algorithm 2019-03-19 16:10:24 +03:00
alesapin
d8aa5c7c49 Slightly clearer debug and fix alter 2019-03-19 12:57:29 +03:00
alesapin
ce03636f05 Merge master 2019-03-18 15:02:33 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after 
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
 2019-03-17 00:46:53 +03:00
Alexey Zatelepin
a030ce90b5 fix build 2019-03-15 20:40:16 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00