thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-02 06:30:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
34,086 Commits 8,979 Branches 1,767 Tags 1.8 GiB
9d30f3c876
Commit Graph

1798 Commits

Author SHA1 Message Date
Alexey Milovidov
f6b9b06307 Attempt to implemnt global thread pool #4018 2019-01-14 22:22:09 +03:00
Alexey Milovidov
abcd5a2a49 Attempt to implemnt global thread pool #4018 2019-01-11 22:12:36 +03:00
Alexey Milovidov
38b7a459d1 Merge branch 'master' into processors 2019-01-11 18:53:53 +03:00
Alexey Milovidov
19f4652959 Fixed bugs found by PVS-Studio 2019-01-09 18:44:20 +03:00
Alexey Milovidov
1d4701b0bc Added some warnings from clang's -Weverything 2019-01-04 15:10:00 +03:00
Alexey Milovidov
e33e5150b7 Miscellaneous [#CLICKHOUSE-2] 2019-01-02 09:44:36 +03:00
proller
300bbdfb43 Fix cyclic lib depend ppart 2: clean 2018-12-28 21:15:26 +03:00
Alexey Milovidov
3c84e47419 Fixed UB #3926 2018-12-27 03:33:54 +03:00
Alexey Milovidov
713a44c38e Fixed UB #3926 2018-12-27 03:33:32 +03:00
Alexey Milovidov
1191f1575d Less dependencies [#CLICKHOUSE-2] 2018-12-26 02:44:44 +03:00
Alexey Milovidov
a8f09809f5 Simplified logic with "IColumn::convertToFullColumnIfConst" (suggested by Amos Bird) [#CLICKHOUSE-2] 2018-12-21 19:00:07 +03:00
Nikolai Kochetov
4eb7a820d6 Fix style 2018-12-19 20:54:46 +03:00
Nikolai Kochetov
78321a04a1 Added low_cardinality_allow_in_native_format setting. 2018-12-19 19:47:30 +03:00
alexey-milovidov
cea269883c
Merge pull request #3803 from yandex/low-cardinality-native-format-conversion-2 
LowCardinality support for old clients, part 2
 2018-12-10 21:03:43 +03:00
Nikolai Kochetov
1a6127dce4 Remove LowCardinality from NativeBlockOutputStream types for old clients. 2018-12-10 15:09:37 +03:00
alexey-milovidov
0fdb3b9628
Merge branch 'master' into issue-3578 2018-12-07 23:53:34 +03:00
KochetovNicolai
431cff1613
Update NativeBlockInputStream.cpp 
Fix type for LowCardinality inserts.
 2018-12-07 20:17:50 +03:00
chertus
60dc8fcac2 fixes for review CLICKHOUSE-3578 2018-12-06 20:20:17 +03:00
Nikolai Kochetov
2bb57ce472 Support insertion into LowCardinality from old native clients. 2018-12-06 17:08:42 +03:00
Alexey Milovidov
f66b15efb3 Removed useless file #3754 2018-12-05 17:59:48 +03:00
proller
61328a2c9b
ARM build fixes (#3754) 2018-12-05 16:41:29 +03:00
chertus
1a7313eaa0 resolve class name conflict 2018-12-05 15:27:21 +03:00
chertus
3db00b7b98 Merge branch 'master' into issue-3578 2018-12-05 14:43:14 +03:00
chertus
a71d03737c send defaults via serialized ColumnsDescription CLICKHOUSE-3578 2018-12-04 23:03:04 +03:00
alesapin
7925abcd74 Deep debugging 2018-12-04 17:44:42 +03:00
chertus
933c055104 CLICKHOUSE-3578 review proress 2018-12-04 17:09:47 +03:00
alesapin
bf338b957f Merge master 2018-12-03 12:10:06 +03:00
alexey-milovidov
02636b3388
Merge pull request #3729 from amosbird/dryrun 
Function execution with dry runs
 2018-12-02 22:45:07 +03:00
Amos Bird
3cc0829cc1 Function execution with dry runs 
This commit prevents stateful functions like rowNumberInAllBlocks from being modified in getHeader() calls.
 2018-12-02 19:02:04 +08:00
alexey-milovidov
bf7b68cf95
Merge pull request #3689 from abyss7/CLICKHOUSE-3936 
CLICKHOUSE-3936
 2018-12-01 01:50:04 +03:00
alesapin
5524b77915 Compilable code! 2018-11-30 18:36:10 +03:00
Alexey Milovidov
f615b062d8 Fixed build [#CLICKHOUSE-2] 2018-11-28 19:29:56 +03:00
Ivan
448846fc0d
Merge branch 'master' into CLICKHOUSE-3936 2018-11-28 18:59:57 +03:00
Ivan Lezhankin
8b5a05947c Remove redundant information from RWLock. 
And fix broken exception in some race conditions
 2018-11-28 18:50:52 +03:00
Alexey Milovidov
52fea90a86 Removed useless code [#CLICKHOUSE-2] 2018-11-28 17:33:40 +03:00
alexey-milovidov
a12927a439
Merge pull request #3603 from vitlibar/CLICKHOUSE-4127 
CLICKHOUSE-4127: Fix ALTER of destination table for the BUFFER engine.
 2018-11-27 21:38:40 +03:00
Vitaly Baranov
44ca56c731 CLICKHOUSE-4127: Convert destination table's data when reading from 
StorageBuffer.
 2018-11-27 03:43:58 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alexey-milovidov
733ab51089
Merge pull request #3643 from yandex/fix-parallel-inputs-processor-deadlock 
Fix deadlock in ParallelInputsProcessor in case thread creation fails.
 2018-11-23 00:30:01 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645) 
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
 2018-11-23 00:19:58 +03:00
Alexey Zatelepin
8b25084637 fix deadlock in ParallelInputsProcessor in case thread creation fails [#CLICKHOUSE-4155] 2018-11-22 20:29:49 +03:00
proller
1d40c2c871 Better link and deps (#3631) 
* try fix 1

* Better deps

* fix

* fix

* fix

* Update CMakeLists.txt

* Update CMakeLists.txt

* fix

* fix

* fix

* disable old

* Update find_odbc.cmake
 2018-11-21 22:20:27 +03:00
Marek Vavruša
8fad726d95 Added null guards for all CurrentThread::attachToIfDetached() 
refs #3622
 2018-11-20 09:10:34 -08:00
chertus
811b824b01 AddingDefaultsBlockInputStream fixed types optimisation 2018-11-15 23:26:51 +03:00
chertus
c642e16ee1 clearer evaluateMissingDefaults [CLICKHOUSE-3578] 2018-11-15 19:57:20 +03:00
chertus
13646eb4c4 move BlockMissingValues from Block to IBlockInputStream::getMissingValues() 2018-11-15 18:57:20 +03:00
chertus
5c67e02205 fix build 2018-11-15 13:39:13 +03:00
chertus
ebf3d60186 column defaults without CapNProto [CLICKHOUSE-3578] 2018-11-14 21:20:16 +03:00
chertus
9966f975a3 Merge branch 'master' into issue-3578 2018-11-12 17:58:00 +03:00
chertus
2fe3cdb3f5 restore lost commits [CLICKHOUSE-3578] 2018-11-12 17:52:30 +03:00
Nikolai Kochetov
1e9aeba603 Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-09 18:01:18 +03:00
chertus
cc005c3ac9 Merge branch 'master' into issue-3578 2018-11-09 13:12:34 +03:00
Nikolai Kochetov
726ae0cb9a Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-08 19:47:12 +03:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master 
Flexible fields assignment
 2018-11-01 20:22:28 +03:00
Alexey Zatelepin
e4e38f71e1 allow empty header in RemoteBlockOutputStream #3411 
The bug with inserts to Distributed tables was introduced in https://github.com/yandex/ClickHouse/pull/3171
It added a workaround specifically for inserting in the Native format without specifying the list of columns.
Native (as opposed to other formats) historically supports this. To signal that the input block structure
shouldn't conform to any fixed header in this case, the remote server started sending empty header block.
This commit adds support for empty headers to RemoteBlockOutputStream.
 2018-10-26 18:26:07 +03:00
Amos Bird
3cf2177268 Flexible fields assignment 
Field f;

before:

f = Int64(-42);

after:

f = -42;
 2018-10-24 08:47:33 +08:00
alexey-milovidov
4bf54337b9
Merge pull request #3292 from CurtizJ/order-by-efficient 
Efficiently finish sorting by (x, y) stream, that already sorted by (x) [CLICKHOUSE-4022]
 2018-10-23 11:34:22 +03:00
alexey-milovidov
21e7c25134
Update FinishSortingBlockInputStream.cpp 2018-10-23 11:32:28 +03:00
Alex Zatelepin
4449d7e059
Update FinishSortingBlockInputStream.cpp 2018-10-19 16:21:50 +03:00
CurtizJ
6ff8a60460 fix style 2018-10-19 16:04:50 +03:00
CurtizJ
8a72ddd94b wip on finish sorting 2018-10-19 15:02:31 +03:00
CurtizJ
f86b9d3983 add lock for .inner. table 2018-10-17 17:11:20 +03:00
CurtizJ
d81ed27004 add lock for .inner. table 2018-10-17 17:08:52 +03:00
chertus
5896e45dac SummingMergeTree for Decimal128 [issue-3282] 2018-10-11 17:33:01 +03:00
CurtizJ
c565c75350 fix style 2018-10-11 12:27:16 +03:00
alexey-milovidov
36c3feea80
Merge pull request #3270 from yandex/left-join-right-keys-fix 
Left join right keys fix
 2018-10-07 23:26:40 +03:00
CurtizJ
5a01eb3d5e add test 2018-10-05 17:35:35 +03:00
Nikolai Kochetov
67ca27a09a Merged with master. 2018-10-05 11:33:12 +03:00
Nikolai Kochetov
064facd8de Updated test. 2018-10-05 10:43:58 +03:00
CurtizJ
8c2060b48a wip on finish sorting 2018-10-04 17:55:02 +03:00
CurtizJ
dd9516a810 wip on finish sorting 2018-10-04 13:24:51 +03:00
Alexey Milovidov
698be017e9 Changes after merge #3208 2018-10-02 00:49:56 +03:00
alexey-milovidov
a4736275c6
Merge pull request #3208 from vavrusa/master 
PushingToViewsBlockOutputStream: process blocks concurrently
 2018-10-01 04:42:55 +03:00
alexey-milovidov
c4939a1bec
Update PushingToViewsBlockOutputStream.cpp 2018-10-01 04:39:00 +03:00
luc1ph3r
f1d21189a4 Parquet data format: refactoring 2018-09-30 22:02:42 +03:00
luc1ph3r
cf42b10c3b Parquet output: support NULL values 2018-09-30 22:02:42 +03:00
Nikolai Kochetov
97add69825 Rename WithDictionary to LowCardinality. 2018-09-28 13:44:59 +03:00
Marek Vavruša
a971a0bc07 PushingToViewsBlockOutputStream: process blocks concurrently 
The current model is to process blocks for attached views in sequence.
This is not ideal when the processing time for each view varies, or is
blocking (for example with replicated tables), as processing of next-in-line
view is blocked by wait in it's predecessor.

This commit changes the behavior to process 2 or more attached views concurrently.
 2018-09-26 15:22:06 -07:00
Alexey Milovidov
57822ad592 Improvement #3205 2018-09-26 04:30:07 +03:00
Alexey Milovidov
81e2fe14e5 Better messages #3205 2018-09-24 23:30:02 +03:00
Alexey Milovidov
8e7c6598e8 Added remerge step to process ORDER BY with LIMIT when memory usage is high #3179 2018-09-24 23:07:30 +03:00
alexey-milovidov
17d50ecef0
Merge pull request #3186 from CurtizJ/CLICKHOUSE-3979 
Fix bug in Cube #3172
 2018-09-21 13:38:46 +03:00
CurtizJ
b355ac8e71 fix bug 2018-09-21 10:23:31 +03:00
alexey-milovidov
5d3027d4d0
Merge pull request #3171 from yandex/fix_segfault_on_incomplete_block 
Reorder Squashing and adding default output stream in insert
 2018-09-20 21:11:45 +03:00
alexey-milovidov
be77567e4f
Update AddingDefaultBlockOutputStream.cpp 2018-09-20 21:09:01 +03:00
alexey-milovidov
e74615f29e
Update AddingDefaultBlockOutputStream.cpp 2018-09-20 21:07:10 +03:00
Anton Popov
dd1b130048
Update CubeBlockInputStream.cpp 2018-09-20 20:32:57 +03:00
CurtizJ
8644853558 optimize 2018-09-20 18:46:37 +03:00
alesapin
94287f3199 Finally fixed 2018-09-20 18:35:52 +03:00
alesapin
c13ffed085 Remove redundant changes 2018-09-20 16:26:32 +03:00
alesapin
0f12e028a5 Fix insert for native format 2018-09-20 15:59:33 +03:00
alesapin
b87a084f38 Strict order of evaluated and added columns 2018-09-20 14:16:15 +03:00
CurtizJ
f9ff586415 optimize 2018-09-20 13:44:13 +03:00
alesapin
2b3e29f607 Take header from first block in Squashing stream 2018-09-19 20:39:04 +03:00
alesapin
e1c8045055 Fix error with header 2018-09-19 15:56:56 +03:00
CurtizJ
31bf960bfe add new syntax 2018-09-19 14:18:38 +03:00
alesapin
c2f3453fda Reorder Squashing and adding default output stream in insert 2018-09-19 14:06:42 +03:00
CurtizJ
43951e4879 add test 2018-09-17 22:16:51 +03:00
CurtizJ
8c9fe80d2d add modificator cube 2018-09-17 21:01:04 +03:00
Amos Bird
af369483a9 Simply Self. 
> When the normal name of the template (i.e., the name from the enclosing scope, not the injected-class-name) is used, it always refers to the class template itself and not a specialization of the template

http://eel.is/c++draft/temp.local
 2018-09-13 22:59:54 +08:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update 
ALTER UPDATE
 2018-09-13 06:03:35 +03:00
Alexey Milovidov
3293480a12 Validate sizes of arrays - elements of Nested data structures [#CLICKHOUSE-3692] 2018-09-13 00:08:55 +03:00
Alexey Milovidov
f16aa1964a Better formatting of numbers in log message [#CLICKHOUSE-2] 2018-09-10 21:23:11 +03:00
alexey-milovidov
20d5ddd58c
Merge branch 'master' into alter-update 2018-09-10 17:17:10 +03:00
Alexey Milovidov
3f07a1af51 Fixed error [#CLICKHOUSE-2] 2018-09-09 08:47:27 +03:00
Alexey Milovidov
c7b1a40296 Fixed test [#CLICKHOUSE-2] 2018-09-09 05:23:24 +03:00
Alexey Milovidov
4ec18956c7 Preparation [#CLICKHOUSE-2] 2018-09-08 22:23:48 +03:00
Alexey Milovidov
e78c16000c utils/check-style/check-style #3069 2018-09-08 06:07:12 +03:00
alexey-milovidov
a2df7d522c
Merge pull request #3069 from CurtizJ/CLICKHOUSE-3893 
Fix code duplication in RollupBlockInputStream and TotalsHavingBlockInputStream
 2018-09-08 00:35:56 +03:00
Alexey Zatelepin
133c9c7c37 Merge branch 'master' into alter-update 
Conflicts:
	docs/en/query_language/alter.md
 2018-09-07 19:11:02 +03:00
chertus
0b35cdae69 refactoring: add some sugar in type checks [CLICKHOUSE-0002] 2018-09-07 17:37:26 +03:00
CurtizJ
a0ee183826 whitespaces 2018-09-07 17:21:11 +03:00
CurtizJ
3e854df5a5 remove code duplicates 2018-09-07 17:18:15 +03:00
Alexander Sapin
03174e131d Merge remote-tracking branch 'upstream/master' 2018-09-06 12:39:42 +03:00
Alexey Milovidov
9df01c1012 Style #2948 2018-09-06 04:06:30 +03:00
alexey-milovidov
0ca8e20e66
Merge pull request #2948 from CurtizJ/CLICKHOUSE-3893 
CLICKHOUSE-3893 - Add modificator rollup.
 2018-09-06 03:59:02 +03:00
alexey-milovidov
4c549f79cd
Update RollupBlockInputStream.cpp 2018-09-06 03:58:24 +03:00
Alexey Zatelepin
6275bfd8cd fix CollapsingMergeTree + vertical merge [#CLICKHOUSE-3963] 
don't skip writing to rows sources even if all rows have collapsed.
 2018-09-05 20:19:51 +03:00
CurtizJ
472adf4ab9 add rollup to formatted query 2018-09-05 19:23:28 +03:00
CurtizJ
35cbdcda5b optimize memory consumption 2018-09-05 17:39:51 +03:00
CurtizJ
18da41afe3 Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-3893 2018-09-05 12:49:02 +03:00
CurtizJ
a7bbf83c91 Revert "Revert "Merge branch 'master' into CLICKHOUSE-3893"" 
This reverts commit cdb2c8a770.
 2018-09-05 12:47:57 +03:00
CurtizJ
cdb2c8a770 Revert "Merge branch 'master' into CLICKHOUSE-3893" 
This reverts commit 0704da5756, reversing
changes made to 4534d449c1.
 2018-09-05 12:45:57 +03:00
Alexey Zatelepin
4f91833e67 Merge branch 'master' into alter-update 
Conflicts:
	dbms/src/Parsers/ASTIdentifier.cpp
 2018-09-04 17:39:08 +03:00
Alexey Zatelepin
d4d1020798 execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13] 2018-09-03 22:34:49 +03:00
alesapin
11d248ba10 Resolve conflict 2018-09-03 13:11:10 +03:00
CurtizJ
3bc743c50d do not merge blocks into one 2018-09-03 12:49:04 +03:00
Alexey Milovidov
26587dd2bb Addition to prev. revision [#CLICKHOUSE-2] 2018-09-02 08:23:20 +03:00
Alexey Milovidov
f5d03f6ac2 Miscellaneous [#CLICKHOUSE-2] 2018-09-01 22:14:04 +03:00
Alexey Milovidov
7d77d001f5 Full support for alignment of aggregate states #2808 2018-09-01 07:25:03 +03:00
alesapin
711b228a30 Merge remote-tracking branch 'upstream/master' 2018-08-31 10:15:33 +03:00
Alexey Milovidov
8aecbc6df6 Data streams: better [#CLICKHOUSE-3944] 2018-08-31 04:46:39 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
Alexey Zatelepin
dc2a4c21e9 execute ALTER UPDATE [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
CurtizJ
a04c37251b remove redundant code 2018-08-27 12:09:47 +03:00
CurtizJ
cf3fbb8c51 minor changes 2018-08-24 20:37:08 +03:00
CurtizJ
e0b3283ed3 Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-3893 2018-08-24 18:09:53 +03:00
CurtizJ
c18ad18d96 Add rollup modificator 2018-08-24 18:00:00 +03:00
Alexey Zatelepin
f592aa84d1 fix vertical merge for empty parts [#CLICKHOUSE-3913] 2018-08-23 15:04:30 +03:00
Alexey Milovidov
5435dc3dc2 Fixed error with thread statuses #2482 2018-08-22 07:32:21 +03:00
CurtizJ
0704da5756 Merge branch 'master' into CLICKHOUSE-3893 2018-08-21 20:34:01 +03:00
CurtizJ
4534d449c1 working on rollup 2018-08-21 19:08:45 +03:00
Alexey Milovidov
2138f50e48 Better exception message #2888 2018-08-20 19:10:58 +03:00
Nikolai Kochetov
391b4b5927 Merged with master. 2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
Nikolai Kochetov
26f464a4f9 Fix Const(LowCardinality) conversion. [#CLICKHOUSE-3621] 2018-08-14 20:19:48 +03:00
Nikolai Kochetov
4a62ab9d5c Merged with master. 2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Nikolai Kochetov
ab10005af5 Renamed settings for LowCardinality type. 2018-08-09 13:52:46 +03:00
Nikolai Kochetov
f4d9d50168 Merged with master. 2018-08-08 15:01:18 +03:00
Alexey Zatelepin
1f2d4f90b9 allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879] 2018-08-06 19:54:00 +03:00
Alexey Milovidov
2016374d20 Merging #2226 2018-08-05 10:05:43 +03:00
Nikolai Kochetov
9359ae7650 Fix test. 2018-07-31 20:34:17 +03:00
Nikolai Kochetov
368e7d0b08 Added joined_block_actions to SubqueryForSet for join subquery. [#CLICKHOUSE-3761] 
3Added joined_block_actions to join expression action.
 2018-07-30 22:41:27 +03:00
Alexey Zatelepin
f75fb6cd68 refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Constantin S. Pan
8539c1e119 Fix the column size difference bug in SummingMergeTree 2018-07-18 00:17:04 +03:00
chertus
3d133a6a5a save block structure when add defaults 2018-07-17 23:02:37 +03:00
chertus
07a782e637 fix wrong defaults at columns tail and some build fixes 2018-07-16 22:28:07 +03:00
chertus
e65c0b436a Merge branch 'master' into issue-3578 2018-07-16 18:28:06 +03:00
proller
5384504fa2 More information in 'Cannot read all data' errors 2018-07-13 22:06:26 +03:00
chertus
4e0d9aa8d4 revert unneeded changes 2018-07-13 15:46:29 +03:00
chertus
c8f71cb539 Merge branch 'master' into issue-3578 2018-07-13 14:30:42 +03:00
chertus
c78a67d573 fix case with unexpected aliases 2018-07-13 01:05:03 +03:00
chertus
3c39f2fc69 fix some tests 2018-07-11 21:34:12 +03:00
chertus
82d22574d4 fix empty defaults mask issue and add some comments 2018-07-11 17:11:47 +03:00
chertus
fe1b393e55 defaults for storages with formated input 2018-07-11 15:05:04 +03:00
chertus
519102b110 defaults for http inserts 2018-07-10 20:20:55 +03:00
Alexey Milovidov
8e0ae12b4e Miscellaneous [#CLICKHOUSE-2] 2018-07-10 16:43:01 +03:00
chertus
5036309d26 fix const defaults 2018-07-10 16:33:41 +03:00
Alexey Milovidov
c0373c1d45 Style; added comment #2566 2018-07-04 23:46:17 +03:00
Alexey Milovidov
47958bee7c Merge branch 'feature-agg-func-in-summing-merge-tree' of https://github.com/kvap/ClickHouse into kvap-feature-agg-func-in-summing-merge-tree 2018-07-04 23:34:28 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
chertus
88c4081a82 3578: defaults for input streams (in progress) 2018-07-04 20:02:47 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface. 2018-06-26 17:12:21 +03:00
Constantin S. Pan
cc4c4e0b49 Make the test more comprehensive and fix bugs in AggregateFunction implementation of SummingMergeTree 2018-06-26 11:28:42 +01:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Nikolai Kochetov
91c9906c88 Fixed reading from ReplacingMergeTree from emprty row set after prewhere. #2525 2018-06-25 13:48:11 +03:00
Alexey Zatelepin
2fb3d42dfd temporary fix for a bug when several mutations have the same predicate [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Constantin S. Pan
e94570d206 Add support for AggregateFunction in SummingMergeTree 2018-06-21 16:10:32 +01:00
Nikolai Kochetov
f88584d748 Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary. 2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910] 
Fixed race condition in SystemLog.
 2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488) 
CONTRIB-254
 2018-06-19 21:09:09 +03:00
Vitaliy Lyudvichenko
8dc1bebf00 Add logs forwarding from remote severs to client. [#CLICKHOUSE-2910] 2018-06-18 19:30:26 +03:00
Vitaliy Lyudvichenko
392f6e0c6c Print query_id in logs. Add own logging interface. [#CLICKHOUSE-2910] 2018-06-18 16:41:13 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table 
[WIP] system.mutations table skeleton
 2018-06-13 23:00:30 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492) 
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
 2018-06-10 22:22:49 +03:00
Vitaliy Lyudvichenko
ed7cd86f09 Fixed several bug. Trun on --server_logs_level=warning in tests. [#CLICKHOUSE-2910] 
Fixed several test to be compatible with --server_logs_level=warning.
 2018-06-08 22:50:15 +03:00
Alexey Milovidov
96fbe1d716 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:27:34 +03:00
Alexey Milovidov
101276e541 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:15:33 +03:00
Alexey Milovidov
2152b932c2 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text: preparation #1710 2018-06-08 05:56:37 +03:00
Alexey Milovidov
29bd48fc7a Passing settings to ser/de of data types: development #1710 2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Alexey Milovidov
d81d4dfb29 Merge branch 'master' into format-settings 2018-06-08 01:39:55 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
alexey-milovidov
be4be0758a
Remove escaping in presentational formats (#2476) 
* Removed escaping in presentational formats; changed a way how NULL is output #1729

* Addition to prev. revision #1729

* Addition to prev. revision #1729

* Updated tests #1729

* Updated function visibleWidth to be consistent with Pretty formats #1729
 2018-06-07 04:30:29 +03:00
Alexey Milovidov
0b7bf8491f Merge branch 'master' into format-settings 2018-06-07 02:13:45 +03:00
proller
347579ce46 Cmake: mark system includes as SYSTEM (#1449) 
* contrib: cctz as submodule. update cctz.

* pbuilder: add ubuntu bionic, devel

* Cmake: mark system includes as SYSTEM

* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Cmake: Add SYSTEM to includes for external libs
 2018-06-06 23:21:58 +03:00
Ivan Zhukov
6dd0f89d68 Refactor: make some members and methods static 2018-06-06 00:47:57 +03:00
Alexey Milovidov
092d156800 Settings for DateTime format (incomplete) [#CLICKHOUSE-2] 2018-06-06 00:39:01 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Ivan Zhukov
b34c2443f4 Parquet input: support NULL values 2018-06-05 02:44:36 +03:00
Alexey Milovidov
df11490b2a Insignificant changes guided by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:45:08 +03:00
Alexey Milovidov
d811647668 Suppressions for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:28:25 +03:00
Vitaliy Lyudvichenko
89f2107c75 C++ify taskstats getter, periodic auto update of profile events. [#CLICKHOUSE-2910] 2018-06-04 17:50:35 +03:00
Alexey Zatelepin
2e77c508ad add comments [#CLICKHOUSE-3747] 2018-06-04 14:43:09 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Vitaliy Lyudvichenko
549a6944d9 Better AsynchronousBlockInputStream in sync mode. [#CLICKHOUSE-2910] 2018-06-01 14:58:17 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
 2018-05-28 18:37:30 +03:00
Vitaliy Lyudvichenko
7615f5a09a More detail dignostic when parse JSONEachRow. [#CLICKHOUSE-2] 2018-05-28 14:40:07 +03:00
Ivan Zhukov
882e246e4f Actualize TODOs 2018-05-26 23:44:51 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Ivan Zhukov
72ccc8f978 Parquet output: refactor functions-fillers 2018-05-25 01:23:36 +03:00
Ivan Zhukov
0111969eaa Check arrow status 2018-05-25 00:33:12 +03:00
Alexey Milovidov
a7a16c3c24 Processors: experimental [#CLICKHOUSE-2948] 2018-05-24 04:02:16 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Nikolai Kochetov
937cb2db29 Merged with master. 2018-05-21 14:38:50 +03:00
Alexey Milovidov
1203df737d Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 07:51:45 +03:00
Ivan Zhukov
b3de2f4b2b Parquet output: support numeric and string types 2018-05-18 05:53:54 +03:00
Ivan Zhukov
f1bef15705 Parquet input: add a Date type support 2018-05-17 22:07:51 +03:00
Ivan Zhukov
31e27effa6 Parquet input: change if to switch 2018-05-17 22:07:51 +03:00
Ivan Zhukov
4076ae77b4 Parquet input: add a boolean type support 2018-05-17 22:07:51 +03:00
Ivan Zhukov
f8dae2bc76 Parquet input: get rid of redundant copying 2018-05-17 22:07:49 +03:00
Nikolai Kochetov
d7ead51796 Added invalid FixedString size to the list of parse errors. 2018-05-17 18:29:59 +03:00
Ivan Zhukov
282110cba4 Parquet input: support a string type 2018-05-17 04:54:25 +03:00
Ivan Zhukov
e5307e3c18 Parquet input: support numeric types 2018-05-17 04:54:25 +03:00
Ivan Zhukov
fabd38fe6d Add a template for ParquetBlockInputStream 2018-05-17 04:54:23 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2] 
Faster partition check.

Added more debug info.
 2018-05-14 17:14:58 +03:00
Nikolai Kochetov
6ba8cb922c Fix usage of columns from header in SummingSortedBlockInputStream. #2273 2018-05-14 13:48:50 +03:00
Vitaliy Lyudvichenko
5704de8774 Fixed settings passing in clickhouse-local and tmp dirs. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
proller
398097d24a Build fixes (#2323) 
* Build fixes

* Fixes

* remove libzookeeper-mt-dev

* fix

* fix

* wrong

* try fix

* fix

* Update CMakeLists.txt
 2018-05-07 18:59:52 +03:00
Nikolai Kochetov
af5475b77c Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:50:42 +03:00
Nikolai Kochetov
67769ef333 Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:47:39 +03:00
Nikolai Kochetov
f4627af23f Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:44:52 +03:00
Nikolai Kochetov
13ba167dce Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:40:36 +03:00
Nikolai Kochetov
530b99cee5 Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:39:15 +03:00
alexey-milovidov
093c054b1f
Merge pull request #2263 from luc1ph3r/arbitrary-csv-delimiter 
Support an arbitrary CSV delimiter
 2018-04-27 13:13:09 -07:00
Nikolai Kochetov
7a62bb9267 added comments and fixed tests build 2018-04-23 22:41:10 +03:00
Ivan Zhukov
e402ff3f81 Unify string checks with a new type 2018-04-22 02:42:01 +03:00
Ivan Zhukov
a138ab2820 Add CSV delimter support in CSVRowOutputStream 2018-04-22 02:08:50 +03:00
Ivan Zhukov
91cb03bdaf Add delimiter support in CSVRowInputStream 2018-04-22 02:08:31 +03:00
Nikolai Kochetov
a6375d6155 merged with master 2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620 fix build 2018-04-20 17:06:01 +03:00
Alexey Milovidov
207a8cc03c Fixed error with Sets, part 2 #2246 2018-04-20 00:36:58 +03:00
Alexey Milovidov
ce0ac3f8f8 Fixed error with Sets, part 2 #2246 2018-04-20 00:34:04 +03:00
Nikolai Kochetov
dd10c2073c merged with master 2018-04-19 18:10:44 +03:00
Alexey Milovidov
cce4c8886c Removed obsolete code #2226 2018-04-19 00:23:55 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements 
Small enhancements
 2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
f642d0828e Avoid freezing of KILL QUERY. [#CLICKHOUSE-3706] 2018-04-17 17:29:52 +03:00
Nikolai Kochetov
66905a1366 fix build 2018-04-16 22:59:12 +03:00
Nikolai Kochetov
081f0feb56 fix test [#CLICKHOUSE-3694] #2156 2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a merged with master 2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34 minor fixes 2018-04-16 18:11:13 +03:00
Nikolai Kochetov
41229b201b Merge branch 'master' into fix-header-for-union-stream-in-distributed-2 2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5 fix perf 2018-04-13 23:09:13 +03:00
Alexey Milovidov
a2482f120d Fixed test [#CLICKHOUSE-2] 2018-04-08 07:38:27 +03:00
proller
07b81c875e CLICKHOUSE-3444: show error for old query on replace_running_query (#2127) 
* Add tests

* Fix test

* Fix test build

* CLICKHOUSE-3444: show error for replace_running_query

* fix naming

* fix

* fix test

* Update IProfilingBlockInputStream.cpp
 2018-04-07 06:49:49 +03:00
Alexey Milovidov
babfc6aaf7 Fixed error [#CLICKHOUSE-2] 2018-04-07 06:46:20 +03:00
Alexey Milovidov
3fd2773151 Improved code after introduction of method "getHeader" in every stream [#CLICKHOUSE-2] 2018-04-07 04:46:50 +03:00
Alexey Milovidov
af226d62f5 Fixed totally wrong code in SummingMergeTree in the case of complex maps [#CLICKHOUSE-2] 2018-04-06 21:09:20 +03:00
Alexey Milovidov
f66d2fb780 Allow to use FINAL even in case of single part #2086 2018-04-06 00:36:55 +03:00
Alexey Milovidov
36c9409899 Fixed error [#CLICKHOUSE-2] 2018-04-05 07:42:20 +03:00
Vitaliy Lyudvichenko
ce8de108ed Better timeouts handling. [#CLICKHOUSE-2] 2018-04-04 22:44:38 +03:00
Alexey Milovidov
b3e6bb453a Renamed method #217 [#CLICKHOUSE-1942] 2018-04-02 20:57:38 +03:00
Alexey Zatelepin
f2db72a5e5 move squashing to read side #2084 [#CLICKHOUSE-3540] 
This way there is a clear correspondence between blocks inserted into the parent table
and blocks inserted into the materialized view.
 2018-03-28 14:41:20 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2 
&& - qualified IColumn::mutate
 2018-03-28 05:27:35 +03:00
Alex Zatelepin
1be7c09702 add readPrefix()/readSuffix() calls for completeness #2084 [#CLICKHOUSE-3540] 2018-03-27 22:25:50 +00:00
Alexey Zatelepin
88a9b7de91 fix calls to writeSuffix() in PushingToViewsBlockOutputStream #2084 [#CLICKHOUSE-3540] 
don't use copyData because it calls writeSuffix() prematurely.
 2018-03-27 23:04:40 +03:00
Alexey Zatelepin
d58483b084 squash blocks when inserting into materialized views #2084 [#CLICKHOUSE-3540] 2018-03-27 20:08:41 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996) 
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
 2018-03-23 19:05:14 +03:00
Nikolai Kochetov
bd3f2ea361 Merge branch 'stricter-mutable-column-semantic-3' into stricter-mutable-column-semantic-2 2018-03-20 22:47:40 +03:00
Nikolai Kochetov
476d4b339c Immutable construction for columns 2018-03-20 22:45:10 +03:00
Nikolai Kochetov
1f4db58d53 fix test 2018-03-20 20:01:13 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
Alexey Zatelepin
5906c9a988 rename for clarity 2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac encapsulate ColumnsDeclaration [#CLICKHOUSE-3241] 2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346 
Sync insert and сluster copier enhancements
 2018-03-12 20:58:53 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
f3b6d35167 Removed setting "strict_insert_defaults" [#CLICKHOUSE-2] 2018-03-10 03:11:39 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
8ff0c520d0 Removed the possibility to use queries with empty query_id; better semantics #245 2018-03-10 02:04:26 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
alexey-milovidov
a06af52824
Merge pull request #1995 from yandex/CLICKHOUSE-3616 
Fixed segfault in case of WHERE <non-UInt8 type expression>
 2018-03-06 22:10:14 +03:00
Alexey Zatelepin
f3812dddea generic comparison code in GraphiteRollupSortedBlockInputStream [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Alexey Zatelepin
5d51c66bbb generic version comparison code for ReplacingMergeTree [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Vitaliy Lyudvichenko
1d247d0e31 Fixed segfault in case of WHERE <non-UInt8 type expression>. [#CLICKHOUSE-3616] 
Prohibited non-UInt8 constants in WHERE expressions.
Fixed KILL QUERY syntax highlighting.
 2018-03-06 18:42:00 +03:00
proller
82a361d0e9 Show error to client if query was killed (#1989) 
* Show error to client if query was killed

* Kill exception v2

* Use kill

* fix

* wip

* fix

* fxi

* try fix

* Revert "try fix"

This reverts commit eb76e4c040.

* QUERY_WASCANCELLED

* Fxi all cancel()

* fix
 2018-03-06 00:09:39 +03:00
Alexey Milovidov
ba481a6acd Fixed error with TOTALS [#CLICKHOUSE-3619] 2018-03-03 04:28:13 +03:00
Alexey Milovidov
8cb640ac54 Better UNION ALL: development #1947 2018-03-01 09:08:09 +03:00
Alexey Milovidov
15dc5da190 Fixed error #1947 2018-03-01 09:07:04 +03:00
Alexey Milovidov
ac37b89b16 Better UNION ALL: development #1947 2018-02-26 12:05:06 +03:00
Alexey Milovidov
243563d247 Fixed build [#CLICKHOUSE-2] 2018-02-23 21:55:54 +03:00
Alexey Milovidov
1a3fa45b6f Fixed race condition in Lazy stream [#CLICKHOUSE-2] 2018-02-23 13:43:24 +03:00
Alexey Milovidov
cae7f96f34 Simplification [#CLICKHOUSE-2] 2018-02-23 13:02:29 +03:00
Alexey Milovidov
36a9502e80 Simplification #1896 2018-02-23 11:05:21 +03:00
Alexey Milovidov
640daaf052 Fixed test #1947 2018-02-23 04:00:47 +03:00
Alexey Milovidov
245fd61b12 Unify NullableAdapterBlockInputStream and CastTypeBlockInputStream #1947 2018-02-23 02:02:35 +03:00
Alexey Milovidov
f792ab0824 Remove RemoveColumnsBlockInputStream #1947 2018-02-23 00:35:17 +03:00
alexey-milovidov
7a5ccc86cc
Merge pull request #1937 from yandex/CLICKHOUSE-3606 
Update of clickhouse-copier
 2018-02-22 23:42:33 +03:00
Vitaliy Lyudvichenko
07d01d2dfb Fixed build after merge. [#CLICKHOUSE-3606] 2018-02-22 14:40:23 +03:00
KochetovNicolai
bcad88c9ae
Update ReplacingSortedBlockInputStream.h 
added comment
 2018-02-22 11:37:16 +03:00
alexey-milovidov
b6f3f06ef3
Merge branch 'master' into CLICKHOUSE-3606 2018-02-22 02:13:38 +03:00
alexey-milovidov
533b5cbe00
Merge pull request #1938 from yandex/fix-replacing-merge-tree 
Fix replacing merge tree vertical merge
 2018-02-22 02:06:24 +03:00
alexey-milovidov
331fca64a9
Update ReplacingSortedBlockInputStream.h 2018-02-22 02:04:37 +03:00
Alexey Milovidov
222fb2c945 Miscellaneous [#CLICKHOUSE-2] 2018-02-21 23:23:27 +03:00
Nikolai Kochetov
9d348846d6 fix row position with max version for vertical merge of ReplacingMergeTree #1914 2018-02-21 16:57:58 +03:00
Alexey Milovidov
fef53b1963 Tiny modification [#CLICKHOUSE-2] 2018-02-21 11:34:38 +03:00
Alexey Milovidov
b1fc5eed45 Fixed error [#CLICKHOUSE-2] 2018-02-21 10:34:40 +03:00
Alexey Milovidov
1a026e6131 Fixed error [#CLICKHOUSE-2] 2018-02-21 09:47:32 +03:00
Alexey Milovidov
09ac108f4c Fixed error [#CLICKHOUSE-2] 2018-02-21 07:38:26 +03:00
Alexey Milovidov
33e42a9001 Better [#CLICKHOUSE-2] 2018-02-21 06:48:46 +03:00
Alexey Milovidov
13f1d5c67d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-20 04:25:56 +03:00
Alexey Milovidov
fa6420b34d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-20 04:14:38 +03:00
Alexey Milovidov
582798b77f Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 23:42:05 +03:00
Alexey Milovidov
ee4b5d2527 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 23:23:25 +03:00
Alexey Milovidov
b747c83b15 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 22:18:51 +03:00
Vitaliy Lyudvichenko
369f88f65d Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346] 2018-02-19 20:26:47 +03:00
Alexey Milovidov
c3b0f0bceb Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:30:11 +03:00
Alexey Milovidov
399ede6404 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:29:56 +03:00
Alexey Milovidov
92cfa63e29 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:50 +03:00
Alexey Milovidov
17320cc40b Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:30 +03:00
Alexey Milovidov
f6766c89c4 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:08 +03:00
Alexey Milovidov
900755555f Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:11:55 +03:00
Alexey Milovidov
8d9fc36ac8 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:03:59 +03:00
Alexey Milovidov
307fc93d1d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:03:31 +03:00
Alexey Milovidov
8b7003ade6 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 06:57:24 +03:00
Alexey Milovidov
74c56c2def Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 06:56:08 +03:00
Alexey Milovidov
fa50fe80a0 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 03:45:32 +03:00
Alexey Milovidov
d4710c78bf Fixed error [#CLICKHOUSE-1920] #51 2018-02-18 09:12:19 +03:00
Alexey Milovidov
7415513151 Return single row for aggregation without keys on empty set: development [#CLICKHOUSE-1920] #51 2018-02-18 08:35:48 +03:00
Alexey Milovidov
a4c10f7499 Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 07:17:11 +03:00
Alexey Milovidov
afe09d3138 Removed unused code [#CLICKHOUSE-2] 2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2] 2018-02-18 06:23:48 +03:00
Alexey Milovidov
d6d7b3e7e4 Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 05:46:39 +03:00
Alexey Milovidov
dba529d674 Header in every stream: development [#CLICKHOUSE-2] 2018-02-17 07:13:49 +03:00
Alexey Milovidov
a673790748 Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 23:53:47 +03:00
Alexey Milovidov
d76feb779c Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 22:04:27 +03:00
Alexey Milovidov
264e6cbc84 Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 00:31:09 +03:00
Alexey Milovidov
69a9723ce2 Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 22:48:41 +03:00
Alexey Milovidov
30b657a0da Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 21:54:12 +03:00
Alexey Milovidov
0cdfadeb5a Removed useless method [#CLICKHOUSE-2] 2018-02-15 19:54:14 +03:00
Alexey Milovidov
e658741ccf Removed useless methods [#CLICKHOUSE-2] 2018-02-15 19:29:34 +03:00
Alexey Milovidov
921e09b5f8 Merge branch 'master' into header-in-input-streams 2018-02-15 19:20:36 +03:00
proller
10803568ad
Macos shared build fix (#1906) 2018-02-15 00:01:40 +03:00
Nikolai Kochetov
4040e156b5 added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e997db55ef fix for vertical merge in MultiversionMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a added MultiversionMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e02ca10b9a merged with master 2018-02-08 20:46:22 +03:00
Nikolai Kochetov
583ff32fe8 changed IFunction 2018-02-08 20:18:15 +03:00
Tsarkova Anastasia
5ecd50ff44 Adding comments. Reversing infinities. 2018-02-08 17:28:31 +03:00
Alexey Milovidov
02ae36fe0c Little better #1855 2018-02-06 21:43:28 +03:00
zhang2014
5e001ba8e0 ISSUES-67 Use initial column values with default expression 2018-02-03 15:42:40 +08:00
Vitaliy Lyudvichenko
e2fb6d8c80 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-25 22:00:08 +03:00
alexey-milovidov
24ac18201c Update getFQDNOrHostName.cpp 
Update isLocalAddress.cpp

Update IBlockOutputStream.h

Update users.xml
 2018-01-24 17:14:21 +03:00
Alexey Milovidov
e8a0dde15b Added more checks [#CLICKHOUSE-2]. 2018-01-23 21:49:15 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Alexey Milovidov
9a02d4f5ff Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-01-20 04:20:40 +03:00
Amos Bird
f87d80c378 Add #pragma once for SquashingTransform.h 2018-01-19 21:40:23 +03:00
Vitaliy Lyudvichenko
bee7127572 Refactoring of Graphite merger. [#CLICKHOUSE-2860] 2018-01-19 21:40:05 +03:00
Vitaliy Lyudvichenko
0b8d2a2024 Fixed nondeterministic merge in GraphiteMergeTree. [#CLICKHOUSE-2860] 2018-01-18 23:30:03 +03:00
Vitaliy Lyudvichenko
69a3c81866 Fix incorrect delayed max_result_bytes check. [#CLICKHOUSE-2] 
Resolves #1724
 2018-01-17 21:15:25 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749) 
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
 2018-01-15 22:07:47 +03:00
Alexey Milovidov
ce5de79263 Fixed tests #1665 2018-01-14 03:12:23 +03:00
Alexey Milovidov
9283c38854 Fixed error [#CLICKHOUSE-2]. 2018-01-13 04:33:55 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f Minimal working example. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
proller
b026eb7797 Use submodule contrib/capnproto, remove include_directories (#1746) 
* Add submodule contrib/capnproto

* Use contrib/capnproto, remove include_directories

* Fix include

* Clean

* Fix werror

* Update doc

* Fix

* Final fix

* Fxi
 2018-01-11 21:39:52 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Alexey Milovidov
5081f276d1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 04:51:08 +03:00
Alexey Milovidov
fe880d73e7 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 03:19:58 +03:00
Alexey Milovidov
1780e6c1d9 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-08 04:14:43 +03:00
Alexey Milovidov
12c521fa25 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-07 03:35:44 +03:00
Alexey Milovidov
9996e181e1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-06 21:10:44 +03:00
Alexey Milovidov
7a2fcd3055 Fixed build on AArch64 [#CLICKHOUSE-1700] 2017-12-28 19:51:53 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]." 
This reverts commit fcabe8b888.
 2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89 Merge branch 'aavdonkin-master' 2017-12-28 07:33:55 +03:00
Alexey Milovidov
104b09604a Merging [#CLICKHOUSE-3114] 2017-12-28 00:45:05 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
proller
da1233fe3f Fix missing includes 2017-12-26 22:02:00 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]." 
This reverts commit fcabe8b888.
 2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0 Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2]. 2017-12-25 21:58:39 +03:00
Alexey Milovidov
8ff93487e3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-25 07:01:46 +03:00
Alexey Milovidov
671b731c90 Removed useless calls [#CLICKHOUSE-2]. 2017-12-25 03:37:13 +03:00
Alexey Milovidov
9aa0ebff01 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-24 10:59:39 +03:00
Alexey Milovidov
7ee1c81d45 Fixed DISTINCT if all columns are constant [#CLICKHOUSE-3505]. 2017-12-24 10:59:26 +03:00
Marek Vavruša
ad59a1460e IProfilingBlockInputStream: check limits before reading block 
This makes one pointless check before the first block is read, but
is necessary to prevent reading blocks from storages like Kafka where
messages are read only once.
 2017-12-24 09:57:20 +03:00
Alexey Milovidov
d6dc25b09e Fixed wording #1650 2017-12-23 03:21:49 +03:00
Alexey Milovidov
5e39b55f60 Added PR changes #1676 2017-12-22 22:20:18 +03:00
Alexey Milovidov
bf9c301784 Simplification of aggregate functions: compatibility details [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Alexey Milovidov
c990740b33 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Marek Vavruša
fd260c31ba CapnpProtoRowInputStream: fixed build in current master, added docs 2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking 
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
 2017-12-21 00:46:50 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS 
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
 2017-12-21 00:46:50 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
280b88454b Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:43:40 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
c0670435ab Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 11:44:06 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
5f4a536f75 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:33:54 +03:00
Alexey Milovidov
6fe31d257d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:10:05 +03:00
Alexey Milovidov
342f0e431a Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:08:33 +03:00
Alexey Milovidov
645f620873 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
a92055c768 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:04:28 +03:00
Alexey Milovidov
6756b37925 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 04:34:30 +03:00
Alexey Milovidov
4148c6ce81 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:06:56 +03:00
Alexey Milovidov
8926af2ced Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:01:59 +03:00
Alexey Milovidov
c2985857f8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:51:30 +03:00
Alexey Milovidov
01a0b91c83 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:20:14 +03:00
Alexey Milovidov
d164024e3d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 23:58:18 +03:00
Alexey Milovidov
744c2d3d02 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:30:01 +03:00
Alexey Milovidov
911d80ab51 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert 
Support table functions for desc and insert
 2017-12-11 23:28:10 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
6a568ab692 Technically allowed empty arrays of unspecified type [#CLICKHOUSE-2]. 2017-12-09 23:56:53 +03:00
Alexey Milovidov
b34cdeec79 Fixed error [#CLICKHOUSE-2] 2017-12-09 19:17:37 +03:00
Alexey Milovidov
b00bb5c348 Added support for nullable types in HAVING section in presence of WITH TOTALS [#CLICKHOUSE-3431]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
ae3d44f30f Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
384d03d4ce Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 10:41:08 +03:00
Alexey Milovidov
741a6e0066 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 03:50:25 +03:00
Alexey Milovidov
be72c247fe Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 15:09:55 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
0ea105f639 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:31:47 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-04 23:34:27 +03:00
Alexey Milovidov
344f861adb Clarifications [#CLICKHOUSE-2]. 2017-12-04 23:29:13 +03:00
alexey-milovidov
1aaeaf653d
Merge pull request #1551 from amosbird/patch-5 
Propagate readPrefix in ParallelInputsProcessor (take 2)
 2017-12-04 23:16:11 +03:00
alexey-milovidov
521e6181c1
Update ParallelInputsProcessor.h 2017-12-04 23:15:40 +03:00
Alexey Milovidov
d36d7170ed Better [#CLICKHOUSE-2]. 2017-12-02 06:42:21 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
7196602e12 Better [#CLICKHOUSE-2]. 2017-12-02 00:51:50 +03:00
Alexey Milovidov
739b7e0e37 Removed BlockTabSeparated format as it was totally useless [#CLICKHOUSE-2]. 2017-12-02 00:44:12 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
Nikolai Kochetov
470c633e09 merged with master 2017-12-01 16:33:47 +03:00
Nikolai Kochetov
f025f22007 Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-01 16:24:50 +03:00
Amos Bird
b516e5e087
Propagate readPrefix in ParallelInputsProcessor (take 2) 
Both UnionBlockInputStream and ParallelAggregatingBlockInputStream rely on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.

Fix thread unsafty issue in https://github.com/yandex/ClickHouse/pull/1516

Here is a list of inputstreams with meaningful work in readPrefix

```
IProfilingBlockInputStream

AsynchronousBlockInputStream
BlockInputStreamFromRowInputStream
CatBoostDatasetBlockInputStream
CreatingSetsBlockInputStream
CSVRowInputStream
DictionaryBlockInputStreamBase
InputStreamFromASTInsertQuery
KafkaBlockInputStream
MergingAggregatedMemoryEfficientBlockInputStream
RemoteBlockInputStream
StorageFileBlockInputStream
```
 2017-11-28 16:52:00 +08:00
Alexey Milovidov
c05cf01a9b SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:50 +03:00
Alexey Milovidov
06a65168ac SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h 
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
 2017-11-24 16:55:31 +03:00
Alexey Milovidov
c13872450f Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:53 +03:00
Alexey Milovidov
d50511b8e1 Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:02 +03:00
Alexey Milovidov
2d98a33dd0 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 05:40:07 +03:00
alexey-milovidov
35ce63a762 Revert "Propagate readPrefix in ParallelInputsProcessor" 2017-11-22 05:17:42 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:07 +03:00
Alexey Milovidov
7cce063d00 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:50:52 +03:00
Alexey Milovidov
feea8996d5 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:46:00 +03:00
Alexey Milovidov
02a991a49c Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:45:33 +03:00
Alexey Milovidov
fbab976e09 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-20 07:44:53 +03:00
alexey-milovidov
c88855873d
Merge pull request #1516 from amosbird/patch-1 
Propagate readPrefix in ParallelInputsProcessor
 2017-11-20 07:45:40 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Amos Bird
22e9772593
Propagate readPrefix in ParallelInputsProcessor 
UnionBlockInputStream relies on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
 2017-11-20 10:53:48 +08:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate 
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
 2017-11-19 23:01:23 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option 
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
 2017-11-15 23:17:22 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
60477a9aaa Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Nikolai Kochetov
1cee62eb0a supported table_function in insert query [#CLICKHOUSE-3397] 2017-11-03 16:25:39 +03:00
proller
6e3ca916d9 Fix atomic usage 2017-11-01 16:35:34 +03:00
proller
9bc029ba17 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-01 14:43:48 +03:00
Alexey Milovidov
175af4b2e9 Removed copy-paste [#CLICKHOUSE-2]. 2017-11-01 06:09:06 +03:00
proller
47eae26d75 Fix build 2017-10-31 22:19:36 +03:00
proller
5d137e22eb More atomics 2017-10-30 17:38:16 +03:00
Marek Vavruša
c44e3e76c8 Renamed CapnProtoInputStream to CapnProtoRowInputStream. 2017-10-27 23:03:51 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support 
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
 2017-10-27 23:03:51 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Marek Vavruša
c0458999f9 SummingSortedBlockInputStream: fix summing of multiple blocks 
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
 2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066 AggregateFunctionSum: implemented sumWithOverflow(x) 
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.

This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
 2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf SummingSortedBlockInputStream: fix explicitly configured columns to sum 
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.

This also fixes summation of invalid maps with
with only one key column and no value columns.

Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
 2017-10-25 22:21:59 +03:00
proller
4ffbca2d8c Fix warnings (#1406) 
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
 2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)" 
This reverts commit fa2484ea90.
 2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381) 
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
 2017-10-24 22:11:42 +03:00
alexey-milovidov
5bfb4c213c Update JSONEachRowRowInputStream.cpp 2017-10-23 20:47:33 +03:00
Marek Vavruša
6be0ffd943 DataStreams/JSONEachRow: read exact number of rows 
When using a LIMIT to reduce the number of rows
read, JSONEachRow format would always read an
extra row as it triggered a scan to seek the
EOF or beginning of the next row. This is not
an issue with physical tables, but it is
for streaming tables as an extra row is
unintentionally consumed on each read.
 2017-10-23 20:47:33 +03:00
Marek Vavruša
927c0f7b74 dbms: Partially revert previous change 
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
 2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24 dbms: Better fix for missing unsigned long to Poco::UInt64 alias 2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update 
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
 2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang 
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
 2017-10-13 18:12:29 -07:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
Marek Vavruša
41b0bea84c SummingSortedBlockInputStream: use a separate structure for MapDescription 2017-10-13 21:51:03 +03:00
Marek Vavruša
39a5ae97c9 SummingSortedBlockInputStream: added comments, destructor for state 2017-10-13 21:51:03 +03:00
alexey-milovidov
d561d8d701 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
a2fa58a2e4 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
fee883d7c5 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
Marek Vavruša
2edf5492d0 AggregateFunctionSumMap: support variardic arguments, specialized keys 
The function is rewritten to avoid allocations on every insert with
Field deserialising each array. The key type is now specialized,
so it can be accessed directly. The value type is variant type,
but only individual values are deserialised (which is cheap, since they're PODs).
The function also support summing of multiple columns by the same key.

The SummingSortedBlockInputStream uses the function in case of
Nested structure with one numeric key and many values to sum.
 2017-10-13 21:51:03 +03:00
Marek Vavruša
be2faa82ff DataStreams/test: test case for nested field with two arrays for summing 2017-10-13 21:51:03 +03:00
Marek Vavruša
c09a43a7b2 DataStreams/SummingSortedBlockInputStream: use builtin aggregated functions 
This replaces custom summation function implementations with an implementation
using built-in aggregation functions (sum and sumMap). The goal is to be able to
use specialized variants of aggregation functions, and to have a single
efficient implementation.
 2017-10-13 21:51:03 +03:00
Marek Vavruša
c9be3719bc DataStreams/tests: add SummingSortedBlockInputStream test variant 
This is basically useful for testing SummingSortedBlockInputStream
against the AggregatingBlockInputStream, which are used in the
{Summing,Aggregating}MergeTree table engines respectively.
 2017-10-13 21:51:03 +03:00
Alexey Milovidov
e57e79a5ff Proper fix for the issue: better exception message [#CLICKHOUSE-2]. 2017-10-12 22:56:47 +03:00
proller
cbc81a6a9f Received signal Segmentation fault (#1300) (#1302) 
* Received signal Segmentation fault (#1300)

* Add test
 2017-10-12 22:46:40 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change 
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
 2017-10-10 08:33:00 -07:00
proller
7feb94357b use enum class 2017-10-03 22:12:44 +03:00