Commit Graph

1808 Commits

Author SHA1 Message Date
alesapin
c13ffed085 Remove redundant changes 2018-09-20 16:26:32 +03:00
alesapin
0f12e028a5 Fix insert for native format 2018-09-20 15:59:33 +03:00
alesapin
b87a084f38 Strict order of evaluated and added columns 2018-09-20 14:16:15 +03:00
CurtizJ
f9ff586415 optimize 2018-09-20 13:44:13 +03:00
alesapin
2b3e29f607 Take header from first block in Squashing stream 2018-09-19 20:39:04 +03:00
alesapin
e1c8045055 Fix error with header 2018-09-19 15:56:56 +03:00
CurtizJ
31bf960bfe add new syntax 2018-09-19 14:18:38 +03:00
alesapin
c2f3453fda Reorder Squashing and adding default output stream in insert 2018-09-19 14:06:42 +03:00
CurtizJ
43951e4879 add test 2018-09-17 22:16:51 +03:00
CurtizJ
8c9fe80d2d add modificator cube 2018-09-17 21:01:04 +03:00
Amos Bird
af369483a9 Simply Self.
> When the normal name of the template (i.e., the name from the enclosing scope, not the injected-class-name) is used, it always refers to the class template itself and not a specialization of the template

http://eel.is/c++draft/temp.local
2018-09-13 22:59:54 +08:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update
ALTER UPDATE
2018-09-13 06:03:35 +03:00
Alexey Milovidov
3293480a12 Validate sizes of arrays - elements of Nested data structures [#CLICKHOUSE-3692] 2018-09-13 00:08:55 +03:00
Alexey Milovidov
f16aa1964a Better formatting of numbers in log message [#CLICKHOUSE-2] 2018-09-10 21:23:11 +03:00
alexey-milovidov
20d5ddd58c
Merge branch 'master' into alter-update 2018-09-10 17:17:10 +03:00
Alexey Milovidov
3f07a1af51 Fixed error [#CLICKHOUSE-2] 2018-09-09 08:47:27 +03:00
Alexey Milovidov
c7b1a40296 Fixed test [#CLICKHOUSE-2] 2018-09-09 05:23:24 +03:00
Alexey Milovidov
4ec18956c7 Preparation [#CLICKHOUSE-2] 2018-09-08 22:23:48 +03:00
Alexey Milovidov
e78c16000c utils/check-style/check-style #3069 2018-09-08 06:07:12 +03:00
alexey-milovidov
a2df7d522c
Merge pull request #3069 from CurtizJ/CLICKHOUSE-3893
Fix code duplication in RollupBlockInputStream and TotalsHavingBlockInputStream
2018-09-08 00:35:56 +03:00
Alexey Zatelepin
133c9c7c37 Merge branch 'master' into alter-update
Conflicts:
	docs/en/query_language/alter.md
2018-09-07 19:11:02 +03:00
chertus
0b35cdae69 refactoring: add some sugar in type checks [CLICKHOUSE-0002] 2018-09-07 17:37:26 +03:00
CurtizJ
a0ee183826 whitespaces 2018-09-07 17:21:11 +03:00
CurtizJ
3e854df5a5 remove code duplicates 2018-09-07 17:18:15 +03:00
Alexander Sapin
03174e131d Merge remote-tracking branch 'upstream/master' 2018-09-06 12:39:42 +03:00
Alexey Milovidov
9df01c1012 Style #2948 2018-09-06 04:06:30 +03:00
alexey-milovidov
0ca8e20e66
Merge pull request #2948 from CurtizJ/CLICKHOUSE-3893
CLICKHOUSE-3893 - Add modificator rollup.
2018-09-06 03:59:02 +03:00
alexey-milovidov
4c549f79cd
Update RollupBlockInputStream.cpp 2018-09-06 03:58:24 +03:00
Alexey Zatelepin
6275bfd8cd fix CollapsingMergeTree + vertical merge [#CLICKHOUSE-3963]
don't skip writing to rows sources even if all rows have collapsed.
2018-09-05 20:19:51 +03:00
CurtizJ
472adf4ab9 add rollup to formatted query 2018-09-05 19:23:28 +03:00
CurtizJ
35cbdcda5b optimize memory consumption 2018-09-05 17:39:51 +03:00
CurtizJ
18da41afe3 Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-3893 2018-09-05 12:49:02 +03:00
CurtizJ
a7bbf83c91 Revert "Revert "Merge branch 'master' into CLICKHOUSE-3893""
This reverts commit cdb2c8a770.
2018-09-05 12:47:57 +03:00
CurtizJ
cdb2c8a770 Revert "Merge branch 'master' into CLICKHOUSE-3893"
This reverts commit 0704da5756, reversing
changes made to 4534d449c1.
2018-09-05 12:45:57 +03:00
Alexey Zatelepin
4f91833e67 Merge branch 'master' into alter-update
Conflicts:
	dbms/src/Parsers/ASTIdentifier.cpp
2018-09-04 17:39:08 +03:00
Alexey Zatelepin
d4d1020798 execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13] 2018-09-03 22:34:49 +03:00
alesapin
11d248ba10 Resolve conflict 2018-09-03 13:11:10 +03:00
CurtizJ
3bc743c50d do not merge blocks into one 2018-09-03 12:49:04 +03:00
Alexey Milovidov
26587dd2bb Addition to prev. revision [#CLICKHOUSE-2] 2018-09-02 08:23:20 +03:00
Alexey Milovidov
f5d03f6ac2 Miscellaneous [#CLICKHOUSE-2] 2018-09-01 22:14:04 +03:00
Alexey Milovidov
7d77d001f5 Full support for alignment of aggregate states #2808 2018-09-01 07:25:03 +03:00
alesapin
711b228a30 Merge remote-tracking branch 'upstream/master' 2018-08-31 10:15:33 +03:00
Alexey Milovidov
8aecbc6df6 Data streams: better [#CLICKHOUSE-3944] 2018-08-31 04:46:39 +03:00
alesapin
6e64067a70 CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache 2018-08-30 19:31:20 +03:00
Alexey Zatelepin
dc2a4c21e9 execute ALTER UPDATE [#CLICKHOUSE-13] 2018-08-30 16:56:43 +03:00
CurtizJ
a04c37251b remove redundant code 2018-08-27 12:09:47 +03:00
CurtizJ
cf3fbb8c51 minor changes 2018-08-24 20:37:08 +03:00
CurtizJ
e0b3283ed3 Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-3893 2018-08-24 18:09:53 +03:00
CurtizJ
c18ad18d96 Add rollup modificator 2018-08-24 18:00:00 +03:00
Alexey Zatelepin
f592aa84d1 fix vertical merge for empty parts [#CLICKHOUSE-3913] 2018-08-23 15:04:30 +03:00
Alexey Milovidov
5435dc3dc2 Fixed error with thread statuses #2482 2018-08-22 07:32:21 +03:00
CurtizJ
0704da5756 Merge branch 'master' into CLICKHOUSE-3893 2018-08-21 20:34:01 +03:00
CurtizJ
4534d449c1 working on rollup 2018-08-21 19:08:45 +03:00
Alexey Milovidov
2138f50e48 Better exception message #2888 2018-08-20 19:10:58 +03:00
Nikolai Kochetov
391b4b5927 Merged with master. 2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df Merge branch 'master' into CLICKHOUSE-2910 2018-08-14 23:29:42 +03:00
Nikolai Kochetov
26f464a4f9 Fix Const(LowCardinality) conversion. [#CLICKHOUSE-3621] 2018-08-14 20:19:48 +03:00
Nikolai Kochetov
4a62ab9d5c Merged with master. 2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf Preparation for extra warnings [#CLICKHOUSE-2] 2018-08-10 07:02:56 +03:00
Nikolai Kochetov
ab10005af5 Renamed settings for LowCardinality type. 2018-08-09 13:52:46 +03:00
Nikolai Kochetov
f4d9d50168 Merged with master. 2018-08-08 15:01:18 +03:00
Alexey Zatelepin
1f2d4f90b9 allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879] 2018-08-06 19:54:00 +03:00
Alexey Milovidov
2016374d20 Merging #2226 2018-08-05 10:05:43 +03:00
Nikolai Kochetov
9359ae7650 Fix test. 2018-07-31 20:34:17 +03:00
Nikolai Kochetov
368e7d0b08 Added joined_block_actions to SubqueryForSet for join subquery. [#CLICKHOUSE-3761]
3Added joined_block_actions to join expression action.
2018-07-30 22:41:27 +03:00
Alexey Zatelepin
f75fb6cd68 refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Constantin S. Pan
8539c1e119 Fix the column size difference bug in SummingMergeTree 2018-07-18 00:17:04 +03:00
chertus
3d133a6a5a save block structure when add defaults 2018-07-17 23:02:37 +03:00
chertus
07a782e637 fix wrong defaults at columns tail and some build fixes 2018-07-16 22:28:07 +03:00
chertus
e65c0b436a Merge branch 'master' into issue-3578 2018-07-16 18:28:06 +03:00
proller
5384504fa2 More information in 'Cannot read all data' errors 2018-07-13 22:06:26 +03:00
chertus
4e0d9aa8d4 revert unneeded changes 2018-07-13 15:46:29 +03:00
chertus
c8f71cb539 Merge branch 'master' into issue-3578 2018-07-13 14:30:42 +03:00
chertus
c78a67d573 fix case with unexpected aliases 2018-07-13 01:05:03 +03:00
chertus
3c39f2fc69 fix some tests 2018-07-11 21:34:12 +03:00
chertus
82d22574d4 fix empty defaults mask issue and add some comments 2018-07-11 17:11:47 +03:00
chertus
fe1b393e55 defaults for storages with formated input 2018-07-11 15:05:04 +03:00
chertus
519102b110 defaults for http inserts 2018-07-10 20:20:55 +03:00
Alexey Milovidov
8e0ae12b4e Miscellaneous [#CLICKHOUSE-2] 2018-07-10 16:43:01 +03:00
chertus
5036309d26 fix const defaults 2018-07-10 16:33:41 +03:00
Alexey Milovidov
c0373c1d45 Style; added comment #2566 2018-07-04 23:46:17 +03:00
Alexey Milovidov
47958bee7c Merge branch 'feature-agg-func-in-summing-merge-tree' of https://github.com/kvap/ClickHouse into kvap-feature-agg-func-in-summing-merge-tree 2018-07-04 23:34:28 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
chertus
88c4081a82 3578: defaults for input streams (in progress) 2018-07-04 20:02:47 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface. 2018-06-26 17:12:21 +03:00
Constantin S. Pan
cc4c4e0b49 Make the test more comprehensive and fix bugs in AggregateFunction implementation of SummingMergeTree 2018-06-26 11:28:42 +01:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Nikolai Kochetov
91c9906c88 Fixed reading from ReplacingMergeTree from emprty row set after prewhere. #2525 2018-06-25 13:48:11 +03:00
Alexey Zatelepin
2fb3d42dfd temporary fix for a bug when several mutations have the same predicate [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Constantin S. Pan
e94570d206 Add support for AggregateFunction in SummingMergeTree 2018-06-21 16:10:32 +01:00
Nikolai Kochetov
f88584d748 Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary. 2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488)
CONTRIB-254
2018-06-19 21:09:09 +03:00
Vitaliy Lyudvichenko
8dc1bebf00 Add logs forwarding from remote severs to client. [#CLICKHOUSE-2910] 2018-06-18 19:30:26 +03:00
Vitaliy Lyudvichenko
392f6e0c6c Print query_id in logs. Add own logging interface. [#CLICKHOUSE-2910] 2018-06-18 16:41:13 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Vitaliy Lyudvichenko
ed7cd86f09 Fixed several bug. Trun on --server_logs_level=warning in tests. [#CLICKHOUSE-2910]
Fixed several test to be compatible with --server_logs_level=warning.
2018-06-08 22:50:15 +03:00
Alexey Milovidov
96fbe1d716 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:27:34 +03:00
Alexey Milovidov
101276e541 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:15:33 +03:00
Alexey Milovidov
2152b932c2 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text: preparation #1710 2018-06-08 05:56:37 +03:00
Alexey Milovidov
29bd48fc7a Passing settings to ser/de of data types: development #1710 2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Alexey Milovidov
d81d4dfb29 Merge branch 'master' into format-settings 2018-06-08 01:39:55 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
alexey-milovidov
be4be0758a
Remove escaping in presentational formats (#2476)
* Removed escaping in presentational formats; changed a way how NULL is output #1729

* Addition to prev. revision #1729

* Addition to prev. revision #1729

* Updated tests #1729

* Updated function visibleWidth to be consistent with Pretty formats #1729
2018-06-07 04:30:29 +03:00
Alexey Milovidov
0b7bf8491f Merge branch 'master' into format-settings 2018-06-07 02:13:45 +03:00
proller
347579ce46 Cmake: mark system includes as SYSTEM (#1449)
* contrib: cctz as submodule. update cctz.

* pbuilder: add ubuntu bionic, devel

* Cmake: mark system includes as SYSTEM

* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Cmake: Add SYSTEM to includes for external libs
2018-06-06 23:21:58 +03:00
Ivan Zhukov
6dd0f89d68 Refactor: make some members and methods static 2018-06-06 00:47:57 +03:00
Alexey Milovidov
092d156800 Settings for DateTime format (incomplete) [#CLICKHOUSE-2] 2018-06-06 00:39:01 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Ivan Zhukov
b34c2443f4 Parquet input: support NULL values 2018-06-05 02:44:36 +03:00
Alexey Milovidov
df11490b2a Insignificant changes guided by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:45:08 +03:00
Alexey Milovidov
d811647668 Suppressions for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:28:25 +03:00
Vitaliy Lyudvichenko
89f2107c75 C++ify taskstats getter, periodic auto update of profile events. [#CLICKHOUSE-2910] 2018-06-04 17:50:35 +03:00
Alexey Zatelepin
2e77c508ad add comments [#CLICKHOUSE-3747] 2018-06-04 14:43:09 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Vitaliy Lyudvichenko
549a6944d9 Better AsynchronousBlockInputStream in sync mode. [#CLICKHOUSE-2910] 2018-06-01 14:58:17 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Vitaliy Lyudvichenko
7615f5a09a More detail dignostic when parse JSONEachRow. [#CLICKHOUSE-2] 2018-05-28 14:40:07 +03:00
Ivan Zhukov
882e246e4f Actualize TODOs 2018-05-26 23:44:51 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Ivan Zhukov
72ccc8f978 Parquet output: refactor functions-fillers 2018-05-25 01:23:36 +03:00
Ivan Zhukov
0111969eaa Check arrow status 2018-05-25 00:33:12 +03:00
Alexey Milovidov
a7a16c3c24 Processors: experimental [#CLICKHOUSE-2948] 2018-05-24 04:02:16 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Nikolai Kochetov
937cb2db29 Merged with master. 2018-05-21 14:38:50 +03:00
Alexey Milovidov
1203df737d Processors: experimental [#CLICKHOUSE-2948] 2018-05-20 07:51:45 +03:00
Ivan Zhukov
b3de2f4b2b Parquet output: support numeric and string types 2018-05-18 05:53:54 +03:00
Ivan Zhukov
f1bef15705 Parquet input: add a Date type support 2018-05-17 22:07:51 +03:00
Ivan Zhukov
31e27effa6 Parquet input: change if to switch 2018-05-17 22:07:51 +03:00
Ivan Zhukov
4076ae77b4 Parquet input: add a boolean type support 2018-05-17 22:07:51 +03:00
Ivan Zhukov
f8dae2bc76 Parquet input: get rid of redundant copying 2018-05-17 22:07:49 +03:00
Nikolai Kochetov
d7ead51796 Added invalid FixedString size to the list of parse errors. 2018-05-17 18:29:59 +03:00
Ivan Zhukov
282110cba4 Parquet input: support a string type 2018-05-17 04:54:25 +03:00
Ivan Zhukov
e5307e3c18 Parquet input: support numeric types 2018-05-17 04:54:25 +03:00
Ivan Zhukov
fabd38fe6d Add a template for ParquetBlockInputStream 2018-05-17 04:54:23 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2]
Faster partition check.

Added more debug info.
2018-05-14 17:14:58 +03:00
Nikolai Kochetov
6ba8cb922c Fix usage of columns from header in SummingSortedBlockInputStream. #2273 2018-05-14 13:48:50 +03:00
Vitaliy Lyudvichenko
5704de8774 Fixed settings passing in clickhouse-local and tmp dirs. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
proller
398097d24a Build fixes (#2323)
* Build fixes

* Fixes

* remove libzookeeper-mt-dev

* fix

* fix

* wrong

* try fix

* fix

* Update CMakeLists.txt
2018-05-07 18:59:52 +03:00
Nikolai Kochetov
af5475b77c Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:50:42 +03:00
Nikolai Kochetov
67769ef333 Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:47:39 +03:00
Nikolai Kochetov
f4627af23f Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:44:52 +03:00
Nikolai Kochetov
13ba167dce Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:40:36 +03:00
Nikolai Kochetov
530b99cee5 Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:39:15 +03:00
alexey-milovidov
093c054b1f
Merge pull request #2263 from luc1ph3r/arbitrary-csv-delimiter
Support an arbitrary CSV delimiter
2018-04-27 13:13:09 -07:00
Nikolai Kochetov
7a62bb9267 added comments and fixed tests build 2018-04-23 22:41:10 +03:00
Ivan Zhukov
e402ff3f81 Unify string checks with a new type 2018-04-22 02:42:01 +03:00
Ivan Zhukov
a138ab2820 Add CSV delimter support in CSVRowOutputStream 2018-04-22 02:08:50 +03:00
Ivan Zhukov
91cb03bdaf Add delimiter support in CSVRowInputStream 2018-04-22 02:08:31 +03:00
Nikolai Kochetov
a6375d6155 merged with master 2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620 fix build 2018-04-20 17:06:01 +03:00
Alexey Milovidov
207a8cc03c Fixed error with Sets, part 2 #2246 2018-04-20 00:36:58 +03:00
Alexey Milovidov
ce0ac3f8f8 Fixed error with Sets, part 2 #2246 2018-04-20 00:34:04 +03:00
Nikolai Kochetov
dd10c2073c merged with master 2018-04-19 18:10:44 +03:00
Alexey Milovidov
cce4c8886c Removed obsolete code #2226 2018-04-19 00:23:55 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
f642d0828e Avoid freezing of KILL QUERY. [#CLICKHOUSE-3706] 2018-04-17 17:29:52 +03:00
Nikolai Kochetov
66905a1366 fix build 2018-04-16 22:59:12 +03:00
Nikolai Kochetov
081f0feb56 fix test [#CLICKHOUSE-3694] #2156 2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a merged with master 2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34 minor fixes 2018-04-16 18:11:13 +03:00
Nikolai Kochetov
41229b201b Merge branch 'master' into fix-header-for-union-stream-in-distributed-2 2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5 fix perf 2018-04-13 23:09:13 +03:00
Alexey Milovidov
a2482f120d Fixed test [#CLICKHOUSE-2] 2018-04-08 07:38:27 +03:00
proller
07b81c875e CLICKHOUSE-3444: show error for old query on replace_running_query (#2127)
* Add tests

* Fix test

* Fix test build

* CLICKHOUSE-3444: show error for replace_running_query

* fix naming

* fix

* fix test

* Update IProfilingBlockInputStream.cpp
2018-04-07 06:49:49 +03:00
Alexey Milovidov
babfc6aaf7 Fixed error [#CLICKHOUSE-2] 2018-04-07 06:46:20 +03:00
Alexey Milovidov
3fd2773151 Improved code after introduction of method "getHeader" in every stream [#CLICKHOUSE-2] 2018-04-07 04:46:50 +03:00
Alexey Milovidov
af226d62f5 Fixed totally wrong code in SummingMergeTree in the case of complex maps [#CLICKHOUSE-2] 2018-04-06 21:09:20 +03:00
Alexey Milovidov
f66d2fb780 Allow to use FINAL even in case of single part #2086 2018-04-06 00:36:55 +03:00
Alexey Milovidov
36c9409899 Fixed error [#CLICKHOUSE-2] 2018-04-05 07:42:20 +03:00
Vitaliy Lyudvichenko
ce8de108ed Better timeouts handling. [#CLICKHOUSE-2] 2018-04-04 22:44:38 +03:00
Alexey Milovidov
b3e6bb453a Renamed method #217 [#CLICKHOUSE-1942] 2018-04-02 20:57:38 +03:00
Alexey Zatelepin
f2db72a5e5 move squashing to read side #2084 [#CLICKHOUSE-3540]
This way there is a clear correspondence between blocks inserted into the parent table
and blocks inserted into the materialized view.
2018-03-28 14:41:20 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
Alex Zatelepin
1be7c09702 add readPrefix()/readSuffix() calls for completeness #2084 [#CLICKHOUSE-3540] 2018-03-27 22:25:50 +00:00
Alexey Zatelepin
88a9b7de91 fix calls to writeSuffix() in PushingToViewsBlockOutputStream #2084 [#CLICKHOUSE-3540]
don't use copyData because it calls writeSuffix() prematurely.
2018-03-27 23:04:40 +03:00
Alexey Zatelepin
d58483b084 squash blocks when inserting into materialized views #2084 [#CLICKHOUSE-3540] 2018-03-27 20:08:41 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996)
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Nikolai Kochetov
bd3f2ea361 Merge branch 'stricter-mutable-column-semantic-3' into stricter-mutable-column-semantic-2 2018-03-20 22:47:40 +03:00
Nikolai Kochetov
476d4b339c Immutable construction for columns 2018-03-20 22:45:10 +03:00
Nikolai Kochetov
1f4db58d53 fix test 2018-03-20 20:01:13 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
Alexey Zatelepin
5906c9a988 rename for clarity 2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac encapsulate ColumnsDeclaration [#CLICKHOUSE-3241] 2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346
Sync insert and сluster copier enhancements
2018-03-12 20:58:53 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
f3b6d35167 Removed setting "strict_insert_defaults" [#CLICKHOUSE-2] 2018-03-10 03:11:39 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
8ff0c520d0 Removed the possibility to use queries with empty query_id; better semantics #245 2018-03-10 02:04:26 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
alexey-milovidov
a06af52824
Merge pull request #1995 from yandex/CLICKHOUSE-3616
Fixed segfault in case of WHERE <non-UInt8 type expression>
2018-03-06 22:10:14 +03:00
Alexey Zatelepin
f3812dddea generic comparison code in GraphiteRollupSortedBlockInputStream [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Alexey Zatelepin
5d51c66bbb generic version comparison code for ReplacingMergeTree [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Vitaliy Lyudvichenko
1d247d0e31 Fixed segfault in case of WHERE <non-UInt8 type expression>. [#CLICKHOUSE-3616]
Prohibited non-UInt8 constants in WHERE expressions.
Fixed KILL QUERY syntax highlighting.
2018-03-06 18:42:00 +03:00
proller
82a361d0e9 Show error to client if query was killed (#1989)
* Show error to client if query was killed

* Kill exception v2

* Use kill

* fix

* wip

* fix

* fxi

* try fix

* Revert "try fix"

This reverts commit eb76e4c040.

* QUERY_WASCANCELLED

* Fxi all cancel()

* fix
2018-03-06 00:09:39 +03:00
Alexey Milovidov
ba481a6acd Fixed error with TOTALS [#CLICKHOUSE-3619] 2018-03-03 04:28:13 +03:00
Alexey Milovidov
8cb640ac54 Better UNION ALL: development #1947 2018-03-01 09:08:09 +03:00
Alexey Milovidov
15dc5da190 Fixed error #1947 2018-03-01 09:07:04 +03:00
Alexey Milovidov
ac37b89b16 Better UNION ALL: development #1947 2018-02-26 12:05:06 +03:00
Alexey Milovidov
243563d247 Fixed build [#CLICKHOUSE-2] 2018-02-23 21:55:54 +03:00
Alexey Milovidov
1a3fa45b6f Fixed race condition in Lazy stream [#CLICKHOUSE-2] 2018-02-23 13:43:24 +03:00
Alexey Milovidov
cae7f96f34 Simplification [#CLICKHOUSE-2] 2018-02-23 13:02:29 +03:00
Alexey Milovidov
36a9502e80 Simplification #1896 2018-02-23 11:05:21 +03:00
Alexey Milovidov
640daaf052 Fixed test #1947 2018-02-23 04:00:47 +03:00
Alexey Milovidov
245fd61b12 Unify NullableAdapterBlockInputStream and CastTypeBlockInputStream #1947 2018-02-23 02:02:35 +03:00
Alexey Milovidov
f792ab0824 Remove RemoveColumnsBlockInputStream #1947 2018-02-23 00:35:17 +03:00
alexey-milovidov
7a5ccc86cc
Merge pull request #1937 from yandex/CLICKHOUSE-3606
Update of clickhouse-copier
2018-02-22 23:42:33 +03:00
Vitaliy Lyudvichenko
07d01d2dfb Fixed build after merge. [#CLICKHOUSE-3606] 2018-02-22 14:40:23 +03:00
KochetovNicolai
bcad88c9ae
Update ReplacingSortedBlockInputStream.h
added comment
2018-02-22 11:37:16 +03:00
alexey-milovidov
b6f3f06ef3
Merge branch 'master' into CLICKHOUSE-3606 2018-02-22 02:13:38 +03:00
alexey-milovidov
533b5cbe00
Merge pull request #1938 from yandex/fix-replacing-merge-tree
Fix replacing merge tree vertical merge
2018-02-22 02:06:24 +03:00
alexey-milovidov
331fca64a9
Update ReplacingSortedBlockInputStream.h 2018-02-22 02:04:37 +03:00
Alexey Milovidov
222fb2c945 Miscellaneous [#CLICKHOUSE-2] 2018-02-21 23:23:27 +03:00
Nikolai Kochetov
9d348846d6 fix row position with max version for vertical merge of ReplacingMergeTree #1914 2018-02-21 16:57:58 +03:00
Alexey Milovidov
fef53b1963 Tiny modification [#CLICKHOUSE-2] 2018-02-21 11:34:38 +03:00
Alexey Milovidov
b1fc5eed45 Fixed error [#CLICKHOUSE-2] 2018-02-21 10:34:40 +03:00
Alexey Milovidov
1a026e6131 Fixed error [#CLICKHOUSE-2] 2018-02-21 09:47:32 +03:00
Alexey Milovidov
09ac108f4c Fixed error [#CLICKHOUSE-2] 2018-02-21 07:38:26 +03:00
Alexey Milovidov
33e42a9001 Better [#CLICKHOUSE-2] 2018-02-21 06:48:46 +03:00
Alexey Milovidov
13f1d5c67d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-20 04:25:56 +03:00
Alexey Milovidov
fa6420b34d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-20 04:14:38 +03:00
Alexey Milovidov
582798b77f Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 23:42:05 +03:00
Alexey Milovidov
ee4b5d2527 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 23:23:25 +03:00
Alexey Milovidov
b747c83b15 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 22:18:51 +03:00
Vitaliy Lyudvichenko
369f88f65d Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346] 2018-02-19 20:26:47 +03:00
Alexey Milovidov
c3b0f0bceb Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:30:11 +03:00
Alexey Milovidov
399ede6404 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:29:56 +03:00
Alexey Milovidov
92cfa63e29 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:50 +03:00
Alexey Milovidov
17320cc40b Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:30 +03:00
Alexey Milovidov
f6766c89c4 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:12:08 +03:00
Alexey Milovidov
900755555f Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:11:55 +03:00
Alexey Milovidov
8d9fc36ac8 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:03:59 +03:00
Alexey Milovidov
307fc93d1d Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 07:03:31 +03:00
Alexey Milovidov
8b7003ade6 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 06:57:24 +03:00
Alexey Milovidov
74c56c2def Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 06:56:08 +03:00
Alexey Milovidov
fa50fe80a0 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-19 03:45:32 +03:00
Alexey Milovidov
d4710c78bf Fixed error [#CLICKHOUSE-1920] #51 2018-02-18 09:12:19 +03:00
Alexey Milovidov
7415513151 Return single row for aggregation without keys on empty set: development [#CLICKHOUSE-1920] #51 2018-02-18 08:35:48 +03:00
Alexey Milovidov
a4c10f7499 Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 07:17:11 +03:00
Alexey Milovidov
afe09d3138 Removed unused code [#CLICKHOUSE-2] 2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2] 2018-02-18 06:23:48 +03:00
Alexey Milovidov
d6d7b3e7e4 Header in every stream: development [#CLICKHOUSE-2] 2018-02-18 05:46:39 +03:00
Alexey Milovidov
dba529d674 Header in every stream: development [#CLICKHOUSE-2] 2018-02-17 07:13:49 +03:00
Alexey Milovidov
a673790748 Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 23:53:47 +03:00
Alexey Milovidov
d76feb779c Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 22:04:27 +03:00
Alexey Milovidov
264e6cbc84 Header in every stream: development [#CLICKHOUSE-2] 2018-02-16 00:31:09 +03:00
Alexey Milovidov
69a9723ce2 Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 22:48:41 +03:00
Alexey Milovidov
30b657a0da Header in every stream: development [#CLICKHOUSE-2] 2018-02-15 21:54:12 +03:00
Alexey Milovidov
0cdfadeb5a Removed useless method [#CLICKHOUSE-2] 2018-02-15 19:54:14 +03:00
Alexey Milovidov
e658741ccf Removed useless methods [#CLICKHOUSE-2] 2018-02-15 19:29:34 +03:00
Alexey Milovidov
921e09b5f8 Merge branch 'master' into header-in-input-streams 2018-02-15 19:20:36 +03:00
proller
10803568ad
Macos shared build fix (#1906) 2018-02-15 00:01:40 +03:00
Nikolai Kochetov
4040e156b5 added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e997db55ef fix for vertical merge in MultiversionMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a added MultiversionMergeTree [#CLICKHOUSE-3479] 2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e02ca10b9a merged with master 2018-02-08 20:46:22 +03:00
Nikolai Kochetov
583ff32fe8 changed IFunction 2018-02-08 20:18:15 +03:00
Tsarkova Anastasia
5ecd50ff44 Adding comments. Reversing infinities. 2018-02-08 17:28:31 +03:00
Alexey Milovidov
02ae36fe0c Little better #1855 2018-02-06 21:43:28 +03:00
zhang2014
5e001ba8e0 ISSUES-67 Use initial column values with default expression 2018-02-03 15:42:40 +08:00
Vitaliy Lyudvichenko
e2fb6d8c80 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-25 22:00:08 +03:00
alexey-milovidov
24ac18201c Update getFQDNOrHostName.cpp
Update isLocalAddress.cpp

Update IBlockOutputStream.h

Update users.xml
2018-01-24 17:14:21 +03:00
Alexey Milovidov
e8a0dde15b Added more checks [#CLICKHOUSE-2]. 2018-01-23 21:49:15 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Alexey Milovidov
9a02d4f5ff Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams 2018-01-20 04:20:40 +03:00
Amos Bird
f87d80c378 Add #pragma once for SquashingTransform.h 2018-01-19 21:40:23 +03:00
Vitaliy Lyudvichenko
bee7127572 Refactoring of Graphite merger. [#CLICKHOUSE-2860] 2018-01-19 21:40:05 +03:00
Vitaliy Lyudvichenko
0b8d2a2024 Fixed nondeterministic merge in GraphiteMergeTree. [#CLICKHOUSE-2860] 2018-01-18 23:30:03 +03:00
Vitaliy Lyudvichenko
69a3c81866 Fix incorrect delayed max_result_bytes check. [#CLICKHOUSE-2]
Resolves #1724
2018-01-17 21:15:25 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749)
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
2018-01-15 22:07:47 +03:00
Alexey Milovidov
ce5de79263 Fixed tests #1665 2018-01-14 03:12:23 +03:00
Alexey Milovidov
9283c38854 Fixed error [#CLICKHOUSE-2]. 2018-01-13 04:33:55 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f Minimal working example. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
proller
b026eb7797 Use submodule contrib/capnproto, remove include_directories (#1746)
* Add submodule contrib/capnproto

* Use contrib/capnproto, remove include_directories

* Fix include

* Clean

* Fix werror

* Update doc

* Fix

* Final fix

* Fxi
2018-01-11 21:39:52 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Alexey Milovidov
5081f276d1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 04:51:08 +03:00
Alexey Milovidov
fe880d73e7 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-09 03:19:58 +03:00
Alexey Milovidov
1780e6c1d9 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-08 04:14:43 +03:00
Alexey Milovidov
12c521fa25 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-07 03:35:44 +03:00
Alexey Milovidov
9996e181e1 Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2] 2018-01-06 21:10:44 +03:00
Alexey Milovidov
7a2fcd3055 Fixed build on AArch64 [#CLICKHOUSE-1700] 2017-12-28 19:51:53 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89 Merge branch 'aavdonkin-master' 2017-12-28 07:33:55 +03:00
Alexey Milovidov
104b09604a Merging [#CLICKHOUSE-3114] 2017-12-28 00:45:05 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
proller
da1233fe3f Fix missing includes 2017-12-26 22:02:00 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
This reverts commit fcabe8b888.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0 Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2]. 2017-12-25 21:58:39 +03:00
Alexey Milovidov
8ff93487e3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-25 07:01:46 +03:00
Alexey Milovidov
671b731c90 Removed useless calls [#CLICKHOUSE-2]. 2017-12-25 03:37:13 +03:00
Alexey Milovidov
9aa0ebff01 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-24 10:59:39 +03:00
Alexey Milovidov
7ee1c81d45 Fixed DISTINCT if all columns are constant [#CLICKHOUSE-3505]. 2017-12-24 10:59:26 +03:00
Marek Vavruša
ad59a1460e IProfilingBlockInputStream: check limits before reading block
This makes one pointless check before the first block is read, but
is necessary to prevent reading blocks from storages like Kafka where
messages are read only once.
2017-12-24 09:57:20 +03:00
Alexey Milovidov
d6dc25b09e Fixed wording #1650 2017-12-23 03:21:49 +03:00
Alexey Milovidov
5e39b55f60 Added PR changes #1676 2017-12-22 22:20:18 +03:00
Alexey Milovidov
bf9c301784 Simplification of aggregate functions: compatibility details [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Alexey Milovidov
c990740b33 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Marek Vavruša
fd260c31ba CapnpProtoRowInputStream: fixed build in current master, added docs 2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
2017-12-21 00:46:50 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
280b88454b Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:43:40 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
c0670435ab Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 11:44:06 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
5f4a536f75 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:33:54 +03:00
Alexey Milovidov
6fe31d257d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:10:05 +03:00
Alexey Milovidov
342f0e431a Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:08:33 +03:00
Alexey Milovidov
645f620873 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
a92055c768 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:04:28 +03:00
Alexey Milovidov
6756b37925 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 04:34:30 +03:00
Alexey Milovidov
4148c6ce81 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:06:56 +03:00
Alexey Milovidov
8926af2ced Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:01:59 +03:00
Alexey Milovidov
c2985857f8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:51:30 +03:00
Alexey Milovidov
01a0b91c83 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:20:14 +03:00
Alexey Milovidov
d164024e3d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 23:58:18 +03:00
Alexey Milovidov
744c2d3d02 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:30:01 +03:00
Alexey Milovidov
911d80ab51 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert
Support table functions for desc and insert
2017-12-11 23:28:10 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
6a568ab692 Technically allowed empty arrays of unspecified type [#CLICKHOUSE-2]. 2017-12-09 23:56:53 +03:00
Alexey Milovidov
b34cdeec79 Fixed error [#CLICKHOUSE-2] 2017-12-09 19:17:37 +03:00
Alexey Milovidov
b00bb5c348 Added support for nullable types in HAVING section in presence of WITH TOTALS [#CLICKHOUSE-3431]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
ae3d44f30f Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
384d03d4ce Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 10:41:08 +03:00
Alexey Milovidov
741a6e0066 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 03:50:25 +03:00
Alexey Milovidov
be72c247fe Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 15:09:55 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
0ea105f639 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:31:47 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-04 23:34:27 +03:00
Alexey Milovidov
344f861adb Clarifications [#CLICKHOUSE-2]. 2017-12-04 23:29:13 +03:00
alexey-milovidov
1aaeaf653d
Merge pull request #1551 from amosbird/patch-5
Propagate readPrefix in ParallelInputsProcessor (take 2)
2017-12-04 23:16:11 +03:00
alexey-milovidov
521e6181c1
Update ParallelInputsProcessor.h 2017-12-04 23:15:40 +03:00
Alexey Milovidov
d36d7170ed Better [#CLICKHOUSE-2]. 2017-12-02 06:42:21 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
7196602e12 Better [#CLICKHOUSE-2]. 2017-12-02 00:51:50 +03:00
Alexey Milovidov
739b7e0e37 Removed BlockTabSeparated format as it was totally useless [#CLICKHOUSE-2]. 2017-12-02 00:44:12 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
Nikolai Kochetov
470c633e09 merged with master 2017-12-01 16:33:47 +03:00
Nikolai Kochetov
f025f22007 Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-01 16:24:50 +03:00
Amos Bird
b516e5e087
Propagate readPrefix in ParallelInputsProcessor (take 2)
Both UnionBlockInputStream and ParallelAggregatingBlockInputStream rely on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.

Fix thread unsafty issue in https://github.com/yandex/ClickHouse/pull/1516

Here is a list of inputstreams with meaningful work in readPrefix

```
IProfilingBlockInputStream

AsynchronousBlockInputStream
BlockInputStreamFromRowInputStream
CatBoostDatasetBlockInputStream
CreatingSetsBlockInputStream
CSVRowInputStream
DictionaryBlockInputStreamBase
InputStreamFromASTInsertQuery
KafkaBlockInputStream
MergingAggregatedMemoryEfficientBlockInputStream
RemoteBlockInputStream
StorageFileBlockInputStream
```
2017-11-28 16:52:00 +08:00
Alexey Milovidov
c05cf01a9b SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:50 +03:00
Alexey Milovidov
06a65168ac SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
c13872450f Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:53 +03:00
Alexey Milovidov
d50511b8e1 Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:02 +03:00
Alexey Milovidov
2d98a33dd0 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 05:40:07 +03:00
alexey-milovidov
35ce63a762 Revert "Propagate readPrefix in ParallelInputsProcessor" 2017-11-22 05:17:42 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:07 +03:00
Alexey Milovidov
7cce063d00 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:50:52 +03:00
Alexey Milovidov
feea8996d5 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:46:00 +03:00
Alexey Milovidov
02a991a49c Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:45:33 +03:00
Alexey Milovidov
fbab976e09 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-20 07:44:53 +03:00
alexey-milovidov
c88855873d
Merge pull request #1516 from amosbird/patch-1
Propagate readPrefix in ParallelInputsProcessor
2017-11-20 07:45:40 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Amos Bird
22e9772593
Propagate readPrefix in ParallelInputsProcessor
UnionBlockInputStream relies on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
2017-11-20 10:53:48 +08:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
2017-11-19 23:01:23 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
60477a9aaa Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Nikolai Kochetov
1cee62eb0a supported table_function in insert query [#CLICKHOUSE-3397] 2017-11-03 16:25:39 +03:00
proller
6e3ca916d9 Fix atomic usage 2017-11-01 16:35:34 +03:00
proller
9bc029ba17 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-01 14:43:48 +03:00
Alexey Milovidov
175af4b2e9 Removed copy-paste [#CLICKHOUSE-2]. 2017-11-01 06:09:06 +03:00
proller
47eae26d75 Fix build 2017-10-31 22:19:36 +03:00
proller
5d137e22eb More atomics 2017-10-30 17:38:16 +03:00
Marek Vavruša
c44e3e76c8 Renamed CapnProtoInputStream to CapnProtoRowInputStream. 2017-10-27 23:03:51 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
2017-10-27 23:03:51 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Marek Vavruša
c0458999f9 SummingSortedBlockInputStream: fix summing of multiple blocks
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066 AggregateFunctionSum: implemented sumWithOverflow(x)
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.

This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf SummingSortedBlockInputStream: fix explicitly configured columns to sum
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.

This also fixes summation of invalid maps with
with only one key column and no value columns.

Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
2017-10-25 22:21:59 +03:00
proller
4ffbca2d8c Fix warnings (#1406)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)"
This reverts commit fa2484ea90.
2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381)
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
2017-10-24 22:11:42 +03:00
alexey-milovidov
5bfb4c213c Update JSONEachRowRowInputStream.cpp 2017-10-23 20:47:33 +03:00
Marek Vavruša
6be0ffd943 DataStreams/JSONEachRow: read exact number of rows
When using a LIMIT to reduce the number of rows
read, JSONEachRow format would always read an
extra row as it triggered a scan to seek the
EOF or beginning of the next row. This is not
an issue with physical tables, but it is
for streaming tables as an extra row is
unintentionally consumed on each read.
2017-10-23 20:47:33 +03:00
Marek Vavruša
927c0f7b74 dbms: Partially revert previous change
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24 dbms: Better fix for missing unsigned long to Poco::UInt64 alias 2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
Marek Vavruša
41b0bea84c SummingSortedBlockInputStream: use a separate structure for MapDescription 2017-10-13 21:51:03 +03:00
Marek Vavruša
39a5ae97c9 SummingSortedBlockInputStream: added comments, destructor for state 2017-10-13 21:51:03 +03:00
alexey-milovidov
d561d8d701 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
a2fa58a2e4 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
fee883d7c5 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
Marek Vavruša
2edf5492d0 AggregateFunctionSumMap: support variardic arguments, specialized keys
The function is rewritten to avoid allocations on every insert with
Field deserialising each array. The key type is now specialized,
so it can be accessed directly. The value type is variant type,
but only individual values are deserialised (which is cheap, since they're PODs).
The function also support summing of multiple columns by the same key.

The SummingSortedBlockInputStream uses the function in case of
Nested structure with one numeric key and many values to sum.
2017-10-13 21:51:03 +03:00
Marek Vavruša
be2faa82ff DataStreams/test: test case for nested field with two arrays for summing 2017-10-13 21:51:03 +03:00
Marek Vavruša
c09a43a7b2 DataStreams/SummingSortedBlockInputStream: use builtin aggregated functions
This replaces custom summation function implementations with an implementation
using built-in aggregation functions (sum and sumMap). The goal is to be able to
use specialized variants of aggregation functions, and to have a single
efficient implementation.
2017-10-13 21:51:03 +03:00
Marek Vavruša
c9be3719bc DataStreams/tests: add SummingSortedBlockInputStream test variant
This is basically useful for testing SummingSortedBlockInputStream
against the AggregatingBlockInputStream, which are used in the
{Summing,Aggregating}MergeTree table engines respectively.
2017-10-13 21:51:03 +03:00
Alexey Milovidov
e57e79a5ff Proper fix for the issue: better exception message [#CLICKHOUSE-2]. 2017-10-12 22:56:47 +03:00
proller
cbc81a6a9f Received signal Segmentation fault (#1300) (#1302)
* Received signal Segmentation fault (#1300)

* Add test
2017-10-12 22:46:40 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
proller
7feb94357b use enum class 2017-10-03 22:12:44 +03:00
proller
5250650f65 Fixes (#1286)
* Revert "Simplification [#CLICKHOUSE-2]."

This reverts commit 98ad6a5db3.

* Fix error: comparison of unsigned expression < 0 is always false

* Fix float division by zero

* Fix float division by zero

* Disable PointInPolygon function if compiling with old clang

* Fix warning:
dbms/src/Functions/FunctionsCoding.h:336:21: error: comparison of constant -1 with expression of type 'const char' is always true [-Werror,-Wtautological-constant-out-of-range-compare]
            if (num != -1)

* Fix
2017-09-26 23:29:34 +03:00
Alex Bocharov
55e1559733 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:46:10 +01:00
Alex Bocharov
1f70d0e163 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:43:47 +01:00
Alex Bocharov
6e74602e45 Aggregate function sumMap: use FieldVisitorSum instead of += operator. 2017-09-18 16:41:07 +01:00
Alexey Milovidov
21fe32b929 Fixed build in clang with raised up inline-depth [#CLICKHOUSE-2]. 2017-09-15 15:17:01 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5 Fixed merges progress bar. [#CLICKHOUSE-2] 2017-09-15 01:04:13 +03:00
proller
a43b9ec398 Revert "Simplification [#CLICKHOUSE-2]."
This reverts commit 98ad6a5db3.
2017-09-14 23:16:31 +03:00
Alexey Milovidov
2c424c7989 Added description of possible race condition [#CLICKHOUSE-2]. 2017-09-10 06:17:05 +03:00
Alexey Milovidov
98ad6a5db3 Simplification [#CLICKHOUSE-2]. 2017-09-10 05:30:45 +03:00
Alexey Milovidov
dc5eca0beb Fixed awful translation [#CLICKHOUSE-2]. 2017-09-10 05:06:16 +03:00
Alexey Milovidov
cf5fd27b94 Clarifications [#CLICKHOUSE-2]. 2017-09-10 04:39:40 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
94b975e7f9 Removed function deprecated in C++ [#CLICKHOUSE-3174]. 2017-09-09 02:31:18 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
8c9ec83a33 Implemented some suggestions from clang-tidy (part 4) [#CLICKHOUSE-3301]. 2017-09-08 07:10:43 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
e9ae193870 Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301]. 2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vitaliy Lyudvichenko
325ceb85b5 Delete unusing files. [#CLICKHOUSE-2] 2017-09-06 04:18:07 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150)
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-09-05 04:08:26 +03:00
Alexey Milovidov
4d97959e57 Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-09-04 04:11:00 +03:00
Alexey Milovidov
f51cc679a0 Fixed inserting wrong default value for Enums [#CLICKHOUSE-3270]. 2017-09-02 00:37:57 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Alexey Zatelepin
ce3e4676fa remove unnecessary calls to find() [#CLICKHOUSE-2171] 2017-08-19 21:35:01 +03:00
Alexey Milovidov
e01c23267a Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-08-18 22:41:27 +03:00
Alexey Milovidov
12a034478c Fixed bad translation [#CLICKHOUSE-2]. 2017-08-18 22:30:39 +03:00
Alexey Milovidov
16d6c4f9e7 Removed very old protocol compatibility features [#CLICKHOUSE-2]. 2017-08-16 23:27:35 +03:00
Alexey Zatelepin
67dffb9be6 simplify MultiplexedConnections further (so that it works with only one shard) [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
36dc7857a1 make LazyBlockInputStream thread-safe [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a remove shard multiplexing code, simplify [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Milovidov
1e1dc8828a Miscellaneous [#CLICKHOUSE-2]. 2017-08-13 00:02:45 +03:00
Alexey Milovidov
45ea2fba47 Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838]. 2017-08-07 10:44:27 +03:00
Alexey Milovidov
fb2aff4704 Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838]. 2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Alexey Milovidov
fd9b8c6fbe Fixed error [#METR-25976]. 2017-08-01 20:02:41 +03:00
Alexey Milovidov
a6cb383c4f Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 04:25:03 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
Alexey Milovidov
d57f5b81a4 Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175]. 2017-07-26 00:07:05 +03:00
Alexey Zatelepin
18672204e5 fix handling of overflow data during external aggregation [#CLICKHOUSE-3133] 2017-07-25 19:56:48 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Nikolai Kochetov
7e293df9af merged with master 2017-07-17 22:48:22 +03:00
Nikolai Kochetov
39cb5e0e3e fixed ColumnGathererStream finish reading condition 2017-07-17 22:43:09 +03:00
Nikolai Kochetov
eae94edd6b fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131] 2017-07-17 22:40:30 +03:00
Alexey Milovidov
bfc099ea5f Miscellaneous [#CLICKHOUSE-2]. 2017-07-17 01:41:15 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Alexey Zatelepin
b10e9d1f18 Vertical merge fix: don't forget to output last source_to_fully_copy [#CLICKHOUSE-3118] 2017-07-14 22:06:40 +03:00
Nikolai Kochetov
a13423e552 added vertical merge for ReplacingSortedBlockInputStream 2017-07-14 21:17:23 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
210f14aaba renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint 2017-07-13 21:54:17 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
0614ba5684 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
7068d1ff81 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
1bab7fc344 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Nikolai Kochetov
7c705b1a24 added RemoveColumnsBlockInputStream 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
489af678d5 added avg_value_size_hint for NativeBlockInputStream [#CLICKHOUSE-3066] 2017-07-12 21:41:08 +03:00
Alexey Milovidov
1908b2b5a5 Fixed error in prev. revision [#CLICKHOUSE-2]. 2017-07-12 19:51:39 +03:00
Alexey Milovidov
24331a18f5 Removing dependency on functions from client: bug fixes [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
976e47e1af Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
8c1a6f5736 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Nikolai Kochetov
ee66169d5e added throw_if_column_not_found to FilterColumnsBlockInputStream [#CLICKHOUSE-3111] 2017-07-11 20:58:49 +03:00
Alexey Milovidov
2bd84600d1 Miscellaneous [#CLICKHOUSE-2]. 2017-07-11 04:20:40 +03:00
Alexey Milovidov
a742ac3b6c Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:39 +03:00
Alexey Milovidov
78e905aa3a Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:25 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master
Implement natively uuid type in Clickhouse
2017-07-10 07:00:45 +03:00
Alexey Milovidov
db3d56b1f5 Removed obsolete test binary [#CLICKHOUSE-3]. 2017-07-10 06:43:25 +03:00
Alexey Zatelepin
89939a685a Stream row sources from disk for vertical merge [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Alexey Zatelepin
1cd936579d introduce IColumn::gather() [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Nikolai Kochetov
25ac546e78 disabled exception during overriding settings with same value in readonly mode [#CLICKHOUSE-3041] 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
63119eda7d updated FormatSettingsJSON 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
c99a9b1c55 moved FilterColumnsBlockInputStream implementation to .cpp [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
alexey-milovidov
85bdb472ea Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
alexey-milovidov
7bc0e40135 Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
Nikolai Kochetov
f1ec4cd863 added FilterColumnsBlockInputStream into StorageMerge [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Alexey Milovidov
c170b6f0d2 Removed useless code [#CLICKHOUSE-3111]. 2017-07-03 20:34:27 +03:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alex Zatelepin
8f250d4a18 Merge pull request #927 from yandex/fix-profile-info-race
Fix race condition while initializing BlockStreamProfileInfo
2017-06-26 16:38:26 +03:00
Alexey Zatelepin
1917de0380 fix race condition while initializing BlockStreamProfileInfo [#CLICKHOUSE-3099] 2017-06-26 15:30:35 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
3c33f1841f Little better [#CLICKHOUSE-2]. 2017-06-23 09:45:48 +03:00
Alexey Milovidov
7f48f1a7f5 Fixed error [#CLICKHOUSE-2]. 2017-06-23 09:11:00 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Alexey Milovidov
782fe332b1 Miscellaneous [#CLICKHOUSE-31]. 2017-06-13 07:13:54 +03:00
Alexey Zatelepin
877283b589 fix sorting when all columns are const [#CLICKHOUSE-3062] 2017-06-09 09:13:20 +03:00
Alexey Milovidov
dc0d5b604f Addition to prev. revision [#CLICKHOUSE-2]. 2017-06-06 22:06:44 +03:00
Alexey Milovidov
0d7d379b44 Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:36:13 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
8fb0afe74e Fixed build of tests [#CLICKHOUSE-2]. 2017-06-02 22:35:37 +03:00
Alexey Milovidov
5bd9342c0b Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-01 21:13:42 +03:00
Alexey Milovidov
862a304db2 Small refinements [#CLICKHOUSE-2]. 2017-06-01 16:41:58 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
f1yegor
0bf5182020 translate comments: etc 2017-05-28 16:32:59 +02:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Alexey Milovidov
0dd71e32e0 Preparations, part 8 [#CLICKHOUSE-31]. 2017-05-23 23:04:42 +03:00
Alexey Milovidov
e073b62301 Fixed build [#CLICKHOUSE-31]. 2017-05-23 21:58:38 +03:00
Alexey Milovidov
25209bf040 Allow semicolon after JSONEachRow lines, for convenience [#CLICKHOUSE-2] 2017-05-23 03:57:58 +03:00
Alexey Milovidov
7269f3a23b Format Vertical: added support for totals, extremes and output_format_pretty_max_rows [#CLICKHOUSE-3014]. 2017-05-22 22:00:45 +03:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]:
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
2017-05-20 17:25:48 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
proller
1474de179c CastTypeBlockInputStream: hotfix: sometimes columns in sample blocks and stream blocks does not match 2017-05-04 22:41:55 +03:00
proller
0787bd66ff Merge: fail if cant convert columns (#753)
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
2017-05-03 21:08:59 -07:00
alexey-milovidov
0e8c3b976f Update CastTypeBlockInputStream.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
c77152e3ba Loosen dependency [#CLICKHOUSE-2828]. 2017-04-27 23:47:24 +03:00
artpaul
d269827dfd #215 convert to Enum with FunctionCast 2017-04-27 23:29:39 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
artpaul
c19dada4a3 switch while to if 2017-04-25 20:17:13 +05:00
Alexey Milovidov
5f32cf5d90 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:10:29 +03:00
Alexey Milovidov
7f0aecfcf6 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:08:26 +03:00
Alexey Milovidov
74c04c467b Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:07:18 +03:00
artpaul
fd9d613dc9 #215 add tests 2017-04-25 07:57:49 +03:00
artpaul
323a9aff6d #215 cast strings or ints to enum on insert 2017-04-25 07:57:49 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
artpaul
d43c9bb1d0 odbc: send header info even on empty result 2017-04-19 18:42:58 +05:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
alexey-milovidov
f03f32e2ab Update DistinctSortedBlockInputStream.h 2017-04-14 23:00:44 +03:00
alexey-milovidov
e62769190e Update DistinctSortedBlockInputStream.cpp 2017-04-14 23:00:44 +03:00
Yuri Dyachenko
c6d6f2de3d add DataStreams::DistinctSortedBlockInputStream 2017-04-14 23:00:44 +03:00
Yuri Dyachenko
b9461b8a1b add IBlockInputStream::isGroupedOutput 2017-04-14 22:40:04 +03:00
proller
72ccc69212 Debian: simpler package (#662)
* Allow use external re2 with re2_st=re2

* fix

* remove dupe

* use re2_st in FunctionsStringSearch.h

* fix

* move files from tools/etc to debian

* dont generate control

* version

* ok.

* wip

* Cmake: dont touch CMAKE_INSTALL_PREFIX

* wip

* works!

* clean

* okay

* like old

* wip

* wip

* okay

* clickhouse-server-base-dbg

* clean

* clickhouse-server-dbg

* Debian: Remove daemons

* Update rules

* add source/format

* control clean

* add watch

* clean

* clean

* temp fix build

* clean

* docs

* fake make_control

* fix

* testme

* testme

* add metrika package

* fake metrika files
2017-04-10 20:43:30 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
alexey-milovidov
d0629a9df6 Update IBlockInputStream.h 2017-04-07 23:31:53 +03:00
Yuri Dyachenko
d54d44d97d provide SortedDescription to block pipe 2017-04-07 23:31:53 +03:00
Alexey Milovidov
bd544bbe3a Fixed error with NULLs [#CLICKHOUSE-4]. 2017-04-06 22:51:44 +03:00
Vitaliy Lyudvichenko
74a92cb8d9 Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886] 2017-04-04 15:54:21 +03:00
Alexey Milovidov
a272614c3d Fixed error with filtering by Nullable, continued [#CLICKHOUSE-2754]. 2017-04-04 12:22:06 +03:00
Alexey Milovidov
5919dcae70 Fixed error in filtering by Nullable column [#CLICKHOUSE-2754]. 2017-04-04 11:00:31 +03:00
f1yegor
b4c23f122a Translated comments 2017-04-02 20:37:49 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]."
This reverts commit 431a735efe.
2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
f2933e7623 Fixed double whitespace [#CLICKHOUSE-2]. 2017-03-28 06:54:25 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3].
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
2017-03-26 04:28:07 +03:00
Alexey Milovidov
93890423f1 Fixed zero-width spaces [#CLICKHOUSE-3].
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xe2\x80\x8b' | xargs sed -i 's/'$'\xe2\x80\x8b''//g'
2017-03-26 04:20:25 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Vitaliy Lyudvichenko
d7d22b80e5 Fix Vertical merge in case of OPTIMIZE FINAL with single part. [#CLICKHOUSE-2886] 2017-03-16 13:42:00 +03:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
proller
9a1169fef6 fix tests 2017-03-16 13:51:21 +04:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
Alexey Milovidov
7532a1d564 Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882]. 2017-03-12 15:56:59 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
b6e01cd47e Fix isolated usage of all .h files, move some code to .cpp (#578)
* split ColumnAggregateFunction.h

* format

* Allow use re2_st without cmake

* use std type in find_first_symbols.h

* fix ArrayEvaluator.h

* include fixes

* split ColumnConstAggregateFunction.h

* fix StorageMaterializedView.h

* split AddingDefaultBlockOutputStream.h

* move CSVRowInputStream::updateDiagnosticInfo to .cpp

* split ParserEnumElement.h

* format

* split DB/Parsers/ParserUseQuery.h

* clean
2017-03-11 04:27:59 +04:00
artpaul
0ef749839c issue #390: insert values by their positions instead of name 2017-03-07 15:30:05 +05:00
artpaul
1d8da3f8aa allow compiler to catch inconsistency 2017-03-06 18:39:29 +05:00
Vitaliy Lyudvichenko
8bcb1fe970 Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845] 2017-02-18 00:36:31 +04:00
Alexey Milovidov
82f3f5ad66 Fixed error with GraphiteMergeTree [#CLICKHOUSE-2804]. 2017-02-09 09:45:29 +03:00
Alexey Milovidov
f4cb4cafb1 Fixed error with usage of 'version' column in GraphiteMergeTree [#CLICKHOUSE-2804]. 2017-02-09 07:21:56 +03:00
Alexey Milovidov
f0ca756f52 GraphiteMergeTree: fixed handling of 'version' column [#CLICKHOUSE-2804]. 2017-02-08 00:20:28 +03:00
Alexey Milovidov
1302c3958a Comments [#CLICKHOUSE-3]. 2017-02-07 22:21:59 +03:00
Vitaliy Lyudvichenko
1b7b2b8373 Avoid extra current limits checks in non-root streams. [#CLICKHOUSE-2745] 2017-01-31 23:28:37 +04:00
Vitaliy Lyudvichenko
6500a84dd0 Fix overestimation of AggregateFunction columns size during remote aggregation. [#CLICKHOUSE-2745] 2017-01-31 23:28:37 +04:00
Alexey Milovidov
48db8d121d Moved code out of header [#CLICKHOUSE-2]. 2017-01-31 21:39:01 +03:00
alexey-milovidov
de9bc1dc75 Text formats allow to skip errors (#407)
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Added test [#CLICKHOUSE-2778].
2017-01-27 08:29:47 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following:
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
2017-01-14 12:00:19 +03:00
artpaul
3292ca81cb fix distinct on single string field [#CLICKHOUSE-28] 2017-01-12 20:34:41 +05:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Alexey Milovidov
604bd6c5a3 Less const_casts [#METR-2944]. 2017-01-03 04:42:17 +03:00
Alexey Milovidov
1f3aeb066a Renamed methods for bulk binary serialization (continued) [#METR-2944]. 2017-01-03 02:08:09 +03:00
Alexey Milovidov
701ca28c85 Renamed methods for bulk binary serialization [#METR-2944]. 2017-01-03 01:47:28 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
alexey-milovidov
0dd2191c87 Merge branch 'master' into issue-111 2016-12-31 05:53:52 +04:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930]
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00