Alexey Milovidov
e658741ccf
Removed useless methods [#CLICKHOUSE-2]
2018-02-15 19:29:34 +03:00
Alexey Milovidov
921e09b5f8
Merge branch 'master' into header-in-input-streams
2018-02-15 19:20:36 +03:00
proller
10803568ad
Macos shared build fix ( #1906 )
2018-02-15 00:01:40 +03:00
Nikolai Kochetov
4040e156b5
added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d
added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c
renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e997db55ef
fix for vertical merge in MultiversionMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a
added MultiversionMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
e02ca10b9a
merged with master
2018-02-08 20:46:22 +03:00
Nikolai Kochetov
583ff32fe8
changed IFunction
2018-02-08 20:18:15 +03:00
Tsarkova Anastasia
5ecd50ff44
Adding comments. Reversing infinities.
2018-02-08 17:28:31 +03:00
Alexey Milovidov
02ae36fe0c
Little better #1855
2018-02-06 21:43:28 +03:00
zhang2014
5e001ba8e0
ISSUES-67 Use initial column values with default expression
2018-02-03 15:42:40 +08:00
Vitaliy Lyudvichenko
e2fb6d8c80
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-25 22:00:08 +03:00
alexey-milovidov
24ac18201c
Update getFQDNOrHostName.cpp
...
Update isLocalAddress.cpp
Update IBlockOutputStream.h
Update users.xml
2018-01-24 17:14:21 +03:00
Alexey Milovidov
e8a0dde15b
Added more checks [#CLICKHOUSE-2].
2018-01-23 21:49:15 +03:00
Vitaliy Lyudvichenko
1000328571
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-22 20:31:08 +03:00
Alexey Milovidov
9a02d4f5ff
Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams
2018-01-20 04:20:40 +03:00
Amos Bird
f87d80c378
Add #pragma once for SquashingTransform.h
2018-01-19 21:40:23 +03:00
Vitaliy Lyudvichenko
bee7127572
Refactoring of Graphite merger. [#CLICKHOUSE-2860]
2018-01-19 21:40:05 +03:00
Vitaliy Lyudvichenko
0b8d2a2024
Fixed nondeterministic merge in GraphiteMergeTree. [#CLICKHOUSE-2860]
2018-01-18 23:30:03 +03:00
Vitaliy Lyudvichenko
69a3c81866
Fix incorrect delayed max_result_bytes check. [#CLICKHOUSE-2]
...
Resolves #1724
2018-01-17 21:15:25 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Alexey Milovidov
ce5de79263
Fixed tests #1665
2018-01-14 03:12:23 +03:00
Alexey Milovidov
9283c38854
Fixed error [#CLICKHOUSE-2].
2018-01-13 04:33:55 +03:00
Vitaliy Lyudvichenko
388d47bbbc
Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346
2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f
Minimal working example. [#CLICKHOUSE-3346]
2018-01-11 21:55:45 +03:00
Vitaliy Lyudvichenko
ac17c59108
Updated describe query, cluster copier draft. [#CLICKHOUSE-3346]
2018-01-11 21:55:08 +03:00
proller
b026eb7797
Use submodule contrib/capnproto, remove include_directories ( #1746 )
...
* Add submodule contrib/capnproto
* Use contrib/capnproto, remove include_directories
* Fix include
* Clean
* Fix werror
* Update doc
* Fix
* Final fix
* Fxi
2018-01-11 21:39:52 +03:00
Alexey Milovidov
0bfea2f52c
Miscellaneous [#CLICKHOUSe-2]
2018-01-10 03:04:08 +03:00
Alexey Milovidov
5081f276d1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 04:51:08 +03:00
Alexey Milovidov
fe880d73e7
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 03:19:58 +03:00
Alexey Milovidov
1780e6c1d9
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-08 04:14:43 +03:00
Alexey Milovidov
12c521fa25
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-07 03:35:44 +03:00
Alexey Milovidov
9996e181e1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-06 21:10:44 +03:00
Alexey Milovidov
7a2fcd3055
Fixed build on AArch64 [#CLICKHOUSE-1700]
2017-12-28 19:51:53 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89
Merge branch 'aavdonkin-master'
2017-12-28 07:33:55 +03:00
Alexey Milovidov
104b09604a
Merging [#CLICKHOUSE-3114]
2017-12-28 00:45:05 +03:00
Alexey Milovidov
09262ae0d7
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-27 01:56:30 +03:00
proller
da1233fe3f
Fix missing includes
2017-12-26 22:02:00 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0
Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2].
2017-12-25 21:58:39 +03:00
Alexey Milovidov
8ff93487e3
Miscellaneous [#CLICKHOUSE-2].
2017-12-25 07:01:46 +03:00
Alexey Milovidov
671b731c90
Removed useless calls [#CLICKHOUSE-2].
2017-12-25 03:37:13 +03:00
Alexey Milovidov
9aa0ebff01
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-24 10:59:39 +03:00
Alexey Milovidov
7ee1c81d45
Fixed DISTINCT if all columns are constant [#CLICKHOUSE-3505].
2017-12-24 10:59:26 +03:00
Marek Vavruša
ad59a1460e
IProfilingBlockInputStream: check limits before reading block
...
This makes one pointless check before the first block is read, but
is necessary to prevent reading blocks from storages like Kafka where
messages are read only once.
2017-12-24 09:57:20 +03:00
Alexey Milovidov
d6dc25b09e
Fixed wording #1650
2017-12-23 03:21:49 +03:00
Alexey Milovidov
5e39b55f60
Added PR changes #1676
2017-12-22 22:20:18 +03:00
Alexey Milovidov
bf9c301784
Simplification of aggregate functions: compatibility details [#CLICKHOUSE-2].
2017-12-21 05:08:25 +03:00
Alexey Milovidov
c990740b33
Simplification of aggregate functions: development [#CLICKHOUSE-2].
2017-12-21 05:08:25 +03:00
Marek Vavruša
fd260c31ba
CapnpProtoRowInputStream: fixed build in current master, added docs
2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9
StorageKafka: extended configuration, parallel consumers, offset tracking
...
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.
The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Marek Vavruša
fb1aa84973
Fixed clang build on macOS
...
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
2017-12-21 00:46:50 +03:00
Alexey Milovidov
c5d5296889
Miscellaneous [#CLICKHOUSE-2].
2017-12-18 07:07:26 +03:00
Alexey Milovidov
280b88454b
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 05:43:40 +03:00
Alexey Milovidov
7c802ee3de
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10
Make DataTypes totally immutable [#CLICKHOUSE-2].
2017-12-18 04:11:48 +03:00
Alexey Milovidov
c0670435ab
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 11:44:06 +03:00
Alexey Milovidov
d497d010d7
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 08:21:04 +03:00
Alexey Milovidov
5f4a536f75
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 09:33:54 +03:00
Alexey Milovidov
6fe31d257d
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 09:10:05 +03:00
Alexey Milovidov
342f0e431a
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 09:08:33 +03:00
Alexey Milovidov
645f620873
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 00:32:25 +03:00
Alexey Milovidov
401fd2d6d8
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 05:36:40 +03:00
Alexey Milovidov
a92055c768
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 05:04:28 +03:00
Alexey Milovidov
6756b37925
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 04:34:30 +03:00
Alexey Milovidov
4148c6ce81
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 03:06:56 +03:00
Alexey Milovidov
8926af2ced
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 03:01:59 +03:00
Alexey Milovidov
c2985857f8
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 00:51:30 +03:00
Alexey Milovidov
01a0b91c83
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 00:20:14 +03:00
Alexey Milovidov
d164024e3d
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 23:58:18 +03:00
Alexey Milovidov
744c2d3d02
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 07:30:01 +03:00
Alexey Milovidov
911d80ab51
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6
Merge remote-tracking branch 'origin/master' into cow_columns
2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert
...
Support table functions for desc and insert
2017-12-11 23:28:10 +03:00
Alexey Milovidov
c3015bece3
Miscellaneous [#CLICKHOUSE-2].
2017-12-11 01:44:04 +03:00
Alexey Milovidov
6a568ab692
Technically allowed empty arrays of unspecified type [#CLICKHOUSE-2].
2017-12-09 23:56:53 +03:00
Alexey Milovidov
b34cdeec79
Fixed error [#CLICKHOUSE-2]
2017-12-09 19:17:37 +03:00
Alexey Milovidov
b00bb5c348
Added support for nullable types in HAVING section in presence of WITH TOTALS [#CLICKHOUSE-3431].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
ae3d44f30f
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
384d03d4ce
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-08 10:41:08 +03:00
Alexey Milovidov
741a6e0066
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-08 03:50:25 +03:00
Alexey Milovidov
be72c247fe
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 15:09:55 +03:00
Alexey Milovidov
f5a06cee5b
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 11:47:13 +03:00
Alexey Milovidov
0ea105f639
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 11:31:47 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert
2017-12-04 23:34:27 +03:00
Alexey Milovidov
344f861adb
Clarifications [#CLICKHOUSE-2].
2017-12-04 23:29:13 +03:00
alexey-milovidov
1aaeaf653d
Merge pull request #1551 from amosbird/patch-5
...
Propagate readPrefix in ParallelInputsProcessor (take 2)
2017-12-04 23:16:11 +03:00
alexey-milovidov
521e6181c1
Update ParallelInputsProcessor.h
2017-12-04 23:15:40 +03:00
Alexey Milovidov
d36d7170ed
Better [#CLICKHOUSE-2].
2017-12-02 06:42:21 +03:00
Alexey Milovidov
c748493a86
Better [#CLICKHOUSE-2].
2017-12-02 05:47:12 +03:00
Alexey Milovidov
7196602e12
Better [#CLICKHOUSE-2].
2017-12-02 00:51:50 +03:00
Alexey Milovidov
739b7e0e37
Removed BlockTabSeparated format as it was totally useless [#CLICKHOUSE-2].
2017-12-02 00:44:12 +03:00
Alexey Milovidov
54e601019c
Better [#CLICKHOUSE-2].
2017-12-02 00:40:58 +03:00
Alexey Milovidov
acd78e4891
Better [#CLICKHOUSE-2].
2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99
Better [#CLICKHOUSE-2].
2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd
Better [#CLICKHOUSE-2].
2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b
Better [#CLICKHOUSE-2].
2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d
Better [#CLICKHOUSE-2].
2017-12-01 20:49:12 +03:00
Nikolai Kochetov
470c633e09
merged with master
2017-12-01 16:33:47 +03:00
Nikolai Kochetov
f025f22007
Merge branch 'master' into support-table-functions-for-desc-and-insert
2017-12-01 16:24:50 +03:00
Amos Bird
b516e5e087
Propagate readPrefix in ParallelInputsProcessor (take 2)
...
Both UnionBlockInputStream and ParallelAggregatingBlockInputStream rely on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
Fix thread unsafty issue in https://github.com/yandex/ClickHouse/pull/1516
Here is a list of inputstreams with meaningful work in readPrefix
```
IProfilingBlockInputStream
AsynchronousBlockInputStream
BlockInputStreamFromRowInputStream
CatBoostDatasetBlockInputStream
CreatingSetsBlockInputStream
CSVRowInputStream
DictionaryBlockInputStreamBase
InputStreamFromASTInsertQuery
KafkaBlockInputStream
MergingAggregatedMemoryEfficientBlockInputStream
RemoteBlockInputStream
StorageFileBlockInputStream
```
2017-11-28 16:52:00 +08:00
Alexey Milovidov
c05cf01a9b
SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2].
2017-11-28 05:14:50 +03:00
Alexey Milovidov
06a65168ac
SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2].
2017-11-28 05:14:06 +03:00
Alexey Milovidov
95d33b3e65
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-27 22:33:38 +03:00
proller
0d3c4f4d67
Core/FieldVisitors.h -> Common/FieldVisitors.h
...
Core/Progress.h -> IO/Progress.h
tests: sudo --non-interactive
Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
c13872450f
Whitespace [#CLICKHOUSE-2].
2017-11-22 05:42:53 +03:00
Alexey Milovidov
d50511b8e1
Whitespace [#CLICKHOUSE-2].
2017-11-22 05:42:02 +03:00
Alexey Milovidov
2d98a33dd0
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-22 05:40:07 +03:00
alexey-milovidov
35ce63a762
Revert "Propagate readPrefix in ParallelInputsProcessor"
2017-11-22 05:17:42 +03:00
Alexey Milovidov
3b5f82000c
Fixed linking [#CLICKHOUSE-2].
2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b
Fixed linking [#CLICKHOUSE-2].
2017-11-20 08:22:07 +03:00
Alexey Milovidov
7cce063d00
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 07:50:52 +03:00
Alexey Milovidov
feea8996d5
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:46:00 +03:00
Alexey Milovidov
02a991a49c
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:45:33 +03:00
Alexey Milovidov
fbab976e09
Merge branch 'master' of github.com:yandex/ClickHouse
2017-11-20 07:44:53 +03:00
alexey-milovidov
c88855873d
Merge pull request #1516 from amosbird/patch-1
...
Propagate readPrefix in ParallelInputsProcessor
2017-11-20 07:45:40 +03:00
Alexey Milovidov
87ff2f35ec
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff
Removed "experimental" namespace [#CLICKHOUSE-2].
2017-11-20 07:15:43 +03:00
Amos Bird
22e9772593
Propagate readPrefix in ParallelInputsProcessor
...
UnionBlockInputStream relies on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
2017-11-20 10:53:48 +08:00
Alexey Milovidov
2ca6952deb
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 02:16:18 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4
2017-11-19 23:57:44 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate
...
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
2017-11-19 23:01:23 +03:00
Alexey Milovidov
7c9ba15ba1
Style [#CLICKHOUSE-2].
2017-11-17 23:42:03 +03:00
proller
79b3ef2f57
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-17 15:31:13 +03:00
alexey-milovidov
e6f1262409
Update SummingSortedBlockInputStream.h
2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add
Update SummingSortedBlockInputStream.h
2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709
Fixed SummingMergeTree. [#CLICKHOUSE-2]
2017-11-16 23:48:39 +03:00
Marek Vavruša
64a892c0e6
DataStreams: CapnProto uses <format_schema_path> config option
...
This addresses one of the remarks in the PR.
All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
proller
468e2ab044
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-14 14:50:19 +03:00
Alexey Milovidov
60477a9aaa
Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402].
2017-11-09 22:25:21 +03:00
Alexey Zatelepin
d6b82a28fd
clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412]
2017-11-05 20:50:12 +03:00
Nikolai Kochetov
1cee62eb0a
supported table_function in insert query [#CLICKHOUSE-3397]
2017-11-03 16:25:39 +03:00
proller
6e3ca916d9
Fix atomic usage
2017-11-01 16:35:34 +03:00
proller
9bc029ba17
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-01 14:43:48 +03:00
Alexey Milovidov
175af4b2e9
Removed copy-paste [#CLICKHOUSE-2].
2017-11-01 06:09:06 +03:00
proller
47eae26d75
Fix build
2017-10-31 22:19:36 +03:00
proller
5d137e22eb
More atomics
2017-10-30 17:38:16 +03:00
Marek Vavruša
c44e3e76c8
Renamed CapnProtoInputStream to CapnProtoRowInputStream.
2017-10-27 23:03:51 +03:00
Marek Vavruša
0d942a69c5
DataStreams: added Cap’n Proto format support
...
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
2017-10-27 23:03:51 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0
Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381]
2017-10-26 17:58:00 +03:00
Marek Vavruša
c0458999f9
SummingSortedBlockInputStream: fix summing of multiple blocks
...
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066
AggregateFunctionSum: implemented sumWithOverflow(x)
...
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.
This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf
SummingSortedBlockInputStream: fix explicitly configured columns to sum
...
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.
This also fixes summation of invalid maps with
with only one key column and no value columns.
Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
2017-10-25 22:21:59 +03:00
proller
4ffbca2d8c
Fix warnings ( #1406 )
...
* Log query id in executeQuery; Better type mismatch error; change format in report tool
* Better log query_id
* fix message
* Use c++11 thread_local instaed of gcc's __thread
* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
* Cmake: fix build without downloaded submodules (#1379 )
* fix
* ZooKeeper: fixed stack smashing with tryGet()
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.
This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
* increased timeout for test_insertion_sync_fails_with_timeout
* Update CHANGELOG_RU.md
* Update ZooKeeper.cpp
* Fix warnings
* Fixes
* Dont strip debug info from asan, tsan and other builds except releases
* Fix asan error causd by test 00144
* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378
Revert "Make gperftools (libtcmalloc) as submodule and update. ( #1381 )"
...
This reverts commit fa2484ea90
2017-10-24 22:18:15 +03:00
proller
fa2484ea90
Make gperftools (libtcmalloc) as submodule and update. ( #1381 )
...
* Update tcmalloc and make submodule
* wip
* wip
* wip
* wip
* clean
* fix
* fix
* fix
* Fix tests
2017-10-24 22:11:42 +03:00
alexey-milovidov
5bfb4c213c
Update JSONEachRowRowInputStream.cpp
2017-10-23 20:47:33 +03:00
Marek Vavruša
6be0ffd943
DataStreams/JSONEachRow: read exact number of rows
...
When using a LIMIT to reduce the number of rows
read, JSONEachRow format would always read an
extra row as it triggered a scan to seek the
EOF or beginning of the next row. This is not
an issue with physical tables, but it is
for streaming tables as an extra row is
unintentionally consumed on each read.
2017-10-23 20:47:33 +03:00
Marek Vavruša
927c0f7b74
dbms: Partially revert previous change
...
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24
dbms: Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be
dbms: Fix build with clang after Poco update
...
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc
dbms: fix build with OS X built-in clang
...
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:
```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
res.insert({elem.column, elem.type, rename[i].value()});
~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
value_type& value()
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
alexey-milovidov
9ccdb5420b
Merge branch 'master' into upstream-add-kafka
2017-10-13 23:52:42 +03:00
Marek Vavruša
41b0bea84c
SummingSortedBlockInputStream: use a separate structure for MapDescription
2017-10-13 21:51:03 +03:00
Marek Vavruša
39a5ae97c9
SummingSortedBlockInputStream: added comments, destructor for state
2017-10-13 21:51:03 +03:00
alexey-milovidov
d561d8d701
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
alexey-milovidov
a2fa58a2e4
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
alexey-milovidov
fee883d7c5
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
Marek Vavruša
2edf5492d0
AggregateFunctionSumMap: support variardic arguments, specialized keys
...
The function is rewritten to avoid allocations on every insert with
Field deserialising each array. The key type is now specialized,
so it can be accessed directly. The value type is variant type,
but only individual values are deserialised (which is cheap, since they're PODs).
The function also support summing of multiple columns by the same key.
The SummingSortedBlockInputStream uses the function in case of
Nested structure with one numeric key and many values to sum.
2017-10-13 21:51:03 +03:00
Marek Vavruša
be2faa82ff
DataStreams/test: test case for nested field with two arrays for summing
2017-10-13 21:51:03 +03:00
Marek Vavruša
c09a43a7b2
DataStreams/SummingSortedBlockInputStream: use builtin aggregated functions
...
This replaces custom summation function implementations with an implementation
using built-in aggregation functions (sum and sumMap). The goal is to be able to
use specialized variants of aggregation functions, and to have a single
efficient implementation.
2017-10-13 21:51:03 +03:00
Marek Vavruša
c9be3719bc
DataStreams/tests: add SummingSortedBlockInputStream test variant
...
This is basically useful for testing SummingSortedBlockInputStream
against the AggregatingBlockInputStream, which are used in the
{Summing,Aggregating}MergeTree table engines respectively.
2017-10-13 21:51:03 +03:00
Alexey Milovidov
e57e79a5ff
Proper fix for the issue: better exception message [#CLICKHOUSE-2].
2017-10-12 22:56:47 +03:00
proller
cbc81a6a9f
Received signal Segmentation fault ( #1300 ) ( #1302 )
...
* Received signal Segmentation fault (#1300 )
* Add test
2017-10-12 22:46:40 +03:00
proller
1505ad6bac
Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171)
2017-10-12 22:36:27 +03:00
Marek Vavruša
4fb570fa5e
IStorage: allow notification on dependency change
...
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.
This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
proller
7feb94357b
use enum class
2017-10-03 22:12:44 +03:00
proller
5250650f65
Fixes ( #1286 )
...
* Revert "Simplification [#CLICKHOUSE-2]."
This reverts commit 98ad6a5db3
2017-09-26 23:29:34 +03:00
Alex Bocharov
55e1559733
Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum.
2017-09-18 18:46:10 +01:00
Alex Bocharov
1f70d0e163
Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum.
2017-09-18 18:43:47 +01:00
Alex Bocharov
6e74602e45
Aggregate function sumMap: use FieldVisitorSum instead of += operator.
2017-09-18 16:41:07 +01:00
Alexey Milovidov
21fe32b929
Fixed build in clang with raised up inline-depth [#CLICKHOUSE-2].
2017-09-15 15:17:01 +03:00
Alexey Milovidov
86c46ad1bd
Unification [#CLICKHOUSE-2].
2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5
Fixed merges progress bar. [#CLICKHOUSE-2]
2017-09-15 01:04:13 +03:00
proller
a43b9ec398
Revert "Simplification [#CLICKHOUSE-2]."
...
This reverts commit 98ad6a5db3
2017-09-14 23:16:31 +03:00
Alexey Milovidov
2c424c7989
Added description of possible race condition [#CLICKHOUSE-2].
2017-09-10 06:17:05 +03:00
Alexey Milovidov
98ad6a5db3
Simplification [#CLICKHOUSE-2].
2017-09-10 05:30:45 +03:00
Alexey Milovidov
dc5eca0beb
Fixed awful translation [#CLICKHOUSE-2].
2017-09-10 05:06:16 +03:00
Alexey Milovidov
cf5fd27b94
Clarifications [#CLICKHOUSE-2].
2017-09-10 04:39:40 +03:00
Alexey Milovidov
cd540c2674
Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2].
2017-09-10 02:17:38 +03:00
Alexey Milovidov
94b975e7f9
Removed function deprecated in C++ [#CLICKHOUSE-3174].
2017-09-09 02:31:18 +03:00
Alexey Milovidov
dc4976f562
Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301].
2017-09-08 07:58:57 +03:00
Alexey Milovidov
8c9ec83a33
Implemented some suggestions from clang-tidy (part 4) [#CLICKHOUSE-3301].
2017-09-08 07:10:43 +03:00
Alexey Milovidov
d29c77adea
Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301].
2017-09-08 06:47:27 +03:00
Alexey Milovidov
e9ae193870
Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301].
2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e
Fixed warnings found by cppcheck [#CLICKHOUSE-3300].
2017-09-08 00:04:48 +03:00
Vitaliy Lyudvichenko
325ceb85b5
Delete unusing files. [#CLICKHOUSE-2]
2017-09-06 04:18:07 +03:00
Vitaliy Lyudvichenko
d55d5eca46
Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117]
2017-09-06 04:18:07 +03:00
proller
2a7813049e
LibDictionarySource : First lib dictionary version with only uint64 type support ( #1150 )
...
* Wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* Config: Allow multiple dictionaries_config
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* wip
* clean
* clean
* wip
* clean
* clean
* wip
* wip
* clean
* clean
* clean
* clean
* clean
* Requested changes
* Reqested changes
* Requested changes
* Requested changes
* Requested changes
* Requested changes
* requested changes
* Requested changes
* Requested changes
* requested changes
* Requested changes
* fix
* Requested changes
* Requested changes
* fix
* Requested changes
* Requested changes
2017-09-05 04:08:26 +03:00
Alexey Milovidov
4d97959e57
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-09-04 04:11:00 +03:00
Alexey Milovidov
f51cc679a0
Fixed inserting wrong default value for Enums [#CLICKHOUSE-3270].
2017-09-02 00:37:57 +03:00
Alexey Milovidov
40884640a1
Merge branch 'master' of github.com:yandex/ClickHouse
2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
Vitaliy Lyudvichenko
566160c048
Use FIFO lock in IStorage. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
Alexey Zatelepin
ce3e4676fa
remove unnecessary calls to find() [#CLICKHOUSE-2171]
2017-08-19 21:35:01 +03:00
Alexey Milovidov
e01c23267a
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-08-18 22:41:27 +03:00
Alexey Milovidov
12a034478c
Fixed bad translation [#CLICKHOUSE-2].
2017-08-18 22:30:39 +03:00
Alexey Milovidov
16d6c4f9e7
Removed very old protocol compatibility features [#CLICKHOUSE-2].
2017-08-16 23:27:35 +03:00
Alexey Zatelepin
67dffb9be6
simplify MultiplexedConnections further (so that it works with only one shard) [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
b469ef1792
don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
36dc7857a1
make LazyBlockInputStream thread-safe [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
3f3b7f61e2
always send changed settings for remote connections [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a
remove shard multiplexing code, simplify [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Milovidov
1e1dc8828a
Miscellaneous [#CLICKHOUSE-2].
2017-08-13 00:02:45 +03:00
Alexey Milovidov
45ea2fba47
Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].
2017-08-07 10:44:27 +03:00
Alexey Milovidov
fb2aff4704
Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].
2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb
Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]
2017-08-04 17:35:36 +03:00
Alexey Milovidov
fd9b8c6fbe
Fixed error [#METR-25976].
2017-08-01 20:02:41 +03:00
Alexey Milovidov
a6cb383c4f
Fixed build with gcc-7.1 [#CLICKHOUSE-2].
2017-08-01 04:25:03 +03:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
Alexey Milovidov
e4af70149f
Fixed build [#CLICKHOUSE-2].
2017-07-28 00:27:10 +03:00
Alexey Milovidov
d57f5b81a4
Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175].
2017-07-26 00:07:05 +03:00
Alexey Zatelepin
18672204e5
fix handling of overflow data during external aggregation [#CLICKHOUSE-3133]
2017-07-25 19:56:48 +03:00
Alexey Milovidov
efaa44bea8
Attempt to improve performance [#CLICKHOUSE-3].
2017-07-23 09:53:28 +03:00
alexey-milovidov
d4d266fa18
ColumnConst unification ( #1011 )
...
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
Nikolai Kochetov
7e293df9af
merged with master
2017-07-17 22:48:22 +03:00
Nikolai Kochetov
39cb5e0e3e
fixed ColumnGathererStream finish reading condition
2017-07-17 22:43:09 +03:00
Nikolai Kochetov
eae94edd6b
fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131]
2017-07-17 22:40:30 +03:00
Alexey Milovidov
bfc099ea5f
Miscellaneous [#CLICKHOUSE-2].
2017-07-17 01:41:15 +03:00
Alexey Milovidov
5c3ca0c16e
Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149].
2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa
Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148].
2017-07-15 06:48:36 +03:00
Alexey Zatelepin
b10e9d1f18
Vertical merge fix: don't forget to output last source_to_fully_copy [#CLICKHOUSE-3118]
2017-07-14 22:06:40 +03:00
Nikolai Kochetov
a13423e552
added vertical merge for ReplacingSortedBlockInputStream
2017-07-14 21:17:23 +03:00
Nikolai Kochetov
283810e8ab
merged with master
2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8
removed typeid_cast from IColumn.h
2017-07-13 23:58:19 +03:00
Nikolai Kochetov
210f14aaba
renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint
2017-07-13 21:54:17 +03:00
Nikolai Kochetov
985e449bd3
added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h
2017-07-13 19:49:09 +03:00
Alexey Milovidov
0614ba5684
Using lexer: better error messages [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
7068d1ff81
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
1bab7fc344
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Nikolai Kochetov
7c705b1a24
added RemoveColumnsBlockInputStream
2017-07-12 21:51:51 +03:00
Nikolai Kochetov
489af678d5
added avg_value_size_hint for NativeBlockInputStream [#CLICKHOUSE-3066]
2017-07-12 21:41:08 +03:00
Alexey Milovidov
1908b2b5a5
Fixed error in prev. revision [#CLICKHOUSE-2].
2017-07-12 19:51:39 +03:00
