thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
21,706 Commits 9,138 Branches 1,778 Tags 2 GiB
f731702de0
Commit Graph

1282 Commits

Author SHA1 Message Date
Alexey Milovidov
9aa0ebff01 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-24 10:59:39 +03:00
Alexey Milovidov
7ee1c81d45 Fixed DISTINCT if all columns are constant [#CLICKHOUSE-3505]. 2017-12-24 10:59:26 +03:00
Marek Vavruša
ad59a1460e IProfilingBlockInputStream: check limits before reading block 
This makes one pointless check before the first block is read, but
is necessary to prevent reading blocks from storages like Kafka where
messages are read only once.
 2017-12-24 09:57:20 +03:00
Alexey Milovidov
d6dc25b09e Fixed wording #1650 2017-12-23 03:21:49 +03:00
Alexey Milovidov
5e39b55f60 Added PR changes #1676 2017-12-22 22:20:18 +03:00
Alexey Milovidov
bf9c301784 Simplification of aggregate functions: compatibility details [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Alexey Milovidov
c990740b33 Simplification of aggregate functions: development [#CLICKHOUSE-2]. 2017-12-21 05:08:25 +03:00
Marek Vavruša
fd260c31ba CapnpProtoRowInputStream: fixed build in current master, added docs 2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9 StorageKafka: extended configuration, parallel consumers, offset tracking 
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.

The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
 2017-12-21 00:46:50 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS 
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
 2017-12-21 00:46:50 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
280b88454b Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:43:40 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10 Make DataTypes totally immutable [#CLICKHOUSE-2]. 2017-12-18 04:11:48 +03:00
Alexey Milovidov
c0670435ab Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 11:44:06 +03:00
Alexey Milovidov
d497d010d7 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-17 08:21:04 +03:00
Alexey Milovidov
5f4a536f75 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:33:54 +03:00
Alexey Milovidov
6fe31d257d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:10:05 +03:00
Alexey Milovidov
342f0e431a Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 09:08:33 +03:00
Alexey Milovidov
645f620873 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
401fd2d6d8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:36:40 +03:00
Alexey Milovidov
a92055c768 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 05:04:28 +03:00
Alexey Milovidov
6756b37925 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 04:34:30 +03:00
Alexey Milovidov
4148c6ce81 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:06:56 +03:00
Alexey Milovidov
8926af2ced Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 03:01:59 +03:00
Alexey Milovidov
c2985857f8 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:51:30 +03:00
Alexey Milovidov
01a0b91c83 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:20:14 +03:00
Alexey Milovidov
d164024e3d Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 23:58:18 +03:00
Alexey Milovidov
744c2d3d02 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:30:01 +03:00
Alexey Milovidov
911d80ab51 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert 
Support table functions for desc and insert
 2017-12-11 23:28:10 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
6a568ab692 Technically allowed empty arrays of unspecified type [#CLICKHOUSE-2]. 2017-12-09 23:56:53 +03:00
Alexey Milovidov
b34cdeec79 Fixed error [#CLICKHOUSE-2] 2017-12-09 19:17:37 +03:00
Alexey Milovidov
b00bb5c348 Added support for nullable types in HAVING section in presence of WITH TOTALS [#CLICKHOUSE-3431]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
ae3d44f30f Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
384d03d4ce Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 10:41:08 +03:00
Alexey Milovidov
741a6e0066 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 03:50:25 +03:00
Alexey Milovidov
be72c247fe Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 15:09:55 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
0ea105f639 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:31:47 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-04 23:34:27 +03:00
Alexey Milovidov
344f861adb Clarifications [#CLICKHOUSE-2]. 2017-12-04 23:29:13 +03:00
alexey-milovidov
1aaeaf653d
Merge pull request #1551 from amosbird/patch-5 
Propagate readPrefix in ParallelInputsProcessor (take 2)
 2017-12-04 23:16:11 +03:00
alexey-milovidov
521e6181c1
Update ParallelInputsProcessor.h 2017-12-04 23:15:40 +03:00
Alexey Milovidov
d36d7170ed Better [#CLICKHOUSE-2]. 2017-12-02 06:42:21 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
7196602e12 Better [#CLICKHOUSE-2]. 2017-12-02 00:51:50 +03:00
Alexey Milovidov
739b7e0e37 Removed BlockTabSeparated format as it was totally useless [#CLICKHOUSE-2]. 2017-12-02 00:44:12 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
Nikolai Kochetov
470c633e09 merged with master 2017-12-01 16:33:47 +03:00
Nikolai Kochetov
f025f22007 Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-01 16:24:50 +03:00
Amos Bird
b516e5e087
Propagate readPrefix in ParallelInputsProcessor (take 2) 
Both UnionBlockInputStream and ParallelAggregatingBlockInputStream rely on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.

Fix thread unsafty issue in https://github.com/yandex/ClickHouse/pull/1516

Here is a list of inputstreams with meaningful work in readPrefix

```
IProfilingBlockInputStream

AsynchronousBlockInputStream
BlockInputStreamFromRowInputStream
CatBoostDatasetBlockInputStream
CreatingSetsBlockInputStream
CSVRowInputStream
DictionaryBlockInputStreamBase
InputStreamFromASTInsertQuery
KafkaBlockInputStream
MergingAggregatedMemoryEfficientBlockInputStream
RemoteBlockInputStream
StorageFileBlockInputStream
```
 2017-11-28 16:52:00 +08:00
Alexey Milovidov
c05cf01a9b SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:50 +03:00
Alexey Milovidov
06a65168ac SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h 
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
 2017-11-24 16:55:31 +03:00
Alexey Milovidov
c13872450f Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:53 +03:00
Alexey Milovidov
d50511b8e1 Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:02 +03:00
Alexey Milovidov
2d98a33dd0 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 05:40:07 +03:00
alexey-milovidov
35ce63a762 Revert "Propagate readPrefix in ParallelInputsProcessor" 2017-11-22 05:17:42 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
f6f77f5f0b Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:07 +03:00
Alexey Milovidov
7cce063d00 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:50:52 +03:00
Alexey Milovidov
feea8996d5 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:46:00 +03:00
Alexey Milovidov
02a991a49c Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:45:33 +03:00
Alexey Milovidov
fbab976e09 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-20 07:44:53 +03:00
alexey-milovidov
c88855873d
Merge pull request #1516 from amosbird/patch-1 
Propagate readPrefix in ParallelInputsProcessor
 2017-11-20 07:45:40 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Amos Bird
22e9772593
Propagate readPrefix in ParallelInputsProcessor 
UnionBlockInputStream relies on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
 2017-11-20 10:53:48 +08:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate 
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
 2017-11-19 23:01:23 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option 
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
 2017-11-15 23:17:22 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
60477a9aaa Enhanced time zones support: the DateTime data type can track time zone [#CLICKHOUSE-3402]. 2017-11-09 22:25:21 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Nikolai Kochetov
1cee62eb0a supported table_function in insert query [#CLICKHOUSE-3397] 2017-11-03 16:25:39 +03:00
proller
6e3ca916d9 Fix atomic usage 2017-11-01 16:35:34 +03:00
proller
9bc029ba17 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-01 14:43:48 +03:00
Alexey Milovidov
175af4b2e9 Removed copy-paste [#CLICKHOUSE-2]. 2017-11-01 06:09:06 +03:00
proller
47eae26d75 Fix build 2017-10-31 22:19:36 +03:00
proller
5d137e22eb More atomics 2017-10-30 17:38:16 +03:00
Marek Vavruša
c44e3e76c8 Renamed CapnProtoInputStream to CapnProtoRowInputStream. 2017-10-27 23:03:51 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support 
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
 2017-10-27 23:03:51 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Marek Vavruša
c0458999f9 SummingSortedBlockInputStream: fix summing of multiple blocks 
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
 2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066 AggregateFunctionSum: implemented sumWithOverflow(x) 
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.

This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
 2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf SummingSortedBlockInputStream: fix explicitly configured columns to sum 
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.

This also fixes summation of invalid maps with
with only one key column and no value columns.

Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
 2017-10-25 22:21:59 +03:00
proller
4ffbca2d8c Fix warnings (#1406) 
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
 2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)" 
This reverts commit fa2484ea90.
 2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381) 
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
 2017-10-24 22:11:42 +03:00
alexey-milovidov
5bfb4c213c Update JSONEachRowRowInputStream.cpp 2017-10-23 20:47:33 +03:00
Marek Vavruša
6be0ffd943 DataStreams/JSONEachRow: read exact number of rows 
When using a LIMIT to reduce the number of rows
read, JSONEachRow format would always read an
extra row as it triggered a scan to seek the
EOF or beginning of the next row. This is not
an issue with physical tables, but it is
for streaming tables as an extra row is
unintentionally consumed on each read.
 2017-10-23 20:47:33 +03:00
Marek Vavruša
927c0f7b74 dbms: Partially revert previous change 
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
 2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24 dbms: Better fix for missing unsigned long to Poco::UInt64 alias 2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update 
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
 2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang 
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
 2017-10-13 18:12:29 -07:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
Marek Vavruša
41b0bea84c SummingSortedBlockInputStream: use a separate structure for MapDescription 2017-10-13 21:51:03 +03:00
Marek Vavruša
39a5ae97c9 SummingSortedBlockInputStream: added comments, destructor for state 2017-10-13 21:51:03 +03:00
alexey-milovidov
d561d8d701 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
a2fa58a2e4 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
alexey-milovidov
fee883d7c5 Update SummingSortedBlockInputStream.cpp 2017-10-13 21:51:03 +03:00
Marek Vavruša
2edf5492d0 AggregateFunctionSumMap: support variardic arguments, specialized keys 
The function is rewritten to avoid allocations on every insert with
Field deserialising each array. The key type is now specialized,
so it can be accessed directly. The value type is variant type,
but only individual values are deserialised (which is cheap, since they're PODs).
The function also support summing of multiple columns by the same key.

The SummingSortedBlockInputStream uses the function in case of
Nested structure with one numeric key and many values to sum.
 2017-10-13 21:51:03 +03:00
Marek Vavruša
be2faa82ff DataStreams/test: test case for nested field with two arrays for summing 2017-10-13 21:51:03 +03:00
Marek Vavruša
c09a43a7b2 DataStreams/SummingSortedBlockInputStream: use builtin aggregated functions 
This replaces custom summation function implementations with an implementation
using built-in aggregation functions (sum and sumMap). The goal is to be able to
use specialized variants of aggregation functions, and to have a single
efficient implementation.
 2017-10-13 21:51:03 +03:00
Marek Vavruša
c9be3719bc DataStreams/tests: add SummingSortedBlockInputStream test variant 
This is basically useful for testing SummingSortedBlockInputStream
against the AggregatingBlockInputStream, which are used in the
{Summing,Aggregating}MergeTree table engines respectively.
 2017-10-13 21:51:03 +03:00
Alexey Milovidov
e57e79a5ff Proper fix for the issue: better exception message [#CLICKHOUSE-2]. 2017-10-12 22:56:47 +03:00
proller
cbc81a6a9f Received signal Segmentation fault (#1300) (#1302) 
* Received signal Segmentation fault (#1300)

* Add test
 2017-10-12 22:46:40 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change 
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
 2017-10-10 08:33:00 -07:00
proller
7feb94357b use enum class 2017-10-03 22:12:44 +03:00
proller
5250650f65 Fixes (#1286) 
* Revert "Simplification [#CLICKHOUSE-2]."

This reverts commit 98ad6a5db3.

* Fix error: comparison of unsigned expression < 0 is always false

* Fix float division by zero

* Fix float division by zero

* Disable PointInPolygon function if compiling with old clang

* Fix warning:
dbms/src/Functions/FunctionsCoding.h:336:21: error: comparison of constant -1 with expression of type 'const char' is always true [-Werror,-Wtautological-constant-out-of-range-compare]
            if (num != -1)

* Fix
 2017-09-26 23:29:34 +03:00
Alex Bocharov
55e1559733 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:46:10 +01:00
Alex Bocharov
1f70d0e163 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:43:47 +01:00
Alex Bocharov
6e74602e45 Aggregate function sumMap: use FieldVisitorSum instead of += operator. 2017-09-18 16:41:07 +01:00
Alexey Milovidov
21fe32b929 Fixed build in clang with raised up inline-depth [#CLICKHOUSE-2]. 2017-09-15 15:17:01 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5 Fixed merges progress bar. [#CLICKHOUSE-2] 2017-09-15 01:04:13 +03:00
proller
a43b9ec398 Revert "Simplification [#CLICKHOUSE-2]." 
This reverts commit 98ad6a5db3.
 2017-09-14 23:16:31 +03:00
Alexey Milovidov
2c424c7989 Added description of possible race condition [#CLICKHOUSE-2]. 2017-09-10 06:17:05 +03:00
Alexey Milovidov
98ad6a5db3 Simplification [#CLICKHOUSE-2]. 2017-09-10 05:30:45 +03:00
Alexey Milovidov
dc5eca0beb Fixed awful translation [#CLICKHOUSE-2]. 2017-09-10 05:06:16 +03:00
Alexey Milovidov
cf5fd27b94 Clarifications [#CLICKHOUSE-2]. 2017-09-10 04:39:40 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
94b975e7f9 Removed function deprecated in C++ [#CLICKHOUSE-3174]. 2017-09-09 02:31:18 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
8c9ec83a33 Implemented some suggestions from clang-tidy (part 4) [#CLICKHOUSE-3301]. 2017-09-08 07:10:43 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
e9ae193870 Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301]. 2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vitaliy Lyudvichenko
325ceb85b5 Delete unusing files. [#CLICKHOUSE-2] 2017-09-06 04:18:07 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150) 
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
 2017-09-05 04:08:26 +03:00
Alexey Milovidov
4d97959e57 Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-09-04 04:11:00 +03:00
Alexey Milovidov
f51cc679a0 Fixed inserting wrong default value for Enums [#CLICKHOUSE-3270]. 2017-09-02 00:37:57 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175) 
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
 2017-09-01 20:21:03 +03:00
Alexey Zatelepin
ce3e4676fa remove unnecessary calls to find() [#CLICKHOUSE-2171] 2017-08-19 21:35:01 +03:00
Alexey Milovidov
e01c23267a Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-08-18 22:41:27 +03:00
Alexey Milovidov
12a034478c Fixed bad translation [#CLICKHOUSE-2]. 2017-08-18 22:30:39 +03:00
Alexey Milovidov
16d6c4f9e7 Removed very old protocol compatibility features [#CLICKHOUSE-2]. 2017-08-16 23:27:35 +03:00
Alexey Zatelepin
67dffb9be6 simplify MultiplexedConnections further (so that it works with only one shard) [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
36dc7857a1 make LazyBlockInputStream thread-safe [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a remove shard multiplexing code, simplify [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Milovidov
1e1dc8828a Miscellaneous [#CLICKHOUSE-2]. 2017-08-13 00:02:45 +03:00
Alexey Milovidov
45ea2fba47 Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838]. 2017-08-07 10:44:27 +03:00
Alexey Milovidov
fb2aff4704 Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838]. 2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Alexey Milovidov
fd9b8c6fbe Fixed error [#METR-25976]. 2017-08-01 20:02:41 +03:00
Alexey Milovidov
a6cb383c4f Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 04:25:03 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
Alexey Milovidov
d57f5b81a4 Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175]. 2017-07-26 00:07:05 +03:00
Alexey Zatelepin
18672204e5 fix handling of overflow data during external aggregation [#CLICKHOUSE-3133] 2017-07-25 19:56:48 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011) 
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
 2017-07-21 09:35:58 +03:00
Nikolai Kochetov
7e293df9af merged with master 2017-07-17 22:48:22 +03:00
Nikolai Kochetov
39cb5e0e3e fixed ColumnGathererStream finish reading condition 2017-07-17 22:43:09 +03:00
Nikolai Kochetov
eae94edd6b fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131] 2017-07-17 22:40:30 +03:00
Alexey Milovidov
bfc099ea5f Miscellaneous [#CLICKHOUSE-2]. 2017-07-17 01:41:15 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Alexey Zatelepin
b10e9d1f18 Vertical merge fix: don't forget to output last source_to_fully_copy [#CLICKHOUSE-3118] 2017-07-14 22:06:40 +03:00
Nikolai Kochetov
a13423e552 added vertical merge for ReplacingSortedBlockInputStream 2017-07-14 21:17:23 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
210f14aaba renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint 2017-07-13 21:54:17 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
0614ba5684 Using lexer: better error messages [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
7068d1ff81 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Alexey Milovidov
1bab7fc344 Using lexer (incomplete) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Nikolai Kochetov
7c705b1a24 added RemoveColumnsBlockInputStream 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
489af678d5 added avg_value_size_hint for NativeBlockInputStream [#CLICKHOUSE-3066] 2017-07-12 21:41:08 +03:00
Alexey Milovidov
1908b2b5a5 Fixed error in prev. revision [#CLICKHOUSE-2]. 2017-07-12 19:51:39 +03:00
Alexey Milovidov
24331a18f5 Removing dependency on functions from client: bug fixes [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
976e47e1af Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Alexey Milovidov
8c1a6f5736 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Nikolai Kochetov
ee66169d5e added throw_if_column_not_found to FilterColumnsBlockInputStream [#CLICKHOUSE-3111] 2017-07-11 20:58:49 +03:00
Alexey Milovidov
2bd84600d1 Miscellaneous [#CLICKHOUSE-2]. 2017-07-11 04:20:40 +03:00
Alexey Milovidov
a742ac3b6c Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:39 +03:00
Alexey Milovidov
78e905aa3a Fixed build after merge [#CLICKHOUSE-3]. 2017-07-10 07:10:25 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master 
Implement natively uuid type in Clickhouse
 2017-07-10 07:00:45 +03:00
Alexey Milovidov
db3d56b1f5 Removed obsolete test binary [#CLICKHOUSE-3]. 2017-07-10 06:43:25 +03:00
Alexey Zatelepin
89939a685a Stream row sources from disk for vertical merge [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Alexey Zatelepin
1cd936579d introduce IColumn::gather() [#CLICKHOUSE-3118] 2017-07-09 21:57:06 +03:00
Nikolai Kochetov
25ac546e78 disabled exception during overriding settings with same value in readonly mode [#CLICKHOUSE-3041] 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
63119eda7d updated FormatSettingsJSON 2017-07-09 20:16:26 +03:00
Nikolai Kochetov
c99a9b1c55 moved FilterColumnsBlockInputStream implementation to .cpp [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
alexey-milovidov
85bdb472ea Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
alexey-milovidov
7bc0e40135 Update FilterColumnsBlockInputStream.h 2017-07-05 20:14:17 +03:00
Nikolai Kochetov
f1ec4cd863 added FilterColumnsBlockInputStream into StorageMerge [#CLICKHOUSE-3111] 2017-07-05 20:14:17 +03:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Alexey Milovidov
c170b6f0d2 Removed useless code [#CLICKHOUSE-3111]. 2017-07-03 20:34:27 +03:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alex Zatelepin
8f250d4a18 Merge pull request #927 from yandex/fix-profile-info-race 
Fix race condition while initializing BlockStreamProfileInfo
 2017-06-26 16:38:26 +03:00
Alexey Zatelepin
1917de0380 fix race condition while initializing BlockStreamProfileInfo [#CLICKHOUSE-3099] 2017-06-26 15:30:35 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921) 
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
 2017-06-23 23:22:35 +03:00
Alexey Milovidov
3c33f1841f Little better [#CLICKHOUSE-2]. 2017-06-23 09:45:48 +03:00
Alexey Milovidov
7f48f1a7f5 Fixed error [#CLICKHOUSE-2]. 2017-06-23 09:11:00 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
Alexey Milovidov
782fe332b1 Miscellaneous [#CLICKHOUSE-31]. 2017-06-13 07:13:54 +03:00
Alexey Zatelepin
877283b589 fix sorting when all columns are const [#CLICKHOUSE-3062] 2017-06-09 09:13:20 +03:00
Alexey Milovidov
dc0d5b604f Addition to prev. revision [#CLICKHOUSE-2]. 2017-06-06 22:06:44 +03:00
Alexey Milovidov
0d7d379b44 Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:36:13 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
8fb0afe74e Fixed build of tests [#CLICKHOUSE-2]. 2017-06-02 22:35:37 +03:00
Alexey Milovidov
5bd9342c0b Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-01 21:13:42 +03:00
Alexey Milovidov
862a304db2 Small refinements [#CLICKHOUSE-2]. 2017-06-01 16:41:58 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
f1yegor
0bf5182020 translate comments: etc 2017-05-28 16:32:59 +02:00
Alexey Milovidov
6f5dcb1d84 Miscellaneous [#CLICKHOUSE-3039]. 2017-05-25 22:26:17 +03:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Alexey Milovidov
0dd71e32e0 Preparations, part 8 [#CLICKHOUSE-31]. 2017-05-23 23:04:42 +03:00
Alexey Milovidov
e073b62301 Fixed build [#CLICKHOUSE-31]. 2017-05-23 21:58:38 +03:00
Alexey Milovidov
25209bf040 Allow semicolon after JSONEachRow lines, for convenience [#CLICKHOUSE-2] 2017-05-23 03:57:58 +03:00
Alexey Milovidov
7269f3a23b Format Vertical: added support for totals, extremes and output_format_pretty_max_rows [#CLICKHOUSE-3014]. 2017-05-22 22:00:45 +03:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Vitaliy Lyudvichenko
48d85af41a Allow to skip garbage in TSKV format. [#CLICKHOUSE-3012] 2017-05-22 17:50:13 +04:00
Vitaliy Lyudvichenko
4fd357a311 Add more clear comments, refined code. [#CLICKHOUSE-2957] 2017-05-22 15:16:21 +04:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807) 
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
 2017-05-20 18:47:40 +04:00
Alexey Zatelepin
d9306ab6b5 choose row with the max version for unmatched paths [#CLICKHOUSE-2984] 2017-05-20 17:25:48 +04:00
Alexey Zatelepin
f37ed1fbdb fix bugs in GraphiteMergeTree [#CLICKHOUSE-2984]: 
* destructive rollup with Time=0 if no pattern matches
* differences in row count for Path and Value columns
* missed output rows on the boundaries between blocks
 2017-05-20 17:25:48 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
proller
1474de179c CastTypeBlockInputStream: hotfix: sometimes columns in sample blocks and stream blocks does not match 2017-05-04 22:41:55 +03:00
proller
0787bd66ff Merge: fail if cant convert columns (#753) 
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
 2017-05-03 21:08:59 -07:00
alexey-milovidov
0e8c3b976f Update CastTypeBlockInputStream.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
c77152e3ba Loosen dependency [#CLICKHOUSE-2828]. 2017-04-27 23:47:24 +03:00
artpaul
d269827dfd #215 convert to Enum with FunctionCast 2017-04-27 23:29:39 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
artpaul
c19dada4a3 switch while to if 2017-04-25 20:17:13 +05:00
Alexey Milovidov
5f32cf5d90 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:10:29 +03:00
Alexey Milovidov
7f0aecfcf6 Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:08:26 +03:00
Alexey Milovidov
74c04c467b Review modifications [#CLICKHOUSE-2828]. 2017-04-25 08:07:18 +03:00
artpaul
fd9d613dc9 #215 add tests 2017-04-25 07:57:49 +03:00
artpaul
323a9aff6d #215 cast strings or ints to enum on insert 2017-04-25 07:57:49 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover 
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
 2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
artpaul
d43c9bb1d0 odbc: send header info even on empty result 2017-04-19 18:42:58 +05:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
alexey-milovidov
f03f32e2ab Update DistinctSortedBlockInputStream.h 2017-04-14 23:00:44 +03:00
alexey-milovidov
e62769190e Update DistinctSortedBlockInputStream.cpp 2017-04-14 23:00:44 +03:00
Yuri Dyachenko
c6d6f2de3d add DataStreams::DistinctSortedBlockInputStream 2017-04-14 23:00:44 +03:00
Yuri Dyachenko
b9461b8a1b add IBlockInputStream::isGroupedOutput 2017-04-14 22:40:04 +03:00
proller
72ccc69212 Debian: simpler package (#662) 
* Allow use external re2 with re2_st=re2

* fix

* remove dupe

* use re2_st in FunctionsStringSearch.h

* fix

* move files from tools/etc to debian

* dont generate control

* version

* ok.

* wip

* Cmake: dont touch CMAKE_INSTALL_PREFIX

* wip

* works!

* clean

* okay

* like old

* wip

* wip

* okay

* clickhouse-server-base-dbg

* clean

* clickhouse-server-dbg

* Debian: Remove daemons

* Update rules

* add source/format

* control clean

* add watch

* clean

* clean

* temp fix build

* clean

* docs

* fake make_control

* fix

* testme

* testme

* add metrika package

* fake metrika files
 2017-04-10 20:43:30 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
alexey-milovidov
d0629a9df6 Update IBlockInputStream.h 2017-04-07 23:31:53 +03:00
Yuri Dyachenko
d54d44d97d provide SortedDescription to block pipe 2017-04-07 23:31:53 +03:00
Alexey Milovidov
bd544bbe3a Fixed error with NULLs [#CLICKHOUSE-4]. 2017-04-06 22:51:44 +03:00
Vitaliy Lyudvichenko
74a92cb8d9 Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886] 2017-04-04 15:54:21 +03:00
Alexey Milovidov
a272614c3d Fixed error with filtering by Nullable, continued [#CLICKHOUSE-2754]. 2017-04-04 12:22:06 +03:00
Alexey Milovidov
5919dcae70 Fixed error in filtering by Nullable column [#CLICKHOUSE-2754]. 2017-04-04 11:00:31 +03:00
f1yegor
b4c23f122a Translated comments 2017-04-02 20:37:49 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]." 
This reverts commit 431a735efe.
 2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
f2933e7623 Fixed double whitespace [#CLICKHOUSE-2]. 2017-03-28 06:54:25 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3]. 
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
 2017-03-26 04:28:07 +03:00
Alexey Milovidov
93890423f1 Fixed zero-width spaces [#CLICKHOUSE-3]. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xe2\x80\x8b' | xargs sed -i 's/'$'\xe2\x80\x8b''//g'
 2017-03-26 04:20:25 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
Vitaliy Lyudvichenko
d7d22b80e5 Fix Vertical merge in case of OPTIMIZE FINAL with single part. [#CLICKHOUSE-2886] 2017-03-16 13:42:00 +03:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
proller
9a1169fef6 fix tests 2017-03-16 13:51:21 +04:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
Alexey Milovidov
7532a1d564 Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882]. 2017-03-12 15:56:59 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581) 
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
 2017-03-12 14:13:45 +04:00
proller
b6e01cd47e Fix isolated usage of all .h files, move some code to .cpp (#578) 
* split ColumnAggregateFunction.h

* format

* Allow use re2_st without cmake

* use std type in find_first_symbols.h

* fix ArrayEvaluator.h

* include fixes

* split ColumnConstAggregateFunction.h

* fix StorageMaterializedView.h

* split AddingDefaultBlockOutputStream.h

* move CSVRowInputStream::updateDiagnosticInfo to .cpp

* split ParserEnumElement.h

* format

* split DB/Parsers/ParserUseQuery.h

* clean
 2017-03-11 04:27:59 +04:00
artpaul
0ef749839c issue #390: insert values by their positions instead of name 2017-03-07 15:30:05 +05:00
artpaul
1d8da3f8aa allow compiler to catch inconsistency 2017-03-06 18:39:29 +05:00
Vitaliy Lyudvichenko
8bcb1fe970 Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845] 2017-02-18 00:36:31 +04:00
Alexey Milovidov
82f3f5ad66 Fixed error with GraphiteMergeTree [#CLICKHOUSE-2804]. 2017-02-09 09:45:29 +03:00
Alexey Milovidov
f4cb4cafb1 Fixed error with usage of 'version' column in GraphiteMergeTree [#CLICKHOUSE-2804]. 2017-02-09 07:21:56 +03:00
Alexey Milovidov
f0ca756f52 GraphiteMergeTree: fixed handling of 'version' column [#CLICKHOUSE-2804]. 2017-02-08 00:20:28 +03:00
Alexey Milovidov
1302c3958a Comments [#CLICKHOUSE-3]. 2017-02-07 22:21:59 +03:00
Vitaliy Lyudvichenko
1b7b2b8373 Avoid extra current limits checks in non-root streams. [#CLICKHOUSE-2745] 2017-01-31 23:28:37 +04:00
Vitaliy Lyudvichenko
6500a84dd0 Fix overestimation of AggregateFunction columns size during remote aggregation. [#CLICKHOUSE-2745] 2017-01-31 23:28:37 +04:00
Alexey Milovidov
48db8d121d Moved code out of header [#CLICKHOUSE-2]. 2017-01-31 21:39:01 +03:00
alexey-milovidov
de9bc1dc75 Text formats allow to skip errors (#407) 
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Added test [#CLICKHOUSE-2778].
 2017-01-27 08:29:47 +04:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378) 
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
 2017-01-21 08:24:28 +04:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following: 
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
 2017-01-14 12:00:19 +03:00
artpaul
3292ca81cb fix distinct on single string field [#CLICKHOUSE-28] 2017-01-12 20:34:41 +05:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following: 
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
 2017-01-06 20:41:19 +03:00
Alexey Milovidov
604bd6c5a3 Less const_casts [#METR-2944]. 2017-01-03 04:42:17 +03:00
Alexey Milovidov
1f3aeb066a Renamed methods for bulk binary serialization (continued) [#METR-2944]. 2017-01-03 02:08:09 +03:00
Alexey Milovidov
701ca28c85 Renamed methods for bulk binary serialization [#METR-2944]. 2017-01-03 01:47:28 +03:00
Alexey Milovidov
ca37f28b5f Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944]. 2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
alexey-milovidov
0dd2191c87 Merge branch 'master' into issue-111 2016-12-31 05:53:52 +04:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930] 
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
 2016-12-31 02:39:53 +03:00
artpaul
c74b8e2366 add comments; count exact number of inserted rows [#METR-23881] 2016-12-30 18:40:12 +05:00
artpaul
9cfc019a12 fix calculation of condition for skipping all block [#METR-23881] 2016-12-30 16:15:17 +05:00
Alexey Milovidov
3f9fc77e22 Fixed most cases of misleading messages "Could not print diagnostic info because two last rows aren't in buffer (rare case)" [#METR-20000]. 2016-12-30 08:40:49 +03:00
Alexey Milovidov
baf29f5c48 NULLs support: fixed totally wrong code [#METR-19266]. 2016-12-30 08:13:14 +03:00
Alexey Milovidov
ee2c5f0d65 Fixed error in format PrettySpace [#METR-2944]. 2016-12-30 03:24:56 +03:00
Alexey Milovidov
b4e18e2222 Cut dependendy (code must depend on Functions only via FunctionFactory) [#METR-2944]. 2016-12-30 03:15:50 +03:00
Alexey Milovidov
1a64417044 Added setting "output_format_pretty_max_rows" [#METR-23999]. 2016-12-29 23:15:18 +03:00
artpaul
2b38babb89 organize code [#METR-23881] 2016-12-29 16:55:10 +05:00
artpaul
3f064d9ff7 first dirty implementation of LIMIT BY clause [#METR-23881] 2016-12-28 20:12:54 +05:00
alexey-milovidov
d1383c5f62 Merge pull request #288 from yandex/issue-199 
Issue #199: speedup DISTINCT
 2016-12-23 19:02:48 +04:00
artpaul
2467a010c9 translate comments 2016-12-23 13:01:35 +05:00
artpaul
c904d31882 translate comments 2016-12-23 03:19:57 +05:00
artpaul
964afabf6a check limit hint only at beginning of block processing [#METR-23882] 2016-12-23 01:50:12 +05:00
artpaul
c5eb898416 organize code [#METR-23882] 2016-12-22 22:00:23 +05:00
Vitaliy Lyudvichenko
e2bd364844 Added whole block optimization. [#METR-23783] 2016-12-22 16:19:02 +03:00
artpaul
fe9c28ad49 distinct filtration was rewrited with SetVariants [#METR-23882] 2016-12-22 13:51:34 +05:00
Alexey Milovidov
e5440d0f67 Fixed desinformation [#METR-23305]. 2016-12-22 04:37:05 +03:00
Alexey Milovidov
168472fc9f Fixed typo [#METR-23305]. 2016-12-22 04:14:19 +03:00
Vitaliy Lyudvichenko
e39b41e158 Typo and codestyle fix. 2016-12-18 22:38:30 +03:00
Vitaliy Lyudvichenko
5aa1822fb2 Consecutive optimization for vertical merge. [#METR-23783] 2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
8835275713 More detail log for merges. [#METR-23770] [#METR-23769] [#METR-23783] 2016-12-18 22:12:25 +03:00
Igor Hatarist
9be107e89e Removed TSVBlock format by Alexey's request 2016-12-13 21:26:34 +03:00
Igor Hatarist
96fa052839 Added TSV format synonyms for the TabSeparated formats 2016-12-13 21:03:10 +03:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
Alexey Milovidov
dae8814a71 Addition to prev. revision [#METR-2944]. 2016-12-12 08:20:56 +03:00
Alexey Milovidov
0bdd22efe0 Addition to prev. revision [#METR-2944]. 2016-12-12 08:15:34 +03:00
Alexey Milovidov
70b01f0a53 Do not include ClickHouseRevision.h in header files [#METR-2944]. 2016-12-12 08:14:46 +03:00
Alexey Milovidov
e97ecb6cf7 Merge branch 'master' into METR-19266 
Conflicts:
	dbms/CMakeLists.txt
	dbms/include/DB/Functions/FunctionsArray.h
	dbms/include/DB/Functions/FunctionsString.h
	dbms/include/DB/Parsers/ExpressionListParsers.h
	dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
	dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
	dbms/src/Core/ErrorCodes.cpp
	dbms/src/Parsers/ASTFunction.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/MergeTreeReader.cpp
	dbms/src/Storages/StorageLog.cpp
 2016-12-10 07:51:36 +03:00
Vitaliy Lyudvichenko
ea11f61433 Added requested changes. [#METR-19372] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
f8eb9028fd Refined query_log, processes and merges metrics. 
Also, dbms/CMakeLists.txt was rewritten.
 2016-12-09 13:11:25 +03:00
Alexey Milovidov
6546b73dcc Added setting 'input_format_values_interpret_expressions' [#METR-23720]. 2016-12-08 03:25:52 +03:00
Vladimir Chebotarev
bcc5500f91 cmake: More options. [#METR-23701] 2016-12-05 15:43:14 +03:00
Vitaliy Lyudvichenko
202ba912ce Vertical merging algorithm for MergeTree engines. [#METR-23305] 2016-11-29 22:41:31 +03:00
alexey-milovidov
8c2e228856 Revert "New "vertical" algorithm for MergeTrees' parts merges" 2016-11-24 23:08:54 +04:00
Vitaliy Lyudvichenko
fe891eb198 Removed extra check. 2016-11-23 16:09:29 +03:00
Vitaliy Lyudvichenko
588add5a49 Added requested changes. 
Also fixed single thread read from empty storage Log.
 2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
ec9bcd8054 Vertical merging algorithm for ordinary MergeTreee. 2016-11-23 15:47:19 +03:00
Alexey Milovidov
6d914bc4db Fixed error with default value of Enum and WITH TOTALS [#METR-23539]. 2016-11-18 11:29:45 +03:00
artpaul
1e34e7a15c move some impl details of DistinctBlockInputStream to cpp 2016-11-11 02:24:40 +05:00
Alexey Milovidov
daeac24f04 Added ClientInfo: passing original source of query during distributed query execution; improvement of per-user limits in ProcessList [#METR-23279]. 2016-10-25 00:40:39 +03:00
Alexey Milovidov
ea852bb9d8 Separate compilation of CurrentMetrics; Separated AsynchronousMetrics from CurrentMetrics; Comments [#METR-23237]. 2016-10-24 07:06:27 +03:00
Alexey Milovidov
9af5ce1e3b Separate compilation of ProfileEvents; comments [#METR-23237]. 2016-10-24 05:02:37 +03:00
Alexey Arno
8dede69eb3 dbms: Server: updated comment [#METR-19266] 2016-10-20 13:16:19 +03:00
Alexey Arno
924402f33e dbms: Server: merged from master [#METR-19266] 2016-10-19 18:00:56 +03:00
Vitaliy Lyudvichenko
311f1b1bb9 Replaced IConnectionPool * -> ConnectionPoolPtr to avoid mangling references after Context update. 2016-10-11 15:07:42 +03:00
Vitaliy Lyudvichenko
3451223408 Fixed test build after change of JSON output formats API. 2016-10-10 12:04:56 +03:00
Vitaliy Lyudvichenko
a29ee13702 Fixed compilation error after inaccurate renaming of force_quoting parametr. [#METR-22950] 2016-10-04 19:38:22 +03:00
Vitaliy Lyudvichenko
c3617aaa32 Added docs for output_format_json_quote_64bit_integers parameter. [#METR-22950] 2016-09-30 21:21:58 +03:00
Vitaliy Lyudvichenko
4c242e8a4d Added output_format_json_quote_64bit_integers new config option. 2016-09-30 19:02:16 +03:00
alexey-milovidov
3296310a9d Merge pull request #116 from ludv1x/METR-22071 
More datatypes for groupUniqArray() function [#METR-22071]
 2016-09-29 23:53:18 +04:00
alexey-milovidov
30c4b21a50 Merge pull request #121 from ludv1x/METR-22801 
Ability to skip columns with unknown names from input JSON data [#METR-22801]
 2016-09-28 22:49:50 +04:00
Vitaliy Lyudvichenko
f3d70eb87c Added test for JSONEachRow format. [#METR-22801] 2016-09-28 21:45:28 +03:00
Vitaliy Lyudvichenko
c4666af3ab Add input_format_skip_unknown_fields new config parameter. [#METR-22801] 2016-09-28 01:44:45 +03:00
Alexey Milovidov
0515bee021 Fixed error [#METR-22876]. 2016-09-26 16:40:02 +03:00
Vitaliy Lyudvichenko
80f037b12e Added arena parameter into merge() method of aggregation function states. [#METR-22071] 2016-09-26 15:42:40 +03:00
Alexey Milovidov
6b2755bf2a Non significant change [#METR-2944]. 2016-09-23 23:33:06 +03:00
Vitaliy Lyudvichenko
451a4b1d67 Added new Arena parameter to add() method of IAggregateFunction. [#METR-22071] 2016-09-21 20:13:32 +03:00
Alexey Arno
cc43b1b165 dbms: Server: better [#METR-19266] 2016-09-21 15:31:50 +03:00
Alexey Arno
a1da591237 dbms: Server: Fixed display of arrays . [#METR-19266] 2016-09-21 14:00:04 +03:00
Alexey Arno
045169a065 dbms: Server: Adding nullable type support to functions manipulating arrays. [#METR-19266] 2016-09-20 16:51:45 +03:00
Alexey Milovidov
891a0ea06e Addition to prev. revision [#METR-22237]. 2016-09-19 08:24:49 +03:00
Alexey Milovidov
8d70fd4d51 MergingAggregatedMemoryEfficient: clarifications, probably fixed error with aggregation_memory_efficient_merge_threads > 1 [#METR-22237]. 2016-09-19 08:01:32 +03:00
Alexey Arno
ef7eb14979 dbms: Server: Adding nullable types support for arrays. Ongoing. [#METR-19266] 2016-09-11 10:40:47 +03:00
Alexey Arno
e822631310 dbms: cleanup [#METR-19266] 2016-08-18 18:58:46 +03:00
Pavel Kartavyy
9c8697655e build: fix build after merge with clickhouse repo 2016-08-18 14:17:07 +03:00
Alexey Milovidov
349d303558 Addition to prev. revision [#METR-22400]. 2016-08-17 23:17:16 +03:00
Alexey Milovidov
a50c733345 Make tests deterministic [#METR-22400]. 2016-08-17 23:03:22 +03:00
Alexey Arno
c4f348619d dbms: cleanup [#METR-19266] 2016-08-17 16:38:33 +03:00
Alexey Milovidov
a9eca34a14 Statistics in JSON formats: development [#METR-22400]. 2016-08-17 07:55:57 +03:00
Alexey Milovidov
dfa46b9fcb Statistics in JSON formats: development [#METR-22400]. 2016-08-17 07:54:43 +03:00
Alexey Milovidov
9531d6413b Statistics in JSON formats: development [#METR-22400]. 2016-08-17 07:53:14 +03:00
Alexey Milovidov
ee40dfb9cb Statistics in JSON formats: development [#METR-22400]. 2016-08-17 06:29:26 +03:00
Alexey Milovidov
278d56ea4c Allow to parse Java-style floating point denormals 'NaN' and 'Infinity' [#METR-22428]. 2016-08-17 00:23:53 +03:00
Alexey Arno
f4e77aaf97 dbms: Better code for functions processing. Code cleanup. [#METR-19266] 2016-08-15 14:14:29 +03:00
Alexey Milovidov
0cf32c8aed Renamed method [#METR-22400]. 2016-08-13 05:21:17 +03:00
Alexey Milovidov
19f861464a Moving code [#METR-2944]. 2016-08-13 04:57:35 +03:00
Alexey Arno
c74ee4e478 dbms: Code cleanup [#METR-19266] 2016-08-12 18:22:28 +03:00
Alexey Arno
f5d9d0ebc9 Merge branch 'master' into METR-19266 [#METR-19266] 2016-08-10 22:13:15 +03:00
Alexey Arno
e2b6e10ec1 dbms: Various fixes + more comments [#METR-19266] 2016-08-10 22:12:29 +03:00
Alexey Milovidov
30eb125100 Fixed error with INSERT SELECT and nested data structures [#METR-22328]. 2016-08-07 18:13:40 +03:00
Alexey Milovidov
d613c1e0e9 Removed old debug code [#METR-2944]. 2016-08-07 11:13:29 +03:00
Alexey Arno
531ff3d5ac dbms: Merged with master [#METR-19266] 2016-08-05 18:44:19 +03:00
Alexey Arno
efe8a6f7da dbms: Cleanup [#METR-19266] 2016-08-05 17:59:26 +03:00
Alexey Milovidov
61b9996d9e Better [#METR-22173]. 2016-08-05 05:28:34 +03:00
Alexey Milovidov
fb5981871a Avoid copying ColumnWithTypeAndName [#METR-22173]. 2016-08-05 02:35:07 +03:00
Alexey Milovidov
6c476974d4 Maybe better [#METR-22173]. 2016-08-04 07:51:41 +03:00
Alexey Milovidov
9a07830dbb Removed useless code (experimental) [#METR-2944]. 2016-08-02 04:46:05 +03:00
Alexey Milovidov
47fc043fd9 More [#METR-2944]. 2016-07-31 09:48:06 +03:00
Alexey Milovidov
9014f19f01 Fewer warnings from UBSan [#METR-2944]. 2016-07-31 08:56:36 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
e1411af2ed Fixed error with external sorting when constants are present [#METR-21787]. 2016-07-25 23:57:05 +03:00
Alexey Arno
2514b2a04c dbms: simplifications, improvements, post-testing fixes. Unfinished, so do not pay attention to this commit. [#METR-19266] 2016-07-25 21:26:45 +03:00
Alexey Arno
6cf06f6004 dbms: improvements [#METR-19266] 2016-07-14 21:36:34 +03:00
Alexey Milovidov
55ed2904f4 Allowed for certain aggregate functions to have case insensitive names for compatibility [#METR-22087]. 2016-07-14 08:22:09 +03:00
Alexey Arno
dcbe183d41 dbms: merged with master [#METR-19266] 2016-07-11 13:09:16 +03:00
Alexey Milovidov
f5f38e1e50 Better support for tuples, arrays in SELECT DISTINCT [#METR-22035]. 2016-07-10 18:58:58 +03:00
Alexey Arno
2201ad84ff dbms: merged with master [#METR-19266] 2016-07-08 19:52:26 +03:00
Alexey Milovidov
c2929666fd Fixed error [#METR-21877]. 2016-07-07 04:57:48 +03:00
Alexey Milovidov
77f178e046 Squashing transforms: development [#METR-21877]. 2016-07-07 00:50:16 +03:00
Alexey Milovidov
5f81c096f6 Squashing transforms: development [#METR-21877]. 2016-07-07 00:48:11 +03:00
Alexey Arno
93ac3ee3a8 dbms: Server: Feature development. [#METR-19266] 2016-07-06 18:15:15 +03:00
Alexey Arno
59aeadd843 dbms: Server: Feature development. [#METR-19266] 2016-07-06 13:50:31 +03:00
Alexey Arno
4ff528140a dbms: Server: Feature development. [#METR-19266] 2016-07-06 13:36:58 +03:00
Alexey Arno
347d7bf74f dbms: Server: Feature development. [#METR-19266] 2016-07-05 19:57:46 +03:00
Alexey Milovidov
1a420a14e9 Squashing small blocks on INSERT (when passing blocks via TCP interface or when doing INSERT SELECT) [#METR-21877]. 2016-07-02 00:02:13 +03:00
Alexey Milovidov
df538babc8 Text formats: detecting and skipping UTF-8 BOM when possible [#METR-21817]. 2016-06-23 22:39:20 +03:00
Alexey Milovidov
07a47ecd1e Tiny modification [#METR-2944]. 2016-06-08 04:53:17 +03:00
Alexey Milovidov
87f612345e Fixed error [#METR-21408]. 2016-05-31 04:04:34 +03:00
Alexey Milovidov
9eb249afa6 Using std::shared_ptr for functions and AST [#METR-21503]. 2016-05-28 19:19:27 +03:00
Alexey Milovidov
92917ab043 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 17:33:38 +03:00
Alexey Milovidov
646d70a545 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 17:14:18 +03:00
Alexey Milovidov
3c1c9d46f7 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 15:22:22 +03:00
Alexey Milovidov
4c7eb03b63 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:35:44 +03:00
Alexey Milovidov
6863e72f3d Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:15:36 +03:00
Alexey Milovidov
f9b2cd5ab6 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 11:23:36 +03:00
Alexey Milovidov
bf71e2ed90 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 11:11:52 +03:00
Alexey Milovidov
be394f2c84 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 10:48:40 +03:00
Alexey Milovidov
4b7f461e46 Using std::shared_ptr for columns [#METR-21503]. 2016-05-28 08:31:36 +03:00
Alexey Milovidov
a5397d0382 Fixed error [#METR-21408]. 2016-05-24 21:22:15 +03:00
Vladimir Chebotarev
866c8929e2 dbms, contrib: GCC 6 build fixes [#METR-20000] 2016-05-23 03:41:26 +03:00
Alexey Milovidov
7f4d8d15cd Attempt to fix suboptimal performance when running query with ORDER BY and without GROUP BY to distributed table with very many remote servers [#METR-21408]. 2016-05-20 23:30:53 +03:00
Alexey Milovidov
aae7269dd0 Revert "Attempt to fix suboptimal performance when running query with ORDER BY and without GROUP BY to distributed table with very many remote servers [#METR-21408]." 
This reverts commit bd47aaeefe38a1c55ed5a225cbda49db0f8ce1dc.
 2016-05-20 23:27:04 +03:00
Alexey Milovidov
b7a05d0608 Attempt to fix suboptimal performance when running query with ORDER BY and without GROUP BY to distributed table with very many remote servers [#METR-21408]. 2016-05-20 23:01:34 +03:00
Alexey Milovidov
2b1550105c Merge 2016-04-28 22:44:43 +03:00
Alexey Milovidov
f3ad486e14 Merge 2016-04-28 05:33:57 +03:00
Alexey Milovidov
e344f3275b Merge 2016-04-24 22:46:37 +03:00