Commit Graph

9613 Commits

Author SHA1 Message Date
Alexey Milovidov
2e652ffa1e Removed hopscotch hash (was used only in single test) [#CLICKHOUSE-2]. 2017-12-02 06:28:00 +03:00
Alexey Milovidov
b932a193e2 Better [#CLICKHOUSE-2]. 2017-12-02 06:25:52 +03:00
Alexey Milovidov
668d88a359 Better [#CLICKHOUSE-2]. 2017-12-02 06:22:51 +03:00
Alexey Milovidov
1090cf2596 Better [#CLICKHOUSE-2]. 2017-12-02 06:11:15 +03:00
Alexey Milovidov
d091789a09 Better [#CLICKHOUSE-2]. 2017-12-02 05:58:25 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
d932d615e7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-02 02:14:59 +03:00
Alexey Milovidov
790bda3b9a Whitespace [#CLICKHOUSE-2]. 2017-12-02 02:14:53 +03:00
Alexey Milovidov
7196602e12 Better [#CLICKHOUSE-2]. 2017-12-02 00:51:50 +03:00
Alexey Milovidov
739b7e0e37 Removed BlockTabSeparated format as it was totally useless [#CLICKHOUSE-2]. 2017-12-02 00:44:12 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
a85773bdbc Fixed error [#CLICKHOUSE-2838]. 2017-12-02 00:30:43 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
1efef27af9 Better [#CLICKHOUSE-2] 2017-12-01 23:38:50 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
proller
71b9fa3a9c Fix test 2017-12-01 21:40:57 +03:00
proller
c516b37d93 Merge remote-tracking branch 'upstream/master' into fix14 2017-12-01 21:40:42 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Nikolai Kochetov
5cbacbc2d7 fixed test [#CLICKHOUSE-3397] 2017-12-01 21:21:37 +03:00
proller
2663871717 Fix some server crashes on incorrect functions usage. Add test. 2017-12-01 21:03:56 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata
[clickhouse-yt] separate geo dictionaries from data providers
2017-12-01 19:54:08 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index 2017-12-01 19:53:04 +03:00
alexey-milovidov
ac25fc2eef
Merge pull request #1547 from proller/fix8
googletest as submodule
2017-12-01 19:44:56 +03:00
alexey-milovidov
493e7a4976
Merge pull request #1571 from rlipovsky/get_user_by_ptr
[clickhouse-yt] more consistent ISecurityManager interface
2017-12-01 19:43:00 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
alexey-milovidov
96695b54fa
Merge pull request #1555 from rlipovsky/external_dicts_repo
[clickhouse-yt] abstract config repository for user-defined objects (dictionaries, etc)
2017-12-01 19:23:08 +03:00
alexey-milovidov
6a3c824056
Update ExternalLoaderConfigRepository.cpp 2017-12-01 19:22:19 +03:00
alexey-milovidov
a48a519c8d
Update ExternalLoaderConfigRepository.cpp 2017-12-01 19:20:01 +03:00
Alexey Milovidov
98291f1a24 Cleanups [#CLICKHOUSE-2838]. 2017-12-01 17:21:24 +03:00
Alexey Milovidov
6fb18a7dc2 Added comments [#CLICKHOUSE-2838]. 2017-12-01 17:15:38 +03:00
Nikolai Kochetov
470c633e09 merged with master 2017-12-01 16:33:47 +03:00
Alexey Milovidov
d4089695ad Cleanups [#CLICKHOUSE-2838]. 2017-12-01 16:32:37 +03:00
Nikolai Kochetov
f025f22007 Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-01 16:24:50 +03:00
Nikolai Kochetov
ec6619e3c9 added INSERT INTO TABLE syntax [#CLICKHOUSE-3397] 2017-12-01 16:23:10 +03:00
Alexey Milovidov
241e0638b7 Merge branch 'master' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams 2017-12-01 15:36:15 +03:00
Nikolai Kochetov
c60a1820a8 reverted changes in Cluster.cpp 2017-12-01 14:47:23 +03:00
robot-metrika-test
f76587faa2 Auto version update to [54319] 2017-12-01 09:36:28 +03:00
Alexey Milovidov
304acb9a8e Merge branch 'unify-data-types-that-serialized-with-multiple-streams' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams 2017-12-01 00:42:09 +03:00
Alexey Milovidov
dbc1b76ab1 Normalized tests: use /clickhouse/tables/test/ as prefix for tables in ZooKeeper [#CLICKHOUSE-2]. 2017-12-01 00:41:29 +03:00
Alexey Milovidov
da795a6fb3 Normalized tests: use /clickhouse/tables/test/ as prefix for tables in ZooKeeper [#CLICKHOUSE-2]. 2017-12-01 00:41:19 +03:00
proller
a520d30a5e zlib fix flags in headers 2017-11-30 20:52:09 +03:00
Roman Lipovsky
430837706c more consistent ISecurityManager interface: return shared pointer to User to prevent race conditions with loadFromConfig 2017-11-30 17:53:12 +03:00
alexey-milovidov
62cfe39b9d
Merge pull request #1570 from kshvakov/master
Добавил колонку с описанием настройки в system.settings
2017-11-30 17:08:25 +03:00
Kirill Shvakov
cd7f7b076e Merge branch 'add-description-to-settings-table' 2017-11-30 13:55:42 +02:00
Kirill Shvakov
4d73516508 Add description to system.settings table 2017-11-30 13:50:02 +02:00
robot-metrika-test
82bdb77dac Auto version update to [54317] 2017-11-30 08:52:07 +03:00
Alexey Milovidov
9b75c88a0f Added instruction for heap profiler [#CLICKHOUSE-3453]. 2017-11-29 22:42:09 +03:00
Alexey Milovidov
de37ced469 Added instruction for heap profiler [#CLICKHOUSE-3453]. 2017-11-29 22:41:57 +03:00
Roman Lipovsky
44f8fcaf0d fix indentation 2017-11-29 15:48:28 +03:00
Roman Lipovsky
db0fc481d7 do not rely on total size estimation from data source 2017-11-29 15:45:17 +03:00
Roman Lipovsky
45637ddee8 fix indentation 2017-11-29 15:41:42 +03:00
Vitaliy Lyudvichenko
ddb02d8ccf Small enhancements. [#CLICKHOUSE-3452] 2017-11-29 14:54:37 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Alexey Milovidov
fb4951b679 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-29 02:50:17 +03:00
Alexey Milovidov
37a22bceba Merge branch 'master' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams 2017-11-29 02:31:38 +03:00
Alexey Milovidov
7b4bffe088 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-29 02:31:21 +03:00
Roman Lipovsky
845b4e0cac use types from Dictionaries/Embedded/GeodataProviders/Types.h 2017-11-29 01:27:32 +03:00
Roman Lipovsky
e37b13dfef update comment 2017-11-29 01:18:38 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
alexey-milovidov
2ab73565b2
Fixed terrible translation. 2017-11-28 19:30:24 +03:00
Alexey Zatelepin
01d42242b1 mark queue as dirty if status of ZK operation is unknown [#CLICKHOUSE-3405] 2017-11-28 17:09:53 +03:00
Roman Lipovsky
639d850d97 abstract config repository of user-defined objects (dictionaries, models) 2017-11-28 14:00:07 +03:00
robot-metrika-test
149b9bd4e2 Auto version update to [54314] 2017-11-28 13:25:48 +03:00
Amos Bird
b516e5e087
Propagate readPrefix in ParallelInputsProcessor (take 2)
Both UnionBlockInputStream and ParallelAggregatingBlockInputStream rely on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.

Fix thread unsafty issue in https://github.com/yandex/ClickHouse/pull/1516

Here is a list of inputstreams with meaningful work in readPrefix

```
IProfilingBlockInputStream

AsynchronousBlockInputStream
BlockInputStreamFromRowInputStream
CatBoostDatasetBlockInputStream
CreatingSetsBlockInputStream
CSVRowInputStream
DictionaryBlockInputStreamBase
InputStreamFromASTInsertQuery
KafkaBlockInputStream
MergingAggregatedMemoryEfficientBlockInputStream
RemoteBlockInputStream
StorageFileBlockInputStream
```
2017-11-28 16:52:00 +08:00
Alexey Milovidov
cccf8aa8a8 Fixed test [#CLICKHOUSE-2]. 2017-11-28 05:21:32 +03:00
Alexey Milovidov
6713069aef Fixed test [#CLICKHOUSE-2]. 2017-11-28 05:20:28 +03:00
Alexey Milovidov
c05cf01a9b SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:50 +03:00
Alexey Milovidov
06a65168ac SummingSortedBlockInputStream: miscellaneous [#CLICKHOUSE-2]. 2017-11-28 05:14:06 +03:00
Alexey Milovidov
36d4f89c7a Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-28 05:13:46 +03:00
Roman Lipovsky
ae6e9a870f edit comment 2017-11-28 04:12:57 +03:00
Roman Lipovsky
4eda095654 add comments 2017-11-28 04:12:57 +03:00
alexey-milovidov
1879fe93f1 Update Context.h 2017-11-28 04:12:57 +03:00
alexey-milovidov
7819424e2a Update Context.h 2017-11-28 04:12:57 +03:00
Roman Lipovsky
dd22bf2179 fix include 2017-11-28 04:12:57 +03:00
Roman Lipovsky
af6c6f0afa mark ISecurityManager::getUser as const 2017-11-28 04:12:57 +03:00
Roman Lipovsky
cf6dd4e73b abstractions: runtime components factory + security manager 2017-11-28 04:12:57 +03:00
Alexey Milovidov
71378d329c Merge branch 'unify-data-types-that-serialized-with-multiple-streams' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams 2017-11-28 02:47:21 +03:00
Alexey Milovidov
719d2654f8 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-28 02:47:14 +03:00
Alexey Milovidov
55971073fc Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-28 00:21:09 +03:00
proller
2ade0a92d2 Cmake fix 2017-11-27 23:40:19 +03:00
proller
4b63d9a4c3 Cmake: fix link of some tests (missing pthread) 2017-11-27 23:39:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
Alexey Milovidov
7e5bab971d Fixed build [#CLICKHOUSE-2]. 2017-11-27 22:12:18 +03:00
alexey-milovidov
5dd7279e15 Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
alexey-milovidov
d6766a8ef4 Update DictionarySourceFactory.h 2017-11-27 22:08:40 +03:00
alexey-milovidov
1a28e785af Update DictionarySourceFactory.cpp 2017-11-27 22:08:40 +03:00
Roman Lipovsky
b218dfab1c [clickhouse-yt] support external dictionaries registration in DictionarySourceFactory 2017-11-27 22:08:40 +03:00
proller
e190cb383c Merge remote-tracking branch 'upstream/master' into fix8 2017-11-27 16:46:23 +03:00
Alexey Milovidov
42cc689474 Miscellaneous [#CLICKHOUSE-2]. 2017-11-26 22:22:33 +03:00
Alexey Milovidov
6266ecc5ed Miscellaneous [#CLICKHOUSE-2]. 2017-11-25 02:03:58 +03:00
alexey-milovidov
33ddc5e0f5 Update ConfigProcessor.cpp 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
a6ee2125a4 ConfigProcessor: explicit ctor [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
bc3b20edac fixed one more ConfigProcessor usage [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
1114a749e3 fixed one more ConfigProcessor usage [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
592f892821 fixed one more ConfigProcessor usage [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
alexey-milovidov
3a0e0173ab
Merge pull request #1545 from samael500/master
Fix integer overflow
2017-11-25 01:43:48 +03:00
proller
91cddb511a googletest as submodule 2017-11-25 00:15:24 +03:00
proller
827a5d0612 Fix warnings-errors in gtest 2017-11-24 23:40:14 +03:00
proller
6ff1968196 Compile and likk optimize and fixes 2017-11-24 21:08:01 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Maks Skorokhod
d5cdfa6a48
🔧 fix typeowerflow on gcd and modulo functions 2017-11-24 11:17:49 +03:00
Maks Skorokhod
66bbc737d4
add test for gcd and modulo functions 2017-11-24 11:17:17 +03:00
Alexey Milovidov
859bf86a43 Fixed error found by ASan with debug libc++ (actually not dangerous) [#CLICKHOUSE-2]. 2017-11-23 18:24:55 +03:00
Alexey Zatelepin
78aaa42ddd add idempotent retries of updating the replica queue in ZooKeeper [#CLICKHOUSE-3405] 2017-11-23 16:19:29 +03:00
Maks Skorokhod
a06ca9cb82
:octocat: merge with master 2017-11-23 11:57:10 +03:00
Maks Skorokhod
c4ee8b93e3
add test for gcd/lcm functions 2017-11-23 11:47:34 +03:00
Maks Skorokhod
e0f981f48c
🔧 correct type cast for LCM result 2017-11-23 11:40:06 +03:00
Alexey Milovidov
e15d637714 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:12:09 +03:00
Alexey Milovidov
4bf120b285 Miscellaneous [#CLICKHOUSE-2]. 2017-11-23 05:11:16 +03:00
Alexey Milovidov
562cfe9f9f Fixed error (static initializers became too complex) [#CLICKHOUSE-2]. 2017-11-23 00:09:23 +03:00
Alexey Milovidov
d2c900cdcc Fixed error (static initializers became too complex) [#CLICKHOUSE-2]. 2017-11-23 00:08:14 +03:00
Alexey Milovidov
1872f6ad6d Fixed error (static initializers became too complex) [#CLICKHOUSE-2]. 2017-11-22 23:54:55 +03:00
Alexey Milovidov
df95b81196 Fixed error (static initializers became too complex) [#CLICKHOUSE-2]. 2017-11-22 23:53:47 +03:00
Alexey Milovidov
11afd41f5e Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 22:42:49 +03:00
Maks Skorokhod
6b5fafbf73 🔁 add gcd and lcm to generate functions 2017-11-22 22:42:16 +03:00
Maks Skorokhod
f4489f17fc 🔧 use correct result types 2017-11-22 22:42:16 +03:00
Maks Skorokhod
25509e2ee2 🔁 add GCD and LCM functions support 2017-11-22 22:42:16 +03:00
Alexey Milovidov
f3b0f17d50 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 22:02:24 +03:00
proller
875ef9b5cf Fix allocator test 2017-11-22 17:54:12 +03:00
Maks Skorokhod
a6f1707158
🔁 add gcd and lcm to generate functions 2017-11-22 13:48:59 +03:00
Maks Skorokhod
f09855e6f8
🔧 use correct result types 2017-11-22 12:50:23 +03:00
Maks Skorokhod
c31fd8ba88
🔁 add GCD and LCM functions support 2017-11-22 12:25:36 +03:00
Alexey Milovidov
c13872450f Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:53 +03:00
Alexey Milovidov
d50511b8e1 Whitespace [#CLICKHOUSE-2]. 2017-11-22 05:42:02 +03:00
Alexey Milovidov
2d98a33dd0 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 05:40:07 +03:00
alexey-milovidov
35ce63a762 Revert "Propagate readPrefix in ParallelInputsProcessor" 2017-11-22 05:17:42 +03:00
Alexey Zatelepin
7775216c3d do not save query output options to the ATTACH query [#CLICKHOUSE-3439] 2017-11-22 00:39:03 +03:00
Alexey Zatelepin
d6816c6f22 add test [#CLICKHOUSE-3448] 2017-11-22 00:39:03 +03:00
Alexey Zatelepin
b2963d4c60 add current database to a CREATE SELECT query only for views [#CLICKHOUSE-3448] 2017-11-22 00:39:03 +03:00
proller
e448f4a73a Always make symlink to clickhouse-clang and clickhouse-lld (debian package fix) 2017-11-22 00:22:18 +03:00
proller
411202d5ad Zlib: as submodule, fix compile options; config: add logger options: logger.flush logger.rotateOnOpen 2017-11-21 23:10:37 +03:00
Alexey Milovidov
4aa520e7be Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-21 22:40:59 +03:00
alexey-milovidov
44b8cc2292 Update parseIdentifierOrStringLiteral.h 2017-11-21 22:35:54 +03:00
proller
2778f35e48 Lib Parsers 2017-11-21 22:35:54 +03:00
Amos Bird
92811ca5f2
Make malformed array join statement fail early
Currently array join clause that have no parent table can go through the parser and generates some confusing error.
```
create table aa (a Array(UInt64)) Engine=Memory;
select * from array join aa;

Received exception from server (version 1.1.54311):
Code: 208. DB::Exception: Received from localhost:9000, ::1. DB::Exception: No columns in nested table aa.
```

This patch makes it fail at client side. 
```
Syntax error: failed at position 21:

select * from array join aa;

Expected one of: SAMPLE, INNER, WITH, HAVING, SETTINGS, identifier, Dot, ORDER BY, AS, GROUP BY, INTO OUTFILE, UNION ALL, LEFT ARRAY JOIN, ARRAY JOIN, table, table function, subquery or list of joined tables, array join, alias, FINAL, PREWHERE, WHERE, token, FORMAT, LIMIT
```

However I'm not sure if `ParserCompoundIdentifier` should be stricter so that `array` wouldn't be consider as a table name.
2017-11-21 15:16:15 +08:00
Alexey Milovidov
4bc98c9253 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:25:36 +03:00
Alexey Milovidov
63f79b7b4f Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-21 05:23:41 +03:00
alexey-milovidov
2350a73b8a
Merge pull request #1519 from amosbird/patch-3
Fixes StorageJoin's sample block order.
2017-11-20 23:16:45 +03:00
Vitaliy Lyudvichenko
2cf6e20fef Fixed a vague error message in integration tests. [#CLICKHOUSE-2] 2017-11-20 23:15:30 +03:00
Amos Bird
dc6847d5c6
Fixes StorageJoin's sample block order.
Here is a reproducible test case.
```
create table e (s UInt64, t UInt64) Engine = Memory;
create table v (s UInt64, w Float64, c UInt64) Engine = Join(Any, Inner, s);
insert into e values (1, 2), (1, 3), (1, 4), (2, 1), (2, 4), (3, 1), (4, 2), (4, 3);
insert into v values (1, 0.5, 3), (2, 0.5, 2), (3, 1, 1), (4, 0.5, 2);
select *, w, c from e any inner join v using (s);
```

# before this patch
```
┌─s─┬─t─┬─────w─┬──────────c─┐
│ 1 │ 2 │ 4e-45 │ 1051372192 │
│ 1 │ 3 │ 4e-45 │ 1051372192 │
│ 1 │ 4 │ 4e-45 │ 1051372192 │
│ 2 │ 1 │ 3e-45 │ 1056964608 │
│ 2 │ 4 │ 3e-45 │ 1056964608 │
│ 3 │ 1 │ 1e-45 │ 1065353216 │
│ 4 │ 2 │ 3e-45 │ 1056964608 │
│ 4 │ 3 │ 3e-45 │ 1056964608 │
└───┴───┴───────┴────────────┘
```
# after this patch
```
┌─s─┬─t─┬───w─┬─c─┐
│ 1 │ 2 │ 0.5 │ 3 │
│ 1 │ 3 │ 0.5 │ 3 │
│ 1 │ 4 │ 0.5 │ 3 │
│ 2 │ 1 │ 0.5 │ 2 │
│ 2 │ 4 │ 0.5 │ 2 │
│ 3 │ 1 │   1 │ 1 │
│ 4 │ 2 │ 0.5 │ 2 │
│ 4 │ 3 │ 0.5 │ 2 │
└───┴───┴─────┴───┘
```
2017-11-20 19:46:24 +08:00
Alexey Milovidov
2fd17a3072 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 09:01:05 +03:00
Alexey Milovidov
07d594c505 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:59:58 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
3403f68c3f Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:21:50 +03:00
Alexey Milovidov
7cce063d00 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:50:52 +03:00
Alexey Milovidov
feea8996d5 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:46:00 +03:00
Alexey Milovidov
02a991a49c Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:45:33 +03:00
Alexey Milovidov
fbab976e09 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-20 07:44:53 +03:00
alexey-milovidov
c88855873d
Merge pull request #1516 from amosbird/patch-1
Propagate readPrefix in ParallelInputsProcessor
2017-11-20 07:45:40 +03:00
Alexey Milovidov
87ff2f35ec Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2 Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:40:51 +03:00
Alexey Milovidov
380fc668dc Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:37:54 +03:00
Alexey Milovidov
725bd4046f Miscellaneous [#CLICKHOUSE-2]. 2017-11-20 07:36:46 +03:00
Alexey Milovidov
e340511931 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:22:21 +03:00
Alexey Milovidov
a7d4fef0d2 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:21:14 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
fd3239dd46 Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 07:18:27 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Amos Bird
22e9772593
Propagate readPrefix in ParallelInputsProcessor
UnionBlockInputStream relies on ParallelInputsProcessor to do stream preparation in parallel, which seems to be absent. This patch fixes it.
2017-11-20 10:53:48 +08:00
Alexey Milovidov
5d57e014a1 Returned serialization of zero Date and DateTime as zeros [#CLICKHOUSE-2]. 2017-11-20 05:45:37 +03:00
Alexey Milovidov
31fc79b809 Returned serialization of zero Date and DateTime as zeros [#CLICKHOUSE-2]. 2017-11-20 05:44:39 +03:00
Alexey Milovidov
8e6466454a Unification of serde of data types: development [#CLICKHOUSE-2838]. 2017-11-20 05:15:15 +03:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
Alexey Milovidov
6c8b5e29d8 Additions after merge [#CLICKHOUSE-2]. 2017-11-20 00:17:58 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4 2017-11-19 23:57:44 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
2017-11-19 23:01:23 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Pavel Yakunin
bb967007ff merged master 2017-11-19 10:55:46 +03:00
Pavel Yakunin
bd62ea2535 To support "incl" directive in the dictionaries config ConfigProcessor is now used to parse external modules configuration.
"include_from" directive also works if the config has "<yandex>" as the root element. Otherwise default include file will be used.

To enable substitutions in a dictionary config one needs to have it in the following form:
<yandex>
	<include_from>...</include_from>
	<dictionary>
		<name incl="dict_name"></name>
		...
	</dictionary>
</yandex>

instead of

<dictionaries>
        <include_from>...</include_from>
        <dictionary>
                ...
        </dictionary>
</dictionaries>

The latter form will still work if no substitutions are used or if the default includes file exist. So no outright configuration change is necessary on the existing installations.
2017-11-19 09:33:20 +03:00
Alexey Milovidov
c0321ce752 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:59:57 +03:00
Alexey Milovidov
94d3b49e99 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:27:43 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Alexey Milovidov
69714f0671 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:55:53 +03:00
Alexey Milovidov
dfb4a92f5a BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:47:39 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
14e069f748 Allow to extract empty matches in "extractAll" function #1493. 2017-11-18 05:48:11 +03:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
8517251ebd Improved performance of toString function of Date and DateTime arguments [#CLICKHOUSE-2]. 2017-11-18 02:45:49 +03:00
Alexey Milovidov
655565466c Merge remote-tracking branch 'origin/master' into better-date-parsing-formatting 2017-11-18 02:45:17 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
8425c56c0f Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-18 00:00:29 +03:00
Alexey Milovidov
7cf5eaddc0 Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-17 23:59:31 +03:00
Alexey Milovidov
4f8009517c Thread name can be 15 bytes max [#CLICKHOUSE-2]. 2017-11-17 23:57:07 +03:00
Alexey Milovidov
f54e99490f Merge branch 'master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:48:16 +03:00
Alexey Milovidov
8e362ba641 Fixed build [#CLICKHOUSE-2]. 2017-11-17 23:48:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
18be706127 Merge remote-tracking branch 'origin/master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:30:51 +03:00
proller
5190325275 Allocator fix: nothing do when sizes equal, allow reallocate to smaller size (#1512)
* PerformanceTest fixes.

* format

* Allocator fix: nothing do when sizes equal, allow reallocate to smaller size

* Update Allocator.cpp
2017-11-17 23:27:12 +03:00
Alexey Milovidov
9264bc4013 Style [#CLICKHOUSE-2]. 2017-11-17 23:18:06 +03:00
proller
19d102cc4f fix 2017-11-17 22:53:02 +03:00
Alexey Milovidov
4ab2d4bc31 Added comment [#CLICKHOUSE-2]. 2017-11-17 22:49:17 +03:00
Alexey Milovidov
263e262413 Style [#CLICKHOUSE-2]. 2017-11-17 22:43:25 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
proller
79b3ef2f57 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
proller
7b417de0c7 format 2017-11-17 00:01:00 +03:00
proller
cf35323fc4 PerformanceTest fixes. 2017-11-17 00:01:00 +03:00
alexey-milovidov
e6f1262409 Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
alexey-milovidov
ff93d38add Update SummingSortedBlockInputStream.h 2017-11-16 23:48:39 +03:00
Vitaliy Lyudvichenko
ab0aff8709 Fixed SummingMergeTree. [#CLICKHOUSE-2] 2017-11-16 23:48:39 +03:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
Alexey Milovidov
28b5bd8821 Removed useless code [#CLICKHOUSE-3431]. 2017-11-16 22:04:07 +03:00
Alexey Milovidov
c0c3f3115e RegionsHierarchy: read hidden regions [#CLICKHOUSE-3427]. 2017-11-16 21:50:01 +03:00
Alexey Milovidov
5ef829c5f3 RegionsHierarchy: minor modification [#CLICKHOUSE-3427]. 2017-11-16 21:47:59 +03:00
Alexey Milovidov
edcbf791fb Miscellaneous [#CLICKHOUSE-2]. 2017-11-16 20:40:54 +03:00
Alexey Milovidov
ee48dea0d3 Attempt to improve performance of formatting Date and DateTime [#CLICKHOUSE-2]. 2017-11-16 05:07:19 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
2017-11-15 23:32:31 +03:00
Иванов Евгений
48636ac601 Added support UUID type for dictionaries 2017-11-15 23:31:53 +03:00
Marek Vavruša
c07b48075b StorageKafka: fixed messages not showing when EOF is reached in current batch
This prevents messages from being read if there's less than 16 messages to read in Kafka.
Updated documentation with more detailed description.
2017-11-15 23:17:22 +03:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
alexey-milovidov
dbee90ba5b Update ReplicatedMergeTreeBlockOutputStream.cpp 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Zatelepin
0342d785c9 add failing test [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
Alexander Makarov
5b113df16c Rewrote pieces of code with ambiguous '&pointer[offset]' semantics 2017-11-15 22:22:32 +03:00
Alexander Makarov
84b2f16913 fixed several UB-abusing places 2017-11-15 22:22:32 +03:00
robot-metrika-test
ebec370fa5 Auto version update to [54312] 2017-11-15 16:12:02 +03:00
Alexey Milovidov
1a50e733b2 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-15 05:24:22 +03:00
Alexey Milovidov
8d3da74aae Fixed error [#CLICKHOUSE-2]. 2017-11-15 05:24:05 +03:00
alexey-milovidov
19e0cd879d
Extended date parsing (#1495)
* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].

* Allowed to parse Date in YYYY-mM-dD format [#CLICKHOUSE-3].
2017-11-15 05:08:55 +03:00
Alexey Milovidov
dfdc3ba680 Revert "Enable YYYY-mM-dD parsing."
This reverts commit e1fb55cc99.
2017-11-15 05:08:12 +03:00
Amos Bird
e1fb55cc99 Enable YYYY-mM-dD parsing.
This patch makes ClickHouse be able to parse DateTime string like '2017-2-3',
'2017-02-3' and '2017-2-03' correctly.
2017-11-15 05:07:52 +03:00
Alexey Milovidov
fb2d2d36e0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-11-14 20:08:55 +03:00
Alexey Milovidov
e6ccb9b662 Renamed function "runningIncome" to "runningDifferenceStartingWithFirstValue" for clarity [#CLICKHOUSE-2]. 2017-11-14 20:08:51 +03:00
proller
468e2ab044 Merge remote-tracking branch 'upstream/master' into fix4 2017-11-14 14:50:19 +03:00
Alexey Milovidov
c4b4764a0a Fixed error after merge [#CLICKHOUSE-2]. 2017-11-14 03:11:33 +03:00
Alexey Milovidov
18cdec38bd Added comment [#CLICKHOUSE-2]. 2017-11-14 01:53:14 +03:00
Alexey Milovidov
c58ef28b60 Added test [#CLICKHOUSE-2]. 2017-11-14 01:34:14 +03:00
Alexey Milovidov
4c2ffbb315 Better implementations of isInfinite, isFinite, isNaN [#CLICKHOUSE-2]. 2017-11-14 00:47:49 +03:00
alexey-milovidov
855742ba4e
Merge pull request #1426 from yandex/catboost-models
Catboost models
2017-11-13 22:06:22 +03:00
Alexey Milovidov
dcd8355b81 Addition to prev. revision [#CLICKHOUSE-3396]. 2017-11-12 20:26:49 +03:00
Alexey Milovidov
0298243b46 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 20:08:52 +03:00
Alexey Milovidov
2029b38527 Fixed build [#CLICKHOUSE-3396]. 2017-11-12 19:45:30 +03:00
Alexey Milovidov
1dd7568fc1 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:19:48 +03:00
Alexey Milovidov
c8dbea9d36 Merge branch 'embedded-compiler' 2017-11-12 16:09:56 +03:00
Alexey Milovidov
fd8c418416 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:09:08 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484)
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
2017-11-12 15:58:40 +03:00
Alexey Milovidov
22f06f3f7a Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 14:40:27 +03:00
Alexey Milovidov
cd25ecafb7 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 13:29:52 +03:00
Alexey Milovidov
07650e02c4 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 12:10:59 +03:00
Alexey Milovidov
037b7da2ae Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 11:44:22 +03:00
Alexey Milovidov
6d84a88629 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 09:46:42 +03:00
Alexey Milovidov
5074301f8d Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 08:14:39 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00