thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
12,519 Commits 9,138 Branches 1,778 Tags 2 GiB
e36906cdf5
Commit Graph

2197 Commits

Author SHA1 Message Date
Marek Vavruša
927c0f7b74 dbms: Partially revert previous change 
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
 2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24 dbms: Better fix for missing unsigned long to Poco::UInt64 alias 2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update 
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
 2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang 
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
 2017-10-13 18:12:29 -07:00
proller
4c7850fdc2 Optional kafka (#1355) 
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper

* Fix compile with external zookeeper

* Optional kafka

* fix

* Fix

* fix
 2017-10-14 03:53:01 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
alexey-milovidov
adedf47715 Update StorageKafka.cpp 2017-10-13 23:18:43 +03:00
proller
49f8080e52 Small debud improvement 2017-10-13 21:44:26 +03:00
Amos Bird
f30841d5ab Fix SummingMergeTree argument checking logic. 
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
 2017-10-13 15:42:32 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Vladimir Chebotarev
4e313f3732 dbms: Added compression level for ZSTD. [#METR-26742] 2017-10-13 04:08:23 +03:00
Alexey Milovidov
d3d976a6fb Misc [#CLICKHOUSE-2]. 2017-10-12 23:45:55 +03:00
proller
b993667156 Try fix strange terminate (#1329) 
* Tests: External: rename --use_http  => --no_http and fix

* Try fix strange terminate
 2017-10-12 23:42:58 +03:00
Alexey Milovidov
3a6705af0f Improvement [#CLICKHOUSE-2]. 2017-10-12 23:34:01 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
KochetovNicolai
83925f1d5e Fix array writing (#1314) 
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]

* added test [#CLICKHOUSE-3341]

* fixed test [#CLICKHOUSE-3341]

* refactoring and comments [#CLICKHOUSE-3341]

* fix build [#CLICKHOUSE-3341]

* Update ColumnArray.h
 2017-10-12 23:13:26 +03:00
alexey-milovidov
c1285c7d6b Update MergeTreeDataMerger.cpp 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
cabf6d7799 Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2] 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc Less noisy logging. [#CLICKHOSUE-2] 2017-10-12 22:28:24 +03:00
Alexey Milovidov
d468473d62 Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369]. 2017-10-12 21:21:17 +03:00
Alexey Milovidov
4814eb7072 Whitespaces [#CLICKHOUSE-2]. 2017-10-11 17:41:49 +03:00
Marek Vavruša
7fc08389c9 Storages: added Kafka table engine (read-only) 
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.

It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.

Currently it only supports reading, no insertion.
 2017-10-10 08:33:00 -07:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change 
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
 2017-10-10 08:33:00 -07:00
proller
19042816c4 Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) (#1325) 2017-10-06 19:26:32 +03:00
Alexey Zatelepin
6e57272052 don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1 add comments [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757 forbid ALTER of partition key columns for now [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91 serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741 partition serialization into id and text [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a absence of partitioning works [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932 load partition and minmax index from disk [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8 serialize partition and minmax index values [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Nikolai Kochetov
322e56c692 fix reading with preferred_block_size_bytes = 0 2017-09-24 02:16:30 +03:00
Alexey Zatelepin
df58949a68 make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259] 2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258] 2017-09-20 06:05:20 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5 Fixed merges progress bar. [#CLICKHOUSE-2] 2017-09-15 01:04:13 +03:00
Vadim Skipin
e0a1e6982b Context parameter added to the IDatabase methods 2017-09-11 21:29:26 +03:00
proller
5054d50307 Remove too noisy message (#CLICKHOUSE-3304) 2017-09-11 21:26:43 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
5a8f47a640 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:07:32 +03:00
Alexey Milovidov
a6d5e9c7e8 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:04:22 +03:00
Alexey Milovidov
94b975e7f9 Removed function deprecated in C++ [#CLICKHOUSE-3174]. 2017-09-09 02:31:18 +03:00
Alexey Milovidov
ed1c0820f0 Fixed minor issue found by Coverity [#CLICKHOUSE-3285]. 2017-09-09 02:25:42 +03:00
Alexey Milovidov
a81028377e Implemented some suggestions from clang-tidy (part 9) [#CLICKHOUSE-3301]. 2017-09-08 08:03:21 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
6307661c35 Addition to prev. revision [#CLICKHOUSE-3300]. 2017-09-08 00:26:25 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Alexey Milovidov
0dcee75180 Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300]. 2017-09-07 22:13:37 +03:00
Alexey Milovidov
d82b87aaef Fixed redundand code in better way [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
Alexey Milovidov
87fab3396e Fixed build [#CLICKHOUSE-2]. 2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931 
Introduce SYSTEM queries
 2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
88c9dcbb3d Changed method signature. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175) 
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
 2017-09-01 20:21:03 +03:00
Nikolai Kochetov
937f37c489 fixed reading of empty block in prewhere [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Nikolai Kochetov
a9e2a17f69 fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Alexey Zatelepin
d2847f22af PR fixes [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169 check alter of partition key columns [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
dc5809ed8d get rid of unneeded variable [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876 remove unnecessary include [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf rename partition -> partition_id for clarity [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53 generalize MinMax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8 split partition and minmax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
5916d823ef Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238] 2017-08-30 17:34:40 +03:00
Alexey Milovidov
e4eb6f0cfb Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 22:02:07 +03:00
Alexey Milovidov
709eba2a00 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-29 21:51:58 +03:00
Alexey Milovidov
04af7a3349 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko
84660029ec Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252] 2017-08-29 20:49:37 +03:00
Alexey Milovidov
8d7937cc30 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 17:08:25 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
fd63277b15 Unified spelling. [#CLICKHOUSE-2] 2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko
37820f7f64 Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252] 2017-08-28 18:27:25 +03:00
Nikolai Kochetov
c43a13cb81 fixed async insertion into local shard of distributed [#CLICKHOUSE-3245] 2017-08-23 15:44:18 +03:00
Alexey Milovidov
e25f232b5a Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2] 2017-08-19 01:56:19 +03:00
Vitaliy Lyudvichenko
e52428ddb2 Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2] 
Resolves #1112
Resolves #598
 2017-08-19 00:10:53 +03:00
Vadim Skipin
61f65e97a8 Fix typo 2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko
f28d0cff3c Add more detailed exception message. [#CLICKHOUSE-3234] 2017-08-17 23:06:38 +03:00
Nikolai Kochetov
850bc9f19d fixed reading const zero column in prewhere 2017-08-17 23:06:00 +03:00
proller
175cd99288 Freebsd fixes: fix build with libc++, fix find system lib double-conversion (#1109) 
* Cmake: Don't detect and use -no-pie flag with clang

* Camke: find_unwind: Fix disable on arm

* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
 2017-08-17 00:01:43 +03:00
Alexey Milovidov
3a86673aea Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232]. 2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1 Little better [#CLICKHOUSE-3231]. 2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0185fd4542 fix parsing min-max dates from part name [#CLICKHOUSE-3000] 2017-08-15 23:03:59 +03:00
Alexey Zatelepin
372801c59b fix comments [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00