Marek Vavruša
3926851343
StorageKafka: use config string instead of just server name
2017-10-23 20:47:33 +03:00
Marek Vavruša
a7c391fbf7
StorageKafka: use std::vector instead of stack array for error string buffers
2017-10-23 20:47:33 +03:00
Marek Vavruša
f4c1149606
Settings: renamed schema to format_schema
2017-10-23 20:47:33 +03:00
Alexey Milovidov
c57a62611b
Removed StorageTrivialBuffer because it is underdeveloped [#CLICKHOUSE-2].
2017-10-23 20:38:56 +03:00
proller
c66228a746
Log query id in executeQuery; Better type mismatch error; change format in report tool ( #1372 )
...
* Log query id in executeQuery; Better type mismatch error; change format in report tool
* Better log query_id
* fix message
* Use c++11 thread_local instaed of gcc's __thread
* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
* Cmake: fix build without downloaded submodules (#1379 )
* fix
2017-10-23 20:32:39 +03:00
Nikolai Kochetov
5966574405
fix timeout lock in DistributedBlockOutputStream
2017-10-23 16:47:00 +03:00
Nikolai Kochetov
3317251e2f
fix jobs flags in DistributedBlockOutputStream
2017-10-23 15:00:56 +03:00
Marek Vavruša
975a7ada42
StorageMaterializedView: allow CREATE MATERIALIZED VIEW x TO y
...
This allows creation of materialized views without inner tables,
using an existing table for materialized rows instead.
This is useful for cases when you want to detach the materializing
view, but keep the already materialized data readable, especially
when the inner table is replicated.
2017-10-21 13:34:59 -07:00
Alexey Zatelepin
dd42d53856
additional help messages for extended syntax [#CLICKHOUSE-3000]
2017-10-20 23:02:55 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Alexey Zatelepin
a7c85e0c89
save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]
2017-10-20 21:28:44 +03:00
Alexey Zatelepin
1f76900500
move CREATE query rewriting for views to Interpreter [#CLICKHOUSE-2]
2017-10-20 21:28:43 +03:00
Alexey Zatelepin
75c65c7b59
use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
6b9ead4bd8
parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
48dea685d0
use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000]
2017-10-20 21:28:41 +03:00
Nikolai Kochetov
74a4c7508a
merged with master
2017-10-20 19:18:09 +03:00
Nikolai Kochetov
4262c00122
lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
2017-10-19 22:52:45 +03:00
Alexey Zatelepin
e51f95872f
fix backward compatibility for new part format: [#CLICKHOUSE-3000]
...
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Marek Vavruša
927c0f7b74
dbms: Partially revert previous change
...
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24
dbms: Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be
dbms: Fix build with clang after Poco update
...
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc
dbms: fix build with OS X built-in clang
...
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:
```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
res.insert({elem.column, elem.type, rename[i].value()});
~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
value_type& value()
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
4c7850fdc2
Optional kafka ( #1355 )
...
* Zookeeper include fix
* Update submodule contrib/poco
* Fix zookeeper submodule ho-to-make doc
* Update zookeeper submodule
* Update submodule zookeeper
* Fix compile with external zookeeper
* Optional kafka
* fix
* Fix
* fix
2017-10-14 03:53:01 +03:00
alexey-milovidov
9ccdb5420b
Merge branch 'master' into upstream-add-kafka
2017-10-13 23:52:42 +03:00
alexey-milovidov
adedf47715
Update StorageKafka.cpp
2017-10-13 23:18:43 +03:00
proller
49f8080e52
Small debud improvement
2017-10-13 21:44:26 +03:00
Amos Bird
f30841d5ab
Fix SummingMergeTree argument checking logic.
...
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 15:42:32 +03:00
Vladimir Chebotarev
1e0241e262
dbms: CompressionSettingsSelector. [#METR-21516]
2017-10-13 04:08:23 +03:00
Vladimir Chebotarev
4e313f3732
dbms: Added compression level for ZSTD. [#METR-26742]
2017-10-13 04:08:23 +03:00
Alexey Milovidov
d3d976a6fb
Misc [#CLICKHOUSE-2].
2017-10-12 23:45:55 +03:00
proller
b993667156
Try fix strange terminate ( #1329 )
...
* Tests: External: rename --use_http => --no_http and fix
* Try fix strange terminate
2017-10-12 23:42:58 +03:00
Alexey Milovidov
3a6705af0f
Improvement [#CLICKHOUSE-2].
2017-10-12 23:34:01 +03:00
Vitaliy Lyudvichenko
62ea1133dd
Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]
2017-10-12 23:26:54 +03:00
KochetovNicolai
83925f1d5e
Fix array writing ( #1314 )
...
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* added test [#CLICKHOUSE-3341]
* fixed test [#CLICKHOUSE-3341]
* refactoring and comments [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* Update ColumnArray.h
2017-10-12 23:13:26 +03:00
alexey-milovidov
c1285c7d6b
Update MergeTreeDataMerger.cpp
2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
cabf6d7799
Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]
2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc
Less noisy logging. [#CLICKHOSUE-2]
2017-10-12 22:28:24 +03:00
Alexey Milovidov
d468473d62
Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
2017-10-12 21:21:17 +03:00
Alexey Milovidov
4814eb7072
Whitespaces [#CLICKHOUSE-2].
2017-10-11 17:41:49 +03:00
Marek Vavruša
7fc08389c9
Storages: added Kafka table engine (read-only)
...
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.
It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.
Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Marek Vavruša
4fb570fa5e
IStorage: allow notification on dependency change
...
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.
This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
proller
19042816c4
Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) ( #1325 )
2017-10-06 19:26:32 +03:00
Nikolai Kochetov
61bef2adf1
added ExternalLoader [#CLICKHOUSE-3305]
2017-10-06 13:31:06 +03:00
Alexey Zatelepin
6e57272052
don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1
add comments [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757
forbid ALTER of partition key columns for now [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e
safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e
allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91
serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f
add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277
allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741
partition serialization into id and text [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a
absence of partitioning works [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e
encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932
load partition and minmax index from disk [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8
serialize partition and minmax index values [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db
save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Nikolai Kochetov
322e56c692
fix reading with preferred_block_size_bytes = 0
2017-09-24 02:16:30 +03:00
Alexey Zatelepin
df58949a68
make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259]
2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c
be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258]
2017-09-20 06:05:20 +03:00
proller
0a0e04f1a5
Fix includes
2017-09-18 21:52:47 +03:00
Alexey Milovidov
86c46ad1bd
Unification [#CLICKHOUSE-2].
2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5
Fixed merges progress bar. [#CLICKHOUSE-2]
2017-09-15 01:04:13 +03:00
Vadim Skipin
e0a1e6982b
Context parameter added to the IDatabase methods
2017-09-11 21:29:26 +03:00
proller
5054d50307
Remove too noisy message (#CLICKHOUSE-3304)
2017-09-11 21:26:43 +03:00
Alexey Milovidov
cd540c2674
Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2].
2017-09-10 02:17:38 +03:00
Alexey Milovidov
5a8f47a640
Fixed not an issue, shown by TSan [#CLICKHOUSE-2].
2017-09-10 02:07:32 +03:00
Alexey Milovidov
a6d5e9c7e8
Fixed not an issue, shown by TSan [#CLICKHOUSE-2].
2017-09-10 02:04:22 +03:00
Alexey Milovidov
94b975e7f9
Removed function deprecated in C++ [#CLICKHOUSE-3174].
2017-09-09 02:31:18 +03:00
Alexey Milovidov
ed1c0820f0
Fixed minor issue found by Coverity [#CLICKHOUSE-3285].
2017-09-09 02:25:42 +03:00
Alexey Milovidov
a81028377e
Implemented some suggestions from clang-tidy (part 9) [#CLICKHOUSE-3301].
2017-09-08 08:03:21 +03:00
Alexey Milovidov
dc4976f562
Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301].
2017-09-08 07:58:57 +03:00
Alexey Milovidov
d29c77adea
Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301].
2017-09-08 06:47:27 +03:00
Alexey Milovidov
6307661c35
Addition to prev. revision [#CLICKHOUSE-3300].
2017-09-08 00:26:25 +03:00
Alexey Milovidov
8b313ab99e
Fixed warnings found by cppcheck [#CLICKHOUSE-3300].
2017-09-08 00:04:48 +03:00
Alexey Milovidov
0dcee75180
Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300].
2017-09-07 22:13:37 +03:00
Alexey Milovidov
d82b87aaef
Fixed redundand code in better way [#CLICKHOUSE-3281].
2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46
Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117]
2017-09-06 04:18:07 +03:00
Alexey Milovidov
48ab039501
Unify serialization of complex data types: development [#CLICKHOUSE-2838].
2017-09-05 05:36:35 +03:00
Alexey Milovidov
4d97959e57
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-09-04 04:11:00 +03:00
Alexey Milovidov
87fab3396e
Fixed build [#CLICKHOUSE-2].
2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1
Merge branch 'master' of github.com:yandex/ClickHouse
2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a
Merge pull request #1163 from yandex/CLICKHOUSE-2931
...
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
88c9dcbb3d
Changed method signature. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
566160c048
Use FIFO lock in IStorage. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
Nikolai Kochetov
937f37c489
fixed reading of empty block in prewhere [#CLICKHOUSE-3266]
2017-09-01 15:18:40 +03:00
Nikolai Kochetov
a9e2a17f69
fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266]
2017-09-01 15:18:40 +03:00
Alexey Zatelepin
d2847f22af
PR fixes [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169
check alter of partition key columns [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
dc5809ed8d
get rid of unneeded variable [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876
remove unnecessary include [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf
rename partition -> partition_id for clarity [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53
generalize MinMax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46
generic partitioning of inserted blocks [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8
split partition and minmax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a
Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989
Merge branch 'master' into CLICKHOUSE-2931
2017-08-31 00:23:39 +03:00
Alexey Milovidov
495daffa16
Miscellaneous [#CLICKHOUSE-2].
2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
5916d823ef
Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238]
2017-08-30 17:34:40 +03:00
Alexey Milovidov
e4eb6f0cfb
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 22:02:07 +03:00
Alexey Milovidov
709eba2a00
Merge branch 'master' of github.com:yandex/ClickHouse
2017-08-29 21:51:58 +03:00
Alexey Milovidov
04af7a3349
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko
84660029ec
Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252]
2017-08-29 20:49:37 +03:00
Alexey Milovidov
8d7937cc30
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 17:08:25 +03:00
Vadim Skipin
4dc36893d3
Keep config in context to avoid Application singleton usages
2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3
Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931]
2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
fd63277b15
Unified spelling. [#CLICKHOUSE-2]
2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko
37820f7f64
Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252]
2017-08-28 18:27:25 +03:00
Nikolai Kochetov
c43a13cb81
fixed async insertion into local shard of distributed [#CLICKHOUSE-3245]
2017-08-23 15:44:18 +03:00
Alexey Milovidov
e25f232b5a
Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2]
2017-08-19 01:56:19 +03:00
Vitaliy Lyudvichenko
e52428ddb2
Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2]
...
Resolves #1112
Resolves #598
2017-08-19 00:10:53 +03:00
Alexey Milovidov
e01c23267a
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-08-18 22:41:27 +03:00
Vadim Skipin
61f65e97a8
Fix typo
2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko
f28d0cff3c
Add more detailed exception message. [#CLICKHOUSE-3234]
2017-08-17 23:06:38 +03:00
Nikolai Kochetov
850bc9f19d
fixed reading const zero column in prewhere
2017-08-17 23:06:00 +03:00
proller
175cd99288
Freebsd fixes: fix build with libc++, fix find system lib double-conversion ( #1109 )
...
* Cmake: Don't detect and use -no-pie flag with clang
* Camke: find_unwind: Fix disable on arm
* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Alexey Milovidov
3a86673aea
Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232].
2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1
Little better [#CLICKHOUSE-3231].
2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0185fd4542
fix parsing min-max dates from part name [#CLICKHOUSE-3000]
2017-08-15 23:03:59 +03:00
Alexey Zatelepin
372801c59b
fix comments [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Alexey Zatelepin
0df4ae6b02
do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Alexey Zatelepin
f25f0cd759
reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
8a14cc49ff
asyncMulti() -> multi(). [#CLICKHOUSE-3221]
2017-08-15 19:18:02 +03:00
Alexey Zatelepin
3f3b7f61e2
always send changed settings for remote connections [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a
remove shard multiplexing code, simplify [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
133be4d739
move and rename things [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
alexey-milovidov
9b99dfb53d
Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
...
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Nikolai Kochetov
24b5a59f8c
merged with remote [#CLICKHOUSE-3033]
2017-08-11 18:38:46 +03:00
Nikolai Kochetov
90940d8423
Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033]
2017-08-11 18:02:07 +03:00
Vitaliy Lyudvichenko
cd3a696d8b
Add requested changes. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Alexey Milovidov
e6739cc35d
Whitespace [#CLICKHOUSE-2].
2017-08-10 22:41:21 +03:00
alexey-milovidov
4398d71ef5
Update StorageDistributed.h
2017-08-10 07:37:35 +03:00
alexey-milovidov
0282d516a4
Update DistributedBlockOutputStream.cpp
2017-08-10 07:10:36 +03:00
alexey-milovidov
2717c94a36
Update DistributedBlockOutputStream.cpp
2017-08-10 07:05:16 +03:00
alexey-milovidov
0285f99c4e
Update DistributedBlockOutputStream.cpp
2017-08-10 06:54:02 +03:00
alexey-milovidov
57a9d22b0c
Update DistributedBlockOutputStream.cpp
2017-08-10 06:49:03 +03:00
alexey-milovidov
c665c4c4e5
Update DirectoryMonitor.h
2017-08-10 06:46:16 +03:00
alexey-milovidov
5773832979
Update DirectoryMonitor.cpp
2017-08-10 06:45:57 +03:00
Alexey Milovidov
e86d0b4a74
Merge branch 'master' of github.com:yandex/ClickHouse
2017-08-10 00:07:10 +03:00
Alexey Milovidov
56a5bb53fa
Miscellaneous [#CLICKHOUSE-2].
2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko
27174d9dd2
Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2]
2017-08-09 23:57:42 +03:00
Nikolai Kochetov
43dc201f49
merged with master
2017-08-08 15:11:49 +03:00
Vitaliy Lyudvichenko
00ce8c9603
Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173]
2017-08-08 03:28:43 +03:00
Nikolai Kochetov
ea2b486735
added threadpool to DistributedBlockOutputStream
2017-08-07 23:26:28 +03:00
Alexey Milovidov
fb2aff4704
Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].
2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb
Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]
2017-08-04 17:35:36 +03:00
Nikolai Kochetov
63ec81e2e3
added threadpool for sync insertion into distributed
2017-08-03 20:42:31 +03:00
Nikolai Kochetov
0c15b2c6fc
fixed number of rows to read from first granula in mergetree
2017-08-03 15:58:04 +03:00
alexey-milovidov
ae8783aee3
Merge pull request #1045 from prog8/nocompression
...
Added compression NONE
2017-08-01 23:07:52 +03:00
alexey-milovidov
2ae6f1ebdb
Update MergeTreeDataWriter.cpp
2017-08-01 23:07:16 +03:00
Pawel Rog
d6a2056851
Applied changes requested by Alexey
2017-08-01 16:48:24 +02:00
Pawel Rog
9f799820d9
Applied changes requested by Alexey
2017-08-01 10:12:15 +02:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
alexey-milovidov
d174ebc5c9
Update MergeTreeDataWriter.cpp
2017-07-31 20:44:58 +03:00
alexey-milovidov
4877aa394c
Update MergeTreeData.cpp
2017-07-31 20:44:41 +03:00
Pawel Rog
3a6c444996
Merge branch 'master' into nocompression
2017-07-31 13:36:58 +02:00
Pawel Rog
e1ab721d3d
Use compression method from configs
2017-07-31 13:12:28 +02:00
Pawel Rog
a0cc54457e
Added compression NONE
2017-07-31 12:44:45 +02:00
Nikolai Kochetov
78991b25ee
fixed preferred_max_column_in_block_size_bytes disabling
2017-07-30 01:24:57 +03:00
Alexey Milovidov
8fb452e99a
Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175].
2017-07-29 00:25:24 +03:00
proller
700d4e0904
Fix boost 1.64 and gcc7+ compile errors ( #1040 )
...
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* Requested changes
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153
Update MergeTreeBaseBlockInputStream.cpp
2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514
fixed column size calculation for Array column in MergeTreeReader::readRows
2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9
changed skipping rows for Array columns in MergeTreeBaseBlockInputStream
2017-07-28 22:29:40 +03:00
Alexey Milovidov
dd1f54bce2
Changed Poco::RWLock to std::shared_lock [#APRILDEV-91].
2017-07-28 20:34:02 +03:00
Alexey Milovidov
3502d36d7d
Fixed build [#CLICKHOUSE-2].
2017-07-28 02:23:13 +03:00
Nikolai Kochetov
c88e8a79cc
merged with master
2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08
separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033]
2017-07-27 18:24:39 +03:00
Vitaliy Lyudvichenko
515271544d
Add detail comment. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec
Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921
Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0
Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Nikolai Kochetov
01a004050d
fixed MergeTreeBlockSizePredictor updating from empy block while reading
2017-07-26 20:03:09 +03:00
Alexey Milovidov
d57f5b81a4
Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175].
2017-07-26 00:07:05 +03:00
Nikolai Kochetov
b3157aebb2
added synchronous insert into distributed table [#CLICKHOUSE-3033]
2017-07-25 22:42:36 +03:00
Vitaliy Lyudvichenko
03e5bf9471
Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084]
2017-07-25 20:04:10 +03:00
Alexey Milovidov
4a4e863f9d
Fixed warning on clang 6 [#CLICKHOUSE-2].
2017-07-25 01:44:13 +03:00
alexey-milovidov
d3159ed2c5
Merge pull request #1015 from yandex/fix-performance-after-changing-reading
...
Fix performance after changing reading
2017-07-24 18:07:57 +03:00
Nikolai Kochetov
fcd50e3629
fixed comment
2017-07-24 18:06:32 +03:00
proller
57b9bcd354
Fix missing includes
2017-07-24 18:04:49 +03:00
Vitaliy Lyudvichenko
bc9ee54985
Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896]
2017-07-24 18:04:17 +03:00
Nikolai Kochetov
b55dcc9f93
cnanged comments; fixed 00443_preferred_block_size_bytes test
2017-07-24 16:59:03 +03:00
Alexey Milovidov
1e8547b3f6
Fixed regression [#CLICKHOUSE-3148].
2017-07-21 23:59:01 +03:00
Nikolai Kochetov
10bbededb0
merged with master
2017-07-21 21:10:14 +03:00
Nikolai Kochetov
bc0921a64e
added comments
2017-07-21 21:02:02 +03:00
Alexey Zatelepin
c939d2f96e
put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163]
2017-07-21 20:55:38 +03:00
Nikolai Kochetov
ca1957ab82
ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]
2017-07-21 20:54:09 +03:00
Nikolai Kochetov
cc349b410e
set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]
2017-07-21 20:54:09 +03:00
Nikolai Kochetov
c64b65ee29
ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]
2017-07-21 20:45:51 +03:00
Nikolai Kochetov
755d16b22d
set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]
2017-07-21 14:55:33 +03:00
Alexey Milovidov
c7b1e92522
Fixed error after merge [#CLICKHOUSE-3150].
2017-07-21 09:40:05 +03:00
alexey-milovidov
d4d266fa18
ColumnConst unification ( #1011 )
...
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
alexey-milovidov
1a1112d8bb
Update MergeTreeBlockReadUtils.h
2017-07-20 23:45:23 +03:00
Nikolai Kochetov
0b7439469d
fixed MergeTreeBlockSizePredictor initialization for sample block
2017-07-20 23:45:23 +03:00
