Nikolai Kochetov
4262c00122
lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
2017-10-19 22:52:45 +03:00
proller
443088ce31
Use c++11 thread_local instaed of gcc's __thread
2017-10-19 22:36:37 +03:00
Alexey Zatelepin
e51f95872f
fix backward compatibility for new part format: [#CLICKHOUSE-3000]
...
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Vitaliy Lyudvichenko
24a865a4ff
Update ru changelog for 1.1.54301 version. [#CLICKHOUSE-3]
2017-10-19 17:16:43 +03:00
Marek Vavruša
e2a8526990
ZooKeeper: fixed stack smashing with tryGet()
...
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.
This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
2017-10-18 15:13:42 -07:00
proller
0eb833c433
Fix tcmalloc compile with old clang
2017-10-18 15:24:56 +03:00
alexey-milovidov
3119afbee8
Merge pull request #1366 from avasiliev/master
...
Added explicit copy constructor for mysqlxx::Null
2017-10-18 12:35:01 +03:00
Alexey Vasiliev
7ec4530354
Added explicit copy constructor for mysqlxx::Null
2017-10-17 20:01:01 +03:00
alexey-milovidov
9183c3f897
Merge pull request #1363 from avasiliev/master
...
Updated copy/move operations for some types, https://nda.ya.ru/3TWvPE
2017-10-17 19:04:17 +03:00
Alexey Vasiliev
59309432f9
Updated copy/move operations for some types, https://nda.ya.ru/3TWvPE
2017-10-17 14:58:08 +03:00
robot-metrika-test
8a2b7cf0b6
Auto version update to [54300]
2017-10-16 13:49:50 +03:00
alexey-milovidov
ae009442d3
Merge pull request #1358 from vavrusa/master
...
Partially revert previous change #1357
2017-10-15 02:57:03 +03:00
Marek Vavruša
927c0f7b74
dbms: Partially revert previous change
...
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
alexey-milovidov
55892ad8dc
Merge pull request #1357 from vavrusa/master
...
Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-14 07:54:08 +03:00
Marek Vavruša
8a0571af24
dbms: Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-13 21:39:14 -07:00
alexey-milovidov
30df1e64d1
Merge pull request #1356 from vavrusa/master
...
Fix clang build
2017-10-14 05:52:36 +03:00
Marek Vavruša
70543200be
dbms: Fix build with clang after Poco update
...
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc
dbms: fix build with OS X built-in clang
...
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:
```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
res.insert({elem.column, elem.type, rename[i].value()});
~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
value_type& value()
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
4c7850fdc2
Optional kafka ( #1355 )
...
* Zookeeper include fix
* Update submodule contrib/poco
* Fix zookeeper submodule ho-to-make doc
* Update zookeeper submodule
* Update submodule zookeeper
* Fix compile with external zookeeper
* Optional kafka
* fix
* Fix
* fix
2017-10-14 03:53:01 +03:00
Alexey Milovidov
10392d5452
Fixed build on Mac OS X [#CLICKHOUSE-2].
2017-10-14 02:12:06 +03:00
Alexey Milovidov
f42c6014ce
Merge branch 'master' of github.com:yandex/ClickHouse
2017-10-14 02:06:11 +03:00
proller
142da9550e
Fix zookeeper submodule and how-to-make doc ( #1354 )
...
* Zookeeper include fix
* Update submodule contrib/poco
* Fix zookeeper submodule ho-to-make doc
* Update zookeeper submodule
* Update submodule zookeeper
2017-10-14 01:53:57 +03:00
alexey-milovidov
7fe700c960
Merge pull request #1331 from vavrusa/upstream-add-kafka
...
Add Kafka as a table engine
2017-10-13 23:53:03 +03:00
alexey-milovidov
9ccdb5420b
Merge branch 'master' into upstream-add-kafka
2017-10-13 23:52:42 +03:00
proller
5af5c8d1a7
Update submodule contrib/poco
2017-10-13 23:37:41 +03:00
proller
20329ce794
Zookeeper include fix ( #1353 )
2017-10-13 23:30:55 +03:00
alexey-milovidov
adedf47715
Update StorageKafka.cpp
2017-10-13 23:18:43 +03:00
Alexey Milovidov
b586e2771e
Removed old files after creating a submodules [#CLICKHOUSE-2].
2017-10-13 23:03:44 +03:00
proller
14d9a91b6e
Update submodule contrib/poco (warning fixes)
2017-10-13 22:54:22 +03:00
alexey-milovidov
18bb96a094
Update find_lz4.cmake
2017-10-13 22:26:06 +03:00
alexey-milovidov
e1e65d7298
Update CMakeLists.txt
2017-10-13 22:24:37 +03:00
proller
4844c99d9d
zookeeper 3.4.10 as submodule ( #1304 )
...
* zookeeper 3.4.10 as submodule
* fix
* Apply patch
2017-10-13 22:02:41 +03:00
proller
64194c9b03
Updating poco and making submodule ( #1263 )
...
* Updating poco part 1: use submodule
* switch to tmp submodule
* update submodule
* wip
* wip
* wip
* wip
* wip
* fix
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* test
* wip
* wip
* wip
* wip
* wip
* wip
* Remove werror
* wip
* wip
* wip
* wip
* wip
* Block pipe signal
* Update poco
* Update and fix poco
* Better sigpipe handler
* Better block sigpipe
* Update BaseDaemon.cpp
2017-10-13 21:58:19 +03:00
proller
fd072b58bb
zstd, lz4 as submodule ( #1214 )
...
* Contrib: use zstd, lz4 as submodule
* fix shared build
* re-test me.
* wip
* Update CHANGELOG_RU.md
* Update CHANGELOG.md
* Update CHANGELOG_RU.md
* Whitespaces [#CLICKHOUSE-2].
* Implemented TODO [#CLICKHOUSE-2].
* Whitespaces [#CLICKHOUSE-2].
* Remove wrong test
* Implemented TODO [#CLICKHOUSE-2].
* Moved chown to correct place [#CLICKHOUSE-2].
* Resolves #1273 . Exception safe users update. [#CLICKHOUSE-3]
* Less noisy logging. [#CLICKHOSUE-2]
* Add metrics for RWLockFIFO. [#CLICKHOUSE-3246]
* Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171)
* Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]
* test me
* Fixing documentation fragment about "default" user. It is not mandatory anymore.
* append yurial/clickhouse-client to docs/interfaces
* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
* Removed tcp_ssl_port by default [#CLICKHOUSE-2].
* Update MergeTreeDataMerger.cpp
* Update ShellCommand.cpp
* Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]
* Update ExecutableDictionarySource.cpp
* Update ExecutableDictionarySource.cpp
* Miscellaneous changes after merge [#CLICKHOUSE-2].
* Improve tests: allow redefine some values (clickhouse path, ports, ...)
* Received signal Segmentation fault (#1300 ) (#1302 )
* Received signal Segmentation fault (#1300 )
* Add test
* Tests: Use new possibly redefined values from env (in 2 tests)
* Proper fix for the issue: better exception message [#CLICKHOUSE-2].
* Split GatherUtils.cpp for faster compile (#1312 )
* Split GatherUtils.cpp for faster compile
* remove GatherUtils.cpp
* Fix array writing (#1314 )
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* added test [#CLICKHOUSE-3341]
* fixed test [#CLICKHOUSE-3341]
* refactoring and comments [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* Update ColumnArray.h
* Update ActionBlocker.h
* Fix section tabulation
* Fixed infinite recursion in expression analyzer. [#CLICKHOUSE-3125]
* Update ActionBlocker.h
* Improvement [#CLICKHOUSE-2].
* Try fix strange terminate (#1329 )
* Tests: External: rename --use_http => --no_http and fix
* Try fix strange terminate
* Misc [#CLICKHOUSE-2].
* Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa) (#1333 )
* Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 )
* Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa)
* Fix complex queries with GLOBAL IN and UNION ALL (#CLICKHOUSE-3356) (#1339 )
* TEST only: why initQueryAnalyzer ?
* Better tests
* missing file
* Missing file
* Add test
* Test fixes
* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
* Removed tcp_ssl_port by default [#CLICKHOUSE-2].
* Better tests
* comment
* clean
* REmove wrong code
* clean
* dbms: Added compression level for ZSTD. [#METR-26742]
* dbms: CompressionSettingsSelector. [#METR-21516]
* dbms: Minor fix. [#METR-21516]
* Fix SummingMergeTree argument checking logic.
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 21:52:23 +03:00
Marek Vavruša
41b0bea84c
SummingSortedBlockInputStream: use a separate structure for MapDescription
2017-10-13 21:51:03 +03:00
Marek Vavruša
39a5ae97c9
SummingSortedBlockInputStream: added comments, destructor for state
2017-10-13 21:51:03 +03:00
alexey-milovidov
d561d8d701
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
alexey-milovidov
a2fa58a2e4
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
alexey-milovidov
fee883d7c5
Update SummingSortedBlockInputStream.cpp
2017-10-13 21:51:03 +03:00
alexey-milovidov
6405620dfb
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
alexey-milovidov
a5955d527d
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
alexey-milovidov
4124465d0b
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
alexey-milovidov
725379e23d
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
alexey-milovidov
9eca78273f
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
alexey-milovidov
1984782321
Update AggregateFunctionSumMap.h
2017-10-13 21:51:03 +03:00
Marek Vavruša
2edf5492d0
AggregateFunctionSumMap: support variardic arguments, specialized keys
...
The function is rewritten to avoid allocations on every insert with
Field deserialising each array. The key type is now specialized,
so it can be accessed directly. The value type is variant type,
but only individual values are deserialised (which is cheap, since they're PODs).
The function also support summing of multiple columns by the same key.
The SummingSortedBlockInputStream uses the function in case of
Nested structure with one numeric key and many values to sum.
2017-10-13 21:51:03 +03:00
Marek Vavruša
be2faa82ff
DataStreams/test: test case for nested field with two arrays for summing
2017-10-13 21:51:03 +03:00
Marek Vavruša
c09a43a7b2
DataStreams/SummingSortedBlockInputStream: use builtin aggregated functions
...
This replaces custom summation function implementations with an implementation
using built-in aggregation functions (sum and sumMap). The goal is to be able to
use specialized variants of aggregation functions, and to have a single
efficient implementation.
2017-10-13 21:51:03 +03:00
Marek Vavruša
c9be3719bc
DataStreams/tests: add SummingSortedBlockInputStream test variant
...
This is basically useful for testing SummingSortedBlockInputStream
against the AggregatingBlockInputStream, which are used in the
{Summing,Aggregating}MergeTree table engines respectively.
2017-10-13 21:51:03 +03:00
proller
cc2324c3b7
Debian: use links generated by cmake (in future maybe real binaries) ( #1348 )
...
* TEST only: why initQueryAnalyzer ?
* Better tests
* missing file
* Missing file
* Add test
* Test fixes
* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
* Removed tcp_ssl_port by default [#CLICKHOUSE-2].
* Better tests
* comment
* clean
* REmove wrong code
* clean
* Debian: use links generated by cmake (in future maybe real binaries)
2017-10-13 21:48:20 +03:00