Commit Graph

12603 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
3b466ec57b Add deduplication test. [#CLICKHOUSE-3381] 2017-10-26 18:22:34 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Nikolai Kochetov
371e234f01 changed ExternalLoader::getObjectsMap return type [#CLICKHOUSE-3305] 2017-10-26 17:26:03 +03:00
Vitaliy Lyudvichenko
602560cb2e Update system.parts table. [#CLICKHOUSE-3178] 2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
483dfd1b44 Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
397b8bcf92 Smarter parts deletion. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
a5e29f2166 Add integration test. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf Fixed awful copypaste. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
71833a7f0f More correct procedure of parts deleting. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421 Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088 Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257 Add state for MergeTree parts. [#CLICKHOUSE-3178]
And Removed obsolete code.
2017-10-26 17:16:06 +03:00
Nikolai Kochetov
092567af39 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:10:51 +03:00
Nikolai Kochetov
4204a94b20 changed CatBoost model evaluate signature [#CLICKHOUSE-3305] 2017-10-26 17:08:05 +03:00
Alexey Zatelepin
ec963e3397 save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000] 2017-10-26 17:07:15 +03:00
Nikolai Kochetov
2e6b1dfd92 renamed cloneObject to clone in IExternalLoadable [#CLICKHOUSE-3305] 2017-10-26 16:42:14 +03:00
Nikolai Kochetov
c3d104f53b changed IDictionary clone [#CLICKHOUSE-3305] 2017-10-26 16:41:51 +03:00
Alexey Zatelepin
f130d2df65 fix creation of system log tables [#CLICKHOUSE-2] 2017-10-26 15:44:47 +03:00
Nikolai Kochetov
fd8eb13dcc refactoring [#CLICKHOUSE-3305] 2017-10-26 15:18:37 +03:00
Alexey Zatelepin
88c4ea1ac3 allow specifying ENGINE for CREATE TEMPORARY TABLE (but only if it is Memory) [#CLICKHOUSE-2] 2017-10-26 15:15:33 +03:00
proller
9ccba5fad1 Fix includes 2017-10-26 14:46:57 +03:00
Alexey Zatelepin
6ada6d9aa5 remove dead code [#CLICKHOUSE-2] 2017-10-26 07:53:52 +03:00
Alexey Zatelepin
01c39dcf1c fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Milovidov
2cc3fdae9b Useless modifications for cppcheck [#CLICKHOUSE-2]. 2017-10-26 04:47:03 +03:00
Marek Vavruša
ee22253857 tests: added tests for sumWithOverflow(x) preserving input type 2017-10-25 22:21:59 +03:00
Marek Vavruša
c0458999f9 SummingSortedBlockInputStream: fix summing of multiple blocks
Previously the destination columns were only computed for the first
block, so that subsequently written blocks failed to write
aggregation results to corrent columns.
2017-10-25 22:21:59 +03:00
Marek Vavruša
e936c4d066 AggregateFunctionSum: implemented sumWithOverflow(x)
By default sum(x) promotes the result type to
largest possible integral type to avoid
arithmetic overflow when summing values from
smaller data types.

This is generally desirable behaviour, but it doesn’t
work with summing merge tree, as the result is
expected to be of same type as the input.
2017-10-25 22:21:59 +03:00
Marek Vavruša
5c87a91aaf SummingSortedBlockInputStream: fix explicitly configured columns to sum
This fixes a variant of SummingMergeTree() in which
the columns to sum are explicitly configured.
Previously columns not in that list were ignored,
instead of writing last value.

This also fixes summation of invalid maps with
with only one key column and no value columns.

Modified test to work around compaction limitation
in which a zero-value column isn’t compacted
immediately if the inputs are non-zero but the
output is zero (+1 -1).
2017-10-25 22:21:59 +03:00
Marek Vavruša
fa098b469c AggregateFunctionSumMap: compact keys with zero value
This allows `sumMap(k, v)` to compact all keys
for which the values are all zero.
2017-10-25 22:21:59 +03:00
Alexey Milovidov
65982a1642 Fixed exception messages [#CLICKHOUSE-2]. 2017-10-25 22:17:37 +03:00
Alexey Milovidov
93e32e92fa Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-25 21:53:44 +03:00
Alexey Milovidov
84d966f0d3 Fixed overflow in function toRelativeWeekNum with argument of first week of unix epoch; result values changed by 1 [#CLICKHOUSE-3384]. 2017-10-25 21:53:35 +03:00
proller
4ffbca2d8c Fix warnings (#1406)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
Nikolai Kochetov
54786902c3 added test [#CLICKHOUSE-3305]
added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]

added test [#CLICKHOUSE-3305]
2017-10-25 20:08:46 +03:00
alexey-milovidov
ca3c209f18 Merge pull request #1401 from proller/fix8
Update submodule contrib/poco
2017-10-25 05:05:33 +03:00
Marek Vavruša
d942ca0c0b Updated exceptions and added comments. 2017-10-24 17:57:03 -07:00
proller
00c995bffc Update submodule contrib/poco 2017-10-25 01:03:37 +03:00
proller
f5853a7af6 Fix revision of submodule contrib/librdkafka 2017-10-25 00:56:24 +03:00
alexey-milovidov
b5155916a8 Merge branch 'master' into materialized-view-to 2017-10-24 22:39:24 +03:00
alexey-milovidov
996b18c816 Merge pull request #1398 from yandex/revert-1381-fix2
Revert "Make gperftools (libtcmalloc) as submodule and update."
2017-10-24 22:18:28 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)"
This reverts commit fa2484ea90.
2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381)
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
2017-10-24 22:11:42 +03:00
alexey-milovidov
6d62a117a1 Merge pull request #1395 from proller/fix4
Fix stripping debug info from huge .o (-g0)
2017-10-24 22:04:21 +03:00
Alexey Milovidov
66f099cf93 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-24 21:28:31 +03:00
Alexey Milovidov
7c99e50a2f Fixed build [#CLICKHOUSE-2]. 2017-10-24 21:28:20 +03:00
alexey-milovidov
c8d66bfed0 Merge pull request #1391 from yandex/arbitrary-partitioning
Custom partitioning 3
2017-10-24 21:18:34 +03:00
Alexey Zatelepin
6bb34a4494 Merge branch 'master' into arbitrary-partitioning
Conflicts:
	dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Alexey Zatelepin
b6b5d1cf25 store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000] 2017-10-24 17:11:53 +03:00
proller
2d2a4afa3f Fix stripping debug info from huge .o (-g0) 2017-10-24 16:30:44 +03:00