Commit Graph

5833 Commits

Author SHA1 Message Date
Nikolai Kochetov
78991b25ee fixed preferred_max_column_in_block_size_bytes disabling 2017-07-30 01:24:57 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
proller
700d4e0904 Fix boost 1.64 and gcc7+ compile errors (#1040)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153 Update MergeTreeBaseBlockInputStream.cpp 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514 fixed column size calculation for Array column in MergeTreeReader::readRows 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9 changed skipping rows for Array columns in MergeTreeBaseBlockInputStream 2017-07-28 22:29:40 +03:00
Alexey Milovidov
4c89570988 Don't limit the size of internal queries (this is for cache dictionaries with ClickHouse source) [#CLICKHOUSE-2]. 2017-07-28 21:43:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
3502d36d7d Fixed build [#CLICKHOUSE-2]. 2017-07-28 02:23:13 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
Alexey Milovidov
acf9c2fbd5 Miscellaneous [#CLICKHOUSE-2]. 2017-07-28 00:05:33 +03:00
proller
9eb6e5b19c clang-format of Split ComplexKeyCacheDictionary (#1035)
* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes
2017-07-27 23:39:40 +03:00
Alexey Milovidov
2c815356c1 Fixed regression in parsing of CAST [#CLICKHOUSE-3180]. 2017-07-27 22:25:52 +03:00
proller
3dbde50daa Split ComplexKeyCacheDictionary to use less then 1.5G ram when compile (#1034)
* Split FunctionsArithmetic.cpp to generated functions

* Use ccache if found

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* check_include.sh: print memory usage

* Try split CacheDictionary source

* Split ok

* wip

* wip

* wip

* wip

* wip

* wip
2017-07-27 22:05:55 +03:00
Vitaliy Lyudvichenko
515271544d Add detail comment. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0 Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
proller
ff7f3af238 Split FunctionsArithmetic.cpp to generated functions 2017-07-26 21:32:35 +03:00
Nikolai Kochetov
01a004050d fixed MergeTreeBlockSizePredictor updating from empy block while reading 2017-07-26 20:03:09 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
Alexey Milovidov
3dcb2e6aed Fixed test [#CLICKHOUSE-2]. 2017-07-26 04:21:19 +03:00
Alexey Milovidov
de1f4f4c5b Merge branch 'master' of github.com:yandex/ClickHouse 2017-07-26 00:07:13 +03:00
Alexey Milovidov
d57f5b81a4 Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175]. 2017-07-26 00:07:05 +03:00
Alexey Zatelepin
64fa3ebc58 correctly choose number of merge threads for external aggregation [#CLICKHOUSE-2] 2017-07-25 22:43:23 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
Alexey Milovidov
6851a7754a Fixed linkage [#CLICKHOUSE-2]. 2017-07-25 21:32:52 +03:00
Alexey Milovidov
d20c411b0d Fixed linkage [#CLICKHOUSE-2]. 2017-07-25 21:19:22 +03:00
Alexey Zatelepin
2230bef68a reset resulting bucket_num if source blocks are from different buckets [#CLICKHOUSE-3133] 2017-07-25 20:56:09 +03:00
alexey-milovidov
b831d88162 Update ArenaAllocator.h 2017-07-25 20:06:24 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
ae3b1d8d3a Fix clang compilation. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
fefb4dad67 Get rid of old groupArray() implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
792faaa2db Add adaptive allocator. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
03e5bf9471 Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c3a15da3f8 Add support of limit parameter into groupArray. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Guillaume Tassery
03bbe9938a Function for generate an uuid v4 (#1008)
* Fix compilation error when include FunctionsRandom.h twice

* Implement function for generate UUID V4

* remove isDeterministicInScopeOfQuery for generateUUIDV4

* Uniformize RandX Implementation

* rename generateUUIDV4 into generateUUIDv4

* Modify random function for making it more generic
2017-07-25 20:00:38 +03:00
Alexey Zatelepin
18672204e5 fix handling of overflow data during external aggregation [#CLICKHOUSE-3133] 2017-07-25 19:56:48 +03:00
Alexey Zatelepin
cd5dc7ca29 fix segfault when handling overflow blocks in MergingAggregatedMemoryEfficientBlockInputStream [#CLICKHOUSE-3133] 2017-07-25 19:56:48 +03:00
Alexey Milovidov
f153d5f5db Additions to prev. revision [#CLICKHOUSE-2]. 2017-07-25 01:53:44 +03:00
Alexey Milovidov
b4c610a8e7 Fixed errors [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
188ee349bd Fixed errors [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
a6df2e7151 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
487278e2f5 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
3144cbc9c1 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
94768fe9bf Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
52b5bae62f Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
30ff4a78a6 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
14de659c99 Added support for non-constant offset and size for substring function [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
4a4e863f9d Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
0c8e082954 Using GatherUtils (experimental) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
366ad1595e Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
1557fa2e8d Removed "dispatchFor" templates, because gcc 6 cannot compile them (only clang is capable) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
ffbd2f46f9 GatherUtils (experimental) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
9540a2da90 GatherUtils (experimental) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
bfdc108a08 Cleaning old code [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
Alexey Milovidov
ee81d53bd5 Functions simplification [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
alexey-milovidov
bbe70e8cfa Update FunctionsStringSearch.cpp 2017-07-24 20:36:16 +03:00
alexey-milovidov
d3159ed2c5 Merge pull request #1015 from yandex/fix-performance-after-changing-reading
Fix performance after changing reading
2017-07-24 18:07:57 +03:00
Nikolai Kochetov
fcd50e3629 fixed comment 2017-07-24 18:06:32 +03:00
proller
eba5ad73ec clean 2017-07-24 18:04:49 +03:00
proller
57b9bcd354 Fix missing includes 2017-07-24 18:04:49 +03:00
Vitaliy Lyudvichenko
bc9ee54985 Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896] 2017-07-24 18:04:17 +03:00
Nikolai Kochetov
b55dcc9f93 cnanged comments; fixed 00443_preferred_block_size_bytes test 2017-07-24 16:59:03 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
Alexey Milovidov
a76061e1a9 Fixed MAC address related functions; added test [#CLICKHOUSE-3]. 2017-07-23 09:13:57 +03:00
Alexey Milovidov
1e8547b3f6 Fixed regression [#CLICKHOUSE-3148]. 2017-07-21 23:59:01 +03:00
Alexey Milovidov
31d8ba3b34 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 23:20:22 +03:00
Nikolai Kochetov
10bbededb0 merged with master 2017-07-21 21:10:14 +03:00
Nikolai Kochetov
bc0921a64e added comments 2017-07-21 21:02:02 +03:00
alexey-milovidov
6d47981e86 Update Collator.cpp 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
1b8a062e7b Issue #1000 - Returned some remote code in Collator.app 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
e85cd44e48 Issue #1000 - remove 'diagnostic ignored -Wunused-private-field' in Collator.app 2017-07-21 20:59:39 +03:00
Alexey Zatelepin
c939d2f96e put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163] 2017-07-21 20:55:38 +03:00
Nikolai Kochetov
ca1957ab82 ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170] 2017-07-21 20:54:09 +03:00
Nikolai Kochetov
cc349b410e set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170] 2017-07-21 20:54:09 +03:00
Nikolai Kochetov
5477e7c1f9 added date and time to number functions [#CLICKHOUSE-3132] 2017-07-21 20:51:08 +03:00
Nikolai Kochetov
c64b65ee29 ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170] 2017-07-21 20:45:51 +03:00
Nikolai Kochetov
755d16b22d set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170] 2017-07-21 14:55:33 +03:00
Alexey Milovidov
3a0bf8e642 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:55:33 +03:00
Alexey Milovidov
e1cc8289b2 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:46:50 +03:00
Alexey Milovidov
c7b1e92522 Fixed error after merge [#CLICKHOUSE-3150]. 2017-07-21 09:40:05 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011)
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
alexey-milovidov
1a1112d8bb Update MergeTreeBlockReadUtils.h 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
0b7439469d fixed MergeTreeBlockSizePredictor initialization for sample block 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
00ae32c946 renamed approximate_number_of_rows_in_part to number_of_rows_in_part 2017-07-20 23:45:23 +03:00
Nikolai Kochetov
e612152584 changed initialization in MergeTreeBlockSizePredictor 2017-07-20 23:45:23 +03:00
Vladimir Chebotarev
7254478fde functions: Remote mode for hasColumnInTable. [#CHEBOTAREV-9] 2017-07-20 17:08:42 +03:00
Nikolai Kochetov
2afd84c40c fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 19:39:18 +03:00
Guillaume Tassery
57b4066da8 Improve performance for deserialization/serialization of UUID type 2017-07-19 19:26:37 +03:00
proller
3f9cdfe464 PerformanceTest: Add memory and threads info (#1004)
* Cmake: clear test variables with CMakePushCheckState (it will fix macos build issue)

* Add some perf tests

* Fix PerformanceTest, fix tests

* Add nyc-taxi queries

* Update PerformanceTest.cpp

* PerformanceTest: allow recursive .xml search

* Tests tune

* Move tests to dirs

* --recursive

* Add space

* PerformanceTest: Add memory and threads info
2017-07-19 18:18:47 +03:00
Nikolai Kochetov
b5e94ede62 fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161] 2017-07-19 16:44:46 +03:00
Alexey Milovidov
6e6e9f9d38 Removed useless variable [#CLICKHOUSE-3161]. 2017-07-19 04:05:39 +03:00
proller
ae626281b6 PerformanceTest: add --recursive option. add more threaded/not threaded tests (#997)
* Cmake: clear test variables with CMakePushCheckState (it will fix macos build issue)

* Add some perf tests

* Fix PerformanceTest, fix tests

* Add nyc-taxi queries

* Update PerformanceTest.cpp

* PerformanceTest: allow recursive .xml search

* Tests tune

* Move tests to dirs

* --recursive

* Add space
2017-07-18 23:41:24 +03:00
Alexey Zatelepin
4866a37a2b fix selecting max_threads for MergingAggregatedBlockInputStream [#CLICKHOUSE-3156] 2017-07-18 23:40:23 +03:00
alexey-milovidov
25288ac4d5 Update PerformanceTest.cpp 2017-07-18 19:35:01 +03:00