Commit Graph

8477 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Alexey Milovidov
e6739cc35d Whitespace [#CLICKHOUSE-2]. 2017-08-10 22:41:21 +03:00
proller
2344fe7dae Cmake: fix tests includes (#1090)
Cmake: fix tests includes
2017-08-10 20:51:45 +03:00
alexey-milovidov
4398d71ef5 Update StorageDistributed.h 2017-08-10 07:37:35 +03:00
alexey-milovidov
0282d516a4 Update DistributedBlockOutputStream.cpp 2017-08-10 07:10:36 +03:00
alexey-milovidov
2717c94a36 Update DistributedBlockOutputStream.cpp 2017-08-10 07:05:16 +03:00
alexey-milovidov
0285f99c4e Update DistributedBlockOutputStream.cpp 2017-08-10 06:54:02 +03:00
alexey-milovidov
57a9d22b0c Update DistributedBlockOutputStream.cpp 2017-08-10 06:49:03 +03:00
alexey-milovidov
c665c4c4e5 Update DirectoryMonitor.h 2017-08-10 06:46:16 +03:00
alexey-milovidov
5773832979 Update DirectoryMonitor.cpp 2017-08-10 06:45:57 +03:00
alexey-milovidov
bf77c602de Update Settings.h 2017-08-10 06:44:34 +03:00
alexey-milovidov
a122cd613a Update FunctionsExternalDictionaries.h 2017-08-10 06:29:06 +03:00
alexey-milovidov
b01f0c6d13 Update CacheDictionary.cpp 2017-08-10 06:29:06 +03:00
alexey-milovidov
0fbda791b5 Update iostream_debug_helpers.h 2017-08-10 06:29:06 +03:00
proller
4cda5b4470 Fix result 2017-08-10 06:29:06 +03:00
proller
6ca798a357 Fix infinite loop in dictGetHierarchy if id chain looped 2017-08-10 06:29:06 +03:00
proller
7937903d56 Improve debug helpers 2017-08-10 06:29:06 +03:00
proller
139d9e5c19 Config: Allow multiple dictionaries_config 2017-08-10 06:17:19 +03:00
Vadim Skipin
e6344f9048 Extract handlers to allow reuse 2017-08-10 06:13:15 +03:00
Vadim Skipin
f1e88e074c Introduce IServer to host handlers 2017-08-10 06:13:15 +03:00
proller
2ea63defa5 Fix test/string_pool include (#1086)
* Fix sparcehash include

* Fix re2_st include

* Fix test/string_pool include
2017-08-10 03:28:29 +03:00
Alexey Milovidov
46b5c9ce03 Miscellaneous [#CLICKHOUSE-2]. 2017-08-10 02:57:54 +03:00
proller
c351b367fb Fix sparcehash include (#1084)
* Fix sparcehash include

* Fix re2_st include
2017-08-10 02:11:28 +03:00
Alexey Milovidov
e86d0b4a74 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-10 00:07:10 +03:00
Alexey Milovidov
56a5bb53fa Miscellaneous [#CLICKHOUSE-2]. 2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko
27174d9dd2 Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2] 2017-08-09 23:57:42 +03:00
proller
ac178bde1f Cmake: link ltdl with pocoodbc static only. rename ARM -> ARCH_ARM (#1083)
* Cmake: link ltdl with pocoodbc static only. rename ARM -> ARCH_ARM

* Fix lib find order

* Allow define non-contrib cityhash farmhash metrohash

* Fix message

* Cmake: fixes

* clean

* Update CMakeLists.txt
2017-08-09 23:52:55 +03:00
Alexey Milovidov
1daf11153a Fixed typo [#CLICKHOUSE-2]. 2017-08-09 18:34:30 +03:00
robot-metrika-test
6a4460c69f Auto version update to [54269] 2017-08-09 16:36:38 +03:00
Alexey Milovidov
4f633f316c Removed TODO [#CLICKHOUSE-2]. 2017-08-09 04:38:56 +03:00
Alexey Milovidov
6edb14ba6b Fixed garbage [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Alexey Milovidov
1fc8548018 Fixing garbage (incomplete) [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Alexey Milovidov
9bbcfbd35c Fixed error [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Alexey Milovidov
b0b7f1b161 Miscellaneous [#CLICKHOUSE-2]. 2017-08-08 23:58:18 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
robot-metrika-test
4c0a0d07e9 Auto version update to [54268] 2017-08-08 14:50:37 +03:00
Vitaliy Lyudvichenko
00ce8c9603 Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173] 2017-08-08 03:28:43 +03:00
Alexey Milovidov
864cae7107 Fixed test [#CLICKHOUSE-3]. 2017-08-08 03:25:05 +03:00
Marek Vavruša
65a90288dc PKCondition: added tests for subexpr inference (#951) 2017-08-08 03:19:39 +03:00
Alexey Milovidov
692b923b0c Use in SELECT even shards with zero weight [#CLICKHOUSE-3204]. 2017-08-08 03:06:21 +03:00
Nikolai Kochetov
ea2b486735 added threadpool to DistributedBlockOutputStream 2017-08-07 23:26:28 +03:00
Alexey Milovidov
8fb22b1dcb Added failing test [#CLICKHOUSE-2]. 2017-08-07 11:05:03 +03:00
Alexey Milovidov
46be81bc88 Fixed error [#CLICKHOUSE-2]. 2017-08-07 11:03:23 +03:00
Alexey Milovidov
ff54c93a22 Miscellaneous [#CLICKHOUSE-2]. 2017-08-07 04:37:52 +03:00
Alexey Milovidov
f386788278 Using GatherUtils for function if on arguments of type Array(String) [#CLICKHOUSE-2]. 2017-08-05 07:13:23 +03:00
Alexey Milovidov
c2a32990bb Added test [#CLICKHOUSE-2]. 2017-08-05 07:13:23 +03:00
Alexey Milovidov
d70f59e9bb Added performance test [#CLICKHOUSE-2]. 2017-08-05 07:13:23 +03:00
Alexey Milovidov
5ddc354989 Using GatherUtils for function if on arguments of type Array(String) [#CLICKHOUSE-2]. 2017-08-05 07:13:23 +03:00
Alexey Milovidov
8536fb96f7 Fixed error message in case of syntax error [#CLICKHOUSE-2]. 2017-08-05 06:31:52 +03:00
Alexey Milovidov
24d8f0aedf Added performance test [#CLICKHOUSE-2]. 2017-08-05 06:30:54 +03:00
Alexey Milovidov
19ff0db9f1 Using GatherUtils for if on numeric arrays [#CLICKHOUSE-2]. 2017-08-05 06:30:54 +03:00
Alexey Milovidov
6648d6dee4 Using GatherUtils for if on numeric arrays [#CLICKHOUSE-2]. 2017-08-05 06:30:54 +03:00
Alexey Milovidov
8d7214e554 Added performance test [#CLICKHOUSE-3202]. 2017-08-05 05:29:38 +03:00
Alexey Milovidov
57b2dbfa93 Added test [#CLICKHOUSE-3202]. 2017-08-05 05:24:13 +03:00
Alexey Milovidov
11da533de1 Fixed function if of FixedString arguments [#CLICKHOUSE-3202]. 2017-08-05 05:13:38 +03:00
Alexey Milovidov
39392a2961 Fixed function if of FixedString arguments [#CLICKHOUSE-3202]. 2017-08-05 05:03:49 +03:00
Alexey Milovidov
46486a5cba Fixed function if of FixedString arguments [#CLICKHOUSE-3202]. 2017-08-05 04:54:38 +03:00
Alexey Milovidov
0c0c8da4f8 Fixed function if of FixedString arguments [#CLICKHOUSE-3202]. 2017-08-05 04:43:29 +03:00
Alexey Milovidov
aecafc0931 Fixed function if of FixedString arguments [#CLICKHOUSE-3202]. 2017-08-05 02:18:51 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Nikolai Kochetov
63ec81e2e3 added threadpool for sync insertion into distributed 2017-08-03 20:42:31 +03:00
Nikolai Kochetov
83cd2a40e4 added test 2017-08-03 15:58:04 +03:00
Nikolai Kochetov
0c15b2c6fc fixed number of rows to read from first granula in mergetree 2017-08-03 15:58:04 +03:00
proller
d6833a0d55 Cmake: remove global include_directories (#1055)
* Fix .h compile

* Cmake: remove global include_directories

* boost include hide

* fix cctz

* add \n
2017-08-03 15:44:39 +03:00
Vitaliy Lyudvichenko
003d2a9478 Add comprehensive exception message for ZooKeeper::multi(). [#CLICKHOUSE-2] 2017-08-03 15:42:23 +03:00
robot-metrika-test
afc4b1bef2 Auto version update to [54267] 2017-08-02 17:13:14 +03:00
alexey-milovidov
ae8783aee3 Merge pull request #1045 from prog8/nocompression
Added compression NONE
2017-08-01 23:07:52 +03:00
alexey-milovidov
2ae6f1ebdb Update MergeTreeDataWriter.cpp 2017-08-01 23:07:16 +03:00
Alexey Milovidov
30cb7da23b Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-01 20:26:57 +03:00
Alexey Milovidov
35ff7ab9f2 Added test [#METR-25976]. 2017-08-01 20:26:36 +03:00
robot-metrika-test
b591304265 Auto version update to [54266] 2017-08-01 20:14:45 +03:00
Alexey Milovidov
1d7a91a544 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-01 20:02:51 +03:00
Alexey Milovidov
fd9b8c6fbe Fixed error [#METR-25976]. 2017-08-01 20:02:41 +03:00
proller
8f6c2d4e47 Fix .h compile 2017-08-01 18:02:16 +03:00
Pawel Rog
d6a2056851 Applied changes requested by Alexey 2017-08-01 16:48:24 +02:00
Alexey Milovidov
34ac4fa3b8 Added metric with revision number for better monitoring of deployment [#CLICKHOUSE-2]. 2017-08-01 17:34:06 +03:00
Alexey Milovidov
fd5ac57b8e Addition to prev. revision [#CLICKHOUSE-2]. 2017-08-01 17:33:38 +03:00
proller
db984d92a8 Fix crash on start 2017-08-01 16:36:07 +03:00
Pawel Rog
9f799820d9 Applied changes requested by Alexey 2017-08-01 10:12:15 +02:00
Alexey Milovidov
9a546b5414 Fixed build with gcc 6 [#CLICKHOUSE-2]. 2017-08-01 04:58:18 +03:00
Alexey Milovidov
a6cb383c4f Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 04:25:03 +03:00
Alexey Milovidov
844990db27 Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 00:50:21 +03:00
Alexey Milovidov
f8a761fbd9 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:44:57 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
alexey-milovidov
d174ebc5c9 Update MergeTreeDataWriter.cpp 2017-07-31 20:44:58 +03:00
alexey-milovidov
4877aa394c Update MergeTreeData.cpp 2017-07-31 20:44:41 +03:00
alexey-milovidov
fdb7e080be Update CompressedWriteBuffer.cpp 2017-07-31 20:43:33 +03:00
alexey-milovidov
50244880cc Update CompressedReadBufferBase.cpp 2017-07-31 20:42:23 +03:00
alexey-milovidov
3d2ec763ed Update CompressedReadBufferBase.cpp 2017-07-31 20:40:56 +03:00
Pawel Rog
3a6c444996 Merge branch 'master' into nocompression 2017-07-31 13:36:58 +02:00
Pawel Rog
e1ab721d3d Use compression method from configs 2017-07-31 13:12:28 +02:00
Pawel Rog
a0cc54457e Added compression NONE 2017-07-31 12:44:45 +02:00
robot-metrika-test
0e6ab4d8ca Auto version update to [54265] 2017-07-31 03:51:31 +03:00
Alexey Milovidov
b12ee66520 Merge branch 'master' of github.com:yandex/ClickHouse 2017-07-31 03:50:17 +03:00
Alexey Milovidov
4e76c96381 Temporarily disabled "preferred_max_column_in_block_size_bytes" option [#CLICKHOUSE-3188]. 2017-07-31 03:50:06 +03:00
robot-metrika-test
44652bc41a Auto version update to [54264] 2017-07-30 23:31:37 +03:00
Alexey Milovidov
306070d2cc Fixed error in one of prev. revisions [#CLICKHOUSE-3150]. 2017-07-30 22:47:32 +03:00
proller
460d66c68d Split FunctionsArray.cpp register (#1043)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* gcc7 fixes

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* Fix arm build

* Fix nothrow

* Better arm detection

* Split FunctionsArray.cpp register
2017-07-30 15:31:58 +03:00
Nikolai Kochetov
78991b25ee fixed preferred_max_column_in_block_size_bytes disabling 2017-07-30 01:24:57 +03:00
robot-metrika-test
be9a48420e Auto version update to [54263] 2017-07-29 23:25:01 +03:00
proller
465d305479 gcc7 and arm fixes (#1041)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* gcc7 fixes

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* Fix arm build

* Fix nothrow

* Better arm detection
2017-07-29 22:58:10 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
proller
700d4e0904 Fix boost 1.64 and gcc7+ compile errors (#1040)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153 Update MergeTreeBaseBlockInputStream.cpp 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
da9b515e22 added tests 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514 fixed column size calculation for Array column in MergeTreeReader::readRows 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9 changed skipping rows for Array columns in MergeTreeBaseBlockInputStream 2017-07-28 22:29:40 +03:00
Alexey Milovidov
4c89570988 Don't limit the size of internal queries (this is for cache dictionaries with ClickHouse source) [#CLICKHOUSE-2]. 2017-07-28 21:43:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
3502d36d7d Fixed build [#CLICKHOUSE-2]. 2017-07-28 02:23:13 +03:00
Alexey Milovidov
e4af70149f Fixed build [#CLICKHOUSE-2]. 2017-07-28 00:27:10 +03:00
Alexey Milovidov
8523d3fc8f Testing mysqlxx::PoolWithFailover [#CLICKHOUSE-3167] 2017-07-28 00:11:57 +03:00
Alexey Milovidov
acf9c2fbd5 Miscellaneous [#CLICKHOUSE-2]. 2017-07-28 00:05:33 +03:00
proller
9eb6e5b19c clang-format of Split ComplexKeyCacheDictionary (#1035)
* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes
2017-07-27 23:39:40 +03:00
Alexey Milovidov
2c815356c1 Fixed regression in parsing of CAST [#CLICKHOUSE-3180]. 2017-07-27 22:25:52 +03:00
proller
3dbde50daa Split ComplexKeyCacheDictionary to use less then 1.5G ram when compile (#1034)
* Split FunctionsArithmetic.cpp to generated functions

* Use ccache if found

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* check_include.sh: print memory usage

* Try split CacheDictionary source

* Split ok

* wip

* wip

* wip

* wip

* wip

* wip
2017-07-27 22:05:55 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Vitaliy Lyudvichenko
515271544d Add detail comment. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
da9cdfc2f2 Fix integration tests. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
bf1949fc11 Add test. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0 Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
robot-metrika-test
88f29129de Auto version update to [54262] 2017-07-26 22:44:29 +03:00
proller
ff7f3af238 Split FunctionsArithmetic.cpp to generated functions 2017-07-26 21:32:35 +03:00
Nikolai Kochetov
63cdf84fe3 added test 00481_reading_from_last_granula 2017-07-26 20:03:09 +03:00
Nikolai Kochetov
01a004050d fixed MergeTreeBlockSizePredictor updating from empy block while reading 2017-07-26 20:03:09 +03:00
Nikolai Kochetov
19d3c36871 added tests for synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-26 17:41:21 +03:00
Alexey Milovidov
7744b24658 Merge branch 'master' of github.com:yandex/ClickHouse 2017-07-26 08:57:31 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
robot-metrika-test
9e7be70e03 Auto version update to [54261] 2017-07-26 04:25:28 +03:00
Alexey Milovidov
3dcb2e6aed Fixed test [#CLICKHOUSE-2]. 2017-07-26 04:21:19 +03:00
Alexey Milovidov
de1f4f4c5b Merge branch 'master' of github.com:yandex/ClickHouse 2017-07-26 00:07:13 +03:00
Alexey Milovidov
d57f5b81a4 Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175]. 2017-07-26 00:07:05 +03:00
Alexey Zatelepin
64fa3ebc58 correctly choose number of merge threads for external aggregation [#CLICKHOUSE-2] 2017-07-25 22:43:23 +03:00
Nikolai Kochetov
b3157aebb2 added synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-25 22:42:36 +03:00
Alexey Zatelepin
2aaa847e10 add forgotten files [#CLICKHOUSE-3126] 2017-07-25 19:36:14 +00:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
Alexey Milovidov
6851a7754a Fixed linkage [#CLICKHOUSE-2]. 2017-07-25 21:32:52 +03:00
Alexey Milovidov
b52d2eab51 Fixed linkage [#CLICKHOUSE-2]. 2017-07-25 21:20:50 +03:00
Alexey Milovidov
d20c411b0d Fixed linkage [#CLICKHOUSE-2]. 2017-07-25 21:19:22 +03:00
Alexey Zatelepin
2230bef68a reset resulting bucket_num if source blocks are from different buckets [#CLICKHOUSE-3133] 2017-07-25 20:56:09 +03:00
alexey-milovidov
b831d88162 Update ArenaAllocator.h 2017-07-25 20:06:24 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
ae3b1d8d3a Fix clang compilation. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
1c574af576 Add more tests. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00