Commit Graph

2225 Commits

Author SHA1 Message Date
proller
19042816c4 Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) (#1325) 2017-10-06 19:26:32 +03:00
Nikolai Kochetov
61bef2adf1 added ExternalLoader [#CLICKHOUSE-3305] 2017-10-06 13:31:06 +03:00
Alexey Zatelepin
6e57272052 don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1 add comments [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757 forbid ALTER of partition key columns for now [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91 serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741 partition serialization into id and text [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a absence of partitioning works [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932 load partition and minmax index from disk [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8 serialize partition and minmax index values [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Nikolai Kochetov
322e56c692 fix reading with preferred_block_size_bytes = 0 2017-09-24 02:16:30 +03:00
Alexey Zatelepin
df58949a68 make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259] 2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258] 2017-09-20 06:05:20 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5 Fixed merges progress bar. [#CLICKHOUSE-2] 2017-09-15 01:04:13 +03:00
Vadim Skipin
e0a1e6982b Context parameter added to the IDatabase methods 2017-09-11 21:29:26 +03:00
proller
5054d50307 Remove too noisy message (#CLICKHOUSE-3304) 2017-09-11 21:26:43 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
5a8f47a640 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:07:32 +03:00
Alexey Milovidov
a6d5e9c7e8 Fixed not an issue, shown by TSan [#CLICKHOUSE-2]. 2017-09-10 02:04:22 +03:00
Alexey Milovidov
94b975e7f9 Removed function deprecated in C++ [#CLICKHOUSE-3174]. 2017-09-09 02:31:18 +03:00
Alexey Milovidov
ed1c0820f0 Fixed minor issue found by Coverity [#CLICKHOUSE-3285]. 2017-09-09 02:25:42 +03:00
Alexey Milovidov
a81028377e Implemented some suggestions from clang-tidy (part 9) [#CLICKHOUSE-3301]. 2017-09-08 08:03:21 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
6307661c35 Addition to prev. revision [#CLICKHOUSE-3300]. 2017-09-08 00:26:25 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Alexey Milovidov
0dcee75180 Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300]. 2017-09-07 22:13:37 +03:00
Alexey Milovidov
d82b87aaef Fixed redundand code in better way [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
Alexey Milovidov
87fab3396e Fixed build [#CLICKHOUSE-2]. 2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
88c9dcbb3d Changed method signature. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Nikolai Kochetov
937f37c489 fixed reading of empty block in prewhere [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Nikolai Kochetov
a9e2a17f69 fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266] 2017-09-01 15:18:40 +03:00
Alexey Zatelepin
d2847f22af PR fixes [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169 check alter of partition key columns [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
dc5809ed8d get rid of unneeded variable [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876 remove unnecessary include [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf rename partition -> partition_id for clarity [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53 generalize MinMax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8 split partition and minmax index [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
5916d823ef Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238] 2017-08-30 17:34:40 +03:00
Alexey Milovidov
e4eb6f0cfb Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 22:02:07 +03:00
Alexey Milovidov
709eba2a00 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-29 21:51:58 +03:00
Alexey Milovidov
04af7a3349 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko
84660029ec Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252] 2017-08-29 20:49:37 +03:00
Alexey Milovidov
8d7937cc30 Fixed bad translation [#CLICKHOUSE-2]. 2017-08-29 17:08:25 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
fd63277b15 Unified spelling. [#CLICKHOUSE-2] 2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko
37820f7f64 Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252] 2017-08-28 18:27:25 +03:00
Nikolai Kochetov
c43a13cb81 fixed async insertion into local shard of distributed [#CLICKHOUSE-3245] 2017-08-23 15:44:18 +03:00
Alexey Milovidov
e25f232b5a Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2] 2017-08-19 01:56:19 +03:00
Vitaliy Lyudvichenko
e52428ddb2 Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2]
Resolves #1112
Resolves #598
2017-08-19 00:10:53 +03:00
Vadim Skipin
61f65e97a8 Fix typo 2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko
f28d0cff3c Add more detailed exception message. [#CLICKHOUSE-3234] 2017-08-17 23:06:38 +03:00
Nikolai Kochetov
850bc9f19d fixed reading const zero column in prewhere 2017-08-17 23:06:00 +03:00
proller
175cd99288 Freebsd fixes: fix build with libc++, fix find system lib double-conversion (#1109)
* Cmake: Don't detect and use -no-pie flag with clang

* Camke: find_unwind: Fix disable on arm

* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Alexey Milovidov
3a86673aea Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232]. 2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1 Little better [#CLICKHOUSE-3231]. 2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0185fd4542 fix parsing min-max dates from part name [#CLICKHOUSE-3000] 2017-08-15 23:03:59 +03:00
Alexey Zatelepin
372801c59b fix comments [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Alexey Zatelepin
0df4ae6b02 do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Alexey Zatelepin
f25f0cd759 reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
8a14cc49ff asyncMulti() -> multi(). [#CLICKHOUSE-3221] 2017-08-15 19:18:02 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a remove shard multiplexing code, simplify [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
133be4d739 move and rename things [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Nikolai Kochetov
24b5a59f8c merged with remote [#CLICKHOUSE-3033] 2017-08-11 18:38:46 +03:00
Nikolai Kochetov
90940d8423 Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033] 2017-08-11 18:02:07 +03:00
Vitaliy Lyudvichenko
cd3a696d8b Add requested changes. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Alexey Milovidov
e6739cc35d Whitespace [#CLICKHOUSE-2]. 2017-08-10 22:41:21 +03:00
alexey-milovidov
4398d71ef5 Update StorageDistributed.h 2017-08-10 07:37:35 +03:00
alexey-milovidov
0282d516a4 Update DistributedBlockOutputStream.cpp 2017-08-10 07:10:36 +03:00
alexey-milovidov
2717c94a36 Update DistributedBlockOutputStream.cpp 2017-08-10 07:05:16 +03:00
alexey-milovidov
0285f99c4e Update DistributedBlockOutputStream.cpp 2017-08-10 06:54:02 +03:00
alexey-milovidov
57a9d22b0c Update DistributedBlockOutputStream.cpp 2017-08-10 06:49:03 +03:00
alexey-milovidov
c665c4c4e5 Update DirectoryMonitor.h 2017-08-10 06:46:16 +03:00
alexey-milovidov
5773832979 Update DirectoryMonitor.cpp 2017-08-10 06:45:57 +03:00
Alexey Milovidov
e86d0b4a74 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-10 00:07:10 +03:00
Alexey Milovidov
56a5bb53fa Miscellaneous [#CLICKHOUSE-2]. 2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko
27174d9dd2 Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2] 2017-08-09 23:57:42 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
Vitaliy Lyudvichenko
00ce8c9603 Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173] 2017-08-08 03:28:43 +03:00
Nikolai Kochetov
ea2b486735 added threadpool to DistributedBlockOutputStream 2017-08-07 23:26:28 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Nikolai Kochetov
63ec81e2e3 added threadpool for sync insertion into distributed 2017-08-03 20:42:31 +03:00
Nikolai Kochetov
0c15b2c6fc fixed number of rows to read from first granula in mergetree 2017-08-03 15:58:04 +03:00
alexey-milovidov
ae8783aee3 Merge pull request #1045 from prog8/nocompression
Added compression NONE
2017-08-01 23:07:52 +03:00
alexey-milovidov
2ae6f1ebdb Update MergeTreeDataWriter.cpp 2017-08-01 23:07:16 +03:00
Pawel Rog
d6a2056851 Applied changes requested by Alexey 2017-08-01 16:48:24 +02:00
Pawel Rog
9f799820d9 Applied changes requested by Alexey 2017-08-01 10:12:15 +02:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
alexey-milovidov
d174ebc5c9 Update MergeTreeDataWriter.cpp 2017-07-31 20:44:58 +03:00
alexey-milovidov
4877aa394c Update MergeTreeData.cpp 2017-07-31 20:44:41 +03:00
Pawel Rog
3a6c444996 Merge branch 'master' into nocompression 2017-07-31 13:36:58 +02:00
Pawel Rog
e1ab721d3d Use compression method from configs 2017-07-31 13:12:28 +02:00
Pawel Rog
a0cc54457e Added compression NONE 2017-07-31 12:44:45 +02:00
Nikolai Kochetov
78991b25ee fixed preferred_max_column_in_block_size_bytes disabling 2017-07-30 01:24:57 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
proller
700d4e0904 Fix boost 1.64 and gcc7+ compile errors (#1040)
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* Requested changes

* Fix boost 1.64 and gcc7+ compile errors

* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153 Update MergeTreeBaseBlockInputStream.cpp 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514 fixed column size calculation for Array column in MergeTreeReader::readRows 2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9 changed skipping rows for Array columns in MergeTreeBaseBlockInputStream 2017-07-28 22:29:40 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
3502d36d7d Fixed build [#CLICKHOUSE-2]. 2017-07-28 02:23:13 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Vitaliy Lyudvichenko
515271544d Add detail comment. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0 Update ReplicatedMergeTreeCleanupThread.cpp 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921 Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0 Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173] 2017-07-27 11:19:20 +03:00
Nikolai Kochetov
01a004050d fixed MergeTreeBlockSizePredictor updating from empy block while reading 2017-07-26 20:03:09 +03:00
Alexey Milovidov
d57f5b81a4 Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175]. 2017-07-26 00:07:05 +03:00
Nikolai Kochetov
b3157aebb2 added synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-25 22:42:36 +03:00
Vitaliy Lyudvichenko
03e5bf9471 Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Alexey Milovidov
4a4e863f9d Fixed warning on clang 6 [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
alexey-milovidov
d3159ed2c5 Merge pull request #1015 from yandex/fix-performance-after-changing-reading
Fix performance after changing reading
2017-07-24 18:07:57 +03:00
Nikolai Kochetov
fcd50e3629 fixed comment 2017-07-24 18:06:32 +03:00
proller
57b9bcd354 Fix missing includes 2017-07-24 18:04:49 +03:00
Vitaliy Lyudvichenko
bc9ee54985 Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896] 2017-07-24 18:04:17 +03:00
Nikolai Kochetov
b55dcc9f93 cnanged comments; fixed 00443_preferred_block_size_bytes test 2017-07-24 16:59:03 +03:00
Alexey Milovidov
1e8547b3f6 Fixed regression [#CLICKHOUSE-3148]. 2017-07-21 23:59:01 +03:00
Nikolai Kochetov
10bbededb0 merged with master 2017-07-21 21:10:14 +03:00
Nikolai Kochetov
bc0921a64e added comments 2017-07-21 21:02:02 +03:00
Alexey Zatelepin
c939d2f96e put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163] 2017-07-21 20:55:38 +03:00
Nikolai Kochetov
ca1957ab82 ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170] 2017-07-21 20:54:09 +03:00
Nikolai Kochetov
cc349b410e set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170] 2017-07-21 20:54:09 +03:00
Nikolai Kochetov
c64b65ee29 ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170] 2017-07-21 20:45:51 +03:00