Commit Graph

6521 Commits

Author SHA1 Message Date
Azat Khuzhin
62b60a09a4 Add missing space in StorageDistributed logging (sharding key) 2020-03-20 20:51:37 +03:00
alesapin
2a533264e7 Correct merge with master (try 2) 2020-03-20 19:32:16 +03:00
alesapin
62f39b6f52 Correct merge with master 2020-03-20 19:28:41 +03:00
alesapin
90c436f940 Fix style 2020-03-20 15:45:05 +03:00
alesapin
ba3ac3df32 Fix alter drop column for compact parts 2020-03-20 15:25:24 +03:00
alesapin
5a3216b26f Merge with master 2020-03-20 13:45:36 +03:00
alesapin
610a727b92 Fix tidy error 2020-03-19 22:12:38 +03:00
alexey-milovidov
791dddc184
Merge pull request #9754 from ClickHouse/fix_mutations_memory_consumption
Fix mutations huge memory consumption
2020-03-19 21:56:50 +03:00
Pavel Kovalenko
f2dca656f9
MergeTree full support for S3 (#9646)
* IMergeDataPart full S3 support.

* MergeTreeData full S3 support.

* Compilation fixes.

* Mutations and merges S3 support.

* Fixed removing data part.

* MergeTree for S3 integration tests and fixes.

* Code style issues.

* Enable AWS logging.

* Fixed hardlink creation for DiskLocal.

* Fixed localBackup.cpp compilation.

* Fixed attaching partition.

* Get rid of extra methods in IDisk.

* Fixed storage config reloading.

* More tests with table manipulations.

* Remove unused error codes.

* Move localBackup to MergeTree folder.

* Minor fixes.
2020-03-19 19:37:55 +03:00
alesapin
c6d10e32fc Revert accident changes 2020-03-19 18:12:22 +03:00
alesapin
204d0ac955 Fix bugs after method split 2020-03-19 17:11:37 +03:00
alesapin
ce8eb9293a Merge branch 'master' into alter_on_top_of_mutations_merge_tree 2020-03-19 16:05:17 +03:00
alesapin
72baec8523 Better includes 2020-03-19 14:34:54 +03:00
alesapin
d27cd773cc Fix mutations huge memory consumption 2020-03-19 14:31:21 +03:00
alesapin
37cc49efad Fix clang-tidy 2020-03-18 20:06:48 +03:00
alesapin
04494c6ec2 Merge with master after strange conflict 2020-03-18 19:59:22 +03:00
Alexey Milovidov
93466ce097 Added even more clang-tidy checks 2020-03-18 19:51:20 +03:00
Alexey Milovidov
c20853eecc Added most of bugprone checks 2020-03-18 19:51:20 +03:00
alesapin
baec35a18b Better locking in alter 2020-03-18 17:43:16 +03:00
alesapin
f64c005e70 Split merger mutator 2020-03-18 16:16:59 +03:00
alesapin
d00406294c Splitting mutate part to temporarty part 2020-03-18 14:36:18 +03:00
alesapin
eb938f66e4 Better mutations interface 2020-03-18 13:02:57 +03:00
alesapin
3babac10f5 Fix query hang 2020-03-18 12:48:29 +03:00
alesapin
13a0151cf3 Remove garbage 2020-03-18 12:34:05 +03:00
alesapin
87e9a84ef7 Unblock waiting mutations 2020-03-18 11:53:55 +03:00
Alexey Milovidov
1bd7e594b0 clang-tidy, part 2 2020-03-18 03:57:00 +03:00
alesapin
17e505da0f Fix build errors 2020-03-17 20:22:41 +03:00
alesapin
347d2a328f Remove columns lock!!! 2020-03-17 18:10:56 +03:00
alesapin
d5636fb76b Fix style check 2020-03-17 17:31:24 +03:00
alesapin
8d0cb42ef3 Remove more code 2020-03-17 17:07:27 +03:00
alesapin
5877a5af42 Remove alter transaction!!! 2020-03-17 16:49:50 +03:00
alesapin
b0b81bec89 Merge with master and fix 2020-03-17 14:03:29 +03:00
alesapin
18dcb193fd More verbose message about error in case of exception during recursive remove 2020-03-16 21:57:01 +03:00
Guillaume Tassery
bbd6ff8466 test 2020-03-16 14:35:22 +01:00
alesapin
930e6f24b1
Merge pull request #9652 from ClickHouse/fix_compatibility_for_mutations
Fix compatibility in replication
2020-03-16 11:19:57 +03:00
alesapin
2c16732536 Revert version check 2020-03-15 22:34:36 +03:00
alesapin
b0cc690cfb Fix entries compatibility without versions update 2020-03-15 22:33:25 +03:00
alexey-milovidov
a4cc526133
Merge pull request #9065 from ClickHouse/split_databases_from_context
Split databases from Context
2020-03-15 03:42:57 +03:00
alexey-milovidov
9e658d4541
Merge pull request #9602 from ClickHouse/common-prelimit-counter
Common prelimit counter
2020-03-15 02:24:07 +03:00
alexey-milovidov
68074a1524
Merge pull request #9653 from ClickHouse/add_setting_for_path_format
Add setting for a new format of distributed parts
2020-03-15 00:40:33 +03:00
alexey-milovidov
6dbb6317b6
Merge pull request #9654 from ClickHouse/remove-nontrivial-global-variable
Remove global variable with nontrivial ctor/dtor
2020-03-14 23:14:24 +03:00
Anton Popov
71e86fc471
Merge pull request #9581 from excitoon-favorites/materializeinpartition
Added MATERIALIZE TTL IN PARTITION
2020-03-14 02:15:03 +03:00
alesapin
f6044c9c53 Add setting for a new format of distributed parts 2020-03-13 21:49:46 +03:00
Alexey Milovidov
3f6fdc1ddb Remove global variable with nontrivial ctor/dtor 2020-03-13 21:42:19 +03:00
Alexey Milovidov
0a1b3e57a8 Renamed a file for consistency 2020-03-13 20:47:46 +03:00
alesapin
c7c945a859 Fix style check 2020-03-13 20:38:26 +03:00
alesapin
d7a13fb1c4 Merge branch 'remove_empty_columns_when_part_written' into alter_on_top_of_mutations_merge_tree 2020-03-13 20:32:32 +03:00
alesapin
18bbe16aae Fix compatibility in replication 2020-03-13 20:23:36 +03:00
Alexander Tokmakov
00b7190003 minor improvements 2020-03-13 18:41:36 +03:00
alesapin
c777191217 Get rid of removeEmptyColumnsFromPart method based on alterDataPart. 2020-03-13 18:09:55 +03:00
alesapin
814e4c0f07 Return back some log messages 2020-03-13 13:41:54 +03:00
Alexander Tokmakov
2208ff67e2 fix build 2020-03-13 13:30:55 +03:00
alesapin
71e2af386a Some trach code 2020-03-13 13:18:37 +03:00
alesapin
dbf940d64a Merge branch 'master' of github.com:ClickHouse/ClickHouse into alter_on_top_of_mutations_merge_tree 2020-03-13 12:38:13 +03:00
Ivan
b7ef5a699c
Move FastMemcpy to contribs (#9219)
* Get rid of non-existent vectorclass
* Move FastMemcpy to contribs
* Restore comments
* Disable FastMemcpy on non-Linux
* Fix cmake file
* Don't build FastMemcpy for ARM64
* Replace FastMemcpy submodule with its contents
* Fix cmake file
* Move widechar_width to contrib/
* Move sumbur to contrib/
* Move consistent-hashing to contrib/
* Fix UBSan tests
2020-03-13 01:26:16 +03:00
alexey-milovidov
dc9725a757
Merge pull request #9612 from CurtizJ/fix-range-reader
Fix MergeTreeRangeReader
2020-03-12 23:31:50 +03:00
Alexander Tokmakov
158cde68b5 enable UUIDs for temporary tables 2020-03-12 23:00:37 +03:00
alesapin
74a908f7de Reslove conflicts 2020-03-12 18:41:34 +03:00
alesapin
7a9f7bda9e test 2020-03-12 17:50:44 +03:00
robot-clickhouse
6a4e022a3b Auto version update to [20.4.1.1] [54434] 2020-03-12 16:07:08 +03:00
Alexander Tokmakov
cf28bfe8a7 Merge branch 'master' into split_databases_from_context 2020-03-12 15:09:41 +03:00
alexey-milovidov
05da1bff8b
Merge pull request #9566 from ClickHouse/clang-tidy
Added some clang-tidy checks
2020-03-12 13:33:19 +03:00
Alexey Milovidov
4543bca16f Fixed error 2020-03-12 12:09:44 +03:00
Anton Popov
76cfa8a215 fix incorrect number of rows after filtering column with defaults 2020-03-12 05:16:05 +03:00
Anton Popov
32f82629d8 fix prewhere in case when filter is shrinked by optimization and exists missing default in part 2020-03-12 03:39:48 +03:00
Vladimir Chebotarev
8a8142049a Added MATERIALIZE TTL IN PARTITION. 2020-03-11 22:38:55 +03:00
Alexander Tokmakov
4972daeaed fixes 2020-03-11 22:10:55 +03:00
alesapin
406b48a20e First stupid implementation of non-blocking alter for vanilla merge tree 2020-03-11 18:51:04 +03:00
Nikolai Kochetov
5b56cb196c Fix debug tests. 2020-03-11 16:46:51 +03:00
Nikolai Kochetov
43ff4e669c Use common read roes counter for all pre-limit streams. 2020-03-11 15:19:30 +03:00
Nikolai Kochetov
12212fc2d0
Merge pull request #9593 from ClickHouse/storage-system-zeroes
Storage system zeros
2020-03-11 13:09:48 +03:00
Alexey Milovidov
5b2c7507d2 Fixed build 2020-03-11 11:55:37 +03:00
alexey-milovidov
beed841441
Merge branch 'master' into clang-tidy 2020-03-11 10:16:13 +03:00
Vxider
42dbdcc205 revert registerStorages 2020-03-11 12:45:29 +08:00
Vxider
7e7f1cea9f add heartbeat interval setting 2020-03-11 11:23:28 +08:00
Vxider
a759799ca8 support lateness 2020-03-11 11:23:28 +08:00
Vxider
33055fae75 support multiple watermark strategies 2020-03-11 11:23:28 +08:00
Vxider
7b2ded1c9b remove duplicated call of readSuffix 2020-03-11 11:23:28 +08:00
Vxider
bd8eaf8688 fix bug that late events will not trigger 2020-03-11 11:23:27 +08:00
Vxider
17f7a8408a fixed watch when where is no target table 2020-03-11 11:23:27 +08:00
Vxider
dcf6ede525 eliminate dup calculations caused by WATCH/TO 2020-03-11 11:23:27 +08:00
Vxider
ea8d8a6733 use pipes 2020-03-11 11:23:27 +08:00
Vxider
6d35d8ccaf optimize write 2020-03-11 11:23:27 +08:00
Vxider
bc01964973 optimize write 2020-03-11 11:23:27 +08:00
Vxider
328150797d try to fix stress test error 2020-03-11 11:23:27 +08:00
Vxider
35600d6a99 trauncate and optimize support 2020-03-11 11:23:27 +08:00
Vxider
00c3bfb72a processing time support 2020-03-11 11:23:27 +08:00
Vxider
c296b76624 fix code style 2020-03-11 11:23:27 +08:00
Vxider
817980a878 watermark support 2020-03-11 11:23:27 +08:00
Vxider
4351a16103 multi 'WATCH' and 'TO' support 2020-03-11 11:23:27 +08:00
Vxider
4658732e16 inner table support 2020-03-11 11:23:27 +08:00
Vxider
772d9cb222 remove unused code 2020-03-11 11:23:27 +08:00
Vxider
2d7b0545fe try to fix code style check 2020-03-11 11:23:27 +08:00
Vxider
4c2f5e1c8d build fix 2020-03-11 11:23:27 +08:00
Vxider
c6db98e0b5 fix build in clang-8 2020-03-11 11:23:27 +08:00
Vxider
98eacca0b6 fix build in clang-8 2020-03-11 11:23:27 +08:00
Vxider
7b0e4cdcb7 update code style 2020-03-11 11:23:27 +08:00
Vxider
0b0bde7da4 build fix 2020-03-11 11:23:26 +08:00
Vxider
ed8b3b4a4e add WINDOW VIEW 2020-03-11 11:22:56 +08:00
alexey-milovidov
f89ea41f63
Merge pull request #9586 from amosbird/cn
parallelogram -> hyperrectangle
2020-03-11 03:21:51 +03:00