Alexey Milovidov
236c3872b8
Miscellaneous #2758
2018-08-28 03:23:38 +03:00
Alexey Milovidov
32286484cd
Miscellaneous #2758
2018-08-28 03:22:32 +03:00
Alexey Milovidov
52379be265
Miscellaneous #2758
2018-08-28 03:21:02 +03:00
Alexey Milovidov
4f8d324fa7
Miscellaneous #2758
2018-08-28 03:18:32 +03:00
Alexey Milovidov
fa0ffcf8dc
Miscellaneous #2758
2018-08-28 03:17:27 +03:00
Alexey Milovidov
2a4b4eefd6
Miscellaneous #2758
2018-08-28 03:10:05 +03:00
Alexey Milovidov
ea643eeff9
Miscellaneous #2758
2018-08-28 03:03:10 +03:00
Alexey Milovidov
7c777c48d7
Miscellaneous #2758
2018-08-28 03:01:03 +03:00
Alexey Milovidov
0a7e288d70
Miscellaneous #2758
2018-08-28 02:59:49 +03:00
Alexey Milovidov
24bd803c07
Whitespaces #2758
2018-08-27 22:06:32 +03:00
Vadim
a246b913e0
Merge branch 'master' into ISSUES-2581
2018-08-27 19:45:35 +03:00
Vadim
2d8bffafa3
Update MergeTreeSettings.h
2018-08-27 19:38:54 +03:00
Vadim
4d9d80b271
Update MergeTreeSettings.h
2018-08-27 19:38:36 +03:00
VadimPE
418375aa1d
Merge branch 'CLICKHOUSE-3847' of https://github.com/VadimPE/ClickHouse into CLICKHOUSE-3847
2018-08-27 19:23:08 +03:00
VadimPE
70ebb6a47d
CLICKHOUSE-3847 fix code-style
2018-08-27 19:22:39 +03:00
Vadim
64a27e592b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 19:00:40 +03:00
VadimPE
4d198f2bfe
CLICKHOUSE-3847 fix build
2018-08-27 18:54:07 +03:00
VadimPE
0281678c3e
CLICKHOUSE-3847 fix code style
2018-08-27 18:44:51 +03:00
VadimPE
a8974f8786
CLICKHOUSE-3847 add Coordinator
2018-08-27 16:51:22 +03:00
Vadim
be2d821669
Merge branch 'master' into CLICKHOUSE-3847
2018-08-27 15:26:41 +03:00
Vadim
c4e90d89f0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 15:16:52 +03:00
VadimPE
22aa521884
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:14:48 +03:00
VadimPE
cf0a7c1529
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:09:22 +03:00
Alexey Milovidov
c193d15ef2
Merge branch 'master' into generalize-zookeeper
2018-08-26 03:32:15 +03:00
Alexey Milovidov
3475ef5304
Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2]
2018-08-25 04:58:14 +03:00
Alexey Milovidov
01082d03d2
Adopted logic in ReplicatedMergeTreeBlockOutputStream #2949
2018-08-25 01:55:02 +03:00
Alexey Milovidov
eec8af52f3
Fixed potential data loss [#CLICKHOUSE-3916]
2018-08-24 11:57:24 +03:00
alexey-milovidov
e1e6e316d9
Merge pull request #2930 from yandex/fix-empty-parts-vertical-merge
...
Fix vertical merge of empty parts
2018-08-24 01:47:11 +03:00
Vadim
1c596db7c0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 20:19:05 +03:00
Vadim
5a129f5383
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:37:28 +03:00
Vadim
380452c933
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:36:54 +03:00
Alexey Zatelepin
08f6305dba
add missed logging message
2018-08-23 19:33:25 +03:00
Vadim
e7d6bc3dbc
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:02:19 +03:00
VadimPE
ce217af78a
CLICKHOUSE-3847 fix
2018-08-23 18:58:29 +03:00
Vadim
9271ea7a5f
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:20:13 +03:00
Vadim
94699b8f6a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:08:24 +03:00
Vadim
234242dd2d
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:04:53 +03:00
VadimPE
9beb841406
CLICKHOUSE-3847 fix throw and del log
2018-08-23 16:55:59 +03:00
Alexey Zatelepin
f592aa84d1
fix vertical merge for empty parts [#CLICKHOUSE-3913]
2018-08-23 15:04:30 +03:00
Vadim
b8dd1cbdf2
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:18:05 +03:00
Vadim
58fa299b0a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:14:30 +03:00
Vadim
9bce62719f
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:10:00 +03:00
Vadim
984d6b5db8
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:06:34 +03:00
VadimPE
d81d4dfc70
CLICKHOUSE-3847 change createReplica and change check in cloneReolica()
2018-08-22 17:01:54 +03:00
Alexey Zatelepin
66d49f0abc
start and stop mutations_finalizing_task during replica restart [#CLICKHOUSE-3747]
2018-08-22 16:57:30 +03:00
Alexey Zatelepin
b6aa7542d0
add BackgroundSchedulePool::TaskInfo::activateAndSchedule() method
...
Almost always it (and not activate()) is precisely what is needed.
2018-08-22 16:43:27 +03:00
Alexey Zatelepin
5c748bfdce
fix bug when MATERIALIZED columns were not selected during mutation #2900 [#CLICKHOUSE-3911]
2018-08-22 15:45:24 +03:00
Alexey Milovidov
ca5b83ac39
Fixed error when BackgroundSchedulePool is initialized in context of a query #2482
2018-08-22 06:58:19 +03:00
Alexey Milovidov
fc9d335d41
Fixed error when empty part is generated after merge or mutation #2830
2018-08-22 06:33:46 +03:00
Alexey Zatelepin
55d82dfc84
fix race in initialization of ReplicatedMergeTreeRestartingThread [#CLICKHOUSE-3899]
2018-08-21 18:22:55 +03:00
Vadim
e9954d3ab7
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:53:16 +03:00
Vadim
79a089a996
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:32:47 +03:00
Vadim
5f7117e6a2
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:32:28 +03:00
Vadim
b96d15f266
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:28:22 +03:00
Vadim
306c1b0b48
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:27:51 +03:00
Vadim
3598f39f82
Merge branch 'master' into ISSUES-2581
2018-08-21 17:24:03 +03:00
Nikolai Kochetov
b291a9694e
Force update dictionary when seek to new granule. #2896
2018-08-21 17:05:50 +03:00
Vadim
8f3350216f
Merge branch 'master' into CLICKHOUSE-3847
2018-08-21 13:27:18 +03:00
VadimPE
99a26f17f6
CLICKHOUSE-3847 fix settings
2018-08-21 13:23:48 +03:00
Alexey Milovidov
9287a63180
Removed useless headers [#CLICKHOUSE-3249]
2018-08-21 06:40:47 +03:00
Alexey Milovidov
3b39f6a4c3
Split ZooKeeperExceptions to three different metrics #2316
2018-08-21 04:27:22 +03:00
VadimPE
a49cc41279
CLICKHOUSE-3847 add support old version of CH server
2018-08-21 02:08:45 +03:00
VadimPE
4064ec0bc2
CLICKHOUSE-3847 add value '1' and '2' in is_lost
2018-08-20 20:15:04 +03:00
proller
91363760ea
Merge remote-tracking branch 'upstream/master' into fix3
2018-08-20 19:34:09 +03:00
Alexey Zatelepin
765b908450
change the order in which the locks are taken to make TSan happy [#CLICKHOUSE-3892]
2018-08-20 19:07:07 +03:00
proller
159cdbbb3e
Try fix build (link order)
2018-08-20 18:34:37 +03:00
VadimPE
0c119d7667
CLICKHOUSE-3847 fix bugs
2018-08-20 16:31:24 +03:00
Nikolai Kochetov
391b4b5927
Merged with master.
2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df
Merge branch 'master' into CLICKHOUSE-2910
2018-08-14 23:29:42 +03:00
Vadim
537a8f0240
Update MergeTreeDataSelectExecutor.cpp
2018-08-14 13:03:32 +03:00
VadimPE
3c0f6ce87b
ISSUES-2581 fix SELECT with select_sequential_consistency
2018-08-14 12:57:18 +03:00
Nikolai Kochetov
4a62ab9d5c
Merged with master.
2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf
Preparation for extra warnings [#CLICKHOUSE-2]
2018-08-10 07:02:56 +03:00
Vadim
fad1e37605
Update ReplicatedMergeTreeQueue.h
2018-08-09 19:24:37 +03:00
Vadim
a133f20b33
Update ReplicatedMergeTreeQueue.cpp
2018-08-09 19:24:03 +03:00
VadimPE
75900f494f
CLICKHOUSE-3847 add "is_lost". load() in Queue can check duplicate records
2018-08-09 18:06:39 +03:00
Nikolai Kochetov
4fd3d57e79
Less compiler warnings.
2018-08-09 13:52:54 +03:00
Nikolai Kochetov
ab10005af5
Renamed settings for LowCardinality type.
2018-08-09 13:52:46 +03:00
Vadim
61338697b0
Update MergeTreeSettings.h
2018-08-08 18:28:48 +03:00
VadimPE
3b9002dfc9
CLICKHOUSE-3847 fix
2018-08-08 17:31:56 +03:00
VadimPE
4c0bb93345
CLICKHOUSE-3847 fix UInt - UInt. del clearQueue()
2018-08-08 17:07:39 +03:00
VadimPE
8d28b9f6b4
CLICKHOUSE-3847 we can do pullToLog() after we mark replica is_active and before we calc delay.
2018-08-08 16:53:06 +03:00
Nikolai Kochetov
f4d9d50168
Merged with master.
2018-08-08 15:01:18 +03:00
VadimPE
01e9d15914
CLICKHOUSE-3847 Del restartLostReplica()
2018-08-07 18:28:12 +03:00
VadimPE
0be75baeda
CLICKHOUSE-3847 Del markLosrTeplicas()
2018-08-07 18:26:27 +03:00
VadimPE
32b6965cf2
CLICKHOUSE-3847 Update. Add new settings. Del is_lost
2018-08-07 18:21:42 +03:00
alexey-milovidov
72af99fdd5
Merge pull request #2814 from alesapin/master
...
Fix REPLACE PARTITION logic inside replicated merge tree
2018-08-06 20:18:30 +03:00
alexey-milovidov
aa4b2b1782
Update ReplicatedMergeTreeQueue.h
2018-08-06 20:18:11 +03:00
alexey-milovidov
4bfbe80d4f
Update MergedBlockOutputStream.cpp
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
72c4d8f064
add assert that MinMax index is correctly initialized [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
1f2d4f90b9
allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
alesapin
425918afe1
CLICKHOUSE-3880: Fix replace partition logic inside replicated merge tree
2018-08-06 15:59:51 +03:00
Alexey Milovidov
2016374d20
Merging #2226
2018-08-05 10:05:43 +03:00
Alexey Zatelepin
b6b54eea52
old mutations cleaner for ReplicatedMergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
a0730d7696
old mutations cleaner for non-replicated MergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
94723bea63
add setting [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
alesapin
e81108b954
CLICKHOUSE-3863: Add more convinient exception message
2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1
CLICKHOUSE-3863: Add HTTPS support for interserver replication
2018-08-01 00:29:47 +03:00
VadimPE
e2be3fd5ce
CLICKHOUSE-3847 fix
2018-07-31 17:11:27 +03:00
VadimPE
3eaae23559
Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847
2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e
CLICKHOUSE-3847 fix problems with empty entries
2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1
CLICKHOUSE-3847 fix comments.
2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa
Compatibility with obsolete version of Poco for alternative build variants #2759
2018-07-30 23:21:45 +03:00
Alexey Zatelepin
4863c5c178
fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862]
2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733
don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
...
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293
CLICKHOUSE-3847 add support lost replica
2018-07-30 19:31:14 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
...
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
6abbfbce87
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 18:10:57 +03:00
Alexey Milovidov
a10ebecc67
Enabled minimalistic checksums in ZooKeeper by default #2666
2018-07-24 22:29:40 +03:00
Alex Zatelepin
41d87fdb0a
fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798]
2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b
use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147
don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0
create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
alexey-milovidov
f31b1236c1
Update MergeTreeDataSelectExecutor.cpp
2018-07-16 16:44:32 +03:00
proller
0b0a2838c8
Fix compile error with boost 1.68.0
2018-07-16 16:44:32 +03:00
alexey-milovidov
4d1c470469
Update MergeTreeData.cpp
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alex Zatelepin
f7f4f220f1
Update MergeTreeData.cpp
2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6
Recreate format_version.txt when missing
2018-07-06 15:14:23 +03:00
Alexey Zatelepin
d5f8e4a1a5
load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Milovidov
c99e717632
Fixed bad code #2571
2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910
2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700
BackgroundSchedulePool: remove task from delayed even it it is currently executing
...
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Nikolai Kochetov
4f7c284d34
Fixed build.
2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299
add comments [#CLICKHOUSE-3747]
2018-06-22 13:43:35 +03:00
Alexey Zatelepin
e78dc8142c
factor out common code [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d
use single mutex in ReplicatedMergeTreeQueue for simplicity
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca
calculate and update parts_to_do for mutations [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Nikolai Kochetov
f88584d748
Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary.
2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf
Fixed failures in utils, more precise test. [#CLICKHOUSE-2910]
2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes ( #2488 )
...
CONTRIB-254
2018-06-19 21:09:09 +03:00
alesapin
148cbe8058
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:20:39 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00