VadimPE
70ebb6a47d
CLICKHOUSE-3847 fix code-style
2018-08-27 19:22:39 +03:00
Vadim
64a27e592b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 19:00:40 +03:00
VadimPE
4d198f2bfe
CLICKHOUSE-3847 fix build
2018-08-27 18:54:07 +03:00
VadimPE
0281678c3e
CLICKHOUSE-3847 fix code style
2018-08-27 18:44:51 +03:00
VadimPE
a8974f8786
CLICKHOUSE-3847 add Coordinator
2018-08-27 16:51:22 +03:00
Vadim
be2d821669
Merge branch 'master' into CLICKHOUSE-3847
2018-08-27 15:26:41 +03:00
Vadim
c4e90d89f0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 15:16:52 +03:00
VadimPE
22aa521884
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:14:48 +03:00
VadimPE
cf0a7c1529
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:09:22 +03:00
Alexey Milovidov
c193d15ef2
Merge branch 'master' into generalize-zookeeper
2018-08-26 03:32:15 +03:00
Alexey Milovidov
3475ef5304
Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2]
2018-08-25 04:58:14 +03:00
Alexey Milovidov
01082d03d2
Adopted logic in ReplicatedMergeTreeBlockOutputStream #2949
2018-08-25 01:55:02 +03:00
Alexey Milovidov
eec8af52f3
Fixed potential data loss [#CLICKHOUSE-3916]
2018-08-24 11:57:24 +03:00
alexey-milovidov
e1e6e316d9
Merge pull request #2930 from yandex/fix-empty-parts-vertical-merge
...
Fix vertical merge of empty parts
2018-08-24 01:47:11 +03:00
Vadim
1c596db7c0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 20:19:05 +03:00
Vadim
5a129f5383
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:37:28 +03:00
Vadim
380452c933
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:36:54 +03:00
Alexey Zatelepin
08f6305dba
add missed logging message
2018-08-23 19:33:25 +03:00
Vadim
e7d6bc3dbc
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:02:19 +03:00
VadimPE
ce217af78a
CLICKHOUSE-3847 fix
2018-08-23 18:58:29 +03:00
Vadim
9271ea7a5f
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:20:13 +03:00
Vadim
94699b8f6a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:08:24 +03:00
Vadim
234242dd2d
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:04:53 +03:00
VadimPE
9beb841406
CLICKHOUSE-3847 fix throw and del log
2018-08-23 16:55:59 +03:00
Alexey Zatelepin
f592aa84d1
fix vertical merge for empty parts [#CLICKHOUSE-3913]
2018-08-23 15:04:30 +03:00
Vadim
b8dd1cbdf2
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:18:05 +03:00
Vadim
58fa299b0a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:14:30 +03:00
Vadim
9bce62719f
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:10:00 +03:00
Vadim
984d6b5db8
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:06:34 +03:00
VadimPE
d81d4dfc70
CLICKHOUSE-3847 change createReplica and change check in cloneReolica()
2018-08-22 17:01:54 +03:00
Alexey Zatelepin
66d49f0abc
start and stop mutations_finalizing_task during replica restart [#CLICKHOUSE-3747]
2018-08-22 16:57:30 +03:00
Alexey Zatelepin
b6aa7542d0
add BackgroundSchedulePool::TaskInfo::activateAndSchedule() method
...
Almost always it (and not activate()) is precisely what is needed.
2018-08-22 16:43:27 +03:00
Alexey Zatelepin
5c748bfdce
fix bug when MATERIALIZED columns were not selected during mutation #2900 [#CLICKHOUSE-3911]
2018-08-22 15:45:24 +03:00
Alexey Milovidov
ca5b83ac39
Fixed error when BackgroundSchedulePool is initialized in context of a query #2482
2018-08-22 06:58:19 +03:00
Alexey Milovidov
fc9d335d41
Fixed error when empty part is generated after merge or mutation #2830
2018-08-22 06:33:46 +03:00
Alexey Zatelepin
55d82dfc84
fix race in initialization of ReplicatedMergeTreeRestartingThread [#CLICKHOUSE-3899]
2018-08-21 18:22:55 +03:00
Vadim
e9954d3ab7
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:53:16 +03:00
Vadim
79a089a996
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:32:47 +03:00
Vadim
5f7117e6a2
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:32:28 +03:00
Vadim
b96d15f266
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:28:22 +03:00
Vadim
306c1b0b48
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:27:51 +03:00
Vadim
3598f39f82
Merge branch 'master' into ISSUES-2581
2018-08-21 17:24:03 +03:00
Nikolai Kochetov
b291a9694e
Force update dictionary when seek to new granule. #2896
2018-08-21 17:05:50 +03:00
Vadim
8f3350216f
Merge branch 'master' into CLICKHOUSE-3847
2018-08-21 13:27:18 +03:00
VadimPE
99a26f17f6
CLICKHOUSE-3847 fix settings
2018-08-21 13:23:48 +03:00
Alexey Milovidov
9287a63180
Removed useless headers [#CLICKHOUSE-3249]
2018-08-21 06:40:47 +03:00
Alexey Milovidov
3b39f6a4c3
Split ZooKeeperExceptions to three different metrics #2316
2018-08-21 04:27:22 +03:00
VadimPE
a49cc41279
CLICKHOUSE-3847 add support old version of CH server
2018-08-21 02:08:45 +03:00
VadimPE
4064ec0bc2
CLICKHOUSE-3847 add value '1' and '2' in is_lost
2018-08-20 20:15:04 +03:00
proller
91363760ea
Merge remote-tracking branch 'upstream/master' into fix3
2018-08-20 19:34:09 +03:00
Alexey Zatelepin
765b908450
change the order in which the locks are taken to make TSan happy [#CLICKHOUSE-3892]
2018-08-20 19:07:07 +03:00
proller
159cdbbb3e
Try fix build (link order)
2018-08-20 18:34:37 +03:00
VadimPE
0c119d7667
CLICKHOUSE-3847 fix bugs
2018-08-20 16:31:24 +03:00
Nikolai Kochetov
391b4b5927
Merged with master.
2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df
Merge branch 'master' into CLICKHOUSE-2910
2018-08-14 23:29:42 +03:00
Vadim
537a8f0240
Update MergeTreeDataSelectExecutor.cpp
2018-08-14 13:03:32 +03:00
VadimPE
3c0f6ce87b
ISSUES-2581 fix SELECT with select_sequential_consistency
2018-08-14 12:57:18 +03:00
Nikolai Kochetov
4a62ab9d5c
Merged with master.
2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf
Preparation for extra warnings [#CLICKHOUSE-2]
2018-08-10 07:02:56 +03:00
Vadim
fad1e37605
Update ReplicatedMergeTreeQueue.h
2018-08-09 19:24:37 +03:00
Vadim
a133f20b33
Update ReplicatedMergeTreeQueue.cpp
2018-08-09 19:24:03 +03:00
VadimPE
75900f494f
CLICKHOUSE-3847 add "is_lost". load() in Queue can check duplicate records
2018-08-09 18:06:39 +03:00
Nikolai Kochetov
4fd3d57e79
Less compiler warnings.
2018-08-09 13:52:54 +03:00
Nikolai Kochetov
ab10005af5
Renamed settings for LowCardinality type.
2018-08-09 13:52:46 +03:00
Vadim
61338697b0
Update MergeTreeSettings.h
2018-08-08 18:28:48 +03:00
VadimPE
3b9002dfc9
CLICKHOUSE-3847 fix
2018-08-08 17:31:56 +03:00
VadimPE
4c0bb93345
CLICKHOUSE-3847 fix UInt - UInt. del clearQueue()
2018-08-08 17:07:39 +03:00
VadimPE
8d28b9f6b4
CLICKHOUSE-3847 we can do pullToLog() after we mark replica is_active and before we calc delay.
2018-08-08 16:53:06 +03:00
Nikolai Kochetov
f4d9d50168
Merged with master.
2018-08-08 15:01:18 +03:00
VadimPE
01e9d15914
CLICKHOUSE-3847 Del restartLostReplica()
2018-08-07 18:28:12 +03:00
VadimPE
0be75baeda
CLICKHOUSE-3847 Del markLosrTeplicas()
2018-08-07 18:26:27 +03:00
VadimPE
32b6965cf2
CLICKHOUSE-3847 Update. Add new settings. Del is_lost
2018-08-07 18:21:42 +03:00
alexey-milovidov
72af99fdd5
Merge pull request #2814 from alesapin/master
...
Fix REPLACE PARTITION logic inside replicated merge tree
2018-08-06 20:18:30 +03:00
alexey-milovidov
aa4b2b1782
Update ReplicatedMergeTreeQueue.h
2018-08-06 20:18:11 +03:00
alexey-milovidov
4bfbe80d4f
Update MergedBlockOutputStream.cpp
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
72c4d8f064
add assert that MinMax index is correctly initialized [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
1f2d4f90b9
allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
alesapin
425918afe1
CLICKHOUSE-3880: Fix replace partition logic inside replicated merge tree
2018-08-06 15:59:51 +03:00
Alexey Milovidov
2016374d20
Merging #2226
2018-08-05 10:05:43 +03:00
Alexey Zatelepin
b6b54eea52
old mutations cleaner for ReplicatedMergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
a0730d7696
old mutations cleaner for non-replicated MergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
94723bea63
add setting [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
alesapin
e81108b954
CLICKHOUSE-3863: Add more convinient exception message
2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1
CLICKHOUSE-3863: Add HTTPS support for interserver replication
2018-08-01 00:29:47 +03:00
VadimPE
e2be3fd5ce
CLICKHOUSE-3847 fix
2018-07-31 17:11:27 +03:00
VadimPE
3eaae23559
Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847
2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e
CLICKHOUSE-3847 fix problems with empty entries
2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1
CLICKHOUSE-3847 fix comments.
2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa
Compatibility with obsolete version of Poco for alternative build variants #2759
2018-07-30 23:21:45 +03:00
Alexey Zatelepin
4863c5c178
fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862]
2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733
don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
...
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293
CLICKHOUSE-3847 add support lost replica
2018-07-30 19:31:14 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
...
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
6abbfbce87
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 18:10:57 +03:00
Alexey Milovidov
a10ebecc67
Enabled minimalistic checksums in ZooKeeper by default #2666
2018-07-24 22:29:40 +03:00
Alex Zatelepin
41d87fdb0a
fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798]
2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b
use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147
don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0
create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
alexey-milovidov
f31b1236c1
Update MergeTreeDataSelectExecutor.cpp
2018-07-16 16:44:32 +03:00
proller
0b0a2838c8
Fix compile error with boost 1.68.0
2018-07-16 16:44:32 +03:00
alexey-milovidov
68b57e605a
Merge branch 'master' into background-processing-pool-backoff
2018-07-16 06:27:43 +03:00
alexey-milovidov
4d1c470469
Update MergeTreeData.cpp
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alexey Milovidov
7dc1276afe
Little better #2281
2018-07-08 08:26:51 +03:00
Alexey Milovidov
0947c7808d
Avoid locking while reading config to check part_log #2281
2018-07-08 07:54:37 +03:00
Alexey Milovidov
a2faa511cc
Less number of "stat" calls for each INSERT into MergeTree #2281
2018-07-08 06:56:24 +03:00
Alexey Milovidov
3445c78190
Added exponential backoff for BackgroundProcessingPool #2281
2018-07-08 05:57:41 +03:00
Alex Zatelepin
f7f4f220f1
Update MergeTreeData.cpp
2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6
Recreate format_version.txt when missing
2018-07-06 15:14:23 +03:00
Alexey Zatelepin
d5f8e4a1a5
load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Milovidov
c99e717632
Fixed bad code #2571
2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910
2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700
BackgroundSchedulePool: remove task from delayed even it it is currently executing
...
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Nikolai Kochetov
4f7c284d34
Fixed build.
2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299
add comments [#CLICKHOUSE-3747]
2018-06-22 13:43:35 +03:00
Alexey Zatelepin
e78dc8142c
factor out common code [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d
use single mutex in ReplicatedMergeTreeQueue for simplicity
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca
calculate and update parts_to_do for mutations [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Nikolai Kochetov
f88584d748
Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary.
2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf
Fixed failures in utils, more precise test. [#CLICKHOUSE-2910]
2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes ( #2488 )
...
CONTRIB-254
2018-06-19 21:09:09 +03:00
alesapin
148cbe8058
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:20:39 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
b60a2a90fa
rename method for clarity
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b
system.mutations table skeleton [#CLICKHOUSE-3747]
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c
store mutation entries in shared_ptr
2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662
save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747]
2018-06-13 17:14:08 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. ( #2492 )
...
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development): removed very old tests #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
ebe5e3f9b6
Reverted unclear modification #2260
2018-06-09 21:35:51 +03:00
Alexey Milovidov
d864f39ec7
Merge branch 'master' into zhang2014-feature/support_truncate
2018-06-09 19:10:06 +03:00
Vitaliy Lyudvichenko
c04dfb40a6
Fixed memory tracking. [#CLICKHOUSE-2910]
2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Milovidov
26d448baad
Passing settings to ser/de of data types: development #1710
2018-06-08 04:51:55 +03:00
Alexey Milovidov
267a69fe7e
Better type for number of rows [#CLICKHOUSE-2]
2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5
add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747]
2018-06-06 16:22:30 +03:00
Alexey Zatelepin
3947f25365
add general comment about the mutation algorithm [#CLICKHOUSE-3747]
2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning
...
Fix pruning of parts by conditions on partition key columns
2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60
Per granula reading for ColumnWithDictionary in MergeTreeRangeReader.
2018-06-05 13:10:54 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19
...
Build fixes
2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio
...
Fixes according to PVS-Studio report.
2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5
Suppressions for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:46:47 +03:00
proller
9907388766
32bit Compile fix
2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7
Slightly better (preparation) [#CLICKHOUSE-3]
2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e
check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757]
2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541
calculate primary key when mutating a part [#CLICKHOUSE-3747]
2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad
add comments [#CLICKHOUSE-3747]
2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866
introduce constants for max level and max block number
2018-06-04 14:23:47 +03:00
Alexey Milovidov
f5adbceed2
Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2]
2018-06-03 23:39:06 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h
2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b
Initialize external tables after enqueue query. [#CLICKHOUSE-2910]
2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c
Merge branch 'master' into replicated-mergetree-mutations
2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b
Removed wrong query optimization [#CLICKHOUSE-3726]
2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b
support skipping mutations (just in case) [#CLICKHOUSE-3747]
2018-05-31 18:21:00 +03:00
Vitaliy Lyudvichenko
dc5de3bbec
More optimal conflicts check in future_parts. [#CLICKHOUSE-2]
2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24
Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
...
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
Vitaliy Lyudvichenko
e265e5c2ab
Refactoring. [#CLICKHOUSE-2910]
2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06
Add more perfomance counters. [#CLICKHOUSE-2910]
2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15
part log and metrics [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed
support empty parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972
DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c
execute mutation log entries [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66
mutation executor for MergeTree [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8
select and write part mutations to queue [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd
more honest constness in ActionBlocker
2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782
don't select merges of parts with different mutation versions [#CLICKHOUSE-3747]
2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146
notify relevant events directly from queue [#CLICKHOUSE-3747]
2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7
load mutations from ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2
write mutations to ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3
test getting abandonable lock in all partitions [#CLICKHOUSE-3747]
2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76
parts versioning [#CLICKHOUSE-3687]
2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf
merge selection based on checking current inserts [#CLICKHOUSE-3732]
2018-05-25 23:03:56 +03:00
Alexey Milovidov
13762471da
Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3]
2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259
More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743]
2018-05-23 19:18:04 +03:00
Vitaliy Lyudvichenko
8349d2b9a0
Fixed gcc7 compilation. [#CLICKHOUSE-2]
2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
...
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]
* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]
* Disable merges in the dropping range. [#CLICKHOUSE-3546]
* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]
* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]
SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]
* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]
* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]
* Add system.part_log logging. [#CLICKHOUSE-3546]
* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]
* Add requested changes. [#CLICKHOUSE-3546]
Fixed clickhouse-client bad return code.
* Add requested chenges. [#CLICKHOUSE-3546]
* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
zhang2014
fa865636ce
ISSUES-2259 add comment & move delete database metadata implementation
2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa
ISSUES-2259 fix the test after the merge master
2018-05-21 11:38:46 +08:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
...
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
...
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Nikolai Kochetov
9a1c286ade
Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734]
2018-05-17 17:54:43 +03:00
Vitaliy Lyudvichenko
de6c48f4df
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
864dc0546b
Add requested changes. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777
Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688
Better #2328
2018-05-09 07:49:34 +03:00
proller
eb772b8001
gcc8 fixes (memset, uncaught_exception)
2018-05-08 22:44:54 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name
2018-05-08 15:47:06 +03:00
Alexey Zatelepin
6047db7ea2
fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag)
2018-05-07 23:31:28 +03:00
Alexey Milovidov
94369e55d3
Fixed style a bit [#CLICKHOUSE-2]
2018-05-07 05:01:29 +03:00
Tsarkova Anastasia
2c96b1c684
Add comments. Change projection restoring function.
2018-04-29 15:49:58 +02:00
Silviu Caragea
1dd5a704fc
Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c
Conditional computations.
2018-04-24 09:16:39 +02:00
Nikolai Kochetov
7a62bb9267
added comments and fixed tests build
2018-04-23 22:41:10 +03:00
Alexey Milovidov
958a3d7ee7
Fixed error with Arrays inside Nested data type; added a test #2066
2018-04-22 20:30:28 -07:00
Nikolai Kochetov
7e45661a38
merged with master
2018-04-20 22:51:21 +03:00
Alexey Milovidov
ac48e1e911
Fixed error #2246
2018-04-20 20:34:09 +03:00
Nikolai Kochetov
a6375d6155
merged with master
2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620
fix build
2018-04-20 17:06:01 +03:00
Alexey Milovidov
6b88a2a7a5
Better info in log #2246
2018-04-20 04:14:04 +03:00
Alexey Milovidov
70be882b64
Renamed PK to Key where it's appropriate #2246
2018-04-20 03:27:25 +03:00
Alexey Milovidov
d71b3a95ef
Renamed PK to Key where it's appropriate #2246
2018-04-20 03:20:50 +03:00
Alexey Milovidov
ce0ac3f8f8
Fixed error with Sets, part 2 #2246
2018-04-20 00:34:04 +03:00
Alexey Milovidov
c0978919e3
Fixed error with partition key IN, part 1 #2246
2018-04-19 23:34:02 +03:00
Alexey Milovidov
12e33cfd85
Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2]
2018-04-19 21:16:18 +03:00
Nikolai Kochetov
dd10c2073c
merged with master
2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675
added IStorage::getQueryProcessingStage
2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da
Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
a55abd0a25
Fixed test [#CLICKHOUSE-2]
2018-04-18 23:27:27 +03:00
Alexey Milovidov
3eff0184fa
Added set size checking when set from subquery is used for index; removed harmful feature for special support of (a, b) IN (SELECT (a, b)) instead of (a, b) IN (SELECT a, b) [#CLICKHOUSE-2]
2018-04-18 22:38:40 +03:00
alexey-milovidov
22f7a3a545
Merge pull request #2223 from sundy-li/master
...
Fix:ignore the format_version check when the data is empty
2018-04-17 22:50:26 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
...
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
bf832b3ea6
Fixed OPTIMIZE after RENAME of replicated table. [#CLICKHOUSE-2]
2018-04-17 20:59:42 +03:00
Nikolai Kochetov
081f0feb56
fix test [#CLICKHOUSE-3694] #2156
2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a
merged with master
2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34
minor fixes
2018-04-16 18:11:13 +03:00
sundy-li
12211ffc5b
Fix:ignore the format_version check when the data is empty
2018-04-16 18:04:59 +08:00
Nikolai Kochetov
41229b201b
Merge branch 'master' into fix-header-for-union-stream-in-distributed-2
2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5
fix perf
2018-04-13 23:09:13 +03:00
Nikolai Kochetov
42f9a4d773
added PrewhereInfo [#CLICKHOUSE-3694] #2156
2018-04-11 22:10:08 +03:00
Nikolai Kochetov
c9abeed3f5
remove unused columns from prewhere actions [#CLICKHOUSE-3694] #2156
2018-04-11 22:08:53 +03:00
Silviu Caragea
c547c5a7b0
Merge remote-tracking branch 'origin/background-schedule-pool-fix'
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Common/ZooKeeper/ZooKeeper.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Alexey Milovidov
0a4b349f73
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664
ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2]
2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
...
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
ee7fe63b69
Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2]
2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2
Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2]
2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f
fix races in leader election [#CLICKHOUSE-3533]
2018-04-06 19:10:23 +03:00
Alexey Milovidov
f66d2fb780
Allow to use FINAL even in case of single part #2086
2018-04-06 00:36:55 +03:00
Nikolai Kochetov
b96039bafe
added check for partition column in mayBenefitFromIndexForIn #2170
2018-04-05 00:03:16 +03:00
alexey-milovidov
e2a517db12
Update MergeTreeData.cpp
2018-04-04 00:17:22 +03:00
Nikolai Kochetov
2163977b2a
mayBenefitFromIndexForIn returns true if at least one tuple element is in pk [#CLICKHOUSE-3680]
2018-04-04 00:17:22 +03:00
Alexey Milovidov
08170d0d77
Modifications after removing libzookeeper [#CLICKHOUSE-2]
2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947
Miscellaneous [#CLICKHOUSE-2]
2018-04-03 20:35:48 +03:00
KochetovNicolai
62e6a1bde6
Update MergeTreeBaseBlockInputStream.cpp
...
Check is block is not empty before removing prewhere column
2018-04-02 17:08:05 +03:00
proller
440b0f33c7
Compile fixes
2018-04-02 15:31:49 +03:00
Alexey Milovidov
3fe743e2bd
Fixed error after merge [#CLICKHOUSE-2]
2018-04-01 22:29:08 +03:00
alexey-milovidov
b07fb1ddda
Merge branch 'master' into better-range-reader
2018-04-01 22:16:39 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite
2018-04-01 17:31:20 +03:00
alexey-milovidov
2e15ce6791
Merge pull request #2132 from yandex/small-enhancements
...
Small enhancements
2018-03-29 03:07:49 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database
2018-03-29 03:01:07 +03:00
Vitaliy Lyudvichenko
701b58b4ff
Faster DROP PARTITION. [#CLICKHOUSE-2]
2018-03-28 15:48:40 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
...
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
Silviu Caragea
1418e339e4
Rename merge_selecting_handle with merge_selecting_task_handle for consistency
2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6
)
2018-03-26 23:12:17 +03:00
Silviu Caragea
438121e45b
Renamed Zookeeper get method with getWatch for consistency
2018-03-26 23:08:14 +03:00
Silviu Caragea
50992843c6
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle)
2018-03-26 22:59:58 +03:00
Silviu Caragea
4361df913b
Remove exists and use existsWatch instead for WatchCallbacks
2018-03-26 22:46:14 +03:00
Silviu Caragea
31874ed172
Use consistent names for the task variables
2018-03-26 22:37:47 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352
Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite
2018-03-24 23:30:57 +03:00
Alexey Milovidov
58f32f98d7
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Alexey Zatelepin
cf3c24d07d
break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664]
2018-03-23 23:30:04 +03:00
KochetovNicolai
aacc0bee53
Merge pull request #2097 from yandex/CLICKHOUSE-3663
...
Clickhouse 3663
2018-03-23 14:56:08 +03:00
Nikolai Kochetov
2f468f1ae1
fix test [#CLICKHOUSE-3663]
2018-03-23 13:50:20 +03:00
alexey-milovidov
cf52c2840a
Merge branch 'master' into better-range-reader
2018-03-23 02:14:40 +03:00
Alexey Milovidov
0a06971e43
Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite
2018-03-23 02:10:00 +03:00
alexey-milovidov
a75d5525e7
Update MergeTreeDataPartChecksum.h
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
883de7a2a6
startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038
Add minimalistic checksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
7c2a99c9b8
Introduced MinimalisticDataPartChecksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00
Nikolai Kochetov
cbfd862fa3
fix reading with evaluated defaults [#CLICKHOUSE-3663]
2018-03-22 23:18:11 +03:00
Nikolai Kochetov
97624d7d78
fix reading with evaluated defaults [#CLICKHOUSE-3663]
2018-03-22 22:53:19 +03:00
Silviu Caragea
a2dc16a582
Remove the link between TaskHandles and ZooKeeper
2018-03-22 17:21:14 +02:00
Silviu Caragea
6629b03af9
Fixed few of the observation of the code review
2018-03-22 17:09:30 +02:00
Silviu Caragea
b24a4b2111
Add back the buggy BackgroundSchedulePool
2018-03-22 17:07:12 +02:00
Alexey Milovidov
d690c24198
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 00:40:53 +03:00
Nikolai Kochetov
476d4b339c
Immutable construction for columns
2018-03-20 22:45:10 +03:00
Alexey Milovidov
02c67e2b13
Fixed error [#CLICKHOUSE-2]
2018-03-16 09:51:37 +03:00
alexey-milovidov
b9339e0ea1
Merge pull request #2053 from yandex/small-enhancements
...
Small enhancements
2018-03-15 22:10:29 +03:00
alexey-milovidov
1e88f2fe5c
Update AbandonableLockInZooKeeper.h
2018-03-15 22:06:53 +03:00
alexey-milovidov
e64b2df874
Update ReplicatedMergeTreeBlockOutputStream.cpp
2018-03-15 22:06:23 +03:00
alexey-milovidov
1554390bab
Update AbandonableLockInZooKeeper.h
2018-03-15 22:05:58 +03:00
Vitaliy Lyudvichenko
16dad209f7
Do not make extra ZK RTTs in inserts. [#CLICKHOUSE-3]
...
Resolves #2054
2018-03-15 21:40:59 +03:00
Vitaliy Lyudvichenko
f1b32e8982
Fixed ordinary MergeTree merges in case of empty ORDER BY key. [#CLICKHOUSE-2]
2018-03-14 23:49:18 +03:00
alexey-milovidov
e5836cf97f
Merge pull request #2036 from yandex/CLICKHOUSE-3639
...
Fixed ZooKeeper with chroot, refactoring of ZooKeeper::multi*
2018-03-14 21:56:22 +03:00
Vitaliy Lyudvichenko
7abbe093e9
Avoid magic constants in system.parts. [#CLICKHOUSE-3]
...
Resolves #2039
2018-03-14 19:04:19 +03:00
Vitaliy Lyudvichenko
56bfb05ebb
Fix insane DateTime in system.parts. [#CLICKHOUSE-3]
2018-03-14 19:00:02 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Alexey Milovidov
c9d1b61ef7
Fixed build after merge #2029
2018-03-14 06:19:23 +03:00
Alexey Zatelepin
5906c9a988
rename for clarity
2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac
encapsulate ColumnsDeclaration [#CLICKHOUSE-3241]
2018-03-13 17:41:25 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
972db7b072
iterate over materialized columns where it makes sense
2018-03-12 22:07:48 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Alexey Milovidov
5ff433b670
Merged Limits to Settings [#CLICKHOUSE-2021]
2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3
Fixed error with initialization of PartLog [#CLICKHOUSE-3354]
2018-03-10 22:57:13 +03:00
Alexey Milovidov
3f8ef38b41
Fixed wording #245
2018-03-10 02:23:15 +03:00
Vitaliy Lyudvichenko
efdda9cc9b
Introduced ThreadStatus. [#CLICKHOUSE-2910]
2018-03-07 14:35:10 +03:00
Nikolai Kochetov
532b57aef8
perf. fixes
2018-03-07 01:05:36 +03:00
Alex Zatelepin
90ea45a397
better exception message [#CLICKHOUSE-3599]
2018-03-06 22:01:45 +03:00
Alexey Zatelepin
ec91d29d6a
correct MergingParams columns check [#CLICKHOUSE-3599]
2018-03-06 20:17:58 +03:00
Nikolai Kochetov
b2b1588d5f
added FilterWithZerosCounter
2018-03-05 17:25:20 +03:00
Nikolai Kochetov
8b01ec2225
Merge branch 'master' into better-range-reader
2018-03-05 15:55:06 +03:00
Alexey Milovidov
91a6a88102
Explicit semantic for TSan [#CLICKHOUSE-2]
2018-03-03 21:00:46 +03:00
Alexey Milovidov
07d8db9f2a
Explicit semantic for TSan [#CLICKHOUSE-2]
2018-03-03 20:44:53 +03:00
Alexey Milovidov
368f46d764
Addition to prev. revision [#CLICKHOUSE-2]
2018-03-03 19:48:24 +03:00
Alexey Milovidov
2e371822ad
Changed low level data race to high level data race [#CLICKHOUSE-2]
2018-03-03 19:46:32 +03:00
Alexey Milovidov
3b0d713120
Cleanup semantics [#CLICKHOUSE-2]
2018-03-03 19:26:06 +03:00
Alexey Milovidov
c897e5ca39
Better [#CLICKHOUSE-2]
2018-03-03 18:36:20 +03:00
Alexey Milovidov
bf924d1c9d
Better name [#CLICKHOUSE-2]
2018-03-02 21:51:59 +03:00
Nikolai Kochetov
7851e71a2a
fix continueReadingChain from several mark ranges
2018-03-02 16:05:33 +03:00
Alexey Milovidov
601ff1eee4
Simplification of AST #1947
2018-02-26 06:37:08 +03:00
Alexey Milovidov
2b974554e5
Fixed test [#CLICKHOUSE-2]
2018-02-24 04:55:43 +03:00
Alexey Milovidov
cae7f96f34
Simplification [#CLICKHOUSE-2]
2018-02-23 13:02:29 +03:00
alexey-milovidov
82fa3883f8
Merge pull request #1930 from yandex/nonblocking-precommitted
...
Allow PreCommitted parts to contain each other
2018-02-22 23:35:16 +03:00
Nikolai Kochetov
976d2a49fe
merged with master
2018-02-22 14:54:26 +03:00
Nikolai Kochetov
733156438a
fix continueReadingChain from several mark ranges
2018-02-22 14:35:06 +03:00
Nikolai Kochetov
39f16b66b5
fix continueReadingChain from several mark ranges
2018-02-22 14:31:15 +03:00
alexey-milovidov
ee41f7000f
Merge pull request #1940 from yandex/CLICKHOUSE-3571
...
Try to reduce false positive of sanity check
2018-02-22 01:59:33 +03:00
alexey-milovidov
d4dcb9412c
Merge pull request #1941 from yandex/unsorted-mergetree
...
Fix MergeTree idiosyncrasies
2018-02-22 00:36:59 +03:00
Alexey Zatelepin
610f70fbeb
forbid non-deterministic functions in primary and partition keys [#CLICKHOUSE-3455]
2018-02-21 20:54:16 +03:00
Vitaliy Lyudvichenko
47becc0b92
Try to reduce false positive of sanity check. More detail dignostics. [#CLICKHOUSE-3571]
2018-02-21 20:06:29 +03:00
Alexey Zatelepin
6fdf82e452
allow the primary key and the partition key to use the same expression [#CLICKHOUSE-3455]
2018-02-21 18:43:24 +03:00
Alexey Zatelepin
e3422ea52e
MergeTree without primary key [#CLICKHOUSE-3462]
2018-02-21 17:50:26 +03:00
Alexey Milovidov
aad0c62e67
Fixed error [#CLICKHOUSE-2]
2018-02-21 08:11:53 +03:00
Alexey Milovidov
652dfc8c36
Fixed error [#CLICKHOUSE-2]
2018-02-21 07:18:08 +03:00
Alexey Milovidov
a69bd2220a
Merge branch 'master' into header-in-output-streams
2018-02-21 04:41:09 +03:00
Alexey Milovidov
3dd665179e
Fixed error with components of Nested data structures without data and PREWHERE filtering [#CLICKHOUSE-3608]
2018-02-21 04:16:09 +03:00
Tsarkova Anastasia
d99d01ac3a
Fix data types for key_ranges
2018-02-20 23:03:15 +03:00
Nikolai Kochetov
ba81835e58
fixed progress stats
2018-02-20 17:26:22 +03:00
Nikolai Kochetov
36fe36d003
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:59:19 +03:00
Alexey Zatelepin
da87abc422
fix condition for the 'intersects previous part' log message
2018-02-20 16:59:01 +03:00
Alexey Zatelepin
53b5c5f54c
add check for intersecting parts when adding new parts
2018-02-20 16:58:41 +03:00
Nikolai Kochetov
2bf1931d86
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:37:04 +03:00
Alexey Zatelepin
5bc6bd55b1
allow PreCommitted parts to contain each other, clean up code
2018-02-20 16:33:28 +03:00
Nikolai Kochetov
dcd99860fe
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:30:47 +03:00
Nikolai Kochetov
3063c35429
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:23:56 +03:00
Nikolai Kochetov
d8b5f14dd7
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:26:09 +03:00
Nikolai Kochetov
d2d0d570d8
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:09:32 +03:00
Nikolai Kochetov
77a3989558
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:02:25 +03:00
Nikolai Kochetov
58b6b7570f
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:54:32 +03:00
Nikolai Kochetov
af6895ee6f
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:50:33 +03:00
Nikolai Kochetov
ce70d4faa9
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:45:58 +03:00
Nikolai Kochetov
af9ac7b48b
merged with master
2018-02-20 12:27:47 +03:00
Nikolai Kochetov
82c76d8467
added MergeTreePrewhereRangeReader
2018-02-20 12:23:02 +03:00
Alexey Milovidov
d0bfa15525
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:49 +03:00
Alexey Milovidov
7ff1346685
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:30 +03:00
Alexey Milovidov
74c56c2def
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 06:56:08 +03:00
Alexey Milovidov
fa50fe80a0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 03:45:32 +03:00
alexey-milovidov
d73080640d
Merge pull request #1921 from yandex/header-in-input-streams
...
Header in input streams
2018-02-18 07:58:04 +03:00
Alexey Milovidov
afe09d3138
Removed unused code [#CLICKHOUSE-2]
2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df
Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2]
2018-02-18 06:23:48 +03:00
Alexey Milovidov
df4853a13a
Header in every stream: development [#CLICKHOUSE-2]
2018-02-18 03:37:22 +03:00
Alexey Milovidov
ff235fc506
Header in every stream: development [#CLICKHOUSE-2]
2018-02-18 00:08:21 +03:00
Alexey Milovidov
dba529d674
Header in every stream: development [#CLICKHOUSE-2]
2018-02-17 07:13:49 +03:00
Alexey Milovidov
fb0920ff98
Whitespace [#CLICKHOUSE-2]
2018-02-17 01:33:46 +03:00
Alexey Milovidov
264e6cbc84
Header in every stream: development [#CLICKHOUSE-2]
2018-02-16 00:31:09 +03:00
Alexey Milovidov
921e09b5f8
Merge branch 'master' into header-in-input-streams
2018-02-15 19:20:36 +03:00
Nikolai Kochetov
7c69ecb3ef
fix test [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
90d67d4e8a
added test for moving partition from collapsing to versioned collapsing merge tree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
36de8a2911
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d
added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
40ef753992
added VersionedCollapsingMergeTree to help message [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c
renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a
added MultiversionMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Alexey Milovidov
c104566eb8
Fixed performance regression in usage of COWPtr in complex cases [#CLICKHOUSE-3584].
2018-02-12 23:10:24 +03:00
alexey-milovidov
8fb9967903
Merge pull request #1879 from yandex/lambdas-without-prerequisites
...
Lambdas without prerequisites
2018-02-09 22:22:58 +03:00
Nikolai Kochetov
e02ca10b9a
merged with master
2018-02-08 20:46:22 +03:00
alexey-milovidov
2e115dff1b
Merge pull request #1823 from chenxing-xc/master
...
fix endless query issue
2018-02-08 20:41:52 +03:00
alexey-milovidov
bca723b06b
Update MergeTreeBaseBlockInputStream.cpp
2018-02-08 20:41:36 +03:00
alexey-milovidov
1d8cfa351d
Update MergeTreeBaseBlockInputStream.cpp
2018-02-08 20:40:23 +03:00
Nikolai Kochetov
27179b375a
removed prerequisites [#CLICKHOUSE-3550]
2018-02-08 20:18:52 +03:00
Nikolai Kochetov
583ff32fe8
changed IFunction
2018-02-08 20:18:15 +03:00
Alexey Milovidov
953ab16cde
Miscellaneous #1853
2018-02-08 18:31:37 +03:00
Alexey Milovidov
777b4404bd
Fixed build #1853
2018-02-08 18:25:46 +03:00
Tsarkova Anastasia
5ecd50ff44
Adding comments. Reversing infinities.
2018-02-08 17:28:31 +03:00
Tsarkova Anastasia
938cb2b57a
Considering set first.
2018-02-07 18:29:00 +03:00
Tsarkova Anastasia
c50ccabb0a
Implement MergeTree index using for IN operator with tuple of columns.
2018-02-07 18:29:00 +03:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
...
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
Vitaliy Lyudvichenko
e2fb6d8c80
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
4665201827
Add metric for duplicated inserts. [#CLICKHOUSE-2]
2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
chenxing.xc
be85910088
fix endless query issue #1769
2018-01-26 00:44:47 +08:00
Vitaliy Lyudvichenko
26e58271e9
Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2]
2018-01-25 17:42:39 +03:00
alexey-milovidov
b8cb9267c7
Merge pull request #1804 from arkhipov/master
...
Replace subqueries and table expressions on the right side of the IN …
2018-01-23 22:31:49 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e
Make early deduplication with block number creation. [#CLICKHOUSE-3545]
2018-01-23 18:50:29 +03:00
Vlad Arkhipov
6738d6a995
Add comments. Improve method names.
2018-01-23 11:18:12 +03:00
Vlad Arkhipov
be96cf5133
Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index.
2018-01-21 11:22:52 +03:00
Alexey Milovidov
9a02d4f5ff
Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams
2018-01-20 04:20:40 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
...
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
f770156b0b
Update MergeTreeDataMerger.cpp
2018-01-19 21:42:22 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
...
Small enhancements
2018-01-16 22:07:43 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
5d5ed63e8c
Better error message. [#CLICKHOUSE-2]
2018-01-15 20:30:16 +03:00
Vitaliy Lyudvichenko
03bca2144d
OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
...
Resolves #1753
2018-01-15 13:13:18 +03:00
Alexey Milovidov
550053a0ca
Merge branch 'master' into header-in-input-streams
2018-01-10 03:05:51 +03:00
Alexey Milovidov
0bfea2f52c
Miscellaneous [#CLICKHOUSe-2]
2018-01-10 03:04:08 +03:00
Nikolai Kochetov
cbeeb84999
added http_*_timeout settings [#CLICKHOUSE-3440]
2018-01-09 21:41:01 +03:00
alexey-milovidov
890ad92f90
Merge pull request #1627 from yandex/table-system-parts_columns
...
Table system.parts_columns
2018-01-09 21:33:55 +03:00
alexey-milovidov
2a7024ba5a
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
alexey-milovidov
1292d14185
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
zhang2014
517958ab09
ISSUES-1369 fix typo
2018-01-09 21:01:26 +03:00
zhang2014
be966015c9
ISSUES-1369 add check when create Replacing & Collapsing
2018-01-09 21:01:26 +03:00
Alexey Milovidov
5081f276d1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 04:51:08 +03:00
Alexey Milovidov
9996e181e1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-06 21:10:44 +03:00
Alexey Milovidov
ffca152c45
Inverted dependencies in StorageFactory [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Alexey Milovidov
7244514859
Less dependencies in StorageFactory: development [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Nikolai Kochetov
ea41197c51
merger with master
2017-12-28 21:20:53 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-28 07:39:19 +03:00
Alexey Milovidov
4cde48fb20
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-28 01:40:42 +03:00
Alexey Milovidov
b79aa5db4e
Update documentation about required ZK version; Miscellaneous #1458
2017-12-27 21:34:58 +03:00
Alexey Milovidov
09262ae0d7
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-27 01:56:30 +03:00
Alexey Zatelepin
280c147a89
remove dependency to StorageReplicatedMergeTree [#CLICKHOUSE-2]
2017-12-26 22:15:15 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
.
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0
Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2].
2017-12-25 21:58:39 +03:00
Alexey Zatelepin
c3348e27a4
shorter [#CLICKHOUSE-2]
2017-12-25 20:31:14 +03:00
proller
fb7047bfe8
Fix 32bit build
2017-12-25 20:17:32 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb
Whitespace [#CLICKHOUSE-2].
2017-12-21 20:43:32 +03:00
Alexey Milovidov
584a263d79
Simplification of aggregate functions: development [#CLICKHOUSE-2].
2017-12-21 05:08:25 +03:00
Alexey Zatelepin
c422b5b2e4
take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508]
2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95
add comments [#CLICKHOUSE-3508]
2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8
check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e
revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Milovidov
32fcc7b3f0
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 09:23:19 +03:00
Alexey Milovidov
11d3b9c710
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 08:37:20 +03:00
Alexey Milovidov
c5d5296889
Miscellaneous [#CLICKHOUSE-2].
2017-12-18 07:07:26 +03:00