VadimPE
33545a41b6
fix style. And del getMaxBlock...()
2018-09-21 18:07:43 +03:00
VadimPE
8b8697bc5d
Merge remote-tracking branch 'origin/master' into ISSUES-2581
2018-09-21 17:11:57 +03:00
Alexey Zatelepin
230a9fff2d
Write the columns list of the resulting part in the same order as all_columns [#CLICKHOUSE-13]
2018-09-21 15:40:34 +03:00
alexey-milovidov
a2d8ee1caa
Merge pull request #3183 from 4ertus2/refactoring
...
refactoring: hide ASTIdentifier kind
2018-09-20 20:38:06 +03:00
Alexey Zatelepin
0ec0a24bc9
fix use of temp variable after it gets out of scope
2018-09-20 16:55:22 +03:00
chertus
6442b5b167
refactoring: hide ASTIdentifier kind
2018-09-20 16:13:33 +03:00
VadimPE
66b4a606d5
fix bug with add new partition in quorum
2018-09-19 17:34:41 +03:00
Alexey Zatelepin
b7cb8d1ae1
write correct columns list when UPDATEd part doesn't contain all columns [#CLICKHOUSE-13]
2018-09-19 16:04:52 +03:00
VadimPE
f05d93897b
Del old class
2018-09-19 14:10:56 +03:00
VadimPE
17ffa8c310
fix class for added parts
2018-09-19 14:08:04 +03:00
VadimPE
96b117cb00
Revert "Update ReplicatedMergeTreeQuorumWriter.h"
...
This reverts commit e3add7f0c7
.
2018-09-19 13:23:52 +03:00
Vadim
e3add7f0c7
Update ReplicatedMergeTreeQuorumWriter.h
2018-09-17 16:05:20 +03:00
Vadim
3fabac31f6
Update ReplicatedMergeTreeQuorumWriter.h
2018-09-17 16:02:30 +03:00
Vadim
3b155638a0
Update ReplicatedMergeTreeQuorumWriter.h
2018-09-17 15:54:20 +03:00
Vadim
df9a01585a
Update ReplicatedMergeTreeQuorumWriter.h
2018-09-17 15:51:42 +03:00
Vadim
4dee095b9d
Update MergeTreeDataSelectExecutor.cpp
2018-09-17 15:43:14 +03:00
Vadim
204e1d437f
Merge branch 'master' into ISSUES-2581
2018-09-17 15:30:08 +03:00
VadimPE
5defbadb4a
Add new class for write new parts
2018-09-17 15:28:29 +03:00
Alexey Milovidov
7f27f0e4ca
Fixed build #3146
2018-09-17 06:44:29 +03:00
Alexey Milovidov
5e3b507bd6
Added functions "toISOWeek", "toISOYear", "toStartOfISOYear" [#CLICKHOUSE-3988]
2018-09-17 06:09:56 +03:00
Alexey Milovidov
59f8313b83
utils/check-style/check-style
2018-09-13 06:34:58 +03:00
alexey-milovidov
0223225a05
Merge pull request #3035 from yandex/alter-update
...
ALTER UPDATE
2018-09-13 06:03:35 +03:00
alexey-milovidov
fd630179ec
Merge pull request #3103 from yandex/dont-fetch-unchanged-mutated-parts
...
Don't fetch parts not changed by mutations
2018-09-13 04:00:31 +03:00
alesapin
17a8fb86dc
CLICKHOUSE-3970: Rename variable
2018-09-12 21:19:47 +03:00
alesapin
c38e3e7890
CLICKHOUSE-3970: Add logging
2018-09-12 20:28:59 +03:00
alesapin
1664bec008
CLICKHOUSE-3970: Add setting for O_DIRECT for big merges
2018-09-12 20:19:52 +03:00
alexey-milovidov
0751290dca
Merge pull request #3099 from VadimPE/CLICKHOUSE-3839
...
CLICKHOUSE-3839 add partition_id in system.merges
2018-09-12 07:38:43 +03:00
Alexey Zatelepin
6da58aedd8
don't fetch mutated part if we have local part with the same checksums [#CLICKHOUSE-3937]
2018-09-11 19:41:01 +03:00
VadimPE
5da1561e69
CLICKHOUSE-3839
2018-09-11 14:16:40 +03:00
alexey-milovidov
4793e620be
Merge pull request #3093 from yandex/fix-columns-ordering
...
Fix columns ordering in MergeTreeRangeReader
2018-09-10 20:26:45 +03:00
Nikolai Kochetov
2ea009bddc
Fix columns ordering.
2018-09-10 18:28:03 +03:00
alexey-milovidov
20d5ddd58c
Merge branch 'master' into alter-update
2018-09-10 17:17:10 +03:00
alexey-milovidov
3054e62e00
Merge pull request #3089 from VadimPE/CLICKHOUSE-3839
...
CLICKHOUSE-3839 add virtual column "_partition_id"
2018-09-10 17:16:21 +03:00
VadimPE
10ab9587a2
CLICKHOUSE-3839 add virtual column _partition_id
2018-09-10 12:53:13 +03:00
alexey-milovidov
0b6e85e51d
Merge pull request #3073 from yandex/fix_prewhere_with_sampling
...
Fix prewhere with sampling
2018-09-08 00:34:06 +03:00
Nikolai Kochetov
8311c23d83
Fix test.
2018-09-07 23:23:28 +03:00
Alexey Zatelepin
133c9c7c37
Merge branch 'master' into alter-update
...
Conflicts:
docs/en/query_language/alter.md
2018-09-07 19:11:02 +03:00
Nikolai Kochetov
6e41be3476
Avoid removing columns used in sample expression in prewhere actions. [#CLICKHOUSE-3969]
2018-09-07 19:01:21 +03:00
Alexey Zatelepin
1064d1d26b
update MATERIALIZED columns when their dependencies are updated [#CLICKHOUSE-13]
2018-09-07 18:54:18 +03:00
chertus
0b35cdae69
refactoring: add some sugar in type checks [CLICKHOUSE-0002]
2018-09-07 17:37:26 +03:00
Alexander Sapin
03174e131d
Merge remote-tracking branch 'upstream/master'
2018-09-06 12:39:42 +03:00
Alexey Zatelepin
6275bfd8cd
fix CollapsingMergeTree + vertical merge [#CLICKHOUSE-3963]
...
don't skip writing to rows sources even if all rows have collapsed.
2018-09-05 20:19:51 +03:00
Alexey Zatelepin
acc1a84827
better name [#CLICKHOUSE-13]
2018-09-05 15:54:03 +03:00
Nikolai Kochetov
3c6db8ebc1
Fix prewhere with aliased columns. [#CLICKHOUSE-3944]
2018-09-04 21:28:01 +03:00
Alexey Zatelepin
4f91833e67
Merge branch 'master' into alter-update
...
Conflicts:
dbms/src/Parsers/ASTIdentifier.cpp
2018-09-04 17:39:08 +03:00
Alexey Zatelepin
816b91e2e3
additional checks for UPDATEs of key columns [#CLICKHOUSE-13]
2018-09-04 17:34:50 +03:00
Alexey Zatelepin
dc0c731c10
later mutation stages now work with IN (SELECT ...) [#CLICKHOUSE-13]
2018-09-04 14:39:10 +03:00
Alexey Zatelepin
d4d1020798
execute UPDATEs and DELETEs in stages [#CLICKHOUSE-13]
2018-09-03 22:34:49 +03:00
alesapin
83574eed7c
Merge remote-tracking branch 'upstream/master'
2018-09-03 13:11:33 +03:00
alesapin
11d248ba10
Resolve conflict
2018-09-03 13:11:10 +03:00
VadimPE
6e78f576d7
ISSUES-2581 add comments, and fix
2018-09-03 11:25:35 +03:00
Alexey Milovidov
226a7f491e
Whitespaces [#CLICKHOUSE-3944]
2018-09-03 08:06:19 +03:00
Alexey Milovidov
fc27be314b
Avoid temporary nullptr references [#CLICKHOUSE-2]
2018-09-02 06:00:04 +03:00
alesapin
6e64067a70
CLICKHOUSE-3800: Move cache to context, change hashing algorithm, add drop instruction for compiled expressions cache
2018-08-30 19:31:20 +03:00
Alexey Zatelepin
e9493b3a5f
use hard links to copy columns that didn't change [#CLICKHOUSE-13]
2018-08-30 16:56:43 +03:00
Alexey Zatelepin
dc2a4c21e9
execute ALTER UPDATE [#CLICKHOUSE-13]
2018-08-30 16:56:43 +03:00
Alexey Milovidov
9a4b4fbccd
Miscellaneous #2758
2018-08-28 03:23:52 +03:00
Alexey Milovidov
236c3872b8
Miscellaneous #2758
2018-08-28 03:23:38 +03:00
Alexey Milovidov
32286484cd
Miscellaneous #2758
2018-08-28 03:22:32 +03:00
Alexey Milovidov
52379be265
Miscellaneous #2758
2018-08-28 03:21:02 +03:00
Alexey Milovidov
4f8d324fa7
Miscellaneous #2758
2018-08-28 03:18:32 +03:00
Alexey Milovidov
fa0ffcf8dc
Miscellaneous #2758
2018-08-28 03:17:27 +03:00
Alexey Milovidov
2a4b4eefd6
Miscellaneous #2758
2018-08-28 03:10:05 +03:00
Alexey Milovidov
ea643eeff9
Miscellaneous #2758
2018-08-28 03:03:10 +03:00
Alexey Milovidov
7c777c48d7
Miscellaneous #2758
2018-08-28 03:01:03 +03:00
Alexey Milovidov
0a7e288d70
Miscellaneous #2758
2018-08-28 02:59:49 +03:00
Alexey Milovidov
24bd803c07
Whitespaces #2758
2018-08-27 22:06:32 +03:00
Vadim
a246b913e0
Merge branch 'master' into ISSUES-2581
2018-08-27 19:45:35 +03:00
Vadim
2d8bffafa3
Update MergeTreeSettings.h
2018-08-27 19:38:54 +03:00
Vadim
4d9d80b271
Update MergeTreeSettings.h
2018-08-27 19:38:36 +03:00
VadimPE
418375aa1d
Merge branch 'CLICKHOUSE-3847' of https://github.com/VadimPE/ClickHouse into CLICKHOUSE-3847
2018-08-27 19:23:08 +03:00
VadimPE
70ebb6a47d
CLICKHOUSE-3847 fix code-style
2018-08-27 19:22:39 +03:00
Vadim
64a27e592b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 19:00:40 +03:00
VadimPE
4d198f2bfe
CLICKHOUSE-3847 fix build
2018-08-27 18:54:07 +03:00
VadimPE
0281678c3e
CLICKHOUSE-3847 fix code style
2018-08-27 18:44:51 +03:00
VadimPE
a8974f8786
CLICKHOUSE-3847 add Coordinator
2018-08-27 16:51:22 +03:00
Vadim
be2d821669
Merge branch 'master' into CLICKHOUSE-3847
2018-08-27 15:26:41 +03:00
Vadim
c4e90d89f0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-27 15:16:52 +03:00
VadimPE
22aa521884
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:14:48 +03:00
VadimPE
cf0a7c1529
CLICKHOUSE-3847 fix bug when replica recover and it's log_pointer will be deleted
2018-08-27 15:09:22 +03:00
Alexey Milovidov
c193d15ef2
Merge branch 'master' into generalize-zookeeper
2018-08-26 03:32:15 +03:00
Alexey Milovidov
3475ef5304
Attempt to generalize ZooKeeper interface [#CLICKHOUSE-2]
2018-08-25 04:58:14 +03:00
Alexey Milovidov
01082d03d2
Adopted logic in ReplicatedMergeTreeBlockOutputStream #2949
2018-08-25 01:55:02 +03:00
Alexey Milovidov
eec8af52f3
Fixed potential data loss [#CLICKHOUSE-3916]
2018-08-24 11:57:24 +03:00
alexey-milovidov
e1e6e316d9
Merge pull request #2930 from yandex/fix-empty-parts-vertical-merge
...
Fix vertical merge of empty parts
2018-08-24 01:47:11 +03:00
Vadim
1c596db7c0
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 20:19:05 +03:00
Vadim
5a129f5383
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:37:28 +03:00
Vadim
380452c933
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:36:54 +03:00
Alexey Zatelepin
08f6305dba
add missed logging message
2018-08-23 19:33:25 +03:00
Vadim
e7d6bc3dbc
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 19:02:19 +03:00
VadimPE
ce217af78a
CLICKHOUSE-3847 fix
2018-08-23 18:58:29 +03:00
Vadim
9271ea7a5f
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:20:13 +03:00
Vadim
94699b8f6a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:08:24 +03:00
Vadim
234242dd2d
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-23 17:04:53 +03:00
VadimPE
9beb841406
CLICKHOUSE-3847 fix throw and del log
2018-08-23 16:55:59 +03:00
Alexey Zatelepin
f592aa84d1
fix vertical merge for empty parts [#CLICKHOUSE-3913]
2018-08-23 15:04:30 +03:00
Vadim
b8dd1cbdf2
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:18:05 +03:00
Vadim
58fa299b0a
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:14:30 +03:00
Vadim
9bce62719f
Update ReplicatedMergeTreeQueue.cpp
2018-08-22 17:10:00 +03:00
Vadim
984d6b5db8
Update ReplicatedMergeTreeCleanupThread.cpp
2018-08-22 17:06:34 +03:00
VadimPE
d81d4dfc70
CLICKHOUSE-3847 change createReplica and change check in cloneReolica()
2018-08-22 17:01:54 +03:00
Alexey Zatelepin
66d49f0abc
start and stop mutations_finalizing_task during replica restart [#CLICKHOUSE-3747]
2018-08-22 16:57:30 +03:00
Alexey Zatelepin
b6aa7542d0
add BackgroundSchedulePool::TaskInfo::activateAndSchedule() method
...
Almost always it (and not activate()) is precisely what is needed.
2018-08-22 16:43:27 +03:00
Alexey Zatelepin
5c748bfdce
fix bug when MATERIALIZED columns were not selected during mutation #2900 [#CLICKHOUSE-3911]
2018-08-22 15:45:24 +03:00
Alexey Milovidov
ca5b83ac39
Fixed error when BackgroundSchedulePool is initialized in context of a query #2482
2018-08-22 06:58:19 +03:00
Alexey Milovidov
fc9d335d41
Fixed error when empty part is generated after merge or mutation #2830
2018-08-22 06:33:46 +03:00
Alexey Zatelepin
55d82dfc84
fix race in initialization of ReplicatedMergeTreeRestartingThread [#CLICKHOUSE-3899]
2018-08-21 18:22:55 +03:00
Vadim
e9954d3ab7
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:53:16 +03:00
Vadim
79a089a996
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:32:47 +03:00
Vadim
5f7117e6a2
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:32:28 +03:00
Vadim
b96d15f266
Update MergeTreeDataSelectExecutor.cpp
2018-08-21 17:28:22 +03:00
Vadim
306c1b0b48
Update MergeTreeDataSelectExecutor.h
2018-08-21 17:27:51 +03:00
Vadim
3598f39f82
Merge branch 'master' into ISSUES-2581
2018-08-21 17:24:03 +03:00
Nikolai Kochetov
b291a9694e
Force update dictionary when seek to new granule. #2896
2018-08-21 17:05:50 +03:00
Vadim
8f3350216f
Merge branch 'master' into CLICKHOUSE-3847
2018-08-21 13:27:18 +03:00
VadimPE
99a26f17f6
CLICKHOUSE-3847 fix settings
2018-08-21 13:23:48 +03:00
Alexey Milovidov
9287a63180
Removed useless headers [#CLICKHOUSE-3249]
2018-08-21 06:40:47 +03:00
Alexey Milovidov
3b39f6a4c3
Split ZooKeeperExceptions to three different metrics #2316
2018-08-21 04:27:22 +03:00
VadimPE
a49cc41279
CLICKHOUSE-3847 add support old version of CH server
2018-08-21 02:08:45 +03:00
VadimPE
4064ec0bc2
CLICKHOUSE-3847 add value '1' and '2' in is_lost
2018-08-20 20:15:04 +03:00
proller
91363760ea
Merge remote-tracking branch 'upstream/master' into fix3
2018-08-20 19:34:09 +03:00
Alexey Zatelepin
765b908450
change the order in which the locks are taken to make TSan happy [#CLICKHOUSE-3892]
2018-08-20 19:07:07 +03:00
proller
159cdbbb3e
Try fix build (link order)
2018-08-20 18:34:37 +03:00
VadimPE
0c119d7667
CLICKHOUSE-3847 fix bugs
2018-08-20 16:31:24 +03:00
Nikolai Kochetov
391b4b5927
Merged with master.
2018-08-20 15:25:06 +03:00
Alexey Milovidov
acb99b49df
Merge branch 'master' into CLICKHOUSE-2910
2018-08-14 23:29:42 +03:00
Vadim
537a8f0240
Update MergeTreeDataSelectExecutor.cpp
2018-08-14 13:03:32 +03:00
VadimPE
3c0f6ce87b
ISSUES-2581 fix SELECT with select_sequential_consistency
2018-08-14 12:57:18 +03:00
Nikolai Kochetov
4a62ab9d5c
Merged with master.
2018-08-10 16:53:08 +03:00
Alexey Milovidov
36db216abf
Preparation for extra warnings [#CLICKHOUSE-2]
2018-08-10 07:02:56 +03:00
Vadim
fad1e37605
Update ReplicatedMergeTreeQueue.h
2018-08-09 19:24:37 +03:00
Vadim
a133f20b33
Update ReplicatedMergeTreeQueue.cpp
2018-08-09 19:24:03 +03:00
VadimPE
75900f494f
CLICKHOUSE-3847 add "is_lost". load() in Queue can check duplicate records
2018-08-09 18:06:39 +03:00
Nikolai Kochetov
4fd3d57e79
Less compiler warnings.
2018-08-09 13:52:54 +03:00
Nikolai Kochetov
ab10005af5
Renamed settings for LowCardinality type.
2018-08-09 13:52:46 +03:00
Vadim
61338697b0
Update MergeTreeSettings.h
2018-08-08 18:28:48 +03:00
VadimPE
3b9002dfc9
CLICKHOUSE-3847 fix
2018-08-08 17:31:56 +03:00
VadimPE
4c0bb93345
CLICKHOUSE-3847 fix UInt - UInt. del clearQueue()
2018-08-08 17:07:39 +03:00
VadimPE
8d28b9f6b4
CLICKHOUSE-3847 we can do pullToLog() after we mark replica is_active and before we calc delay.
2018-08-08 16:53:06 +03:00
Nikolai Kochetov
f4d9d50168
Merged with master.
2018-08-08 15:01:18 +03:00
VadimPE
01e9d15914
CLICKHOUSE-3847 Del restartLostReplica()
2018-08-07 18:28:12 +03:00
VadimPE
0be75baeda
CLICKHOUSE-3847 Del markLosrTeplicas()
2018-08-07 18:26:27 +03:00
VadimPE
32b6965cf2
CLICKHOUSE-3847 Update. Add new settings. Del is_lost
2018-08-07 18:21:42 +03:00
alexey-milovidov
72af99fdd5
Merge pull request #2814 from alesapin/master
...
Fix REPLACE PARTITION logic inside replicated merge tree
2018-08-06 20:18:30 +03:00
alexey-milovidov
aa4b2b1782
Update ReplicatedMergeTreeQueue.h
2018-08-06 20:18:11 +03:00
alexey-milovidov
4bfbe80d4f
Update MergedBlockOutputStream.cpp
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
72c4d8f064
add assert that MinMax index is correctly initialized [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
Alexey Zatelepin
1f2d4f90b9
allow empty parts after merge for Summing, Collapsing and VersionedCollapsing engines [#CLICKHOUSE-3879]
2018-08-06 19:54:00 +03:00
alesapin
425918afe1
CLICKHOUSE-3880: Fix replace partition logic inside replicated merge tree
2018-08-06 15:59:51 +03:00
Alexey Milovidov
2016374d20
Merging #2226
2018-08-05 10:05:43 +03:00
Alexey Zatelepin
b6b54eea52
old mutations cleaner for ReplicatedMergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
a0730d7696
old mutations cleaner for non-replicated MergeTree engines [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
Alexey Zatelepin
94723bea63
add setting [#CLICKHOUSE-3828]
2018-08-03 22:21:44 +03:00
alesapin
e81108b954
CLICKHOUSE-3863: Add more convinient exception message
2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1
CLICKHOUSE-3863: Add HTTPS support for interserver replication
2018-08-01 00:29:47 +03:00
VadimPE
e2be3fd5ce
CLICKHOUSE-3847 fix
2018-07-31 17:11:27 +03:00
VadimPE
3eaae23559
Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847
2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e
CLICKHOUSE-3847 fix problems with empty entries
2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1
CLICKHOUSE-3847 fix comments.
2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa
Compatibility with obsolete version of Poco for alternative build variants #2759
2018-07-30 23:21:45 +03:00
Alexey Zatelepin
4863c5c178
fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862]
2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733
don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
...
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293
CLICKHOUSE-3847 add support lost replica
2018-07-30 19:31:14 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
...
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
6abbfbce87
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 18:10:57 +03:00
Alexey Milovidov
a10ebecc67
Enabled minimalistic checksums in ZooKeeper by default #2666
2018-07-24 22:29:40 +03:00
Alex Zatelepin
41d87fdb0a
fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798]
2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b
use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147
don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0
create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
alexey-milovidov
f31b1236c1
Update MergeTreeDataSelectExecutor.cpp
2018-07-16 16:44:32 +03:00
proller
0b0a2838c8
Fix compile error with boost 1.68.0
2018-07-16 16:44:32 +03:00
alexey-milovidov
68b57e605a
Merge branch 'master' into background-processing-pool-backoff
2018-07-16 06:27:43 +03:00
alexey-milovidov
4d1c470469
Update MergeTreeData.cpp
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alexey Milovidov
7dc1276afe
Little better #2281
2018-07-08 08:26:51 +03:00
Alexey Milovidov
0947c7808d
Avoid locking while reading config to check part_log #2281
2018-07-08 07:54:37 +03:00
Alexey Milovidov
a2faa511cc
Less number of "stat" calls for each INSERT into MergeTree #2281
2018-07-08 06:56:24 +03:00
Alexey Milovidov
3445c78190
Added exponential backoff for BackgroundProcessingPool #2281
2018-07-08 05:57:41 +03:00
Alex Zatelepin
f7f4f220f1
Update MergeTreeData.cpp
2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6
Recreate format_version.txt when missing
2018-07-06 15:14:23 +03:00
Alexey Zatelepin
d5f8e4a1a5
load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Milovidov
c99e717632
Fixed bad code #2571
2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910
2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700
BackgroundSchedulePool: remove task from delayed even it it is currently executing
...
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Nikolai Kochetov
4f7c284d34
Fixed build.
2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299
add comments [#CLICKHOUSE-3747]
2018-06-22 13:43:35 +03:00
Alexey Zatelepin
e78dc8142c
factor out common code [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d
use single mutex in ReplicatedMergeTreeQueue for simplicity
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca
calculate and update parts_to_do for mutations [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Nikolai Kochetov
f88584d748
Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary.
2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
358e4ae9bf
Fixed failures in utils, more precise test. [#CLICKHOUSE-2910]
2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes ( #2488 )
...
CONTRIB-254
2018-06-19 21:09:09 +03:00
alesapin
148cbe8058
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:20:39 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
b60a2a90fa
rename method for clarity
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b
system.mutations table skeleton [#CLICKHOUSE-3747]
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c
store mutation entries in shared_ptr
2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662
save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747]
2018-06-13 17:14:08 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. ( #2492 )
...
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development): removed very old tests #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
ebe5e3f9b6
Reverted unclear modification #2260
2018-06-09 21:35:51 +03:00
Alexey Milovidov
d864f39ec7
Merge branch 'master' into zhang2014-feature/support_truncate
2018-06-09 19:10:06 +03:00
Vitaliy Lyudvichenko
c04dfb40a6
Fixed memory tracking. [#CLICKHOUSE-2910]
2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Milovidov
26d448baad
Passing settings to ser/de of data types: development #1710
2018-06-08 04:51:55 +03:00
Alexey Milovidov
267a69fe7e
Better type for number of rows [#CLICKHOUSE-2]
2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5
add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747]
2018-06-06 16:22:30 +03:00
Alexey Zatelepin
3947f25365
add general comment about the mutation algorithm [#CLICKHOUSE-3747]
2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning
...
Fix pruning of parts by conditions on partition key columns
2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60
Per granula reading for ColumnWithDictionary in MergeTreeRangeReader.
2018-06-05 13:10:54 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19
...
Build fixes
2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio
...
Fixes according to PVS-Studio report.
2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5
Suppressions for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:46:47 +03:00
proller
9907388766
32bit Compile fix
2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7
Slightly better (preparation) [#CLICKHOUSE-3]
2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e
check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757]
2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541
calculate primary key when mutating a part [#CLICKHOUSE-3747]
2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad
add comments [#CLICKHOUSE-3747]
2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866
introduce constants for max level and max block number
2018-06-04 14:23:47 +03:00
Alexey Milovidov
f5adbceed2
Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2]
2018-06-03 23:39:06 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h
2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b
Initialize external tables after enqueue query. [#CLICKHOUSE-2910]
2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c
Merge branch 'master' into replicated-mergetree-mutations
2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b
Removed wrong query optimization [#CLICKHOUSE-3726]
2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b
support skipping mutations (just in case) [#CLICKHOUSE-3747]
2018-05-31 18:21:00 +03:00
Vitaliy Lyudvichenko
dc5de3bbec
More optimal conflicts check in future_parts. [#CLICKHOUSE-2]
2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24
Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
...
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
Vitaliy Lyudvichenko
e265e5c2ab
Refactoring. [#CLICKHOUSE-2910]
2018-05-29 21:14:31 +03:00