VadimPE
3eaae23559
Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847
2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e
CLICKHOUSE-3847 fix problems with empty entries
2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1
CLICKHOUSE-3847 fix comments.
2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa
Compatibility with obsolete version of Poco for alternative build variants #2759
2018-07-30 23:21:45 +03:00
Nikolai Kochetov
bc054f2247
Fix tests. [#CLICKHOUSE-3761]
2018-07-30 22:40:43 +03:00
Alexey Zatelepin
4863c5c178
fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862]
2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733
don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862]
...
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp
2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293
CLICKHOUSE-3847 add support lost replica
2018-07-30 19:31:14 +03:00
Alexey Milovidov
8bc95412b6
Fixed bad code #2708
2018-07-28 00:33:30 +03:00
alexey-milovidov
9242588449
Merge pull request #2708 from VadimPE/CLICKHOUSE-3837
...
CLICKHOUSE-3837 Add support for table function in remote() and cluster()
2018-07-26 21:36:04 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
...
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
65a6a1225c
Merge pull request #2726 from alesapin/master
2018-07-26 18:20:02 +03:00
alesapin
9aec460f2e
Fix build warning
2018-07-26 18:15:48 +03:00
alesapin
6abbfbce87
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 18:10:57 +03:00
alexey-milovidov
67c0cf5efc
Merge pull request #2721 from alesapin/master
...
CLICKHOUSE-3857: Add table table_engines, alias factory base class and columns alias_to and case_insensitive to functions
2018-07-25 21:50:14 +03:00
alesapin
3888077398
CLICKHOUSE-3857: Fix typo
2018-07-25 19:19:11 +03:00
alesapin
9adb251689
CLICKHOUSE-3857: Add table table_engines, alias factory base class and columns alias_to and case_insensitive to functions
2018-07-25 19:08:23 +03:00
Amos Bird
0965f991b3
Add row_delimiter argument to StorageKafka.
...
There are common cases where a message doesn't end with a row delimiter.
This patch allows specifying a row_delimiter char to compensate that.
https://github.com/yandex/ClickHouse/issues/2298
2018-07-25 18:54:01 +03:00
VadimPE
1d5d097b0d
CLICKHOUSE-3837 fix build
2018-07-25 16:16:36 +03:00
VadimPE
1b07873669
CLICKHOUSE-3837 fix
2018-07-25 15:53:38 +03:00
VadimPE
867a3ebfae
CLICKHOUSE-3837 fix mistakes
2018-07-25 15:31:47 +03:00
alesapin
17cc27d1c0
Merge branch 'master' of github.com:alesapin/ClickHouse
2018-07-25 13:59:57 +03:00
alesapin
f04b2c3340
Merge remote-tracking branch 'upstream/master'
2018-07-25 13:59:23 +03:00
Alexey Milovidov
c2a50991c9
Minor modifications [#CLICKHOUSE-2]
2018-07-25 03:00:08 +03:00
Alexey Milovidov
a10ebecc67
Enabled minimalistic checksums in ZooKeeper by default #2666
2018-07-24 22:29:40 +03:00
Alexey Milovidov
7c07f46d50
Style [#CLICKHOUSE-2]
2018-07-24 21:46:23 +03:00
alexey-milovidov
d17aa47250
Update StorageSystemZooKeeper.cpp
2018-07-24 21:41:22 +03:00
alexey-milovidov
ee6eddb159
Update StorageSystemFunctions.h
2018-07-24 21:41:22 +03:00
alexey-milovidov
fe19ce6c10
Update StorageSystemDictionaries.cpp
2018-07-24 21:41:22 +03:00
alexey-milovidov
2d3a0796a6
Update StorageSystemAggregateFunctionCombinators.cpp
2018-07-24 21:41:22 +03:00
alesapin
d52fd35396
CLICKHOUSE-3772: Move headers to appropriate place (one more time)
2018-07-24 21:41:22 +03:00
alesapin
0f36999b12
CLICKHOUSE-3772: Move headers to appropriate place
2018-07-24 21:41:22 +03:00
alesapin
5459ca1401
CLICKHOUSE-3772: Change base class of almost all StorageSystem* tables and fix remarks
2018-07-24 21:41:22 +03:00
alesapin
a9eb190363
CLICKHOUSE-3772: Fix strange initialization
2018-07-24 21:41:22 +03:00
alesapin
e87460540a
CLICKHOUSE-3772: Add size column
2018-07-24 21:41:22 +03:00
alesapin
5221adf1ea
CLICKHOUSE-3772: Remove unused import
2018-07-24 21:41:22 +03:00
alesapin
6d6bad51ad
CLICKHOUSE-3772: Fixes in system tables formats, data_type_families, aggregate_function_combinators
2018-07-24 21:41:22 +03:00
alexey-milovidov
ba4f988e3f
Update StorageSystemZooKeeper.cpp
2018-07-24 21:40:53 +03:00
alexey-milovidov
8af95f39e8
Update StorageSystemFunctions.h
2018-07-24 21:39:21 +03:00
alexey-milovidov
2834ba2dfb
Update StorageSystemDictionaries.cpp
2018-07-24 21:38:41 +03:00
alexey-milovidov
1824758f8f
Update StorageSystemAggregateFunctionCombinators.cpp
2018-07-24 21:37:07 +03:00
alesapin
8536761a76
CLICKHOUSE-3772: Move headers to appropriate place (one more time)
2018-07-24 17:42:52 +03:00
alesapin
4905c6ac51
CLICKHOUSE-3772: Move headers to appropriate place
2018-07-24 17:32:54 +03:00
alesapin
670353895b
CLICKHOUSE-3772: Change base class of almost all StorageSystem* tables and fix remarks
2018-07-24 17:28:56 +03:00
VadimPE
46dec0d341
[CLICKHOUSE-3837] fix error in build
2018-07-24 17:05:37 +03:00
Vadim
437f3f20a9
Merge branch 'master' into CLICKHOUSE-3837
2018-07-24 16:21:51 +03:00
VadimPE
8dfb6806d8
add support for table function in remote() and cluster()
2018-07-24 16:10:34 +03:00
alesapin
f464bd73cf
Merge remote-tracking branch 'upstream/master'
2018-07-24 12:34:19 +03:00
Alexey Zatelepin
c793277bcc
add forgotten sort [#CLICKHOUSE-3748]
2018-07-23 21:04:13 +03:00
alesapin
220f4d6c43
CLICKHOUSE-3772: Fix strange initialization
2018-07-23 20:12:29 +03:00
alesapin
f2451210d0
CLICKHOUSE-3772: Add size column
2018-07-23 19:52:11 +03:00
alesapin
24a9bebec9
CLICKHOUSE-3772: Remove unused import
2018-07-23 19:13:35 +03:00
alesapin
18dd1e1f14
CLICKHOUSE-3772: Fixes in system tables formats, data_type_families, aggregate_function_combinators
2018-07-23 19:10:57 +03:00
Alex Zatelepin
41d87fdb0a
fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798]
2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b
use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147
don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0
create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Zatelepin
f75fb6cd68
refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798]
2018-07-20 22:44:34 +03:00
Alexey Milovidov
09d22da9b9
Miscellaneous #2687
2018-07-20 18:59:11 +03:00
alesapin
fae9c33282
CLICKHOUSE-3791: Add system table collations
2018-07-20 16:17:16 +03:00
Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
alesapin
2915a58c8f
Merge remote-tracking branch 'upstream/master'
2018-07-20 13:13:50 +03:00
alesapin
32e03f42ef
CLICKHOUSE-3772: Fix initialization
2018-07-20 13:13:23 +03:00
alesapin
a45e707f41
CLICKHOUSE-3772: Rename column in formats
2018-07-20 13:01:46 +03:00
alesapin
ec156e9f2b
CLICKHOUSE-3772: Add system tables formats, data_type_families, table_functions, aggregate_function_combinators
2018-07-20 13:00:56 +03:00
Alexey Milovidov
245b114363
Quote all identifiers when querying external database #2635
2018-07-20 03:04:48 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. ( #2677 )
...
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Removed debug output [#CLICKHOUSE-3796]
* Removed debug output [#CLICKHOUSE-3796]
* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]
* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"
This reverts commit 9eafc13f3b
.
* Revert "Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]"
This reverts commit e28ad4b5fe
.
* Fixed test #2677
* Update InterpreterSelectQuery.cpp
2018-07-19 16:36:21 +03:00
alexey-milovidov
f31b1236c1
Update MergeTreeDataSelectExecutor.cpp
2018-07-16 16:44:32 +03:00
proller
0b0a2838c8
Fix compile error with boost 1.68.0
2018-07-16 16:44:32 +03:00
alexey-milovidov
4d1c470469
Update MergeTreeData.cpp
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88300258a7
info in system.mutations for nonreplicated MergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alexey Milovidov
4f2655960c
Fixed test [#CLICKHOUSE-2]
2018-07-07 22:39:20 +03:00
Alexey Milovidov
d2a44248cd
Fixed error with empty TinyLog table; added a test from Nickolay Kovalev #2563
2018-07-07 22:02:10 +03:00
Alexey Milovidov
b714d87de7
Get rid of virtual columns in system.tables table [#CLICKHOUSE-3806]
2018-07-07 21:58:48 +03:00
Alexey Milovidov
93f8316e1f
Little better [#CLICKHOUSE-3806]
2018-07-06 19:34:53 +03:00
Alexey Milovidov
95915579c7
Fixed test [#CLICKHOUSE-3806]
2018-07-06 19:22:15 +03:00
Alex Zatelepin
f7f4f220f1
Update MergeTreeData.cpp
2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6
Recreate format_version.txt when missing
2018-07-06 15:14:23 +03:00
Alexey Milovidov
67b9a69f19
Fixed error in prev. revision [#CLICKHOUSE-3806]
2018-07-06 00:26:23 +03:00
Alexey Milovidov
88c582106b
Attempt to get rid of VirtualColumnFactory (part 2) [#CLICKHOUSE-3806]
2018-07-05 23:38:05 +03:00
Alexey Milovidov
cc2250f688
Attempt to get rid of VirtualColumnFactory (part 1) [#CLICKHOUSE-3806]
2018-07-05 22:56:51 +03:00
Alexey Milovidov
0a188389c0
Fixed error #2599
2018-07-05 21:56:33 +03:00
Alexey Milovidov
4a35b57cea
Little better #2599
2018-07-05 21:45:18 +03:00
Amos Bird
78beacb3a5
Make OPTIMIZE be able to merge all parts with FINAL.
2018-07-05 21:32:54 +03:00
Alexey Zatelepin
d5f8e4a1a5
load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
0a46d231ed
speedup merge selection: async exists check for selected parts [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
116ed0a59e
add RestartingThread wakeup for faster session recovery
2018-07-05 19:30:52 +03:00
Alexey Zatelepin
fe83c8dab1
stricter validation of mutation commands #2588
2018-07-05 17:19:33 +03:00
Alexey Milovidov
c99e717632
Fixed bad code #2571
2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a
Review fixes. [#CLICKHOUSE-3694] #2156
2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910
2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700
BackgroundSchedulePool: remove task from delayed even it it is currently executing
...
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Nikolai Kochetov
60f0ed9296
Added processing stage check for StorageMerge. [#CLICKHOUSE-3694] #2156
2018-06-25 15:47:51 +03:00
Nikolai Kochetov
4f7c284d34
Fixed build.
2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299
add comments [#CLICKHOUSE-3747]
2018-06-22 13:43:35 +03:00
zhang2014
f4e72792a5
ISSUES-2553 add offset parameter to numbers
2018-06-22 12:55:36 +03:00
Alexey Zatelepin
e78dc8142c
factor out common code [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d
use single mutex in ReplicatedMergeTreeQueue for simplicity
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca
calculate and update parts_to_do for mutations [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
proller
e1ae5233df
Add // Y_IGNORE tags
2018-06-21 18:24:36 +03:00
Nikolai Kochetov
f88584d748
Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary.
2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
1a4157f2a9
clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910]
...
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf
Fixed failures in utils, more precise test. [#CLICKHOUSE-2910]
2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes ( #2488 )
...
CONTRIB-254
2018-06-19 21:09:09 +03:00
Alexey Milovidov
2298f1c68b
Fixed strange code #2501
2018-06-16 08:54:06 +03:00
Alexey Milovidov
b108882e2e
Merge branch 'master' of https://github.com/alesapin/ClickHouse into alesapin-master
2018-06-16 08:29:00 +03:00
Alexey Milovidov
4e8082a699
Fixed build [#CLICKHOUSE-2]
2018-06-16 05:16:19 +03:00
Alexey Milovidov
0272fc996a
Fixed build [#CLICKHOUSE-2]
2018-06-16 05:13:54 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd
Add query_id and host_name to server logs. [#CLICKHOUSE-2910]
2018-06-15 16:49:01 +03:00
alesapin
6e07b17632
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:22:56 +03:00
alesapin
148cbe8058
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:20:39 +03:00
alesapin
4125b0c7f3
Merge remote-tracking branch 'upstream/master'
2018-06-14 21:06:24 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
Alexey Milovidov
1e60b733f4
Fixed warning #2504
2018-06-13 23:02:27 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
alexey-milovidov
ca883a699d
Update StorageURL.cpp
2018-06-13 21:54:32 +03:00
alexey-milovidov
f546169a4d
Update StorageURL.cpp
2018-06-13 21:51:56 +03:00
Alexey Zatelepin
a3bf3e6d20
add missing columns to system.parts [#CLICKHOUSE-3747]
2018-06-13 18:47:40 +03:00
Alexey Zatelepin
b60a2a90fa
rename method for clarity
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b
system.mutations table skeleton [#CLICKHOUSE-3747]
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c
store mutation entries in shared_ptr
2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662
save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747]
2018-06-13 17:14:08 +03:00
alesapin
567bbb2bbb
Fix header path and small fixes in tests
2018-06-13 10:36:47 +03:00
alesapin
b42351d36c
Fix format in storage url
2018-06-13 10:00:07 +03:00
alesapin
df4f8bea35
Merge remote-tracking branch 'upstream/master'
2018-06-11 16:31:58 +03:00
alesapin
0f529dbc6e
Add table fuction url and storage URL
2018-06-11 15:13:00 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. ( #2492 )
...
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development): removed very old tests #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
72af2b7b0f
Removed wrong modification #2260
2018-06-10 21:26:02 +03:00
Alexey Milovidov
641076de51
Reverted unclear modification #2260
2018-06-09 21:39:29 +03:00
Alexey Milovidov
ebe5e3f9b6
Reverted unclear modification #2260
2018-06-09 21:35:51 +03:00
Alexey Milovidov
6475ea98c7
Merging: Fixed most of problems, actualized test #2260
2018-06-09 21:17:27 +03:00
Alexey Milovidov
d864f39ec7
Merge branch 'master' into zhang2014-feature/support_truncate
2018-06-09 19:10:06 +03:00
Alexey Milovidov
cfacdf1457
Merging: Fixed most of problems #2260
2018-06-09 19:09:37 +03:00
Alexey Milovidov
d56c199f07
Merging: Fixed half of problems #2260
2018-06-09 18:48:22 +03:00
Vitaliy Lyudvichenko
c04dfb40a6
Fixed memory tracking. [#CLICKHOUSE-2910]
2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Milovidov
9940b4f8ff
Passing settings to ser/de of data types: development #1710
2018-06-08 05:26:44 +03:00
Alexey Milovidov
29bd48fc7a
Passing settings to ser/de of data types: development #1710
2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad
Passing settings to ser/de of data types: development #1710
2018-06-08 04:51:55 +03:00
Alexey Milovidov
8901414ad2
Fixed error; added test [#CLICKHOUSE-3764]
2018-06-07 23:49:59 +03:00
proller
347579ce46
Cmake: mark system includes as SYSTEM ( #1449 )
...
* contrib: cctz as submodule. update cctz.
* pbuilder: add ubuntu bionic, devel
* Cmake: mark system includes as SYSTEM
* Build fixes
* fix
* Fix package without compiler
* Better
* fix
* fix
* fix
* Build fix
* fix
* fix
* fix
* Cmake: Add SYSTEM to includes for external libs
2018-06-06 23:21:58 +03:00
Alexey Milovidov
267a69fe7e
Better type for number of rows [#CLICKHOUSE-2]
2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5
add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747]
2018-06-06 16:22:30 +03:00
Alexey Zatelepin
dbfee942af
escape serialized AST in MutationCommands (just in case) [#CLICKHOUSE-3747]
2018-06-06 14:30:58 +03:00
Alexey Milovidov
b9b89a5590
Less dependencies [#CLICKHOUSE-2]
2018-06-05 22:46:49 +03:00
Alexey Zatelepin
3947f25365
add general comment about the mutation algorithm [#CLICKHOUSE-3747]
2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning
...
Fix pruning of parts by conditions on partition key columns
2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60
Per granula reading for ColumnWithDictionary in MergeTreeRangeReader.
2018-06-05 13:10:54 +03:00
alexey-milovidov
f69ecf7a9d
Merge pull request #2448 from LiuYangkuan/fix-issue-2439
...
fix Exception in issue#2439
2018-06-04 23:17:44 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19
...
Build fixes
2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio
...
Fixes according to PVS-Studio report.
2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5
Suppressions for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:46:47 +03:00
proller
9907388766
32bit Compile fix
2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7
Slightly better (preparation) [#CLICKHOUSE-3]
2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e
check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757]
2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541
calculate primary key when mutating a part [#CLICKHOUSE-3747]
2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad
add comments [#CLICKHOUSE-3747]
2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866
introduce constants for max level and max block number
2018-06-04 14:23:47 +03:00
Alexey Milovidov
7c60adbebb
Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2]
2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2
Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2]
2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39
Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2]
2018-06-03 20:43:56 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h
2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b
Initialize external tables after enqueue query. [#CLICKHOUSE-2910]
2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c
Merge branch 'master' into replicated-mergetree-mutations
2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b
Removed wrong query optimization [#CLICKHOUSE-3726]
2018-05-31 21:28:04 +03:00
Alexey Zatelepin
f63d2dc3c8
cannot take a number of unlocked abandonable lock
2018-05-31 20:28:17 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b
support skipping mutations (just in case) [#CLICKHOUSE-3747]
2018-05-31 18:21:00 +03:00
Babacar Diassé
3d518e48b9
NULL check to allow insertion in distributed tables with Materialized views
2018-05-31 17:21:35 +03:00
Vitaliy Lyudvichenko
dc5de3bbec
More optimal conflicts check in future_parts. [#CLICKHOUSE-2]
2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24
Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
...
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
LiuYangkuan
7eb25ef55b
fix Exception in issue#2439
2018-05-30 11:11:53 -04:00
Vitaliy Lyudvichenko
e265e5c2ab
Refactoring. [#CLICKHOUSE-2910]
2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06
Add more perfomance counters. [#CLICKHOUSE-2910]
2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15
part log and metrics [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed
support empty parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972
DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c
execute mutation log entries [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66
mutation executor for MergeTree [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8
select and write part mutations to queue [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd
more honest constness in ActionBlocker
2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782
don't select merges of parts with different mutation versions [#CLICKHOUSE-3747]
2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146
notify relevant events directly from queue [#CLICKHOUSE-3747]
2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7
load mutations from ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2
write mutations to ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3
test getting abandonable lock in all partitions [#CLICKHOUSE-3747]
2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76
parts versioning [#CLICKHOUSE-3687]
2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf
merge selection based on checking current inserts [#CLICKHOUSE-3732]
2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master
...
Fix DateTime vs DateTime('UTC') inconsistency on data read.
2018-05-25 21:44:11 +03:00
Alexey Milovidov
13762471da
Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3]
2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259
More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743]
2018-05-23 19:18:04 +03:00
Alex Bocharov
3618842579
Fix DateTime vs DateTime('UTC') inconsistency on data read.
...
Original problem was described in PR #1650 and partially fixed by
b5af4c95
, however one place was forgotten and it was causing query
exceptions when trying to read DateTime column across parts with
different DateTime and DateTime('UTC') data type.
2018-05-22 12:23:07 +01:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion
...
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
2018-05-21 22:42:42 +03:00
Vitaliy Lyudvichenko
8349d2b9a0
Fixed gcc7 compilation. [#CLICKHOUSE-2]
2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
...
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]
* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]
* Disable merges in the dropping range. [#CLICKHOUSE-3546]
* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]
* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]
SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]
* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]
* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]
* Add system.part_log logging. [#CLICKHOUSE-3546]
* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]
* Add requested changes. [#CLICKHOUSE-3546]
Fixed clickhouse-client bad return code.
* Add requested chenges. [#CLICKHOUSE-3546]
* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7
Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo.
2018-05-21 14:18:11 +03:00
zhang2014
fa865636ce
ISSUES-2259 add comment & move delete database metadata implementation
2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa
ISSUES-2259 fix the test after the merge master
2018-05-21 11:38:46 +08:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
...
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
...
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5
Style #2387
2018-05-18 21:31:18 +03:00
Nikolai Kochetov
5e22f19258
Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734]
2018-05-18 20:27:58 +03:00
Vitaliy Lyudvichenko
4b093e3e0a
Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2]
...
This patch is very crucial in case of many replicas.
2018-05-18 02:01:36 +03:00
Vitaliy Lyudvichenko
bd4d8a6766
Add profile events and settings logging. [#CLICKHOUSE-2910]
2018-05-17 19:01:41 +03:00
Nikolai Kochetov
9a1c286ade
Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734]
2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7
validate mutation commands [#CLICKHOUSE-3688]
2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f
alter delete skeleton [#CLICKHOUSE-3688]
2018-05-16 05:46:15 +03:00
Vitaliy Lyudvichenko
abc73eb6ba
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-15 21:35:52 +03:00
sundy-li
5d91b4f2fd
fix some bugs, fix some code styles
2018-05-15 03:02:59 +03:00
sundy-li
200076b593
ADD replace_query, on_duplicate_clause config for StorageMySQL && add docs
2018-05-15 03:02:59 +03:00
sundy-li
763f1fda96
Avoid Excessive copy when block is small enough && fix some code
2018-05-15 03:02:59 +03:00
sundy-li
2511a4784b
Support data write to StorageMySQL table
2018-05-15 03:02:59 +03:00
proller
fb911f7cfa
Allow force disable libs: poco netssl poco mongodb, poco data odbc
2018-05-14 21:36:01 +03:00
Vitaliy Lyudvichenko
de6c48f4df
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9
Removed dbg output, fixed test. [#CLICKHOUSE-2]
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d
Speedup partition check, add more preformance output. [#CLICKHOUSE-2]
...
Faster partition check.
Added more debug info.
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
864dc0546b
Add requested changes. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c
Better naming. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f
Do not save resolved addresses in Connections. [#CLICKHOSUE-2]
...
Add disable_internal_dns_cache main config option.
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777
Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688
Better #2328
2018-05-09 07:49:34 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15
...
Build fixes (gcc8)
2018-05-09 07:25:18 +03:00
Alexey Milovidov
b442cd9c64
Miscellaneous (no effect) [#CLICKHOUSE-2]
2018-05-09 07:22:30 +03:00
proller
eb772b8001
gcc8 fixes (memset, uncaught_exception)
2018-05-08 22:44:54 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name
2018-05-08 15:47:06 +03:00
Alexey Zatelepin
6047db7ea2
fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag)
2018-05-07 23:31:28 +03:00
Alexey Milovidov
94369e55d3
Fixed style a bit [#CLICKHOUSE-2]
2018-05-07 05:01:29 +03:00