Nikolai Kochetov
3a74ec7c0c
Mergred with master
2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090
Make DatsTypeWithDictionary independent from index type.
2018-07-20 13:16:27 +03:00
alesapin
2915a58c8f
Merge remote-tracking branch 'upstream/master'
2018-07-20 13:13:50 +03:00
alesapin
32e03f42ef
CLICKHOUSE-3772: Fix initialization
2018-07-20 13:13:23 +03:00
alesapin
a45e707f41
CLICKHOUSE-3772: Rename column in formats
2018-07-20 13:01:46 +03:00
alesapin
ec156e9f2b
CLICKHOUSE-3772: Add system tables formats, data_type_families, table_functions, aggregate_function_combinators
2018-07-20 13:00:56 +03:00
Alexey Milovidov
245b114363
Quote all identifiers when querying external database #2635
2018-07-20 03:04:48 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. ( #2677 )
...
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]
* Attempt to fix performance regression [#CLICKHOUSE-3796]
* Removed debug output [#CLICKHOUSE-3796]
* Removed debug output [#CLICKHOUSE-3796]
* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]
* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"
This reverts commit 9eafc13f3be28ad4b5fe#2677
* Update InterpreterSelectQuery.cpp
2018-07-19 16:36:21 +03:00
alexey-milovidov
2d3aa8cdba
Update TableMetadata.h
2018-07-16 19:41:15 +03:00
chertus
e65c0b436a
Merge branch 'master' into issue-3578
2018-07-16 18:28:06 +03:00
chertus
2cddb4b840
send metadata only for affected table
2018-07-16 17:52:02 +03:00
alexey-milovidov
f31b1236c1
Update MergeTreeDataSelectExecutor.cpp
2018-07-16 16:44:32 +03:00
proller
0b0a2838c8
Fix compile error with boost 1.68.0
2018-07-16 16:44:32 +03:00
alexey-milovidov
68b57e605a
Merge branch 'master' into background-processing-pool-backoff
2018-07-16 06:27:43 +03:00
alexey-milovidov
4d1c470469
Update MergeTreeData.cpp
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d
save mutations to disk and load them on startup [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0
execute part mutations in a background pool [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88300258a7
info in system.mutations for nonreplicated MergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c
execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748]
2018-07-16 06:22:22 +03:00
chertus
53f1f4794d
fix inserts into unknown table, ex. 'table function url(...)'
2018-07-13 21:06:47 +03:00
chertus
c8f71cb539
Merge branch 'master' into issue-3578
2018-07-13 14:30:42 +03:00
chertus
f89e476c0f
add option to disable sending metadata
2018-07-12 17:33:57 +03:00
chertus
a765aef4db
fix KafkaStorage build and add sql test for defaults
2018-07-11 19:24:29 +03:00
chertus
fe1b393e55
defaults for storages with formated input
2018-07-11 15:05:04 +03:00
chertus
519102b110
defaults for http inserts
2018-07-10 20:20:55 +03:00
Amos Bird
ea01a3b22e
add OPTIMIZE FINAL support for ReplicatedMergeTree.
2018-07-09 18:03:23 +03:00
Alexey Milovidov
7dc1276afe
Little better #2281
2018-07-08 08:26:51 +03:00
Alexey Milovidov
0947c7808d
Avoid locking while reading config to check part_log #2281
2018-07-08 07:54:37 +03:00
Alexey Milovidov
a2faa511cc
Less number of "stat" calls for each INSERT into MergeTree #2281
2018-07-08 06:56:24 +03:00
Alexey Milovidov
3445c78190
Added exponential backoff for BackgroundProcessingPool #2281
2018-07-08 05:57:41 +03:00
Alexey Milovidov
4f2655960c
Fixed test [#CLICKHOUSE-2]
2018-07-07 22:39:20 +03:00
Alexey Milovidov
d2a44248cd
Fixed error with empty TinyLog table; added a test from Nickolay Kovalev #2563
2018-07-07 22:02:10 +03:00
Alexey Milovidov
b714d87de7
Get rid of virtual columns in system.tables table [#CLICKHOUSE-3806]
2018-07-07 21:58:48 +03:00
Alexey Milovidov
93f8316e1f
Little better [#CLICKHOUSE-3806]
2018-07-06 19:34:53 +03:00
Alexey Milovidov
95915579c7
Fixed test [#CLICKHOUSE-3806]
2018-07-06 19:22:15 +03:00
Alex Zatelepin
f7f4f220f1
Update MergeTreeData.cpp
2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6
Recreate format_version.txt when missing
2018-07-06 15:14:23 +03:00
Alexey Milovidov
67b9a69f19
Fixed error in prev. revision [#CLICKHOUSE-3806]
2018-07-06 00:26:23 +03:00
Alexey Milovidov
88c582106b
Attempt to get rid of VirtualColumnFactory (part 2) [#CLICKHOUSE-3806]
2018-07-05 23:38:05 +03:00
Alexey Milovidov
cc2250f688
Attempt to get rid of VirtualColumnFactory (part 1) [#CLICKHOUSE-3806]
2018-07-05 22:56:51 +03:00
Alexey Milovidov
0a188389c0
Fixed error #2599
2018-07-05 21:56:33 +03:00
Alexey Milovidov
4a35b57cea
Little better #2599
2018-07-05 21:45:18 +03:00
Amos Bird
78beacb3a5
Make OPTIMIZE be able to merge all parts with FINAL.
2018-07-05 21:32:54 +03:00
Alexey Zatelepin
d5f8e4a1a5
load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7
switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
0a46d231ed
speedup merge selection: async exists check for selected parts [#CLICKHOUSE-3802]
2018-07-05 20:06:33 +03:00
Alexey Zatelepin
116ed0a59e
add RestartingThread wakeup for faster session recovery
2018-07-05 19:30:52 +03:00
Alexey Zatelepin
fe83c8dab1
stricter validation of mutation commands #2588
2018-07-05 17:19:33 +03:00
Alexey Milovidov
c99e717632
Fixed bad code #2571
2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465
Fixed half of bad code #2571
2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a
Review fixes. [#CLICKHOUSE-3694] #2156
2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910
2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700
BackgroundSchedulePool: remove task from delayed even it it is currently executing
...
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02
Merged with master.
2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b
Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface.
2018-06-26 17:12:21 +03:00
Nikolai Kochetov
60f0ed9296
Added processing stage check for StorageMerge. [#CLICKHOUSE-3694] #2156
2018-06-25 15:47:51 +03:00
Nikolai Kochetov
4f7c284d34
Fixed build.
2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0
Merged with master.
2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299
add comments [#CLICKHOUSE-3747]
2018-06-22 13:43:35 +03:00
zhang2014
f4e72792a5
ISSUES-2553 add offset parameter to numbers
2018-06-22 12:55:36 +03:00
Alexey Zatelepin
e78dc8142c
factor out common code [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1
mutations finalizing task [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d
use single mutex in ReplicatedMergeTreeQueue for simplicity
2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca
calculate and update parts_to_do for mutations [#CLICKHOUSE-3747]
2018-06-21 22:47:44 +03:00
proller
e1ae5233df
Add // Y_IGNORE tags
2018-06-21 18:24:36 +03:00
Nikolai Kochetov
f88584d748
Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary.
2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
1a4157f2a9
clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910]
...
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf
Fixed failures in utils, more precise test. [#CLICKHOUSE-2910]
2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004
Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
...
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes ( #2488 )
...
CONTRIB-254
2018-06-19 21:09:09 +03:00
Alexey Milovidov
2298f1c68b
Fixed strange code #2501
2018-06-16 08:54:06 +03:00
Alexey Milovidov
b108882e2e
Merge branch 'master' of https://github.com/alesapin/ClickHouse into alesapin-master
2018-06-16 08:29:00 +03:00
Alexey Milovidov
4e8082a699
Fixed build [#CLICKHOUSE-2]
2018-06-16 05:16:19 +03:00
Alexey Milovidov
0272fc996a
Fixed build [#CLICKHOUSE-2]
2018-06-16 05:13:54 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd
Add query_id and host_name to server logs. [#CLICKHOUSE-2910]
2018-06-15 16:49:01 +03:00
alesapin
6e07b17632
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:22:56 +03:00
alesapin
148cbe8058
Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring.
2018-06-15 00:20:39 +03:00
alesapin
4125b0c7f3
Merge remote-tracking branch 'upstream/master'
2018-06-14 21:06:24 +03:00
Vitaliy Lyudvichenko
4cd230f85c
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-06-14 16:04:00 +03:00
Alexey Milovidov
1e60b733f4
Fixed warning #2504
2018-06-13 23:02:27 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
...
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
alexey-milovidov
ca883a699d
Update StorageURL.cpp
2018-06-13 21:54:32 +03:00
alexey-milovidov
f546169a4d
Update StorageURL.cpp
2018-06-13 21:51:56 +03:00
Alexey Zatelepin
a3bf3e6d20
add missing columns to system.parts [#CLICKHOUSE-3747]
2018-06-13 18:47:40 +03:00
Alexey Zatelepin
b60a2a90fa
rename method for clarity
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b
system.mutations table skeleton [#CLICKHOUSE-3747]
2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c
store mutation entries in shared_ptr
2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662
save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747]
2018-06-13 17:14:08 +03:00
alesapin
567bbb2bbb
Fix header path and small fixes in tests
2018-06-13 10:36:47 +03:00
alesapin
b42351d36c
Fix format in storage url
2018-06-13 10:00:07 +03:00
alesapin
df4f8bea35
Merge remote-tracking branch 'upstream/master'
2018-06-11 16:31:58 +03:00
alesapin
0f529dbc6e
Add table fuction url and storage URL
2018-06-11 15:13:00 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. ( #2492 )
...
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development): removed very old tests #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
72af2b7b0f
Removed wrong modification #2260
2018-06-10 21:26:02 +03:00
Alexey Milovidov
641076de51
Reverted unclear modification #2260
2018-06-09 21:39:29 +03:00
Alexey Milovidov
ebe5e3f9b6
Reverted unclear modification #2260
2018-06-09 21:35:51 +03:00
Alexey Milovidov
6475ea98c7
Merging: Fixed most of problems, actualized test #2260
2018-06-09 21:17:27 +03:00
Alexey Milovidov
d864f39ec7
Merge branch 'master' into zhang2014-feature/support_truncate
2018-06-09 19:10:06 +03:00
Alexey Milovidov
cfacdf1457
Merging: Fixed most of problems #2260
2018-06-09 19:09:37 +03:00
Alexey Milovidov
d56c199f07
Merging: Fixed half of problems #2260
2018-06-09 18:48:22 +03:00
Vitaliy Lyudvichenko
c04dfb40a6
Fixed memory tracking. [#CLICKHOUSE-2910]
2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e
Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate
2018-06-09 17:24:50 +03:00
Alexey Milovidov
9940b4f8ff
Passing settings to ser/de of data types: development #1710
2018-06-08 05:26:44 +03:00
Alexey Milovidov
29bd48fc7a
Passing settings to ser/de of data types: development #1710
2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad
Passing settings to ser/de of data types: development #1710
2018-06-08 04:51:55 +03:00
Alexey Milovidov
8901414ad2
Fixed error; added test [#CLICKHOUSE-3764]
2018-06-07 23:49:59 +03:00
proller
347579ce46
Cmake: mark system includes as SYSTEM ( #1449 )
...
* contrib: cctz as submodule. update cctz.
* pbuilder: add ubuntu bionic, devel
* Cmake: mark system includes as SYSTEM
* Build fixes
* fix
* Fix package without compiler
* Better
* fix
* fix
* fix
* Build fix
* fix
* fix
* fix
* Cmake: Add SYSTEM to includes for external libs
2018-06-06 23:21:58 +03:00
Alexey Milovidov
267a69fe7e
Better type for number of rows [#CLICKHOUSE-2]
2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5
add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747]
2018-06-06 16:22:30 +03:00
Alexey Zatelepin
dbfee942af
escape serialized AST in MutationCommands (just in case) [#CLICKHOUSE-3747]
2018-06-06 14:30:58 +03:00
Alexey Milovidov
b9b89a5590
Less dependencies [#CLICKHOUSE-2]
2018-06-05 22:46:49 +03:00
Alexey Zatelepin
3947f25365
add general comment about the mutation algorithm [#CLICKHOUSE-3747]
2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning
...
Fix pruning of parts by conditions on partition key columns
2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60
Per granula reading for ColumnWithDictionary in MergeTreeRangeReader.
2018-06-05 13:10:54 +03:00
alexey-milovidov
f69ecf7a9d
Merge pull request #2448 from LiuYangkuan/fix-issue-2439
...
fix Exception in issue#2439
2018-06-04 23:17:44 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19
...
Build fixes
2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio
...
Fixes according to PVS-Studio report.
2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5
Suppressions for PVS-Studio [#CLICKHOUSE-3]
2018-06-04 22:46:47 +03:00
proller
9907388766
32bit Compile fix
2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7
Slightly better (preparation) [#CLICKHOUSE-3]
2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e
check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757]
2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541
calculate primary key when mutating a part [#CLICKHOUSE-3747]
2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde
Fixed bug found by PVS-Studio [#CLICKHOUSE-3]
2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad
add comments [#CLICKHOUSE-3747]
2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866
introduce constants for max level and max block number
2018-06-04 14:23:47 +03:00
Alexey Milovidov
7c60adbebb
Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2]
2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2
Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2]
2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39
Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2]
2018-06-03 20:43:56 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h
2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b
Initialize external tables after enqueue query. [#CLICKHOUSE-2910]
2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c
Merge branch 'master' into replicated-mergetree-mutations
2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b
Removed wrong query optimization [#CLICKHOUSE-3726]
2018-05-31 21:28:04 +03:00
Alexey Zatelepin
f63d2dc3c8
cannot take a number of unlocked abandonable lock
2018-05-31 20:28:17 +03:00
Vitaliy Lyudvichenko
0355f81f20
[WIP] Introduced query_thread_log. [#CLICKHOUSE-2910]
2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b
support skipping mutations (just in case) [#CLICKHOUSE-3747]
2018-05-31 18:21:00 +03:00
Babacar Diassé
3d518e48b9
NULL check to allow insertion in distributed tables with Materialized views
2018-05-31 17:21:35 +03:00
Vitaliy Lyudvichenko
dc5de3bbec
More optimal conflicts check in future_parts. [#CLICKHOUSE-2]
2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24
Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3]
...
Resolves #2315
2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458
easier init and deactivation of BackgroundSchedulePool tasks
2018-05-31 16:18:52 +03:00
LiuYangkuan
7eb25ef55b
fix Exception in issue#2439
2018-05-30 11:11:53 -04:00
Vitaliy Lyudvichenko
e265e5c2ab
Refactoring. [#CLICKHOUSE-2910]
2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06
Add more perfomance counters. [#CLICKHOUSE-2910]
2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56
Merge branch 'master' into replicated-mergetree-mutations
...
Conflicts:
dbms/src/Common/ActionBlocker.h
dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
dbms/src/Storages/MergeTree/ActiveDataPartSet.h
dbms/src/Storages/MergeTree/MergeTreeData.h
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
dbms/src/Storages/StorageMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.cpp
dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15
part log and metrics [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed
support empty parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972
DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c
execute mutation log entries [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66
mutation executor for MergeTree [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8
select and write part mutations to queue [#CLICKHOUSE-3747]
2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd
more honest constness in ActionBlocker
2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782
don't select merges of parts with different mutation versions [#CLICKHOUSE-3747]
2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146
notify relevant events directly from queue [#CLICKHOUSE-3747]
2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7
load mutations from ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2
write mutations to ZK [#CLICKHOUSE-3747]
2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3
test getting abandonable lock in all partitions [#CLICKHOUSE-3747]
2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76
parts versioning [#CLICKHOUSE-3687]
2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf
merge selection based on checking current inserts [#CLICKHOUSE-3732]
2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master
...
Fix DateTime vs DateTime('UTC') inconsistency on data read.
2018-05-25 21:44:11 +03:00
Alexey Milovidov
13762471da
Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3]
2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259
More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743]
2018-05-23 19:18:04 +03:00
Alex Bocharov
3618842579
Fix DateTime vs DateTime('UTC') inconsistency on data read.
...
Original problem was described in PR #1650 and partially fixed by
b5af4c95
2018-05-22 12:23:07 +01:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion
...
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
2018-05-21 22:42:42 +03:00
Vitaliy Lyudvichenko
8349d2b9a0
Fixed gcc7 compilation. [#CLICKHOUSE-2]
2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
...
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]
* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]
* Disable merges in the dropping range. [#CLICKHOUSE-3546]
* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]
* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]
SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]
* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]
* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]
* Add system.part_log logging. [#CLICKHOUSE-3546]
* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]
* Add requested changes. [#CLICKHOUSE-3546]
Fixed clickhouse-client bad return code.
* Add requested chenges. [#CLICKHOUSE-3546]
* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7
Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo.
2018-05-21 14:18:11 +03:00
zhang2014
fa865636ce
ISSUES-2259 add comment & move delete database metadata implementation
2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa
ISSUES-2259 fix the test after the merge master
2018-05-21 11:38:46 +08:00
zhang2014
6613e56784
ISSUES-2259 support truncate syntax
2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
...
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
...
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5
Style #2387
2018-05-18 21:31:18 +03:00
Nikolai Kochetov
5e22f19258
Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734]
2018-05-18 20:27:58 +03:00
Vitaliy Lyudvichenko
4b093e3e0a
Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2]
...
This patch is very crucial in case of many replicas.
2018-05-18 02:01:36 +03:00
Vitaliy Lyudvichenko
bd4d8a6766
Add profile events and settings logging. [#CLICKHOUSE-2910]
2018-05-17 19:01:41 +03:00
Nikolai Kochetov
9a1c286ade
Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734]
2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7
validate mutation commands [#CLICKHOUSE-3688]
2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f
alter delete skeleton [#CLICKHOUSE-3688]
2018-05-16 05:46:15 +03:00
Vitaliy Lyudvichenko
abc73eb6ba
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-15 21:35:52 +03:00
sundy-li
5d91b4f2fd
fix some bugs, fix some code styles
2018-05-15 03:02:59 +03:00
sundy-li
200076b593
ADD replace_query, on_duplicate_clause config for StorageMySQL && add docs
2018-05-15 03:02:59 +03:00
sundy-li
763f1fda96
Avoid Excessive copy when block is small enough && fix some code
2018-05-15 03:02:59 +03:00
sundy-li
2511a4784b
Support data write to StorageMySQL table
2018-05-15 03:02:59 +03:00
proller
fb911f7cfa
Allow force disable libs: poco netssl poco mongodb, poco data odbc
2018-05-14 21:36:01 +03:00
Vitaliy Lyudvichenko
de6c48f4df
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910
2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9
Removed dbg output, fixed test. [#CLICKHOUSE-2]
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d
Speedup partition check, add more preformance output. [#CLICKHOUSE-2]
...
Faster partition check.
Added more debug info.
2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
864dc0546b
Add requested changes. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c
Better naming. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f
Do not save resolved addresses in Connections. [#CLICKHOSUE-2]
...
Add disable_internal_dns_cache main config option.
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777
Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645]
2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688
Better #2328
2018-05-09 07:49:34 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15
...
Build fixes (gcc8)
2018-05-09 07:25:18 +03:00
Alexey Milovidov
b442cd9c64
Miscellaneous (no effect) [#CLICKHOUSE-2]
2018-05-09 07:22:30 +03:00
proller
eb772b8001
gcc8 fixes (memset, uncaught_exception)
2018-05-08 22:44:54 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name
2018-05-08 15:47:06 +03:00
Alexey Zatelepin
6047db7ea2
fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag)
2018-05-07 23:31:28 +03:00
Alexey Milovidov
94369e55d3
Fixed style a bit [#CLICKHOUSE-2]
2018-05-07 05:01:29 +03:00
proller
7781492624
Fix user name on distributed queries ( #2292 )
...
* Fix user name on distributed queries
* wip
* fix
2018-05-05 00:21:23 +03:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master
2018-04-29 18:02:34 +02:00
Tsarkova Anastasia
2c96b1c684
Add comments. Change projection restoring function.
2018-04-29 15:49:58 +02:00
Vitaliy Lyudvichenko
e152f223c9
Fix nodes leak in case of session expiration. [#CLICKHOUSE-2]
2018-04-26 22:46:45 +03:00
Silviu Caragea
1dd5a704fc
Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c
Conditional computations.
2018-04-24 09:16:39 +02:00
Nikolai Kochetov
7a62bb9267
added comments and fixed tests build
2018-04-23 22:41:10 +03:00
Alexey Milovidov
958a3d7ee7
Fixed error with Arrays inside Nested data type; added a test #2066
2018-04-22 20:30:28 -07:00
Alexey Milovidov
499b67642f
Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2]
2018-04-21 21:41:06 +03:00
Nikolai Kochetov
7e45661a38
merged with master
2018-04-20 22:51:21 +03:00
Alexey Milovidov
ac48e1e911
Fixed error #2246
2018-04-20 20:34:09 +03:00
Kirill Shvakov
918dbc2902
#2249 allow macros while creating kafka engine
2018-04-20 19:10:26 +03:00
Nikolai Kochetov
a6375d6155
merged with master
2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620
fix build
2018-04-20 17:06:01 +03:00
Alexey Milovidov
6b88a2a7a5
Better info in log #2246
2018-04-20 04:14:04 +03:00
Alexey Milovidov
70be882b64
Renamed PK to Key where it's appropriate #2246
2018-04-20 03:27:25 +03:00
Alexey Milovidov
d71b3a95ef
Renamed PK to Key where it's appropriate #2246
2018-04-20 03:20:50 +03:00
Alexey Milovidov
ce0ac3f8f8
Fixed error with Sets, part 2 #2246
2018-04-20 00:34:04 +03:00
Alexey Milovidov
fee22dac33
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-19 23:34:23 +03:00
Alexey Milovidov
c0978919e3
Fixed error with partition key IN, part 1 #2246
2018-04-19 23:34:02 +03:00
张健
e9b03b3abc
ISSUES-2242 add default data_path & metadata_path for system.tables with temporary ( #2243 )
2018-04-19 23:22:08 +03:00
Alexey Milovidov
12e33cfd85
Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2]
2018-04-19 21:16:18 +03:00
Alexey Milovidov
da94c7dd91
Exit from queueUpdatingThread when ZooKeeper session is expired (non-significant change) [#CLICKHOUSE-2]
2018-04-19 21:01:50 +03:00
Nikolai Kochetov
dd10c2073c
merged with master
2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675
added IStorage::getQueryProcessingStage
2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da
Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
...
# Conflicts:
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11
Allowed to read files by table function "file" inside "user_files_path" #2164
2018-04-19 08:32:09 +03:00
alexey-milovidov
08dfd8a09b
Merge pull request #2164 from topvisor/add_table_function_file
...
Add table function file
2018-04-19 07:53:49 +03:00
alexey-milovidov
8f5436e8b0
Update StorageFile.cpp
2018-04-19 07:39:48 +03:00
alexey-milovidov
4b3aa3fc11
Update StorageFile.cpp
2018-04-19 07:39:16 +03:00
alexey-milovidov
19f918512b
Update StorageFile.cpp
2018-04-19 07:36:08 +03:00
Alexey Milovidov
a55abd0a25
Fixed test [#CLICKHOUSE-2]
2018-04-18 23:27:27 +03:00
Alexey Milovidov
3eff0184fa
Added set size checking when set from subquery is used for index; removed harmful feature for special support of (a, b) IN (SELECT (a, b)) instead of (a, b) IN (SELECT a, b) [#CLICKHOUSE-2]
2018-04-18 22:38:40 +03:00
alexey-milovidov
22f7a3a545
Merge pull request #2223 from sundy-li/master
...
Fix:ignore the format_version check when the data is empty
2018-04-17 22:50:26 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
...
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
bf832b3ea6
Fixed OPTIMIZE after RENAME of replicated table. [#CLICKHOUSE-2]
2018-04-17 20:59:42 +03:00
proller
27b4af9dd7
Change obsolete comment
2018-04-16 23:25:07 +03:00
alexey-milovidov
17dd218338
Merge pull request #2202 from proller/fix15
...
CLICKHOUSE-3700: Fix empty password on replica query
2018-04-16 23:18:47 +03:00
Nikolai Kochetov
081f0feb56
fix test [#CLICKHOUSE-3694] #2156
2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a
merged with master
2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34
minor fixes
2018-04-16 18:11:13 +03:00
sundy-li
12211ffc5b
Fix:ignore the format_version check when the data is empty
2018-04-16 18:04:59 +08:00
Nikolai Kochetov
41229b201b
Merge branch 'master' into fix-header-for-union-stream-in-distributed-2
2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5
fix perf
2018-04-13 23:09:13 +03:00
Nikolai Kochetov
42f9a4d773
added PrewhereInfo [#CLICKHOUSE-3694] #2156
2018-04-11 22:10:08 +03:00
Nikolai Kochetov
c9abeed3f5
remove unused columns from prewhere actions [#CLICKHOUSE-3694] #2156
2018-04-11 22:08:53 +03:00
proller
157067b127
CLICKHOUSE-3700: Fix empty password on replica query
2018-04-10 17:49:52 +03:00
Silviu Caragea
f1b8d4bc39
Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
2018-04-10 16:27:17 +03:00
Silviu Caragea
c547c5a7b0
Merge remote-tracking branch 'origin/background-schedule-pool-fix'
...
# Conflicts:
# dbms/src/Common/ZooKeeper/LeaderElection.h
# dbms/src/Common/ZooKeeper/ZooKeeper.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
# dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
# dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
# dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
decaseal
40b41c3c6e
storage file - change error code [#add_table_function_file]
2018-04-10 11:54:31 +03:00
decaseal
e8ae0343ed
Merge remote-tracking branch 'yandex/master' into add_table_function_file_dev
2018-04-10 10:30:46 +03:00
decaseal
279fa17ff6
storage file - fix check creation is allowed [#add_table_function_file]
2018-04-10 10:09:50 +03:00
Alexey Milovidov
d3cf85057b
Removed useless code [#CLICKHOUSE-2]
2018-04-09 18:49:12 +03:00
proller
c26b3bdef1
Fix split shared build; fix build without system odbc libs ( #2191 )
...
* Fix split shared build
* Fix build without system odbc libs
* Move dbms/src/Common/iostream_debug_helpers.h -> libs/libcommon/include/common/iostream_debug_helpers.h
* Fix build with libiodbc
2018-04-09 06:52:39 -07:00
Alexey Milovidov
18bbd0e61b
Moved SessionPoolHelpers #2180
2018-04-07 06:07:32 +03:00
Alexey Milovidov
0a4b349f73
Merge branch 'master' of github.com:yandex/ClickHouse
2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664
ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2]
2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race
...
Fix races in leader election.
2018-04-07 00:18:26 +03:00
Alexey Milovidov
0d8d99e7a4
Fixed typo [#CLICKHOUSE-2]
2018-04-06 22:48:54 +03:00
Alexey Milovidov
ee7fe63b69
Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2]
2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2
Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2]
2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f
fix races in leader election [#CLICKHOUSE-3533]
2018-04-06 19:10:23 +03:00
decaseal
139b40f976
storage file - fix check creation is allowed [#add_table_function_file]
2018-04-06 16:43:29 +03:00
decaseal
157d51446b
Merge remote-tracking branch 'yandex/master' into add_table_function_file_dev
2018-04-06 15:55:02 +03:00
decaseal
30e79f4c7d
storage file - relative table path starts with db_dir_path [#add_table_function_file]
2018-04-06 13:35:52 +03:00
decaseal
8b96dc8c7e
storage file - test db_dir_path [#add_table_function_file]
2018-04-06 13:24:12 +03:00
decaseal
7296bf2cb7
storage file - fix check table file path [#add_table_function_file]
2018-04-06 13:11:39 +03:00
decaseal
39cc42172d
storage file - check table file path [#add_table_function_file]
2018-04-06 12:53:29 +03:00
Alexey Milovidov
f66d2fb780
Allow to use FINAL even in case of single part #2086
2018-04-06 00:36:55 +03:00
Nikolai Kochetov
b96039bafe
added check for partition column in mayBenefitFromIndexForIn #2170
2018-04-05 00:03:16 +03:00
alexey-milovidov
e2a517db12
Update MergeTreeData.cpp
2018-04-04 00:17:22 +03:00
Nikolai Kochetov
2163977b2a
mayBenefitFromIndexForIn returns true if at least one tuple element is in pk [#CLICKHOUSE-3680]
2018-04-04 00:17:22 +03:00
Alexey Milovidov
08170d0d77
Modifications after removing libzookeeper [#CLICKHOUSE-2]
2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947
Miscellaneous [#CLICKHOUSE-2]
2018-04-03 20:35:48 +03:00
proller
e58b0830e6
Prepare to new poco (PocoData renamed to PocoSQL) ( #2158 )
2018-04-03 04:48:40 -07:00
KochetovNicolai
62e6a1bde6
Update MergeTreeBaseBlockInputStream.cpp
...
Check is block is not empty before removing prewhere column
2018-04-02 17:08:05 +03:00
Silviu Caragea
f811da7ed4
Move merge selection state into ReplicatedMergeTreeMergeSelectingThread
2018-04-02 15:45:55 +03:00
proller
440b0f33c7
Compile fixes
2018-04-02 15:31:49 +03:00
Alexey Milovidov
3fe743e2bd
Fixed error after merge [#CLICKHOUSE-2]
2018-04-01 22:29:08 +03:00
alexey-milovidov
b07fb1ddda
Merge branch 'master' into better-range-reader
2018-04-01 22:16:39 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite
2018-04-01 17:31:20 +03:00
proller
a6f9df105c
Allow use encryption for distributed tables ( #2065 )
...
* Allow use encryption for distributed tables
* wip
* fix
* rename encryption to secure
* Fix DirectoryMonitor with +secure
* fix
* fix
* Update DirectoryMonitor.cpp
* Update DirectoryMonitor.cpp
2018-03-29 04:41:06 +03:00
alexey-milovidov
4126c7767d
Merge pull request #2130 from yandex/fix-distributed-batch-inserts
...
More aggressively move files to broken/ when doing distributed batch inserts
2018-03-29 03:12:28 +03:00
alexey-milovidov
2e15ce6791
Merge pull request #2132 from yandex/small-enhancements
...
Small enhancements
2018-03-29 03:07:49 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database
2018-03-29 03:01:07 +03:00
Vitaliy Lyudvichenko
701b58b4ff
Faster DROP PARTITION. [#CLICKHOUSE-2]
2018-03-28 15:48:40 +03:00
Alexey Zatelepin
aa4f4e62fe
mark failed batches as broken [#CLICKHOUSE-3594]
2018-03-28 15:28:15 +03:00
Alexey Zatelepin
00da8a477c
report broken files more accurately [#CLICKHOUSE-3594]
2018-03-28 15:28:15 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database
...
Show create database
2018-03-28 05:29:36 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
...
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
Silviu Caragea
1418e339e4
Rename merge_selecting_handle with merge_selecting_task_handle for consistency
2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6)
2018-03-26 23:12:17 +03:00
Silviu Caragea
438121e45b
Renamed Zookeeper get method with getWatch for consistency
2018-03-26 23:08:14 +03:00
Silviu Caragea
50992843c6
Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle)
2018-03-26 22:59:58 +03:00
Silviu Caragea
4361df913b
Remove exists and use existsWatch instead for WatchCallbacks
2018-03-26 22:46:14 +03:00
Silviu Caragea
31874ed172
Use consistent names for the task variables
2018-03-26 22:37:47 +03:00
alexey-milovidov
03b01fc249
Merge pull request #2118 from yandex/faster-sync-insert
...
Faster distributed sync insert
2018-03-26 22:23:41 +03:00
Vitaliy Lyudvichenko
190964f98e
Avoid extra waits in copier. [#CLICKHOUSE-2]
2018-03-26 21:39:28 +03:00
Alex Zatelepin
c5b04f7f17
Add info about total uncompressed part size to system tables ( #2052 )
...
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]
* rename for clarity
* use more appropriate method for calculating table size
* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]
* rename columns for clarity [#CLICKHOUSE-2831]
* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
alexey-milovidov
db4944508f
Merge pull request #2100 from tobad357/bugfix/fix-subscribe-multiple-topics
...
#2095 Make sure to split the topics args list on ','
2018-03-26 01:43:21 +03:00
alexey-milovidov
237c530b4e
Update StorageKafka.cpp
2018-03-26 01:42:36 +03:00
Alexey Milovidov
522bf01db9
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352
Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite
2018-03-24 23:30:57 +03:00
Alexey Milovidov
87b4d8209a
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:28:43 +03:00
Alexey Milovidov
7ec66830af
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:17:27 +03:00
Alexey Milovidov
58f32f98d7
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-24 23:00:16 +03:00
Tobias Adamson
0af09ae0c7
Add trim to topic names to be a bit more lenient if config is 'topic1, topic2'
2018-03-24 14:51:35 +08:00
Tobias Adamson
dd06b39e5f
Fix rename of variable, duplication of wrong variable name
2018-03-24 09:16:33 +08:00
Alexey Milovidov
26584844b6
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8
Rewriting ZooKeeper library [#CLICKHOUSE-2]
2018-03-24 03:45:04 +03:00
Alexey Zatelepin
cf3c24d07d
break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664]
2018-03-23 23:30:04 +03:00
proller
caf83a650e
libs: compiling with msvc2017 ( #1996 )
...
* Allow use bundled *ssl library
* fix
* Add submodule
* Fixes
* fix
* fixes
* fixes
* fix
* fix
* update poco
* fix warnings
* fix
* fix
* Build fixes
* Build fixes
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* add bat
* no zookeeper in dbms
* update boost
* fixes
* fixes
* fix
* fix
* fix
* fix
* try fix
* try fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* fix
* Better
* fix
* dh verbose
* fix
* dh verbose
* fix
* clean
* Update LocalDate.h
* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Tobias Adamson
c76d1a008d
Make sure to split the topics args list on ','
2018-03-23 22:13:09 +08:00
KochetovNicolai
aacc0bee53
Merge pull request #2097 from yandex/CLICKHOUSE-3663
...
Clickhouse 3663
2018-03-23 14:56:08 +03:00
Nikolai Kochetov
2f468f1ae1
fix test [#CLICKHOUSE-3663]
2018-03-23 13:50:20 +03:00
alexey-milovidov
cf52c2840a
Merge branch 'master' into better-range-reader
2018-03-23 02:14:40 +03:00
Alexey Milovidov
0a06971e43
Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite
2018-03-23 02:10:00 +03:00
alexey-milovidov
a75d5525e7
Update MergeTreeDataPartChecksum.h
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
883de7a2a6
startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038
Add minimalistic checksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
7c2a99c9b8
Introduced MinimalisticDataPartChecksums. [#CLICKHOUSE-3660]
2018-03-23 00:26:46 +03:00
Nikolai Kochetov
cbfd862fa3
fix reading with evaluated defaults [#CLICKHOUSE-3663]
2018-03-22 23:18:11 +03:00
Nikolai Kochetov
97624d7d78
fix reading with evaluated defaults [#CLICKHOUSE-3663]
2018-03-22 22:53:19 +03:00
Silviu Caragea
a2dc16a582
Remove the link between TaskHandles and ZooKeeper
2018-03-22 17:21:14 +02:00
Silviu Caragea
6629b03af9
Fixed few of the observation of the code review
2018-03-22 17:09:30 +02:00
Silviu Caragea
b24a4b2111
Add back the buggy BackgroundSchedulePool
2018-03-22 17:07:12 +02:00
Alexey Milovidov
d690c24198
Using different ZooKeeper library (development) [#CLICKHOUSE-2]
2018-03-22 00:40:53 +03:00
Nikolai Kochetov
476d4b339c
Immutable construction for columns
2018-03-20 22:45:10 +03:00
Nikolai Kochetov
a399c17f01
&& - qualified IColumn::mutate
2018-03-20 17:01:00 +03:00
Alexey Zatelepin
86d53b34a5
forward ALTER PARTITION statements for materialized views [#CLICKHOUSE-3659]
2018-03-20 16:44:36 +03:00
Vitaliy Lyudvichenko
e41b653f14
Parallelized block split in sync Distributed insert. [#CLICKHOUSE-2]
2018-03-19 21:26:52 +03:00
Alexey Zatelepin
b1274f7b34
fix deadlock in StorageKafka::shutdown() in case startup() wasn't called #2075
2018-03-19 20:52:48 +03:00
Alexey Milovidov
590feb02b5
Fixed error; added test from Alexander Zaitsev [#CLICKHOUSE-2]
2018-03-19 17:29:40 +03:00
Alexey Milovidov
a6892b8813
Fixed test [#CLICKHOUSE-2]
2018-03-16 12:00:04 +03:00
Alexey Milovidov
02c67e2b13
Fixed error [#CLICKHOUSE-2]
2018-03-16 09:51:37 +03:00
Alexey Milovidov
25a691f03d
Don't allow Distributed table that look at itself [#CLICKHOUSE-2919].
2018-03-16 05:08:31 +03:00
Alexey Milovidov
b5e4d0692a
Disallow PREWHERE, SAMPLE, FINAL in MATERIALIZED VIEWs [#CLICKHOUSE-2].
2018-03-16 04:23:37 +03:00
alexey-milovidov
b9339e0ea1
Merge pull request #2053 from yandex/small-enhancements
...
Small enhancements
2018-03-15 22:10:29 +03:00
alexey-milovidov
1e88f2fe5c
Update AbandonableLockInZooKeeper.h
2018-03-15 22:06:53 +03:00
alexey-milovidov
e64b2df874
Update ReplicatedMergeTreeBlockOutputStream.cpp
2018-03-15 22:06:23 +03:00
alexey-milovidov
1554390bab
Update AbandonableLockInZooKeeper.h
2018-03-15 22:05:58 +03:00
Vitaliy Lyudvichenko
16dad209f7
Do not make extra ZK RTTs in inserts. [#CLICKHOUSE-3]
...
Resolves #2054
2018-03-15 21:40:59 +03:00
Vitaliy Lyudvichenko
4011afa399
Parallel SELECT and INSERT in ClusterCopier. [#CLICKHOUSE-2]
2018-03-14 23:49:18 +03:00
Vitaliy Lyudvichenko
f1b32e8982
Fixed ordinary MergeTree merges in case of empty ORDER BY key. [#CLICKHOUSE-2]
2018-03-14 23:49:18 +03:00
Nikolai Kochetov
51301d38cd
added tryGetCreateTableQuery [#CLICKHOUSE-3590]
2018-03-14 22:56:44 +03:00
Alexey Milovidov
3c16faaff0
Merge branch 'master' of github.com:yandex/ClickHouse
2018-03-14 21:57:15 +03:00
alexey-milovidov
e5836cf97f
Merge pull request #2036 from yandex/CLICKHOUSE-3639
...
Fixed ZooKeeper with chroot, refactoring of ZooKeeper::multi*
2018-03-14 21:56:22 +03:00
Alexey Milovidov
9862f17ae4
Merge branch 'master' of github.com:yandex/ClickHouse
2018-03-14 19:40:32 +03:00
Alexey Milovidov
57279a87c7
Whitespaces [#CLICKHOUSE-2].
2018-03-14 19:40:08 +03:00
Vitaliy Lyudvichenko
7abbe093e9
Avoid magic constants in system.parts. [#CLICKHOUSE-3]
...
Resolves #2039
2018-03-14 19:04:19 +03:00
Vitaliy Lyudvichenko
56bfb05ebb
Fix insane DateTime in system.parts. [#CLICKHOUSE-3]
2018-03-14 19:00:02 +03:00
Vitaliy Lyudvichenko
8028ba0de9
Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2]
2018-03-14 16:29:03 +03:00
Nikolai Kochetov
d6e9d08d5e
getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590]
2018-03-14 15:37:38 +03:00
Alexey Milovidov
c9d1b61ef7
Fixed build after merge #2029
2018-03-14 06:19:23 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration
2018-03-14 05:35:50 +03:00
kshvakov
3ae2e443fd
Revert "Fix quotes in partition display name based on Date, DateTime or UUID type"
...
This reverts commit 10aa9cfc8a
2018-03-14 03:33:21 +03:00
Kirill Shvakov
0a33b774a3
Fix quotes in partition display name based on Date, DateTime or UUID type
2018-03-14 03:33:21 +03:00
alexey-milovidov
04cc8a52f7
Merge pull request #2032 from yandex/system-table-macro
...
System table macro
2018-03-14 02:10:30 +03:00
alexey-milovidov
8522a1b4d1
Update StorageSystemMacros.h
2018-03-14 02:09:26 +03:00
Alexey Zatelepin
5906c9a988
rename for clarity
2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac
encapsulate ColumnsDeclaration [#CLICKHOUSE-3241]
2018-03-13 17:41:25 +03:00
Alexey Milovidov
b7475b1d2c
Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641]
2018-03-12 23:25:18 +03:00
Alexey Zatelepin
de1db216a5
getStructureOfRemoteTable returns info about column default kinds [#CLICKHOUSE-3241]
2018-03-12 23:21:54 +03:00
Alexey Zatelepin
78d92f6794
add some useful methods, rename for clarity [#CLICKHOUSE-3241]
2018-03-12 22:10:13 +03:00
Alexey Zatelepin
972db7b072
iterate over materialized columns where it makes sense
2018-03-12 22:07:48 +03:00
Alexey Zatelepin
71642b0880
use ColumnsDescription everywhere [#CLICKHOUSE-3241]
2018-03-12 22:07:48 +03:00
Nikolai Kochetov
8b09e55102
added system.macros table [#CLICKHOUSE-3591]
2018-03-12 21:38:00 +03:00
Nikolai Kochetov
4dd7f47ad5
reload macros with config [#CLICKHOUSE-3591]
2018-03-12 21:16:51 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346
...
Sync insert and сluster copier enhancements
2018-03-12 20:58:53 +03:00
Nikolai Kochetov
60ab3294b1
fix concurrent select from system.parts_columns
2018-03-12 19:23:48 +03:00
Vitaliy Lyudvichenko
30b69c84ae
Fixed Illegal PREWHERE error for Merge tables over Distributed. [#CLICKHOUSE-3637]
2018-03-12 18:14:26 +03:00
Vitaliy Lyudvichenko
32b617e1d6
Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346]
2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670
Merged Limits to Settings [#CLICKHOUSE-2021]
2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3
Fixed error with initialization of PartLog [#CLICKHOUSE-3354]
2018-03-10 22:57:13 +03:00
Alexey Milovidov
5fc47bdfb1
Fixed error [#CLICKHOUSE-3627]
2018-03-10 03:26:17 +03:00
Alexey Milovidov
3f8ef38b41
Fixed wording #245
2018-03-10 02:23:15 +03:00
Alexey Milovidov
97b30d0b33
Added column "peak_memory_usage" to SHOW PROCESSLIST #245
2018-03-10 02:09:28 +03:00
Alexey Milovidov
add4d29298
Added "is_cancelled" columns to SHOW PROCESSLIST #245
2018-03-10 00:12:52 +03:00
alexey-milovidov
e41e2fe613
Merge pull request #1912 from zhang2014/fix/ISSUES-369
...
ISSUES-369 add default database when create materialize view
2018-03-07 23:28:17 +03:00
proller
d73fea5ab0
Fix macos compile ( #2006 )
...
* Fix macos compile
* rename cluster-copier -> copier
2018-03-07 21:17:17 +03:00
Vitaliy Lyudvichenko
96d4e59dab
Simplified logic of distributed sync insert. [#CLICKHOUSE-2]
2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
47d1d4c83c
More effective retries, fast partition discovering. [#CLICKHOUSE-3346]
2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
364f519eea
Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910]
2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
efdda9cc9b
Introduced ThreadStatus. [#CLICKHOUSE-2910]
2018-03-07 14:35:10 +03:00
Nikolai Kochetov
532b57aef8
perf. fixes
2018-03-07 01:05:36 +03:00
Alex Zatelepin
90ea45a397
better exception message [#CLICKHOUSE-3599]
2018-03-06 22:01:45 +03:00
Alexey Zatelepin
ec91d29d6a
correct MergingParams columns check [#CLICKHOUSE-3599]
2018-03-06 20:17:58 +03:00
Alexey Milovidov
8bc40879ab
Fixed error [#CLICKHOUSE-2]
2018-03-06 19:11:29 +03:00
proller
82a361d0e9
Show error to client if query was killed ( #1989 )
...
* Show error to client if query was killed
* Kill exception v2
* Use kill
* fix
* wip
* fix
* fxi
* try fix
* Revert "try fix"
This reverts commit eb76e4c040
2018-03-06 00:09:39 +03:00
Nikolai Kochetov
b2b1588d5f
added FilterWithZerosCounter
2018-03-05 17:25:20 +03:00
Nikolai Kochetov
8b01ec2225
Merge branch 'master' into better-range-reader
2018-03-05 15:55:06 +03:00
Alexey Milovidov
91a6a88102
Explicit semantic for TSan [#CLICKHOUSE-2]
2018-03-03 21:00:46 +03:00
Alexey Milovidov
07d8db9f2a
Explicit semantic for TSan [#CLICKHOUSE-2]
2018-03-03 20:44:53 +03:00
Alexey Milovidov
368f46d764
Addition to prev. revision [#CLICKHOUSE-2]
2018-03-03 19:48:24 +03:00
Alexey Milovidov
2e371822ad
Changed low level data race to high level data race [#CLICKHOUSE-2]
2018-03-03 19:46:32 +03:00
Alexey Milovidov
3b0d713120
Cleanup semantics [#CLICKHOUSE-2]
2018-03-03 19:26:06 +03:00
Alexey Milovidov
c897e5ca39
Better [#CLICKHOUSE-2]
2018-03-03 18:36:20 +03:00
Alexey Milovidov
8c37547bfe
Fixed harmless data race [#CLICKHOUSE-2]
2018-03-03 18:35:24 +03:00
alexey-milovidov
9b4ea7acde
Merge pull request #1933 from zhang2014/fix/ISSUES-1386
...
ISSUES-1386 add illegal column exception when drop exist depend
2018-03-02 22:33:57 +03:00
alexey-milovidov
1bc8e61d8b
Update AlterCommands.cpp
2018-03-02 22:33:04 +03:00
alexey-milovidov
e57124481e
Update AlterCommands.cpp
2018-03-02 22:32:30 +03:00
Alexey Milovidov
bf924d1c9d
Better name [#CLICKHOUSE-2]
2018-03-02 21:51:59 +03:00
Nikolai Kochetov
7851e71a2a
fix continueReadingChain from several mark ranges
2018-03-02 16:05:33 +03:00
zhang2014
c400613f03
Merge branch 'master' into fix/ISSUES-369
2018-03-02 18:55:15 +08:00
zhang2014
4a38e97ed6
Merge branch 'master' into fix/ISSUES-1386
2018-03-02 18:03:18 +08:00
Alexey Milovidov
22bbc9f08c
Added limit on size of AST after expansion of aliases [#CLICKHOUSE-18]
2018-03-02 09:33:17 +03:00
zhang2014
54cba2f5a6
Fix exist subquery when create materializer view
2018-03-02 01:05:03 +08:00
Alexey Milovidov
c42d3ac17f
Fixed error (PREWHERE in Distributed table) #1947
2018-03-01 10:11:35 +03:00
Alexey Milovidov
fe2da8a2c7
Added method rename for StorageView [#CLICKHOUSE-2]
2018-03-01 07:23:32 +03:00
Alexey Milovidov
9c68584281
Fixed error #1947
2018-02-28 22:47:33 +03:00
Alexey Milovidov
c35727c7ed
Miscellaneous #1947
2018-02-28 03:07:39 +03:00
Alexey Milovidov
ac37b89b16
Better UNION ALL: development #1947
2018-02-26 12:05:06 +03:00
Alexey Milovidov
601ff1eee4
Simplification of AST #1947
2018-02-26 06:37:08 +03:00
Alexey Milovidov
88b01e867d
Better UNION ALL: development #1947
2018-02-25 10:39:45 +03:00
Alexey Milovidov
6e93635275
Better UNION ALL: development #1947
2018-02-25 09:35:24 +03:00
Alexey Milovidov
6e8572e628
Merge branch 'master' into better-union-all-try2
2018-02-25 08:03:59 +03:00
Alexey Milovidov
722b6287ec
Miscellaneous [#CLICKHOUSE-2]
2018-02-25 05:43:27 +03:00
Alexey Milovidov
ab594375ab
Better UNION ALL: development #1947
2018-02-25 03:50:53 +03:00
Alexey Milovidov
2b974554e5
Fixed test [#CLICKHOUSE-2]
2018-02-24 04:55:43 +03:00
Alexey Milovidov
cae7f96f34
Simplification [#CLICKHOUSE-2]
2018-02-23 13:02:29 +03:00
Alexey Milovidov
ecc3ab8636
Fixed test #1896
2018-02-23 11:42:10 +03:00
Alexey Milovidov
ce1f9d7feb
Fixed error #1947
2018-02-23 08:59:12 +03:00
Alexey Milovidov
640daaf052
Fixed test #1947
2018-02-23 04:00:47 +03:00
Alexey Milovidov
245fd61b12
Unify NullableAdapterBlockInputStream and CastTypeBlockInputStream #1947
2018-02-23 02:02:35 +03:00
Alexey Milovidov
f792ab0824
Remove RemoveColumnsBlockInputStream #1947
2018-02-23 00:35:17 +03:00
alexey-milovidov
7a5ccc86cc
Merge pull request #1937 from yandex/CLICKHOUSE-3606
...
Update of clickhouse-copier
2018-02-22 23:42:33 +03:00
alexey-milovidov
82fa3883f8
Merge pull request #1930 from yandex/nonblocking-precommitted
...
Allow PreCommitted parts to contain each other
2018-02-22 23:35:16 +03:00
alexey-milovidov
2acdba3781
Merge pull request #1943 from yandex/add_path_to_system_tables_and_databases
...
Add path to system tables and databases
2018-02-22 19:26:19 +03:00
Nikolai Kochetov
976d2a49fe
merged with master
2018-02-22 14:54:26 +03:00
Nikolai Kochetov
733156438a
fix continueReadingChain from several mark ranges
2018-02-22 14:35:06 +03:00
Nikolai Kochetov
39f16b66b5
fix continueReadingChain from several mark ranges
2018-02-22 14:31:15 +03:00
zhang2014
9cffea1958
ISSUES-1386 resolve some opinions
2018-02-22 19:27:58 +08:00
Nikolai Kochetov
c7f5f6f574
added data_path and metadata_path to system.databases and path to system.parts and system.parts_columns [#CLICKHOUSE-3580]
2018-02-22 13:03:45 +03:00
Nikolai Kochetov
a75e095a80
added data_path and metadata_path to system.tables
2018-02-22 13:03:35 +03:00
alexey-milovidov
b6f3f06ef3
Merge branch 'master' into CLICKHOUSE-3606
2018-02-22 02:13:38 +03:00
alexey-milovidov
ee41f7000f
Merge pull request #1940 from yandex/CLICKHOUSE-3571
...
Try to reduce false positive of sanity check
2018-02-22 01:59:33 +03:00
alexey-milovidov
d4dcb9412c
Merge pull request #1941 from yandex/unsorted-mergetree
...
Fix MergeTree idiosyncrasies
2018-02-22 00:36:59 +03:00
Alexey Milovidov
02f7cc2d04
Fixed error with StorageMerge [#CLICKHOUSE-2].
2018-02-21 23:24:29 +03:00
Alexey Milovidov
222fb2c945
Miscellaneous [#CLICKHOUSE-2]
2018-02-21 23:23:27 +03:00
Alexey Milovidov
4055da5979
Fixed error with filtering of tables by _table virtual column in StorageMerge [#CLICKHOUSE-3583]
2018-02-21 22:44:22 +03:00
Alexey Zatelepin
610f70fbeb
forbid non-deterministic functions in primary and partition keys [#CLICKHOUSE-3455]
2018-02-21 20:54:16 +03:00
Vitaliy Lyudvichenko
47becc0b92
Try to reduce false positive of sanity check. More detail dignostics. [#CLICKHOUSE-3571]
2018-02-21 20:06:29 +03:00
Alexey Zatelepin
6fdf82e452
allow the primary key and the partition key to use the same expression [#CLICKHOUSE-3455]
2018-02-21 18:43:24 +03:00
Alexey Zatelepin
e3422ea52e
MergeTree without primary key [#CLICKHOUSE-3462]
2018-02-21 17:50:26 +03:00
Alexey Milovidov
1a026e6131
Fixed error [#CLICKHOUSE-2]
2018-02-21 09:47:32 +03:00
Alexey Milovidov
aad0c62e67
Fixed error [#CLICKHOUSE-2]
2018-02-21 08:11:53 +03:00
Alexey Milovidov
09ac108f4c
Fixed error [#CLICKHOUSE-2]
2018-02-21 07:38:26 +03:00
Alexey Milovidov
652dfc8c36
Fixed error [#CLICKHOUSE-2]
2018-02-21 07:18:08 +03:00
Alexey Milovidov
a69bd2220a
Merge branch 'master' into header-in-output-streams
2018-02-21 04:41:09 +03:00
Alexey Milovidov
3dd665179e
Fixed error with components of Nested data structures without data and PREWHERE filtering [#CLICKHOUSE-3608]
2018-02-21 04:16:09 +03:00
zhang2014
dc189fd129
ISSUES-1386 add logical error when drop exist depend
2018-02-21 08:49:30 +08:00
Tsarkova Anastasia
d99d01ac3a
Fix data types for key_ranges
2018-02-20 23:03:15 +03:00
Nikolai Kochetov
ba81835e58
fixed progress stats
2018-02-20 17:26:22 +03:00
Nikolai Kochetov
36fe36d003
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:59:19 +03:00
Alexey Zatelepin
da87abc422
fix condition for the 'intersects previous part' log message
2018-02-20 16:59:01 +03:00
Alexey Zatelepin
53b5c5f54c
add check for intersecting parts when adding new parts
2018-02-20 16:58:41 +03:00
Nikolai Kochetov
2bf1931d86
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:37:04 +03:00
Alexey Zatelepin
5bc6bd55b1
allow PreCommitted parts to contain each other, clean up code
2018-02-20 16:33:28 +03:00
Nikolai Kochetov
dcd99860fe
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:30:47 +03:00
Nikolai Kochetov
3063c35429
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 16:23:56 +03:00
Nikolai Kochetov
d8b5f14dd7
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:26:09 +03:00
Nikolai Kochetov
d2d0d570d8
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:09:32 +03:00
Nikolai Kochetov
77a3989558
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 15:02:25 +03:00
Nikolai Kochetov
58b6b7570f
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:54:32 +03:00
Nikolai Kochetov
af6895ee6f
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:50:33 +03:00
Nikolai Kochetov
ce70d4faa9
updated MergeTreePrewhereRangeReader; renamed MergeTreePrewhereRangeReader to MergeTreeRangeReader
2018-02-20 14:45:58 +03:00
Nikolai Kochetov
af9ac7b48b
merged with master
2018-02-20 12:27:47 +03:00
Nikolai Kochetov
82c76d8467
added MergeTreePrewhereRangeReader
2018-02-20 12:23:02 +03:00
Alexey Milovidov
8942d7c127
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-20 04:38:42 +03:00
Alexey Milovidov
fa6420b34d
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-20 04:14:38 +03:00
Alexey Milovidov
3b550789b0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 21:15:30 +03:00
Alexey Milovidov
d0bfa15525
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:49 +03:00
Alexey Milovidov
7ff1346685
Removed UnsortedMergeTree, part 2 [#CLICKHOUSE-2]
2018-02-19 20:31:30 +03:00
Vitaliy Lyudvichenko
369f88f65d
Rewritten and improved sync distributed insert. [#CLICKHOUSE-3346]
2018-02-19 20:26:47 +03:00
Alexey Milovidov
74c56c2def
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 06:56:08 +03:00
Alexey Milovidov
fa50fe80a0
Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2]
2018-02-19 03:45:32 +03:00
alexey-milovidov
d73080640d
Merge pull request #1921 from yandex/header-in-input-streams
...
Header in input streams
2018-02-18 07:58:04 +03:00
Alexey Milovidov
afe09d3138
Removed unused code [#CLICKHOUSE-2]
2018-02-18 06:46:18 +03:00
Alexey Milovidov
754a4296df
Header in every stream: fixed non-deterministic test [#CLICKHOUSE-2]
2018-02-18 06:23:48 +03:00
Alexey Milovidov
d6d7b3e7e4
Header in every stream: development [#CLICKHOUSE-2]
2018-02-18 05:46:39 +03:00
Alexey Milovidov
df4853a13a
Header in every stream: development [#CLICKHOUSE-2]
2018-02-18 03:37:22 +03:00
Alexey Milovidov
ff235fc506
Header in every stream: development [#CLICKHOUSE-2]
2018-02-18 00:08:21 +03:00
Alexey Milovidov
dba529d674
Header in every stream: development [#CLICKHOUSE-2]
2018-02-17 07:13:49 +03:00
Alexey Milovidov
999d59e5ac
Header in every stream: development [#CLICKHOUSE-2]
2018-02-17 06:49:34 +03:00
Alexey Milovidov
fb0920ff98
Whitespace [#CLICKHOUSE-2]
2018-02-17 01:33:46 +03:00
zhang2014
5f0ecd7fbd
ISSUES-369 fix restart error
2018-02-16 15:47:35 +08:00
zhang2014
cfb2efbaa6
ISSUES-369 add default database when create materialize view
2018-02-16 15:10:42 +08:00
Alexey Milovidov
264e6cbc84
Header in every stream: development [#CLICKHOUSE-2]
2018-02-16 00:31:09 +03:00
Alexey Milovidov
69a9723ce2
Header in every stream: development [#CLICKHOUSE-2]
2018-02-15 22:48:41 +03:00
Alexey Milovidov
30b657a0da
Header in every stream: development [#CLICKHOUSE-2]
2018-02-15 21:54:12 +03:00
Alexey Milovidov
0cdfadeb5a
Removed useless method [#CLICKHOUSE-2]
2018-02-15 19:54:14 +03:00
Alexey Milovidov
921e09b5f8
Merge branch 'master' into header-in-input-streams
2018-02-15 19:20:36 +03:00
Nikolai Kochetov
7c69ecb3ef
fix test [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
90d67d4e8a
added test for moving partition from collapsing to versioned collapsing merge tree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
36de8a2911
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
64b3a8baa7
added secondary sort expression [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
beb866150d
added checks and comments for FixedSizeDequeWithGaps; review fixes [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
40ef753992
added VersionedCollapsingMergeTree to help message [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
32bdf7c38c
renamed MultiversionMergeTree to VersionedCollapsingMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Nikolai Kochetov
66b94d481a
added MultiversionMergeTree [#CLICKHOUSE-3479]
2018-02-13 00:13:50 +03:00
Vitaliy Lyudvichenko
d5fd8b9b5f
Fix DROP MV with max_table_size_to_drop. [#CLICKHOUSE-3]
...
Resolves #1863
2018-02-12 23:35:56 +03:00
Alexey Milovidov
c104566eb8
Fixed performance regression in usage of COWPtr in complex cases [#CLICKHOUSE-3584].
2018-02-12 23:10:24 +03:00
alexey-milovidov
8fb9967903
Merge pull request #1879 from yandex/lambdas-without-prerequisites
...
Lambdas without prerequisites
2018-02-09 22:22:58 +03:00
Alexey Milovidov
7e83b8a729
Fixed build #1840
2018-02-09 00:15:46 +03:00
alexey-milovidov
d3160393c5
Merge branch 'master' into CLICKHOUSE-3554
2018-02-08 23:07:50 +03:00
alexey-milovidov
d6b7233aa3
Merge pull request #1824 from zhang2014/fix/ISSUES-117
...
ISSUES-117 support temporary table management
2018-02-08 22:42:10 +03:00
alexey-milovidov
8b2678328e
Update StorageSystemTables.cpp
2018-02-08 22:40:41 +03:00
Alexey Milovidov
5872cd5b63
Removed useless code [#CLICKHOUSE-2]
2018-02-08 22:20:24 +03:00
Nikolai Kochetov
e02ca10b9a
merged with master
2018-02-08 20:46:22 +03:00
alexey-milovidov
2e115dff1b
Merge pull request #1823 from chenxing-xc/master
...
fix endless query issue
2018-02-08 20:41:52 +03:00
alexey-milovidov
bca723b06b
Update MergeTreeBaseBlockInputStream.cpp
2018-02-08 20:41:36 +03:00
alexey-milovidov
1d8cfa351d
Update MergeTreeBaseBlockInputStream.cpp
2018-02-08 20:40:23 +03:00
Nikolai Kochetov
27179b375a
removed prerequisites [#CLICKHOUSE-3550]
2018-02-08 20:18:52 +03:00
Nikolai Kochetov
583ff32fe8
changed IFunction
2018-02-08 20:18:15 +03:00
Alexey Milovidov
953ab16cde
Miscellaneous #1853
2018-02-08 18:31:37 +03:00
Alexey Milovidov
777b4404bd
Fixed build #1853
2018-02-08 18:25:46 +03:00
alexey-milovidov
5a03f9e0fb
Merge pull request #1853 from ilyshnikova/master
...
Implement MergeTree index using for IN operator with tuple of columns.
2018-02-08 18:03:23 +03:00
Tsarkova Anastasia
5ecd50ff44
Adding comments. Reversing infinities.
2018-02-08 17:28:31 +03:00
Vitaliy Lyudvichenko
c575a7fe8a
Fix DROP of virtual databases. Add requested changes. [#CLICKHOUSE-3554]
2018-02-08 17:17:51 +03:00
Vitaliy Lyudvichenko
42754a5327
Add new virtual columns into system.tables. [#CLICKHOUSE-3554]
2018-02-08 17:15:40 +03:00
alexey-milovidov
20686ab405
Merge pull request #1847 from yandex/CLICKHOUSE-3558
...
Add system_profile setting
2018-02-07 21:29:04 +03:00
Tsarkova Anastasia
938cb2b57a
Considering set first.
2018-02-07 18:29:00 +03:00
Tsarkova Anastasia
c50ccabb0a
Implement MergeTree index using for IN operator with tuple of columns.
2018-02-07 18:29:00 +03:00
Vitaliy Lyudvichenko
ef98bff6e1
ClusterCopier improvements ( #1869 )
...
* Fixed race condition in StorageDistributed. [#CLICKHOUSE-2]
* ClusterCopier improvements. [#CLICKHOUSE-3346]
* Add performance metrics. [#CLICKHOUSE-3346]
2018-02-07 16:02:47 +03:00
zhang2014
62b6a9e07c
ISSUES-117 resolve some opinions
2018-02-03 16:00:14 +08:00
zhang2014
982b2ee7ca
ISSUES-117 resolve some opinions
2018-02-02 22:20:35 +08:00
zhang2014
4875a80825
Merge branch 'master' into fix/ISSUES-117
2018-02-02 20:21:40 +08:00
Vitaliy Lyudvichenko
118b17253e
Add system_profile config. [#CLICKHOUSE-3558]
2018-02-01 16:53:44 +03:00
zhang2014
bfd19965b5
ISSUES-117 fix failed test
2018-01-31 23:56:52 +08:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346
...
Fault-tolerant cluster copier util
2018-01-31 13:21:51 +03:00
zhang2014
bfe48f1255
ISSUES-117 support show tables with temporary table
2018-01-28 00:07:55 +08:00
Vitaliy Lyudvichenko
e2fb6d8c80
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-25 22:00:08 +03:00
Vitaliy Lyudvichenko
4665201827
Add metric for duplicated inserts. [#CLICKHOUSE-2]
2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a
Better system.part_log. [#CLICKHOUSE-3342]
2018-01-25 21:40:02 +03:00
chenxing.xc
be85910088
fix endless query issue #1769
2018-01-26 00:44:47 +08:00
Vitaliy Lyudvichenko
d6db480be1
Forward settings through Distributed table. [#CLICKHOUSE-3346]
2018-01-25 19:04:54 +03:00
Nikolai Kochetov
9965f5e357
swap source and last_exception in StorageSystemDictionaries
2018-01-25 18:57:07 +03:00
Vitaliy Lyudvichenko
26e58271e9
Removed repeatable columns field from Storages declarations. [#CLICKHOUSE-2]
2018-01-25 17:42:39 +03:00
Vitaliy Lyudvichenko
8be2bfc513
Added docs and requested changes. [#CLICKHOUSE-3346]
2018-01-25 15:45:07 +03:00
alexey-milovidov
b8cb9267c7
Merge pull request #1804 from arkhipov/master
...
Replace subqueries and table expressions on the right side of the IN …
2018-01-23 22:31:49 +03:00
alexey-milovidov
151901af0f
Merge pull request #1814 from yandex/CLICKHOUSE-3545
...
Make early deduplication with block number creation
2018-01-23 22:27:02 +03:00
Alexey Milovidov
e8a0dde15b
Added more checks [#CLICKHOUSE-2].
2018-01-23 21:49:15 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e
Make early deduplication with block number creation. [#CLICKHOUSE-3545]
2018-01-23 18:50:29 +03:00
Vlad Arkhipov
6738d6a995
Add comments. Improve method names.
2018-01-23 11:18:12 +03:00
Nikolai Kochetov
018c32010e
added macro for cluster name in Distributerd table and DDL [#CLICKHOUSE-3409]
2018-01-22 21:49:17 +03:00
Vitaliy Lyudvichenko
1000328571
Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346
2018-01-22 20:31:08 +03:00
Vlad Arkhipov
be96cf5133
Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index.
2018-01-21 11:22:52 +03:00
Alexey Milovidov
9a02d4f5ff
Merge branch 'master' of github.com:yandex/ClickHouse into header-in-input-streams
2018-01-20 04:20:40 +03:00
alexey-milovidov
1f9ea8b6b0
Merge pull request #1721 from zhang2014/fix/ISSUES-957
...
ISSUES-957 fix not work when materialized columns with buff table
2018-01-19 21:50:26 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432
...
Fixed 'intersects previous part' due to blind OPTIMIZE
2018-01-19 21:48:41 +03:00
alexey-milovidov
6198fe4a1a
Update StorageReplicatedMergeTree.cpp
2018-01-19 21:46:22 +03:00
alexey-milovidov
e8ebf3b56a
Update StorageReplicatedMergeTree.cpp
2018-01-19 21:45:28 +03:00
alexey-milovidov
f770156b0b
Update MergeTreeDataMerger.cpp
2018-01-19 21:42:22 +03:00
Alexey Milovidov
9f57a1f7a5
Fixed error: if default user had readonly accesss, the server could not start [#CLICKHOUSE-2]
2018-01-19 02:40:32 +03:00
alexey-milovidov
7a25b441f4
Merge pull request #1773 from yandex/small-enhancements
...
Small enhancements
2018-01-16 22:07:43 +03:00
Vitaliy Lyudvichenko
b68b60fb38
More detailed test. [#CLICKHOUSE-3]
...
Resolves #1553 .
2018-01-16 15:05:01 +03:00
proller
d97b2edc7c
Make separate libs Common/ZooKeeper and Common/ConfigProcessor ( #1749 )
...
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed: dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h
* Fix space
* Fix data in system.build_options
* merge
* merge
2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
5d5ed63e8c
Better error message. [#CLICKHOUSE-2]
2018-01-15 20:30:16 +03:00
Vitaliy Lyudvichenko
554ed52920
Avoid superflous pullLogsToQueue() calls. [#CLICKHOUSE-3432]
2018-01-15 13:30:31 +03:00
Vitaliy Lyudvichenko
03bca2144d
OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
...
Resolves #1753
2018-01-15 13:13:18 +03:00
Alexey Milovidov
55ea2ebbe5
Allow to create StorageDictionary with identifier in ENGINE parameter [#CLICKHOUSE-2].
2018-01-12 21:56:13 +03:00
zhang2014
66dd568e64
ISSUES-957 update condition & test
2018-01-12 21:03:35 +08:00
proller
1c06c0f810
Fix 32bit build
2018-01-12 15:50:59 +03:00
Vitaliy Lyudvichenko
388d47bbbc
Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346
2018-01-11 23:51:30 +03:00
Anastasiya Tsarkova
2b8a4cf030
Add ALTER for null storage tables.
2018-01-11 22:13:19 +03:00
Vitaliy Lyudvichenko
7c66d2c47c
Fixed incorrect INSERT into Distributed table in async mode. [#CLICKHOUSE-2]
...
See a4636f8656
2018-01-11 21:55:46 +03:00
Vitaliy Lyudvichenko
c818beedcb
Make data_path creation for Databases optional. [#CLICKHOUSE-2]
2018-01-11 21:55:43 +03:00
Vitaliy Lyudvichenko
ac17c59108
Updated describe query, cluster copier draft. [#CLICKHOUSE-3346]
2018-01-11 21:55:08 +03:00
Vitaliy Lyudvichenko
fbba1ff99d
Remove obsolete code. [#CLICKHOUSE-2]
2018-01-11 21:55:07 +03:00
张健
6f28e0a66a
Merge branch 'master' into fix/ISSUES-957
2018-01-10 14:53:52 +08:00
Alexey Milovidov
d33023574b
Addition to prev. revision [#CLICKHOUSE-2].
2018-01-10 03:14:06 +03:00
Alexey Milovidov
550053a0ca
Merge branch 'master' into header-in-input-streams
2018-01-10 03:05:51 +03:00
Alexey Milovidov
0bfea2f52c
Miscellaneous [#CLICKHOUSe-2]
2018-01-10 03:04:08 +03:00
Nikolai Kochetov
cbeeb84999
added http_*_timeout settings [#CLICKHOUSE-3440]
2018-01-09 21:41:01 +03:00
alexey-milovidov
890ad92f90
Merge pull request #1627 from yandex/table-system-parts_columns
...
Table system.parts_columns
2018-01-09 21:33:55 +03:00
alexey-milovidov
2a7024ba5a
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
alexey-milovidov
1292d14185
Update MergeTreeData.cpp
2018-01-09 21:01:26 +03:00
zhang2014
517958ab09
ISSUES-1369 fix typo
2018-01-09 21:01:26 +03:00
zhang2014
be966015c9
ISSUES-1369 add check when create Replacing & Collapsing
2018-01-09 21:01:26 +03:00
Chen Yufei
88ef42c222
Aggressive merge for ReplicatedMergeTree optimize.
2018-01-09 20:44:07 +03:00
Alexey Milovidov
098cdf8ebe
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 05:09:08 +03:00
Alexey Milovidov
5081f276d1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 04:51:08 +03:00
Alexey Milovidov
fe880d73e7
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-09 03:19:58 +03:00
Alexey Milovidov
9996e181e1
Added method "getHeader" in IBlockInputStream [#CLICKHOUSE-2]
2018-01-06 21:10:44 +03:00
Alexey Milovidov
e2d70943b8
Unification of Nested: development [#CLICKHOUSE-2].
2018-01-02 12:11:13 +03:00
Alexey Milovidov
4371778144
Unification of Nested: development [#CLICKHOUSE-2].
2018-01-02 09:13:22 +03:00
zhang2014
6fe64aa346
ISSUES-957 fix not work when materialized columns with buff table
2018-01-01 19:54:14 +08:00
Alexey Milovidov
68de761e6a
Fixed comment [#CLICKHOUSE-2].
2017-12-30 07:03:49 +03:00
Alexey Milovidov
993a5e44d0
Inverted dependencies in StorageFactory (continued) [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Alexey Milovidov
ffca152c45
Inverted dependencies in StorageFactory [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
Alexey Milovidov
7244514859
Less dependencies in StorageFactory: development [#CLICKHOUSE-2].
2017-12-30 07:00:39 +03:00
proller
70e35d0bcc
Build fixes ( #1718 )
...
* Embedded compiler fixes
* common lib not needed for clang and lld
* Fix pthread link
* Fix shared build
* Arm fixes 1
* arm fix
* Unused fix
* Build fixes
* release --pbuilder
* release pbuilder fix
* FORCE_PBUILDER_CREATE=1 release
* release: Auto use clang with sanitizers
* Fix build without poco data odbc lib. zlib arm build fix.
* Fix freebsd build and build without mysql
* Tests: Dont eat my cpu!
* Test me
2017-12-29 18:48:20 +03:00
Nikolai Kochetov
645a8d86f2
fix build
2017-12-28 21:33:07 +03:00
Nikolai Kochetov
ea41197c51
merger with master
2017-12-28 21:20:53 +03:00
Alexey Milovidov
4c3fba2719
Table functions MySQL and ODBC: development [#CLICKHOUSE-3114].
2017-12-28 08:26:45 +03:00
Alexey Milovidov
fcdd5de47d
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89
Merge branch 'aavdonkin-master'
2017-12-28 07:33:55 +03:00
Alexey Milovidov
1fecbc3ef4
Merging [#CLICKHOUSE-3114]
2017-12-28 07:33:35 +03:00
Alexey Milovidov
4448766266
Merging [#CLICKHOUSE-3114]
2017-12-28 07:28:05 +03:00
Alexey Milovidov
4cde48fb20
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-28 01:40:42 +03:00
Alexey Milovidov
104b09604a
Merging [#CLICKHOUSE-3114]
2017-12-28 00:45:05 +03:00
Alexey Milovidov
f5b1ad1fa2
Merge branch 'master' into aavdonkin-master
2017-12-27 21:50:01 +03:00
Alexey Milovidov
b79aa5db4e
Update documentation about required ZK version; Miscellaneous #1458
2017-12-27 21:34:58 +03:00
Alexey Milovidov
09262ae0d7
Merge branch 'master' of github.com:yandex/ClickHouse
2017-12-27 01:56:30 +03:00
Alexey Milovidov
b2fcf06353
Merging [#CLICKHOUSE-3114]
2017-12-27 00:34:06 +03:00
Alexey Zatelepin
280c147a89
remove dependency to StorageReplicatedMergeTree [#CLICKHOUSE-2]
2017-12-26 22:15:15 +03:00
Alexey Milovidov
f87761df90
Merged with master; applied clang-format with newer files [#CLICKHOUSE-3114].
2017-12-26 21:32:17 +03:00
Nikolai Kochetov
5a3506eada
merged with master
2017-12-26 13:54:39 +03:00
Alexey Milovidov
c89041ce63
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00
Revert "Removed questionable code (2) [#CLICKHOUSE-2]."
...
This reverts commit fcabe8b888
2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888
Removed questionable code (2) [#CLICKHOUSE-2].
2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95
Removed questionable code [#CLICKHOUSE-2].
2017-12-26 00:10:46 +03:00
Alexey Milovidov
bcfde7c6c0
Get rid of DataTypeNested, part 2 [#CLICKHOUSE-2].
2017-12-25 21:58:39 +03:00
Nikolai Kochetov
2ed66515ff
Date type for range_min and range_max in Dictionare(range_hashed) [#CLICKHOUSE-3521]
2017-12-25 21:29:04 +03:00
Alexey Zatelepin
c3348e27a4
shorter [#CLICKHOUSE-2]
2017-12-25 20:31:14 +03:00
proller
fb7047bfe8
Fix 32bit build
2017-12-25 20:17:32 +03:00
Alexey Zatelepin
b07dbf52c6
remove unused function [#CLICKHOUSE-2]
2017-12-25 14:40:59 +03:00
Alexey Milovidov
8ff93487e3
Miscellaneous [#CLICKHOUSE-2].
2017-12-25 07:01:46 +03:00
Marek Vavruša
aed35f16ca
StorageKafka: move limits to individual Kafka streams instead of UnionBlockInputStream
...
The UnionBlockInputStream might read an extra block from the asynchronous child streams otherwise,
which will never be used, but offsets for this block would be committed, which would result in
lost messages.
2017-12-24 09:57:20 +03:00
Marek Vavruša
77393287ab
StorageKafka: make commit message only if messages are consumed
2017-12-24 09:57:20 +03:00
Alexey Milovidov
b5af4c95bf
Using IDataType::equals to compare for type equivalence #1650
2017-12-23 04:55:46 +03:00
Alexey Zatelepin
6d5ce3fa9a
revert BackgroundSchedulePool usage in Replicated tables
2017-12-22 21:25:54 +03:00
Alexey Milovidov
5b59a6f4cb
Whitespace [#CLICKHOUSE-2].
2017-12-21 20:43:32 +03:00
Alexey Milovidov
584a263d79
Simplification of aggregate functions: development [#CLICKHOUSE-2].
2017-12-21 05:08:25 +03:00
Marek Vavruša
3e1ce9bf26
StorageKafka: nicer interface for claiming consumers
2017-12-21 00:46:50 +03:00
Marek Vavruša
9c57def8df
StorageKafka: update comments
2017-12-21 00:46:50 +03:00
Marek Vavruša
c6e959d1e9
StorageKafka: extended configuration, parallel consumers, offset tracking
...
This contains many fixes and corrections for the Kafka engine.
Most notably it now supports extended configuration similarly to GraphiteMergeTree.
Now it also allows specification of consumer count to parallelize consumption of
multiple partitions both in materialized views and in SELECT queries.
The offsets are now committed in the insertSuffix() method after all rows
are successfully read. If an exception is thrown during reading, affected consumer
unsubscribes from all assignments and rejoins the consumer group to rewind offsets.
This means that the consumer won't lose messages in case of write failures.
2017-12-21 00:46:50 +03:00
Marek Vavruša
6d4f106f11
StorageMaterializedView: update dependencies on DETACH TABLE
...
Previously the dependencies were updated only on DROP TABLE, so
detaching a materialized view and inserting to source table thrown an exception.
2017-12-21 00:46:50 +03:00
Alexey Zatelepin
c422b5b2e4
take PreCommitted parts into account when calculating total merge size [#CLICKHOUSE-3508]
2017-12-20 20:52:28 +03:00
Alexey Zatelepin
835b957e95
add comments [#CLICKHOUSE-3508]
2017-12-20 20:40:36 +03:00
Alexey Zatelepin
d35baafde8
check PreCommitted parts when executing log entries and in PartChecker [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Zatelepin
2340e55d0e
revert to old behaviour of getPartIfExists() [#CLICKHOUSE-3508]
2017-12-20 20:04:14 +03:00
Alexey Milovidov
bc160f5e4d
Fixed error [#CLICKHOUSE-2].
2017-12-18 09:49:38 +03:00
Alexey Milovidov
32fcc7b3f0
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 09:23:19 +03:00
Alexey Milovidov
816169a3be
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 08:38:42 +03:00
Alexey Milovidov
11d3b9c710
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 08:37:20 +03:00
Alexey Milovidov
c5d5296889
Miscellaneous [#CLICKHOUSE-2].
2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-18 05:37:08 +03:00
Alexey Milovidov
f95ddfce10
Make DataTypes totally immutable [#CLICKHOUSE-2].
2017-12-18 04:11:48 +03:00
Alexey Milovidov
8484f086a5
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 10:59:14 +03:00
Alexey Milovidov
6ad5be5eee
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 10:15:13 +03:00
Alexey Milovidov
d497d010d7
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-17 08:21:04 +03:00
Alexey Milovidov
62f7c25522
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 09:19:21 +03:00
Alexey Milovidov
8302769563
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 03:49:03 +03:00
Alexey Milovidov
7284a64740
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 00:32:25 +03:00
Alexey Milovidov
ecd56de6a8
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-16 00:11:24 +03:00
Alexey Milovidov
c4bbc1c963
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 23:48:46 +03:00
Alexey Milovidov
8ce60e3af0
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 22:53:11 +03:00
Alexey Milovidov
d0ca8b2533
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 21:23:05 +03:00
Alexey Milovidov
b2aff7521b
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 06:47:43 +03:00
Alexey Milovidov
401fd2d6d8
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-15 05:36:40 +03:00
Alexey Milovidov
fb38ef9a8e
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6
Merge remote-tracking branch 'origin/master' into cow_columns
2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-14 04:43:19 +03:00
Alexander Avdonkin
331c5c3db8
Merge branch 'master' of github.com:aavdonkin/ClickHouse
2017-12-13 19:48:27 +03:00
Alexander Avdonkin
d1ee8c5358
Fixed issues
2017-12-13 19:46:57 +03:00
Alexey Milovidov
819287b697
Better semantic of sharing columns: development [#CLICKHOUSE-2].
2017-12-13 04:27:53 +03:00
Nikolai Kochetov
cd0eb53e36
added StorageSystemPartsBase [#CLICKHOUSE-3328]
2017-12-12 21:38:56 +03:00
Nikolai Kochetov
97917098a0
added system.parts_columns as a copy of system.parts [#CLICKHOUSE-3328]
2017-12-12 21:38:41 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert
...
Support table functions for desc and insert
2017-12-11 23:28:10 +03:00
Alexey Milovidov
7d04e67262
Merge branch 'write-buffer-from-arena'
2017-12-11 21:25:03 +03:00
Alexey Milovidov
90848adc6b
Fixed translation [#CLICKHOUSE-2].
2017-12-11 21:19:35 +03:00
Nikolai Kochetov
f71b8bf58f
merged with master
2017-12-11 21:13:24 +03:00
Nikolai Kochetov
68ccadfc6c
removed owned_cluster_for_insertion from StorageDistributed [#CLICKHOUSE-3397]
2017-12-11 21:09:20 +03:00
Alexey Milovidov
c3015bece3
Miscellaneous [#CLICKHOUSE-2].
2017-12-11 01:44:04 +03:00
Alexey Milovidov
71116c4d82
Fixed error [#CLICKHOUSE-2].
2017-12-09 20:16:24 +03:00
Alexey Milovidov
3def5f03f5
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b
Cleanup semantics of data types [#CLICKHOUSE-2].
2017-12-09 19:17:37 +03:00
alexey-milovidov
1d0df29e0f
Merge branch 'master' into master
2017-12-08 11:29:01 +03:00
Alexey Milovidov
8cc0bae1bc
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-08 02:07:41 +03:00
Alexey Milovidov
f5a06cee5b
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 11:47:13 +03:00
Alexey Milovidov
e776a4fc67
Simplification of Nullable [#CLICKHOUSE-2]
2017-12-07 07:26:30 +03:00
Alexander Avdonkin
89db5040df
Implemented MySQL and ODBC storages and table functions
2017-12-05 16:32:02 +03:00
alexey-milovidov
6c86bc2506
Merge pull request #1584 from yandex/table-system-models
...
added system.models
2017-12-05 00:25:04 +03:00
alexey-milovidov
b7f656d289
Merge pull request #1541 from yandex/fix-replica-queue-load
...
Add idempotent retries of updating the replica queue in ZooKeeper
2017-12-05 00:16:03 +03:00
Alexey Milovidov
7e2100d7f7
Fixed exception message [#CLICKHOUSE-2].
2017-12-04 23:37:28 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert
2017-12-04 23:34:27 +03:00
Alexey Zatelepin
fb9c7ab81d
remove experimental_allow_extended_storage_definition_syntax Setting (turn on by default) [#CLICKHOUSE-3000]
2017-12-04 22:45:18 +03:00
proller
826936cf9b
Better fix of std::numeric_limits<__uint128_t> ( #1585 )
...
* Fix std::numeric_limits<__uint128_t>
* clean
* Better fix of std::numeric_limits<__uint128_t>
2017-12-04 19:12:56 +03:00
Nikolai Kochetov
de62ae6b1b
added system.parts_columns as a copy of system.parts [#CLICKHOUSE-3328]
2017-12-04 18:44:31 +03:00
Nikolai Kochetov
d2710bd0f4
added system.models [#CLICKHOUSE-3477]
2017-12-04 16:32:49 +03:00
proller
4c3dfb97df
Clang: Fix std::numeric_limits<__uint128_t> ( #1583 )
...
Fix std::numeric_limits<__uint128_t>
2017-12-04 16:03:40 +03:00
Alexey Milovidov
06dfe7f562
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 08:55:49 +03:00
Alexey Milovidov
a80259d0cb
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:57:33 +03:00
Alexey Milovidov
418e5012e7
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:43:38 +03:00
Alexey Milovidov
3717d80017
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:40:21 +03:00
Alexey Milovidov
c472172fa8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:25:41 +03:00
Alexey Milovidov
a597f3e7d9
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:23:03 +03:00
Alexey Milovidov
3786786aeb
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 07:19:46 +03:00
Alexey Milovidov
294c0ba5cf
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 06:43:48 +03:00
Alexey Milovidov
ab022d0882
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:59:59 +03:00
Alexey Milovidov
1aa99092c3
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 05:15:35 +03:00
Alexey Milovidov
a9ddaa2b19
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 04:49:54 +03:00
Alexey Milovidov
a813287afd
Rewrite MergeTreePartChecker [#CLICKHOUSE-2838].
2017-12-03 03:48:19 +03:00
Alexey Milovidov
464d962010
Rewrite MergeTreePartChecker [#CLICKHOUSE-2838].
2017-12-03 03:46:34 +03:00
Alexey Milovidov
5510bea3f8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-12-03 01:12:27 +03:00
Alexey Milovidov
b932a193e2
Better [#CLICKHOUSE-2].
2017-12-02 06:25:52 +03:00
Alexey Milovidov
c748493a86
Better [#CLICKHOUSE-2].
2017-12-02 05:47:12 +03:00
Alexey Milovidov
7196602e12
Better [#CLICKHOUSE-2].
2017-12-02 00:51:50 +03:00
Alexey Milovidov
54e601019c
Better [#CLICKHOUSE-2].
2017-12-02 00:40:58 +03:00
Alexey Milovidov
a85773bdbc
Fixed error [#CLICKHOUSE-2838].
2017-12-02 00:30:43 +03:00
Alexey Milovidov
acd78e4891
Better [#CLICKHOUSE-2].
2017-12-02 00:13:25 +03:00
Alexey Milovidov
1efef27af9
Better [#CLICKHOUSE-2]
2017-12-01 23:38:50 +03:00
Alexey Milovidov
bdd25b15bd
Better [#CLICKHOUSE-2].
2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b
Better [#CLICKHOUSE-2].
2017-12-01 21:36:55 +03:00
Nikolai Kochetov
5cbacbc2d7
fixed test [#CLICKHOUSE-3397]
2017-12-01 21:21:37 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index
2017-12-01 19:53:04 +03:00
Alexey Milovidov
98291f1a24
Cleanups [#CLICKHOUSE-2838].
2017-12-01 17:21:24 +03:00
Alexey Milovidov
6fb18a7dc2
Added comments [#CLICKHOUSE-2838].
2017-12-01 17:15:38 +03:00
Nikolai Kochetov
470c633e09
merged with master
2017-12-01 16:33:47 +03:00
Alexey Milovidov
d4089695ad
Cleanups [#CLICKHOUSE-2838].
2017-12-01 16:32:37 +03:00
Nikolai Kochetov
f025f22007
Merge branch 'master' into support-table-functions-for-desc-and-insert
2017-12-01 16:24:50 +03:00
Alexey Milovidov
241e0638b7
Merge branch 'master' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams
2017-12-01 15:36:15 +03:00
Kirill Shvakov
cd7f7b076e
Merge branch 'add-description-to-settings-table'
2017-11-30 13:55:42 +02:00
Kirill Shvakov
4d73516508
Add description to system.settings table
2017-11-30 13:50:02 +02:00
Vitaliy Lyudvichenko
2afbd8bcee
Small enhancements. [#CLICKHOUSE-3452]
2017-11-29 15:00:20 +03:00
Vitaliy Lyudvichenko
ddb02d8ccf
Small enhancements. [#CLICKHOUSE-3452]
2017-11-29 14:54:37 +03:00
Vitaliy Lyudvichenko
b738d1baed
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 14:25:11 +03:00
Vitaliy Lyudvichenko
9229961721
Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452]
...
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
2017-11-29 13:23:11 +03:00
Alexey Milovidov
fb4951b679
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-29 02:50:17 +03:00
Alexey Milovidov
7b4bffe088
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-29 02:31:21 +03:00
Alexey Zatelepin
01d42242b1
mark queue as dirty if status of ZK operation is unknown [#CLICKHOUSE-3405]
2017-11-28 17:09:53 +03:00
Alexey Milovidov
36d4f89c7a
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-28 05:13:46 +03:00
Alexey Milovidov
71378d329c
Merge branch 'unify-data-types-that-serialized-with-multiple-streams' of github.com:yandex/ClickHouse into unify-data-types-that-serialized-with-multiple-streams
2017-11-28 02:47:21 +03:00
Alexey Milovidov
719d2654f8
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-28 02:47:14 +03:00
Alexey Milovidov
55971073fc
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-28 00:21:09 +03:00
Alexey Milovidov
95d33b3e65
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-27 22:33:38 +03:00
Alexey Milovidov
42cc689474
Miscellaneous [#CLICKHOUSE-2].
2017-11-26 22:22:33 +03:00
Alexey Milovidov
6266ecc5ed
Miscellaneous [#CLICKHOUSE-2].
2017-11-25 02:03:58 +03:00
proller
827a5d0612
Fix warnings-errors in gtest
2017-11-24 23:40:14 +03:00
proller
6ff1968196
Compile and likk optimize and fixes
2017-11-24 21:08:01 +03:00
proller
0d3c4f4d67
Core/FieldVisitors.h -> Common/FieldVisitors.h
...
Core/Progress.h -> IO/Progress.h
tests: sudo --non-interactive
Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Milovidov
859bf86a43
Fixed error found by ASan with debug libc++ (actually not dangerous) [#CLICKHOUSE-2].
2017-11-23 18:24:55 +03:00
Alexey Zatelepin
78aaa42ddd
add idempotent retries of updating the replica queue in ZooKeeper [#CLICKHOUSE-3405]
2017-11-23 16:19:29 +03:00
Alexey Milovidov
e15d637714
Miscellaneous [#CLICKHOUSE-2].
2017-11-23 05:12:09 +03:00
Alexey Milovidov
4bf120b285
Miscellaneous [#CLICKHOUSE-2].
2017-11-23 05:11:16 +03:00
Alexey Milovidov
4aa520e7be
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-21 22:40:59 +03:00
Alexey Milovidov
4bc98c9253
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-21 05:25:36 +03:00
Alexey Milovidov
63f79b7b4f
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-21 05:23:41 +03:00
Amos Bird
dc6847d5c6
Fixes StorageJoin's sample block order.
...
Here is a reproducible test case.
```
create table e (s UInt64, t UInt64) Engine = Memory;
create table v (s UInt64, w Float64, c UInt64) Engine = Join(Any, Inner, s);
insert into e values (1, 2), (1, 3), (1, 4), (2, 1), (2, 4), (3, 1), (4, 2), (4, 3);
insert into v values (1, 0.5, 3), (2, 0.5, 2), (3, 1, 1), (4, 0.5, 2);
select *, w, c from e any inner join v using (s);
```
# before this patch
```
┌─s─┬─t─┬─────w─┬──────────c─┐
│ 1 │ 2 │ 4e-45 │ 1051372192 │
│ 1 │ 3 │ 4e-45 │ 1051372192 │
│ 1 │ 4 │ 4e-45 │ 1051372192 │
│ 2 │ 1 │ 3e-45 │ 1056964608 │
│ 2 │ 4 │ 3e-45 │ 1056964608 │
│ 3 │ 1 │ 1e-45 │ 1065353216 │
│ 4 │ 2 │ 3e-45 │ 1056964608 │
│ 4 │ 3 │ 3e-45 │ 1056964608 │
└───┴───┴───────┴────────────┘
```
# after this patch
```
┌─s─┬─t─┬───w─┬─c─┐
│ 1 │ 2 │ 0.5 │ 3 │
│ 1 │ 3 │ 0.5 │ 3 │
│ 1 │ 4 │ 0.5 │ 3 │
│ 2 │ 1 │ 0.5 │ 2 │
│ 2 │ 4 │ 0.5 │ 2 │
│ 3 │ 1 │ 1 │ 1 │
│ 4 │ 2 │ 0.5 │ 2 │
│ 4 │ 3 │ 0.5 │ 2 │
└───┴───┴─────┴───┘
```
2017-11-20 19:46:24 +08:00
Alexey Milovidov
3b5f82000c
Fixed linking [#CLICKHOUSE-2].
2017-11-20 08:22:54 +03:00
Alexey Milovidov
3403f68c3f
Fixed linking [#CLICKHOUSE-2].
2017-11-20 08:21:50 +03:00
Alexey Milovidov
87ff2f35ec
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:41:56 +03:00
Alexey Milovidov
2106849ec2
Miscellaneous [#CLICKHOUSE-2].
2017-11-20 07:40:51 +03:00
Alexey Milovidov
b3f6844171
Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 07:18:37 +03:00
Alexey Milovidov
fd3239dd46
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-20 07:18:27 +03:00
Alexey Milovidov
01e8adbfff
Removed "experimental" namespace [#CLICKHOUSE-2].
2017-11-20 07:15:43 +03:00
Alexey Milovidov
8e6466454a
Unification of serde of data types: development [#CLICKHOUSE-2838].
2017-11-20 05:15:15 +03:00
Alexey Milovidov
2ca6952deb
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-11-20 02:16:18 +03:00
Alexey Milovidov
6c8b5e29d8
Additions after merge [#CLICKHOUSE-2].
2017-11-20 00:17:58 +03:00
alexey-milovidov
fc0a51f1b9
Merge branch 'master' into fix4
2017-11-19 23:57:44 +03:00
Alexey Milovidov
60825748d4
Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11
2017-11-19 22:57:28 +03:00
Alexey Milovidov
94d3b49e99
BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].
2017-11-19 03:27:43 +03:00
Alexey Milovidov
9b92c0fecd
BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2].
2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c
BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2].
2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2
Merge with master
2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15
Removed unsupported functionality [#CLICKHOUSE-2].
2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014
More clear [#CLICKHOUSE-2].
2017-11-18 00:20:28 +03:00
Alexey Milovidov
7c9ba15ba1
Style [#CLICKHOUSE-2].
2017-11-17 23:42:03 +03:00
proller
aa3dd03389
Split lib dbms to dbms + dbms_common_io
2017-11-17 22:19:49 +03:00
proller
79b3ef2f57
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-17 15:31:13 +03:00
Silviu Caragea
64619c614f
Basic idea is :
...
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions
This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks
NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Marek Vavruša
c07b48075b
StorageKafka: fixed messages not showing when EOF is reached in current batch
...
This prevents messages from being read if there's less than 16 messages to read in Kafka.
Updated documentation with more detailed description.
2017-11-15 23:17:22 +03:00
alexey-milovidov
dbee90ba5b
Update ReplicatedMergeTreeBlockOutputStream.cpp
2017-11-15 23:13:10 +03:00
Alexey Zatelepin
99b2d135df
clear deduplication blocks when doing DROP PARTITION [#CLICKHOUSE-3208]
2017-11-15 23:13:10 +03:00
Alexey Milovidov
2846c7560f
Fixed wording [#CLICKHOUSE-2].
2017-11-15 22:47:49 +03:00
proller
468e2ab044
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-14 14:50:19 +03:00
Alexey Milovidov
c4b4764a0a
Fixed error after merge [#CLICKHOUSE-2].
2017-11-14 03:11:33 +03:00
Nikolai Kochetov
14d2b830bb
fix build
2017-11-10 14:44:32 +03:00
Nikolai Kochetov
cdd852902d
Merge branch 'master' into catboost-models
2017-11-10 14:40:08 +03:00
Nikolai Kochetov
ad381f90e5
changed column names in catboost pool [#CLICKHOUSE-3305]
2017-11-10 14:31:02 +03:00
Nikolai Kochetov
2ae3f0b3b4
fixed tests [#CLICKHOUSE-3305]
...
added aliases for catboost pool [#CLICKHOUSE-3305]
2017-11-10 14:30:48 +03:00
Alexey Milovidov
ac1b69247c
Addition to prev. revision [#CLICKHOUSE-3402].
2017-11-09 22:25:21 +03:00
Alexey Milovidov
783e812eb7
Fixed error [#CLICKHOUSE-2]
2017-11-04 19:46:14 +03:00
Alexey Milovidov
1aaff5762c
Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].
2017-11-04 06:20:18 +03:00
Alexey Milovidov
fa8bcccdb9
Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2].
2017-11-04 00:50:22 +03:00
Nikolai Kochetov
1cee62eb0a
supported table_function in insert query [#CLICKHOUSE-3397]
2017-11-03 16:25:39 +03:00
Nikolai Kochetov
1d01d228a4
removed macro DEFINE_AST_QUERY_WITH_TABLE_AND_OUTPUT
...
supported table_functions in desctibe table query [#CLICKHOUSE-3397]
2017-11-03 16:24:52 +03:00
Vitaliy Lyudvichenko
a4636f8656
Fixed incorrect INSERT into Distributed table in async mode with local replicas in a shard. #1404 [#CLICKHOUSE-2]
...
Resolves #1404
2017-11-03 00:32:59 +03:00
proller
c974f0e88e
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-02 17:42:36 +03:00
Vitaliy Lyudvichenko
9cf14d2c61
Remove obsolete code. [#CLICKHOUSE-2]
2017-11-02 17:35:12 +03:00
proller
e671c48a6e
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-02 14:50:47 +03:00
KochetovNicolai
bfb4e8f3fe
zookeeper chroot fix ( #1430 )
...
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]
* moved root section in zookeeper configuration [#CLICKHOUSE-3031]
* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]
* added tests [#CLICKHOUSE-3031]
* replaced tabs to spaces in config files [#CLICKHOUSE-3031]
* fix build [#CLICKHOUSE-3031]
* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]
* added comments [#CLICKHOUSE-3031]
* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]
* added starting '/' to zookeeper path in ReplicatedMergeTree
2017-11-02 01:59:27 +03:00
proller
6da4f5a661
add locks
2017-11-01 22:56:07 +03:00
proller
3b58e9cd67
Fix atomic usage
2017-11-01 20:15:05 +03:00
proller
c5dcde0c78
fix atomic usage
2017-11-01 16:58:02 +03:00
proller
9bc029ba17
Merge remote-tracking branch 'upstream/master' into fix4
2017-11-01 14:43:48 +03:00
Alexey Milovidov
6aff58c747
Added backward compatibility for tables created with wrong sampling key; fixed tiny error [#CLICKHOUSE-2].
2017-11-01 04:45:10 +03:00
proller
47eae26d75
Fix build
2017-10-31 22:19:36 +03:00
proller
6debbf819a
Merge remote-tracking branch 'origin/fix4' into fix4
2017-10-31 18:36:04 +03:00
proller
9e73e08269
wip
2017-10-31 17:40:44 +03:00
Nikolai Kochetov
554bb889ac
merged with master
2017-10-31 15:04:13 +03:00
Nikolai Kochetov
2bd2bc6191
renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305]
...
renamed feature columns, check CatBoost pool in data directory [#CLICKHOUSE-3305]
2017-10-31 14:50:23 +03:00
Nikolai Kochetov
9baa5b9e14
add non-feature columns as materialized to StorageCatBoostPool [#CLICKHOUSE-3305]
2017-10-31 14:50:22 +03:00
Nikolai Kochetov
d54e27cdcb
added TableFunctionCatBoostPool [#CLICKHOUSE-3305]
...
fix column descriptions parsing [#CLICKHOUSE-3305]
2017-10-31 14:50:22 +03:00
Nikolai Kochetov
8ebce6ef5d
StorageCatBoostPool [#CLICKHOUSE-3305]
2017-10-31 14:50:21 +03:00
proller
bd1d699441
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 22:30:28 +03:00
Alexey Zatelepin
f2ebffb7f0
save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2]
2017-10-30 21:39:39 +03:00
proller
723cbb310d
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 21:19:28 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
...
Catboost models
2017-10-30 19:16:41 +03:00
proller
5d137e22eb
More atomics
2017-10-30 17:38:16 +03:00
proller
cda6473668
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 16:45:22 +03:00
Alexey Zatelepin
141b85189e
always allow attaching tables with extended storage definition syntax [#CLICKHOUSE-3000]
2017-10-30 16:44:43 +03:00
proller
8b3d3cf56f
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 16:19:19 +03:00
Vitaliy Lyudvichenko
4a55e5f94b
Hotfix of CREATE MATERIALIZED VIEW a TO b. [#CLICKHOUSE-2]
2017-10-30 15:14:36 +03:00
proller
b7dd5cd0ba
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 13:42:34 +03:00
proller
956e1513c5
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-30 13:22:20 +03:00
Alexey Milovidov
e36906cdf5
Fixed build [#CLICKHOUSE-2].
2017-10-28 06:59:42 +03:00
proller
ba49157f84
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-28 01:06:09 +03:00
Alexey Milovidov
9e3daca437
Fixed build [#CLICKHOUSE-2].
2017-10-28 00:36:43 +03:00
Alexey Milovidov
b2892e058a
Fixed bad file name [#CLICKHOUSE-2].
2017-10-28 00:31:10 +03:00
Alexey Milovidov
5ab78c249d
Fixed build after merge [#CLICKHOUSE-2].
2017-10-28 00:18:06 +03:00
alexey-milovidov
9e200bdfd9
Merge branch 'master' into materialized-view-to
2017-10-27 23:21:27 +03:00
proller
c878af8740
Merge remote-tracking branch 'upstream/master' into fix4
2017-10-27 23:13:35 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178
...
Atomic parts addition and removing
2017-10-27 23:03:33 +03:00
alexey-milovidov
b4bb6796c1
Merge pull request #1407 from yandex/CLICKHOUSE-3381
...
Ability to turn off deduplication, smart deduplication for MV
2017-10-27 23:03:25 +03:00
proller
07009d5072
Bughunt tsan
2017-10-27 18:34:26 +03:00
proller
1736d7d312
Allow build with system lib rdkafka
2017-10-27 17:40:41 +03:00
Alexey Milovidov
41c05f22be
Removed very old obsolete tests [#CLICKHOUSE-2].
2017-10-26 21:49:48 +03:00
Alexey Milovidov
6022201c26
Removed very old obsolete test [#CLICKHOUSE-2].
2017-10-26 21:38:40 +03:00
Alexey Milovidov
a27981b4ef
Get rid of double whitespaces [#CLICKHOUSE-2].
2017-10-26 21:36:23 +03:00
Vitaliy Lyudvichenko
51265506f8
Convey session setting up to inner table creation for MV. [#CLICKHOUSE-3381]
2017-10-26 18:39:56 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0
Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381]
2017-10-26 17:58:00 +03:00
Nikolai Kochetov
371e234f01
changed ExternalLoader::getObjectsMap return type [#CLICKHOUSE-3305]
2017-10-26 17:26:03 +03:00
Vitaliy Lyudvichenko
602560cb2e
Update system.parts table. [#CLICKHOUSE-3178]
2017-10-26 17:20:21 +03:00
Vitaliy Lyudvichenko
483dfd1b44
Fixed "No part error" in replicated sender. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
397b8bcf92
Smarter parts deletion. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
d6ea9c3dcf
Fixed awful copypaste. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
b5c7eaa80e
Force data parts cleanup before repeat fetch. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
71833a7f0f
More correct procedure of parts deleting. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
db3a67a421
Add clearer RangeFiltered implementation. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
e2a12d1088
Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178]
2017-10-26 17:16:06 +03:00
Vitaliy Lyudvichenko
5787e8b257
Add state for MergeTree parts. [#CLICKHOUSE-3178]
...
And Removed obsolete code.
2017-10-26 17:16:06 +03:00
Alexey Zatelepin
ec963e3397
save evaluated storage parameters in ATTACH queries [#CLICKHOUSE-3000]
2017-10-26 17:07:15 +03:00
proller
9ccba5fad1
Fix includes
2017-10-26 14:46:57 +03:00
Alexey Zatelepin
6ada6d9aa5
remove dead code [#CLICKHOUSE-2]
2017-10-26 07:53:52 +03:00
Alexey Zatelepin
01c39dcf1c
fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
...
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Milovidov
65982a1642
Fixed exception messages [#CLICKHOUSE-2].
2017-10-25 22:17:37 +03:00
proller
4ffbca2d8c
Fix warnings ( #1406 )
...
* Log query id in executeQuery; Better type mismatch error; change format in report tool
* Better log query_id
* fix message
* Use c++11 thread_local instaed of gcc's __thread
* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
* Cmake: fix build without downloaded submodules (#1379 )
* fix
* ZooKeeper: fixed stack smashing with tryGet()
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.
This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
* increased timeout for test_insertion_sync_fails_with_timeout
* Update CHANGELOG_RU.md
* Update ZooKeeper.cpp
* Fix warnings
* Fixes
* Dont strip debug info from asan, tsan and other builds except releases
* Fix asan error causd by test 00144
* Fix empty log message (#CLICKHOUSE-3378)
2017-10-25 21:39:10 +03:00
alexey-milovidov
b5155916a8
Merge branch 'master' into materialized-view-to
2017-10-24 22:39:24 +03:00
Alexey Zatelepin
6bb34a4494
Merge branch 'master' into arbitrary-partitioning
...
Conflicts:
dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Alexey Zatelepin
b6b5d1cf25
store rows count for part on disk to allow tables without fixed size columns [#CLICKHOUSE-3000]
2017-10-24 17:11:53 +03:00
alexey-milovidov
3c2155df0b
Update StorageKafka.cpp
2017-10-23 20:47:33 +03:00
alexey-milovidov
139e2080ae
Update StorageKafka.cpp
2017-10-23 20:47:33 +03:00
Marek Vavruša
3926851343
StorageKafka: use config string instead of just server name
2017-10-23 20:47:33 +03:00
Marek Vavruša
a7c391fbf7
StorageKafka: use std::vector instead of stack array for error string buffers
2017-10-23 20:47:33 +03:00
Marek Vavruša
f4c1149606
Settings: renamed schema to format_schema
2017-10-23 20:47:33 +03:00
Alexey Milovidov
c57a62611b
Removed StorageTrivialBuffer because it is underdeveloped [#CLICKHOUSE-2].
2017-10-23 20:38:56 +03:00
proller
c66228a746
Log query id in executeQuery; Better type mismatch error; change format in report tool ( #1372 )
...
* Log query id in executeQuery; Better type mismatch error; change format in report tool
* Better log query_id
* fix message
* Use c++11 thread_local instaed of gcc's __thread
* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
* Cmake: fix build without downloaded submodules (#1379 )
* fix
2017-10-23 20:32:39 +03:00
Nikolai Kochetov
5966574405
fix timeout lock in DistributedBlockOutputStream
2017-10-23 16:47:00 +03:00
Nikolai Kochetov
3317251e2f
fix jobs flags in DistributedBlockOutputStream
2017-10-23 15:00:56 +03:00
Marek Vavruša
975a7ada42
StorageMaterializedView: allow CREATE MATERIALIZED VIEW x TO y
...
This allows creation of materialized views without inner tables,
using an existing table for materialized rows instead.
This is useful for cases when you want to detach the materializing
view, but keep the already materialized data readable, especially
when the inner table is replicated.
2017-10-21 13:34:59 -07:00
Alexey Zatelepin
dd42d53856
additional help messages for extended syntax [#CLICKHOUSE-3000]
2017-10-20 23:02:55 +03:00
Alexey Zatelepin
c61d4106e8
allow loading all MergeTree settings from a query [#CLICKHOUSE-3000]
2017-10-20 21:28:45 +03:00
Alexey Zatelepin
a7c85e0c89
save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000]
2017-10-20 21:28:44 +03:00
Alexey Zatelepin
1f76900500
move CREATE query rewriting for views to Interpreter [#CLICKHOUSE-2]
2017-10-20 21:28:43 +03:00
Alexey Zatelepin
75c65c7b59
use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
6b9ead4bd8
parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000]
2017-10-20 21:28:42 +03:00
Alexey Zatelepin
48dea685d0
use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000]
2017-10-20 21:28:41 +03:00
Nikolai Kochetov
74a4c7508a
merged with master
2017-10-20 19:18:09 +03:00
Nikolai Kochetov
4262c00122
lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]
2017-10-19 22:52:45 +03:00
Alexey Zatelepin
e51f95872f
fix backward compatibility for new part format: [#CLICKHOUSE-3000]
...
* do not write out partition and minmax index files for old MergeTreeData format
* download the part from another replica if there are missing or extra files
2017-10-19 21:24:30 +03:00
Marek Vavruša
927c0f7b74
dbms: Partially revert previous change
...
Instead of trying to convert long/unsigned long to Poco types, just
don't use them.
2017-10-13 23:46:10 -07:00
Marek Vavruša
8a0571af24
dbms: Better fix for missing unsigned long to Poco::UInt64 alias
2017-10-13 21:39:14 -07:00
Marek Vavruša
70543200be
dbms: Fix build with clang after Poco update
...
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc
dbms: fix build with OS X built-in clang
...
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:
```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
res.insert({elem.column, elem.type, rename[i].value()});
~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
value_type& value()
^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
proller
4c7850fdc2
Optional kafka ( #1355 )
...
* Zookeeper include fix
* Update submodule contrib/poco
* Fix zookeeper submodule ho-to-make doc
* Update zookeeper submodule
* Update submodule zookeeper
* Fix compile with external zookeeper
* Optional kafka
* fix
* Fix
* fix
2017-10-14 03:53:01 +03:00
alexey-milovidov
9ccdb5420b
Merge branch 'master' into upstream-add-kafka
2017-10-13 23:52:42 +03:00
alexey-milovidov
adedf47715
Update StorageKafka.cpp
2017-10-13 23:18:43 +03:00
proller
49f8080e52
Small debud improvement
2017-10-13 21:44:26 +03:00
Amos Bird
f30841d5ab
Fix SummingMergeTree argument checking logic.
...
This patch fixes the Nested Column Name checking logic, which allows nested
columns be explicitly specified in SummingMergeTree engine.
2017-10-13 15:42:32 +03:00
Vladimir Chebotarev
1e0241e262
dbms: CompressionSettingsSelector. [#METR-21516]
2017-10-13 04:08:23 +03:00
Vladimir Chebotarev
4e313f3732
dbms: Added compression level for ZSTD. [#METR-26742]
2017-10-13 04:08:23 +03:00
Alexey Milovidov
d3d976a6fb
Misc [#CLICKHOUSE-2].
2017-10-12 23:45:55 +03:00
proller
b993667156
Try fix strange terminate ( #1329 )
...
* Tests: External: rename --use_http => --no_http and fix
* Try fix strange terminate
2017-10-12 23:42:58 +03:00
Alexey Milovidov
3a6705af0f
Improvement [#CLICKHOUSE-2].
2017-10-12 23:34:01 +03:00
Vitaliy Lyudvichenko
62ea1133dd
Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343]
2017-10-12 23:26:54 +03:00
KochetovNicolai
83925f1d5e
Fix array writing ( #1314 )
...
* changed MergedBlockOutputStream [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* disabled checkNoMultidimensionalArrays [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* fix IMergedBlockOutputStream::writeDataImpl [#CLICKHOUSE-3341]
* added test [#CLICKHOUSE-3341]
* fixed test [#CLICKHOUSE-3341]
* refactoring and comments [#CLICKHOUSE-3341]
* fix build [#CLICKHOUSE-3341]
* Update ColumnArray.h
2017-10-12 23:13:26 +03:00
alexey-milovidov
c1285c7d6b
Update MergeTreeDataMerger.cpp
2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
cabf6d7799
Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2]
2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc
Less noisy logging. [#CLICKHOSUE-2]
2017-10-12 22:28:24 +03:00
Alexey Milovidov
d468473d62
Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].
2017-10-12 21:21:17 +03:00
Alexey Milovidov
4814eb7072
Whitespaces [#CLICKHOUSE-2].
2017-10-11 17:41:49 +03:00
Marek Vavruša
7fc08389c9
Storages: added Kafka table engine (read-only)
...
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.
It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.
Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Marek Vavruša
4fb570fa5e
IStorage: allow notification on dependency change
...
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.
This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
proller
19042816c4
Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) ( #1325 )
2017-10-06 19:26:32 +03:00
Nikolai Kochetov
61bef2adf1
added ExternalLoader [#CLICKHOUSE-3305]
2017-10-06 13:31:06 +03:00
Alexey Zatelepin
6e57272052
don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1
add comments [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757
forbid ALTER of partition key columns for now [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e
safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e
allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91
serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f
add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277
allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741
partition serialization into id and text [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a
absence of partitioning works [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e
encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932
load partition and minmax index from disk [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8
serialize partition and minmax index values [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db
save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000]
2017-09-26 20:40:02 +03:00
Nikolai Kochetov
322e56c692
fix reading with preferred_block_size_bytes = 0
2017-09-24 02:16:30 +03:00
Alexey Zatelepin
df58949a68
make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259]
2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c
be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258]
2017-09-20 06:05:20 +03:00
proller
0a0e04f1a5
Fix includes
2017-09-18 21:52:47 +03:00
Alexey Milovidov
86c46ad1bd
Unification [#CLICKHOUSE-2].
2017-09-15 15:16:12 +03:00
Vitaliy Lyudvichenko
826c354ff5
Fixed merges progress bar. [#CLICKHOUSE-2]
2017-09-15 01:04:13 +03:00
Vadim Skipin
e0a1e6982b
Context parameter added to the IDatabase methods
2017-09-11 21:29:26 +03:00
proller
5054d50307
Remove too noisy message (#CLICKHOUSE-3304)
2017-09-11 21:26:43 +03:00
Alexey Milovidov
cd540c2674
Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2].
2017-09-10 02:17:38 +03:00
Alexey Milovidov
5a8f47a640
Fixed not an issue, shown by TSan [#CLICKHOUSE-2].
2017-09-10 02:07:32 +03:00
Alexey Milovidov
a6d5e9c7e8
Fixed not an issue, shown by TSan [#CLICKHOUSE-2].
2017-09-10 02:04:22 +03:00
Alexey Milovidov
94b975e7f9
Removed function deprecated in C++ [#CLICKHOUSE-3174].
2017-09-09 02:31:18 +03:00
Alexey Milovidov
ed1c0820f0
Fixed minor issue found by Coverity [#CLICKHOUSE-3285].
2017-09-09 02:25:42 +03:00
Alexey Milovidov
a81028377e
Implemented some suggestions from clang-tidy (part 9) [#CLICKHOUSE-3301].
2017-09-08 08:03:21 +03:00
Alexey Milovidov
dc4976f562
Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301].
2017-09-08 07:58:57 +03:00
Alexey Milovidov
d29c77adea
Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301].
2017-09-08 06:47:27 +03:00
Alexey Milovidov
6307661c35
Addition to prev. revision [#CLICKHOUSE-3300].
2017-09-08 00:26:25 +03:00
Alexey Milovidov
8b313ab99e
Fixed warnings found by cppcheck [#CLICKHOUSE-3300].
2017-09-08 00:04:48 +03:00
Alexey Milovidov
0dcee75180
Supporessed useless false positive errors found by cppcheck [#CLICKHOUSE-3300].
2017-09-07 22:13:37 +03:00
Alexey Milovidov
d82b87aaef
Fixed redundand code in better way [#CLICKHOUSE-3281].
2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46
Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117]
2017-09-06 04:18:07 +03:00
Alexey Milovidov
48ab039501
Unify serialization of complex data types: development [#CLICKHOUSE-2838].
2017-09-05 05:36:35 +03:00
Alexey Milovidov
4d97959e57
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-09-04 04:11:00 +03:00
Alexey Milovidov
87fab3396e
Fixed build [#CLICKHOUSE-2].
2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1
Merge branch 'master' of github.com:yandex/ClickHouse
2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164
Removed obsolete code [#CLICKHOUSE-3270].
2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a
Merge pull request #1163 from yandex/CLICKHOUSE-2931
...
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
88c9dcbb3d
Changed method signature. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
566160c048
Use FIFO lock in IStorage. [#CLICKHOUSE-3246]
2017-09-01 20:45:05 +03:00
proller
1a8e22c37f
Allow compile on 32bit systems ( #1175 )
...
* Trying compile under 32bit..
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* wip
* Requested changes
* wip
* wip
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
* wip
* Fix arm build
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* clean
* fix
* wip
* wip
* clean
* clean
* wip
* wip
* Update MergeTreeSettings.h
* Requested changes
* Requested changes
* Requested changes
* Requested changes
2017-09-01 20:21:03 +03:00
Nikolai Kochetov
937f37c489
fixed reading of empty block in prewhere [#CLICKHOUSE-3266]
2017-09-01 15:18:40 +03:00
Nikolai Kochetov
a9e2a17f69
fixed estimateNumRows in MergeTreeBlockSizePredictor; fixed reading of empty block in prewhere; added test [#CLICKHOUSE-3266]
2017-09-01 15:18:40 +03:00
Alexey Zatelepin
d2847f22af
PR fixes [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
61987df169
check alter of partition key columns [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
dc5809ed8d
get rid of unneeded variable [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
34ac0e0876
remove unnecessary include [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
14ba0a9acf
rename partition -> partition_id for clarity [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
645e4b7a53
generalize MinMax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46
generic partitioning of inserted blocks [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
be1c62d7f8
split partition and minmax index [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a
Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000]
2017-08-31 23:32:03 +03:00
alexey-milovidov
5d14855989
Merge branch 'master' into CLICKHOUSE-2931
2017-08-31 00:23:39 +03:00
Alexey Milovidov
495daffa16
Miscellaneous [#CLICKHOUSE-2].
2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
5916d823ef
Fix deadlock in case of using Buffer table with CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-3238]
2017-08-30 17:34:40 +03:00
Alexey Milovidov
e4eb6f0cfb
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 22:02:07 +03:00
Alexey Milovidov
709eba2a00
Merge branch 'master' of github.com:yandex/ClickHouse
2017-08-29 21:51:58 +03:00
Alexey Milovidov
04af7a3349
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 21:51:48 +03:00
Vitaliy Lyudvichenko
84660029ec
Don't leave trash part nodes in ZK in case of deleting non-existing duplicated parts. [#CLICKHOUSE-3252]
2017-08-29 20:49:37 +03:00
Alexey Milovidov
8d7937cc30
Fixed bad translation [#CLICKHOUSE-2].
2017-08-29 17:08:25 +03:00
Vadim Skipin
4dc36893d3
Keep config in context to avoid Application singleton usages
2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3
Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931]
2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
fd63277b15
Unified spelling. [#CLICKHOUSE-2]
2017-08-28 18:27:25 +03:00
Vitaliy Lyudvichenko
37820f7f64
Don't leave trash parts in ZK in case of temporary errors. [#CLICKHOUSE-3252]
2017-08-28 18:27:25 +03:00
Nikolai Kochetov
c43a13cb81
fixed async insertion into local shard of distributed [#CLICKHOUSE-3245]
2017-08-23 15:44:18 +03:00
Alexey Milovidov
e25f232b5a
Raising limit on max size for merge (step 1 of 4) [#CLICKHOUSE-2]
2017-08-19 01:56:19 +03:00
Vitaliy Lyudvichenko
e52428ddb2
Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2]
...
Resolves #1112
Resolves #598
2017-08-19 00:10:53 +03:00
Alexey Milovidov
e01c23267a
Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams
2017-08-18 22:41:27 +03:00
Vadim Skipin
61f65e97a8
Fix typo
2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko
f28d0cff3c
Add more detailed exception message. [#CLICKHOUSE-3234]
2017-08-17 23:06:38 +03:00
Nikolai Kochetov
850bc9f19d
fixed reading const zero column in prewhere
2017-08-17 23:06:00 +03:00
proller
175cd99288
Freebsd fixes: fix build with libc++, fix find system lib double-conversion ( #1109 )
...
* Cmake: Don't detect and use -no-pie flag with clang
* Camke: find_unwind: Fix disable on arm
* Freebsd fixes: fix build with libc++, fix find system lib double-conversion
2017-08-17 00:01:43 +03:00
Alexey Milovidov
3a86673aea
Fixed error when part could become broken during ALTER MODIFY of element of Nested column [#CLICKHOUSE-3232].
2017-08-16 22:41:52 +03:00
Alexey Milovidov
164ad05ae1
Little better [#CLICKHOUSE-3231].
2017-08-16 22:22:49 +03:00
Alexey Zatelepin
0185fd4542
fix parsing min-max dates from part name [#CLICKHOUSE-3000]
2017-08-15 23:03:59 +03:00
Alexey Zatelepin
372801c59b
fix comments [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Alexey Zatelepin
0df4ae6b02
do not use unnecessary temporary objects to query a set of parts [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Alexey Zatelepin
f25f0cd759
reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000]
2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
8a14cc49ff
asyncMulti() -> multi(). [#CLICKHOUSE-3221]
2017-08-15 19:18:02 +03:00
Alexey Zatelepin
3f3b7f61e2
always send changed settings for remote connections [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a
remove shard multiplexing code, simplify [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
Alexey Zatelepin
133be4d739
move and rename things [#CLICKHOUSE-3151]
2017-08-13 12:17:09 +03:00
alexey-milovidov
9b99dfb53d
Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
...
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Nikolai Kochetov
24b5a59f8c
merged with remote [#CLICKHOUSE-3033]
2017-08-11 18:38:46 +03:00
Nikolai Kochetov
90940d8423
Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033]
2017-08-11 18:02:07 +03:00
Vitaliy Lyudvichenko
cd3a696d8b
Add requested changes. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5
Implemented fast block and parts cleaning. [#CLICKHOUSE-3207]
2017-08-10 23:09:05 +03:00
Alexey Milovidov
e6739cc35d
Whitespace [#CLICKHOUSE-2].
2017-08-10 22:41:21 +03:00
alexey-milovidov
4398d71ef5
Update StorageDistributed.h
2017-08-10 07:37:35 +03:00
alexey-milovidov
0282d516a4
Update DistributedBlockOutputStream.cpp
2017-08-10 07:10:36 +03:00
alexey-milovidov
2717c94a36
Update DistributedBlockOutputStream.cpp
2017-08-10 07:05:16 +03:00
alexey-milovidov
0285f99c4e
Update DistributedBlockOutputStream.cpp
2017-08-10 06:54:02 +03:00
alexey-milovidov
57a9d22b0c
Update DistributedBlockOutputStream.cpp
2017-08-10 06:49:03 +03:00
alexey-milovidov
c665c4c4e5
Update DirectoryMonitor.h
2017-08-10 06:46:16 +03:00
alexey-milovidov
5773832979
Update DirectoryMonitor.cpp
2017-08-10 06:45:57 +03:00
Alexey Milovidov
e86d0b4a74
Merge branch 'master' of github.com:yandex/ClickHouse
2017-08-10 00:07:10 +03:00
Alexey Milovidov
56a5bb53fa
Miscellaneous [#CLICKHOUSE-2].
2017-08-10 00:07:01 +03:00
Vitaliy Lyudvichenko
27174d9dd2
Avoid many checks of sending parts if sendings fail due to network error. [#CLICKHOUSE-2]
2017-08-09 23:57:42 +03:00
Nikolai Kochetov
43dc201f49
merged with master
2017-08-08 15:11:49 +03:00
Vitaliy Lyudvichenko
00ce8c9603
Add ctime caching in MergeTree's cleaner. [#CLICKHOUSE-3173]
2017-08-08 03:28:43 +03:00
Nikolai Kochetov
ea2b486735
added threadpool to DistributedBlockOutputStream
2017-08-07 23:26:28 +03:00
Alexey Milovidov
fb2aff4704
Unification of data types, that is serialized with multiple streams [#CLICKHOUSE-2838].
2017-08-07 10:31:16 +03:00
Vitaliy Lyudvichenko
10c14cfccb
Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931]
2017-08-04 17:35:36 +03:00
Nikolai Kochetov
63ec81e2e3
added threadpool for sync insertion into distributed
2017-08-03 20:42:31 +03:00
Nikolai Kochetov
0c15b2c6fc
fixed number of rows to read from first granula in mergetree
2017-08-03 15:58:04 +03:00
alexey-milovidov
ae8783aee3
Merge pull request #1045 from prog8/nocompression
...
Added compression NONE
2017-08-01 23:07:52 +03:00
alexey-milovidov
2ae6f1ebdb
Update MergeTreeDataWriter.cpp
2017-08-01 23:07:16 +03:00
Pawel Rog
d6a2056851
Applied changes requested by Alexey
2017-08-01 16:48:24 +02:00
Pawel Rog
9f799820d9
Applied changes requested by Alexey
2017-08-01 10:12:15 +02:00
Alexey Milovidov
6578fb2645
Fixed error [#CLICKHOUSE-3191].
2017-08-01 00:39:24 +03:00
alexey-milovidov
d174ebc5c9
Update MergeTreeDataWriter.cpp
2017-07-31 20:44:58 +03:00
alexey-milovidov
4877aa394c
Update MergeTreeData.cpp
2017-07-31 20:44:41 +03:00
Pawel Rog
3a6c444996
Merge branch 'master' into nocompression
2017-07-31 13:36:58 +02:00
Pawel Rog
e1ab721d3d
Use compression method from configs
2017-07-31 13:12:28 +02:00
Pawel Rog
a0cc54457e
Added compression NONE
2017-07-31 12:44:45 +02:00
Nikolai Kochetov
78991b25ee
fixed preferred_max_column_in_block_size_bytes disabling
2017-07-30 01:24:57 +03:00
Alexey Milovidov
8fb452e99a
Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175].
2017-07-29 00:25:24 +03:00
proller
700d4e0904
Fix boost 1.64 and gcc7+ compile errors ( #1040 )
...
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers
* Missing file
* clnag-format of Split ComplexKeyCacheDictionary
* Requested changes
* Fix boost 1.64 and gcc7+ compile errors
* More fixes
2017-07-28 23:41:51 +03:00
alexey-milovidov
6917eb3153
Update MergeTreeBaseBlockInputStream.cpp
2017-07-28 22:29:40 +03:00
Nikolai Kochetov
b714d2b514
fixed column size calculation for Array column in MergeTreeReader::readRows
2017-07-28 22:29:40 +03:00
Nikolai Kochetov
d9f4f9b0f9
changed skipping rows for Array columns in MergeTreeBaseBlockInputStream
2017-07-28 22:29:40 +03:00
Alexey Milovidov
dd1f54bce2
Changed Poco::RWLock to std::shared_lock [#APRILDEV-91].
2017-07-28 20:34:02 +03:00
Alexey Milovidov
3502d36d7d
Fixed build [#CLICKHOUSE-2].
2017-07-28 02:23:13 +03:00
Nikolai Kochetov
c88e8a79cc
merged with master
2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08
separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033]
2017-07-27 18:24:39 +03:00
Vitaliy Lyudvichenko
515271544d
Add detail comment. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
445608afec
Fix an iterator pointing after std::end(). [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
alexey-milovidov
73c2a1483d
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
dcd7354fb2
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
alexey-milovidov
d6750880e0
Update ReplicatedMergeTreeCleanupThread.cpp
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
cd5bb4d921
Add replicated_deduplication_window_seconds merge_tree parameter. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Vitaliy Lyudvichenko
dcc4d3bff0
Avoid zxid overflow problem when cleaning old blocks used in the deduplication. [#CLICKHOUSE-3173]
2017-07-27 11:19:20 +03:00
Nikolai Kochetov
01a004050d
fixed MergeTreeBlockSizePredictor updating from empy block while reading
2017-07-26 20:03:09 +03:00
Alexey Milovidov
d57f5b81a4
Removed MaterializedView inheritance of View, as they are not related. Fixed error with Views [#CLICKHOUSE-3175].
2017-07-26 00:07:05 +03:00
Nikolai Kochetov
b3157aebb2
added synchronous insert into distributed table [#CLICKHOUSE-3033]
2017-07-25 22:42:36 +03:00
Vitaliy Lyudvichenko
03e5bf9471
Add support of parameters in aggregate function constructors. [#CLICKHOUSE-3084]
2017-07-25 20:04:10 +03:00
Alexey Milovidov
4a4e863f9d
Fixed warning on clang 6 [#CLICKHOUSE-2].
2017-07-25 01:44:13 +03:00
alexey-milovidov
d3159ed2c5
Merge pull request #1015 from yandex/fix-performance-after-changing-reading
...
Fix performance after changing reading
2017-07-24 18:07:57 +03:00
Nikolai Kochetov
fcd50e3629
fixed comment
2017-07-24 18:06:32 +03:00
proller
57b9bcd354
Fix missing includes
2017-07-24 18:04:49 +03:00
Vitaliy Lyudvichenko
bc9ee54985
Don't throw exception in case of clearing empty part. [#CLICKHOUSE-2896]
2017-07-24 18:04:17 +03:00
Nikolai Kochetov
b55dcc9f93
cnanged comments; fixed 00443_preferred_block_size_bytes test
2017-07-24 16:59:03 +03:00
Alexey Milovidov
1e8547b3f6
Fixed regression [#CLICKHOUSE-3148].
2017-07-21 23:59:01 +03:00
Nikolai Kochetov
10bbededb0
merged with master
2017-07-21 21:10:14 +03:00
Nikolai Kochetov
bc0921a64e
added comments
2017-07-21 21:02:02 +03:00
Alexey Zatelepin
c939d2f96e
put Distributed inserts with different block structure into different batches [#CLICKHOUSE-3163]
2017-07-21 20:55:38 +03:00
Nikolai Kochetov
ca1957ab82
ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]
2017-07-21 20:54:09 +03:00
Nikolai Kochetov
cc349b410e
set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]
2017-07-21 20:54:09 +03:00
Nikolai Kochetov
c64b65ee29
ignore preferred_max_column_in_block_size_bytes if zero [#CLICKHOUSE-3170]
2017-07-21 20:45:51 +03:00
Nikolai Kochetov
755d16b22d
set min block size as index granularity for max_block_size limit during reading [#CLICKHOUSE-3170]
2017-07-21 14:55:33 +03:00
Alexey Milovidov
c7b1e92522
Fixed error after merge [#CLICKHOUSE-3150].
2017-07-21 09:40:05 +03:00
alexey-milovidov
d4d266fa18
ColumnConst unification ( #1011 )
...
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
2017-07-21 09:35:58 +03:00
alexey-milovidov
1a1112d8bb
Update MergeTreeBlockReadUtils.h
2017-07-20 23:45:23 +03:00
Nikolai Kochetov
0b7439469d
fixed MergeTreeBlockSizePredictor initialization for sample block
2017-07-20 23:45:23 +03:00
Nikolai Kochetov
00ae32c946
renamed approximate_number_of_rows_in_part to number_of_rows_in_part
2017-07-20 23:45:23 +03:00
Nikolai Kochetov
e612152584
changed initialization in MergeTreeBlockSizePredictor
2017-07-20 23:45:23 +03:00
Nikolai Kochetov
2afd84c40c
fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161]
2017-07-19 19:39:18 +03:00
Nikolai Kochetov
b5e94ede62
fixed is_reading_finished status assignment in MergeTreeRangeReader [#CLICKHOUSE-3161]
2017-07-19 16:44:46 +03:00
Alexey Milovidov
6e6e9f9d38
Removed useless variable [#CLICKHOUSE-3161].
2017-07-19 04:05:39 +03:00
Nikolai Kochetov
7e293df9af
merged with master
2017-07-17 22:48:22 +03:00
Nikolai Kochetov
eae94edd6b
fixed vertical merge for ReplacingSortedBlockInputStream [#CLICKHOUSE-3131]
2017-07-17 22:40:30 +03:00
Alexey Milovidov
5c3ca0c16e
Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149].
2017-07-16 07:11:11 +03:00
Alexey Milovidov
17786c0e6d
Added missing file [#CLICKHOUSE-3148].
2017-07-15 07:06:51 +03:00
Alexey Milovidov
9406b6a5aa
Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148].
2017-07-15 06:48:36 +03:00
Nikolai Kochetov
a13423e552
added vertical merge for ReplacingSortedBlockInputStream
2017-07-14 21:17:23 +03:00
Alexey Milovidov
1a0f5dd7cf
Getting rid of ASTSet (incomplete) [#CLICKHOUSE-2]
2017-07-14 03:33:37 +03:00
Nikolai Kochetov
283810e8ab
merged with master
2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8
removed typeid_cast from IColumn.h
2017-07-13 23:58:19 +03:00
Nikolai Kochetov
210f14aaba
renamed IDataType::updateAvgValueSizeHints to IDataType::updateAvgValueSizeHint
2017-07-13 21:54:17 +03:00
Nikolai Kochetov
f3f217b40a
fixed tests
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
546012079c
fixed reading with zero max block size setting
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
e2d032b883
fixed reading with zero max block size setting
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8ea812e669
better comment for MergeTreeRangeReader
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f232afd2f8
round number of rows to nearest mark in MergeTreeBaseBlockInputStream
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
f1775af3f0
deleted commented code
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
30ed774bf7
refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065]
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
89386394aa
refactoring and more comments in MergeTreeBaseBlockInputStream [#CLICKHOUSE-3065]
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
8c65d6013e
added preferred_max_column_in_block_size_bytes setting, added filtration ratio prediction [#CLICKHOUSE-3065]
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
4470afc9a9
added estimateNumRowsMax to MergeTreeBlockSizePredictor based on max column size
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
6b29b3bd47
round number of rows to next mark in MergeTreeBaseBlockInputStream
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
d14f64af7b
delected commented logging code
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
586dff9126
delay reading for granulas if prewhere column is false during partial granula reading
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
86680f5513
fixed partial granula reading for const columns in prewhere
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
609711b20c
partial part reading with prewhere
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
c6d5ef6d30
added MergeTreeRangeReader
2017-07-13 21:45:09 +03:00
Nikolai Kochetov
985e449bd3
added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h
2017-07-13 19:49:09 +03:00
Alexey Milovidov
7068d1ff81
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
de75fa000b
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
83c8043193
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
1bab7fc344
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
4b1eeee1a3
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Alexey Milovidov
5b5795633e
Using lexer (incomplete) [#CLICKHOUSE-2].
2017-07-13 08:59:01 +03:00
Nikolai Kochetov
1cf669cc0a
made collectIdentifiersInFirstLevelOfSelectQuery static
2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5ed5e8c75d
moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery
2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5924b13f4c
fixed unnecessary columns removing for merge table on distibuted
2017-07-12 21:51:51 +03:00
Alexey Zatelepin
58d541b740
slightly more robust ReplicatedMergeTreePartCheckThread::TemporarilyStop [#CLICKHOUSE-3074]
2017-07-12 20:09:44 +03:00
Alexey Zatelepin
bdc529645e
fix cyclical yielding of leadership at startup [#CLICKHOUSE-3074]
2017-07-12 20:09:44 +03:00
Vitaliy Lyudvichenko
b843ea5b3f
Resolves #964 . Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3]
2017-07-11 21:36:51 +03:00
Nikolai Kochetov
ee66169d5e
added throw_if_column_not_found to FilterColumnsBlockInputStream [#CLICKHOUSE-3111]
2017-07-11 20:58:49 +03:00
Alexey Zatelepin
57ba50f585
allow batching Distributed inserts [#CLICKHOUSE-3126]
2017-07-11 20:56:17 +03:00
Alexey Zatelepin
4a98d83a3b
introduce replicated_can_become_leader merge_tree setting [#CLICKHOUSE-3109]
2017-07-11 20:44:35 +03:00
Alexey Milovidov
2bd84600d1
Miscellaneous [#CLICKHOUSE-2].
2017-07-11 04:20:40 +03:00
Alexey Milovidov
86eb4d2d06
Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343].
...
* - "Arcadia" is the name of Yandex's monorepo.
2017-07-10 07:34:14 +03:00
alexey-milovidov
b64b243a73
Merge pull request #945 from YiuRULE/master
...
Implement natively uuid type in Clickhouse
2017-07-10 07:00:45 +03:00
Alexey Milovidov
119961133c
Removed obsolete test [#CLICKHOUSE-3].
2017-07-10 06:47:20 +03:00
Alexey Milovidov
bf58b8cdb1
Fixed test [#CLICKHOUSE-3].
2017-07-10 06:45:04 +03:00
Alexey Zatelepin
89939a685a
Stream row sources from disk for vertical merge [#CLICKHOUSE-3118]
2017-07-09 21:57:06 +03:00
Marek Vavruša
ff73394124
PKCondition: infer index use with pk subexpression
...
By default only constraints explicitly matching
primary key expression (or expression wrapped in
a monotonic function) are eligible for part and
range selection. So for example, if index is:
(toStartOfHour(dt), UserID)
Then a query such as this resorts to full scan:
SELECT count() FROM t WHERE dt = now()
Intuitively, only parts with toStartOfHour(now())
could be selected, but it is less trivial to prove.
The primary key currently can be wrapped in a chain
of monotonic functions, so following would work:
toStartOfHour(dt) = toStartOfHour(now()) AND dt = now()
It must be however explicitly stated, if we wanted
to infer that we’d have to know the inverse function,
and prove that the inverse function is monotonic
on given interval. This is not practical as
there is no inverse function that for example undos
rounding, it isn’t strictly monotonic.
There are however functions that don’t transform
output range and preserve monotonicity on the
complete input range, such as rounding or casts
to a same or wider numeric type. This eliminates
the need to find inverse function, as no check for monotonicity over arbitrary interval is needed,
and thus makes this optimisation possible.
2017-07-09 17:13:51 +03:00
Nikolai Kochetov
f1ec4cd863
added FilterColumnsBlockInputStream into StorageMerge [#CLICKHOUSE-3111]
2017-07-05 20:14:17 +03:00
Alexey Milovidov
66638c4158
Fixed error in StorageDictionary [#CLICKHOUSE-2].
2017-07-05 19:36:45 +03:00
Guillaume Tassery
aeeb81fadf
Rename field in UInt128
2017-07-04 18:10:36 +02:00
Alexey Milovidov
032d12d431
Fixed translation error [#CLICKHOUSE-2].
2017-07-04 15:46:31 +03:00
Guillaume Tassery
cba9815981
Change Uuid to UUID datatype and make UInt128 a generic type
2017-07-04 12:42:53 +02:00
Alexey Milovidov
727ce48c23
Fixed error with selecting number of threads for distributed query processing [#CLICKHOUSE-3115].
2017-07-04 00:04:10 +03:00
Guillaume Tassery
525851ec68
sync master
2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca
Implement UUID type and toUuid function
2017-06-30 22:01:27 +02:00
Alexey Zatelepin
9de4d8facb
allow loading missing setting from config [#CLICKHOUSE-3091]
2017-06-28 19:56:35 +03:00
Alexey Zatelepin
7cf413dea8
Revert "Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]."
...
This reverts commit 425156e32c
2017-06-28 15:32:52 +03:00
Vitaliy Lyudvichenko
97f7b46ebd
Fixed CLEAR COLUMN test in case of deduplication rollback. [#CLICKHOUSE-2]
2017-06-26 19:34:38 +03:00
Vitaliy Lyudvichenko
9c0da6e698
Addition to previous commit. Fix error code, rename test tables. [#CLICKHOUSE-2]
2017-06-26 17:35:26 +03:00
Vitaliy Lyudvichenko
49cbc33a6b
Fix ZK exception in case of concurrent INSERTs in new partition. [#CLICKHOUSE-2]
2017-06-26 17:21:25 +03:00
Vitaliy Lyudvichenko
b53d6976b3
Fix build after merge. [#CLICKHOUSE-2]
2017-06-26 15:47:15 +03:00
Alexey Milovidov
a48a21f593
Merge branch 'master' into CLICKHOUSE-2896
2017-06-26 11:54:58 +03:00
alexey-milovidov
e122cf0bcf
Merge pull request #914 from yandex/database-dictionary
...
DatabaseDictionary
2017-06-25 22:02:45 +03:00
Alexey Milovidov
8f145da1e8
Preparation [#CLICKHOUSE-2].
2017-06-25 06:43:59 +03:00
Alexey Milovidov
dbc61a6a43
Added support for SQL-style quoting [#CLICKHOUSE-20].
2017-06-25 06:43:37 +03:00
Alexey Milovidov
275a1d4651
Improvement [#CLICKHOUSE-3091].
2017-06-25 05:48:38 +03:00
Alexey Milovidov
90a1ae1062
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-25 05:22:10 +03:00
Alexey Milovidov
516b095423
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-25 04:54:25 +03:00
Alexey Milovidov
8228acd3ea
Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091].
2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b
Fixed translation errors [#CLICKHOUSE-3091].
2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992
Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].
2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5
Removed unused variable [#CLICKHOUSE-2].
2017-06-25 01:36:43 +03:00
proller
4db8d09de9
Reorganize includes. part 1 ( #921 )
...
* Make libunwind optional. Allow use custom libcctz
* fix
* Fix
* fix
* Update BaseDaemon.cpp
* Update CMakeLists.txt
* Reorganize includes. part 1
* Update dbms_include.cmake
* Reorganize includes. part 2
* Reorganize includes. part 3
* dbms/src/Common/ThreadPool -> libs/libcommon
* Reorganize includes. part 4
* Fix print_include_directories
* Update thread_creation_latency.cpp
* Update StringRef.h
2017-06-23 23:22:35 +03:00
Nikolai Kochetov
adb632319d
DatabaseDictionary creates new storage for every create table query; drop table works untill restart
2017-06-23 18:55:45 +03:00
Alexey Milovidov
061c214c16
Fixed error [#CLICKHOUSE-3074].
2017-06-23 09:57:55 +03:00
Alexey Milovidov
f409cad0ac
Miscellaneous [#CLICKHOUSE-3091].
2017-06-23 09:18:00 +03:00
Alexey Milovidov
7d732343eb
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-22 22:52:06 +03:00
Alexey Milovidov
425156e32c
Raised up limit on max size of parts to merge [#CLICKHOUSE-3091].
2017-06-22 21:29:40 +03:00
Alexey Milovidov
6eb06774d3
Addition to prev. revision [#CLICKHOUSE-3091].
2017-06-22 19:29:15 +03:00
Alexey Milovidov
c96719685c
Lowered max_delay_to_insert to one second, because higher values are non practical and could be harmful for usual failover logic in client apps [#CLICKHOUSE-3091].
2017-06-22 19:17:01 +03:00
Alexey Milovidov
941c281221
Updated comment [#CLICKHOUSE-3091].
2017-06-22 19:09:03 +03:00
Alexey Milovidov
22e7070fb0
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-22 19:07:57 +03:00
Alexey Milovidov
bb7fc04e2b
Whitespaces [#CLICKHOUSE-2].
2017-06-22 19:07:52 +03:00
Nikolai Kochetov
4c114bc3a1
added DatabaseDictionary
2017-06-22 18:44:19 +03:00
Vitaliy Lyudvichenko
d7db235269
Better names and log messages. [#CLICKHOUSE-2896]
2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0
Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2]
2017-06-22 18:01:08 +03:00
proller
51b41aa0e3
Fix build
2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko
eff3588f28
Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896]
2017-06-22 16:18:19 +03:00
Alexey Milovidov
4af5a9c7ba
Merge branch 'cache_parts_that_cannot_be_merged'
2017-06-22 03:56:44 +03:00
Alexey Milovidov
946c275dfb
Added missing case for broken files in StorageDistributed [#CLICKHOUSE-3091].
2017-06-22 03:56:17 +03:00
Alexey Milovidov
db546dc827
Caching parts that cannot be merged for some time [#CLICKHOUSE-3091].
2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko
53adb891b3
Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896]
2017-06-22 00:56:38 +03:00
Alexey Milovidov
7bdc87adf0
Loosened threshold on broken parts in filesystem [#CLICKHOUSE-3076].
2017-06-21 22:11:11 +03:00
Alexey Milovidov
5c322f5756
Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076].
2017-06-21 22:07:08 +03:00
Alexey Milovidov
6df5d556e5
Changed namespace [#DEVTOOLS-3381].
2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb
Better [#DEVTOOLS-3381].
2017-06-21 04:24:05 +03:00
Vitaliy Lyudvichenko
534b766250
CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083]
2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
a098fb170a
Avoid creating multiple global Context. [#CLICKHOUSE-3083]
2017-06-20 10:49:18 +03:00
Георгий Кондратьев
47161f8425
Specify all link dependencies [#DEVTOOLS-3381]
...
Tested with:
export LDFLAGS="-Wl,--no-undefined"
cmake -DUSE_STATIC_LIBRARIES=OFF -DBUILD_SHARED_LIBS=ON
2017-06-20 00:53:12 +03:00
Alexey Milovidov
05accbdcbe
Removed cyclic dependency [#DEVTOOLS-3381].
2017-06-19 23:06:35 +03:00
Alexey Milovidov
401d922a4b
Tiny modifications [#CLICKHOUSE-3044].
2017-06-18 09:11:49 +03:00
Alexey Milovidov
d64f2beaf8
Fixed build [#CLICKHOUSE-3044].
2017-06-18 08:43:29 +03:00
Alexey Zatelepin
3c6b278b3d
fix infinite recursion in StorageMerge::isRemote() [#CLICKHOUSE-2911]
2017-06-16 19:19:15 +03:00
Alex Zatelepin
4cd9df27ab
fix infinite loop in StorageMerge::isRemote() [#CLICKHOUSE-2911]
2017-06-16 03:21:00 +03:00
alexey-milovidov
43a18b164d
Merge pull request #883 from yandex/fix-merge-global-in
...
Fix GLOBAL IN for Merge table over Distributed tables
2017-06-15 23:09:51 +03:00
Alexey Zatelepin
8ee85e6440
calculate isRemote() from underlying tables of StorageMerge [#CLICKHOUSE-2911]
2017-06-15 22:24:59 +03:00
Vitaliy Lyudvichenko
63ac609e8b
Avoid overestimation of avg. column element size. [#CLICKHOUSE-3058]
2017-06-15 20:33:03 +03:00
alexey-milovidov
a669136ac2
Merge branch 'master' into CLICKHOUSE-5
2017-06-13 07:30:36 +03:00
alexey-milovidov
e03ae570f7
Merge pull request #763 from yandex/storage-dictionary
...
Storage dictionary
2017-06-13 07:20:46 +03:00
Vitaliy Lyudvichenko
49eab81d9a
Fix: ReshardingWorker doesn't finish if ZooKeeper session expired. [#CLICKHOUSE-2]
2017-06-13 07:15:25 +03:00
Alexey Milovidov
43fedfecea
Get rid of INSERT ID [#CLICKHOUSE-31].
2017-06-13 07:13:20 +03:00
Alexey Milovidov
45c76803a9
Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31].
2017-06-10 12:04:31 +03:00
Alexey Milovidov
d5ca92093a
Fixed comment [#CLICKHOUSE-2].
2017-06-10 08:30:07 +03:00
Nikolai Kochetov
679cccc52d
renamed *.hpp to *.h in DictionaryBlickInputStream
2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae
merged with master
2017-06-08 15:00:11 +03:00
Alexey Milovidov
38885d00a3
Merge branch 'storage-startup-method'
2017-06-07 02:27:16 +03:00
Alexey Milovidov
dc0d5b604f
Addition to prev. revision [#CLICKHOUSE-2].
2017-06-06 22:06:44 +03:00
Alexey Milovidov
50b84fcc9d
Removed duplicate code [#CLICKHOUSE-2].
2017-06-06 21:48:38 +03:00
Alexey Milovidov
0d7d379b44
Removed duplicate code [#CLICKHOUSE-2].
2017-06-06 21:36:13 +03:00
Alexey Milovidov
9c5ddce06d
Get rid of .hpp files [#CLICKHOUSE-2].
2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f
Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2].
2017-06-06 20:06:14 +03:00
Alexey Milovidov
153693cd4c
Non significant modifications [#CLICKHOUSE-3].
2017-06-05 23:43:23 +03:00
Vitaliy Lyudvichenko
1e4906816c
Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023]
2017-06-05 17:25:10 +03:00
Alexey Milovidov
8fb0afe74e
Fixed build of tests [#CLICKHOUSE-2].
2017-06-02 22:35:37 +03:00
alexey-milovidov
147b2f62b2
Update StorageReplicatedMergeTree.cpp
2017-06-02 20:02:59 +04:00
alexey-milovidov
12e6024abd
Update StorageReplicatedMergeTree.h
2017-06-02 20:02:59 +04:00
Vitaliy Lyudvichenko
6bddd4c1c5
Clean incomplete part nodes in ZooKeeper. [#CLICKHOUSE-3040]
2017-06-02 20:02:59 +04:00
Alexey Milovidov
ba499585cd
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6
Small refinements [#CLICKHOUSE-2].
2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
3a2c1a195d
Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5]
2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
9fd8d6b79f
Add ALTER queries. [#CLICKHOUSE-5]
2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f
Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5]
2017-06-01 13:49:20 +03:00
Nikolai Kochetov
d606436023
using MergeTreeDataPartChecksums to calculate marks_size in system.parts
2017-05-31 20:54:40 +04:00
Nikolai Kochetov
c58e98b607
added marks_size column in system.parts
2017-05-31 20:54:40 +04:00
Vitaliy Lyudvichenko
1a4b0eb355
Remove tmp part directories on server start. [#CLICKHOUSE-3044]
2017-05-31 18:01:25 +03:00
Nikolai Kochetov
7c736b12ef
added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes
2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572
merged with master
2017-05-29 20:23:14 +03:00
Alexey Milovidov
fa64d14f26
More readable temporary part names [#CLICKHOUSE-2].
2017-05-26 03:47:06 +03:00
Alexey Milovidov
ed44304c49
Removed obsolete commented code [#CLICKHOUSE-2].
2017-05-26 03:43:35 +03:00
alexey-milovidov
c79ebc586d
Merge pull request #825 from yandex/CLICKHOUSE-2989
...
Separate dirs for different part sources, fix RC during replicated alters
2017-05-26 04:42:03 +04:00
Alexey Milovidov
d35a586af2
Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039].
2017-05-25 23:59:14 +03:00
alexey-milovidov
72822714c3
Merge branch 'master' into CLICKHOUSE-2989
2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Zatelepin
e9f8f99e06
Correct index comparisons in case constants cannot be precisely casted [#CLICKHOUSE-3002]
2017-05-25 05:34:26 +04:00
Alexey Milovidov
a77369d082
Preparation: Storages do not modify query [#CLICKHOUSE-31].
2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4
Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].
2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097
Preparation: untangling [#CLICKHOUSE-31].
2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko
d9637c2980
MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
...
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko
5618234ee8
Separate tmp part dirs for merges, fetches and inserts. [#CLICKHOUSE-2989]
2017-05-24 23:23:58 +03:00
Alexey Milovidov
8d570e2768
Renamed column "default_type" to "default_kind" in system.columns table to avoid ambiguity [#CLICKHOUSE-2].
2017-05-24 22:54:25 +03:00
Alexey Milovidov
0dd71e32e0
Preparations, part 8 [#CLICKHOUSE-31].
2017-05-23 23:04:42 +03:00
Alexey Milovidov
2b20eca06b
Preparations, part 4: StorageDistributed is initialized with const Context [#CLICKHOUSE-31].
2017-05-23 21:37:14 +03:00
Alexey Milovidov
ce581bbf35
Preparations, part 3 [#CLICKHOUSE-31].
2017-05-23 21:33:48 +03:00
Nikolai Kochetov
45c1beca2a
Merge branch 'master' into storage-dictionary
2017-05-23 13:44:03 +03:00
Alexey Milovidov
0c416be381
More simple code; fixed translation error [#CLICKHOUSE-2].
2017-05-23 04:09:47 +03:00
Alexey Milovidov
734b240490
TrivialBuffer: fixed build after merge [#CLICKHOUSE-2929].
2017-05-22 19:46:33 +03:00
Alexander Makarov
55bfaca662
StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929]
2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785
fixup #2 : comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929]
2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3
fixups after review [#CLICKHOUSE-2929]
2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387
Update TrivialBuffer.cpp
2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba
Update TrivialBuffer.cpp
2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b
Update TrivialBuffer.h
2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85
Update TrivialBuffer.cpp
2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828
Update TrivialBuffer.h
2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d
Update TrivialBuffer.cpp
2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b
Update TrivialBuffer.h
2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4
Update TrivialBuffer.cpp
2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373
TrivialBuffer implementation [#CLICKHOUSE-2929]
2017-05-22 18:40:11 +04:00
Alexey Milovidov
0f252046ca
Preparations [#CLICKHOUSE-2]
2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556
Fix wrong implementation of CastTypeBlockInputStream ( #807 )
...
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]
* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982
Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141]
2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
bbe2a656cd
Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237]
2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
1d00f45dd3
Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989]
2017-05-17 21:44:16 +04:00
Nikolai Kochetov
16256503ec
merged with master
2017-05-16 13:03:06 +03:00
Nikolai Kochetov
427c020140
deleted dictionary ptr from StorageDictionary
2017-05-15 16:58:40 +03:00
alexey-milovidov
e7b7f6f73d
Update MergeTreeData.cpp
2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650
Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2]
2017-05-15 10:34:40 +04:00
f1yegor
c252863b2e
translate comments
2017-05-14 19:03:55 +04:00
Alexey Milovidov
282a395464
Fixed test [#CLICKHOUSE-2].
2017-05-13 00:03:01 +03:00
Alexey Milovidov
3819216085
StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999].
2017-05-12 17:02:24 +03:00
Vitaliy Lyudvichenko
021e37943e
More clearer code and correct test. [#CLICKHOUSE-1993]
2017-05-12 16:44:11 +03:00
Vitaliy Lyudvichenko
0f1627691e
Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993]
2017-05-11 18:39:12 +04:00
Alexey Milovidov
e5e8667bc9
Addition to prev. revision [#CLICKHOUSE-2].
2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759
Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2].
2017-05-10 04:08:32 -04:00
Alexey Milovidov
5ca7650c86
Removed Increment and CounterInFile [#CLICKHOUSE-2].
2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028
Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2].
2017-05-10 02:39:37 -04:00
Alexey Milovidov
27a324b469
Tiny modifications [#CLICKHOUSE-2].
2017-05-10 00:29:36 -04:00
Alexey Milovidov
8e5f92f025
Fixed translation errors, part 1 [#CLICKHOUSE-3].
2017-05-09 15:07:35 -04:00
proller
fac00792f9
Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system
2017-05-05 16:59:18 -07:00
proller
6c34f27e3b
Another freebsd fix, update freebsd build doc
2017-05-05 03:23:32 +03:00
Nikolai Kochetov
1604ce138a
changed key storage format for complex key dictionaries
2017-05-04 21:14:23 +03:00
proller
0787bd66ff
Merge: fail if cant convert columns ( #753 )
...
* Merge: fail if cant convert columns
* Merge: convert all different types, more tests
* clean
* clean
* clean
2017-05-03 21:08:59 -07:00
alexey-milovidov
fb01ef0132
Update StorageMerge.cpp
2017-04-29 06:37:38 +03:00
proller
b2e2233a59
rename CastEnumBlockInputStream -> CastTypeBlockInputStream
2017-04-29 06:37:38 +03:00
proller
7a0854775b
Merge: Cast types on read [#CLICKHOUSE-2957]
2017-04-29 06:37:38 +03:00
Alexey Milovidov
e0b141e3eb
Do not remove temporary directory on fetch [#CLICKHOUSE-2894].
2017-04-29 01:26:39 +03:00
Vitaliy Lyudvichenko
42fcf148e2
Add column rows to system.parts table. [#CLICKHOUSE-2950]
2017-04-28 23:54:24 +03:00
Nikolai Kochetov
79564054a9
added RangeDictionaryBlockInputStream
2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b
added DictionaryBlockInputStream
2017-04-27 20:16:24 +03:00
proller
bcb230ebc6
Fix incudes, move code from daemon/OwnPatternFormatter.h
2017-04-27 08:40:27 +03:00
Nikolai Kochetov
bdf998d20f
added StorageDictionary
2017-04-25 12:10:27 +03:00
Alexey Milovidov
6f65176285
Explicitly disallow dummy data types and special Null data type to be in table declaration [#CLICKHOUSE-4].
2017-04-23 10:59:49 +03:00
proller
8cf716fa29
Functions as separate lib
2017-04-21 21:30:16 +03:00
Alexey Milovidov
110defd56f
Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960].
2017-04-20 21:38:17 +03:00
Alexey Milovidov
ee6a7ee204
Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960].
2017-04-20 21:37:01 +03:00
alexey-milovidov
512d86ceaf
Merge pull request #706 from yandex/lagging-replicas-failover
...
Check for stale replicas when performing distributed queries
2017-04-20 21:30:02 +03:00
Alexey Milovidov
2d3e09af82
Fixed error [#CLICKHOUSE-2960].
2017-04-20 05:22:17 +03:00
Alexey Zatelepin
ba254a082e
Merge branch 'master' into lagging-replicas-failover
...
Conflicts:
dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039
use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141]
2017-04-19 20:50:17 +03:00
Alexey Milovidov
0b5645db1a
Better code for parsing part names [#CLICKHOUSE-2].
2017-04-18 23:38:07 +03:00
Alexey Milovidov
47d2ca4136
Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960].
2017-04-18 23:36:19 +03:00
Alexey Milovidov
502f42a572
Fixed translation error [#CLICKHOUSE-3].
2017-04-18 22:13:12 +03:00
Alexey Zatelepin
e30dc7c254
check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141]
2017-04-17 22:51:41 +03:00
Yuri Dyachenko
51d2ffc654
fix TODO
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8fb2b7ee3d
fix zookeeper format version 4
2017-04-17 21:15:14 +03:00
alexey-milovidov
5a8344382b
Update StorageReplicatedMergeTree.cpp
2017-04-17 21:15:14 +03:00
alexey-milovidov
9d3e3675fd
Update ReplicatedMergeTreeLogEntry.h
2017-04-17 21:15:14 +03:00
alexey-milovidov
acd3c3d4ab
Update MergeTreeDataMerger.cpp
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8792c4f3ca
add 'deduplicate' flag into zookeeper 'merge' Entry
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4
support DEDUPLICATE option in OPTIMIZE query
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
5e61448f25
add support DEDUPLICATE to MergeTreeDataMerger
2017-04-17 21:15:14 +03:00
Alexey Zatelepin
2bd089d589
start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141]
2017-04-17 18:06:12 +03:00
f1yegor
0b243a8b01
translate comments
2017-04-16 23:17:32 +03:00
Alexey Milovidov
676192f16e
Fixed errors on clang [#CLICKHOUSE-2902].
2017-04-15 07:03:12 +03:00
artpaul
050f1d4b0a
drop column from partition for MergeTree
2017-04-15 06:52:04 +03:00
alexey-milovidov
7fcf570c43
Update MergeTreeDataPart.cpp
2017-04-15 06:48:24 +03:00
alexey-milovidov
5a7a155ca1
Update MergeTreeBlockReadUtils.cpp
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
8b54e9fc65
Removed extra diagnostic log messages. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
848c927bb7
Fix race condition. Add test. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
56b00a110a
Removed debug code and add docs. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
c78177a28a
More accurate prediction. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
f519100946
Split base and derived class implementations. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
4b566304ca
Tests are passed. [#CLICKHOUSE-2902]
2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
82af2278fc
Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2]
...
Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902]
Make enums test more deterministic. [#CLICKHOUSE-2]
Refactored MergeTree readers.
Tabs -> spaces.
Move include/DB/ -> src/.
2017-04-15 06:48:24 +03:00
Alexey Zatelepin
3ca6efbbd9
substitute parse<size_t>(config.getString()) for config.getUInt64()
2017-04-12 19:37:19 +03:00
Alexey Zatelepin
eb4f895ea5
fix integer overflow [#CLICKHOUSE-2927]
2017-04-12 19:10:06 +03:00
Alexey Zatelepin
0e6c38bd63
throw exception for invalid MergeTreeSettings config values [#CLICKHOUSE-2927]
2017-04-12 18:07:58 +03:00
Alexey Zatelepin
e1c9878c34
more descriptive exception message [#CLICKHOUSE-2927]
2017-04-12 18:07:58 +03:00
Alexey Zatelepin
0b0e8fa7e1
stable column order in BufferBlockInputStream [#CLICKHOUSE-2940]
2017-04-11 21:45:41 +03:00
proller
38e9254d33
fix http methods for ReadWriteBufferFromHTTP ( #675 )
2017-04-11 17:13:19 +03:00
proller
72ccc69212
Debian: simpler package ( #662 )
...
* Allow use external re2 with re2_st=re2
* fix
* remove dupe
* use re2_st in FunctionsStringSearch.h
* fix
* move files from tools/etc to debian
* dont generate control
* version
* ok.
* wip
* Cmake: dont touch CMAKE_INSTALL_PREFIX
* wip
* works!
* clean
* okay
* like old
* wip
* wip
* okay
* clickhouse-server-base-dbg
* clean
* clickhouse-server-dbg
* Debian: Remove daemons
* Update rules
* add source/format
* control clean
* add watch
* clean
* clean
* temp fix build
* clean
* docs
* fake make_control
* fix
* testme
* testme
* add metrika package
* fake metrika files
2017-04-10 20:43:30 +03:00
Alexey Milovidov
a0b9bf5e97
Moved code to cpp [#CLICKHOUSE-2].
2017-04-08 04:32:05 +03:00
proller
adba3b8e6d
delete ReadBufferFromHTTP, use ReadWriteBufferFromHTTP instead
2017-04-06 22:39:25 +03:00
proller
1bc311eefd
ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] ( #656 )
...
* ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878]
* fix
* better messages on client
* change code to 429 TOO_MANY_REQUESTS
* wip
* better message
* Update InterserverIOHandler.h
* Update InterserverIOHTTPHandler.cpp
* Update StorageReplicatedMergeTree.cpp
2017-04-06 16:03:23 +03:00
Alexey Milovidov
31f7fe42d6
Fool's day changed, continued [#CLICKHOUSE-3].
2017-04-05 14:52:23 +03:00
Vitaliy Lyudvichenko
74a92cb8d9
Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886]
2017-04-04 15:54:21 +03:00
proller
11218b9ba5
cmake: remove hardcoded src/ in macros add_headers_and_sources
2017-04-04 15:37:04 +03:00
Alexey Milovidov
baf2e6e95b
Added 'join_use_nulls' setting to allow using NULLs as default values for non-joined rows in case of outer joins [#CLICKHOUSE-2].
2017-04-04 09:52:39 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
09e3134bf4
Revert "Using C++17 [#CLICKHOUSE-3]."
...
This reverts commit 431a735efe
2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8
Using C++17 [#CLICKHOUSE-3].
2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
4423420c20
Merge branch 'master' of github.com:yandex/ClickHouse
2017-03-31 19:00:42 +03:00
Alexey Milovidov
4f44445ff0
Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//'
2017-03-31 19:00:30 +03:00
proller
fbdcab343f
Limit fetching threads [#CLICKHOUSE-2878] ( #648 )
...
* Max parallel fetches limit
* use MergeTreeSettings.h
* clean
2017-03-31 17:46:48 +03:00
Ravengg
a973e3898d
Add remove for part log ( #638 )
...
* Add REMOVE_PART
* fix
* fix
* fix codestyle
2017-03-28 20:18:49 +03:00
Alexey Milovidov
e6a41a0256
Fixed error with NULLs [#CLICKHOUSE-2901].
2017-03-24 07:42:36 +03:00
Vitaliy Lyudvichenko
84694ca269
Resolved #594 . Select least busiest buffer for insert into StorageBuffer. [#CLICKHOUSE-2892]
2017-03-23 21:25:14 +04:00
proller
670e98fa92
allow several <graphite> targets ( #603 )
...
* allow several <graphite> targets
* fix
* fix
* Adjustable parts
* changelog version
* fix
* changelog
* Style fixes
* attachSystemTables
* config describe
* fixes
* fixes
2017-03-21 23:08:09 +04:00
Alexey Milovidov
c21b4c52c5
Misc [#CLICKHOUSE-3].
2017-03-21 21:39:07 +03:00
Alexey Milovidov
d3ae1267eb
Fixed error when parts of unlimited total size could be selected for merge in case of low free disk space [#CLICKHOUSE-2895].
2017-03-20 23:29:12 +03:00
proller
930ac5b2ce
move ClickHouseRevision to dbms
2017-03-16 13:51:41 +04:00
proller
28ed324702
add cmake option USE_VECTORIZED_MATH_FUNCTIONS, reorganize auto configs
2017-03-16 13:51:41 +04:00
proller
9a1169fef6
fix tests
2017-03-16 13:51:21 +04:00
Bogdan Voronin
a3ff193fe3
Add log merge for replicas
2017-03-16 00:23:02 +04:00
proller
d777cab172
link Storages/System via lib
2017-03-15 23:43:02 +04:00
proller
25caed0c03
move all attaches of system tables to attach_system_tables.cpp
2017-03-15 23:43:02 +04:00
Ravengg
b47cc72701
Fix part log ( #591 )
...
* fix_part_log
* fixed language back
* add reset part_log back
* reset part_log when don't need more
* Fix header
* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
4e67e05835
Fixed error [#CLICKHOUSE-2].
2017-03-14 03:14:19 +03:00
Alexey Milovidov
bd34b62f4a
Avoid most of cases when server is aborted after exception 'Memory limit (for user) exceeded' [#CLICKHOUSE-2863].
2017-03-13 23:38:42 +03:00
Alexey Milovidov
f9b4b2012f
Removed zero-width spaces [#CLICKHOUSE-2].
2017-03-13 21:02:45 +03:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
Alexey Milovidov
a6a18db6da
Merge branch 'translate/comments' of https://github.com/f1yegor/ClickHouse into f1yegor-translate/comments
2017-03-13 20:51:22 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
Alexey Milovidov
59613e1da4
Fixed build [#CLICKHOUSE-2882].
2017-03-12 19:09:39 +03:00
Alexey Milovidov
65beb6f961
Added support for NULLS FIRST and LAST in ORDER BY (continued) [#CLICKHOUSE-2882].
2017-03-12 16:03:07 +03:00
Alexey Milovidov
7532a1d564
Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882].
2017-03-12 15:56:59 +03:00
alexey-milovidov
6d5bfc8c6f
Refactoring of numeric DataTypes ( #581 )
...
* Better code [#CLICKHOUSE-2].
* Addition to prev. revision [#CLICKHOUSE-2].
* Addition to prev. revision [#CLICKHOUSE-2].
* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
b6e01cd47e
Fix isolated usage of all .h files, move some code to .cpp ( #578 )
...
* split ColumnAggregateFunction.h
* format
* Allow use re2_st without cmake
* use std type in find_first_symbols.h
* fix ArrayEvaluator.h
* include fixes
* split ColumnConstAggregateFunction.h
* fix StorageMaterializedView.h
* split AddingDefaultBlockOutputStream.h
* move CSVRowInputStream::updateDiagnosticInfo to .cpp
* split ParserEnumElement.h
* format
* split DB/Parsers/ParserUseQuery.h
* clean
2017-03-11 04:27:59 +04:00
Alexey Milovidov
caebb93995
Merge remote-tracking branch 'origin/master' into if-support-nulls
...
Conflicts:
dbms/include/DB/Columns/ColumnArray.h
dbms/include/DB/Columns/ColumnString.h
dbms/include/DB/Functions/FunctionsMiscellaneous.h
2017-03-09 07:39:45 +03:00
Alexey Milovidov
5546f7f75b
Normalized formatting [#CLICKHOUSE-3].
2017-03-09 07:26:17 +03:00
Alexey Milovidov
f9a5902e76
Support for NULLs in function if: continued [#CLICKHOUSE-2873].
2017-03-09 06:34:09 +03:00
Ravengg
b079dacfd1
Added part_log with statistics scripts ( #549 )
...
* Added part_log
* first_test
* filter and hits_res
* Add renamer and drawer
* Add columns database and table into PartLog
* Add normal way to get table_name and database_name from part
* improve drawer
* add stats for random size parts
* Merge converter and drawer
* make drawer more informative
* add new data
* add new data
* new data
* add long range stats
* for checking best way
* Add add_parts script
* Good style for global merge
* delete commented code
* Fixed spaces to tabs
* Note that Stopwatch is started automatically.
* Style
* Update StorageMergeTree.cpp
* Update StorageReplicatedMergeTree.cpp
* Switch act_time_ms to duration_ms
* Added ability to disable part_log
* fixed getPartLog
* fix usage getPartLog
* fix
2017-03-07 21:13:54 +04:00
artpaul
91f5e7ae5c
add priority and is_default columns [#CLICKHOUSE-2084]
2017-03-05 16:00:25 +05:00
Alexey Milovidov
a706e96bc4
Added more metrics for StorageBuffer [#CLICKHOUSE-2871].
2017-03-05 04:23:10 +03:00
artpaul
aed028eb96
remove meaningless comment
2017-03-05 04:45:35 +04:00
artpaul
76e9213141
system table with graphite configuration [#CLICKHOUSE-2084]
2017-03-05 04:45:35 +04:00
artpaul
1e13e68028
blank for system.graphite
2017-03-05 04:45:35 +04:00
proller
05e87ad7a2
fix scope_exit formatting
2017-03-04 00:10:41 +03:00
Alexey Zatelepin
7090d0861a
reinitialize primary key after ALTER [#CLICKHOUSE-2853]
2017-02-21 21:32:04 +04:00
Vitaliy Lyudvichenko
8bcb1fe970
Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845]
2017-02-18 00:36:31 +04:00
Alexey Milovidov
354bed5bd7
Merge branch 'master' of github.com:yandex/ClickHouse
2017-02-13 19:12:46 +03:00
Alexey Milovidov
db9935337c
Misc [#CLICKHOUSE-2].
2017-02-13 19:12:34 +03:00
Alexey Milovidov
8f9b70a1d7
Style [#CLICKHOUSE-2].
2017-02-13 13:38:50 +03:00
Alexey Milovidov
bb7247993a
Merge branch 'uncompressed-size-in-system-tables'
2017-02-13 01:08:31 +03:00
Alexey Milovidov
7bf5373390
Added comments [#CLICKHOUSE-2831].
2017-02-13 01:07:38 +03:00
artpaul
f8a0f55335
#360 explicit types
2017-02-12 16:09:55 +05:00
artpaul
0c1dab92a3
#360 ordinary
2017-02-12 15:34:08 +05:00
Alexey Milovidov
c9b4a163be
Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].
2017-02-12 01:31:22 +04:00
alexey-milovidov
4593d363d1
Fix poor distributed insertion scalability ( #481 )
...
* Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791].
* Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791].
* Misc [#CLICKHOUSE-2791].
* Fixed error [#CLICKHOUSE-2791].
2017-02-12 00:20:57 +04:00
Alexey Milovidov
30737aa7a1
Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].
2017-02-11 20:43:28 +03:00
Alexey Zatelepin
9918965c5f
Allow metadata-only ALTER of primary key columns [#CLICKHOUSE-2027]
2017-02-10 22:19:40 +04:00
Alexey Zatelepin
7b57402291
allow ALTERing Enum types in primary key columns [#CLICKHOUSE-2795]
2017-02-10 22:19:40 +04:00
Alexey Milovidov
d065087506
Fixed timeouts of ALTER [#CLICKHOUSE-2836].
2017-02-10 21:09:49 +03:00
Alexey Zatelepin
6b47ac1fc0
translate comments [#CLICKHOUSE-3]
2017-02-10 09:05:33 +04:00
Alexey Zatelepin
aace171ef6
forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803]
2017-02-10 09:05:33 +04:00
Alexey Zatelepin
8d001db5d5
forbid altering of date column in MergeTree engines
2017-02-10 09:05:33 +04:00
Alexey Milovidov
d95663865f
Miscellaneous [#CLICKHOUSE-2].
2017-02-09 02:56:40 +03:00
Alexey Milovidov
2e9ab88cb7
Fixed error by removal of obsolete optimization [#CLICKHOUSE-2825].
2017-02-09 00:45:19 +03:00
Vitaliy Lyudvichenko
98af273cbc
Fixed and refactored storage Merge. [#CLICKHOUSE-2758]
2017-02-07 23:43:31 +04:00
Vitaliy Lyudvichenko
76916739e2
Fixed arrayReduce. Refactoring of ObjectPool. [#CLICKHOUSE-2787]
2017-02-07 23:43:31 +04:00
artpaul
4c57c9731e
#437 encode name of default_database so it's can be passed through connection
2017-02-07 20:11:02 +04:00
proller
c51801d776
Change default user and paths [#CLICKHOUSE-2715] ( #382 )
...
* Changing default user to clickhouse and path to /var/lib/clickhouse [#CLICKHOUSE-2715]
* wip
* Auto version update to [54141]
* Get version from saved in cmake
2017-01-31 23:53:05 +04:00
Alexey Zatelepin
4ecfd44015
[#CLICKHOUSE-2115] PR changes:
...
* do not insert produced value into the cache if the cache has been reset.
* less logging
* cosmetic fixes
2017-01-31 22:45:10 +04:00
Alexey Zatelepin
0fdcdd7bdb
Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115]
2017-01-31 22:45:10 +04:00
proller
79a7e893c7
system.build_options: move generated data to cpp, dont regenerate every compile ( #423 )
...
* system.build_options: move generated data to cpp, dont regenerate every compile
* Fix linking iconv under macos and freebsd
Partially Revert "Removed usage of glib [#CLICKHOUSE-2]."
This reverts commit e4ff740ef1
2017-01-31 22:03:56 +04:00
Alexey Milovidov
ff54b9466d
Fixed error [#CLICKHOUSE-2191].
2017-01-28 00:46:15 +03:00
alexey-milovidov
de9bc1dc75
Text formats allow to skip errors ( #407 )
...
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134
* Added test [#CLICKHOUSE-2778].
2017-01-27 08:29:47 +04:00
Vitaliy Lyudvichenko
b1bccb0bb2
Query KILL QUERY. [#CLICKHOUSE-2120]
2017-01-27 03:59:39 +04:00
Alexey Milovidov
a106520a0d
Added requested change [#CLICKHOUSE-2191].
2017-01-27 00:51:30 +03:00
Artemkin Pavel
06d1509da1
check that sharding_key exists in the table and has numeric type ( #392 )
...
* check that sharding_key exists in the table and has numeric type [#CLICKHOUSE-2191]
* style
* infer type of sharding expression [#CLICKHOUSE-2191]
2017-01-27 01:47:33 +04:00
proller
e715ddd72a
SELECT * FROM system.build_options [#METR-24175] ( #398 )
...
* start [#METR-24175]
* missing
* wip
* add spaces
* wip
* wip
* fix
* fix
* missing
* style fix
2017-01-26 02:24:36 +04:00
Alex Zatelepin
543b6ee757
ensure that all streams point to to_mark after reading even if max_rows_to_read is zero [#CLICKHOUSE-2775] ( #396 )
2017-01-25 23:16:31 +04:00
Alexey Zatelepin
281744667d
use common cur_mark_idx for all streams [#CLICKHOUSE-2116]
2017-01-25 00:48:58 +04:00
Alexey Zatelepin
dc1f0d96bd
add clarifying comment [#CLICKHOUSE-2116]
2017-01-25 00:48:58 +04:00
Alexey Zatelepin
f7ca39da77
translate comments [#CLICKHOUSE-3]
2017-01-25 00:48:58 +04:00
Alexey Zatelepin
32e5713822
do not load marks when reading the whole part [#CLICKHOUSE-2116]
2017-01-25 00:48:58 +04:00
Vitaliy Lyudvichenko
c9e52a5cf9
Add requested PR changes. [#CLICKHOUSE-2145] [issue #325 ]
2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
20a5ae4bc4
Add protection from accidental DROP queries. [#CLICKHOUSE-2184]
2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
1c38a89785
Add source_part_names column into system.merges. [#CLICKHOUSE-2145]
2017-01-24 22:26:29 +04:00
alexey-milovidov
ed5b521110
Less dependencies 2 ( #378 )
...
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
proller
1adf0bb3e1
Remove -metrika-yandex postfix from package names ( #377 )
2017-01-20 23:58:13 +04:00
Alexey Milovidov
5c1ae060a4
Miscellaneous [#CLICKHOUSE-2761].
2017-01-20 05:22:18 +03:00
Alexey Milovidov
ffed6b1d5e
Added one more column to system.parts [#CLICKHOUSE-2757].
2017-01-17 23:54:32 +03:00
Alexey Milovidov
e407bf879c
system.parts: added a column for primary key size in bytes in RAM [#CLICKHOUSE-2757].
2017-01-17 23:49:16 +03:00
Alexey Milovidov
58e5dad1a1
Squashed commit of the following:
...
commit e712f469a52a002823089e06f407c89581620f1e2a8564c68ccf60632d78ee3d1dc6e065592ef71137972c2573dd909d14993cf43266ca6731a3df961b5727e0d5bbcf726a55c03b477d5e2986e2fb045d6cdef13df2b819b25c
2017-01-14 12:00:19 +03:00
artpaul
402f974fb7
fix where <const> in (<const>) expression; [#METR-24043]
2017-01-10 19:16:37 +05:00
artpaul
903e1eab98
#200 : remove dependency to the view if backend storage can't be created
2017-01-09 01:34:40 +05:00
Alexey Milovidov
d89ee33ce2
Squashed commit of the following:
...
commit c567d4e1fe26bf3e1228eb946f4c6f78c867a1476604c5c83c23fbf05c1d98772faf113dc636ab9f3e16aee954ae7e7e90eb
2017-01-06 20:41:19 +03:00
Alexey Milovidov
f7fa5b73b9
Changed names of files with NULL-related data to be more consistent [#METR-19266].
2017-01-04 07:15:38 +03:00
Alexey Milovidov
9dc44c1a3a
Renamed methods for bulk binary serialization (continued) [#METR-2944].
2017-01-03 02:31:26 +03:00
Alexey Milovidov
1f3aeb066a
Renamed methods for bulk binary serialization (continued) [#METR-2944].
2017-01-03 02:08:09 +03:00
Alexey Milovidov
701ca28c85
Renamed methods for bulk binary serialization [#METR-2944].
2017-01-03 01:47:28 +03:00
Alexey Milovidov
3fbb597694
Addition to prev. revision [#METR-2944].
2017-01-02 23:52:30 +03:00
Alexey Milovidov
ca37f28b5f
Renamed methods Block::rows and Block::rowsInFirstColumn [#METR-2944].
2017-01-02 23:45:27 +03:00
Alexey Milovidov
2b4f3b5d34
Renamed method (less confusion) [#METR-2944].
2017-01-02 23:12:12 +03:00
Vitaliy Lyudvichenko
694b0fad97
Reverted system.events changes. Added docs for system.metrics. [#METR-239111]
2016-12-31 03:06:23 +03:00
Vitaliy Lyudvichenko
07d720565c
Added profile events for INSERTs. [#METR-23930]
...
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e
Added memory tracking events and columns for merges. [#METR-23911]
2016-12-31 02:39:53 +03:00
Alexey Milovidov
baf29f5c48
NULLs support: fixed totally wrong code [#METR-19266].
2016-12-30 08:13:14 +03:00
Alexey Milovidov
f71c49ff6f
Addition to prev. revision [#METR-22189].
2016-12-30 02:12:56 +03:00
Alexey Milovidov
77aa5d17c8
Addition to prev. revision [#METR-22189].
2016-12-30 02:04:56 +03:00
Alexey Milovidov
ee80b16488
Fixed error with creation of GraphiteMergeTree table [#METR-22189].
2016-12-30 01:56:37 +03:00
Alexey Milovidov
5dad134760
Fixed error in reading config with settings for GraphiteMergeTree table engine [#METR-23978].
2016-12-30 01:06:31 +03:00
Alexey Milovidov
cf4f8d6ce4
Modified comment [#METR-2944].
2016-12-27 18:50:31 +03:00
Alexey Milovidov
c195b0212b
Fixed long delay when querying Merge table based on very large amount of StripeLog tables; fixed error in Merge table [#METR-23945].
2016-12-25 07:39:22 +03:00
Vitaliy Lyudvichenko
ba2b32b0ad
Added vertical_merge_algorithm_min_columns_to_activate option. [#METR-23783]
2016-12-22 16:19:03 +03:00
Vitaliy Lyudvichenko
e2bd364844
Added whole block optimization. [#METR-23783]
2016-12-22 16:19:02 +03:00
Alexey Milovidov
536f88ea55
Adjusted coefficients [#METR-23916].
2016-12-22 05:04:32 +03:00
Alexey Milovidov
7ebbf72ca6
Removed unused variable [#METR-23305].
2016-12-22 04:27:41 +03:00
Alexey Milovidov
c47406c42d
StorageBuffer: addition to prev. modification [#METR-23909].
2016-12-22 03:13:59 +03:00
proller
d270053c3c
Replace all !/bin/bash by !/usr/bin/env bash : allow running scripts with bash in non standard path. also on freebsd.
2016-12-21 23:04:27 +03:00
Alexey Milovidov
7222afe5eb
StorageBuffer: fixed exception safety [#METR-23909].
2016-12-21 20:10:32 +03:00
Alexey Milovidov
54587fec1b
Tracking memory used in merges [#METR-23888].
2016-12-20 05:29:35 +03:00
Alexey Milovidov
442ff1d3b8
StorageBuffer: simplification; added metrics [#METR-23888].
2016-12-20 02:55:13 +03:00
Vitaliy Lyudvichenko
e39b41e158
Typo and codestyle fix.
2016-12-18 22:38:30 +03:00
Vitaliy Lyudvichenko
5aa1822fb2
Consecutive optimization for vertical merge. [#METR-23783]
2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
8835275713
More detail log for merges. [#METR-23770] [#METR-23769] [#METR-23783]
2016-12-18 22:12:25 +03:00
Vladimir Chebotarev
d172cb1fc2
StorageReplicatedMergeTree: Correct taking /quorum/last_part into account when merging. [#METR-23826]
2016-12-15 17:32:47 +03:00
Vitaliy Lyudvichenko
876ad28dd8
Merge remote-tracking branch 'origin/master' into metrics_refinement
2016-12-12 19:17:23 +03:00
Alexey Milovidov
c1ecc41804
Fixed error after merge [#METR-19266].
2016-12-12 10:25:31 +03:00
Alexey Milovidov
54af522de1
Preparation [#METR-2944].
2016-12-12 10:24:56 +03:00
Alexey Milovidov
8a69df19c4
Fixed error after merge [#METR-19266].
2016-12-12 09:00:37 +03:00
Alexey Milovidov
de82683197
Fixed build on clang [#METR-2944].[C
2016-12-12 08:56:34 +03:00
Alexey Milovidov
e2ed20999c
Fixed build on clang [#METR-2944].
2016-12-12 08:53:37 +03:00
Alexey Milovidov
31c4636538
Using internal boost library [#METR-2944].
2016-12-12 07:59:19 +03:00
Alexey Milovidov
d5a002f441
Using internal boost library [#METR-2944].
2016-12-12 07:57:55 +03:00
Alexey Milovidov
d605bfdc9d
Using internal boost library [#METR-2944].
2016-12-12 07:57:09 +03:00
Alexey Milovidov
fc43827a6c
Preparation [#METR-2944].
2016-12-12 06:33:34 +03:00
Alexey Milovidov
b3e85e6469
Addition to prev. revision [#METR-22442].
2016-12-11 14:59:55 +03:00
Alexey Milovidov
436d2c43c9
Addition to prev. revision [#METR-22442].
2016-12-11 14:47:09 +03:00
Alexey Milovidov
ce6556639e
Fixed tests after merge [#METR-19266] [#METR-22442].
2016-12-11 14:33:51 +03:00
Alexey Milovidov
c937d75a78
Merging [#METR-19266].
2016-12-10 09:10:29 +03:00
Alexey Milovidov
e53e32130d
Merging [#METR-19266].
2016-12-10 07:58:40 +03:00
Alexey Milovidov
e97ecb6cf7
Merge branch 'master' into METR-19266
...
Conflicts:
dbms/CMakeLists.txt
dbms/include/DB/Functions/FunctionsArray.h
dbms/include/DB/Functions/FunctionsString.h
dbms/include/DB/Parsers/ExpressionListParsers.h
dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
dbms/src/Core/ErrorCodes.cpp
dbms/src/Parsers/ASTFunction.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/MergeTreeReader.cpp
dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Vitaliy Lyudvichenko
ea11f61433
Added requested changes. [#METR-19372]
2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
855dc56598
Added treshold setting for Vertical merge algorithm. [#METR-23305]
2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
774eb01fd3
Added MergesTime metric. [#METR-23305]
2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
fc4c02c510
StorageSystemMerges refactoring.
2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
f8eb9028fd
Refined query_log, processes and merges metrics.
...
Also, dbms/CMakeLists.txt was rewritten.
2016-12-09 13:11:25 +03:00
Alexey Milovidov
514715589b
Preparation [#METR-23747].
2016-12-08 05:49:04 +03:00
proller
76dc51aae5
Merge remote-tracking branch 'upstream/master' into METR-23466
2016-12-07 22:08:09 +03:00
Alexey Milovidov
072f2fc7b8
Merges: start to lower maximum size of merge only when number of free entries in pool/queue is lower than specified threshold [#METR-21504].
2016-12-06 06:09:07 +03:00
Alexey Milovidov
0717bfa4d2
Simplified LevelMergeSelector [#METR-21504].
2016-12-06 00:34:46 +03:00
Vladimir Chebotarev
bcc5500f91
cmake: More options. [#METR-23701]
2016-12-05 15:43:14 +03:00
Alexey Milovidov
02eb36fd03
MergeSelector: attempt to make something better [#METR-21504].
2016-12-05 09:31:48 +03:00
Vitaliy Lyudvichenko
202ba912ce
Vertical merging algorithm for MergeTree engines. [#METR-23305]
2016-11-29 22:41:31 +03:00
