thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-07 00:50:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
19,543 Commits 8,977 Branches 1,768 Tags 2 GiB
f4c26e78d2
Commit Graph

3368 Commits

Author SHA1 Message Date
alesapin
4905c6ac51 CLICKHOUSE-3772: Move headers to appropriate place 2018-07-24 17:32:54 +03:00
alesapin
670353895b CLICKHOUSE-3772: Change base class of almost all StorageSystem* tables and fix remarks 2018-07-24 17:28:56 +03:00
VadimPE
46dec0d341 [CLICKHOUSE-3837] fix error in build 2018-07-24 17:05:37 +03:00
Vadim
437f3f20a9
Merge branch 'master' into CLICKHOUSE-3837 2018-07-24 16:21:51 +03:00
VadimPE
8dfb6806d8 add support for table function in remote() and cluster() 2018-07-24 16:10:34 +03:00
alesapin
f464bd73cf Merge remote-tracking branch 'upstream/master' 2018-07-24 12:34:19 +03:00
Alexey Zatelepin
c793277bcc add forgotten sort [#CLICKHOUSE-3748] 2018-07-23 21:04:13 +03:00
alesapin
220f4d6c43 CLICKHOUSE-3772: Fix strange initialization 2018-07-23 20:12:29 +03:00
alesapin
f2451210d0 CLICKHOUSE-3772: Add size column 2018-07-23 19:52:11 +03:00
alesapin
24a9bebec9 CLICKHOUSE-3772: Remove unused import 2018-07-23 19:13:35 +03:00
alesapin
18dd1e1f14 CLICKHOUSE-3772: Fixes in system tables formats, data_type_families, aggregate_function_combinators 2018-07-23 19:10:57 +03:00
Alex Zatelepin
41d87fdb0a fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798] 2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147 don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0 create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
f75fb6cd68 refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Milovidov
09d22da9b9 Miscellaneous #2687 2018-07-20 18:59:11 +03:00
alesapin
fae9c33282 CLICKHOUSE-3791: Add system table collations 2018-07-20 16:17:16 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090 Make DatsTypeWithDictionary independent from index type. 2018-07-20 13:16:27 +03:00
alesapin
2915a58c8f Merge remote-tracking branch 'upstream/master' 2018-07-20 13:13:50 +03:00
alesapin
32e03f42ef CLICKHOUSE-3772: Fix initialization 2018-07-20 13:13:23 +03:00
alesapin
a45e707f41 CLICKHOUSE-3772: Rename column in formats 2018-07-20 13:01:46 +03:00
alesapin
ec156e9f2b CLICKHOUSE-3772: Add system tables formats, data_type_families, table_functions, aggregate_function_combinators 2018-07-20 13:00:56 +03:00
Alexey Milovidov
245b114363 Quote all identifiers when querying external database #2635 2018-07-20 03:04:48 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. (#2677) 
* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]

* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"

This reverts commit 9eafc13f3b.

* Revert "Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]"

This reverts commit e28ad4b5fe.

* Fixed test #2677

* Update InterpreterSelectQuery.cpp
 2018-07-19 16:36:21 +03:00
alexey-milovidov
f31b1236c1 Update MergeTreeDataSelectExecutor.cpp 2018-07-16 16:44:32 +03:00
proller
0b0a2838c8 Fix compile error with boost 1.68.0 2018-07-16 16:44:32 +03:00
alexey-milovidov
4d1c470469 Update MergeTreeData.cpp 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d save mutations to disk and load them on startup [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0 execute part mutations in a background pool [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88300258a7 info in system.mutations for nonreplicated MergeTree [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e add OPTIMIZE FINAL support for ReplicatedMergeTree. 2018-07-09 18:03:23 +03:00
Alexey Milovidov
4f2655960c Fixed test [#CLICKHOUSE-2] 2018-07-07 22:39:20 +03:00
Alexey Milovidov
d2a44248cd Fixed error with empty TinyLog table; added a test from Nickolay Kovalev #2563 2018-07-07 22:02:10 +03:00
Alexey Milovidov
b714d87de7 Get rid of virtual columns in system.tables table [#CLICKHOUSE-3806] 2018-07-07 21:58:48 +03:00
Alexey Milovidov
93f8316e1f Little better [#CLICKHOUSE-3806] 2018-07-06 19:34:53 +03:00
Alexey Milovidov
95915579c7 Fixed test [#CLICKHOUSE-3806] 2018-07-06 19:22:15 +03:00
Alex Zatelepin
f7f4f220f1 Update MergeTreeData.cpp 2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6 Recreate format_version.txt when missing 2018-07-06 15:14:23 +03:00
Alexey Milovidov
67b9a69f19 Fixed error in prev. revision [#CLICKHOUSE-3806] 2018-07-06 00:26:23 +03:00
Alexey Milovidov
88c582106b Attempt to get rid of VirtualColumnFactory (part 2) [#CLICKHOUSE-3806] 2018-07-05 23:38:05 +03:00
Alexey Milovidov
cc2250f688 Attempt to get rid of VirtualColumnFactory (part 1) [#CLICKHOUSE-3806] 2018-07-05 22:56:51 +03:00
Alexey Milovidov
0a188389c0 Fixed error #2599 2018-07-05 21:56:33 +03:00
Alexey Milovidov
4a35b57cea Little better #2599 2018-07-05 21:45:18 +03:00
Amos Bird
78beacb3a5 Make OPTIMIZE be able to merge all parts with FINAL. 2018-07-05 21:32:54 +03:00
Alexey Zatelepin
d5f8e4a1a5 load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7 switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
0a46d231ed speedup merge selection: async exists check for selected parts [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
116ed0a59e add RestartingThread wakeup for faster session recovery 2018-07-05 19:30:52 +03:00
Alexey Zatelepin
fe83c8dab1 stricter validation of mutation commands #2588 2018-07-05 17:19:33 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465 Fixed half of bad code #2571 2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700 BackgroundSchedulePool: remove task from delayed even it it is currently executing 
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
 2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface. 2018-06-26 17:12:21 +03:00
Nikolai Kochetov
60f0ed9296 Added processing stage check for StorageMerge. [#CLICKHOUSE-3694] #2156 2018-06-25 15:47:51 +03:00
Nikolai Kochetov
4f7c284d34 Fixed build. 2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299 add comments [#CLICKHOUSE-3747] 2018-06-22 13:43:35 +03:00
zhang2014
f4e72792a5 ISSUES-2553 add offset parameter to numbers 2018-06-22 12:55:36 +03:00
Alexey Zatelepin
e78dc8142c factor out common code [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1 mutations finalizing task [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d use single mutex in ReplicatedMergeTreeQueue for simplicity 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca calculate and update parts_to_do for mutations [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
proller
e1ae5233df Add // Y_IGNORE tags 2018-06-21 18:24:36 +03:00
Nikolai Kochetov
f88584d748 Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary. 2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
1a4157f2a9 clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910] 
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
 2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910] 
Fixed race condition in SystemLog.
 2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488) 
CONTRIB-254
 2018-06-19 21:09:09 +03:00
Alexey Milovidov
2298f1c68b Fixed strange code #2501 2018-06-16 08:54:06 +03:00
Alexey Milovidov
b108882e2e Merge branch 'master' of https://github.com/alesapin/ClickHouse into alesapin-master 2018-06-16 08:29:00 +03:00
Alexey Milovidov
4e8082a699 Fixed build [#CLICKHOUSE-2] 2018-06-16 05:16:19 +03:00
Alexey Milovidov
0272fc996a Fixed build [#CLICKHOUSE-2] 2018-06-16 05:13:54 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
alesapin
6e07b17632 Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring. 2018-06-15 00:22:56 +03:00
alesapin
148cbe8058 Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring. 2018-06-15 00:20:39 +03:00
alesapin
4125b0c7f3 Merge remote-tracking branch 'upstream/master' 2018-06-14 21:06:24 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Alexey Milovidov
1e60b733f4 Fixed warning #2504 2018-06-13 23:02:27 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table 
[WIP] system.mutations table skeleton
 2018-06-13 23:00:30 +03:00
alexey-milovidov
ca883a699d
Update StorageURL.cpp 2018-06-13 21:54:32 +03:00
alexey-milovidov
f546169a4d
Update StorageURL.cpp 2018-06-13 21:51:56 +03:00
Alexey Zatelepin
a3bf3e6d20 add missing columns to system.parts [#CLICKHOUSE-3747] 2018-06-13 18:47:40 +03:00
Alexey Zatelepin
b60a2a90fa rename method for clarity 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b system.mutations table skeleton [#CLICKHOUSE-3747] 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c store mutation entries in shared_ptr 2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
alesapin
567bbb2bbb Fix header path and small fixes in tests 2018-06-13 10:36:47 +03:00
alesapin
b42351d36c Fix format in storage url 2018-06-13 10:00:07 +03:00
alesapin
df4f8bea35 Merge remote-tracking branch 'upstream/master' 2018-06-11 16:31:58 +03:00
alesapin
0f529dbc6e Add table fuction url and storage URL 2018-06-11 15:13:00 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492) 
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
 2018-06-10 22:22:49 +03:00
Alexey Milovidov
72af2b7b0f Removed wrong modification #2260 2018-06-10 21:26:02 +03:00
Alexey Milovidov
641076de51 Reverted unclear modification #2260 2018-06-09 21:39:29 +03:00
Alexey Milovidov
ebe5e3f9b6 Reverted unclear modification #2260 2018-06-09 21:35:51 +03:00
Alexey Milovidov
6475ea98c7 Merging: Fixed most of problems, actualized test #2260 2018-06-09 21:17:27 +03:00
Alexey Milovidov
d864f39ec7 Merge branch 'master' into zhang2014-feature/support_truncate 2018-06-09 19:10:06 +03:00
Alexey Milovidov
cfacdf1457 Merging: Fixed most of problems #2260 2018-06-09 19:09:37 +03:00
Alexey Milovidov
d56c199f07 Merging: Fixed half of problems #2260 2018-06-09 18:48:22 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Alexey Milovidov
9940b4f8ff Passing settings to ser/de of data types: development #1710 2018-06-08 05:26:44 +03:00
Alexey Milovidov
29bd48fc7a Passing settings to ser/de of data types: development #1710 2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Alexey Milovidov
8901414ad2 Fixed error; added test [#CLICKHOUSE-3764] 2018-06-07 23:49:59 +03:00
proller
347579ce46 Cmake: mark system includes as SYSTEM (#1449) 
* contrib: cctz as submodule. update cctz.

* pbuilder: add ubuntu bionic, devel

* Cmake: mark system includes as SYSTEM

* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Cmake: Add SYSTEM to includes for external libs
 2018-06-06 23:21:58 +03:00
Alexey Milovidov
267a69fe7e Better type for number of rows [#CLICKHOUSE-2] 2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5 add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747] 2018-06-06 16:22:30 +03:00
Alexey Zatelepin
dbfee942af escape serialized AST in MutationCommands (just in case) [#CLICKHOUSE-3747] 2018-06-06 14:30:58 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Alexey Zatelepin
3947f25365 add general comment about the mutation algorithm [#CLICKHOUSE-3747] 2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning 
Fix pruning of parts by conditions on partition key columns
 2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60 Per granula reading for ColumnWithDictionary in MergeTreeRangeReader. 2018-06-05 13:10:54 +03:00
alexey-milovidov
f69ecf7a9d
Merge pull request #2448 from LiuYangkuan/fix-issue-2439 
fix Exception in issue#2439
 2018-06-04 23:17:44 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19 
Build fixes
 2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio 
Fixes according to PVS-Studio report.
 2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5 Suppressions for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:46:47 +03:00
proller
9907388766 32bit Compile fix 2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7 Slightly better (preparation) [#CLICKHOUSE-3] 2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757] 2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541 calculate primary key when mutating a part [#CLICKHOUSE-3747] 2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942 Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad add comments [#CLICKHOUSE-3747] 2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866 introduce constants for max level and max block number 2018-06-04 14:23:47 +03:00
Alexey Milovidov
7c60adbebb Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2] 2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h 2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Alexey Zatelepin
f63d2dc3c8 cannot take a number of unlocked abandonable lock 2018-05-31 20:28:17 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Babacar Diassé
3d518e48b9 NULL check to allow insertion in distributed tables with Materialized views 2018-05-31 17:21:35 +03:00
Vitaliy Lyudvichenko
dc5de3bbec More optimal conflicts check in future_parts. [#CLICKHOUSE-2] 2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24 Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3] 
Resolves #2315
 2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
LiuYangkuan
7eb25ef55b fix Exception in issue#2439 2018-05-30 11:11:53 -04:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
 2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972 DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c execute mutation log entries [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782 don't select merges of parts with different mutation versions [#CLICKHOUSE-3747] 2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146 notify relevant events directly from queue [#CLICKHOUSE-3747] 2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7 load mutations from ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76 parts versioning [#CLICKHOUSE-3687] 2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf merge selection based on checking current inserts [#CLICKHOUSE-3732] 2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master 
Fix DateTime vs DateTime('UTC') inconsistency on data read.
 2018-05-25 21:44:11 +03:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Alex Bocharov
3618842579 Fix DateTime vs DateTime('UTC') inconsistency on data read. 
Original problem was described in PR #1650 and partially fixed by
b5af4c95, however one place was forgotten and it was causing query
exceptions when trying to read DateTime column across parts with
different DateTime and DateTime('UTC') data type.
 2018-05-22 12:23:07 +01:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion 
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
 2018-05-21 22:42:42 +03:00
Vitaliy Lyudvichenko
8349d2b9a0 Fixed gcc7 compilation. [#CLICKHOUSE-2] 2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2 
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
 2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7 Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo. 2018-05-21 14:18:11 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa ISSUES-2259 fix the test after the merge master 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation 
Fix prepared sets creation
 2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix 
Background schedule pool fixed
 2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5 Style #2387 2018-05-18 21:31:18 +03:00
Nikolai Kochetov
5e22f19258 Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734] 2018-05-18 20:27:58 +03:00
Vitaliy Lyudvichenko
4b093e3e0a Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2] 
This patch is very crucial in case of many replicas.
 2018-05-18 02:01:36 +03:00
Vitaliy Lyudvichenko
bd4d8a6766 Add profile events and settings logging. [#CLICKHOUSE-2910] 2018-05-17 19:01:41 +03:00
Nikolai Kochetov
9a1c286ade Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734] 2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7 validate mutation commands [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f alter delete skeleton [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Vitaliy Lyudvichenko
abc73eb6ba Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-15 21:35:52 +03:00
sundy-li
5d91b4f2fd fix some bugs, fix some code styles 2018-05-15 03:02:59 +03:00
sundy-li
200076b593 ADD replace_query, on_duplicate_clause config for StorageMySQL && add docs 2018-05-15 03:02:59 +03:00
sundy-li
763f1fda96 Avoid Excessive copy when block is small enough && fix some code 2018-05-15 03:02:59 +03:00
sundy-li
2511a4784b Support data write to StorageMySQL table 2018-05-15 03:02:59 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2] 
Faster partition check.

Added more debug info.
 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
864dc0546b Add requested changes. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2] 
Add disable_internal_dns_cache main config option.
 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688 Better #2328 2018-05-09 07:49:34 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15 
Build fixes (gcc8)
 2018-05-09 07:25:18 +03:00
Alexey Milovidov
b442cd9c64 Miscellaneous (no effect) [#CLICKHOUSE-2] 2018-05-09 07:22:30 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name 2018-05-08 15:47:06 +03:00
Alexey Zatelepin
6047db7ea2 fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag) 2018-05-07 23:31:28 +03:00
Alexey Milovidov
94369e55d3 Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:29 +03:00
proller
7781492624 Fix user name on distributed queries (#2292) 
* Fix user name on distributed queries

* wip

* fix
 2018-05-05 00:21:23 +03:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master 2018-04-29 18:02:34 +02:00
Tsarkova Anastasia
2c96b1c684 Add comments. Change projection restoring function. 2018-04-29 15:49:58 +02:00
Vitaliy Lyudvichenko
e152f223c9 Fix nodes leak in case of session expiration. [#CLICKHOUSE-2] 2018-04-26 22:46:45 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
Nikolai Kochetov
7a62bb9267 added comments and fixed tests build 2018-04-23 22:41:10 +03:00
Alexey Milovidov
958a3d7ee7 Fixed error with Arrays inside Nested data type; added a test #2066 2018-04-22 20:30:28 -07:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
Nikolai Kochetov
7e45661a38 merged with master 2018-04-20 22:51:21 +03:00
Alexey Milovidov
ac48e1e911 Fixed error #2246 2018-04-20 20:34:09 +03:00
Kirill Shvakov
918dbc2902 #2249 allow macros while creating kafka engine 2018-04-20 19:10:26 +03:00
Nikolai Kochetov
a6375d6155 merged with master 2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620 fix build 2018-04-20 17:06:01 +03:00
Alexey Milovidov
6b88a2a7a5 Better info in log #2246 2018-04-20 04:14:04 +03:00
Alexey Milovidov
70be882b64 Renamed PK to Key where it's appropriate #2246 2018-04-20 03:27:25 +03:00
Alexey Milovidov
d71b3a95ef Renamed PK to Key where it's appropriate #2246 2018-04-20 03:20:50 +03:00
Alexey Milovidov
ce0ac3f8f8 Fixed error with Sets, part 2 #2246 2018-04-20 00:34:04 +03:00
Alexey Milovidov
fee22dac33 Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-19 23:34:23 +03:00
Alexey Milovidov
c0978919e3 Fixed error with partition key IN, part 1 #2246 2018-04-19 23:34:02 +03:00
张健
e9b03b3abc ISSUES-2242 add default data_path & metadata_path for system.tables with temporary (#2243) 2018-04-19 23:22:08 +03:00
Alexey Milovidov
12e33cfd85 Exit from threads when ZooKeeper session is expired (non significant change) [#CLICKHOUSE-2] 2018-04-19 21:16:18 +03:00
Alexey Milovidov
da94c7dd91 Exit from queueUpdatingThread when ZooKeeper session is expired (non-significant change) [#CLICKHOUSE-2] 2018-04-19 21:01:50 +03:00
Nikolai Kochetov
dd10c2073c merged with master 2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675 added IStorage::getQueryProcessingStage 2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix 
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11 Allowed to read files by table function "file" inside "user_files_path" #2164 2018-04-19 08:32:09 +03:00
alexey-milovidov
08dfd8a09b
Merge pull request #2164 from topvisor/add_table_function_file 
Add table function file
 2018-04-19 07:53:49 +03:00
alexey-milovidov
8f5436e8b0
Update StorageFile.cpp 2018-04-19 07:39:48 +03:00
alexey-milovidov
4b3aa3fc11
Update StorageFile.cpp 2018-04-19 07:39:16 +03:00
alexey-milovidov
19f918512b
Update StorageFile.cpp 2018-04-19 07:36:08 +03:00
Alexey Milovidov
a55abd0a25 Fixed test [#CLICKHOUSE-2] 2018-04-18 23:27:27 +03:00
Alexey Milovidov
3eff0184fa Added set size checking when set from subquery is used for index; removed harmful feature for special support of (a, b) IN (SELECT (a, b)) instead of (a, b) IN (SELECT a, b) [#CLICKHOUSE-2] 2018-04-18 22:38:40 +03:00
alexey-milovidov
22f7a3a545
Merge pull request #2223 from sundy-li/master 
Fix:ignore the format_version check when the data is empty
 2018-04-17 22:50:26 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements 
Small enhancements
 2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
bf832b3ea6 Fixed OPTIMIZE after RENAME of replicated table. [#CLICKHOUSE-2] 2018-04-17 20:59:42 +03:00
proller
27b4af9dd7 Change obsolete comment 2018-04-16 23:25:07 +03:00
alexey-milovidov
17dd218338
Merge pull request #2202 from proller/fix15 
CLICKHOUSE-3700: Fix empty password on replica query
 2018-04-16 23:18:47 +03:00
Nikolai Kochetov
081f0feb56 fix test [#CLICKHOUSE-3694] #2156 2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a merged with master 2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34 minor fixes 2018-04-16 18:11:13 +03:00
sundy-li
12211ffc5b Fix:ignore the format_version check when the data is empty 2018-04-16 18:04:59 +08:00
Nikolai Kochetov
41229b201b Merge branch 'master' into fix-header-for-union-stream-in-distributed-2 2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5 fix perf 2018-04-13 23:09:13 +03:00
Nikolai Kochetov
42f9a4d773 added PrewhereInfo [#CLICKHOUSE-3694] #2156 2018-04-11 22:10:08 +03:00
Nikolai Kochetov
c9abeed3f5 remove unused columns from prewhere actions [#CLICKHOUSE-3694] #2156 2018-04-11 22:08:53 +03:00
proller
157067b127 CLICKHOUSE-3700: Fix empty password on replica query 2018-04-10 17:49:52 +03:00
Silviu Caragea
f1b8d4bc39 Merge remote-tracking branch 'github/master' into background-schedule-pool-fix 2018-04-10 16:27:17 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix' 
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-04-10 16:20:14 +03:00
decaseal
40b41c3c6e storage file - change error code [#add_table_function_file] 2018-04-10 11:54:31 +03:00
decaseal
e8ae0343ed Merge remote-tracking branch 'yandex/master' into add_table_function_file_dev 2018-04-10 10:30:46 +03:00
decaseal
279fa17ff6 storage file - fix check creation is allowed [#add_table_function_file] 2018-04-10 10:09:50 +03:00
Alexey Milovidov
d3cf85057b Removed useless code [#CLICKHOUSE-2] 2018-04-09 18:49:12 +03:00
proller
c26b3bdef1
Fix split shared build; fix build without system odbc libs (#2191) 
* Fix split shared build

* Fix build without system odbc libs

* Move dbms/src/Common/iostream_debug_helpers.h -> libs/libcommon/include/common/iostream_debug_helpers.h

* Fix build with libiodbc
 2018-04-09 06:52:39 -07:00
Alexey Milovidov
18bbd0e61b Moved SessionPoolHelpers #2180 2018-04-07 06:07:32 +03:00
Alexey Milovidov
0a4b349f73 Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-07 00:47:18 +03:00
Alexey Milovidov
4e5e0fa664 ReplicatedMergeTree: Better diagnostics [#CLICKHOUSE-2] 2018-04-07 00:46:57 +03:00
alexey-milovidov
84726e17e8
Merge pull request #2185 from yandex/fix-leader-election-race 
Fix races in leader election.
 2018-04-07 00:18:26 +03:00
Alexey Milovidov
0d8d99e7a4 Fixed typo [#CLICKHOUSE-2] 2018-04-06 22:48:54 +03:00
Alexey Milovidov
ee7fe63b69 Avoid herd effect in ReplicatedMergeTreeCleanupThread (continued) [#CLICKHOUSE-2] 2018-04-06 22:44:55 +03:00
Alexey Milovidov
fa776b93c2 Avoid herd effect in ReplicatedMergeTreeCleanupThread [#CLICKHOUSE-2] 2018-04-06 22:43:37 +03:00
Alexey Zatelepin
3a8ca70d1f fix races in leader election [#CLICKHOUSE-3533] 2018-04-06 19:10:23 +03:00
decaseal
139b40f976 storage file - fix check creation is allowed [#add_table_function_file] 2018-04-06 16:43:29 +03:00
decaseal
157d51446b Merge remote-tracking branch 'yandex/master' into add_table_function_file_dev 2018-04-06 15:55:02 +03:00
decaseal
30e79f4c7d storage file - relative table path starts with db_dir_path [#add_table_function_file] 2018-04-06 13:35:52 +03:00
decaseal
8b96dc8c7e storage file - test db_dir_path [#add_table_function_file] 2018-04-06 13:24:12 +03:00
decaseal
7296bf2cb7 storage file - fix check table file path [#add_table_function_file] 2018-04-06 13:11:39 +03:00
decaseal
39cc42172d storage file - check table file path [#add_table_function_file] 2018-04-06 12:53:29 +03:00
Alexey Milovidov
f66d2fb780 Allow to use FINAL even in case of single part #2086 2018-04-06 00:36:55 +03:00
Nikolai Kochetov
b96039bafe added check for partition column in mayBenefitFromIndexForIn #2170 2018-04-05 00:03:16 +03:00
alexey-milovidov
e2a517db12 Update MergeTreeData.cpp 2018-04-04 00:17:22 +03:00
Nikolai Kochetov
2163977b2a mayBenefitFromIndexForIn returns true if at least one tuple element is in pk [#CLICKHOUSE-3680] 2018-04-04 00:17:22 +03:00
Alexey Milovidov
08170d0d77 Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
proller
e58b0830e6
Prepare to new poco (PocoData renamed to PocoSQL) (#2158) 2018-04-03 04:48:40 -07:00
KochetovNicolai
62e6a1bde6
Update MergeTreeBaseBlockInputStream.cpp 
Check is block is not empty before removing prewhere column
 2018-04-02 17:08:05 +03:00
Silviu Caragea
f811da7ed4 Move merge selection state into ReplicatedMergeTreeMergeSelectingThread 2018-04-02 15:45:55 +03:00
proller
440b0f33c7 Compile fixes 2018-04-02 15:31:49 +03:00
Alexey Milovidov
3fe743e2bd Fixed error after merge [#CLICKHOUSE-2] 2018-04-01 22:29:08 +03:00
alexey-milovidov
b07fb1ddda
Merge branch 'master' into better-range-reader 2018-04-01 22:16:39 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite 2018-04-01 17:31:20 +03:00
proller
a6f9df105c Allow use encryption for distributed tables (#2065) 
* Allow use encryption for distributed tables

* wip

* fix

* rename encryption to secure

* Fix DirectoryMonitor with +secure

* fix

* fix

* Update DirectoryMonitor.cpp

* Update DirectoryMonitor.cpp
 2018-03-29 04:41:06 +03:00
alexey-milovidov
4126c7767d
Merge pull request #2130 from yandex/fix-distributed-batch-inserts 
More aggressively move files to broken/ when doing distributed batch inserts
 2018-03-29 03:12:28 +03:00
alexey-milovidov
2e15ce6791
Merge pull request #2132 from yandex/small-enhancements 
Small enhancements
 2018-03-29 03:07:49 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
Vitaliy Lyudvichenko
701b58b4ff Faster DROP PARTITION. [#CLICKHOUSE-2] 2018-03-28 15:48:40 +03:00
Alexey Zatelepin
aa4f4e62fe mark failed batches as broken [#CLICKHOUSE-3594] 2018-03-28 15:28:15 +03:00
Alexey Zatelepin
00da8a477c report broken files more accurately [#CLICKHOUSE-3594] 2018-03-28 15:28:15 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database 
Show create database
 2018-03-28 05:29:36 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2 
&& - qualified IColumn::mutate
 2018-03-28 05:27:35 +03:00
Silviu Caragea
1418e339e4 Rename merge_selecting_handle with merge_selecting_task_handle for consistency 2018-03-26 23:18:19 +03:00
Silviu Caragea
0aa9b9efbe Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) (reverted from commit 50992843c6) 2018-03-26 23:12:17 +03:00
Silviu Caragea
438121e45b Renamed Zookeeper get method with getWatch for consistency 2018-03-26 23:08:14 +03:00
Silviu Caragea
50992843c6 Use consistent names for the task variables (change from next_update_task_handle to merge_selecting_handle) 2018-03-26 22:59:58 +03:00
Silviu Caragea
4361df913b Remove exists and use existsWatch instead for WatchCallbacks 2018-03-26 22:46:14 +03:00
Silviu Caragea
31874ed172 Use consistent names for the task variables 2018-03-26 22:37:47 +03:00
alexey-milovidov
03b01fc249
Merge pull request #2118 from yandex/faster-sync-insert 
Faster distributed sync insert
 2018-03-26 22:23:41 +03:00
Vitaliy Lyudvichenko
190964f98e Avoid extra waits in copier. [#CLICKHOUSE-2] 2018-03-26 21:39:28 +03:00
Alex Zatelepin
c5b04f7f17 Add info about total uncompressed part size to system tables (#2052) 
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]

* rename for clarity

* use more appropriate method for calculating table size

* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]

* rename columns for clarity [#CLICKHOUSE-2831]

* count shared substreams only once [#CLICKHOUSE-2831]
 2018-03-26 17:18:04 +03:00
alexey-milovidov
db4944508f
Merge pull request #2100 from tobad357/bugfix/fix-subscribe-multiple-topics 
#2095 Make sure to split the topics args list on ','
 2018-03-26 01:43:21 +03:00
alexey-milovidov
237c530b4e
Update StorageKafka.cpp 2018-03-26 01:42:36 +03:00
Alexey Milovidov
522bf01db9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
Alexey Milovidov
87b4d8209a Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:28:43 +03:00
Alexey Milovidov
7ec66830af Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:17:27 +03:00
Alexey Milovidov
58f32f98d7 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:11:46 +03:00
Alexey Milovidov
ae9633c1e5 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-24 23:00:16 +03:00
Tobias Adamson
0af09ae0c7 Add trim to topic names to be a bit more lenient if config is 'topic1, topic2' 2018-03-24 14:51:35 +08:00
Tobias Adamson
dd06b39e5f Fix rename of variable, duplication of wrong variable name 2018-03-24 09:16:33 +08:00
Alexey Milovidov
26584844b6 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 04:00:12 +03:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996) 
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
 2018-03-23 19:05:14 +03:00
Tobias Adamson
c76d1a008d Make sure to split the topics args list on ',' 2018-03-23 22:13:09 +08:00
KochetovNicolai
aacc0bee53
Merge pull request #2097 from yandex/CLICKHOUSE-3663 
Clickhouse 3663
 2018-03-23 14:56:08 +03:00
Nikolai Kochetov
2f468f1ae1 fix test [#CLICKHOUSE-3663] 2018-03-23 13:50:20 +03:00
alexey-milovidov
cf52c2840a
Merge branch 'master' into better-range-reader 2018-03-23 02:14:40 +03:00
Alexey Milovidov
0a06971e43 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-23 02:10:00 +03:00
alexey-milovidov
a75d5525e7 Update MergeTreeDataPartChecksum.h 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
883de7a2a6 startup() waits for initialization of ReplicatedMergeTreeRestartingThread. [#CLICKHOUSE-2] 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
fe8dfd3038 Add minimalistic checksums. [#CLICKHOUSE-3660] 2018-03-23 00:26:46 +03:00
Vitaliy Lyudvichenko
7c2a99c9b8 Introduced MinimalisticDataPartChecksums. [#CLICKHOUSE-3660] 2018-03-23 00:26:46 +03:00
Nikolai Kochetov
cbfd862fa3 fix reading with evaluated defaults [#CLICKHOUSE-3663] 2018-03-22 23:18:11 +03:00
Nikolai Kochetov
97624d7d78 fix reading with evaluated defaults [#CLICKHOUSE-3663] 2018-03-22 22:53:19 +03:00
Silviu Caragea
a2dc16a582 Remove the link between TaskHandles and ZooKeeper 2018-03-22 17:21:14 +02:00
Silviu Caragea
6629b03af9 Fixed few of the observation of the code review 2018-03-22 17:09:30 +02:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
d690c24198 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 00:40:53 +03:00
Nikolai Kochetov
476d4b339c Immutable construction for columns 2018-03-20 22:45:10 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
Alexey Zatelepin
86d53b34a5 forward ALTER PARTITION statements for materialized views [#CLICKHOUSE-3659] 2018-03-20 16:44:36 +03:00
Vitaliy Lyudvichenko
e41b653f14 Parallelized block split in sync Distributed insert. [#CLICKHOUSE-2] 2018-03-19 21:26:52 +03:00
Alexey Zatelepin
b1274f7b34 fix deadlock in StorageKafka::shutdown() in case startup() wasn't called #2075 2018-03-19 20:52:48 +03:00
Alexey Milovidov
590feb02b5 Fixed error; added test from Alexander Zaitsev [#CLICKHOUSE-2] 2018-03-19 17:29:40 +03:00
Alexey Milovidov
a6892b8813 Fixed test [#CLICKHOUSE-2] 2018-03-16 12:00:04 +03:00
Alexey Milovidov
02c67e2b13 Fixed error [#CLICKHOUSE-2] 2018-03-16 09:51:37 +03:00
Alexey Milovidov
25a691f03d Don't allow Distributed table that look at itself [#CLICKHOUSE-2919]. 2018-03-16 05:08:31 +03:00
Alexey Milovidov
b5e4d0692a Disallow PREWHERE, SAMPLE, FINAL in MATERIALIZED VIEWs [#CLICKHOUSE-2]. 2018-03-16 04:23:37 +03:00
alexey-milovidov
b9339e0ea1
Merge pull request #2053 from yandex/small-enhancements 
Small enhancements
 2018-03-15 22:10:29 +03:00
alexey-milovidov
1e88f2fe5c
Update AbandonableLockInZooKeeper.h 2018-03-15 22:06:53 +03:00
alexey-milovidov
e64b2df874
Update ReplicatedMergeTreeBlockOutputStream.cpp 2018-03-15 22:06:23 +03:00
alexey-milovidov
1554390bab
Update AbandonableLockInZooKeeper.h 2018-03-15 22:05:58 +03:00
Vitaliy Lyudvichenko
16dad209f7 Do not make extra ZK RTTs in inserts. [#CLICKHOUSE-3] 
Resolves #2054
 2018-03-15 21:40:59 +03:00
Vitaliy Lyudvichenko
4011afa399 Parallel SELECT and INSERT in ClusterCopier. [#CLICKHOUSE-2] 2018-03-14 23:49:18 +03:00
Vitaliy Lyudvichenko
f1b32e8982 Fixed ordinary MergeTree merges in case of empty ORDER BY key. [#CLICKHOUSE-2] 2018-03-14 23:49:18 +03:00
Nikolai Kochetov
51301d38cd added tryGetCreateTableQuery [#CLICKHOUSE-3590] 2018-03-14 22:56:44 +03:00
Alexey Milovidov
3c16faaff0 Merge branch 'master' of github.com:yandex/ClickHouse 2018-03-14 21:57:15 +03:00
alexey-milovidov
e5836cf97f
Merge pull request #2036 from yandex/CLICKHOUSE-3639 
Fixed ZooKeeper with chroot, refactoring of ZooKeeper::multi*
 2018-03-14 21:56:22 +03:00
Alexey Milovidov
9862f17ae4 Merge branch 'master' of github.com:yandex/ClickHouse 2018-03-14 19:40:32 +03:00
Alexey Milovidov
57279a87c7 Whitespaces [#CLICKHOUSE-2]. 2018-03-14 19:40:08 +03:00
Vitaliy Lyudvichenko
7abbe093e9 Avoid magic constants in system.parts. [#CLICKHOUSE-3] 
Resolves #2039
 2018-03-14 19:04:19 +03:00
Vitaliy Lyudvichenko
56bfb05ebb Fix insane DateTime in system.parts. [#CLICKHOUSE-3] 2018-03-14 19:00:02 +03:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Nikolai Kochetov
d6e9d08d5e getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590] 2018-03-14 15:37:38 +03:00
Alexey Milovidov
c9d1b61ef7 Fixed build after merge #2029 2018-03-14 06:19:23 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration 2018-03-14 05:35:50 +03:00
kshvakov
3ae2e443fd Revert "Fix quotes in partition display name based on Date, DateTime or UUID type" 
This reverts commit 10aa9cfc8a.
 2018-03-14 03:33:21 +03:00
Kirill Shvakov
0a33b774a3 Fix quotes in partition display name based on Date, DateTime or UUID type 2018-03-14 03:33:21 +03:00
alexey-milovidov
04cc8a52f7
Merge pull request #2032 from yandex/system-table-macro 
System table macro
 2018-03-14 02:10:30 +03:00
alexey-milovidov
8522a1b4d1
Update StorageSystemMacros.h 2018-03-14 02:09:26 +03:00
Alexey Zatelepin
5906c9a988 rename for clarity 2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac encapsulate ColumnsDeclaration [#CLICKHOUSE-3241] 2018-03-13 17:41:25 +03:00
Alexey Milovidov
b7475b1d2c Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641] 2018-03-12 23:25:18 +03:00
Alexey Zatelepin
de1db216a5 getStructureOfRemoteTable returns info about column default kinds [#CLICKHOUSE-3241] 2018-03-12 23:21:54 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
972db7b072 iterate over materialized columns where it makes sense 2018-03-12 22:07:48 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
Nikolai Kochetov
8b09e55102 added system.macros table [#CLICKHOUSE-3591] 2018-03-12 21:38:00 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346 
Sync insert and сluster copier enhancements
 2018-03-12 20:58:53 +03:00
Nikolai Kochetov
60ab3294b1 fix concurrent select from system.parts_columns 2018-03-12 19:23:48 +03:00
Vitaliy Lyudvichenko
30b69c84ae Fixed Illegal PREWHERE error for Merge tables over Distributed. [#CLICKHOUSE-3637] 2018-03-12 18:14:26 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
5fc47bdfb1 Fixed error [#CLICKHOUSE-3627] 2018-03-10 03:26:17 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
97b30d0b33 Added column "peak_memory_usage" to SHOW PROCESSLIST #245 2018-03-10 02:09:28 +03:00
Alexey Milovidov
add4d29298 Added "is_cancelled" columns to SHOW PROCESSLIST #245 2018-03-10 00:12:52 +03:00
alexey-milovidov
e41e2fe613
Merge pull request #1912 from zhang2014/fix/ISSUES-369 
ISSUES-369 add default database when create materialize view
 2018-03-07 23:28:17 +03:00
proller
d73fea5ab0
Fix macos compile (#2006) 
* Fix macos compile

* rename cluster-copier -> copier
 2018-03-07 21:17:17 +03:00
Vitaliy Lyudvichenko
96d4e59dab Simplified logic of distributed sync insert. [#CLICKHOUSE-2] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
47d1d4c83c More effective retries, fast partition discovering. [#CLICKHOUSE-3346] 2018-03-07 17:39:02 +03:00
Vitaliy Lyudvichenko
364f519eea Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910] 2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
Nikolai Kochetov
532b57aef8 perf. fixes 2018-03-07 01:05:36 +03:00
Alex Zatelepin
90ea45a397
better exception message [#CLICKHOUSE-3599] 2018-03-06 22:01:45 +03:00
Alexey Zatelepin
ec91d29d6a correct MergingParams columns check [#CLICKHOUSE-3599] 2018-03-06 20:17:58 +03:00
Alexey Milovidov
8bc40879ab Fixed error [#CLICKHOUSE-2] 2018-03-06 19:11:29 +03:00
proller
82a361d0e9 Show error to client if query was killed (#1989) 
* Show error to client if query was killed

* Kill exception v2

* Use kill

* fix

* wip

* fix

* fxi

* try fix

* Revert "try fix"

This reverts commit eb76e4c040.

* QUERY_WASCANCELLED

* Fxi all cancel()

* fix
 2018-03-06 00:09:39 +03:00
Nikolai Kochetov
b2b1588d5f added FilterWithZerosCounter 2018-03-05 17:25:20 +03:00
Nikolai Kochetov
8b01ec2225 Merge branch 'master' into better-range-reader 2018-03-05 15:55:06 +03:00
Alexey Milovidov
91a6a88102 Explicit semantic for TSan [#CLICKHOUSE-2] 2018-03-03 21:00:46 +03:00
Alexey Milovidov
07d8db9f2a Explicit semantic for TSan [#CLICKHOUSE-2] 2018-03-03 20:44:53 +03:00
Alexey Milovidov
368f46d764 Addition to prev. revision [#CLICKHOUSE-2] 2018-03-03 19:48:24 +03:00