thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-06 16:40:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
18,691 Commits 8,976 Branches 1,768 Tags 2 GiB
1664bec008
Commit Graph

3268 Commits

Author SHA1 Message Date
alexey-milovidov
405d7f9232
Merge pull request #2742 from yandex/support-join-on-syntax 
Support join on syntax
 2018-08-01 00:30:46 +03:00
alesapin
e81108b954 CLICKHOUSE-3863: Add more convinient exception message 2018-08-01 00:29:47 +03:00
alesapin
2db2d208e1 CLICKHOUSE-3863: Add HTTPS support for interserver replication 2018-08-01 00:29:47 +03:00
Alexey Milovidov
c9ab39c8c6 Added validation of ODBC connection string [#CLICKHOUSE-3861] 2018-08-01 00:25:26 +03:00
VadimPE
e2be3fd5ce CLICKHOUSE-3847 fix 2018-07-31 17:11:27 +03:00
VadimPE
3eaae23559 Merge branch 'CLICKHOUSE-3847' of github.com:VadimPE/ClickHouse into CLICKHOUSE-3847 2018-07-31 16:46:27 +03:00
VadimPE
ed8d749b9e CLICKHOUSE-3847 fix problems with empty entries 2018-07-31 16:45:43 +03:00
Vadim
1b068ac24c
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-31 16:04:35 +03:00
VadimPE
9b5620fac1 CLICKHOUSE-3847 fix comments. 2018-07-31 12:01:24 +03:00
Alexey Milovidov
b5b48d59fa Compatibility with obsolete version of Poco for alternative build variants #2759 2018-07-30 23:21:45 +03:00
Nikolai Kochetov
bc054f2247 Fix tests. [#CLICKHOUSE-3761] 2018-07-30 22:40:43 +03:00
Alexey Zatelepin
4863c5c178 fix potential segfault in MergeTreeData::delayInsertOrThrowIfNeeded [#CLICKHOUSE-3862] 2018-07-30 21:47:24 +03:00
Alexey Zatelepin
cc7950a733 don't destroy Cleanup- and AlterThread objects, just deactivate the tasks [#CLICKHOUSE-3862] 
Otherwise segfaults are possible when the objects are recreated in the middle of the queue task execution.
 2018-07-30 21:47:24 +03:00
Vadim
40999bfb0c
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-30 21:34:57 +03:00
Vadim
035af6327b
Update ReplicatedMergeTreeCleanupThread.cpp 2018-07-30 21:32:58 +03:00
VadimPE
3f6cdab293 CLICKHOUSE-3847 add support lost replica 2018-07-30 19:31:14 +03:00
Alexey Milovidov
8bc95412b6 Fixed bad code #2708 2018-07-28 00:33:30 +03:00
alexey-milovidov
9242588449
Merge pull request #2708 from VadimPE/CLICKHOUSE-3837 
CLICKHOUSE-3837 Add support for table function in remote() and cluster()
 2018-07-26 21:36:04 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832 
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
 2018-07-26 20:50:09 +03:00
alesapin
65a6a1225c
Merge pull request #2726 from alesapin/master 2018-07-26 18:20:02 +03:00
alesapin
9aec460f2e Fix build warning 2018-07-26 18:15:48 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
alexey-milovidov
67c0cf5efc
Merge pull request #2721 from alesapin/master 
CLICKHOUSE-3857: Add table table_engines, alias factory base class and columns alias_to and case_insensitive to functions
 2018-07-25 21:50:14 +03:00
alesapin
3888077398 CLICKHOUSE-3857: Fix typo 2018-07-25 19:19:11 +03:00
alesapin
9adb251689 CLICKHOUSE-3857: Add table table_engines, alias factory base class and columns alias_to and case_insensitive to functions 2018-07-25 19:08:23 +03:00
Amos Bird
0965f991b3 Add row_delimiter argument to StorageKafka. 
There are common cases where a message doesn't end with a row delimiter.
This patch allows specifying a row_delimiter char to compensate that.

https://github.com/yandex/ClickHouse/issues/2298
 2018-07-25 18:54:01 +03:00
VadimPE
1d5d097b0d CLICKHOUSE-3837 fix build 2018-07-25 16:16:36 +03:00
VadimPE
1b07873669 CLICKHOUSE-3837 fix 2018-07-25 15:53:38 +03:00
VadimPE
867a3ebfae CLICKHOUSE-3837 fix mistakes 2018-07-25 15:31:47 +03:00
alesapin
17cc27d1c0 Merge branch 'master' of github.com:alesapin/ClickHouse 2018-07-25 13:59:57 +03:00
alesapin
f04b2c3340 Merge remote-tracking branch 'upstream/master' 2018-07-25 13:59:23 +03:00
Alexey Milovidov
c2a50991c9 Minor modifications [#CLICKHOUSE-2] 2018-07-25 03:00:08 +03:00
Alexey Milovidov
a10ebecc67 Enabled minimalistic checksums in ZooKeeper by default #2666 2018-07-24 22:29:40 +03:00
Alexey Milovidov
7c07f46d50 Style [#CLICKHOUSE-2] 2018-07-24 21:46:23 +03:00
alexey-milovidov
d17aa47250 Update StorageSystemZooKeeper.cpp 2018-07-24 21:41:22 +03:00
alexey-milovidov
ee6eddb159 Update StorageSystemFunctions.h 2018-07-24 21:41:22 +03:00
alexey-milovidov
fe19ce6c10 Update StorageSystemDictionaries.cpp 2018-07-24 21:41:22 +03:00
alexey-milovidov
2d3a0796a6 Update StorageSystemAggregateFunctionCombinators.cpp 2018-07-24 21:41:22 +03:00
alesapin
d52fd35396 CLICKHOUSE-3772: Move headers to appropriate place (one more time) 2018-07-24 21:41:22 +03:00
alesapin
0f36999b12 CLICKHOUSE-3772: Move headers to appropriate place 2018-07-24 21:41:22 +03:00
alesapin
5459ca1401 CLICKHOUSE-3772: Change base class of almost all StorageSystem* tables and fix remarks 2018-07-24 21:41:22 +03:00
alesapin
a9eb190363 CLICKHOUSE-3772: Fix strange initialization 2018-07-24 21:41:22 +03:00
alesapin
e87460540a CLICKHOUSE-3772: Add size column 2018-07-24 21:41:22 +03:00
alesapin
5221adf1ea CLICKHOUSE-3772: Remove unused import 2018-07-24 21:41:22 +03:00
alesapin
6d6bad51ad CLICKHOUSE-3772: Fixes in system tables formats, data_type_families, aggregate_function_combinators 2018-07-24 21:41:22 +03:00
alexey-milovidov
ba4f988e3f
Update StorageSystemZooKeeper.cpp 2018-07-24 21:40:53 +03:00
alexey-milovidov
8af95f39e8
Update StorageSystemFunctions.h 2018-07-24 21:39:21 +03:00
alexey-milovidov
2834ba2dfb
Update StorageSystemDictionaries.cpp 2018-07-24 21:38:41 +03:00
alexey-milovidov
1824758f8f
Update StorageSystemAggregateFunctionCombinators.cpp 2018-07-24 21:37:07 +03:00
alesapin
8536761a76 CLICKHOUSE-3772: Move headers to appropriate place (one more time) 2018-07-24 17:42:52 +03:00
alesapin
4905c6ac51 CLICKHOUSE-3772: Move headers to appropriate place 2018-07-24 17:32:54 +03:00
alesapin
670353895b CLICKHOUSE-3772: Change base class of almost all StorageSystem* tables and fix remarks 2018-07-24 17:28:56 +03:00
VadimPE
46dec0d341 [CLICKHOUSE-3837] fix error in build 2018-07-24 17:05:37 +03:00
Vadim
437f3f20a9
Merge branch 'master' into CLICKHOUSE-3837 2018-07-24 16:21:51 +03:00
VadimPE
8dfb6806d8 add support for table function in remote() and cluster() 2018-07-24 16:10:34 +03:00
alesapin
f464bd73cf Merge remote-tracking branch 'upstream/master' 2018-07-24 12:34:19 +03:00
Alexey Zatelepin
c793277bcc add forgotten sort [#CLICKHOUSE-3748] 2018-07-23 21:04:13 +03:00
alesapin
220f4d6c43 CLICKHOUSE-3772: Fix strange initialization 2018-07-23 20:12:29 +03:00
alesapin
f2451210d0 CLICKHOUSE-3772: Add size column 2018-07-23 19:52:11 +03:00
alesapin
24a9bebec9 CLICKHOUSE-3772: Remove unused import 2018-07-23 19:13:35 +03:00
alesapin
18dd1e1f14 CLICKHOUSE-3772: Fixes in system tables formats, data_type_families, aggregate_function_combinators 2018-07-23 19:10:57 +03:00
Alex Zatelepin
41d87fdb0a fix getting new name for cloned part in case of empty parts [#CLICKHOUSE-3798] 2018-07-20 23:56:25 +00:00
Alexey Zatelepin
0fed05d25b use MergeTreeData::cloneAndLoadDataPart [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
c2897e2147 don't rewrite parts that aren't touched by mutation commands (copy them using localBackup instead) [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
55301ce1f0 create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
f75fb6cd68 refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Milovidov
09d22da9b9 Miscellaneous #2687 2018-07-20 18:59:11 +03:00
alesapin
fae9c33282 CLICKHOUSE-3791: Add system table collations 2018-07-20 16:17:16 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090 Make DatsTypeWithDictionary independent from index type. 2018-07-20 13:16:27 +03:00
alesapin
2915a58c8f Merge remote-tracking branch 'upstream/master' 2018-07-20 13:13:50 +03:00
alesapin
32e03f42ef CLICKHOUSE-3772: Fix initialization 2018-07-20 13:13:23 +03:00
alesapin
a45e707f41 CLICKHOUSE-3772: Rename column in formats 2018-07-20 13:01:46 +03:00
alesapin
ec156e9f2b CLICKHOUSE-3772: Add system tables formats, data_type_families, table_functions, aggregate_function_combinators 2018-07-20 13:00:56 +03:00
Alexey Milovidov
245b114363 Quote all identifiers when querying external database #2635 2018-07-20 03:04:48 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. (#2677) 
* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]

* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"

This reverts commit 9eafc13f3b.

* Revert "Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]"

This reverts commit e28ad4b5fe.

* Fixed test #2677

* Update InterpreterSelectQuery.cpp
 2018-07-19 16:36:21 +03:00
alexey-milovidov
f31b1236c1 Update MergeTreeDataSelectExecutor.cpp 2018-07-16 16:44:32 +03:00
proller
0b0a2838c8 Fix compile error with boost 1.68.0 2018-07-16 16:44:32 +03:00
alexey-milovidov
4d1c470469 Update MergeTreeData.cpp 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88aa790a2d save mutations to disk and load them on startup [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
78b83d78f0 execute part mutations in a background pool [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
88300258a7 info in system.mutations for nonreplicated MergeTree [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Alexey Zatelepin
ce17868a5c execute mutations synchronously for StorageMergeTree [#CLICKHOUSE-3748] 2018-07-16 06:22:22 +03:00
Amos Bird
ea01a3b22e add OPTIMIZE FINAL support for ReplicatedMergeTree. 2018-07-09 18:03:23 +03:00
Alexey Milovidov
4f2655960c Fixed test [#CLICKHOUSE-2] 2018-07-07 22:39:20 +03:00
Alexey Milovidov
d2a44248cd Fixed error with empty TinyLog table; added a test from Nickolay Kovalev #2563 2018-07-07 22:02:10 +03:00
Alexey Milovidov
b714d87de7 Get rid of virtual columns in system.tables table [#CLICKHOUSE-3806] 2018-07-07 21:58:48 +03:00
Alexey Milovidov
93f8316e1f Little better [#CLICKHOUSE-3806] 2018-07-06 19:34:53 +03:00
Alexey Milovidov
95915579c7 Fixed test [#CLICKHOUSE-3806] 2018-07-06 19:22:15 +03:00
Alex Zatelepin
f7f4f220f1 Update MergeTreeData.cpp 2018-07-06 15:14:23 +03:00
Ciprian Hacman
fd6fb023b6 Recreate format_version.txt when missing 2018-07-06 15:14:23 +03:00
Alexey Milovidov
67b9a69f19 Fixed error in prev. revision [#CLICKHOUSE-3806] 2018-07-06 00:26:23 +03:00
Alexey Milovidov
88c582106b Attempt to get rid of VirtualColumnFactory (part 2) [#CLICKHOUSE-3806] 2018-07-05 23:38:05 +03:00
Alexey Milovidov
cc2250f688 Attempt to get rid of VirtualColumnFactory (part 1) [#CLICKHOUSE-3806] 2018-07-05 22:56:51 +03:00
Alexey Milovidov
0a188389c0 Fixed error #2599 2018-07-05 21:56:33 +03:00
Alexey Milovidov
4a35b57cea Little better #2599 2018-07-05 21:45:18 +03:00
Amos Bird
78beacb3a5 Make OPTIMIZE be able to merge all parts with FINAL. 2018-07-05 21:32:54 +03:00
Alexey Zatelepin
d5f8e4a1a5 load quorum status in merge predicate asynchronously [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
a41ee1f0a7 switch to ephemeral nodes for block number locks [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
0a46d231ed speedup merge selection: async exists check for selected parts [#CLICKHOUSE-3802] 2018-07-05 20:06:33 +03:00
Alexey Zatelepin
116ed0a59e add RestartingThread wakeup for faster session recovery 2018-07-05 19:30:52 +03:00
Alexey Zatelepin
fe83c8dab1 stricter validation of mutation commands #2588 2018-07-05 17:19:33 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465 Fixed half of bad code #2571 2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Alexey Zatelepin
2447755700 BackgroundSchedulePool: remove task from delayed even it it is currently executing 
If the task was left in the delayed_tasks set, it could lead to a nasty bug:
delayExecutionThreadFunction() would schedule the task, then it would immediately
go on a next iteration and schedule the same task again. Thus this task would be
continually executing, and other delayed tasks would have no chance to run.
 2018-06-27 13:47:58 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
f56d16769b Added pre and post serialization for IDataType BinaryBulkWithMultipleStreams. Supported dictionary serialization format with single global dictionary (limited wit max_dictionary_size) and additional keys which are stored per granule. Changed IDataType::enumerateStream interface. Added (de)serialization params for binary bulk with multiple stream (de)serialization. Changed IColumn::index interface. 2018-06-26 17:12:21 +03:00
Nikolai Kochetov
60f0ed9296 Added processing stage check for StorageMerge. [#CLICKHOUSE-3694] #2156 2018-06-25 15:47:51 +03:00
Nikolai Kochetov
4f7c284d34 Fixed build. 2018-06-25 15:47:45 +03:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
Alexey Zatelepin
971fddb299 add comments [#CLICKHOUSE-3747] 2018-06-22 13:43:35 +03:00
zhang2014
f4e72792a5 ISSUES-2553 add offset parameter to numbers 2018-06-22 12:55:36 +03:00
Alexey Zatelepin
e78dc8142c factor out common code [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
a6c61848f1 mutations finalizing task [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
36982b967d use single mutex in ReplicatedMergeTreeQueue for simplicity 2018-06-21 22:47:44 +03:00
Alexey Zatelepin
b2cdfcbaca calculate and update parts_to_do for mutations [#CLICKHOUSE-3747] 2018-06-21 22:47:44 +03:00
proller
e1ae5233df Add // Y_IGNORE tags 2018-06-21 18:24:36 +03:00
Nikolai Kochetov
f88584d748 Added DeserializeBinaryBulkState which stores reading state for ColumnWithDictionary. 2018-06-21 16:28:53 +03:00
Vitaliy Lyudvichenko
1a4157f2a9 clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910] 
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
 2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910] 
Fixed race condition in SystemLog.
 2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488) 
CONTRIB-254
 2018-06-19 21:09:09 +03:00
Alexey Milovidov
2298f1c68b Fixed strange code #2501 2018-06-16 08:54:06 +03:00
Alexey Milovidov
b108882e2e Merge branch 'master' of https://github.com/alesapin/ClickHouse into alesapin-master 2018-06-16 08:29:00 +03:00
Alexey Milovidov
4e8082a699 Fixed build [#CLICKHOUSE-2] 2018-06-16 05:16:19 +03:00
Alexey Milovidov
0272fc996a Fixed build [#CLICKHOUSE-2] 2018-06-16 05:13:54 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
alesapin
6e07b17632 Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring. 2018-06-15 00:22:56 +03:00
alesapin
148cbe8058 Added WriteBufferFromHTTP and used it in StorageURL. Also small refactoring. 2018-06-15 00:20:39 +03:00
alesapin
4125b0c7f3 Merge remote-tracking branch 'upstream/master' 2018-06-14 21:06:24 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Alexey Milovidov
1e60b733f4 Fixed warning #2504 2018-06-13 23:02:27 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table 
[WIP] system.mutations table skeleton
 2018-06-13 23:00:30 +03:00
alexey-milovidov
ca883a699d
Update StorageURL.cpp 2018-06-13 21:54:32 +03:00
alexey-milovidov
f546169a4d
Update StorageURL.cpp 2018-06-13 21:51:56 +03:00
Alexey Zatelepin
a3bf3e6d20 add missing columns to system.parts [#CLICKHOUSE-3747] 2018-06-13 18:47:40 +03:00
Alexey Zatelepin
b60a2a90fa rename method for clarity 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
4ee581117b system.mutations table skeleton [#CLICKHOUSE-3747] 2018-06-13 17:15:36 +03:00
Alexey Zatelepin
2c61a5940c store mutation entries in shared_ptr 2018-06-13 17:14:12 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
alesapin
567bbb2bbb Fix header path and small fixes in tests 2018-06-13 10:36:47 +03:00
alesapin
b42351d36c Fix format in storage url 2018-06-13 10:00:07 +03:00
alesapin
df4f8bea35 Merge remote-tracking branch 'upstream/master' 2018-06-11 16:31:58 +03:00
alesapin
0f529dbc6e Add table fuction url and storage URL 2018-06-11 15:13:00 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492) 
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
 2018-06-10 22:22:49 +03:00
Alexey Milovidov
72af2b7b0f Removed wrong modification #2260 2018-06-10 21:26:02 +03:00
Alexey Milovidov
641076de51 Reverted unclear modification #2260 2018-06-09 21:39:29 +03:00
Alexey Milovidov
ebe5e3f9b6 Reverted unclear modification #2260 2018-06-09 21:35:51 +03:00
Alexey Milovidov
6475ea98c7 Merging: Fixed most of problems, actualized test #2260 2018-06-09 21:17:27 +03:00
Alexey Milovidov
d864f39ec7 Merge branch 'master' into zhang2014-feature/support_truncate 2018-06-09 19:10:06 +03:00
Alexey Milovidov
cfacdf1457 Merging: Fixed most of problems #2260 2018-06-09 19:09:37 +03:00
Alexey Milovidov
d56c199f07 Merging: Fixed half of problems #2260 2018-06-09 18:48:22 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Alexey Milovidov
9940b4f8ff Passing settings to ser/de of data types: development #1710 2018-06-08 05:26:44 +03:00
Alexey Milovidov
29bd48fc7a Passing settings to ser/de of data types: development #1710 2018-06-08 05:24:27 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Alexey Milovidov
8901414ad2 Fixed error; added test [#CLICKHOUSE-3764] 2018-06-07 23:49:59 +03:00
proller
347579ce46 Cmake: mark system includes as SYSTEM (#1449) 
* contrib: cctz as submodule. update cctz.

* pbuilder: add ubuntu bionic, devel

* Cmake: mark system includes as SYSTEM

* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Cmake: Add SYSTEM to includes for external libs
 2018-06-06 23:21:58 +03:00
Alexey Milovidov
267a69fe7e Better type for number of rows [#CLICKHOUSE-2] 2018-06-06 20:16:05 +03:00
Alexey Zatelepin
863c1c6ed5 add fields related to part mutations to system.replicas table [#CLICKHOUSE-3747] 2018-06-06 16:22:30 +03:00
Alexey Zatelepin
dbfee942af escape serialized AST in MutationCommands (just in case) [#CLICKHOUSE-3747] 2018-06-06 14:30:58 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Alexey Zatelepin
3947f25365 add general comment about the mutation algorithm [#CLICKHOUSE-3747] 2018-06-05 17:55:35 +03:00
alexey-milovidov
39e69b421a
Merge pull request #2468 from yandex/fix-partition-key-parts-pruning 
Fix pruning of parts by conditions on partition key columns
 2018-06-05 15:52:47 +03:00
Nikolai Kochetov
d018f3ad60 Per granula reading for ColumnWithDictionary in MergeTreeRangeReader. 2018-06-05 13:10:54 +03:00
alexey-milovidov
f69ecf7a9d
Merge pull request #2448 from LiuYangkuan/fix-issue-2439 
fix Exception in issue#2439
 2018-06-04 23:17:44 +03:00
alexey-milovidov
3af746aab1
Merge pull request #2462 from proller/fix19 
Build fixes
 2018-06-04 23:17:21 +03:00
alexey-milovidov
88efe5ad56
Merge pull request #2463 from yandex/pvs-studio 
Fixes according to PVS-Studio report.
 2018-06-04 22:59:47 +03:00
Alexey Milovidov
0f96a5c1c5 Suppressions for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:46:47 +03:00
proller
9907388766 32bit Compile fix 2018-06-04 20:04:31 +03:00
Alexey Milovidov
e5682e81f7 Slightly better (preparation) [#CLICKHOUSE-3] 2018-06-04 20:01:00 +03:00
Alexey Zatelepin
a9b348fe5e check if partition key condition can be true in parallelogram instead of range [#CLICKHOUSE-3757] 2018-06-04 19:20:02 +03:00
Alexey Zatelepin
ec7446e541 calculate primary key when mutating a part [#CLICKHOUSE-3747] 2018-06-04 18:45:34 +03:00
Alexey Milovidov
fa3a01f942 Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:03:21 +03:00
Alexey Milovidov
de72b4adde Fixed bug found by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:01:18 +03:00
Alexey Zatelepin
2e77c508ad add comments [#CLICKHOUSE-3747] 2018-06-04 14:43:09 +03:00
Alexey Zatelepin
e55097b866 introduce constants for max level and max block number 2018-06-04 14:23:47 +03:00
Alexey Milovidov
7c60adbebb Non significant changes according to clang's -Weverything, part 4 [#CLICKHOUSE-2] 2018-06-03 23:48:36 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
alexey-milovidov
02f7277dc7
Update ReplicatedMergeTreeQueue.h 2018-06-01 21:06:43 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Alexey Zatelepin
f63d2dc3c8 cannot take a number of unlocked abandonable lock 2018-05-31 20:28:17 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Babacar Diassé
3d518e48b9 NULL check to allow insertion in distributed tables with Materialized views 2018-05-31 17:21:35 +03:00
Vitaliy Lyudvichenko
dc5de3bbec More optimal conflicts check in future_parts. [#CLICKHOUSE-2] 2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24 Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3] 
Resolves #2315
 2018-05-31 17:14:50 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
LiuYangkuan
7eb25ef55b fix Exception in issue#2439 2018-05-30 11:11:53 -04:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
d81744fd06 Add more perfomance counters. [#CLICKHOUSE-2910] 2018-05-28 23:03:03 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
 2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972 DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c execute mutation log entries [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782 don't select merges of parts with different mutation versions [#CLICKHOUSE-3747] 2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146 notify relevant events directly from queue [#CLICKHOUSE-3747] 2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7 load mutations from ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76 parts versioning [#CLICKHOUSE-3687] 2018-05-25 23:04:07 +03:00
Alexey Zatelepin
17437a95bf merge selection based on checking current inserts [#CLICKHOUSE-3732] 2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master 
Fix DateTime vs DateTime('UTC') inconsistency on data read.
 2018-05-25 21:44:11 +03:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Alex Bocharov
3618842579 Fix DateTime vs DateTime('UTC') inconsistency on data read. 
Original problem was described in PR #1650 and partially fixed by
b5af4c95, however one place was forgotten and it was causing query
exceptions when trying to read DateTime column across parts with
different DateTime and DateTime('UTC') data type.
 2018-05-22 12:23:07 +01:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion 
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
 2018-05-21 22:42:42 +03:00
Vitaliy Lyudvichenko
8349d2b9a0 Fixed gcc7 compilation. [#CLICKHOUSE-2] 2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2 
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
 2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7 Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo. 2018-05-21 14:18:11 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa ISSUES-2259 fix the test after the merge master 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation 
Fix prepared sets creation
 2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix 
Background schedule pool fixed
 2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5 Style #2387 2018-05-18 21:31:18 +03:00
Nikolai Kochetov
5e22f19258 Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734] 2018-05-18 20:27:58 +03:00
Vitaliy Lyudvichenko
4b093e3e0a Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2] 
This patch is very crucial in case of many replicas.
 2018-05-18 02:01:36 +03:00
Vitaliy Lyudvichenko
bd4d8a6766 Add profile events and settings logging. [#CLICKHOUSE-2910] 2018-05-17 19:01:41 +03:00
Nikolai Kochetov
9a1c286ade Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734] 2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7 validate mutation commands [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f alter delete skeleton [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Vitaliy Lyudvichenko
abc73eb6ba Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-15 21:35:52 +03:00
sundy-li
5d91b4f2fd fix some bugs, fix some code styles 2018-05-15 03:02:59 +03:00
sundy-li
200076b593 ADD replace_query, on_duplicate_clause config for StorageMySQL && add docs 2018-05-15 03:02:59 +03:00
sundy-li
763f1fda96 Avoid Excessive copy when block is small enough && fix some code 2018-05-15 03:02:59 +03:00
sundy-li
2511a4784b Support data write to StorageMySQL table 2018-05-15 03:02:59 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2] 
Faster partition check.

Added more debug info.
 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
864dc0546b Add requested changes. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2] 
Add disable_internal_dns_cache main config option.
 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688 Better #2328 2018-05-09 07:49:34 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15 
Build fixes (gcc8)
 2018-05-09 07:25:18 +03:00