Commit Graph

4324 Commits

Author SHA1 Message Date
artpaul
2467a010c9 translate comments 2016-12-23 13:01:35 +05:00
artpaul
964afabf6a check limit hint only at beginning of block processing [#METR-23882] 2016-12-23 01:50:12 +05:00
artpaul
c5eb898416 organize code [#METR-23882] 2016-12-22 22:00:23 +05:00
Vitaliy Lyudvichenko
ba2b32b0ad Added vertical_merge_algorithm_min_columns_to_activate option. [#METR-23783] 2016-12-22 16:19:03 +03:00
Vitaliy Lyudvichenko
e2bd364844 Added whole block optimization. [#METR-23783] 2016-12-22 16:19:02 +03:00
artpaul
fe9c28ad49 distinct filtration was rewrited with SetVariants [#METR-23882] 2016-12-22 13:51:34 +05:00
artpaul
b160e2a1cf SetVariants was extracted into separated file [#METR-23882] 2016-12-21 17:42:54 +05:00
Alexey Milovidov
02af261c07 Cleanups [#METR-2944]. 2016-12-21 03:18:11 +03:00
Alexander Makarov
15118dec81 Added new diff for block structures. 2016-12-21 01:22:23 +03:00
artpaul
2ebe00ffab move constructor was implemented for Field [#METR-2944] 2016-12-20 17:04:22 +05:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
54587fec1b Tracking memory used in merges [#METR-23888]. 2016-12-20 05:29:35 +03:00
Vitaliy Lyudvichenko
5aa1822fb2 Consecutive optimization for vertical merge. [#METR-23783] 2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
8835275713 More detail log for merges. [#METR-23770] [#METR-23769] [#METR-23783] 2016-12-18 22:12:25 +03:00
artpaul
4025dbe7af style 2016-12-15 23:59:07 +05:00
alexey-milovidov
fea00eb595 Merge pull request #239 from yandex/issue-219
Issue 219
2016-12-15 17:21:35 +04:00
artpaul
92a7dc6908 style 2016-12-15 17:33:50 +05:00
artpaul
785a98e624 move all url's functions to FunctionsURL 2016-12-15 17:05:05 +05:00
kmeaw
8667a0e044 Minor fix: update <graphite_rollup/> conf example
Update the example usage of <graphite_rollup /> given in comments to
contain somewhat meaningful values.
2016-12-14 18:54:06 +03:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
artpaul
6694c14338 try resolve conflicts 2016-12-13 16:51:40 +05:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
Alexey Milovidov
54af522de1 Preparation [#METR-2944]. 2016-12-12 10:24:56 +03:00
artpaul
fb900881da resolve conflicts 2016-12-12 11:15:01 +05:00
artpaul
529f75c8b4 - use std::experimental::string_view
- rename unquoteUrl to decodeURLComponent
- fix code-style
2016-12-12 11:09:00 +05:00
Alexey Milovidov
3d643fc786 Fixed build on clang [#METR-2944]. 2016-12-12 09:02:35 +03:00
Alexey Milovidov
8a69df19c4 Fixed error after merge [#METR-19266]. 2016-12-12 09:00:37 +03:00
Alexey Milovidov
de82683197 Fixed build on clang [#METR-2944].[C 2016-12-12 08:56:34 +03:00
Alexey Milovidov
e2ed20999c Fixed build on clang [#METR-2944]. 2016-12-12 08:53:37 +03:00
Alexey Milovidov
70b01f0a53 Do not include ClickHouseRevision.h in header files [#METR-2944]. 2016-12-12 08:14:46 +03:00
Alexey Milovidov
d605bfdc9d Using internal boost library [#METR-2944]. 2016-12-12 07:57:09 +03:00
Alexey Milovidov
fc43827a6c Preparation [#METR-2944]. 2016-12-12 06:33:34 +03:00
Alexey Milovidov
8b06b09f34 Moved code to cpp [#METR-2944]. 2016-12-12 04:33:18 +03:00
artpaul
bea52b8631 lost files 2016-12-11 18:55:13 +05:00
Alexey Milovidov
31dbff77c4 Little better [#METR-23792]. 2016-12-11 14:15:24 +03:00
Alexey Milovidov
d77b4f12fb Added UUID functions [#METR-23792]. 2016-12-11 13:57:34 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
artpaul
99cec8b165 implement unquoteUrl 2016-12-11 02:04:58 +05:00
Alexey Milovidov
2aa02d0547 Merging [#METR-19266]. 2016-12-10 09:12:21 +03:00
Alexey Milovidov
c937d75a78 Merging [#METR-19266]. 2016-12-10 09:10:29 +03:00
Alexey Milovidov
f4815364f6 Merging [#METR-19266]. 2016-12-10 08:03:12 +03:00
Alexey Milovidov
e97ecb6cf7 Merge branch 'master' into METR-19266
Conflicts:
	dbms/CMakeLists.txt
	dbms/include/DB/Functions/FunctionsArray.h
	dbms/include/DB/Functions/FunctionsString.h
	dbms/include/DB/Parsers/ExpressionListParsers.h
	dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
	dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
	dbms/src/Core/ErrorCodes.cpp
	dbms/src/Parsers/ASTFunction.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/MergeTreeReader.cpp
	dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Alexey Milovidov
95b08c9b03 Miscellaneous [#METR-2944]. 2016-12-10 02:35:18 +03:00
artpaul
396ccccfce fix extraction of TLD from fqdn 2016-12-10 03:49:21 +05:00
artpaul
4cf4fa68e1 parametrize StringView 2016-12-10 03:13:33 +05:00
artpaul
228b43bc95 calculate size of 'https' at compile time 2016-12-10 00:33:52 +05:00
artpaul
dfb466d156 host extraction functionality was moved to UrlUtils 2016-12-10 00:31:16 +05:00
artpaul
544143f5c9 url's scheme extraction was fixed according to rfc3986. 2016-12-09 22:38:15 +05:00
Vitaliy Lyudvichenko
ea11f61433 Added requested changes. [#METR-19372] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
855dc56598 Added treshold setting for Vertical merge algorithm. [#METR-23305] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
f8eb9028fd Refined query_log, processes and merges metrics.
Also, dbms/CMakeLists.txt was rewritten.
2016-12-09 13:11:25 +03:00
Alexey Milovidov
a8eedafcd0 Fixed error in cached dictionary when using C++11 ABI [#METR-23764]. 2016-12-08 07:56:52 +03:00
Alexey Milovidov
514715589b Preparation [#METR-23747]. 2016-12-08 05:49:04 +03:00
Alexey Milovidov
9303a07b39 Removed garbage [#METR-23747]. 2016-12-08 04:11:44 +03:00
Alexey Milovidov
f2cd8de5b4 Removed garbage [#METR-23747]. 2016-12-08 04:08:19 +03:00
alexey-milovidov
5923df80e4 Merge pull request #204 from proller/METR-23466
Metr-23466 : dictonary sources: http and executable
2016-12-08 05:04:50 +04:00
Alexey Milovidov
6546b73dcc Added setting 'input_format_values_interpret_expressions' [#METR-23720]. 2016-12-08 03:25:52 +03:00
proller
76dc51aae5 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-12-07 22:08:09 +03:00
Alexey Milovidov
072f2fc7b8 Merges: start to lower maximum size of merge only when number of free entries in pool/queue is lower than specified threshold [#METR-21504]. 2016-12-06 06:09:07 +03:00
Alexey Milovidov
0717bfa4d2 Simplified LevelMergeSelector [#METR-21504]. 2016-12-06 00:34:46 +03:00
Vladimir Chebotarev
bcc5500f91 cmake: More options. [#METR-23701] 2016-12-05 15:43:14 +03:00
artpaul
2616453263 #214 fix offsets assigments 2016-12-03 02:18:29 +05:00
Alexey Milovidov
2def6778e7 Merge branch 'master' of github.com:yandex/ClickHouse 2016-12-02 23:27:42 +03:00
Alexey Milovidov
4110b6865f Merge branch 'METR-23305' of git://github.com/ludv1x/ClickHouse into ludv1x-METR-23305
Conflicts:
	contrib/CMakeLists.txt
2016-12-02 23:22:11 +03:00
artpaul
7eb7cc38f7 move impls of FunctionsString to cpp 2016-12-02 12:32:39 +05:00
artpaul
41fda59c95 move impls of FunctionsArray to cpp 2016-12-02 12:15:35 +05:00
proller
33cc46d225 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-30 00:42:05 +03:00
Vitaliy Lyudvichenko
202ba912ce Vertical merging algorithm for MergeTree engines. [#METR-23305] 2016-11-29 22:41:31 +03:00
alexey-milovidov
08cb8e506b Merge pull request #211 from yandex/if_with_const_condition
ExpressionAnalyzer: added more tests for aliases. fix bug [METR-23545]
2016-11-29 23:28:50 +04:00
Pavel Kartavyy
106bb24fd8 ExpressionAnalyzer: added more tests for aliases. fix bug [#METR-23545] 2016-11-29 22:19:15 +03:00
proller
b529f29bb7 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-29 19:57:01 +03:00
Alexey Milovidov
0a2d1ebbb3 Attempt to improve merge selecting algorithm [#METR-23632]. 2016-11-28 06:46:08 +03:00
Alexey Milovidov
cac8f9216f MergeSelector: attempt to do something that has sense [#METR-23632]. 2016-11-28 06:17:31 +03:00
Alexey Milovidov
8bc84e29ac Increased default background_pool_size [#METR-23632]. 2016-11-28 02:50:46 +03:00
proller
5e6cac10e5 no copypaste 2016-11-27 16:01:35 +03:00
proller
556bd12de1 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-25 20:46:59 +03:00
alexey-milovidov
7fda6394b8 Merge pull request #202 from yandex/if_with_const_condition
ExpressionAnalyzer: optimize if with constant condition [METR-23545]
2016-11-25 20:03:04 +04:00
proller
26fe10a7b4 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-25 03:22:30 +03:00
proller
40e674407f return http write callback 2016-11-25 03:16:20 +03:00
Alexey Milovidov
8e5889cf0e Improved merge selecting algorithm for Replicated tables [#METR-23615]. 2016-11-25 01:41:27 +03:00
Alexey Milovidov
36553dd653 Fixed deadlock [#METR-23605]. 2016-11-24 23:25:02 +03:00
proller
3b335b5546 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 22:58:40 +03:00
proller
e6d3c8855e http ook 2016-11-24 22:57:24 +03:00
alexey-milovidov
8c2e228856 Revert "New "vertical" algorithm for MergeTrees' parts merges" 2016-11-24 23:08:54 +04:00
proller
e855c16f4a Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 21:25:56 +03:00
alexey-milovidov
8544a8b852 Merge pull request #171 from ludv1x/METR-23305
New "vertical" algorithm for MergeTrees' parts merges
2016-11-24 22:07:41 +04:00
Pavel Kartavyy
84a89b3b3d ExpressionAnalyzer: optimize if with constant condition [#METR-23545] 2016-11-24 17:18:44 +03:00
Vitaliy Lyudvichenko
544ef67c28 Fixed IN <Set> usage inside PK expressions.
Refactoring of type conversion functions convertFieldToType().
2016-11-24 15:32:04 +03:00
proller
8c07957e38 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 04:01:18 +03:00
proller
2e02e29652 wip 2016-11-24 04:01:11 +03:00
alexey-milovidov
fdabcd4e38 Merge pull request #192 from ludv1x/enums-fix
Fixed Enum usage in PK expressions.
2016-11-24 03:13:16 +04:00
proller
8f573d7308 clean 2016-11-24 01:44:53 +03:00
proller
c919c02ed4 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-24 00:04:38 +03:00
Alexey Milovidov
a2e9359b18 Fixed rare deadlock after startup when structure of query_log was changed [#METR-23594]. 2016-11-23 23:41:39 +03:00
Vitaliy Lyudvichenko
4f9064ca19 Fixed case when pk column is wrapped by functions. 2016-11-23 22:58:33 +03:00
Vitaliy Lyudvichenko
d27951b4a7 Added requested changes. [#METR-23473] 2016-11-23 16:33:05 +03:00
Vitaliy Lyudvichenko
e07fc7cea5 Fixed Enum usage in PK expressions. [#METR-23473]
Added check for duplicates of column names in CREATE query.
2016-11-23 16:19:15 +03:00
Vitaliy Lyudvichenko
ef593d1b01 Added merge_tree.enable_vertical_merge_algorithm setting. 2016-11-23 15:59:25 +03:00
Vitaliy Lyudvichenko
588add5a49 Added requested changes.
Also fixed single thread read from empty storage Log.
2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
2cd5b8b604 Updated MergeInfo and progress callbacks with respect to vertical merge alg. 2016-11-23 15:52:12 +03:00
Vitaliy Lyudvichenko
ec9bcd8054 Vertical merging algorithm for ordinary MergeTreee. 2016-11-23 15:47:19 +03:00
proller
eeeacd0805 merge upstream 2016-11-23 01:33:02 +03:00
Alexey Milovidov
bba5dcbcfa Fixed deadlock [#METR-23557]. 2016-11-22 22:27:45 +03:00
Alexey Milovidov
94e344ee38 Part checks don't lock ALTERs [#METR-22214]. 2016-11-22 21:49:17 +03:00
proller
e280569453 Everything [maybe] works! 2016-11-22 18:03:54 +03:00
proller
0b40a13ea7 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-22 14:56:57 +03:00
Alexey Milovidov
820659b71c Fixed error in URL functions [#METR-2944]. 2016-11-21 05:39:37 +03:00
Alexey Milovidov
9018906e1a Better [#METR-2944]. 2016-11-20 15:43:20 +03:00
Alexey Milovidov
37d6ecc372 Allowed to sort one array by values of another array [#METR-23547]. 2016-11-20 09:49:24 +03:00
Alexey Milovidov
23257cd562 Added functions arraySort and arrayReverseSort [#METR-23547]. 2016-11-20 09:44:38 +03:00
Alexey Milovidov
7c53fd5867 Miscellaneous [#METR-2944]. 2016-11-20 08:48:07 +03:00
Alexey Milovidov
312ec5f817 Style [#METR-2944]. 2016-11-20 08:13:55 +03:00
Alexey Milovidov
3a16cd3ecc Added string concatenation operator [#METR-23546]. 2016-11-20 07:47:51 +03:00
proller
ee2d9503c8 wip 2016-11-19 03:56:15 +03:00
proller
fd3a9da076 httd dict wip 2016-11-19 03:07:58 +03:00
proller
61e6ee9100 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-18 15:14:34 +03:00
Alexey Milovidov
e73e4e887a Better logic when there is very large number of parts in non-replicated MergeTree [#METR-22327]. 2016-11-18 05:34:34 +03:00
Alexey Milovidov
a44e5193b0 Better backpressure for INSERT SELECT into MergeTree [#METR-22327]. 2016-11-18 05:05:25 +03:00
proller
881319c4ec Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-18 04:48:21 +03:00
proller
63eaa97086 wip 2016-11-18 04:48:13 +03:00
Alexey Milovidov
b19e61757e Little improvement for large number of small inserts [#METR-22327]. 2016-11-18 04:03:57 +03:00
proller
da6f40ac12 Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-17 04:09:58 +03:00
proller
cc0e0e739e ExecutableDictionarySource ok 2016-11-17 04:09:46 +03:00
Alexey Zatelepin
307e397dce adopt server timezone in non-interactive mode also 2016-11-17 00:12:08 +00:00
proller
278fbbb4da Merge remote-tracking branch 'upstream/master' into METR-23466 2016-11-17 00:02:25 +03:00
proller
5c9d42d4f4 wip 2016-11-17 00:02:07 +03:00
Alexey Milovidov
a4aae7e047 Fixed ClientInfo [#METR-19471]. 2016-11-16 23:46:02 +03:00
Pavel Kartavyy
aac646ccfc update after review 2016-11-16 18:52:35 +03:00
Pavel Kartavyy
631d9ea0a0 add getSessionContext() const 2016-11-16 18:52:35 +03:00
Pavel Kartavyy
bdb7e9745b add hasColumnInTable function [#METR-23248] 2016-11-16 18:52:35 +03:00
Alexey Milovidov
c6c94cbcef Added missing modification [#METR-23505]. 2016-11-16 09:15:38 +03:00
Alexey Milovidov
d5155fbe7a Added quota_key to query_log and processlist [#METR-23505]. 2016-11-16 08:09:41 +03:00
alexey-milovidov
3432f84409 Merge pull request #183 from ztlpn/METR-23447
Client uses server timezone for interpreting DateTime strings [#METR-23447]
2016-11-16 05:22:28 +04:00
proller
099edebc28 wip 2016-11-16 03:34:57 +03:00
proller
8fec8e2ac4 simple get works 2016-11-16 02:55:45 +03:00
proller
60ec3506a9 wip 2016-11-16 01:05:49 +03:00
proller
593e3c26bf initial 2016-11-15 22:51:06 +03:00
Alexey Zatelepin
e1bb33cad0 PR fixes:
* add forgotten const
* print exception string if switching to server timezone failed
* protocol compatibility with old versions
* use ALWAYS_INLINE in DateLUT.h
2016-11-15 10:24:55 +00:00
Alexey Milovidov
e7fccc4044 Modified backpressure method for MergeTree [#METR-23488]. 2016-11-14 21:19:08 +03:00
Alexey Milovidov
eb1ae65eda Fixed error with analyzing double-distributed subqueries [#METR-23472]. 2016-11-14 04:13:56 +03:00
alexey-milovidov
52390b0180 Merge pull request #150 from ludv1x/METR-23101
clickhouse-local application and File(...) storage
2016-11-14 04:03:03 +04:00
Vitaliy Lyudvichenko
107f7b34c7 Added requested PR changes, 2nd iteration. 2016-11-14 02:57:18 +03:00
Alexey Zatelepin
3a7260e200 [#METR-23447] Client uses server timezone for DateTime string parsing 2016-11-13 19:34:31 +00:00
Alexey Milovidov
bfdc262f87 Added comment [#METR-23472]. 2016-11-13 05:25:03 +03:00
artpaul
e1cda4b760 move impl of common parsers to cpp 2016-11-12 22:55:40 +05:00
artpaul
b5ad7c021b fix clang: remove unused variable 2016-11-12 21:03:44 +05:00
artpaul
1e34e7a15c move some impl details of DistinctBlockInputStream to cpp 2016-11-11 02:24:40 +05:00
Vitaliy Lyudvichenko
bf924009b9 Added support of seekable files for StorageFile, more options for clickhouse-local. [#METR-23101] 2016-11-09 22:05:35 +03:00
Vitaliy Lyudvichenko
2242cfd6b0 Put DatabaseMemory class into separated file. 2016-11-09 22:05:35 +03:00
Vitaliy Lyudvichenko
d952dd39b0 Merged clickhouse-server and clickhouse-local into common app. 2016-11-09 22:05:35 +03:00