Commit Graph

6787 Commits

Author SHA1 Message Date
Alexey Milovidov
ad6507f9df Preparation [#METR-23490]. 2016-12-27 09:36:53 +03:00
Alexey Milovidov
7771a3aa13 Miscellaneous [#METR-2944]. 2016-12-27 09:34:01 +03:00
Alexey Milovidov
dd0b5a1b82 Added test [#METR-23945]. 2016-12-25 07:50:06 +03:00
Alexey Milovidov
c195b0212b Fixed long delay when querying Merge table based on very large amount of StripeLog tables; fixed error in Merge table [#METR-23945]. 2016-12-25 07:39:22 +03:00
Alexey Milovidov
72888b48ef Printing user name in exception messages about exceeded quota [#METR-19622]. 2016-12-25 07:00:33 +03:00
Alexey Milovidov
3e15e81fab Fixed overflow in quota [#METR-23944]. 2016-12-24 05:42:22 +03:00
Alexey Milovidov
901c6a8d50 Addition to prev. revision [#METR-22799]. 2016-12-24 04:30:05 +03:00
proller
4bc003c4c1 Porting to freebsd: initial, compile ok, most tests ok. 2016-12-24 01:03:10 +00:00
Alexey Milovidov
2552e7de4b Added test [#METR-22799]. 2016-12-24 00:35:22 +03:00
Alexey Milovidov
47756eda45 Fixed error with --external command line arguments for clickhouse-client [#METR-22799]. 2016-12-24 00:34:49 +03:00
proller
22371fdead Add initial test for executable and http dictonaries [METR-23466] 2016-12-23 22:20:07 +03:00
alexey-milovidov
d1383c5f62 Merge pull request #288 from yandex/issue-199
Issue #199: speedup DISTINCT
2016-12-23 19:02:48 +04:00
artpaul
2467a010c9 translate comments 2016-12-23 13:01:35 +05:00
Alexey Milovidov
3d5005016b Applied a patch, sent by aSealBack [#METR-2944]. 2016-12-23 04:24:19 +03:00
artpaul
c904d31882 translate comments 2016-12-23 03:19:57 +05:00
artpaul
964afabf6a check limit hint only at beginning of block processing [#METR-23882] 2016-12-23 01:50:12 +05:00
artpaul
c5eb898416 organize code [#METR-23882] 2016-12-22 22:00:23 +05:00
artpaul
200f84c046 add test for DISTINCT with nullable values [#METR-23882] 2016-12-22 21:39:00 +05:00
artpaul
5d1cfc0517 use swtich instead of if ... else, so we will get error about unhandled enum on the compile time [#METR-2944] 2016-12-22 21:35:54 +05:00
alexey-milovidov
690ab98b91 Merge pull request #287 from ludv1x/METR-23783
[WIP] Vertical merge optimization, fix and perf tests.
2016-12-22 17:40:01 +04:00
Alexey Milovidov
dc3a25dd63 Addition to prev. revision [#METR-23920]. 2016-12-22 16:37:47 +03:00
Alexey Milovidov
433673871c Fixed error with dynamic builds [#METR-23920]. 2016-12-22 16:27:20 +03:00
Vitaliy Lyudvichenko
ba2b32b0ad Added vertical_merge_algorithm_min_columns_to_activate option. [#METR-23783] 2016-12-22 16:19:03 +03:00
Vitaliy Lyudvichenko
3432f3c013 Added draft scripts for performance testing of vertical merge. [#METR-23783] 2016-12-22 16:19:02 +03:00
Vitaliy Lyudvichenko
e2bd364844 Added whole block optimization. [#METR-23783] 2016-12-22 16:19:02 +03:00
artpaul
fe9c28ad49 distinct filtration was rewrited with SetVariants [#METR-23882] 2016-12-22 13:51:34 +05:00
Alexey Milovidov
536f88ea55 Adjusted coefficients [#METR-23916]. 2016-12-22 05:04:32 +03:00
Alexey Milovidov
e5440d0f67 Fixed desinformation [#METR-23305]. 2016-12-22 04:37:05 +03:00
Alexey Milovidov
7ebbf72ca6 Removed unused variable [#METR-23305]. 2016-12-22 04:27:41 +03:00
Alexey Milovidov
168472fc9f Fixed typo [#METR-23305]. 2016-12-22 04:14:19 +03:00
Alexey Milovidov
c47406c42d StorageBuffer: addition to prev. modification [#METR-23909]. 2016-12-22 03:13:59 +03:00
proller
999b181aa5 fix 'env bash -e' 2016-12-21 23:43:35 +03:00
proller
d270053c3c Replace all !/bin/bash by !/usr/bin/env bash : allow running scripts with bash in non standard path. also on freebsd. 2016-12-21 23:04:27 +03:00
Alexey Milovidov
7222afe5eb StorageBuffer: fixed exception safety [#METR-23909]. 2016-12-21 20:10:32 +03:00
artpaul
b160e2a1cf SetVariants was extracted into separated file [#METR-23882] 2016-12-21 17:42:54 +05:00
Alexey Milovidov
87695c02da MongoDBDictionarySource: fixed incompatibility with MongoDB 3.4.0 [#METRIQA-599]. 2016-12-21 05:13:51 +03:00
Alexey Milovidov
02af261c07 Cleanups [#METR-2944]. 2016-12-21 03:18:11 +03:00
Vitaliy Lyudvichenko
6ee0cc795a Prevent "variable tracking size limit exceeded" compiler notice. [#METR-20000] 2016-12-21 02:05:43 +03:00
alexey-milovidov
d277d55763 Merge pull request #280 from aSealBack/BlockStructureDiff
Added new diff for block structures.
2016-12-21 02:59:41 +04:00
Alexey Milovidov
df54b52db0 Revert "Fixed 'variable tracking size limit exceeded' notice (again) [#METR-23101]."
This reverts commit b6fb08c77f.
2016-12-21 01:22:32 +03:00
Alexander Makarov
15118dec81 Added new diff for block structures. 2016-12-21 01:22:23 +03:00
Alexey Milovidov
b6fb08c77f Fixed 'variable tracking size limit exceeded' notice (again) [#METR-23101]. 2016-12-20 23:58:54 +03:00
Alexey Milovidov
5e5c3b5661 Merge branch 'master' of github.com:yandex/ClickHouse 2016-12-20 23:49:05 +03:00
Alexey Milovidov
5fe11c0697 Fixed MongoDBDictionarySource [#METR-2944]. 2016-12-20 23:48:40 +03:00
alexey-milovidov
111aaae0d3 Merge pull request #273 from ludv1x/METR-23765
clickhouse-local enhancements
2016-12-21 00:11:00 +04:00
Vitaliy Lyudvichenko
836f641f5f Fix rare race condition which occurrs during update of config files. [#METRIKASUPP-7653] 2016-12-20 22:03:12 +03:00
Vitaliy Lyudvichenko
6fe581c172 Added --stacktrace option to clickhouse-local. [#METR-23765]
Added support of path config variable and ability to load clickhouse-server data. [#METR-20000]
Default database of clickhouse-local is changed to "_local" to avoid collisions with clickhouse-server.

Small fixes and enhancements of command line options (setting and limits). [#METR-23101]
2016-12-20 18:01:05 +03:00
artpaul
2ebe00ffab move constructor was implemented for Field [#METR-2944] 2016-12-20 17:04:22 +05:00
Alexey Milovidov
a3e22e10d9 MongoDBDictionarySource: fixed error [#METR-2944]. 2016-12-20 05:31:25 +03:00
Alexey Milovidov
54587fec1b Tracking memory used in merges [#METR-23888]. 2016-12-20 05:29:35 +03:00
Alexey Milovidov
47b75e6c1e MongoDBDictionarySource: preparation [#METR-2944]. 2016-12-20 04:20:59 +03:00
Alexey Milovidov
442ff1d3b8 StorageBuffer: simplification; added metrics [#METR-23888]. 2016-12-20 02:55:13 +03:00
Vitaliy Lyudvichenko
8398baea85 Fixed getFlagsPath() for clickhouse-local use case. [#METR-23761] 2016-12-19 17:15:45 +03:00
Vitaliy Lyudvichenko
e39b41e158 Typo and codestyle fix. 2016-12-18 22:38:30 +03:00
Vitaliy Lyudvichenko
5aa1822fb2 Consecutive optimization for vertical merge. [#METR-23783] 2016-12-18 22:12:25 +03:00
Vitaliy Lyudvichenko
8835275713 More detail log for merges. [#METR-23770] [#METR-23769] [#METR-23783] 2016-12-18 22:12:25 +03:00
Alexey Milovidov
57426cafc8 Improved test of external dictionaries [#METRIQA-599]. 2016-12-18 21:43:08 +03:00
Alexey Milovidov
ca4438d470 Fixed style [#METR-2944]. 2016-12-18 21:34:49 +03:00
Alexey Milovidov
927721baee Fixed error in autotests of external dictionaries [#METR-2944]. 2016-12-17 03:25:10 +03:00
alexey-milovidov
4fa9390840 Merge pull request #264 from ekonkov/master
METRIQA-599 port parameter
2016-12-17 00:31:20 +04:00
Eugene Konkov
6f7a359079 METRIQA-599 port parameter 2016-12-16 17:37:06 +03:00
alexey-milovidov
f5b5b274a3 Merge pull request #262 from drrtuy/benchmark-testing-greenplum
Greenplum benchmark test environment description and test results.
2016-12-16 15:37:04 +04:00
Vitaliy Lyudvichenko
d2e594cdf7 Fixed groupUniqArray for Date and DateTime types. [#METR-23869] 2016-12-16 13:59:16 +03:00
Roman Nozdrin
934b715a7d Greenplum benchmark test environment description and test results. 2016-12-16 12:08:55 +03:00
Alexey Milovidov
08bf108961 Fixed error in tests [#METRIQA-599]. 2016-12-16 03:10:37 +03:00
Alexey Milovidov
9ab111640c Fixed error after changing MongoDB driver for external dictionaries [#METR-2944]. 2016-12-16 02:40:30 +03:00
Alexey Milovidov
989d542f66 Fixed error (tnx. artpaul) [#METR-23793]. 2016-12-15 23:33:35 +03:00
Alexey Milovidov
1311b93c9c Fixed error (tnx. artpaul) [#METR-23793]. 2016-12-15 23:29:42 +03:00
Alexey Milovidov
b113a7a473 Tiny modifications [#METR-23793]. 2016-12-15 22:35:32 +03:00
artpaul
4025dbe7af style 2016-12-15 23:59:07 +05:00
artpaul
0b0dc43e9b fix 2016-12-15 23:56:31 +05:00
artpaul
945f879765 fix 2016-12-15 23:21:38 +05:00
artpaul
722e4dab6d merge with master 2016-12-15 23:19:12 +05:00
alexey-milovidov
6d164a363b Merge pull request #259 from ekonkov/METRIQA-599
METRIQA-599
2016-12-15 21:57:12 +04:00
artpaul
eb80837355 use find_first_symbols 2016-12-15 22:55:12 +05:00
artpaul
d3657d311b fix decodeUrl; decode all values; add more tests 2016-12-15 22:12:41 +05:00
Eugene Konkov
3e67ac7232 METRIQA-599
JUnit output
2016-12-15 19:10:12 +03:00
alexey-milovidov
2de93a2a78 Merge pull request #257 from excitoon/quorum
StorageReplicatedMergeTree: Correct taking /quorum/last_part into acc…
2016-12-15 19:01:43 +04:00
Vladimir Chebotarev
d172cb1fc2 StorageReplicatedMergeTree: Correct taking /quorum/last_part into account when merging. [#METR-23826] 2016-12-15 17:32:47 +03:00
alexey-milovidov
a3886babed Revert "Issue 219" 2016-12-15 18:19:16 +04:00
Alexey Milovidov
082820b405 Removed executable attribute from test files [#METR-20000]. 2016-12-15 17:12:31 +03:00
alexey-milovidov
fea00eb595 Merge pull request #239 from yandex/issue-219
Issue 219
2016-12-15 17:21:35 +04:00
artpaul
92a7dc6908 style 2016-12-15 17:33:50 +05:00
artpaul
785a98e624 move all url's functions to FunctionsURL 2016-12-15 17:05:05 +05:00
kmeaw
8667a0e044 Minor fix: update <graphite_rollup/> conf example
Update the example usage of <graphite_rollup /> given in comments to
contain somewhat meaningful values.
2016-12-14 18:54:06 +03:00
alexey-milovidov
1ee5ad2ce0 Merge pull request #250 from hatarist/tsv_format_synonym
Added TSV format synonyms
2016-12-14 17:53:33 +04:00
Igor Hatarist
76365c3c15 Fixed the test 2016-12-14 08:56:19 +03:00
alexey-milovidov
5af401721e Merge pull request #251 from proller/METR-23466
Dictonary: executable: rename 'path' to 'command' [#METR-23466]
2016-12-14 01:45:48 +04:00
proller
357d995e75 Dictonary: executable: rename 'path' to 'command' [#METR-23466] 2016-12-14 00:28:31 +03:00
Alexey Milovidov
cdfeccd38d clickhouse-client: Fixed error that 'host' and 'port' parameters cannot have default values set in configuration file [#METR-23829]. 2016-12-14 00:26:31 +03:00
Igor Hatarist
9be107e89e Removed TSVBlock format by Alexey's request 2016-12-13 21:26:34 +03:00
Igor Hatarist
96fa052839 Added TSV format synonyms for the TabSeparated formats 2016-12-13 21:03:10 +03:00
artpaul
6694c14338 try resolve conflicts 2016-12-13 16:51:40 +05:00
Vladimir Chebotarev
cc7db759fe create_init_script: Avoid generation of init file each configuration phase. [#METR-21516] 2016-12-13 14:09:22 +03:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
Igor Hatarist
b22e4981df Add clickhouse-client option: --version 2016-12-12 12:25:33 +03:00
Alexey Milovidov
f9c31c42c5 Fixed error after updating boost [#METR-2944]. 2016-12-12 10:56:49 +03:00
Alexey Milovidov
a0dfb3e179 Addition to prev. revision [#METR-2944]. 2016-12-12 10:29:21 +03:00
Alexey Milovidov
6dcabed912 Addition to prev. revision [#METR-2944]. 2016-12-12 10:27:47 +03:00
Alexey Milovidov
c1ecc41804 Fixed error after merge [#METR-19266]. 2016-12-12 10:25:31 +03:00
Alexey Milovidov
54af522de1 Preparation [#METR-2944]. 2016-12-12 10:24:56 +03:00
artpaul
fb900881da resolve conflicts 2016-12-12 11:15:01 +05:00
artpaul
529f75c8b4 - use std::experimental::string_view
- rename unquoteUrl to decodeURLComponent
- fix code-style
2016-12-12 11:09:00 +05:00
Alexey Milovidov
3d643fc786 Fixed build on clang [#METR-2944]. 2016-12-12 09:02:35 +03:00
Alexey Milovidov
8a69df19c4 Fixed error after merge [#METR-19266]. 2016-12-12 09:00:37 +03:00
Alexey Milovidov
de82683197 Fixed build on clang [#METR-2944].[C 2016-12-12 08:56:34 +03:00
Alexey Milovidov
7e37460c38 Merge branch 'master' of github.com:yandex/ClickHouse 2016-12-12 08:53:56 +03:00
Alexey Milovidov
e2ed20999c Fixed build on clang [#METR-2944]. 2016-12-12 08:53:37 +03:00
alexey-milovidov
52c34b4276 Merge pull request #240 from vavrusa/master
HTTPHandler: added support for X-ClickHouse-*
2016-12-12 09:47:40 +04:00
Alexey Milovidov
dae8814a71 Addition to prev. revision [#METR-2944]. 2016-12-12 08:20:56 +03:00
Alexey Milovidov
0bdd22efe0 Addition to prev. revision [#METR-2944]. 2016-12-12 08:15:34 +03:00
Alexey Milovidov
70b01f0a53 Do not include ClickHouseRevision.h in header files [#METR-2944]. 2016-12-12 08:14:46 +03:00
Alexey Milovidov
31c4636538 Using internal boost library [#METR-2944]. 2016-12-12 07:59:19 +03:00
Alexey Milovidov
d5a002f441 Using internal boost library [#METR-2944]. 2016-12-12 07:57:55 +03:00
Alexey Milovidov
d605bfdc9d Using internal boost library [#METR-2944]. 2016-12-12 07:57:09 +03:00
Marek Vavrusa
f7a7e8e858 HTTPHandler: added support for X-ClickHouse-*
Support X-ClickHouse-* to allow running behind authenticating LBs, that
pass through user information or enforce fixed user.
The format of the new options follows X-Auth-*

Supported headers are:

* X-ClickHouse-User (identical to "user" URL parameter)
* X-ClickHouse-Key (identical to "password" URL parameter)
* X-ClickHouse-Quota (identical to "quota_key" URL parameter)
2016-12-11 20:46:37 -08:00
Alexey Milovidov
58a8cff3ae Using internal boost library [#METR-2944]. 2016-12-12 07:17:16 +03:00
Alexey Milovidov
fc43827a6c Preparation [#METR-2944]. 2016-12-12 06:33:34 +03:00
Alexey Milovidov
927b84323b Addition to prev. revision [#METR-2944]. 2016-12-12 04:51:27 +03:00
Alexey Milovidov
8b06b09f34 Moved code to cpp [#METR-2944]. 2016-12-12 04:33:18 +03:00
artpaul
bea52b8631 lost files 2016-12-11 18:55:13 +05:00
artpaul
9ec6688397 move char2DigitTable to hex.cpp 2016-12-11 18:54:38 +05:00
Alexey Milovidov
b3e85e6469 Addition to prev. revision [#METR-22442]. 2016-12-11 14:59:55 +03:00
Alexey Milovidov
436d2c43c9 Addition to prev. revision [#METR-22442]. 2016-12-11 14:47:09 +03:00
Alexey Milovidov
ce6556639e Fixed tests after merge [#METR-19266] [#METR-22442]. 2016-12-11 14:33:51 +03:00
Alexey Milovidov
31dbff77c4 Little better [#METR-23792]. 2016-12-11 14:15:24 +03:00
Alexey Milovidov
d77b4f12fb Added UUID functions [#METR-23792]. 2016-12-11 13:57:34 +03:00
Alexey Milovidov
599308aef0 Get rid of obsolete mongodb client library [#METR-23791]. 2016-12-11 12:43:16 +03:00
artpaul
99cec8b165 implement unquoteUrl 2016-12-11 02:04:58 +05:00
Alexey Milovidov
4aeb017093 Renamed test [#METR-19266]. 2016-12-10 09:40:46 +03:00
Alexey Milovidov
02cb56653a Merging [#METR-19266]. 2016-12-10 09:22:03 +03:00
Alexey Milovidov
dc9e88a9d7 Merging [#METR-19266]. 2016-12-10 09:16:06 +03:00
Alexey Milovidov
2aa02d0547 Merging [#METR-19266]. 2016-12-10 09:12:21 +03:00
Alexey Milovidov
c937d75a78 Merging [#METR-19266]. 2016-12-10 09:10:29 +03:00
Alexey Milovidov
f4815364f6 Merging [#METR-19266]. 2016-12-10 08:03:12 +03:00
Alexey Milovidov
e53e32130d Merging [#METR-19266]. 2016-12-10 07:58:40 +03:00
Alexey Milovidov
e97ecb6cf7 Merge branch 'master' into METR-19266
Conflicts:
	dbms/CMakeLists.txt
	dbms/include/DB/Functions/FunctionsArray.h
	dbms/include/DB/Functions/FunctionsString.h
	dbms/include/DB/Parsers/ExpressionListParsers.h
	dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
	dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
	dbms/src/Core/ErrorCodes.cpp
	dbms/src/Parsers/ASTFunction.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/MergeTreeReader.cpp
	dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
Alexey Milovidov
95b08c9b03 Miscellaneous [#METR-2944]. 2016-12-10 02:35:18 +03:00
artpaul
396ccccfce fix extraction of TLD from fqdn 2016-12-10 03:49:21 +05:00
artpaul
4cf4fa68e1 parametrize StringView 2016-12-10 03:13:33 +05:00
artpaul
228b43bc95 calculate size of 'https' at compile time 2016-12-10 00:33:52 +05:00
artpaul
dfb466d156 host extraction functionality was moved to UrlUtils 2016-12-10 00:31:16 +05:00
artpaul
544143f5c9 url's scheme extraction was fixed according to rfc3986. 2016-12-09 22:38:15 +05:00
Vitaliy Lyudvichenko
ea11f61433 Added requested changes. [#METR-19372] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
855dc56598 Added treshold setting for Vertical merge algorithm. [#METR-23305] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
774eb01fd3 Added MergesTime metric. [#METR-23305] 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
fc4c02c510 StorageSystemMerges refactoring. 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
6540156100 Removed redundant code from CMakeLists. 2016-12-09 13:13:16 +03:00
Vitaliy Lyudvichenko
f8eb9028fd Refined query_log, processes and merges metrics.
Also, dbms/CMakeLists.txt was rewritten.
2016-12-09 13:11:25 +03:00
Alexey Milovidov
a1c599fc57 Autotests for external dictionaries: removed garbage [#METR-23766]. 2016-12-08 08:58:45 +03:00