Commit Graph

998 Commits

Author SHA1 Message Date
Ravengg
b079dacfd1 Added part_log with statistics scripts (#549)
* Added part_log

* first_test

* filter and hits_res

* Add renamer and drawer

* Add columns database and table into PartLog

* Add normal way to get table_name and database_name from part

* improve drawer

* add stats for random size parts

* Merge converter and drawer

* make drawer more informative

* add new data

* add new data

* new data

* add long range stats

* for checking best way

* Add add_parts script

* Good style for global merge

* delete commented code

* Fixed spaces to tabs

* Note that Stopwatch is started automatically.

* Style

* Update StorageMergeTree.cpp

* Update StorageReplicatedMergeTree.cpp

* Switch act_time_ms to duration_ms

* Added ability to disable part_log

* fixed getPartLog

* fix usage getPartLog

* fix
2017-03-07 21:13:54 +04:00
Alexey Milovidov
d3b22774c9 Comments [#CLICKHOUSE-2788]. 2017-03-04 00:15:46 +03:00
proller
067ff7a5c7 Customizable internal compiler 2017-03-02 16:34:43 +03:00
alexey-milovidov
554688bd89 Update evaluateConstantExpression.h 2017-02-18 00:36:31 +04:00
Vitaliy Lyudvichenko
8bcb1fe970 Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845] 2017-02-18 00:36:31 +04:00
Alexey Milovidov
96449a2bc9 Changed default implementation of COUNT(DISTINCT ...) to avoid confusion [#CLICKHOUSE-3]. 2017-02-17 17:12:23 +03:00
Alexey Zatelepin
93a9e64624 fix usage of possibly invalidated iterator [#CLICKHOUSE-2] 2017-02-15 22:39:18 +03:00
alexey-milovidov
4593d363d1 Fix poor distributed insertion scalability (#481)
* Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791].

* Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791].

* Misc [#CLICKHOUSE-2791].

* Fixed error [#CLICKHOUSE-2791].
2017-02-12 00:20:57 +04:00
Alexey Zatelepin
9918965c5f Allow metadata-only ALTER of primary key columns [#CLICKHOUSE-2027] 2017-02-10 22:19:40 +04:00
Vitaliy Lyudvichenko
d6e9af834a Refined comments and status codes. [#CLICKHOUSE-2799] 2017-02-07 20:08:43 +04:00
Vitaliy Lyudvichenko
7e5a075ef3 Fixed long ProcessList lock in case of remote server timeout. [#CLICKHOUSE-2799] 2017-02-07 20:08:43 +04:00
proller
27cde5f8c8 Fix some includes and missing definitions (#446) 2017-02-03 02:08:19 +04:00
Alexey Milovidov
efbfbdc7a3 Added setting 'send_progress_in_http_headers', disabled by default [#CLICKHOUSE-32]. 2017-02-01 04:19:32 +03:00
Alexey Milovidov
48ed301e56 Revert "Revert "KILL QUERY""
This reverts commit 720781a7bc.
2017-01-30 18:43:20 +03:00
alexey-milovidov
720781a7bc Revert "KILL QUERY" 2017-01-30 16:20:11 +04:00
Alexey Milovidov
d4d3d36ff0 Removed useless code; improved performance [#CLICKHOUSE-2785]. 2017-01-30 09:48:10 +03:00
proller
bff12c5f93 Fix clang 4.0 2017-01-27 20:30:23 +03:00
alexey-milovidov
de9bc1dc75 Text formats allow to skip errors (#407)
* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Allow to skip errors in text formats: added settings 'input_format_allow_errors_num' and 'input_format_allow_errors_ratio' [#CLICKHOUSE-2778]. https://github.com/yandex/ClickHouse/issues/134

* Added test [#CLICKHOUSE-2778].
2017-01-27 08:29:47 +04:00
Vitaliy Lyudvichenko
55390715b1 Add requested changes. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
Vitaliy Lyudvichenko
891437e531 Add docs. Add TEST version of KILL QUERY. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
Vitaliy Lyudvichenko
649fd1922b Add TOO_MUCH_SIMULTANEOUS_QUERIES exception. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
Vitaliy Lyudvichenko
6bd306ca8c Improve KILL QUERY. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
Vitaliy Lyudvichenko
b1bccb0bb2 Query KILL QUERY. [#CLICKHOUSE-2120] 2017-01-27 03:59:39 +04:00
alexey-milovidov
8c0e81f8cb Remove stringstream performance on very short queries (#391)
* Improved performance on very short-response queries [#CLICKHOUSE-2].

* Improved performance on very short-response queries [#CLICKHOUSE-2].

* Improved performance on very short-response queries [#CLICKHOUSE-2].
2017-01-25 05:53:29 +04:00
Vitaliy Lyudvichenko
c9e52a5cf9 Add requested PR changes. [#CLICKHOUSE-2145] [issue #325] 2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
20a5ae4bc4 Add protection from accidental DROP queries. [#CLICKHOUSE-2184] 2017-01-24 22:26:29 +04:00
alexey-milovidov
17a4ead1ef Setting fsync metadata (#380)
* Added setting 'fsync_metadata' [#CLICKHOUSE-2770].

* Added setting 'fsync_metadata' [#CLICKHOUSE-2770].

* Added setting 'fsync_metadata' [#CLICKHOUSE-2770].

* Added setting 'fsync_metadata' [#CLICKHOUSE-2770].
2017-01-23 22:05:07 +04:00
Alexey Milovidov
48ae82e1c7 Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 19:34:17 +03:00
Alexey Milovidov
d8b95e6d2a Sending progress in HTTP headers (continued) [#CLICKHOUSE-32]. 2017-01-22 18:06:04 +03:00
alexey-milovidov
ed5b521110 Less dependencies 2 (#378)
* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].

* Less dependencies [#CLICKHOUSE-2].
2017-01-21 08:24:28 +04:00
Alexey Zatelepin
f5a25c341c translate comments [#CLICKHOUSE-3] 2017-01-19 03:48:59 +04:00
Alexey Zatelepin
5de1975bc4 parse INTO OUTFILE clause [#CLICKHOUSE-2133] 2017-01-19 03:48:59 +04:00
proller
2fe033d00e Fix compiling in freebsd/clang 2017-01-17 18:03:32 +00:00
proller
29475c94c0 Reorganize includes, less depends in .h files 2017-01-16 22:47:11 +03:00
Alexey Milovidov
5c89153e5e Fixed error on clang [#CLICKHOUSE-2]. 2017-01-14 12:11:11 +03:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following:
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
2017-01-14 12:00:19 +03:00
Alexey Milovidov
0440e031c5 Translated comments [#CLICKHOUSE-3]. 2017-01-14 05:53:40 +03:00
Alexey Milovidov
95e9ef2fc4 Reworked InJoinSubqueriesPreprocessor [#METR-2944]. 2017-01-04 05:37:47 +03:00
Alexey Milovidov
4140e7e889 Get out garbage from AST [#METR-2944]. 2017-01-03 10:37:29 +03:00
Alexey Milovidov
1f3aeb066a Renamed methods for bulk binary serialization (continued) [#METR-2944]. 2017-01-03 02:08:09 +03:00
alexey-milovidov
0dd2191c87 Merge branch 'master' into issue-111 2016-12-31 05:53:52 +04:00
Alexey Milovidov
baf29f5c48 NULLs support: fixed totally wrong code [#METR-19266]. 2016-12-30 08:13:14 +03:00
Alexey Milovidov
1a64417044 Added setting "output_format_pretty_max_rows" [#METR-23999]. 2016-12-29 23:15:18 +03:00
artpaul
3f064d9ff7 first dirty implementation of LIMIT BY clause [#METR-23881] 2016-12-28 20:12:54 +05:00
Alexey Milovidov
72888b48ef Printing user name in exception messages about exceeded quota [#METR-19622]. 2016-12-25 07:00:33 +03:00
artpaul
fe9c28ad49 distinct filtration was rewrited with SetVariants [#METR-23882] 2016-12-22 13:51:34 +05:00
artpaul
b160e2a1cf SetVariants was extracted into separated file [#METR-23882] 2016-12-21 17:42:54 +05:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
Alexey Milovidov
54af522de1 Preparation [#METR-2944]. 2016-12-12 10:24:56 +03:00
Alexey Milovidov
e97ecb6cf7 Merge branch 'master' into METR-19266
Conflicts:
	dbms/CMakeLists.txt
	dbms/include/DB/Functions/FunctionsArray.h
	dbms/include/DB/Functions/FunctionsString.h
	dbms/include/DB/Parsers/ExpressionListParsers.h
	dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
	dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
	dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
	dbms/src/Core/ErrorCodes.cpp
	dbms/src/Parsers/ASTFunction.cpp
	dbms/src/Storages/MergeTree/MergeTreeData.cpp
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/MergeTreeReader.cpp
	dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00