Commit Graph

411 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
e2a12d1088 Introduced logic for MergeTree parts states. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Zatelepin
a7c85e0c89 save index_granularity to ATTACH query if it wasn't set explicitly [#CLICKHOUSE-3000] 2017-10-20 21:28:44 +03:00
Alexey Zatelepin
48dea685d0 use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000] 2017-10-20 21:28:41 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
Vitaliy Lyudvichenko
cabf6d7799 Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2] 2017-10-12 22:28:24 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91 serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
Alexey Zatelepin
14ba0a9acf rename partition -> partition_id for clarity [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Alexey Zatelepin
99969ab77a Introduce MergeTreePartitionIndex. Isolate its loading code. [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alexey Zatelepin
f25f0cd759 reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Alexey Milovidov
a48a21f593 Merge branch 'master' into CLICKHOUSE-2896 2017-06-26 11:54:58 +03:00
Alexey Milovidov
28e9e06992 Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091]. 2017-06-25 03:01:10 +03:00
Vitaliy Lyudvichenko
d7db235269 Better names and log messages. [#CLICKHOUSE-2896] 2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0 Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2] 2017-06-22 18:01:08 +03:00
Vitaliy Lyudvichenko
53adb891b3 Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896] 2017-06-22 00:56:38 +03:00
Vitaliy Lyudvichenko
534b766250 CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Alexey Milovidov
38885d00a3 Merge branch 'storage-startup-method' 2017-06-07 02:27:16 +03:00
Alexey Milovidov
0d7d379b44 Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:36:13 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Vitaliy Lyudvichenko
1e4906816c Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023] 2017-06-05 17:25:10 +03:00
Alexey Milovidov
ba499585cd Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6 Small refinements [#CLICKHOUSE-2]. 2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
1a4b0eb355 Remove tmp part directories on server start. [#CLICKHOUSE-3044] 2017-05-31 18:01:25 +03:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Alexey Milovidov
0dd71e32e0 Preparations, part 8 [#CLICKHOUSE-31]. 2017-05-23 23:04:42 +03:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
Yuri Dyachenko
51d2ffc654 fix TODO 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4 support DEDUPLICATE option in OPTIMIZE query 2017-04-17 21:15:14 +03:00
f1yegor
0b243a8b01 translate comments 2017-04-16 23:17:32 +03:00
artpaul
050f1d4b0a drop column from partition for MergeTree 2017-04-15 06:52:04 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]."
This reverts commit 431a735efe.
2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
4f44445ff0 Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//' 2017-03-31 19:00:30 +03:00
Ravengg
a973e3898d Add remove for part log (#638)
* Add REMOVE_PART

* fix

* fix

* fix codestyle
2017-03-28 20:18:49 +03:00
Alexey Milovidov
d3ae1267eb Fixed error when parts of unlimited total size could be selected for merge in case of low free disk space [#CLICKHOUSE-2895]. 2017-03-20 23:29:12 +03:00
Ravengg
b47cc72701 Fix part log (#591)
* fix_part_log

* fixed language back

* add reset part_log back

* reset part_log when don't need more

* Fix header

* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
f1yegor
401425bb89 translate comments 2017-03-12 20:18:07 +01:00
Ravengg
b079dacfd1 Added part_log with statistics scripts (#549)
* Added part_log

* first_test

* filter and hits_res

* Add renamer and drawer

* Add columns database and table into PartLog

* Add normal way to get table_name and database_name from part

* improve drawer

* add stats for random size parts

* Merge converter and drawer

* make drawer more informative

* add new data

* add new data

* new data

* add long range stats

* for checking best way

* Add add_parts script

* Good style for global merge

* delete commented code

* Fixed spaces to tabs

* Note that Stopwatch is started automatically.

* Style

* Update StorageMergeTree.cpp

* Update StorageReplicatedMergeTree.cpp

* Switch act_time_ms to duration_ms

* Added ability to disable part_log

* fixed getPartLog

* fix usage getPartLog

* fix
2017-03-07 21:13:54 +04:00
Alexey Zatelepin
7090d0861a reinitialize primary key after ALTER [#CLICKHOUSE-2853] 2017-02-21 21:32:04 +04:00
Alexey Milovidov
c9b4a163be Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831]. 2017-02-12 01:31:22 +04:00
Alexey Zatelepin
aace171ef6 forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803] 2017-02-10 09:05:33 +04:00
Vitaliy Lyudvichenko
c9e52a5cf9 Add requested PR changes. [#CLICKHOUSE-2145] [issue #325] 2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
20a5ae4bc4 Add protection from accidental DROP queries. [#CLICKHOUSE-2184] 2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
1c38a89785 Add source_part_names column into system.merges. [#CLICKHOUSE-2145] 2017-01-24 22:26:29 +04:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following:
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
2017-01-14 12:00:19 +03:00
Alexey Milovidov
d89ee33ce2 Squashed commit of the following:
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:35:01 2017 +0300

    Style [#METR-2944].

commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:33:11 2017 +0300

    Miscellaneous [#METR-2944].

commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:30:19 2017 +0300

    Miscellaneous [#METR-2944].

commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 20:11:41 2017 +0300

    Miscellaneous [#METR-2944].

commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:56:15 2017 +0300

    Miscellaneous [#METR-2944].

commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:47:52 2017 +0300

    Miscellaneous [#METR-2944].

commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:46:05 2017 +0300

    Miscellaneous [#METR-2944].

commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:39:46 2017 +0300

    Miscellaneous [#METR-2944].

commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:38:03 2017 +0300

    Miscellaneous [#METR-2944].

commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Fri Jan 6 19:34:15 2017 +0300

    Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930]
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e Added memory tracking events and columns for merges. [#METR-23911] 2016-12-31 02:39:53 +03:00
Alexey Milovidov
bba5dcbcfa Fixed deadlock [#METR-23557]. 2016-11-22 22:27:45 +03:00
Alexey Milovidov
e73e4e887a Better logic when there is very large number of parts in non-replicated MergeTree [#METR-22327]. 2016-11-18 05:34:34 +03:00
Alexey Milovidov
b19e61757e Little improvement for large number of small inserts [#METR-22327]. 2016-11-18 04:03:57 +03:00
Alexey Milovidov
74c3b30622 dbms: Simplified logic of selecting merges [#METR-21841]. 2016-10-28 01:50:02 +03:00
Alexey Milovidov
365be3c026 Fixed warning with gcc 6 [#METR-2944]. 2016-09-19 09:24:18 +03:00
Alexey Milovidov
322e5031bd Investigation [#METR-22327]. 2016-09-02 07:03:40 +03:00
alexey-milovidov
012f34a799 Merge pull request #96 from yurial/yurial-IStorage-enable_shared_from_this
use std::enable_shared_from_this for IStorage
2016-08-31 00:00:23 +04:00
Yuri Dyachenko
e5825f790f use std::enable_shared_from_this for IStorage 2016-08-29 16:28:34 +03:00
Alexey Milovidov
867b73b6b0 Fixed error with cancelling merges on ALTERs [#METR-22524]. 2016-08-26 22:50:04 +03:00
Alexey Milovidov
b3b2cd110a Tiny modification [#METR-22327]. 2016-08-13 04:59:09 +03:00
Alexey Milovidov
b51bdbd0c0 Allow to set 'force_restore_data' flag with creating file on local filesystem [#METR-21594], [#METR-17811]. 2016-08-10 00:48:05 +03:00
Alexey Milovidov
cb7a458ac4 Added check [#METR-22325]. 2016-08-07 14:12:55 +03:00
Alexey Milovidov
6f4fc79cde Better [#METR-2944]. 2016-07-31 06:53:16 +03:00
Alexey Milovidov
130ec8b58b Compatibility with new parser and AST of tables list [#METR-2944]. 2016-07-22 23:39:28 +03:00
Alexey Milovidov
5ded454986 Added 'WITH NAME' section to ALTER TABLE ... FREEZE PARTITION query [#METR-21884]. 2016-06-28 23:50:37 +03:00
Alexey Milovidov
47898ae73b Disabled implicit moving to PREWHERE when using FINAL [#METR-20644]. 2016-06-06 21:41:28 +03:00
Alexey Milovidov
8c4abcdd43 Using std::shared_ptr for functions and AST [#METR-21503]. 2016-05-28 18:42:22 +03:00
Alexey Milovidov
3c1c9d46f7 Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 15:22:22 +03:00
Alexey Milovidov
6863e72f3d Using std::shared_ptr for data types [#METR-21503]. 2016-05-28 13:15:36 +03:00
Alexey Milovidov
8f50b30268 Alter primary key: development [#METR-21119]. 2016-05-18 00:07:10 +03:00
Alexey Milovidov
9a60b90941 Alter primary key: development [#METR-21119]. 2016-05-17 23:11:43 +03:00
Alexey Milovidov
d680a7f8da Alter primary key: development [#METR-21119]. 2016-05-17 04:17:32 +03:00
Alexey Milovidov
bf265e264a Alter primary key: development [#METR-21119]. 2016-05-17 02:04:03 +03:00
Alexey Milovidov
2f1fead382 Merge 2016-05-16 21:47:34 +03:00
Alexey Milovidov
093f69c45d Added support for FINAL and PARTITION specification for OPTIMIZE query [#METR-21326]. 2016-05-16 21:43:38 +03:00
Alexey Milovidov
6942819013 Altering primary key [#METR-21119]. 2016-05-14 00:08:19 +03:00
Alexey Milovidov
07f04d70d3 Merge 2016-04-24 12:44:47 +03:00
Alexey Milovidov
3923c7abce Merge 2016-04-15 20:42:51 +03:00
Alexey Milovidov
d79174b2ce Preparation [#METR-20644]. 2016-04-15 20:13:51 +03:00
Alexey Milovidov
e1a80f5ded Added support for case when merged data differs from data on another replicas [#METR-20670]. 2016-03-31 04:25:16 +03:00
Alexey Milovidov
bb122a2fa7 dbms: less locking while clearing old parts; better while loading parts [#METR-2944]. 2016-02-14 14:02:47 +03:00
Alexey Milovidov
67a07205b7 Merge 2016-01-28 04:00:27 +03:00
Alexey Milovidov
5c90d7d45c Merge 2016-01-26 05:00:25 +03:00
Alexey Arno
a3ea32b985 Merge 2016-01-21 19:30:05 +03:00
Alexey Milovidov
13c7d0983a dbms: cutting dependency [#METR-2944].. 2016-01-12 00:46:36 +03:00
Alexey Milovidov
f1f3619df4 dbms: cancelling fetching of parts on table shutdown [#METR-19544]. 2015-12-25 00:28:18 +03:00