Alexey Milovidov
275a1d4651
Improvement [#CLICKHOUSE-3091].
2017-06-25 05:48:38 +03:00
Alexey Milovidov
516b095423
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-25 04:54:25 +03:00
Alexey Milovidov
8228acd3ea
Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091].
2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b
Fixed translation errors [#CLICKHOUSE-3091].
2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992
Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091].
2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5
Removed unused variable [#CLICKHOUSE-2].
2017-06-25 01:36:43 +03:00
proller
4db8d09de9
Reorganize includes. part 1 ( #921 )
...
* Make libunwind optional. Allow use custom libcctz
* fix
* Fix
* fix
* Update BaseDaemon.cpp
* Update CMakeLists.txt
* Reorganize includes. part 1
* Update dbms_include.cmake
* Reorganize includes. part 2
* Reorganize includes. part 3
* dbms/src/Common/ThreadPool -> libs/libcommon
* Reorganize includes. part 4
* Fix print_include_directories
* Update thread_creation_latency.cpp
* Update StringRef.h
2017-06-23 23:22:35 +03:00
Alexey Milovidov
f409cad0ac
Miscellaneous [#CLICKHOUSE-3091].
2017-06-23 09:18:00 +03:00
Alexey Milovidov
7d732343eb
Fixed error in prev. revision [#CLICKHOUSE-3091].
2017-06-22 22:52:06 +03:00
Alexey Milovidov
22e7070fb0
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-22 19:07:57 +03:00
Alexey Milovidov
bb7fc04e2b
Whitespaces [#CLICKHOUSE-2].
2017-06-22 19:07:52 +03:00
Vitaliy Lyudvichenko
d7db235269
Better names and log messages. [#CLICKHOUSE-2896]
2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0
Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2]
2017-06-22 18:01:08 +03:00
proller
51b41aa0e3
Fix build
2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko
eff3588f28
Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896]
2017-06-22 16:18:19 +03:00
Alexey Milovidov
db546dc827
Caching parts that cannot be merged for some time [#CLICKHOUSE-3091].
2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko
53adb891b3
Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896]
2017-06-22 00:56:38 +03:00
Alexey Milovidov
5c322f5756
Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076].
2017-06-21 22:07:08 +03:00
Vitaliy Lyudvichenko
a098fb170a
Avoid creating multiple global Context. [#CLICKHOUSE-3083]
2017-06-20 10:49:18 +03:00
Alexey Milovidov
05accbdcbe
Removed cyclic dependency [#DEVTOOLS-3381].
2017-06-19 23:06:35 +03:00
Alexey Milovidov
43fedfecea
Get rid of INSERT ID [#CLICKHOUSE-31].
2017-06-13 07:13:20 +03:00
Alexey Milovidov
38885d00a3
Merge branch 'storage-startup-method'
2017-06-07 02:27:16 +03:00
Alexey Milovidov
9c5ddce06d
Get rid of .hpp files [#CLICKHOUSE-2].
2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f
Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2].
2017-06-06 20:06:14 +03:00
Vitaliy Lyudvichenko
1e4906816c
Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023]
2017-06-05 17:25:10 +03:00
alexey-milovidov
147b2f62b2
Update StorageReplicatedMergeTree.cpp
2017-06-02 20:02:59 +04:00
Vitaliy Lyudvichenko
6bddd4c1c5
Clean incomplete part nodes in ZooKeeper. [#CLICKHOUSE-3040]
2017-06-02 20:02:59 +04:00
Alexey Milovidov
ba499585cd
Merge branch 'master' of github.com:yandex/ClickHouse
2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6
Small refinements [#CLICKHOUSE-2].
2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
1a4b0eb355
Remove tmp part directories on server start. [#CLICKHOUSE-3044]
2017-05-31 18:01:25 +03:00
alexey-milovidov
72822714c3
Merge branch 'master' into CLICKHOUSE-2989
2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9
Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
...
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Milovidov
a77369d082
Preparation: Storages do not modify query [#CLICKHOUSE-31].
2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4
Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31].
2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097
Preparation: untangling [#CLICKHOUSE-31].
2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko
d9637c2980
MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
...
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Alexey Milovidov
0f252046ca
Preparations [#CLICKHOUSE-2]
2017-05-22 01:25:25 +03:00
Alexey Zatelepin
9c6829e982
Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141]
2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
1d00f45dd3
Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989]
2017-05-17 21:44:16 +04:00
Vitaliy Lyudvichenko
6262fc8650
Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2]
2017-05-15 10:34:40 +04:00
Alexey Milovidov
ee6a7ee204
Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960].
2017-04-20 21:37:01 +03:00
alexey-milovidov
512d86ceaf
Merge pull request #706 from yandex/lagging-replicas-failover
...
Check for stale replicas when performing distributed queries
2017-04-20 21:30:02 +03:00
Alexey Milovidov
2d3e09af82
Fixed error [#CLICKHOUSE-2960].
2017-04-20 05:22:17 +03:00
Alexey Zatelepin
ba254a082e
Merge branch 'master' into lagging-replicas-failover
...
Conflicts:
dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Milovidov
47d2ca4136
Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960].
2017-04-18 23:36:19 +03:00
Yuri Dyachenko
8fb2b7ee3d
fix zookeeper format version 4
2017-04-17 21:15:14 +03:00
alexey-milovidov
5a8344382b
Update StorageReplicatedMergeTree.cpp
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8792c4f3ca
add 'deduplicate' flag into zookeeper 'merge' Entry
2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4
support DEDUPLICATE option in OPTIMIZE query
2017-04-17 21:15:14 +03:00
Alexey Zatelepin
2bd089d589
start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141]
2017-04-17 18:06:12 +03:00
f1yegor
0b243a8b01
translate comments
2017-04-16 23:17:32 +03:00
proller
1bc311eefd
ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] ( #656 )
...
* ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878]
* fix
* better messages on client
* change code to 429 TOO_MANY_REQUESTS
* wip
* better message
* Update InterserverIOHandler.h
* Update InterserverIOHTTPHandler.cpp
* Update StorageReplicatedMergeTree.cpp
2017-04-06 16:03:23 +03:00
Alexey Milovidov
310736cd7e
Moved headers and sources to same place [#CLICKHOUSE-3].
2017-04-01 12:22:42 +03:00
Alexey Milovidov
137ad95929
Changed tabs to spaces in code [#CLICKHOUSE-3].
2017-04-01 11:35:09 +03:00
Alexey Milovidov
4423420c20
Merge branch 'master' of github.com:yandex/ClickHouse
2017-03-31 19:00:42 +03:00
Alexey Milovidov
4f44445ff0
Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//'
2017-03-31 19:00:30 +03:00
proller
fbdcab343f
Limit fetching threads [#CLICKHOUSE-2878] ( #648 )
...
* Max parallel fetches limit
* use MergeTreeSettings.h
* clean
2017-03-31 17:46:48 +03:00
Ravengg
a973e3898d
Add remove for part log ( #638 )
...
* Add REMOVE_PART
* fix
* fix
* fix codestyle
2017-03-28 20:18:49 +03:00
Alexey Milovidov
d3ae1267eb
Fixed error when parts of unlimited total size could be selected for merge in case of low free disk space [#CLICKHOUSE-2895].
2017-03-20 23:29:12 +03:00
Bogdan Voronin
a3ff193fe3
Add log merge for replicas
2017-03-16 00:23:02 +04:00
Ravengg
b47cc72701
Fix part log ( #591 )
...
* fix_part_log
* fixed language back
* add reset part_log back
* reset part_log when don't need more
* Fix header
* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
26788e3938
Formatting [#CLICKHOUSE-2].
2017-03-13 21:01:46 +03:00
f1yegor
401425bb89
translate comments
2017-03-12 20:18:07 +01:00
Ravengg
b079dacfd1
Added part_log with statistics scripts ( #549 )
...
* Added part_log
* first_test
* filter and hits_res
* Add renamer and drawer
* Add columns database and table into PartLog
* Add normal way to get table_name and database_name from part
* improve drawer
* add stats for random size parts
* Merge converter and drawer
* make drawer more informative
* add new data
* add new data
* new data
* add long range stats
* for checking best way
* Add add_parts script
* Good style for global merge
* delete commented code
* Fixed spaces to tabs
* Note that Stopwatch is started automatically.
* Style
* Update StorageMergeTree.cpp
* Update StorageReplicatedMergeTree.cpp
* Switch act_time_ms to duration_ms
* Added ability to disable part_log
* fixed getPartLog
* fix usage getPartLog
* fix
2017-03-07 21:13:54 +04:00
proller
05e87ad7a2
fix scope_exit formatting
2017-03-04 00:10:41 +03:00
Alexey Milovidov
c9b4a163be
Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831].
2017-02-12 01:31:22 +04:00
Alexey Milovidov
d065087506
Fixed timeouts of ALTER [#CLICKHOUSE-2836].
2017-02-10 21:09:49 +03:00
Alexey Zatelepin
aace171ef6
forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803]
2017-02-10 09:05:33 +04:00
Vitaliy Lyudvichenko
c9e52a5cf9
Add requested PR changes. [#CLICKHOUSE-2145] [issue #325 ]
2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
20a5ae4bc4
Add protection from accidental DROP queries. [#CLICKHOUSE-2184]
2017-01-24 22:26:29 +04:00
Vitaliy Lyudvichenko
1c38a89785
Add source_part_names column into system.merges. [#CLICKHOUSE-2145]
2017-01-24 22:26:29 +04:00
Alexey Milovidov
58e5dad1a1
Squashed commit of the following:
...
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:59:13 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:58:30 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:55:14 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:54:22 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:47:34 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:40:09 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:22:49 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:18:17 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:17:06 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:16:28 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:15:42 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:13:35 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:11:18 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:09:04 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:06:30 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:05:44 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:04:53 2017 +0300
Less dependencies [#CLICKHOUSE-2]
commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Sat Jan 14 11:01:47 2017 +0300
Less dependencies [#CLICKHOUSE-2]
2017-01-14 12:00:19 +03:00
Alexey Milovidov
d89ee33ce2
Squashed commit of the following:
...
commit c567d4e1fe
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 20:35:01 2017 +0300
Style [#METR-2944].
commit 26bf3e1228
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 20:33:11 2017 +0300
Miscellaneous [#METR-2944].
commit eb946f4c6f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 20:30:19 2017 +0300
Miscellaneous [#METR-2944].
commit 78c867a147
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 20:11:41 2017 +0300
Miscellaneous [#METR-2944].
commit 6604c5c83c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:56:15 2017 +0300
Miscellaneous [#METR-2944].
commit 23fbf05c1d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:47:52 2017 +0300
Miscellaneous [#METR-2944].
commit 98772faf11
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:46:05 2017 +0300
Miscellaneous [#METR-2944].
commit 3dc636ab9f
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:39:46 2017 +0300
Miscellaneous [#METR-2944].
commit 3e16aee954
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:38:03 2017 +0300
Miscellaneous [#METR-2944].
commit ae7e7e90eb
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date: Fri Jan 6 19:34:15 2017 +0300
Miscellaneous [#METR-2944].
2017-01-06 20:41:19 +03:00
Vitaliy Lyudvichenko
07d720565c
Added profile events for INSERTs. [#METR-23930]
...
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e
Added memory tracking events and columns for merges. [#METR-23911]
2016-12-31 02:39:53 +03:00
Vladimir Chebotarev
d172cb1fc2
StorageReplicatedMergeTree: Correct taking /quorum/last_part into account when merging. [#METR-23826]
2016-12-15 17:32:47 +03:00
Alexey Milovidov
54af522de1
Preparation [#METR-2944].
2016-12-12 10:24:56 +03:00
Alexey Milovidov
d5a002f441
Using internal boost library [#METR-2944].
2016-12-12 07:57:55 +03:00
Alexey Milovidov
d605bfdc9d
Using internal boost library [#METR-2944].
2016-12-12 07:57:09 +03:00
Alexey Milovidov
e97ecb6cf7
Merge branch 'master' into METR-19266
...
Conflicts:
dbms/CMakeLists.txt
dbms/include/DB/Functions/FunctionsArray.h
dbms/include/DB/Functions/FunctionsString.h
dbms/include/DB/Parsers/ExpressionListParsers.h
dbms/include/DB/Storages/MergeTree/MergeTreeBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergeTreeReader.h
dbms/include/DB/Storages/MergeTree/MergeTreeThreadBlockInputStream.h
dbms/include/DB/Storages/MergeTree/MergedBlockOutputStream.h
dbms/src/Core/ErrorCodes.cpp
dbms/src/Parsers/ASTFunction.cpp
dbms/src/Storages/MergeTree/MergeTreeData.cpp
dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
dbms/src/Storages/MergeTree/MergeTreeReader.cpp
dbms/src/Storages/StorageLog.cpp
2016-12-10 07:51:36 +03:00
proller
26fe10a7b4
Merge remote-tracking branch 'upstream/master' into METR-23466
2016-11-25 03:22:30 +03:00
Alexey Milovidov
7d280a55a3
Fixed error that server could not shutdown while fetching parts [#METR-23616].
2016-11-25 02:18:24 +03:00
Alexey Milovidov
167782c230
Addition to prev. revision [#METR-23615].
2016-11-25 01:43:49 +03:00
Alexey Milovidov
8e5889cf0e
Improved merge selecting algorithm for Replicated tables [#METR-23615].
2016-11-25 01:41:27 +03:00
proller
eeeacd0805
merge upstream
2016-11-23 01:33:02 +03:00
Alexey Milovidov
bba5dcbcfa
Fixed deadlock [#METR-23557].
2016-11-22 22:27:45 +03:00
Alexey Milovidov
3b635bf641
Merge branch 'master' of github.com:yandex/ClickHouse
2016-11-22 20:42:21 +03:00
Alexey Milovidov
a464f2303d
Better logic for ALTER in ReplicatedMergeTree [#METR-22214].
2016-11-22 20:41:45 +03:00
proller
e280569453
Everything [maybe] works!
2016-11-22 18:03:54 +03:00
Alexey Milovidov
9018906e1a
Better [#METR-2944].
2016-11-20 15:43:20 +03:00
Alexey Milovidov
866e64a65e
Fixed deadlock in test when many replicas on single server try to execute multiple attaches and wait for each other [#METR-23507].
2016-11-16 09:08:29 +03:00
Alexey Milovidov
5b72f0956a
Setting level to zero after ATTACH [#METR-23438].
2016-11-11 20:33:43 +03:00
Alexey Milovidov
bee00bfcfc
MergeSelector: development [#METR-21841].
2016-10-30 14:05:45 +03:00
Alexey Milovidov
74c3b30622
dbms: Simplified logic of selecting merges [#METR-21841].
2016-10-28 01:50:02 +03:00
Alexey Milovidov
2dd43be6e6
Don't hold shared_ptr to zookeeper for long time, because it makes very difficult to remove ephemeral nodes in case of temporary communication errors and thus breaks leader election [#METR-23272].
2016-10-24 15:34:08 +03:00
Alexey Milovidov
9af5ce1e3b
Separate compilation of ProfileEvents; comments [#METR-23237].
2016-10-24 05:02:37 +03:00
Alexey Arno
924402f33e
dbms: Server: merged from master [#METR-19266]
2016-10-19 18:00:56 +03:00
Vitaliy Lyudvichenko
669e2982a5
Made merge_selecting_thread creation & deletion atomic. [#METR-22471]
2016-10-14 14:47:11 +03:00
Vitaliy Lyudvichenko
aa863ea7bb
Fixed std::terminate on DROP of StorageReplicatedMergeTree. [#METR-22471]
2016-10-14 13:17:05 +03:00
Alexey Milovidov
6b2755bf2a
Non significant change [#METR-2944].
2016-09-23 23:33:06 +03:00