Commit Graph

2098 Commits

Author SHA1 Message Date
Alexey Milovidov
275a1d4651 Improvement [#CLICKHOUSE-3091]. 2017-06-25 05:48:38 +03:00
Alexey Milovidov
90a1ae1062 Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-25 05:22:10 +03:00
Alexey Milovidov
516b095423 Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-25 04:54:25 +03:00
Alexey Milovidov
8228acd3ea Removed obsolete code that was relevant only in extremely rare case of transforming CollapsingMergeTree to ReplicatedCollapsingMergeTree through ATTACHing data parts and while some considerations about data order in table is important [#CLICKHOUSE-3091]. 2017-06-25 03:51:51 +03:00
Alexey Milovidov
3c660fd65b Fixed translation errors [#CLICKHOUSE-3091]. 2017-06-25 03:17:08 +03:00
Alexey Milovidov
28e9e06992 Preparation: locking block number only after write to filesystem; removed obsolete code [#CLICKHOUSE-3091]. 2017-06-25 03:01:10 +03:00
Alexey Milovidov
c7f35997f5 Removed unused variable [#CLICKHOUSE-2]. 2017-06-25 01:36:43 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921)
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
2017-06-23 23:22:35 +03:00
Nikolai Kochetov
adb632319d DatabaseDictionary creates new storage for every create table query; drop table works untill restart 2017-06-23 18:55:45 +03:00
Alexey Milovidov
061c214c16 Fixed error [#CLICKHOUSE-3074]. 2017-06-23 09:57:55 +03:00
Alexey Milovidov
f409cad0ac Miscellaneous [#CLICKHOUSE-3091]. 2017-06-23 09:18:00 +03:00
Alexey Milovidov
7d732343eb Fixed error in prev. revision [#CLICKHOUSE-3091]. 2017-06-22 22:52:06 +03:00
Alexey Milovidov
425156e32c Raised up limit on max size of parts to merge [#CLICKHOUSE-3091]. 2017-06-22 21:29:40 +03:00
Alexey Milovidov
6eb06774d3 Addition to prev. revision [#CLICKHOUSE-3091]. 2017-06-22 19:29:15 +03:00
Alexey Milovidov
c96719685c Lowered max_delay_to_insert to one second, because higher values are non practical and could be harmful for usual failover logic in client apps [#CLICKHOUSE-3091]. 2017-06-22 19:17:01 +03:00
Alexey Milovidov
941c281221 Updated comment [#CLICKHOUSE-3091]. 2017-06-22 19:09:03 +03:00
Alexey Milovidov
22e7070fb0 Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-22 19:07:57 +03:00
Alexey Milovidov
bb7fc04e2b Whitespaces [#CLICKHOUSE-2]. 2017-06-22 19:07:52 +03:00
Nikolai Kochetov
4c114bc3a1 added DatabaseDictionary 2017-06-22 18:44:19 +03:00
Vitaliy Lyudvichenko
d7db235269 Better names and log messages. [#CLICKHOUSE-2896] 2017-06-22 18:32:09 +03:00
Vitaliy Lyudvichenko
99f502d5e0 Support OPTIMIZE query on non-leader replica. [#CLICKHOUSE-2] 2017-06-22 18:01:08 +03:00
proller
51b41aa0e3 Fix build 2017-06-22 17:14:13 +03:00
Vitaliy Lyudvichenko
eff3588f28 Rename DROP COLUMN FROM PARTITION -> CLEAR COLUMN IN PARTITION. [#CLICKHOUSE-2896] 2017-06-22 16:18:19 +03:00
Alexey Milovidov
4af5a9c7ba Merge branch 'cache_parts_that_cannot_be_merged' 2017-06-22 03:56:44 +03:00
Alexey Milovidov
946c275dfb Added missing case for broken files in StorageDistributed [#CLICKHOUSE-3091]. 2017-06-22 03:56:17 +03:00
Alexey Milovidov
db546dc827 Caching parts that cannot be merged for some time [#CLICKHOUSE-3091]. 2017-06-22 03:28:44 +03:00
Vitaliy Lyudvichenko
53adb891b3 Add replicated DROP COLUMN FROM partition for optimistic case. [#CLICKHOUSE-2896] 2017-06-22 00:56:38 +03:00
Alexey Milovidov
7bdc87adf0 Loosened threshold on broken parts in filesystem [#CLICKHOUSE-3076]. 2017-06-21 22:11:11 +03:00
Alexey Milovidov
5c322f5756 Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076]. 2017-06-21 22:07:08 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Vitaliy Lyudvichenko
534b766250 CREATE of MergeTree checks that data dir is empty. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Vitaliy Lyudvichenko
a098fb170a Avoid creating multiple global Context. [#CLICKHOUSE-3083] 2017-06-20 10:49:18 +03:00
Георгий Кондратьев
47161f8425 Specify all link dependencies [#DEVTOOLS-3381]
Tested with:

export LDFLAGS="-Wl,--no-undefined"
cmake -DUSE_STATIC_LIBRARIES=OFF -DBUILD_SHARED_LIBS=ON
2017-06-20 00:53:12 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Alexey Milovidov
401d922a4b Tiny modifications [#CLICKHOUSE-3044]. 2017-06-18 09:11:49 +03:00
Alexey Milovidov
d64f2beaf8 Fixed build [#CLICKHOUSE-3044]. 2017-06-18 08:43:29 +03:00
Alexey Zatelepin
3c6b278b3d fix infinite recursion in StorageMerge::isRemote() [#CLICKHOUSE-2911] 2017-06-16 19:19:15 +03:00
Alex Zatelepin
4cd9df27ab fix infinite loop in StorageMerge::isRemote() [#CLICKHOUSE-2911] 2017-06-16 03:21:00 +03:00
alexey-milovidov
43a18b164d Merge pull request #883 from yandex/fix-merge-global-in
Fix GLOBAL IN for Merge table over Distributed tables
2017-06-15 23:09:51 +03:00
Alexey Zatelepin
8ee85e6440 calculate isRemote() from underlying tables of StorageMerge [#CLICKHOUSE-2911] 2017-06-15 22:24:59 +03:00
Vitaliy Lyudvichenko
63ac609e8b Avoid overestimation of avg. column element size. [#CLICKHOUSE-3058] 2017-06-15 20:33:03 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
alexey-milovidov
e03ae570f7 Merge pull request #763 from yandex/storage-dictionary
Storage dictionary
2017-06-13 07:20:46 +03:00
Vitaliy Lyudvichenko
49eab81d9a Fix: ReshardingWorker doesn't finish if ZooKeeper session expired. [#CLICKHOUSE-2] 2017-06-13 07:15:25 +03:00
Alexey Milovidov
43fedfecea Get rid of INSERT ID [#CLICKHOUSE-31]. 2017-06-13 07:13:20 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
d5ca92093a Fixed comment [#CLICKHOUSE-2]. 2017-06-10 08:30:07 +03:00
Nikolai Kochetov
679cccc52d renamed *.hpp to *.h in DictionaryBlickInputStream 2017-06-08 16:35:35 +03:00
Nikolai Kochetov
bff77d1bae merged with master 2017-06-08 15:00:11 +03:00
Alexey Milovidov
38885d00a3 Merge branch 'storage-startup-method' 2017-06-07 02:27:16 +03:00
Alexey Milovidov
dc0d5b604f Addition to prev. revision [#CLICKHOUSE-2]. 2017-06-06 22:06:44 +03:00
Alexey Milovidov
50b84fcc9d Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:48:38 +03:00
Alexey Milovidov
0d7d379b44 Removed duplicate code [#CLICKHOUSE-2]. 2017-06-06 21:36:13 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
153693cd4c Non significant modifications [#CLICKHOUSE-3]. 2017-06-05 23:43:23 +03:00
Vitaliy Lyudvichenko
1e4906816c Avoid SIGSEGV in SystemLog destructors. [#CLICKHOUSE-3023] 2017-06-05 17:25:10 +03:00
Alexey Milovidov
8fb0afe74e Fixed build of tests [#CLICKHOUSE-2]. 2017-06-02 22:35:37 +03:00
alexey-milovidov
147b2f62b2 Update StorageReplicatedMergeTree.cpp 2017-06-02 20:02:59 +04:00
alexey-milovidov
12e6024abd Update StorageReplicatedMergeTree.h 2017-06-02 20:02:59 +04:00
Vitaliy Lyudvichenko
6bddd4c1c5 Clean incomplete part nodes in ZooKeeper. [#CLICKHOUSE-3040] 2017-06-02 20:02:59 +04:00
Alexey Milovidov
ba499585cd Merge branch 'master' of github.com:yandex/ClickHouse 2017-06-02 18:54:43 +03:00
Alexey Milovidov
80080f1ad6 Small refinements [#CLICKHOUSE-2]. 2017-06-02 18:54:39 +03:00
Vitaliy Lyudvichenko
3a2c1a195d Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
9fd8d6b79f Add ALTER queries. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Nikolai Kochetov
d606436023 using MergeTreeDataPartChecksums to calculate marks_size in system.parts 2017-05-31 20:54:40 +04:00
Nikolai Kochetov
c58e98b607 added marks_size column in system.parts 2017-05-31 20:54:40 +04:00
Vitaliy Lyudvichenko
1a4b0eb355 Remove tmp part directories on server start. [#CLICKHOUSE-3044] 2017-05-31 18:01:25 +03:00
Nikolai Kochetov
7c736b12ef added raw serialization functions for IColumn; changed key serialization in ComplexKeyCacheDictionary; style fixes 2017-05-29 20:26:45 +03:00
Nikolai Kochetov
787bf12572 merged with master 2017-05-29 20:23:14 +03:00
Alexey Milovidov
fa64d14f26 More readable temporary part names [#CLICKHOUSE-2]. 2017-05-26 03:47:06 +03:00
Alexey Milovidov
ed44304c49 Removed obsolete commented code [#CLICKHOUSE-2]. 2017-05-26 03:43:35 +03:00
alexey-milovidov
c79ebc586d Merge pull request #825 from yandex/CLICKHOUSE-2989
Separate dirs for different part sources, fix RC during replicated alters
2017-05-26 04:42:03 +04:00
Alexey Milovidov
d35a586af2 Fixed deadlock when using executable dictionary source with cache or complex_key_cache layout [#CLICKHOUSE-3039]. 2017-05-25 23:59:14 +03:00
alexey-milovidov
72822714c3 Merge branch 'master' into CLICKHOUSE-2989 2017-05-25 21:04:37 +04:00
Vitaliy Lyudvichenko
1e29795cf9 Fix race condition between cleanup and fetch thread. [#CLICKHOUSE-2989]
It was happening during ALTERs.
TODO: stop fetches during ALTER.
2017-05-25 13:08:52 +03:00
Alexey Zatelepin
e9f8f99e06 Correct index comparisons in case constants cannot be precisely casted [#CLICKHOUSE-3002] 2017-05-25 05:34:26 +04:00
Alexey Milovidov
a77369d082 Preparation: Storages do not modify query [#CLICKHOUSE-31]. 2017-05-25 04:12:41 +03:00
Alexey Milovidov
557c3dc7f4 Preparation: removed support for unreplicated data in Replicated tables [#CLICKHOUSE-31]. 2017-05-25 00:38:56 +03:00
Alexey Milovidov
48f65e9097 Preparation: untangling [#CLICKHOUSE-31]. 2017-05-25 00:06:29 +03:00
Vitaliy Lyudvichenko
d9637c2980 MergeTreeDataPart refactoring. [#CLICKHOUSE-2989]
Use relative_path to store actual part path.
Use renameTo() to move parts.
2017-05-24 23:23:58 +03:00
Vitaliy Lyudvichenko
5618234ee8 Separate tmp part dirs for merges, fetches and inserts. [#CLICKHOUSE-2989] 2017-05-24 23:23:58 +03:00
Alexey Milovidov
8d570e2768 Renamed column "default_type" to "default_kind" in system.columns table to avoid ambiguity [#CLICKHOUSE-2]. 2017-05-24 22:54:25 +03:00
Alexey Milovidov
0dd71e32e0 Preparations, part 8 [#CLICKHOUSE-31]. 2017-05-23 23:04:42 +03:00
Alexey Milovidov
2b20eca06b Preparations, part 4: StorageDistributed is initialized with const Context [#CLICKHOUSE-31]. 2017-05-23 21:37:14 +03:00
Alexey Milovidov
ce581bbf35 Preparations, part 3 [#CLICKHOUSE-31]. 2017-05-23 21:33:48 +03:00
Nikolai Kochetov
45c1beca2a Merge branch 'master' into storage-dictionary 2017-05-23 13:44:03 +03:00
Alexey Milovidov
0c416be381 More simple code; fixed translation error [#CLICKHOUSE-2]. 2017-05-23 04:09:47 +03:00
Alexey Milovidov
734b240490 TrivialBuffer: fixed build after merge [#CLICKHOUSE-2929]. 2017-05-22 19:46:33 +03:00
Alexander Makarov
55bfaca662 StorageTrivialBuffer: added support for the replication [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
fdd636a785 fixup #2: comments on English, proper classname, StorageFactory update and merging in 'flush' method without lock [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexander Makarov
f8e19de0e3 fixups after review [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
alexey-milovidov
90e1767387 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
2fdb7057ba Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
10f188708b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
84040d8a85 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
1059c87828 Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
3d009d153d Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
alexey-milovidov
4cb799307b Update TrivialBuffer.h 2017-05-22 18:40:11 +04:00
alexey-milovidov
fd1403d4c4 Update TrivialBuffer.cpp 2017-05-22 18:40:11 +04:00
Alexander Makarov
dfabe90373 TrivialBuffer implementation [#CLICKHOUSE-2929] 2017-05-22 18:40:11 +04:00
Alexey Milovidov
0f252046ca Preparations [#CLICKHOUSE-2] 2017-05-22 01:25:25 +03:00
Vitaliy Lyudvichenko
45c1856556 Fix wrong implementation of CastTypeBlockInputStream (#807)
* Fix wrong implementation of CastTypeBlockInputStream. [#CLICKHOUSE-2957]

* Fix typos and add comments. [#CLICKHOUSE-2957]
2017-05-20 18:47:40 +04:00
Alexey Zatelepin
9c6829e982 Fix replica delay counting in case of ZooKeeper communication problems [#CLICKHOUSE-2141] 2017-05-20 17:32:00 +04:00
Vitaliy Lyudvichenko
bbe2a656cd Fixed preferred_block_size_bytes in case of PREWHERE with non-materialized column. [#METR-25237] 2017-05-20 17:30:59 +04:00
Vitaliy Lyudvichenko
1d00f45dd3 Detect race condition between fetches and merges of the same part. [#CLICKHOUSE-2989] 2017-05-17 21:44:16 +04:00
Nikolai Kochetov
16256503ec merged with master 2017-05-16 13:03:06 +03:00
Nikolai Kochetov
427c020140 deleted dictionary ptr from StorageDictionary 2017-05-15 16:58:40 +03:00
alexey-milovidov
e7b7f6f73d Update MergeTreeData.cpp 2017-05-15 10:34:40 +04:00
Vitaliy Lyudvichenko
6262fc8650 Fix inccorect columns size in MergeTreeData after ALTER. [#CLICKHOUSE-2] 2017-05-15 10:34:40 +04:00
f1yegor
c252863b2e translate comments 2017-05-14 19:03:55 +04:00
Alexey Milovidov
282a395464 Fixed test [#CLICKHOUSE-2]. 2017-05-13 00:03:01 +03:00
Alexey Milovidov
3819216085 StorageBuffer: explicitly disable support for PREWHERE, because possibility of wrong query results [#CLICKHOUSE-2999]. 2017-05-12 17:02:24 +03:00
Vitaliy Lyudvichenko
021e37943e More clearer code and correct test. [#CLICKHOUSE-1993] 2017-05-12 16:44:11 +03:00
Vitaliy Lyudvichenko
0f1627691e Don't forget to ATTACH MATERIALIZED columns. [#CLICKHOUSE-1993] 2017-05-11 18:39:12 +04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
acfe3d5028 Improved performance of inserting into StorageDistributed with very high number of shards (not tested) [#CLICKHOUSE-2]. 2017-05-10 02:39:37 -04:00
Alexey Milovidov
27a324b469 Tiny modifications [#CLICKHOUSE-2]. 2017-05-10 00:29:36 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
proller
fac00792f9 Move most AggregateFunctions to separate lib, use AggregateFunctionFactory as singletone, rename lib storages_system->clickhouse_storages_system 2017-05-05 16:59:18 -07:00
proller
6c34f27e3b Another freebsd fix, update freebsd build doc 2017-05-05 03:23:32 +03:00
Nikolai Kochetov
1604ce138a changed key storage format for complex key dictionaries 2017-05-04 21:14:23 +03:00
proller
0787bd66ff Merge: fail if cant convert columns (#753)
* Merge: fail if cant convert columns

* Merge: convert all different types, more tests

* clean

* clean

* clean
2017-05-03 21:08:59 -07:00
alexey-milovidov
fb01ef0132 Update StorageMerge.cpp 2017-04-29 06:37:38 +03:00
proller
b2e2233a59 rename CastEnumBlockInputStream -> CastTypeBlockInputStream 2017-04-29 06:37:38 +03:00
proller
7a0854775b Merge: Cast types on read [#CLICKHOUSE-2957] 2017-04-29 06:37:38 +03:00
Alexey Milovidov
e0b141e3eb Do not remove temporary directory on fetch [#CLICKHOUSE-2894]. 2017-04-29 01:26:39 +03:00
Vitaliy Lyudvichenko
42fcf148e2 Add column rows to system.parts table. [#CLICKHOUSE-2950] 2017-04-28 23:54:24 +03:00
Nikolai Kochetov
79564054a9 added RangeDictionaryBlockInputStream 2017-04-28 21:33:31 +03:00
Nikolai Kochetov
9243439e9b added DictionaryBlockInputStream 2017-04-27 20:16:24 +03:00
proller
bcb230ebc6 Fix incudes, move code from daemon/OwnPatternFormatter.h 2017-04-27 08:40:27 +03:00
Nikolai Kochetov
bdf998d20f added StorageDictionary 2017-04-25 12:10:27 +03:00
Alexey Milovidov
6f65176285 Explicitly disallow dummy data types and special Null data type to be in table declaration [#CLICKHOUSE-4]. 2017-04-23 10:59:49 +03:00
proller
8cf716fa29 Functions as separate lib 2017-04-21 21:30:16 +03:00
Alexey Milovidov
110defd56f Disabled replicated max parallel fetches/sends, because it does not work properly [#CLICKHOUSE-2960]. 2017-04-20 21:38:17 +03:00
Alexey Milovidov
ee6a7ee204 Allow to disable replicated max parallel fetches/sends [#CLICKHOUSE-2960]. 2017-04-20 21:37:01 +03:00
alexey-milovidov
512d86ceaf Merge pull request #706 from yandex/lagging-replicas-failover
Check for stale replicas when performing distributed queries
2017-04-20 21:30:02 +03:00
Alexey Milovidov
2d3e09af82 Fixed error [#CLICKHOUSE-2960]. 2017-04-20 05:22:17 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
2017-04-19 21:31:29 +03:00
Alexey Zatelepin
485c58b039 use only ConnectionPoolWithFailover in RemoteBlockInputStream [#CLICKHOUSE-2141] 2017-04-19 20:50:17 +03:00
Alexey Milovidov
0b5645db1a Better code for parsing part names [#CLICKHOUSE-2]. 2017-04-18 23:38:07 +03:00
Alexey Milovidov
47d2ca4136 Fixed error with fetches and sends limit when queue is traversed without pause [#CLICKHOUSE-2960]. 2017-04-18 23:36:19 +03:00
Alexey Milovidov
502f42a572 Fixed translation error [#CLICKHOUSE-3]. 2017-04-18 22:13:12 +03:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
Yuri Dyachenko
51d2ffc654 fix TODO 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8fb2b7ee3d fix zookeeper format version 4 2017-04-17 21:15:14 +03:00
alexey-milovidov
5a8344382b Update StorageReplicatedMergeTree.cpp 2017-04-17 21:15:14 +03:00
alexey-milovidov
9d3e3675fd Update ReplicatedMergeTreeLogEntry.h 2017-04-17 21:15:14 +03:00
alexey-milovidov
acd3c3d4ab Update MergeTreeDataMerger.cpp 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
8792c4f3ca add 'deduplicate' flag into zookeeper 'merge' Entry 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
10082f3ef4 support DEDUPLICATE option in OPTIMIZE query 2017-04-17 21:15:14 +03:00
Yuri Dyachenko
5e61448f25 add support DEDUPLICATE to MergeTreeDataMerger 2017-04-17 21:15:14 +03:00
Alexey Zatelepin
2bd089d589 start counting absolute replica delay when there are problems with queue update [#CLICKHOUSE-2141] 2017-04-17 18:06:12 +03:00
f1yegor
0b243a8b01 translate comments 2017-04-16 23:17:32 +03:00
Alexey Milovidov
676192f16e Fixed errors on clang [#CLICKHOUSE-2902]. 2017-04-15 07:03:12 +03:00
artpaul
050f1d4b0a drop column from partition for MergeTree 2017-04-15 06:52:04 +03:00
alexey-milovidov
7fcf570c43 Update MergeTreeDataPart.cpp 2017-04-15 06:48:24 +03:00
alexey-milovidov
5a7a155ca1 Update MergeTreeBlockReadUtils.cpp 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
8b54e9fc65 Removed extra diagnostic log messages. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
848c927bb7 Fix race condition. Add test. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
56b00a110a Removed debug code and add docs. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
c78177a28a More accurate prediction. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
f519100946 Split base and derived class implementations. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
4b566304ca Tests are passed. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
82af2278fc Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2]
Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902]

Make enums test more deterministic. [#CLICKHOUSE-2]

Refactored MergeTree readers.

Tabs -> spaces.

Move include/DB/ -> src/.
2017-04-15 06:48:24 +03:00
Alexey Zatelepin
3ca6efbbd9 substitute parse<size_t>(config.getString()) for config.getUInt64() 2017-04-12 19:37:19 +03:00
Alexey Zatelepin
eb4f895ea5 fix integer overflow [#CLICKHOUSE-2927] 2017-04-12 19:10:06 +03:00
Alexey Zatelepin
0e6c38bd63 throw exception for invalid MergeTreeSettings config values [#CLICKHOUSE-2927] 2017-04-12 18:07:58 +03:00
Alexey Zatelepin
e1c9878c34 more descriptive exception message [#CLICKHOUSE-2927] 2017-04-12 18:07:58 +03:00
Alexey Zatelepin
0b0e8fa7e1 stable column order in BufferBlockInputStream [#CLICKHOUSE-2940] 2017-04-11 21:45:41 +03:00
proller
38e9254d33 fix http methods for ReadWriteBufferFromHTTP (#675) 2017-04-11 17:13:19 +03:00
proller
72ccc69212 Debian: simpler package (#662)
* Allow use external re2 with re2_st=re2

* fix

* remove dupe

* use re2_st in FunctionsStringSearch.h

* fix

* move files from tools/etc to debian

* dont generate control

* version

* ok.

* wip

* Cmake: dont touch CMAKE_INSTALL_PREFIX

* wip

* works!

* clean

* okay

* like old

* wip

* wip

* okay

* clickhouse-server-base-dbg

* clean

* clickhouse-server-dbg

* Debian: Remove daemons

* Update rules

* add source/format

* control clean

* add watch

* clean

* clean

* temp fix build

* clean

* docs

* fake make_control

* fix

* testme

* testme

* add metrika package

* fake metrika files
2017-04-10 20:43:30 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
proller
adba3b8e6d delete ReadBufferFromHTTP, use ReadWriteBufferFromHTTP instead 2017-04-06 22:39:25 +03:00
proller
1bc311eefd ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878] (#656)
* ReplicatedMergeTree: Max streams to send data [#CLICKHOUSE-2878]

* fix

* better messages on client

* change code to 429 TOO_MANY_REQUESTS

* wip

* better message

* Update InterserverIOHandler.h

* Update InterserverIOHTTPHandler.cpp

* Update StorageReplicatedMergeTree.cpp
2017-04-06 16:03:23 +03:00
Alexey Milovidov
31f7fe42d6 Fool's day changed, continued [#CLICKHOUSE-3]. 2017-04-05 14:52:23 +03:00
Vitaliy Lyudvichenko
74a92cb8d9 Add test for OPTIMIZE FINAL and more diagnostics. [#CLICKHOUSE-2886] 2017-04-04 15:54:21 +03:00
proller
11218b9ba5 cmake: remove hardcoded src/ in macros add_headers_and_sources 2017-04-04 15:37:04 +03:00
Alexey Milovidov
baf2e6e95b Added 'join_use_nulls' setting to allow using NULLs as default values for non-joined rows in case of outer joins [#CLICKHOUSE-2]. 2017-04-04 09:52:39 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]."
This reverts commit 431a735efe.
2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
4423420c20 Merge branch 'master' of github.com:yandex/ClickHouse 2017-03-31 19:00:42 +03:00
Alexey Milovidov
4f44445ff0 Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//' 2017-03-31 19:00:30 +03:00
proller
fbdcab343f Limit fetching threads [#CLICKHOUSE-2878] (#648)
* Max parallel fetches limit

* use MergeTreeSettings.h

* clean
2017-03-31 17:46:48 +03:00
Ravengg
a973e3898d Add remove for part log (#638)
* Add REMOVE_PART

* fix

* fix

* fix codestyle
2017-03-28 20:18:49 +03:00
Alexey Milovidov
e6a41a0256 Fixed error with NULLs [#CLICKHOUSE-2901]. 2017-03-24 07:42:36 +03:00
Vitaliy Lyudvichenko
84694ca269 Resolved #594. Select least busiest buffer for insert into StorageBuffer. [#CLICKHOUSE-2892] 2017-03-23 21:25:14 +04:00
proller
670e98fa92 allow several <graphite> targets (#603)
* allow several <graphite> targets

* fix

* fix

* Adjustable parts

* changelog version

* fix

* changelog

* Style fixes

* attachSystemTables

* config describe

* fixes

* fixes
2017-03-21 23:08:09 +04:00
Alexey Milovidov
c21b4c52c5 Misc [#CLICKHOUSE-3]. 2017-03-21 21:39:07 +03:00
Alexey Milovidov
d3ae1267eb Fixed error when parts of unlimited total size could be selected for merge in case of low free disk space [#CLICKHOUSE-2895]. 2017-03-20 23:29:12 +03:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
proller
28ed324702 add cmake option USE_VECTORIZED_MATH_FUNCTIONS, reorganize auto configs 2017-03-16 13:51:41 +04:00
proller
9a1169fef6 fix tests 2017-03-16 13:51:21 +04:00
Bogdan Voronin
a3ff193fe3 Add log merge for replicas 2017-03-16 00:23:02 +04:00
proller
d777cab172 link Storages/System via lib 2017-03-15 23:43:02 +04:00
proller
25caed0c03 move all attaches of system tables to attach_system_tables.cpp 2017-03-15 23:43:02 +04:00
Ravengg
b47cc72701 Fix part log (#591)
* fix_part_log

* fixed language back

* add reset part_log back

* reset part_log when don't need more

* Fix header

* fix
2017-03-14 19:58:34 +04:00
Alexey Milovidov
4e67e05835 Fixed error [#CLICKHOUSE-2]. 2017-03-14 03:14:19 +03:00
Alexey Milovidov
bd34b62f4a Avoid most of cases when server is aborted after exception 'Memory limit (for user) exceeded' [#CLICKHOUSE-2863]. 2017-03-13 23:38:42 +03:00
Alexey Milovidov
f9b4b2012f Removed zero-width spaces [#CLICKHOUSE-2]. 2017-03-13 21:02:45 +03:00
Alexey Milovidov
26788e3938 Formatting [#CLICKHOUSE-2]. 2017-03-13 21:01:46 +03:00
Alexey Milovidov
a6a18db6da Merge branch 'translate/comments' of https://github.com/f1yegor/ClickHouse into f1yegor-translate/comments 2017-03-13 20:51:22 +03:00
f1yegor
401425bb89 translate comments 2017-03-12 20:18:07 +01:00
Alexey Milovidov
59613e1da4 Fixed build [#CLICKHOUSE-2882]. 2017-03-12 19:09:39 +03:00
Alexey Milovidov
65beb6f961 Added support for NULLS FIRST and LAST in ORDER BY (continued) [#CLICKHOUSE-2882]. 2017-03-12 16:03:07 +03:00
Alexey Milovidov
7532a1d564 Added support for NULLS FIRST and LAST in ORDER BY [#CLICKHOUSE-2882]. 2017-03-12 15:56:59 +03:00
alexey-milovidov
6d5bfc8c6f Refactoring of numeric DataTypes (#581)
* Better code [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
2017-03-12 14:13:45 +04:00
proller
b6e01cd47e Fix isolated usage of all .h files, move some code to .cpp (#578)
* split ColumnAggregateFunction.h

* format

* Allow use re2_st without cmake

* use std type in find_first_symbols.h

* fix ArrayEvaluator.h

* include fixes

* split ColumnConstAggregateFunction.h

* fix StorageMaterializedView.h

* split AddingDefaultBlockOutputStream.h

* move CSVRowInputStream::updateDiagnosticInfo to .cpp

* split ParserEnumElement.h

* format

* split DB/Parsers/ParserUseQuery.h

* clean
2017-03-11 04:27:59 +04:00
Alexey Milovidov
caebb93995 Merge remote-tracking branch 'origin/master' into if-support-nulls
Conflicts:
	dbms/include/DB/Columns/ColumnArray.h
	dbms/include/DB/Columns/ColumnString.h
	dbms/include/DB/Functions/FunctionsMiscellaneous.h
2017-03-09 07:39:45 +03:00
Alexey Milovidov
5546f7f75b Normalized formatting [#CLICKHOUSE-3]. 2017-03-09 07:26:17 +03:00
Alexey Milovidov
f9a5902e76 Support for NULLs in function if: continued [#CLICKHOUSE-2873]. 2017-03-09 06:34:09 +03:00
Ravengg
b079dacfd1 Added part_log with statistics scripts (#549)
* Added part_log

* first_test

* filter and hits_res

* Add renamer and drawer

* Add columns database and table into PartLog

* Add normal way to get table_name and database_name from part

* improve drawer

* add stats for random size parts

* Merge converter and drawer

* make drawer more informative

* add new data

* add new data

* new data

* add long range stats

* for checking best way

* Add add_parts script

* Good style for global merge

* delete commented code

* Fixed spaces to tabs

* Note that Stopwatch is started automatically.

* Style

* Update StorageMergeTree.cpp

* Update StorageReplicatedMergeTree.cpp

* Switch act_time_ms to duration_ms

* Added ability to disable part_log

* fixed getPartLog

* fix usage getPartLog

* fix
2017-03-07 21:13:54 +04:00
artpaul
91f5e7ae5c add priority and is_default columns [#CLICKHOUSE-2084] 2017-03-05 16:00:25 +05:00
Alexey Milovidov
a706e96bc4 Added more metrics for StorageBuffer [#CLICKHOUSE-2871]. 2017-03-05 04:23:10 +03:00
artpaul
aed028eb96 remove meaningless comment 2017-03-05 04:45:35 +04:00
artpaul
76e9213141 system table with graphite configuration [#CLICKHOUSE-2084] 2017-03-05 04:45:35 +04:00
artpaul
1e13e68028 blank for system.graphite 2017-03-05 04:45:35 +04:00
proller
05e87ad7a2 fix scope_exit formatting 2017-03-04 00:10:41 +03:00
Alexey Zatelepin
7090d0861a reinitialize primary key after ALTER [#CLICKHOUSE-2853] 2017-02-21 21:32:04 +04:00
Vitaliy Lyudvichenko
8bcb1fe970 Add support of AggregateFunction constants in VALUES and Set. [#CLICKHOUSE-2845] 2017-02-18 00:36:31 +04:00
Alexey Milovidov
354bed5bd7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-02-13 19:12:46 +03:00
Alexey Milovidov
db9935337c Misc [#CLICKHOUSE-2]. 2017-02-13 19:12:34 +03:00
Alexey Milovidov
8f9b70a1d7 Style [#CLICKHOUSE-2]. 2017-02-13 13:38:50 +03:00
Alexey Milovidov
bb7247993a Merge branch 'uncompressed-size-in-system-tables' 2017-02-13 01:08:31 +03:00
Alexey Milovidov
7bf5373390 Added comments [#CLICKHOUSE-2831]. 2017-02-13 01:07:38 +03:00
artpaul
f8a0f55335 #360 explicit types 2017-02-12 16:09:55 +05:00
artpaul
0c1dab92a3 #360 ordinary 2017-02-12 15:34:08 +05:00
Alexey Milovidov
c9b4a163be Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831]. 2017-02-12 01:31:22 +04:00
alexey-milovidov
4593d363d1 Fix poor distributed insertion scalability (#481)
* Fix poor scalability of INSERT into Distributed table [#CLICKHOUSE-2791].

* Fix poor scalability of INSERT into Distributed table (continued) [#CLICKHOUSE-2791].

* Misc [#CLICKHOUSE-2791].

* Fixed error [#CLICKHOUSE-2791].
2017-02-12 00:20:57 +04:00
Alexey Milovidov
30737aa7a1 Added info about uncompressed size to system.columns table [#CLICKHOUSE-2831]. 2017-02-11 20:43:28 +03:00
Alexey Zatelepin
9918965c5f Allow metadata-only ALTER of primary key columns [#CLICKHOUSE-2027] 2017-02-10 22:19:40 +04:00
Alexey Zatelepin
7b57402291 allow ALTERing Enum types in primary key columns [#CLICKHOUSE-2795] 2017-02-10 22:19:40 +04:00
Alexey Milovidov
d065087506 Fixed timeouts of ALTER [#CLICKHOUSE-2836]. 2017-02-10 21:09:49 +03:00
Alexey Zatelepin
6b47ac1fc0 translate comments [#CLICKHOUSE-3] 2017-02-10 09:05:33 +04:00
Alexey Zatelepin
aace171ef6 forbid multidimensional array columns in MergeTree tables [#CLICKHOUSE-2803] 2017-02-10 09:05:33 +04:00
Alexey Zatelepin
8d001db5d5 forbid altering of date column in MergeTree engines 2017-02-10 09:05:33 +04:00
Alexey Milovidov
d95663865f Miscellaneous [#CLICKHOUSE-2]. 2017-02-09 02:56:40 +03:00
Alexey Milovidov
2e9ab88cb7 Fixed error by removal of obsolete optimization [#CLICKHOUSE-2825]. 2017-02-09 00:45:19 +03:00
Vitaliy Lyudvichenko
98af273cbc Fixed and refactored storage Merge. [#CLICKHOUSE-2758] 2017-02-07 23:43:31 +04:00
Vitaliy Lyudvichenko
76916739e2 Fixed arrayReduce. Refactoring of ObjectPool. [#CLICKHOUSE-2787] 2017-02-07 23:43:31 +04:00
artpaul
4c57c9731e #437 encode name of default_database so it's can be passed through connection 2017-02-07 20:11:02 +04:00
proller
c51801d776 Change default user and paths [#CLICKHOUSE-2715] (#382)
* Changing default user to clickhouse and path to /var/lib/clickhouse [#CLICKHOUSE-2715]

* wip

* Auto version update to [54141]

* Get version from saved in cmake
2017-01-31 23:53:05 +04:00
Alexey Zatelepin
4ecfd44015 [#CLICKHOUSE-2115] PR changes:
* do not insert produced value into the cache if the cache has been reset.
* less logging
* cosmetic fixes
2017-01-31 22:45:10 +04:00
Alexey Zatelepin
0fdcdd7bdb Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115] 2017-01-31 22:45:10 +04:00