thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-17 21:24:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
13,649 Commits 9,139 Branches 1,774 Tags 2.1 GiB
66dd568e64
Commit Graph

591 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alexey Milovidov
738f1685b2 Fixed build after merge [#CLICKHOUSE-2]. 2017-08-25 19:35:10 +03:00
Marek Vavruša
3659caad7d ZooKeeper: use seeded random device to shuffle node list #1149 
std::random_shuffle() may or may not use std::rand() which isn't
seeded, and since configuration parsing runs predictably as one
of the first things after server startup, the list of ZK nodes
is shuffled the same way on all replicas.
 2017-08-25 18:37:27 +03:00
Nikolai Kochetov
239f4f2d36 merged with master 2017-08-25 15:05:18 +03:00
Nikolai Kochetov
c1479a5594 updated GatherUtils [#CLICKHOUSE-2090] 2017-08-24 19:46:15 +03:00
Alexey Milovidov
c34211e0c5 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
033b139288 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
003d2525e0 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f39db7ba1a More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
8085359518 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f8b2400a84 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
3748b7b332 Added hopscotch-map just for tests [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
e47a29fd4b More sophisticated test of hash tables with integer keys [#CLICKHOUSE-2]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
fc409f61e5 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 16:12:14 +03:00
Alexey Milovidov
2fb7a34f0d Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:07:11 +03:00
Alexey Milovidov
7dc4d6f7b3 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:05:59 +03:00
Alexey Zatelepin
e545777187 fix PoolWithFailoverBase::TryResult initialization 2017-08-18 15:38:43 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
628de0a3ea Fixed logging of DDL queries. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
736feab79f Add port field. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Vitaliy Lyudvichenko
1c8a280d63 Fixed escapeForFileName(). [#CLICKHOUSE-2] 2017-08-12 23:46:22 +03:00
Nikolai Kochetov
b7f8ac1f2d rewrote rewriting of SELECT query in StorageMerge with WITH statement 2017-08-12 00:01:28 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed 
Wait for insertion in distributed
 2017-08-11 21:35:13 +03:00
Alexey Milovidov
d7d6c4b962 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-11 02:26:51 +03:00
Alexey Milovidov
1e941a137e Better exception message [#CLICKHOUSE-2]. 2017-08-11 02:26:38 +03:00
Alexey Milovidov
ce4349b6cd Fixed error when huge sets for IN, JOIN, DISTINCT cannot be created with exception message "Cannot mremap... Bad address" [#CLICKHOUSE-2]. 2017-08-11 02:25:51 +03:00
alexey-milovidov
1626637a89 Update zkutil_test_multi_exception.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
e44614d017 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
5d3bff4802 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
23af9ddd5e Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
alexey-milovidov
0fbda791b5 Update iostream_debug_helpers.h 2017-08-10 06:29:06 +03:00
proller
7937903d56 Improve debug helpers 2017-08-10 06:29:06 +03:00
proller
139d9e5c19 Config: Allow multiple dictionaries_config 2017-08-10 06:17:19 +03:00
Alexey Milovidov
6edb14ba6b Fixed garbage [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
Alexey Milovidov
46be81bc88 Fixed error [#CLICKHOUSE-2]. 2017-08-07 11:03:23 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Vitaliy Lyudvichenko
003d2a9478 Add comprehensive exception message for ZooKeeper::multi(). [#CLICKHOUSE-2] 2017-08-03 15:42:23 +03:00
Alexey Milovidov
34ac4fa3b8 Added metric with revision number for better monitoring of deployment [#CLICKHOUSE-2]. 2017-08-01 17:34:06 +03:00
Alexey Milovidov
844990db27 Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 00:50:21 +03:00
Alexey Milovidov
f8a761fbd9 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:44:57 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
acf9c2fbd5 Miscellaneous [#CLICKHOUSE-2]. 2017-07-28 00:05:33 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
alexey-milovidov
b831d88162 Update ArenaAllocator.h 2017-07-25 20:06:24 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
ae3b1d8d3a Fix clang compilation. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
fefb4dad67 Get rid of old groupArray() implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
792faaa2db Add adaptive allocator. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c3a15da3f8 Add support of limit parameter into groupArray. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Alexey Milovidov
a6df2e7151 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
proller
eba5ad73ec clean 2017-07-24 18:04:49 +03:00
proller
57b9bcd354 Fix missing includes 2017-07-24 18:04:49 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
alexey-milovidov
6d47981e86 Update Collator.cpp 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
1b8a062e7b Issue #1000 - Returned some remote code in Collator.app 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
e85cd44e48 Issue #1000 - remove 'diagnostic ignored -Wunused-private-field' in Collator.app 2017-07-21 20:59:39 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011) 
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
 2017-07-21 09:35:58 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
a8b6920eab Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Nikolai Kochetov
5ed5e8c75d moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5924b13f4c fixed unnecessary columns removing for merge table on distibuted 2017-07-12 21:51:51 +03:00
Alexey Milovidov
33c6e0b804 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Vitaliy Lyudvichenko
b843ea5b3f Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3] 2017-07-11 21:36:51 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343]. 
* - "Arcadia" is the name of Yandex's monorepo.
 2017-07-10 07:34:14 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master 
Implement natively uuid type in Clickhouse
 2017-07-10 07:00:45 +03:00
Vitaliy Lyudvichenko
b46a2a6eab Fixed infinite sleeping of low-priority queries. [#CLICKHOUSE-2] 2017-07-09 03:53:13 +03:00
Guillaume Tassery
c6a5083419 Fix comparison of UInt128 to Float64 2017-07-05 18:29:16 +02:00
Guillaume Tassery
b90734920e Adapt UInt128 operator 2017-07-05 12:09:24 +02:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Guillaume Tassery
d6ab06437a Remove mention of UUID type for dictonnary 2017-07-03 18:08:32 +02:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alexey Milovidov
2b67782845 Applied clang-format [#CLICKHOUSE-2]. 2017-06-28 15:30:23 +03:00
Alexey Milovidov
39ddcf1c74 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:24:49 +03:00
Alexey Milovidov
c6b83a1c60 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:22:07 +03:00
Marek Vavruša
e189c39056 SpaceSaving: internal storage for StringRef{} 
The SpaceSaving has now specialised storage for
some keys, which only copies keys that
are to be retained in the structure, not all.

Most of the PODs implement this interface empty,
so there shouldn’t be any extra cost.
 2017-06-26 21:16:13 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921) 
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
 2017-06-23 23:22:35 +03:00
Alexey Milovidov
324fc7ef3e Miscellaneous [#CLICKHOUSE-3094]. 2017-06-23 08:39:27 +03:00
proller
70d9fb06b4 PerformanceTest: use getMultiple*FromConfig, fix debug helpers (#915) 
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file
 2017-06-22 21:56:40 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905) 
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
 2017-06-22 18:57:37 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Георгий Кондратьев
a736ef618a Put ClickHouse variant of CityHash into DB namespace [#DEVTOOLS-3381] 
This avoids symbol conflict when linking external applications that use another
variant of CityHash in the global namespace with ClickHouse libraries.
 2017-06-20 12:25:16 +03:00
alexey-milovidov
057b919f20 Update ArrayCache.h 2017-06-20 10:51:53 +03:00
alexey-milovidov
ec5d2c3914 Update Allocator.cpp 2017-06-20 10:51:53 +03:00
Георгий Кондратьев
4d57012c62 Fix older Darwin build [#DEVTOOLS-3381] 2017-06-20 10:51:53 +03:00
Alexey Milovidov
150d3bb60f Removed useless code [#CLICKHOUSE-2]. 2017-06-20 10:36:16 +03:00
Alexey Milovidov
1b17f6191b Addition to prev. revision [#DEVTOOLS-3381]. 2017-06-19 23:09:11 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Alexey Milovidov
401d922a4b Tiny modifications [#CLICKHOUSE-3044]. 2017-06-18 09:11:49 +03:00
Alexey Milovidov
f51db5e1f6 Fixed build [#CLICKHOUSE-3044]. 2017-06-18 08:55:46 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
proller
f6f85440d4 Fix compile with gcc7 2017-06-13 02:50:34 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
862a304db2 Small refinements [#CLICKHOUSE-2]. 2017-06-01 16:41:58 +03:00
Vitaliy Lyudvichenko
6db8da82c6 Add requested changes. [#CLICKHOUSE-5] 2017-06-01 13:49:21 +03:00
Vitaliy Lyudvichenko
3a2c1a195d Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Alexey Milovidov
0a55310076 Added comment [#CLICKHOUSE-3027]. 2017-05-24 21:49:30 +03:00
Alexey Milovidov
2e47c35fa9 Fixed error "zero number of streams requested" on Google Compute Engine VMs [#CLICKHOUSE-2037]. 2017-05-24 21:38:18 +03:00
Alexey Milovidov
66e209b492 Preparations, part 1 [#CLICKHOUSE-31]. 2017-05-23 21:01:50 +03:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance 
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
 2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion 
* fixes missing setHash on reinsert
* reuses hash when emplacing value
 2017-05-11 18:52:49 +04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Alexey Milovidov
d3e6321967 AggregateFunctionTopK: minor modifications [#CLICKHOUSE-2]. 2017-05-05 16:36:02 -07:00
Alexey Milovidov
9d4c814b12 Aggregate function topK: style modifications [#CLICKHOUSE-2]. 2017-05-05 14:17:04 -07:00
Marek Vavruša
5f1e65b252 AggregateFunctions: implemented topK(n) 
This implements a new function for approximate
computation of the most frequent entries using
Filtered Space Saving with a merge step adapted
from Parallel Space Saving paper.

It works better for cases where GROUP BY x
is impractical due to high cardinality of x,
such as top IP addresses or top search queries.
 2017-05-03 23:09:52 -07:00
Maxim Fridental
e9d9abf328 Fix escaping of columns starting with a number 2017-04-29 23:40:34 -07:00
proller
2a1eceef03 Try fix macos build 2017-04-29 00:18:18 +03:00
proller
edcc18992b Try fix macos build (again) 2017-04-28 22:50:42 +03:00
proller
948d9c39cd Try fix macos build. Add more debug io helpers 2017-04-28 21:57:26 +03:00
proller
d00ae1a640 fix build on freebsd/macos 2017-04-26 18:16:36 +03:00
proller
cd4a5c040c More debug io helpers: some types from dbms (#725) 
* release: import options from jenkins script

* correct chdir

* limit parallel build threads

* VERSION_POSTFIX

* add postfix

* support BUILD_TYPE

* Removed unused.

* Fixed error [#CLICKHOUSE-2960].

* Fix version incrementing

* Fix message

* Fix build without icu and readline

* More io helpers: some types from dbms

* Requested changes
 2017-04-26 05:50:03 +03:00
Vladimir Chebotarev
0e0ccdccf1 dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 15:20:03 +03:00
Vladimir Chebotarev
79e72a685d dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 12:58:21 +03:00
Alexey Zatelepin
baf0f70ba3 Failover if the needed table is missing on remote server [#CLICKHOUSE-2141] 2017-04-20 19:19:30 +03:00
Alexey Zatelepin
d1fa449f4a PR fixes [#CLICKHOUSE-2141] 2017-04-20 17:04:38 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover 
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
 2017-04-19 21:31:29 +03:00
Alexey Zatelepin
c91828e5bf PR fixes [#CLICKHOUSE-2141] 2017-04-19 21:29:50 +03:00
Alexey Milovidov
be316af758 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:38:54 +03:00
Alexey Milovidov
0224468be3 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:36:50 +03:00
alexey-milovidov
35abae95c8 Allow to disable ICU (#711) 
* Allow to disable ICU [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
 2017-04-19 04:06:29 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710) 
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
 2017-04-19 03:25:57 +03:00
Alexey Zatelepin
aa62dc354f ensure that empty entries are not returned from PoolWithFailoverBase [#CLICKHOUSE-2141] 2017-04-18 16:37:00 +03:00
Alexey Milovidov
22e8b8029b Implemented ColumnArray::replicate for Nullable, Tuple and for generic case [#CLICKHOUSE-4]. 2017-04-18 06:03:39 +03:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
Alexey Zatelepin
0a98f43d3a add TablesStatus request to protocol [#CLICKHOUSE-2141] 2017-04-17 19:02:48 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
Alexey Milovidov
ef3557950c Less dependencies [#CLICKHOUSE-2952]. 2017-04-16 07:03:14 +03:00
Alexey Milovidov
83ed2a794b Fixed -ForEach combinator of aggregate functions [#CLICKHOUSE-2952]. 2017-04-16 06:38:37 +03:00
proller
824dc5c655 fix freebsd build (#677) 
* fix freebsd build

* Fix freebsd build

* fix freebsd build

* fix freebsd build

* Update ArrayCache.h

* good fix
 2017-04-11 22:39:43 +03:00
alexey-milovidov
d68ea42643 Fixed unbounded growth of total memory tracking (that hits max_memory_usage_for_all_queries limit) (#681) 
* MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Added comment [#CLICKHOUSE-2935].
 2017-04-11 22:10:31 +03:00
proller
b01a65f922 Remove missing allocator_stress from cmake 2017-04-11 16:25:27 +03:00
Alexey Milovidov
6256a40199 Merge branch 'array-cache' 2017-04-11 05:53:50 +03:00
Alexey Milovidov
174ef70e0a Merge branch 'master' of github.com:yandex/ClickHouse 2017-04-11 05:53:39 +03:00
Alexey Milovidov
a37fa9ca6a Whitespace [#CLICKHOUSE-2]. 2017-04-11 05:53:29 +03:00
Alexey Milovidov
756df579b2 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-11 05:52:22 +03:00
Alexey Milovidov
5b29658aae MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935]. 2017-04-11 00:43:59 +03:00
proller
72ccc69212 Debian: simpler package (#662) 
* Allow use external re2 with re2_st=re2

* fix

* remove dupe

* use re2_st in FunctionsStringSearch.h

* fix

* move files from tools/etc to debian

* dont generate control

* version

* ok.

* wip

* Cmake: dont touch CMAKE_INSTALL_PREFIX

* wip

* works!

* clean

* okay

* like old

* wip

* wip

* okay

* clickhouse-server-base-dbg

* clean

* clickhouse-server-dbg

* Debian: Remove daemons

* Update rules

* add source/format

* control clean

* add watch

* clean

* clean

* temp fix build

* clean

* docs

* fake make_control

* fix

* testme

* testme

* add metrika package

* fake metrika files
 2017-04-10 20:43:30 +03:00
Alexey Milovidov
ba108daf9d ArrayCache: development [#CLICKHOUSE-2]. 2017-04-10 03:24:58 +03:00
Alexey Milovidov
f418ed37cf ArrayCache: development [#CLICKHOUSE-2]. 2017-04-10 02:10:05 +03:00
Alexey Milovidov
5f8d99cbe9 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 10:02:13 +03:00
Alexey Milovidov
1005236a09 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:44:45 +03:00
Alexey Milovidov
5ededd6b51 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:39:26 +03:00
Alexey Milovidov
2d0421e801 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:29:26 +03:00
Alexey Milovidov
0ceb92b037 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 08:19:50 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Yuri Dyachenko
ad79394799 add ClearableHashSetWithSavedHash 2017-04-07 20:12:54 +03:00
Alexey Milovidov
0f775ef20b Added missing modification [#CLICKHOUSE-2]. 2017-04-01 13:15:01 +03:00
Alexey Milovidov
5784e4a898 Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 13:10:04 +03:00
Alexey Milovidov
12dc10feaa Revert "Moved headers and sources to same place [#CLICKHOUSE-3]." 
This reverts commit abaa1501fc.
 2017-04-01 12:21:05 +03:00
Alexey Milovidov
abaa1501fc Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:19:00 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]." 
This reverts commit 431a735efe.
 2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
4f44445ff0 Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//' 2017-03-31 19:00:30 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3]. 
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
 2017-03-26 04:28:07 +03:00
Alexey Milovidov
93890423f1 Fixed zero-width spaces [#CLICKHOUSE-3]. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xe2\x80\x8b' | xargs sed -i 's/'$'\xe2\x80\x8b''//g'
 2017-03-26 04:20:25 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
proller
670e98fa92 allow several <graphite> targets (#603) 
* allow several <graphite> targets

* fix

* fix

* Adjustable parts

* changelog version

* fix

* changelog

* Style fixes

* attachSystemTables

* config describe

* fixes

* fixes
 2017-03-21 23:08:09 +04:00
Alexey Zatelepin
fccbc82c24 translate comments 2017-03-19 21:58:12 +04:00
Alexey Zatelepin
faadab3034 Allow including config elements from ZooKeeper [#CLICKHOUSE-2794] 2017-03-19 21:58:12 +04:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
proller
28ed324702 add cmake option USE_VECTORIZED_MATH_FUNCTIONS, reorganize auto configs 2017-03-16 13:51:41 +04:00
Alexey Milovidov
4e67e05835 Fixed error [#CLICKHOUSE-2]. 2017-03-14 03:14:19 +03:00
ks1322
afbd2f78d8 pager for command line client 2017-03-13 00:10:52 +03:00
Alexey Milovidov
5546f7f75b Normalized formatting [#CLICKHOUSE-3]. 2017-03-09 07:26:17 +03:00
Alexey Milovidov
7934475779 Added missing line [#CLICKHOUSE-2871]. 2017-03-05 06:37:34 +03:00
Alexey Milovidov
a706e96bc4 Added more metrics for StorageBuffer [#CLICKHOUSE-2871]. 2017-03-05 04:23:10 +03:00
Alexey Milovidov
8f9b70a1d7 Style [#CLICKHOUSE-2]. 2017-02-13 13:38:50 +03:00
Vitaliy Lyudvichenko
38c900bf2f Add request changes for #436 PR. 2017-02-07 23:43:31 +04:00
Vitaliy Lyudvichenko
67d8ce3568 Fast SIGINT handling and correct exception handling in Benchmark. [#CLICKHOUSE-2774] 2017-02-07 23:43:31 +04:00
artpaul
245b715723 #455 also update tmp_files_info_path when files_info_path is changed 2017-02-06 17:09:54 +05:00
Alexey Milovidov
b8ac19999c Settings 'max_memory_usage_for_user' and 'max_memory_usage_for_all_queries': do not interfere between different queries [#CLICKHOUSE-2796]. 2017-02-01 06:53:10 +03:00
Alexey Zatelepin
4ecfd44015 [#CLICKHOUSE-2115] PR changes: 
* do not insert produced value into the cache if the cache has been reset.
* less logging
* cosmetic fixes
 2017-01-31 22:45:10 +04:00
Alexey Zatelepin
0fdcdd7bdb Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115] 2017-01-31 22:45:10 +04:00
proller
f8d1573946 Various arm64 compile fixes on utils (#394) 2017-01-25 23:17:13 +04:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381) 
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
 2017-01-25 22:40:44 +04:00
proller
f890af1f8d Remove code and includes from Collator.h, fix including <unicode/...> in dbms (#395) 2017-01-25 22:19:15 +04:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following: 
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
 2017-01-14 12:00:19 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930] 
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
 2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e Added memory tracking events and columns for merges. [#METR-23911] 2016-12-31 02:39:53 +03:00
proller
4bc003c4c1 Porting to freebsd: initial, compile ok, most tests ok. 2016-12-24 01:03:10 +00:00
Alexey Milovidov
54587fec1b Tracking memory used in merges [#METR-23888]. 2016-12-20 05:29:35 +03:00
Alexey Milovidov
442ff1d3b8 StorageBuffer: simplification; added metrics [#METR-23888]. 2016-12-20 02:55:13 +03:00
artpaul
785a98e624 move all url's functions to FunctionsURL 2016-12-15 17:05:05 +05:00
artpaul
6694c14338 try resolve conflicts 2016-12-13 16:51:40 +05:00
Vitaliy Lyudvichenko
876ad28dd8 Merge remote-tracking branch 'origin/master' into metrics_refinement 2016-12-12 19:17:23 +03:00
artpaul
fb900881da resolve conflicts 2016-12-12 11:15:01 +05:00
artpaul
529f75c8b4 - use std::experimental::string_view 
- rename unquoteUrl to decodeURLComponent
- fix code-style
 2016-12-12 11:09:00 +05:00
Alexey Milovidov
927b84323b Addition to prev. revision [#METR-2944]. 2016-12-12 04:51:27 +03:00
Alexey Milovidov
8b06b09f34 Moved code to cpp [#METR-2944]. 2016-12-12 04:33:18 +03:00
artpaul
bea52b8631 lost files 2016-12-11 18:55:13 +05:00
artpaul
9ec6688397 move char2DigitTable to hex.cpp 2016-12-11 18:54:38 +05:00
artpaul
99cec8b165 implement unquoteUrl 2016-12-11 02:04:58 +05:00
artpaul
dfb466d156 host extraction functionality was moved to UrlUtils 2016-12-10 00:31:16 +05:00
artpaul
544143f5c9 url's scheme extraction was fixed according to rfc3986. 2016-12-09 22:38:15 +05:00
Vitaliy Lyudvichenko
774eb01fd3 Added MergesTime metric. [#METR-23305] 2016-12-09 13:13:16 +03:00
Alexey Milovidov
59da0fd12a Added metrics and events for Context lock [#METR-23763]. 2016-12-08 01:49:42 +03:00
Vladimir Chebotarev
8e1a6aaf3e cmake: Boost, OpenSSL into find_package(). [#METR-23701] 2016-12-06 16:20:32 +03:00
Vladimir Chebotarev
bcc5500f91 cmake: More options. [#METR-23701] 2016-12-05 15:43:14 +03:00
Marek Vavrusa
64f86b7d20 IO: Added ProfileEvents to Open/Read/Write failures 2016-11-30 12:21:57 -08:00
Alexey Milovidov
e7fccc4044 Modified backpressure method for MergeTree [#METR-23488]. 2016-11-14 21:19:08 +03:00
Vladimir Chebotarev
cdaece7dfa : More specific usage of static libraries. [#METR-21516] 2016-11-09 21:49:01 +03:00
Vladimir Chebotarev
72a533bc11 dbms: max_open_files for server, readline in OS X. [#METR-21516] 2016-11-07 14:33:25 +03:00
Vladimir Chebotarev
e2ceb63c54 libcommon, libre2, tools: Fixed build under OS X Sierra. [#METR-21516] 2016-11-03 15:41:13 +03:00
Vladimir Smirnov
d36f52502e Make it compilable on OS X 
It's still hackish and dirty, but server and client compies.

Server starts, but throwes meaningless exception on any query.

Client seems to be working fine.

Linux compilation might (but shouldn't) be broken (not tested).
 2016-11-01 17:59:21 +01:00
Alexey Milovidov
74c3b30622 dbms: Simplified logic of selecting merges [#METR-21841]. 2016-10-28 01:50:02 +03:00
Alexey Milovidov
687a6d1496 Addition to prev. revision [#METR-2944]. 2016-10-25 09:57:12 +03:00
Alexey Milovidov
8be993bd1e Preparation [#METR-2944]. 2016-10-25 09:49:24 +03:00
Alexey Milovidov
15b369bd08 More instrumentation [#METR-23272]. 2016-10-24 16:47:15 +03:00
Alexey Milovidov
9a3deed1ea Added metric about leadership [#METR-23272]. 2016-10-24 15:46:54 +03:00
Alexey Milovidov
ea852bb9d8 Separate compilation of CurrentMetrics; Separated AsynchronousMetrics from CurrentMetrics; Comments [#METR-23237]. 2016-10-24 07:06:27 +03:00
Alexey Milovidov
9af5ce1e3b Separate compilation of ProfileEvents; comments [#METR-23237]. 2016-10-24 05:02:37 +03:00
Vitaliy Lyudvichenko
ebbc9b9877 Added abilty to automatically update clusters configuration. [#METR-22802] 2016-10-11 17:17:49 +03:00
Alexey Milovidov
d71d53fc1a Fixed error [#METR-22876]. 2016-09-26 13:15:33 +03:00
Alexey Milovidov
6b2755bf2a Non significant change [#METR-2944]. 2016-09-23 23:33:06 +03:00
Alexey Milovidov
5cdc330273 Fixed error [#METR-22625]. 2016-09-02 05:58:59 +03:00
Yuri Dyachenko
065b02494a add -Wold-style-cast 2016-08-26 22:55:11 +03:00
Alexey Milovidov
1bb6ccd7f8 Better [#METR-22410]. 2016-08-13 08:29:53 +03:00
Alexey Milovidov
6c861fe798 Style [#METR-2807]. 2016-08-07 12:09:18 +03:00