thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 14:11:58 +00:00
Code Issues Packages Projects Releases Wiki Activity
17,850 Commits 9,138 Branches 1,778 Tags 2 GiB
86ede3d38c
Commit Graph

1030 Commits

Author SHA1 Message Date
proller
db8ea9205c
LibraryDictionarySource: api v2 with strings (#1915) 
* LibraryDictionarySource: Support numeric types, initial support for strings
 2018-02-16 20:12:22 +03:00
zhang2014
eeae014a42 ISSUES-1885 use movemask & popcnt 2018-02-14 08:11:12 +08:00
zhang2014
0d8730c687 ISSUES-1885 fix signed problem 2018-02-13 13:46:16 +08:00
Alexey Milovidov
c104566eb8 Fixed performance regression in usage of COWPtr in complex cases [#CLICKHOUSE-3584]. 2018-02-12 23:10:24 +03:00
zhang2014
acb5b99195 ISSUES-1885 fix align bound 2018-02-12 16:05:24 +08:00
zhang2014
5f9292ac30 ISSUES-1885 resolve some opinions 2018-02-12 15:58:04 +08:00
zhang2014
73077e0245 ISSUES-1885 fix failed test 2018-02-12 15:31:54 +08:00
zhang2014
0f20952f2c ISSUES-1885 UTF8 countCodePoints use simd 2018-02-12 15:31:22 +08:00
alexey-milovidov
d3160393c5
Merge branch 'master' into CLICKHOUSE-3554 2018-02-08 23:07:50 +03:00
alexey-milovidov
b7d0ae49fd
Merge pull request #1844 from bocharov/master 
Fix uniqHLL12 and uniqCombined for cardinalities 100M+.
 2018-02-08 20:01:45 +03:00
Vitaliy Lyudvichenko
42754a5327 Add new virtual columns into system.tables. [#CLICKHOUSE-3554] 2018-02-08 17:15:40 +03:00
proller
0c00e47930 Fix tests 2018-02-02 20:29:45 +03:00
Alex Bocharov
9963e2f160 Fix uniqHLL12 and uniqCombined for cardinalities 100M+. 
* Changing size() return type from UInt32 to UInt64 to prevent overflow (this shouldn't break back compatibility).
 * Removing "big cardinalities fix" for cardinalities >2^32/30 as it was very inaccurate and for estimates >2^32 it was trying to do 'log' of negative number which is NaN and it was casted to 0.
 * Adding python script to show that intHash32 is not a good choice for HyperLogLog algorithm when it's used for linear counting branch of it.
 * Adding bash script to test uniq, uniqHLL12, uniqCombined on different set cardinalities.
 * Altering documentation of uniq* aggregate functions with recommendations to use uniq instead of uniqHLL12 or uniqCombined.
 2018-01-31 11:36:01 +00:00
Vitaliy Lyudvichenko
94f38d744e
Merge pull request #1750 from yandex/CLICKHOUSE-3346 
Fault-tolerant cluster copier util
 2018-01-31 13:21:51 +03:00
alexey-milovidov
bea49ca136
Merge pull request #1741 from yandex/array-functions-hasAll-hasAny-intersect 
Array functions hasAll hasAny arrayIntersect arrayResize
 2018-01-26 12:06:48 +03:00
proller
63b3bccb04 Test and build fixes (#1822) 
* Fix travis

* try

* try

* Disable macos

* Travis enable macos

* Fix

* fast_finish: true

* fix

*  fxi

* fix openssl

* fix

* fix

* Fix

* try travis

* fix

* fix

* Cmake: dont filter platform-depended files in cmake

* misc

* renamed:    tests/server_wrapper.sh -> tests/clickhouse-test-serve

* install clickhouse-test-server

* clickhouse-test-server wip

* wip
 2018-01-26 12:03:38 +03:00
Vitaliy Lyudvichenko
4665201827 Add metric for duplicated inserts. [#CLICKHOUSE-2] 2018-01-25 21:47:44 +03:00
Vitaliy Lyudvichenko
61233b886a Better system.part_log. [#CLICKHOUSE-3342] 2018-01-25 21:40:02 +03:00
alexey-milovidov
24ac18201c Update getFQDNOrHostName.cpp 
Update isLocalAddress.cpp

Update IBlockOutputStream.h

Update users.xml
 2018-01-24 17:14:21 +03:00
Vitaliy Lyudvichenko
b4ab7d4b8e Make early deduplication with block number creation. [#CLICKHOUSE-3545] 2018-01-23 18:50:29 +03:00
Vitaliy Lyudvichenko
0bd5f6a447 Merged ZooKeeper lib changes from CLICKHOUSE-3342. Part 1. [#CLICKHOUSE-3346] 2018-01-22 21:56:23 +03:00
Vitaliy Lyudvichenko
1000328571 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-3346 2018-01-22 20:31:08 +03:00
Nikolai Kochetov
ff0328aee7 fix build [#CLICKHOUSE-2998] 2018-01-22 13:18:55 +03:00
Nikolai Kochetov
ba1bfb97c8 Merge branch 'array-function-resize' into array-functions-hasAll-hasAny-intersect 2018-01-19 22:33:43 +03:00
alexey-milovidov
0a3b1679ec
Update ClearableHashSet.h 2018-01-19 21:51:45 +03:00
alexey-milovidov
1b462b0b94
Merge pull request #1759 from yandex/CLICKHOUSE-3432 
Fixed 'intersects previous part' due to blind OPTIMIZE
 2018-01-19 21:48:41 +03:00
proller
76cf0ba5d0 Better tests (#1785) 
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge

* Travis optimize

* optimize

* Fix clickhouse-test --no-long

* no long

* Split too long test

* Better tests

* missing file

* Fix includes

* Added draft [#CLICKHOUSE-2].

* fix

* fix

* fix

* Fix test 281 under asan
 2018-01-18 23:33:16 +03:00
Nikolai Kochetov
de274b317a added ArraySourceVisitor and ArraySinkVisitor [#CLICKHOUSE-2998] 2018-01-18 18:50:35 +03:00
Nikolai Kochetov
694b305036 added arrayIntersect [#CLICKHOUSE-3504] 2018-01-17 14:36:02 +03:00
proller
d97b2edc7c Make separate libs Common/ZooKeeper and Common/ConfigProcessor (#1749) 
* Make separate libs Common/ZooKeeper and Common/ConfigProcessor
renamed:    dbms/src/Common/StringUtils.h -> dbms/src/Common/StringUtils/StringUtils.h

* Fix space

* Fix data in system.build_options

* merge

* merge
 2018-01-15 22:07:47 +03:00
Vitaliy Lyudvichenko
03bca2144d OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420] 
Resolves #1753
 2018-01-15 13:13:18 +03:00
proller
22e3695a47 More system.build_options 2018-01-12 19:50:10 +03:00
proller
364b8ec5ee Fix data in system.build_options 2018-01-12 19:04:18 +03:00
Vitaliy Lyudvichenko
388d47bbbc Merge branch 'CLICKHOUSE-3346-v310' into CLICKHOUSE-3346 2018-01-11 23:51:30 +03:00
Vitaliy Lyudvichenko
e996da050d Add copying check and retries. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Vitaliy Lyudvichenko
e1fafb1f2f Minimal working example. [#CLICKHOUSE-3346] 2018-01-11 21:55:45 +03:00
Alexey Milovidov
73460a5f86 Fixed error [#CLICKHOUSE-2]. 2018-01-11 21:55:31 +03:00
Vitaliy Lyudvichenko
ac17c59108 Updated describe query, cluster copier draft. [#CLICKHOUSE-3346] 2018-01-11 21:55:08 +03:00
proller
b026eb7797 Use submodule contrib/capnproto, remove include_directories (#1746) 
* Add submodule contrib/capnproto

* Use contrib/capnproto, remove include_directories

* Fix include

* Clean

* Fix werror

* Update doc

* Fix

* Final fix

* Fxi
 2018-01-11 21:39:52 +03:00
Alexey Milovidov
0bfea2f52c Miscellaneous [#CLICKHOUSe-2] 2018-01-10 03:04:08 +03:00
Alexey Milovidov
c4687b5fb9 Unification of Nested: development [#CLICKHOUSE-2]. 2018-01-02 08:54:34 +03:00
Alexey Milovidov
fcdd5de47d Revert "Removed questionable code (2) [#CLICKHOUSE-2]." 
This reverts commit fcabe8b888.
 2017-12-28 07:39:19 +03:00
Alexey Milovidov
798299ba89 Merge branch 'aavdonkin-master' 2017-12-28 07:33:55 +03:00
Alexey Milovidov
4448766266 Merging [#CLICKHOUSE-3114] 2017-12-28 07:28:05 +03:00
Alexey Milovidov
104b09604a Merging [#CLICKHOUSE-3114] 2017-12-28 00:45:05 +03:00
Alexey Milovidov
09262ae0d7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-27 01:56:30 +03:00
Alexey Milovidov
b2fcf06353 Merging [#CLICKHOUSE-3114] 2017-12-27 00:34:06 +03:00
Alexey Milovidov
203363ea73 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-26 20:53:36 +03:00
Alexey Milovidov
7a60d773ec Fixed strange code [#CLICKHOUSE-2]. 2017-12-26 20:53:31 +03:00
alexey-milovidov
9bf06a26cc Update PODArray.h 2017-12-26 20:52:22 +03:00
chenxing.xc
e7efee8f41 fix potential memory issue 2017-12-26 20:52:22 +03:00
Alexey Milovidov
c89041ce63 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 01:51:04 +03:00
Alexey Milovidov
ec71908b00 Revert "Removed questionable code (2) [#CLICKHOUSE-2]." 
This reverts commit fcabe8b888.
 2017-12-26 00:57:29 +03:00
Alexey Milovidov
fcabe8b888 Removed questionable code (2) [#CLICKHOUSE-2]. 2017-12-26 00:32:33 +03:00
Alexey Milovidov
a85b2e5a95 Removed questionable code [#CLICKHOUSE-2]. 2017-12-26 00:10:46 +03:00
Alexey Milovidov
04eb0b896c Added proper support for Nullable arguments for function OR #1416 2017-12-25 09:33:51 +03:00
Alexey Milovidov
8ff93487e3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-25 07:01:46 +03:00
Alexey Milovidov
61174e9150 Better implementation for IDataType::equals method #1650 2017-12-23 04:05:29 +03:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Roman Tsisyk
0e556c2b03 Fix compilation without SSE 4.2 
Fixes "'hash64' was not declared in this scope" on aarch64.
 2017-12-21 00:48:17 +03:00
Marek Vavruša
fb1aa84973 Fixed clang build on macOS 
- Make sure to use dynamic linking on macOS to avoid OpenSSL static linking bug
- Use -std=c++17 in CFLAGS for files in contrib
- Avoid bad support for thread_local on macOS with clang altogether
 2017-12-21 00:46:50 +03:00
Nikolai Kochetov
39ec3f7d74 changed exception message, added comments 2017-12-19 22:51:59 +03:00
Silviu Caragea
b08463ed7b Fix for https://github.com/yandex/ClickHouse/issues/1648 2017-12-19 22:41:05 +03:00
Alexey Milovidov
d9732198ac Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:51:12 +03:00
Alexey Milovidov
61c2b55a57 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-19 03:43:04 +03:00
Alexey Milovidov
f9170190c6 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:17:56 +03:00
Alexey Milovidov
c5d5296889 Miscellaneous [#CLICKHOUSE-2]. 2017-12-18 07:07:26 +03:00
Alexey Milovidov
7c802ee3de Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-18 05:37:08 +03:00
Alexey Milovidov
5b32914089 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 07:29:34 +03:00
Alexey Milovidov
645f620873 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:46:56 +03:00
Alexey Milovidov
7284a64740 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-16 00:32:25 +03:00
Alexey Milovidov
01a0b91c83 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-15 00:20:14 +03:00
Alexey Milovidov
911d80ab51 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 07:25:22 +03:00
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
9cc424b4b5 Fixed error: loading "preprocessed" files if dictionary/model config was specified with glob [#CLICKHOUSE-3501]. 2017-12-13 23:21:03 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
Alexey Milovidov
524d98c7fc More strict semantic on sharing columns (development) [#CLICKHOUSE-2]. 2017-12-11 05:59:56 +03:00
Alexey Milovidov
254030d6c3 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
00a7209607 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 04:34:52 +03:00
Alexey Milovidov
2c1d7ad343 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 03:31:46 +03:00
Alexey Milovidov
9996e15458 Allow to use values of AggregateFunction data type in groupArray aggregate function [#CLICKHOUSE-3485]. 2017-12-06 06:10:32 +03:00
Alexey Milovidov
5bb326de61 Allow to use values of AggregateFunction data type in groupArray aggregate function (incomplete) [#CLICKHOUSE-3485]. 2017-12-06 00:25:01 +03:00
Alexey Milovidov
2e652ffa1e Removed hopscotch hash (was used only in single test) [#CLICKHOUSE-2]. 2017-12-02 06:28:00 +03:00
Alexey Milovidov
668d88a359 Better [#CLICKHOUSE-2]. 2017-12-02 06:22:51 +03:00
Alexey Milovidov
d091789a09 Better [#CLICKHOUSE-2]. 2017-12-02 05:58:25 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
d932d615e7 Merge branch 'master' of github.com:yandex/ClickHouse 2017-12-02 02:14:59 +03:00
Alexey Milovidov
790bda3b9a Whitespace [#CLICKHOUSE-2]. 2017-12-02 02:14:53 +03:00
Alexey Milovidov
54e601019c Better [#CLICKHOUSE-2]. 2017-12-02 00:40:58 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata 
[clickhouse-yt] separate geo dictionaries from data providers
 2017-12-01 19:54:08 +03:00
alexey-milovidov
09f030a3ee
Merge branch 'master' into data_parts_multi_index 2017-12-01 19:53:04 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
Vitaliy Lyudvichenko
b738d1baed Add multi index for data_parts storage. And fixed bugs. [#CLICKHOUSE-3452] 
Fixed handling of obsolete parts.
Fixed conflict resolution between simultaneous PreCommitted covering parts.
Fixed memory leak caused by ordinary MergeTree parts stucked in Deleting state.
Added hidden _state column into system.parts.
 2017-11-29 14:25:11 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
Alexey Milovidov
95d33b3e65 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-27 22:33:38 +03:00
alexey-milovidov
33ddc5e0f5 Update ConfigProcessor.cpp 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
a6ee2125a4 ConfigProcessor: explicit ctor [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
827a5d0612 Fix warnings-errors in gtest 2017-11-24 23:40:14 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h 
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
 2017-11-24 16:55:31 +03:00
Alexey Milovidov
f3b0f17d50 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-22 22:02:24 +03:00
proller
875ef9b5cf Fix allocator test 2017-11-22 17:54:12 +03:00
Alexey Milovidov
f9cd1e7afc Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-21 23:10:58 +03:00
proller
411202d5ad Zlib: as submodule, fix compile options; config: add logger options: logger.flush logger.rotateOnOpen 2017-11-21 23:10:37 +03:00
Alexey Milovidov
4aa520e7be Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-21 22:40:59 +03:00
proller
2778f35e48 Lib Parsers 2017-11-21 22:35:54 +03:00
Alexey Milovidov
2fd17a3072 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 09:01:05 +03:00
Alexey Milovidov
07d594c505 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:59:58 +03:00
Alexey Milovidov
3b5f82000c Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:22:54 +03:00
Alexey Milovidov
3403f68c3f Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:21:50 +03:00
Alexey Milovidov
e340511931 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:22:21 +03:00
Alexey Milovidov
a7d4fef0d2 Removed useless code [#CLICKHOUSE-2]. 2017-11-20 07:21:14 +03:00
Alexey Milovidov
b3f6844171 Merge remote-tracking branch 'origin/master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 07:18:37 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
Alexey Milovidov
2ca6952deb Merge branch 'master' into unify-data-types-that-serialized-with-multiple-streams 2017-11-20 02:16:18 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Alexey Milovidov
c0321ce752 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:59:57 +03:00
Alexey Milovidov
9b92c0fecd BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 03:22:13 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Alexey Milovidov
69714f0671 BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:55:53 +03:00
Alexey Milovidov
dfb4a92f5a BackgroundSchedulePool: miscellaneous [#CLICKHOUSE-2]. 2017-11-19 02:47:39 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
076e0ae014 More clear [#CLICKHOUSE-2]. 2017-11-18 00:20:28 +03:00
Alexey Milovidov
8425c56c0f Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-18 00:00:29 +03:00
Alexey Milovidov
7cf5eaddc0 Fixed wrong logic [#CLICKHOUSE-2]. 2017-11-17 23:59:31 +03:00
Alexey Milovidov
4f8009517c Thread name can be 15 bytes max [#CLICKHOUSE-2]. 2017-11-17 23:57:07 +03:00
Alexey Milovidov
f54e99490f Merge branch 'master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:48:16 +03:00
Alexey Milovidov
8e362ba641 Fixed build [#CLICKHOUSE-2]. 2017-11-17 23:48:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
Alexey Milovidov
18be706127 Merge remote-tracking branch 'origin/master' into silviucpp-replicated_merge_tree_thread_pool 2017-11-17 23:30:51 +03:00
proller
5190325275 Allocator fix: nothing do when sizes equal, allow reallocate to smaller size (#1512) 
* PerformanceTest fixes.

* format

* Allocator fix: nothing do when sizes equal, allow reallocate to smaller size

* Update Allocator.cpp
 2017-11-17 23:27:12 +03:00
Alexey Milovidov
9264bc4013 Style [#CLICKHOUSE-2]. 2017-11-17 23:18:06 +03:00
Alexey Milovidov
4ab2d4bc31 Added comment [#CLICKHOUSE-2]. 2017-11-17 22:49:17 +03:00
Alexey Milovidov
263e262413 Style [#CLICKHOUSE-2]. 2017-11-17 22:43:25 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
proller
aa3dd03389 Split lib dbms to dbms + dbms_common_io 2017-11-17 22:19:49 +03:00
Silviu Caragea
64619c614f Basic idea is : 
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
 2017-11-17 10:58:35 +02:00
proller
fa65bdcf48 Fix realloc on freebsd and macos (#1494) 2017-11-16 22:17:09 +03:00
proller
339424f5ea Fix realloc on freebsd and macos 2017-11-16 14:27:31 +03:00
Marek Vavruša
ba82b20cbe MemoryTracker: fixed build with clang 9.0.0 not properly supporting thread_local 
This fixes #1488.

XCode 9.0 added support for C++11 thread_local:
https://developer.apple.com/library/content/releasenotes/DeveloperTools/RN-Xcode/Chapters/Introduction.html

The 443088ce31 replaced __thread with C++11 thread_local, which
broke the compilation for this platform with an error on link time.

I can't reproduce this with a minimal example yet.
 2017-11-15 23:32:31 +03:00
Alexey Zatelepin
3ffb239185 add ZooKeeper::asyncTryRemove() [#CLICKHOUSE-3208] 2017-11-15 23:13:10 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484) 
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
 2017-11-12 15:58:40 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00
Alexey Milovidov
a3fa44e71a Miscellaneous [#CLICKHOUSE-2]. 2017-11-12 03:46:22 +03:00
Silviu Caragea
b4f7bfaa02 Remove duplicate code from zookeeper.cpp 2017-11-11 03:36:29 +03:00
Alexey Milovidov
4e04c4da5f Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:56:31 +03:00
KochetovNicolai
bfb4e8f3fe zookeeper chroot fix (#1430) 
* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* added root and identity section to zookeeper configuration [#CLICKHOUSE-3031]

* moved root section in zookeeper configuration [#CLICKHOUSE-3031]

* fixed root section in zookeeper configuration [#CLICKHOUSE-3031]

* added tests [#CLICKHOUSE-3031]

* replaced tabs to spaces in config files [#CLICKHOUSE-3031]

* fix build [#CLICKHOUSE-3031]

* added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031]

* added comments [#CLICKHOUSE-3031]

* Check if zookeeper chroot exists before start. Remove tailing slash form chroot. [#CLICKHOUSE-3400]

* added starting '/' to zookeeper path in ReplicatedMergeTree
 2017-11-02 01:59:27 +03:00
Marek Vavruša
0d942a69c5 DataStreams: added Cap’n Proto format support 
Cap'n Proto is a binary message format.
Like Protocol Buffers and Thrift (but unlike JSON or MessagePack), Cap'n Proto messages are strongly-typed and not self-describing. Due to this, it requires a schema setting to specify schema file and the root object. The schema is parsed on runtime and cached for each SQL statement.
 2017-10-27 23:03:51 +03:00
alexey-milovidov
3b99b723d7
Merge pull request #1245 from yandex/CLICKHOUSE-3178 
Atomic parts addition and removing
 2017-10-27 23:03:33 +03:00
proller
4dd1634772 Print sizes in memory errors (#1413) 
* Print sizes in memory errors

* use formatReadableSizeWithBinarySuffix

* Fix

* Requested changes

* fix alignment message
 2017-10-27 22:18:39 +03:00
Alexey Milovidov
1d8dc11f40 Fixed one of errors that cause abort when no space left on device with logs (now useless, as ClickHouse will instead refuse all connections) [#CLICKHOUSE-2] 2017-10-27 20:24:33 +03:00
Vitaliy Lyudvichenko
71833a7f0f More correct procedure of parts deleting. [#CLICKHOUSE-3178] 2017-10-26 17:16:06 +03:00
Alexey Milovidov
2cc3fdae9b Useless modifications for cppcheck [#CLICKHOUSE-2]. 2017-10-26 04:47:03 +03:00
proller
4ffbca2d8c Fix warnings (#1406) 
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix

* ZooKeeper: fixed stack smashing with tryGet()

The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.

* increased timeout for test_insertion_sync_fails_with_timeout

* Update CHANGELOG_RU.md

* Update ZooKeeper.cpp

* Fix warnings

* Fixes

* Dont strip debug info from  asan, tsan and other builds except releases

* Fix asan error causd by test 00144

* Fix empty log message (#CLICKHOUSE-3378)
 2017-10-25 21:39:10 +03:00
alexey-milovidov
8c327e9378 Revert "Make gperftools (libtcmalloc) as submodule and update. (#1381)" 
This reverts commit fa2484ea90.
 2017-10-24 22:18:15 +03:00
proller
fa2484ea90 Make gperftools (libtcmalloc) as submodule and update. (#1381) 
* Update tcmalloc and make submodule

* wip

* wip

* wip

* wip

* clean

* fix

* fix

* fix

* Fix tests
 2017-10-24 22:11:42 +03:00
Alexey Milovidov
d77686685a Using PODArray instead of std::vector in ZooKeeper library [#CLICKHOUSE-2]. 2017-10-23 18:08:31 +03:00
alexey-milovidov
91aa0713e5 Merge pull request #1371 from vavrusa/fix-zookeeper-stack-smashing 
ZooKeeper: fixed stack smashing with tryGet()
 2017-10-23 17:40:12 +03:00
alexey-milovidov
4f86ec9d58 Update ZooKeeper.cpp 2017-10-23 17:39:29 +03:00
alexey-milovidov
c5b5f2b4f8 Merge pull request #1374 from proller/fix4 
Use c++11 thread_local instead of gcc's __thread
 2017-10-22 12:43:11 +03:00
proller
8dd5c9dac2 Cmake: fix build without downloaded submodules (#1379) 2017-10-20 20:59:44 +03:00
proller
443088ce31 Use c++11 thread_local instaed of gcc's __thread 2017-10-19 22:36:37 +03:00
Marek Vavruša
e2a8526990 ZooKeeper: fixed stack smashing with tryGet() 
The tryGet() operation creates a 1MB buffer on stack. This may or
may not work depending on the default stack size for threads,
whether the stack protector is enabled or not, recursion depth,
and the actual value size.

This is probably going to slow down some ZK operations, but I don't
see how else this could work reliably with the existing API.
 2017-10-18 15:13:42 -07:00
Marek Vavruša
70543200be dbms: Fix build with clang after Poco update 
In the current version of Poco, unsigned long no longer aliases to
UInt64 with LP64. The size_t aliases to unsigned long with clang,
so all the uses of size_t instead of UInt64 when interacting with
Poco interfaces are gone. I replaced uses with UInt64 where it makes
sense, and added an overloaded function for readVarUInt() to support size_t.
 2017-10-13 18:26:24 -07:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang 
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
 2017-10-13 18:12:29 -07:00
proller
4c7850fdc2 Optional kafka (#1355) 
* Zookeeper include fix

* Update submodule contrib/poco

* Fix zookeeper submodule ho-to-make doc

* Update zookeeper submodule

* Update submodule zookeeper

* Fix compile with external zookeeper

* Optional kafka

* fix

* Fix

* fix
 2017-10-14 03:53:01 +03:00
Alexey Milovidov
f42c6014ce Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-14 02:06:11 +03:00
proller
20329ce794 Zookeeper include fix (#1353) 2017-10-13 23:30:55 +03:00
proller
49f8080e52 Small debud improvement 2017-10-13 21:44:26 +03:00
Alexey Milovidov
0ec218a853 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-13 04:09:51 +03:00
Alexey Milovidov
3a6705af0f Improvement [#CLICKHOUSE-2]. 2017-10-12 23:34:01 +03:00
alexey-milovidov
b7c1076df2 Update ActionBlocker.h 2017-10-12 23:26:54 +03:00
alexey-milovidov
96b603a023 Update ActionBlocker.h 2017-10-12 23:26:54 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
alexey-milovidov
44e6ecfe78 Update ShellCommand.cpp 2017-10-12 22:36:27 +03:00
proller
1505ad6bac Executable dictionaries: fail if program returns non zero exit code (#CLICKHOUSE-3171) 2017-10-12 22:36:27 +03:00
Vitaliy Lyudvichenko
18af75a4f1 Add metrics for RWLockFIFO. [#CLICKHOUSE-3246] 2017-10-12 22:32:31 +03:00
Alexey Milovidov
1405415f94 Miscellaneous [#CLICKHOUSE-3]. 2017-10-09 01:53:38 +03:00
Marek Vavruša
28bb5e25cf AggregateFunctionTopK: read alphaMap for generic 
* the alpha_map vector always (de)serialises
  the actual version (could empty sometimes)
* AggregateFunctionTopK generic variant deserialises
  it as well instead of ignoring it
* AggregateFunctionTopK generic variant clears the
  array before deserialising

refs #1283
 2017-10-09 01:12:38 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
KochetovNicolai
e0efb7e8c1 Point in polygon (#1264) 
* added FunctionPointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid with holes [#CLICKHOUSE-3201]

* added arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed shifted grid for PointInPolygonWithGrid, added test [CLICKHOUSE-3201]

* expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fix expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added pool to PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* fixed test [#CLICKHOUSE-3201]

* unified signature for PointInPolygon [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* supported Float64 for pointInPolygon [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fixed check for numeric tuple in PointInPolygon function [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* added profile events polygons pool [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* Update FunctionsGeo.cpp
 2017-09-20 05:30:44 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
bc622c4c45 Better [#CLICKHOUSE-2]. 2017-09-17 03:13:26 +03:00
Alexey Milovidov
86c46ad1bd Unification [#CLICKHOUSE-2]. 2017-09-15 15:16:12 +03:00
Alexey Milovidov
5e25c40a26 Fixed error found by Coverity [#CLICKHOUSE-2]. 2017-09-14 07:24:20 +03:00
Alexey Milovidov
9a58e26b8c Added comment [#CLICKHOUSE-2]. 2017-09-13 00:06:11 +03:00
Vadim Skipin
7576cb2c18 fix LRU cache definition 2017-09-11 14:41:47 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
253893bf4d Fixed insignificant error, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 07:06:54 +03:00
Alexey Milovidov
5a8f45c131 Fixed insignificant error, shown by TSan [#CLICKHOUSE-2]. 2017-09-09 06:46:18 +03:00
Alexey Milovidov
dc4976f562 Implemented some suggestions from clang-tidy (part 8) [#CLICKHOUSE-3301]. 2017-09-08 07:58:57 +03:00
Alexey Milovidov
71d29acdfb Implemented some suggestions from clang-tidy (part 7) [#CLICKHOUSE-3301]. 2017-09-08 07:43:57 +03:00
Alexey Milovidov
4799f28dad Implemented some suggestions from clang-tidy (part 6) [#CLICKHOUSE-3301]. 2017-09-08 07:39:03 +03:00
Alexey Milovidov
b282c8fcbb Implemented some suggestions from clang-tidy (part 5) [#CLICKHOUSE-3301]. 2017-09-08 07:11:39 +03:00
Alexey Milovidov
8c9ec83a33 Implemented some suggestions from clang-tidy (part 4) [#CLICKHOUSE-3301]. 2017-09-08 07:10:43 +03:00
Alexey Milovidov
e9ae193870 Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301]. 2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
Vadim Skipin
4017622ffb CLICKHOUSE-3289: Do not use Application singleton 2017-09-07 20:55:33 +03:00
proller
d422777d9c ShellCommand: automatic wait call in destructor (#1210) 
* ShellCommand: automatic wait call in destructor

* ShellCommand: tryWait in destructor

* Update ShellCommand.cpp

* Update ShellCommand.cpp
 2017-09-07 03:12:39 +03:00
Alexey Milovidov
ff8940ddbe Fixed bad code [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Alexey Milovidov
24ac5a68e1 More uniform style [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Alexey Milovidov
31b598e1e3 Fixed bad code [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150) 
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
 2017-09-05 04:08:26 +03:00
proller
1b3bc42586 Fix freebsd/macos compile (#1198) 
* Header compile fixes

* Fix includes

* Update debian/.pbuilderrc description

* Fix freebsd/macos compile

* Fix freebsd/macos compile
 2017-09-04 21:18:45 +03:00
alexey-milovidov
c1fdb785f0 Merge branch 'master' into CLICKHOUSE-3246 2017-09-04 20:06:18 +03:00
proller
39c1bf0984 Fix freebsd/macos compile (#1194) 
* Header compile fixes

* Fix includes

* Update debian/.pbuilderrc description

* Fix freebsd/macos compile
 2017-09-04 18:14:05 +03:00
Vitaliy Lyudvichenko
706d4db332 Made RWLockFIFO recursive. [#CLICKHOUSE-3246] 2017-09-04 15:54:13 +03:00
proller
aa1f27553e Header compile fixes 2017-09-01 22:05:29 +03:00
Alexey Milovidov
87fab3396e Fixed build [#CLICKHOUSE-2]. 2017-09-01 21:22:03 +03:00
Alexey Milovidov
40884640a1 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-01 21:21:05 +03:00
Alexey Milovidov
2af8747164 Removed obsolete code [#CLICKHOUSE-3270]. 2017-09-01 21:21:01 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931 
Introduce SYSTEM queries
 2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
Vitaliy Lyudvichenko
add3f920ff RWLockFIFO implementation. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
alexey-milovidov
897a9ad6b2 Merge pull request #1146 from yandex/array-functions-concat-slice-push-pop 
Array functions concat slice push pop
 2017-09-01 20:30:51 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175) 
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
 2017-09-01 20:21:03 +03:00
Vitaliy Lyudvichenko
c32bf4f597 Use only one cache in DNSCache. Add requested changes. [#CLICKHOUSE-2931] 2017-09-01 20:05:24 +03:00
Nikolai Kochetov
7891596579 unified TypeList [#CLICKHOUSE-2090] 2017-09-01 15:05:19 +03:00
Alexey Zatelepin
5471979f46 generic partitioning of inserted blocks [#CLICKHOUSE-3000] 2017-08-31 23:32:03 +03:00
proller
be7e082b35 Fix test simple_cache compile 2017-08-31 22:27:55 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Nikolai Kochetov
ec58bfae90 added comments [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1e08db938d added chech that root starts with '/' in zookeeper config file [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
871a7cabc6 fix build [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
d4bf2bf102 replaced tabs to spaces in config files [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
5ff1669406 fixed root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
1539648910 moved root section in zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
fa2f0dfa4d added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Nikolai Kochetov
16103456e2 added root and identity section to zookeeper configuration [#CLICKHOUSE-3031] 2017-08-30 21:30:57 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Alexey Milovidov
738f1685b2 Fixed build after merge [#CLICKHOUSE-2]. 2017-08-25 19:35:10 +03:00
Marek Vavruša
3659caad7d ZooKeeper: use seeded random device to shuffle node list #1149 
std::random_shuffle() may or may not use std::rand() which isn't
seeded, and since configuration parsing runs predictably as one
of the first things after server startup, the list of ZK nodes
is shuffled the same way on all replicas.
 2017-08-25 18:37:27 +03:00
Nikolai Kochetov
239f4f2d36 merged with master 2017-08-25 15:05:18 +03:00
Nikolai Kochetov
c1479a5594 updated GatherUtils [#CLICKHOUSE-2090] 2017-08-24 19:46:15 +03:00
Alexey Milovidov
c34211e0c5 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
033b139288 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
003d2525e0 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f39db7ba1a More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
8085359518 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f8b2400a84 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
3748b7b332 Added hopscotch-map just for tests [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
e47a29fd4b More sophisticated test of hash tables with integer keys [#CLICKHOUSE-2]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
fc409f61e5 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 16:12:14 +03:00
Alexey Milovidov
2fb7a34f0d Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:07:11 +03:00
Alexey Milovidov
7dc4d6f7b3 Miscellaneous [#CLICKHOUSE-2]. 2017-08-20 04:05:59 +03:00
Alexey Zatelepin
e545777187 fix PoolWithFailoverBase::TryResult initialization 2017-08-18 15:38:43 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
628de0a3ea Fixed logging of DDL queries. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
736feab79f Add port field. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Vitaliy Lyudvichenko
1c8a280d63 Fixed escapeForFileName(). [#CLICKHOUSE-2] 2017-08-12 23:46:22 +03:00
Nikolai Kochetov
b7f8ac1f2d rewrote rewriting of SELECT query in StorageMerge with WITH statement 2017-08-12 00:01:28 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed 
Wait for insertion in distributed
 2017-08-11 21:35:13 +03:00
Alexey Milovidov
d7d6c4b962 Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-11 02:26:51 +03:00
Alexey Milovidov
1e941a137e Better exception message [#CLICKHOUSE-2]. 2017-08-11 02:26:38 +03:00
Alexey Milovidov
ce4349b6cd Fixed error when huge sets for IN, JOIN, DISTINCT cannot be created with exception message "Cannot mremap... Bad address" [#CLICKHOUSE-2]. 2017-08-11 02:25:51 +03:00
alexey-milovidov
1626637a89 Update zkutil_test_multi_exception.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
e44614d017 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
alexey-milovidov
5d3bff4802 Update ZooKeeper.cpp 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
23af9ddd5e Fixed segfault: the future owns source ops. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
Vitaliy Lyudvichenko
351a0905d5 Implemented fast block and parts cleaning. [#CLICKHOUSE-3207] 2017-08-10 23:09:05 +03:00
alexey-milovidov
0fbda791b5 Update iostream_debug_helpers.h 2017-08-10 06:29:06 +03:00
proller
7937903d56 Improve debug helpers 2017-08-10 06:29:06 +03:00
proller
139d9e5c19 Config: Allow multiple dictionaries_config 2017-08-10 06:17:19 +03:00
Alexey Milovidov
6edb14ba6b Fixed garbage [#CLICKHOUSE-2]. 2017-08-09 04:35:12 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
Alexey Milovidov
46be81bc88 Fixed error [#CLICKHOUSE-2]. 2017-08-07 11:03:23 +03:00
Vitaliy Lyudvichenko
10c14cfccb Small code enhancements according to clang-tidy. [#CLICKHOUSE-2931] 2017-08-04 17:35:36 +03:00
Vitaliy Lyudvichenko
003d2a9478 Add comprehensive exception message for ZooKeeper::multi(). [#CLICKHOUSE-2] 2017-08-03 15:42:23 +03:00
Alexey Milovidov
34ac4fa3b8 Added metric with revision number for better monitoring of deployment [#CLICKHOUSE-2]. 2017-08-01 17:34:06 +03:00
Alexey Milovidov
844990db27 Fixed build with gcc-7.1 [#CLICKHOUSE-2]. 2017-08-01 00:50:21 +03:00
Alexey Milovidov
f8a761fbd9 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:44:57 +03:00
Alexey Milovidov
6578fb2645 Fixed error [#CLICKHOUSE-3191]. 2017-08-01 00:39:24 +03:00
Alexey Milovidov
8fb452e99a Fixed wrong log message when removing temporary part after merge, that is not byte-identical than same part on replicas; added profile event; added fail-safe logic [#MTRSADMIN-3175]. 2017-07-29 00:25:24 +03:00
Alexey Milovidov
dd1f54bce2 Changed Poco::RWLock to std::shared_lock [#APRILDEV-91]. 2017-07-28 20:34:02 +03:00
Alexey Milovidov
acf9c2fbd5 Miscellaneous [#CLICKHOUSE-2]. 2017-07-28 00:05:33 +03:00
Nikolai Kochetov
c88e8a79cc merged with master 2017-07-27 18:43:46 +03:00
Nikolai Kochetov
2f8f199d08 separated connection pool creation from StorageDistributedDirectoryMonitor in StorageDistributed; fixed bugs from review [#CLICKHOUSE-3033] 2017-07-27 18:24:39 +03:00
Alexey Milovidov
cd4fef7767 Miscellaneous [#CLICKHOUSE-2]. 2017-07-26 08:55:59 +03:00
Alexey Milovidov
ec676baee7 Fixed error after merge [#CLICKHOUSE-2]. 2017-07-25 22:07:07 +03:00
alexey-milovidov
b831d88162 Update ArenaAllocator.h 2017-07-25 20:06:24 +03:00
Vitaliy Lyudvichenko
870b1aefcb Get rid of of PODArray copypaste. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
ae3b1d8d3a Fix clang compilation. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
fefb4dad67 Get rid of old groupArray() implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
792faaa2db Add adaptive allocator. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c3a15da3f8 Add support of limit parameter into groupArray. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Vitaliy Lyudvichenko
c2cc8d6147 Add several groupArray implementations. [#CLICKHOUSE-3084] 2017-07-25 20:04:10 +03:00
Alexey Milovidov
a6df2e7151 Added support for non-constant and negative offset and size for substring function (continued) [#CLICKHOUSE-2]. 2017-07-25 01:44:13 +03:00
proller
eba5ad73ec clean 2017-07-24 18:04:49 +03:00
proller
57b9bcd354 Fix missing includes 2017-07-24 18:04:49 +03:00
Alexey Milovidov
efaa44bea8 Attempt to improve performance [#CLICKHOUSE-3]. 2017-07-23 09:53:28 +03:00
alexey-milovidov
6d47981e86 Update Collator.cpp 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
1b8a062e7b Issue #1000 - Returned some remote code in Collator.app 2017-07-21 20:59:39 +03:00
Vladimir Kolobaev
e85cd44e48 Issue #1000 - remove 'diagnostic ignored -Wunused-private-field' in Collator.app 2017-07-21 20:59:39 +03:00
alexey-milovidov
d4d266fa18 ColumnConst unification (#1011) 
* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* Fixed error in ColumnArray::replicateGeneric [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].

* ColumnConst: unification (incomplete) [#CLICKHOUSE-3150].
 2017-07-21 09:35:58 +03:00
Alexey Milovidov
5c3ca0c16e Inverted dependency in DataTypeFactory [#CLICKHOUSE-3149]. 2017-07-16 07:11:11 +03:00
Alexey Milovidov
9406b6a5aa Get rid of ASTSet, because it is not really an AST and it lead to bugs [#CLICKHOUSE-3148]. 2017-07-15 06:48:36 +03:00
Nikolai Kochetov
283810e8ab merged with master 2017-07-13 23:59:34 +03:00
Nikolai Kochetov
75be0b81d8 removed typeid_cast from IColumn.h 2017-07-13 23:58:19 +03:00
Nikolai Kochetov
985e449bd3 added IDataType::updateAvgValueSizeHints; renamed PODArray::allocated_size to PODArray::allocated_bytes; renamed renamed IColumn::allocatedSize to IColumn::allocatedBytes; removed IColumn.h from IDataType.h 2017-07-13 19:49:09 +03:00
Alexey Milovidov
a8b6920eab Using lexer (development) [#CLICKHOUSE-2]. 2017-07-13 08:59:01 +03:00
Nikolai Kochetov
5ed5e8c75d moved getRequestedColumns to StorageMerge::collectIdentifiersInFirstLevelOfSelectQuery 2017-07-12 21:51:51 +03:00
Nikolai Kochetov
5924b13f4c fixed unnecessary columns removing for merge table on distibuted 2017-07-12 21:51:51 +03:00
Alexey Milovidov
33c6e0b804 Removing dependency on functions from client: preparation [#CLICKHOUSE-2]. 2017-07-12 03:42:50 +03:00
Vitaliy Lyudvichenko
b843ea5b3f Resolves #964. Fixed input_format_skip_unknown_fields for negative numbers. [#CLICKHOUSE-3] 2017-07-11 21:36:51 +03:00
Alexey Milovidov
86eb4d2d06 Renamed Singleton to avoid conflicts with Arcadia* codebase [#DEVTOOLS-3343]. 
* - "Arcadia" is the name of Yandex's monorepo.
 2017-07-10 07:34:14 +03:00
alexey-milovidov
b64b243a73 Merge pull request #945 from YiuRULE/master 
Implement natively uuid type in Clickhouse
 2017-07-10 07:00:45 +03:00
Vitaliy Lyudvichenko
b46a2a6eab Fixed infinite sleeping of low-priority queries. [#CLICKHOUSE-2] 2017-07-09 03:53:13 +03:00
Guillaume Tassery
c6a5083419 Fix comparison of UInt128 to Float64 2017-07-05 18:29:16 +02:00
Guillaume Tassery
b90734920e Adapt UInt128 operator 2017-07-05 12:09:24 +02:00
Guillaume Tassery
aeeb81fadf Rename field in UInt128 2017-07-04 18:10:36 +02:00
Guillaume Tassery
d6ab06437a Remove mention of UUID type for dictonnary 2017-07-03 18:08:32 +02:00
Guillaume Tassery
525851ec68 sync master 2017-06-30 22:21:42 +02:00
Guillaume Tassery
1231952fca Implement UUID type and toUuid function 2017-06-30 22:01:27 +02:00
Alexey Milovidov
2b67782845 Applied clang-format [#CLICKHOUSE-2]. 2017-06-28 15:30:23 +03:00
Alexey Milovidov
39ddcf1c74 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:24:49 +03:00
Alexey Milovidov
c6b83a1c60 Fixed build [#CLICKHOUSE-2]. 2017-06-28 15:22:07 +03:00
Marek Vavruša
e189c39056 SpaceSaving: internal storage for StringRef{} 
The SpaceSaving has now specialised storage for
some keys, which only copies keys that
are to be retained in the structure, not all.

Most of the PODs implement this interface empty,
so there shouldn’t be any extra cost.
 2017-06-26 21:16:13 +03:00
proller
4db8d09de9 Reorganize includes. part 1 (#921) 
* Make libunwind optional. Allow use custom libcctz

* fix

* Fix

* fix

* Update BaseDaemon.cpp

* Update CMakeLists.txt

* Reorganize includes. part 1

* Update dbms_include.cmake

* Reorganize includes. part 2

* Reorganize includes. part 3

* dbms/src/Common/ThreadPool -> libs/libcommon

* Reorganize includes. part 4

* Fix print_include_directories

* Update thread_creation_latency.cpp

* Update StringRef.h
 2017-06-23 23:22:35 +03:00
Alexey Milovidov
324fc7ef3e Miscellaneous [#CLICKHOUSE-3094]. 2017-06-23 08:39:27 +03:00
proller
70d9fb06b4 PerformanceTest: use getMultiple*FromConfig, fix debug helpers (#915) 
* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file
 2017-06-22 21:56:40 +03:00
proller
8ef51bf19b Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers (#905) 
* Fix missing includes

* ComplexKeyCacheDictionary: Move includes to .cpp

* Fixing PerformanceTest: table_exists condition, move getMemoryAmount function to file. Add more debug helpers

* Multiplatform memory size getter

* Requested changes

* Requested changes

* Requested changes

* fix

* Requested changes
 2017-06-22 18:57:37 +03:00
Alexey Milovidov
6df5d556e5 Changed namespace [#DEVTOOLS-3381]. 2017-06-21 11:35:38 +03:00
Alexey Milovidov
604de2bfeb Better [#DEVTOOLS-3381]. 2017-06-21 04:24:05 +03:00
Георгий Кондратьев
a736ef618a Put ClickHouse variant of CityHash into DB namespace [#DEVTOOLS-3381] 
This avoids symbol conflict when linking external applications that use another
variant of CityHash in the global namespace with ClickHouse libraries.
 2017-06-20 12:25:16 +03:00
alexey-milovidov
057b919f20 Update ArrayCache.h 2017-06-20 10:51:53 +03:00
alexey-milovidov
ec5d2c3914 Update Allocator.cpp 2017-06-20 10:51:53 +03:00
Георгий Кондратьев
4d57012c62 Fix older Darwin build [#DEVTOOLS-3381] 2017-06-20 10:51:53 +03:00
Alexey Milovidov
150d3bb60f Removed useless code [#CLICKHOUSE-2]. 2017-06-20 10:36:16 +03:00
Alexey Milovidov
1b17f6191b Addition to prev. revision [#DEVTOOLS-3381]. 2017-06-19 23:09:11 +03:00
Alexey Milovidov
05accbdcbe Removed cyclic dependency [#DEVTOOLS-3381]. 2017-06-19 23:06:35 +03:00
Alexey Milovidov
401d922a4b Tiny modifications [#CLICKHOUSE-3044]. 2017-06-18 09:11:49 +03:00
Alexey Milovidov
f51db5e1f6 Fixed build [#CLICKHOUSE-3044]. 2017-06-18 08:55:46 +03:00
Alexey Milovidov
a73790f17d Less dependencies [#CLICKHOUSE-2]. 2017-06-13 08:14:24 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
proller
f6f85440d4 Fix compile with gcc7 2017-06-13 02:50:34 +03:00
Alexey Milovidov
45c76803a9 Moved table functions to separate library; fixed errors; improved testability [#CLICKHOUSE-31]. 2017-06-10 12:04:31 +03:00
Alexey Milovidov
9c5ddce06d Get rid of .hpp files [#CLICKHOUSE-2]. 2017-06-06 20:18:32 +03:00
Alexey Milovidov
9ebf0b633f Added IStorage::startup method to avoid starting replication and merging threads too early during server startup [#CLICKHOUSE-2]. 2017-06-06 20:06:14 +03:00
Alexey Milovidov
862a304db2 Small refinements [#CLICKHOUSE-2]. 2017-06-01 16:41:58 +03:00
Vitaliy Lyudvichenko
6db8da82c6 Add requested changes. [#CLICKHOUSE-5] 2017-06-01 13:49:21 +03:00
Vitaliy Lyudvichenko
3a2c1a195d Add ZooKeeper session recovering and trashy integration test. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Vitaliy Lyudvichenko
209015574f Workable version for CREATE DROP w/o ZK tests. [#CLICKHOUSE-5] 2017-06-01 13:49:20 +03:00
Alexey Milovidov
0a55310076 Added comment [#CLICKHOUSE-3027]. 2017-05-24 21:49:30 +03:00
Alexey Milovidov
2e47c35fa9 Fixed error "zero number of streams requested" on Google Compute Engine VMs [#CLICKHOUSE-2037]. 2017-05-24 21:38:18 +03:00
Alexey Milovidov
66e209b492 Preparations, part 1 [#CLICKHOUSE-31]. 2017-05-23 21:01:50 +03:00
Marek Vavruša
74cc0849dc iostream_debug_helpers: fixed build 2017-05-13 03:58:05 +04:00
Marek Vavruša
45bd332460 AggregateFunctionTopK: fix memory usage, performance 
* allow separate table key / hash key, and use
  std::string / StringRef for generic variant as
  it has built-in storage and StringRef is supported
  by the hash table, this avoids infinitely
  growing arena with serialised keys
* use power-of-2 size for alpha vector for faster
  binning without using modulo
* use custom grower and allocator for SpaceSaving
  to start with smaller tables
* store computed hash in counter for faster
  reinsertion of smallest element
 2017-05-11 18:52:49 +04:00
Marek Vavruša
bc878f9785 Common/HashTable: allow cell reinsertion 
* fixes missing setHash on reinsert
* reuses hash when emplacing value
 2017-05-11 18:52:49 +04:00
Alexey Milovidov
e5e8667bc9 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 04:10:50 -04:00
Alexey Milovidov
a7b9a12759 Returned back Increment and CounterInFile, because they are still needed [#CLICKHOUSE-2]. 2017-05-10 04:08:32 -04:00
Alexey Milovidov
bb41d47096 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:50:37 -04:00
Alexey Milovidov
5ca7650c86 Removed Increment and CounterInFile [#CLICKHOUSE-2]. 2017-05-10 02:49:19 -04:00
Alexey Milovidov
e2f8ec8f2d Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-10 02:36:15 -04:00
Alexey Milovidov
542eba7e17 Fixed translation errors [#CLICKHOUSE-3]. 2017-05-10 00:30:33 -04:00
Alexey Milovidov
7bf7242ad3 Fixed translation errors; miscellaneous changes [#CLICKHOUSE-3]. 2017-05-10 00:00:19 -04:00
Alexey Milovidov
ff02af9804 Addition to prev. revision [#CLICKHOUSE-2]. 2017-05-09 22:45:21 -04:00
Alexey Milovidov
7fc3d90035 Renamed .inl file to .inl.h to avoid confusion [#CLICKHOUSE-2]. 2017-05-09 22:41:26 -04:00
Alexey Milovidov
8e5f92f025 Fixed translation errors, part 1 [#CLICKHOUSE-3]. 2017-05-09 15:07:35 -04:00
f1yegor
46db454562 translate comments 2017-05-09 13:03:35 -04:00
Alexey Milovidov
d3e6321967 AggregateFunctionTopK: minor modifications [#CLICKHOUSE-2]. 2017-05-05 16:36:02 -07:00
Alexey Milovidov
9d4c814b12 Aggregate function topK: style modifications [#CLICKHOUSE-2]. 2017-05-05 14:17:04 -07:00
Marek Vavruša
5f1e65b252 AggregateFunctions: implemented topK(n) 
This implements a new function for approximate
computation of the most frequent entries using
Filtered Space Saving with a merge step adapted
from Parallel Space Saving paper.

It works better for cases where GROUP BY x
is impractical due to high cardinality of x,
such as top IP addresses or top search queries.
 2017-05-03 23:09:52 -07:00
Maxim Fridental
e9d9abf328 Fix escaping of columns starting with a number 2017-04-29 23:40:34 -07:00
proller
2a1eceef03 Try fix macos build 2017-04-29 00:18:18 +03:00
proller
edcc18992b Try fix macos build (again) 2017-04-28 22:50:42 +03:00
proller
948d9c39cd Try fix macos build. Add more debug io helpers 2017-04-28 21:57:26 +03:00
proller
d00ae1a640 fix build on freebsd/macos 2017-04-26 18:16:36 +03:00
proller
cd4a5c040c More debug io helpers: some types from dbms (#725) 
* release: import options from jenkins script

* correct chdir

* limit parallel build threads

* VERSION_POSTFIX

* add postfix

* support BUILD_TYPE

* Removed unused.

* Fixed error [#CLICKHOUSE-2960].

* Fix version incrementing

* Fix message

* Fix build without icu and readline

* More io helpers: some types from dbms

* Requested changes
 2017-04-26 05:50:03 +03:00
Vladimir Chebotarev
0e0ccdccf1 dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 15:20:03 +03:00
Vladimir Chebotarev
79e72a685d dbms/src/Common: Comments for HyperLogLogCounter.h. [#CHEBOTAREV-4] 2017-04-21 12:58:21 +03:00
Alexey Zatelepin
baf0f70ba3 Failover if the needed table is missing on remote server [#CLICKHOUSE-2141] 2017-04-20 19:19:30 +03:00
Alexey Zatelepin
d1fa449f4a PR fixes [#CLICKHOUSE-2141] 2017-04-20 17:04:38 +03:00
Alexey Zatelepin
ba254a082e Merge branch 'master' into lagging-replicas-failover 
Conflicts:
	dbms/src/Core/ErrorCodes.cpp
 2017-04-19 21:31:29 +03:00
Alexey Zatelepin
c91828e5bf PR fixes [#CLICKHOUSE-2141] 2017-04-19 21:29:50 +03:00
Alexey Milovidov
be316af758 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:38:54 +03:00
Alexey Milovidov
0224468be3 Save stack trace on exception from typeid_cast [#CLICKHOUSE-4]. 2017-04-19 06:36:50 +03:00
alexey-milovidov
35abae95c8 Allow to disable ICU (#711) 
* Allow to disable ICU [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
 2017-04-19 04:06:29 +03:00
alexey-milovidov
c9c8c8ec50 Better option to disable mysqlclient (#710) 
* Better support for disabling libmysqlclient [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].

* Addition to prev. revision [#CLICKHOUSE-2].
 2017-04-19 03:25:57 +03:00
Alexey Zatelepin
aa62dc354f ensure that empty entries are not returned from PoolWithFailoverBase [#CLICKHOUSE-2141] 2017-04-18 16:37:00 +03:00
Alexey Milovidov
22e8b8029b Implemented ColumnArray::replicate for Nullable, Tuple and for generic case [#CLICKHOUSE-4]. 2017-04-18 06:03:39 +03:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
Alexey Zatelepin
0a98f43d3a add TablesStatus request to protocol [#CLICKHOUSE-2141] 2017-04-17 19:02:48 +03:00
Alexey Milovidov
41e97787e3 Less dependencies [#CLICKHOUSE-2]. 2017-04-16 08:40:17 +03:00
Alexey Milovidov
ef3557950c Less dependencies [#CLICKHOUSE-2952]. 2017-04-16 07:03:14 +03:00
Alexey Milovidov
83ed2a794b Fixed -ForEach combinator of aggregate functions [#CLICKHOUSE-2952]. 2017-04-16 06:38:37 +03:00
proller
824dc5c655 fix freebsd build (#677) 
* fix freebsd build

* Fix freebsd build

* fix freebsd build

* fix freebsd build

* Update ArrayCache.h

* good fix
 2017-04-11 22:39:43 +03:00
alexey-milovidov
d68ea42643 Fixed unbounded growth of total memory tracking (that hits max_memory_usage_for_all_queries limit) (#681) 
* MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Investigation [#CLICKHOUSE-2935].

* Added comment [#CLICKHOUSE-2935].
 2017-04-11 22:10:31 +03:00
proller
b01a65f922 Remove missing allocator_stress from cmake 2017-04-11 16:25:27 +03:00
Alexey Milovidov
6256a40199 Merge branch 'array-cache' 2017-04-11 05:53:50 +03:00
Alexey Milovidov
174ef70e0a Merge branch 'master' of github.com:yandex/ClickHouse 2017-04-11 05:53:39 +03:00
Alexey Milovidov
a37fa9ca6a Whitespace [#CLICKHOUSE-2]. 2017-04-11 05:53:29 +03:00
Alexey Milovidov
756df579b2 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-11 05:52:22 +03:00
Alexey Milovidov
5b29658aae MemoryTracker: more convenient for investigations [#CLICKHOUSE-2935]. 2017-04-11 00:43:59 +03:00
proller
72ccc69212 Debian: simpler package (#662) 
* Allow use external re2 with re2_st=re2

* fix

* remove dupe

* use re2_st in FunctionsStringSearch.h

* fix

* move files from tools/etc to debian

* dont generate control

* version

* ok.

* wip

* Cmake: dont touch CMAKE_INSTALL_PREFIX

* wip

* works!

* clean

* okay

* like old

* wip

* wip

* okay

* clickhouse-server-base-dbg

* clean

* clickhouse-server-dbg

* Debian: Remove daemons

* Update rules

* add source/format

* control clean

* add watch

* clean

* clean

* temp fix build

* clean

* docs

* fake make_control

* fix

* testme

* testme

* add metrika package

* fake metrika files
 2017-04-10 20:43:30 +03:00
Alexey Milovidov
ba108daf9d ArrayCache: development [#CLICKHOUSE-2]. 2017-04-10 03:24:58 +03:00
Alexey Milovidov
f418ed37cf ArrayCache: development [#CLICKHOUSE-2]. 2017-04-10 02:10:05 +03:00
Alexey Milovidov
5f8d99cbe9 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 10:02:13 +03:00
Alexey Milovidov
1005236a09 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:44:45 +03:00
Alexey Milovidov
5ededd6b51 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:39:26 +03:00
Alexey Milovidov
2d0421e801 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 09:29:26 +03:00
Alexey Milovidov
0ceb92b037 ArrayCache: development [#CLICKHOUSE-2]. 2017-04-09 08:19:50 +03:00
Alexey Milovidov
a0b9bf5e97 Moved code to cpp [#CLICKHOUSE-2]. 2017-04-08 04:32:05 +03:00
Yuri Dyachenko
ad79394799 add ClearableHashSetWithSavedHash 2017-04-07 20:12:54 +03:00
Alexey Milovidov
0f775ef20b Added missing modification [#CLICKHOUSE-2]. 2017-04-01 13:15:01 +03:00
Alexey Milovidov
5784e4a898 Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 13:10:04 +03:00
Alexey Milovidov
12dc10feaa Revert "Moved headers and sources to same place [#CLICKHOUSE-3]." 
This reverts commit abaa1501fc.
 2017-04-01 12:21:05 +03:00
Alexey Milovidov
abaa1501fc Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:19:00 +03:00
Alexey Milovidov
09e3134bf4 Revert "Using C++17 [#CLICKHOUSE-3]." 
This reverts commit 431a735efe.
 2017-04-01 11:51:30 +03:00
Alexey Milovidov
ecb0b87bd8 Using C++17 [#CLICKHOUSE-3]. 2017-04-01 11:51:30 +03:00
Alexey Milovidov
137ad95929 Changed tabs to spaces in code [#CLICKHOUSE-3]. 2017-04-01 11:35:09 +03:00
Alexey Milovidov
4f44445ff0 Removed all trailing whitespaces [#CLICKHOUSE-2]. find . -name '*.h' -or -name '*.cpp' -or -name '*.cmake' -or -name 'CMakeLists.txt' -or -name '*.html' -or -name '*.xml' | grep -v contrib | xargs sed -i -r -e 's/\s+$//' 2017-03-31 19:00:30 +03:00
Alexey Milovidov
14c8003081 Normalized formatting [#CLICKHOUSE-3]. 
Apply in a loop:
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '^(\t*)    ' | xargs sed -i -r -e 's/^(\t*)    /\1\t/'
 2017-03-26 04:28:07 +03:00
Alexey Milovidov
93890423f1 Fixed zero-width spaces [#CLICKHOUSE-3]. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l $'\xe2\x80\x8b' | xargs sed -i 's/'$'\xe2\x80\x8b''//g'
 2017-03-26 04:20:25 +03:00
f1yegor
bc0d9a2cae translate comments 2017-03-25 21:12:56 +01:00
proller
670e98fa92 allow several <graphite> targets (#603) 
* allow several <graphite> targets

* fix

* fix

* Adjustable parts

* changelog version

* fix

* changelog

* Style fixes

* attachSystemTables

* config describe

* fixes

* fixes
 2017-03-21 23:08:09 +04:00
Alexey Zatelepin
fccbc82c24 translate comments 2017-03-19 21:58:12 +04:00
Alexey Zatelepin
faadab3034 Allow including config elements from ZooKeeper [#CLICKHOUSE-2794] 2017-03-19 21:58:12 +04:00
proller
930ac5b2ce move ClickHouseRevision to dbms 2017-03-16 13:51:41 +04:00
proller
28ed324702 add cmake option USE_VECTORIZED_MATH_FUNCTIONS, reorganize auto configs 2017-03-16 13:51:41 +04:00
Alexey Milovidov
4e67e05835 Fixed error [#CLICKHOUSE-2]. 2017-03-14 03:14:19 +03:00
ks1322
afbd2f78d8 pager for command line client 2017-03-13 00:10:52 +03:00
Alexey Milovidov
5546f7f75b Normalized formatting [#CLICKHOUSE-3]. 2017-03-09 07:26:17 +03:00
Alexey Milovidov
7934475779 Added missing line [#CLICKHOUSE-2871]. 2017-03-05 06:37:34 +03:00
Alexey Milovidov
a706e96bc4 Added more metrics for StorageBuffer [#CLICKHOUSE-2871]. 2017-03-05 04:23:10 +03:00
Alexey Milovidov
8f9b70a1d7 Style [#CLICKHOUSE-2]. 2017-02-13 13:38:50 +03:00
Vitaliy Lyudvichenko
38c900bf2f Add request changes for #436 PR. 2017-02-07 23:43:31 +04:00
Vitaliy Lyudvichenko
67d8ce3568 Fast SIGINT handling and correct exception handling in Benchmark. [#CLICKHOUSE-2774] 2017-02-07 23:43:31 +04:00
artpaul
245b715723 #455 also update tmp_files_info_path when files_info_path is changed 2017-02-06 17:09:54 +05:00
Alexey Milovidov
b8ac19999c Settings 'max_memory_usage_for_user' and 'max_memory_usage_for_all_queries': do not interfere between different queries [#CLICKHOUSE-2796]. 2017-02-01 06:53:10 +03:00
Alexey Zatelepin
4ecfd44015 [#CLICKHOUSE-2115] PR changes: 
* do not insert produced value into the cache if the cache has been reset.
* less logging
* cosmetic fixes
 2017-01-31 22:45:10 +04:00
Alexey Zatelepin
0fdcdd7bdb Introduce LRUCache::getOrSet(), use it to avoid mark cache stampede [#CLICKHOUSE-2115] 2017-01-31 22:45:10 +04:00
proller
f8d1573946 Various arm64 compile fixes on utils (#394) 2017-01-25 23:17:13 +04:00
proller
f04dffc05c External dictionary profiling [#CLICKHOUSE-2197] (#381) 
* Profiling external cached dictonaries [#CLICKHOUSE-2197]

* style
 2017-01-25 22:40:44 +04:00
proller
f890af1f8d Remove code and includes from Collator.h, fix including <unicode/...> in dbms (#395) 2017-01-25 22:19:15 +04:00
Alexey Milovidov
58e5dad1a1 Squashed commit of the following: 
commit e712f469a5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:59:13 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a00282308
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:58:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9e06f407c8
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:55:14 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 9581620f1e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:54:22 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2a8564c68c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:47:34 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit cf60632d78
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:40:09 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit ee3d1dc6e0
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:22:49 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 65592ef711
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:18:17 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 37972c2573
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:17:06 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit dd909d1499
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:16:28 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 3cf43266ca
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:15:42 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 6731a3df96
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:13:35 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 1b5727e0d5
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:11:18 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit bbcf726a55
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:09:04 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit c03b477d5e
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:06:30 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 2986e2fb04
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:05:44 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit 5d6cdef13d
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:04:53 2017 +0300

    Less dependencies [#CLICKHOUSE-2]

commit f2b819b25c
Author: Alexey Milovidov <milovidov@yandex-team.ru>
Date:   Sat Jan 14 11:01:47 2017 +0300

    Less dependencies [#CLICKHOUSE-2]
 2017-01-14 12:00:19 +03:00
Alexey Milovidov
2b4f3b5d34 Renamed method (less confusion) [#METR-2944]. 2017-01-02 23:12:12 +03:00
Vitaliy Lyudvichenko
07d720565c Added profile events for INSERTs. [#METR-23930] 
Added new column and CurrentMetrics data into system.events table.
Removed unnecessary code from Context and Merge list. [#METR-23911]
 2016-12-31 02:39:53 +03:00
Vitaliy Lyudvichenko
108bfac17e Added memory tracking events and columns for merges. [#METR-23911] 2016-12-31 02:39:53 +03:00