thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 13:42:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
31,118 Commits 9,138 Branches 1,774 Tags 2 GiB
0fefebae1b
Commit Graph

2188 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
57b5592236 Work around garbage in roaring.h to fix Mac OS build. 2019-10-11 14:28:16 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Alexander Kazakov
03c7b7ff8d
Prevent from using non-deterministic functions in mutations of replicated tables (#7247) 
* Added isDeterministic() to IFunctionBuilder i-face
* A test for non-deterministic mutations
* In MutationsInterpreter::validate() ensure deterministic functions
* Adjusted nondeterministic mutation tests
* Moved around some code in MutationsInterpreter::validate()
* Dropped unnecessary check in findFirstNonDeterministicFuncName()
* Corrections to IFunction{Base,Builder} interface
 2019-10-10 17:38:08 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
alexey-milovidov
d096119529
Merge pull request #7156 from ClickHouse/fix-header-for-now 
Fix header for function 'now'
 2019-10-05 22:35:23 +03:00
proller
594c535bd4 Build fixes (#7063) 
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
 2019-10-05 22:25:31 +03:00
tavplubix
d73db7f779
Merge pull request #6781 from ClickHouse/merging_values_with_expressions 
Merging Values with expressions
 2019-10-04 12:51:22 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field 
Fix some MemorySanitizer warnings for Fields.
 2019-10-03 10:33:44 +03:00
Alexander Tokmakov
80e5976d10 fixes after review 2019-10-02 20:51:00 +03:00
Nikolai Kochetov
58a432be62 Updated functions today, yestarday, randConstant. 2019-10-01 13:15:20 +03:00
Nikolai Kochetov
b9b2ca342d Updated functions today, yestarday, randConstant. 2019-10-01 13:11:16 +03:00
Nikolai Kochetov
92ba6081a4 Updated functions today, yestarday, randConstant. 2019-10-01 13:10:07 +03:00
Nikolai Kochetov
0d94bdb6a1 Updated functions today, yestarday, randConstant. 2019-10-01 13:03:55 +03:00
Nikolai Kochetov
486deee1f1 Use new iface for now function. Use current time value from function builder. 2019-09-30 20:36:03 +03:00
Nikolai Kochetov
393bfdcd9f Use new iface for now function. Use current time value from function builder. 2019-09-30 20:31:36 +03:00
Alexander Tokmakov
979f235e38 Merge branch 'master' into merging_values_with_expressions 2019-09-30 18:06:58 +03:00
Nikolai Kochetov
963acff1d2 Use new iface for now function. Use current time value from function builder. 2019-09-30 17:59:04 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alesapin
4fdb5a61e5 Rename ExternalDictionaries to ExternalDictionariesLoader 2019-09-26 13:41:33 +03:00
alesapin
5668f55ab7 Rename ExternalModels to ExternalModelsLoader 2019-09-26 13:23:14 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables. 
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
 2019-09-24 17:44:35 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459 
Implement cross-compilation support Linux → Darwin
 2019-09-24 02:20:17 +03:00
alexey-milovidov
a314a36feb
Merge pull request #7062 from ClickHouse/fix-msan-for-low-cardinality 
Fix msan for LowCardinality
 2019-09-24 02:11:15 +03:00
alexey-milovidov
c4c936c685
Merge pull request #7049 from ClickHouse/ucasFL-master 
Merging function "repeat"
 2019-09-23 22:52:38 +03:00
alexey-milovidov
e24d882326
Merge pull request #7024 from millb/master 
Fixed Function Hex for Float32 and Float64
 2019-09-23 22:52:19 +03:00
Nikolai Kochetov
630872837e Skip null columns while checknig num rows. 2019-09-23 22:26:04 +03:00
millb
bd29efdbbe New hex function release 
Bugs and tests fixed
 2019-09-23 18:47:34 +03:00
Ivan Lezhankin
ce2fb6d3d1 Fix build 2019-09-23 17:46:01 +03:00
Nikolai Kochetov
61b583ccb9 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 17:19:02 +03:00
Nikolai Kochetov
f15bc77778 Fix size of constant columns in case of execution function over LowCardinality without allowed defaults. 2019-09-23 16:36:20 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
Alexey Milovidov
2585cde3d0 Added safety threshold 2019-09-23 02:49:15 +03:00
Alexey Milovidov
454b83fcd3 Merging function 'repeat' 2019-09-23 02:30:13 +03:00
Alexey Milovidov
52272eeea9 Merge branch 'master' of https://github.com/ucasFL/ClickHouse into ucasFL-master 2019-09-23 02:04:18 +03:00
alexey-milovidov
61b02598d7
Update repeat.cpp 2019-09-23 02:02:03 +03:00
alexey-milovidov
0dc4b1793d
Merge pull request #7036 from infinivision/fix_bitmapMax_doc 
fix bitmapMin and bitmapMax doc
 2019-09-23 01:49:04 +03:00
alexey-milovidov
6fa234cea4
Merge pull request #6894 from azat-archive/hashed-dict-memory-usage-v2 
[RFC] Add sparsehash support for hashed dictionary (to reduce memory usage)
 2019-09-22 15:55:36 +03:00
fenglv
4465fdb8bf Add test 
fix

fix

fix
 2019-09-22 14:25:43 +08:00
alexey-milovidov
67e02b4ea0
Merge pull request #6957 from infinivision/add_bitmapSubsetLimit 
added bitmapSubsetLimit
 2019-09-22 04:58:44 +03:00
Silviu Caragea
5a14d97587 Fix linking when __ELF__ is not defined 2019-09-22 01:04:17 +03:00
Zhichang Yu
ab7ecd84a1 fix bitmapMin and bitmapMax doc 2019-09-21 23:34:44 +08:00
Azat Khuzhin
420089c301
Add new dictionary layout (sparse_hashed) that is more memory efficient 
With this new layout, sparsehash will be used over default HashMap,
sparsehash is more memory efficient but it is also slower.

So in a nutshell:
- HashMap uses ~2x more memory then sparse_hash_map
- HashMap ~2-2.5x faster then sparse_hash_map
(tested on lots of input, and the most close to production was
dictionary with 600KK hashes and UInt16 as value)

TODO:
- fix allocated memory calculation
- getBufferSizeInBytes/getBufferSizeInCells interface
- benchmarks

v0: replace HashMap with google::sparse_hash_map
v2: use google::sparse_hash_map only when <sparse> isset to true
v3: replace attributes with different layout
v4: use ch hash over std::hash
 2019-09-21 02:22:40 +03:00
Alexander Tokmakov
0080639f79 Merge branch 'master' into merging_values_with_expressions 2019-09-20 23:26:01 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
967e00a8da It works! 
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
 2019-09-20 20:09:22 +03:00
millb
88adbb72d9 Fixed Function Hex for Float32 and Float64 2019-09-20 19:21:05 +03:00
fenglv
2062bedaf0 Add repeat function 2019-09-20 00:46:41 +08:00
Zhichang Yu
0dc3866c36 added bitmapSubsetLimit 2019-09-19 10:15:36 +08:00
alexey-milovidov
01a1920e9b
Merge pull request #6970 from infinivision/add_bitmapMin_bitmapMax 
added bitmapMin and bitmapMax
 2019-09-19 02:01:16 +03:00
Artem Zuikov
aae82eed5a
Merge pull request #6940 from 4ertus2/mjoin 
PartialMergeJoin
 2019-09-18 16:16:10 +03:00
Zhichang Yu
460ccb04a2 added bitmapMin and bitmapMax 2019-09-18 16:56:12 +08:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
Guillaume Tassery
bb088fbf65 Write dictionary permission on user instead of dictionary configuration 2019-09-13 10:22:34 +02:00
proller
0d6612d424 CLICKHOUSE-4652 Simpler 2019-09-12 22:52:24 +03:00
proller
8ce32897fa CLICKHOUSE-4652 Another fix for АrrayEnumerateUniqRanked with empty arrays 2019-09-12 22:38:34 +03:00
Alexander Tokmakov
f323476111 Merge branch 'master' into merging_values_with_expressions 2019-09-11 23:31:37 +03:00
Guillaume Tassery
5f1621faa2 Add database right for dictionaries 2019-09-11 13:14:55 +02:00
Amos Bird
bf799fef92 Build fix 2019-09-11 10:53:56 +08:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library 
Now the linking time of incremental builds are around 1-2 seconds
 2019-09-11 01:56:01 +08:00
chertus
1b313eedfa MergeJoin in progress 2019-09-09 22:43:37 +03:00
Denis Zhuravlev
50c32490be
Update arrayElement.cpp 
Typo in error message ( is -> are )
 2019-09-05 19:41:27 -03:00
Alexander Tokmakov
8936f854be better checking of types of literals 2019-09-04 19:54:20 +03:00
Zhichang Yu
cfac445144 fix bitmapSubsetInRange memory leak 2019-09-04 22:05:32 +08:00
alexey-milovidov
4f7d472cb7
Merge pull request #6048 from Akazz/ternary-logic-light 
Correct implementation of ternary logic for AND/OR
 2019-09-03 22:09:56 +03:00
alexey-milovidov
845a612b95
Merge pull request #6773 from infinivision/fix_issue_6575 
fix DataTypeAggregateFunction deserialization
 2019-09-03 21:19:41 +03:00
Zhichang Yu
fd0947899d fix 00980_shard_aggregation_state_deserialization.sql 2019-09-03 23:47:09 +08:00
Alexander Tokmakov
b9eb992320 Merge branch 'master' into merging_values_with_expressions 2019-09-02 19:54:56 +03:00
proller
184e2ef9ab CLICKHOUSE-4644 arrayEnumerateUniqRanked: fix for empty arrays 2019-09-02 18:49:25 +03:00
Alexander Tokmakov
46effbd7f6 Template for functions with constant arguments 2019-09-02 17:33:10 +03:00
Alexander Kuzmenkov
ab2bd54022 Remove a redundant condition (found by PVS-Studio). 2019-09-02 16:17:14 +03:00
Zhichang Yu
9e587fb139 fix DataTypeAggregateFunction deserialization 2019-09-02 20:09:40 +08:00
Alexey Milovidov
dcc6163d32 Added function "trap" 2019-09-01 00:39:17 +03:00
Alexey Milovidov
aac0b27daa Fixed possible deadlock in distributed queries 2019-08-31 15:18:14 +03:00
alexey-milovidov
2b124c5af8
Merge pull request #6718 from vitlibar/fix-extract-tuple-from-json 
Fix extracting a Tuple from JSON
 2019-08-29 17:40:26 +03:00
Vitaly Baranov
6cbb52128b Fix extracting tuple from JSON. 2019-08-29 01:55:35 +03:00
alexey-milovidov
16ba2fa85a
Merge pull request #6662 from Enmk/hasTokenCaseInsensitive 
Implemented hasTokenCaseInsensitive function
 2019-08-27 00:39:04 +03:00
Vasily Nemkov
d0d63d769e Implemented hasTokenCaseInsensitive function 
And tests;
 2019-08-26 11:00:48 +03:00
alexey-milovidov
03deb642d5
Merge pull request #6647 from yandex/fix-trim 
Fixed "trim" functions
 2019-08-24 17:36:38 +03:00
Alexey Milovidov
cc0157b293 Added a test 2019-08-24 02:07:05 +03:00
Alexey Milovidov
d38e9ee229 Fixed "trim" functions (in progress) 2019-08-23 23:32:31 +03:00
alexey-milovidov
eeeaf8fbee
Merge pull request #6643 from yandex/double-whitespaces 
Added a check for double whitespaces
 2019-08-23 23:10:12 +03:00
alexey-milovidov
012a5f8911
Merge pull request #6596 from Enmk/hasToken 
hasToken function implementation
 2019-08-23 21:41:33 +03:00
Alexey Milovidov
b42f85e16b Added a check for double whitespaces 2019-08-23 21:30:04 +03:00
Alexey Milovidov
20b9af29f5 More tests 2019-08-23 07:34:59 +03:00
Alexey Milovidov
6685365ab8 Added optimized case 2019-08-23 07:25:32 +03:00
Alexey Milovidov
341e2e4587 Step 1: make it correct. 2019-08-23 06:00:06 +03:00
Alexey Milovidov
1222973cb3 Function "neighbor": merging #5925 2019-08-23 05:02:14 +03:00
Alexey Milovidov
cff8ec43f9 Rename neighbour -> neighbor 2019-08-23 04:31:04 +03:00
alexey-milovidov
49aa9384af
Merge pull request #5925 from alex-krash/function_next_prev_in_block 
Implement neighbour() function
 2019-08-23 04:28:36 +03:00
Vasily Nemkov
6d78e3be94 hasToken function implementation 
* Function to check if given token is present in a string;
* Special case for hasToken to 'tokenbf_v1' index;
* Test cases for hasToken()
* Test case for hasToken() + 'tokenbf_v1' integration
 2019-08-22 18:00:35 +03:00
alexey-milovidov
f0e0793cdd
Merge pull request #6581 from yandex/assert_cast 
Added checks to static_cast of columns.
 2019-08-22 05:09:34 +03:00
Alexey Milovidov
e573b06373 Updated comment 2019-08-21 23:33:38 +03:00
Alexey Milovidov
93d380ddaa Fixed test 2019-08-21 23:32:58 +03:00
alexey-milovidov
e6fd885c68
Merge pull request #6580 from yandex/fix-nullif 
Fix nullIf function.
 2019-08-21 06:36:47 +03:00
alexey-milovidov
0e896fb341
Merge pull request #6578 from yandex/disable-elf-on-macos 
Disable ELF on Mac OS
 2019-08-21 06:01:49 +03:00
Alexey Milovidov
8966520801 Added "assert_cast" function as a replacement for static_cast for columns 2019-08-21 05:28:04 +03:00
Alexey Milovidov
b768bef4e3 Fixed nullIf function 2019-08-21 04:43:19 +03:00
Alexey Milovidov
69be2c4658 Fixed nullIf function 2019-08-21 04:28:55 +03:00
Alexey Milovidov
449dc4757a Fixed nullIf function 2019-08-21 04:20:06 +03:00
Alexey Milovidov
562bffb337 Fixed nullIf function 2019-08-21 04:14:25 +03:00
Alexey Milovidov
17e93b8f2d Disable ELF on Mac OS #6429 2019-08-21 03:48:34 +03:00
Nikolai Kochetov
0ab886ce9d Materialize constant in arrayWithConstant function. 2019-08-20 15:28:36 +03:00
Nikolai Kochetov
bfd0505d99 Fix tests. 2019-08-20 11:36:10 +03:00
Nikolai Kochetov
d359ff3d4a Fix build. 2019-08-19 21:34:12 +03:00
Nikolai Kochetov
56a9c3920f Fix build. 2019-08-19 21:28:48 +03:00
Nikolai Kochetov
d4363768e6 Added IFunctonBase::getResultIfAlwaysReturnsConstantAndHasArguments 2019-08-19 20:48:19 +03:00
Nikolai Kochetov
cb848159e1 Merged with master. 2019-08-18 14:52:49 +03:00
proller
d09c5c871b Build fixes (#6491) 
* Fix build

* cmake: fix cpuinfo

* Fix includes after processors merge

Conflicts:
	dbms/src/Processors/Formats/Impl/CapnProtoRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ParquetBlockOutputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowInputFormat.cpp
	dbms/src/Processors/Formats/Impl/ProtobufRowOutputFormat.cpp

* Fix build in gcc8

* fix test link

* fix test link

* Fix test link

* link fix

* Fix includes after processors merge 2

Conflicts:
	dbms/src/Processors/Formats/Impl/ParquetBlockInputFormat.cpp

* Fix includes after processors merge 3

* link fix

* Fix likely/unlikely conflict with cython

* Fix conflict with protobuf/stubs/atomicops.h

* remove unlikely.h

* Fix macos build (do not use timer_t)
 2019-08-18 01:53:46 +03:00
Nikolai Kochetov
86bba711c4 Merge branch 'master' into try-to-remove-dry-run 2019-08-17 13:43:14 +03:00
Nikolai Kochetov
7da72261a2 Merge branch 'master' into try-to-remove-dry-run 2019-08-16 15:50:48 +03:00
Nikolai Kochetov
2ef878d7ce Add alwaysReturnsConstant for IFunctionBase. Set alwaysReturnsConstant=true for ignore. 2019-08-15 22:31:43 +03:00
Nikita Vasilev
a051009d28 add it's a bug mes 2019-08-15 21:48:48 +03:00
Nikita Vasilev
f59fa67050 added type checks for set index functions 2019-08-15 21:46:16 +03:00
Alexandr Krasheninnikov
27b079bd6a Tests added, fix wrong behaviour 2019-08-15 11:59:20 +03:00
Nikolai Kochetov
867a7461dc Make randConstant const again. 2019-08-15 10:32:06 +03:00
alexey-milovidov
7a439e269f
Merge pull request #6470 from alex-krash/function_user 
Function currentUser()
 2019-08-14 20:09:54 +03:00
Nikolai Kochetov
287eb633b8 Merged with master 2019-08-14 18:16:52 +03:00
Nikolai Kochetov
5131b6af4b Fix header for joins. Make function randConstant not constant. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
16918c7dba Added more comments. 2019-08-14 18:14:32 +03:00
Nikolai Kochetov
de93b759c9 Return non-const column in ignoreExceptNull. 2019-08-14 18:14:32 +03:00
Alexandr Krasheninnikov
d9234a64c4 Make function return initial user 2019-08-14 15:18:11 +03:00
Alexandr Krasheninnikov
2126196c89 Nullable correct handling 2019-08-14 15:09:51 +03:00
Alexandr Krasheninnikov
986d56ba0c Fix casting style, work with Nullable 2019-08-14 14:32:03 +03:00
Alexandr Krasheninnikov
bc4177f64c Make alias case-insenstitive 2019-08-14 13:20:15 +03:00
Vitaly Baranov
75aa1d7858
Merge pull request #6320 from yandex/simdjson-sse42 
Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set
 2019-08-13 23:12:40 +03:00
Alexandr Krasheninnikov
e227611f01 New function currentUser() implemented 2019-08-13 19:05:13 +03:00
Vitaly Baranov
9632c4102a Change test to pass the exceeding of memory limit in ParsedJson::Iterator::Iterator when UBSan is used. 2019-08-13 18:26:31 +03:00
Alexandr Krasheninnikov
6bf3902ce5 Format file 2019-08-13 16:20:32 +03:00
Alexandr Krasheninnikov
ea9cf3a62f Done 2019-08-13 16:11:24 +03:00
Alexandr Krasheninnikov
9fa0b867f1 Merge branch 'master' of https://github.com/yandex/ClickHouse into function_next_prev_in_block 2019-08-13 11:45:00 +03:00
Alexandr Krasheninnikov
31fdc99efc In progress 2019-08-12 18:44:28 +03:00
Alexandr Krasheninnikov
1b54a52488 Temp 2019-08-12 17:10:29 +03:00
Alexandr Krasheninnikov
2e79158b5c Merge branch 'master' of https://github.com/yandex/ClickHouse into function_next_prev_in_block 2019-08-12 12:59:11 +03:00
Guillaume Tassery
3f572a45b7 Fix nullIf when we have a null constant on the right argument 2019-08-12 10:46:58 +02:00
Alexey Milovidov
45b88adedc Merge branch 'master' into fix-array-enumerate-uniq-ranked 2019-08-11 00:35:37 +03:00
alexey-milovidov
30f8529e04
Merge pull request #6325 from kreuzerkrieg/Shadow4GCC 
adding -Wshadow for GCC
 2019-08-10 17:29:10 +03:00
Alexey Milovidov
7e6b1333a1 Renamed Yandex CTO just in case 2019-08-10 00:58:17 +03:00
kreuzerkrieg
112fc71276 adding -Wshadow for GCC 2019-08-09 23:58:16 +03:00
Alexey Milovidov
f636a4c2c1 Fixed arrayEnumerateUniqRanked function (TODO: simplify code as much as possible) 2019-08-09 20:25:19 +03:00
alexey-milovidov
80e68a803b
Merge pull request #6374 from dimarub2000/fix_toFloat_monotonicity 
toFloat() monotonicity fixed
 2019-08-08 19:11:38 +03:00
dimarub2000
90010c4040 Changed to a more suitable name 2019-08-08 11:41:38 +03:00
alexey-milovidov
99fad0904b
Merge pull request #6314 from infinivision/add_bitmapRange 
added bitmapRange function
 2019-08-08 04:51:48 +03:00
Alexey Milovidov
cfe3112bf2 Enabled SIMDJSON for SSE 4.2 with PCLMUL instruction set 2019-08-07 15:07:34 +03:00
dimarub2000
7f26e09160 toFloat() monotonicity fixed 2019-08-07 12:22:33 +03:00
Alexander Kuzmenkov
224ed0ca67 Revert wrong merge commit. 
This reverts commit 9cd9c69449.
 2019-08-06 17:59:19 +03:00
Vasily Nemkov
9cd9c69449 geohashesInbox(lon_min, lat_min, lon_max, lat_max, precision) function (#6127) 2019-08-06 17:57:17 +03:00
Vasily Nemkov
fcb0482830 Implement geohashesInBox function. #6127 2019-08-06 17:53:06 +03:00
alexey-milovidov
416a498b0f
Merge pull request #6329 from Vdimir/throwif-custom-message-5772 
Added optional message argument in throwIf (#5772)
 2019-08-06 17:27:46 +03:00