thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-10-09 18:10:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
37,451 Commits 8,985 Branches 1,770 Tags 2.1 GiB
a70a9e5383
Commit Graph

2445 Commits

Author SHA1 Message Date
alexey-milovidov
056aba49ff
Update QueryProfiler.cpp 2020-01-26 14:27:12 +03:00
alexey-milovidov
9602e67050
Update QueryProfiler.cpp 2020-01-26 14:25:28 +03:00
Alexey Milovidov
2acb71337f Added workaround for Google Cloud Runner 2020-01-26 14:19:04 +03:00
alexey-milovidov
9814831c8f
Merge pull request #8827 from zlobober/disable_mmap 
Allow disabling mmapping
 2020-01-25 23:42:04 +03:00
alexey-milovidov
ab172eb0bd
Revert "Initialize query profiler for all threads in a group" 2020-01-25 23:34:22 +03:00
Maxim Akhmedov
2f12866bc2 Introduce macro for disabling allocator mmapping. 2020-01-25 22:17:18 +03:00
alexey-milovidov
1630e88c81
Merge pull request #8820 from abyss7/issue-6964 
Initialize query profiler for all threads in a group
 2020-01-25 21:33:46 +03:00
alexey-milovidov
df4f0c7379
Merge pull request #8805 from azat/force_optimize_skip_unused_shards 
force_optimize_skip_unused_shards setting to throw if skipping is not possible
 2020-01-25 17:37:59 +03:00
Alexey Milovidov
bf59e09901 Fixed style check 2020-01-25 16:18:17 +03:00
alexey-milovidov
2627e34ddf
Merge pull request #8808 from zlobober/weak_check_stack_size 
Make checkStackSize symbol weak.
 2020-01-25 03:10:41 +03:00
alexey-milovidov
8bde8e5e14
Update checkStackSize.cpp 2020-01-25 03:10:09 +03:00
alexey-milovidov
095f666677
Update checkStackSize.cpp 2020-01-25 03:06:13 +03:00
Azat Khuzhin
6939ffeabf force_optimize_skip_unused_shards setting to throw if skipping is not possible 2020-01-24 21:15:40 +03:00
Ivan Lezhankin
9d30f3c876 Initialize query profiler for all threads in a group 2020-01-24 17:47:38 +03:00
Alexey Milovidov
b1fcea78b8 Merge branch 'fix-paren' 2020-01-24 07:05:32 +03:00
Alexey Milovidov
3a5c7370b2 Addition to prev. revision #8811 2020-01-24 07:05:15 +03:00
alexey-milovidov
2105c02e85
Merge pull request #8811 from ClickHouse/fix-paren 
Fixed bug with parentheses
 2020-01-24 07:04:13 +03:00
Alexey Milovidov
12d980259e Fixed bug with parentheses 2020-01-24 05:38:03 +03:00
Maxim Akhmedov
af54c378ce Make checkStackSize symbol weak. 2020-01-23 23:30:40 +03:00
Ivan Lezhankin
a982309cff Fix client hanging on quit 2020-01-23 12:42:58 +03:00
Alexey Milovidov
2a6b9fbeb4 Merge branch 'master' into oandrew-avro 2020-01-22 22:37:07 +03:00
Ivan Lezhankin
7706e0a35c Some renames 2020-01-22 18:20:19 +03:00
Nikita Mikhaylov
97144cb645 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2020-01-22 14:51:05 +03:00
Ivan Lezhankin
2899fbfb52 Remove unused diff 2020-01-21 19:43:42 +03:00
Ivan Lezhankin
d444bc7a11 Remove unused diff 2020-01-21 19:39:52 +03:00
Ivan Lezhankin
008faaa760 Add settings for soft limit raising. 2020-01-21 19:39:52 +03:00
Ivan Lezhankin
1934706ca9 [WIP] 2020-01-21 19:39:52 +03:00
Ivan Lezhankin
c566f406c5 Add new trace type to system.trace_log table 2020-01-21 19:39:52 +03:00
CurtizJ
9275225527 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-21 17:21:52 +03:00
Alexey Milovidov
ae7b9a652b Merge branch 'vfs-s3' of https://github.com/GrigoryPervakov/ClickHouse into GrigoryPervakov-vfs-s3 2020-01-19 01:12:05 +03:00
Alexey Milovidov
457c50c7d7 Code cleanups around 2020-01-18 23:19:10 +03:00
Alexey Milovidov
c0a5c664a9 Replace readline to replxx: docs and corrections 2020-01-18 18:44:08 +03:00
Pervakov Grigory
70e50ecf10 Base implementation of IDisk interafce for S3 2020-01-17 14:34:39 +03:00
CurtizJ
27750f0cd4 Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-15 19:36:35 +03:00
alexey-milovidov
4dd5da353a
Merge pull request #8286 from amosbird/grouparraysample 
groupArraySample
 2020-01-13 20:57:27 +03:00
alexey-milovidov
303b146a93
Merge branch 'master' into vfs_log 2020-01-12 20:16:30 +03:00
Alexey Milovidov
797b1b9cd5 Fixed error code of test assertion in client 2020-01-12 16:47:56 +03:00
Alexey Milovidov
cc609143e9 Make one unit test more maintainable 2020-01-11 16:28:24 +03:00
Pradeep Chhetri
4941fdfe4b Fix some spelling mistakes 2020-01-11 17:51:33 +08:00
alexey-milovidov
bfda1ff807 Update FileChecker.cpp 2020-01-11 00:54:47 +03:00
Alexander Burmak
26511b7978 Added DiskMemory and tests 2020-01-11 00:43:42 +03:00
Alexander Kuzmenkov
3999675383 In debug builds, treat LOGICAL_ERROR as an assertion failure. 2020-01-09 19:58:32 +03:00
Alexander Burmak
c4f44bb06c Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-09 16:29:03 +03:00
CurtizJ
33ae97894b Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-01-09 15:54:37 +03:00
Alexey Milovidov
16f9628513 Fixed error 2020-01-06 09:19:12 +03:00
Alexey Milovidov
be90d33797 Avoid MSan report for data from libunwind 2020-01-06 05:15:31 +03:00
alexey-milovidov
42226b1a96
Added setting "min_bytes_to_use_mmap_io" (#8520) 
* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io"

* Added setting "min_bytes_to_use_mmap_io": better error message

* Added setting "min_bytes_to_use_mmap_io": fixed error
 2020-01-04 08:46:50 +03:00
Alexey Milovidov
ab001c5b3a Fixed build 2020-01-02 21:55:45 +03:00
Alexey Milovidov
9e78683c87 Fixed build 2020-01-02 19:32:17 +03:00
Alexander Burmak
70b3a1a0d8 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2020-01-02 18:01:41 +03:00
Alexey Milovidov
909ac8dcb8 Fixed build 2020-01-02 13:29:59 +03:00
Alexey Milovidov
18a27d532c Stack trace for every exception (experimental) 2020-01-02 10:59:18 +03:00
Alexey Milovidov
c1699b9555 Stack trace for every exception (experimental) 2020-01-02 10:37:13 +03:00
Alexey Milovidov
3367e42297 Stack trace for every exception (experimental) 2020-01-02 10:16:02 +03:00
Alexey Milovidov
73ae5ab7fc Stack trace for every exception (experimental) 2020-01-02 10:09:56 +03:00
Alexey Milovidov
67afaa9d93 Stack trace for every exception (experimental) 2020-01-02 09:56:53 +03:00
Alexey Milovidov
92ddcf6a41 Removed obsolete unmaintained test 2019-12-31 07:42:26 +03:00
Alexey Milovidov
3339b8e0e5 Make "mark_cache_min_lifetime" setting obsolete 2019-12-31 05:47:10 +03:00
Nikita Mikhaylov
f0e4b0c013 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2019-12-30 14:55:11 +03:00
Alexey Milovidov
579137486b Added aggregate function aggThrow 2019-12-28 07:23:08 +03:00
Alexander Burmak
9df9983641 Added fileName and parentPath utility functions 2019-12-27 13:42:30 +03:00
Amos Bird
1b52b8cbd5
groupArraySample 2019-12-27 11:41:11 +08:00
Alexander Burmak
3f1832355f Added WriteMode enumeration 2019-12-26 17:28:22 +03:00
Alexander Burmak
764b506fd5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs_log 2019-12-26 17:03:32 +03:00
Nikita Mikhaylov
ea6c894656 Merge branch 'master' of github.com:ClickHouse/ClickHouse into cache-dictionary 2019-12-26 12:01:43 +03:00
Nikita Mikhaylov
208db45668 add condvar usage and better code 2019-12-26 00:43:12 +03:00
CurtizJ
4bd4ac715c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-25 03:10:24 +03:00
Alexey Milovidov
80f42a1f3b Show physical addresses in StackTrace 2019-12-24 23:07:44 +03:00
Alexey Milovidov
f04a2a5f7b Fixed Darwin build 2019-12-23 19:54:51 +03:00
Alexander Burmak
0894ed9f33 Integration of log storages with IDisk interface 2019-12-23 16:11:56 +03:00
Alexey Milovidov
e0000bef98 Added "system.stack_trace" table (development) 2019-12-22 20:20:33 +03:00
Alexey Milovidov
61dbd52a3f Fixed build after updating libcxx 2019-12-20 21:44:40 +03:00
CurtizJ
9db2f2ccbc Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2019-12-19 14:46:43 +03:00
Alexey Milovidov
d0073ac7cf Minimal change in preparation for #7477 2019-12-18 19:47:51 +03:00
kreuzerkrieg
9612bb0e79 More GCC warnings 2019-12-16 23:19:50 +02:00
alexey-milovidov
d0ef4b6b96
Merge branch 'master' into more-accurate-using-load-reload 2019-12-16 02:42:45 +03:00
zhang2014
713923e451 Support detach and drop table for mysql database engine 2019-12-13 19:48:38 +08:00
Vladimir Chebotarev
e413cd6e6c Fixed metrics in BackgroundProcessingPool. 2019-12-13 01:08:54 +03:00
Alexey Milovidov
8580f8b56c Proper fix for #8147 2019-12-12 21:53:48 +03:00
Vitaly Baranov
4c157007f5 Refactoring of using ExternalLoader in dictionary DDL: 
Instead of using ExternalLoader::reload() now it's used reloadConfig() which reloads only what necessary.
Functions attachDictionary() and detachDictionary() are simplified and have lesser number of parameters.
Instead of injecting into LoadablesConfigReader's internals for creating dictionary a temp repository is used.
 2019-12-12 21:45:58 +03:00
alexey-milovidov
51ed10ed78
Merge pull request #8011 from Jokser/aws-s3-sdk-integration 
AWS SDK S3 integration
 2019-12-12 20:43:16 +03:00
Alexander Burmak
2ce6136de5 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-12 12:10:50 +03:00
Vladimir Chebotarev
33ded274a3 First attempt to store min/max for move ttl expressions. 2019-12-11 13:24:20 +03:00
alexey-milovidov
aecd5a5493
Merge pull request #8123 from ClickHouse/aku/field-prepare 
Prepare for stricter type checking in Field.
 2019-12-11 02:21:34 +03:00
Alexander Kuzmenkov
50a8a7197f Prepare for stricter type checking in Field. 2019-12-10 16:40:45 +03:00
Vladimir Chebotarev
269a0246aa Added explicit check for existence of part and pair of log messages. 2019-12-10 12:47:23 +03:00
Alexander Burmak
5a93441445 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-09 17:18:47 +03:00
alexey-milovidov
0d278b414c
Merge pull request #8046 from amosbird/interpose 
Interpose malloc symbols entirely.
 2019-12-09 04:33:49 +03:00
Alexander Burmak
edd11abad1 Addressed code review comments 2019-12-08 19:47:51 +03:00
Alexander Burmak
8104395dd2 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-08 11:45:18 +03:00
Amos Bird
971770a040
Interpose malloc symbols entirely. 2019-12-07 00:32:00 +08:00
Pavel Kovalenko
c840fdefc0 Merge branch 'master' into aws-s3-sdk-integration 
# Conflicts:
#	dbms/src/Common/ErrorCodes.cpp
#	dbms/src/IO/ReadBufferFromS3.cpp
#	dbms/src/IO/ReadBufferFromS3.h
#	dbms/src/IO/WriteBufferFromS3.cpp
#	dbms/src/IO/WriteBufferFromS3.h
#	dbms/src/Storages/StorageS3.cpp
 2019-12-06 17:52:29 +03:00
Pavel Kovalenko
a9dfefd37f AWS SDK integration rework. 2019-12-06 17:37:21 +03:00
Nikita Mikhaylov
6fc5248a27
Merge branch 'master' into limit_with_ties 2019-12-06 13:16:54 +03:00
Nikita Mikhaylov
4946409a78
Merge branch 'master' into limit_with_ties 2019-12-05 21:58:47 +03:00
Vitaly Baranov
6306e2ab91 Add DCL to manage quotas. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
8035af3a79 Make Field::getScaleMultiplier() inline to allow using FieldVisitorConvertToNumber 
in the "clickhouse_parsers" library.
 2019-12-05 21:03:57 +03:00
Vitaly Baranov
3e6619c076 Move IntervalKind-related functions to a separate file. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
0e21673271 Rework Quota based on IAccessEntity. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
7db6c60bb1 Add AccessControlManager and an interface for the storage. 2019-12-05 21:03:57 +03:00
Vitaly Baranov
44f3ab5f96 Extend typeid_cast() for shared_ptr. 2019-12-05 21:03:57 +03:00
CurtizJ
bd08520436 polymorphic parts (development) 2019-12-05 16:23:36 +03:00
alesapin
2a43daec5c Buildable code 2019-12-03 20:15:16 +03:00
alesapin
20e4e92c49 Fix some conflicts 2019-12-03 19:32:41 +03:00
Pavel Kovalenko
a9e2327ec0 AWS S3 SDK integration. 2019-12-03 19:23:24 +03:00
Alexander Burmak
21623c3308 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-12-03 18:16:19 +03:00
alexey-milovidov
f09c29a2b6
Merge pull request #7992 from ClickHouse/excitoon-favorites-s3auth 
Merging #7623
 2019-12-03 15:21:12 +03:00
alexey-milovidov
0c904f1484
Merge pull request #7721 from 4ertus2/decimal 
Basic GatherUtils support for Decimals
 2019-12-03 05:15:38 +03:00
Alexey Milovidov
8fa05a212b Fixed bug in #7623 2019-12-03 04:22:25 +03:00
Ivan Lezhankin
2118b33d9a Replace SIGRTMIN with SIGTSTP 2019-12-02 20:29:19 +03:00
Ivan Lezhankin
0e276ad887 Fix build 2019-12-02 14:29:52 +03:00
Ivan Lezhankin
4f56e03729 Use SIGRTMIN instead of SIGPROF for user debugging purposes 2019-12-02 13:50:57 +03:00
Alexander Burmak
e5ffdc0224 Merge remote-tracking branch 'refs/remotes/upstream/master' into vfs 2019-11-29 18:27:56 +03:00
stavrolia
295633b7ef Another try 2019-11-28 17:31:35 +03:00
Alexander Burmak
910ceb67b3 Fixed darwin buils 2019-11-27 18:49:15 +03:00
stavrolia
f23273fa80 Fix 2019-11-27 17:29:00 +03:00
Alexander Burmak
3e5ef56644 Filesystem abstraction layer 2019-11-27 14:33:27 +03:00
Alexey Milovidov
2d9d116267 Slightly better exception messages 2019-11-23 03:18:56 +03:00
Nikita Mikhaylov
02b0101fc8 Merge branch 'master' of github.com:ClickHouse/ClickHouse into limit_with_ties 2019-11-19 18:00:16 +03:00
Vitaly Baranov
681f03c625
Merge pull request #7653 from vitlibar/skip-unknown-settings-with-warnings 
Skip unknown settings with warnings.
 2019-11-18 13:50:52 +03:00
Vitaly Baranov
ff6cba192b Replace pointer with reference in SettingsCollection<T>::MemberInfos::findStrict(). 
Rename SettingsCommon.h -> SettingsCollection.h for consistency.
 2019-11-17 03:51:51 +03:00
alexey-milovidov
87c6a63b65
Update gtest_pod_array.cpp 2019-11-15 18:00:10 +03:00
Dmitrii Kovalkov
ea177061e8 Fix PODArray.insert 2019-11-15 17:36:52 +03:00
Alexey Milovidov
1c975a46e7 Fallback for unknown CPUs when using libcpuid #5239 2019-11-12 00:01:55 +03:00
Alexey Milovidov
47f577d963 Indent 2019-11-11 23:56:11 +03:00
chertus
03933a1039 gather utils for Decimals (no scale checks) 2019-11-11 19:18:37 +03:00
Amos Bird
3707da4fbf
Better addBatchArray aggregator 2019-11-11 16:56:11 +08:00
millb
7a2dcf451a Merge branch 'master' into url_engine_problem 2019-11-08 02:19:09 +03:00
Alexander Kuzmenkov
233212ac68
Merge pull request #7531 from amosbird/getkeymapped 
Unify hash tables interface (separated for review)
 2019-11-06 13:49:39 +03:00
Vladimir Chebotarev
9446edb42a
Fixed bug with keep_free_space_ratio not being read from disks configuration. 2019-11-06 07:59:35 +03:00
Amos Bird
fbfbe161ec
Unify hash tables interface. 2019-11-06 00:08:04 +08:00
Nikita Mikhaylov
c5b4707e92 exception 2019-11-05 18:49:13 +03:00
Alexander Kuzmenkov
36a9ac86b8 More verbose error message in macros. 2019-11-05 17:02:38 +03:00
millb
a03f8145bb Created check for HDFS and S3 storages 
:
 2019-11-05 15:40:49 +03:00
millb
d62cd6efa8 Merge branch 'master' into url_engine_problem 2019-11-05 14:42:53 +03:00
Amos Bird
ad12099642
ubsan fix 2019-11-02 17:00:03 +08:00
Vitaly Baranov
56011d4649
Merge pull request #7553 from vitlibar/add-constraints-columns-to-table-system-settings 
Add constraints columns to table system.settings
 2019-10-31 19:06:46 +03:00
Vitaly Baranov
5601d6ae66 Add constraints columns to table system.settings 2019-10-31 01:45:57 +03:00
Ivan
4f2f5cca84
Add support for cross-compiling to the CPU architecture AARCH64 (#7370) 2019-10-30 10:01:53 +03:00
millb
c154675a17 fixed_merge_conflict:wq 2019-10-29 13:30:47 +03:00
Mikhail Korotov
57f6780136
Update ErrorCodes.cpp 2019-10-29 14:39:57 +03:00
alesapin
a6199b7e69 Merge with master 2019-10-24 12:33:40 +03:00
Amos Bird
295864e6e0
better scalar query 2019-10-23 21:37:54 +08:00
Alexander Kuzmenkov
1a609c27bd
Merge pull request #6243 from ClickHouse/aku/hashtables 
Introduce String Hash Map to speed up aggregation over short string keys.
 2019-10-23 12:52:50 +03:00
alesapin
4c5d150d7a Review fixes 2019-10-22 13:47:43 +03:00
Alexander Kuzmenkov
dfd9f26652 Port the latest dispatch() improvements. 2019-10-22 13:44:08 +03:00
Vladimir Chebotarev
395e63ddf1
Fixed erroneous warning max_data_part_size is too low #7414 2019-10-22 12:24:30 +03:00
Alexander Kuzmenkov
d865aeba9b Review fixes. 2019-10-21 17:54:53 +03:00
millb
8b8ca9a141 Support redirect improvement 2019-10-21 17:45:57 +03:00
Amos Bird
a864447802 Introduce String Hash Map. 
It speeds up aggregation over short string keys. Use it as a default
aggregation method for string keys.
 2019-10-21 16:27:35 +03:00
alesapin
26c87e46c9 Merge branch 'master' into dictionaries_ddl_loader 2019-10-21 11:46:49 +03:00
alesapin
35e66d6696 Merge with master 2019-10-21 11:46:11 +03:00
millb
f64f6658ce Merge branch 'master' into url_engine_problem 2019-10-21 11:44:31 +03:00
Alexander Kuzmenkov
5e2cc37381
Distinguish Array and Tuple field types when creating from array of Fields. (#7179) 2019-10-18 18:57:05 +03:00
alesapin
71cbe878fc
Merge pull request #7374 from millb/fixed_getMultipleValuesFromConfig 
Fixed function getMultipleValuesFromConfig
 2019-10-18 11:55:41 +03:00
Mikhail Korotov
a1f417a537
Update gtest_getMultipleValuesFromConfig.cpp 2019-10-18 00:07:27 +03:00
millb
26d9ee3ae5 Fixed bug with function getMultipleValuesFromConfig and added test which confirms this. 2019-10-17 19:52:47 +03:00
tavplubix
0046b9f137 Wait for jobs to finish on exception (fixes rare segfaults) (#7350) 2019-10-17 17:41:27 +03:00
Amos Bird
dd128e9e1d Build fix 2019-10-16 10:49:29 +08:00
alesapin
f850408ae4 Convert AST to Abstract configuration 2019-10-15 15:16:19 +03:00
alesapin
1ce0eb6e63 Appropriate error codes numbers 2019-10-14 13:04:10 +03:00
alesapin
155731a676 Merge branch 'master' into dictionaries_ddl_interpreter 2019-10-14 11:49:18 +03:00
Alexander Kuzmenkov
31bd359100
Merge pull request #7231 from ClickHouse/aku/podarray-includes 
Include PODArray.h into fewer files.
 2019-10-12 15:08:41 +03:00
alesapin
ae42dc0d4c Attach detach and introspection queries for dictionaries 2019-10-11 16:21:52 +03:00
Alexander Kuzmenkov
8a1d57bddb Include PODArray.h into fewer files. 2019-10-11 14:28:16 +03:00
Vitaly Baranov
18ccb4d64d Move backQuote() and quoteString() to a separate file, use StringRefs. 2019-10-11 00:18:52 +03:00
alesapin
2a5713e6e4 Compilable code 2019-10-10 23:47:47 +03:00
alesapin
67fc3347c2 Preparing databases for dictionaries 2019-10-10 20:33:01 +03:00
Mikhail Korotov
7b62fc68cf
Update RemoteHostFilter.cpp 2019-10-10 16:53:52 +03:00
Mikhail Korotov
375866936d
Update RemoteHostFilter.h 2019-10-10 16:53:26 +03:00
millb
a00089f0b4 Renamed StorageOfAllowedURL -> RemoteHostFilter 2019-10-10 15:58:06 +03:00
millb
a97739f67f Created class StorageOfAllowedURL 
Created test for table function remote and remoteSecure
Created check allowed url in remote and remoteSecure
Fixed tests
 2019-10-09 23:29:41 +03:00
millb
fec1c6deba Fixed Error message and error code 2019-10-09 14:16:14 +03:00
Alexey Milovidov
9f8d562543 Add function "getMacro" #7239 2019-10-09 04:14:57 +03:00
alexey-milovidov
5c2d478543
Merge pull request #7212 from ClickHouse/aku/field-includes 
Include Field.h and FieldVisitor.h into fewer files.
 2019-10-08 22:40:30 +03:00
Alexander Kuzmenkov
2b30f2696c Include Field.h in less files. 2019-10-08 16:23:24 +03:00
Azat Khuzhin
92c88248a1 Fix uniqCombined() result for >UINT_MAX values (return UInt64 to avoid overflow) 
uniqCombined() return type is UInt64, but uniqCombined() uses
CombinedCardinalityEstimator, and CombinedCardinalityEstimator::size()
return type is UInt32, while the underlying HyperLogLog::size() is
UInt64.

So after this patch uniqCombined() can be used for >UINT_MAX values, the
outcome is not ideal (#2073) but at least sane.
 2019-10-07 21:38:58 +03:00
Alexander Kuzmenkov
367c537106 Do not include Field.h everywhere through SettingsCommon.h. 
Move the methods of SettingsCollection<> that are dependent on Field to
a separate file, and include it once for each instantiation. This allows
to work on Field without always recompiling the entire project.
 2019-10-07 20:23:05 +03:00
proller
594c535bd4 Build fixes (#7063) 
* Build fixes

*            fix

* Fix

* fix

* Fix install(export..

* Freebsd fixes

* Freebsd fixes

* Fix warning

* fix

* More PRIVATE linking

* Fix review

* Timmy

* fix

* fix
 2019-10-05 22:25:31 +03:00
Alexander Kuzmenkov
8e245d4e8c
Merge pull request #7135 from ClickHouse/aku/msan-field 
Fix some MemorySanitizer warnings for Fields.
 2019-10-03 10:33:44 +03:00
chertus
3b0d870804 rename function 2019-10-02 15:06:34 +03:00
chertus
c46cc3ff1a refactoring: remove copy-paste 2019-10-01 21:51:33 +03:00
millb
9246f258e8 Created ability to configure allowed URL in config.xml without tests. 2019-09-30 18:29:05 +03:00
Alexander Kuzmenkov
ec2d9a083c Remove excessive includes. 2019-09-30 15:31:14 +03:00
alexey-milovidov
a2fc7e2e9e
Merge pull request #7093 from millb/merges_counter_metric 
Add merge metric
 2019-09-26 21:49:43 +03:00
alexey-milovidov
87a6d3b222
Update ProfileEvents.cpp 2019-09-26 21:49:30 +03:00
millb
259be751ee Fixed metric name. 
Add metric description.
Add test.
 2019-09-26 15:06:52 +03:00
millb
97a2ae176b Add CountOfMerges metric 2019-09-25 13:37:43 +03:00
Alexey Milovidov
ff07ffbbae Merge branch 'merging_redis' of https://github.com/CurtizJ/ClickHouse into CurtizJ-merging_redis 2019-09-25 02:27:05 +03:00
Alexander Kuzmenkov
b949cc232b Mark lookupResultGetKey/Mapped functions ALWAYS_INLINE. 
They only do pointer arithmetics, so it makes sense to always inline
them.
 2019-09-24 22:03:10 +03:00
Alexander Kuzmenkov
f3bde19b74 Do not use iterators in find() and emplace() methods of hash tables. 
Instead, these methods return a pointer to the required data as they are
stored inside the hash table. The caller uses overloaded functions to
get the key and "mapped" values from this pointer. Such an interface
avoids the need for constructing iterator-like wrapper objects, which is
especially important for compound hash tables such as the future
StringHashMap.
 2019-09-24 17:44:35 +03:00
Alexey Milovidov
dcd40d1d07 Better log messages about disks 2019-09-24 03:45:40 +03:00
alexey-milovidov
2f195ddb03
Merge pull request #7028 from abyss7/issue-6459 
Implement cross-compilation support Linux → Darwin
 2019-09-24 02:20:17 +03:00
alexey-milovidov
e9bfe99dd8
Merge pull request #7072 from silviucpp/silviu-osx-stack 
Get proper stack address on osx
 2019-09-24 02:09:24 +03:00
alexey-milovidov
e2cc551b22
Merge pull request #6914 from maqroll/master 
+ Redirect URL Storage
 2019-09-24 02:07:06 +03:00
Silviu Caragea
d187b5ed42 Get proper stack address on osx 2019-09-23 22:47:12 +03:00
Alexey Milovidov
8579c26efb Changed repository URL 2019-09-23 19:18:19 +03:00
Ivan Lezhankin
4b143c3e0f Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-23 16:07:19 +03:00
maqroll
a6e7519f9d Merge remote-tracking branch 'upstream/master' 2019-09-23 07:55:07 +00:00
alexey-milovidov
d446205eec
Update QueryProfiler.cpp 2019-09-22 04:53:19 +03:00
Silviu Caragea
1fbd2fb6a8 Fix osx build 2019-09-21 21:30:01 +03:00
Ivan Lezhankin
9e46118edd Merge remote-tracking branch 'upstream/master' into issue-6459 2019-09-20 21:25:55 +03:00
Ivan Lezhankin
8cb0e58bc7 Fix build for all targets 2019-09-20 21:13:51 +03:00
Ivan Lezhankin
967e00a8da It works! 
if compiled with:

CC=clang CXX=clang++ cmake -Wno-dev . -Bbuild -GNinja -DCMAKE_AR:FILEPATH=x86_64-apple-darwin-ar -DCMAKE_RANLIB:FILEPATH=x86_64-apple-darwin-ranlib -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=MacOSX10.14.sdk -DLINKER_NAME=x86_64-apple-darwin-ld -DUSE_SNAPPY=OFF -DENABLE_SSL=OFF -DENABLE_PROTOBUF=OFF -DENABLE_PARQUET=OFF -DENABLE_READLINE=OFF -DENABLE_ICU=OFF -DENABLE_FASTOPS=OFF
 2019-09-20 20:09:22 +03:00
alexey-milovidov
7325f4a77b
Merge pull request #6974 from yandex/aku/mmap-linux 
Use MAP_POPULATE only on Linux.
 2019-09-19 01:58:40 +03:00
alexey-milovidov
bc1ecb0be5
Merge pull request #6951 from yandex/aku/alloc-continue 
Make the quadratic Arena::allocContinue less bad.
 2019-09-19 01:57:26 +03:00
root
ea5480fd72 merge 
Committer: maqroll <loteroc@gmail.com>
 2019-09-18 13:13:40 +00:00
Alexander Kuzmenkov
e3a9863260 Use MAP_POPULATE only on Linux. 2019-09-18 15:32:23 +03:00
Alexander Kuzmenkov
e1898ca89a Make the quadratic Arena::allocContinue less bad. 
Scenarios that use Arena::allocContinue may waste quadratically many
memory and perform quadratically many copying, when the memory range
size reaches Arena's linear allocation threshold. To alleviate this,
make sure that the next memory chunk allocated by allocContinue is at
least linear_growth_threshold bytes bigger than the previous one, so
that we don't reallocate and copy that often.
 2019-09-18 15:04:56 +03:00
CurtizJ
651f5b0e9f merging with master 2019-09-18 13:21:10 +03:00
CurtizJ
79a08ef8ea Merge remote-tracking branch 'upstream/master' into merging_redis 2019-09-18 12:58:22 +03:00
alexey-milovidov
fe9e110a6a
Merge pull request #6965 from azat-archive/sparsehash-c11 
Replace libsparsehash with sparsehash-c11
 2019-09-18 12:46:13 +03:00
Azat Khuzhin
780341060f
Replace libsparsehash with sparsehash-c11 
- use sparsehash-c11 over libsparsehash
- fix typos in find_sparsehash and users of the vars (s/SPARCE/SPARSE/)
- drop libsparsehash-dev from docker images (but keep for unbunlded build)
- use ::google over GOOGLE_NAMESPACE
 2019-09-18 00:08:20 +03:00
CurtizJ
7ccf04440a better code in Redis external dictionary 2019-09-17 20:57:48 +03:00
CurtizJ
4480e97f9f fix build 2019-09-17 17:16:07 +03:00
akuzm
75dc7d331e
Merge pull request #6937 from amosbird/ubmemfix 
In hash tables, properly initialize zero key cell.
 2019-09-17 14:57:38 +03:00
Amos Bird
1cf47da60d ubsan/memsan fix. 2019-09-16 21:20:17 +08:00
Ivan Lezhankin
01fdb802d4 Useful changes 2019-09-15 13:35:12 +03:00
Vitaly Baranov
0fb234c63e
Merge branch 'master' into dict_allow_databases 2019-09-15 01:51:44 +03:00
akuzm
e765733a26
Merge pull request #6925 from yandex/aku/msan 
Some MemorySanitizer fixes
 2019-09-13 20:26:48 +03:00
Ivan Lezhankin
5b60053ef7 [WIP] 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
e692a88196 CMake now works 
Example: -DCMAKE_SYSTEM_NAME=Darwin -DSDK_PATH=${HOME}/stuff/MacOSX10.12.sdk -DLINKER_NAME=${HOME}/.local/bin/ld64
 2019-09-13 17:56:27 +03:00
Ivan Lezhankin
1b5192706e Some fixes for OS X build. 2019-09-13 17:56:26 +03:00
Alexander Kuzmenkov
f4da0399c0 Some MemorySanitizer fixes. 2019-09-13 14:49:29 +03:00
alesapin
02cff38fef Merge with master 2019-09-13 13:58:23 +03:00
CurtizJ
fa416dc941 fix Redis dictionary 2019-09-12 17:48:28 +03:00
alexey-milovidov
c5cf4fa4f4
Merge pull request #6878 from azat-archive/build--fixes 
Trivial build fixes (mostly for -DSPLIT_SHARED_LIBRARIES=ON)
 2019-09-12 03:25:19 +03:00
Amos Bird
93c0880ca7 Fix non-ssl build. 2019-09-12 04:20:27 +08:00
l
adb4a58092 Style checks & security considerations added to setting description. 2019-09-11 22:18:22 +02:00
alesapin
b0fce77c3d Fix path to data on disk 2019-09-11 20:17:10 +03:00
l
cdbcfc2c90 + Redirect 2019-09-11 18:39:30 +02:00
alexey-milovidov
3ca084ec57
Merge pull request #6854 from Akazz/rwlock-cumulative-update-1 
Rwlock sanitary update 1: removed weak_ptrs from implementation + added strong exception safety guarantee
 2019-09-11 15:40:28 +03:00
Guillaume Tassery
5f1621faa2 Add database right for dictionaries 2019-09-11 13:14:55 +02:00
alesapin
0b8aec469f Make absolute path on disks start from /clickhouse/data, fix freeze and rename, add tests 2019-09-11 13:57:32 +03:00
Azat Khuzhin
6c646a6978
Missing <chrono> for gtest_sensitive_data_masker 
I guess that <chrono> had been included somewhere before in primary env.
 2019-09-11 02:04:11 +03:00
alexey-milovidov
254102c5bd
Merge pull request #6602 from amosbird/object-library 
Split libdbms.so using object library
 2019-09-11 02:00:13 +03:00
Akazz
7b65dfb867 Build fixed 2019-09-11 01:21:08 +03:00
Akazz
40a9495267 Some formatting + minor change 2019-09-10 22:58:04 +03:00
Amos Bird
8f28a36c17 Use internal iteration over hash tables in Aggregator. 
For compound hash tables such as the future StringHashMap, an
iterator-based API might be inefficient for iterating over a table or
for merging two tables, because:

1) the key has to be converted to a general format from a from a
   component-specific format, which may differ between the components;

2) the information about the component of the compound hash table to
   which the value belongs is lost, and has to be recalculated if the
   value is reinserted.

A more efficient approach is to use internal iteration, that is,
map-like functions, which avoids unnecessary conversions when iterating,
and allows to use an efficient component-wise approach when merging.
 2019-09-10 21:52:53 +03:00
Amos Bird
a1310ffbe6 Split libdbms.so using object library 
Now the linking time of incremental builds are around 1-2 seconds
 2019-09-11 01:56:01 +08:00
Alexander Kuzmenkov
160e0faf77 Do not use iterator::getValue() in Aggregator. 
Use separate key and "mapped" value references instead. This is
important for hash tables that do not store the key/"mapped" pair
directly, and cannot provide this interface without some runtime
overhead.
 2019-09-10 20:12:30 +03:00
Alexander Kuzmenkov
8e9a8584e0 Do not provide mutable key access in hash map cells. 
We don't need it anymore after we changed the hash table key memory
management to use callbacks. Removing this interface is important for
hash maps that do not store the key, such as FixedHashMap or the
prospective compound StringHashMap.
 2019-09-10 20:12:30 +03:00
akazz
33f462d011 Dropped some garbage lines 2019-09-10 15:37:14 +03:00
akazz
4f71fe715c Strong exception safety guarantee: 
Based on std::list<>::emplace_back() and std::unordered_map<>::emplace()
provide strong exception safety, RWLockImpl is now changed to provide
the same level of exception safety.
 2019-09-10 15:33:45 +03:00
alesapin
193049293a More comments, more readable code 2019-09-10 14:21:59 +03:00
alesapin
4702e40ed7 Fix bug with b_free and small refactoring 2019-09-10 11:56:27 +03:00
alesapin
1bc0aaeb35 Less code, more comments 2019-09-09 17:20:07 +03:00
alesapin
9f88baebb9 More constants, better tests 2019-09-09 16:50:19 +03:00
alesapin
ef08d6f10b More tests 2019-09-09 15:28:28 +03:00
alesapin
27419c965e Merge with master 2019-09-09 14:13:36 +03:00