Commit Graph

14791 Commits

Author SHA1 Message Date
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex
Check dictionaries for modification with unlocked ExternalLoader::mutex
2019-07-17 16:06:25 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
alexey-milovidov
07fcbbcdc8
Merge pull request #6028 from amosbird/c1
Optimize count()
2019-07-17 13:08:16 +03:00
alexey-milovidov
e11c4a7740
Merge pull request #6027 from amosbird/c2
Misc build fix
2019-07-17 12:47:16 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Alexander Kozhikhov
52007c96d9 adam is default now 2019-07-17 00:11:10 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
Vitaly Baranov
b74dacf9c4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-16 20:47:18 +03:00
Alexey Milovidov
3793c3cd13 Merge branch 'ThreeDots' of https://github.com/Immowelt/ClickHouse into Immowelt-ThreeDots 2019-07-16 19:41:05 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
alexey-milovidov
14dc9ad801
Merge pull request #6024 from yandex/check_table_old_behaviour
Add settings for check query backward compatibility
2019-07-16 15:19:55 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
alesapin
27447d4816 Fix style 2019-07-16 13:50:59 +03:00
alesapin
f786c45ac4 Add settings for check query backward compatibility 2019-07-16 13:19:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
c370de432a better 2019-07-16 10:28:53 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
alexey-milovidov
b4306c13cd
Merge pull request #6019 from yandex/fix-max-rows-to-read-without-uniform-read-distribution
Fixed error with calculating of max_rows_to_read if the setting merge_tree_uniform_read_distribution is set to zero.
2019-07-16 02:06:17 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
alexey-milovidov
37f9206925
Merge pull request #6001 from yandex/fixed-error-with-query-id-printing
Fixed error with query_id printing
2019-07-16 00:46:11 +03:00
alexey-milovidov
c517c467de
Merge pull request #6018 from yandex/fix_protocol_inconsistency
Fix bug client version which is able to read additional progress fiel…
2019-07-16 00:38:00 +03:00
Yuriy
f221fb0999 build fix 2019-07-15 23:37:01 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
alexey-milovidov
bfe5022643
Merge pull request #6008 from yandex/gcd-lcm-std
Using std::gcd, lcm instead of boost
2019-07-15 22:30:42 +03:00
Alexey Milovidov
3ac5ca0da0 Merge branch 'master' into fixed-error-with-query-id-printing 2019-07-15 22:29:33 +03:00
Alexey Milovidov
1937623f18 Better test 2019-07-15 22:13:43 +03:00
alexey-milovidov
1597103107
Merge pull request #6017 from yandex/mimallocexceptions
Add OOM checks in mimalloc
2019-07-15 22:10:05 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Alexey Milovidov
a175c55136 Added a test that shows catastrophic behaviour of mimalloc 2019-07-15 21:49:30 +03:00
alesapin
25ed737798 Fix bug client version which is able to read additional progress fields from server 2019-07-15 21:05:49 +03:00
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Alexey Milovidov
b3c0292613 Fixed error; added test 2019-07-15 19:32:52 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Nikolai Kochetov
ced2721ce8 Fix deserializeAndInsertFromArena. (#5973) 2019-07-15 19:20:21 +03:00
Alexey Milovidov
68ba42cc89 Using std::gcd, lcm instead of boost 2019-07-15 17:45:56 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
91028e9e5d Merge branch 'master' into some 2019-07-15 13:45:48 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Alexey Milovidov
4d14f8c230 Fixed error in query_id printing 2019-07-15 04:07:01 +03:00
Yuriy
baa62f2aba style check 2019-07-15 01:53:30 +03:00
Yuriy
0ed77453d3 reading packets in parts 2019-07-15 01:13:56 +03:00
Alexander Kozhikhov
860be14761 adam optimizer 2019-07-14 23:35:34 +03:00
Yuriy
a6bd5bccff tiny fix 2019-07-14 11:27:58 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
Maxim Fridental
bb40d4729c Implement COLUMNS clause 2019-07-12 13:17:38 +02:00
Vitaly Baranov
fd89a8b051
Merge pull request #5212 from andyyzh/custom_week_functions
Added functions for working with the Custom week number
2019-07-12 14:00:35 +03:00
alexey-milovidov
ac035f7f5b
Merge pull request #5970 from vitlibar/invalid-json-must-not-parse
Extra bytes after correctly parsed JSON are now considered as a parsing error.
2019-07-12 03:26:42 +03:00
alexey-milovidov
a3dda4053f
Merge pull request #5979 from vitlibar/read-prefix-before-blocks-while-executing-subquery
Fix using a table powered by the File engine in a subquery.
2019-07-12 03:20:31 +03:00
Alexander Kozhikhov
c5b0871c9b small fix 2019-07-12 00:02:22 +03:00
Alexander Kozhikhov
e046cdd62d some change on regression method 2019-07-11 23:56:58 +03:00
Nikolai Kochetov
954485ad6b Disable processors by default. 2019-07-11 19:30:39 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Vitaly Baranov
001e4daf25 Read prefix before blocks while executing subquery. 2019-07-11 16:53:26 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
Vitaly Baranov
8306f25634 Extra bytes after correctly parsed JSON is now considered as a parsing error. 2019-07-11 11:31:45 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
Vitaly Baranov
10b6e1b786
Merge pull request #5962 from vitlibar/fix-unused-variable-in-checkDataPart.cpp
Fix unused variable in checkDataPart.cpp
2019-07-10 19:10:55 +03:00
Ivan Lezhankin
998aa795fc Merge remote-tracking branch 'upstream/master' into fix-filter-table 2019-07-10 18:14:15 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Nikita Mikhaylov
1740a24ded better 2019-07-10 16:04:39 +03:00
Nikita Mikhaylov
6ff9dfce34 first try 2019-07-10 16:04:01 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alexey-milovidov
cb05312ce0
Merge branch 'master' into libcxx-as-submodule 2019-07-09 22:35:03 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
alexey-milovidov
97b75fe343
Merge pull request #5946 from akonyaev90/add_user_parsing_in_HDFS_uri
WIP: add user parsing in HDFS URI
2019-07-09 20:35:57 +03:00
alexey-milovidov
f6df911307
Update HDFSCommon.cpp 2019-07-09 20:35:47 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00
akonyaev
54d890b984 add user parsing in HDFS URI (rewrite split boost->std::string) 2019-07-09 17:09:56 +03:00
akonyaev
c0dc8fc9d3 add user parsing in HDFS URI (fixes after review, style fixes) 2019-07-09 16:16:04 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
akonyaev
74b2440f66 add user parsing in HDFS URI 2019-07-09 13:26:06 +03:00
alesapin
d4c44320ea Merge branch 'fix_fetch_of_existing_part' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 12:04:00 +03:00
alesapin
9a17a461ea Review fixes and better tests 2019-07-09 12:02:52 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
Alexey Milovidov
283872f098 Fixed build 2019-07-09 05:12:02 +03:00
Alexey Milovidov
823ef749fd Fixed build 2019-07-09 05:06:26 +03:00
Alexey Milovidov
10e4baf3f8 Fixed build 2019-07-09 05:01:25 +03:00
alexey-milovidov
ef3c06b3d0
Merge pull request #5943 from yandex/ubsan-fixes-5
Fixed ubsan report in fuzz test
2019-07-09 04:12:49 +03:00
Alexey Milovidov
8778b9a1f3 "clickhouse_compression" library is dependent on "typeinfo for DB::IDataType" (at least when building with ubsan) 2019-07-09 04:09:42 +03:00
alexey-milovidov
d6afdd5a8d
Merge pull request #5941 from 4ertus2/bugs
Fix wrong array_join_columns calculation
2019-07-09 03:58:36 +03:00
Alexey Milovidov
52bb292327 Merge branch 'master' into libcxx-as-submodule 2019-07-09 01:58:09 +03:00
Alexey Milovidov
f748efbb5b Fixed ubsan report in fuzz test 2019-07-09 01:30:30 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
3c7178a8d1
Merge pull request #5923 from yandex/add-noreturn
Add two more warnings from -Weverything
2019-07-09 00:10:35 +03:00
chertus
ef41b16a44 fix wrong ExpressionAnalyzer.array_join_columns calculation 2019-07-08 23:06:17 +03:00
alexey-milovidov
c491cddb78
Update CheckResults.h 2019-07-08 22:56:48 +03:00
alexey-milovidov
6088aa233f
Update ASTCheckQuery.h 2019-07-08 22:55:54 +03:00
alexey-milovidov
a1e7d12f68
Update ParserQueryWithOutput.cpp 2019-07-08 22:55:36 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
a5cce21ebd Addition to prev. revision 2019-07-08 19:53:49 +03:00
Alexey Milovidov
6512f923ac Fixed error with unit test 2019-07-08 19:47:40 +03:00
Alexey Milovidov
3779a5cba2 Addition to prev. revision 2019-07-08 19:01:00 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Alexander Kuzmenkov
78df28f0e9 Cleanup. 2019-07-08 18:35:32 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Nikolai Kochetov
a2cdab2799 Fix build. 2019-07-08 16:07:46 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00
Nikolai Kochetov
f808d71aba Fix build. 2019-07-08 15:48:16 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Alexey Milovidov
e64e520e5b One more fix for PVS-Studio 2019-07-08 03:11:39 +03:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master
startsWith now uses PK index
2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
alexey-milovidov
97b8b2c769
Merge pull request #5915 from yandex/merge-table-more-streams
Increase number of streams to SELECT from Merge table
2019-07-07 15:57:06 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Alexey Milovidov
2e6280de07 Fixed #5797 2019-07-07 03:20:38 +03:00
Alexey Milovidov
e8b6ac3fad Returned back support for floating point argument in function quantileTiming 2019-07-07 02:15:14 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined
Use --no-undefined linker option for split build
2019-07-07 01:47:11 +03:00
alexey-milovidov
31d71862e0
Merge pull request #5909 from yandex/os-nice
Added "os_thread_priority" setting
2019-07-06 23:59:56 +03:00
Nikita Lapkov
3828684f7a style 2019-07-06 20:42:03 +00:00
Nikita Lapkov
ef1d84b35a do not run trace collector without trace_log. do not run query profilers without trace collector. 2019-07-06 20:29:00 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
alexey-milovidov
758de14138
Merge pull request #5902 from yandex/fix-visit-param-extract-raw
Fixed buffer underflow in visitParamExtractRaw
2019-07-06 20:34:46 +03:00
alexey-milovidov
004d3d462a
Merge pull request #5903 from dimarub2000/master
Exect -> Exact grammar fixed
2019-07-06 17:55:39 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
dimarub2000
fd69ee1275 Exect -> Exact grammar improved 2019-07-06 01:18:37 +03:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
alexey-milovidov
f25a3fd230
Merge pull request #5886 from dimarub2000/master
Enum data type as a synonim for Enum8 or Enum16.
2019-07-05 23:59:36 +03:00
alexey-milovidov
eb2ffccaf3
Merge pull request #5874 from nikitamikhaylov/master
Add data checksums to system.parts_columns table. #5151
2019-07-05 23:58:58 +03:00
Alexey Milovidov
b396a5a392 Little better 2019-07-05 21:36:20 +03:00
alexey-milovidov
78c61ab772
Merge pull request #5890 from yandex/dns-cache-updater-allow-drift
Allow time drift in DNSCacheUpdater for natural randomization
2019-07-05 21:27:24 +03:00
dimarub2000
c4447355b3 Nicolay's suggestion 2019-07-05 21:23:50 +03:00
Alexey Milovidov
1c2e422797 Fixed buffer underflow in visitParamExtractRaw 2019-07-05 21:23:14 +03:00
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
Nikita Mikhaylov
afdd45fd85 checksum added to system_parts 2019-07-05 18:32:55 +03:00
Nikita Lapkov
6b7f587156 cut large query_ids 2019-07-05 14:16:20 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
dimarub2000
a6086ed7a8 changed names 2019-07-05 16:48:14 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
dimarub2000
a7c05938e3 checkASTStructure 2019-07-05 16:33:03 +03:00
Alexey Milovidov
5c3cd40db3 Allow time drift in DNSCacheUpdater for natural randomization 2019-07-05 16:20:21 +03:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
Nikita Mikhaylov
1ffa488be4 lowercase added~ 2019-07-05 14:45:47 +03:00
alexey-milovidov
8b62c96989
Merge pull request #5859 from 4ertus2/joins
Fix FULL|RIGHT JOIN with nulls in right table's keys
2019-07-05 14:23:35 +03:00
dimarub2000
dc13d2e4a7 Added Enum data type as a synonim for Enum8 or Enum16. 2019-07-05 14:22:45 +03:00
alexey-milovidov
c3c4f4aff0
Merge pull request #5880 from yandex/close-idle-connections
Close idle TCP connections
2019-07-05 14:04:28 +03:00
Nikolai Kochetov
bc1e9df6cc
Merge pull request #5871 from yandex/fix-clickhouse-copier-heap-use-after-free
Fix heap-use-after-free in ClusterCopier
2019-07-05 13:48:06 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Mikhaylov
f8dde20dcb easier code 2019-07-05 13:13:44 +03:00
Nikita Mikhaylov
0e25190433 checksums now output in the same way + tests are better 2019-07-05 12:00:19 +03:00
alexey-milovidov
101b317efa
Merge pull request #5850 from PerformanceVision/top_k_weighted_fix
Add element on SpaceSaving set if the last element has a lower value compared to the last one
2019-07-05 10:57:11 +03:00
Guillaume Tassery
53d67103e7 Add documentation about removing the lowest element for the SpaceSaving set 2019-07-05 09:20:27 +02:00
Alexey Milovidov
2c6dd99644 Updated contributors 2019-07-05 04:13:03 +03:00
Alexey Milovidov
6efca57979 Close idle connections #5879 2019-07-05 01:23:45 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Nikita Mikhaylov
fc75c8f62e done 2019-07-04 21:27:14 +03:00
Nikolai Kochetov
72afe9b842 Fix heap-use-after-free in ClusterCopier caused by watch which try to use already removed copier object. 2019-07-04 17:48:40 +03:00
Ivan Lezhankin
3b995bdb02 Add missing dependecies on sight to enable --no-undefined option 2019-07-04 17:05:55 +03:00
Guillaume Tassery
85151b339b Add test on topKWeighted function 2019-07-04 15:15:08 +02:00
chertus
8dc6810799 do not save null bitmaps for blocks without nulls 2019-07-04 15:38:54 +03:00
chertus
301345724a use better data types 2019-07-04 15:12:39 +03:00
chertus
4759e8632e fix crash and update test results 2019-07-04 14:50:32 +03:00
CurtizJ
f3ac23fd48 add logging about DNS resolution errors 2019-07-04 13:38:44 +03:00
alesapin
65437d2289 Fix final mark and tests 2019-07-04 13:21:14 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
alesapin
18544e8f64 Missed file and style fix 2019-07-04 09:04:31 +03:00
CurtizJ
8eda3b5de4 fix deadlock in getHostName 2019-07-04 02:05:59 +03:00
alesapin
83ca611c59 Remove more unexpected changes 2019-07-03 23:59:47 +03:00
alesapin
4557412fed Remove unexpected changes 2019-07-03 23:57:05 +03:00
alesapin
477a7450fb Add test for data corruption 2019-07-03 23:51:13 +03:00
Alexey Milovidov
6b9df067d8 Merge branch 'master' into libcxx-as-submodule 2019-07-03 22:34:58 +03:00
chertus
73d6784c59 join right table nulls 2019-07-03 22:06:34 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
Ivan
fdae12a51c
Keep on reading of new Kafka messages after stalling (#5852) 2019-07-03 19:51:11 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
c880e00ffa Start writing tests 2019-07-03 19:00:24 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
Guillaume Tassery
81e39744e2 Add element on the SpaceSavingSet if the last element has a smaller weight value compared to the new one 2019-07-03 13:49:03 +02:00
alesapin
6b0498cd93 First version of check cmd 2019-07-03 11:49:52 +03:00
alexey-milovidov
50c22ef71a
Merge pull request #5628 from yandex/index_granularity_by_default
Enable adaptive index granularity by default
2019-07-03 02:15:33 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
alexey-milovidov
90ea3b25fd
Merge pull request #5728 from yandex/aku/asan-arenas
Add asan integration to arenas.
2019-07-03 02:01:46 +03:00
alexey-milovidov
7ea33203d7
Merge pull request #5742 from 4ertus2/t64
T64 full bit-transpose variant
2019-07-03 01:56:34 +03:00
alexey-milovidov
de92b9854e
Merge pull request #5838 from 4ertus2/joins
Joins refactoring: extract joinDispatch into own file
2019-07-03 01:55:45 +03:00
alexey-milovidov
8d4af1bd33
Update joinDispatch.h 2019-07-03 01:55:36 +03:00
alexey-milovidov
1d582c92a7
Merge pull request #5842 from yandex/revert-questionable-code-query-priorities
Fixed wrong code in QueryPriorities
2019-07-03 01:53:07 +03:00
Alexey Milovidov
6fba717d50 Fixed wrong code in QueryPriorities 2019-07-02 23:21:31 +03:00
Alexander Kuzmenkov
90c40dccc8 Disable copy and move for AllocatorWithStackMemory.
Since this allocator uses its own buffer field for small allocations,
moving or copying it is ill-defined, because someone might already
use the pointers to its body.
2019-07-02 20:48:33 +03:00
Alexander Kuzmenkov
b445525426 Include asan_interface.h before including LLVM internals. 2019-07-02 20:48:00 +03:00
Alexander Kuzmenkov
bd33bf8f96 Don't copy aggregate function states with memcpy.
They may contain pointers to themselves, such as when using
PODArrayWithStackMemory. Instead, initialize empty new structures
with `create`, and merge the old one to it with `merge`.
2019-07-02 20:48:00 +03:00
Alexander Kuzmenkov
f6ee2ea4e4 Add asan integration to arenas. 2019-07-02 20:48:00 +03:00
Alexey Milovidov
ffaaf93c49 Compatibility with old compiler (gcc-7) 2019-07-02 20:24:22 +03:00
chertus
207145025c Join.h refactoring: extract joinDispatch into own file 2019-07-02 17:38:31 +03:00
alexey-milovidov
1bda6994ad
Merge pull request #5832 from yandex/fix_low_cardinality_check
Fix low cardinality check
2019-07-02 17:06:06 +03:00
chertus
8932dc9c23 minpr perf improvement 2019-07-02 15:31:20 +03:00
chertus
d1250e6042 fix build 2019-07-02 15:01:39 +03:00
alesapin
cbb0d640f4 Add comments 2019-07-02 14:34:16 +03:00
alesapin
f68b5216a8 Fix prefix reading and skip check for low cardinality dictionary 2019-07-02 13:55:47 +03:00
alexey-milovidov
aea3fc661a
Merge pull request #5824 from Enmk/double_delta_fix
Fixed DoubleDelta codec edge case
2019-07-02 12:52:40 +03:00
Vasily Nemkov
c5b2ba2a25 Fixed DoubleDelta codec edge case
Casused by mistreating negative double delta value as HUGE unsigned value, crippling compression ratio.
2019-07-02 07:58:03 +03:00
alexey-milovidov
28ae9f9044
Merge pull request #4828 from laplab/update_libunwind
switch to llvm libunwind
2019-07-02 02:34:01 +03:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
alexey-milovidov
6890c5e3b3
Merge pull request #5822 from yandex/fix-build-gcc9
fix build on macosx and gcc9
2019-07-01 23:16:11 +03:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
alexey-milovidov
bf8c154d3d
Merge pull request #5819 from CurtizJ/fix-segfault-ttl
Fix segfault in TTL merge with non-physical columns in block.
2019-07-01 20:28:26 +03:00
filimonov
c5492e59f1
more accidental spaces 2019-07-01 17:01:10 +02:00
filimonov
051a9ae492
remove accidental spaces 2019-07-01 16:44:45 +02:00
filimonov
2627dec804
fix build on macosx and gcc9 2019-07-01 16:42:05 +02:00
CurtizJ
ecf9feab9c remove extra semicolon 2019-07-01 17:09:22 +03:00
Alexey Milovidov
cb8be105d5 Added missing implementations of IColumn::getFloat64, IColumn::getBool 2019-07-01 16:49:50 +03:00
chertus
13fa9a07e5 Merge branch 'master' into t64 2019-07-01 16:40:32 +03:00
chertus
37b7ff7a0a fix maning, add comment 2019-07-01 16:35:04 +03:00
CurtizJ
c0a63801fc fix segfault in ttl merge with non-physical columns in block 2019-07-01 15:50:50 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
chertus
0c634129da add IColumn.isNullable() 2019-07-01 14:44:19 +03:00
alexey-milovidov
106a2d0c0f
Merge pull request #4930 from yandex/tsan-miscellaneous
Miscellaneous changes
2019-07-01 11:11:53 +03:00
Yuriy
450b20ca89 max_memory_usage support in MySQL wire protocol 2019-07-01 08:58:31 +03:00
alexey-milovidov
5fb7bf6854
Update ParallelInputsProcessor.h 2019-07-01 03:15:14 +03:00
alexey-milovidov
c108882c5f
Merge pull request #5805 from yandex/BHYCHIK-h3-integration
Merge H3 integration
2019-07-01 01:02:16 +03:00
alexey-milovidov
a9cfe4ce91
Merge pull request #5807 from yandex/ngramSearch
Inverting ngramSearch to be more intuitive
2019-07-01 00:43:17 +03:00
Alexey Milovidov
fd2f90488e Simplification 2019-06-30 23:54:06 +03:00
Alexey Milovidov
6eae511b6e Changed order of (lat, lon) to (lon, lat) to be consistent with "greatCircleDistance" function and PostGIS 2019-06-30 23:13:32 +03:00
Maxim Sabyanin
663aab6f5b complete ExternalLoader method's implementations 2019-06-30 23:04:21 +03:00
Alexey Milovidov
7591c3b7b2 Fixed error 2019-06-30 22:47:20 +03:00
Alexey Milovidov
7c98327e4d Fixed error 2019-06-30 22:46:23 +03:00
Alexey Milovidov
86093a474f Fixed error 2019-06-30 22:45:23 +03:00
Danila Kutenin
9127c8b27c inverting ngramSearch to be more intuitive 2019-06-30 22:34:17 +03:00
Alexey Milovidov
a7fc631de7 Style 2019-06-30 21:55:08 +03:00
Alexey Milovidov
1777313821 Own CMakeLists for H3 because otherwise "m" library does not link correctly 2019-06-30 21:49:57 +03:00
Alexey Milovidov
008f3a247e Merging H3 integration 2019-06-30 21:20:32 +03:00
Alexey Milovidov
b86aca37ea Merge branch 'h3-integration' of https://github.com/BHYCHIK/ClickHouse into BHYCHIK-h3-integration 2019-06-30 19:15:33 +03:00
Alexey Milovidov
33cff5ee0f Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-30 17:24:15 +03:00
alexey-milovidov
feafcb21bd
Merge branch 'master' into h3-integration 2019-06-30 16:19:11 +03:00
proller
a69990ce27 CLICKHOUSE-4514 Unique query_id among all users (#5430)
* CLICKHOUSE-4514 Unique query_id among all users

* try 1

* Fix

* fix

* use condvar

* fix style

* Update ProcessList.cpp
2019-06-30 16:17:27 +03:00
alexey-milovidov
18535590ce
Merge pull request #5802 from CurtizJ/upstream/systemlog-flushing
Fix shutdown of SystemLogs
2019-06-30 15:51:35 +03:00
Alexey Milovidov
6ad07172ee Fixed error in query formatting 2019-06-30 15:49:06 +03:00
CurtizJ
1a8695ffd9 fix shutdown of system_logs 2019-06-30 04:56:16 +03:00
Alexey Milovidov
725bcd9d02 Merge branch 'master' into sanych73-prepared_statements 2019-06-30 02:59:37 +03:00
Alexey Milovidov
f25b96bed2 Moved a few tests to gtest 2019-06-30 02:23:53 +03:00
Alexey Milovidov
b76d5a7cf0 Added a test (not gtest though) 2019-06-30 01:45:57 +03:00
Alexey Milovidov
299607a301 ThreadPool: more informative error message if exception is thrown before we schedule a next thread #5305 2019-06-30 01:37:46 +03:00
Alexey Milovidov
c7e70df5fc Fixed error with formatting aliases 2019-06-29 21:59:07 +03:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
alexey-milovidov
87993de98d
Merge pull request #5725 from yandex/PerformanceVision-ignore_scheme
Performance vision ignore scheme
2019-06-29 20:36:23 +03:00
Alexey Milovidov
90898905e0 Allow to DROP database with Dictionary engine 2019-06-29 20:27:32 +03:00
Alexey Milovidov
de8a15b5f4 Removed unused method 2019-06-29 20:19:46 +03:00
Alexey Milovidov
498a2072b5 Fixed bug in query formatting with TEMPORARY tables 2019-06-29 19:58:32 +03:00
Alexey Milovidov
6566bb7088 Updated tests 2019-06-29 19:18:59 +03:00
Alexey Milovidov
a8e1c8a7d2 Fixed formatting of invalid queries with ambiguous aliases 2019-06-29 19:13:28 +03:00
Alexey Milovidov
6ff0a88eb3 Fixed minor issue in query formatting 2019-06-29 18:26:19 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
alexey-milovidov
fe542e26f8
Merge pull request #5685 from CurtizJ/upstream/systemlog-flushing
Fix race condition in flushing system log in another way.
2019-06-29 15:46:22 +03:00
alexey-milovidov
a0d3db8d9b
Merge pull request #5787 from yandex/aku/podarray-bytes
Fix initial size of some inline PODArray's.
2019-06-29 15:34:00 +03:00
alexey-milovidov
7474abfea6
Merge pull request #5791 from yandex/aku/store-explicit
Require explicit type in unalignedStore
2019-06-29 15:33:38 +03:00
Danila Kutenin
614ec98a42 Fix runtime of SPLIT_SHARED_LIBRARIES build 2019-06-28 21:26:24 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
Alexander Kuzmenkov
0116c10e41 Require explicit type in unalignedStore
This is a follow-up to PR #5786, which fixed a segfault caused by
an unexpected deduced type for unalignedStore. To prevent future errors
of this kind, require a caller to specify the stored type explicitly.
2019-06-28 20:33:14 +03:00
Alexander Kuzmenkov
a719933c58 Fix initial size of some inline PODArray's.
A template parameter of PODArray named INITIAL_SIZE didn't make its
units clear, which made some callers to erroneously assume that it
specifies the number of elements and not the number of bytes.
Rename it, fix the wrong usages and, where possible, use the
PODArrayWithStackMemory typedef for arrays with inline memory.
2019-06-28 16:03:14 +03:00
alexey-milovidov
18659e367e
Merge pull request #5758 from zlobober/bool_masks
Extend KeyCondition interface so that it returns BoolMask.
2019-06-28 14:51:52 +03:00
alexey-milovidov
b9cbd36487
Merge pull request #5750 from hczhcz/patch-7
Refactor: Improve function registering
2019-06-28 14:50:38 +03:00
alexey-milovidov
1327342040
Merge pull request #5764 from hczhcz/patch-8
Add synonim arrayFlatten <-> flatten
2019-06-28 14:49:05 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
alexey-milovidov
8b93f086aa
Merge pull request #5777 from proller/fix27
Move file Functions/array/empty.cpp -> Functions/empty.cpp
2019-06-28 14:47:12 +03:00
alexey-milovidov
72b0bdd0d3
Merge pull request #5786 from yandex/awful_delta_codec_bug
Fix bug in delta codec
2019-06-28 14:46:05 +03:00
alexey-milovidov
2f0918eadf
Merge pull request #5785 from fredchenbj/fix/io_endian_portable_on_mac
IO: fix endian portable on macos x
2019-06-28 14:45:20 +03:00
alesapin
cfd8df6568 Fix bug in delta codec caused by genious C++ implicit type conversion and consequent template type deduction 2019-06-28 13:42:36 +03:00
fredchenbj
e3b3ca8d0e IO: fix endian portable on macos x
Signed-off-by: fredchenbj <cfworking@163.com>
2019-06-28 15:15:56 +08:00
hcz
1d2695cbd2 Add alias flatten/arrayFlatten 2019-06-28 11:55:09 +08:00
Danila Kutenin
407cf9a229 Comments 2019-06-28 00:43:50 +03:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Alexey Milovidov
3c4784a466 Removed obsolete undocumented embedded dictionaries that were used by Yandex.Metrica 2019-06-27 22:18:28 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
proller
da6490c11d renamed: Functions/array/notEmpty.cpp -> Functions/notEmpty.cpp 2019-06-27 21:43:40 +03:00
proller
0baaa4b254 Move file Functions/array/empty.cpp -> Functions/empty.cpp 2019-06-27 20:45:41 +03:00
alexey-milovidov
ea37aeb1b4
Merge pull request #5774 from yandex/gcc-9
Compatibility with gcc-9
2019-06-27 20:24:09 +03:00
alexey-milovidov
246f34d8f6
Merge pull request #5768 from abyss7/better-log
Print table name in message about missing column
2019-06-27 18:49:40 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Alexey Milovidov
e33d482271 Fixed warning in gcc-9 2019-06-27 17:44:39 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
Alexey Milovidov
e3277c191b Fixed idiotic inconsistency in code 2019-06-27 16:26:06 +03:00