Commit Graph

19516 Commits

Author SHA1 Message Date
Alexey Milovidov
a3f6b70433 Fixed warning from PVS-Studio 2019-07-23 23:07:33 +03:00
chertus
9da1b0089c visitor for JOIN ON keys extraction 2019-07-23 22:49:15 +03:00
Alexey Milovidov
02fb67dc8a Simple protection from too frequent profiler signals 2019-07-23 21:45:54 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
Alexey Milovidov
1913bfa276 Added cache for symbolizeAddress function 2019-07-23 17:59:29 +03:00
dimarub2000
752eccf2eb changes after review 2019-07-23 17:41:41 +03:00
Alexey Milovidov
1b00e99334 Fixed error with initialization of query profiler 2019-07-23 17:30:14 +03:00
Vitaly Baranov
746066be48 Remove excessive throw in a correct case. 2019-07-23 17:02:15 +03:00
Vitaly Baranov
2068e1f0e0 Add more protobuf IO tests. 2019-07-23 16:57:25 +03:00
Dmitry Rubashkin
4bee54cd93 integration test added 2019-07-23 16:53:25 +03:00
Dmitry Rubashkin
13ef987361 Git commit fixes 2019-07-23 16:53:25 +03:00
Dmitry Rubashkin
4d43cf2a8d config exception when not corresponding root names 2019-07-23 16:53:25 +03:00
Vitaly Baranov
4f91e3e4b7 Fix protobuf format tests. 2019-07-23 16:51:22 +03:00
Alexey Milovidov
0755d1e4b3 Added demangling to function symbolizeAddress 2019-07-23 16:34:22 +03:00
Alexey Milovidov
bd3173bac2 Added comment 2019-07-23 16:17:56 +03:00
Alexey Milovidov
398a280f23 Fixed error 2019-07-23 16:16:51 +03:00
Alexey Milovidov
97103b9067 Every function in its own file 2019-07-23 15:55:13 +03:00
Alexey Milovidov
2d895c4fe6 Changed symbolizeTrace to symbolizeAddress 2019-07-23 15:46:58 +03:00
chertus
9baf1bf196 Merge branch 'master' into ast 2019-07-23 13:49:18 +03:00
tai
b01f54ade1 ISSUE-5695: support push down predicate to final subquery 2019-07-23 18:22:07 +08:00
Nikolai Kochetov
eef0e08fbd Added test with LowCardinality(Nullable) to not-Nullable cast. 2019-07-23 13:04:26 +03:00
robot-clickhouse
58e03ad7b9 Auto version update to [19.13.1.1] [54425] 2019-07-23 11:20:52 +03:00
robot-clickhouse
8c71c109a6 Auto version update to [19.12.1.889] [54424] 2019-07-23 11:20:19 +03:00
Yuriy
a1152f99ae switching to sha256_password after handshake in order to use PHP client without SSL 2019-07-23 10:57:58 +03:00
Nikolai Kochetov
1e35f87760 Fix CAST from LowCardinality(Nullable). 2019-07-23 10:57:32 +03:00
Alexey Milovidov
a652a8bb6c Disabled query profiler by default #4247 2019-07-23 03:04:04 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request #6057 from dimarub2000/master
CREATE TABLE AS table_function()
2019-07-23 02:50:08 +03:00
chertus
eaa3cb557a move prefer_alias_to_column_name logic out of parser 2019-07-22 22:21:07 +03:00
Nikolai Kochetov
fa2610e096 Fix CAST from LowCardinality(Nullable). 2019-07-22 19:46:42 +03:00
Nikolai Kochetov
1d960e5c0b Fix CAST from LowCardinality(Nullable). 2019-07-22 18:41:52 +03:00
Dmitry Rubashkin
0320de9132 test and fixes 2019-07-22 16:49:16 +03:00
Dmitry Rubashkin
9ffbf65741 Fix of a fix 2019-07-22 15:50:10 +03:00
Dmitry Rubashkin
42efc1051e fixes of bad commit 2019-07-22 15:35:29 +03:00
Dmitry Rubashkin
d279a685a9 Merge branch 2019-07-22 15:31:17 +03:00
Dmitry Rubashkin
6c6af60194 Fixes after review 2019-07-22 15:18:53 +03:00
Ivan Lezhankin
762f1d3a85 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-22 13:19:37 +03:00
alexey-milovidov
adfc369172
Merge pull request #6082 from vitlibar/fix-segfault-in-reload-outdated
Fix segfault in ExternalLoader::reloadOutdated().
2019-07-22 01:28:37 +03:00
alexey-milovidov
3da461fea5
Merge pull request #6038 from yandex/Immowelt-ThreeDots
Merging COLUMNS matcher
2019-07-22 01:27:38 +03:00
Alexey Milovidov
9b5cba8174 Fixed bad code 2019-07-22 00:35:43 +03:00
Alexey Milovidov
b2961bcc31 Added check for empty number of columns; improved test 2019-07-22 00:19:42 +03:00
Alexey Milovidov
8060993ca2 Removed obsolete comment 2019-07-21 23:40:34 +03:00
alexey-milovidov
ea9b36e531
Merge pull request #6091 from yurriy/php-client-test
MySQL Native Driver test
2019-07-21 23:29:24 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
Alexey Milovidov
fb0d09c5d3 Rename files 2019-07-21 20:03:58 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Yuriy
28a0481f1a php mysql client test 2019-07-21 15:19:14 +03:00
Mikhail f. Shiryaev
75de4eec70 Add tests for optimization exceptions 2019-07-21 08:57:24 +02:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Alexey Milovidov
7064fe6678 Merge branch 'master' into Immowelt-ThreeDots 2019-07-21 02:21:55 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
Ivan Lezhankin
301a64afa6 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-21 01:09:03 +03:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
alexey-milovidov
c6b468d435
Merge pull request #6083 from yandex/odbc-initial-load-fix
Fix for initial load of external dictionaries via ODBC
2019-07-20 04:26:22 +03:00
Alexey Milovidov
7661eeefa0 Fixed idiotic test 2019-07-20 03:47:06 +03:00
Alexey Milovidov
cf873b9308 Fixed flappy test (can fail due to timeout in debug/sanitizer builds) 2019-07-20 03:28:48 +03:00
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
alexey-milovidov
b035edefea
Update InterpreterCreateQuery.cpp 2019-07-20 03:02:18 +03:00
alexey-milovidov
f9d1214bbc
Update DatabasesCommon.cpp 2019-07-20 02:51:43 +03:00
alexey-milovidov
3abf1b278e
Update DatabasesCommon.cpp 2019-07-20 02:51:20 +03:00
Alexey Milovidov
7ce6a71c95 Steal part of modifications from #6007 2019-07-20 02:42:59 +03:00
Alexey Milovidov
389cf9fcee Better fix: removed old and bad code #6069 2019-07-20 02:10:55 +03:00
Alexey Milovidov
21165edcb7 Quick fix for initial load of external dictionaries via ODBC 2019-07-20 02:06:15 +03:00
alexey-milovidov
ad95d4e3e0
Merge pull request #6000 from Quid37/master
regression methods adam optimizer
2019-07-20 00:45:51 +03:00
alexey-milovidov
175c4655d8
Merge pull request #6043 from 4ertus2/ast
Enable 'input_format_defaults_for_omitted_fields' by default
2019-07-20 00:42:01 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for #6070 2019-07-20 00:37:34 +03:00
alexey-milovidov
4adf47bb77
Merge pull request #6068 from PerformanceVision/fix_ipv6_cidr
Resolve segfault on IPv6CIDRToRange with setting a max cidr
2019-07-20 00:32:05 +03:00
alexey-milovidov
d0eb20f4b7
Merge pull request #6070 from bopohaa/fix-protobuf-length-delimited-message-limit
Add verification of the length of the protobuf message
2019-07-20 00:31:36 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexey Milovidov
9a9e6b7a44 Minor modification #6073 2019-07-20 00:09:28 +03:00
alexey-milovidov
746fe5cdac
Merge pull request #6073 from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
Vitaly Baranov
e64f8e606d Add comments. 2019-07-20 00:04:19 +03:00
alexey-milovidov
f18e9592a1 Update ExternalLoader.cpp 2019-07-20 00:03:57 +03:00
Vitaly Baranov
5b879e143f Fix segfault in ExternalLoader::reloadOutdated(). 2019-07-20 00:03:25 +03:00
alexey-milovidov
ca5d078a23
Update DatabaseOrdinary.cpp 2019-07-20 00:02:29 +03:00
alexey-milovidov
14f14c68cb
Update FunctionsCoding.h 2019-07-19 23:58:28 +03:00
alexey-milovidov
936aa38e64
Merge pull request #6062 from weiqxu/master
support reading from HA mode HDFS
2019-07-19 23:56:09 +03:00
Alexey Milovidov
9ccf5a7c90 Merge branch 'master' into Immowelt-ThreeDots 2019-07-19 19:54:00 +03:00
alexey-milovidov
6f96102fe9
Merge pull request #6058 from yandex/uniq-fix-non-deterministic-result
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
2019-07-19 18:40:12 +03:00
Alexey Milovidov
faa07c8440 Added a test 2019-07-19 18:37:45 +03:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
Dmitry Rubashkin
6ba4408741 Tests added 2019-07-19 16:30:22 +03:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
dimarub2000
c9ec16987e minor fixes 2019-07-18 22:09:45 +03:00
dimarub2000
1ab0893432 minor fixes 2019-07-18 21:59:31 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dc8b83c882 Added a test #6040 2019-07-17 20:23:06 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex
Check dictionaries for modification with unlocked ExternalLoader::mutex
2019-07-17 16:06:25 +03:00
proller
9be369fed5
clickhouse-test: optional termcolor (#6035) 2019-07-17 15:46:20 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
Nikita Mikhaylov
56c9bf5acc pep8 2019-07-17 14:57:05 +03:00
Nikita Mikhaylov
e5360413a6 integration test added 2019-07-17 14:55:18 +03:00
alexey-milovidov
07fcbbcdc8
Merge pull request #6028 from amosbird/c1
Optimize count()
2019-07-17 13:08:16 +03:00
alexey-milovidov
e11c4a7740
Merge pull request #6027 from amosbird/c2
Misc build fix
2019-07-17 12:47:16 +03:00
Vitaly Baranov
38c3889564 Add an integration test for the invalidate_query parameter. 2019-07-17 11:40:35 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Alexander Kozhikhov
52007c96d9 adam is default now 2019-07-17 00:11:10 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00