Commit Graph

14734 Commits

Author SHA1 Message Date
Alexey Milovidov
472a61c1fa Updating PHDRCache after dlopen 2019-07-25 22:56:51 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
chertus
554e4ab5b8 fix cross alliasing case with JOIN ON 2019-07-25 22:25:51 +03:00
Alexey Milovidov
522aed7168 Fixed build 2019-07-25 22:02:44 +03:00
Alexey Milovidov
93c7f6aedf Merge branch 'fix_ISSUE5695' of https://github.com/TCeason/ClickHouse into TCeason-fix_ISSUE5695 2019-07-25 19:09:18 +03:00
dimarub2000
f53f22fd17 ISSUE-6136: Fix DB::Exception throwed by bitmapContains 2019-07-25 18:56:20 +03:00
CurtizJ
b1cc019bd4 fix pipeline 2019-07-25 14:00:14 +03:00
chertus
06076e67a3 Merge branch 'master' into joins 2019-07-25 13:48:32 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
chertus
50e3839157 NOT_UNBUNDLED -> UNBUNDLED 2019-07-25 13:35:57 +03:00
alexey-milovidov
7219e167d2
Merge pull request from bopohaa/fix-kafka-unclean-stream
Clear Kafka's buffer if an invalid message is found.
2019-07-25 04:30:37 +03:00
alexey-milovidov
f1f5cdc802
Merge pull request from yandex/fix-msan
Fixed MSan report
2019-07-25 04:29:11 +03:00
alexey-milovidov
56131a7fe7
Merge pull request from abyss7/issue-6071
Check background_task_handle before use
2019-07-25 04:16:47 +03:00
alexey-milovidov
8064fb3b94
Merge pull request from 4ertus2/ast
Refactoring: move prefer_alias_to_column_name logic out of parser
2019-07-25 04:14:34 +03:00
alexey-milovidov
20a8914858
Merge pull request from vitlibar/allow-protobuf-message-with-all-fields-by-default
Allow protobuf message with all fields by default
2019-07-25 04:12:23 +03:00
alexey-milovidov
6c782b91d5
Merge pull request from yurriy/mysqlnd-workaround
A workaround for PHP mysqlnd extension bugs
2019-07-25 04:12:00 +03:00
Alexey Milovidov
e52653aa06 Miscellaneous 2019-07-25 04:08:33 +03:00
alexey-milovidov
a985897a07
Update PredicateExpressionsOptimizer.h 2019-07-25 04:05:16 +03:00
alexey-milovidov
3022c4a759
Update PredicateExpressionsOptimizer.cpp 2019-07-25 04:04:03 +03:00
alexey-milovidov
8f3c097c1b
Update Settings.h 2019-07-25 04:03:16 +03:00
alexey-milovidov
bb74727065
Merge pull request from dimarub2000/config_exception
Throw an exception if config.d file doesn't have the corresponding root element as the config file
2019-07-25 04:00:33 +03:00
Alexey Milovidov
6b2810d346 Fixed error with non-SIMD implementation of memcmpSmall 2019-07-25 03:28:27 +03:00
Alexey Milovidov
5755c93d5c Fixed MSan report 2019-07-25 01:31:39 +03:00
Alexey Milovidov
4c57405770 Added information about revision to trace log 2019-07-24 23:12:32 +03:00
Alexey Milovidov
cfb2066198 Added information about thread number to trace log 2019-07-24 23:10:23 +03:00
Alexey Milovidov
4b93b45935 Update settings description 2019-07-24 22:22:42 +03:00
Alexey Milovidov
d9976abe18 Added ProfileEvents for signal handler overruns 2019-07-24 22:19:29 +03:00
Alexey Milovidov
63764af4fb Merge branch 'merge-profiler' of github.com:yandex/ClickHouse into merge-profiler 2019-07-24 22:04:13 +03:00
Alexey Milovidov
6e8258fa2f Added ProfileEvent for dropped traces due to pipe full 2019-07-24 22:04:07 +03:00
Alexey Milovidov
f031d064b6 Don't drop all traces if frequency is too high 2019-07-24 22:03:26 +03:00
chertus
b3123df58e use source and joined columns to detect JOIN ON right and left keys 2019-07-24 18:37:37 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
Vitaly Baranov
d3ff30cb5b Use better approach to check offsets in protobuf messages. 2019-07-24 14:41:49 +03:00
alesapin
75c2f4950b Merge branch 'master' into fix_index_write_with_adaptive_granularity 2019-07-24 14:13:20 +03:00
Nikolai Kochetov
ca17df3f26
Merge pull request from yandex/fix-cast-from-nullable-lc
Fix LowCardinality(Nullable) to not-Nullable cast.
2019-07-24 12:49:20 +03:00
Alexey Milovidov
56bb2956cd Addition to prev. revision 2019-07-24 05:07:16 +03:00
Alexey Milovidov
b9105e131f Avoid deadlock in TraceCollector 2019-07-24 05:02:10 +03:00
Alexey Milovidov
33ee957b5c Addition to prev. revision 2019-07-24 03:49:14 +03:00
Alexey Milovidov
36746d85dd Better cache for symbolizeAddress function 2019-07-24 03:47:17 +03:00
Alexey Milovidov
378fff2990 Lower bound on profiler period 2019-07-24 03:46:37 +03:00
Alexey Milovidov
a3f6b70433 Fixed warning from PVS-Studio 2019-07-23 23:07:33 +03:00
chertus
9da1b0089c visitor for JOIN ON keys extraction 2019-07-23 22:49:15 +03:00
Alexey Milovidov
02fb67dc8a Simple protection from too frequent profiler signals 2019-07-23 21:45:54 +03:00
Ivan Lezhankin
e8ef13edfa Check background_task_handle 2019-07-23 20:34:57 +03:00
alesapin
6e458a6a68 Fix secondary indices write with adaptive granularity 2019-07-23 18:27:36 +03:00
Alexey Milovidov
1913bfa276 Added cache for symbolizeAddress function 2019-07-23 17:59:29 +03:00
dimarub2000
752eccf2eb changes after review 2019-07-23 17:41:41 +03:00
Alexey Milovidov
1b00e99334 Fixed error with initialization of query profiler 2019-07-23 17:30:14 +03:00
Vitaly Baranov
746066be48 Remove excessive throw in a correct case. 2019-07-23 17:02:15 +03:00
Dmitry Rubashkin
13ef987361 Git commit fixes 2019-07-23 16:53:25 +03:00
Dmitry Rubashkin
4d43cf2a8d config exception when not corresponding root names 2019-07-23 16:53:25 +03:00
Alexey Milovidov
0755d1e4b3 Added demangling to function symbolizeAddress 2019-07-23 16:34:22 +03:00
Alexey Milovidov
bd3173bac2 Added comment 2019-07-23 16:17:56 +03:00
Alexey Milovidov
398a280f23 Fixed error 2019-07-23 16:16:51 +03:00
Alexey Milovidov
97103b9067 Every function in its own file 2019-07-23 15:55:13 +03:00
Alexey Milovidov
2d895c4fe6 Changed symbolizeTrace to symbolizeAddress 2019-07-23 15:46:58 +03:00
chertus
9baf1bf196 Merge branch 'master' into ast 2019-07-23 13:49:18 +03:00
tai
b01f54ade1 ISSUE-5695: support push down predicate to final subquery 2019-07-23 18:22:07 +08:00
Yuriy
a1152f99ae switching to sha256_password after handshake in order to use PHP client without SSL 2019-07-23 10:57:58 +03:00
Nikolai Kochetov
1e35f87760 Fix CAST from LowCardinality(Nullable). 2019-07-23 10:57:32 +03:00
Alexey Milovidov
a652a8bb6c Disabled query profiler by default 2019-07-23 03:04:04 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request from dimarub2000/master
CREATE TABLE AS table_function()
2019-07-23 02:50:08 +03:00
chertus
eaa3cb557a move prefer_alias_to_column_name logic out of parser 2019-07-22 22:21:07 +03:00
Nikolai Kochetov
fa2610e096 Fix CAST from LowCardinality(Nullable). 2019-07-22 19:46:42 +03:00
Nikolai Kochetov
1d960e5c0b Fix CAST from LowCardinality(Nullable). 2019-07-22 18:41:52 +03:00
Dmitry Rubashkin
0320de9132 test and fixes 2019-07-22 16:49:16 +03:00
Dmitry Rubashkin
9ffbf65741 Fix of a fix 2019-07-22 15:50:10 +03:00
Dmitry Rubashkin
42efc1051e fixes of bad commit 2019-07-22 15:35:29 +03:00
Dmitry Rubashkin
d279a685a9 Merge branch 2019-07-22 15:31:17 +03:00
Dmitry Rubashkin
6c6af60194 Fixes after review 2019-07-22 15:18:53 +03:00
Ivan Lezhankin
762f1d3a85 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-22 13:19:37 +03:00
alexey-milovidov
adfc369172
Merge pull request from vitlibar/fix-segfault-in-reload-outdated
Fix segfault in ExternalLoader::reloadOutdated().
2019-07-22 01:28:37 +03:00
alexey-milovidov
3da461fea5
Merge pull request from yandex/Immowelt-ThreeDots
Merging COLUMNS matcher
2019-07-22 01:27:38 +03:00
Alexey Milovidov
b2961bcc31 Added check for empty number of columns; improved test 2019-07-22 00:19:42 +03:00
Alexey Milovidov
8060993ca2 Removed obsolete comment 2019-07-21 23:40:34 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
Alexey Milovidov
fb0d09c5d3 Rename files 2019-07-21 20:03:58 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Alexey Milovidov
7064fe6678 Merge branch 'master' into Immowelt-ThreeDots 2019-07-21 02:21:55 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
Ivan Lezhankin
301a64afa6 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-21 01:09:03 +03:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
alexey-milovidov
c6b468d435
Merge pull request from yandex/odbc-initial-load-fix
Fix for initial load of external dictionaries via ODBC
2019-07-20 04:26:22 +03:00
alexey-milovidov
67b72f4261
Merge pull request from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
alexey-milovidov
b035edefea
Update InterpreterCreateQuery.cpp 2019-07-20 03:02:18 +03:00
alexey-milovidov
f9d1214bbc
Update DatabasesCommon.cpp 2019-07-20 02:51:43 +03:00
alexey-milovidov
3abf1b278e
Update DatabasesCommon.cpp 2019-07-20 02:51:20 +03:00
Alexey Milovidov
389cf9fcee Better fix: removed old and bad code 2019-07-20 02:10:55 +03:00
Alexey Milovidov
21165edcb7 Quick fix for initial load of external dictionaries via ODBC 2019-07-20 02:06:15 +03:00
alexey-milovidov
ad95d4e3e0
Merge pull request from Quid37/master
regression methods adam optimizer
2019-07-20 00:45:51 +03:00
alexey-milovidov
175c4655d8
Merge pull request from 4ertus2/ast
Enable 'input_format_defaults_for_omitted_fields' by default
2019-07-20 00:42:01 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for 2019-07-20 00:37:34 +03:00
alexey-milovidov
4adf47bb77
Merge pull request from PerformanceVision/fix_ipv6_cidr
Resolve segfault on IPv6CIDRToRange with setting a max cidr
2019-07-20 00:32:05 +03:00
alexey-milovidov
d0eb20f4b7
Merge pull request from bopohaa/fix-protobuf-length-delimited-message-limit
Add verification of the length of the protobuf message
2019-07-20 00:31:36 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexey Milovidov
9a9e6b7a44 Minor modification 2019-07-20 00:09:28 +03:00
alexey-milovidov
746fe5cdac
Merge pull request from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
Vitaly Baranov
e64f8e606d Add comments. 2019-07-20 00:04:19 +03:00
alexey-milovidov
f18e9592a1 Update ExternalLoader.cpp 2019-07-20 00:03:57 +03:00
Vitaly Baranov
5b879e143f Fix segfault in ExternalLoader::reloadOutdated(). 2019-07-20 00:03:25 +03:00
alexey-milovidov
ca5d078a23
Update DatabaseOrdinary.cpp 2019-07-20 00:02:29 +03:00
alexey-milovidov
14f14c68cb
Update FunctionsCoding.h 2019-07-19 23:58:28 +03:00
alexey-milovidov
936aa38e64
Merge pull request from weiqxu/master
support reading from HA mode HDFS
2019-07-19 23:56:09 +03:00
Yuriy
be589ed825 commented about endianness 2019-07-19 22:29:44 +03:00
Yuriy
fa2dfcd71d better 2019-07-19 21:43:52 +03:00
Yuriy
475179cec7 added size limit for packets which are read without memory tracker (all packets except for COM_QUERY) 2019-07-19 20:55:07 +03:00
Alexey Milovidov
9ccf5a7c90 Merge branch 'master' into Immowelt-ThreeDots 2019-07-19 19:54:00 +03:00
alexey-milovidov
6f96102fe9
Merge pull request from yandex/uniq-fix-non-deterministic-result
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
2019-07-19 18:40:12 +03:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header 2019-07-19 15:57:23 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
dimarub2000
c9ec16987e minor fixes 2019-07-18 22:09:45 +03:00
dimarub2000
1ab0893432 minor fixes 2019-07-18 21:59:31 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue . Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00