Commit Graph

19245 Commits

Author SHA1 Message Date
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
Alexey Milovidov
7ce6a71c95 Steal part of modifications from #6007 2019-07-20 02:42:59 +03:00
alexey-milovidov
ad95d4e3e0
Merge pull request #6000 from Quid37/master
regression methods adam optimizer
2019-07-20 00:45:51 +03:00
alexey-milovidov
175c4655d8
Merge pull request #6043 from 4ertus2/ast
Enable 'input_format_defaults_for_omitted_fields' by default
2019-07-20 00:42:01 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for #6070 2019-07-20 00:37:34 +03:00
alexey-milovidov
4adf47bb77
Merge pull request #6068 from PerformanceVision/fix_ipv6_cidr
Resolve segfault on IPv6CIDRToRange with setting a max cidr
2019-07-20 00:32:05 +03:00
alexey-milovidov
d0eb20f4b7
Merge pull request #6070 from bopohaa/fix-protobuf-length-delimited-message-limit
Add verification of the length of the protobuf message
2019-07-20 00:31:36 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexey Milovidov
9a9e6b7a44 Minor modification #6073 2019-07-20 00:09:28 +03:00
alexey-milovidov
746fe5cdac
Merge pull request #6073 from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
alexey-milovidov
ca5d078a23
Update DatabaseOrdinary.cpp 2019-07-20 00:02:29 +03:00
alexey-milovidov
14f14c68cb
Update FunctionsCoding.h 2019-07-19 23:58:28 +03:00
alexey-milovidov
936aa38e64
Merge pull request #6062 from weiqxu/master
support reading from HA mode HDFS
2019-07-19 23:56:09 +03:00
alexey-milovidov
6f96102fe9
Merge pull request #6058 from yandex/uniq-fix-non-deterministic-result
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
2019-07-19 18:40:12 +03:00
Alexey Milovidov
faa07c8440 Added a test 2019-07-19 18:37:45 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dc8b83c882 Added a test #6040 2019-07-17 20:23:06 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00