Commit Graph

19395 Commits

Author SHA1 Message Date
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexey Milovidov
9a9e6b7a44 Minor modification #6073 2019-07-20 00:09:28 +03:00
alexey-milovidov
746fe5cdac
Merge pull request #6073 from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
Vitaly Baranov
e64f8e606d Add comments. 2019-07-20 00:04:19 +03:00
alexey-milovidov
f18e9592a1 Update ExternalLoader.cpp 2019-07-20 00:03:57 +03:00
Vitaly Baranov
5b879e143f Fix segfault in ExternalLoader::reloadOutdated(). 2019-07-20 00:03:25 +03:00
alexey-milovidov
ca5d078a23
Update DatabaseOrdinary.cpp 2019-07-20 00:02:29 +03:00
alexey-milovidov
14f14c68cb
Update FunctionsCoding.h 2019-07-19 23:58:28 +03:00
alexey-milovidov
936aa38e64
Merge pull request #6062 from weiqxu/master
support reading from HA mode HDFS
2019-07-19 23:56:09 +03:00
Alexey Milovidov
9ccf5a7c90 Merge branch 'master' into Immowelt-ThreeDots 2019-07-19 19:54:00 +03:00
alexey-milovidov
6f96102fe9
Merge pull request #6058 from yandex/uniq-fix-non-deterministic-result
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
2019-07-19 18:40:12 +03:00
Alexey Milovidov
faa07c8440 Added a test 2019-07-19 18:37:45 +03:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
Dmitry Rubashkin
6ba4408741 Tests added 2019-07-19 16:30:22 +03:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
dimarub2000
c9ec16987e minor fixes 2019-07-18 22:09:45 +03:00
dimarub2000
1ab0893432 minor fixes 2019-07-18 21:59:31 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
Igr Mineev
52bca488dc Add alter move part command 2019-07-18 18:19:03 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dc8b83c882 Added a test #6040 2019-07-17 20:23:06 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex
Check dictionaries for modification with unlocked ExternalLoader::mutex
2019-07-17 16:06:25 +03:00
proller
9be369fed5
clickhouse-test: optional termcolor (#6035) 2019-07-17 15:46:20 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
Nikita Mikhaylov
56c9bf5acc pep8 2019-07-17 14:57:05 +03:00
Nikita Mikhaylov
e5360413a6 integration test added 2019-07-17 14:55:18 +03:00
alexey-milovidov
07fcbbcdc8
Merge pull request #6028 from amosbird/c1
Optimize count()
2019-07-17 13:08:16 +03:00
alexey-milovidov
e11c4a7740
Merge pull request #6027 from amosbird/c2
Misc build fix
2019-07-17 12:47:16 +03:00
Vitaly Baranov
38c3889564 Add an integration test for the invalidate_query parameter. 2019-07-17 11:40:35 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Alexander Kozhikhov
52007c96d9 adam is default now 2019-07-17 00:11:10 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
Igr Mineev
770b74ac17 Add names for volumes 2019-07-16 21:20:47 +03:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
Vitaly Baranov
96f7a41044 Add an integration test for the invalidate_query parameter. 2019-07-16 20:57:08 +03:00
Vitaly Baranov
b74dacf9c4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-16 20:47:18 +03:00
Alexey Milovidov
3793c3cd13 Merge branch 'ThreeDots' of https://github.com/Immowelt/ClickHouse into Immowelt-ThreeDots 2019-07-16 19:41:05 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
Igr Mineev
ad497fbaa1 Fix bug with duplication of parts on restart 2019-07-16 16:06:23 +03:00
alexey-milovidov
14dc9ad801
Merge pull request #6024 from yandex/check_table_old_behaviour
Add settings for check query backward compatibility
2019-07-16 15:19:55 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
Igr Mineev
d6b1035301 Merge branch 'feature_multiple_disks' of https://github.com/filimonov/ClickHouse into filimonov-feature_multiple_disks 2019-07-16 14:23:33 +03:00
Igr Mineev
90fab48cd7 Stylefixes 2019-07-16 14:07:04 +03:00
alesapin
27447d4816 Fix style 2019-07-16 13:50:59 +03:00
alesapin
0df345c2d9 Fix integration test 2019-07-16 13:49:16 +03:00
Igr Mineev
21e0bec3d0 Merge remote-tracking branch 'upstream/master' into feature_multiple_disks 2019-07-16 13:45:07 +03:00
alesapin
f786c45ac4 Add settings for check query backward compatibility 2019-07-16 13:19:37 +03:00
alexey-milovidov
70b0c3157d
Merge pull request #6009 from filimonov/config_for_query_masking_rules_tests
configs for query masking rules tests
2019-07-16 03:38:18 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
alexey-milovidov
b4306c13cd
Merge pull request #6019 from yandex/fix-max-rows-to-read-without-uniform-read-distribution
Fixed error with calculating of max_rows_to_read if the setting merge_tree_uniform_read_distribution is set to zero.
2019-07-16 02:06:17 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
alexey-milovidov
37f9206925
Merge pull request #6001 from yandex/fixed-error-with-query-id-printing
Fixed error with query_id printing
2019-07-16 00:46:11 +03:00
alexey-milovidov
c517c467de
Merge pull request #6018 from yandex/fix_protocol_inconsistency
Fix bug client version which is able to read additional progress fiel…
2019-07-16 00:38:00 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Alexey Milovidov
77fb3de2d6 Improved test 2019-07-15 23:26:22 +03:00
Alexey Milovidov
21958c47cd Added failing test 2019-07-15 23:06:20 +03:00