Commit Graph

19699 Commits

Author SHA1 Message Date
Alexey Milovidov
9b5cba8174 Fixed bad code 2019-07-22 00:35:43 +03:00
Alexey Milovidov
b2961bcc31 Added check for empty number of columns; improved test 2019-07-22 00:19:42 +03:00
Alexey Milovidov
8060993ca2 Removed obsolete comment 2019-07-21 23:40:34 +03:00
alexey-milovidov
ea9b36e531
Merge pull request #6091 from yurriy/php-client-test
MySQL Native Driver test
2019-07-21 23:29:24 +03:00
CurtizJ
e559c8f949 fix build 2019-07-21 21:17:28 +03:00
Alexey Milovidov
fb0d09c5d3 Rename files 2019-07-21 20:03:58 +03:00
alexey-milovidov
9f9dd040dd
Update StorageMergeTree.cpp 2019-07-21 17:14:55 +03:00
Yuriy
28a0481f1a php mysql client test 2019-07-21 15:19:14 +03:00
Mikhail f. Shiryaev
75de4eec70 Add tests for optimization exceptions 2019-07-21 08:57:24 +02:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Alexey Milovidov
7064fe6678 Merge branch 'master' into Immowelt-ThreeDots 2019-07-21 02:21:55 +03:00
Mikhail f. Shiryaev
15fd980d0b Add description "unable to select parts" and logging 2019-07-21 00:39:40 +02:00
Ivan Lezhankin
301a64afa6 Merge remote-tracking branch 'upstream/master' into issue-5846 2019-07-21 01:09:03 +03:00
alexey-milovidov
8008ce6e9e Update StorageReplicatedMergeTree.cpp 2019-07-20 10:44:05 +02:00
Mikhail f. Shiryaev
da50663e2c Pass a proper message to exception 2019-07-20 10:44:05 +02:00
alexey-milovidov
c6b468d435
Merge pull request #6083 from yandex/odbc-initial-load-fix
Fix for initial load of external dictionaries via ODBC
2019-07-20 04:26:22 +03:00
Alexey Milovidov
7661eeefa0 Fixed idiotic test 2019-07-20 03:47:06 +03:00
Alexey Milovidov
cf873b9308 Fixed flappy test (can fail due to timeout in debug/sanitizer builds) 2019-07-20 03:28:48 +03:00
alexey-milovidov
67b72f4261
Merge pull request #6029 from yandex/aku/agg-arenas
Do not access shared arenas in aggregate function columns.
2019-07-20 03:16:24 +03:00
alexey-milovidov
b035edefea
Update InterpreterCreateQuery.cpp 2019-07-20 03:02:18 +03:00
alexey-milovidov
f9d1214bbc
Update DatabasesCommon.cpp 2019-07-20 02:51:43 +03:00
alexey-milovidov
3abf1b278e
Update DatabasesCommon.cpp 2019-07-20 02:51:20 +03:00
Alexey Milovidov
7ce6a71c95 Steal part of modifications from #6007 2019-07-20 02:42:59 +03:00
Alexey Milovidov
389cf9fcee Better fix: removed old and bad code #6069 2019-07-20 02:10:55 +03:00
Alexey Milovidov
21165edcb7 Quick fix for initial load of external dictionaries via ODBC 2019-07-20 02:06:15 +03:00
alexey-milovidov
ad95d4e3e0
Merge pull request #6000 from Quid37/master
regression methods adam optimizer
2019-07-20 00:45:51 +03:00
alexey-milovidov
175c4655d8
Merge pull request #6043 from 4ertus2/ast
Enable 'input_format_defaults_for_omitted_fields' by default
2019-07-20 00:42:01 +03:00
Alexey Milovidov
d0996c0b73 Minor modifications for #6070 2019-07-20 00:37:34 +03:00
alexey-milovidov
4adf47bb77
Merge pull request #6068 from PerformanceVision/fix_ipv6_cidr
Resolve segfault on IPv6CIDRToRange with setting a max cidr
2019-07-20 00:32:05 +03:00
alexey-milovidov
d0eb20f4b7
Merge pull request #6070 from bopohaa/fix-protobuf-length-delimited-message-limit
Add verification of the length of the protobuf message
2019-07-20 00:31:36 +03:00
alexey-milovidov
3a8bb58522
Update ProtobufReader.cpp 2019-07-20 00:30:22 +03:00
alexey-milovidov
f2b6adf15e
Update ProtobufReader.cpp 2019-07-20 00:27:20 +03:00
alexey-milovidov
6cb9e9f56f
Update ProtobufReader.h 2019-07-20 00:26:12 +03:00
alexey-milovidov
3ec2360afd
Update ProtobufReader.h 2019-07-20 00:25:49 +03:00
alexey-milovidov
93ddb7da89
Update ProtobufReader.cpp 2019-07-20 00:25:07 +03:00
Alexey Milovidov
9a9e6b7a44 Minor modification #6073 2019-07-20 00:09:28 +03:00
alexey-milovidov
746fe5cdac
Merge pull request #6073 from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
Vitaly Baranov
e64f8e606d Add comments. 2019-07-20 00:04:19 +03:00
alexey-milovidov
f18e9592a1 Update ExternalLoader.cpp 2019-07-20 00:03:57 +03:00
Vitaly Baranov
5b879e143f Fix segfault in ExternalLoader::reloadOutdated(). 2019-07-20 00:03:25 +03:00
alexey-milovidov
ca5d078a23
Update DatabaseOrdinary.cpp 2019-07-20 00:02:29 +03:00
alexey-milovidov
14f14c68cb
Update FunctionsCoding.h 2019-07-19 23:58:28 +03:00
alexey-milovidov
936aa38e64
Merge pull request #6062 from weiqxu/master
support reading from HA mode HDFS
2019-07-19 23:56:09 +03:00
Yuriy
be589ed825 commented about endianness 2019-07-19 22:29:44 +03:00
Alexander Tokmakov
fb06a8518e optimization 2019-07-19 21:56:14 +03:00
Yuriy
34a4d6a57a better 2019-07-19 21:46:57 +03:00
Yuriy
fa2dfcd71d better 2019-07-19 21:43:52 +03:00
Yuriy
39ea5486f5 removed reinterpret_cast 2019-07-19 21:29:39 +03:00
Yuriy
475179cec7 added size limit for packets which are read without memory tracker (all packets except for COM_QUERY) 2019-07-19 20:55:07 +03:00
Alexey Milovidov
9ccf5a7c90 Merge branch 'master' into Immowelt-ThreeDots 2019-07-19 19:54:00 +03:00
alexey-milovidov
6f96102fe9
Merge pull request #6058 from yandex/uniq-fix-non-deterministic-result
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
2019-07-19 18:40:12 +03:00
Alexey Milovidov
faa07c8440 Added a test 2019-07-19 18:37:45 +03:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription.
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
2019-07-19 18:01:34 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
CurtizJ
1bec5a8241 refactor MergeTree select streams 2019-07-19 17:56:00 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
tavplubix
349d69c849
Merge branch 'master' into csv_unquoted_nulls_and_default_values 2019-07-19 17:03:34 +03:00
Alexander Tokmakov
8146126dfd improvements 2019-07-19 16:57:20 +03:00
Dmitry Rubashkin
6ba4408741 Tests added 2019-07-19 16:30:22 +03:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
2019-07-19 07:32:59 +08:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some
Count new/delete memory in MemoryTracker
2019-07-18 23:07:00 +03:00
dimarub2000
c9ec16987e minor fixes 2019-07-18 22:09:45 +03:00
dimarub2000
1ab0893432 minor fixes 2019-07-18 21:59:31 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
CurtizJ
12b3560def build fixes 2019-07-18 21:34:15 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
Alexander Tokmakov
4c8c516208 add tests 2019-07-18 18:54:58 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
Alexander Tokmakov
6565d5c15f parse unquoted NULL 2019-07-18 18:20:45 +03:00
CurtizJ
4380404604 skip block with zero rows in MergingSortedBlockInputStream 2019-07-18 18:09:08 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
Alexander Tokmakov
668959b300 use default if not nullable 2019-07-18 16:43:20 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns.
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
2019-07-18 14:21:37 +03:00
Yuriy
1913ae9cee fixed asan check 2019-07-18 08:00:35 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dc8b83c882 Added a test #6040 2019-07-17 20:23:06 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex
Check dictionaries for modification with unlocked ExternalLoader::mutex
2019-07-17 16:06:25 +03:00
proller
9be369fed5
clickhouse-test: optional termcolor (#6035) 2019-07-17 15:46:20 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
Nikita Mikhaylov
56c9bf5acc pep8 2019-07-17 14:57:05 +03:00
Nikita Mikhaylov
e5360413a6 integration test added 2019-07-17 14:55:18 +03:00
alexey-milovidov
07fcbbcdc8
Merge pull request #6028 from amosbird/c1
Optimize count()
2019-07-17 13:08:16 +03:00
alexey-milovidov
e11c4a7740
Merge pull request #6027 from amosbird/c2
Misc build fix
2019-07-17 12:47:16 +03:00
Vitaly Baranov
38c3889564 Add an integration test for the invalidate_query parameter. 2019-07-17 11:40:35 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Alexander Kozhikhov
52007c96d9 adam is default now 2019-07-17 00:11:10 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
Vitaly Baranov
96f7a41044 Add an integration test for the invalidate_query parameter. 2019-07-16 20:57:08 +03:00
Vitaly Baranov
b74dacf9c4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-16 20:47:18 +03:00
Alexey Milovidov
3793c3cd13 Merge branch 'ThreeDots' of https://github.com/Immowelt/ClickHouse into Immowelt-ThreeDots 2019-07-16 19:41:05 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master
Minor fixes for FullTextIndex string functions
2019-07-16 19:30:32 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem
Report memory usage in performance tests.
2019-07-16 18:09:44 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
alexey-milovidov
14dc9ad801
Merge pull request #6024 from yandex/check_table_old_behaviour
Add settings for check query backward compatibility
2019-07-16 15:19:55 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
alesapin
27447d4816 Fix style 2019-07-16 13:50:59 +03:00
alesapin
0df345c2d9 Fix integration test 2019-07-16 13:49:16 +03:00
alesapin
f786c45ac4 Add settings for check query backward compatibility 2019-07-16 13:19:37 +03:00
Yuriy
a03114ede2 cast to proper type 2019-07-16 11:47:54 +03:00
Yuriy
d74be1dc9c fixed MySQLOutputFormat used by new query processing pipeline 2019-07-16 11:24:51 +03:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
c370de432a better 2019-07-16 10:28:53 +03:00
Yuriy
a514de943c replacing not implemented query 2019-07-16 10:11:59 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
alexey-milovidov
70b0c3157d
Merge pull request #6009 from filimonov/config_for_query_masking_rules_tests
configs for query masking rules tests
2019-07-16 03:38:18 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
2019-07-16 03:36:42 +03:00
alexey-milovidov
b4306c13cd
Merge pull request #6019 from yandex/fix-max-rows-to-read-without-uniform-read-distribution
Fixed error with calculating of max_rows_to_read if the setting merge_tree_uniform_read_distribution is set to zero.
2019-07-16 02:06:17 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2
Fixed DoubleDelta encoding cases for random Int32 and Int64.
2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
alexey-milovidov
37f9206925
Merge pull request #6001 from yandex/fixed-error-with-query-id-printing
Fixed error with query_id printing
2019-07-16 00:46:11 +03:00
alexey-milovidov
c517c467de
Merge pull request #6018 from yandex/fix_protocol_inconsistency
Fix bug client version which is able to read additional progress fiel…
2019-07-16 00:38:00 +03:00
Yuriy
f221fb0999 build fix 2019-07-15 23:37:01 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Alexey Milovidov
77fb3de2d6 Improved test 2019-07-15 23:26:22 +03:00
Alexey Milovidov
21958c47cd Added failing test 2019-07-15 23:06:20 +03:00
alexey-milovidov
bfe5022643
Merge pull request #6008 from yandex/gcd-lcm-std
Using std::gcd, lcm instead of boost
2019-07-15 22:30:42 +03:00
Alexey Milovidov
066337e197 Fixed test 2019-07-15 22:29:54 +03:00
Alexey Milovidov
3ac5ca0da0 Merge branch 'master' into fixed-error-with-query-id-printing 2019-07-15 22:29:33 +03:00
Alexey Milovidov
1937623f18 Better test 2019-07-15 22:13:43 +03:00
alexey-milovidov
1597103107
Merge pull request #6017 from yandex/mimallocexceptions
Add OOM checks in mimalloc
2019-07-15 22:10:05 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Alexey Milovidov
a175c55136 Added a test that shows catastrophic behaviour of mimalloc 2019-07-15 21:49:30 +03:00
alesapin
25ed737798 Fix bug client version which is able to read additional progress fields from server 2019-07-15 21:05:49 +03:00
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Alexey Milovidov
b3c0292613 Fixed error; added test 2019-07-15 19:32:52 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Nikolai Kochetov
ced2721ce8 Fix deserializeAndInsertFromArena. (#5973) 2019-07-15 19:20:21 +03:00
alesapin
30464ccef7 Remove flapping uniqCombined(>= 19) tests 2019-07-15 19:19:25 +03:00
Nikita Mikhailov
d192df1388 poco patch define added 2019-07-15 18:25:32 +03:00
Mikhail Filimonov
e7b23d4fb2 configs for query masking rules tests 2019-07-15 16:53:16 +02:00
Alexey Milovidov
68ba42cc89 Using std::gcd, lcm instead of boost 2019-07-15 17:45:56 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
91028e9e5d Merge branch 'master' into some 2019-07-15 13:45:48 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Alexey Milovidov
4d14f8c230 Fixed error in query_id printing 2019-07-15 04:07:01 +03:00
Yuriy
baa62f2aba style check 2019-07-15 01:53:30 +03:00
Yuriy
0ed77453d3 reading packets in parts 2019-07-15 01:13:56 +03:00
Alexander Kozhikhov
7c54bb0956 deleted metadata 2019-07-14 23:38:07 +03:00
Alexander Kozhikhov
860be14761 adam optimizer 2019-07-14 23:35:34 +03:00
Yuriy
a6bd5bccff tiny fix 2019-07-14 11:27:58 +03:00
Alexey Milovidov
e1271ae1f2 Added missing file #5958 2019-07-13 02:13:15 +03:00
alexey-milovidov
1314e083b4
Merge pull request #5958 from alex-krash/coverage_tests
Batch of tests
2019-07-13 00:52:18 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
chertus
8c715d9b91 minor fix in cmake-files 2019-07-12 20:22:20 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
Maxim Fridental
bb40d4729c Implement COLUMNS clause 2019-07-12 13:17:38 +02:00
Vitaly Baranov
fd89a8b051
Merge pull request #5212 from andyyzh/custom_week_functions
Added functions for working with the Custom week number
2019-07-12 14:00:35 +03:00
alexey-milovidov
ac035f7f5b
Merge pull request #5970 from vitlibar/invalid-json-must-not-parse
Extra bytes after correctly parsed JSON are now considered as a parsing error.
2019-07-12 03:26:42 +03:00
alexey-milovidov
a3dda4053f
Merge pull request #5979 from vitlibar/read-prefix-before-blocks-while-executing-subquery
Fix using a table powered by the File engine in a subquery.
2019-07-12 03:20:31 +03:00
Alexander Kozhikhov
c5b0871c9b small fix 2019-07-12 00:02:22 +03:00
Alexander Kozhikhov
e046cdd62d some change on regression method 2019-07-11 23:56:58 +03:00
Nikolai Kochetov
954485ad6b Disable processors by default. 2019-07-11 19:30:39 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Vitaly Baranov
001e4daf25 Read prefix before blocks while executing subquery. 2019-07-11 16:53:26 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
Vitaly Baranov
7aad2eff28 Add more test cases for JSON functions. 2019-07-11 11:39:30 +03:00
Vitaly Baranov
8306f25634 Extra bytes after correctly parsed JSON is now considered as a parsing error. 2019-07-11 11:31:45 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
robot-clickhouse
f635d2bd9b Auto version update to [19.12.1.1] [54424] 2019-07-10 22:57:53 +03:00
robot-clickhouse
e0f04dee04 Auto version update to [19.11.0.830] [54423] 2019-07-10 22:57:24 +03:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
Vitaly Baranov
10b6e1b786
Merge pull request #5962 from vitlibar/fix-unused-variable-in-checkDataPart.cpp
Fix unused variable in checkDataPart.cpp
2019-07-10 19:10:55 +03:00
Ivan Lezhankin
998aa795fc Merge remote-tracking branch 'upstream/master' into fix-filter-table 2019-07-10 18:14:15 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Nikita Mikhaylov
55e9e21cc5 better includes 2019-07-10 16:05:12 +03:00
Nikita Mikhaylov
c0a4495d17 multithreading 2019-07-10 16:04:50 +03:00
Nikita Mikhaylov
1740a24ded better 2019-07-10 16:04:39 +03:00
Nikita Mikhaylov
6ff9dfce34 first try 2019-07-10 16:04:01 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Alexey Milovidov
7643b1c7f9 Attempt to fix "splitted" build 2019-07-10 14:46:37 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Alexandr Krasheninnikov
eb78c9f084 Batch of tests 2019-07-10 13:19:14 +03:00
Nikolai Kochetov
282feb1fdb Update PipelineExecutor 2019-07-10 09:52:44 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
alexey-milovidov
cb05312ce0
Merge branch 'master' into libcxx-as-submodule 2019-07-09 22:35:03 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Nikolai Kochetov
6974cc3c9f Update ResizePipeline 2019-07-09 20:47:13 +03:00
Alexey Milovidov
85100048dd Updated instruction 2019-07-09 20:36:51 +03:00
alexey-milovidov
97b75fe343
Merge pull request #5946 from akonyaev90/add_user_parsing_in_HDFS_uri
WIP: add user parsing in HDFS URI
2019-07-09 20:35:57 +03:00
alexey-milovidov
f6df911307
Update HDFSCommon.cpp 2019-07-09 20:35:47 +03:00
alesapin
8faf0b0dc7 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-09 19:43:03 +03:00
alesapin
81ee9a3683 Log to stderr for external_dictionaries tests 2019-07-09 19:42:37 +03:00
Alexey Milovidov
729ecfa9ab Fixed build without SSL (disable MySQL protocol support) 2019-07-09 19:41:11 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
Alexey Milovidov
ed5abe83c0 Fixed build without SSL (disable MySQL protocol support) 2019-07-09 17:59:52 +03:00
Alexander Kuzmenkov
8c379fb972 Flush query log instead of waiting for it. 2019-07-09 17:22:42 +03:00
akonyaev
54d890b984 add user parsing in HDFS URI (rewrite split boost->std::string) 2019-07-09 17:09:56 +03:00
akonyaev
c0dc8fc9d3 add user parsing in HDFS URI (fixes after review, style fixes) 2019-07-09 16:16:04 +03:00
Nikolai Kochetov
0df2a67c19 Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:46:50 +03:00
Nikolai Kochetov
911e4014ff Increase queue size in LazyOutputFormat in order to prevent potential lock. 2019-07-09 15:26:22 +03:00
akonyaev
74b2440f66 add user parsing in HDFS URI 2019-07-09 13:26:06 +03:00
Alexander Kuzmenkov
f260296f89 Print logs to stderr. 2019-07-09 12:49:34 +03:00
alesapin
d4c44320ea Merge branch 'fix_fetch_of_existing_part' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 12:04:00 +03:00
alesapin
9a17a461ea Review fixes and better tests 2019-07-09 12:02:52 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
Alexey Milovidov
283872f098 Fixed build 2019-07-09 05:12:02 +03:00
Alexey Milovidov
823ef749fd Fixed build 2019-07-09 05:06:26 +03:00
Alexey Milovidov
10e4baf3f8 Fixed build 2019-07-09 05:01:25 +03:00
alexey-milovidov
ef3c06b3d0
Merge pull request #5943 from yandex/ubsan-fixes-5
Fixed ubsan report in fuzz test
2019-07-09 04:12:49 +03:00
Alexey Milovidov
8778b9a1f3 "clickhouse_compression" library is dependent on "typeinfo for DB::IDataType" (at least when building with ubsan) 2019-07-09 04:09:42 +03:00
alexey-milovidov
d6afdd5a8d
Merge pull request #5941 from 4ertus2/bugs
Fix wrong array_join_columns calculation
2019-07-09 03:58:36 +03:00
Alexey Milovidov
52bb292327 Merge branch 'master' into libcxx-as-submodule 2019-07-09 01:58:09 +03:00
Alexey Milovidov
f748efbb5b Fixed ubsan report in fuzz test 2019-07-09 01:30:30 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
alexey-milovidov
3c7178a8d1
Merge pull request #5923 from yandex/add-noreturn
Add two more warnings from -Weverything
2019-07-09 00:10:35 +03:00
chertus
ef41b16a44 fix wrong ExpressionAnalyzer.array_join_columns calculation 2019-07-08 23:06:17 +03:00
alexey-milovidov
c491cddb78
Update CheckResults.h 2019-07-08 22:56:48 +03:00
alexey-milovidov
6088aa233f
Update ASTCheckQuery.h 2019-07-08 22:55:54 +03:00
alexey-milovidov
a1e7d12f68
Update ParserQueryWithOutput.cpp 2019-07-08 22:55:36 +03:00
Alexey Milovidov
02eada5b35 Fixed error in prev. revision 2019-07-08 22:41:11 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Nikolai Kochetov
27acbb0412 Fix tests. 2019-07-08 21:08:44 +03:00
Alexey Milovidov
26f91c4a96 Added a test 2019-07-08 20:05:38 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Alexey Milovidov
c1bb550c07 Addition to prev. revision 2019-07-08 19:58:32 +03:00
Alexey Milovidov
a5cce21ebd Addition to prev. revision 2019-07-08 19:53:49 +03:00
Alexey Milovidov
6512f923ac Fixed error with unit test 2019-07-08 19:47:40 +03:00
Alexey Milovidov
3779a5cba2 Addition to prev. revision 2019-07-08 19:01:00 +03:00
Nikolai Kochetov
de2221222e Don't skip empty chunks in Filter Transform. 2019-07-08 18:52:18 +03:00
Alexander Kuzmenkov
78df28f0e9 Cleanup. 2019-07-08 18:35:32 +03:00
Nikolai Kochetov
2128fb890b Don't skip empty chunks in Filter Transform. 2019-07-08 18:23:45 +03:00
Alexander Kuzmenkov
b928d87d8a error: declaration shadows a field of 'DB::PerformanceTest' 2019-07-08 18:08:46 +03:00
Nikolai Kochetov
865f403227 Remove tsan-suppressions. 2019-07-08 16:29:26 +03:00
Alexander Kuzmenkov
bdbb77a0a1 Read the query log after running all the queries.
The log entries appear ~10s after a query has finished, so waiting
for them after each query takes too long.
2019-07-08 16:23:30 +03:00
Nikolai Kochetov
e0362c5216 Fix build. 2019-07-08 16:15:45 +03:00
Alexey Milovidov
3f92ecf334 Merge branch 'master' into add-noreturn 2019-07-08 16:13:56 +03:00
Nikolai Kochetov
a2cdab2799 Fix build. 2019-07-08 16:07:46 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Nikolai Kochetov
e5103d741c Fix lock in case of query was cancelled. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
fc3b465d60 Fix race in doExpandPipeline. 2019-07-08 15:49:46 +03:00
Nikolai Kochetov
a27fbe6ea7 Removed lockfree stack. 2019-07-08 15:49:33 +03:00
Nikolai Kochetov
fbd96ff037 Disable processors for 00416_pocopatch_progress_in_http_headers 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
a4b3338182 Add sorting to tests with union. 2019-07-08 15:49:28 +03:00
Nikolai Kochetov
45b7d479aa Fix arguments in prepareProcessor call. 2019-07-08 15:49:23 +03:00
Nikolai Kochetov
02bded6f21 Added MySQLOutputFormat. 2019-07-08 15:49:15 +03:00
Nikolai Kochetov
acf382f9e5 Use boost::lockfree::stack instead of boost::lockfree::queue 2019-07-08 15:48:51 +03:00
Nikolai Kochetov
3ff5495fba Fix raise in PipelineExecutor::doExpandPipeline 2019-07-08 15:48:41 +03:00
Nikolai Kochetov
3df6d12216 More comments for PipelineExecutor. 2019-07-08 15:48:16 +03:00
Nikolai Kochetov
e8b4362ed2 Use ThreadPool in PipelineExecutor. 2019-07-08 15:48:32 +03:00
Nikolai Kochetov
f808d71aba Fix build. 2019-07-08 15:48:16 +03:00
Alexey Milovidov
36269c4e2a Addition to prev. revision 2019-07-08 06:41:37 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
57d8dac95d Two more fixes for PVS-Studio 2019-07-08 05:06:15 +03:00
Alexey Milovidov
f9f85b4c65 Added test 2019-07-08 05:03:01 +03:00
Alexey Milovidov
ac20c515ab Better code in unit tests 2019-07-08 04:58:31 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
d362ffb3ee Added test for #5909 2019-07-08 04:01:52 +03:00
Alexey Milovidov
c35a832095 Two more fixes for PVS-Studio 2019-07-08 03:56:52 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
Alexey Milovidov
03712aabec Add two more warnings from -Weverything 2019-07-08 03:16:39 +03:00
Alexey Milovidov
e64e520e5b One more fix for PVS-Studio 2019-07-08 03:11:39 +03:00
Alexey Milovidov
19059ef650 One more fix for PVS-Studio 2019-07-08 02:29:54 +03:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
alexey-milovidov
8d4358f19c
Merge pull request #5919 from dimarub2000/master
startsWith now uses PK index
2019-07-08 02:06:05 +03:00
alexey-milovidov
0480706ff4
Update KeyCondition.cpp 2019-07-08 00:28:03 +03:00
dimarub2000
0b756c48a8 also style changes 2019-07-07 18:56:15 +03:00
dimarub2000
95118a5fa3 also style changes 2019-07-07 18:54:13 +03:00
dimarub2000
94523c00cd minor style changes 2019-07-07 18:52:20 +03:00
dimarub2000
2693ce27ff startsWith now uses PK index 2019-07-07 18:48:34 +03:00
alexey-milovidov
97b8b2c769
Merge pull request #5915 from yandex/merge-table-more-streams
Increase number of streams to SELECT from Merge table
2019-07-07 15:57:06 +03:00
alexey-milovidov
d9029be079
Merge pull request #5914 from yandex/merge-table-streams-perf-test
Added performance test in appreciation of #5797
2019-07-07 15:56:12 +03:00
alexey-milovidov
bf4ace06e8
Merge pull request #5911 from yandex/quantile-timing-float
Returned back support for floating point argument in function quantileTiming
2019-07-07 04:27:34 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Alexey Milovidov
99334d0451 Added a test #5614 2019-07-07 03:39:45 +03:00
Alexey Milovidov
2e6280de07 Fixed #5797 2019-07-07 03:20:38 +03:00
Alexey Milovidov
db0f1825b7 Added performance test in appreciation of #5797 2019-07-07 03:19:29 +03:00
Alexey Milovidov
e8b6ac3fad Returned back support for floating point argument in function quantileTiming 2019-07-07 02:15:14 +03:00
alexey-milovidov
a1cfdf2a60
Merge pull request #5855 from abyss7/no-undefined
Use --no-undefined linker option for split build
2019-07-07 01:47:11 +03:00
alexey-milovidov
31d71862e0
Merge pull request #5909 from yandex/os-nice
Added "os_thread_priority" setting
2019-07-06 23:59:56 +03:00
Nikita Lapkov
3828684f7a style 2019-07-06 20:42:03 +00:00
Nikita Lapkov
ef1d84b35a do not run trace collector without trace_log. do not run query profilers without trace collector. 2019-07-06 20:29:00 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
alexey-milovidov
758de14138
Merge pull request #5902 from yandex/fix-visit-param-extract-raw
Fixed buffer underflow in visitParamExtractRaw
2019-07-06 20:34:46 +03:00
alexey-milovidov
004d3d462a
Merge pull request #5903 from dimarub2000/master
Exect -> Exact grammar fixed
2019-07-06 17:55:39 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
dimarub2000
fd69ee1275 Exect -> Exact grammar improved 2019-07-06 01:18:37 +03:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
alexey-milovidov
f25a3fd230
Merge pull request #5886 from dimarub2000/master
Enum data type as a synonim for Enum8 or Enum16.
2019-07-05 23:59:36 +03:00
alexey-milovidov
eb2ffccaf3
Merge pull request #5874 from nikitamikhaylov/master
Add data checksums to system.parts_columns table. #5151
2019-07-05 23:58:58 +03:00
Alexey Milovidov
6b357421fc Added another test just in case 2019-07-05 21:47:59 +03:00
Alexey Milovidov
b396a5a392 Little better 2019-07-05 21:36:20 +03:00
alexey-milovidov
78c61ab772
Merge pull request #5890 from yandex/dns-cache-updater-allow-drift
Allow time drift in DNSCacheUpdater for natural randomization
2019-07-05 21:27:24 +03:00
alexey-milovidov
6dea389f26
Merge pull request #5892 from yandex/thread-status-remove-bad-code
ThreadStatus: removed bad and questionable code
2019-07-05 21:27:08 +03:00
alexey-milovidov
6a7c8b3c03
Merge pull request #5887 from PerformanceVision/test_jit
Add performance test concerning JIT with bigger dataset
2019-07-05 21:26:45 +03:00
dimarub2000
c4447355b3 Nicolay's suggestion 2019-07-05 21:23:50 +03:00
Alexey Milovidov
1c2e422797 Fixed buffer underflow in visitParamExtractRaw 2019-07-05 21:23:14 +03:00
Alexander Kuzmenkov
a43d3a6902 Report memory usage in performance tests. 2019-07-05 19:50:44 +03:00
Nikita Mikhaylov
afdd45fd85 checksum added to system_parts 2019-07-05 18:32:55 +03:00
Nikita Lapkov
6b7f587156 cut large query_ids 2019-07-05 14:16:20 +00:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
dimarub2000
6537016abe minor test change 2019-07-05 17:10:24 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
dimarub2000
a6086ed7a8 changed names 2019-07-05 16:48:14 +03:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
Nikita Mikhaylov
375932678b new test with table creation 2019-07-05 16:33:28 +03:00
dimarub2000
a7c05938e3 checkASTStructure 2019-07-05 16:33:03 +03:00
Alexey Milovidov
5c3cd40db3 Allow time drift in DNSCacheUpdater for natural randomization 2019-07-05 16:20:21 +03:00