thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-04 13:32:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
26,998 Commits 9,179 Branches 1,782 Tags 2.3 GiB
c633dfa5c0
Commit Graph

19383 Commits

Author SHA1 Message Date
alexey-milovidov
6f96102fe9
Merge pull request #6058 from yandex/uniq-fix-non-deterministic-result 
Fix non-deterministic result of "uniq" aggregate function in extreme rare cases.
 2019-07-19 18:40:12 +03:00
Alexey Milovidov
faa07c8440 Added a test 2019-07-19 18:37:45 +03:00
Ivan Lezhankin
f9945494d9 Always resume consumer before subscription. 
Also add more logs to see the difference between rd_kafka_assignment() vs rd_kafka_subscription()
 2019-07-19 18:01:34 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading. 
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
 2019-07-19 17:35:02 +03:00
Dmitry Rubashkin
6ba4408741 Tests added 2019-07-19 16:30:22 +03:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
Alexey Milovidov
98b0d08bf3 Added missing header #5981 2019-07-19 15:57:23 +03:00
Guillaume Tassery
7063ab3c38 Set max CIDR for IPV6 cidr function 2019-07-19 11:39:25 +02:00
Weiqing Xu
ec3c5a369d support reading from HA mode HDSF 
the driver libhdfs3 can support HA mode. When the uri doesn't contain
port num, the libhdfs3 will handle it in HA mode, treat the uri as
nameservice name and read the real host and port from configuration file
as the origin Java client.
the default configuration file is hdfs-client.xml in the working
directory, it also can be set in env variable "LIBHDFS3_CONF".
the format of the configuration file is same with hdfs-site.xml.
 2019-07-19 07:32:59 +08:00
Alexey Milovidov
a8caf269ca Better rehash loop 2019-07-18 23:28:47 +03:00
Alexey Milovidov
268854d14e Fix non-deterministic result of "uniq" aggregate function in extreme rare cases 2019-07-18 23:21:24 +03:00
Alexey Milovidov
71eed6507e Removed manual memory tracking when appropriate 2019-07-18 23:10:31 +03:00
alexey-milovidov
6706af64d7
Merge pull request #5981 from 4ertus2/some 
Count new/delete memory in MemoryTracker
 2019-07-18 23:07:00 +03:00
dimarub2000
c9ec16987e minor fixes 2019-07-18 22:09:45 +03:00
dimarub2000
1ab0893432 minor fixes 2019-07-18 21:59:31 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
alexey-milovidov
d3449e118f
Update TaskStatsInfoGetter.cpp 2019-07-18 21:24:38 +03:00
Amos Bird
9d5693bd69 fix clang build with certain toolchain 2019-07-19 02:17:26 +08:00
chertus
8f168005d9 disable (not working) defaults for table functions in HTTP 2019-07-18 19:54:31 +03:00
chertus
d8579714b8 trying to speedup Allocator::realloc() (attempt 2) 2019-07-18 18:25:23 +03:00
chertus
34e1b81f84 trying to speedup Allocator::realloc() 2019-07-18 18:07:41 +03:00
chertus
6885e892ae do not damage ColumnsDescription in TTLBlockInputStream (appempt 2) 2019-07-18 16:44:29 +03:00
chertus
5f510d5657 fix damage ColumnsDescription in TTLBlockInputStream 2019-07-18 16:30:02 +03:00
Nik
514851f0f8 Added verification of the length of the protobuff message 2019-07-18 15:58:03 +04:00
Alexander Kuzmenkov
9df09f3506 Do not access shared arenas in aggregate function columns. 
These arenas may be updated concurrently, so it is unsafe to
access them, as illustrated by issue #4402. Store them separately
and use a different arena for the updates. Change some callers
to accomodate for this.
 2019-07-18 14:21:37 +03:00
chertus
afa2bd6dfb allow alloc 4Mb more after out-of-limit exception 2019-07-18 01:48:31 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch 
Remove unnecessary try catch
 2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task 
AsynchronousMetrics: add a metric for number of databases and total number of tables.
 2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
Alexey Milovidov
0f15c01c68 Added a notion of obsolete settings for our best clients 2019-07-17 21:54:34 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dc8b83c882 Added a test #6040 2019-07-17 20:23:06 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
chertus
90487058c4 remove wrong infinite loop ckeck 2019-07-17 18:16:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix 
"send_logs_level" bugfix
 2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex 
Check dictionaries for modification with unlocked ExternalLoader::mutex
 2019-07-17 16:06:25 +03:00
proller
9be369fed5
clickhouse-test: optional termcolor (#6035) 2019-07-17 15:46:20 +03:00
chertus
ce1bc54c0c infinite loop detection in MemoryTracker + shrink joins perf test into 1Gb memory usage 2019-07-17 15:40:05 +03:00
Nikita Mikhaylov
56c9bf5acc pep8 2019-07-17 14:57:05 +03:00
Nikita Mikhaylov
e5360413a6 integration test added 2019-07-17 14:55:18 +03:00
alexey-milovidov
07fcbbcdc8
Merge pull request #6028 from amosbird/c1 
Optimize count()
 2019-07-17 13:08:16 +03:00
alexey-milovidov
e11c4a7740
Merge pull request #6027 from amosbird/c2 
Misc build fix
 2019-07-17 12:47:16 +03:00
Vitaly Baranov
38c3889564 Add an integration test for the invalidate_query parameter. 2019-07-17 11:40:35 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Amos Bird
71233e11a9 minor updates. 2019-07-17 14:17:34 +08:00
Alexander Kozhikhov
52007c96d9 adam is default now 2019-07-17 00:11:10 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Nik
4a30eba32f Fix style check 2019-07-16 22:34:47 +04:00
Amos Bird
9fa955403b Optimize count() 
Choose the smallest column to count if possible.
 2019-07-17 02:29:17 +08:00
Amos Bird
a3312106af Misc build fix 2019-07-17 02:27:11 +08:00
chertus
3db106c1f2 disable new/delete memory tracking for unbundled build 2019-07-16 21:09:06 +03:00
Vitaly Baranov
96f7a41044 Add an integration test for the invalidate_query parameter. 2019-07-16 20:57:08 +03:00
Vitaly Baranov
b74dacf9c4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-16 20:47:18 +03:00
Alexey Milovidov
3793c3cd13 Merge branch 'ThreeDots' of https://github.com/Immowelt/ClickHouse into Immowelt-ThreeDots 2019-07-16 19:41:05 +03:00
chertus
019c156afa fix je_nalocx() call with 0 & remove std::new_handler logic 2019-07-16 19:36:10 +03:00
alexey-milovidov
45b7588ab1
Merge pull request #6025 from dimarub2000/master 
Minor fixes for FullTextIndex string functions
 2019-07-16 19:30:32 +03:00
Nikita Mikhaylov
04de34a74f changes after review 2019-07-16 19:27:42 +03:00
Nik
922c3eb22e Clear Kafka's buffer if an invalid message is found. 2019-07-16 19:27:42 +04:00
alesapin
f5b7523429
Merge pull request #5899 from yandex/aku/perftest-mem 
Report memory usage in performance tests.
 2019-07-16 18:09:44 +03:00
chertus
4bc79bca35 fix unbandled build & add comment 2019-07-16 17:18:01 +03:00
alexey-milovidov
14dc9ad801
Merge pull request #6024 from yandex/check_table_old_behaviour 
Add settings for check query backward compatibility
 2019-07-16 15:19:55 +03:00
chertus
7065504d5e fix throw from ThreadStatus dtor 2019-07-16 14:56:46 +03:00
Dmitry Rubashkin
dcd8696466 Minor fixes 2019-07-16 14:40:11 +03:00
alesapin
27447d4816 Fix style 2019-07-16 13:50:59 +03:00
alesapin
0df345c2d9 Fix integration test 2019-07-16 13:49:16 +03:00
alesapin
f786c45ac4 Add settings for check query backward compatibility 2019-07-16 13:19:37 +03:00
alexey-milovidov
70b0c3157d
Merge pull request #6009 from filimonov/config_for_query_masking_rules_tests 
configs for query masking rules tests
 2019-07-16 03:38:18 +03:00
alexey-milovidov
ceffbf39d6
Merge pull request #5965 from dimarub2000/master 
Primary key, MergeTreeIndexFullText and MergeTreeIndexSet support for string functions
 2019-07-16 03:36:42 +03:00
alexey-milovidov
b4306c13cd
Merge pull request #6019 from yandex/fix-max-rows-to-read-without-uniform-read-distribution 
Fixed error with calculating of max_rows_to_read if the setting merge_tree_uniform_read_distribution is set to zero.
 2019-07-16 02:06:17 +03:00
Alexey Milovidov
4ed1592cb6 Added license for test 2019-07-16 01:00:06 +03:00
alexey-milovidov
5215d13437
Merge pull request #5998 from Enmk/double_delta_fix_2 
Fixed DoubleDelta encoding cases for random Int32 and Int64.
 2019-07-16 00:54:22 +03:00
alexey-milovidov
ea54cdbede
Update CompressionCodecDoubleDelta.cpp 2019-07-16 00:53:23 +03:00
alexey-milovidov
37f9206925
Merge pull request #6001 from yandex/fixed-error-with-query-id-printing 
Fixed error with query_id printing
 2019-07-16 00:46:11 +03:00
alexey-milovidov
c517c467de
Merge pull request #6018 from yandex/fix_protocol_inconsistency 
Fix bug client version which is able to read additional progress fiel…
 2019-07-16 00:38:00 +03:00
Alexey Milovidov
27b9f79cba Fixed error after refactoring 2019-07-15 23:26:55 +03:00
Alexey Milovidov
77fb3de2d6 Improved test 2019-07-15 23:26:22 +03:00
Alexey Milovidov
21958c47cd Added failing test 2019-07-15 23:06:20 +03:00
alexey-milovidov
bfe5022643
Merge pull request #6008 from yandex/gcd-lcm-std 
Using std::gcd, lcm instead of boost
 2019-07-15 22:30:42 +03:00
Alexey Milovidov
066337e197 Fixed test 2019-07-15 22:29:54 +03:00
Alexey Milovidov
3ac5ca0da0 Merge branch 'master' into fixed-error-with-query-id-printing 2019-07-15 22:29:33 +03:00
Alexey Milovidov
1937623f18 Better test 2019-07-15 22:13:43 +03:00
alexey-milovidov
1597103107
Merge pull request #6017 from yandex/mimallocexceptions 
Add OOM checks in mimalloc
 2019-07-15 22:10:05 +03:00
chertus
bd821d1898 exception safety and fix sanitizers' builds 2019-07-15 21:57:00 +03:00
Alexey Milovidov
a175c55136 Added a test that shows catastrophic behaviour of mimalloc 2019-07-15 21:49:30 +03:00
alesapin
25ed737798 Fix bug client version which is able to read additional progress fields from server 2019-07-15 21:05:49 +03:00
Danila Kutenin
f375a4559a Add exception checking in mimalloc 2019-07-15 20:49:54 +03:00
Alexey Milovidov
b3c0292613 Fixed error; added test 2019-07-15 19:32:52 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Nikolai Kochetov
ced2721ce8 Fix deserializeAndInsertFromArena. (#5973) 2019-07-15 19:20:21 +03:00
alesapin
30464ccef7 Remove flapping uniqCombined(>= 19) tests 2019-07-15 19:19:25 +03:00
Nikita Mikhailov
d192df1388 poco patch define added 2019-07-15 18:25:32 +03:00
Mikhail Filimonov
e7b23d4fb2 configs for query masking rules tests 2019-07-15 16:53:16 +02:00
Alexey Milovidov
68ba42cc89 Using std::gcd, lcm instead of boost 2019-07-15 17:45:56 +03:00
chertus
81d8597bb9 memory tracking for size-unaware deletes with jemalloc 2019-07-15 16:19:56 +03:00
chertus
91028e9e5d Merge branch 'master' into some 2019-07-15 13:45:48 +03:00
Vasily Nemkov
0f4075478e Fixed DoubleDelta encoding cases for random Int32 and Int64. 2019-07-15 08:17:14 +03:00
Alexey Milovidov
4d14f8c230 Fixed error in query_id printing 2019-07-15 04:07:01 +03:00
Alexander Kozhikhov
7c54bb0956 deleted metadata 2019-07-14 23:38:07 +03:00
Alexander Kozhikhov
860be14761 adam optimizer 2019-07-14 23:35:34 +03:00
Alexey Milovidov
e1271ae1f2 Added missing file #5958 2019-07-13 02:13:15 +03:00
alexey-milovidov
1314e083b4
Merge pull request #5958 from alex-krash/coverage_tests 
Batch of tests
 2019-07-13 00:52:18 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table 
Implement getDatabaseName() and rename() for all storages
 2019-07-13 00:51:39 +03:00
chertus
8c715d9b91 minor fix in cmake-files 2019-07-12 20:22:20 +03:00
chertus
a4bbb39195 fix crash cause of recursion in allocs and memory tracking 2019-07-12 20:06:02 +03:00
chertus
37bee1104d Merge branch 'master' into some 2019-07-12 18:16:03 +03:00
chertus
9bd42366f0 build fixes 2019-07-12 17:41:59 +03:00
dimarub2000
4005987fc4 multiSearchAny fixed, tests added, minor syle changes 2019-07-12 14:35:17 +03:00
Maxim Fridental
bb40d4729c Implement COLUMNS clause 2019-07-12 13:17:38 +02:00
Vitaly Baranov
fd89a8b051
Merge pull request #5212 from andyyzh/custom_week_functions 
Added functions for working with the Custom week number
 2019-07-12 14:00:35 +03:00
alexey-milovidov
ac035f7f5b
Merge pull request #5970 from vitlibar/invalid-json-must-not-parse 
Extra bytes after correctly parsed JSON are now considered as a parsing error.
 2019-07-12 03:26:42 +03:00
alexey-milovidov
a3dda4053f
Merge pull request #5979 from vitlibar/read-prefix-before-blocks-while-executing-subquery 
Fix using a table powered by the File engine in a subquery.
 2019-07-12 03:20:31 +03:00
Alexander Kozhikhov
c5b0871c9b small fix 2019-07-12 00:02:22 +03:00
Alexander Kozhikhov
e046cdd62d some change on regression method 2019-07-11 23:56:58 +03:00
Nikolai Kochetov
954485ad6b Disable processors by default. 2019-07-11 19:30:39 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors 
Processors
 2019-07-11 19:22:02 +03:00
chertus
9739ac13e4 move new/delete overloads to dbms/src/Common 2019-07-11 18:40:55 +03:00
Vitaly Baranov
001e4daf25 Read prefix before blocks while executing subquery. 2019-07-11 16:53:26 +03:00
dimarub2000
e5d4f11c73 Deleted some extra implementations, fixed style. multiSearchAny still not working. 2019-07-11 16:44:44 +03:00
dimarub2000
1480b8e62c Actually set index already woks for everything. Here are some tests. 2019-07-11 15:31:24 +03:00
Vitaly Baranov
7aad2eff28 Add more test cases for JSON functions. 2019-07-11 11:39:30 +03:00
Vitaly Baranov
8306f25634 Extra bytes after correctly parsed JSON is now considered as a parsing error. 2019-07-11 11:31:45 +03:00
Nikolai Kochetov
bfa114126a More comments for PipelineExecutor. 2019-07-11 09:50:44 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
robot-clickhouse
f635d2bd9b Auto version update to [19.12.1.1] [54424] 2019-07-10 22:57:53 +03:00
robot-clickhouse
e0f04dee04 Auto version update to [19.11.0.830] [54423] 2019-07-10 22:57:24 +03:00
chertus
18a13a03dd memory tracked new/delete concept 2019-07-10 21:12:50 +03:00
Vitaly Baranov
10b6e1b786
Merge pull request #5962 from vitlibar/fix-unused-variable-in-checkDataPart.cpp 
Fix unused variable in checkDataPart.cpp
 2019-07-10 19:10:55 +03:00
Ivan Lezhankin
998aa795fc Merge remote-tracking branch 'upstream/master' into fix-filter-table 2019-07-10 18:14:15 +03:00
dimarub2000
88778b0f5b minor style changes 2019-07-10 18:12:02 +03:00
dimarub2000
f5ba5e3ca9 Merge branch 'master' of github.com:dimarub2000/ClickHouse 2019-07-10 18:08:10 +03:00
dimarub2000
c9a5b3c9ab primary key and MergeTreeIndexFullText support for string functions 2019-07-10 17:53:57 +03:00
NIKITA MIKHAILOV
e05f5388bc clean after cherry-pick 2019-07-10 16:27:16 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
NIKITA MIKHAILOV
21ad247df3 only for saving this changes 2019-07-10 16:05:22 +03:00
Nikita Mikhaylov
55e9e21cc5 better includes 2019-07-10 16:05:12 +03:00
Nikita Mikhaylov
c0a4495d17 multithreading 2019-07-10 16:04:50 +03:00
Nikita Mikhaylov
1740a24ded better 2019-07-10 16:04:39 +03:00
Nikita Mikhaylov
6ff9dfce34 first try 2019-07-10 16:04:01 +03:00
Vitaly Baranov
3a74f326a8 Fix unused variable in checkDataPart.cpp 2019-07-10 15:13:10 +03:00
Nikolai Kochetov
d104f2d8ff Update PipelineExecutor 2019-07-10 14:59:30 +03:00
Alexey Milovidov
7643b1c7f9 Attempt to fix "splitted" build 2019-07-10 14:46:37 +03:00