Commit Graph

4709 Commits

Author SHA1 Message Date
Alexey Milovidov
b5b80fb342 Merge branch 'master' into thread_local_rng 2019-07-30 03:19:48 +03:00
Alexey Milovidov
372c4d89b2 Enabled line numbers in stack traces 2019-07-30 01:26:44 +03:00
chertus
7b4ddd268e support ASOF JOIN ON syntax 2019-07-29 17:58:36 +03:00
Alexander Tokmakov
3c15b87003 Merge branch 'master' into alter_table_drop_detached_part 2019-07-29 14:29:23 +03:00
Yuriy
f1694a1746 build fix 2019-07-29 03:09:17 +03:00
alexey-milovidov
3e9dd7ed42
Merge pull request #6196 from zlobober/patch-2
Fix build under gcc-8.2
2019-07-29 02:21:46 +03:00
Max Akhmedov
5e9ea2a905
Remove spaces from empty line 2019-07-28 20:46:48 +03:00
alexey-milovidov
129e88ee26
Merge pull request #6189 from CurtizJ/order-by-efficient
Fix reading in order of sorting key and refactoring.
2019-07-28 19:43:49 +03:00
Alexey Milovidov
856cc1b9c5 Added thread_local_rng 2019-07-28 18:30:38 +03:00
Max Akhmedov
f632a0b241
Fix build under gcc-8.2 2019-07-28 18:12:07 +03:00
Yuriy
b1d5f4ca20 disabled mysql_native_password when password is specified as a plain text as it allows to connect to ClickHouse knowing only SHA1 instead of a password 2019-07-28 17:17:33 +03:00
Yuriy
760afb007c arbitrary passwords 2019-07-28 16:36:27 +03:00
Yuriy
21ce5331d1 implemented mysql_native_password auth plugin for compatibility with mysqljs 2019-07-28 16:12:26 +03:00
Gleb Novikov
8f4883b0d2 Better constraint exception 2019-07-28 15:33:40 +03:00
CurtizJ
b4991b38bf Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-28 04:26:43 +03:00
CurtizJ
d69d68f065 rename setting 'optimize_pk_order' and some functions 2019-07-28 04:16:56 +03:00
Yuriy
383fa25c51 resolved conflict 2019-07-28 02:00:15 +03:00
alexey-milovidov
12a15316fd
Merge pull request #6181 from 4ertus2/joins
Fix crop column names in GLOBAL JOIN ON
2019-07-28 00:31:29 +03:00
CurtizJ
08d5ebb54d Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-27 10:38:10 +03:00
Nikita Vasilev
7efb1bcb12 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-07-27 10:30:43 +03:00
CurtizJ
60289cd764 fix optimizeSortingWithPK 2019-07-27 03:15:22 +03:00
CurtizJ
cb85721cba handle ExpressionAnalyzer exceptions, while trying to optimize order by, in case of complicated queries 2019-07-27 03:02:04 +03:00
CurtizJ
b1d981ec3a better pipeline while reading in pk_order 2019-07-27 01:18:27 +03:00
chertus
9f9ba3a06f restore cropped names in JOIN ON section for distributed queries 2019-07-26 20:43:42 +03:00
qianlixiang
64d65c0123 Fixed mismatched header of prewhere with sample column 2019-07-26 18:48:42 +08:00
alexey-milovidov
2442e65367
Merge pull request #6124 from yandex/merge-profiler
Fixes for query profiler.
2019-07-26 03:51:57 +03:00
alexey-milovidov
a3e4c1d39f
Merge pull request #6131 from 4ertus2/joins
Better JOIN ON keys extraction
2019-07-26 02:10:45 +03:00
Alexey Milovidov
f4ec18b30f Merge branch 'system_text_log' of https://github.com/nikitamikhaylov/ClickHouse into nikitamikhaylov-system_text_log 2019-07-26 01:51:19 +03:00
Alexey Milovidov
0cce86db3f Merge remote-tracking branch 'origin/master' into merge-profiler 2019-07-26 00:41:24 +03:00
Alexey Milovidov
050db07e3d Merge branch 'master' into merge-profiler 2019-07-25 22:54:22 +03:00
chertus
554e4ab5b8 fix cross alliasing case with JOIN ON 2019-07-25 22:25:51 +03:00
Alexey Milovidov
93c7f6aedf Merge branch 'fix_ISSUE5695' of https://github.com/TCeason/ClickHouse into TCeason-fix_ISSUE5695 2019-07-25 19:09:18 +03:00
CurtizJ
b1cc019bd4 fix pipeline 2019-07-25 14:00:14 +03:00
chertus
06076e67a3 Merge branch 'master' into joins 2019-07-25 13:48:32 +03:00
CurtizJ
f5b93eb991 fix order by optimization 2019-07-25 13:45:01 +03:00
alexey-milovidov
a985897a07
Update PredicateExpressionsOptimizer.h 2019-07-25 04:05:16 +03:00
alexey-milovidov
3022c4a759
Update PredicateExpressionsOptimizer.cpp 2019-07-25 04:04:03 +03:00
Alexey Milovidov
4c57405770 Added information about revision to trace log 2019-07-24 23:12:32 +03:00
Alexey Milovidov
cfb2066198 Added information about thread number to trace log 2019-07-24 23:10:23 +03:00
chertus
b3123df58e use source and joined columns to detect JOIN ON right and left keys 2019-07-24 18:37:37 +03:00
CurtizJ
3d706ec20e support 'order by' optimiation with simple monotonic functions 2019-07-24 17:23:57 +03:00
Nikita Mikhaylov
38607af95f nothing interesting 2019-07-24 11:26:23 +03:00
Alexey Milovidov
a3f6b70433 Fixed warning from PVS-Studio 2019-07-23 23:07:33 +03:00
chertus
9da1b0089c visitor for JOIN ON keys extraction 2019-07-23 22:49:15 +03:00
Alexander Tokmakov
3c2172b750 parse and interpret query 2019-07-23 22:25:10 +03:00
Nikita Mikhaylov
811e3ab241 style check 2019-07-23 17:50:38 +03:00
Alexey Milovidov
1b00e99334 Fixed error with initialization of query profiler 2019-07-23 17:30:14 +03:00
Nikita Mikhaylov
14b384f3e5
Merge branch 'master' into system_text_log 2019-07-23 15:51:04 +03:00
chertus
9baf1bf196 Merge branch 'master' into ast 2019-07-23 13:49:18 +03:00
tai
b01f54ade1 ISSUE-5695: support push down predicate to final subquery 2019-07-23 18:22:07 +08:00
Nikita Mikhaylov
61412e7f74 changes after review + update config + resolve build fail 2019-07-23 11:22:38 +03:00
alexey-milovidov
e4ad0da6e3
Merge pull request #4247 from laplab/query-poor-mans-profiler
Poor man's profiler on query level [Work in progress]
2019-07-23 03:02:58 +03:00
alexey-milovidov
cd6c15b79f
Merge pull request #6057 from dimarub2000/master
CREATE TABLE AS table_function()
2019-07-23 02:50:08 +03:00
chertus
eaa3cb557a move prefer_alias_to_column_name logic out of parser 2019-07-22 22:21:07 +03:00
Nikita Mikhaylov
daa7fc154f better includes 2019-07-22 19:21:34 +03:00
Nikita Mikhaylov
a80e066769 better 2019-07-22 19:04:15 +03:00
Nikita Mikhaylov
0f3a4a34b4 test + comment 2019-07-22 18:33:38 +03:00
Nikita Mikhaylov
8289472b98 style improvements 2019-07-22 18:09:33 +03:00
Nikita Mikhaylov
c6667ff888 wip 2019-07-22 16:54:08 +03:00
Dmitry Rubashkin
0320de9132 test and fixes 2019-07-22 16:49:16 +03:00
Dmitry Rubashkin
9ffbf65741 Fix of a fix 2019-07-22 15:50:10 +03:00
Dmitry Rubashkin
42efc1051e fixes of bad commit 2019-07-22 15:35:29 +03:00
Dmitry Rubashkin
d279a685a9 Merge branch 2019-07-22 15:31:17 +03:00
Dmitry Rubashkin
6c6af60194 Fixes after review 2019-07-22 15:18:53 +03:00
alexey-milovidov
adfc369172
Merge pull request #6082 from vitlibar/fix-segfault-in-reload-outdated
Fix segfault in ExternalLoader::reloadOutdated().
2019-07-22 01:28:37 +03:00
Alexey Milovidov
b2961bcc31 Added check for empty number of columns; improved test 2019-07-22 00:19:42 +03:00
Alexey Milovidov
8060993ca2 Removed obsolete comment 2019-07-21 23:40:34 +03:00
Alexey Milovidov
fb0d09c5d3 Rename files 2019-07-21 20:03:58 +03:00
Alexey Milovidov
47058e8e11 Fixed error 2019-07-21 05:13:42 +03:00
Alexey Milovidov
7064fe6678 Merge branch 'master' into Immowelt-ThreeDots 2019-07-21 02:21:55 +03:00
alexey-milovidov
b035edefea
Update InterpreterCreateQuery.cpp 2019-07-20 03:02:18 +03:00
alexey-milovidov
175c4655d8
Merge pull request #6043 from 4ertus2/ast
Enable 'input_format_defaults_for_omitted_fields' by default
2019-07-20 00:42:01 +03:00
alexey-milovidov
746fe5cdac
Merge pull request #6073 from yandex/aku/loaddb-race
Fix a race condition in parallel table loading.
2019-07-20 00:08:09 +03:00
Vitaly Baranov
e64f8e606d Add comments. 2019-07-20 00:04:19 +03:00
alexey-milovidov
f18e9592a1 Update ExternalLoader.cpp 2019-07-20 00:03:57 +03:00
Vitaly Baranov
5b879e143f Fix segfault in ExternalLoader::reloadOutdated(). 2019-07-20 00:03:25 +03:00
Yuriy
fa2dfcd71d better 2019-07-19 21:43:52 +03:00
Alexey Milovidov
9ccf5a7c90 Merge branch 'master' into Immowelt-ThreeDots 2019-07-19 19:54:00 +03:00
chertus
e15f6e9752 Merge branch 'master' into ast 2019-07-19 18:01:09 +03:00
Alexander Kuzmenkov
de72d117ce Fix a race condition in parallel table loading.
ThreadSanitizer reported that a data race occurs when we attach to a
database and load its tables concurrently. Remove the custom code that
waits for all tables to load, and replace it with a local thread pool
and its wait() method.

This changes observable behavior: before, we would load the tables
sequentially when loading the system database, or performing an ATTACH
DATABASE query. Now we always load tables of ordinary databases in
parallel.
2019-07-19 17:35:02 +03:00
Mikhail Filimonov
b9f208d54c reverse order of cropping and removing sensitive data in query 2019-07-19 15:50:11 +02:00
Dmitry Rubashkin
1aca3da121 Fixed inegration 2019-07-19 16:28:28 +03:00
CurtizJ
2797c16930 fix prewhere at fetching columns 2019-07-19 13:14:27 +03:00
Mikhail Filimonov
f13e18d4fb atomic masker in channel 2019-07-19 10:23:51 +02:00
Mikhail Filimonov
9c2ae4513d SensitiveDataMasker 2019-07-19 10:22:42 +02:00
CurtizJ
b9dc472071 Merge remote-tracking branch 'upstream/master' into order-by-efficient 2019-07-19 01:09:59 +03:00
dimarub2000
20a846d753 Merge branch 'master' of github.com:yandex/ClickHouse 2019-07-18 21:52:18 +03:00
Dmitry Rubashkin
7382cb41fa CREATE TABLE AS table_function() 2019-07-18 21:29:49 +03:00
CurtizJ
a3d25790bd basic implementation of reading in pk order and 'order by' optimization 2019-07-18 17:41:11 +03:00
alexey-milovidov
a20a39caac
Merge pull request #6036 from vitlibar/remove-unnecessary-try-catch
Remove unnecessary try catch
2019-07-17 23:34:37 +03:00
alexey-milovidov
f6c636ce2e
Merge pull request #6039 from nikitamikhaylov/metrics_task
AsynchronousMetrics: add a metric for number of databases and total number of tables.
2019-07-17 22:34:37 +03:00
alexey-milovidov
aaee4724c3
Update AsynchronousMetrics.cpp 2019-07-17 22:34:29 +03:00
chertus
fbc0c87c18 enable input_format_defaults_for_omitted_fields & disable (not working) defaults for table functions 2019-07-17 21:30:17 +03:00
Alexey Milovidov
dd97878107 Style 2019-07-17 20:19:55 +03:00
Ivan
af44506ab4
Do not show virtual columns in DESCRIBE TABLE 2019-07-17 18:45:32 +03:00
Nikita Mikhaylov
44db7badbe done 2019-07-17 18:36:28 +03:00
Alexey Milovidov
eb625cba11 Merge remote-tracking branch 'origin/master' into Immowelt-ThreeDots 2019-07-17 17:49:21 +03:00
alexey-milovidov
ea28254711
Merge pull request #5964 from nikitamikhaylov/logs_bugfix
"send_logs_level" bugfix
2019-07-17 17:42:54 +03:00
Vitaly Baranov
ee2fd91e8f
Merge branch 'master' into remove-unnecessary-try-catch 2019-07-17 16:10:58 +03:00
Vitaly Baranov
a01fa50a93
Merge pull request #6011 from vitlibar/check-dictionaries-for-modification-with-unlocked-mutex
Check dictionaries for modification with unlocked ExternalLoader::mutex
2019-07-17 16:06:25 +03:00
Vitaly Baranov
503553cbe4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-17 11:40:35 +03:00
Vitaly Baranov
6d563c51e6 Remove unnecessary try-catch in the constructors of classes derived from IExternalLoadable. 2019-07-17 11:39:36 +03:00
Alexey Milovidov
ef6c7ea5be Merge COLUMNS matcher (incomplete) 2019-07-16 23:05:00 +03:00
alexey-milovidov
503556ae53
Update ExpressionAnalyzer.cpp 2019-07-16 22:22:05 +03:00
alexey-milovidov
d0c088b9cc
Update ExpressionAnalyzer.cpp 2019-07-16 22:16:25 +03:00
Amos Bird
9fa955403b Optimize count()
Choose the smallest column to count if possible.
2019-07-17 02:29:17 +08:00
Vitaly Baranov
b74dacf9c4 Check dictionaries for modification with unlocked ExternalLoader::mutex 2019-07-16 20:47:18 +03:00
Alexey Milovidov
3793c3cd13 Merge branch 'ThreeDots' of https://github.com/Immowelt/ClickHouse into Immowelt-ThreeDots 2019-07-16 19:41:05 +03:00
alexey-milovidov
14dc9ad801
Merge pull request #6024 from yandex/check_table_old_behaviour
Add settings for check query backward compatibility
2019-07-16 15:19:55 +03:00
alesapin
27447d4816 Fix style 2019-07-16 13:50:59 +03:00
alesapin
f786c45ac4 Add settings for check query backward compatibility 2019-07-16 13:19:37 +03:00
Yuriy
1d6e31be4d merged master 2019-07-16 10:33:25 +03:00
Yuriy
c370de432a better 2019-07-16 10:28:53 +03:00
Yuriy
4df72f18ce writing packets in parts 2019-07-16 09:39:18 +03:00
Alexey Milovidov
b3c0292613 Fixed error; added test 2019-07-15 19:32:52 +03:00
Nikita Mikhailov
cc5f87e352 Merge branch 'master' of github.com:yandex/ClickHouse into logs_bugfix 2019-07-15 19:31:54 +03:00
Alexey Milovidov
4d14f8c230 Fixed error in query_id printing 2019-07-15 04:07:01 +03:00
alexey-milovidov
a93c76837e
Merge pull request #5953 from abyss7/fix-filter-table
Implement getDatabaseName() and rename() for all storages
2019-07-13 00:51:39 +03:00
Maxim Fridental
bb40d4729c Implement COLUMNS clause 2019-07-12 13:17:38 +02:00
alexey-milovidov
a3dda4053f
Merge pull request #5979 from vitlibar/read-prefix-before-blocks-while-executing-subquery
Fix using a table powered by the File engine in a subquery.
2019-07-12 03:20:31 +03:00
Nikolai Kochetov
e9f3d4d6b8
Merge pull request #4914 from yandex/processors
Processors
2019-07-11 19:22:02 +03:00
Vitaly Baranov
001e4daf25 Read prefix before blocks while executing subquery. 2019-07-11 16:53:26 +03:00
Nikita Lapkov
9d540abc84 refactor 2019-07-10 20:47:39 +00:00
Ivan Lezhankin
998aa795fc Merge remote-tracking branch 'upstream/master' into fix-filter-table 2019-07-10 18:14:15 +03:00
NIKITA MIKHAILOV
865606b83c bugfix client logs + some tests 2019-07-10 16:15:22 +03:00
Ivan Lezhankin
befb3ce15b Merge branch 'master' into fix-filter-table 2019-07-10 13:27:26 +03:00
Alexey Milovidov
499d798b34 Remove "clickhouse_compression" library because it is not a library (cyclic dependency via IDataType) 2019-07-10 00:37:43 +03:00
Ivan Lezhankin
8a600c39af Fix build for gtests 2019-07-09 21:53:16 +03:00
Ivan Lezhankin
9f01fa7aaa Implement getDatabaseName() and rename() for all storages 2019-07-09 18:40:21 +03:00
alesapin
6a3b543e10 Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-09 11:21:44 +03:00
alexey-milovidov
d6afdd5a8d
Merge pull request #5941 from 4ertus2/bugs
Fix wrong array_join_columns calculation
2019-07-09 03:58:36 +03:00
alexey-milovidov
a8d8eb6b28
Merge pull request #5921 from yandex/pvs-studio-fixes-4
A few fixes for PVS-Studio
2019-07-09 01:10:05 +03:00
chertus
ef41b16a44 fix wrong ExpressionAnalyzer.array_join_columns calculation 2019-07-08 23:06:17 +03:00
Alexey Milovidov
e07235e294 Addition to prev. revision 2019-07-08 21:55:06 +03:00
Alexey Milovidov
886e8ea0d4 Merge branch 'master' into pvs-studio-fixes-4 2019-07-08 19:58:42 +03:00
Nikolai Kochetov
209793c981 Merged with master. 2019-07-08 16:00:54 +03:00
Nikolai Kochetov
472f32f718 Remove ThreadGroupThreadPoolCallbacks 2019-07-08 15:49:52 +03:00
Alexey Milovidov
f40b70884f Two more fixes for PVS-Studio 2019-07-08 05:14:32 +03:00
Alexey Milovidov
4752dae9bb Allowed unresolvable addresses in cluster configuration #5714 2019-07-08 04:43:41 +03:00
Alexey Milovidov
553e6a273e Two more fixes for PVS-Studio 2019-07-08 03:51:43 +03:00
Vitaliy Zakaznikov
24a3726235 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-07 20:03:14 -04:00
Vitaliy Zakaznikov
259a95a3da * Updates to fix issues after the merge 2019-07-07 19:57:58 -04:00
Alexey Milovidov
bba2641bd0 A few fixes for PVS-Studio 2019-07-08 02:25:15 +03:00
Nikita Lapkov
e935cb08a8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-07 01:06:10 +00:00
Nikita Lapkov
3828684f7a style 2019-07-06 20:42:03 +00:00
Nikita Lapkov
ef1d84b35a do not run trace collector without trace_log. do not run query profilers without trace collector. 2019-07-06 20:29:00 +00:00
Alexey Milovidov
338c0d27ca Added "os_thread_priority" setting 2019-07-06 21:02:28 +03:00
Nikita Lapkov
17e3542a5a refactor 2019-07-05 22:35:09 +00:00
Nikita Lapkov
aaea6cbfc9 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-05 21:37:31 +00:00
alexey-milovidov
78c61ab772
Merge pull request #5890 from yandex/dns-cache-updater-allow-drift
Allow time drift in DNSCacheUpdater for natural randomization
2019-07-05 21:27:24 +03:00
Alexey Milovidov
0225cb0089 ThreadStatus: removed bad and questionable code 2019-07-05 17:15:05 +03:00
Nikita Lapkov
b8585a5630 refactor and comments 2019-07-05 13:48:47 +00:00
CurtizJ
a49112a14e Merge branch 'master' of https://github.com/yandex/ClickHouse into order-by-efficient 2019-07-05 16:41:48 +03:00
Alexey Milovidov
5c3cd40db3 Allow time drift in DNSCacheUpdater for natural randomization 2019-07-05 16:20:21 +03:00
alexey-milovidov
2469ec1af3
Merge pull request #5857 from CurtizJ/dns-cache
Implement dns cache with asynchronous update.
2019-07-05 15:56:26 +03:00
alexey-milovidov
8b62c96989
Merge pull request #5859 from 4ertus2/joins
Fix FULL|RIGHT JOIN with nulls in right table's keys
2019-07-05 14:23:35 +03:00
CurtizJ
410b62f7fa Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into order-by-efficient 2019-07-05 13:48:04 +03:00
Nikita Lapkov
0f579860f7 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-07-04 22:13:51 +00:00
Gleb Novikov
71c2ca0fe9 Merge branch 'master' into table-constraints 2019-07-04 22:40:00 +03:00
Nikolai Kochetov
72afe9b842 Fix heap-use-after-free in ClusterCopier caused by watch which try to use already removed copier object. 2019-07-04 17:48:40 +03:00
chertus
8dc6810799 do not save null bitmaps for blocks without nulls 2019-07-04 15:38:54 +03:00
chertus
301345724a use better data types 2019-07-04 15:12:39 +03:00
chertus
4759e8632e fix crash and update test results 2019-07-04 14:50:32 +03:00
alesapin
a0496da05f Merge branch 'master' of github.com:yandex/ClickHouse into fix_fetch_of_existing_part 2019-07-04 12:46:54 +03:00
chertus
73d6784c59 join right table nulls 2019-07-03 22:06:34 +03:00
CurtizJ
187812a00e cleanup 2019-07-03 21:34:37 +03:00
CurtizJ
80e96995ae Merge branch 'master' of https://github.com/yandex/ClickHouse into dns-cache 2019-07-03 21:27:43 +03:00
CurtizJ
35ad1a3b6b implement dns cache with asynchronous update 2019-07-03 19:26:22 +03:00
alesapin
3925a3bd13 Generalize check query 2019-07-03 16:17:19 +03:00
alexey-milovidov
d81ae49f2c
Merge pull request #5755 from 4ertus2/bugs
Fix wrong ColumnConst.isColumnNullable()
2019-07-03 02:06:07 +03:00
alexey-milovidov
de92b9854e
Merge pull request #5838 from 4ertus2/joins
Joins refactoring: extract joinDispatch into own file
2019-07-03 01:55:45 +03:00
alexey-milovidov
8d4af1bd33
Update joinDispatch.h 2019-07-03 01:55:36 +03:00
alexey-milovidov
1d582c92a7
Merge pull request #5842 from yandex/revert-questionable-code-query-priorities
Fixed wrong code in QueryPriorities
2019-07-03 01:53:07 +03:00
Alexey Milovidov
6fba717d50 Fixed wrong code in QueryPriorities 2019-07-02 23:21:31 +03:00
Alexey Milovidov
ffaaf93c49 Compatibility with old compiler (gcc-7) 2019-07-02 20:24:22 +03:00
chertus
207145025c Join.h refactoring: extract joinDispatch into own file 2019-07-02 17:38:31 +03:00
chertus
8932dc9c23 minpr perf improvement 2019-07-02 15:31:20 +03:00
Vitaliy Zakaznikov
b5120931d5 Merge branch 'master' of https://github.com/yandex/ClickHouse into liveview 2019-07-01 18:12:31 -04:00
Nikita Lapkov
5286ab97fd refactor and comments 2019-07-01 22:11:11 +00:00
Vitaliy Zakaznikov
a363189dfc Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-07-01 18:05:14 -04:00
Nikita Lapkov
9641d058d0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-07-01 21:11:26 +00:00
alexey-milovidov
c43dfce041
Merge pull request #5382 from abyss7/issue-5286
Add virtual columns to Kafka Engine tables
2019-07-01 21:30:09 +03:00
chertus
5df4ad0f28 Merge branch 'master' into bugs 2019-07-01 14:49:01 +03:00
chertus
0c634129da add IColumn.isNullable() 2019-07-01 14:44:19 +03:00
Maxim Sabyanin
663aab6f5b complete ExternalLoader method's implementations 2019-06-30 23:04:21 +03:00
Alexey Milovidov
33cff5ee0f Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-30 17:24:15 +03:00
proller
a69990ce27 CLICKHOUSE-4514 Unique query_id among all users (#5430)
* CLICKHOUSE-4514 Unique query_id among all users

* try 1

* Fix

* fix

* use condvar

* fix style

* Update ProcessList.cpp
2019-06-30 16:17:27 +03:00
alexey-milovidov
18535590ce
Merge pull request #5802 from CurtizJ/upstream/systemlog-flushing
Fix shutdown of SystemLogs
2019-06-30 15:51:35 +03:00
Gleb Novikov
a146b7383e Merge branch 'master' into table-constraints 2019-06-30 11:32:02 +02:00
CurtizJ
1a8695ffd9 fix shutdown of system_logs 2019-06-30 04:56:16 +03:00
Alexey Milovidov
725bcd9d02 Merge branch 'master' into sanych73-prepared_statements 2019-06-30 02:59:37 +03:00
Alexey Milovidov
88fc72f0b9 Merge branch 'feature/bloom_filter' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/bloom_filter 2019-06-29 20:44:11 +03:00
Alexey Milovidov
90898905e0 Allow to DROP database with Dictionary engine 2019-06-29 20:27:32 +03:00
Alexey Milovidov
de8a15b5f4 Removed unused method 2019-06-29 20:19:46 +03:00
Alexey Milovidov
a643f2f75e Merge branch 'master' into sanych73-prepared_statements 2019-06-29 15:51:56 +03:00
alexey-milovidov
fe542e26f8
Merge pull request #5685 from CurtizJ/upstream/systemlog-flushing
Fix race condition in flushing system log in another way.
2019-06-29 15:46:22 +03:00
Nikita Lapkov
2a131185b0 Merge remote-tracking branch 'upstream/master' into update_libunwind 2019-06-28 18:20:23 +00:00
Nikita Lapkov
f8d2b5effd introduce Backtrace class 2019-06-28 18:06:38 +00:00
alexey-milovidov
18659e367e
Merge pull request #5758 from zlobober/bool_masks
Extend KeyCondition interface so that it returns BoolMask.
2019-06-28 14:51:52 +03:00
alexey-milovidov
6e77fc4abe
Merge pull request #5775 from yandex/lfalloc2mimalloc
Use mimalloc instead of lfallocator
2019-06-28 14:48:18 +03:00
chertus
f19dee706a move IColumn.isColumnConst() outside of interface 2019-06-27 22:28:52 +03:00
Alexey Milovidov
3c4784a466 Removed obsolete undocumented embedded dictionaries that were used by Yandex.Metrica 2019-06-27 22:18:28 +03:00
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
chertus
68034103bb fix arrayIndex for new columns's isNullable 2019-06-27 15:49:08 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
alesapin
b7f173ad2c Execute some distributed DDL queries on leader 2019-06-26 17:52:20 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
b2a3835195 Unify streams for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
CurtizJ
53634a324e fix error with uninitialized system_logs 2019-06-21 22:24:30 +03:00
CurtizJ
ac3072cd9b better shutdown of system_logs 2019-06-21 20:25:47 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
CurtizJ
25cbc901ed fix deadlock at flushing on shutdown 2019-06-20 20:38:16 +03:00
stavrolia
aff92c263e Make setting join_use_nulls get no effect for types that cannot be inside Nullable 2019-06-20 16:13:46 +03:00
CurtizJ
5e6ceef224 fix race condition in flushing system log 2019-06-19 19:50:17 +03:00
CurtizJ
047ee38838 fix race condition in flushing system log 2019-06-19 18:38:06 +03:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
CurtizJ
bb95d9a860 fix race condition in flushing system log 2019-06-19 15:28:34 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
CurtizJ
2a04125360 fix ignore_limits option 2019-06-18 01:07:16 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas
Support system replicas queries for distributed
2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00
Alexey Milovidov
f98d0a108f Removed useless header file 2019-06-16 15:16:16 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
Alexey Milovidov
7514674447 Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-16 02:40:17 +03:00
Alexey Milovidov
f38855fe61 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 02:39:55 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
a999cb4fbc Merge branch 'master' into sanych73-prepared_statements 2019-06-15 17:22:01 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug
Add database engine of MySQL type
2019-06-15 14:52:57 +03:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Alexey Milovidov
08636dce92 Added missing files 2019-06-14 22:39:56 +03:00
CurtizJ
6d9cbc6f28 ignore query limits from system profile while executing mutations 2019-06-14 22:27:53 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
c2d4c11cb8 Fixes for #5331 2019-06-14 20:15:30 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
alexey-milovidov
1e385cac7c
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:18:59 +03:00
alexey-milovidov
5317c5a08b
Update ReplaceQueryParameterVisitor.cpp 2019-06-14 19:18:24 +03:00
alexey-milovidov
daca715a0e
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:15:14 +03:00
alexey-milovidov
03076a0f8d
Update Context.cpp 2019-06-14 19:08:07 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
alexey-milovidov
eb1fe2ed17
Merge pull request #5613 from sundy-li/improve/distribute-alter-more
make isSupportedAlterType better
2019-06-14 15:39:09 +03:00
sundy-li
eac978f1e0 make isSupportedAlterType better 2019-06-14 11:06:08 +08:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
2019-06-13 11:58:58 +08:00
sundy-li
d23e505414 remove line 2019-06-12 18:56:01 +08:00
sundy-li
38d4d2937e Support more AlterType in distribute DDL 2019-06-12 18:50:50 +08:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found
* Trying to fix failed style checks
* Trying to fix clang build fail
2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Alexander Tretiakov
dec0430327 check for trash 2019-06-05 23:04:17 +02:00
Alexander Tretiakov
8d91419a25 fix 2019-06-05 17:07:50 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Gleb Novikov
b8385aae8c Merge branch 'master' into table-constraints 2019-06-05 15:33:07 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Alexander Tretiakov
d97c2ccdc8 support complex datatype 2019-06-04 21:15:32 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Vitaliy Zakaznikov
fc21200bdd * Started to add LIVE VIEW table tests
* Added uexpect.py module
* Fixed support for CREATE TEMPORARY LIVE VIEW
2019-06-03 15:53:11 -04:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Konstantin Podshumok
633f2f2664 limit remote timeouts to max_execution_time for SelectStreamFactory 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d52be42c37 use new timeouts in ClusterProxy 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
bebd19135a remove connections_with_failover_max_tries and getSaturated(settings.max_execution_time) from Cluster 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
alexey-milovidov
086572b604
Merge pull request #5503 from 4ertus2/bugs
Fix union all supertype column
2019-06-02 06:18:33 +03:00
alesapin
117c9edda7
Merge pull request #5489 from azat-archive/DDLWorker-fix
Skip ZNONODE during DDL query processing
2019-05-31 18:34:47 +03:00
chertus
28c1a60eb7 fix union all supertype column 2019-05-31 15:36:44 +03:00
palasonicq
7826effcd7 Minor changes 2019-05-31 00:33:06 +03:00
Vitaliy Zakaznikov
f06f0e3947 * Adding support for CREATE TEMPORARY LIVE VIEW
* Fixing issue with setting _version virtual column
2019-05-30 17:29:30 -04:00
palasonicq
ea86a758a1 Added some improvements after code review 2019-05-30 23:12:44 +03:00
Azat Khuzhin
eb5f46fb07
Skip ZNONODE during DDL query processing
Right now if another node removes the znode in task_queue, the one that
did not process it, but already get list of children, will terminated
the DDLWorker thread, and this is very unconvinient because you do not
have any sane way to know is DDLWorker still running or not (except for
timed out DDL queries or via debugger), and the clickhouse-server it
self do not fail either.

Fixes: #5064
2019-05-30 20:25:29 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
proller
a813a001e2
Allow to use internal compiler with system includes (fix compile for freebsd) (#5447)
* Allow to use internal compiler with system includes (fix compile for freebsd)
* Fix macos build
2019-05-30 15:58:15 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Nikita Lapkov
3b54fde8a7 replace StackTrace with Backtrace 2019-05-30 10:30:24 +00:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
2019-05-29 17:52:13 -04:00
stavrolia
60459bbb87 Yet another fix 2019-05-29 20:49:35 +03:00
stavrolia
605de8c36c Fixed 2019-05-29 17:59:11 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
stavrolia
3edf296aa3 Change error message 2019-05-28 22:09:40 +03:00
stavrolia
0a5fb04b56 One more fixed 2019-05-28 21:32:14 +03:00
palasonicq
0823e397ea Added missed modifications 2019-05-28 21:30:10 +03:00
stavrolia
aa0e227288 Fixed 2019-05-28 21:08:47 +03:00
stavrolia
976815660f Fix improvement of check 2019-05-28 20:28:17 +03:00
stavrolia
a91e72eb39 Improve check 2019-05-28 19:45:27 +03:00
stavrolia
4cd595b450 Add setting allow suspicious types for low cardinality with long message about error (fixed #4965) 2019-05-28 19:10:55 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
207d2048c6 Added forward declarations 2019-05-25 17:15:22 +03:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
bffe621d94
Merge pull request #5407 from kvap/all-columns-required-in-limit-by
Mark all input columns in LIMIT BY as required output
2019-05-25 15:13:01 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
alexey-milovidov
9e24c8d19a
Merge pull request #5396 from 4ertus2/ast
Support IN in CrossToInnerJoin push down predicates
2019-05-25 14:07:45 +03:00
alexey-milovidov
661d661d57
Update CrossToInnerJoinVisitor.cpp 2019-05-25 14:05:12 +03:00
proller
6c1cb02172 CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT (#5397)
* CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT

* fix style

* Fix build

* Update iostream_debug_helpers.cpp

* Update evaluateMissingDefaults.cpp
2019-05-25 14:03:12 +03:00
alexey-milovidov
1d98441c34
Update ExpressionAnalyzer.cpp 2019-05-25 13:51:48 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Constantin S. Pan
cbc0f56af1 Mark all input columns in LIMIT BY as required output
The query analyzer only marks the actual arguments of LIMIT BY as required
output for the LimitBy step in the pipeline. This is fine, unless the query is
distributed, in which case the first stage might remove a column that is used
at the second stage (e.g. for ORDER BY) but is not part of the final select.

Prevent removal of any columns in LimitBy by marking all input columns as
required output.
2019-05-24 09:53:09 +01:00
chertus
333c9aeecc support IN in CrossToInnerJoin push down 2019-05-23 19:01:17 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Guillaume Tassery
938d6d7f24 coding style 2019-05-21 11:06:36 +07:00
chertus
187311add0 add decimal to decimal convertion in IN 2019-05-20 18:51:54 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Nikita Lapkov
0a533b0225 fix codestyle 2019-05-19 20:25:14 +00:00
Nikita Lapkov
b12db6e0e8 fix data race on trace_pipe close 2019-05-19 20:22:44 +00:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Gleb Novikov
9e6625441c Returned context to CheckConstraintsBlockOutputStream constructor 2019-05-19 10:19:44 +03:00
Gleb Novikov
d1492fc05d Removed context from CheckConstraintsBlockOutputStream 2019-05-19 10:17:06 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
Alexander Tretiakov
f6812bbb1a fix style 2019-05-19 02:57:26 +03:00
Alexander Tretiakov
c661f5c0a1 new 2019-05-19 00:07:23 +03:00
Anastasiya Rodigina
c8d4952702 Fix test with order by and final, need to think about it 2019-05-18 21:13:18 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00