Commit Graph

4213 Commits

Author SHA1 Message Date
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
b2a3835195 Unify streams for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
CurtizJ
53634a324e fix error with uninitialized system_logs 2019-06-21 22:24:30 +03:00
CurtizJ
ac3072cd9b better shutdown of system_logs 2019-06-21 20:25:47 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits
Ignore query execution limits and limits for max parts size for merge while executing mutations.
2019-06-21 02:14:41 +03:00
CurtizJ
25cbc901ed fix deadlock at flushing on shutdown 2019-06-20 20:38:16 +03:00
stavrolia
aff92c263e Make setting join_use_nulls get no effect for types that cannot be inside Nullable 2019-06-20 16:13:46 +03:00
CurtizJ
5e6ceef224 fix race condition in flushing system log 2019-06-19 19:50:17 +03:00
CurtizJ
047ee38838 fix race condition in flushing system log 2019-06-19 18:38:06 +03:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
CurtizJ
bb95d9a860 fix race condition in flushing system log 2019-06-19 15:28:34 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
CurtizJ
2a04125360 fix ignore_limits option 2019-06-18 01:07:16 +03:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas
Support system replicas queries for distributed
2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout
Distributed and remote timeouts
2019-06-17 13:58:17 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00
Alexey Milovidov
f98d0a108f Removed useless header file 2019-06-16 15:16:16 +03:00
Alexey Milovidov
7514674447 Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-16 02:40:17 +03:00
Alexey Milovidov
f38855fe61 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 02:39:55 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load
Non-blocking loading of external dictionaries
2019-06-15 22:15:53 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
2019-06-15 21:21:24 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
a999cb4fbc Merge branch 'master' into sanych73-prepared_statements 2019-06-15 17:22:01 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug
Add database engine of MySQL type
2019-06-15 14:52:57 +03:00
Alexey Milovidov
08636dce92 Added missing files 2019-06-14 22:39:56 +03:00
CurtizJ
6d9cbc6f28 ignore query limits from system profile while executing mutations 2019-06-14 22:27:53 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel.
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
2019-06-14 22:18:47 +03:00
Alexey Milovidov
c2d4c11cb8 Fixes for #5331 2019-06-14 20:15:30 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
alexey-milovidov
1e385cac7c
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:18:59 +03:00
alexey-milovidov
5317c5a08b
Update ReplaceQueryParameterVisitor.cpp 2019-06-14 19:18:24 +03:00
alexey-milovidov
daca715a0e
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:15:14 +03:00
alexey-milovidov
03076a0f8d
Update Context.cpp 2019-06-14 19:08:07 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
alexey-milovidov
eb1fe2ed17
Merge pull request #5613 from sundy-li/improve/distribute-alter-more
make isSupportedAlterType better
2019-06-14 15:39:09 +03:00
sundy-li
eac978f1e0 make isSupportedAlterType better 2019-06-14 11:06:08 +08:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style.
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
2019-06-13 13:43:37 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
2019-06-13 11:58:58 +08:00
sundy-li
d23e505414 remove line 2019-06-12 18:56:01 +08:00
sundy-li
38d4d2937e Support more AlterType in distribute DDL 2019-06-12 18:50:50 +08:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Alexander Tretiakov
dec0430327 check for trash 2019-06-05 23:04:17 +02:00
Alexander Tretiakov
8d91419a25 fix 2019-06-05 17:07:50 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533)
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
2019-06-05 14:52:39 +03:00
Alexander Tretiakov
d97c2ccdc8 support complex datatype 2019-06-04 21:15:32 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Konstantin Podshumok
633f2f2664 limit remote timeouts to max_execution_time for SelectStreamFactory 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d52be42c37 use new timeouts in ClusterProxy 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
bebd19135a remove connections_with_failover_max_tries and getSaturated(settings.max_execution_time) from Cluster 2019-06-02 12:43:20 +03:00
alexey-milovidov
086572b604
Merge pull request #5503 from 4ertus2/bugs
Fix union all supertype column
2019-06-02 06:18:33 +03:00
alesapin
117c9edda7
Merge pull request #5489 from azat-archive/DDLWorker-fix
Skip ZNONODE during DDL query processing
2019-05-31 18:34:47 +03:00
chertus
28c1a60eb7 fix union all supertype column 2019-05-31 15:36:44 +03:00
Azat Khuzhin
eb5f46fb07
Skip ZNONODE during DDL query processing
Right now if another node removes the znode in task_queue, the one that
did not process it, but already get list of children, will terminated
the DDLWorker thread, and this is very unconvinient because you do not
have any sane way to know is DDLWorker still running or not (except for
timed out DDL queries or via debugger), and the clickhouse-server it
self do not fail either.

Fixes: #5064
2019-05-30 20:25:29 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
proller
a813a001e2
Allow to use internal compiler with system includes (fix compile for freebsd) (#5447)
* Allow to use internal compiler with system includes (fix compile for freebsd)
* Fix macos build
2019-05-30 15:58:15 +03:00
stavrolia
60459bbb87 Yet another fix 2019-05-29 20:49:35 +03:00
stavrolia
605de8c36c Fixed 2019-05-29 17:59:11 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
stavrolia
3edf296aa3 Change error message 2019-05-28 22:09:40 +03:00
stavrolia
0a5fb04b56 One more fixed 2019-05-28 21:32:14 +03:00
stavrolia
aa0e227288 Fixed 2019-05-28 21:08:47 +03:00
stavrolia
976815660f Fix improvement of check 2019-05-28 20:28:17 +03:00
stavrolia
a91e72eb39 Improve check 2019-05-28 19:45:27 +03:00
stavrolia
4cd595b450 Add setting allow suspicious types for low cardinality with long message about error (fixed #4965) 2019-05-28 19:10:55 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
2019-05-25 20:20:35 +03:00
Alexey Milovidov
207d2048c6 Added forward declarations 2019-05-25 17:15:22 +03:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
bffe621d94
Merge pull request #5407 from kvap/all-columns-required-in-limit-by
Mark all input columns in LIMIT BY as required output
2019-05-25 15:13:01 +03:00
alexey-milovidov
9e24c8d19a
Merge pull request #5396 from 4ertus2/ast
Support IN in CrossToInnerJoin push down predicates
2019-05-25 14:07:45 +03:00
alexey-milovidov
661d661d57
Update CrossToInnerJoinVisitor.cpp 2019-05-25 14:05:12 +03:00
proller
6c1cb02172 CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT (#5397)
* CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT

* fix style

* Fix build

* Update iostream_debug_helpers.cpp

* Update evaluateMissingDefaults.cpp
2019-05-25 14:03:12 +03:00
alexey-milovidov
1d98441c34
Update ExpressionAnalyzer.cpp 2019-05-25 13:51:48 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Constantin S. Pan
cbc0f56af1 Mark all input columns in LIMIT BY as required output
The query analyzer only marks the actual arguments of LIMIT BY as required
output for the LimitBy step in the pipeline. This is fine, unless the query is
distributed, in which case the first stage might remove a column that is used
at the second stage (e.g. for ORDER BY) but is not part of the final select.

Prevent removal of any columns in LimitBy by marking all input columns as
required output.
2019-05-24 09:53:09 +01:00
chertus
333c9aeecc support IN in CrossToInnerJoin push down 2019-05-23 19:01:17 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Guillaume Tassery
938d6d7f24 coding style 2019-05-21 11:06:36 +07:00
chertus
187311add0 add decimal to decimal convertion in IN 2019-05-20 18:51:54 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Alexander Tretiakov
f6812bbb1a fix style 2019-05-19 02:57:26 +03:00
Alexander Tretiakov
c661f5c0a1 new 2019-05-19 00:07:23 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage.
Also a couple of massive include-refactorings with better forwarding
2019-05-17 17:34:25 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
chertus
b166791176 batched version of RowRefList 2019-05-14 17:40:43 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
chertus
20e7de7cce fix perf regression: do not add right join key to result if possible 2019-05-13 21:58:15 +03:00
Guillaume Tassery
1ae8948177 Merge branch 'master' of https://github.com/yandex/ClickHouse into send_header 2019-05-13 13:35:12 +07:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv
Support rename operation for MaterializeView storage
2019-05-09 23:10:41 +03:00
alexey-milovidov
a1cb9a2d67
Merge pull request #5152 from janplus/bug-null-in
Fix null problem in FunctionIn
2019-05-09 19:22:41 +03:00
Guillaume Tassery
c8bf190f84 add unsafe function member for (add|remove)dependency for calling manually the context locking 2019-05-09 13:12:02 +07:00
chertus
4969ad2f98 correct comment & some renames 2019-05-08 13:53:45 +03:00
chertus
74feef7e53 Join.h refactoring: remove unneeded specialisations 2019-05-07 21:21:44 +03:00
吴健
84ee8cec93 Add function ignoreExceptNull to meet nullable functionIn's requirement for optimization of analyse. 2019-05-07 13:20:23 +08:00
Guillaume Tassery
6dcaadc620 Merge remote-tracking branch 'upstream/master' into send_header 2019-05-06 17:18:41 +07:00
Guillaume Tassery
55842dce10 code style 2019-05-06 13:57:48 +07:00
zhang2014
359e4c33bd try fix push require columns with join 2019-05-05 19:12:07 +08:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
alexey-milovidov
d4b4a9425b
Merge pull request #5154 from yandex/fix-low-cardinality-keys-in-set-index
LowCardinality keys in set index
2019-05-01 20:19:04 +03:00
Nikolai Kochetov
b8adb0937f Do not create processors for totals stream. 2019-04-30 20:37:30 +03:00
Nikolai Kochetov
43adf33ec2 Do not create processors for totals stream. 2019-04-30 20:30:19 +03:00
Nikolai Kochetov
f170e55ebd Do not create processors for totals stream. 2019-04-30 20:20:34 +03:00
Nikolai Kochetov
1410d1a1ae Do not create processors for totals stream. 2019-04-30 20:06:41 +03:00
Nikolai Kochetov
728e8dfc26 Do not create processors for totals stream. 2019-04-30 20:04:31 +03:00
Nikolai Kochetov
72c0530845 Do not create processors for totals stream. 2019-04-30 20:01:12 +03:00
Nikolai Kochetov
6a3966cd08
Update PreparedSets.h 2019-04-30 17:46:17 +03:00
Vitaly Baranov
19259ab5e3 Get rid of thread_local in SettingsConstraints.cpp 2019-04-30 17:09:10 +03:00
Nikolai Kochetov
6b2656b02c Remove LowCardinality from types in PreparedSetKey. #5031 2019-04-30 13:34:12 +03:00
alexey-milovidov
0a34e05130
Merge pull request #5138 from CurtizJ/limit-by-offset
Added support of LIMIT n, m BY clause.
2019-04-30 00:17:29 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Nikolai Kochetov
0b8107c497 Fix totals with rollup. 2019-04-29 13:00:17 +03:00
alexey-milovidov
0a88bcbb48
Merge pull request #5129 from kvinty/msd-radix-sort
[WIP] Add MSD radix sort
2019-04-29 04:50:27 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
Vitaly Baranov
7801671225 Use shared_ptr to avoid copying SettingsConstraints 2019-04-27 01:09:16 +03:00
Vitaly Baranov
7e3c8d6022 Implement new constraints: "min" and "readonly". 2019-04-27 01:09:16 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
Vitaly Baranov
77e7838c30 Implemented iterators in the SettingsCollection template class 2019-04-26 19:11:05 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection.
Add new class SettingsConstraints.
2019-04-26 19:11:05 +03:00
Guillaume Tassery
7b1be6efc4 Clode cleaning and add test for X-ClickHouse-Summary header 2019-04-26 10:46:52 +07:00
Guillaume Tassery
ced71ac9fd Send how many rows and bytes were written during the query 2019-04-25 18:25:49 +07:00
Alexey Milovidov
661c840fbe Code cleanups after #4439 2019-04-25 04:16:26 +03:00