thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 06:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
28,958 Commits 9,136 Branches 1,778 Tags 2 GiB
b831f2f636
Commit Graph

4647 Commits

Author SHA1 Message Date
chertus
db7c8748e9 remove IColumn.isColumnNullable() 2019-06-27 21:50:20 +03:00
Danila Kutenin
e67431e455 Use mimalloc instead of lfallocator 2019-06-27 18:13:19 +03:00
Maxim Akhmedov
2cacc3cfd2 CHYT-142: extend KeyCondition interface so that it returns BoolMask. 2019-06-27 16:31:33 +03:00
chertus
68034103bb fix arrayIndex for new columns's isNullable 2019-06-27 15:49:08 +03:00
chertus
65c0d23efa better casts to ColumnNullable 2019-06-26 20:20:33 +03:00
alesapin
b7f173ad2c Execute some distributed DDL queries on leader 2019-06-26 17:52:20 +03:00
Nikita Lapkov
7cff36fbfc Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-06-26 11:46:04 +00:00
Nikolai Kochetov
f9b29bfdd2 Merged with master. 2019-06-25 20:00:54 +03:00
Nikolai Kochetov
3bee30a215 Update PipelineExecutor. 2019-06-25 19:41:11 +03:00
Nikolai Kochetov
b2a3835195 Unify streams for SourceFromInputStream. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
821d520a52 Fix limit by offset. 2019-06-25 19:41:06 +03:00
Nikolai Kochetov
96174e90b0 Fix build. 2019-06-25 19:41:00 +03:00
Nikita Vasilev
7079c91a0e Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-25 16:34:11 +03:00
Nikita Vasilev
7b7517ff85 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-06-24 16:44:44 +03:00
Ivan Lezhankin
0917573493 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-24 14:42:58 +03:00
proller
1ac09fa721
Split Common/config.h by libs (dbms) (#5715) 2019-06-24 14:17:15 +03:00
CurtizJ
53634a324e fix error with uninitialized system_logs 2019-06-21 22:24:30 +03:00
CurtizJ
ac3072cd9b better shutdown of system_logs 2019-06-21 20:25:47 +03:00
alexey-milovidov
606b074a4b
Merge pull request #5659 from yandex/ignore-mutation-limits 
Ignore query execution limits and limits for max parts size for merge while executing mutations.
 2019-06-21 02:14:41 +03:00
CurtizJ
25cbc901ed fix deadlock at flushing on shutdown 2019-06-20 20:38:16 +03:00
stavrolia
aff92c263e Make setting join_use_nulls get no effect for types that cannot be inside Nullable 2019-06-20 16:13:46 +03:00
CurtizJ
5e6ceef224 fix race condition in flushing system log 2019-06-19 19:50:17 +03:00
CurtizJ
047ee38838 fix race condition in flushing system log 2019-06-19 18:38:06 +03:00
zhang2014
a50aea09f1 fix float in bloom filter 2019-06-19 23:13:21 +08:00
zhang2014
d145295163 convert type with condition 2019-06-19 23:12:06 +08:00
zhang2014
6c8ff6dc31 add some test 2019-06-19 23:12:05 +08:00
zhang2014
f52b16e1e1 support bloom filter for any type 2019-06-19 23:12:05 +08:00
CurtizJ
bb95d9a860 fix race condition in flushing system log 2019-06-19 15:28:34 +03:00
Ivan Lezhankin
9fd048cdbd Allow to select virtual columns in materialized view 2019-06-18 19:32:37 +03:00
Ivan Lezhankin
436052c67b Merge branch 'master' into issue-5286 2019-06-18 16:03:29 +03:00
CurtizJ
2a04125360 fix ignore_limits option 2019-06-18 01:07:16 +03:00
Vitaliy Zakaznikov
51bf8a1baa Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-17 12:42:31 -04:00
alesapin
fd3abbe93d
Merge pull request #4935 from zhang2014/feature/support_system_replicas 
Support system replicas queries for distributed
 2019-06-17 15:30:30 +03:00
alesapin
e45d727e9d
Merge pull request #4558 from podshumok/distributred-timeout 
Distributed and remote timeouts
 2019-06-17 13:58:17 +03:00
Alexey Milovidov
88c35d541d Merge branch 'master' into sanych73-prepared_statements 2019-06-16 23:53:31 +03:00
Alexey Milovidov
413b780b65 Various fixes for PVS-Studio 2019-06-16 21:13:39 +03:00
Alexey Milovidov
02034c5d91 Merging 2019-06-16 20:32:37 +03:00
Alexey Milovidov
864dacd112 Merging 2019-06-16 19:47:47 +03:00
Alexey Milovidov
f98d0a108f Removed useless header file 2019-06-16 15:16:16 +03:00
Vitaliy Zakaznikov
abc7c3f6c1 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-15 21:22:28 -04:00
Alexey Milovidov
7514674447 Merge remote-tracking branch 'origin/master' into sanych73-prepared_statements 2019-06-16 02:40:17 +03:00
Alexey Milovidov
f38855fe61 Merge branch 'master' into sanych73-prepared_statements 2019-06-16 02:39:55 +03:00
alexey-milovidov
39c6fbc324
Merge pull request #5567 from vitlibar/really-lazy-dictionary-load 
Non-blocking loading of external dictionaries
 2019-06-15 22:15:53 +03:00
Alexey Milovidov
b079631f61 Fixed tests 2019-06-15 21:22:48 +03:00
alexey-milovidov
a52e13b891
Merge pull request #5640 from yandex/use-ipv6-in-system-tables 
Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log
 2019-06-15 21:21:24 +03:00
Alexey Milovidov
fad6013270 Fixing query parameters 2019-06-15 20:52:53 +03:00
Alexey Milovidov
a999cb4fbc Merge branch 'master' into sanych73-prepared_statements 2019-06-15 17:22:01 +03:00
Alexey Milovidov
d8f76152d5 Adopted IPv6 data type in system tables; unified client info columns in system.processes and system.query_log 2019-06-15 17:20:32 +03:00
Alexey Milovidov
b2100c7bcf Removed strange quoting style like `this'. See https://english.stackexchange.com/questions/17695/any-reference-on-the-usage-of-a-backtick-and-single-quotation-mark-like-this 
Added backQuote and backQuoteIfNeed when required to correctly quote identifiers with proper escaping.
 2019-06-15 15:06:22 +03:00
alexey-milovidov
807bfa913e
Merge pull request #5599 from zhang2014/fix_createtable_bug 
Add database engine of MySQL type
 2019-06-15 14:52:57 +03:00
Gleb Novikov
15004ce055 Merge branch 'master' into table-constraints 2019-06-14 23:10:48 +03:00
Alexey Milovidov
08636dce92 Added missing files 2019-06-14 22:39:56 +03:00
CurtizJ
6d9cbc6f28 ignore query limits from system profile while executing mutations 2019-06-14 22:27:53 +03:00
Vitaly Baranov
b4384ce2a9 Dictionaries can be loaded in parallel. 
A bad dictionary cannot block all the loading anymore.
Implemented really lazy loading of external dictionaries.
Provided more detailed information about the loading of each dictionary
to make diagnostics easier.
 2019-06-14 22:18:47 +03:00
Alexey Milovidov
c2d4c11cb8 Fixes for #5331 2019-06-14 20:15:30 +03:00
Alexey Milovidov
c5c2bd4a3f Merge branch 'prepared_statements' of https://github.com/sanych73/ClickHouse into sanych73-prepared_statements 2019-06-14 19:28:25 +03:00
alexey-milovidov
1e385cac7c
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:18:59 +03:00
alexey-milovidov
5317c5a08b
Update ReplaceQueryParameterVisitor.cpp 2019-06-14 19:18:24 +03:00
alexey-milovidov
daca715a0e
Update ReplaceQueryParameterVisitor.h 2019-06-14 19:15:14 +03:00
alexey-milovidov
03076a0f8d
Update Context.cpp 2019-06-14 19:08:07 +03:00
proller
7e7b5b3810 Allow run query with remote() in clickhouse-local; Aloow redefine config from command line for clickhouse-local 2019-06-14 18:35:45 +03:00
alexey-milovidov
eb1fe2ed17
Merge pull request #5613 from sundy-li/improve/distribute-alter-more 
make isSupportedAlterType better
 2019-06-14 15:39:09 +03:00
sundy-li
eac978f1e0 make isSupportedAlterType better 2019-06-14 11:06:08 +08:00
Vitaliy Zakaznikov
117f2d191e Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-13 15:23:20 -04:00
Alexey Milovidov
c846d0f6af Namespace comments are unneeded according to the code style. 
find dbms -name '*.h' -or -name '*.cpp' | xargs grep -l -P '}\s*//+\s*namespace\s*' | xargs sed -i -r -e 's/}\s*\/\/+\s*namespace\s*.*$/}/'
 2019-06-13 13:43:37 +03:00
zhang2014
6ccef4d802 Add database engine of MySQL type 
Co-authored-by: zhang2014 <coswde@gmail.com>
Co-authored-by: TCeason <tai_chong@foxmail.com>
 2019-06-13 11:58:58 +08:00
sundy-li
d23e505414 remove line 2019-06-12 18:56:01 +08:00
sundy-li
38d4d2937e Support more AlterType in distribute DDL 2019-06-12 18:50:50 +08:00
Vitaliy Zakaznikov
a467e7c105 * Moving uexpect.py so that it can be found 
* Trying to fix failed style checks
* Trying to fix clang build fail
 2019-06-10 22:22:53 -04:00
Vitaliy Zakaznikov
a68980ab38 * Style check fixes 2019-06-10 07:41:33 -04:00
Ivan Lezhankin
97558c1b41 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-10 14:15:14 +03:00
Vitaliy Zakaznikov
b65ff910b6 Merge branch 'master' of https://github.com/vzakaznikov/ClickHouse into liveview 2019-06-07 08:02:59 -04:00
Alexander Tretiakov
dec0430327 check for trash 2019-06-05 23:04:17 +02:00
Alexander Tretiakov
8d91419a25 fix 2019-06-05 17:07:50 +03:00
Alexander Tretiakov
905856f02d merge 2019-06-05 17:02:13 +03:00
Gleb Novikov
b8385aae8c Merge branch 'master' into table-constraints 2019-06-05 15:33:07 +03:00
Orivej Desh
5ec179377a DEVTOOLS-5170 Delete Y_IGNORE markers (#5533) 
They have been superseded by a new include resolution configuration that lives
outside clickhouse source tree.
 2019-06-05 14:52:39 +03:00
Alexander Tretiakov
d97c2ccdc8 support complex datatype 2019-06-04 21:15:32 +03:00
Alexander Tretiakov
2f1a03dac0 merge 2019-06-04 21:08:08 +03:00
Vitaliy Zakaznikov
fc21200bdd * Started to add LIVE VIEW table tests 
* Added uexpect.py module
* Fixed support for CREATE TEMPORARY LIVE VIEW
 2019-06-03 15:53:11 -04:00
Ivan Lezhankin
b311984879 Merge remote-tracking branch 'upstream/master' into issue-5286 2019-06-03 17:19:09 +03:00
Anastasiya Rodigina
4ff02cff4d Fix some problems with tests, add more tests, more syntetic tests are coming today 2019-06-03 06:00:54 +00:00
Konstantin Podshumok
633f2f2664 limit remote timeouts to max_execution_time for SelectStreamFactory 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
d52be42c37 use new timeouts in ClusterProxy 2019-06-02 12:43:20 +03:00
Konstantin Podshumok
bebd19135a remove connections_with_failover_max_tries and getSaturated(settings.max_execution_time) from Cluster 2019-06-02 12:43:20 +03:00
Gleb Novikov
2b5cf46842 Merge branch 'master' into table-constraints 2019-06-02 08:33:36 +03:00
alexey-milovidov
086572b604
Merge pull request #5503 from 4ertus2/bugs 
Fix union all supertype column
 2019-06-02 06:18:33 +03:00
alesapin
117c9edda7
Merge pull request #5489 from azat-archive/DDLWorker-fix 
Skip ZNONODE during DDL query processing
 2019-05-31 18:34:47 +03:00
chertus
28c1a60eb7 fix union all supertype column 2019-05-31 15:36:44 +03:00
Vitaliy Zakaznikov
f06f0e3947 * Adding support for CREATE TEMPORARY LIVE VIEW 
* Fixing issue with setting _version virtual column
 2019-05-30 17:29:30 -04:00
Azat Khuzhin
eb5f46fb07
Skip ZNONODE during DDL query processing 
Right now if another node removes the znode in task_queue, the one that
did not process it, but already get list of children, will terminated
the DDLWorker thread, and this is very unconvinient because you do not
have any sane way to know is DDLWorker still running or not (except for
timed out DDL queries or via debugger), and the clickhouse-server it
self do not fail either.

Fixes: #5064
 2019-05-30 20:25:29 +03:00
Olga Khvostikova
2fc3ce7f5d
Merge branch 'master' into low-cardinality 2019-05-30 16:31:40 +03:00
proller
a813a001e2
Allow to use internal compiler with system includes (fix compile for freebsd) (#5447) 
* Allow to use internal compiler with system includes (fix compile for freebsd)
* Fix macos build
 2019-05-30 15:58:15 +03:00
Nikita Lapkov
8f36af7760 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-30 10:33:33 +00:00
Nikita Lapkov
3b54fde8a7 replace StackTrace with Backtrace 2019-05-30 10:30:24 +00:00
Vitaliy Zakaznikov
673d1a46a0 * Adding support for _version virtual column to LIVE VIEWs when using SELECT 
* Adding support for _version column to LIVE VIEWS when using WATCH query
* Adding initial support for WATCH query on LIVE VIEWs
 2019-05-29 17:52:13 -04:00
stavrolia
60459bbb87 Yet another fix 2019-05-29 20:49:35 +03:00
stavrolia
605de8c36c Fixed 2019-05-29 17:59:11 +03:00
zhang2014
80788cd7a8 Rename system sync distributed to system flush distributed 2019-05-29 10:43:52 +08:00
zhang2014
1a33840964 fix review 2019-05-29 10:43:52 +08:00
zhang2014
c44f608868 support replicas system queries for distributed 2019-05-29 10:43:52 +08:00
Vitaliy Zakaznikov
d112695c42 * Adding other changes to support LIVE VIEWs 2019-05-28 17:17:48 -04:00
stavrolia
3edf296aa3 Change error message 2019-05-28 22:09:40 +03:00
stavrolia
0a5fb04b56 One more fixed 2019-05-28 21:32:14 +03:00
stavrolia
aa0e227288 Fixed 2019-05-28 21:08:47 +03:00
stavrolia
976815660f Fix improvement of check 2019-05-28 20:28:17 +03:00
stavrolia
a91e72eb39 Improve check 2019-05-28 19:45:27 +03:00
stavrolia
4cd595b450 Add setting allow suspicious types for low cardinality with long message about error (fixed #4965) 2019-05-28 19:10:55 +03:00
Vitaliy Zakaznikov
9dd07bcc23 * Work in progress to redo live view implementation to be less invasive 2019-05-26 18:03:30 -04:00
Gleb Novikov
337897c4b8 Merge branch 'master' into table-constraints 2019-05-26 12:36:02 +03:00
Alexander Tretiakov
212731b3e2 merge 2019-05-26 01:45:15 +03:00
alexey-milovidov
461c4919d3
Merge pull request #5116 from PerformanceVision/send_header 
Send a X-ClickHouse summary on the header for HTTP client with number of rows inserted
 2019-05-25 20:20:35 +03:00
Nikita Lapkov
06d370dee2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-25 16:23:08 +00:00
Alexey Milovidov
207d2048c6 Added forward declarations 2019-05-25 17:15:22 +03:00
Alexey Milovidov
b94f2be154 Merge branch 'mysql' of https://github.com/yurriy/ClickHouse into yurriy-mysql 2019-05-25 17:14:57 +03:00
Alexander Tretiakov
946fa5b47e fix style and add tests 2019-05-25 16:43:52 +03:00
alexey-milovidov
bffe621d94
Merge pull request #5407 from kvap/all-columns-required-in-limit-by 
Mark all input columns in LIMIT BY as required output
 2019-05-25 15:13:01 +03:00
Gleb Novikov
c401d282da Merge branch 'master' into table-constraints 2019-05-25 14:26:08 +03:00
Anastasiya Rodigina
6c779e63b0 Edit reverse order 2019-05-25 14:09:23 +03:00
alexey-milovidov
9e24c8d19a
Merge pull request #5396 from 4ertus2/ast 
Support IN in CrossToInnerJoin push down predicates
 2019-05-25 14:07:45 +03:00
alexey-milovidov
661d661d57
Update CrossToInnerJoinVisitor.cpp 2019-05-25 14:05:12 +03:00
proller
6c1cb02172 CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT (#5397) 
* CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT

* fix style

* Fix build

* Update iostream_debug_helpers.cpp

* Update evaluateMissingDefaults.cpp
 2019-05-25 14:03:12 +03:00
alexey-milovidov
1d98441c34
Update ExpressionAnalyzer.cpp 2019-05-25 13:51:48 +03:00
chertus
9eca696e82 actualize isNumber for Decimal 2019-05-24 15:11:03 +03:00
Constantin S. Pan
cbc0f56af1 Mark all input columns in LIMIT BY as required output 
The query analyzer only marks the actual arguments of LIMIT BY as required
output for the LimitBy step in the pipeline. This is fine, unless the query is
distributed, in which case the first stage might remove a column that is used
at the second stage (e.g. for ORDER BY) but is not part of the final select.

Prevent removal of any columns in LimitBy by marking all input columns as
required output.
 2019-05-24 09:53:09 +01:00
chertus
333c9aeecc support IN in CrossToInnerJoin push down 2019-05-23 19:01:17 +03:00
Ivan Lezhankin
800854119e Add buffer callback to fill in virtual columns 2019-05-23 14:15:18 +03:00
Alexander Tretiakov
9099f1810b merge 2019-05-22 17:41:35 +03:00
Nikita Lapkov
382beefdb8 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-21 22:52:57 +00:00
Ivan Lezhankin
cf39c4cc47 Embed virtual columns into IStorage 2019-05-21 14:24:32 +03:00
Guillaume Tassery
938d6d7f24 coding style 2019-05-21 11:06:36 +07:00
chertus
187311add0 add decimal to decimal convertion in IN 2019-05-20 18:51:54 +03:00
Guillaume Tassery
77b7158cd8 Progress rename for total_rows and write_[rows|bytes] 2019-05-20 18:37:41 +07:00
Nikita Lapkov
0a533b0225 fix codestyle 2019-05-19 20:25:14 +00:00
Nikita Lapkov
b12db6e0e8 fix data race on trace_pipe close 2019-05-19 20:22:44 +00:00
Nikita Lapkov
1dd87261ae move SleepFor* to libcommon 2019-05-19 09:14:23 +00:00
Gleb Novikov
9e6625441c Returned context to CheckConstraintsBlockOutputStream constructor 2019-05-19 10:19:44 +03:00
Gleb Novikov
d1492fc05d Removed context from CheckConstraintsBlockOutputStream 2019-05-19 10:17:06 +03:00
Gleb Novikov
2e7b6af137 Merge branch 'master' into table-constraints 2019-05-19 09:03:04 +03:00
Gleb Novikov
300ec160f4 Constraints MVP 2019-05-19 08:27:00 +03:00
Nikita Lapkov
483f68b728 refactor. introduce SleepFor* functions 2019-05-19 00:25:45 +00:00
Alexander Tretiakov
f6812bbb1a fix style 2019-05-19 02:57:26 +03:00
Alexander Tretiakov
c661f5c0a1 new 2019-05-19 00:07:23 +03:00
Anastasiya Rodigina
c8d4952702 Fix test with order by and final, need to think about it 2019-05-18 21:13:18 +03:00
Anastasiya Rodigina
b3d811a199 Fix some tests 2019-05-18 19:46:29 +03:00
Anastasiya Rodigina
8c2630eddc Merge branch 'clickhouse-4013' of https://github.com/anrodigina/ClickHouse into clickhouse-4013 2019-05-18 15:54:50 +03:00
Anastasiya Rodigina
63a56f4bd9 Fix tests with group by 2019-05-18 15:54:04 +03:00
anrodigina
d7ee2cb907
Merge branch 'master' into clickhouse-4013 2019-05-18 15:34:23 +03:00
Ivan Lezhankin
0821d62516 Merge ITableDeclaration into IStorage. 
Also a couple of massive include-refactorings with better forwarding
 2019-05-17 17:34:25 +03:00
Gleb Novikov
07abed6d31 Renamed constraints getter and setter 2019-05-17 08:05:19 +03:00
Gleb Novikov
3c905e24e2 Merge branch 'master' into table-constraints 2019-05-17 08:02:33 +03:00
Gleb Novikov
502d86bd02 Added constraints to InterpreterCreateQuery and storages 2019-05-17 07:08:03 +03:00
Yuriy
0cd3094240 fixed stack buffer overflow 2019-05-16 20:15:43 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
Nikita Lapkov
ab69128e1d introduce Backtrace class 2019-05-14 22:15:23 +00:00
chertus
b166791176 batched version of RowRefList 2019-05-14 17:40:43 +03:00
chertus
6200d20dc2 RowRefList refactoring 2019-05-14 17:39:03 +03:00
Nikolai Kochetov
808d0f3b08 Merged with master. 2019-05-14 13:31:19 +03:00
chertus
20e7de7cce fix perf regression: do not add right join key to result if possible 2019-05-13 21:58:15 +03:00
Guillaume Tassery
1ae8948177 Merge branch 'master' of https://github.com/yandex/ClickHouse into send_header 2019-05-13 13:35:12 +07:00
Nikita Lapkov
6dbe205b55 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-05-12 16:16:30 +00:00
Nikita Vasilev
b0307ceeef Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-11 22:04:57 +03:00
Anastasiya Rodigina
af4fff970b Revert "Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery" 
This reverts commit 61d49e1e5f.
 2019-05-10 23:22:45 +03:00
Anastasiya Rodigina
61d49e1e5f Changes in read in pk_order, UnionBlockInputStream and InterpreterSelectQuery 2019-05-10 22:09:15 +03:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv 
Support rename operation for MaterializeView storage
 2019-05-09 23:10:41 +03:00
Nikita Vasilev
05f9373af0 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-09 21:59:22 +03:00
alexey-milovidov
a1cb9a2d67
Merge pull request #5152 from janplus/bug-null-in 
Fix null problem in FunctionIn
 2019-05-09 19:22:41 +03:00
Anastasiya Rodigina
23a8efe367 Fix tests and change pipeline 2019-05-09 18:44:51 +03:00
Guillaume Tassery
c8bf190f84 add unsafe function member for (add|remove)dependency for calling manually the context locking 2019-05-09 13:12:02 +07:00
chertus
4969ad2f98 correct comment & some renames 2019-05-08 13:53:45 +03:00
chertus
74feef7e53 Join.h refactoring: remove unneeded specialisations 2019-05-07 21:21:44 +03:00
吴健
84ee8cec93 Add function ignoreExceptNull to meet nullable functionIn's requirement for optimization of analyse. 2019-05-07 13:20:23 +08:00
Guillaume Tassery
6dcaadc620 Merge remote-tracking branch 'upstream/master' into send_header 2019-05-06 17:18:41 +07:00
Guillaume Tassery
55842dce10 code style 2019-05-06 13:57:48 +07:00
alexey-milovidov
436c8817a4
Update InterpreterSelectQuery.h 2019-05-05 23:32:44 +03:00
alexey-milovidov
e1158f53ad
Update InterpreterSelectQuery.cpp 2019-05-05 23:29:17 +03:00
alexey-milovidov
125fce3303
Update InterpreterSelectQuery.cpp 2019-05-05 23:27:03 +03:00
alexey-milovidov
c04c614bc0
Merge branch 'master' into clickhouse-4013 2019-05-05 23:22:45 +03:00
Nikita Vasilev
27aeb3a36d fix 2019-05-05 21:19:07 +03:00
Nikita Vasilev
3bf2397332 materialize 2019-05-05 20:01:54 +03:00
Nikita Vasilev
85564c3a84 Merge remote-tracking branch 'upstream/master' into nikvas0/index_mutate 2019-05-05 14:34:10 +03:00
zhang2014
359e4c33bd try fix push require columns with join 2019-05-05 19:12:07 +08:00
Alexey Milovidov
a6ca9f266f Removed huge chunk of bad code 2019-05-03 05:00:57 +03:00
Alexey Milovidov
270a31abb5 Rename method for consistency 2019-05-02 19:07:23 +03:00
alexey-milovidov
d4b4a9425b
Merge pull request #5154 from yandex/fix-low-cardinality-keys-in-set-index 
LowCardinality keys in set index
 2019-05-01 20:19:04 +03:00
Nikolai Kochetov
b8adb0937f Do not create processors for totals stream. 2019-04-30 20:37:30 +03:00
Nikolai Kochetov
43adf33ec2 Do not create processors for totals stream. 2019-04-30 20:30:19 +03:00
Nikolai Kochetov
f170e55ebd Do not create processors for totals stream. 2019-04-30 20:20:34 +03:00
Nikolai Kochetov
1410d1a1ae Do not create processors for totals stream. 2019-04-30 20:06:41 +03:00
Nikolai Kochetov
728e8dfc26 Do not create processors for totals stream. 2019-04-30 20:04:31 +03:00
Nikolai Kochetov
72c0530845 Do not create processors for totals stream. 2019-04-30 20:01:12 +03:00
Nikolai Kochetov
6a3966cd08
Update PreparedSets.h 2019-04-30 17:46:17 +03:00
Vitaly Baranov
19259ab5e3 Get rid of thread_local in SettingsConstraints.cpp 2019-04-30 17:09:10 +03:00
Nikolai Kochetov
6b2656b02c Remove LowCardinality from types in PreparedSetKey. #5031 2019-04-30 13:34:12 +03:00
alexey-milovidov
0a34e05130
Merge pull request #5138 from CurtizJ/limit-by-offset 
Added support of LIMIT n, m BY clause.
 2019-04-30 00:17:29 +03:00
Nikolai Kochetov
1c0cf652ef Attach to current thread in threadpool. 2019-04-29 18:01:53 +03:00
Nikolai Kochetov
aacc0572e5 Attach to current thread in threadpool. 2019-04-29 16:57:29 +03:00
CurtizJ
7766f5c0c3 added offset for limit by 2019-04-29 16:12:39 +03:00
Nikolai Kochetov
0b8107c497 Fix totals with rollup. 2019-04-29 13:00:17 +03:00
alexey-milovidov
0a88bcbb48
Merge pull request #5129 from kvinty/msd-radix-sort 
[WIP] Add MSD radix sort
 2019-04-29 04:50:27 +03:00
Evgenii Pravda
91ccf2ab20 Fixes 2019-04-27 20:52:43 +03:00
Anastasiya Rodigina
e750755f8f Add comments and edit style 2019-04-27 14:59:08 +03:00
Anastasiya Rodigina
747d2e0d3a Change pipeline + add optimize stuff into Settings.h 2019-04-27 12:39:03 +03:00
Vitaly Baranov
7801671225 Use shared_ptr to avoid copying SettingsConstraints 2019-04-27 01:09:16 +03:00
Vitaly Baranov
7e3c8d6022 Implement new constraints: "min" and "readonly". 2019-04-27 01:09:16 +03:00
Evgenii Pravda
568ef78803 Add MSD radix sort 2019-04-27 01:07:32 +03:00
Vitaly Baranov
77e7838c30 Implemented iterators in the SettingsCollection template class 2019-04-26 19:11:05 +03:00
Vitaly Baranov
d43e7a8960 Implement max constraints for number settings. 2019-04-26 19:11:05 +03:00
Vitaly Baranov
8277e9d8f1 Refactoring of Settings based on new template class SettingsCollection. 
Add new class SettingsConstraints.
 2019-04-26 19:11:05 +03:00
Guillaume Tassery
7b1be6efc4 Clode cleaning and add test for X-ClickHouse-Summary header 2019-04-26 10:46:52 +07:00
Guillaume Tassery
ced71ac9fd Send how many rows and bytes were written during the query 2019-04-25 18:25:49 +07:00
Alexey Milovidov
661c840fbe Code cleanups after #4439 2019-04-25 04:16:26 +03:00
Alexey Milovidov
b52f1257a9 Removed useless include 2019-04-23 19:48:46 +03:00
Alexey Milovidov
58d7d1e451 Resolved some of PVS-Studio warnings 2019-04-22 19:07:09 +03:00
Nikita Vasilev
0c2684b33e fix 2019-04-18 18:41:07 +03:00
Nikolai Kochetov
745beb6080 Fix rollup and cube transforms. 2019-04-18 15:43:13 +03:00
Ivan
118bea2be6
Enable predicate push-down optimization by default. (#4846) 
* Enable predicate push-down optimization by default.
* Forbid push-downs for some JOIN cases.
* Fix existing tests
* Forbid optimization if a select query has ARRAY JOIN on any side.
 2019-04-18 13:39:25 +03:00
Anastasiya Rodigina
ef0be2a721 Fix build and style issues 2019-04-18 01:58:24 +03:00
Anastasiya Rodigina
0c1735f1b1 ReverseBlockInputStream, optimization of group by, tests 2019-04-18 00:20:51 +03:00
Vitaly Baranov
345ae9aaa5
Merge pull request #5037 from vitlibar/fix-ubsan-errors 
Fix ubsan errors
 2019-04-17 23:39:01 +03:00
Nikita Vasilev
8e8c77a46b added indices to mutationsInterpreter 2019-04-17 20:07:07 +03:00
Vitaly Baranov
58a9105038 Fix ubsan error "outside the range of representable values" in convertFieldToType.cpp 2019-04-17 19:10:40 +03:00
Nikolai Kochetov
d5f878dba3 Fix totals. 2019-04-17 18:35:22 +03:00
alexey-milovidov
7b201a9491
Merge pull request #4986 from 4ertus2/ast 
Partially fix distributed_product_mode=local columns access
 2019-04-17 17:59:01 +03:00
Nikolai Kochetov
87472146b3 Fix totals. 2019-04-17 17:56:46 +03:00
Nikolai Kochetov
323f742c1b Fix totals. 2019-04-17 17:54:44 +03:00
Nikolai Kochetov
647afb65e8 Fix totals. 2019-04-17 17:38:16 +03:00
Artem Zuikov
29c92372a2
Merge pull request #4993 from 4ertus2/asof 
Radix sort for ASOF JOIN
 2019-04-16 21:31:21 +03:00
alexey-milovidov
76b6d43a53
Merge pull request #5001 from 4ertus2/bugs 
Fix select distinct with join
 2019-04-16 20:08:15 +03:00
Nikolai Kochetov
2001a38347 Fix kill query. 2019-04-16 19:38:33 +03:00
chertus
041f299979 Merge branch 'master' into bugs 2019-04-16 15:48:56 +03:00
chertus
a519e7f01a Merge branch 'master' into asof 2019-04-16 15:48:28 +03:00
Vitaly Baranov
39c71075fa Don't wait for the reloading when it's been doing in another thread. 2019-04-16 14:40:36 +03:00
Vitaly Baranov
6d96443440 Resolve correctly when dictionary depends on dictionary 2019-04-15 20:40:45 +03:00
chertus
7697b18b07 enable RadixSort for ASOF JOIN over UInt32 2019-04-15 17:09:39 +03:00
chertus
9c80466230 add comment 2019-04-15 14:22:51 +03:00
alesapin
8cd18c0723
Merge pull request #4991 from yandex/fix_ddl_on_relicated_table 
Do not send queries received from DDLWorker to leader replica
 2019-04-15 13:07:55 +03:00
Anton Popov
7f93f9ad2f TTL for columns and tables (#4212) 
Add TTL for columns and tables.
 2019-04-15 12:30:45 +03:00
Danila Kutenin
b81e0f51f1 fix compilation in clickhouse 2019-04-14 13:37:25 +03:00
chertus
950f8a7042 fix distinct with join 2019-04-12 20:04:38 +03:00
Nikolai Kochetov
4311904af4 Fix execute query. 2019-04-12 18:32:53 +03:00
Nikolai Kochetov
17d2de2d72 Append MaterializingTransform before output format at executeQuery function. 2019-04-12 16:56:48 +03:00
Nikolai Kochetov
6949f2d80a Added force_add_agg_info to SourceFromInputStream/ 2019-04-12 16:16:07 +03:00
Nikolai Kochetov
1e5731496c Added force_add_agg_info to SourceFromInputStream. 2019-04-12 16:09:46 +03:00
chertus
4192deb5ad radix sort for asof join 2019-04-12 15:48:00 +03:00
alesapin
f47e3292e1 Do not send queries to leader replica received from DDLWorker 2019-04-12 14:06:05 +03:00
chertus
4707200f83 partially fix distributed_product_mode=local 2019-04-11 22:29:28 +03:00
Nikolai Kochetov
d1840417a8 Don't resize pipeline before memory efficient transform. 2019-04-11 17:28:42 +03:00
Nikolai Kochetov
a72f402468 Fix double readPrefix call. 2019-04-11 16:04:43 +03:00
alexey-milovidov
d083976b88
Merge pull request #4952 from 4ertus2/ast 
Rewrite ASTSelectQuery (consistent children)
 2019-04-11 13:38:44 +03:00
alexey-milovidov
7e7b458eb9
Merge pull request #4938 from 4ertus2/joins 
Fix unexpected error in case of JOIN + ARRAY JOIN
 2019-04-11 13:35:31 +03:00
Nikita Vasilev
20f0b17cf4 mutations 2019-04-10 20:44:39 +03:00
chertus
ee6c83a2f7 global join: fix wrong name qualification (save replaced table name as alias) 2019-04-10 20:41:19 +03:00
Nikolai Kochetov
403df591dc Fix totals fro single remote source. 2019-04-10 19:34:20 +03:00
Nikolai Kochetov
d7aa7412ae Fix totals fro single remote source. 2019-04-10 19:28:37 +03:00
Nikolai Kochetov
c4c98c3a99 Fix full join. 2019-04-10 17:01:52 +03:00
Nikolai Kochetov
8cbecbf5cb Fix clang build. 2019-04-10 16:28:54 +03:00
Nikolai Kochetov
b16bce0698 Fix clang build. 2019-04-10 16:27:51 +03:00
Nikolai Kochetov
94305c41e3 Fix join for totals. 2019-04-10 14:04:56 +03:00
Nikolai Kochetov
31ed0f0e38 Fix join for totals. 2019-04-10 13:52:20 +03:00
chertus
e53a50e01a fix pushdown & build 2019-04-09 19:49:52 +03:00
chertus
9329410012 fix use after move 2019-04-09 17:59:06 +03:00
Nikolai Kochetov
59eae7b23d Fix join for totals. 2019-04-09 17:51:38 +03:00
chertus
82dc1fb1db rewrite ASTSelectQuery (consistent children) 2019-04-09 17:22:35 +03:00
Nikolai Kochetov
322b1ccd6b Fix join for totals. 2019-04-09 17:08:52 +03:00
Nikolai Kochetov
695238147b Fix header for union. 2019-04-09 16:07:07 +03:00
Nikolai Kochetov
b1c98a9398 Fix execute query over HTTP. 2019-04-09 14:00:38 +03:00
Nikolai Kochetov
54066fc312 Fix rows_before_limit_at_least. 2019-04-09 13:17:25 +03:00
chertus
58d24c0840 join + array join: fix unexpected error 2019-04-08 15:35:26 +03:00
Artem Zuikov
cbb0404d19
Merge pull request #4924 from Gladdy/martijn-asof-speedup 
Significant speedup of ASOF join
 2019-04-06 21:38:46 +03:00
alexey-milovidov
04a163b952
Merge pull request #4922 from yandex/fix-issue-4919 
Fix types for aggregate functions with low cardinality arguments.
 2019-04-06 18:07:25 +03:00
Nikita Lapkov
fbdf2c3525 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-04-06 06:58:40 +00:00
Alexey Milovidov
07334ebad4 Fixed race condition in DNSCacheUpdater 2019-04-06 04:09:15 +03:00
Alexey Milovidov
571bc7065a Removed unused code related to MemoryTracker 2019-04-06 01:35:56 +03:00
Martijn Bakker
0848f53bed move the sorted atomic bool first in the class 2019-04-05 21:22:57 +01:00
Martijn Bakker
442c001fd5 fix style 2019-04-05 19:05:24 +01:00
Martijn Bakker
f96a7e401e remove the list lookup and prevent the global lock 2019-04-05 18:59:48 +01:00
Nikolai Kochetov
523c8e5ec1 Remove LowCardinality from aggregate function argument types. #4919 2019-04-05 19:52:31 +03:00
chertus
aae1e56214 fix typo 2019-04-05 15:57:08 +03:00
chertus
f50a0778fb fix missing column error message 2019-04-05 15:50:14 +03:00
Nikolai Kochetov
33b176f2da Fix style. 2019-04-05 14:34:11 +03:00
Nikolai Kochetov
1470fe0a72 Fix clang build. 2019-04-05 14:27:08 +03:00
Nikolai Kochetov
7626b1b267 Multiple fixes. 2019-04-05 13:52:07 +03:00
chertus
e578020bd3 safe tables order in select * with multiple joins 2019-04-04 15:14:10 +03:00
chertus
6b49900e1a Asterisks for multiple joins CLICKHOUSE-4372 2019-04-03 19:06:05 +03:00
Nikolai Kochetov
5e39ec610c Merged with master 2019-04-03 14:21:38 +03:00
Nikolai Kochetov
94ff7f694a QueryPipeline [in progress]. 2019-04-03 13:14:36 +03:00
Nikolai Kochetov
18133a4948 Added processors_test_aggregation. 2019-04-03 13:13:25 +03:00
Nikolai Kochetov
6976b65b2d Added MergingAggregatedTransform. 2019-04-03 13:13:25 +03:00
chertus
d5ffbd9b6d fix multithreaded ASOF JOIN crash 2019-04-02 21:50:35 +03:00
chertus
04efcf2bdc asof refactoring (searching for the crash reason) 2019-04-02 19:22:14 +03:00
chertus
886e6883e6 fix clang-7 build 2019-04-01 21:37:52 +03:00
chertus
9ed4ac7e82 get rid of macro in AsofRowRefs 2019-04-01 19:44:15 +03:00
Artem Zuikov
b6b9be7b8f
Merge pull request #4867 from Gladdy/martijn-asof-working-bt 
Return the correct timestamp for the right-hand table of the ASOF join
 2019-04-01 15:36:27 +03:00
Artem Zuikov
019c6ca591
Merge pull request #4794 from zhang2014/fix/crash_when_predicate 
fix crash when predicate optimzer & join on
 2019-04-01 15:09:50 +03:00
Martijn Bakker
d4ec3bbf70 fix style 2019-04-01 11:35:37 +01:00
Martijn Bakker
a64b8afc7e cleanup 2019-04-01 00:09:00 +01:00
Martijn Bakker
27776ca929 fix up wrong assumption that the sample_block_with_keys has same ordering as key_names_right 2019-03-31 22:56:37 +01:00
Martijn Bakker
7ea03f6fa7 appears to work and get the correct timestamps 2019-03-31 22:14:43 +01:00
Martijn Bakker
4a7393cfc6 include the asof column in the block stored. overall not working yet but at least doesnt crash anymore 2019-03-31 20:03:57 +01:00
chertus
11997ed772 fix build 2019-03-31 13:56:54 +03:00
Martijn Bakker
4709b744bb address the code review issues 2019-03-30 21:30:21 +00:00
Martijn Bakker
3ac66dfdb6 set default asof type value 2019-03-30 13:09:03 +00:00
Martijn Bakker
20e5fb61c4 fix style 2019-03-30 13:02:30 +00:00
Martijn Bakker
4a94545882 add test for multiple supported asof types 2019-03-30 12:52:48 +00:00
Martijn Bakker
7c5febb6aa Merge branch 'master' into martijn-asof-nomap 2019-03-30 02:02:48 +00:00
Martijn Bakker
389f108807 working multi type asof join columns 2019-03-30 01:32:08 +00:00
alexey-milovidov
0dee8cf79c
Merge pull request #4855 from 4ertus2/joins 
Fix crash when joining nulluble vs not nullable
 2019-03-30 02:15:50 +03:00
Martijn Bakker
89515861df asof join without using std::map, but still only on u32 2019-03-29 21:20:23 +00:00
Ivan
957d23267b
Minimal implementation of row-level security CLICKHOUSE-4315 (#4792) 
For detailed description see the related PR
 2019-03-29 23:31:06 +03:00
alexey-milovidov
cb486da9cd
Merge pull request #4852 from zhang2014/improvement/const_interpreter 
Const context for insert interpreter
 2019-03-29 21:42:35 +03:00
chertus
6bdbf75e30 fix crash when joining nulluble vs not nullable 2019-03-29 21:07:22 +03:00
zhang2014
aab314f154 const insert interpreter 2019-03-29 23:47:16 +08:00
zhang2014
0096ef3524 try fix 2019-03-29 22:25:37 +08:00
Alexey Milovidov
88e94bad74 Removed "assumeMutable" usage in one case 2019-03-29 17:17:29 +03:00
zhang2014
1eb5713a74 fix crash when predicate optimzer & join on 2019-03-29 18:41:26 +08:00
Martijn Bakker
9ac52b9368 fix master merge 2019-03-28 21:06:49 +00:00
Martijn Bakker
46f4557944 Merge branch 'master' into martijn-asof-join 2019-03-28 20:20:17 +00:00
Martijn Bakker
e7a10b8a3e add inner asof join with tests 2019-03-28 19:31:11 +00:00
Martijn Bakker
817a9244c0 fix up code style 2019-03-28 19:03:57 +00:00
Martijn Bakker
b0fd915724 remove the ASOFSplit struct 2019-03-28 18:35:50 +00:00
chertus
2a5b4b3b31 fix ANY JOIN nulls in right key (ALL JOIN is still affected) 2019-03-27 16:37:11 +03:00
chertus
e92dcd4774 fix clang release build 2019-03-27 01:47:38 +03:00
Martijn Bakker
ac68fc8088 pass the half-enforced style checks such that they cannot be run on a whole file automatically :( 2019-03-26 22:05:51 +00:00
Martijn Bakker
84f40ddf02 fix build as cpp does not do partial function specialization 2019-03-26 20:13:15 +00:00
chertus
274916d944 Merge branch 'master' into nulls 2019-03-26 23:04:39 +03:00
chertus
0a0e986f75 fix crash on join not nullable with nullable 2019-03-26 22:46:03 +03:00
Martijn Bakker
f6987cfa52 have the parser recognize asof joins and feed them through to the executor 
insert the time series into a struct ready for joining

working version that inserts the data into the hash table using the existing dispatching machinery for various types

working asof left join in clickhouse

add a test for the asof join

do some asof join cleanup

revisit the logic in case the values match between left and right side
 2019-03-26 19:17:21 +00:00
alexey-milovidov
b8d9ed6f54
Merge pull request #4723 from 4ertus2/joins 
Fix LEFT JOIN with const column + lots of Join.cpp refactoring
 2019-03-26 19:46:46 +03:00
alexey-milovidov
c2e4942009
Merge pull request #4705 from 4ertus2/ast 
SelectQueryOptions + fix duplicates in GLOBAL JOIN with asterisks
 2019-03-26 19:45:27 +03:00
chertus
aac69eaa2c Merge branch 'joins' into nulls 2019-03-25 14:54:47 +03:00
Nikita Lapkov
4a4ff8d5bf Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-23 18:45:22 +00:00
proller
d79fd73753 Fix critical naming bug 2019-03-23 14:23:17 +03:00
alexey-milovidov
efc2d91507
Merge pull request #4764 from proller/fix23 
Move Interpreters/Settings* -> Core/Settings*
 2019-03-22 17:49:19 +03:00
alexey-milovidov
b919876a8c
Merge pull request #4758 from yandex/tsan-system-log-fix-race-on-shutdown 
Fixed TSan report on shutdown
 2019-03-22 17:47:35 +03:00
proller
fce9db12b9 Move Interpreters/Settings* -> Core/Settings* 2019-03-22 15:08:30 +03:00
proller
d6d83d4a5c
Allow build without ssl (#4525) (#4750) 2019-03-22 14:18:24 +03:00
Alexey Milovidov
41fede9c6b Fixed TSan report on shutdown 2019-03-21 22:22:38 +03:00
chertus
3e146c7bbd Merge branch 'master' into joins 2019-03-21 22:01:35 +03:00
chertus
b1f4cc6ed2 fix left join with const column 2019-03-20 20:20:14 +03:00
Nikita Vasilev
c10f10cc0b Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-20 19:39:18 +03:00
chertus
2ea11f8528 more Joins.cpp refactoring (constexpr if) 2019-03-20 18:52:41 +03:00
chertus
efa4a2bb18 minor changes 2019-03-20 18:15:44 +03:00
chertus
2713d36ce8 syntax: remove tab 2019-03-20 17:49:05 +03:00
chertus
1bb05eb089 more Join.cpp refactoring (hide some logic into AddedColumns) 2019-03-20 17:41:35 +03:00
chertus
2a4da2f687 more refactoring (rename misleading variable) 2019-03-20 16:38:17 +03:00
chertus
e1f015295b rename functions & add comment 2019-03-20 15:28:45 +03:00
chertus
ef2d77f946 some more refactoring 2019-03-20 15:08:38 +03:00
chertus
e5a9633132 Join.cpp refactoring 2019-03-19 19:53:36 +03:00
chertus
913377fdaf restore GLOBAL IN column renames 2019-03-18 21:45:49 +03:00
chertus
c9169b0a98 Merge branch 'master' into ast 2019-03-18 20:46:24 +03:00
chertus
1446c50884 fix RowRef initialisation (found by PVS) 2019-03-18 20:43:09 +03:00
chertus
7561ff2ab7 fix dups in GLOBAL JOIN with asterisks 2019-03-18 17:56:33 +03:00
chertus
bd559f8db8 SelectQueryOptions v3 (no inheritance) 2019-03-18 15:05:51 +03:00
chertus
b6e2697101 Merge branch 'master' into ast 2019-03-18 13:36:13 +03:00
Alexey Zatelepin
304c67da99 Merge branch 'master' into fix-add-materialized-column-after 
Conflicts:
	dbms/src/Interpreters/InterpreterCreateQuery.cpp
	dbms/src/Interpreters/InterpreterDescribeQuery.cpp
	dbms/src/Interpreters/interpretSubquery.cpp
	dbms/src/Storages/ColumnsDescription.cpp
 2019-03-17 00:46:53 +03:00
alexey-milovidov
ae2d974dda
Merge pull request #4708 from kvap/distributed-limit-by 
Make the query planner respect LIMIT BY in remote queries
 2019-03-16 20:54:06 +03:00
Ivan
8ac3e89628
Merge pull request #4649 from abyss7/iast-as 
Implement and use method IAST::as<Derived>()
 2019-03-15 23:22:46 +03:00
chertus
a63cf1aeef fix line with PVS warning 2019-03-15 21:04:30 +03:00
chertus
5104665a05 Merge branch 'master' into ast 2019-03-15 19:40:26 +03:00
Alexey Zatelepin
b5a0a3fa23 store all kinds of columns in the same list in ColumnsDescription [#CLICKHOUSE-3101] 2019-03-15 19:37:52 +03:00
Ivan Lezhankin
4f6a494af8 Revert references where they were before refactoring. 2019-03-15 19:14:13 +03:00
chertus
ffc3974934 SelectQueryOptions v2 2019-03-15 18:57:18 +03:00
Constantin S. Pan
df6860d5e0 Make the query planner respect LIMIT BY in remote queries 2019-03-15 15:26:21 +00:00
chertus
53abdccb95 refactoring: extract SelectQueryOptions 2019-03-15 16:49:58 +03:00
Alexey Milovidov
aea3bd2cc9 Fixed potential deadlock in ExternalDictionaries 2019-03-15 03:29:53 +03:00
proller
1a33f4da40
Optional current_thread and memory_tracker (#4664) 2019-03-14 21:03:35 +03:00
Ivan Lezhankin
a6ca8bcb10 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-14 16:05:09 +03:00
alexey-milovidov
f398fb3691
Merge pull request #4661 from 4ertus2/joins 
Multiple COMMA/CROSS JOINS
 2019-03-14 03:10:52 +03:00
alexey-milovidov
f76a9ba4c0
Merge pull request #4654 from bgranvea/create_or_replace_view 
support for CREATE OR REPLACE VIEW
 2019-03-14 02:32:31 +03:00
Ivan Lezhankin
f64118030a Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-13 17:23:02 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
Ivan Lezhankin
39f7225bd4 Fix build after merge 2019-03-12 17:07:02 +03:00
chertus
b76e3ad1c4 fix tests 2019-03-12 16:17:17 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
Ivan Lezhankin
67eefa7b12 Revert wrong replacements of dynamic_cast. 
dynamic_cast to intermediate type is not equivalent to typeid_cast
 2019-03-12 15:41:57 +03:00
proller
8227f5fe63 Arcadia fix 2019-03-12 15:06:17 +03:00
chertus
114e55c956 multiple COMMA/CROSS JOIN 2019-03-12 14:06:54 +03:00
chertus
69ed6e549c Merge branch 'master' into joins 2019-03-11 22:46:21 +03:00
chertus
150fbc43c2 improve CrossToInnerJoinVisitor for multiple JOINS 2019-03-11 22:45:04 +03:00
alexey-milovidov
a4e9c59aa3
Merge pull request #4648 from 4ertus2/joins 
Refactoring: move JOIN conversions to InterpreterSelectQuery
 2019-03-11 22:17:58 +03:00
bgranvea
2029f71869 support for CREATE OR REPLACE VIEW 2019-03-11 17:50:31 +01:00
Ivan Lezhankin
a3a8b2bbf7 Include IAST_fwd.h for using ASTPtr 2019-03-11 17:01:45 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
chertus
c089d5b88a CrossToInnerJoinVisitor before JoinToSubqueryTransformVisitor 2019-03-11 16:08:51 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived> 
Also remove some redundant methods like IsIdentifier() et. al.
 2019-03-11 15:49:39 +03:00
chertus
04f5584d72 move JOIn convertions to InterpreterSelectQuery 2019-03-11 15:20:55 +03:00
chertus
09a3b24cbc join kind helpers 2019-03-11 14:14:09 +03:00
Nikita Vasilev
d171330599 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-11 13:06:09 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2 
Fix a race condition during concurrent ALTER COLUMN queries
 2019-03-10 19:11:49 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632) 
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
 2019-03-10 06:16:51 +03:00
Nikita Lapkov
1ea971ddd2 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-10 01:56:41 +00:00
Nikita Lapkov
5b50026860 - remove memory allocations in signal handler 
- revert ThreadStatus::getQueryId()
- refactor
 2019-03-10 01:49:36 +00:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Alexey Milovidov
356a5c54b8 Whitespaces 2019-03-08 06:23:34 +03:00
Alex Zatelepin
896b8b15f6 fix build 2019-03-07 23:52:25 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Alexey Milovidov
58bfcba361 Merge branch 'master' into dictionaries-dont-check-is-modified-under-lock 2019-03-07 02:46:27 +03:00
alexey-milovidov
b72894d693
Merge pull request #4613 from zlobober/host_context 
CHYT-67: introduce host context for using CH as a library.
 2019-03-07 02:35:15 +03:00
alexey-milovidov
e2fde4f0d8
Merge pull request #4576 from BayoNet/DOCAPI-5203-direct-io-settings 
DOCAPI-5203 direct i/o settings EN description
 2019-03-06 21:34:35 +03:00
Maxim Akhmedov
9a56294fdf CHYT-67: introduce host context for using CH as a library. 2019-03-06 19:47:47 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
Nikita Lapkov
12fe175385 Merge remote-tracking branch 'upstream/master' into query-poor-mans-profiler 2019-03-06 10:30:47 +00:00
alexey-milovidov
74f7ef390a
Merge pull request #4595 from 4ertus2/joins 
Multiple JOINs multiple fixes
 2019-03-06 02:55:05 +03:00
chertus
4f80afb158 fix gcc build 2019-03-05 19:34:10 +03:00
Alexey Milovidov
842a9708e9 ExternalDictionaries: don't lock when checking if a dictionary is modified 2019-03-05 19:06:40 +03:00
chertus
049d49333d undo last change 2019-03-05 18:21:52 +03:00
chertus
22f699c8a0 fix CrossToInnerJoin (empty where crash & where for one table wrong result) 2019-03-05 18:16:59 +03:00
chertus
72fe0115d1 move join convertions to InterpreterSelectQuery 2019-03-05 16:53:39 +03:00
chertus
ea4d3ec661 some multiple join fixes 2019-03-05 15:34:48 +03:00
alexey-milovidov
b311bfb11d
Merge pull request #4583 from yandex/fix-invalidate-query-for-clickhouse-dictionary-source 
Fix invalidate query for clickhouse dictionary source
 2019-03-05 01:27:22 +03:00
chertus
339047fc40 fix multiple joins asterisks qualification 2019-03-04 22:40:58 +03:00
alexey-milovidov
d2d4f4a237
Merge pull request #4579 from yandex/disable_compile_expressions 
Disable compile expressions by default
 2019-03-04 22:31:08 +03:00
Alexey Milovidov
2e7db37cde Fixed issue with update time of dictionaries after checking that the dictionary is not modified #4581 2019-03-04 22:13:05 +03:00
Alexey Milovidov
af5041532a Logging of internal queries 2019-03-04 21:28:42 +03:00
Alexey Milovidov
d019ac7ec5 Avoid std::terminate when invalidate_query returned wrong resultset #4580 2019-03-04 21:19:48 +03:00
alesapin
05f187c122 Disable compile expressions by default 2019-03-04 19:36:52 +03:00
Alexey Milovidov
c3a2e73f32 Fixed build 2019-03-04 18:53:51 +03:00
Nikita Lapkov
6367e15e4e add cpu timer. add timer type to log. refactor 2019-03-04 13:03:32 +00:00
zhang2014
fb44b6692a rename setting name 2019-03-04 10:09:44 +08:00
zhang2014
b696ef34d2 Add max_execution_speed & min_execution_bytes_speed & max_execution_bytes_speed 2019-03-02 15:08:02 +08:00
alexey-milovidov
ee903886e6
Merge pull request #4387 from abyss7/CLICKHOUSE-4268 
Improve push-down logic for joined statements
 2019-03-02 04:19:50 +03:00
alexey-milovidov
695a2dc35f
Merge pull request #4552 from 4ertus2/bugs 
Fix crash on JOIN with array or tuple
 2019-03-01 18:49:22 +03:00
chertus
83503df56a fix crach on JOIN with array or tuple 2019-03-01 18:32:32 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable 
A Proper lookup table that uses HashTable's API
 2019-03-01 17:47:33 +03:00
Nikita Lapkov
ce4e48d6f4 Merge branch 'master' into query-poor-mans-profiler 2019-03-01 14:22:38 +00:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API 
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
 2019-03-01 16:47:13 +08:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
BayoNet
455ca955e5 DOCAPI-5203: Added the descriptions for direct I/O settings for MergeTree merge and SELECT queries. 2019-02-28 14:20:27 +03:00
liangqian
6757b112d1 change Sream into Stream 2019-02-28 15:27:30 +08:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789] 
this is important in preventing ALTER deadlocks
 2019-02-27 21:34:38 +03:00
Ivan Lezhankin
d66626a35a Revert "Move experimental join transformations to syntax analyzer" 
This reverts commit 0e2316e0ac.
 2019-02-27 16:35:43 +03:00
Ivan Lezhankin
2a604d075a Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-4268 2019-02-27 15:08:36 +03:00
Nikita Vasilev
7a51928cad Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-02-26 23:35:57 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Ivan Lezhankin
e9849ba8de Don't replace tables with compound names 2019-02-26 20:22:05 +03:00
chertus
d448d3e907 enable allow_experimental_multiple_joins_emulation and allow_experimental_cross_to_join_conversion by default 2019-02-26 20:00:33 +03:00
Ivan Lezhankin
7f130d2362 Don't replace aliased tables. 2019-02-26 17:12:25 +03:00
Ivan Lezhankin
09af5512b8 Implement push-down inside join-statement 2019-02-26 13:56:19 +03:00
Ivan Lezhankin
0e2316e0ac Move experimental join transformations to syntax analyzer 2019-02-26 13:18:12 +03:00
Ivan Lezhankin
c8eefb3927 Always modify subqueries if modifying inplace 
to support push-down while analyzing.
 2019-02-26 13:18:12 +03:00
Ivan Lezhankin
0a443399a0 Implement the debug query "ANALYZE" 
that prints out the query after syntax analysis.
Should be helpful for tests.
 2019-02-26 13:17:25 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
alexey-milovidov
864a81f1d5
Merge pull request #4502 from yandex/speedup-ddl-cleanup 
Speedup ddl cleanup
 2019-02-25 19:00:16 +03:00
Alexey Zatelepin
50dbfc8d50 clean distributed DDL queue in a separate thread [#CLICKHOUSE-3977] 2019-02-25 15:42:23 +03:00
alexey-milovidov
9d8b91b97a
Merge pull request #4483 from yandex/dont-create-part-log-if-not-defined 
Do not create part_log if it is not defined in configuration file
 2019-02-24 18:27:50 +03:00
alexey-milovidov
16225dff12
Merge pull request #4480 from 4ertus2/ast 
Refactoring: simplify InDepthNodeVisitor
 2019-02-24 02:32:42 +03:00
Nikita Vasilev
c61d5c84c8 UInt64 in bloom filter 2019-02-23 18:56:48 +03:00
Nikita Vasilev
635b34c442 better bloom filter 2019-02-23 17:46:40 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Alexey Zatelepin
46520e2887 protect zk variable with a mutex [#CLICKHOUSE-3977] 2019-02-22 22:41:33 +03:00
Alex Zatelepin
34346e37eb
Merge pull request #4472 from yandex/speedup-ddl-cleanup 
Fix hangup on server shutdown if distributed DDLs were used.
 2019-02-22 21:42:05 +03:00
chertus
14faa95c83 fix table functions & RequiredSourceColumnsVisitor 2019-02-22 20:08:10 +03:00
Alexey Milovidov
85c0ba1e70 Do not create part_log if it is not defined in configuration file 2019-02-22 19:10:14 +03:00
chertus
8bff0d74c0 minor changes 2019-02-22 18:45:47 +03:00
chertus
9e2aa47478 simplify InDepthNodeVisitor 2019-02-22 16:33:56 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
chertus
a14d955e9e mJOIN: correct names for right table 2019-02-21 22:43:14 +03:00
chertus
642ad05473 minor refactoring 2019-02-21 22:38:12 +03:00
Alexey Zatelepin
73f852ae82 manually reset DDLWorker in shared context to prevent reference cycles 2019-02-21 19:41:27 +03:00
chertus
10b473bb24 mJOIN: correct names for left table columns 2019-02-21 15:45:31 +03:00
Vitaly Baranov
31039056f5
Merge pull request #4174 from vitlibar/add-protobuf-input-format 
Add protobuf input format.
 2019-02-21 00:59:13 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
chertus
f028691eaa Merge branch 'master' into joins 2019-02-20 18:48:47 +03:00
chertus
1f2a5f9a91 disable asterisks in mJOIN, add some tests 2019-02-20 18:28:53 +03:00
chertus
d45d980716 support column names without aliases (make special ones) 2019-02-20 16:22:01 +03:00
Nikita Vasilev
f7c091d497 utf8 + fixes 2019-02-20 15:48:50 +03:00
chertus
48ee3e83fa JoinToSubqueryTransform with short names 2019-02-20 15:12:36 +03:00
alesapin
432a802342 Merge branch 'master' into fix_long_http_queries_insert 2019-02-20 14:53:36 +03:00
Nikita Vasilev
3c3cc597ab added granule 2019-02-20 14:22:07 +03:00
alesapin
ef7beb1596 Fix bug with long http insert queries processing 2019-02-20 12:22:13 +03:00
Nikita Vasilev
10bc08b830 added StringBloomFilter 2019-02-20 12:02:19 +03:00
Vitaly Baranov
76aae5f5d0 Add support for settings 'format_schema' in a "INSERT INTO table FORMAT" query. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Alexey Milovidov
9c23486551 Fixed backward incompatibility of table function "remote" introduced with column comments 2019-02-19 20:02:51 +03:00
Alexey Milovidov
11fc35e098 Fixed accidential incompatibility due to wrong implementation of "send_logs_level" setting 2019-02-19 16:27:59 +03:00
alexey-milovidov
15b03f6e12
Merge pull request #4412 from 4ertus2/joins 
Support aliases in JOIN ON section for right table columns
 2019-02-18 18:31:01 +03:00
chertus
1fc6c60668 undo unneeded changes 2019-02-15 18:47:39 +03:00
chertus
b72d12d12e join on allow aliases for right table columns 2019-02-15 18:47:39 +03:00
chertus
dc1a0ed3f4 normalize JOIN ON section 2019-02-15 18:47:39 +03:00
chertus
33c3b5cdad some more refactoring 2019-02-15 18:47:39 +03:00
chertus
c6e541858e refactoring: do not match columns to tables twice 2019-02-15 18:47:39 +03:00
zhang2014
597ae0b937 ISSUES-4389 fix lambda function with predicate optimizer 2019-02-15 17:04:02 +08:00
alexey-milovidov
6d5bbd642a
Merge pull request #4401 from 4ertus2/ast 
fix UB in TranslateQualifiedNamesMatcher
 2019-02-14 21:48:30 +03:00
chertus
a2ff9391ad fix UB 2019-02-14 17:25:55 +03:00
alexey-milovidov
578b18af84
Merge pull request #4384 from yandex/fix-low-cardinality-with-rollup 
Fix low cardinality with rollup
 2019-02-13 21:29:16 +03:00
Nikolai Kochetov
cf40a1538b Fix size() and empty() for AggregationDataWithNullKey. #4223 2019-02-13 19:54:55 +03:00
alesapin
af4c4dc1e5 Fix old clients insert query processing with embedded data 2019-02-13 15:54:22 +03:00
Alexey Milovidov
6a16d27da4 Fixed bad error message #2418 2019-02-13 02:49:32 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field 
Aggregate function state in field
 2019-02-12 22:13:38 +03:00