Commit Graph

3914 Commits

Author SHA1 Message Date
alexey-milovidov
f398fb3691
Merge pull request #4661 from 4ertus2/joins
Multiple COMMA/CROSS JOINS
2019-03-14 03:10:52 +03:00
alexey-milovidov
f76a9ba4c0
Merge pull request #4654 from bgranvea/create_or_replace_view
support for CREATE OR REPLACE VIEW
2019-03-14 02:32:31 +03:00
Ivan Lezhankin
f64118030a Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-13 17:23:02 +03:00
proller
cf8001b6a9
Fix includes (#4673) 2019-03-13 16:58:04 +03:00
Ivan Lezhankin
39f7225bd4 Fix build after merge 2019-03-12 17:07:02 +03:00
chertus
b76e3ad1c4 fix tests 2019-03-12 16:17:17 +03:00
Ivan Lezhankin
4c1a0ca255 Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-12 15:51:18 +03:00
Ivan Lezhankin
67eefa7b12 Revert wrong replacements of dynamic_cast.
dynamic_cast to intermediate type is not equivalent to typeid_cast
2019-03-12 15:41:57 +03:00
proller
8227f5fe63 Arcadia fix 2019-03-12 15:06:17 +03:00
chertus
114e55c956 multiple COMMA/CROSS JOIN 2019-03-12 14:06:54 +03:00
chertus
69ed6e549c Merge branch 'master' into joins 2019-03-11 22:46:21 +03:00
chertus
150fbc43c2 improve CrossToInnerJoinVisitor for multiple JOINS 2019-03-11 22:45:04 +03:00
alexey-milovidov
a4e9c59aa3
Merge pull request #4648 from 4ertus2/joins
Refactoring: move JOIN conversions to InterpreterSelectQuery
2019-03-11 22:17:58 +03:00
bgranvea
2029f71869 support for CREATE OR REPLACE VIEW 2019-03-11 17:50:31 +01:00
Ivan Lezhankin
a3a8b2bbf7 Include IAST_fwd.h for using ASTPtr 2019-03-11 17:01:45 +03:00
Ivan Lezhankin
d1ead22073 Rename As<…> → as<…> 2019-03-11 16:22:51 +03:00
Ivan Lezhankin
1e9f7847dc Merge remote-tracking branch 'upstream/master' into iast-as 2019-03-11 16:11:22 +03:00
chertus
c089d5b88a CrossToInnerJoinVisitor before JoinToSubqueryTransformVisitor 2019-03-11 16:08:51 +03:00
Ivan Lezhankin
a7e838e328 Replace all other casts to method IAST::As<Derived>
Also remove some redundant methods like IsIdentifier() et. al.
2019-03-11 15:49:39 +03:00
chertus
04f5584d72 move JOIn convertions to InterpreterSelectQuery 2019-03-11 15:20:55 +03:00
chertus
09a3b24cbc join kind helpers 2019-03-11 14:14:09 +03:00
Nikita Vasilev
d171330599 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-11 13:06:09 +03:00
alexey-milovidov
617a0a8938
Merge pull request #4592 from yandex/fix-concurrent-alters2
Fix a race condition during concurrent ALTER COLUMN queries
2019-03-10 19:11:49 +03:00
alexey-milovidov
6db73152d2
Hardening debug build (experimental) (#4632)
* Hardening debug build: more granular memory mappings and ASLR; add memory protection for mark cache and index

* Addition to prev. revision

* Addition to prev. revision

* Addition to prev. revision
2019-03-10 06:16:51 +03:00
Ivan Lezhankin
0e325c7a4a Replace const typeid_casts with As<Derived>() method invocations 2019-03-08 12:48:20 +03:00
Nikita Vasilev
a77d20e56d Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-08 11:13:48 +03:00
Alexey Milovidov
356a5c54b8 Whitespaces 2019-03-08 06:23:34 +03:00
Alex Zatelepin
896b8b15f6 fix build 2019-03-07 23:52:25 +03:00
Alexey Zatelepin
3344955154 separate Read and Write lock holders, better method names 2019-03-07 21:10:21 +03:00
Alexey Zatelepin
ab025805a3 alter intention lock 2019-03-07 20:21:18 +03:00
Nikita Vasilev
fcb82ba901 Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-07 16:55:38 +03:00
Alexey Milovidov
58bfcba361 Merge branch 'master' into dictionaries-dont-check-is-modified-under-lock 2019-03-07 02:46:27 +03:00
alexey-milovidov
b72894d693
Merge pull request #4613 from zlobober/host_context
CHYT-67: introduce host context for using CH as a library.
2019-03-07 02:35:15 +03:00
alexey-milovidov
e2fde4f0d8
Merge pull request #4576 from BayoNet/DOCAPI-5203-direct-io-settings
DOCAPI-5203 direct i/o settings EN description
2019-03-06 21:34:35 +03:00
Maxim Akhmedov
9a56294fdf CHYT-67: introduce host context for using CH as a library. 2019-03-06 19:47:47 +03:00
Nikita Vasilev
c428d9a64c Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-03-06 16:36:34 +03:00
alexey-milovidov
74f7ef390a
Merge pull request #4595 from 4ertus2/joins
Multiple JOINs multiple fixes
2019-03-06 02:55:05 +03:00
chertus
4f80afb158 fix gcc build 2019-03-05 19:34:10 +03:00
Alexey Milovidov
842a9708e9 ExternalDictionaries: don't lock when checking if a dictionary is modified 2019-03-05 19:06:40 +03:00
chertus
049d49333d undo last change 2019-03-05 18:21:52 +03:00
chertus
22f699c8a0 fix CrossToInnerJoin (empty where crash & where for one table wrong result) 2019-03-05 18:16:59 +03:00
chertus
72fe0115d1 move join convertions to InterpreterSelectQuery 2019-03-05 16:53:39 +03:00
chertus
ea4d3ec661 some multiple join fixes 2019-03-05 15:34:48 +03:00
alexey-milovidov
b311bfb11d
Merge pull request #4583 from yandex/fix-invalidate-query-for-clickhouse-dictionary-source
Fix invalidate query for clickhouse dictionary source
2019-03-05 01:27:22 +03:00
chertus
339047fc40 fix multiple joins asterisks qualification 2019-03-04 22:40:58 +03:00
alexey-milovidov
d2d4f4a237
Merge pull request #4579 from yandex/disable_compile_expressions
Disable compile expressions by default
2019-03-04 22:31:08 +03:00
Alexey Milovidov
2e7db37cde Fixed issue with update time of dictionaries after checking that the dictionary is not modified #4581 2019-03-04 22:13:05 +03:00
Alexey Milovidov
af5041532a Logging of internal queries 2019-03-04 21:28:42 +03:00
Alexey Milovidov
d019ac7ec5 Avoid std::terminate when invalidate_query returned wrong resultset #4580 2019-03-04 21:19:48 +03:00
alesapin
05f187c122 Disable compile expressions by default 2019-03-04 19:36:52 +03:00
Alexey Milovidov
c3a2e73f32 Fixed build 2019-03-04 18:53:51 +03:00
zhang2014
fb44b6692a rename setting name 2019-03-04 10:09:44 +08:00
zhang2014
b696ef34d2 Add max_execution_speed & min_execution_bytes_speed & max_execution_bytes_speed 2019-03-02 15:08:02 +08:00
alexey-milovidov
ee903886e6
Merge pull request #4387 from abyss7/CLICKHOUSE-4268
Improve push-down logic for joined statements
2019-03-02 04:19:50 +03:00
alexey-milovidov
695a2dc35f
Merge pull request #4552 from 4ertus2/bugs
Fix crash on JOIN with array or tuple
2019-03-01 18:49:22 +03:00
chertus
83503df56a fix crach on JOIN with array or tuple 2019-03-01 18:32:32 +03:00
alexey-milovidov
97cea95f74
Merge pull request #4536 from amosbird/fixedhashtable
A Proper lookup table that uses HashTable's API
2019-03-01 17:47:33 +03:00
Amos Bird
26ab5dd7a7 A Proper lookup table that uses HashTable's API
This is the first step of allowing heterogeneous cells in hash tables.

performance test results are

```

1. HashMap<UInt16, UInt8, TrivialHash, HashTableFixedGrower<16>>;
2. NewLookupMap<UInt16, UInt8>

ResolutionWidth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................223550276.46
ResolutionWidth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................248772721.24
Best: 2 - 24877272124

ResolutionWidth 100000 1 ..........................................................................................................................................................................................................................................................238498413.99
ResolutionWidth 100000 2 ..........................................................................................................................................................................................................................................................261808889.98
Best: 2 - 26180888998

ResolutionWidth 300000 1 ...................................................................................239307348.81
ResolutionWidth 300000 2 ...................................................................................257592761.30
Best: 2 - 25759276130

ResolutionWidth 1000000 1 .........................240144759.26
ResolutionWidth 1000000 2 .........................257093531.91
Best: 2 - 25709353191

ResolutionWidth 5000000 1 .....241573260.35
ResolutionWidth 5000000 2 .....259314162.79
Best: 2 - 25931416279

ResolutionDepth 30000 1 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................217108119.84
ResolutionDepth 30000 2 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................249459504.41
Best: 2 - 24945950441

ResolutionDepth 100000 1 ..........................................................................................................................................................................................................................................................229065162.17
ResolutionDepth 100000 2 ..........................................................................................................................................................................................................................................................253769105.64
Best: 2 - 25376910564

ResolutionDepth 300000 1 ...................................................................................233079225.18
ResolutionDepth 300000 2 ...................................................................................256316273.78
Best: 2 - 25631627378

ResolutionDepth 1000000 1 .........................234184633.51
ResolutionDepth 1000000 2 .........................261100491.57
Best: 2 - 26110049157

ResolutionDepth 5000000 1 .....233118795.66
ResolutionDepth 5000000 2 .....252436160.41
Best: 2 - 25243616041

```
2019-03-01 16:47:13 +08:00
Alexey Zatelepin
eee73dac42 Merge branch 'master' into fix-concurrent-alters 2019-02-28 19:19:21 +03:00
BayoNet
455ca955e5 DOCAPI-5203: Added the descriptions for direct I/O settings for MergeTree merge and SELECT queries. 2019-02-28 14:20:27 +03:00
liangqian
6757b112d1 change Sream into Stream 2019-02-28 15:27:30 +08:00
Alexey Zatelepin
0d7ab9e3ea allow acquiring read lock to a table out of order if it was already locked by the same query [#CLICKHOUSE-3789]
this is important in preventing ALTER deadlocks
2019-02-27 21:34:38 +03:00
Ivan Lezhankin
d66626a35a Revert "Move experimental join transformations to syntax analyzer"
This reverts commit 0e2316e0ac.
2019-02-27 16:35:43 +03:00
Ivan Lezhankin
2a604d075a Merge remote-tracking branch 'upstream/master' into CLICKHOUSE-4268 2019-02-27 15:08:36 +03:00
Nikita Vasilev
7a51928cad Merge remote-tracking branch 'upstream/master' into nikvas0/bloom_filter_index 2019-02-26 23:35:57 +03:00
Nikita Vasilev
d6f227ece7 fix build 2019-02-26 22:37:07 +03:00
Ivan Lezhankin
e9849ba8de Don't replace tables with compound names 2019-02-26 20:22:05 +03:00
chertus
d448d3e907 enable allow_experimental_multiple_joins_emulation and allow_experimental_cross_to_join_conversion by default 2019-02-26 20:00:33 +03:00
Ivan Lezhankin
7f130d2362 Don't replace aliased tables. 2019-02-26 17:12:25 +03:00
Ivan Lezhankin
09af5512b8 Implement push-down inside join-statement 2019-02-26 13:56:19 +03:00
Ivan Lezhankin
0e2316e0ac Move experimental join transformations to syntax analyzer 2019-02-26 13:18:12 +03:00
Ivan Lezhankin
c8eefb3927 Always modify subqueries if modifying inplace
to support push-down while analyzing.
2019-02-26 13:18:12 +03:00
Ivan Lezhankin
0a443399a0 Implement the debug query "ANALYZE"
that prints out the query after syntax analysis.
Should be helpful for tests.
2019-02-26 13:17:25 +03:00
Nikita Vasilev
4b04c4bdde improved read 2019-02-25 21:30:02 +03:00
Nikita Vasilev
ef0de1b53e refactoring 2019-02-25 21:23:21 +03:00
alexey-milovidov
864a81f1d5
Merge pull request #4502 from yandex/speedup-ddl-cleanup
Speedup ddl cleanup
2019-02-25 19:00:16 +03:00
Alexey Zatelepin
50dbfc8d50 clean distributed DDL queue in a separate thread [#CLICKHOUSE-3977] 2019-02-25 15:42:23 +03:00
alexey-milovidov
9d8b91b97a
Merge pull request #4483 from yandex/dont-create-part-log-if-not-defined
Do not create part_log if it is not defined in configuration file
2019-02-24 18:27:50 +03:00
alexey-milovidov
16225dff12
Merge pull request #4480 from 4ertus2/ast
Refactoring: simplify InDepthNodeVisitor
2019-02-24 02:32:42 +03:00
Nikita Vasilev
c61d5c84c8 UInt64 in bloom filter 2019-02-23 18:56:48 +03:00
Nikita Vasilev
635b34c442 better bloom filter 2019-02-23 17:46:40 +03:00
Nikita Vasilev
970f93d3c4 fix 2019-02-23 12:26:32 +03:00
Nikita Vasilev
81fdd13420 many columns 2019-02-22 22:59:40 +03:00
Alexey Zatelepin
46520e2887 protect zk variable with a mutex [#CLICKHOUSE-3977] 2019-02-22 22:41:33 +03:00
Alex Zatelepin
34346e37eb
Merge pull request #4472 from yandex/speedup-ddl-cleanup
Fix hangup on server shutdown if distributed DDLs were used.
2019-02-22 21:42:05 +03:00
chertus
14faa95c83 fix table functions & RequiredSourceColumnsVisitor 2019-02-22 20:08:10 +03:00
Alexey Milovidov
85c0ba1e70 Do not create part_log if it is not defined in configuration file 2019-02-22 19:10:14 +03:00
chertus
8bff0d74c0 minor changes 2019-02-22 18:45:47 +03:00
chertus
9e2aa47478 simplify InDepthNodeVisitor 2019-02-22 16:33:56 +03:00
Nikita Vasilev
9a28161414 fixed token extractor 2019-02-22 00:29:24 +03:00
chertus
a14d955e9e mJOIN: correct names for right table 2019-02-21 22:43:14 +03:00
chertus
642ad05473 minor refactoring 2019-02-21 22:38:12 +03:00
Alexey Zatelepin
73f852ae82 manually reset DDLWorker in shared context to prevent reference cycles 2019-02-21 19:41:27 +03:00
chertus
10b473bb24 mJOIN: correct names for left table columns 2019-02-21 15:45:31 +03:00
Vitaly Baranov
31039056f5
Merge pull request #4174 from vitlibar/add-protobuf-input-format
Add protobuf input format.
2019-02-21 00:59:13 +03:00
Nikita Vasilev
f66cef68ff fix in atom_map 2019-02-20 23:17:44 +03:00
Nikita Vasilev
ef55e93016 == 2019-02-20 22:27:23 +03:00
Nikita Vasilev
4e5bbc8176 fix 2019-02-20 20:17:31 +03:00
Nikita Vasilev
c35c671f4e key condition 2019-02-20 19:24:46 +03:00
chertus
f028691eaa Merge branch 'master' into joins 2019-02-20 18:48:47 +03:00
chertus
1f2a5f9a91 disable asterisks in mJOIN, add some tests 2019-02-20 18:28:53 +03:00
chertus
d45d980716 support column names without aliases (make special ones) 2019-02-20 16:22:01 +03:00
Nikita Vasilev
f7c091d497 utf8 + fixes 2019-02-20 15:48:50 +03:00
chertus
48ee3e83fa JoinToSubqueryTransform with short names 2019-02-20 15:12:36 +03:00
alesapin
432a802342 Merge branch 'master' into fix_long_http_queries_insert 2019-02-20 14:53:36 +03:00
Nikita Vasilev
3c3cc597ab added granule 2019-02-20 14:22:07 +03:00
alesapin
ef7beb1596 Fix bug with long http insert queries processing 2019-02-20 12:22:13 +03:00
Nikita Vasilev
10bc08b830 added StringBloomFilter 2019-02-20 12:02:19 +03:00
Vitaly Baranov
76aae5f5d0 Add support for settings 'format_schema' in a "INSERT INTO table FORMAT" query. 2019-02-20 05:32:29 +03:00
proller
e20c77e4c6 Add parquet support. Fixes, tests, ... 2019-02-19 23:51:44 +03:00
Alexey Milovidov
9c23486551 Fixed backward incompatibility of table function "remote" introduced with column comments 2019-02-19 20:02:51 +03:00
Alexey Milovidov
11fc35e098 Fixed accidential incompatibility due to wrong implementation of "send_logs_level" setting 2019-02-19 16:27:59 +03:00
alexey-milovidov
15b03f6e12
Merge pull request #4412 from 4ertus2/joins
Support aliases in JOIN ON section for right table columns
2019-02-18 18:31:01 +03:00
chertus
1fc6c60668 undo unneeded changes 2019-02-15 18:47:39 +03:00
chertus
b72d12d12e join on allow aliases for right table columns 2019-02-15 18:47:39 +03:00
chertus
dc1a0ed3f4 normalize JOIN ON section 2019-02-15 18:47:39 +03:00
chertus
33c3b5cdad some more refactoring 2019-02-15 18:47:39 +03:00
chertus
c6e541858e refactoring: do not match columns to tables twice 2019-02-15 18:47:39 +03:00
zhang2014
597ae0b937 ISSUES-4389 fix lambda function with predicate optimizer 2019-02-15 17:04:02 +08:00
alexey-milovidov
6d5bbd642a
Merge pull request #4401 from 4ertus2/ast
fix UB in TranslateQualifiedNamesMatcher
2019-02-14 21:48:30 +03:00
chertus
a2ff9391ad fix UB 2019-02-14 17:25:55 +03:00
alexey-milovidov
578b18af84
Merge pull request #4384 from yandex/fix-low-cardinality-with-rollup
Fix low cardinality with rollup
2019-02-13 21:29:16 +03:00
Nikolai Kochetov
cf40a1538b Fix size() and empty() for AggregationDataWithNullKey. #4223 2019-02-13 19:54:55 +03:00
alesapin
af4c4dc1e5 Fix old clients insert query processing with embedded data 2019-02-13 15:54:22 +03:00
Alexey Milovidov
6a16d27da4 Fixed bad error message #2418 2019-02-13 02:49:32 +03:00
alexey-milovidov
62f097eb66
Merge pull request #4348 from yandex/aggregate-function-state-in-field
Aggregate function state in field
2019-02-12 22:13:38 +03:00
alexey-milovidov
e49004be2e
Merge pull request #4351 from 4ertus2/joins
Simplify QueryNormalizer and fix for 4110
2019-02-12 21:36:56 +03:00
alexey-milovidov
e762f370a7
Merge pull request #4363 from 4ertus2/ast
Fix full/right join 'different number of columns'
2019-02-12 21:31:09 +03:00
alexey-milovidov
c1bf56c969
Merge pull request #4370 from nikvas0/nikvas0/index_setting
allow_experimental_data_skipping_indices setting
2019-02-12 21:19:55 +03:00
Nikita Vasilev
5279c7ff81 setting 2019-02-12 20:54:52 +03:00
chertus
93e0621a2c fix wrong query in push down test 2019-02-12 18:08:21 +03:00
chertus
aaf3813607 Merge branch 'master' into joins 2019-02-12 15:51:04 +03:00
chertus
3218f5003f fix full/right join different number of columns 2019-02-12 15:11:45 +03:00
chertus
805866e6b3 hotfix for wrong aliases issue-4110 2019-02-11 22:14:57 +03:00
chertus
958b538a01 minor improvement 2019-02-11 21:26:40 +03:00
alexey-milovidov
49165b1347
Merge pull request #4344 from yandex/forbid-temporary-tables-in-database
Forbid temporary tables in database
2019-02-11 19:51:56 +03:00
Nikolai Kochetov
0a6f75a1b6 Allow to execute subquery with scalar aggregate function state. 2019-02-11 18:50:52 +03:00
Nikolai Kochetov
c35439a5f0 Updated FieldVisitor. 2019-02-11 18:46:19 +03:00
Alexey Milovidov
7b312c6df2 Forbid to specify a database when creating a temporary table [#CLICKHOUSE-4294] 2019-02-11 17:46:09 +03:00
alesapin
55fc095c98 Fix big dates comparison with compile expressions (Date and DateTime are not signed types anymore). 2019-02-11 17:36:54 +03:00
chertus
1de1192aa8 move asterisks extraction to TranslateQualifiedNamesVisitor (before column names normalisation) 2019-02-11 17:19:09 +03:00
alexey-milovidov
81a184c47f
Merge pull request #4301 from yandex/input-data-in-perf-test
Fix perf-test input data and refactor two tests
2019-02-11 12:52:03 +03:00
Alexey Milovidov
0861af12a3 Fixed thread names 2019-02-11 00:15:14 +03:00
alexey-milovidov
0dd618b9ad
Merge pull request #4326 from yandex/duplicate-includes
Removed duplicate includes
2019-02-10 22:31:37 +03:00
alexey-milovidov
c6a01ccfb3
Merge pull request #4325 from yandex/k3box-arbitrary-const-expressions-in-limit
Add arbitrary const expressions in limit processing (cleanups)
2019-02-10 22:29:58 +03:00
Alexey Milovidov
d9ab923a2a Fixed typo 2019-02-10 21:14:23 +03:00
Alexey Milovidov
ba3cb83a84 Removed duplicate includes 2019-02-10 20:12:22 +03:00
Alexey Milovidov
58a6accee5 Updated test #4246 2019-02-10 19:55:12 +03:00
alexey-milovidov
09ee8816a1
Merge pull request #4323 from yandex/low-cardinality-production-ready
LowCardinality data type is production ready
2019-02-10 19:41:57 +03:00
Alexey Milovidov
d22b52b933 Allow constant expressions in LIMIT BY and TOP; fixed error #4246 2019-02-10 18:27:27 +03:00