Commit Graph

3532 Commits

Author SHA1 Message Date
chertus
600755745b Merge branch 'ast' into joins 2018-12-27 14:17:24 +03:00
alesapin
3afa03d044 Merge branch 'master' into custom_compression_codecs 2018-12-27 11:23:00 +03:00
alexey-milovidov
5c4ebfa2e1
Update RequiredSourceColumnsVisitor.h 2018-12-26 23:35:06 +03:00
alexey-milovidov
67dbfd8e81
Update ExpressionAnalyzer.cpp 2018-12-26 23:33:29 +03:00
Alexey Milovidov
7509db544c Merge branch 'master' of github.com:yandex/ClickHouse into ubsan-fixes-3 2018-12-26 22:38:11 +03:00
alexey-milovidov
b7f25f6ffe
Merge pull request #3932 from yandex/fix_no_message_received
Move processing pool to ternary logic
2018-12-26 22:16:01 +03:00
chertus
4b63c11cea Merge branch 'master' into ast 2018-12-26 21:56:41 +03:00
chertus
0812f79421 remove unused code 2018-12-26 21:56:21 +03:00
alesapin
9342700ce1 Move processing pool to ternary logic 2018-12-26 20:03:29 +03:00
chertus
371ec0d576 fix gcc build 2018-12-26 18:40:47 +03:00
chertus
6ea13516f0 rewrite ExpressionAnalyzer.collectUsedColumns CLICKHOUSE-3996 2018-12-26 17:43:25 +03:00
chertus
11982046d6 Merge branch 'master' into joins 2018-12-26 17:17:18 +03:00
chertus
62905013d7 rewrite ExpressionAnalyzer.collectUsedColumns CLICKHOUSE-3996 2018-12-26 17:08:57 +03:00
alesapin
8f82d5a687 Merge branch 'master' into custom_compression_codecs 2018-12-26 10:43:33 +03:00
Alexey Milovidov
5ca01486dd Fixed UB #3926 2018-12-26 07:32:58 +03:00
Alexey Milovidov
b7f085c525 Fixed UB #3926 2018-12-26 05:47:16 +03:00
Alexey Milovidov
f2d789d384 Fixed UB #3926 2018-12-26 05:06:54 +03:00
Alexey Milovidov
37bbc0ecd5 Fixed UB #3926 2018-12-26 04:08:14 +03:00
Alexey Milovidov
e8dc222b61 Fixed UB #3926 2018-12-26 03:28:13 +03:00
Alexey Milovidov
cfc1e207ab Fixed UB #3926 2018-12-26 02:27:52 +03:00
Alexey Milovidov
4c0b95ac02 Less dependencies [#CLICKHOUSE-2] 2018-12-26 02:11:36 +03:00
alesapin
1228645a79 Fix segfault and add tabs to ton of tests (desc table) 2018-12-25 14:33:54 +03:00
alesapin
4309775fc8 Add coments and fix compression for nested types 2018-12-25 13:04:38 +03:00
alesapin
22b9969f05 Merge branch 'master' into custom_compression_codecs 2018-12-24 18:53:31 +03:00
Amos Bird
8736a3908f left pad 2018-12-24 23:51:06 +08:00
KochetovNicolai
1070702168
Update CatBoostModel.cpp
Do not evaluate CatBoost model on empty dataset.
2018-12-24 15:35:46 +03:00
alesapin
1e771a4aec Fix error codes 2018-12-24 14:34:50 +03:00
qianlixiang
416d6aa788 Fixed core dump caused by kill query sync 2018-12-24 16:17:22 +08:00
alexey-milovidov
a03c28d0e6
Merge pull request #3909 from yandex/fix-use-after-free-in-array-enumerate
Fix use after free in arrayEnumerateUniq and -Dense function.
2018-12-23 06:11:43 +03:00
Alexey Zatelepin
37065b6b8f prevent race condition when locking a distributed ALTER task for execution [#CLICKHOUSE-4221] 2018-12-21 20:28:21 +03:00
Alexey Milovidov
a8f09809f5 Simplified logic with "IColumn::convertToFullColumnIfConst" (suggested by Amos Bird) [#CLICKHOUSE-2] 2018-12-21 19:00:07 +03:00
alesapin
6f7333840a Move header with compression info to another place 2018-12-21 16:25:39 +03:00
alesapin
7c11455bd3 Remove compression settings 2018-12-21 15:17:30 +03:00
alesapin
5b23210062 Merge branch 'master' into custom_compression_codecs 2018-12-21 11:57:21 +03:00
alexey-milovidov
b1602a5e62
Merge pull request #3887 from yandex/remove-alter-primary-key
Remove ALTER MODIFY PRIMARY KEY command
2018-12-20 22:21:08 +03:00
Alexey Zatelepin
b7afe46dfd remove ALTER MODIFY PRIMARY KEY command [#CLICKHOUSE-4214] 2018-12-20 21:57:20 +03:00
alexey-milovidov
d9e8cd46da
Merge pull request #3879 from yandex/setting-low_cardinality_allow_in_native_format
Added low_cardinality_allow_in_native_format setting.
2018-12-20 21:02:02 +03:00
Alexey Milovidov
9c65c539cd Merge branch 'master' of github.com:yandex/ClickHouse 2018-12-20 20:48:20 +03:00
Alexey Milovidov
b7b418a6f5 Renamed setting #3851 2018-12-20 20:48:11 +03:00
alexey-milovidov
4993cb53d1
Merge pull request #3886 from yandex/low-cardinality-specialized-aggregation
Added LowCardinality support for specialized aggregation.
2018-12-20 20:46:49 +03:00
alexey-milovidov
3cefb27e56
Merge pull request #3851 from abyss7/issue-3592
Refactor constant folding
2018-12-20 19:26:02 +03:00
Nikolai Kochetov
18b530544e Fix setting description. 2018-12-20 18:17:07 +03:00
Nikolai Kochetov
4e58b62b0c Added LowCardinality support for specialized aggregation. 2018-12-20 16:28:20 +03:00
alesapin
0ae14be8d2 Fix codes 2018-12-20 13:44:20 +03:00
proller
6869771ae4 Fix includes 2018-12-19 20:57:51 +03:00
alesapin
512fe3c854 Refactoring (sanitizer failure) 2018-12-19 20:20:18 +03:00
Nikolai Kochetov
78321a04a1 Added low_cardinality_allow_in_native_format setting. 2018-12-19 19:47:30 +03:00
alexey-milovidov
f05bf6c046
Merge pull request #3873 from s-mx/send_logs_level2
Fix strange behavior of send_logs_level setting.
2018-12-19 19:18:02 +03:00
Ivan
37345468b3
Explicitly include <optional> for clang-6.0 2018-12-19 16:57:55 +03:00
Sabyanin Maxim
ea27ec463e add SettingLogsLevel 2018-12-19 16:20:41 +03:00
chertus
7e6a39f623 Merge branch 'master' into joins 2018-12-19 16:14:17 +03:00
chertus
cbf3c34cf3 minor improvement in ExpressionAnalyzer + array join 2018-12-19 16:13:51 +03:00
Ivan Lezhankin
b9440fe99d Another minor refactoring. 2018-12-19 15:38:13 +03:00
Alexey Milovidov
8889f0859a Fixed typo [#CLICKHOUSE-2] 2018-12-19 06:43:37 +03:00
alexey-milovidov
92bb4471df
Merge pull request #3865 from abyss7/issue-3590
ISSUE-3590: Forbid using aggregate functions inside scalar subqueries
2018-12-19 03:19:45 +03:00
alexey-milovidov
c47dfb064e
Update ExecuteScalarSubqueriesVisitor.cpp 2018-12-19 03:19:31 +03:00
Ivan Lezhankin
617082f444 ISSUE-3590: Forbid using aggregate functions inside scalar subqueries 2018-12-18 21:43:06 +03:00
chertus
f992f0a9a0 better check when rewrites needed 2018-12-18 21:28:02 +03:00
chertus
ba91920b19 Merge branch 'master' into joins 2018-12-18 16:26:28 +03:00
chertus
8720d3b937 remove stale code 2018-12-18 16:26:04 +03:00
alesapin
6fe01af829 Merge branch 'master' into custom_compression_codecs 2018-12-18 14:06:11 +03:00
chertus
9ef314aaaf SemanticSelectQuery CLICKHOUSE-3996 2018-12-17 22:30:08 +03:00
Ivan Lezhankin
1a539b3a6d Merge remote-tracking branch 'upstream/master' into issue-3592 2018-12-17 19:30:20 +03:00
chertus
b38f805097 JoinToSubqueryTransformVisitor CLICKHOUSE-3996 2018-12-17 19:22:28 +03:00
Ivan Lezhankin
6df757c6f7 Refactor constant folding and make it reusable for primary_key_expr 2018-12-17 17:59:01 +03:00
alesapin
36a6121f75 Merge branch 'master' into custom_compression_codecs 2018-12-17 12:56:21 +03:00
Samuel Chou
fcde47b45e Ensure ROLLUP and CUBE respect HAVING (no change to TOTALS) 2018-12-14 22:27:40 -08:00
alexey-milovidov
7380abf502
Merge pull request #3021 from yandex/ubsan-fixes-3
UBSan fixes, part 2
2018-12-14 22:29:47 +03:00
alexey-milovidov
3a2c85a06c
Merge pull request #3717 from amosbird/arrayjoin
Support unaligned array join.
2018-12-14 21:12:24 +03:00
alexey-milovidov
120e6b54eb
Update Settings.h 2018-12-14 21:12:01 +03:00
alexey-milovidov
6d27777b19
Merge branch 'master' into ubsan-fixes-3 2018-12-14 20:52:54 +03:00
Alexey Milovidov
9e6d835137 Preparations #2609 2018-12-14 19:17:09 +03:00
Alexey Milovidov
41ed104894 Preparations #2609 2018-12-14 19:12:12 +03:00
Alexey Milovidov
e9a3c93ef0 Merged with master #2609 2018-12-14 18:39:48 +03:00
alexey-milovidov
7cc867de0a
Merge branch 'master' into background-processing-pool-backoff 2018-12-14 17:41:55 +03:00
alesapin
3370a0a4fe Fix order of calls 2018-12-14 14:29:12 +03:00
zhang2014
6d0c4eaf89 ISSUES-838 add lz4、none、zstd codec 2018-12-13 12:10:34 +08:00
Amos Bird
86f462acff Support unaligned array join
For left ARRAY JOIN, expand to the greatest size. If all sizes are zero,
resize to one which is the same as the old behavior, i.e. emptyArrayToSingle

For non-left ARRAY JOIN, expand to the greatest size but keep empty if all sizes are zero.
2018-12-12 22:08:28 +08:00
alexey-milovidov
7af621f6f7
Merge pull request #3728 from amosbird/join
Versatile StorageJoin
2018-12-10 23:16:53 +03:00
alexey-milovidov
3877aad6ef
Merge pull request #3773 from 4ertus2/joins
InDepthNodeVisitor for AST traversal
2018-12-10 22:44:22 +03:00
alexey-milovidov
fb15713979
Merge pull request #3794 from amosbird/aba
Guard `force_restore_data_flag_file` removal
2018-12-10 21:56:45 +03:00
alexey-milovidov
58c9746a91
Update loadMetadata.cpp 2018-12-10 21:56:37 +03:00
alexey-milovidov
a083e6bc64
Merge pull request #3799 from yandex/low-cardinality-join
Low cardinality join
2018-12-10 21:46:42 +03:00
chertus
3dd36cee14 Merge branch 'master' into joins 2018-12-10 19:20:45 +03:00
chertus
9f9bf0cb1b ArrayJoinedColumnsVisitor via InDepthNodeVisitor 2018-12-10 16:49:36 +03:00
chertus
49d80bf8f5 ExecuteScalarSubqueriesVisitor (move code from h to cpp) 2018-12-10 16:19:09 +03:00
chertus
9236e94e1b ExecuteScalarSubqueriesVisitor via InDepthNodeVisitor 2018-12-10 16:02:45 +03:00
chertus
66d73025d7 fix RequiredSourceColumnsMatcher lambda 2018-12-10 13:55:27 +03:00
Nikolai Kochetov
e4fd13f237 Remove LowCardinaity for joined keys. 2018-12-10 13:23:45 +03:00
Nikolai Kochetov
61cd6fe2d3 Remove LowCardinaity for joined keys. 2018-12-10 13:21:32 +03:00
Amos Bird
6bc30f225e Guard force_restore_data_flag_file removal
resemble `force_drop_table` file
2018-12-09 23:11:46 +08:00
alexey-milovidov
0fdb3b9628
Merge branch 'master' into issue-3578 2018-12-07 23:53:34 +03:00
alexey-milovidov
0b4f0ca7d5
Merge pull request #3744 from yandex/low-cardinality-nullable-group-by
LowCardinality optimization for single nullable column.
2018-12-07 23:32:27 +03:00
alexey-milovidov
92ab759ef6
Update Aggregator.h 2018-12-07 23:31:59 +03:00
proller
799edcef78 CLICKHOUSE-4189 Fix segfault (#3788)
* CLICKHOUSE-4189 Fix segfault

* Update ExpressionActions.cpp

* Update ExpressionActions.cpp
2018-12-07 23:05:02 +03:00
chertus
2afe664d67 RequiredSourceColumnsVisitor via InDepthNodeVisitor 2018-12-07 19:28:20 +03:00
chertus
31c629bf55 GlobalSubqueriesMatcher via InDepthNodeVisitor 2018-12-07 18:36:54 +03:00
chertus
abffefc830 ExternalTablesVisitor via InDepthNodeVisitor 2018-12-07 18:14:50 +03:00
chertus
e26c3327cf fix lost AST chenges in InDepthNodeVisitor 2018-12-07 17:24:47 +03:00
chertus
75af882cf3 fix AST debug print with underline symbol 2018-12-07 15:34:40 +03:00
alexey-milovidov
d6915bf61d
Merge pull request #3762 from yandex/fix-something-with-columns-alias-and-prewhere
Fix source columns list for prewhere alias actions.
2018-12-07 07:09:14 +03:00
chertus
6fad51d642 QueryAliasesMatcher via InDepthNodeVisitor (bottom to top) CLICKHOUSE-3996 2018-12-06 22:02:42 +03:00
Alexey Zatelepin
d70533d538 AddDefaultDatabaseVisitor now supports IN and descends into all parts of SELECT query #3597 2018-12-06 21:54:59 +03:00
Alexey Zatelepin
4cc4027821 add default database to table identifiers in alter commands #3597 2018-12-06 21:54:52 +03:00
chertus
ff8fb077a4 InDepthNodeVisitor: extract AST traverse from visitor logic CLICKHOUSE-3996 2018-12-06 18:29:55 +03:00
Nikolai Kochetov
2fc0643bc9 Do not use table column aliases in prewhere alias action source columns 2018-12-05 19:36:26 +03:00
Ivan Lezhankin
887e1089f1 Merge branch 'master' into kanterov_skip_unused_shards 2018-12-05 18:17:04 +03:00
chertus
3db00b7b98 Merge branch 'master' into issue-3578 2018-12-05 14:43:14 +03:00
chertus
a71d03737c send defaults via serialized ColumnsDescription CLICKHOUSE-3578 2018-12-04 23:03:04 +03:00
chertus
933c055104 CLICKHOUSE-3578 review proress 2018-12-04 17:09:47 +03:00
Nikolai Kochetov
b87d81512f Fix merging aggregate data for NULL key. 2018-12-04 13:31:15 +03:00
Nikolai Kochetov
730796dc38 Fix merging aggregate data for NULL key. 2018-12-04 13:29:27 +03:00
Nikolai Kochetov
de524a0158 Fix merging aggregate data for NULL key. 2018-12-04 13:27:44 +03:00
Nikolai Kochetov
98499b1140 LowCardinality optimization for single nullable column. 2018-12-03 21:00:20 +03:00
zhang2014
994d1c0fe0 fix excessive copy 2018-12-03 13:26:27 +08:00
alexey-milovidov
cec49357da
Merge pull request #3581 from yandex/alter-order-by
ALTER MODIFY ORDER BY
2018-12-03 07:15:07 +03:00
alexey-milovidov
02636b3388
Merge pull request #3729 from amosbird/dryrun
Function execution with dry runs
2018-12-02 22:45:07 +03:00
alexey-milovidov
48b30edcf5
Merge branch 'master' into alter-order-by 2018-12-02 21:06:38 +03:00
Amos Bird
3cc0829cc1 Function execution with dry runs
This commit prevents stateful functions like rowNumberInAllBlocks from being modified in getHeader() calls.
2018-12-02 19:02:04 +08:00
Amos Bird
65b654a1b6 Versatile StorageJoin
This commit does the following:

1. StorageJoin with simple keys now supports reading
2. StorageJoin can be created with Join settings applied. Syntax is
similar to MergeTree and Kafka
3. Left Any StorageJoin with one simple key can be used as a
dictionary-like structure by function joinGet.

Examples are listed in the related test file.
2018-12-02 16:49:39 +08:00
Alexey Milovidov
b7d9910bd3 Merge branch 'master' into dont-allocate-too-much-memory-to-parse-query 2018-12-01 04:54:01 +03:00
alexey-milovidov
bf7b68cf95
Merge pull request #3689 from abyss7/CLICKHOUSE-3936
CLICKHOUSE-3936
2018-12-01 01:50:04 +03:00
Alexey Milovidov
35f6fb5ae6 Avoid memory over-allocation when large value of "max_query_size" is specified [#CLICKHOUSE-4169] 2018-11-30 18:36:41 +03:00
Amos Bird
d092d35fa9 NonJoinedStream[ALL] bypasses max_block_size 2018-11-30 22:59:17 +08:00
Alexey Milovidov
97280bb361 Whitespace [#CLICKHOUSE-2] 2018-11-28 21:28:30 +03:00
Ivan
448846fc0d
Merge branch 'master' into CLICKHOUSE-3936 2018-11-28 18:59:57 +03:00
Ivan Lezhankin
8b5a05947c Remove redundant information from RWLock.
And fix broken exception in some race conditions
2018-11-28 18:50:52 +03:00
Alexey Milovidov
52fea90a86 Removed useless code [#CLICKHOUSE-2] 2018-11-28 17:33:40 +03:00
Alexey Zatelepin
1b27fb046d Merge branch 'master' into alter-order-by
Conflicts:
	dbms/programs/server/Server.cpp
2018-11-28 16:47:07 +03:00
proller
dd2371e071 CLICKHOUSE-4137 DictionaryFactory, DictionarySourceFactory (#3653)
* Split ComplexKeyCacheDictionary to faster compile (part2)

* Dictionaries as lib WIP

* wip

* clean

* Fix build with old capnp

* fix

* wip

* fixes

* fix

* clean

* clean

* clean

* wip

* wip

* wip

* flat

* wip

* cache

* clean

* wip

* faster

* fix style

* fixes

* clean

* clean

* Split CacheDictionary.cpp for faster compile

* fix

* fix

* Less memory usage while compiling

* missing file

* format

* Update registerDictionaries.h

* clean
2018-11-28 14:37:12 +03:00
Alexey Milovidov
cdb272848c Fixed typo in comment [#CLICKHOUSE-2] 2018-11-27 21:44:19 +03:00
alexey-milovidov
a12927a439
Merge pull request #3603 from vitlibar/CLICKHOUSE-4127
CLICKHOUSE-4127: Fix ALTER of destination table for the BUFFER engine.
2018-11-27 21:38:40 +03:00
proller
f1791e94e2
Do not write preprocessed configs to /etc/ (#2443) 2018-11-27 19:11:46 +03:00
Vitaly Baranov
44ca56c731 CLICKHOUSE-4127: Convert destination table's data when reading from
StorageBuffer.
2018-11-27 03:43:58 +03:00
Ivan Lezhankin
73aa7f2027 Rename method partition() → alterPartition()
Also fix build with internal shared libraries.
2018-11-26 17:43:40 +03:00
Alexey Zatelepin
d3d9242462 Merge branch 'master' into alter-order-by
Conflicts:
	dbms/src/Parsers/ASTAlterQuery.h
	dbms/src/Parsers/ParserAlterQuery.cpp
	dbms/src/Storages/AlterCommands.cpp
	dbms/src/Storages/AlterCommands.h
2018-11-26 16:01:48 +03:00
Alexey Milovidov
5a0feee45e Removed "conditional computations" feature, because it is not ready #2272 2018-11-26 04:39:04 +03:00
Alexey Milovidov
c77930fe30 Whitespaces [#CLICKHOUSE-2] 2018-11-26 03:56:50 +03:00
Alexey Milovidov
141e9799e4 Fixed error with "extractURLParameter" function (read after buffer); improved performance; added support for zero bytes in URLs; renamed Chars_t type [#CLICKHOUSE-2] 2018-11-25 03:08:50 +03:00
Alexey Milovidov
7d6fffff48 More style checks [#CLICKHOUSE-3] 2018-11-24 04:48:06 +03:00
Alexey Milovidov
dbbacf4f87 Added more style checks [#CLICKHOUSE-3] 2018-11-23 21:52:00 +03:00
alexey-milovidov
0822f500f8
Merge pull request #3642 from yandex/odbc_bridge_die_with_server
ODBC bridge die with server
2018-11-23 16:44:53 +03:00
alexey-milovidov
c6bc4279ee
Merge pull request #3377 from s-mx/CLICKHOUSE-4032
Added support for column COMMENTs in table definition.
2018-11-23 16:43:58 +03:00
alexey-milovidov
2c2d75cceb
Don't allow exceptions without code (#3645)
* Don't allow exceptions without code #3633

* Don't allow exceptions without code #3633
2018-11-23 00:19:58 +03:00
alesapin
1e879850bb Kill odbc-bridge with clickhouse-server 2018-11-22 18:59:00 +03:00
Sabyanin Maxim
3a67b505c5 Merge branch 'master' of https://github.com/yandex/ClickHouse into CLICKHOUSE-4032 2018-11-22 16:54:10 +03:00
Sabyanin Maxim
060fce3899 make ReplicatedMergeTree work with comments. ignore empty comments when make column_comments hashmap 2018-11-22 16:51:43 +03:00
Alexey Milovidov
6f48ebbb06 Better exception message in case of "unknown identifier" [#CLICKHOUSE-4142] 2018-11-21 23:35:55 +03:00
proller
1d40c2c871 Better link and deps (#3631)
* try fix 1

* Better deps

* fix

* fix

* fix

* Update CMakeLists.txt

* Update CMakeLists.txt

* fix

* fix

* fix

* disable old

* Update find_odbc.cmake
2018-11-21 22:20:27 +03:00
alexey-milovidov
5038f13b08
Merge pull request #3514 from abyss7/CLICKHOUSE-3766
Implement 'ALTER … FREEZE' command
2018-11-21 07:17:21 +03:00