Commit Graph

14413 Commits

Author SHA1 Message Date
Amos Bird
6815b25d18 replace std::tuple with std::variant 2018-11-12 03:29:52 +08:00
Amos Bird
f76bfb00a3 Avoid materialization for dictGetTOrDefault 2018-11-12 00:35:13 +08:00
Sabyanin Maxim
94594d8c06 add order_key section in system.tables 2018-11-11 18:44:21 +03:00
proller
5678d1ed98 Build fixes (#3545)
* StorageSystemContributors clean

* Fix

* ARM fixes

* Fix arm compile

* fix

* Fix macos?

* Fix includes

* fix

* fix

* Try fix apple build part 1

* Fix identation

* Fix static libc++ in clang

* fix arm build

* better

* fix

* fix

*  better check-include
2018-11-10 23:09:07 +03:00
alexey-milovidov
93a3f1663e
Merge pull request #3552 from amosbird/patch-14
Prioritize rvalue creator for ColumnTuple
2018-11-10 22:57:55 +03:00
Alexey Milovidov
60d42eb4f7 Merge branch 'master' of github.com:yandex/ClickHouse 2018-11-10 20:52:32 +03:00
Alexey Milovidov
8f50c62033 Avoid busy loop in DDLWorker when ZooKeeper is not available [#CLICKHOUSE-4126] 2018-11-10 20:52:25 +03:00
Nikolai Kochetov
28be6d6443 Review fixes. 2018-11-09 20:23:48 +03:00
Nikolai Kochetov
21c3b36d23 Updated test with mutations. 2018-11-09 19:35:05 +03:00
Sabyanin Maxim
9befbd94e4 is_in_order_key, is_in_partition_key, is_in_sample_key in system.columns works, is_in_primary_key not yet 2018-11-09 18:39:21 +03:00
Nikolai Kochetov
1e9aeba603 Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-09 18:01:18 +03:00
Sabyanin Maxim
ac6aaa37b5 add is_primary_key, is_order_key, is_partition_key, is_sampling_key sections in system.columns 2018-11-09 15:02:08 +03:00
Sabyanin Maxim
51c7284583 add getSecondaryExpression 2018-11-09 12:41:52 +03:00
Sabyanin Maxim
c9d8dc6171 add primary_key, partition_key, sampling_key sections in system.tables. add getPartitionExpression method in IStorage. 2018-11-08 20:45:41 +03:00
Amos Bird
076ec44089
Prioritize rvalue creator for ColumnTuple
This validates `ColumnTuple::create(Columns({std::move(s_c0), std::move(s_c1)})); `
2018-11-09 01:24:30 +08:00
Nikolai Kochetov
726ae0cb9a Split ExpressionAnalyzer and SyntaxAnalyzer. 2018-11-08 19:47:12 +03:00
KochetovNicolai
4609569538
Merge pull request #3549 from yandex/syntax-analyzer
Syntax analyzer
2018-11-08 17:15:37 +03:00
Nikolai Kochetov
baef5abc12 Review fixes. 2018-11-08 15:06:35 +03:00
Nikolai Kochetov
29fe5ea5b6 Review fixes. 2018-11-08 14:17:31 +03:00
Nikolai Kochetov
90120493bf Syntax analyzer (in progress). 2018-11-08 12:06:11 +03:00
Nikolai Kochetov
a5a36d0078 Syntax analyzer (in progress). 2018-11-08 12:01:41 +03:00
Nikolai Kochetov
6ebfd2c42f Syntax analyzer (in progress). 2018-11-08 12:01:12 +03:00
proller
9a98b80cf8 Try fix apple build part 2 2018-11-07 16:24:36 +03:00
proller
a996326efe Fix identation 2018-11-07 15:55:56 +03:00
Nikolai Kochetov
7f8deccd7e Merged with master. 2018-11-07 15:52:16 +03:00
proller
bb1dafd2b3 Try fix apple build part 1 2018-11-07 15:50:36 +03:00
Nikolai Kochetov
748b0f7077 SyntaxAnalyzer (in progress). 2018-11-07 15:44:05 +03:00
chertus
9819c10628 fix build with libcxx 2018-11-07 14:46:39 +03:00
proller
6ec9ca3b07
Better tests (#3535) 2018-11-07 14:00:46 +03:00
Nikolai Kochetov
e44213b026 Added tests. [#CLICKHOUSE-4111] 2018-11-07 13:53:36 +03:00
Nikolai Kochetov
7a5cfc7a6d Skip columns from prewhere_info->remove_columns_actions in prewhere result for alias source columns. [#CLICKHOUSE-4111] 2018-11-07 13:53:36 +03:00
alexey-milovidov
86a4c95048
Merge pull request #3544 from yandex/fix_aio_unknown_compression_method
Fix AIO unknown compression method when merge tree has mark to the last byte of file
2018-11-07 00:34:45 +03:00
Artem Zuikov
e9dc302cdc
Merge pull request #3465 from 4ertus2/bugs
hotfix for distributed DDLs over secure port [CLICKHOUSE-4089]
2018-11-06 21:39:10 +03:00
Nikolai Kochetov
bcd6e03257 SyntaxAnalyzer (in progress). 2018-11-06 21:13:35 +03:00
alesapin
bdb473b425 Fix AIO unknown compression method when merge tree has mark to last byte of file 2018-11-06 20:29:31 +03:00
chertus
172acbabd0 fix tests (second attempt) [CLICKHOUSE-4089] 2018-11-06 19:38:01 +03:00
Artem Zuikov
469ce719dc
Merge pull request #3521 from 4ertus2/joins
Set default database name for tables in view's (sub)selects [CLICKHOUSE-3145]
2018-11-06 19:15:07 +03:00
chertus
458e20c31f fix tests/integration over ssl by alesapin@ 2018-11-06 17:42:30 +03:00
alesapin
70df5a1cb7
Merge pull request #3534 from yandex/block_structure_mistmatch
[WIP] Trying to fix block structure mismatch
2018-11-06 16:40:05 +03:00
chertus
756342551a add general comment for visitors 2018-11-06 16:28:22 +03:00
Nikolai Kochetov
8df77930ec Added InterpreterSelectQuery::unifyStreams 2018-11-06 14:44:45 +03:00
Nikolai Kochetov
d7992b11d8 Fix block structure mismatch in MergingSorted stream. 2018-11-06 13:11:37 +03:00
Alexey Milovidov
c5173782dc Potentially better #3490 2018-11-05 17:29:38 +03:00
Alexey Milovidov
a191c32254 Potential improvement #3490 2018-11-05 13:34:48 +03:00
Alexey Milovidov
6f00f165e5 Clarifications; potential improvement #3490 2018-11-05 12:32:59 +03:00
alexey-milovidov
c25e093b82
Merge pull request #3512 from lapkofear/amd_perf_problem
fixed group by int16 and Date types on AMD EPYC 7401P machine
2018-11-04 11:53:38 +03:00
alesapin
5367b1b8d0 Better answer 2018-11-02 19:10:08 +03:00
alesapin
ef985ce7ad Test to reproduce problem 2018-11-02 18:54:36 +03:00
chertus
50d9a6e5d5 refactoring: unify QueryAliasesVisitor with other AST visitors 2018-11-02 18:09:15 +03:00
alesapin
b74dd7fb3f
Merge pull request #3530 from yandex/project-clone-performance
Project clone performance
2018-11-02 17:29:21 +03:00
chertus
5a06d4953d Merge branch 'master' into joins 2018-11-02 14:58:26 +03:00
alesapin
43a88d83b7 Merge branch 'master' of github.com:yandex/ClickHouse 2018-11-02 14:54:37 +03:00
alesapin
28806049b4 Return client error code to 53 2018-11-02 14:54:24 +03:00
chertus
ce678f0e9c fix join_default_strictness according to new default settings 2018-11-02 14:46:16 +03:00
chertus
2f5fb25de6 Merge branch 'master' into joins 2018-11-02 13:39:19 +03:00
Alexey Milovidov
120e2cbe2f Use "ALL" as "join_default_strictness" setting by default for compatibility [#CLICKHOUSE-4087] 2018-11-02 13:03:05 +03:00
Nikolai Kochetov
ecd48dfd07 Removed column clone from project action. 2018-11-02 12:57:29 +03:00
Nikolai Kochetov
9332dd5d2f Removed column clone from project action. 2018-11-02 12:56:37 +03:00
alexey-milovidov
c19b1d919e
Merge pull request #3517 from yandex/kill_pending_queries
CLICKHOUSE-4094: Add ability to kill pending queries
2018-11-01 21:07:45 +03:00
proller
c2a818b64d StorageSystemContributors clean (#3524)
* StorageSystemContributors clean

* Fix
2018-11-01 21:01:10 +03:00
Alexey Milovidov
9d328839d5 Merge branch 'master' of github.com:yandex/ClickHouse 2018-11-01 20:56:03 +03:00
Alexey Milovidov
30a2513fac Whitespace [#CLICKHOUSE-2] 2018-11-01 20:55:53 +03:00
alexey-milovidov
6bc7297a92
Merge pull request #3523 from yandex/low-cardinality-fix-extremes
Low cardinality fix extremes
2018-11-01 20:54:09 +03:00
Nikolai Kochetov
e7b6937152 Added tests with LowCardinality and mv. #3288
Added tests with LowCardinality and mv. #3288
2018-11-01 20:24:10 +03:00
Nikolai Kochetov
03b2b609b1 Fix ColumnLowCardinality::getExtremes. #3288 2018-11-01 20:24:05 +03:00
alexey-milovidov
b1db9ec23c
Merge pull request #3436 from amosbird/master
Flexible fields assignment
2018-11-01 20:22:28 +03:00
alexey-milovidov
4dedead38f
Update StorageSystemDataTypeFamilies.cpp 2018-11-01 20:21:43 +03:00
alexey-milovidov
1a4a99377a
Update StorageSystemFunctions.cpp 2018-11-01 20:21:15 +03:00
alexey-milovidov
e10fd083ef
Update StorageSystemFunctions.cpp 2018-11-01 20:20:41 +03:00
alexey-milovidov
ac10a55b6f
Update StorageSystemDataTypeFamilies.cpp 2018-11-01 20:20:14 +03:00
alexey-milovidov
cce68f5b40
Merge pull request #3519 from yandex/better-behaviour-of-hash-functions
Fixed idiosyncrasy with hash functions introduced in #3451
2018-11-01 20:13:39 +03:00
alexey-milovidov
e2b0c6c94f
Merge pull request #3518 from yandex/low-cardinality-fix-nullable-serialization-into-arena
Low cardinality fix nullable serialization into arena
2018-11-01 20:12:06 +03:00
chertus
009f77002e add default db name to views [CLICKHOUSE-3145] 2018-11-01 20:07:20 +03:00
proller
f86d1a7034 CONTRIB-254 Arcadia fixes (#3475)
* Macos: set ENABLE_EMBEDDED_COMPILER=0 by default (because contrib/llvm temporary broken under macos)

* \n

* arcadia fix

* fix arcadia link

* wip

* wip

* wip

* fix

* wip

* wip

* fix

* try use users from server dir

* Revert "try use users from server dir"

This reverts commit 79b2c6fd9c.

* Fix logging

* fix

* Update ZooKeeperImpl.h
2018-11-01 20:07:20 +03:00
Alexey Milovidov
77af9f7abb Fixed error code in test #3503 2018-11-01 18:55:28 +03:00
Alexey Milovidov
e7bb9d5d84 Added test #3519 2018-11-01 18:50:30 +03:00
Alexey Milovidov
719efbe60a Fixed idiosyncrasy introduced in #3451 2018-11-01 18:47:08 +03:00
alexey-milovidov
82933e9c31
Merge pull request #3451 from CurtizJ/CLICKHOUSE-3490
Support more hash functions for tuple, unify FunctionHash template. [CLICKHOUSE-3490]
2018-11-01 18:30:01 +03:00
alesapin
11092e895c Better comment 2018-11-01 18:22:59 +03:00
alesapin
c6d1677222 CLICKHOUSE-4097: Remove redundant whitespace 2018-11-01 18:09:19 +03:00
Nikolai Kochetov
f2c64dc5dc Added test with group by LowCardinality(Nullable) #3227 #3256 #3212 2018-11-01 17:57:55 +03:00
Nikolai Kochetov
dc688ef5e1 Fix nullable comparsion for LowCardinality(Nullable()). #3227 #3256 #3212 2018-11-01 17:57:50 +03:00
alesapin
b0ac729228 CLICKHOUSE-4094: Add ability to kill pending queries 2018-11-01 17:56:37 +03:00
Nikolai Kochetov
045b5d5cd8 Fixed LowCardinality(Nullable()) (de)serialization with arena. #3227 #3256 #3212 2018-11-01 17:55:37 +03:00
chertus
d6defafad2 use AddDefaultDatabaseVisitor for views [CLICKHOUSE-3145] 2018-11-01 17:49:37 +03:00
proller
71403c3ff8 StorageSystemContributors.sh debug (#3491)
* Sql fuzzy test

* wip

* wip

* wip

* wip

* wip

* Build fixes

* better

* bugs

* wip

* fix

* Fix test

* build fixes

* better

* wip

* fix test

* StorageSystemContributors.sh debug

* debug

* wip

* more

* Fix jemalloc include

* more
2018-11-01 17:07:14 +03:00
proller
a7437b93a9 Commited StorageSystemContributors.generated.cpp (#3510)
* CLICKHOUSE-4085 system.contributors

* fi

* Fix random

* Commited StorageSystemContributors.generated.cpp

* fix

* Update CMakeLists.txt
2018-11-01 17:05:37 +03:00
alexey-milovidov
121f04522e
Merge pull request #3503 from yandex/check_array_value_null
Better code for check on null values inside array IN expression
2018-11-01 17:01:06 +03:00
alexey-milovidov
7508a8d6a0
Merge pull request #3513 from amosbird/patch-13
restore query context before polling
2018-11-01 16:17:41 +03:00
alexey-milovidov
00fa7d9fad
Update Aggregator.cpp 2018-11-01 15:42:57 +03:00
Artem Zuikov
eb535c4b9b
Merge pull request #3500 from 4ertus2/joins
refactoring: one place for db and table extraction from AST
2018-11-01 14:59:56 +03:00
igor.lapko
2d565f1099 code style fix 2018-11-01 13:42:15 +02:00
chertus
1a71a443b8 resolve review remarks 2018-11-01 14:32:44 +03:00
alesapin
63c6647be4 Better comment 2018-11-01 14:23:23 +03:00
alesapin
abcc692dbf CLICKHOUSE-4096: Fix nested unaliased joins segfault 2018-11-01 14:23:23 +03:00
Amos Bird
d7fe560090
restore query context before polling 2018-11-01 17:14:01 +08:00
igor.lapko
d603cb1eb8 fixed group by int16 and Date types on AMD EPYC 7401P machine 2018-11-01 09:01:34 +02:00
Marek Vavruša
d88450db4d DictionarySourceFactory: fix mistaken connect timeout for read timeout
It looks like this was accidental, as XDBCStorage and bridges use
http_receive_timeout, but the dictionary passes http_connection_timeout,
so it times out on long queries.
2018-10-31 16:21:23 -07:00
chertus
1db565193c description for TranslateQualifiedNamesVisitor 2018-10-31 20:45:41 +03:00
chertus
1eae5c38ea remove code duplicates for creating table AST node 2018-10-31 20:31:04 +03:00
alesapin
237186056a
Merge pull request #3504 from yandex/merge_big_parts_using_direct_io
Enable merge with DIRECT_IO when summary size of participating parts more than 10GB
2018-10-31 18:11:32 +03:00
chertus
3931a4db5c Merge branch 'master' into joins 2018-10-31 18:11:23 +03:00
chertus
6bbbd8721c more tests for joins 2018-10-31 18:09:53 +03:00
chertus
d8674a264a ExpressionAnalyzer fix columns deduplication 2018-10-31 15:58:12 +03:00
alesapin
5e487608d2 Strict order in select 2018-10-31 15:49:50 +03:00
alesapin
252109f314 Add test with O_DIRECT merge 2018-10-31 14:45:53 +03:00
alesapin
791a1422de Enable merge with DIRECT_IO when summary size of participating parts more than 10GB 2018-10-31 12:24:58 +03:00
alesapin
892ab4ce8a Better code for check on null values inside array IN expression 2018-10-31 12:17:47 +03:00
chertus
4ff0391ca6 DatabaseAndTableWithAlias - the only place for db & table expraction from AST 2018-10-30 19:31:21 +03:00
abyss7
d538f70679 Fix build and tests on Fedora (#3496)
* Fix some tests and build on Fedora 28

* Update contrib/ssl

* Try `sudo` first, then without `sudo`.
2018-10-30 17:05:44 +03:00
chertus
d2518fdb3f more refactoring: funcs to extract database_and_table from AST 2018-10-29 22:04:28 +03:00
Alexey Zatelepin
31bc680ac5 ErrorCodes::SYNTAX_ERROR now causes HTTP_BAD_REQUEST 2018-10-29 21:00:36 +03:00
Alex Zatelepin
83ac918bab
Merge pull request #3477 from hotid/master
stop generating empty WHERE () section in mysql queries (#3431)
2018-10-29 18:23:14 +03:00
alesapin
b944a068d0
Merge pull request #3487 from yandex/fix_nullable_array_at_client
Add validation of array data
2018-10-29 18:09:11 +03:00
Alex Zatelepin
fc99b7d389
style fixes 2018-10-29 17:17:58 +03:00
alesapin
444b6e1e43 Add validation of array data 2018-10-29 16:18:41 +03:00
alesapin
32540583a6
Merge pull request #3481 from Enmk/range_hashed_from_mysql_source_2
Tests for MySQL and ClickHouse as sources for range_hashed dictionary
2018-10-29 13:21:54 +03:00
Artem Zuikov
ccfb51b8dd
Merge pull request #3476 from 4ertus2/joins
ExpressionAnalyzer refactoring - remove duplicated code
2018-10-29 11:36:06 +03:00
Vasily Nemkov
aa0f812b1e Tests for ClickHouse as range_hashed dictionary source 2018-10-28 08:17:05 +03:00
proller
c35c979285 CLICKHOUSE-4085 system.contributors (#3452)
* CLICKHOUSE-4085 system.contributors

* fi

* Fix random
2018-10-26 20:43:50 +03:00
hotid
f22779ad15 stop generating empty WHERE () section in mysql queries 2018-10-26 20:14:43 +03:00
Alexey Zatelepin
e4e38f71e1 allow empty header in RemoteBlockOutputStream #3411
The bug with inserts to Distributed tables was introduced in https://github.com/yandex/ClickHouse/pull/3171
It added a workaround specifically for inserting in the Native format without specifying the list of columns.
Native (as opposed to other formats) historically supports this. To signal that the input block structure
shouldn't conform to any fixed header in this case, the remote server started sending empty header block.
This commit adds support for empty headers to RemoteBlockOutputStream.
2018-10-26 18:26:07 +03:00
chertus
95c618b163 ExpressionAnalyzer: remove duplicated code 2018-10-26 18:13:02 +03:00
Alex Zatelepin
a54dff25aa
Merge pull request #3457 from yandex/fix_non_deterministic_compile
Don't unfold non deterministic expressions CLICKHOUSE-4077
2018-10-26 15:59:33 +03:00
alesapin
32f6745ae8 Config file 2018-10-26 12:23:29 +03:00
alesapin
20b20d04f9 Include from env 2018-10-26 12:22:33 +03:00
alesapin
64b1108989 Merge branch 'master' of github.com:yandex/ClickHouse into fix_non_deterministic_compile 2018-10-25 20:01:22 +03:00
alesapin
a4dd489165 Do not build compiled functions 2018-10-25 19:52:28 +03:00
alesapin
3a9311d3ad Now default block can have size more than one 2018-10-25 19:02:20 +03:00
proller
713c44c3db
Build fixes (#3466) 2018-10-25 18:23:41 +03:00
alesapin
c3159af898 Enlarge constant default column if it's empty 2018-10-25 17:54:00 +03:00
chertus
19a69004f0 fix crash with non const scale in toDecimal() 2018-10-25 16:53:25 +03:00
chertus
480bee07db hotfix for distributed DDLs over secure port [CLICKHOUSE-4089] 2018-10-25 14:35:19 +03:00
Artem Zuikov
fd6fc3d2cb
Merge pull request #3460 from 4ertus2/joins
USE database for ON CLUSTER DDLs [CLICKHOUSE-4036]
2018-10-25 14:15:23 +03:00
chertus
e8f9e3c2a2 better fix for distributed DDL [CLICKHOUSE-4036] [CLICKHOUSE-4015] 2018-10-25 12:40:30 +03:00
Vasily Nemkov
7ebc44a0c8 Fixed test case for UUID_ dictionary attribute. 2018-10-25 07:42:02 +03:00
Vasily Nemkov
8aa0c423aa Fix for the case when there is no filter. 2018-10-25 07:16:41 +03:00
proller
7dafcacd15
Build fixes (#3459) 2018-10-24 20:20:27 +03:00
chertus
6375009c81 Merge branch 'master' into joins 2018-10-24 19:43:48 +03:00
chertus
7a24e9b8ff one more minor fix 2018-10-24 18:41:28 +03:00
chertus
a844d10a9a minor fix 2018-10-24 18:39:37 +03:00
chertus
58f14b0db2 USE database for ON CLUSTER DDLs [CLICKHOUSE-4036] 2018-10-24 18:31:07 +03:00
CurtizJ
89808b89b6 update test 2018-10-24 16:27:49 +03:00
CurtizJ
06e955e92a fix combine hashes 2018-10-24 16:12:59 +03:00
alesapin
54a1f0c2a6 enable compiled expressions byt default 2018-10-24 14:36:02 +03:00
alesapin
070d75c7c9 Don't unfold non deterministic expressions 2018-10-24 14:31:23 +03:00
Amos Bird
3cf2177268 Flexible fields assignment
Field f;

before:

f = Int64(-42);

after:

f = -42;
2018-10-24 08:47:33 +08:00
alexey-milovidov
bb00bb8592
Merge pull request #3405 from yandex/CLICKHOUSE-2211
CLICKHOUSE-2211: Fix aio reading (with correct buffer size), reduce M…
2018-10-24 01:37:05 +03:00
Alexey Milovidov
07f0fd3da9 Merge branch 'master' of github.com:yandex/ClickHouse 2018-10-23 23:23:51 +03:00
Alexey Milovidov
1dc2acf3e4 Fixed test #3385 2018-10-23 23:23:39 +03:00