Commit Graph

3050 Commits

Author SHA1 Message Date
VadimPE
6142d9ae6a CLICKHOUSE-3714 fix function names and get partition size 2018-08-03 11:33:57 +03:00
VadimPE
08fe108ba8 CLICKHOUSE-3714 fix methods name 2018-08-02 11:48:57 +03:00
alexey-milovidov
9cd5228df2
Using jemalloc instead of tcmalloc. (#2773)
* Added jemalloc as submodule [#CLICKHOUSE-2]

* Imported jemalloc-cmake [#CLICKHOUSE-2]

* Added README for jemalloc-cmake [#CLICKHOUSE-2]

* Trying to add jemalloc [#CLICKHOUSE-2]

* Trying to add jemalloc [#CLICKHOUSE-2]

* Trying to add jemalloc [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]

* Add support for jemalloc: development [#CLICKHOUSE-2]
2018-08-02 03:20:20 +03:00
chertus
267f28f98d decimal arithm (basic support) 2018-08-01 22:50:19 +03:00
Vadim
f6736a0e6e
Update Context.cpp 2018-08-01 20:44:23 +03:00
Vadim
034a88a504
Merge branch 'master' into CLICKHOUSE-3714 2018-08-01 20:42:56 +03:00
VadimPE
66d9ba3eb7 CLICKHOUSE-3714 add max_partition_size_to_drop 2018-08-01 20:41:18 +03:00
zhang2014
d61c53fc3e ISSUES-863 support predicate push down with subquery 2018-08-01 17:56:02 +08:00
proller
d72ba2701b CLICKHOUSE-3771 Preparing for new version scheme [WIP] (#2646)
* CLICKHOUSE-3771: compatible version transfer

* Fix

* Fixed compatibility

* fix

* Auto version update to [1.1.54401] [54398]

* fix auto revision up

* fix

* comments

* clean

* fix

* Send/recieve patch if we can

* fix

* Auto version update to [18.2.0] [54397]

* Client version in query_log

* Update TCPHandler.cpp

* Update Connection.cpp

* Update Defines.h
2018-08-01 00:36:18 +03:00
alexey-milovidov
405d7f9232
Merge pull request #2742 from yandex/support-join-on-syntax
Support join on syntax
2018-08-01 00:30:46 +03:00
alesapin
2db2d208e1 CLICKHOUSE-3863: Add HTTPS support for interserver replication 2018-08-01 00:29:47 +03:00
Nikolai Kochetov
9359ae7650 Fix test. 2018-07-31 20:34:17 +03:00
alexey-milovidov
f6b9c46d24
Update ExpressionAnalyzer.cpp 2018-07-31 06:04:35 +03:00
Nikolai Kochetov
368e7d0b08 Added joined_block_actions to SubqueryForSet for join subquery. [#CLICKHOUSE-3761]
3Added joined_block_actions to join expression action.
2018-07-30 22:41:27 +03:00
Nikolai Kochetov
bc054f2247 Fix tests. [#CLICKHOUSE-3761] 2018-07-30 22:40:43 +03:00
chertus
4a1b7cfebf Merge branch 'master' into decimal 2018-07-30 21:51:08 +03:00
chertus
582f76c83b string to decimal, decimal to string, check decimal bounds 2018-07-30 21:10:38 +03:00
Alexey Milovidov
8bc95412b6 Fixed bad code #2708 2018-07-28 00:33:30 +03:00
Alexey Milovidov
bbdd780be0 Fixed error when IN is used as an aggregation key [#CLICKHOUSE-3855] 2018-07-27 21:14:58 +03:00
chertus
b9fd87eff7 Merge branch 'master' into decimal 2018-07-27 20:31:33 +03:00
Nikolai Kochetov
7d9ebae2c2 Better comments. 2018-07-27 20:11:56 +03:00
Nikolai Kochetov
b5d6240646 Merged with master 2018-07-27 19:21:43 +03:00
Nikolai Kochetov
5123e0f86f Remove joined table qualifiers from column names. [#CLICKHOUSE-3761] 2018-07-27 19:03:16 +03:00
Nikolai Kochetov
65dcca22a2 Substitute aliases for required columns in ExpressionAnalyzer. [#CLICKHOUSE-3761] 2018-07-27 19:02:56 +03:00
Nikolai Kochetov
11d66d8733 Support expressions for right JOIN keys. [#CLICKHOUSE-3761] 2018-07-27 19:02:42 +03:00
Nikolai Kochetov
98e5821769 Resolve qualified names for JOIN ON expression. [#CLICKHOUSE-3761] 2018-07-27 19:02:23 +03:00
Nikolai Kochetov
cc613d7ad3 Added JOIN keys to the list of needed columns for JOIN expression action. 2018-07-27 19:02:20 +03:00
Nikolai Kochetov
391ff31829 Added actions for JOIN key columns. [#CLICKHOUSE-3761] 2018-07-27 19:02:10 +03:00
Nikolai Kochetov
5058d1a345 Added columns from join on key of right table if they have different name from left block key in merged block. [#CLICKHOUSE-3761] 2018-07-27 19:01:48 +03:00
Nikolai Kochetov
92719e1f48 Supported JOIN ON syntax for single and chain in expression analyzer. [#CLICKHOUSE-3761] 2018-07-27 19:01:25 +03:00
alexey-milovidov
9242588449
Merge pull request #2708 from VadimPE/CLICKHOUSE-3837
CLICKHOUSE-3837 Add support for table function in remote() and cluster()
2018-07-26 21:36:04 +03:00
alexey-milovidov
24b0be2cf0
Merge pull request #2727 from alesapin/CLICKHOUSE-3832
CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol
2018-07-26 20:50:09 +03:00
alesapin
6abbfbce87 CLICKHOUSE-3832: Add HTTP Basic authentification in replication protocol 2018-07-26 18:10:57 +03:00
chertus
c1c149d74b decimal comparisons 2018-07-25 22:38:21 +03:00
VadimPE
867a3ebfae CLICKHOUSE-3837 fix mistakes 2018-07-25 15:31:47 +03:00
zhang2014
7e87fa8e18 ISSUES-2688 support on cluster for kill & optimize query 2018-07-24 22:07:13 +03:00
alexey-milovidov
fb807c10e9
Update evaluateConstantExpression.cpp 2018-07-24 19:32:33 +03:00
VadimPE
46dec0d341 [CLICKHOUSE-3837] fix error in build 2018-07-24 17:05:37 +03:00
Vadim
437f3f20a9
Merge branch 'master' into CLICKHOUSE-3837 2018-07-24 16:21:51 +03:00
VadimPE
8dfb6806d8 add support for table function in remote() and cluster() 2018-07-24 16:10:34 +03:00
chertus
02f016579c decimal (de)serialization (in progress) 2018-07-23 23:19:26 +03:00
Nikolai Kochetov
fd4d992294 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 19:01:25 +03:00
Nikolai Kochetov
dd4ac9f3f1 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:57:52 +03:00
Nikolai Kochetov
0f4c8e2f0a Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:56:43 +03:00
Nikolai Kochetov
bbd13a25e4 Supported JOIN ON syntax for single and chain in expression analyzer. 2018-07-23 18:54:10 +03:00
Alexey Zatelepin
55301ce1f0 create input streams for parts using InterpreterSelectQuery [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Zatelepin
f75fb6cd68 refactor InterpreterSelectQuery constructors [#CLICKHOUSE-3798] 2018-07-20 22:44:34 +03:00
Alexey Milovidov
a4d699e7f5 Comment [#CLICKHOUSE-2] 2018-07-20 18:50:39 +03:00
Nikolai Kochetov
7f8688b67b Support data type with dictionary for krimary key. 2018-07-20 18:41:01 +03:00
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090 Make DatsTypeWithDictionary independent from index type. 2018-07-20 13:16:27 +03:00
Alexey Milovidov
31dbbb05d2 Removed useless setting #2677 2018-07-19 23:22:49 +03:00
Alexey Milovidov
1b39ddf10b Whitespaces [#CLICKHOUSE-2] 2018-07-19 19:39:48 +03:00
alexey-milovidov
164425d1ec
Fix performance regression with prepared sets when they are used inside another subquery. (#2677)
* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]

* Attempt to fix performance regression [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Removed debug output [#CLICKHOUSE-3796]

* Updated documentation about ClickHouse testing [#CLICKHOUSE-2]

* Revert "Updated documentation about ClickHouse testing [#CLICKHOUSE-2]"

This reverts commit 9eafc13f3b.

* Revert "Added documentation about ClickHouse testing (draft) [#CLICKHOUSE-2]"

This reverts commit e28ad4b5fe.

* Fixed test #2677

* Update InterpreterSelectQuery.cpp
2018-07-19 16:36:21 +03:00
proller
51cdec0bec CLICKHOUSE-3771: fixes 2018-07-18 12:48:45 +03:00
chenxing.xc
f6000b304c OR to IN rewrite issue in functions 2018-07-18 09:27:25 +03:00
chenxing.xc
5e3bc07a25 OR to IN rewrite issue in functions 2018-07-17 14:27:28 +08:00
Alexey Milovidov
77ed75e1d3 Merge branch 'master' into amosbird-master 2018-07-16 06:34:22 +03:00
VadimPE
5bb8f7ea4a [CLICKHOUSE-3269] rename isDigit() 2018-07-15 00:22:29 +03:00
VadimPE
4134711faa [CLICKHOUSE-3269] fix 2018-07-15 00:22:29 +03:00
VadimPE
18681db7fa [CLICKHOUSE-3269] fix bug with netmaskToIPv6() 2018-07-15 00:22:29 +03:00
alexey-milovidov
b384b7afc4 Update Users.cpp 2018-07-15 00:22:29 +03:00
VadimPE
c45a5aa775 fix netmask from IPv4 to IPv6 2018-07-15 00:22:29 +03:00
VadimPE
5834c0f9d9 fix bug 2018-07-15 00:22:29 +03:00
VadimPE
180ba17e6b fix 2018-07-15 00:22:29 +03:00
VadimPE
849f02104f added support for new masks 2018-07-15 00:22:29 +03:00
Amos Bird
f5764910c4 Fix TRUNCATE command for temporary tables. 2018-07-10 22:25:08 +08:00
Alexey Milovidov
576885c6b8 Little better [#CLICKHOUSE-2] 2018-07-06 21:35:37 +03:00
Alexey Milovidov
5d52be3c7e Merge branch 'master' of github.com:yandex/ClickHouse 2018-07-06 03:27:58 +03:00
Alexey Milovidov
21508df7c2 Fixed extremely bad code #2313 2018-07-06 03:27:47 +03:00
Amos Bird
78beacb3a5 Make OPTIMIZE be able to merge all parts with FINAL. 2018-07-05 21:32:54 +03:00
Alexey Milovidov
84fd35da41 Adaptations #2574 2018-07-05 00:00:50 +03:00
Alexey Milovidov
7bdafa6105 Merge branch 'master' of https://github.com/amosbird/ClickHouse into amosbird-master 2018-07-04 23:54:54 +03:00
Alexey Milovidov
e6c293ab60 Added setting "use_index_for_in_with_subqueries_max_values" #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
c99e717632 Fixed bad code #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
6afec54f7a Addition to prev. revision #2571 2018-07-04 20:28:52 +03:00
Alexey Milovidov
e86f73e465 Fixed half of bad code #2571 2018-07-04 20:28:52 +03:00
Nikolai Kochetov
6e5e57353a Review fixes. [#CLICKHOUSE-3694] #2156 2018-06-29 19:18:50 +03:00
Amos Bird
900b046943 Add options to enable parsing CSV with single/double quote. 2018-06-29 15:34:55 +08:00
Alexey Milovidov
e051998e1c Renamed setting "send_logs_level" #2482 2018-06-28 23:11:14 +03:00
Alexey Milovidov
3894f094ea Fixed setting descriptions #2482 2018-06-28 22:40:18 +03:00
alexey-milovidov
3904ba561f
Merge branch 'master' into CLICKHOUSE-2910 2018-06-28 20:47:25 +03:00
Nikolai Kochetov
bd4a899dd3 Reduced the number of IAST::getColumnName() calls in ExpressionAnalyzer. 2018-06-28 20:25:09 +03:00
Nikolai Kochetov
ebde528506 Create default macros in global context. [#CLICKHOUSE-3793] 2018-06-28 17:11:09 +03:00
Nikolai Kochetov
9f591b8d02 Merged with master. 2018-06-26 17:41:29 +03:00
Nikolai Kochetov
bd7c72de5c Spelling. 2018-06-25 16:08:35 +03:00
Nikolai Kochetov
ba4cf6faf0 Merged with master. 2018-06-25 15:08:21 +03:00
proller
e1ae5233df Add // Y_IGNORE tags 2018-06-21 18:24:36 +03:00
Vitaliy Lyudvichenko
1a4157f2a9 clickhouse_common_io does not depend on dbms. [#CLICKHOUSE-2910]
Get rid of extra linking dependencies for clickhouse_common_io. [#CLICKHOUSE-2910]
2018-06-21 15:13:56 +03:00
Vitaliy Lyudvichenko
358e4ae9bf Fixed failures in utils, more precise test. [#CLICKHOUSE-2910] 2018-06-20 18:41:15 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
e13ba09004 Rewritten ThreadStatus via adding shared thread state. [#CLICKHOUSE-2910]
Fixed race condition in SystemLog.
2018-06-19 23:30:35 +03:00
proller
fbe7df73a2
CLICKHOUSE-3762 Build fixes (#2488)
CONTRIB-254
2018-06-19 21:09:09 +03:00
Vitaliy Lyudvichenko
8dc1bebf00 Add logs forwarding from remote severs to client. [#CLICKHOUSE-2910] 2018-06-18 19:30:26 +03:00
Vitaliy Lyudvichenko
392f6e0c6c Print query_id in logs. Add own logging interface. [#CLICKHOUSE-2910] 2018-06-18 16:41:13 +03:00
alexey-milovidov
e6daa67beb
Merge pull request #1890 from yandex/lz4_experiments
Faster LZ4 decompression (experimental) + simple draft of data mutator.
2018-06-16 04:57:47 +03:00
Vitaliy Lyudvichenko
a0e9d17bfd Add query_id and host_name to server logs. [#CLICKHOUSE-2910] 2018-06-15 16:49:01 +03:00
Alexey Milovidov
c9789f985a Fallback for non x86 [#CLICKHOUSE-2] 2018-06-14 23:16:57 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Vitaliy Lyudvichenko
95b42afcb9 Add test for profile events logging. [#CLICKHOUSE-2910] 2018-06-14 14:56:12 +03:00
alexey-milovidov
08ec751a8c
Merge pull request #2504 from yandex/system-mutations-table
[WIP] system.mutations table skeleton
2018-06-13 23:00:30 +03:00
Alexey Zatelepin
c5c601f662 save serialized commands in ReplicatedMergeTreeMutationEntry; split InterpreterAlterQuery::parseAlter() [#CLICKHOUSE-3747] 2018-06-13 17:14:08 +03:00
Alexey Zatelepin
14947b494f make ASTAlterQuery::Parameters a real AST element ASTAlterCommand [#CLICKHOUSE-3747] 2018-06-13 17:13:28 +03:00
Alexey Milovidov
2a30db6b44 Whitespace [#CLICKHOUSE-2] 2018-06-12 06:26:24 +03:00
alexey-milovidov
fafecb3c25
Better modularity of formats. (#2492)
* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development): removed very old tests #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447

* Formats: better modularity (development) #2447
2018-06-10 22:22:49 +03:00
Alexey Milovidov
d864f39ec7 Merge branch 'master' into zhang2014-feature/support_truncate 2018-06-09 19:10:06 +03:00
Alexey Milovidov
f3d8b4e3cf Merging: Fixed most of problems #2260 2018-06-09 19:03:07 +03:00
Alexey Milovidov
d56c199f07 Merging: Fixed half of problems #2260 2018-06-09 18:48:22 +03:00
Vitaliy Lyudvichenko
c04dfb40a6 Fixed memory tracking. [#CLICKHOUSE-2910] 2018-06-09 18:29:08 +03:00
Alexey Milovidov
0bc678474e Merge branch 'feature/support_truncate' of https://github.com/zhang2014/ClickHouse into zhang2014-feature/support_truncate 2018-06-09 17:24:50 +03:00
Vitaliy Lyudvichenko
ed7cd86f09 Fixed several bug. Trun on --server_logs_level=warning in tests. [#CLICKHOUSE-2910]
Fixed several test to be compatible with --server_logs_level=warning.
2018-06-08 22:50:15 +03:00
Alexey Milovidov
045d5975b3 Fixed discrepancy between Query, SelectQuery, InsertQuery profile events [#CLICKHOUSE-3769] 2018-06-08 22:32:35 +03:00
Alexey Milovidov
101276e541 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:15:33 +03:00
Alexey Milovidov
9940b4f8ff Passing settings to ser/de of data types: development #1710 2018-06-08 05:26:44 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Vitaliy Lyudvichenko
99b68d3cf3 Add more options for loggig. [#CLICKHOUSE-2910] 2018-06-07 21:46:53 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
proller
cb65528147 Build fixes (#2481)
* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Build fix

* Fix test

* test fixes

* test: netcat-openbsd

* Compile fixes

* Update AggregateFunctionStatisticsSimple.h

* Update FunctionsRound.h
2018-06-07 17:42:38 +03:00
proller
347579ce46 Cmake: mark system includes as SYSTEM (#1449)
* contrib: cctz as submodule. update cctz.

* pbuilder: add ubuntu bionic, devel

* Cmake: mark system includes as SYSTEM

* Build fixes

* fix

* Fix package without compiler

* Better

* fix

* fix

* fix

* Build fix

* fix

* fix

* fix

* Cmake: Add SYSTEM to includes for external libs
2018-06-06 23:21:58 +03:00
proller
e475647594 Build fix 2018-06-06 23:07:41 +03:00
proller
01a31414eb
Build fixes (#2474) 2018-06-06 21:41:39 +03:00
Alexey Milovidov
583b9af56f Fixed error: user settings don't apply when using session_id parameter [#CLICKHOUSE-3763] 2018-06-06 20:35:35 +03:00
Alexey Milovidov
b9b89a5590 Less dependencies [#CLICKHOUSE-2] 2018-06-05 22:46:49 +03:00
Alexey Zatelepin
2fde0acb36 allow ALTER DELETE in distributed DDL [#CLICKHOUSE-3688] 2018-06-05 16:23:52 +03:00
proller
4d12a823da Use copy-headers from cmake. (working compiler test without package install) (#2456)
* Try use copy-headers from cmake [WIP]

* Using internal compiler without install

* 32bit Compile fix

* Fixes

* fix

* clean

* fix

* clean
2018-06-04 23:26:17 +03:00
Alexey Milovidov
ca52d96e09 Insignificant changes for PVS-Studio [#CLICKHOUSE-3] 2018-06-04 22:22:27 +03:00
Alexey Milovidov
df11490b2a Insignificant changes guided by PVS-Studio [#CLICKHOUSE-3] 2018-06-04 18:45:08 +03:00
Alexey Milovidov
278ccdff73 Non significant change: removed redundant checks [#CLICKHOUSE-3] 2018-06-04 17:17:24 +03:00
Alexey Milovidov
8cb65277e2 Non significant changes according to clang's -Weverything, part 5 [#CLICKHOUSE-2] 2018-06-04 01:11:50 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Alexey Milovidov
1c2b024c39 Non significant changes according to clang's -Weverything, part 2 [#CLICKHOUSE-2] 2018-06-03 20:43:56 +03:00
Alexey Milovidov
734cebdf09 Non significant changes according to clang's -Weverything, part 1 [#CLICKHOUSE-2] 2018-06-03 19:51:31 +03:00
Vitaliy Lyudvichenko
b46f2ad946 Simplified code via introducing states. [#CLICKHOUSE-2910] 2018-06-01 22:39:32 +03:00
Vitaliy Lyudvichenko
2b179b560b Initialize external tables after enqueue query. [#CLICKHOUSE-2910] 2018-06-01 18:32:27 +03:00
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
Vitaliy Lyudvichenko
549a6944d9 Better AsynchronousBlockInputStream in sync mode. [#CLICKHOUSE-2910] 2018-06-01 14:58:17 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-05-31 18:52:42 +03:00
alexey-milovidov
cdacf073e8
Merge pull request #2449 from proller/fix15
CLICKHOUSE-3587 Always write client error to log
2018-05-30 22:27:21 +03:00
proller
dc721ed721 Try make cache for getSampleBlock (#2313)
* Cache for getSampleBlock

* Update InterpreterSelectWithUnionQuery.cpp

* Update 00632_get_sample_block_cache.sql

* Add tests
2018-05-30 22:23:15 +03:00
proller
b1f4bf3199 CLICKHOUSE-3587 Always write client error to log 2018-05-30 19:15:35 +03:00
Vitaliy Lyudvichenko
e265e5c2ab Refactoring. [#CLICKHOUSE-2910] 2018-05-29 21:14:31 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
2018-05-28 18:37:30 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Amos Bird
9eec14e9be Let's make it fancier (function try catch block). 2018-05-25 23:38:57 +08:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
proller
87e8d8be5a
Fix internal compiler includes with new clang (#2406) 2018-05-24 15:40:02 +03:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
2018-05-21 22:42:42 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
2018-05-21 16:49:54 +03:00
Nikolai Kochetov
937cb2db29 Merged with master. 2018-05-21 14:38:50 +03:00
Nikolai Kochetov
aeaec2e6d7 Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo. 2018-05-21 14:18:11 +03:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa ISSUES-2259 fix the test after the merge master 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation
Fix prepared sets creation
2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
bd4d8a6766 Add profile events and settings logging. [#CLICKHOUSE-2910] 2018-05-17 19:01:41 +03:00
Nikolai Kochetov
9a1c286ade Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734] 2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7 validate mutation commands [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f alter delete skeleton [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Milovidov
fb91bba279 Miscellaneous [#CLICKHOUSE-2] 2018-05-16 03:34:56 +03:00
Vitaliy Lyudvichenko
abc73eb6ba Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-15 21:35:52 +03:00
Nikolai Kochetov
6715b945d9 Allow using of function which returs tuple for IN. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
aaad77a602 Fixed unnecessary creation of prepared set for function arguments other than second for in or global in. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
e6adcfaad5 Fixed element types for explicit set in IN function. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
651bac519c Fixed element types for explicit set in IN function.
Fixed element types for explicit set in IN function. [#CLICKHOUSE-3730]
2018-05-15 18:38:04 +03:00
sundy-li
2511a4784b Support data write to StorageMySQL table 2018-05-15 03:02:59 +03:00
Alexey Milovidov
3943cfb11e Addition to prev. revision [#CLICKHOUSE-2] 2018-05-14 22:14:37 +03:00
Vitaliy Lyudvichenko
de6c48f4df Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-14 19:09:00 +03:00
Alexey Milovidov
8690d596b0 Miscellaneous [#CLICKHOUSE-2] 2018-05-13 12:32:56 +03:00
Alexey Milovidov
582085bf15 Be more conservative about new feature #2277 2018-05-11 00:29:44 +03:00
Alexey Milovidov
65a08210ac Merge branch 'llvm-jit' of https://github.com/pyos/ClickHouse into pyos-llvm-jit 2018-05-10 22:09:47 +03:00
pyos
e5ebc24657 Revert the part of bd332b that moved a read after std::move. 2018-05-10 21:19:41 +03:00
pyos
1718e575a7 Bridge between incompatible LLVM APIs 2018-05-10 20:31:24 +03:00
Alexey Milovidov
4d9088d3d4 Merge branch 'llvm-jit' of https://github.com/pyos/ClickHouse into pyos-llvm-jit 2018-05-10 18:23:53 +03:00
Alexey Milovidov
d3b7bafedf Miscellaneous #2277 2018-05-10 18:22:54 +03:00
pyos
bd332b9171 Allow calling into libc from jitted code.
Mostly for intrinsics like memcpy/memset/memmove, which are inserted
during optimization by LLVM itself. (With a null resolver, a compiled
version of something like `Uint64 < 0` would segfault.)
2018-05-10 17:00:32 +03:00
pyos
4776168c3b Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-05-10 13:25:26 +03:00
Vitaliy Lyudvichenko
5704de8774 Fixed settings passing in clickhouse-local and tmp dirs. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
Alexey Milovidov
72ab282bca Removed hack #2277 2018-05-10 00:03:03 +03:00
Alexey Milovidov
3a059b82d2 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-09 23:34:20 +03:00
Vitaliy Lyudvichenko
864dc0546b Add requested changes. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8746149965 More persistent directory names for replicas. [#CLICKHOUSE-2] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2]
Add disable_internal_dns_cache main config option.
2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
pyos
32fd123010 Select an *exact* target machine, not an approximation.
Required for enabling advanced features such as AVX and AVX2.

Code mostly copied from LLVM's tools/opt/opt.cpp.
2018-05-07 19:06:13 +03:00
pyos
d4b5c01a1e Fix addModule check for LLVM < 7
It returns `Expected`, so false-y is a failure. (In >= 7 it returns
an `Error`, so truth-y is a failure. Wow, that's confusing.)
2018-05-07 16:04:07 +03:00
pyos
0e09138405 Assume output and one input of LLVMFunction is non-const 2018-05-07 16:03:26 +03:00
Alexey Milovidov
01bbf650f8 Build fixes #2277 2018-05-07 11:59:24 +03:00
Alexey Milovidov
147919928d Better error checks #2277 2018-05-07 09:49:56 +03:00
Alexey Milovidov
d1b4b5c836 Fixed error; added ProfileEvent #2277 2018-05-07 09:23:18 +03:00
Alexey Milovidov
b8a6261bbc Style [#CLICKHOUSE-2] 2018-05-07 05:15:47 +03:00
Alexey Milovidov
fd0ee5c6b1 Style [#CLICKHOUSE-2] 2018-05-07 05:14:24 +03:00
Alexey Milovidov
02f8757bef Applied clang-format #2272 2018-05-07 05:09:44 +03:00
Alexey Milovidov
b2edcfaa50 Applied clang-format #2272 2018-05-07 05:09:29 +03:00
Alexey Milovidov
1dc1ccc1d8 Applied clang-format #2272 2018-05-07 05:08:38 +03:00
Alexey Milovidov
90427db854 Applied clang-format #2272 2018-05-07 05:06:55 +03:00
Alexey Milovidov
94369e55d3 Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:29 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
Alexey Milovidov
a687c90100 Allow to link with LLVM if it was compiled without RTTI #2277 2018-05-07 03:00:12 +03:00
Alexey Milovidov
71814a33d5 Fixed code #2272 2018-05-06 14:34:31 +03:00
Alexey Milovidov
9da677719c Fixed code #2272 2018-05-06 14:34:16 +03:00
Alexey Milovidov
ee019183d2 Fixed code #2272 2018-05-06 14:31:14 +03:00
Alexey Milovidov
04d1c8c449 Fixed code #2272 2018-05-06 14:29:17 +03:00
Alexey Milovidov
b580d1c487 Allow to build with clang 7 2018-05-06 14:16:38 +03:00
Alexey Milovidov
6c7f896f9f Miscellaneous #2277 2018-05-06 13:42:35 +03:00
Alexey Milovidov
69c67b4cd4 Addition to prev. revision #2277 2018-05-06 12:37:16 +03:00
Alexey Milovidov
c4a26764ce Miscellaneous #2277 2018-05-06 12:32:36 +03:00
Alexey Milovidov
b1b95454cc Make warning suppressions more local #2277 2018-05-06 12:29:57 +03:00
pyos
88bb2f7c25 Resolve symbols right after compiling.
llvm::orc::RTDyldObjectLinkingLayer::findSymbol appears to be non-threadsafe.
2018-05-05 00:38:17 +03:00
Nikolai Kochetov
530b99cee5 Added ConvertColumnWithDictionaryToFullBlockInputStream. 2018-05-04 14:39:15 +03:00
pyos
a286dea2e1 Don't waste time jit-compiling isolated functions.
This is already done ahead of time when building the executable.
2018-05-03 16:34:42 +03:00
pyos
23bbf632e5 If all inputs to a jitted function are constant, return a constant 2018-05-03 16:33:40 +03:00
pyos
accbbdb9e3 Add a setting that disables jit-compilation 2018-05-03 00:48:20 +03:00
pyos
900b92f744 Merge API changes from upstream 2018-05-01 22:52:33 +03:00
pyos
27f12eeaa3 Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-05-01 22:51:37 +03:00
Tsarkova Anastasia
ba901ebc3f struct instead of class 2018-05-01 21:18:13 +02:00
Tsarkova Anastasia
7c9741ed5b Fix style. 2018-05-01 15:31:38 +02:00
Tsarkova Anastasia
fe0753a128 Minor fixes, adding test case. 2018-05-01 15:24:43 +02:00
Tsarkova Anastasia
210a389592 Getting rid of measure action, other small fixes applied. 2018-04-30 21:33:32 +02:00
pyos
7529aa55a4 Fix a bug that limited inlining depth at 2 2018-04-30 01:23:27 +03:00
Tsarkova Anastasia
a99ff6f380 Fix tests. 2018-04-29 23:48:33 +02:00
Tsarkova Anastasia
9286c98789 Fix build. 2018-04-29 23:13:01 +02:00
pyos
b4c7bee12b Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-04-29 23:22:18 +03:00
pyos
72f2fea837 Extract the code that compiles a single IFunctionBase from LLVMFunction 2018-04-29 21:03:58 +03:00
pyos
1be009d485 Remove getDefaultNativeValue in favor of llvm::Constant::getNullValue 2018-04-29 20:32:30 +03:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master 2018-04-29 18:02:34 +02:00
Tsarkova Anastasia
2c96b1c684 Add comments. Change projection restoring function. 2018-04-29 15:49:58 +02:00
pyos
4641e2960f Move ExpressionActions::compileFunctions to ExpressionJIT.cpp.
This means ExpressionJIT.h only has to expose one function.
2018-04-29 13:39:01 +03:00
pyos
6e05c5ace4 compilePrologue() isn't particularly useful after all.
Basically the only thing it can do that compile() can't is create 'alloca'
instructions, which are only needed to get pointers to stack variables.
Given that dynamically-sized allocations aren't possible with this API,
such pointers are probably completely pointless (heh).
2018-04-28 18:11:23 +03:00
pyos
1ffc2a0775 Make LLVMFunction monotonicity computation shorter (and fix a typo-bug) 2018-04-28 17:41:24 +03:00
pyos
a1eb938ed2 Inline nullable number constants into compiled code.
Also, protect against some segfaults during compilation by checking
correctness of the type returned by compile().
2018-04-28 17:12:00 +03:00
pyos
ccc895d162 Represent nullable types as pairs instead of pointers.
Turns out LLVM has insertvalue & extractvalue for struct in registers. This is
faster than pointers because null checks are now subject to more optimizations.
2018-04-28 14:12:23 +03:00
pyos
5c75342d54 Check nativity of all types *before* calling isCompilable 2018-04-28 01:03:52 +03:00
pyos
979c4d959f Let jit-compilable functions deal with NULLs themselves.
And provide a default implementation of compile() for nullable columns
that actually works and is consistent with execute().
2018-04-28 00:34:27 +03:00
alexey-milovidov
093c054b1f
Merge pull request #2263 from luc1ph3r/arbitrary-csv-delimiter
Support an arbitrary CSV delimiter
2018-04-27 13:13:09 -07:00
alexey-milovidov
96e2dfa790
Update SettingsCommon.h 2018-04-27 13:12:26 -07:00
pyos
49b61cd27d Refactor LLVMFunction to make extending to DataTypeNullable easier 2018-04-27 18:44:38 +03:00
Ivan Zhukov
4094e21be5 Code review 2018-04-26 20:41:43 +03:00
pyos
b4d527ee85 Inline compile-time constants into jitted functions. 2018-04-26 14:30:16 +03:00
pyos
9ae5fe1b6d Minor style fixes 2018-04-25 18:33:58 +03:00
pyos
854f85dd9b Put #if USE_EMBEDDED_COMPILER in ExpressionJIT.{cpp,h} 2018-04-25 18:19:22 +03:00
pyos
d59b0d7ec0 Add IColumn::getRawData to fixed-contiguous columns 2018-04-25 18:16:48 +03:00
pyos
6c275c27d0 Remove an unnoticed debug return 2018-04-25 16:44:24 +03:00
pyos
c419d5a1a5 Poison only columns actually used by ARRAY_JOIN and JOIN 2018-04-25 16:01:06 +03:00
pyos
5482282943 Implement informational methods for LLVMFunction 2018-04-25 16:01:06 +03:00
pyos
af7ecd4c4a Move function compilation before insertion of REMOVE_COLUMNs 2018-04-25 16:01:06 +03:00
pyos
162a0c8b33 Fix some comments' style 2018-04-25 16:01:06 +03:00
pyos
0da110234c Do not compile the jit if USE_EMBEDDED_COMPILER is disabled 2018-04-25 16:01:00 +03:00
pyos
1bece1de46 Support nullable columns (with default behavior) in jitted functions 2018-04-25 13:37:26 +03:00
pyos
4bd0906613 Fix some comments 2018-04-25 13:37:26 +03:00
pyos
df2d2e0b25 Tweak the jit compilation API to be more amenable to lazy computation 2018-04-25 13:37:26 +03:00
pyos
b2077a466a Inline jit-compilable functions into other jit-compilable functions 2018-04-25 13:37:26 +03:00
pyos
3810173103 Remove IFunction::createResultColumn.
Given that the list of supported types is hardcoded in
LLVMContext::Data::toNativeType, this method is redundant because
LLVMPreparedFunction can create a ColumnVector itself.
2018-04-25 13:37:26 +03:00
pyos
6b526f784c Enable the default set of LLVM optimization passes
I honestly can't tell if they work. LLVM has surprisingly bad API documentation.
2018-04-25 13:37:26 +03:00
pyos
5f1bf11ede Implement a loop over the columns in jit-compiled code 2018-04-25 13:37:25 +03:00
pyos
407008a4d9 Separate jit-compilability checks from actual compilation 2018-04-25 13:37:25 +03:00
pyos
e96a5e8344 Implement JIT compilation, without a loop for now.
It actually seems to work, so long as you only have one row that is. E.g.

    > select something(cast(number + 6 as Float64), cast(number + 2 as Float64)) from system.numbers limit 1';
    8

with this IR:

    define void @"something(CAST(plus(number, 6), 'Float64'), CAST(plus(number, 2), 'Float64'))"(void**, i8*, double*) {
    entry:
      %3 = load void*, void** %0
      %4 = bitcast void* %3 to double*
      %5 = load double, double* %4
      %6 = getelementptr void*, void** %0, i32 1
      %7 = load void*, void** %6
      %8 = bitcast void* %7 to double*
      %9 = load double, double* %8
      %10 = fadd double %5, %9
      store double %10, double* %2
      ret void
    }
2018-04-25 13:37:25 +03:00
pyos
b398ffbaba Map all number types to LLVM types.
The example from the previous commit doesn't need a cast to Float64 anymore.
2018-04-25 13:37:25 +03:00
pyos
851684de51 Add a JIT interface for row-wise default-nullable functions.
Not actually implemented, though. It does print out some jit-compiled stuff,
but that's about it. For example, this query:

    select number from system.numbers where something(cast(number as Float64)) == 4

results in this on server's stderr:

    define double @"something(CAST(number, 'Float64'))"(void**, i8*, void*) {
    "something(CAST(number, 'Float64'))":
      ret double 1.234500e+04
    }

(and an exception, because that's what the non-jitted method does.)

As one may notice, this function neither reads the input (first argument;
tuple of arrays) nor writes the output (third argument; array), instead
returning some general nonsense.

In addition, `#if USE_EMBEDDED_COMPILER` doesn't work for some reason,
including LLVM headers requires -Wno-unused-parameter, this probably only
works on LLVM 5.0 due to rampant API instability, and I'm definitely
no expert on CMake. In short, there's still a long way to go.
2018-04-25 13:37:25 +03:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
Nikolai Kochetov
7a62bb9267 added comments and fixed tests build 2018-04-23 22:41:10 +03:00
Ivan Zhukov
e402ff3f81 Unify string checks with a new type 2018-04-22 02:42:01 +03:00
Ivan Zhukov
e84263eb3b Add a SettingChar type 2018-04-22 02:42:00 +03:00
Ivan Zhukov
1fc6bb6ffe Add a CSV delimiter setting 2018-04-22 01:20:39 +03:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
Nikolai Kochetov
7e45661a38 merged with master 2018-04-20 22:51:21 +03:00
Nikolai Kochetov
233ac6c599 style fixes 2018-04-20 22:38:34 +03:00
Alexey Milovidov
c087449023 Fixed error #2246 2018-04-20 22:14:04 +03:00
Nikolai Kochetov
a6375d6155 merged with master 2018-04-20 17:15:03 +03:00
Nikolai Kochetov
f5fe383620 fix build 2018-04-20 17:06:01 +03:00
Alexey Milovidov
6b88a2a7a5 Better info in log #2246 2018-04-20 04:14:04 +03:00
Alexey Milovidov
70be882b64 Renamed PK to Key where it's appropriate #2246 2018-04-20 03:27:25 +03:00
Alexey Milovidov
d71b3a95ef Renamed PK to Key where it's appropriate #2246 2018-04-20 03:20:50 +03:00
Alexey Milovidov
ce0ac3f8f8 Fixed error with Sets, part 2 #2246 2018-04-20 00:34:04 +03:00
Alexey Milovidov
a6c194fa6d Insignificant change #2246 2018-04-19 23:32:56 +03:00
Nikolai Kochetov
dd10c2073c merged with master 2018-04-19 18:10:44 +03:00
Nikolai Kochetov
a3308bf675 added IStorage::getQueryProcessingStage 2018-04-19 17:47:09 +03:00
Silviu Caragea
32dd4554da Merge remote-tracking branch 'github/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-19 09:29:49 +03:00
Alexey Milovidov
41428e4a11 Allowed to read files by table function "file" inside "user_files_path" #2164 2018-04-19 08:32:09 +03:00
Alexey Milovidov
b4bf2f0c09 Added comment [#CLICKHOUSE-2] 2018-04-19 00:14:47 +03:00
Alexey Milovidov
b6fcb808fe Updated old code [#CLICKHOUSE-2] 2018-04-18 23:18:18 +03:00
Alexey Milovidov
3eff0184fa Added set size checking when set from subquery is used for index; removed harmful feature for special support of (a, b) IN (SELECT (a, b)) instead of (a, b) IN (SELECT a, b) [#CLICKHOUSE-2] 2018-04-18 22:38:40 +03:00
Alexey Milovidov
3bb2fa4702 Fixed bad code [#CLICKHOUSE-2] 2018-04-18 21:44:02 +03:00
alexey-milovidov
089e71d9a5
Merge pull request #2235 from yandex/small-enhancements
Small enhancements
2018-04-17 22:45:01 +03:00
Vitaliy Lyudvichenko
400ad55754 Support allow_databases in distributed DDL. [#CLICKHOUSE-3]
Resolves #2189
2018-04-17 22:33:58 +03:00
Vitaliy Lyudvichenko
5536bf202c Allow SELECT FROM system.processes while max_queries limit is exceeded. [#CLICKHOUSE-3670] 2018-04-17 20:08:15 +03:00
Vitaliy Lyudvichenko
604c7071c3 Fixed a long lock of ProcessList when KILL QUERY is called. [#CLICKHOUSE-3706] 2018-04-17 18:16:32 +03:00
Vitaliy Lyudvichenko
f642d0828e Avoid freezing of KILL QUERY. [#CLICKHOUSE-3706] 2018-04-17 17:29:52 +03:00
alexey-milovidov
17dd218338
Merge pull request #2202 from proller/fix15
CLICKHOUSE-3700: Fix empty password on replica query
2018-04-16 23:18:47 +03:00
proller
42cb1540a1
Update ClientInfo.h 2018-04-16 23:12:44 +03:00
Nikolai Kochetov
081f0feb56 fix test [#CLICKHOUSE-3694] #2156 2018-04-16 22:49:14 +03:00
Nikolai Kochetov
9e05052c2a merged with master 2018-04-16 18:35:11 +03:00
Nikolai Kochetov
7b8a306e34 minor fixes 2018-04-16 18:11:13 +03:00
Nikolai Kochetov
41229b201b Merge branch 'master' into fix-header-for-union-stream-in-distributed-2 2018-04-13 23:11:04 +03:00
Nikolai Kochetov
325f16f8a5 fix perf 2018-04-13 23:09:13 +03:00
Nikolai Kochetov
42f9a4d773 added PrewhereInfo [#CLICKHOUSE-3694] #2156 2018-04-11 22:10:08 +03:00
Nikolai Kochetov
c9abeed3f5 remove unused columns from prewhere actions [#CLICKHOUSE-3694] #2156 2018-04-11 22:08:53 +03:00
proller
157067b127 CLICKHOUSE-3700: Fix empty password on replica query 2018-04-10 17:49:52 +03:00
Silviu Caragea
f1b8d4bc39 Merge remote-tracking branch 'github/master' into background-schedule-pool-fix 2018-04-10 16:27:17 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
proller
c26b3bdef1
Fix split shared build; fix build without system odbc libs (#2191)
* Fix split shared build

* Fix build without system odbc libs

* Move dbms/src/Common/iostream_debug_helpers.h -> libs/libcommon/include/common/iostream_debug_helpers.h

* Fix build with libiodbc
2018-04-09 06:52:39 -07:00
Alexey Milovidov
f02239a307 Fixed linkage of tests [#CLICKHOUSE-2] 2018-04-08 07:54:23 +03:00
proller
07b81c875e CLICKHOUSE-3444: show error for old query on replace_running_query (#2127)
* Add tests

* Fix test

* Fix test build

* CLICKHOUSE-3444: show error for replace_running_query

* fix naming

* fix

* fix test

* Update IProfilingBlockInputStream.cpp
2018-04-07 06:49:49 +03:00
Alexey Milovidov
30dd11f8ca Removed (obsolete) special handling for Arrays in the left hand side of IN (continued) #2113 2018-04-06 03:25:14 +03:00
Alexey Milovidov
6452a3bb76 Removed (obsolete) special handling for Arrays in the left hand side of IN [#CLICKHOUSE-2] 2018-04-05 23:52:01 +03:00
Nikolai Kochetov
dc22b881a7 added columns_added_by_join into in with pk [#CLICKHOUSE-3680] 2018-04-04 22:38:42 +03:00
Nikolai Kochetov
fde23f7975 added array_join_columns [#CLICKHOUSE-3680] 2018-04-04 22:38:42 +03:00
Nikolai Kochetov
7d0602c279 added columns from array join to aggregated_columns [#CLICKHOUSE-3680] 2018-04-04 22:38:42 +03:00
Alexey Milovidov
76e822274a Better exception messages [#CLICKHOUSE-2] 2018-04-04 00:29:11 +03:00
Nikolai Kochetov
4f7d262997 added aggregated_columns to mayBenefitFromIndexForIn [#CLICKHOUSE-3680] 2018-04-04 00:17:22 +03:00
Alexey Milovidov
f5652b4477 Modifications after removing libzookeeper; initialize ZooKeeper session lazily [#CLICKHOUSE-2] 2018-04-03 22:43:33 +03:00
Alexey Milovidov
08170d0d77 Modifications after removing libzookeeper [#CLICKHOUSE-2] 2018-04-03 21:24:18 +03:00
Alexey Milovidov
2310bd7947 Miscellaneous [#CLICKHOUSE-2] 2018-04-03 20:35:48 +03:00
Alexey Milovidov
205d648e0d Fixed error with timeout of distributed queries, part 1 #217 [#CLICKHOUSE-1942] 2018-04-02 21:01:25 +03:00
alexey-milovidov
428ee63a04
Merge branch 'master' into libzookeeper-rewrite 2018-04-01 17:31:20 +03:00
alexey-milovidov
10e5d63d76
Merge pull request #2131 from ClickHouse-Ninja/system-log-prepare-table-on-each-flush
SystemLog: проверка структуры и существования таблицы при каждом flush
2018-03-29 23:55:14 +03:00
alexey-milovidov
30838f4d9f
Update SystemLog.h 2018-03-29 23:54:57 +03:00
Kirill Shvakov
b742908731 SystemLog: execute prepareTable() on each flush
Merge remote-tracking branch 'upstream/master' into system-log-prepare-table-on-each-flush

#2131 deleted excessive logging

Revert "#2131 deleted excessive logging"

This reverts commit d78a46d958.

Revert "SystemLog: execute prepareTable()  on each flush"

This reverts commit 7f60bb0a9b.

SystemLog: execute prepareTable() on each flush
2018-03-29 16:57:16 +03:00
Vitaliy Lyudvichenko
63eee94319
Add max_network_bandwidth_for_all_users setting. [#CLICKHOUSE-2] (#2137) 2018-03-29 16:24:36 +03:00
proller
a6f9df105c Allow use encryption for distributed tables (#2065)
* Allow use encryption for distributed tables

* wip

* fix

* rename encryption to secure

* Fix DirectoryMonitor with +secure

* fix

* fix

* Update DirectoryMonitor.cpp

* Update DirectoryMonitor.cpp
2018-03-29 04:41:06 +03:00
alexey-milovidov
a220a43b8e
Merge branch 'master' into fix-detach-database 2018-03-29 03:01:07 +03:00
alexey-milovidov
ca5fd1e9de
Merge pull request #2033 from yandex/show-create-database
Show create database
2018-03-28 05:29:36 +03:00
alexey-milovidov
e3cbd3306c
Merge pull request #2081 from yandex/stricter-mutable-column-semantic-2
&& - qualified IColumn::mutate
2018-03-28 05:27:35 +03:00
Nikolai Kochetov
d3157d910c minor fixes 2018-03-27 22:14:48 +03:00
Nikolai Kochetov
0d3ee2e07b Merge branch 'read_query_body_fix' of https://github.com/silviucpp/ClickHouse into silviucpp-read_query_body_fix 2018-03-26 21:30:15 +03:00
Nikolai Kochetov
d63d9a4ffb fix test [#CLICKHOUSE-3590] 2018-03-26 18:48:19 +03:00
Alex Zatelepin
c5b04f7f17 Add info about total uncompressed part size to system tables (#2052)
* column size calculating routines now take into account multiple streams [#CLICKHOUSE-2831]

* rename for clarity

* use more appropriate method for calculating table size

* add info about total uncompressed part size to system.parts and system.parts_columns [#CLICKHOUSE-2831]

* rename columns for clarity [#CLICKHOUSE-2831]

* count shared substreams only once [#CLICKHOUSE-2831]
2018-03-26 17:18:04 +03:00
Alexey Milovidov
522bf01db9 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-25 03:15:52 +03:00
Alexey Milovidov
24f94d9352 Merge remote-tracking branch 'origin/master' into libzookeeper-rewrite 2018-03-24 23:30:57 +03:00
Alexey Zatelepin
2a366afbf5 add shutdowns everywhere [#CLICKHOUSE-3664] 2018-03-24 12:08:32 +00:00
Alexey Milovidov
10be6ca8f8 Rewriting ZooKeeper library [#CLICKHOUSE-2] 2018-03-24 03:45:04 +03:00
Alexey Zatelepin
cf3c24d07d break cycle of ptrs to StorageReplicatedMergeTree [#CLICKHOUSE-3664] 2018-03-23 23:30:04 +03:00
proller
caf83a650e libs: compiling with msvc2017 (#1996)
* Allow use bundled *ssl library

* fix

* Add submodule

* Fixes

* fix

* fixes

* fixes

* fix

* fix

* update poco

* fix warnings

* fix

* fix

* Build fixes

* Build fixes

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* add bat

* no zookeeper in dbms

* update boost

* fixes

* fixes

* fix

* fix

* fix

* fix

* try fix

* try fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Better

* fix

* dh verbose

* fix

* dh verbose

* fix

* clean

* Update LocalDate.h

* Update LocalDateTime.h
2018-03-23 19:05:14 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
d690c24198 Using different ZooKeeper library (development) [#CLICKHOUSE-2] 2018-03-22 00:40:53 +03:00
Nikolai Kochetov
a399c17f01 && - qualified IColumn::mutate 2018-03-20 17:01:00 +03:00
Kirill Shvakov
109b73b947 fix CREATE TEMPORARY TABLE IF NOT EXISTS 2018-03-17 01:55:07 +03:00
Vitaliy Lyudvichenko
1f28410490 Fixed false positive error messages for queries with IN and ARRAY JOIN. [#CLICKHOUSE-2] 2018-03-16 17:11:49 +03:00
Alexey Milovidov
cf6112fd37 Fixed half of bad code [#CLICKHOUSE-2] 2018-03-16 09:39:32 +03:00
Alexey Milovidov
dc4a9be6fa Fixed error with "makeSetsForIndex" [#CLICKHOUSE-2] 2018-03-16 09:33:23 +03:00
Alexey Milovidov
73b04a4d27 Revert "Attempt to fix bad code, try 2 [#CLICKHOUSE-3649] #1830"
This reverts commit eb0095a7b9.
2018-03-16 07:37:21 +03:00
Alexey Milovidov
eb0095a7b9 Attempt to fix bad code, try 2 [#CLICKHOUSE-3649] #1830 2018-03-16 07:13:24 +03:00
Alexey Milovidov
83b775fbf5 Attempt to fix bad code, try 1 [#CLICKHOUSE-3649] #1830 2018-03-16 07:10:38 +03:00
Alexey Milovidov
f4c54f02a5 Removed trashy, obsolete code [#CLICKHOUSE-3649] 2018-03-16 07:00:00 +03:00
Alexey Milovidov
25a691f03d Don't allow Distributed table that look at itself [#CLICKHOUSE-2919]. 2018-03-16 05:08:31 +03:00
Alexey Milovidov
3a8d6c28ef Attempt to fix a regression [#CLICKHOUSE-2] 2018-03-16 00:44:09 +03:00
Vitaliy Lyudvichenko
e77701bd4b Enable alisas for sets and tuples for IN operator. [#CLICKHOUSE-3]
Resolves #2044
2018-03-15 21:44:02 +03:00
Vitaliy Lyudvichenko
8028ba0de9 Refactoring of zkutil::ZooKeeper::multi* functions. [#CLICKHOUSE-2] 2018-03-14 16:29:03 +03:00
Nikolai Kochetov
d6e9d08d5e getCreateTableQuery and getCreateDatabaseQuery [#CLICKHOUSE-3590] 2018-03-14 15:37:38 +03:00
alexey-milovidov
8bb3672bea
Update InterpreterSelectQuery.cpp 2018-03-14 05:42:48 +03:00
alexey-milovidov
9ac2569c65
Merge branch 'master' into refactor-table-declaration 2018-03-14 05:35:50 +03:00
Alexey Milovidov
8b59db58c3 Fixed uneven code #2032 2018-03-14 02:44:23 +03:00
alexey-milovidov
04cc8a52f7
Merge pull request #2032 from yandex/system-table-macro
System table macro
2018-03-14 02:10:30 +03:00
alexey-milovidov
165de1bc36
Update Context.cpp 2018-03-14 02:03:00 +03:00
Vitaliy Lyudvichenko
f11f8e0365 Fixed DDLWorker after recent changes. [#CLICKHOUSE-2] 2018-03-14 00:20:08 +03:00
Alexey Zatelepin
5906c9a988 rename for clarity 2018-03-13 18:00:28 +03:00
Alexey Zatelepin
fdffbe53ac encapsulate ColumnsDeclaration [#CLICKHOUSE-3241] 2018-03-13 17:41:25 +03:00
Nikolai Kochetov
632a2ecabc added SYSTEM RELOAD CONFIG query [#CLICKHOUSE-3591] 2018-03-13 13:41:47 +03:00
Alexey Milovidov
b7475b1d2c Fixed error: wrong timeouts passed to ConnectionPoolWithFailover [#CLICKHOUSE-3641] 2018-03-12 23:25:18 +03:00
Alexey Zatelepin
de1db216a5 getStructureOfRemoteTable returns info about column default kinds [#CLICKHOUSE-3241] 2018-03-12 23:21:54 +03:00
Alexey Zatelepin
78d92f6794 add some useful methods, rename for clarity [#CLICKHOUSE-3241] 2018-03-12 22:10:13 +03:00
Alexey Zatelepin
71642b0880 use ColumnsDescription everywhere [#CLICKHOUSE-3241] 2018-03-12 22:07:48 +03:00
Vitaliy Lyudvichenko
0b82551829 Refined comment. [#CLICKHOUSE-2] 2018-03-12 22:02:54 +03:00
Nikolai Kochetov
4dd7f47ad5 reload macros with config [#CLICKHOUSE-3591] 2018-03-12 21:16:51 +03:00
alexey-milovidov
56deedfe9f
Merge pull request #2027 from yandex/CLICKHOUSE-3346
Sync insert and сluster copier enhancements
2018-03-12 20:58:53 +03:00
Nikolai Kochetov
2b3e897aa1 added SHOW CREATE DATABASE query [#CLICKHOUSE-3590] 2018-03-12 18:21:50 +03:00
Vitaliy Lyudvichenko
30b69c84ae Fixed Illegal PREWHERE error for Merge tables over Distributed. [#CLICKHOUSE-3637] 2018-03-12 18:14:26 +03:00
Vitaliy Lyudvichenko
32b617e1d6 Fixed extra squashing leaded to too big timeouts. [#CLICKHOUSE-3346] 2018-03-11 21:36:09 +03:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
afbbd780e3 Fixed error with initialization of PartLog [#CLICKHOUSE-3354] 2018-03-10 22:57:13 +03:00
Alexey Milovidov
f3b6d35167 Removed setting "strict_insert_defaults" [#CLICKHOUSE-2] 2018-03-10 03:11:39 +03:00
Alexey Milovidov
3f8ef38b41 Fixed wording #245 2018-03-10 02:23:15 +03:00
Alexey Milovidov
8ff0c520d0 Removed the possibility to use queries with empty query_id; better semantics #245 2018-03-10 02:04:26 +03:00
Alexey Milovidov
e102ba5415 Fixed error #245 2018-03-10 01:11:42 +03:00
Alexey Milovidov
add4d29298 Added "is_cancelled" columns to SHOW PROCESSLIST #245 2018-03-10 00:12:52 +03:00
Alexey Milovidov
65b95580f3 Removed useless code [#CLICKHOUSE-2] 2018-03-09 21:39:14 +03:00
Alexey Milovidov
fbd50ad399 Fixed bug (dangling reference, use after free) [#CLICKHOUSE-2] 2018-03-09 02:58:13 +03:00
Alexey Milovidov
310b9104b8 Removed useless method [#CLICKHOUSE-2] 2018-03-08 05:16:03 +03:00
Alexey Milovidov
aaee96fc9d Style [#CLICKHOUSE-2] 2018-03-08 04:50:58 +03:00
alexey-milovidov
1ecb9dac72
Merge pull request #1901 from zhang2014/fix/ISSUES-117
ISSUES-117 add show create & exist temporary table
2018-03-07 22:53:11 +03:00
alexey-milovidov
6ce43a9816
Update InterpreterShowCreateQuery.cpp 2018-03-07 22:52:22 +03:00
alexey-milovidov
4ce15695d7
Update Context.cpp 2018-03-07 22:43:13 +03:00
alexey-milovidov
eecdbe9c7b
Update InterpreterShowCreateQuery.cpp 2018-03-07 22:39:05 +03:00
alexey-milovidov
2bb80baae5
Update Context.cpp 2018-03-07 22:33:40 +03:00
Alexey Milovidov
5fbc1a1ee5 Fixed regression: cannot CREATE SELECT using HTTP interface [#CLICKHOUSE-2] 2018-03-07 21:53:21 +03:00
Vitaliy Lyudvichenko
364f519eea Threads and ProfileEvents in system.processes. [#CLICKHOUSE-2910] 2018-03-07 14:35:54 +03:00
Vitaliy Lyudvichenko
efdda9cc9b Introduced ThreadStatus. [#CLICKHOUSE-2910] 2018-03-07 14:35:10 +03:00
Alexey Milovidov
d134f90fa9 Whitespace [#CLICKHOUSE-2] 2018-03-06 14:59:25 +03:00
alexey-milovidov
1acf404ed1
Merge pull request #1831 from yandex/remote-table-function-insert-into-local-replica
Remote table function insert into local replica
2018-03-06 00:14:29 +03:00
proller
82a361d0e9 Show error to client if query was killed (#1989)
* Show error to client if query was killed

* Kill exception v2

* Use kill

* fix

* wip

* fix

* fxi

* try fix

* Revert "try fix"

This reverts commit eb76e4c040.

* QUERY_WASCANCELLED

* Fxi all cancel()

* fix
2018-03-06 00:09:39 +03:00
Nikolai Kochetov
d7e6225815 renamed treat_local_as_shared to treat_local_as_remote 2018-03-05 15:47:09 +03:00
Nikolai Kochetov
871a560b37 merged with master 2018-03-05 15:36:17 +03:00
Alexey Milovidov
c897e5ca39 Better [#CLICKHOUSE-2] 2018-03-03 18:36:20 +03:00
alexey-milovidov
9b4ea7acde
Merge pull request #1933 from zhang2014/fix/ISSUES-1386
ISSUES-1386 add illegal column exception when drop exist depend
2018-03-02 22:33:57 +03:00
alexey-milovidov
fad8a56dc7
Merge pull request #1987 from yandex/add-odbc-max-field-size
added odbc_default_field_size setting
2018-03-02 21:59:52 +03:00