thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 06:01:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
16,196 Commits 9,136 Branches 1,778 Tags 2 GiB
5036309d26
Commit Graph

11810 Commits

Author SHA1 Message Date
Alexey Zatelepin
af06ca5d3c Merge branch 'master' into replicated-mergetree-mutations 2018-06-01 16:21:14 +03:00
robot-metrika-test
6a57f55f0c Auto version update to [54385] 2018-06-01 15:43:56 +03:00
Alexey Milovidov
ba48e31507 Miscellaneous [#CLICKHOUSE-3753] 2018-06-01 15:37:56 +03:00
Alexey Milovidov
81a505ad64 Better name [#CLICKHOUSE-3753] 2018-06-01 15:37:50 +03:00
Alexey Milovidov
ce12f0b37c Fixed error in ZK library [#CLICKHOUSE-3753] 2018-06-01 15:37:39 +03:00
Alexey Milovidov
3cb68784ad Miscellaneous [#CLICKHOUSE-3753] 2018-05-31 22:30:08 +03:00
Alexey Milovidov
515bd29df7 Better name [#CLICKHOUSE-3753] 2018-05-31 22:28:30 +03:00
Alexey Milovidov
6eb43fe9e9 Merge branch 'master' of github.com:yandex/ClickHouse 2018-05-31 22:26:46 +03:00
Alexey Milovidov
5dbd5b6d68 Fixed error in ZK library [#CLICKHOUSE-3753] 2018-05-31 22:26:21 +03:00
Alexey Zatelepin
8da32835d1 add needed file 2018-05-31 21:41:39 +03:00
Alexey Milovidov
848032ef16 Added test [#CLICKHOUSE-3726] 2018-05-31 21:28:47 +03:00
Alexey Milovidov
f45c479a8b Removed wrong query optimization [#CLICKHOUSE-3726] 2018-05-31 21:28:04 +03:00
Alexey Zatelepin
f63d2dc3c8 cannot take a number of unlocked abandonable lock 2018-05-31 20:28:17 +03:00
Alexey Milovidov
eeefe89acd Added test [#CLICKHOUSE-3092] 2018-05-31 20:06:07 +03:00
Alexey Zatelepin
c9bb986330 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Storages/MergeTree/AbandonableLockInZooKeeper.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
 2018-05-31 18:52:42 +03:00
Alexey Zatelepin
dbf6949e0b support skipping mutations (just in case) [#CLICKHOUSE-3747] 2018-05-31 18:21:00 +03:00
Babacar Diassé
3d518e48b9 NULL check to allow insertion in distributed tables with Materialized views 2018-05-31 17:21:35 +03:00
Vitaliy Lyudvichenko
dc5de3bbec More optimal conflicts check in future_parts. [#CLICKHOUSE-2] 2018-05-31 17:14:50 +03:00
Vitaliy Lyudvichenko
888f5f4a24 Allow merges after CLEAR COLUMN. [#CLICKHOUSE-3] 
Resolves #2315
 2018-05-31 17:14:50 +03:00
Alexey Milovidov
0f2f2a043f Added README #2442 2018-05-31 16:35:22 +03:00
alexey-milovidov
5164ef91df
Merge pull request #2442 from shedx/master 
benchmark data generator implemented
 2018-05-31 16:33:23 +03:00
Alexey Zatelepin
d89221c458 easier init and deactivation of BackgroundSchedulePool tasks 2018-05-31 16:18:52 +03:00
alexey-milovidov
cdacf073e8
Merge pull request #2449 from proller/fix15 
CLICKHOUSE-3587 Always write client error to log
 2018-05-30 22:27:21 +03:00
proller
dc721ed721 Try make cache for getSampleBlock (#2313) 
* Cache for getSampleBlock

* Update InterpreterSelectWithUnionQuery.cpp

* Update 00632_get_sample_block_cache.sql

* Add tests
 2018-05-30 22:23:15 +03:00
proller
b1f4bf3199 CLICKHOUSE-3587 Always write client error to log 2018-05-30 19:15:35 +03:00
LiuYangkuan
7eb25ef55b fix Exception in issue#2439 2018-05-30 11:11:53 -04:00
Vadim
620b4a2587 fix tests 2018-05-30 02:21:20 +03:00
Vadim
31a6613105 fix error 2018-05-30 02:01:36 +03:00
Vadim
cf9c03a7bd add test 2018-05-29 22:18:05 +03:00
proller
ead9493741 Build fixes 2018-05-29 20:54:48 +03:00
shedx
d9133cb74a benchmark data generator implemented 2018-05-29 19:14:03 +03:00
proller
221c833cfc Temporary use copy-headers from debian package 2018-05-29 18:13:30 +03:00
proller
0cd644f5ec Fix test (no zookeeper detection) 2018-05-29 15:48:36 +03:00
proller
060e965215
Try fix copy_headers (#2435) 2018-05-29 01:17:10 +03:00
proller
6a70df6d26
Again fix test 00505_secure with random ports (#2436) 2018-05-28 23:55:13 +03:00
proller
895b8e6515
Fix test 00505_secure with random ports (#2433) 2018-05-28 23:38:46 +03:00
Vadim
3aa24d39d4 Add comparison and fix functions 2018-05-28 23:01:20 +03:00
Alexey Zatelepin
f6c72f8e56 Merge branch 'master' into replicated-mergetree-mutations 
Conflicts:
	dbms/src/Common/ActionBlocker.h
	dbms/src/Storages/MergeTree/ActiveDataPartSet.cpp
	dbms/src/Storages/MergeTree/ActiveDataPartSet.h
	dbms/src/Storages/MergeTree/MergeTreeData.h
	dbms/src/Storages/MergeTree/MergeTreeDataPart.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeLogEntry.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.cpp
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeQueue.h
	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
	dbms/src/Storages/StorageMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.cpp
	dbms/src/Storages/StorageReplicatedMergeTree.h
 2018-05-28 18:37:30 +03:00
Vitaliy Lyudvichenko
7615f5a09a More detail dignostic when parse JSONEachRow. [#CLICKHOUSE-2] 2018-05-28 14:40:07 +03:00
Vadim
79791ead1e Add startsWith and endsWith 2018-05-28 01:43:31 +03:00
proller
ab3ab7f52d clickhouse-test-server: use random ports (#2425) 
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules

* pbuildeR: use random ports for testing

* critical fix

* clickhouse-test-server: use random ports

* fix

* fix
 2018-05-25 23:52:20 +03:00
Alexey Zatelepin
59fe12ed15 part log and metrics [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
aff6ad42ed support empty parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
2b80fbf972 DROP PARTITION now works with mutated parts [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fdb33d8f3c execute mutation log entries [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
fd81cc7f66 mutation executor for MergeTree [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
1147e052e8 select and write part mutations to queue [#CLICKHOUSE-3747] 2018-05-25 23:13:00 +03:00
Alexey Zatelepin
41b7e533cd more honest constness in ActionBlocker 2018-05-25 23:06:36 +03:00
Alexey Zatelepin
2721daf782 don't select merges of parts with different mutation versions [#CLICKHOUSE-3747] 2018-05-25 23:06:28 +03:00
Alexey Zatelepin
4c661df146 notify relevant events directly from queue [#CLICKHOUSE-3747] 2018-05-25 23:06:23 +03:00
Alexey Zatelepin
42850f09b7 load mutations from ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:15 +03:00
Alexey Zatelepin
49439aa2d2 write mutations to ZK [#CLICKHOUSE-3747] 2018-05-25 23:06:08 +03:00
Alexey Zatelepin
4ca3bf65f3 test getting abandonable lock in all partitions [#CLICKHOUSE-3747] 2018-05-25 23:05:10 +03:00
Alexey Zatelepin
9a32c76e76 parts versioning [#CLICKHOUSE-3687] 2018-05-25 23:04:07 +03:00
Alexey Zatelepin
2ab50c1f13 add test with inserts into Replicated tables from multiple threads [#CLICKHOUSE-3732] 2018-05-25 23:04:04 +03:00
Alexey Zatelepin
17437a95bf merge selection based on checking current inserts [#CLICKHOUSE-3732] 2018-05-25 23:03:56 +03:00
alexey-milovidov
dcebf08620
Merge pull request #2400 from bocharov/master 
Fix DateTime vs DateTime('UTC') inconsistency on data read.
 2018-05-25 21:44:11 +03:00
proller
68ba523b23 Compile and doc fixes (#2410) 
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap

* termcap fix

* Better llvm version detect

* fix

* Debian postinst fix
Tests: use /usr/local if exists

* Compile and doc fixes

* fix

* fix

* fix

* macos fixes

* fix

* wip

* Update demangle.h

* Update demangle.cpp
 2018-05-25 21:13:48 +03:00
alexey-milovidov
ded9df1bed
Merge pull request #2423 from amosbird/fancy 
Let's make it fancier (function try catch block).
 2018-05-25 21:08:28 +03:00
proller
f1fdea74be pbuilder: use random ports for testing (#2424) 
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules

* pbuildeR: use random ports for testing

* critical fix
 2018-05-25 21:05:30 +03:00
Amos Bird
9eec14e9be Let's make it fancier (function try catch block). 2018-05-25 23:38:57 +08:00
Alexey Milovidov
13762471da Changed DayNum_t to DayNum as Amos Bird suggested [#CLICKHOUSE-3] 2018-05-25 16:29:15 +03:00
proller
5665709bb9 Use copy-headers from cmake (#2412) 
* Fix internal compiler includes with new clang

* debug copy_headers.sh

* Fix copy_headers.sh

* Use copy-headers from cmake

* Update rules
 2018-05-25 01:20:37 +03:00
proller
87e8d8be5a
Fix internal compiler includes with new clang (#2406) 2018-05-24 15:40:02 +03:00
Vitaliy Lyudvichenko
42d5c6925c Removed bad test. [#CLICKHOUSE-2] 2018-05-23 21:29:35 +03:00
Vitaliy Lyudvichenko
87ad1df259 More atomic insert to MATERIALIZED VIEW. [#CLICKHOUSE-3743] 2018-05-23 19:18:04 +03:00
Vitaliy Lyudvichenko
6cc7068c6b Supress dummy program_options assertions in Debug. [#CLICKHOUSE-2] 2018-05-23 19:14:00 +03:00
Alex Bocharov
3618842579 Fix DateTime vs DateTime('UTC') inconsistency on data read. 
Original problem was described in PR #1650 and partially fixed by
b5af4c95, however one place was forgotten and it was causing query
exceptions when trying to read DateTime column across parts with
different DateTime and DateTime('UTC') data type.
 2018-05-22 12:23:07 +01:00
alexey-milovidov
2b581ed2c3
Merge pull request #2293 from proller/fix19 
`clickhouse-client`: option --ask-password for interactively ask for credentials #1044
 2018-05-21 22:54:32 +03:00
alexey-milovidov
55cfebc36b
Merge pull request #2395 from yandex/string_range-pointers-comparsion 
Renamed StringRangeHash to StringRangePointersHash and added StringRa…
 2018-05-21 22:42:42 +03:00
proller
051395a761 clickhouse-client: option --ask-password for interactively ask for credentials #1044 2018-05-21 20:27:18 +03:00
Vitaliy Lyudvichenko
8349d2b9a0 Fixed gcc7 compilation. [#CLICKHOUSE-2] 2018-05-21 18:10:50 +03:00
Vitaliy Lyudvichenko
c888903488
Add query ALTER TABLE t1 [REPLACE|ATTACH] PARTITION FROM t2 
* Add ATTACH PARTITION FROM table for MergeTree. [#CLICKHOUSE-3546]

* Implemented replicated case on non-leader replica. [#CLICKHOUSE-3546]

* Disable merges in the dropping range. [#CLICKHOUSE-3546]

* DROP PARTITION is atomic and simpler now. [#CLICKHOUSE-3546]

* Implemented more SYSTEM queries. [#CLICKHOUSE-2931] [#CLICKHOUSE-3546]

SYSTEM queries:
RESTART REPLICAS
SYNC REPLICA db.name
STOP MERGES [db.name]
START MERGES [db.name]
STOP FETCHES [db.name]
START FETCHES [db.name]
STOP REPLICATED SENDS [db.name]
START REPLICATED SENDS [db.name]
STOP REPLICATION QUEUES [db.name]
START REPLICATION QUEUES [db.name]

* Fixed a bunch of bugs in REPLACE PARTITION. [#CLICKHOUSE-3546]

* Add tests for REPLACE PARTITION and SYSTEM. [#CLICKHOUSE-3546]

* Add system.part_log logging. [#CLICKHOUSE-3546]

* Fixed long wait in SYNC REPLICA. [#CLICKHOUSE-3546]

* Add requested changes. [#CLICKHOUSE-3546]

Fixed clickhouse-client bad return code.

* Add requested chenges. [#CLICKHOUSE-3546]

* Add requested chenges. [#CLICKHOUSE-3546]
 2018-05-21 16:49:54 +03:00
Nikolai Kochetov
aeaec2e6d7 Renamed StringRangeHash to StringRangePointersHash and added StringRangePointersEqualTo. 2018-05-21 14:18:11 +03:00
zhang2014
3afb33593a ISSUES-2260 add some improvements 2018-05-21 13:26:35 +08:00
zhang2014
fa865636ce ISSUES-2259 add comment & move delete database metadata implementation 2018-05-21 11:38:46 +08:00
zhang2014
c8f655c1aa ISSUES-2259 fix the test after the merge master 2018-05-21 11:38:46 +08:00
zhang2014
6613e56784 ISSUES-2259 support truncate syntax 2018-05-21 11:38:46 +08:00
alexey-milovidov
0fe2984d00
Merge pull request #2388 from yandex/fix-prepared-sets-creation 
Fix prepared sets creation
 2018-05-19 19:03:04 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix 
Background schedule pool fixed
 2018-05-19 19:00:43 +03:00
Alexey Milovidov
577268d8f5 Style #2387 2018-05-18 21:31:18 +03:00
Alexey Milovidov
74a6b0010f utils/check-style/fix-style #2387 2018-05-18 21:30:02 +03:00
Nikolai Kochetov
a4b04739c8 Renamed need_parents back to need_parens. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
Nikolai Kochetov
c932ce60c0 Added test with dummy recursive alias. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
Nikolai Kochetov
f739078ea5 Fixed IAST::clone() implementations which were without children deep copy. [#CLICKHOUSE-3735] 2018-05-18 21:28:11 +03:00
proller
22d6afd2ad Debian postinst fix 
Tests: use /usr/local if exists
 2018-05-18 21:26:44 +03:00
Nikolai Kochetov
5e22f19258 Added fake range for ASTIdentifier in order to fix multiple global in. [#CLICKHOUSE-3734] 2018-05-18 20:27:58 +03:00
Arsen Hakobyan
dfe65ba842 Now uses Poco::URI::addQueryParameter for "update_field" parameter 2018-05-18 19:22:28 +03:00
Arsen Hakobyan
ad9659574f Adds percent encoding for "update_field" parameter 
Handles cases when url has fragment
 2018-05-18 19:22:28 +03:00
robot-metrika-test
84532a2a30 Auto version update to [54383] 2018-05-18 02:16:00 +03:00
Vitaliy Lyudvichenko
537c564d02 Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2] 
This patch is very crucial in case of many replicas.
 2018-05-18 02:05:39 +03:00
Vitaliy Lyudvichenko
6d854ee608 Fixed incorrect failed OP detection in ZooKeeper. [#CLICKHOUSE-2] 2018-05-18 02:05:22 +03:00
Vitaliy Lyudvichenko
4b093e3e0a Don't make extra checksums checks when commit a part. [#CLICKHOUSE-2] 
This patch is very crucial in case of many replicas.
 2018-05-18 02:01:36 +03:00
proller
445f8800c3
Build fixes [WIP] (#2374) 2018-05-17 20:55:07 +03:00
Nikolai Kochetov
d7ead51796 Added invalid FixedString size to the list of parse errors. 2018-05-17 18:29:59 +03:00
Nikolai Kochetov
d0341077ee Added test with bug caused set indexing by ptr. [#CLICKHOUSE-3734] 2018-05-17 17:54:57 +03:00
Nikolai Kochetov
9a1c286ade Changed prepared set indexation from AST* to StringRange. [#CLICKHOUSE-3734] 2018-05-17 17:54:43 +03:00
Alexey Zatelepin
d31b897ba7 validate mutation commands [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Zatelepin
3b97d3938f alter delete skeleton [#CLICKHOUSE-3688] 2018-05-16 05:46:15 +03:00
Alexey Milovidov
195f91f191 Merge branch 'master' of github.com:yandex/ClickHouse 2018-05-16 03:35:07 +03:00
Alexey Milovidov
fb91bba279 Miscellaneous [#CLICKHOUSE-2] 2018-05-16 03:34:56 +03:00
Vitaliy Lyudvichenko
412c154045 Better configs for an integration test. [#CLICKHOUSE-2] 2018-05-15 21:25:54 +03:00
Nikolai Kochetov
664171a003 Added test for in syntax. 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
6715b945d9 Allow using of function which returs tuple for IN. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
aaad77a602 Fixed unnecessary creation of prepared set for function arguments other than second for in or global in. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
e6adcfaad5 Fixed element types for explicit set in IN function. [#CLICKHOUSE-3730] 2018-05-15 18:38:04 +03:00
Nikolai Kochetov
651bac519c Fixed element types for explicit set in IN function. 
Fixed element types for explicit set in IN function. [#CLICKHOUSE-3730]
 2018-05-15 18:38:04 +03:00
alexey-milovidov
9ef0a771e3 Update TableFunctionMySQL.cpp 2018-05-15 03:02:59 +03:00
sundy-li
04c734d785 delete unused space 2018-05-15 03:02:59 +03:00
sundy-li
8a5990fc74 add integration test_storage_mysql 2018-05-15 03:02:59 +03:00
sundy-li
5d91b4f2fd fix some bugs, fix some code styles 2018-05-15 03:02:59 +03:00
sundy-li
200076b593 ADD replace_query, on_duplicate_clause config for StorageMySQL && add docs 2018-05-15 03:02:59 +03:00
sundy-li
763f1fda96 Avoid Excessive copy when block is small enough && fix some code 2018-05-15 03:02:59 +03:00
sundy-li
2511a4784b Support data write to StorageMySQL table 2018-05-15 03:02:59 +03:00
Alexey Milovidov
3e79e8974f Addition to prev. revision [#CLICKHOUSE-2] 2018-05-15 00:37:56 +03:00
Alexey Milovidov
3943cfb11e Addition to prev. revision [#CLICKHOUSE-2] 2018-05-14 22:14:37 +03:00
proller
fb911f7cfa Allow force disable libs: poco netssl poco mongodb, poco data odbc 2018-05-14 21:36:01 +03:00
proller
aa1552ebf2 Build fixes 2018-05-14 20:25:32 +03:00
Vitaliy Lyudvichenko
fb7e6350db Fixed disabled stderr output. Better configs for clickhouse-copier. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
e8b94b89e9 Removed dbg output, fixed test. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
61705acd69 Speedup initialization and fixed a bug. [#CLICKHOUSE-2] 2018-05-14 17:14:58 +03:00
Vitaliy Lyudvichenko
d25338582d Speedup partition check, add more preformance output. [#CLICKHOUSE-2] 
Faster partition check.

Added more debug info.
 2018-05-14 17:14:58 +03:00
proller
7deceb5783 Build fixes 2018-05-14 14:52:41 +03:00
Nikolai Kochetov
6ba8cb922c Fix usage of columns from header in SummingSortedBlockInputStream. #2273 2018-05-14 13:48:50 +03:00
Alexey Milovidov
1fa8a9a6df Fixed unclean code #2352 2018-05-13 13:05:34 +03:00
Alexey Milovidov
cecffcd5ab Apply ./utils/check-style/fix-style #2352 2018-05-13 12:36:51 +03:00
Alexey Milovidov
c79d4fd0fd Merge branch 'feature/funnelWindow' of https://github.com/clickhousecn/ClickHouse into clickhousecn-feature/funnelWindow 2018-05-13 12:34:23 +03:00
Alexey Milovidov
8690d596b0 Miscellaneous [#CLICKHOUSE-2] 2018-05-13 12:32:56 +03:00
alexey-milovidov
9043820565
Update AggregateFunctionWindowFunnel.h 2018-05-13 12:31:13 +03:00
sundy-li
c56e9967f2 Add tests && docs 2018-05-13 16:18:35 +08:00
sundy-li
64b1b6d764 Add windowFunnel AggregateFunction 2018-05-12 23:49:17 +08:00
proller
0b386381ac Build fixes 2018-05-11 21:00:24 +03:00
Winter Zhang
adbbbb3c48 ISSUES-2343 fix failed test (#2344) 2018-05-11 17:35:32 +03:00
proller
efe661b620 Build fixes (#2347) 
* Try fix travis

* fix

* Fix clickhouse-local shared-split link

* fix

* fix

* fix

* Build fixes

* Fix tinfo

* fix

* tinfo -> termcap
 2018-05-11 17:16:16 +03:00
Vitaliy Lyudvichenko
d292190d4b Try to fix broken test. [#CLICKHOUSE-2] 2018-05-11 16:53:39 +03:00
Alexey Milovidov
715a9a7233 Miscellaneous [#CLICKHOUSE-2] 2018-05-11 14:04:12 +03:00
Alexey Milovidov
471eb5c8ca Removed useless file [#CLICKHOUSE-2] 2018-05-11 03:49:06 +03:00
Alexey Milovidov
8b05841142 Removed useless files [#CLICKHOUSE-2] 2018-05-11 03:08:49 +03:00
Alexey Milovidov
294b468a32 Avoid warnings in LLVM code #2277 2018-05-11 02:25:46 +03:00
Alexey Milovidov
582085bf15 Be more conservative about new feature #2277 2018-05-11 00:29:44 +03:00
Alexey Milovidov
65a08210ac Merge branch 'llvm-jit' of https://github.com/pyos/ClickHouse into pyos-llvm-jit 2018-05-10 22:09:47 +03:00
pyos
e5ebc24657 Revert the part of bd332b that moved a read after std::move. 2018-05-10 21:19:41 +03:00
pyos
1718e575a7 Bridge between incompatible LLVM APIs 2018-05-10 20:31:24 +03:00
Alexey Milovidov
4d9088d3d4 Merge branch 'llvm-jit' of https://github.com/pyos/ClickHouse into pyos-llvm-jit 2018-05-10 18:23:53 +03:00
Alexey Milovidov
d3b7bafedf Miscellaneous #2277 2018-05-10 18:22:54 +03:00
Alexey Milovidov
93352237d9 Better exception message [#CLICKHOUSE-2] 2018-05-10 18:20:19 +03:00
pyos
c123be1fe4 Fix incorrect phi node edges in if 2018-05-10 17:49:38 +03:00
pyos
6d2259f2cf Implement jit for comparisons, except for (double, int). 
That one has some edge cases which I can't be bothered to code.
 2018-05-10 17:03:18 +03:00
pyos
bd332b9171 Allow calling into libc from jitted code. 
Mostly for intrinsics like memcpy/memset/memmove, which are inserted
during optimization by LLVM itself. (With a null resolver, a compiled
version of something like `Uint64 < 0` would segfault.)
 2018-05-10 17:00:32 +03:00
pyos
4776168c3b Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-05-10 13:25:26 +03:00
pyos
4abcef13a1 Merge branch 'pyos-llvm-jit' of https://github.com/yandex/ClickHouse into llvm-jit 2018-05-10 13:19:49 +03:00
Vitaliy Lyudvichenko
990bcbb007 Add test for --help. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
Vitaliy Lyudvichenko
b4025e312e Use neat boost::program_options, more parameters. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
Vitaliy Lyudvichenko
5704de8774 Fixed settings passing in clickhouse-local and tmp dirs. [#CLICKHOUSE-3713] 2018-05-10 02:15:06 +03:00
Alexey Milovidov
6f69c41bdd Fixed error #2277 2018-05-10 01:29:23 +03:00
Alexey Milovidov
72ab282bca Removed hack #2277 2018-05-10 00:03:03 +03:00
Alexey Milovidov
f82ef70b4f Updated submodules #2277 2018-05-09 23:36:33 +03:00
Alexey Milovidov
3a059b82d2 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-09 23:34:20 +03:00
Alexey Milovidov
4d2989e42f Added support for bundled LLVM libraries #2277 2018-05-09 23:31:03 +03:00
Alexey Milovidov
845d6372e7 Fixed linking of tests #2277 2018-05-09 21:33:29 +03:00
Vitaliy Lyudvichenko
864dc0546b Add requested changes. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8746149965 More persistent directory names for replicas. [#CLICKHOUSE-2] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
1f05000c2c Better naming. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
704583968f Do not save resolved addresses in Connections. [#CLICKHOSUE-2] 
Add disable_internal_dns_cache main config option.
 2018-05-09 07:55:08 +03:00
Vitaliy Lyudvichenko
8fd72a6777 Add automatic DROP DNS CACHE, update of SYSTEM queries. [#CLICKHOUSE-3645] 2018-05-09 07:55:08 +03:00
Alexey Milovidov
bd79242688 Better #2328 2018-05-09 07:49:34 +03:00
alexey-milovidov
1e9edac617
Merge pull request #2328 from proller/fix15 
Build fixes (gcc8)
 2018-05-09 07:25:18 +03:00
Alexey Milovidov
b442cd9c64 Miscellaneous (no effect) [#CLICKHOUSE-2] 2018-05-09 07:22:30 +03:00
Alexey Milovidov
14223a88a3 Fixed build [#CLICKHOUSE-2] 2018-05-09 07:21:40 +03:00
Alexey Milovidov
6efcdc5a6c Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-09 04:55:49 +03:00
proller
eb772b8001 gcc8 fixes (memset, uncaught_exception) 2018-05-08 22:44:54 +03:00
proller
b6ffdd93e1 Ignore werror in Core/Field.h 2018-05-08 17:46:55 +03:00
pyos
f060883c4b Fix a typo 2018-05-08 16:02:32 +03:00
Alexey Milovidov
6e2028d921 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-08 16:01:56 +03:00
Alex Zatelepin
7244dfe1f5
better detached part name 2018-05-08 15:47:06 +03:00
robot-metrika-test
10f68290ee Auto version update to [54382] 2018-05-08 14:40:41 +03:00
alexey-milovidov
fd9938cc46 Update getNumberOfPhysicalCPUCores.cpp 2018-05-08 12:43:45 +03:00
Atri Sharma
14cc530833 Update based on comments 2018-05-08 12:43:45 +03:00
Atri Sharma
22530c38e4 Add Rounding to nearest number 2018-05-08 12:43:45 +03:00
Atri Sharma
9b5ecc83ac Fix quota issue 2018-05-08 12:43:45 +03:00
Atri Sharma
cbaf78df4f Implement CGroups Limit for CPU 2018-05-08 12:43:45 +03:00
Alexey Milovidov
14649ad5e6 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-08 00:27:13 +03:00
Alexey Milovidov
3453bf577a Merge branch 'llvm-jit' of github.com:pyos/ClickHouse into pyos-llvm-jit 2018-05-08 00:25:13 +03:00
Alexey Milovidov
43f0b419ea Removed useless code [#CLICKHOUSE-2] 2018-05-08 00:01:15 +03:00
Alexey Zatelepin
6047db7ea2 fix removing failed quorum parts at startup (tryGetChilden actually returns error code, not success flag) 2018-05-07 23:31:28 +03:00
pyos
2d70d9d601 Implement jit for numeric if and multiIf 2018-05-07 23:17:22 +03:00
pyos
1433e6e849 Extract native bool cast; generalize number cast to nullables 2018-05-07 22:21:23 +03:00
Alexey Milovidov
089ef3277f Removed useless code [#CLICKHOUSE-2] 2018-05-07 19:30:47 +03:00
pyos
cfc41e1a64 Copy changes from LLVM {5,6} CMakeLists to 7 2018-05-07 19:14:00 +03:00
pyos
f070f73220 Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 
Conflicts:
	debian/.pbuilderrc
 2018-05-07 19:11:48 +03:00
pyos
32fd123010 Select an *exact* target machine, not an approximation. 
Required for enabling advanced features such as AVX and AVX2.

Code mostly copied from LLVM's tools/opt/opt.cpp.
 2018-05-07 19:06:13 +03:00
Alexey Milovidov
a611fbd143 Merge branch 'master' of github.com:yandex/ClickHouse into pyos-llvm-jit 2018-05-07 19:00:41 +03:00
proller
398097d24a Build fixes (#2323) 
* Build fixes

* Fixes

* remove libzookeeper-mt-dev

* fix

* fix

* wrong

* try fix

* fix

* Update CMakeLists.txt
 2018-05-07 18:59:52 +03:00
pyos
686c1f73fd Implement IntExp2Impl::compile 2018-05-07 16:36:07 +03:00
pyos
b08dbf2b22 Remove a redundant target_compile_options 2018-05-07 16:33:07 +03:00
pyos
d4b5c01a1e Fix addModule check for LLVM < 7 
It returns `Expected`, so false-y is a failure. (In >= 7 it returns
an `Error`, so truth-y is a failure. Wow, that's confusing.)
 2018-05-07 16:04:07 +03:00
pyos
0e09138405 Assume output and one input of LLVMFunction is non-const 2018-05-07 16:03:26 +03:00
Alexey Milovidov
4c1c2dbdff Merge remote-tracking branch 'origin/master' into pyos-llvm-jit 2018-05-07 13:44:15 +03:00
Alexey Milovidov
01bbf650f8 Build fixes #2277 2018-05-07 11:59:24 +03:00
Alexey Milovidov
147919928d Better error checks #2277 2018-05-07 09:49:56 +03:00
Alexey Milovidov
d1b4b5c836 Fixed error; added ProfileEvent #2277 2018-05-07 09:23:18 +03:00
Alexey Milovidov
e06223cbb8 Style [#CLICKHOUSE-2] 2018-05-07 05:15:47 +03:00
Alexey Milovidov
b8a6261bbc Style [#CLICKHOUSE-2] 2018-05-07 05:15:47 +03:00
Alexey Milovidov
a916d2760e Style [#CLICKHOUSE-2] 2018-05-07 05:15:24 +03:00
Alexey Milovidov
fd0ee5c6b1 Style [#CLICKHOUSE-2] 2018-05-07 05:14:24 +03:00
Alexey Milovidov
02f8757bef Applied clang-format #2272 2018-05-07 05:09:44 +03:00
Alexey Milovidov
b2edcfaa50 Applied clang-format #2272 2018-05-07 05:09:29 +03:00
Alexey Milovidov
723cc53948 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:08:38 +03:00
Alexey Milovidov
c4ff517b8e Fixed style [#CLICKHOUSE-2] 2018-05-07 05:08:38 +03:00
Alexey Milovidov
1dc1ccc1d8 Applied clang-format #2272 2018-05-07 05:08:38 +03:00
Alexey Milovidov
e26abf0ab4 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:08:38 +03:00
Alexey Milovidov
59bc8e1b48 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:07:47 +03:00
Alexey Milovidov
619a0dbd8c Fixed style [#CLICKHOUSE-2] 2018-05-07 05:07:17 +03:00
Alexey Milovidov
90427db854 Applied clang-format #2272 2018-05-07 05:06:55 +03:00
Alexey Milovidov
598c7fddb7 Applied clang-format to some imported code [#CLICKHOUSE-2] 2018-05-07 05:06:00 +03:00
Alexey Milovidov
94369e55d3 Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:29 +03:00
Alexey Milovidov
956128a67a Fixed style a bit [#CLICKHOUSE-2] 2018-05-07 05:01:11 +03:00
Alexey Milovidov
a687c90100 Allow to link with LLVM if it was compiled without RTTI #2277 2018-05-07 03:00:12 +03:00
proller
81e2467283 Squashed commit of the following: 
commit f1c193ea483872fee44e2969fc79a9b111a61d3d
Author: proller <proller@github.com>
Date:   Sun May 6 16:28:46 2018 +0300

    Clang5 build fix

commit c0ff4234747858dfd7741c90a5c77e9f8d47cd40
Merge: 852e11b 71814a3
Author: proller <proller@github.com>
Date:   Sun May 6 16:04:26 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix15

commit 852e11b409
Author: proller <proller@github.com>
Date:   Sat May 5 20:15:40 2018 +0300

    Try master

commit 2a5cebb5e5
Author: proller <proller@github.com>
Date:   Sat May 5 19:34:55 2018 +0300

    Try fix contrib/capnproto error with new compilers

commit bbfe581683
Merge: f493474 634ba89
Author: proller <proller@github.com>
Date:   Sat May 5 19:25:01 2018 +0300

    Merge remote-tracking branch 'upstream/master' into fix15

commit f49347469d
Author: proller <proller@github.com>
Date:   Sat May 5 15:31:47 2018 +0300

    Build fixes
 2018-05-06 16:29:51 +03:00
Alexey Milovidov
71814a33d5 Fixed code #2272 2018-05-06 14:34:31 +03:00
Alexey Milovidov
9da677719c Fixed code #2272 2018-05-06 14:34:16 +03:00
Alexey Milovidov
daed1ea0dc Fixed code #2272 2018-05-06 14:33:19 +03:00
Alexey Milovidov
63625c0a30 Fixed code #2272 2018-05-06 14:33:03 +03:00
Alexey Milovidov
ee019183d2 Fixed code #2272 2018-05-06 14:31:14 +03:00
Alexey Milovidov
04d1c8c449 Fixed code #2272 2018-05-06 14:29:17 +03:00
Alexey Milovidov
b580d1c487 Allow to build with clang 7 2018-05-06 14:16:38 +03:00
Alexey Milovidov
6c7f896f9f Miscellaneous #2277 2018-05-06 13:42:35 +03:00
Alexey Milovidov
69c67b4cd4 Addition to prev. revision #2277 2018-05-06 12:37:16 +03:00
Alexey Milovidov
c4a26764ce Miscellaneous #2277 2018-05-06 12:32:36 +03:00
Alexey Milovidov
f495d8cfa5 Removed deprecated CMake function #2277 2018-05-06 12:30:35 +03:00
Alexey Milovidov
b1b95454cc Make warning suppressions more local #2277 2018-05-06 12:29:57 +03:00
Alexey Milovidov
53f03a4909 Merge branch 'llvm-jit' of https://github.com/pyos/ClickHouse into pyos-llvm-jit 2018-05-06 12:22:42 +03:00
Alexey Milovidov
f589149189 Fixed build of embedded compiler with clang 7 [#CLICKHOUSE-2] 2018-05-06 12:04:10 +03:00
Alexey Milovidov
a8deddbc68 Removed useless code [#CLICKHOUSE-2] 2018-05-06 09:52:23 +03:00
Alexey Milovidov
4bc5163b80 Fixed build with clang 7 #2277 2018-05-06 09:35:59 +03:00
Alexey Milovidov
a227a984b5 Fixed warning found by clang 7 [#CLICKHOUSE-2] 2018-05-06 09:29:57 +03:00
Alexey Milovidov
a5dd90c35e Added a patch for cc1as_main from clang7 #2277 2018-05-06 09:03:36 +03:00
Alexey Milovidov
2ba241b06e Fixed build of embedded compiler with clang 7 #2277 2018-05-06 09:03:05 +03:00
Alexey Milovidov
a0f1b1f1ee Whitespace [#CLICKHOUSE-2] 2018-05-06 05:21:59 +03:00
proller
634ba89f90 Build fixes 2018-05-05 15:34:17 +03:00
pyos
88bb2f7c25 Resolve symbols right after compiling. 
llvm::orc::RTDyldObjectLinkingLayer::findSymbol appears to be non-threadsafe.
 2018-05-05 00:38:17 +03:00
proller
7781492624 Fix user name on distributed queries (#2292) 
* Fix user name on distributed queries

* wip

* fix
 2018-05-05 00:21:23 +03:00
KochetovNicolai
e0addcdfec
Update ColumnVector.cpp 
Fixed memset bytes count.
 2018-05-03 20:29:53 +03:00
pyos
a286dea2e1 Don't waste time jit-compiling isolated functions. 
This is already done ahead of time when building the executable.
 2018-05-03 16:34:42 +03:00
Vitaliy Lyudvichenko
63cc34d3f6 Fixed incorrect failed OP detection in ZooKeeper. [#CLICKHOUSE-2] 2018-05-03 16:34:19 +03:00
pyos
23bbf632e5 If all inputs to a jitted function are constant, return a constant 2018-05-03 16:33:40 +03:00
pyos
accbbdb9e3 Add a setting that disables jit-compilation 2018-05-03 00:48:20 +03:00
pyos
900b92f744 Merge API changes from upstream 2018-05-01 22:52:33 +03:00
pyos
27f12eeaa3 Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-05-01 22:51:37 +03:00
alexey-milovidov
52c58d3a82
Merge pull request #2308 from ilyshnikova/master 
Without std::move
 2018-05-01 12:35:57 -07:00
Tsarkova Anastasia
3a36569439 Without std::move 2018-05-01 21:34:42 +02:00
alexey-milovidov
81161be755
Merge pull request #2307 from ilyshnikova/master 
Without std::move
 2018-05-01 12:32:37 -07:00
Tsarkova Anastasia
8245dc3f6a Without std::move 2018-05-01 21:31:01 +02:00
alexey-milovidov
cb221cee29
Merge pull request #2306 from ilyshnikova/master 
struct instead of class
 2018-05-01 12:20:03 -07:00
Tsarkova Anastasia
ba901ebc3f struct instead of class 2018-05-01 21:18:13 +02:00
alexey-milovidov
9be89bd0d4
Merge pull request #2272 from ilyshnikova/master 
Conditional computations.
 2018-05-01 12:08:46 -07:00
Tsarkova Anastasia
9412222f55 Add test. 2018-05-01 15:33:39 +02:00
Tsarkova Anastasia
7c9741ed5b Fix style. 2018-05-01 15:31:38 +02:00
Tsarkova Anastasia
fe0753a128 Minor fixes, adding test case. 2018-05-01 15:24:43 +02:00
pyos
7483ed24f0 Implement jit for logic functions 2018-05-01 14:43:15 +03:00
Tsarkova Anastasia
210a389592 Getting rid of measure action, other small fixes applied. 2018-04-30 21:33:32 +02:00
pyos
e4ace21f24 Remove laziness on nullable arguments from default implementation 
It breaks semantics, sadly.
 2018-04-30 15:35:32 +03:00
pyos
4970b06b57 Remove outdated comments 2018-04-30 02:21:45 +03:00
pyos
039c377a7a Work around a bug in llvm::IRBuilder::CreateMaxNum 2018-04-30 02:07:39 +03:00
pyos
059bbcacca Implement jit for most arithmetic functions, remove the test function 2018-04-30 01:43:02 +03:00
pyos
7529aa55a4 Fix a bug that limited inlining depth at 2 2018-04-30 01:23:27 +03:00
Tsarkova Anastasia
a99ff6f380 Fix tests. 2018-04-29 23:48:33 +02:00
Tsarkova Anastasia
9286c98789 Fix build. 2018-04-29 23:13:01 +02:00
pyos
b4c7bee12b Merge branch 'master' of https://github.com/yandex/ClickHouse into llvm-jit 2018-04-29 23:22:18 +03:00
pyos
72f2fea837 Extract the code that compiles a single IFunctionBase from LLVMFunction 2018-04-29 21:03:58 +03:00
pyos
1be009d485 Remove getDefaultNativeValue in favor of llvm::Constant::getNullValue 2018-04-29 20:32:30 +03:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master 2018-04-29 18:02:34 +02:00
Tsarkova Anastasia
2c96b1c684 Add comments. Change projection restoring function. 2018-04-29 15:49:58 +02:00
pyos
01aaf99d75 Use C++17 fold expressions to simplify FunctionsArithmetic.h 2018-04-29 16:04:28 +03:00
pyos
fb577b1049 Hide the whole JIT API behind #if USE_EMBEDDED_COMPILER 
Kind ugly, but at least the conditionals are used consistently now.
 2018-04-29 13:48:16 +03:00
pyos
4641e2960f Move ExpressionActions::compileFunctions to ExpressionJIT.cpp. 
This means ExpressionJIT.h only has to expose one function.
 2018-04-29 13:39:01 +03:00
pyos
08345628a2 Support {Date,DateTime,Interval,UUID,FixedString} in compiled functions 2018-04-28 18:55:48 +03:00
pyos
6e05c5ace4 compilePrologue() isn't particularly useful after all. 
Basically the only thing it can do that compile() can't is create 'alloca'
instructions, which are only needed to get pointers to stack variables.
Given that dynamically-sized allocations aren't possible with this API,
such pointers are probably completely pointless (heh).
 2018-04-28 18:11:23 +03:00
pyos
1ffc2a0775 Make LLVMFunction monotonicity computation shorter (and fix a typo-bug) 2018-04-28 17:41:24 +03:00
pyos
a1eb938ed2 Inline nullable number constants into compiled code. 
Also, protect against some segfaults during compilation by checking
correctness of the type returned by compile().
 2018-04-28 17:12:00 +03:00
pyos
ccc895d162 Represent nullable types as pairs instead of pointers. 
Turns out LLVM has insertvalue & extractvalue for struct in registers. This is
faster than pointers because null checks are now subject to more optimizations.
 2018-04-28 14:12:23 +03:00
pyos
5c75342d54 Check nativity of all types *before* calling isCompilable 2018-04-28 01:03:52 +03:00
pyos
979c4d959f Let jit-compilable functions deal with NULLs themselves. 
And provide a default implementation of compile() for nullable columns
that actually works and is consistent with execute().
 2018-04-28 00:34:27 +03:00
alexey-milovidov
093c054b1f
Merge pull request #2263 from luc1ph3r/arbitrary-csv-delimiter 
Support an arbitrary CSV delimiter
 2018-04-27 13:13:09 -07:00
alexey-milovidov
96e2dfa790
Update SettingsCommon.h 2018-04-27 13:12:26 -07:00
pyos
49b61cd27d Refactor LLVMFunction to make extending to DataTypeNullable easier 2018-04-27 18:44:38 +03:00
Ivan Zhukov
a9653e5759 Add a test for CSV input and output formatting 2018-04-27 03:49:44 +03:00
proller
bef63d1dd0 Test: fill CLICKHOUSE_CONFIG from args.configserver 2018-04-26 23:02:10 +03:00
Vitaliy Lyudvichenko
e152f223c9 Fix nodes leak in case of session expiration. [#CLICKHOUSE-2] 2018-04-26 22:46:45 +03:00
Vitaliy Lyudvichenko
ed25e6d634 Fixed tests isolation. [#CLICKHOUSE-2] 2018-04-26 22:46:45 +03:00
pyos
a9e0b6de9f Use system LLVMConfig.cmake with minor tweaks. 
Should fix Travis build, finally.
 2018-04-26 22:45:39 +03:00
Vitaliy Lyudvichenko
af82c78a45 Fix nodes leak in case of session expiration. [#CLICKHOUSE-2] 2018-04-26 22:43:51 +03:00
Vitaliy Lyudvichenko
4695511b58 Fixed tests isolation. [#CLICKHOUSE-2] 2018-04-26 22:21:32 +03:00
Ivan Zhukov
4094e21be5 Code review 2018-04-26 20:41:43 +03:00
pyos
b4d527ee85 Inline compile-time constants into jitted functions. 2018-04-26 14:30:16 +03:00
pyos
c95f8a669f Throw in untyped versions of IFunction::{isCompilable,compile} 
IFunction inherits IFunctionBase for some reason despite not actually knowing
the types, so these two methods make no sense. The versions with DataTypes&
as an argument should be used instead.
 2018-04-25 20:07:19 +03:00
pyos
9ae5fe1b6d Minor style fixes 2018-04-25 18:33:58 +03:00
pyos
854f85dd9b Put #if USE_EMBEDDED_COMPILER in ExpressionJIT.{cpp,h} 2018-04-25 18:19:22 +03:00
pyos
d59b0d7ec0 Add IColumn::getRawData to fixed-contiguous columns 2018-04-25 18:16:48 +03:00
pyos
6c275c27d0 Remove an unnoticed debug return 2018-04-25 16:44:24 +03:00