Commit Graph

15847 Commits

Author SHA1 Message Date
pyos
df2d2e0b25 Tweak the jit compilation API to be more amenable to lazy computation 2018-04-25 13:37:26 +03:00
pyos
b2077a466a Inline jit-compilable functions into other jit-compilable functions 2018-04-25 13:37:26 +03:00
pyos
3810173103 Remove IFunction::createResultColumn.
Given that the list of supported types is hardcoded in
LLVMContext::Data::toNativeType, this method is redundant because
LLVMPreparedFunction can create a ColumnVector itself.
2018-04-25 13:37:26 +03:00
pyos
6b526f784c Enable the default set of LLVM optimization passes
I honestly can't tell if they work. LLVM has surprisingly bad API documentation.
2018-04-25 13:37:26 +03:00
pyos
8c8a8f9c0f Extend the test jit-compilable function to arbitrary numbers 2018-04-25 13:37:25 +03:00
pyos
5f1bf11ede Implement a loop over the columns in jit-compiled code 2018-04-25 13:37:25 +03:00
pyos
407008a4d9 Separate jit-compilability checks from actual compilation 2018-04-25 13:37:25 +03:00
pyos
e96a5e8344 Implement JIT compilation, without a loop for now.
It actually seems to work, so long as you only have one row that is. E.g.

    > select something(cast(number + 6 as Float64), cast(number + 2 as Float64)) from system.numbers limit 1';
    8

with this IR:

    define void @"something(CAST(plus(number, 6), 'Float64'), CAST(plus(number, 2), 'Float64'))"(void**, i8*, double*) {
    entry:
      %3 = load void*, void** %0
      %4 = bitcast void* %3 to double*
      %5 = load double, double* %4
      %6 = getelementptr void*, void** %0, i32 1
      %7 = load void*, void** %6
      %8 = bitcast void* %7 to double*
      %9 = load double, double* %8
      %10 = fadd double %5, %9
      store double %10, double* %2
      ret void
    }
2018-04-25 13:37:25 +03:00
pyos
b398ffbaba Map all number types to LLVM types.
The example from the previous commit doesn't need a cast to Float64 anymore.
2018-04-25 13:37:25 +03:00
pyos
851684de51 Add a JIT interface for row-wise default-nullable functions.
Not actually implemented, though. It does print out some jit-compiled stuff,
but that's about it. For example, this query:

    select number from system.numbers where something(cast(number as Float64)) == 4

results in this on server's stderr:

    define double @"something(CAST(number, 'Float64'))"(void**, i8*, void*) {
    "something(CAST(number, 'Float64'))":
      ret double 1.234500e+04
    }

(and an exception, because that's what the non-jitted method does.)

As one may notice, this function neither reads the input (first argument;
tuple of arrays) nor writes the output (third argument; array), instead
returning some general nonsense.

In addition, `#if USE_EMBEDDED_COMPILER` doesn't work for some reason,
including LLVM headers requires -Wno-unused-parameter, this probably only
works on LLVM 5.0 due to rampant API instability, and I'm definitely
no expert on CMake. In short, there's still a long way to go.
2018-04-25 13:37:25 +03:00
pyos
27d90fb941 Add an example function that uses LLVM to compile its own body 2018-04-25 13:37:25 +03:00
proller
899c65af63 Build fixes (#2275)
* Change obsolete comment

* Simpler disable logging to file in conf.d (<log/> <errorlog/>)

* Arm64 packag fixes

* Build fixes
2018-04-24 22:59:48 -07:00
Silviu Caragea
1dd5a704fc Merge remote-tracking branch 'origin/master' into background-schedule-pool-fix
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-24 20:11:59 +03:00
alexey-milovidov
6c73fb86e3 Update FunctionsMath.h 2018-04-24 10:11:03 -07:00
Babacar Diassé
22b2099b0b use exp10 and cbrt from vectorclass when enabled 2018-04-24 10:11:03 -07:00
Tobias Adamson
ea1e167acf Upgrade librdkafka to v0.11.4 2018-04-24 10:08:47 -07:00
Silviu Caragea
f8241120d7 Merge remote-tracking branch 'github/master' 2018-04-24 17:52:22 +03:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
sundy-li
e882acef31 fix:ODBC sqlType mapping 2018-04-23 22:55:06 -07:00
BayoNet
99b1cbb3c4 Fixed formatting of development/style.md 2018-04-24 01:16:40 +03:00
BayoNet
48ee13e2d9 Fixes of codeblock language and formatting. 2018-04-23 10:34:55 +03:00
BayoNet
765da09e4d Merge branch 'translation_en' with update of english translation. 2018-04-23 09:51:25 +03:00
BayoNet
32b6f0a8af English translation is updated. 2018-04-23 09:20:21 +03:00
Alexey Milovidov
2627a4da2e Better test #2066 2018-04-22 22:09:35 -07:00
Alexey Milovidov
afb7127c67 Better test #2066 2018-04-22 20:32:53 -07:00
Alexey Milovidov
289722e69c Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-22 20:30:39 -07:00
Alexey Milovidov
958a3d7ee7 Fixed error with Arrays inside Nested data type; added a test #2066 2018-04-22 20:30:28 -07:00
Vladislav Rassokhin
44f3584b28 Fix fragments formatting in access_rights.md 2018-04-23 03:40:04 +03:00
Ivan Zhukov
8cb45392c1 Propagate a CSV delimiter to non-basic DataTypes 2018-04-22 20:30:07 +03:00
Ivan Zhukov
4db476b5cd Update docs about a CSV format 2018-04-22 17:30:25 +03:00
Ivan Zhukov
e402ff3f81 Unify string checks with a new type 2018-04-22 02:42:01 +03:00
Ivan Zhukov
e84263eb3b Add a SettingChar type 2018-04-22 02:42:00 +03:00
Ivan Zhukov
a138ab2820 Add CSV delimter support in CSVRowOutputStream 2018-04-22 02:08:50 +03:00
Ivan Zhukov
91cb03bdaf Add delimiter support in CSVRowInputStream 2018-04-22 02:08:31 +03:00
Ivan Zhukov
1fc6bb6ffe Add a CSV delimiter setting 2018-04-22 01:20:39 +03:00
Alexey Milovidov
499b67642f Allow to startup with replicated tables in readonly mode when there is no ZooKeeper configured [#CLICKHOUSE-2] 2018-04-21 21:41:06 +03:00
proller
bd23b8790c Debian packages: better deprecated message, docker: do not use old package 2018-04-20 22:48:31 +03:00
robot-metrika-test
c6e29f0cbb Auto version update to [54380] 2018-04-20 22:47:21 +03:00
Alexey Milovidov
fb4a44a913 Added test #2257 2018-04-20 22:46:01 +03:00
Alexey Milovidov
5ba5e80846 Added correct code #2257 2018-04-20 22:45:23 +03:00
Alexey Milovidov
970fda46fd Merge branch 'master' of github.com:yandex/ClickHouse 2018-04-20 22:22:24 +03:00
Alexey Milovidov
9c750c4786 Added test #2257 2018-04-20 22:22:03 +03:00
alexey-milovidov
60fade5de8 Revert "ISSUES-1885 UTF8 countCodePoints use SIMD" 2018-04-20 22:18:24 +03:00
robot-metrika-test
8bbb295bbc Auto version update to [54379] 2018-04-20 22:15:52 +03:00
Alexey Milovidov
c087449023 Fixed error #2246 2018-04-20 22:14:04 +03:00
Alexey Milovidov
ac48e1e911 Fixed error #2246 2018-04-20 20:34:09 +03:00
alexey-milovidov
21a5d2dfde Update Macros.h 2018-04-20 19:10:26 +03:00
alexey-milovidov
c783a69d6b Update Macros.cpp 2018-04-20 19:10:26 +03:00
Kirill Shvakov
918dbc2902 #2249 allow macros while creating kafka engine 2018-04-20 19:10:26 +03:00
Ivan He
c94b0a1960 fix typo of struct name 2018-04-20 16:27:48 +03:00