Commit Graph

8909 Commits

Author SHA1 Message Date
Vitaliy Lyudvichenko
cabf6d7799 Add better logging if OPTIMIZE cannot be executed. [#CLICKHOUSE-2] 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
a65e8d9ffc Less noisy logging. [#CLICKHOSUE-2] 2017-10-12 22:28:24 +03:00
Vitaliy Lyudvichenko
c0716da718 Resolves #1273. Exception safe users update. [#CLICKHOUSE-3] 2017-10-12 22:28:24 +03:00
Alexey Milovidov
d880762e0a Removed tcp_ssl_port by default [#CLICKHOUSE-2]. 2017-10-12 21:30:45 +03:00
Alexey Milovidov
d468473d62 Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369]. 2017-10-12 21:21:17 +03:00
proller
f42ae974d1 Remove wrong test 2017-10-11 21:22:28 +03:00
Alexey Milovidov
4814eb7072 Whitespaces [#CLICKHOUSE-2]. 2017-10-11 17:41:49 +03:00
Marek Vavruša
7fc08389c9 Storages: added Kafka table engine (read-only)
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.

It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.

Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
Marek Vavruša
011658bb02 contrib: include librdkafka as submodule 2017-10-10 08:33:00 -07:00
Marek Vavruša
cbf9aaca95 dbms: fixed minor mistakes with build
* Use std::abs instead of abs() to properly support floats
2017-10-10 08:32:42 -07:00
proller
47798f0b8a Fix PerformanceTest runs 2017-10-10 16:32:31 +03:00
proller
975e8575c7 Add test (failed on version 1.1.54292) (#1328)
* Tests: External: rename --use_http  => --no_http and fix

* Add test (failed on version 1.1.54292)
2017-10-09 20:22:15 +03:00
alexey-milovidov
2dfb3fa463 Update AggregateFunctionTopK.h 2017-10-09 01:12:38 +03:00
alexey-milovidov
6e5ea5cc10 Update AggregateFunctionTopK.h 2017-10-09 01:12:38 +03:00
Marek Vavruša
28bb5e25cf AggregateFunctionTopK: read alphaMap for generic
* the alpha_map vector always (de)serialises
  the actual version (could empty sometimes)
* AggregateFunctionTopK generic variant deserialises
  it as well instead of ignoring it
* AggregateFunctionTopK generic variant clears the
  array before deserialising

refs #1283
2017-10-09 01:12:38 +03:00
robot-metrika-test
6628b5d308 Auto version update to [54299] 2017-10-09 00:39:00 +03:00
proller
19042816c4 Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 ) (#1325) 2017-10-06 19:26:32 +03:00
proller
704fee8750 Tests: External: rename --use_http => --no_http and fix (#1324) 2017-10-06 18:58:24 +03:00
robot-metrika-test
95ebdd53c0 Auto version update to [54297] 2017-10-05 12:22:56 +03:00
proller
d498e8e152 Try fix work with not connected sockets (#1320)
* Lazy fd_to_replica_state_idx init; Fix work with not connected sockets

* Style

* const
2017-10-04 18:18:05 +03:00
Vitaliy Lyudvichenko
723f36ec6d Fixed integration tests after introduction of 'clickhouse server' commands. [#CLICKHOUSE-2] 2017-10-04 18:15:40 +03:00
alexey-milovidov
96d1ab89da Update Server.cpp 2017-10-03 22:12:44 +03:00
proller
88c88c3f4a Fix 2017-10-03 22:12:44 +03:00
proller
7feb94357b use enum class 2017-10-03 22:12:44 +03:00
proller
a4191614ed fixes 2017-10-03 22:12:44 +03:00
proller
add13f233e requested changes 2017-10-03 22:12:44 +03:00
proller
b289e0027d fix 2017-10-03 22:12:44 +03:00
proller
dc50ea2788 fix 2017-10-03 22:12:44 +03:00
proller
2db34a606a clean 2017-10-03 22:12:44 +03:00
proller
b7780aa6c4 Better ports 2017-10-03 22:12:44 +03:00
proller
2467530583 Works! 2017-10-03 22:12:44 +03:00
proller
ebb4a6a0ed Start ssl'ing (#CLICKHOUSE-3032) 2017-10-03 22:12:44 +03:00
proller
097357799d Tests: --random option; set some env variables for .sh tests 2017-10-03 21:31:32 +03:00
Vitaliy Lyudvichenko
f08545b9b8 Stop tests execution on KeyboardInterrupt. [#CLICKHOUSE-2] 2017-10-03 19:21:25 +03:00
alexey-milovidov
3382a730b8 Merge pull request #1315 from yandex/libunwind-fix
Libunwind fix
2017-10-03 17:06:37 +03:00
Vitaliy Lyudvichenko
97277ed691 Return 411 code in case of empty body without Content-Length head. [#CLICKHOUSE-3333] 2017-09-30 14:06:50 +03:00
robot-metrika-test
5fdede6d85 Auto version update to [54294] 2017-09-29 01:08:47 +03:00
proller
8f3a244d26 Fix internal compiler with some new clang packages 2017-09-27 17:52:24 +03:00
proller
d469e5eddd Fix no-shard tests 2017-09-26 23:55:22 +03:00
proller
c46ce859a1 Fix tests on clean storage 2017-09-26 23:37:03 +03:00
proller
5250650f65 Fixes (#1286)
* Revert "Simplification [#CLICKHOUSE-2]."

This reverts commit 98ad6a5db3.

* Fix error: comparison of unsigned expression < 0 is always false

* Fix float division by zero

* Fix float division by zero

* Disable PointInPolygon function if compiling with old clang

* Fix warning:
dbms/src/Functions/FunctionsCoding.h:336:21: error: comparison of constant -1 with expression of type 'const char' is always true [-Werror,-Wtautological-constant-out-of-range-compare]
            if (num != -1)

* Fix
2017-09-26 23:29:34 +03:00
Alexey Zatelepin
6e57272052 don't use partition value as a prefix for FREEZE PARTITION [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
bfd87add7d improve getExremes(), fix for ColumnNullable [#CLICKHOUSE-2] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f1a8b9bfa1 add comments [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
61f0b32757 forbid ALTER of partition key columns for now [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
4160bcfdf5 add custom partitioning tests [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
1be62b567e safeguards to protect against distinct partition values with the same partition_id [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
a10ba0cd91 serialize partition key in Replicated tables metadata [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
909b46de0f add MergeTreeDataFormatVersion constant [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
ceddecbc10 implement missing getExtremes() functions [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
f0995f2741 partition serialization into id and text [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
25bb444d5a absence of partitioning works [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
71ebf67f2e encapsulate partition and minmax_idx load/store code [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
6906921932 load partition and minmax index from disk [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
e9f93028b8 serialize partition and minmax index values [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
2f80c150db save MergeTree data format version and parse part names depending on it [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Nikolai Kochetov
937d3f3883 added test [#CLICKHOUSE-3339] 2017-09-26 20:34:48 +03:00
Nikolai Kochetov
1592691e47 fixed defalut Nullable implementation for Const(Nullable) columns 2017-09-26 20:34:48 +03:00
Nikolai Kochetov
c8ffca746e fixed defalut Nullable implementation for Const(Nullable) columns [#CLICKHOUSE-3339] 2017-09-26 20:34:48 +03:00
Nikolai Kochetov
c8dc25815f fixed pointinPolygon test, clang build 2017-09-26 19:07:00 +03:00
proller
ed848a7186 Fix warning on arm 2017-09-24 16:59:18 +03:00
Vitaliy Lyudvichenko
56884c1b0d A small enhancement. CLICKHOUSE-3333. 2017-09-24 02:52:49 +03:00
KochetovNicolai
6096227cb2 Point in polygon (#1269)
* added FunctionPointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid with holes [#CLICKHOUSE-3201]

* added arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed shifted grid for PointInPolygonWithGrid, added test [CLICKHOUSE-3201]

* expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fix expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added pool to PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* fixed test [#CLICKHOUSE-3201]

* unified signature for PointInPolygon [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* supported Float64 for pointInPolygon [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fixed check for numeric tuple in PointInPolygon function [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* added profile events polygons pool [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* Update FunctionsGeo.cpp

* made grid_size argument of PointInPolygon; style fixes [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* renamed pointInPolygon functions [#CLICKHOUSE-3201]
2017-09-24 02:47:43 +03:00
Vitaliy Lyudvichenko
9d3f28f52d Fix an error for POST queries with empty body. [#CLICKHOUSE-3333] 2017-09-24 02:38:12 +03:00
alexey-milovidov
b205a2b970 Update HTTPHandler.cpp 2017-09-24 02:21:09 +03:00
alexey-milovidov
e3694e479b Update HTTPHandler.cpp 2017-09-24 02:21:09 +03:00
Vadim Skipin
7e51a06794 Do not allow to mix authorization schemes 2017-09-24 02:21:09 +03:00
Nikolai Kochetov
9a19cdb617 added test 2017-09-24 02:16:30 +03:00
Nikolai Kochetov
322e56c692 fix reading with preferred_block_size_bytes = 0 2017-09-24 02:16:30 +03:00
Vitaliy Lyudvichenko
48c5382c92 Add 'clickhouse compressor' command. [#CLICKHOUSE-2] 2017-09-24 02:15:56 +03:00
Vitaliy Lyudvichenko
7ee2c52328 Use clickhouse extract-from-config intead of clickhouse --extract-from-config and so on. [#CLICKHOUSE-2928] 2017-09-24 02:15:56 +03:00
robot-metrika-test
037a2a378d Auto version update to [54292] 2017-09-20 21:05:46 +03:00
Alexey Milovidov
1331dc0b1c Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-20 20:14:53 +03:00
Alexey Milovidov
ac2b615890 Fixed test on Ubuntu Precise [#CLICKHOUSE-2]. 2017-09-20 20:14:45 +03:00
robot-metrika-test
d44c2c1924 Auto version update to [54291] 2017-09-20 19:34:05 +03:00
Alexey Milovidov
045675be20 Merge branch 'master' of github.com:yandex/ClickHouse 2017-09-20 19:32:07 +03:00
Alexey Milovidov
3d219b220b Fixed test [#CLICKHOUSE-3]. 2017-09-20 19:31:44 +03:00
Alexey Zatelepin
df58949a68 make exit out of the loop possible when ZooKeeper is unavailable [#CLICKHOUSE-3259] 2017-09-20 06:05:20 +03:00
Alexey Zatelepin
ba87fa395c be more conservative when deleting replication queue items in PartCheckThread [#CLICKHOUSE-3258] 2017-09-20 06:05:20 +03:00
robot-metrika-test
40b2fc4e30 Auto version update to [54290] 2017-09-20 05:58:20 +03:00
KochetovNicolai
e0efb7e8c1 Point in polygon (#1264)
* added FunctionPointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for PointInPolygonWithGrid with holes [#CLICKHOUSE-3201]

* added arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added test for arbitrary orientation for polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed shifted grid for PointInPolygonWithGrid, added test [CLICKHOUSE-3201]

* expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fix expand box for complex polygons in PointInPolygonWithGrid [#CLICKHOUSE-3201]

* added pool to PointInPolygonWithGrid [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* changed FunctionPointInPolygonWithGrid signature [#CLICKHOUSE-3201]

* fixed test [#CLICKHOUSE-3201]

* unified signature for PointInPolygon [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* supported Float64 for pointInPolygon [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fix build [#CLICKHOUSE-3201]

* fixed check for numeric tuple in PointInPolygon function [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* added profile events polygons pool [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* fixed build [#CLICKHOUSE-3201]

* Update FunctionsGeo.cpp
2017-09-20 05:30:44 +03:00
alexey-milovidov
76e3f7ac0c Merge pull request #1250 from bocharov/master
Add new aggregate function sumMap(key, value).
2017-09-19 21:31:24 +03:00
Alex Bocharov
e99c969a1c Aggregate function sumMap: improve insertResultInto method and change return type to Tuple(Array(K), Array(V)). 2017-09-19 13:35:25 +01:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alex Bocharov
07cd6829d0 Aggregate function sumMap: fix compilation error regarding getHeaderFilePath after merge with master. 2017-09-18 19:37:44 +01:00
Alex Bocharov
55e1559733 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:46:10 +01:00
Alex Bocharov
1f70d0e163 Resolve conflict in SummingSortedBlockInputStream when moving FieldVisitorSum. 2017-09-18 18:43:47 +01:00
Alex Bocharov
c1feea159e Aggregate function sumMap: optimize serialize/deserialize. 2017-09-18 18:11:16 +01:00
Alex Bocharov
6e74602e45 Aggregate function sumMap: use FieldVisitorSum instead of += operator. 2017-09-18 16:41:07 +01:00
alexey-milovidov
edb66bfffe Merge branch 'master' into master 2017-09-18 10:31:31 +03:00
Alexey Milovidov
ff1598c8d1 Improved performance of dynamic compilation [#CLICKHOUSE-2]. 2017-09-17 23:22:39 +03:00
Alexey Milovidov
156d48f3ee Removed aggregate function "debug" [#CLICKHOUSE-2]. 2017-09-17 23:12:02 +03:00
Alexey Milovidov
dd3e74c0eb Fixed weird translation [#CLICKHOUSE-2]. 2017-09-17 21:17:04 +03:00
Alexey Milovidov
4df44cfeb4 Modified comment [#CLICKHOUSE-2]. 2017-09-17 21:00:27 +03:00
Alexey Milovidov
565902fc4d Added comment; fixed test [#CLICKHOUSE-2]. 2017-09-17 20:58:30 +03:00
Alexey Milovidov
bc622c4c45 Better [#CLICKHOUSE-2]. 2017-09-17 03:13:26 +03:00
Alexey Milovidov
a5e8c5e8f5 Better [#CLICKHOUSE-2]. 2017-09-17 01:24:48 +03:00