Commit Graph

2245 Commits

Author SHA1 Message Date
Alexey Milovidov
fb38ef9a8e Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 06:56:56 +03:00
Alexey Milovidov
bed2d644e6 Merge remote-tracking branch 'origin/master' into cow_columns 2017-12-14 04:44:35 +03:00
Alexey Milovidov
f3bb24a3bf Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-14 04:43:19 +03:00
Alexey Milovidov
b3277408c4 Added fix from proller [#CLICKHOUSE-2]. 2017-12-13 23:43:51 +03:00
Alexey Milovidov
9cc424b4b5 Fixed error: loading "preprocessed" files if dictionary/model config was specified with glob [#CLICKHOUSE-3501]. 2017-12-13 23:21:03 +03:00
Alexander Avdonkin
331c5c3db8 Merge branch 'master' of github.com:aavdonkin/ClickHouse 2017-12-13 19:48:27 +03:00
Alexander Avdonkin
d1ee8c5358 Fixed issues 2017-12-13 19:46:57 +03:00
Alexey Milovidov
819287b697 Better semantic of sharing columns: development [#CLICKHOUSE-2]. 2017-12-13 04:27:53 +03:00
alexey-milovidov
62fb610e4e
Merge pull request #1447 from yandex/support-table-functions-for-desc-and-insert
Support table functions for desc and insert
2017-12-11 23:28:10 +03:00
proller
cbea7bdeb7 Add options to internal compiler: -nostdinc -nostdinc++ -Bprefix= --isysroot= 2017-12-11 23:27:17 +03:00
Alexey Milovidov
c3015bece3 Miscellaneous [#CLICKHOUSE-2]. 2017-12-11 01:44:04 +03:00
Alexey Milovidov
6cf5c63f4e Fixed error [#CLICKHOUSE-2] 2017-12-09 19:17:37 +03:00
Alexey Milovidov
3def5f03f5 Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
7f6c48d5de Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
Alexey Milovidov
d2cfda4d9b Cleanup semantics of data types [#CLICKHOUSE-2]. 2017-12-09 19:17:37 +03:00
alexey-milovidov
1d0df29e0f
Merge branch 'master' into master 2017-12-08 11:29:01 +03:00
Alexey Milovidov
16b06bd544 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 11:25:28 +03:00
Alexey Milovidov
c4a09a11f4 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 06:52:33 +03:00
Alexey Milovidov
00a7209607 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 04:34:52 +03:00
Alexey Milovidov
741a6e0066 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-08 03:50:25 +03:00
Alexey Milovidov
f5a06cee5b Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:47:13 +03:00
Alexey Milovidov
0ea105f639 Simplification of Nullable [#CLICKHOUSE-2] 2017-12-07 11:31:47 +03:00
Alexander Avdonkin
89db5040df Implemented MySQL and ODBC storages and table functions 2017-12-05 16:32:02 +03:00
alexey-milovidov
6c86bc2506
Merge pull request #1584 from yandex/table-system-models
added system.models
2017-12-05 00:25:04 +03:00
alexey-milovidov
575a67b5d2
Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-04 23:34:27 +03:00
Alexey Zatelepin
fb9c7ab81d remove experimental_allow_extended_storage_definition_syntax Setting (turn on by default) [#CLICKHOUSE-3000] 2017-12-04 22:45:18 +03:00
Nikolai Kochetov
d2710bd0f4 added system.models [#CLICKHOUSE-3477] 2017-12-04 16:32:49 +03:00
Alexey Milovidov
903dc680bb Fixed parsing and interpreting of tuples [#CLICKHOUSE-2]. 2017-12-03 11:16:49 +03:00
Alexey Milovidov
e71a6df79c Fixed warnings [#CLICKHOUSE-2]. 2017-12-03 06:22:25 +03:00
Alexey Milovidov
c748493a86 Better [#CLICKHOUSE-2]. 2017-12-02 05:47:12 +03:00
Alexey Milovidov
acd78e4891 Better [#CLICKHOUSE-2]. 2017-12-02 00:13:25 +03:00
Alexey Milovidov
431da20d99 Better [#CLICKHOUSE-2]. 2017-12-01 23:21:35 +03:00
Alexey Milovidov
bdd25b15bd Better [#CLICKHOUSE-2]. 2017-12-01 22:34:51 +03:00
Alexey Milovidov
1a6cb2989b Better [#CLICKHOUSE-2]. 2017-12-01 21:36:55 +03:00
Nikolai Kochetov
5cbacbc2d7 fixed test [#CLICKHOUSE-3397] 2017-12-01 21:21:37 +03:00
Alexey Milovidov
f5ecb2db5d Better [#CLICKHOUSE-2]. 2017-12-01 20:49:12 +03:00
alexey-milovidov
0ac2f5b479
Merge pull request #1559 from rlipovsky/geodata
[clickhouse-yt] separate geo dictionaries from data providers
2017-12-01 19:54:08 +03:00
alexey-milovidov
493e7a4976
Merge pull request #1571 from rlipovsky/get_user_by_ptr
[clickhouse-yt] more consistent ISecurityManager interface
2017-12-01 19:43:00 +03:00
alexey-milovidov
66fdecf6ec
Merge branch 'master' into geodata 2017-12-01 19:25:27 +03:00
alexey-milovidov
96695b54fa
Merge pull request #1555 from rlipovsky/external_dicts_repo
[clickhouse-yt] abstract config repository for user-defined objects (dictionaries, etc)
2017-12-01 19:23:08 +03:00
alexey-milovidov
6a3c824056
Update ExternalLoaderConfigRepository.cpp 2017-12-01 19:22:19 +03:00
alexey-milovidov
a48a519c8d
Update ExternalLoaderConfigRepository.cpp 2017-12-01 19:20:01 +03:00
Nikolai Kochetov
470c633e09 merged with master 2017-12-01 16:33:47 +03:00
Nikolai Kochetov
f025f22007 Merge branch 'master' into support-table-functions-for-desc-and-insert 2017-12-01 16:24:50 +03:00
Nikolai Kochetov
c60a1820a8 reverted changes in Cluster.cpp 2017-12-01 14:47:23 +03:00
Roman Lipovsky
430837706c more consistent ISecurityManager interface: return shared pointer to User to prevent race conditions with loadFromConfig 2017-11-30 17:53:12 +03:00
Kirill Shvakov
cd7f7b076e Merge branch 'add-description-to-settings-table' 2017-11-30 13:55:42 +02:00
Kirill Shvakov
4d73516508 Add description to system.settings table 2017-11-30 13:50:02 +02:00
Roman Lipovsky
44f8fcaf0d fix indentation 2017-11-29 15:48:28 +03:00
Roman Lipovsky
45637ddee8 fix indentation 2017-11-29 15:41:42 +03:00
Roman Lipovsky
9ed1ba2441 separate geo dictionaries from geo data providers 2017-11-29 01:15:06 +03:00
Roman Lipovsky
639d850d97 abstract config repository of user-defined objects (dictionaries, models) 2017-11-28 14:00:07 +03:00
Roman Lipovsky
ae6e9a870f edit comment 2017-11-28 04:12:57 +03:00
Roman Lipovsky
4eda095654 add comments 2017-11-28 04:12:57 +03:00
alexey-milovidov
1879fe93f1 Update Context.h 2017-11-28 04:12:57 +03:00
alexey-milovidov
7819424e2a Update Context.h 2017-11-28 04:12:57 +03:00
Roman Lipovsky
dd22bf2179 fix include 2017-11-28 04:12:57 +03:00
Roman Lipovsky
af6c6f0afa mark ISecurityManager::getUser as const 2017-11-28 04:12:57 +03:00
Roman Lipovsky
cf6dd4e73b abstractions: runtime components factory + security manager 2017-11-28 04:12:57 +03:00
Alexey Vasiliev
592f892821 fixed one more ConfigProcessor usage [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
Alexey Vasiliev
6cb97b9221 ConfigProcessor: do not create config-preprocessed before setting umask [#MOBMET-7044] 2017-11-25 02:00:10 +03:00
proller
0d3c4f4d67 Core/FieldVisitors.h -> Common/FieldVisitors.h
Core/Progress.h -> IO/Progress.h
    tests: sudo --non-interactive
    Fix freebsd link
2017-11-24 16:55:31 +03:00
Alexey Zatelepin
b2963d4c60 add current database to a CREATE SELECT query only for views [#CLICKHOUSE-3448] 2017-11-22 00:39:03 +03:00
proller
2778f35e48 Lib Parsers 2017-11-21 22:35:54 +03:00
Alexey Milovidov
07d594c505 Fixed linking [#CLICKHOUSE-2]. 2017-11-20 08:59:58 +03:00
Alexey Milovidov
01e8adbfff Removed "experimental" namespace [#CLICKHOUSE-2]. 2017-11-20 07:15:43 +03:00
alexey-milovidov
942e59d459
Merge pull request #1455 from yandex/fix-mv-populate
Fix applying WHERE clause in MATERIALIZED VIEW with POPULATE
2017-11-19 23:01:23 +03:00
Alexey Milovidov
60825748d4 Merge branch 'fix11' of https://github.com/proller/ClickHouse into proller-fix11 2017-11-19 22:57:28 +03:00
Pavel Yakunin
bb967007ff merged master 2017-11-19 10:55:46 +03:00
Pavel Yakunin
bd62ea2535 To support "incl" directive in the dictionaries config ConfigProcessor is now used to parse external modules configuration.
"include_from" directive also works if the config has "<yandex>" as the root element. Otherwise default include file will be used.

To enable substitutions in a dictionary config one needs to have it in the following form:
<yandex>
	<include_from>...</include_from>
	<dictionary>
		<name incl="dict_name"></name>
		...
	</dictionary>
</yandex>

instead of

<dictionaries>
        <include_from>...</include_from>
        <dictionary>
                ...
        </dictionary>
</dictionaries>

The latter form will still work if no substitutions are used or if the default includes file exist. So no outright configuration change is necessary on the existing installations.
2017-11-19 09:33:20 +03:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Alexey Milovidov
7c9ba15ba1 Style [#CLICKHOUSE-2]. 2017-11-17 23:42:03 +03:00
proller
5ba7e20c03 fixes 2017-11-17 22:40:27 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Marek Vavruša
64a892c0e6 DataStreams: CapnProto uses <format_schema_path> config option
This addresses one of the remarks in the PR.

All format schemas are required to be in the <format_schema_path> directory.
This makes loading schema files less tedious, as the path can be omitted.
2017-11-15 23:17:22 +03:00
Alexey Milovidov
2846c7560f Fixed wording [#CLICKHOUSE-2]. 2017-11-15 22:47:49 +03:00
Alexander Makarov
84b2f16913 fixed several UB-abusing places 2017-11-15 22:22:32 +03:00
alexey-milovidov
855742ba4e
Merge pull request #1426 from yandex/catboost-models
Catboost models
2017-11-13 22:06:22 +03:00
Alexey Milovidov
c8dbea9d36 Merge branch 'embedded-compiler' 2017-11-12 16:09:56 +03:00
Alexey Milovidov
fd8c418416 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 16:09:08 +03:00
alexey-milovidov
9b18c6cb76
Embedded compiler (#1484)
* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].

* Embedded compiler: development [#CLICKHOUSE-3396].
2017-11-12 15:58:40 +03:00
Alexey Milovidov
6d84a88629 Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 09:46:42 +03:00
Alexey Milovidov
5074301f8d Embedded compiler: development [#CLICKHOUSE-3396]. 2017-11-12 08:14:39 +03:00
Иванов Евгений
e846d62410 Added support UUID type for distinct, uniq* functions and joins 2017-11-12 04:07:05 +03:00
Alexey Milovidov
a3fa44e71a Miscellaneous [#CLICKHOUSE-2]. 2017-11-12 03:46:22 +03:00
Nikolai Kochetov
cdd852902d Merge branch 'master' into catboost-models 2017-11-10 14:40:08 +03:00
Alexey Milovidov
90ca758522 Miscellaneous [#CLICKHOUSE-3]. 2017-11-09 16:44:08 +03:00
Alexey Zatelepin
d6b82a28fd clone query when populating MaterializedView so that it is not garbled [#CLICKHOUSE-3412] 2017-11-05 20:50:12 +03:00
Alexey Milovidov
783e812eb7 Fixed error [#CLICKHOUSE-2] 2017-11-04 19:46:14 +03:00
Alexey Milovidov
1aaff5762c Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 06:20:18 +03:00
Alexey Milovidov
fa8bcccdb9 Attempt to change ext::shared_ptr_helper (incomplete) [#CLICKHOUSE-2]. 2017-11-04 00:50:22 +03:00
Nikolai Kochetov
1cee62eb0a supported table_function in insert query [#CLICKHOUSE-3397] 2017-11-03 16:25:39 +03:00
Nikolai Kochetov
1d01d228a4 removed macro DEFINE_AST_QUERY_WITH_TABLE_AND_OUTPUT
supported table_functions in desctibe table query [#CLICKHOUSE-3397]
2017-11-03 16:24:52 +03:00
proller
d940d1713c Cmake: silent poco warnings, use compiler version defenition by cmake (#1440)
Cmake: silent poco warnings, use compiler version definition by cmake
2017-11-03 00:30:27 +03:00
proller
dadb32d042 Fix freebsd build (#1428)
* Fix compile with boost 1.65.1+ and clang 3.8 ( https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=222439 )

* Fix compile CallPointInPolygon on clang4 (Thanks to @vavrusa)

* Fix freebsd build

* Fix build with installed system cityhash
2017-10-31 22:45:58 +03:00
Nikolai Kochetov
554bb889ac merged with master 2017-10-31 15:04:13 +03:00
Nikolai Kochetov
18ef139e9d load features count from catboost model file [#CLICKHOUSE-3305] 2017-10-31 14:50:24 +03:00
Alexey Zatelepin
f2ebffb7f0 save TO table of a materialized view to the ATTACH query [#CLICKHOUSE-2] 2017-10-30 21:39:39 +03:00
alexey-milovidov
56ef2e9196
Merge pull request #1380 from yandex/catboost-models
Catboost models
2017-10-30 19:16:41 +03:00
Alexey Milovidov
5ab78c249d Fixed build after merge [#CLICKHOUSE-2]. 2017-10-28 00:18:06 +03:00
Alexey Zatelepin
514a4d4fba use stale local replica if all remote replicas are unavailable [#CLICKHOUSE-3377] 2017-10-27 23:46:19 +03:00
alexey-milovidov
9e200bdfd9
Merge branch 'master' into materialized-view-to 2017-10-27 23:21:27 +03:00
alexey-milovidov
b4bb6796c1
Merge pull request #1407 from yandex/CLICKHOUSE-3381
Ability to turn off deduplication, smart deduplication for MV
2017-10-27 23:03:25 +03:00
Nikolai Kochetov
b66577e38a changed ExternalLoaderUpdateSettings [#CLICKHOUSE-3305] 2017-10-26 21:39:55 +03:00
Alexey Milovidov
a27981b4ef Get rid of double whitespaces [#CLICKHOUSE-2]. 2017-10-26 21:36:23 +03:00
Nikolai Kochetov
10bbf0871b added comments [#CLICKHOUSE-3305] 2017-10-26 21:30:28 +03:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Nikolai Kochetov
371e234f01 changed ExternalLoader::getObjectsMap return type [#CLICKHOUSE-3305] 2017-10-26 17:26:03 +03:00
Nikolai Kochetov
2e6b1dfd92 renamed cloneObject to clone in IExternalLoadable [#CLICKHOUSE-3305] 2017-10-26 16:42:14 +03:00
Alexey Zatelepin
f130d2df65 fix creation of system log tables [#CLICKHOUSE-2] 2017-10-26 15:44:47 +03:00
Alexey Zatelepin
88c4ea1ac3 allow specifying ENGINE for CREATE TEMPORARY TABLE (but only if it is Memory) [#CLICKHOUSE-2] 2017-10-26 15:15:33 +03:00
Alexey Zatelepin
01c39dcf1c fix CREATE TABLE bugs and idiosyncrasies: [#CLICKHOUSE-3000]
* fix segfault on ATTACH MATERIALIZED VIEW
* allow only TEMPORARY TABLEs (not databases or views)
* forbid choosing ENGINE for TEMPORARY tables
* fix segfault on CREATE TABLE t1 AS t2 where t2 is a View
2017-10-26 07:53:52 +03:00
Alexey Milovidov
65982a1642 Fixed exception messages [#CLICKHOUSE-2]. 2017-10-25 22:17:37 +03:00
Marek Vavruša
d942ca0c0b Updated exceptions and added comments. 2017-10-24 17:57:03 -07:00
alexey-milovidov
b5155916a8 Merge branch 'master' into materialized-view-to 2017-10-24 22:39:24 +03:00
Alexey Zatelepin
6bb34a4494 Merge branch 'master' into arbitrary-partitioning
Conflicts:
	dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Marek Vavruša
f4c1149606 Settings: renamed schema to format_schema 2017-10-23 20:47:33 +03:00
proller
c66228a746 Log query id in executeQuery; Better type mismatch error; change format in report tool (#1372)
* Log query id in executeQuery; Better type mismatch error; change format in report tool

* Better log query_id

* fix message

* Use c++11 thread_local instaed of gcc's __thread

* lock mutex before notifying waiting thread in sync insertion into distributed [#CLICKHOUSE-3379]

* Cmake: fix build without downloaded submodules (#1379)

* fix
2017-10-23 20:32:39 +03:00
Marek Vavruša
5f53df7dbe ParserCreateQuery: allow ATTACH TABLE x shorthand statement
Allow `ATTACH TABLE [db.]name` if the table was previously detached,
an the table structure can be read from disk. This makes reattaching
tables less cumbersome:

```
CREATE TABLE test.t (x UInt8) ENGINE = Null;
DETACH TABLE test.t;
ATTACH TABLE test.t;
```
2017-10-21 13:38:39 -07:00
Marek Vavruša
975a7ada42 StorageMaterializedView: allow CREATE MATERIALIZED VIEW x TO y
This allows creation of materialized views without inner tables,
using an existing table for materialized rows instead.
This is useful for cases when you want to detach the materializing
view, but keep the already materialized data readable, especially
when the inner table is replicated.
2017-10-21 13:34:59 -07:00
Alexey Zatelepin
1f76900500 move CREATE query rewriting for views to Interpreter [#CLICKHOUSE-2] 2017-10-20 21:28:43 +03:00
Alexey Zatelepin
75c65c7b59 use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Zatelepin
6b9ead4bd8 parse PARTITION BY, ORDER BY, SAMPLE BY, SETTINGS clauses in a storage definition [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Zatelepin
48dea685d0 use more typesafe AST objects in ASTCreateQuery [#CLICKHOUSE-3000] 2017-10-20 21:28:41 +03:00
Nikolai Kochetov
74a4c7508a merged with master 2017-10-20 19:18:09 +03:00
Nikolai Kochetov
ce602387d4 fixed extermal models lifetime in config [#CLICKHOUSE-3305] 2017-10-20 19:13:29 +03:00
Nikolai Kochetov
fdf258f8ed added ExternalModels to Context [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 19:13:25 +03:00
Nikolai Kochetov
bb4547140b added ExternalModels, applyModel [#CLICKHOUSE-3305] 2017-10-20 19:13:21 +03:00
Nikolai Kochetov
99e9c0c486 fix build [#CLICKHOUSE-3305]
fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]

fix build [#CLICKHOUSE-3305]
2017-10-20 18:45:16 +03:00
Marek Vavruša
2ac5a743cc dbms: fix build with OS X built-in clang
The built-in clang doesn’t support value() for
`std::experimental::optional`. It however supports
dereference operator, which is basically the
same thing:

```
/clickhouse/dbms/src/DataStreams/NullableAdapterBlockInputStream.cpp:83:67: error: call to unavailable member function 'value':
                    res.insert({elem.column, elem.type, rename[i].value()});
                                                        ~~~~~~~~~~^~~~~
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:547:17: note: candidate function has been explicitly made unavailable
    value_type& value()
                ^
/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/include/c++/v1/experimental/optional:539:33: note: candidate function has been explicitly made unavailable
    constexpr value_type const& value() const
```
2017-10-13 18:12:29 -07:00
Alexey Milovidov
f42c6014ce Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-14 02:06:11 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
alexey-milovidov
3a1ce26764 Update Context.cpp 2017-10-13 21:46:32 +03:00
proller
c0e9813b90 Fix access for inserting into temporary table (#CLICKHOUSE-3360) 2017-10-13 21:46:32 +03:00
proller
49f8080e52 Small debud improvement 2017-10-13 21:44:26 +03:00
Alexey Milovidov
0ec218a853 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-13 04:09:51 +03:00
Vladimir Chebotarev
1e0241e262 dbms: CompressionSettingsSelector. [#METR-21516] 2017-10-13 04:08:23 +03:00
Vladimir Chebotarev
4e313f3732 dbms: Added compression level for ZSTD. [#METR-26742] 2017-10-13 04:08:23 +03:00
proller
1e961cc69d Fix complex queries with GLOBAL IN and UNION ALL (#CLICKHOUSE-3356) (#1339)
* TEST only: why initQueryAnalyzer ?

* Better tests

* missing file

* Missing file

* Add test

* Test fixes

* Fixed FREEZE PARTITION: using only active data parts; acquire snapshot of parts [#CLICKHOUSE-3369].

* Removed tcp_ssl_port by default [#CLICKHOUSE-2].

* Better tests

* comment

* clean

* REmove wrong code

* clean
2017-10-13 00:28:24 +03:00
Vitaliy Lyudvichenko
7bc58340b0 Fixed infinite recursion in expression analyzer. [#CLICKHOUSE-3125] 2017-10-13 00:27:25 +03:00
Vitaliy Lyudvichenko
62ea1133dd Disable part sendings and fetches before ALTER. [#CLICKHOUSE-3343] 2017-10-12 23:26:54 +03:00
Vitaliy Lyudvichenko
c0716da718 Resolves #1273. Exception safe users update. [#CLICKHOUSE-3] 2017-10-12 22:28:24 +03:00
Marek Vavruša
7fc08389c9 Storages: added Kafka table engine (read-only)
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.

It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.

Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Marek Vavruša
4fb570fa5e IStorage: allow notification on dependency change
This allows sending notifications to supported
table engines when their dependencies change.
For example, a table can be notified when a
MATERIALIZED VIEW is attached to it.

This is a building block for building pipelines.
2017-10-10 08:33:00 -07:00
Alexey Milovidov
1405415f94 Miscellaneous [#CLICKHOUSE-3]. 2017-10-09 01:53:38 +03:00
Nikolai Kochetov
61bef2adf1 added ExternalLoader [#CLICKHOUSE-3305] 2017-10-06 13:31:06 +03:00
proller
ebb4a6a0ed Start ssl'ing (#CLICKHOUSE-3032) 2017-10-03 22:12:44 +03:00
proller
8f3a244d26 Fix internal compiler with some new clang packages 2017-09-27 17:52:24 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Zatelepin
68cb592277 allow arbitrary partition literals in ALTER PARTITION queries [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
proller
0a0e04f1a5 Fix includes 2017-09-18 21:52:47 +03:00
Alexey Milovidov
ff1598c8d1 Improved performance of dynamic compilation [#CLICKHOUSE-2]. 2017-09-17 23:22:39 +03:00
Alexey Milovidov
dd3e74c0eb Fixed weird translation [#CLICKHOUSE-2]. 2017-09-17 21:17:04 +03:00
Alexey Milovidov
4df44cfeb4 Modified comment [#CLICKHOUSE-2]. 2017-09-17 21:00:27 +03:00
Alexey Milovidov
4bf1f39190 Fixed build [#CLICKHOUSE-2]. 2017-09-12 20:21:02 +03:00
alexey-milovidov
c4c8057a28 Update InterpreterSelectQuery.h 2017-09-12 20:06:31 +03:00
alexey-milovidov
af323d4e16 Update InterpreterSelectQuery.cpp 2017-09-12 20:06:31 +03:00
leozhang
a80ebcdbc2 fix union all bug #1059 2017-09-12 20:06:31 +03:00
Vadim Skipin
e0a1e6982b Context parameter added to the IDatabase methods 2017-09-11 21:29:26 +03:00
Alexey Milovidov
cd540c2674 Replaced Mersenne Twister to PCG-Random [#CLICKHOUSE-2]. 2017-09-10 02:17:38 +03:00
Alexey Milovidov
fe717a4d6e Fixed not an issue, shown by TSan; minor modifications [#CLICKHOUSE-2]. 2017-09-10 01:28:38 +03:00
Alexey Milovidov
92d7d6bd44 Fixed error that reproduced only when using libc++ [#CLICKHOUSE-3174]. 2017-09-09 05:12:53 +03:00
Alexey Milovidov
9afe76e212 Minor modification [#CLICKHOUSE-2]. 2017-09-08 19:46:56 +03:00
Alexey Milovidov
4799f28dad Implemented some suggestions from clang-tidy (part 6) [#CLICKHOUSE-3301]. 2017-09-08 07:39:03 +03:00
Alexey Milovidov
d29c77adea Implemented some suggestions from clang-tidy (part 3) [#CLICKHOUSE-3301]. 2017-09-08 06:47:27 +03:00
Alexey Milovidov
d19d9f8589 Implemented some suggestions from clang-tidy (part 2) [#CLICKHOUSE-3301]. 2017-09-08 05:37:02 +03:00
Alexey Milovidov
e9ae193870 Implemented some suggestions from clang-tidy (part 1) [#CLICKHOUSE-3301]. 2017-09-08 05:29:47 +03:00
Alexey Milovidov
8b313ab99e Fixed warnings found by cppcheck [#CLICKHOUSE-3300]. 2017-09-08 00:04:48 +03:00
alexey-milovidov
39a4401f05 Update Cluster.h 2017-09-07 20:55:33 +03:00
Vadim Skipin
4017622ffb CLICKHOUSE-3289: Do not use Application singleton 2017-09-07 20:55:33 +03:00
Alexey Milovidov
657e333dba Added "Uptime" asynchronous metric [#CLICKHOUSE-3282]. 2017-09-07 07:02:29 +03:00
Alexey Milovidov
9c37dfd75f Fixed common source of errors while deploying newer version of ClickHouse [#CLICKHOUSE-3282]. 2017-09-06 23:24:40 +03:00
Alexey Milovidov
24ac5a68e1 More uniform style [#CLICKHOUSE-3281]. 2017-09-06 06:24:39 +03:00
Vitaliy Lyudvichenko
d55d5eca46 Remove extra Context reference and add required ones. Part 2. [#CLICKHOUSE-3117] 2017-09-06 04:18:07 +03:00
proller
2a7813049e LibDictionarySource : First lib dictionary version with only uint64 type support (#1150)
* Wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Do not use ccache if ccache defined in CMAKE_CXX_COMPILER_LAUNCHER

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* Config: Allow multiple dictionaries_config

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* wip

* clean

* clean

* wip

* clean

* clean

* wip

* wip

* clean

* clean

* clean

* clean

* clean

* Requested changes

* Reqested changes

* Requested changes

* Requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* Requested changes

* requested changes

* Requested changes

* fix

* Requested changes

* Requested changes

* fix

* Requested changes

* Requested changes
2017-09-05 04:08:26 +03:00
proller
5889aa9c74 Fix build 2017-09-01 21:37:53 +03:00
alexey-milovidov
775d95888a Merge pull request #1163 from yandex/CLICKHOUSE-2931
Introduce SYSTEM queries
2017-09-01 20:45:29 +03:00
Vitaliy Lyudvichenko
566160c048 Use FIFO lock in IStorage. [#CLICKHOUSE-3246] 2017-09-01 20:45:05 +03:00
alexey-milovidov
897a9ad6b2 Merge pull request #1146 from yandex/array-functions-concat-slice-push-pop
Array functions concat slice push pop
2017-09-01 20:30:51 +03:00
proller
1a8e22c37f Allow compile on 32bit systems (#1175)
* Trying compile under 32bit..

* PerformanceTest: use getMultiple*FromConfig, fix debug helpers

* Missing file

* clnag-format of Split ComplexKeyCacheDictionary

* wip

* Requested changes

* wip

* wip

* Fix boost 1.64 and gcc7+ compile errors

* More fixes

* wip

* Fix arm build

* wip

* wip

* wip

* wip

* wip

* wip

* wip

* clean

* fix

* wip

* wip

* clean

* clean

* wip

* wip

* Update MergeTreeSettings.h

* Requested changes

* Requested changes

* Requested changes

* Requested changes
2017-09-01 20:21:03 +03:00
Vitaliy Lyudvichenko
c32bf4f597 Use only one cache in DNSCache. Add requested changes. [#CLICKHOUSE-2931] 2017-09-01 20:05:24 +03:00
Nikolai Kochetov
7891596579 unified TypeList [#CLICKHOUSE-2090] 2017-09-01 15:05:19 +03:00
alexey-milovidov
aa2d29f5f9 Update ReadWriteBufferFromHTTP.cpp, Context.cpp, etc
Update ASTSystemQuery.cpp

Update ASTSystemQuery.h

Update dictionary_clickhouse_cache.xml

Update dictionary_clickhouse_flat.xml
2017-08-31 13:26:02 +03:00
alexey-milovidov
5d14855989 Merge branch 'master' into CLICKHOUSE-2931 2017-08-31 00:23:39 +03:00
Alexey Milovidov
495daffa16 Miscellaneous [#CLICKHOUSE-2]. 2017-08-30 21:13:32 +03:00
Vitaliy Lyudvichenko
478470e1f1 Avoid segfaults and many other problems related with modifying global context in DDLWorker. [#CLICKHOUSE-3260] 2017-08-30 19:12:45 +03:00
alexey-milovidov
91abe43461 Update ProcessList.cpp 2017-08-29 23:23:54 +03:00
alexey-milovidov
f31ca9276f Update ProcessList.h 2017-08-29 23:23:54 +03:00
Vitaliy Lyudvichenko
1e68d10ce0 Add max_network_bandwidth_for_user limit setting. [#CLICKHOUSE-3139] 2017-08-29 23:23:54 +03:00
Vadim Skipin
4dc36893d3 Keep config in context to avoid Application singleton usages 2017-08-28 22:19:06 +03:00
Vitaliy Lyudvichenko
c9daea1a33 Fixed IP resolving in DNSCache. [#CLICKHOUSE-2931] 2017-08-28 21:43:57 +03:00
Vitaliy Lyudvichenko
8fa3364e4e Add SYSTEM RELOAD DICTIONARY(IES) implementation. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
48f5d8f1a3 Add SYSTEM DROP DNS CACHE. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
ffe7558fe2 Add SYSTEM KILL and SHUTDOWN implementations. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
eb05798130 Add SYSTEM queries parser. [#CLICKHOUSE-2931] 2017-08-28 20:27:16 +03:00
Vitaliy Lyudvichenko
f8c9059857 Fixed SIGABRT in DDLWorker. [#CLICKHOUSE-3251] 2017-08-25 19:31:57 +03:00
Alexey Milovidov
58fc8a2c0b Merge branch 'master' of github.com:yandex/ClickHouse 2017-08-24 16:26:19 +03:00
Alexey Milovidov
fd552774c0 Fixed translation error [#CLICKHOUSE-2]. 2017-08-24 16:25:51 +03:00
Alexey Zatelepin
eec6a3ecb9 add forgotten aggregate functions to SpecializedAggregator.h [#CLICKHOUSE-3247] 2017-08-23 17:00:36 +03:00
Alexey Milovidov
ee553aac65 Updated test of string hashes [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
4eb77e6628 Updated test of string hashes [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
f8b2400a84 More sophisticated test of hash tables with integer keys [#CLICKHOUSE-3244]. 2017-08-22 20:32:13 +03:00
Alexey Milovidov
e47a29fd4b More sophisticated test of hash tables with integer keys [#CLICKHOUSE-2]. 2017-08-22 20:32:13 +03:00
Alexey Zatelepin
ce3e4676fa remove unnecessary calls to find() [#CLICKHOUSE-2171] 2017-08-19 21:35:01 +03:00
Vitaliy Lyudvichenko
e52428ddb2 Fixed SIGSEGV in CREATE TABLE AS <MV>. MV without ENGINE is forbidden! [#CLICKHOUSE-2]
Resolves #1112
Resolves #598
2017-08-19 00:10:53 +03:00
Vadim Skipin
61f65e97a8 Fix typo 2017-08-18 22:38:56 +03:00
Vitaliy Lyudvichenko
1a68a17a06 Avoid infinite loop in DDLWorker if ZooKeeper dies. [#CLICKHOUSE-2] 2017-08-17 23:06:38 +03:00
Alexey Milovidov
9f956d97dd Removed debug output [#CLICKHOUSE-2]. 2017-08-17 21:43:39 +03:00
Alexey Milovidov
eb88391655 Fixed error with alias substitution [#CLICKHOUSE-2986]. 2017-08-16 23:10:25 +03:00
Alexey Milovidov
b6cafb9a88 Set "max_replica_delay_for_distributed_queries" to five minutes by default [#CLICKHOUSE-2141]. 2017-08-16 20:21:39 +03:00
Alexey Milovidov
c629799500 Fixed insufficient arguments checking [#CLICKHOUSE-3102]. 2017-08-16 17:21:24 +03:00
Alberto
727ca81998 Fixed typo 2017-08-16 14:08:02 +03:00
Nikolai Kochetov
f8513b932f removed ability to select from external temporary table by query_id 2017-08-15 22:31:40 +03:00
Nikolai Kochetov
9c6f1a1e4b supported drop query for temporary tables [#CLICKHOUSE-3219] 2017-08-15 22:31:40 +03:00
Alexey Zatelepin
f25f0cd759 reduce number of places where partitioning by month is assumed [#CLICKHOUSE-3000] 2017-08-15 22:30:52 +03:00
Alexey Milovidov
5af5f78cb7 Terminate only DDLWorker in case of unexpected exception in DDLWorker [#CLICKHOUSE-4]. 2017-08-14 08:51:03 +03:00
Alexey Milovidov
1495490726 DDLWorker: better [#CLICKHOUSE-5]. 2017-08-14 08:44:04 +03:00
Alexey Milovidov
547516c636 Fixed errors after merge [#CLICKHOUSE-2]. 2017-08-13 12:27:38 +03:00
Vitaliy Lyudvichenko
bf1c4d156a Fix errors after rebase, better logging. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
04ab103d92 Avoid extra ZK calls on cleanup. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
alexey-milovidov
7ba0fcaf51 Update DDLWorker.cpp 2017-08-13 12:18:46 +03:00
alexey-milovidov
15fa88d25b Update DDLWorker.cpp 2017-08-13 12:18:46 +03:00
alexey-milovidov
4af3e55699 Update DDLWorker.cpp 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
d9ce96f8f5 Fixed test and misspellings. [#CLICKHOUSE-3207] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
4ef5d14722 Add distributed_ddl_task_timeout setting. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
cdf95ab308 Fixed race condition in case of different cluster definitions. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
e4785aeb4d Simplified clean queue logic. Added more tests. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
c2e84d6df7 Fixed several errors in case of connection loss. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
cb02a1b3b5 Add random ZK packets drops into test. Fixed a couple bugs. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
4a7927b186 Many improvements. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
628de0a3ea Fixed logging of DDL queries. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
736feab79f Add port field. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
7e8f3a0561 Add parse error handling. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Vitaliy Lyudvichenko
c65c49b50a Add config-based host name selection. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
alexey-milovidov
3c0d0274d0 Update executeQuery.h 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
7b0a7def02 remove unused setting [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
b469ef1792 don't use local replica if its delay is unacceptable [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
3f3b7f61e2 always send changed settings for remote connections [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
ee457eca8a remove shard multiplexing code, simplify [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Alexey Zatelepin
133be4d739 move and rename things [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
Nikolai Kochetov
37b6c98752 added former WITH clause to SELECT query 2017-08-12 00:01:28 +03:00
alexey-milovidov
9b99dfb53d Merge pull request #1031 from yandex/wait-for-insertion-in-distributed
Wait for insertion in distributed
2017-08-11 21:35:13 +03:00
Nikolai Kochetov
24b5a59f8c merged with remote [#CLICKHOUSE-3033] 2017-08-11 18:38:46 +03:00
Nikolai Kochetov
90940d8423 Cluster and DistributedBlockOutputStream refactoring [#CLICKHOUSE-3033] 2017-08-11 18:02:07 +03:00
Alexey Milovidov
ce4349b6cd Fixed error when huge sets for IN, JOIN, DISTINCT cannot be created with exception message "Cannot mremap... Bad address" [#CLICKHOUSE-2]. 2017-08-11 02:25:51 +03:00
proller
2344fe7dae Cmake: fix tests includes (#1090)
Cmake: fix tests includes
2017-08-10 20:51:45 +03:00
alexey-milovidov
bf77c602de Update Settings.h 2017-08-10 06:44:34 +03:00
proller
139d9e5c19 Config: Allow multiple dictionaries_config 2017-08-10 06:17:19 +03:00