Commit Graph

195 Commits

Author SHA1 Message Date
Nikolai Kochetov
3a74ec7c0c Mergred with master 2018-07-20 14:08:54 +03:00
Nikolai Kochetov
9c763f8090 Make DatsTypeWithDictionary independent from index type. 2018-07-20 13:16:27 +03:00
Alexey Milovidov
31dbbb05d2 Removed useless setting #2677 2018-07-19 23:22:49 +03:00
alexey-milovidov
0463fb6dd3
Update Settings.h 2018-07-16 19:48:56 +03:00
chertus
c8f71cb539 Merge branch 'master' into issue-3578 2018-07-13 14:30:42 +03:00
chertus
f89e476c0f add option to disable sending metadata 2018-07-12 17:33:57 +03:00
Alexey Milovidov
0947c7808d Avoid locking while reading config to check part_log #2281 2018-07-08 07:54:37 +03:00
Alexey Milovidov
576885c6b8 Little better [#CLICKHOUSE-2] 2018-07-06 21:35:37 +03:00
Alexey Milovidov
84fd35da41 Adaptations #2574 2018-07-05 00:00:50 +03:00
Alexey Milovidov
7bdafa6105 Merge branch 'master' of https://github.com/amosbird/ClickHouse into amosbird-master 2018-07-04 23:54:54 +03:00
Alexey Milovidov
e6c293ab60 Added setting "use_index_for_in_with_subqueries_max_values" #2571 2018-07-04 20:28:52 +03:00
Amos Bird
900b046943 Add options to enable parsing CSV with single/double quote. 2018-06-29 15:34:55 +08:00
Alexey Milovidov
e051998e1c Renamed setting "send_logs_level" #2482 2018-06-28 23:11:14 +03:00
Alexey Milovidov
3894f094ea Fixed setting descriptions #2482 2018-06-28 22:40:18 +03:00
Vitaliy Lyudvichenko
310bb4116e Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-19 23:33:11 +03:00
Vitaliy Lyudvichenko
4cd230f85c Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-06-14 16:04:00 +03:00
Alexey Milovidov
2a30db6b44 Whitespace [#CLICKHOUSE-2] 2018-06-12 06:26:24 +03:00
Vitaliy Lyudvichenko
ed7cd86f09 Fixed several bug. Trun on --server_logs_level=warning in tests. [#CLICKHOUSE-2910]
Fixed several test to be compatible with --server_logs_level=warning.
2018-06-08 22:50:15 +03:00
Alexey Milovidov
101276e541 Allowed to switch between 'basic' and 'best effort' methods of parsing DateTime from text #1710 2018-06-08 06:15:33 +03:00
Alexey Milovidov
26d448baad Passing settings to ser/de of data types: development #1710 2018-06-08 04:51:55 +03:00
Vitaliy Lyudvichenko
99b68d3cf3 Add more options for loggig. [#CLICKHOUSE-2910] 2018-06-07 21:46:53 +03:00
Vitaliy Lyudvichenko
ac54e52fb3 Add server logs passing to client. [#CLICKHOUSE-2910] 2018-06-07 20:58:50 +03:00
Alexey Milovidov
f5adbceed2 Non significant changes according to clang's -Weverything, part 3 [#CLICKHOUSE-2] 2018-06-03 23:39:06 +03:00
Vitaliy Lyudvichenko
0355f81f20 [WIP] Introduced query_thread_log. [#CLICKHOUSE-2910] 2018-05-31 18:54:08 +03:00
Vitaliy Lyudvichenko
aa40931824 Merge remote-tracking branch 'origin/master' into CLICKHOUSE-2910 2018-05-28 20:22:27 +03:00
alexey-milovidov
517318334a
Merge pull request #1722 from silviucpp/background-schedule-pool-fix
Background schedule pool fixed
2018-05-19 19:00:43 +03:00
Vitaliy Lyudvichenko
bd4d8a6766 Add profile events and settings logging. [#CLICKHOUSE-2910] 2018-05-17 19:01:41 +03:00
sundy-li
2511a4784b Support data write to StorageMySQL table 2018-05-15 03:02:59 +03:00
Alexey Milovidov
582085bf15 Be more conservative about new feature #2277 2018-05-11 00:29:44 +03:00
pyos
accbbdb9e3 Add a setting that disables jit-compilation 2018-05-03 00:48:20 +03:00
Tsarkova Anastasia
9286c98789 Fix build. 2018-04-29 23:13:01 +02:00
Tsarkova Anastasia
4bce6035b1
Merge branch 'master' into master 2018-04-29 18:02:34 +02:00
Tsarkova Anastasia
2c96b1c684 Add comments. Change projection restoring function. 2018-04-29 15:49:58 +02:00
Tsarkova Anastasia
12c8014e5c Conditional computations. 2018-04-24 09:16:39 +02:00
Ivan Zhukov
e402ff3f81 Unify string checks with a new type 2018-04-22 02:42:01 +03:00
Ivan Zhukov
1fc6bb6ffe Add a CSV delimiter setting 2018-04-22 01:20:39 +03:00
Silviu Caragea
c547c5a7b0 Merge remote-tracking branch 'origin/background-schedule-pool-fix'
# Conflicts:
#	dbms/src/Common/ZooKeeper/LeaderElection.h
#	dbms/src/Common/ZooKeeper/ZooKeeper.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeAlterThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeCleanupThread.h
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreePartCheckThread.cpp
#	dbms/src/Storages/MergeTree/ReplicatedMergeTreeRestartingThread.cpp
#	dbms/src/Storages/StorageReplicatedMergeTree.cpp
2018-04-10 16:20:14 +03:00
Vitaliy Lyudvichenko
63eee94319
Add max_network_bandwidth_for_all_users setting. [#CLICKHOUSE-2] (#2137) 2018-03-29 16:24:36 +03:00
Silviu Caragea
b24a4b2111 Add back the buggy BackgroundSchedulePool 2018-03-22 17:07:12 +02:00
Alexey Milovidov
5ff433b670 Merged Limits to Settings [#CLICKHOUSE-2021] 2018-03-11 03:15:26 +03:00
Alexey Milovidov
f3b6d35167 Removed setting "strict_insert_defaults" [#CLICKHOUSE-2] 2018-03-10 03:11:39 +03:00
Nikolai Kochetov
5842c35aeb added odbc_default_field_size setting 2018-03-02 15:59:41 +03:00
Alexey Milovidov
ce2fa2c4e7 Inline documentation for most of Limits [#CLICKHOUSE-2] 2018-03-02 11:12:43 +03:00
Vitaliy Lyudvichenko
9c889af882 Add allow_distributed_ddl setting. [#CLICKHOUSE-3611]
Clearer exception message.
Fixed Int64 settings parsing.
2018-02-28 16:23:40 +03:00
Alexey Milovidov
8942d7c127 Added method "getHeader" in IBlockOutputStream: development [#CLICKHOUSE-2] 2018-02-20 04:38:42 +03:00
Alexey Milovidov
7415513151 Return single row for aggregation without keys on empty set: development [#CLICKHOUSE-1920] #51 2018-02-18 08:35:48 +03:00
Alexey Milovidov
5324571adf Removed setting "distributed_ddl_allow_replicated_alter" [#CLICKHOUSE-2]. 2018-02-06 21:29:35 +03:00
Alexey Milovidov
7a793e1a80 Removed duplicate comments for embedded documentation of Settings; cleanup [#CLICKHOUSE-2] 2018-02-06 21:28:07 +03:00
Vlad Arkhipov
6738d6a995 Add comments. Improve method names. 2018-01-23 11:18:12 +03:00
Vlad Arkhipov
be96cf5133 Replace subqueries and table expressions on the right side of the IN operator with their results in order to make MergeTree storage engines evaluate the corresponding conditions by using the index. 2018-01-21 11:22:52 +03:00
alexey-milovidov
1f9ea8b6b0
Merge pull request #1721 from zhang2014/fix/ISSUES-957
ISSUES-957 fix not work when materialized columns with buff table
2018-01-19 21:50:26 +03:00
Vitaliy Lyudvichenko
03bca2144d OPTIMIZE doesn't produce intersecting merges now, add optimize_throw_if_noop setting. [#CLICKHOUSE-3432] [#CLICKHOUSE-3420]
Resolves #1753
2018-01-15 13:13:18 +03:00
张健
6f28e0a66a
Merge branch 'master' into fix/ISSUES-957 2018-01-10 14:53:52 +08:00
zhang2014
fc62a3677c ISSUES-957 update setting desc & add condition for insert pipline 2018-01-10 13:26:40 +08:00
Nikolai Kochetov
cbeeb84999 added http_*_timeout settings [#CLICKHOUSE-3440] 2018-01-09 21:41:01 +03:00
zhang2014
6fe64aa346 ISSUES-957 fix not work when materialized columns with buff table 2018-01-01 19:54:14 +08:00
Alexey Zatelepin
6d5ce3fa9a revert BackgroundSchedulePool usage in Replicated tables 2017-12-22 21:25:54 +03:00
Alexey Zatelepin
fb9c7ab81d remove experimental_allow_extended_storage_definition_syntax Setting (turn on by default) [#CLICKHOUSE-3000] 2017-12-04 22:45:18 +03:00
Kirill Shvakov
cd7f7b076e Merge branch 'add-description-to-settings-table' 2017-11-30 13:55:42 +02:00
Kirill Shvakov
4d73516508 Add description to system.settings table 2017-11-30 13:50:02 +02:00
Alexey Milovidov
f497b0c63c BackgroundSchedulePool: miscellaneous; added TODO [#CLICKHOUSE-2]. 2017-11-19 03:08:37 +03:00
Silviu Caragea
dfecd0b2f2 Merge with master 2017-11-18 10:16:06 +02:00
Alexey Milovidov
729b114c15 Removed unsupported functionality [#CLICKHOUSE-2]. 2017-11-18 05:34:00 +03:00
Silviu Caragea
64619c614f Basic idea is :
- We add BackgroundSchedulePool which can execute a function at a specific point in time. Basically all tasks are added in a queue and precessed by worker threads.
- The most important difference between this and BackgroundProcessingPool is that we have the guarantee that the same function is not executed from many workers in the same time
- Each of the following classes instead starting a thread will register a task in BackgroundSchedulePool and when they need to run will call schedule or scheduleAfter(duration) functions

This commit is moving all threads created by ReplicatedMergeTree to BackgroundSchedulePool tasks

NOTE: I did a minimum number of changes to be much simple to review the code
2017-11-17 10:58:35 +02:00
Vitaliy Lyudvichenko
a0d06c5ee0 Don't deduplicate a block inserted from MV if the source block is Ok. [#CLICKHOUSE-3381] 2017-10-26 17:58:00 +03:00
Alexey Zatelepin
6bb34a4494 Merge branch 'master' into arbitrary-partitioning
Conflicts:
	dbms/src/Storages/StorageFactory.cpp
2017-10-24 17:23:18 +03:00
Marek Vavruša
f4c1149606 Settings: renamed schema to format_schema 2017-10-23 20:47:33 +03:00
Alexey Zatelepin
75c65c7b59 use extended storage definition syntax for MergeTree engines [#CLICKHOUSE-3000] 2017-10-20 21:28:42 +03:00
Alexey Milovidov
f42c6014ce Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-14 02:06:11 +03:00
alexey-milovidov
9ccdb5420b Merge branch 'master' into upstream-add-kafka 2017-10-13 23:52:42 +03:00
Alexey Milovidov
0ec218a853 Merge branch 'master' of github.com:yandex/ClickHouse 2017-10-13 04:09:51 +03:00
Vladimir Chebotarev
4e313f3732 dbms: Added compression level for ZSTD. [#METR-26742] 2017-10-13 04:08:23 +03:00
Marek Vavruša
7fc08389c9 Storages: added Kafka table engine (read-only)
Added a new table engine backed by Apache Kafka,
it allows near real-time ingestion or ETL with
exactly-once semantics.

It doesn’t store any data on disk, so data must
be materialized into a physical table to allow
random access.

Currently it only supports reading, no insertion.
2017-10-10 08:33:00 -07:00
Alexey Milovidov
1405415f94 Miscellaneous [#CLICKHOUSE-3]. 2017-10-09 01:53:38 +03:00
Alexey Zatelepin
728a23f60e allow creation of custom-partitioned tables with experimental syntax [#CLICKHOUSE-3000] 2017-09-26 20:40:02 +03:00
Alexey Milovidov
b6cafb9a88 Set "max_replica_delay_for_distributed_queries" to five minutes by default [#CLICKHOUSE-2141]. 2017-08-16 20:21:39 +03:00
Vitaliy Lyudvichenko
4ef5d14722 Add distributed_ddl_task_timeout setting. [#CLICKHOUSE-3128] 2017-08-13 12:18:46 +03:00
Alexey Zatelepin
7b0a7def02 remove unused setting [#CLICKHOUSE-3151] 2017-08-13 12:17:09 +03:00
alexey-milovidov
bf77c602de Update Settings.h 2017-08-10 06:44:34 +03:00
Nikolai Kochetov
43dc201f49 merged with master 2017-08-08 15:11:49 +03:00
Alexey Milovidov
4e76c96381 Temporarily disabled "preferred_max_column_in_block_size_bytes" option [#CLICKHOUSE-3188]. 2017-07-31 03:50:06 +03:00
Nikolai Kochetov
b3157aebb2 added synchronous insert into distributed table [#CLICKHOUSE-3033] 2017-07-25 22:42:36 +03:00
Nikolai Kochetov
8c65d6013e added preferred_max_column_in_block_size_bytes setting, added filtration ratio prediction [#CLICKHOUSE-3065] 2017-07-13 21:45:09 +03:00
Alexey Zatelepin
57ba50f585 allow batching Distributed inserts [#CLICKHOUSE-3126] 2017-07-11 20:56:17 +03:00
Nikolai Kochetov
25ac546e78 disabled exception during overriding settings with same value in readonly mode [#CLICKHOUSE-3041] 2017-07-09 20:16:26 +03:00
Alexey Milovidov
5c322f5756 Loosened threshold on amount of replica inconsistency to refuse server startup [#CLICKHOUSE-3076]. 2017-06-21 22:07:08 +03:00
alexey-milovidov
a669136ac2 Merge branch 'master' into CLICKHOUSE-5 2017-06-13 07:30:36 +03:00
f1yegor
8e261e34c5 translate comments: Interpreters 2017-06-03 19:21:00 +03:00
Vitaliy Lyudvichenko
73e2aab9ec Updated integration tests. Add integration test for DDL. [#CLICKHOUSE-5] 2017-06-01 13:49:21 +03:00
f1yegor
92b56c2c7d translate comments 2017-05-14 19:03:55 +04:00
Alexey Zatelepin
e30dc7c254 check replica delay when getting a connection from ConnectionPoolWithFailover [#CLICKHOUSE-2141] 2017-04-17 22:51:41 +03:00
Vitaliy Lyudvichenko
848c927bb7 Fix race condition. Add test. [#CLICKHOUSE-2902] 2017-04-15 06:48:24 +03:00
Vitaliy Lyudvichenko
82af2278fc Avoid code duplication near MergeTreeBlockInputStream. [#CLICKHOUSE-2]
Add preferred_block_size_bytes for non-uniform reader. [#CLICKHOUSE-2902]

Make enums test more deterministic. [#CLICKHOUSE-2]

Refactored MergeTree readers.

Tabs -> spaces.

Move include/DB/ -> src/.
2017-04-15 06:48:24 +03:00
Alexey Milovidov
baf2e6e95b Added 'join_use_nulls' setting to allow using NULLs as default values for non-joined rows in case of outer joins [#CLICKHOUSE-2]. 2017-04-04 09:52:39 +03:00
Alexey Milovidov
310736cd7e Moved headers and sources to same place [#CLICKHOUSE-3]. 2017-04-01 12:22:42 +03:00