Commit Graph

697 Commits

Author SHA1 Message Date
Ivan
058821fa02
Merge branch 'master' into kafka_better_settings 2020-06-06 19:50:38 +03:00
Anton Popov
5c42408add
Merge pull request #9113 from dimarub2000/group_by_in_order_optimization
[WIP] Optimization of GROUP BY with respect to table sorting key.
2020-06-06 14:25:59 +03:00
alexey-milovidov
5f99d887cc
Merge pull request #11443 from 4ertus2/strange
Rename setting
2020-06-06 01:45:21 +03:00
Artem Zuikov
ab86ca2fb6 rename v2 2020-06-05 01:10:52 +03:00
Alexander Kuzmenkov
377da4656d cleanup 2020-06-04 18:51:34 +03:00
Artem Zuikov
24ee7346a9 rename setting 2020-06-04 17:31:57 +03:00
Mikhail Filimonov
ea6545a175 Return output_format_pretty_max_value_width after rebase 2020-06-03 20:28:28 +02:00
Mikhail Filimonov
4956ade67d Support for all format settings in Kafka, expose some setting on table level, better defaults. 2020-06-03 19:01:41 +02:00
Anton Popov
1ce09e1faa Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-06-03 16:27:54 +03:00
Alexander Kuzmenkov
3bf9cec63b Merge remote-tracking branch 'origin/master' into HEAD 2020-06-03 14:49:49 +03:00
Ruslan
7757c9ec57
Remove arithmetic operations from aggregation functions (#10047) 2020-06-03 13:28:30 +03:00
kssenii
d3b069e37b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-06-01 18:25:36 +00:00
Alexander Kuzmenkov
9a2474ba84 move settings to a more suitable location 2020-06-01 20:17:31 +03:00
Alexander Kuzmenkov
03d8bf9242 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-01 20:15:25 +03:00
Alexey Milovidov
a76bd99e84 Added setting "output_format_pretty_max_value_width" 2020-06-01 01:12:13 +03:00
alexey-milovidov
bebc6f82fc
Merge pull request #10678 from livace/add_geo_types
Add geo data types Point and Polygon
2020-05-31 17:25:15 +03:00
kssenii
e80b405359 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into add-storage-rabbitmq-read-only 2020-05-31 10:30:53 +00:00
Dmitry
4b0d32f026 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-31 00:21:02 +03:00
Alexey Milovidov
421a62e978 Merge branch 'master' into fix-false-too-slow 2020-05-30 19:36:55 +03:00
Alexey Ilyukhov
b84c8fcbd8 Add allow_experimental_geo_types; add test 2020-05-30 18:26:19 +03:00
Nikolai Kochetov
22cba267e3
Merge pull request #11295 from ClickHouse/abb-back-experimental_use_processors-setting
Revert setting.
2020-05-30 10:04:07 +03:00
Alexey Milovidov
0eb2f4dee9 Change default value of "timeout_before_checking_execution_speed" to make it reasonable 2020-05-29 21:51:51 +03:00
Nikolai Kochetov
36b1a37927 Revert setting. 2020-05-29 21:23:11 +03:00
Dmitry
adcb88a1d5 turn OFF by default 2020-05-29 13:54:13 +03:00
Dmitrii Kovalkov
9387981abe Add afwul option for choosing implementation 2020-05-29 07:35:01 +02:00
Alexey Milovidov
9120495c48 Increase chunk size for parallel parsing just in case 2020-05-29 05:31:45 +03:00
Alexander Kuzmenkov
db84f0e892 Merge remote-tracking branch 'origin/master' into HEAD 2020-05-27 16:30:13 +03:00
Dmitry
38c585f867 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-26 21:27:50 +03:00
kssenii
ad1c0de8db Merge 2020-05-26 17:45:39 +00:00
Ivan Blinkov
548fc7141a
Enable log_queries by default 2020-05-25 21:12:03 +03:00
Andrey Skobtsov
d1d9af4fea Perf metrics disabled by default 2020-05-22 14:16:41 +03:00
alesapin
b9dfa61774
Merge pull request #11042 from CurtizJ/modify-ttl
Apply TTL for old data, after ALTER MODIFY TTL query
2020-05-22 11:12:14 +03:00
Dmitry
47778c0259 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-21 23:45:12 +03:00
Andrey Skobtsov
8b98bfe1d4 Enable perf measurements by default for performance tests 2020-05-20 21:28:58 +03:00
Andrey Skobtsov
4816abed28 Settings for measuring only particular metrics via perf events 2020-05-20 21:25:49 +03:00
Anton Popov
d62fe980ef Merge remote-tracking branch 'upstream/master' into modify-ttl 2020-05-20 16:52:30 +03:00
kssenii
3b75f214c5 Register RabbitMQ storage 2020-05-20 09:09:20 +03:00
potya
a21cc0e76e Add NULL and NOT NULL modifiers for data types in create query 2020-05-20 04:26:19 +03:00
potya
d8bb98bbcf Add NULL and NOY NULL modifiers for data types in create query 2020-05-20 04:22:32 +03:00
potya
cee9c1517e cast_keep_nullable set to false 2020-05-20 01:51:06 +03:00
potya
f138628727 Add cast_keep_nullable setting 2020-05-20 01:18:49 +03:00
Nikolai Kochetov
c147badf4f Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size 2020-05-19 18:24:21 +03:00
Anton Popov
58ed04dc24 materialize TTL after its modifying 2020-05-19 04:53:01 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final
Parallel final
2020-05-18 05:20:18 +03:00
Azat Khuzhin
c1cf31f87d Introduce min_insert_block_size_{rows,bytes}_for_materialized_views
With tons of MATERIALIZED VIEW attached to one table pushing to this
views can be pretty memory consuming due to blocks squashing, add
ability to control this separatelly for MATERIALIZED VIEWs.

Plus squashing is useless if the underlying engine is Buffer().
2020-05-17 12:21:05 +03:00
Alexey Milovidov
2df8c4f62e Merge branch 'master' into input-format-use-header-by-default 2020-05-17 05:40:01 +03:00
Nikolai Kochetov
fb38c2a30b
Remove experimental_use_processors setting, part 1. (#10924)
Remove experimental_use_processors setting, part 1.
2020-05-15 22:28:10 +03:00
Alexey Milovidov
7a20d95339 Enable input_format_with_names_use_header by default 2020-05-15 10:30:26 +03:00
Anton Popov
14e1a46a8c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-15 03:48:27 +03:00
Ri
fc7afaa639
Bitonic sort on GPU (OpenCL) (#10232) 2020-05-15 03:01:14 +03:00
Nikolai Kochetov
4d22374f24 Merged with master. 2020-05-14 12:06:15 +03:00
Dmitry
c4295d97f9 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-12 17:57:32 +03:00
potya
723e61c410 go back 2020-05-12 16:19:38 +03:00
alexey-milovidov
33d491edf3
Merge pull request #10516 from azat/dist-GROUP_BY-sharding_key-fixes
Disable GROUP BY sharding_key optimization by default (and fix for WITH ROLLUP/CUBE/TOTALS)
2020-05-11 12:03:27 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final 2020-05-11 06:47:44 +03:00
Azat Khuzhin
7342f46394 Fix setting type for the memory_profiler_sample_probability 2020-05-10 15:49:31 +03:00
Chao Wang
bc5f9d5322
Fix comment for merge_tree_max_bytes_to_use_cache 2020-05-08 16:39:00 -04:00
tavplubix
04a24c59dc
Add tests with DatabaseAtomic (#10714)
* add tests with DatabaseAtomic

* fix
2020-05-07 14:29:58 +03:00
Anton Popov
387041a97e Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-06 19:22:07 +03:00
Alexey Milovidov
99c18c5a09 Check for suspicious codecs #4966 2020-05-04 03:11:49 +03:00
Alexey Milovidov
439777ef23 Allow to set memory_profiler_sample_probability per query 2020-05-01 22:17:56 +03:00
Anton Popov
aa723d245f Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-30 18:27:39 +03:00
Nikolai Kochetov
19dadb8c2d Add parallel final. 2020-04-30 12:59:08 +03:00
Potya
351d62aa83 Nothing interesting 2020-04-29 15:17:40 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
2020-04-29 12:15:54 +03:00
Azat Khuzhin
038235684d Add optimize_distributed_group_by_sharding_key and disable it by default
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
2020-04-29 00:09:25 +03:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk (#10467) 2020-04-28 16:55:50 +03:00
Nikolai Kochetov
32baa073b5 Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view 2020-04-27 17:49:50 +03:00
Vitaliy Zakaznikov
369b4d53ef Adding support for output_format_enable_streaming format setting. 2020-04-26 15:44:11 +02:00
Dmitry
d9ac0e8fef Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-26 14:44:06 +03:00
Vitaliy Zakaznikov
71a40d6ec9 Revert "Working on adding AUTO REFRESH to LIVE VIEW tables."
This reverts commit 855e06b031.
2020-04-25 09:56:57 -04:00
Vitaliy Zakaznikov
855e06b031 Working on adding AUTO REFRESH to LIVE VIEW tables. 2020-04-24 17:15:17 -04:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Alexey Milovidov
0482e2e3ea Implement suggestion from Sergey Veletsky 2020-04-22 01:40:18 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
Anton Popov
4069dbcc58 in-memory parts: add waiting for insert 2020-04-20 04:38:38 +03:00
Alexey Milovidov
3755a5ba54 Added suggestion from Azat 2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab Introduce "max_server_memory_usage" setting 2020-04-20 01:59:21 +03:00
Azat Khuzhin
5d11118cc9 Use thread pool (background_distributed_schedule_pool_size) for distributed sends
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25 Update comment for background_schedule_pool_size
Include info about:
- kafka streaming
- dns cache updates
2020-04-19 11:20:57 +03:00
Dmitry
25cd4ce132 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-18 12:56:34 +03:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Alexander Tokmakov
20e6593f96 disable by default 2020-04-12 21:52:59 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
Azat Khuzhin
365b5207b7 Add log_queries_min_type to filter which entries will be written to query_log
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:

  set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
2020-04-12 10:46:36 +03:00
alexey-milovidov
2adeabd3c7
Update Settings.h 2020-04-12 01:58:45 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
25236d3544
Merge branch 'master' into setting_allow_nondeterministic_mutations 2020-04-10 23:58:46 +03:00
alexey-milovidov
330d138106
Update Settings.h 2020-04-10 23:58:13 +03:00
Mikhail Filimonov
2f5b4b0f9b Added ability to relax the restriction on non-deterministic functions usage in mutations with allow_nondeterministic_mutations setting. 2020-04-10 22:01:10 +02:00
Alexander Kazakov
26dd6140b2 Added new config settings to control timeouts
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
 * "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
2020-04-09 21:10:27 +03:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00