thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-15 10:52:30 +00:00
Code Issues Packages Projects Releases Wiki Activity
79,296 Commits 9,328 Branches 1,783 Tags 2.1 GiB
039afc5cfe
Commit Graph

1709 Commits

Author SHA1 Message Date
potya
f138628727 Add cast_keep_nullable setting 2020-05-20 01:18:49 +03:00
Nikolai Kochetov
c147badf4f Merge remote-tracking branch 'upstream/master' into min_mv_insert_block_size 2020-05-19 18:24:21 +03:00
Anton Popov
58ed04dc24 materialize TTL after its modifying 2020-05-19 04:53:01 +03:00
Artem Zuikov
97c7447130
Bitonic sort improvements (#10934) 2020-05-19 00:41:23 +03:00
alexey-milovidov
7efd2a825f
Merge pull request #10463 from ClickHouse/parallel-final 
Parallel final
 2020-05-18 05:20:18 +03:00
alexey-milovidov
7cf3538840
Merge pull request #10270 from ClickHouse/quota-key-in-client 
Support quota_key for Native client
 2020-05-17 14:09:40 +03:00
Azat Khuzhin
c1cf31f87d Introduce min_insert_block_size_{rows,bytes}_for_materialized_views 
With tons of MATERIALIZED VIEW attached to one table pushing to this
views can be pretty memory consuming due to blocks squashing, add
ability to control this separatelly for MATERIALIZED VIEWs.

Plus squashing is useless if the underlying engine is Buffer().
 2020-05-17 12:21:05 +03:00
alexey-milovidov
a3346e9331
Merge pull request #10912 from ClickHouse/static-mutate 
Static mutate
 2020-05-17 09:05:35 +03:00
Alexey Milovidov
f4ac1eec04 Merge branch 'master' into quota-key-in-client 2020-05-17 08:15:13 +03:00
Alexey Milovidov
2df8c4f62e Merge branch 'master' into input-format-use-header-by-default 2020-05-17 05:40:01 +03:00
alesapin
be4037abb5
Merge pull request #10895 from ClickHouse/fix_multiple_renames 
Fix error in multiple rename commands in a single query.
 2020-05-16 12:54:04 +03:00
Nikolai Kochetov
c957154fef
Merge pull request #10952 from ClickHouse/fix-distributed-queries-incompatibility-19.16-20.1 
Fix incompatibility of two-level aggregation between 19.16 and 20.1
 2020-05-16 10:17:15 +03:00
Nikolai Kochetov
fb38c2a30b
Remove experimental_use_processors setting, part 1. (#10924) 
Remove experimental_use_processors setting, part 1.
 2020-05-15 22:28:10 +03:00
Alexey Milovidov
485d37b043 Fix incompatibility of two-level aggregation between 19.16 and 20.1 2020-05-15 22:09:32 +03:00
Alexey Milovidov
7a20d95339 Enable input_format_with_names_use_header by default 2020-05-15 10:30:26 +03:00
Anton Popov
14e1a46a8c Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-15 03:48:27 +03:00
Ri
fc7afaa639
Bitonic sort on GPU (OpenCL) (#10232) 2020-05-15 03:01:14 +03:00
Nikolai Kochetov
4d22374f24 Merged with master. 2020-05-14 12:06:15 +03:00
Nikolai Kochetov
4d0503f021 Make IColumn::mutate() static. 2020-05-14 11:30:18 +03:00
alesapin
ab760846c2 Fix some rename cases 2020-05-13 20:43:30 +03:00
Dmitry
c4295d97f9 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-05-12 17:57:32 +03:00
Dmitry
3ec80b5531 now aggregates in parallel 2020-05-12 17:50:13 +03:00
potya
723e61c410 go back 2020-05-12 16:19:38 +03:00
alexey-milovidov
75607db571
Merge pull request #10826 from azat/block-sort-fix 
Fix columns order after Block::sortColumns()
 2020-05-12 06:39:18 +03:00
Azat Khuzhin
b963085920 Fix style check in Block::sortColumns() (sigh) 2020-05-12 04:04:25 +03:00
Azat Khuzhin
4de7d7a84f Sort iterators to avoid extra std::string creation in Block::sortColumns() 
Since std::string is pretty heavy.

Suggested-by: @alexey-milovidov
 2020-05-12 03:53:08 +03:00
Azat Khuzhin
0e117abd2b Optimize Block::sortColumns() 
Suggested-by: @alexey-milovidov
 2020-05-12 03:45:50 +03:00
Azat Khuzhin
ce26c09d02 Make order of columns strict in Block::sortColumns() 
Before it depends on the buckets, since it uses plain unordered_set.
 2020-05-12 02:50:42 +03:00
alexey-milovidov
1e70230991
Merge pull request #10722 from Enmk/DateTime64_fixes 
function toStartOfSecond(DateTime64) -> DateTime64
 2020-05-11 20:20:58 +03:00
Vasily Nemkov
2c2005817f New function toStartOfSecond(DateTime64) -> DateTime64 
This funtion nullifies sub-second part of DateTime64 value.
 2020-05-11 12:06:06 +03:00
alexey-milovidov
33d491edf3
Merge pull request #10516 from azat/dist-GROUP_BY-sharding_key-fixes 
Disable GROUP BY sharding_key optimization by default (and fix for WITH ROLLUP/CUBE/TOTALS)
 2020-05-11 12:03:27 +03:00
alexey-milovidov
40ef113503
Merge branch 'master' into parallel-final 2020-05-11 06:47:44 +03:00
alexey-milovidov
ddc84163a7
Merge pull request #10486 from azat/dist-send-on-INSERT 
Fix distributed send that are scheduled by INSERT query
 2020-05-11 06:28:35 +03:00
Azat Khuzhin
7342f46394 Fix setting type for the memory_profiler_sample_probability 2020-05-10 15:49:31 +03:00
Chao Wang
bc5f9d5322
Fix comment for merge_tree_max_bytes_to_use_cache 2020-05-08 16:39:00 -04:00
Ivan
85d783c247
Poco contrib refactoring (#10396) 
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
 2020-05-08 17:11:19 +03:00
Dmitry
7bbb85dbe5 small fixes 2020-05-07 18:37:19 +03:00
tavplubix
04a24c59dc
Add tests with DatabaseAtomic (#10714) 
* add tests with DatabaseAtomic

* fix
 2020-05-07 14:29:58 +03:00
Anton Popov
387041a97e Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-06 19:22:07 +03:00
Dmitry
e98c23a8cf read in order enabled 2020-05-05 17:35:23 +03:00
alexey-milovidov
c54f6d5a66
Merge pull request #10546 from kyprizel/master 
Lexer, ast, checksum and column specs fuzzers added
 2020-05-05 14:50:55 +03:00
Alexey Milovidov
99c18c5a09 Check for suspicious codecs #4966 2020-05-04 03:11:49 +03:00
alexey-milovidov
0cdd48e468
Merge pull request #10598 from ClickHouse/sampling-memory-profiler 
Add sampling memory profiler
 2020-05-03 15:17:03 +03:00
Azat Khuzhin
0157fd5d93 Fix distributed send that are scheduled by INSERT query 
Before this patch each INSERT query re-schedule distributed send, thus
each time it resets the timer, while this is not the expected behaviour,
since in on frequent INSERT distributed sends will not be triggered at
all.

Fix this by not resetting the timer.
 2020-05-03 14:46:42 +03:00
tavplubix
a073cd6c79
Fix segfault in StorageBuffer when exception on server startup (#10609) 
* fix segfault in StorageBuffer when exception on server startup

* Trigger CI

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
 2020-05-02 19:54:20 +03:00
Alexey Milovidov
439777ef23 Allow to set memory_profiler_sample_probability per query 2020-05-01 22:17:56 +03:00
Anton Popov
aa723d245f Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-30 18:27:39 +03:00
Nikolai Kochetov
19dadb8c2d Add parallel final. 2020-04-30 12:59:08 +03:00
Potya
351d62aa83 Nothing interesting 2020-04-29 15:17:40 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view 
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
 2020-04-29 12:15:54 +03:00
Azat Khuzhin
038235684d Add optimize_distributed_group_by_sharding_key and disable it by default 
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
 2020-04-29 00:09:25 +03:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk (#10467) 2020-04-28 16:55:50 +03:00
Eldar Zaitov
043be916cb Add miniman fuzzing documentation, fix code style. 2020-04-28 13:35:44 +03:00
Eldar Zaitov
670ed4bf1b lexer, ast, checksum and column specs fuzzers added 2020-04-28 02:12:18 +03:00
Nikolai Kochetov
32baa073b5 Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view 2020-04-27 17:49:50 +03:00
alexey-milovidov
0a9bcae0ed
Merge pull request #10511 from ClickHouse/fix-ubsan-datetime64 
Fixed UBSan for DateTime64; added a test
 2020-04-26 20:17:01 +03:00
alexey-milovidov
378d73d477
Merge pull request #10449 from azat/metrics-for-new-bg-schedule-pools 
Add tasks/memory metrics for distributed/buffer schedule pools
 2020-04-26 20:16:02 +03:00
Alexey Milovidov
a70637ab4b Fixed UBSan; added a test 2020-04-26 17:57:45 +03:00
Vitaliy Zakaznikov
369b4d53ef Adding support for output_format_enable_streaming format setting. 2020-04-26 15:44:11 +02:00
Dmitry
d9ac0e8fef Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-26 14:44:06 +03:00
Vitaliy Zakaznikov
71a40d6ec9 Revert "Working on adding AUTO REFRESH to LIVE VIEW tables." 
This reverts commit 855e06b031.
 2020-04-25 09:56:57 -04:00
Vitaliy Zakaznikov
855e06b031 Working on adding AUTO REFRESH to LIVE VIEW tables. 2020-04-24 17:15:17 -04:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Azat Khuzhin
4f5ec14f27 Configure thread names for buffer/distributed schedule pools 2020-04-23 03:16:14 +03:00
Azat Khuzhin
d854049d21 Add tasks/memory metrics for distributed/buffer schedule pools 
Follow-up-for: #10315
Follow-up-for: #10263
 2020-04-23 02:18:37 +03:00
Alexander Tokmakov
fefbbd37df Merge branch 'master' into database_atomic 2020-04-22 17:02:30 +03:00
Alexey Milovidov
be22a4b94e Checkpoint 2020-04-22 08:39:31 +03:00
Alexey Milovidov
0482e2e3ea Implement suggestion from Sergey Veletsky 2020-04-22 01:40:18 +03:00
alexey-milovidov
4ecc86beca
Merge pull request #9950 from ClickHouse/aku/literal-columns 
Create unique columns for literals
 2020-04-21 02:30:17 +03:00
alexey-milovidov
faeab5f649
Merge pull request #10370 from amosbird/clang-10 
clang-10 fix
 2020-04-20 22:47:12 +03:00
Alexander Tokmakov
b29bddac12 Merge branch 'master' into database_atomic 2020-04-20 14:09:09 +03:00
alexey-milovidov
9d0004cba0
Merge pull request #10365 from ClickHouse/avoid-infinite-loop-in-hierarchical-dictionaries 
Avoid infinite loop in hierarchical dictionaries
 2020-04-20 10:54:16 +03:00
Amos Bird
2d08c8e4ab
clang-10 fix 2020-04-20 15:45:37 +08:00
Alexey Milovidov
d99c26a40c Fix infinite loop in dictIsIn function #515 2020-04-20 05:31:21 +03:00
Anton Popov
4069dbcc58 in-memory parts: add waiting for insert 2020-04-20 04:38:38 +03:00
Alexey Milovidov
1d885b3ff9 Merge branch 'master' into quota-key-in-client 2020-04-20 02:15:37 +03:00
Alexey Milovidov
3755a5ba54 Added suggestion from Azat 2020-04-20 01:59:21 +03:00
Alexey Milovidov
2987e70aab Introduce "max_server_memory_usage" setting 2020-04-20 01:59:21 +03:00
Azat Khuzhin
5d11118cc9 Use thread pool (background_distributed_schedule_pool_size) for distributed sends 
After #8756 the problem with 1 thread for each (distributed table, disk)
for distributed sends became even worse (since there can be multiple
disks), so use predefined thread pool for this tasks, that can be
controlled with background_distributed_schedule_pool_size knob.
 2020-04-19 12:01:56 +03:00
Azat Khuzhin
201d5d5b25 Update comment for background_schedule_pool_size 
Include info about:
- kafka streaming
- dns cache updates
 2020-04-19 11:20:57 +03:00
alexey-milovidov
17b6e0b3e5
Merge pull request #10315 from azat/buffer-flush-bg-pool 
Use background thread pool for background buffer flushes
 2020-04-18 15:04:35 +03:00
Dmitry
25cd4ce132 Merge branch 'master' of github.com:yandex/ClickHouse into group_by_in_order_optimization 2020-04-18 12:56:34 +03:00
alexey-milovidov
17e7d4d88a
Merge pull request #10307 from abyss7/arcadia-4 
Changes for auto-sync with Arcadia
 2020-04-17 05:08:34 +03:00
Azat Khuzhin
a9b1b36907 Use separate pool for buffer flushes (background_buffer_flush_schedule_pool_size) 2020-04-16 20:14:28 +03:00
Ivan Lezhankin
e230632645 Changes required for auto-sync with Arcadia 2020-04-16 15:31:57 +03:00
Alexey Milovidov
cdeda4ab91 Fix usage of max_parser_depth setting; remove harmful default function arguments 2020-04-16 04:06:10 +03:00
Alexey Milovidov
fe59524481 Implemented in a different way 2020-04-15 04:59:14 +03:00
Alexey Milovidov
c22f91db01 Allow to pass quota_key in clickhouse-client 2020-04-15 04:15:05 +03:00
Alexander Kuzmenkov
59e8230271 Merge remote-tracking branch 'origin/master' into HEAD 2020-04-14 02:27:46 +03:00
Alexander Tokmakov
6c0d9723e0 Merge branch 'master' into database_atomic 2020-04-13 18:47:47 +03:00
Alexander Tokmakov
20e6593f96 disable by default 2020-04-12 21:52:59 +03:00
Alexander Tokmakov
5e6d4b9449 Merge branch 'master' into database_atomic 2020-04-12 16:35:44 +03:00
Azat Khuzhin
365b5207b7 Add log_queries_min_type to filter which entries will be written to query_log 
Can be used to write into query_log only failed queries (i.e. on memory
exceeded error), by using:

  set log_queries_min_type='EXCEPTION_WHILE_PROCESSING'
 2020-04-12 10:46:36 +03:00
alexey-milovidov
9203db0ad5
Merge pull request #10140 from BohuTANG/20200409_bug_fix_mysql_handshake_scramble 
Fix scramble issue for native mysql-connector-java(JDBC)
 2020-04-12 03:53:19 +03:00
alexey-milovidov
2adeabd3c7
Update Settings.h 2020-04-12 01:58:45 +03:00
alexey-milovidov
00d8e7eefb
Merge branch 'master' into transform_null_in 2020-04-11 23:15:54 +03:00
alexey-milovidov
25236d3544
Merge branch 'master' into setting_allow_nondeterministic_mutations 2020-04-10 23:58:46 +03:00
alexey-milovidov
330d138106
Update Settings.h 2020-04-10 23:58:13 +03:00
Mikhail Filimonov
2f5b4b0f9b Added ability to relax the restriction on non-deterministic functions usage in mutations with allow_nondeterministic_mutations setting. 2020-04-10 22:01:10 +02:00
Alexander Kazakov
26dd6140b2 Added new config settings to control timeouts 
* "lock_acquire_timeout" controls for how long a query will continue to
acquire each lock on its argument tables
 * "lock_acquire_timeout_for_background_operations" is a per-table
setting for storages of *MergeTree family
 2020-04-09 21:10:27 +03:00
alexey-milovidov
cb6c860d89
Update MySQLProtocol.h 2020-04-09 06:25:20 +03:00
alexey-milovidov
ccf5cb2a66
Update MySQLProtocol.h 2020-04-09 06:24:09 +03:00
BohuTANG
e544edd726 Fix random scramble using seperator character issue during MySQL handshakes 2020-04-09 09:43:02 +08:00
Alexander Tokmakov
135197aa75 fixes 2020-04-08 04:02:00 +03:00
philip.han
53b5dade5e Implement transform_null_in 2020-04-07 20:08:13 +09:00
Alexander Kuzmenkov
35783af25d Merge remote-tracking branch 'origin/master' into HEAD 2020-04-07 03:34:39 +03:00
Alexander Tokmakov
08bae4668d Merge branch 'master' into database_atomic 2020-04-06 16:18:07 +03:00
Vxider
2fb9138505 merged with master 2020-04-06 17:36:44 +08:00
Ivan Lezhankin
06446b4f08 dbms/ → src/ 2020-04-03 18:14:31 +03:00