248 Commits

Author	SHA1	Message	Date
alexey-milovidov	40ef113503	Merge branch 'master' into parallel-final	2020-05-11 06:47:44 +03:00
alexey-milovidov	ddc84163a7	Merge pull request #10486 from azat/dist-send-on-INSERT ... Fix distributed send that are scheduled by INSERT query	2020-05-11 06:28:35 +03:00
Azat Khuzhin	5c89cdbe61	Fix distributed send retries on distributed_directory_monitor_{max_,}sleep_time_ms > 5min ... In this case error_count can be decreased before checking it for rescheduling send. And actually this can be a problem not only when distributed_directory_monitor_{max_,}sleep_time_ms > 5min, because all threads can be occupated and the real timeout between sends will be > 5min.	2020-05-10 12:37:38 +03:00
Alexey Milovidov	36d9d646a9	Fix race condition in ReplicatedMergeTreeQueue	2020-05-10 05:18:10 +03:00
alexey-milovidov	992e58923a	Merge pull request #10588 from excitoon-favorites/fixmutations ... Fixed handling condition variable for synchronous mutations	2020-05-10 03:20:41 +03:00
alexey-milovidov	63c4a7661f	Merge pull request #10715 from CurtizJ/pk-function ... Fix usage of primary key wrapped into a function.	2020-05-10 02:08:59 +03:00
Ivan	85d783c247	Poco contrib refactoring (#10396) ... * Remove config_common.h * Refactor libcpuid contrib * Remove support for libcpuinfo * Define USE_CPUID in Arcadia * Refactor Poco libraries	2020-05-08 17:11:19 +03:00
Vladimir Chebotarev	28631f461e	Fixed handling of condition variable for synchronous mutations.	2020-05-08 12:01:06 +03:00
Nikolai Kochetov	c22f7a0864	Try fix header for GenerateRandom.	2020-05-07 17:14:56 +03:00
Anton Popov	cbbd8e521c	fix usage of primary key wrapped into a function with 'FINAL' modifier and 'ORDER BY' optimization	2020-05-07 01:27:35 +03:00
alexey-milovidov	4df7dd8c2b	Merge pull request #10656 from azat/kafka-consumer-hang ... Kafka cleanup	2020-05-07 00:20:31 +03:00
alexey-milovidov	114f09cfca	Merge pull request #10666 from NanoBjorn/refactor-volume ... Volumes and storages refactoring	2020-05-05 16:25:26 +03:00
alexey-milovidov	c54f6d5a66	Merge pull request #10546 from kyprizel/master ... Lexer, ast, checksum and column specs fuzzers added	2020-05-05 14:50:55 +03:00
alexey-milovidov	09756a036a	Merge pull request #10645 from ClickHouse/check-suspicious-codecs ... Check for suspicious codecs #4966	2020-05-04 23:33:59 +03:00
Gleb Novikov	c637d99e07	Volumes and storages refactoring: ... 1. Moved Volume to separate file 2. Created IVolume interface and implemented current behaviour in implementation of new interface — VolumeJBOD 3. Replaced all old volume usages with new VolumeJBOD. Where it is unnecessary to have JBOD — left just IVolume. 4. Removed old Volume completely 5. Moved StoragePolicy to separated files 6. Moved DiskSelector to separated files 7. Removed DiskSpaceMonitor file	2020-05-04 23:15:38 +03:00
alesapin	d47d28d51f	Fix mutations assignment	2020-05-04 19:30:39 +03:00
Azat Khuzhin	61c5df5662	Drop claimed from the KafkaBlockInputStream	2020-05-04 17:23:09 +03:00
Azat Khuzhin	a10cfc3ae5	Pass stream_cancelled to the copyData as stub in StorageKafka	2020-05-04 17:23:09 +03:00
Azat Khuzhin	c69217e9f3	Force destrying of kafka buffers from the shutdown in StorageKafka	2020-05-04 17:23:09 +03:00
Azat Khuzhin	9e14db2091	Add missing kafka settings into docs	2020-05-04 17:23:05 +03:00
Alexey Milovidov	99c18c5a09	Check for suspicious codecs #4966	2020-05-04 03:11:49 +03:00
alexey-milovidov	884c2aa631	Merge pull request #10641 from ClickHouse/storage-buffer-nullptr-dereference ... Fix nullptr dereference in StorageBuffer	2020-05-04 02:01:57 +03:00
Alexey Milovidov	a5bdc375ca	Fix Arcadia #10569	2020-05-04 00:36:11 +03:00
Alexey Milovidov	f8866af0c1	Fix nullptr dereference in StorageBuffer	2020-05-03 23:53:54 +03:00
Azat Khuzhin	6ffdd53b6a	Share auto-increment for first batch and tmp file in DistributedBlockOutputStream	2020-05-03 14:47:59 +03:00
Azat Khuzhin	53c470cab4	Fix directory monitor initialization from INSERT into Distributed ... This also fixes hardlink code (when one file should be sent to multiple servers, i.e. internal_replication == false) of writeToShard() with distributed_storage_policy (i.e. when StorageDistributed::getPath() will path to different filesystems). Plus also cleanup DistributedBlockOutputStream::writeToShard() a little.	2020-05-03 14:47:51 +03:00
Azat Khuzhin	e97e1f06db	Do not schedule distributed send if there were no error ... Since in this case it will be scheduled from the DistributedBlockOutputStream with the distributed_directory_monitor_max_sleep_time_ms, and this will overwrite timer that was set by the DistributedBlockOutputStream, not good.	2020-05-03 14:46:44 +03:00
Azat Khuzhin	947b3942dd	Schedule distributed sends after the file has been written	2020-05-03 14:46:43 +03:00
Azat Khuzhin	0157fd5d93	Fix distributed send that are scheduled by INSERT query ... Before this patch each INSERT query re-schedule distributed send, thus each time it resets the timer, while this is not the expected behaviour, since in on frequent INSERT distributed sends will not be triggered at all. Fix this by not resetting the timer.	2020-05-03 14:46:42 +03:00
Azat Khuzhin	6bb39dafc3	Drop decreated code (cond var and note for thread) in DirectoryMonitor	2020-05-03 14:46:41 +03:00
alexey-milovidov	db4c2352e1	Merge pull request #10569 from zhang2014/fix/ISSUES-10551 ... ISSUES-10551 add backward compatibility for create bloom filter index	2020-05-02 22:25:29 +03:00
alexey-milovidov	229f666dea	Merge pull request #10611 from azat/optimize_skip_unused_shards-LowCardinality ... Fix optimize_skip_unused_shards with LowCardinality	2020-05-02 22:14:33 +03:00
alexey-milovidov	4f1b115e76	Merge pull request #10610 from azat/optimize_skip_unused_shards-fixes ... Fix logging for optimize_skip_unused_shards	2020-05-02 22:13:01 +03:00
tavplubix	a073cd6c79	Fix segfault in StorageBuffer when exception on server startup (#10609) ... * fix segfault in StorageBuffer when exception on server startup * Trigger CI Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>	2020-05-02 19:54:20 +03:00
Alexey Milovidov	81adcc9058	Remove obsolete records from system.build_options	2020-05-02 17:00:03 +03:00
alexey-milovidov	404452bad3	Update MergeTreeIndices.cpp	2020-05-01 21:40:56 +03:00
alesapin	4d8660f270	Remove obsolete comment	2020-05-01 13:05:37 +03:00
Azat Khuzhin	63d8ab8f03	Make createSelector() static (in storage) and const (in stream)	2020-05-01 11:31:05 +03:00
Azat Khuzhin	f22ba15b4a	Reduce copy-paste of DistributedBlockOutputStream::createSelector ... This will make it less error prone.	2020-05-01 02:59:40 +03:00
Azat Khuzhin	cdd7013438	Drop superfluous "Skipping irrelevant shards" messages ... Before this patch it printed 3 times: - from StorageDistributed::getProcessingStageImpl() - from StorageDistributed::read() - from StorageDistributed::getProcessingStageImpl() (from StorageDistributed::read() -> getSampleBlock()) (But this should be optimized)	2020-05-01 02:56:13 +03:00
Azat Khuzhin	c648c300bf	Fix optimize_skip_unused_shards with LowCardinality	2020-05-01 02:39:58 +03:00
Azat Khuzhin	4cbe625567	Fix shard numbers output in logs (full cluster had been printed over optimized)	2020-05-01 02:13:07 +03:00
Nikolai Kochetov	19dadb8c2d	Add parallel final.	2020-04-30 12:59:08 +03:00
alesapin	15e8f37839	Merge pull request #10531 from CurtizJ/polymorphic-parts-2 ... Fix index corruption in merges with compact parts.	2020-04-30 12:15:25 +03:00
alesapin	5e2afad549	Merge pull request #10477 from ClickHouse/refactor_istorage ... Remove getColumn and hasColumn from IStorage, better virtuals.	2020-04-30 10:42:52 +03:00
Anton Popov	6ed3092c8a	make fillIndexGranularity less complicated	2020-04-30 00:57:58 +03:00
alesapin	69fdf2a6a3	Review fixes and better test	2020-04-29 15:15:23 +03:00
zhang2014	8ac709b5d3	ISSUES-10551 add backward compatibility for create bloom filter index	2020-04-29 11:57:28 +08:00
robot-clickhouse	de4e88ff97	Auto version update to [20.5.1.1] [54435]	2020-04-28 20:12:16 +03:00
alesapin	f981649213	Fix pushing to views stream and refactor virtuals	2020-04-28 13:38:57 +03:00