225 Commits

Author	SHA1	Message	Date
alesapin	72046313d4	Merge branch 'master' into nvartolomei-drop-part	2020-11-09 10:02:02 +03:00
Alexey Milovidov	5314185e25	Merge branch 'master' into azat-optimize_skip_unused_shards-optimization	2020-11-08 00:17:59 +03:00
Nikolai Kochetov	c10f733587	Merge branch 'master' into storage-read-query-plan	2020-11-06 15:43:46 +03:00
alexey-milovidov	ee3e289ec2	Merge pull request #15983 from ClickHouse/no_background_pool_no_more ... Replace BackgroundProcessingPool with SchedulePool task and ThreadPool.	2020-11-05 21:38:22 +03:00
alesapin	20043e77bb	Merge branch 'master' into nvartolomei-drop-part	2020-11-04 10:22:23 +03:00
Alexander Tokmakov	ac32809b6a	fix #16482	2020-11-02 19:40:39 +03:00
alesapin	67d22b3e57	Merge branch 'master' into nvartolomei-drop-part	2020-11-02 19:09:09 +03:00
hchen9	feaab260d8	Fix conflict	2020-10-23 12:54:33 -07:00
alesapin	7a63b373f9	Merge branch 'blind_fix_of_read_in_order' into no_background_pool_no_more	2020-10-22 15:47:11 +03:00
Nikolai Kochetov	7fa045cff8	Merge branch 'master' into storage-read-query-plan	2020-10-22 13:31:10 +03:00
alesapin	7edbe4d276	Add some comments	2020-10-16 13:12:31 +03:00
alesapin	4c1f5cab13	Sleep less in background task	2020-10-15 19:10:22 +03:00
Amos Bird	867216103f	Extend trivial count optimization.	2020-10-08 18:08:17 +08:00
Azat Khuzhin	b838214a35	Pass non-const SelectQueryInfo (and drop mutable qualifiers)	2020-10-02 22:42:35 +03:00
Azat Khuzhin	587cde853e	Avoid skipping unused shards twice (for query processing stage and read itself)	2020-10-02 22:42:09 +03:00
hchen9	b3949db00f	Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into trivial_count_seq_consistency	2020-10-01 21:15:26 -07:00
Nikolai Kochetov	ec64def384	Use QueryPlan while reading from MergeTree.	2020-10-01 20:34:22 +03:00
hchen9	a5ac39b564	Pass Context parameter for IStorage.totalRows and IStorage.totalBytes	2020-09-30 16:47:42 -07:00
Nikolai Kochetov	2efde179e9	Merge branch 'master' into storage-read-query-plan	2020-09-30 15:23:46 +03:00
Alexander Tokmakov	34addcf61f	add review suggestions	2020-09-26 22:18:28 +03:00
Nikolai Kochetov	dea90009e3	Fix build	2020-09-25 16:03:12 +03:00
Nikolai Kochetov	62ef40394a	Merge pull request #14856 from ClickHouse/query-plan-for-creating-sets ... Query plan for creating sets	2020-09-22 16:19:20 +03:00
Nikolai Kochetov	50674a320f	Refactor IStorage::read with query plan.	2020-09-18 14:39:07 +03:00
roman	b41421cb1c	[settings]: introduce new query complexity settings for leaf-nodes ... The new setting should allow to control query complexity on leaf nodes excluding the final merging stage on the root-node. For example, distributed query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`, while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500` this limit won't be reached and query will succeed since every shard reads not more that ~1k rows.	2020-09-17 10:37:05 +01:00
Nikolai Kochetov	13edfeea1f	Fix build.	2020-09-15 20:23:49 +03:00
Nikolai Kochetov	6eac433c55	Review fixes.	2020-09-15 13:40:39 +03:00
Nikolai Kochetov	8c2aa7ce8c	Added comment.	2020-09-15 12:22:45 +03:00
Nikolai Kochetov	bcfc83022a	Return query plan from storage.	2020-09-14 17:13:58 +03:00
Nicolae Vartolomei	97d0b5ab23	Remove unused query argument	2020-09-08 10:56:10 +01:00
Nikolai Kochetov	9b67cd9faf	Merge branch 'master' into refactor-pipes-3	2020-08-10 10:50:17 +03:00
Alexey Milovidov	edd89a8610	Fix half of typos	2020-08-08 03:47:03 +03:00
Nikolai Kochetov	09fbce1b1e	Merge branch 'master' into refactor-pipes-3	2020-08-04 11:32:34 +03:00
Nikolai Kochetov	e411916bde	Refactor Pipe [part 1].	2020-08-03 14:33:11 +03:00
Vitaly Baranov	90602b869a	Make SettingsChanges a class.	2020-07-31 19:11:27 +03:00
Vitaly Baranov	30b34e6a15	Use SettingSeconds only in Settings, use std::chrono::seconds in other places.	2020-07-31 19:11:27 +03:00
alesapin	c75830e878	Alter table freeze with verbose output	2020-07-28 18:10:36 +03:00
alesapin	1f576ee039	Some intermediate solution	2020-07-13 20:27:52 +03:00
alesapin	4a53264a86	Remove redundant and duplicated code	2020-07-13 19:19:08 +03:00
Azat Khuzhin	433fdffc19	Add lifetime_rows/lifetime_bytes interface (exported via system.tables)	2020-07-11 15:33:11 +03:00
Azat Khuzhin	84c93a6b02	Tiny IStorage refactoring	2020-07-11 15:17:06 +03:00
Maxim Akhmedov	29d2928f93	Consider allocatedBytes() instead of bytes() in Storage{Buffer,Memory}.	2020-06-25 00:27:53 +03:00
alesapin	f262c4f652	Better comments	2020-06-22 12:49:21 +03:00
alesapin	4c0879ae30	Better logging in storages	2020-06-19 20:17:13 +03:00
alesapin	c9fa5d2ec3	Better naming	2020-06-19 18:39:41 +03:00
alesapin	3c47faa9da	Move partition key initialization into registerMergeTree	2020-06-19 18:14:08 +03:00
alesapin	d79982f497	Better locks in Storages	2020-06-18 19:10:47 +03:00
alesapin	d4c49816ab	Really atomic metadata	2020-06-18 14:02:31 +03:00
alesapin	aab4ce6394	Truncate with metadata	2020-06-18 13:29:13 +03:00
alesapin	dffdece350	getColumns in StorageInMemoryMetadta (only compilable)	2020-06-17 19:39:58 +03:00
alesapin	ef8781cce7	Better getVirtuals method	2020-06-17 17:37:21 +03:00
alesapin	33c27de54d	Check methods in metadata	2020-06-17 17:32:25 +03:00
alesapin	31abbe5dbd	Select query in metadata	2020-06-17 17:06:22 +03:00
alesapin	eaaef83742	Settings changes in StorageInMemoryMetadata	2020-06-17 16:46:01 +03:00
alesapin	ed8f3b2fc4	TTL in storage in memory metadata	2020-06-17 16:39:26 +03:00
alesapin	1afdebeebd	Primary key in storage metadata	2020-06-17 15:39:20 +03:00
alesapin	1da393b218	Sampling key in StorageInMemoryMetadata	2020-06-17 15:07:09 +03:00
alesapin	ba04d02f1e	Compilable sorting key in metadata	2020-06-17 14:05:11 +03:00
alesapin	ab61abccc1	Partition key in StorageInMemoryMetadata	2020-06-17 13:34:23 +03:00
alesapin	62f2c17a66	Secondary indices in StorageInMemoryMetadata	2020-06-17 12:38:47 +03:00
alesapin	ccc2bda666	getConstraints() in StorageInMemoryMetadata (suspicious commit, but pretend to work)	2020-06-16 19:55:04 +03:00
alesapin	1ddeb3d149	Buildable getSampleBlock in StorageInMemoryMetadata	2020-06-16 18:51:29 +03:00
alesapin	71f99a274d	Compileable getSampleBlockWithColumns in StorageInMemoryMetadata	2020-06-16 17:25:08 +03:00
alesapin	08b9aa6b2e	getSampleBlockWithVirtuals in StorageInMemoryMetadata	2020-06-16 15:58:05 +03:00
alesapin	53cb5210de	Move getSampleBlockNonMaterialized to StorageInMemoryMetadata	2020-06-16 15:48:10 +03:00
alesapin	0bcd22008a	Get column dependencies in StorageInMemoryMetadata	2020-06-16 15:19:21 +03:00
alesapin	36ba0192df	Metadata in read and write methods of IStorage	2020-06-15 22:08:58 +03:00
alesapin	b47a7327fd	All set methods in metadata	2020-06-15 21:08:05 +03:00
alesapin	33a74a3ea0	TTL methods in StorageInMemoryMetadata	2020-06-15 20:50:53 +03:00
alesapin	5fc41c7ecc	Move set*Key methods to StorageInMemoryMetadata	2020-06-15 20:17:06 +03:00
alesapin	aa30649ce5	Working setColumns, setConstraints, setIndices	2020-06-15 20:10:14 +03:00
alesapin	af2fe2ba55	Compilable setColumns, setConstraints, setIndices	2020-06-15 19:55:33 +03:00
alesapin	18b58e8483	Revert too strict lock	2020-06-13 12:12:45 +03:00
alesapin	d636cdf4b0	Remove outdated comment	2020-06-13 11:55:03 +03:00
alesapin	fcfb6d3bc2	Merge with master	2020-06-13 11:51:07 +03:00
alesapin	0edf5ff7a2	Fix race condition	2020-06-12 17:32:47 +03:00
alesapin	8be957ecb5	Better checks around metadata	2020-06-10 14:16:31 +03:00
alesapin	ec933d9d03	Better naming	2020-06-10 12:09:51 +03:00
alesapin	abaf47f0cd	Make metadata single structure	2020-06-05 20:29:40 +03:00
alesapin	2b23d1aa33	Fix reference	2020-06-05 15:13:24 +03:00
alesapin	5bc7f67e61	Better metadata for select query and renames	2020-06-05 14:54:54 +03:00
alesapin	b49be4c7f2	Better names	2020-06-01 15:11:23 +03:00
alesapin	663e92b1c5	Rename to methods	2020-06-01 14:29:11 +03:00
alesapin	d9a817f578	Less virtual methods in IStorage	2020-06-01 14:17:18 +03:00
alesapin	72c17a8e3a	Slightly more comments	2020-06-01 13:48:52 +03:00
alesapin	3847ea892d	Merge branch 'master' into consistent_metadata3	2020-06-01 13:17:59 +03:00
alexey-milovidov	3eea042d16	Merge pull request #11243 from ClickHouse/remove-experimental-use-processors-flag-4 ... Remove some code.	2020-05-30 21:05:14 +03:00
alesapin	860dc2c814	Merge with consistent_metadata2	2020-05-28 19:45:51 +03:00
alesapin	61aff798d3	Compileable code	2020-05-28 18:33:44 +03:00
alesapin	52ca6b2051	I'm able to build it	2020-05-28 15:37:05 +03:00
Nikolai Kochetov	1fa795988f	Remove some code.	2020-05-28 11:24:59 +03:00
alesapin	380c60a33f	Intermediate stage (doesn't compile)	2020-05-27 21:38:34 +03:00
alesapin	c7cda399c7	Merge branch 'master' into consistent_metadata2	2020-05-27 12:51:56 +03:00
alesapin	9d0c28d96c	Add missing methods	2020-05-26 17:14:08 +03:00
alesapin	6626ef08e8	Fix PVS studio errors	2020-05-26 15:14:50 +03:00
alesapin	adc7439a4c	Comments and refactoring	2020-05-25 20:57:08 +03:00
alesapin	9b3cc9e525	Almost working ttl in IStorage	2020-05-25 20:07:14 +03:00
alesapin	a935db4169	boop CI	2020-05-22 15:34:26 +03:00
alesapin	327d17ac6a	Better	2020-05-21 22:46:03 +03:00
alesapin	616902a995	Sorting and primary key (broken)	2020-05-20 21:11:38 +03:00
alesapin	9fb28f5ac0	Add sampling key	2020-05-20 18:16:39 +03:00
alesapin	8bc527eecd	Compile partition key	2020-05-20 15:16:55 +03:00
alesapin	f209052519	Better comments	2020-05-13 14:04:27 +03:00
alesapin	4d8660f270	Remove obsolete comment	2020-05-01 13:05:37 +03:00
alesapin	f981649213	Fix pushing to views stream and refactor virtuals	2020-04-28 13:38:57 +03:00
alesapin	4badd0fd28	Better code	2020-04-27 20:46:51 +03:00
alesapin	b0c5c1d685	Fix style	2020-04-27 18:21:37 +03:00
alesapin	cefc58e77c	Fix style	2020-04-27 18:17:08 +03:00
alesapin	18c550df15	Better virtuals logic	2020-04-27 16:55:30 +03:00
alesapin	2829774105	Merge branch 'master' into refactor_istorage	2020-04-27 15:34:21 +03:00
tavplubix	7928f2eaa1	Merge pull request #7512 from ClickHouse/database_atomic ... DatabaseAtomic	2020-04-24 22:28:18 +03:00
alesapin	b4425c2dc4	Remove getColumn and hasColumn methods from IStorage	2020-04-24 13:20:03 +03:00
alesapin	5ae25b68e4	Remove redundant virtual from function	2020-04-23 18:18:33 +03:00
alesapin	b0a73589b0	Remove virtual columns as separate field from IStorage	2020-04-23 18:09:00 +03:00
Alexander Tokmakov	04d6b59ac0	Merge branch 'master' into database_atomic	2020-04-23 17:31:37 +03:00
Alexey Milovidov	1e325a9fd9	Checkpoint	2020-04-22 09:22:14 +03:00
Alexander Tokmakov	5e6d4b9449	Merge branch 'master' into database_atomic	2020-04-12 16:35:44 +03:00
Alexander Kazakov	497df3086f	Merge branch 'master' into timed_rwlock ... Change-Id: I620bfde2121ff013773b001d514b40b1e796a58b	2020-04-10 11:38:20 +03:00
Alexander Kazakov	26dd6140b2	Added new config settings to control timeouts ... * "lock_acquire_timeout" controls for how long a query will continue to acquire each lock on its argument tables * "lock_acquire_timeout_for_background_operations" is a per-table setting for storages of *MergeTree family	2020-04-09 21:10:27 +03:00
Alexander Tokmakov	dd1590830b	Merge branch 'master' into database_atomic	2020-04-08 22:00:46 +03:00
Alexander Tokmakov	4c48b7dd80	better rename	2020-04-07 18:31:33 +03:00
Alexander Kazakov	621d26bcf7	Better timeout diagnostics message	2020-04-07 14:34:35 +03:00
Alexander Tokmakov	a2101c9b1c	better code	2020-04-07 02:22:44 +03:00
Alexander Tokmakov	08bae4668d	Merge branch 'master' into database_atomic	2020-04-06 16:18:07 +03:00
Azat Khuzhin	1232760f78	Fix Distributed-over-Distributed when nested table has only one shard	2020-04-04 13:47:35 +03:00
Ivan Lezhankin	06446b4f08	dbms/ → src/	2020-04-03 18:14:31 +03:00