363 Commits

Author	SHA1	Message	Date
Igor Nikonov	131f71b50a	Revert "Revert flaky"	2024-01-19 13:51:30 +01:00
Raúl Marín	477489a05d	Revert "Merge pull request #57235 from ClickHouse/pr-custom-key-failover" ... This reverts commit 8ba9b4a7ef, reversing changes made to 0f39245cb8.	2024-01-19 12:46:05 +00:00
Igor Nikonov	8d4a395afa	Merge remote-tracking branch 'origin/master' into pr-custom-key-failover	2024-01-10 20:28:04 +00:00
Igor Nikonov	7fd851b4e9	Merge remote-tracking branch 'origin/master' into pr-custom-key-failover	2024-01-08 20:43:20 +00:00
Anton Popov	8c9cf394b3	Merge remote-tracking branch 'upstream/master' into HEAD	2024-01-06 20:58:17 +00:00
Anton Popov	f252412915	Merge remote-tracking branch 'upstream/master' into HEAD	2024-01-06 03:08:52 +00:00
Nikolai Kochetov	7cfb2e1b44	Merge branch 'master' into analyzer-execution-names	2024-01-05 11:47:30 +01:00
Nikolai Kochetov	84b566d1a8	Merge pull request #58317 from ClickHouse/analyzer-using-func-arg ... Analyzer: support functional arguments in USING clause	2024-01-05 10:43:42 +01:00
Nikolai Kochetov	80c1e59d3f	Merge branch 'master' into analyzer-execution-names	2024-01-05 09:31:25 +00:00
Maksim Kita	8573c66b09	Fixed code review issues	2024-01-04 15:29:25 +03:00
Maksim Kita	b5997e6a96	MergeTreePrefetchedReadPool disable for LIMIT only queries	2024-01-04 15:06:38 +03:00
Anton Popov	ce1b978a2d	Merge remote-tracking branch 'upstream/master' into HEAD	2024-01-03 16:01:44 +00:00
Anton Popov	7dd128f90f	Revert "remove projection from StorageSnapshot" ... This reverts commit a01acf5d2a.	2024-01-03 16:00:50 +00:00
Dmitry Novik	76f58fb49e	Add a comment	2024-01-03 11:17:24 +00:00
Dmitry Novik	cb4d571a45	Support ALIAS columns in USING clause	2024-01-03 11:14:19 +00:00
Igor Nikonov	bee15325fc	Merge remote-tracking branch 'origin/master' into pr-custom-key-failover	2023-12-26 21:56:46 +00:00
Nikolai Kochetov	3cbd895ce1	Merge pull request #57827 from ClickHouse/vdimir/merge_join_array_lowcard ... Fix low-cardinality keys support in MergeJoin	2023-12-22 13:34:06 +01:00
Nikita Mikhaylov	cb6c9557ff	Merge branch 'master' into remove-old-projections-code	2023-12-20 17:45:38 +01:00
Yarik Briukhovetskyi	6e816d45ae	Merge branch 'master' into paste_join	2023-12-19 20:02:24 +01:00
yariks5s	4e418a89d9	fixed suggestions	2023-12-19 19:00:37 +00:00
Nikolai Kochetov	5c1ed3e2c2	Fix additional filters.	2023-12-15 13:00:10 +00:00
vdimir	0473e39352	lowcard in join output	2023-12-14 15:28:19 +00:00
Igor Nikonov	72f1c415f1	Merge remote-tracking branch 'origin/master' into pr-custom-key-failover	2023-12-13 15:03:05 +00:00
Nikolai Kochetov	3e1dc6bcf9	Merge branch 'master' into analyzer-execution-names	2023-12-12 19:32:50 +01:00
Nikolai Kochetov	63533ad5bf	Merge branch 'master' into analyzer-execution-names	2023-12-12 18:30:59 +00:00
Nikolai Kochetov	12f92c9beb	Try to analyze join expression based on column source.	2023-12-12 18:11:53 +00:00
Igor Nikonov	f7e6a17052	Merge remote-tracking branch 'origin/master' into pr-custom-key-failover	2023-12-10 20:21:47 +00:00
vdimir	f3fada0873	Analyzer: Fix JOIN ON true with join_use_nulls	2023-12-08 15:49:16 +00:00
vdimir	c42fade8a7	Analyzer allow join on const for semi and anti	2023-12-06 11:19:14 +00:00
Anton Popov	69896d94be	fix tests	2023-12-04 21:40:19 +00:00
Anton Popov	40a1744b7c	Merge remote-tracking branch 'upstream/master' into HEAD	2023-12-04 18:10:43 +00:00
Igor Nikonov	59daabe95a	Some refactoring and cleanup ... + change load balancing for custom key w/o hedged connections (need the test though)	2023-11-30 14:08:01 +00:00
Anton Popov	65efb18842	Merge remote-tracking branch 'upstream/master' into HEAD	2023-11-21 17:30:38 +00:00
Igor Nikonov	83c6ac4f6c	Remove storage as parameter dependency, only columns are needed	2023-11-21 12:14:12 +00:00
vdimir	11b8395fe7	Address review comments	2023-11-14 11:07:27 +00:00
vdimir	3b73780bf6	Calculate sets from (array) joined actions	2023-11-14 10:35:43 +00:00
vdimir	5c8d0c25ee	Revert "Analyzer: fix logical error with set in array join" ... This reverts commit fede5d8fcb.	2023-11-13 14:42:14 +00:00
vdimir	fede5d8fcb	Analyzer: fix logical error with set in array join	2023-11-13 11:54:01 +00:00
Maksim Kita	bf37f05ccd	Analyzer log used row policies	2023-11-09 19:43:31 +03:00
vdimir	5b5c8db7ed	Support isNotDistinct in JOIN ON in analyzer	2023-11-06 19:34:57 +00:00
Nikolai Kochetov	e885ea9257	Fix building sets.	2023-10-31 13:30:35 +00:00
Nikolai Kochetov	9894be8ceb	Merge branch 'master' into fix-row-policy-analyzer	2023-10-31 11:45:36 +01:00
Kruglov Pavel	62b154930a	Merge pull request #53504 from filimonov/ignore_max_distributed_connections_for_async_remote ... Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1	2023-10-24 14:15:21 +02:00
Raúl Marín	a4f5e9e045	Improvements based on PR review	2023-10-19 15:36:48 +00:00
Raúl Marín	0c49f72433	Tidy	2023-10-17 16:08:50 +02:00
Raúl Marín	bfb5b8f441	Implement replica estimation on top of the analyzer	2023-10-16 18:34:58 +02:00
Raúl Marín	f799f5d7a1	Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation	2023-10-16 15:07:11 +02:00
Raúl Marín	478f635d60	Merge pull request #53792 from ClickHouse/revert-53782-revert-52762-planner-prepare-filters-for-analysis ... Revert "Revert "Planner prepare filters for analysis""	2023-10-16 13:21:54 +02:00
Alexey Milovidov	f02f8f7a3d	Merge branch 'master' into fix-row-policy-analyzer	2023-10-14 02:24:22 +02:00
Anton Popov	1c9d883d8a	Merge remote-tracking branch 'upstream/master' into HEAD	2023-10-13 17:17:01 +00:00
Raúl Marín	c5bd29792a	Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation	2023-10-13 15:05:47 +02:00
Anton Popov	a01acf5d2a	remove projection from StorageSnapshot	2023-10-13 03:18:43 +00:00
vdimir	3aac663bd2	fix	2023-10-12 10:46:58 +00:00
vdimir	84e838d038	Fix 02382_join_and_filtering_set ... Copy missing corresponding code from Interpreter, adjust test (removed with cube)	2023-10-12 10:45:56 +00:00
Raúl Marín	95d2063e91	Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation	2023-10-10 17:29:45 +02:00
Igor Nikonov	0b4d76780f	Merge branch 'master' into revert-53782-revert-52762-planner-prepare-filters-for-analysis	2023-10-09 14:44:00 +02:00
filimonov	bff832c7f0	Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1 ... See #53287	2023-10-02 08:34:46 +02:00
Nikolai Kochetov	26cbb62f2c	Merge branch 'master' into fix-row-policy-analyzer	2023-09-11 14:18:55 +00:00
Dmitry Novik	5266511281	Merge remote-tracking branch 'origin/master' into revert-53782-revert-52762-planner-prepare-filters-for-analysis	2023-08-31 14:40:53 +00:00
Nikolai Kochetov	571abfd41e	Disable trivial count optimization with additional_table_filters in analyzer.	2023-08-31 13:39:18 +00:00
Sergei Trifonov	802579f3f1	Merge pull request #49618 from ClickHouse/concurrency-control-controllable ... Make concurrency control controllable	2023-08-29 19:44:51 +02:00
Raúl Marín	45e8185f9b	Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation	2023-08-29 11:17:34 +02:00
Kruglov Pavel	44db5fa992	Merge branch 'master' into cache-count	2023-08-24 17:21:18 +02:00
avogar	c4f8113a78	Fix tests	2023-08-24 15:05:45 +00:00
Nikolai Kochetov	15182772cc	Update src/Planner/PlannerJoinTree.cpp ... Co-authored-by: Raúl Marín <git@rmr.ninja>	2023-08-24 12:54:11 +02:00
Nikolai Kochetov	6128146371	Fix 02834_remote_session_log ... (cherry picked from commit 40a84e48aae09aff08850e19c5527fd9bcf4ab8e)	2023-08-24 10:34:47 +00:00
Nikolai Kochetov	93ab53163a	Revert "Revert "Planner prepare filters for analysis""	2023-08-24 12:32:56 +02:00
Alexander Tokmakov	011c7f7064	Revert "Planner prepare filters for analysis"	2023-08-24 12:52:03 +03:00
Kruglov Pavel	063c986680	Merge pull request #53637 from Avogar/fast-count-from-files ... Optimize count from files in most input formats	2023-08-23 22:17:29 +02:00
avogar	40e76bfc39	Apply optimization for Planner	2023-08-22 17:01:42 +00:00
Nikolai Kochetov	4222ac528d	Merge branch 'master' into planner-prepare-filters-for-analysis	2023-08-21 16:48:33 +00:00
Dmitry Novik	84131740fd	Fix sanitizer error	2023-08-15 00:22:05 +02:00
Dmitry Novik	9dafc596d0	Analyzer: fix quotas for system tables	2023-08-14 18:44:09 +02:00
Dmitry Novik	5baadf796e	Analyzer: fix row policy	2023-08-08 19:50:07 +00:00
Alexey Milovidov	ce2fcc8f33	Fix wording	2023-08-06 14:48:20 +02:00
Sergei Trifonov	01196ac41f	Merge branch 'master' into concurrency-control-controllable	2023-08-01 15:40:50 +02:00
Maksim Kita	d82a834bec	Planner prepare filters for analysis	2023-07-29 19:17:14 +03:00
Raúl Marín	974f72800f	Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation	2023-07-26 10:35:40 +02:00
Azat Khuzhin	d7f7f16fbc	Introduce IStorage::supportsTrivialCountOptimization() ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-07-24 05:50:44 +02:00
Raúl Marín	b6900c8517	Add support for the analyzer	2023-07-11 13:57:51 +02:00
Alexey Milovidov	2c96580a77	Merge branch 'master' into concurrency-control-controllable	2023-07-04 23:16:04 +03:00
Nikolai Kochetov	471b0d8ad6	Merge pull request #50638 from ClickHouse/vdimir/semi_join_use_nulls_50540 ... Fix crash in anti/semi join	2023-06-08 12:43:34 +02:00
vdimir	a268250aff	Fixes for LowCardinality Nullable in HashJoin	2023-06-07 20:16:36 +02:00
vdimir	f3b5a87a66	Fixing crash in anti/semi join	2023-06-07 20:16:36 +02:00
Dmitry Novik	280e80fcd4	Merge branch 'master' into analyzer-distr-query	2023-06-07 00:32:09 +02:00
Raúl Marín	473743b49f	Disable pure parallel replicas if trivial count optimization is possible (#50594)	2023-06-06 18:38:32 +02:00
Dmitry Novik	d9a6e36685	Add comments	2023-06-05 11:02:23 +00:00
Dmitry Novik	a4cb82127d	Analyzer: WIP on distributed queries	2023-06-01 14:34:29 +00:00
Azat Khuzhin	d03ae2abfa	Fix modernize-loop-convert clang-tidy warning ... Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>	2023-05-09 21:19:37 +02:00
Alexey Milovidov	6fddb5bad3	Simplification	2023-05-07 06:31:00 +02:00
Dmitry Novik	235ad55bad	Merge branch 'master' into analyzer-additional-filters	2023-04-12 01:13:38 +02:00
Dmitry Novik	0e417b1a6f	Cleanup the code	2023-04-11 14:08:28 +00:00
Dmitry Novik	a60c315b3e	Support additional_result_filter	2023-04-06 19:18:26 +00:00
Dmitry Novik	4cb1ffa2eb	Fix distributed case	2023-04-05 16:13:03 +00:00
vdimir	01ce3baf0f	Rename Context::getTemporaryVolume to getGlobalTemporaryVolume	2023-04-05 13:42:13 +00:00
Dmitry Novik	96a1304730	WIP on additional_table_filters	2023-04-04 20:33:59 +00:00
Antonio Andelic	ac8dd527dc	Address PR comments	2023-03-28 07:49:34 +00:00
Antonio Andelic	28182e9489	Fix typo	2023-03-27 15:51:42 +02:00
Antonio Andelic	fa8ea85f3d	Make custom key work with new analyzer	2023-03-27 13:39:33 +00:00
Maksim Kita	f45dac99c2	Revert "Revert "Analyzer planner fixes before enable by default""	2023-03-22 17:19:32 +01:00
Alexey Milovidov	ef5e8462da	Revert "Analyzer planner fixes before enable by default"	2023-03-19 19:25:37 +03:00
Maksim Kita	87f8138c55	Analyzer support row policy	2023-03-15 15:21:49 +01:00
Maksim Kita	6c2084052c	Fixed tests	2023-03-15 15:21:49 +01:00
Maksim Kita	c102adb728	Analyzer added PREWHERE support	2023-03-15 15:21:49 +01:00
Maksim Kita	fe25922899	Planner JOIN TREE build fix	2023-03-12 13:43:58 +01:00
Maksim Kita	25088187d4	Fixed tests	2023-03-11 11:51:54 +01:00
Maksim Kita	0358cb36d8	Fixed tests	2023-03-11 11:51:54 +01:00
Maksim Kita	a762112e15	Analyzer support distributed JOINS and subqueries in IN functions	2023-03-11 11:51:54 +01:00
Igor Nikonov	56e8547f7e	Do not apply the optimization when plan is built only for analysis	2023-03-06 10:47:32 +00:00
Igor Nikonov	b6f05a6399	Merge remote-tracking branch 'origin/master' into analyzer_trivial_count_optimization	2023-03-03 17:44:08 +00:00
Maksim Kita	d55b800fc6	Fixed code review issues	2023-03-02 13:43:03 +01:00
Igor Nikonov	e17c0b6bf1	Review fixes	2023-03-01 20:19:51 +00:00
Maksim Kita	d39be3ac9c	Fixed tests	2023-03-01 18:05:07 +01:00
Maksim Kita	14e01566a0	Fixed tests	2023-03-01 18:05:07 +01:00
Maksim Kita	51ee007e01	Fixed tests	2023-03-01 18:05:07 +01:00
Maksim Kita	bff55d5b2a	Planner table expression data column order fix	2023-03-01 18:03:42 +01:00
Maksim Kita	40fc36bb6f	Fixed tests	2023-03-01 18:03:42 +01:00
vdimir	0a4842a99f	Fix empty result when selection from only one side of join in analyzer	2023-03-01 16:10:31 +00:00
Igor Nikonov	42c5634ae4	Remove debug logging	2023-02-28 11:35:36 +00:00
Igor Nikonov	e01c9ff5ec	Fixes: group by, final	2023-02-27 17:37:29 +00:00
Igor Nikonov	cac9e96d04	Fix: do not apply if FINAL	2023-02-27 10:56:59 +00:00
Igor Nikonov	f9a324c47a	Make diagnostic traces debug level	2023-02-27 09:48:24 +00:00
Igor Nikonov	1e4d9e2421	try to fix	2023-02-26 22:51:17 +00:00
Igor Nikonov	4b5d62d5bf	Analyzer: trivial count optimization	2023-02-26 22:19:01 +00:00
Maksim Kita	cbd961de98	Fixed code review issues	2023-02-18 17:06:00 +01:00
Maksim Kita	6b2adc1ec2	Analyzer storage Merge fixes	2023-02-16 12:17:03 +01:00
Maksim Kita	80af0666ea	Analyzer support Materialized View	2023-02-16 12:17:03 +01:00
Maksim Kita	b2cc71f413	Fixed tests	2023-02-16 12:17:03 +01:00
Maksim Kita	afb3eb3c31	Planner JOIN planning fix	2023-02-16 12:17:03 +01:00
Maksim Kita	af38660cf5	Analyzer support ARRAY JOIN with Nested	2023-02-16 12:17:03 +01:00
Maksim Kita	f8442b2a8d	Analyzer support LiveView	2023-02-16 12:17:03 +01:00
Maksim Kita	70eb41c6a8	Analyzer add single_join_prefer_left_table setting	2023-02-16 12:17:03 +01:00
Maksim Kita	8eb93b216b	Planner JOIN TREE unused columns drop fix	2023-02-16 12:17:02 +01:00
Yakov Olkhovskiy	47509aea83	propagate storage limits to subquery	2023-02-12 02:11:46 +00:00
Alexander Tokmakov	70d1adfe4b	Better formatting for exception messages (#45449) ... * save format string for NetException * format exceptions * format exceptions 2 * format exceptions 3 * format exceptions 4 * format exceptions 5 * format exceptions 6 * fix * format exceptions 7 * format exceptions 8 * Update MergeTreeIndexGin.cpp * Update AggregateFunctionMap.cpp * Update AggregateFunctionMap.cpp * fix	2023-01-24 00:13:58 +03:00
Maksim Kita	2c56b0b2b9	Planner small fixes	2023-01-19 19:05:49 +01:00
Maksim Kita	c6c17b9e3f	Fixed tests	2023-01-12 16:33:00 +01:00
Maksim Kita	a140d6c5b1	Fixed code review issues	2023-01-12 12:07:58 +01:00
Maksim Kita	47f4159909	Analyzer support distributed queries processing	2023-01-12 12:07:58 +01:00
Maksim Kita	30de77d071	Merge pull request #44545 from ClickHouse/vdimir/analyzer_drop_join_on ... Drop unused columns after join on/using	2023-01-12 13:51:14 +03:00
vdimir	1b6e036d46	Review fixes	2023-01-11 11:54:28 +00:00
vdimir	6c5b4458cb	Add test, comments, rename	2023-01-11 10:55:50 +00:00
vdimir	0b86deb585	[wip] drop unused columns after join on/using	2023-01-11 10:55:49 +00:00
vdimir	a881a61e74	Set pipeline type in join step description	2023-01-11 10:55:49 +00:00
Maksim Kita	fbba28b31e	Analyzer aggregation without column fix	2023-01-10 16:49:55 +01:00
Maksim Kita	99de697ea2	Analyzer added indexes support	2022-12-08 17:30:32 +01:00
Maksim Kita	13d74b4f2f	Analyzer Context refactoring	2022-12-06 10:44:38 +01:00
Igor Nikonov	20e67b7140	Merge remote-tracking branch 'origin/master' into HEAD	2022-11-24 13:10:37 +00:00
Maksim Kita	ab5e1ab650	Merge pull request #43141 from kitaisreal/analyzer-join-with-constants-improvements ... Analyzer improve JOIN with constants	2022-11-14 12:15:34 +03:00
Nikolai Kochetov	63d06c8b53	Merge pull request #42829 from ClickHouse/read-in-order-from-query-plan ... Read-in-order over query plan	2022-11-11 12:15:20 +01:00
Maksim Kita	4ce261dfd7	Analyzer improve JOIN with constants	2022-11-11 10:49:48 +01:00
Nikolai Kochetov	997881c7f7	Review fixes.	2022-11-09 16:07:38 +00:00
Maksim Kita	3b3e27f22a	Analyzer improve ARRAY JOIN with JOIN	2022-11-08 14:25:23 +01:00
Nikolai Kochetov	9ffebf4a0c	Fixing read-in-order for special storages.	2022-11-01 19:51:52 +00:00
vdimir	0028a49de8	Handle grace hash join in planner	2022-10-26 16:26:26 +00:00
Maksim Kita	d083200d65	Fixed code review issues	2022-10-24 10:22:38 +02:00
Maksim Kita	82fae0125c	Added FullSortingMerge JOIN support	2022-10-24 10:22:38 +02:00
Maksim Kita	f4e59b217f	Added RBAC support	2022-10-24 10:22:37 +02:00
Maksim Kita	5a0298ea34	Fixed tests	2022-10-24 10:22:37 +02:00
Maksim Kita	400de59a37	Fixed style check	2022-10-24 10:22:21 +02:00
Maksim Kita	10438aea01	Added JOIN support for different algorithm	2022-10-24 10:22:21 +02:00
Maksim Kita	a0d9251f3a	Added ASOF join support	2022-10-24 10:22:21 +02:00
Maksim Kita	8a39c3e1d5	Separate planner JOIN TREE processing	2022-10-24 10:22:20 +02:00