Commit Graph

568 Commits

Author SHA1 Message Date
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries
Fixes: #56504
2023-11-12 15:11:38 +00:00
Kseniia Sumarokova
ecd98006ce
Merge pull request #56306 from ClickHouse/fix-backup-restore-flatten-nested
Fix restore from backup with `flatten_nested` and `data_type_default_nullable`
2023-11-10 11:43:17 +01:00
kssenii
9178fd4ad1 Fix case with replicated database 2023-11-07 16:02:51 +01:00
yariks5s
8a2f95629f fixed suggestions 2023-10-31 13:16:02 +00:00
Smita Kulkarni
ce36a6475d Fixed cland tidy build 2023-10-31 10:12:31 +01:00
yariks5s
c53faedc4a style fix 2023-10-30 17:56:17 +00:00
yariks5s
03236c48ed init 2023-10-30 16:21:50 +00:00
Smita Kulkarni
d6c63e07ce Fixed expression 2023-10-25 10:23:22 +02:00
Smita Kulkarni
efbcac4e60 Bug fix explain ast with parameterized view 2023-10-25 10:21:06 +02:00
Anton Popov
5819bcd07a
Support asynchronous inserts for native protocol (#54730)
* support async insert for native protocol

* use separate queue for async inserts via native protocol

* fix test

* better logging for async inserts and more tests

* disable mixed internal and external data in async inserts

* fix tests

* fix quota in async inserts

* disable async insert for secondary query of distributed
2023-10-20 18:39:48 +02:00
Raúl Marín
3873a935f4
Merge pull request #55739 from Algunenano/use_default_format_on_http_exception
Respect default format when using http_write_exception_in_output_format
2023-10-19 13:47:36 +02:00
zhongyuankai
d73afed7d5 fix style 2023-10-18 23:09:38 +08:00
huzhicheng
0b52d29cd8 Query Cache: Only cache initial query 2023-10-18 16:56:17 +08:00
Raúl Marín
b4a4c1e02e Only change headers if necessary 2023-10-17 16:02:06 +02:00
Raúl Marín
e500dc22e4 Respect default format when using http_write_exception_in_output_format 2023-10-17 14:14:58 +02:00
Yakov Olkhovskiy
0738984edf
Merge pull request #42510 from ClibMouse/Kusto-phase2-oss-pr
Support Kusto Query Language dialect - phase 2
2023-10-11 08:35:26 -04:00
Robert Schulze
a72ae92328
Make the logging in the query cache easier to understand 2023-10-07 11:33:11 +00:00
Yong Wang
8c9da6bacf Merge remote-tracking branch 'origin/master' into Kusto-phase2-oss-pr 2023-09-27 22:35:14 -07:00
Robert Schulze
cde10fe7b5
Merge remote-tracking branch 'rschu1ze/master' into clang-tidy-reenable-checks 2023-09-26 18:59:41 +00:00
Kruglov Pavel
69a17bbef6
Merge pull request #52853 from Avogar/http-valid-json-on-exception
Output valid JSON/XML on excetpion during HTTP query execution
2023-09-26 14:25:55 +02:00
Robert Schulze
9fff447716
Re-enable clang-tidy checks 2023-09-26 09:34:12 +00:00
Robert Schulze
a15029ecb5
Query Cache: Reject queries with non-deterministic functions by default
https://github.com/ClickHouse/support-escalation/issues/963
2023-09-19 16:41:43 +00:00
Kruglov Pavel
e163670357
Merge branch 'master' into http-valid-json-on-exception 2023-09-19 13:42:53 +02:00
Kruglov Pavel
dbd24b240c
Merge branch 'master' into http-valid-json-on-exception 2023-09-15 14:55:31 +02:00
avogar
93c49dfeaa Fix using structure from insertion tables in case of defaults and explicit insert columns 2023-09-14 19:31:12 +00:00
Alexey Gerasimchuck
c2f4dc0f14 Implemented peak_threads_usage 2023-09-07 01:32:39 +00:00
Yong Wang
1c3a3debb4 Kusto-phase2: fix unit test 2023-08-26 07:40:40 -07:00
Yong Wang
828f4a67b7 Kusto-phase2: use seperated path to parse kql query 2023-08-26 07:40:40 -07:00
Yong Wang
5cc3f4708c Kusto-phase2: restore to kusto dialect only, fix some style issue 2023-08-26 07:40:39 -07:00
Larry Luo
1105ac624b Fixed style issues 2023-08-26 07:40:38 -07:00
Yong Wang
ae6e6b1c3b Kusto-phase2: Changed dialect to use enumerate, Added subquery for in operator, fixed the multi query issue 2023-08-26 07:40:25 -07:00
Yong Wang
760fd6759e Kusto-phase2: add kusto_auto dialect 2023-08-26 07:40:25 -07:00
Alexander Tokmakov
08e4e2bb0b fix 2023-08-16 22:35:45 +02:00
Alexander Tokmakov
808bc59c49 Merge branch 'master' into less_no_parallel 2023-08-15 15:49:32 +02:00
Dmitry Novik
a366c1c532 Update src/Interpreters/executeQuery.cpp 2023-08-14 18:44:09 +02:00
Dmitry Novik
9dafc596d0 Analyzer: fix quotas for system tables 2023-08-14 18:44:09 +02:00
Alexander Tokmakov
0d9e3ca345 remove no-parallel tag from some tests 2023-08-11 00:00:36 +02:00
avogar
a71cd56a90 Output valid JSON/XML on excetpion during HTTP query execution 2023-08-01 10:06:56 +00:00
Robert Schulze
c755fde3a4
Include query cache usage in SYSTEM.QUERY_LOG 2023-07-24 16:24:36 +00:00
Nikita Mikhaylov
668062dc29
Merge branch 'master' into no-keep-context-lock-while-calculating-access 2023-07-20 14:42:13 +02:00
János Benjamin Antal
e74acda53e
PRQL integration (#50686)
* Added prql-lib

* Add PRQL parser

* Extend stateless tests

* Add unit tests for `ParserPRQL`

---------

Co-authored-by: Ubuntu <ubuntu@ip-172-31-37-24.eu-central-1.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-10-10-10-195.eu-central-1.compute.internal>
Co-authored-by: Александр Нам <47687537+seshWCS@users.noreply.github.com>
2023-07-20 12:54:42 +02:00
Vitaly Baranov
815a3857de Remove non-const function Context::getClientInfo(). 2023-07-17 15:02:07 +02:00
Raúl Marín
dbdfc07790
Merge branch 'master' into async_to_query_log 2023-07-10 10:32:56 +02:00
Alexey Milovidov
db14b2c54f Remove useless logs 2023-07-06 02:16:38 +02:00
Raúl Marín
11236b3ce7 Merge remote-tracking branch 'blessed/master' into async_to_query_log 2023-06-26 17:13:19 +02:00
Raúl Marín
b1cedf0e42 Simplify handling of AsyncInsertFlush 2023-06-20 11:38:19 +02:00
Raúl Marín
9b899b9351 Fix async insert logs with setting on mergetree 2023-06-20 11:38:19 +02:00
Raúl Marín
cf74aee6c9 Log async query flushes to query_log 2023-06-20 11:38:19 +02:00
Raúl Marín
7ab660acfb Extract logging functions outside of executeQueryImpl 2023-06-20 11:38:19 +02:00
Robert Schulze
5311ebe1d2
Make query cache work effective with nested queries. 2023-06-17 20:27:25 +00:00
Robert Schulze
24717ed908
Factorize check if query cache exists 2023-06-17 18:24:20 +00:00
Robert Schulze
69e7c1cc82
Introduce convenience ctor for Key construction during read 2023-06-17 18:22:15 +00:00
Robert Schulze
6e8af09289
Provide query cache reader with dummy block 2023-06-17 12:48:29 +00:00
Robert Schulze
840e73eb74
Update #includes 2023-06-17 12:28:18 +00:00
Nikita Taranov
a3652f1727 Merge branch 'master' into optimize_reading2 2023-05-29 15:26:18 +02:00
Nikita Taranov
42a9072888 Merge branch 'master' into optimize_reading2 2023-05-28 18:04:44 +02:00
Anton Popov
612173e734 refactoring near alter conversions 2023-05-25 22:54:54 +00:00
Sema Checherinda
23f894b995
Merge pull request #49777 from helifu/master1
Add 'initial_query_id' field for system.processors_profile_log
2023-05-25 12:55:32 +02:00
helifu
802b63f2ab Add 'initial_query_id' field for system.processors_profile_log
Facilitate profile data association and aggregation for the same query
2023-05-25 09:37:02 +08:00
helifu
2255b0287a Add 'partitions' field for system.query_log 2023-05-24 20:42:31 +08:00
Nikita Taranov
0dd67bacf2
Merge branch 'master' into optimize_reading2 2023-05-17 15:06:41 +02:00
Alexey Milovidov
5a44dc26e7 Fixes for clang-17 2023-05-13 02:57:31 +02:00
Nikita Taranov
ec63a6ee7c
Merge branch 'master' into optimize_reading2 2023-05-10 17:24:37 +02:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental 2023-05-06 13:58:40 +00:00
Robert Schulze
983e37048c
Merge pull request #48853 from ClickHouse/rs/qc-totals-extremes2
QueryCache: Support queries with totals and extremes
2023-05-06 15:41:10 +02:00
Robert Schulze
9cd81400f3
Query cache: disable for internal queries 2023-05-05 19:22:14 +00:00
Robert Schulze
945a5130cf
Simplify simplify simplify 2023-05-05 16:28:51 +00:00
Robert Schulze
aba5db40a1
Merge remote-tracking branch 'origin/master' into rs/qc-totals-extremes2 2023-05-05 14:11:10 +00:00
Nikita Taranov
de03b90570 impl 2023-04-27 17:07:00 +00:00
Anton Popov
c7db58be66 add MergeTree setting async_insert 2023-04-25 01:11:58 +00:00
Robert Schulze
b565257a39
Support totals and extremes in query cache 2023-04-24 22:23:27 +00:00
Robert Schulze
38d5f12a32
Query Cache: Implement per-user quotas 2023-04-23 16:13:51 +00:00
Robert Schulze
b0473098c6
Merge branch 'master' into qc-compression 2023-03-30 10:55:42 +02:00
Nikolay Degterinsky
227425968f
Merge branch 'master' into query_id 2023-03-27 13:41:42 +02:00
Frank Chen
532590773a Fix typo check 2023-03-22 17:46:09 +08:00
Frank Chen
c1927d8f3e Fix check style 2023-03-22 16:39:14 +08:00
Frank Chen
3e05f2c58a Improve comment 2023-03-22 14:35:58 +08:00
Frank Chen
3de73d03cc Improve the robustness 2023-03-22 14:31:16 +08:00
Frank Chen
837638e1c1 Fix style 2023-03-21 15:27:13 +08:00
Frank Chen
91a34fa627 Set query id in case of exceptions during query execution 2023-03-21 14:10:01 +08:00
Robert Schulze
d8493780b2
Query cache: Enable compression and squashing of result blocks
ClickHouse reads table data in blocks of 'max_block_size' rows. Due to
filtering, aggregation, etc., result blocks are typically much smaller
than 'max_block_size' but there are also cases where they are much
bigger. Setting 'query_cache_squash_partial_results' (enabled by
default) now controls if result blocks are squashed (if they are tiny)
or split (if they are large) into blocks of 'max_block_size' size before
insertion into the query result cache. This reduces performance of
writes into the query cache but improves compressability of cache
entries and provides more natural block granularity when query results
are later served from the query cache.

Entries in the query cache are now also compressed by default. This
reduces the overall memory consumption at the cost of slower writes into
/ reads from the query cache. To disable compression, use setting
'query_cache_compress_entries'.
2023-03-20 20:11:41 +00:00
Nikolai Kochetov
815c5aa87e
Merge branch 'master' into apply-settings-for-explain-earlier 2023-03-10 21:19:07 +01:00
Nikolai Kochetov
d2c28fb555 Apply settings for explain subquery as well. 2023-03-10 18:29:13 +00:00
Nikolai Kochetov
f6ac225f98 Apply settings for EXPLAIN earlier (in the same way we do for SELECT). 2023-03-10 15:24:47 +00:00
Alexander Tokmakov
9a95e7b4ee
Merge pull request #47312 from ClickHouse/fix_implicit_transactions
Fix an assertion with implicit transactions in interserver mode
2023-03-09 16:47:40 +03:00
Alexander Tokmakov
debd69f03a fix an assertion with implicit transactions in interserver mode 2023-03-08 16:53:23 +01:00
Igor Nikonov
838ff88abe
Merge branch 'master' into log-level-change 2023-03-06 18:00:49 +01:00
Alexander Tokmakov
a97e15e36f Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-03-01 14:26:41 +01:00
AndyB
5fb1f20882 LOG_DEBUG over LOG_INFO 2023-02-27 23:16:34 +00:00
Anton Popov
37570f10ea
Merge pull request #46364 from CurtizJ/add-query-id-in-response
Add `X-ClickHouse-Query-Id` header in all queries
2023-02-25 14:18:35 +01:00
Alexander Tokmakov
cad1e0b768 fix 2023-02-25 01:18:34 +01:00
Alexander Tokmakov
fe92fd8a61 Merge branch 'master' into fix_insert_cancellation_in_native_protocol 2023-02-23 22:35:31 +01:00
Anton Popov
d5864fa88e allow to fallback from async insert in case of large amount of data 2023-02-22 21:59:24 +00:00
Alexander Tokmakov
e660c0838c fix multipart requests 2023-02-22 17:54:35 +01:00
Alexander Tokmakov
592af6d652 fix incomplete interst through http 2023-02-22 02:34:03 +01:00
Alexey Milovidov
d8cda3dbb8 Remove PVS-Studio 2023-02-19 23:30:05 +01:00
Anton Popov
e9e6d735ef add query_id header in all queries 2023-02-13 16:44:54 +00:00
kssenii
b0b865c32e Resubmit prefetches 2023-02-08 21:26:24 +01:00
Alexey Milovidov
62bfdb349a Merge branch 'master' into fix-trash-query-kind 2023-02-02 04:26:49 +01:00