Commit Graph

41084 Commits

Author SHA1 Message Date
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc
Mark query cache as non-experimental
2023-05-06 19:49:23 +03:00
Alexey Milovidov
b1a92a5712 Remove dangerous code 2023-05-06 18:30:18 +02:00
Alexey Milovidov
7897a6cf92 Remove dangerous code (stringstream) 2023-05-06 18:14:01 +02:00
Alexey Milovidov
62d8677773
Update QueryCache.cpp 2023-05-06 18:25:43 +03:00
Alexey Milovidov
ef16077c72
Merge branch 'master' into pretty-time-squashing 2023-05-06 18:20:49 +03:00
Alexey Milovidov
9efbe86110
Merge pull request #49563 from evillique/object-column-alter
Forbid the change of data type of Object('json') column
2023-05-06 18:17:16 +03:00
Alexey Milovidov
2d39acf2e1
Merge pull request #49554 from kssenii/fix-assertions-3
Fix stress test (assertion 'key_metadata.lock()')
2023-05-06 18:16:40 +03:00
Alexey Milovidov
26d435bd66
Merge pull request #49572 from CurtizJ/fix-thread-pool-wait
Fix `ThreadPool::wait`
2023-05-06 18:15:02 +03:00
Alexey Milovidov
682f3c7bf2
Merge pull request #49564 from ClibMouse/bugfix/fiber-crash
Add CMake option for BOOST_USE_UCONTEXT
2023-05-06 18:13:22 +03:00
Alexey Milovidov
d86bda3054
Merge pull request #49581 from ClickHouse/fix-fuzz-nothing
Fix wrong assert
2023-05-06 18:05:40 +03:00
Robert Schulze
883e0abea1
Query Cache: Safeguard against empty chunks
Reading from the query cache is implemented using processor
"SourceFromChunks" which inherits from ISource. The latter has logic
which finishes processing (= calls .finish() on the output port +
returns Status::Finished) when the derived class returns an empty chunk.
If this empty chunk is not the last chunk, i.e. if it is followed by
non-empty chunks, the query result will be incorrect. This situation
should theoretically never occur in practice but who knows ... To be on
the safe side, writing into the query cache now rejects empty chunks and
thereby avoids this scenario.
2023-05-06 14:22:23 +00:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental 2023-05-06 13:58:40 +00:00
Robert Schulze
983e37048c
Merge pull request #48853 from ClickHouse/rs/qc-totals-extremes2
QueryCache: Support queries with totals and extremes
2023-05-06 15:41:10 +02:00
Robert Schulze
7137c8811a
Merge pull request #49158 from ClickHouse/rs/show-indexes
Implement SHOW INDEX
2023-05-06 15:30:29 +02:00
Robert Schulze
a1c98303a7
Merge pull request #49558 from ClickHouse/rs/writeAnyEscapedString
Fix writeAnyEscapedString if quote_character is a meta character
2023-05-06 15:29:32 +02:00
Robert Schulze
39bd320e37
Merge pull request #49573 from ClickHouse/rs/qc-no-internal-queries
Query cache: disable for internal queries
2023-05-06 15:27:44 +02:00
Igor Nikonov
c23600fb56
Merge pull request #49536 from ClickHouse/propa
Make input_format_parquet_preserve_order imply !parallelize_output_from_storages
2023-05-06 14:53:36 +02:00
jasperzhu
6b9df33ca1
Merge branch 'master' into iaadeflate_isal_issuefix 2023-05-06 10:32:58 +08:00
jinjunzh
576fbb9c25 fixed symbol conflict between contrib/isal and isal in qpl 2023-05-06 10:38:11 -04:00
Alexey Milovidov
e9912e2f7e Fix wrong assert 2023-05-06 02:19:58 +02:00
Alexey Milovidov
75a2589a42
Merge branch 'master' into deprecate-in-memory-parts 2023-05-06 00:49:59 +03:00
Han Fei
d2bd0bcd59
Merge branch 'master' into patch-1 2023-05-05 23:39:08 +02:00
Robert Schulze
3dfc0bd265
Merge pull request #49413 from azat/build/headers
Slightly reduce inter-header dependencies
2023-05-05 23:37:58 +02:00
Alexey Milovidov
a8c410c21a Merge branch 'master' into optimize-query-log 2023-05-05 23:21:01 +02:00
Alexey Milovidov
4b52da173b
Merge pull request #49111 from ClickHouse/safer-cut-and-concat
Refactor ColumnLowCardinality::cutAndCompact
2023-05-05 23:52:00 +03:00
Alexey Milovidov
79ad150454
Merge pull request #49323 from ClickHouse/low-cardinality-fix-progress
Fix progress bar for LowCardinality fields with shared dictionaries
2023-05-05 23:34:27 +03:00
Alexey Milovidov
965956ad55
Merge pull request #47815 from jkaflik/add-gcs-table-function
Add Google Cloud Storage S3 compatible table function
2023-05-05 23:18:58 +03:00
Robert Schulze
b2f0108150
Merge pull request #49292 from exmy/allow_int_type_for_bit_agg
Allow Int arguments for aggregation function groupBitAnd/Or/Xor
2023-05-05 21:23:13 +02:00
Robert Schulze
9cd81400f3
Query cache: disable for internal queries 2023-05-05 19:22:14 +00:00
Ilya Yatsishin
df8c563371
Merge pull request #49538 from ClickHouse/no-prctl-is-ok
Allow to run in Linux without PRCTL support
2023-05-05 21:19:38 +02:00
Anton Popov
223adc1725 fix ThreadPool::wait 2023-05-05 19:14:45 +00:00
Alexander Tokmakov
846abe95e9 fix 2023-05-05 20:50:13 +02:00
Nikolay Degterinsky
d29193da51 Also prohibit complex types with Object('json') 2023-05-05 18:45:00 +00:00
Dmitry Novik
2536dfad3a Fix build 2023-05-05 18:21:25 +00:00
Robert Schulze
bba85c9c25
Improve docs 2023-05-05 18:11:33 +00:00
Azat Khuzhin
157da5b8cb
Optimize PODArray::resize_fill() callers (#49459)
* Use PODArray::resize_fill() without initialize whenever it is possible

resize_fill() with initializer uses std::fill() which is a loop over all
elements, while resize_fill() without argument uses memset().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Optimize ColumnFixedString::insert/insertFrom

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-05-05 20:01:20 +02:00
Michael Kolupaev
396157dcad Allow reordering by default when reading from file/s3/url 2023-05-05 10:55:45 -07:00
Antonio Andelic
edf658010c
Add comments for enums 2023-05-05 19:09:32 +02:00
ltrk2
20cd799e51 Add CMake option for BOOST_USE_UCONTEXT 2023-05-05 16:29:21 +00:00
Robert Schulze
945a5130cf
Simplify simplify simplify 2023-05-05 16:28:51 +00:00
Nikolay Degterinsky
f361d96f21 Forbid the change of data type of Object('json') column 2023-05-05 15:51:17 +00:00
Dmitry Novik
951bef4fd2 Fixmemory counting in TCPHandler 2023-05-05 15:10:50 +00:00
Alexander Tokmakov
dd1bbf7c78 fix another issue with dependencies 2023-05-05 16:27:12 +02:00
Robert Schulze
aba5db40a1
Merge remote-tracking branch 'origin/master' into rs/qc-totals-extremes2 2023-05-05 14:11:10 +00:00
Nikolay Degterinsky
9934eae315
Merge pull request #48983 from evillique/mongodb-array-type
Add `Array` data type to MongoDB
2023-05-05 16:02:07 +02:00
Robert Schulze
f7e31a9664
More protection against SQL injection 2023-05-05 13:58:08 +00:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes
Fix some grammar mistakes in documentation, code and tests
2023-05-05 15:45:58 +02:00
kssenii
6bc302959b Better 2023-05-05 14:55:52 +02:00
Han Fei
9c19bd8179
Merge branch 'master' into patch-1 2023-05-05 14:41:40 +02:00
kssenii
1050754432 Fix 2023-05-05 14:41:35 +02:00
Robert Schulze
d35ff02b8b
Fix writeAnyEscapedString if quote_character is a meta character
Function writeAnyEscapedString() escapes
- quote_character with itself or with a backslash, depending on template
  parameter escape_quote_with_quote
- some metacharacters with backslash.

If quote_character is a metacharacter, the code previously always quoted
with backslash, independently of escape_quote_with_quote. I didn't find
places which do this but better be on the safe side.
2023-05-05 12:40:48 +00:00
Kseniia Sumarokova
478542c6d7
Update ErrorCodes.cpp 2023-05-05 13:56:10 +02:00
Kseniia Sumarokova
221796e053
Merge branch 'master' into allow-to-get-current-az 2023-05-05 13:55:14 +02:00
wangxiaobo
f704c0dfec
Implement SYSTEM DROP REPLICA from auxillary ZooKeeper clusters (#48932)
* multiple zookeeper drop replica bug fix.

* add an integration test.

* format code.

* set stay_alive=True for test.

* style check bug fix.

* add check for is_active

* format code

* remove table_settings and has_metadata_out param.
2023-05-05 14:11:11 +03:00
Kseniia Sumarokova
7c203dbcd2
Merge pull request #49481 from snikch/master
Fix postgres database setting
2023-05-05 12:53:51 +02:00
Kuba Kaflik
8a6084abd4 Fix syntax error for TableFunctionS3 2023-05-05 12:41:30 +02:00
Anton Popov
c87a6e8e7d
Merge pull request #49117 from CurtizJ/limit-mutations
Add settings to delay or throw in case of too many mutations
2023-05-05 12:18:57 +02:00
Ilya Yatsishin
2414dd9a06
Merge pull request #49534 from ClickHouse/remove-garbage-pretty
Remove garbage from Pretty format
2023-05-05 12:15:38 +02:00
Bulat Gaifullin
8556493c9e
Update LRUFileCachePriority.cpp 2023-05-05 12:00:24 +03:00
Bulat Gaifullin
a222c4c5a1
Update LRUFileCachePriority.h 2023-05-05 11:59:59 +03:00
Bulat Gaifullin
82e6ce22fa
Update IFileCachePriority.h
remove extra semicolumn
2023-05-05 11:59:37 +03:00
Bulat Gaifullin
3fe8c9e6ed
Remove extra semicolumns 2023-05-05 11:54:11 +03:00
Kuba Kaflik
ec30b0f2be Add function inline documentation 2023-05-05 10:14:06 +02:00
Sergei Trifonov
f6c433cdd2
Merge pull request #49521 from ClickHouse/serxa-patch-3 2023-05-05 08:28:55 +02:00
Alexey Milovidov
f77d087404 Merge branch 'master' into low-cardinality-fix-progress 2023-05-05 06:43:37 +02:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Alexey Milovidov
efa66521de Allow to run in Linux without PRCTL support 2023-05-05 06:40:12 +02:00
Alexey Milovidov
90b0de5677 Make Pretty prettier 2023-05-05 06:36:53 +02:00
Michael Kolupaev
3bd1489f18 Propagate input_format_parquet_preserve_order to parallelizeOutputAfterReading() 2023-05-05 04:20:27 +00:00
Alexey Milovidov
dfbba48510
Merge pull request #49282 from loneylee/49280
Fix all key value is null and group use rollup return wrong answer
2023-05-05 06:43:41 +03:00
Alexey Milovidov
179eddee01 Remove garbage from Pretty format 2023-05-05 04:44:47 +02:00
Alexey Milovidov
ab1a1ea5b7
Merge pull request #49490 from ClickHouse/fix-s3cluster-with-headers
Correctly handle s3Cluster arguments
2023-05-05 05:31:23 +03:00
Alexey Milovidov
38b2f94bfa
Merge pull request #49476 from ClickHouse/minor-changes
Minor changes for setThreadName
2023-05-05 04:02:30 +03:00
Alexey Milovidov
c5184ed329 Optimize the system.query_log and system.query_thread_log tables by applying LowCardinality when appropriate 2023-05-05 01:36:01 +02:00
Dmitry Novik
4ba7530c23 Fix thread MemoryTracker parent after detach 2023-05-05 00:21:13 +02:00
Kseniia Sumarokova
3cbe9be22d
Merge pull request #49491 from kssenii/fix-assertions-2
Fix logical error in stress test, add some logging
2023-05-05 00:00:57 +02:00
Michael Kolupaev
eb3b774ad0 Better control over Parquet row group size 2023-05-04 14:59:55 -07:00
Ivan Takarlikov
339fb0c2c1
Merge branch 'master' into it-grammar-fixes 2023-05-04 15:57:09 -03:00
Sergei Trifonov
f4b3f1eb28
Fix UserTimeMicroseconds and SystemTimeMicroseconds descriptions 2023-05-04 19:40:41 +02:00
alesapin
9456eb59fd
Merge pull request #48466 from ClickHouse/keeper-correctly-handle-snapshots
Correctly handle concurrent snapshots in Keeper
2023-05-04 19:16:00 +02:00
Kseniia Sumarokova
322b5a4da0
Update ReadBufferFromRemoteFSGather.cpp 2023-05-04 18:59:08 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
kssenii
a7c60aa282 Merge remote-tracking branch 'upstream/master' into allow-zero-objects-in-remote-fs-buffer 2023-05-04 17:39:39 +02:00
kssenii
6d3eb75a54 Allow zero objects in ReadBufferFromRemoteFSGather 2023-05-04 17:35:24 +02:00
Dmitry Novik
befcdbcc6d
Merge pull request #47630 from ClickHouse/revert-47476-revert_46622
Fix user MemoryTracker counter in async inserts
2023-05-04 16:57:41 +02:00
Anton Popov
e61d7baa54 Merge remote-tracking branch 'upstream/master' into HEAD 2023-05-04 14:03:53 +00:00
Kuba Kaflik
0672d75f72
Merge branch 'master' into add-gcs-table-function 2023-05-04 16:00:33 +02:00
Antonio Andelic
9825531cb1 Better 2023-05-04 13:38:28 +00:00
Alexander Tokmakov
b5a57da4ce
Merge pull request #49316 from ClickHouse/rs/48385
Unpoison stack frame ptrs from libunwind for msan
2023-05-04 16:17:30 +03:00
Antonio Andelic
e8e99065c2 Merge branch 'master' into fix-gcs-headers 2023-05-04 13:09:00 +00:00
vdimir
6d3559e817
Merge pull request #49093 from ClickHouse/vdimir/ntile-default-frame 2023-05-04 14:01:53 +02:00
Alexander Tokmakov
36f8fcdfaf
Merge pull request #49458 from ClickHouse/tavplubix-patch-6
Follow-up to #48792
2023-05-04 14:32:18 +03:00
Antonio Andelic
a68a023ca7
Merge pull request #48724 from johanngan/sse-kms
Support SSE-KMS configuration with S3 client
2023-05-04 13:20:54 +02:00
kssenii
9ddd4aa7f7 Merge remote-tracking branch 'origin/allow-to-get-current-az' into allow-to-get-current-az 2023-05-04 13:10:32 +02:00
kssenii
08772e1da7 Review fixes 2023-05-04 13:09:03 +02:00
Nikolai Kochetov
df9f00e87c
Merge pull request #49417 from ClickHouse/respect-PR-for-agg-projection
Respect PK for aggregate projection.
2023-05-04 12:52:27 +02:00
kssenii
cf3a8e9b93 One more fix 2023-05-04 12:49:23 +02:00
kssenii
663a007fa6 Add assertion 2023-05-04 12:11:44 +02:00
Nikolay Degterinsky
f58ec4fbd7
Apply suggestions from code review
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2023-05-04 12:07:53 +02:00
Alexander Gololobov
f77cc89464
Merge pull request #49470 from ClickHouse/remove_no_delay_flag
Replace `NO DELAY` with `SYNC` in tests
2023-05-04 11:57:01 +02:00