thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-05 05:52:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
115,133 Commits 9,186 Branches 1,782 Tags 2 GiB
86e14547d4
Commit Graph

41469 Commits

Author SHA1 Message Date
Anton Popov
0612f5d782 fix sparse columns after reload 2023-05-08 11:50:21 +00:00
Kseniia Sumarokova
b5af1e10cb
Update getThreadPoolReader.cpp 2023-05-08 13:37:03 +02:00
Robert Schulze
aa6eca7e55
Merge branch 'master' into iaadeflate_idxd_config_amend 2023-05-08 13:19:20 +02:00
sanjam
fce2e089c6 temp fix for t64 on s390x 2023-05-08 10:49:25 +00:00
Kseniia Sumarokova
336bb41c5d
Merge branch 'master' into remove-dependency-from-context 2023-05-08 12:46:10 +02:00
Anton Popov
f96e0e44c3
Merge pull request #49519 from kssenii/allow-zero-objects-in-remote-fs-buffer 
Allow zero objects in ReadBufferFromRemoteFSGather
 2023-05-08 12:35:18 +02:00
jasperzhu
d92ff92966
Merge branch 'master' into iaadeflate_idxd_config_amend 2023-05-08 16:36:23 +08:00
jinjunzh
9fad9f234f add missing idxd-config module for qpl-deflate codec 2023-05-08 15:20:55 -04:00
Robert Schulze
d8d2b0af76
Merge pull request #49466 from ucasfl/str_to_map 
add alias str_to_map and mapFromString for extractKeyValuePairs
 2023-05-08 10:11:06 +02:00
Antonio Andelic
212c57c034
Merge pull request #49390 from ClickHouse/fix-gcs-headers 
Properly fix GCS when HMAC is used
 2023-05-08 08:17:43 +02:00
Alexey Milovidov
baf162b26b Optimize opentelemetry_span_log 2023-05-08 05:15:28 +02:00
Alexey Milovidov
ad025fb4f6
Merge pull request #49635 from ClickHouse/remove-commented-code 
Remove commented code
 2023-05-08 06:06:12 +03:00
Alexey Milovidov
647472ed46
Merge branch 'master' into aiven-sal/having_pr 2023-05-08 05:53:38 +03:00
Alexey Milovidov
6ad3becc6e
Merge pull request #49429 from ClickHouse/deprecate-in-memory-parts 
Deprecate in-memory parts
 2023-05-08 05:38:03 +03:00
Alexey Milovidov
67fa5b6b7c
Merge pull request #49628 from ClickHouse/fix-distinct 
Fix bug in DISTINCT
 2023-05-08 03:01:30 +03:00
Alexander Tokmakov
6f8455efcb
Update removeWhereConditionPlaceholder.h 2023-05-08 02:26:29 +03:00
Kseniia Sumarokova
0d15956969
Merge pull request #49623 from kssenii/fix-assertions-5 
Fix stress test (Logical error: Expected 7134 >= 11030)
 2023-05-08 00:59:40 +02:00
Alexander Tokmakov
1224ac9eda fix build 2023-05-08 00:57:13 +02:00
Alexey Milovidov
3cf1da7bf3
Merge branch 'master' into deprecate-in-memory-parts 2023-05-08 01:38:00 +03:00
Alexander Tokmakov
abf6c60ad2 Merge branch 'master' into fix_dictionaries_loading_order 2023-05-08 00:31:03 +02:00
Igor Nikonov
fe02317d45 Clear zero value storage only if need_zero_value_storage 2023-05-07 22:16:16 +00:00
robot-clickhouse-ci-2
6c02b6b327
Merge pull request #49627 from ClickHouse/rs/obsolete-ccache-knob 
CMake: Remove legacy switch for ccache
 2023-05-08 00:16:09 +02:00
Igor Nikonov
ba2e827aa7 Fix: check if zero storage has zeros before clean up 2023-05-07 21:31:01 +00:00
Alexey Milovidov
aa280bcd10 Slightly better 2023-05-07 23:12:28 +02:00
Igor Nikonov
68fcc39292 Fix: DISTINCT in order with zero values in non-sorted columns 2023-05-07 21:09:03 +00:00
Alexey Milovidov
3880053348 Slightly better 2023-05-07 23:02:41 +02:00
Alexey Milovidov
736eac4a5d Remove commented code 2023-05-07 22:46:02 +02:00
Robert Schulze
f4eabd967d
Merge pull request #49603 from ClickHouse/rs/makedate-mysql 
Implement a MySQL-compatible variant of makeDate()
 2023-05-07 21:51:03 +02:00
robot-ch-test-poll
5078231c7e
Merge pull request #49619 from ClickHouse/remove_concurrent 
Better concurrent parts removal with zero copy
 2023-05-07 21:03:44 +02:00
Alexey Milovidov
73a1ea0eb3
Merge pull request #44627 from ClickHouse/system-stack-trace-fix 
Attempt to fix the "system.stack_trace" test
 2023-05-07 21:05:10 +03:00
Alexey Milovidov
a2daeb849e Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 18:25:01 +02:00
Alexey Milovidov
d0400846f1 Fix bug in DISTINCT 2023-05-07 17:50:04 +02:00
Robert Schulze
e275da1d31
Remove deprecated logic for ccache 2023-05-07 15:41:56 +00:00
Alexey Milovidov
98acbff68f Disable distinct_in_order optimization 2023-05-07 17:31:56 +02:00
Alexey Milovidov
df8c930be3
Merge pull request #49537 from ClickHouse/pretty-time-squashing 
Make `Pretty` formats even prettier.
 2023-05-07 17:41:01 +03:00
Alexey Milovidov
f93064d9c8
Merge pull request #49616 from ClickHouse/fix-error-48300 
Fix error in #48300
 2023-05-07 17:38:23 +03:00
Alexey Milovidov
6287160302
Merge pull request #49617 from ClickHouse/fix-typo-8 
Fix typo: "as much slots" -> "as many slots"
 2023-05-07 17:37:01 +03:00
Alexey Milovidov
7993cf73bf
Merge pull request #49612 from ClickHouse/minor-changes-2 
Minor changes
 2023-05-07 17:36:28 +03:00
Robert Schulze
b995795971
Fix style 2023-05-07 13:27:57 +00:00
Robert Schulze
aa09b6154b
Various cleanups 2023-05-07 13:06:35 +00:00
kssenii
6473ec54ee Fix 2023-05-07 15:05:45 +02:00
alesapin
33e691ad51 Better name 2023-05-07 14:26:21 +02:00
alesapin
a2ed457219 Better concurrent parts removal with zero copy 2023-05-07 14:02:24 +02:00
Michael Kolupaev
fd9c9bb25b Split ReadWriteBufferFromHTTP.h into .h and .cpp file 2023-05-06 21:11:06 -07:00
Alexey Milovidov
6b742bb1d1
Merge branch 'master' into system-stack-trace-fix 2023-05-07 06:05:47 +03:00
Alexey Milovidov
c3fa74ab8a
Merge pull request #49435 from ClickHouse/short 
Make 'exceptions shorter than 30' test less noisy
 2023-05-07 06:01:46 +03:00
Alexey Milovidov
cfb35cb251 Fix typo: "as much slots" -> "as many slots" 2023-05-07 04:42:46 +02:00
Alexey Milovidov
72e1f751bb Fix error in #48300 2023-05-07 04:16:18 +02:00
Alexey Milovidov
49766769df
Merge pull request #49584 from jinjunzh/iaadeflate_isal_issuefix 
fixed symbol conflict between contrib/isa-l and isa-l in qpl
 2023-05-07 04:52:08 +03:00
Alexey Milovidov
8323c59742
Merge pull request #49595 from ClickHouse/remove-dangerous-code 
Remove dangerous code (stringstream)
 2023-05-07 04:51:22 +03:00
Alexey Milovidov
3b6edbacab Update tests 2023-05-07 03:45:17 +02:00
Alexey Milovidov
de3e66385c Merge branch 'master' into compress-marks-primary-key-by-default 2023-05-07 02:40:25 +02:00
Alexey Milovidov
cb90c7e670 Minor changes 2023-05-07 02:39:21 +02:00
Alexey Milovidov
e8228cb0d2
Merge pull request #49530 from ClickHouse/optimize-query-log 
Optimize the system.query_log and system.query_thread_log tables by applying LowCardinality when appropriate
 2023-05-07 03:36:30 +03:00
robot-clickhouse-ci-1
d1ad3ea24e
Merge pull request #49593 from ClickHouse/rs/qc-empty-chunk 
Query Cache: Safeguard against empty chunks
 2023-05-07 02:20:54 +02:00
Sema Checherinda
08bfc8f58d inserted parts has exlusive blobs 2023-05-07 01:51:43 +02:00
Alexey Milovidov
3a079dc40e Merge branch 'master' into pretty-time-squashing 2023-05-06 23:15:48 +02:00
Robert Schulze
c893302a08
Implement a MySQL-compatible variant of makeDate() 
Fixes #49143
 2023-05-06 20:11:36 +00:00
Alexey Milovidov
61f1861d70 Fix error 2023-05-06 20:54:52 +02:00
kssenii
2228107134 Better name 2023-05-06 20:12:26 +02:00
Robert Schulze
2986c28761
Small fixes 2023-05-06 18:12:10 +00:00
Michael Kolupaev
49394a097e Fix 'noisy Warning messages' failing when there are no Warning messages 2023-05-06 10:39:59 -07:00
Sema Checherinda
2104baabce
Merge pull request #49527 from ClickHouse/thread-detach-fix 
Fix thread MemoryTracker parent after detach
 2023-05-06 19:11:55 +02:00
Sema Checherinda
eef1d51d4c
Merge pull request #49561 from ClickHouse/fix-snapshot-removal 
Fix memory counting in TCPHandler
 2023-05-06 19:00:00 +02:00
Alexey Milovidov
54163b87ec
Merge pull request #47977 from ClickHouse/rs/non-experimental-qc 
Mark query cache as non-experimental
 2023-05-06 19:49:23 +03:00
Alexey Milovidov
b1a92a5712 Remove dangerous code 2023-05-06 18:30:18 +02:00
Alexey Milovidov
7897a6cf92 Remove dangerous code (stringstream) 2023-05-06 18:14:01 +02:00
Sema Checherinda
56f2917718
Update StorageReplicatedMergeTree.cpp 2023-05-06 17:59:07 +02:00
Alexey Milovidov
62d8677773
Update QueryCache.cpp 2023-05-06 18:25:43 +03:00
Alexey Milovidov
ef16077c72
Merge branch 'master' into pretty-time-squashing 2023-05-06 18:20:49 +03:00
Alexey Milovidov
9efbe86110
Merge pull request #49563 from evillique/object-column-alter 
Forbid the change of data type of Object('json') column
 2023-05-06 18:17:16 +03:00
Alexey Milovidov
2d39acf2e1
Merge pull request #49554 from kssenii/fix-assertions-3 
Fix stress test (assertion 'key_metadata.lock()')
 2023-05-06 18:16:40 +03:00
Alexey Milovidov
26d435bd66
Merge pull request #49572 from CurtizJ/fix-thread-pool-wait 
Fix `ThreadPool::wait`
 2023-05-06 18:15:02 +03:00
Alexey Milovidov
682f3c7bf2
Merge pull request #49564 from ClibMouse/bugfix/fiber-crash 
Add CMake option for BOOST_USE_UCONTEXT
 2023-05-06 18:13:22 +03:00
Alexey Milovidov
d86bda3054
Merge pull request #49581 from ClickHouse/fix-fuzz-nothing 
Fix wrong assert
 2023-05-06 18:05:40 +03:00
Robert Schulze
4529511799
Fix table function docs 2023-05-06 15:01:24 +00:00
Robert Schulze
883e0abea1
Query Cache: Safeguard against empty chunks 
Reading from the query cache is implemented using processor
"SourceFromChunks" which inherits from ISource. The latter has logic
which finishes processing (= calls .finish() on the output port +
returns Status::Finished) when the derived class returns an empty chunk.
If this empty chunk is not the last chunk, i.e. if it is followed by
non-empty chunks, the query result will be incorrect. This situation
should theoretically never occur in practice but who knows ... To be on
the safe side, writing into the query cache now rejects empty chunks and
thereby avoids this scenario.
 2023-05-06 14:22:23 +00:00
Robert Schulze
0598bfd79e
Mark query cache as non-experimental 2023-05-06 13:58:40 +00:00
Robert Schulze
983e37048c
Merge pull request #48853 from ClickHouse/rs/qc-totals-extremes2 
QueryCache: Support queries with totals and extremes
 2023-05-06 15:41:10 +02:00
Robert Schulze
7137c8811a
Merge pull request #49158 from ClickHouse/rs/show-indexes 
Implement SHOW INDEX
 2023-05-06 15:30:29 +02:00
Robert Schulze
a1c98303a7
Merge pull request #49558 from ClickHouse/rs/writeAnyEscapedString 
Fix writeAnyEscapedString if quote_character is a meta character
 2023-05-06 15:29:32 +02:00
Robert Schulze
39bd320e37
Merge pull request #49573 from ClickHouse/rs/qc-no-internal-queries 
Query cache: disable for internal queries
 2023-05-06 15:27:44 +02:00
Igor Nikonov
c23600fb56
Merge pull request #49536 from ClickHouse/propa 
Make input_format_parquet_preserve_order imply !parallelize_output_from_storages
 2023-05-06 14:53:36 +02:00
Sema Checherinda
8f5afffaa0 Outdated parts has to be unlocked in general case 2023-05-06 14:23:57 +02:00
pufit
04a829b554 Fix PR issues 2023-05-05 22:41:44 -04:00
jasperzhu
6b9df33ca1
Merge branch 'master' into iaadeflate_isal_issuefix 2023-05-06 10:32:58 +08:00
jinjunzh
576fbb9c25 fixed symbol conflict between contrib/isal and isal in qpl 2023-05-06 10:38:11 -04:00
Sema Checherinda
f302c1986a use flag has_exclusive_blobs to track the part's originate 2023-05-06 03:07:29 +02:00
Alexey Milovidov
e9912e2f7e Fix wrong assert 2023-05-06 02:19:58 +02:00
Alexey Milovidov
75a2589a42
Merge branch 'master' into deprecate-in-memory-parts 2023-05-06 00:49:59 +03:00
Han Fei
d2bd0bcd59
Merge branch 'master' into patch-1 2023-05-05 23:39:08 +02:00
Robert Schulze
3dfc0bd265
Merge pull request #49413 from azat/build/headers 
Slightly reduce inter-header dependencies
 2023-05-05 23:37:58 +02:00
Robert Schulze
45c28e1221
Introduce more fields for in-source function documentation 2023-05-05 21:30:21 +00:00
Alexey Milovidov
a8c410c21a Merge branch 'master' into optimize-query-log 2023-05-05 23:21:01 +02:00
Alexey Milovidov
4b52da173b
Merge pull request #49111 from ClickHouse/safer-cut-and-concat 
Refactor ColumnLowCardinality::cutAndCompact
 2023-05-05 23:52:00 +03:00
Alexey Milovidov
79ad150454
Merge pull request #49323 from ClickHouse/low-cardinality-fix-progress 
Fix progress bar for LowCardinality fields with shared dictionaries
 2023-05-05 23:34:27 +03:00
Alexey Milovidov
965956ad55
Merge pull request #47815 from jkaflik/add-gcs-table-function 
Add Google Cloud Storage S3 compatible table function
 2023-05-05 23:18:58 +03:00
Robert Schulze
b2f0108150
Merge pull request #49292 from exmy/allow_int_type_for_bit_agg 
Allow Int arguments for aggregation function groupBitAnd/Or/Xor
 2023-05-05 21:23:13 +02:00
Robert Schulze
9cd81400f3
Query cache: disable for internal queries 2023-05-05 19:22:14 +00:00
Ilya Yatsishin
df8c563371
Merge pull request #49538 from ClickHouse/no-prctl-is-ok 
Allow to run in Linux without PRCTL support
 2023-05-05 21:19:38 +02:00
Anton Popov
223adc1725 fix ThreadPool::wait 2023-05-05 19:14:45 +00:00
Alexander Tokmakov
846abe95e9 fix 2023-05-05 20:50:13 +02:00
Nikolay Degterinsky
d29193da51 Also prohibit complex types with Object('json') 2023-05-05 18:45:00 +00:00
Dmitry Novik
2536dfad3a Fix build 2023-05-05 18:21:25 +00:00
Robert Schulze
bba85c9c25
Improve docs 2023-05-05 18:11:33 +00:00
Azat Khuzhin
157da5b8cb
Optimize PODArray::resize_fill() callers (#49459) 
* Use PODArray::resize_fill() without initialize whenever it is possible

resize_fill() with initializer uses std::fill() which is a loop over all
elements, while resize_fill() without argument uses memset().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Optimize ColumnFixedString::insert/insertFrom

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-05 20:01:20 +02:00
Michael Kolupaev
396157dcad Allow reordering by default when reading from file/s3/url 2023-05-05 10:55:45 -07:00
Antonio Andelic
edf658010c
Add comments for enums 2023-05-05 19:09:32 +02:00
ltrk2
20cd799e51 Add CMake option for BOOST_USE_UCONTEXT 2023-05-05 16:29:21 +00:00
Robert Schulze
945a5130cf
Simplify simplify simplify 2023-05-05 16:28:51 +00:00
Smita Kulkarni
b0c408faa4 Merge branch 'master' into Follow_up_Backup_Restore_concurrency_check_node_2 2023-05-05 17:51:33 +02:00
Nikolay Degterinsky
f361d96f21 Forbid the change of data type of Object('json') column 2023-05-05 15:51:17 +00:00
Sema Checherinda
efcf7fbe4f
Update src/Storages/StorageReplicatedMergeTree.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-05-05 17:49:12 +02:00
Sema Checherinda
36b028bc6b
Update src/Storages/StorageReplicatedMergeTree.cpp 
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-05-05 17:48:57 +02:00
Dmitry Novik
951bef4fd2 Fixmemory counting in TCPHandler 2023-05-05 15:10:50 +00:00
Alexander Tokmakov
dd1bbf7c78 fix another issue with dependencies 2023-05-05 16:27:12 +02:00
Robert Schulze
aba5db40a1
Merge remote-tracking branch 'origin/master' into rs/qc-totals-extremes2 2023-05-05 14:11:10 +00:00
Nikolay Degterinsky
9934eae315
Merge pull request #48983 from evillique/mongodb-array-type 
Add `Array` data type to MongoDB
 2023-05-05 16:02:07 +02:00
Robert Schulze
f7e31a9664
More protection against SQL injection 2023-05-05 13:58:08 +00:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes 
Fix some grammar mistakes in documentation, code and tests
 2023-05-05 15:45:58 +02:00
kssenii
6bc302959b Better 2023-05-05 14:55:52 +02:00
Han Fei
9c19bd8179
Merge branch 'master' into patch-1 2023-05-05 14:41:40 +02:00
kssenii
1050754432 Fix 2023-05-05 14:41:35 +02:00
Robert Schulze
d35ff02b8b
Fix writeAnyEscapedString if quote_character is a meta character 
Function writeAnyEscapedString() escapes
- quote_character with itself or with a backslash, depending on template
  parameter escape_quote_with_quote
- some metacharacters with backslash.

If quote_character is a metacharacter, the code previously always quoted
with backslash, independently of escape_quote_with_quote. I didn't find
places which do this but better be on the safe side.
 2023-05-05 12:40:48 +00:00
Kseniia Sumarokova
478542c6d7
Update ErrorCodes.cpp 2023-05-05 13:56:10 +02:00
Kseniia Sumarokova
221796e053
Merge branch 'master' into allow-to-get-current-az 2023-05-05 13:55:14 +02:00
wangxiaobo
f704c0dfec
Implement SYSTEM DROP REPLICA from auxillary ZooKeeper clusters (#48932) 
* multiple zookeeper drop replica bug fix.

* add an integration test.

* format code.

* set stay_alive=True for test.

* style check bug fix.

* add check for is_active

* format code

* remove table_settings and has_metadata_out param.
 2023-05-05 14:11:11 +03:00
Kseniia Sumarokova
7c203dbcd2
Merge pull request #49481 from snikch/master 
Fix postgres database setting
 2023-05-05 12:53:51 +02:00
Kuba Kaflik
8a6084abd4 Fix syntax error for TableFunctionS3 2023-05-05 12:41:30 +02:00
Anton Popov
c87a6e8e7d
Merge pull request #49117 from CurtizJ/limit-mutations 
Add settings to delay or throw in case of too many mutations
 2023-05-05 12:18:57 +02:00
Ilya Yatsishin
2414dd9a06
Merge pull request #49534 from ClickHouse/remove-garbage-pretty 
Remove garbage from Pretty format
 2023-05-05 12:15:38 +02:00
Bulat Gaifullin
8556493c9e
Update LRUFileCachePriority.cpp 2023-05-05 12:00:24 +03:00
Bulat Gaifullin
a222c4c5a1
Update LRUFileCachePriority.h 2023-05-05 11:59:59 +03:00
Bulat Gaifullin
82e6ce22fa
Update IFileCachePriority.h 
remove extra semicolumn
 2023-05-05 11:59:37 +03:00
Bulat Gaifullin
3fe8c9e6ed
Remove extra semicolumns 2023-05-05 11:54:11 +03:00
Kuba Kaflik
ec30b0f2be Add function inline documentation 2023-05-05 10:14:06 +02:00
Antonio Andelic
1dacd5b526 Merge branch 'master' into fix-cnf-new-analyzer 2023-05-05 07:44:22 +00:00
Sergei Trifonov
f6c433cdd2
Merge pull request #49521 from ClickHouse/serxa-patch-3 2023-05-05 08:28:55 +02:00
Alexey Milovidov
f77d087404 Merge branch 'master' into low-cardinality-fix-progress 2023-05-05 06:43:37 +02:00
Alexey Milovidov
09f171822e Merge branch 'master' into deprecate-in-memory-parts 2023-05-05 06:43:23 +02:00
Alexey Milovidov
efa66521de Allow to run in Linux without PRCTL support 2023-05-05 06:40:12 +02:00
Alexey Milovidov
90b0de5677 Make Pretty prettier 2023-05-05 06:36:53 +02:00
Michael Kolupaev
3bd1489f18 Propagate input_format_parquet_preserve_order to parallelizeOutputAfterReading() 2023-05-05 04:20:27 +00:00
Alexey Milovidov
dfbba48510
Merge pull request #49282 from loneylee/49280 
Fix all key value is null and group use rollup return wrong answer
 2023-05-05 06:43:41 +03:00
Alexey Milovidov
179eddee01 Remove garbage from Pretty format 2023-05-05 04:44:47 +02:00
Alexey Milovidov
ab1a1ea5b7
Merge pull request #49490 from ClickHouse/fix-s3cluster-with-headers 
Correctly handle s3Cluster arguments
 2023-05-05 05:31:23 +03:00
Alexey Milovidov
38b2f94bfa
Merge pull request #49476 from ClickHouse/minor-changes 
Minor changes for setThreadName
 2023-05-05 04:02:30 +03:00
Michael Kolupaev
0fa311ee38 Make INSERT do more things in parallel to avoid getting bottlenecked on one thread 2023-05-05 00:49:27 +00:00
Alexey Milovidov
c5184ed329 Optimize the system.query_log and system.query_thread_log tables by applying LowCardinality when appropriate 2023-05-05 01:36:01 +02:00
Dmitry Novik
4ba7530c23 Fix thread MemoryTracker parent after detach 2023-05-05 00:21:13 +02:00
Kseniia Sumarokova
3cbe9be22d
Merge pull request #49491 from kssenii/fix-assertions-2 
Fix logical error in stress test, add some logging
 2023-05-05 00:00:57 +02:00
Michael Kolupaev
eb3b774ad0 Better control over Parquet row group size 2023-05-04 14:59:55 -07:00
Ivan Takarlikov
339fb0c2c1
Merge branch 'master' into it-grammar-fixes 2023-05-04 15:57:09 -03:00
pufit
309032fb67 Check if grantees are empty 2023-05-04 13:42:14 -04:00
Sergei Trifonov
f4b3f1eb28
Fix UserTimeMicroseconds and SystemTimeMicroseconds descriptions 2023-05-04 19:40:41 +02:00
Sema Checherinda
9a0bc891e4 fix can_remove_callback for Temporary parts 2023-05-04 19:39:16 +02:00
alesapin
9456eb59fd
Merge pull request #48466 from ClickHouse/keeper-correctly-handle-snapshots 
Correctly handle concurrent snapshots in Keeper
 2023-05-04 19:16:00 +02:00
Kseniia Sumarokova
322b5a4da0
Update ReadBufferFromRemoteFSGather.cpp 2023-05-04 18:59:08 +02:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
kssenii
a7c60aa282 Merge remote-tracking branch 'upstream/master' into allow-zero-objects-in-remote-fs-buffer 2023-05-04 17:39:39 +02:00
kssenii
6d3eb75a54 Allow zero objects in ReadBufferFromRemoteFSGather 2023-05-04 17:35:24 +02:00
Dmitry Novik
befcdbcc6d
Merge pull request #47630 from ClickHouse/revert-47476-revert_46622 
Fix user MemoryTracker counter in async inserts
 2023-05-04 16:57:41 +02:00
Anton Popov
e61d7baa54 Merge remote-tracking branch 'upstream/master' into HEAD 2023-05-04 14:03:53 +00:00
Kuba Kaflik
0672d75f72
Merge branch 'master' into add-gcs-table-function 2023-05-04 16:00:33 +02:00
Antonio Andelic
9825531cb1 Better 2023-05-04 13:38:28 +00:00
Alexander Tokmakov
b5a57da4ce
Merge pull request #49316 from ClickHouse/rs/48385 
Unpoison stack frame ptrs from libunwind for msan
 2023-05-04 16:17:30 +03:00
Antonio Andelic
e8e99065c2 Merge branch 'master' into fix-gcs-headers 2023-05-04 13:09:00 +00:00
vdimir
6d3559e817
Merge pull request #49093 from ClickHouse/vdimir/ntile-default-frame 2023-05-04 14:01:53 +02:00
Alexander Tokmakov
36f8fcdfaf
Merge pull request #49458 from ClickHouse/tavplubix-patch-6 
Follow-up to #48792
 2023-05-04 14:32:18 +03:00
kssenii
9bb681c104 Fix build 2023-05-04 13:31:07 +02:00
kssenii
1433f5ffc9 Merge remote-tracking branch 'upstream/master' into remove-dependency-from-context 2023-05-04 13:24:02 +02:00
Antonio Andelic
a68a023ca7
Merge pull request #48724 from johanngan/sse-kms 
Support SSE-KMS configuration with S3 client
 2023-05-04 13:20:54 +02:00
kssenii
9ddd4aa7f7 Merge remote-tracking branch 'origin/allow-to-get-current-az' into allow-to-get-current-az 2023-05-04 13:10:32 +02:00
kssenii
08772e1da7 Review fixes 2023-05-04 13:09:03 +02:00
Nikolai Kochetov
df9f00e87c
Merge pull request #49417 from ClickHouse/respect-PR-for-agg-projection 
Respect PK for aggregate projection.
 2023-05-04 12:52:27 +02:00
kssenii
cf3a8e9b93 One more fix 2023-05-04 12:49:23 +02:00
kssenii
663a007fa6 Add assertion 2023-05-04 12:11:44 +02:00
Nikolay Degterinsky
f58ec4fbd7
Apply suggestions from code review 
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
 2023-05-04 12:07:53 +02:00
Alexander Gololobov
f77cc89464
Merge pull request #49470 from ClickHouse/remove_no_delay_flag 
Replace `NO DELAY` with `SYNC` in tests
 2023-05-04 11:57:01 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage 
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
 2023-05-04 11:47:43 +02:00
Eridanus
d428c461fc
Merge branch 'master' into suffix_size 2023-05-04 17:39:27 +08:00
kssenii
7ad4330c14 Fix logical error in stress test 2023-05-04 11:37:19 +02:00
alesapin
ba0d9c8b93
Merge branch 'master' into whitespaces-3 2023-05-04 11:32:02 +02:00
alesapin
89caf40840
Merge pull request #46528 from myrrc/feature/show-secrets-option 
Show secrets in `SHOW` and `SELECT` queries
 2023-05-04 11:21:30 +02:00
Antonio Andelic
8769ac2187 Correctly append arguments 2023-05-04 08:30:45 +00:00
xmy
c8cccb393e fix 2023-05-04 16:05:10 +08:00
Eridanus
72b35729ae
Merge branch 'master' into suffix_size 2023-05-04 13:55:40 +08:00
Li Shuai
279970337a Fix all key value is null and group use rollup return wrong answer 2023-05-04 11:07:17 +08:00
Nikolay Degterinsky
ed9a9ecd57 Fixes 2023-05-04 02:45:25 +00:00
johanngan
731823b873 Add support for SSE-KMS configuration with S3 
https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingKMSEncryption.html

Similar to the server_side_encryption_customer_key_base64 option for
configuring SSE-C with S3, add the following settings to configure
SSE-KMS on a per-endpoint/disk basis:
  - server_side_encryption_kms_key_id
  - server_side_encryption_kms_encryption_context
  - server_side_encryption_kms_bucket_key_enabled
 2023-05-03 21:35:38 -05:00
johanngan
1bc52977a7 Support "header" setting in S3 disk config 
The S3 table engine supports specifying extra HTTP headers in S3
requests to certain endpoints, via the "headers" setting. This commit
adds the same setting to S3 disk config.
 2023-05-03 21:32:58 -05:00
alekar
af81f056b4
Merge branch 'master' into 48716 2023-05-03 18:35:54 -07:00
Mal Curtis
5727585d95 s/use_tables_cache/use_table_cache 2023-05-03 23:40:12 +00:00
Alexey Milovidov
261907c143 Merge branch 'master' into deprecate-in-memory-parts 2023-05-04 01:07:38 +02:00
Alexey Milovidov
50202c1b0a Minor changes 2023-05-03 22:51:56 +02:00
Alexander Gololobov
a90c2ec90d
Merge pull request #49425 from ClickHouse/fix_build_set_with_remote 
Fix fuzz bug when subquery set is not built when reading from remote()
 2023-05-03 21:47:29 +02:00
wangxiaobo
2924837c7e
Fix Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric (#48954) 
* Attaching a table with non-existent ZK path does not increase the ReadonlyReplica metric bug fix.

* add integration test.

* add integration test.

* Update test.py

* format code

* format code
 2023-05-03 22:41:20 +03:00
serxa
5c3e9b9e85 fix style 2023-05-03 18:58:17 +00:00
serxa
94dca90219 do not polute unit test output 2023-05-03 18:43:29 +00:00
serxa
90a5695029 add AsyncLoader introspection 2023-05-03 18:19:32 +00:00
Alexander Tokmakov
83b12ec5ca replace NO DELAY with SYNC in tests 2023-05-03 20:08:49 +02:00
Kseniia Sumarokova
48fab80dd7
Update Credentials.cpp 2023-05-03 19:39:43 +02:00
Anton Popov
c9705d6bf1
Merging #49066 (Better error handling during loading of parts) (#49430) 
* catch filesystem error when loading parts

* better exception handling during part loading

---------

Co-authored-by: cangyin <excangyin@gmail.com>
Co-authored-by: Nikita Mikhaylov <mikhaylovnikitka@gmail.com>
 2023-05-03 19:10:06 +02:00
Nikita Mikhaylov
954e3b724c
Speedup outdated parts loading (#49317) 2023-05-03 18:56:45 +02:00
Alexander Tokmakov
ff70d26c23
Update StorageMergeTree.cpp 2023-05-03 19:30:44 +03:00
kssenii
0a18a87ad3 Fix style check 2023-05-03 18:28:33 +02:00
Kruglov Pavel
01ed70a660
Fix possible logical error "Cannot cancel. Either no query sent or already cancelled" (#49106) 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-05-03 19:16:23 +03:00
kssenii
cb6e5fedc5 Throw on error 2023-05-03 18:02:04 +02:00
flynn
236a0d9da0 add alias str_to_map and mapFromString for extractKeyValuePairs 2023-05-03 15:46:17 +00:00
kssenii
64bc03fefd Allow to get availability zone 2023-05-03 17:40:39 +02:00
Alexander Tokmakov
e399903030
Merge pull request #48548 from ClickHouse/clusters_is_active_column 
Add some columns to system.clusters
 2023-05-03 17:42:40 +03:00
Alexander Tokmakov
f3f6cfdcbb
Update StorageMergeTree.cpp 2023-05-03 17:39:31 +03:00
Nikolay Degterinsky
11d4ce8b4e
Merge pull request #44905 from evillique/bcrypt 
Add bcrypt authentication type
 2023-05-03 16:39:27 +02:00
Dmitry Novik
b921476a3b
Merge pull request #49419 from ClickHouse/fix-function-parameter-exception 
Throw an exception for non-parametric functions in new analyzer
 2023-05-03 16:34:28 +02:00
Nikolay Degterinsky
048b4ec738
Merge branch 'master' into bcrypt 2023-05-03 16:14:57 +02:00
Anton Popov
7896d30737
Merge pull request #49122 from CurtizJ/add-async-insert-mt-setting 
Add `MergeTree` setting `async_insert`
 2023-05-03 16:01:13 +02:00
Mike Kot
3d6240b982 fix 2023-05-03 13:59:45 +00:00
Sergei Trifonov
356bb15e96
Update src/Common/AsyncLoader.h 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-05-03 15:43:52 +02:00
Sergei Trifonov
eeedc5d3e7
Update src/Common/AsyncLoader.h 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-05-03 15:43:31 +02:00
Sergei Trifonov
5f2e6fae22
Update src/Common/AsyncLoader.h 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-05-03 15:42:18 +02:00
Sergei Trifonov
eca52c4015
Update src/Common/AsyncLoader.cpp 
Co-authored-by: Antonio Andelic <antonio2368@users.noreply.github.com>
 2023-05-03 15:41:12 +02:00
kssenii
35f437ac9c Address review comments 2023-05-03 14:37:18 +02:00
Antonio Andelic
b8b7a362b2
Merge branch 'master' into keeper-correctly-handle-snapshots 2023-05-03 13:51:09 +02:00
Azat Khuzhin
ad69fbb972
Fix compiling average example (suppress -Wframe-larger-than) (#49358) 2023-05-03 13:32:34 +02:00
Nikolai Kochetov
2395e52247
Merge branch 'master' into safer-cut-and-concat 2023-05-03 13:21:08 +02:00
kssenii
189f276ff5 Fix 2023-05-03 13:16:08 +02:00
vdimir
ef9c3a3ca1
Merge branch 'master' into vdimir/ntile-default-frame 2023-05-03 12:59:57 +02:00
alesapin
6f3f202f7c
Merge branch 'master' into fix_zero_copy_not_atomic 2023-05-03 12:53:35 +02:00
Nikolai Kochetov
6388be2062
Merge pull request #49326 from k-morozov/refactoring/pipe-into-step 
move pipe compute into initializePipeline
 2023-05-03 12:43:21 +02:00
Alexander Tokmakov
1ec3040d0c
Merge pull request #49420 from ClickHouse/fix_00002 
Fix some bad error messages
 2023-05-03 13:33:53 +03:00
Vladimir C
887ab23487
Merge pull request #49319 from azat/dict/fix-hashed-load_factor 2023-05-03 12:28:40 +02:00
Vladimir C
65ab64a77f
Merge pull request #49418 from ClickHouse/vdimir/keeper_fault_inject_sequential_cleanup 2023-05-03 12:27:10 +02:00
Kseniia Sumarokova
59401ce93c
Merge pull request #49411 from ClickHouse/kssenii-patch-7 
Update FileSegment.cpp
 2023-05-03 11:50:13 +02:00
Kseniia Sumarokova
f5b6aa0fc5
Merge pull request #49415 from kssenii/fix-assertions 
Fix some assertions failing in stress test
 2023-05-03 11:45:33 +02:00
Antonio Andelic
ae62b227f0 More fixes 2023-05-03 08:30:22 +00:00
Antonio Andelic
2a28efbfac Merge branch 'master' into fix-cnf-new-analyzer 2023-05-03 07:25:33 +00:00
Alexey Milovidov
ee9fae6aa2
Merge pull request #49363 from tsolodov/master 
Disallow configuring compression CODECs for alias columns
 2023-05-03 03:37:48 +03:00
Alexey Milovidov
f449df85b6 Deprecate in-memory parts 2023-05-03 00:31:09 +02:00
Kseniia Sumarokova
d4a921bd7c
Merge branch 'master' into fix-assertions 2023-05-03 00:10:32 +02:00
kssenii
d8d0d78db8 Fix build 2023-05-03 00:09:52 +02:00
Nikolay Degterinsky
4c038ef538
Merge branch 'master' into bcrypt 2023-05-02 21:52:21 +02:00
kssenii
ecfbf1e304 Remove dependency from DB::Context in readers 2023-05-02 21:45:27 +02:00
kssenii
ac9ef077ad Fix 2023-05-02 21:41:17 +02:00
Alexander Gololobov
2e20f2a14d Do not skip building set even when reading from remote 2023-05-02 21:31:56 +02:00
Nikolai Kochetov
6beff3bd44
Merge pull request #48603 from ilejn/sequence_state_fix 
sequence state fix
 2023-05-02 21:25:27 +02:00
Azat Khuzhin
2b21b83979 Reduce inter-header dependencies 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-02 21:15:18 +02:00
Dmitry Novik
bab112a1bc
Merge branch 'master' into revert-47476-revert_46622 2023-05-02 20:54:25 +02:00
Dmitry Novik
0c521eb10b Another atempt to fix test 2023-05-02 18:51:36 +00:00
Alexey Milovidov
eb27c58bc0 Whitespaces 2023-05-02 19:27:23 +02:00
Alexander Tokmakov
495325f664 fix some bad error messages, suppress others 2023-05-02 17:55:42 +02:00
Dmitry Novik
3d76c92f30 Throw exception for non-parametric functions in new analyzer 2023-05-02 15:40:19 +00:00
vdimir
33cf697028
Correctly cleanup sequential node in ZooKeeperWithFaultInjection 2023-05-02 15:01:59 +00:00
Nikolai Kochetov
75597efeb6 Respect PK for aggregate projection. 2023-05-02 14:58:44 +00:00
Nikolay Degterinsky
2aa8619534
Merge pull request #48851 from mauidude/date-trunc-return-date-time 
date_trunc function to always return DateTime type
 2023-05-02 16:43:20 +02:00
Nikolay Degterinsky
46c86dce93 Fix bcrypt enum value 2023-05-02 14:36:48 +00:00
kssenii
22487de34a Fix 2023-05-02 16:09:33 +02:00
Nikolay Degterinsky
f6704205ff
Update WithFileName.cpp 2023-05-02 16:05:18 +02:00
Robert Schulze
cf884d29a1
Merge remote-tracking branch 'origin/master' into rs/48385 2023-05-02 13:43:36 +00:00
Kseniia Sumarokova
bccc4d3b7e
Update FileSegment.cpp 2023-05-02 15:43:03 +02:00
Robert Schulze
ee49f8f0fa
Fix clang-tidy build 2023-05-02 13:41:38 +00:00
alesapin
a08225d9ea Fix typo 2023-05-02 15:34:57 +02:00
Robert Schulze
7e5fded3cf
A little less clutter 2023-05-02 13:16:15 +00:00
SmitaRKulkarni
997210c782
Merge pull request #48515 from ClickHouse/Clear_marks_cache_for_outdated_parts 
MergeTreeMarksLoader holds DataPart instead of DataPartStorage
 2023-05-02 15:11:14 +02:00
Nikolay Degterinsky
f87c418fc8
Merge pull request #49360 from evillique/alias-restricted-keywords 
Allow restricted keywords if alias is quoted
 2023-05-02 15:02:05 +02:00
Konstantin Morozov
046949a6d3 fix names 2023-05-02 14:59:41 +02:00
Konstantin Morozov
e4394debd4 forgot about query_plan 2023-05-02 14:59:41 +02:00
Konstantin Morozov
397a1700c7 apply comments 2023-05-02 14:59:41 +02:00
kst-morozov
f0619910d4 move pipe compute into initializePipeline 2023-05-02 14:59:41 +02:00
alesapin
24a744db4c Merge branch 'master' into fix_zero_copy_not_atomic 2023-05-02 14:57:55 +02:00
alesapin
619b6f2071 Fix typo 2023-05-02 14:57:52 +02:00
Robert Schulze
6bdbee33ee
Incorporate review feedback 2023-05-02 12:29:56 +00:00
Antonio Andelic
13739cd26b Correctly stop CNF convert for too many atomics 2023-05-02 12:29:15 +00:00
Nikita Mikhaylov
aa4c5fe958
Enhancements for background merges (#49313) 2023-05-02 13:43:59 +02:00
Anton Popov
bcdd2307fb add comments 2023-05-02 11:30:50 +00:00
Antonio Andelic
f695040a19
Merge pull request #48897 from ClickHouse/keeper-check-not-exists 
Add `CheckNotExists` request to Keeper
 2023-05-02 13:14:22 +02:00
Antonio Andelic
468ed32b23 Fix whitespace 2023-05-02 11:08:26 +00:00
Antonio Andelic
8c91dbdfc6 Properly fix GCS with keys 2023-05-02 10:49:31 +00:00
Kseniia Sumarokova
3ec53152e5
Update Metadata.cpp 2023-05-02 12:02:54 +02:00
kssenii
4fc1f644bc Simplify 2023-05-02 11:57:02 +02:00
Kseniia Sumarokova
1590ba3326
Merge pull request #49376 from ClickHouse/kssenii-patch-7 
Remove wrong assertion in cache
 2023-05-02 11:47:11 +02:00
Vladimir C
96d109c3db
Merge pull request #49137 from ClickHouse/vdimir/mutliple_storage_join 2023-05-02 11:40:16 +02:00
alesapin
96d2482bff
Merge pull request #49365 from ClickHouse/ttl_on_insert 
Fix bug in removal of existing part directory
 2023-05-02 11:32:01 +02:00
serxa
f3b97f9d1f improve helper functions 2023-05-02 09:19:27 +00:00
pufit
2964ca5c84 Specify grants for users in users.xml 2023-05-01 20:24:02 -04:00
Alexey Milovidov
1267fbca1c
Merge pull request #48998 from ongkong/fix-join-clause-create-column 
Fix incorrect createColumn call on join clause
 2023-05-02 02:23:07 +03:00
Alexey Milovidov
6f2ccd88b3
Merge pull request #49241 from evillique/decompress-filename 
Add file name to exception raised during decompression
 2023-05-02 02:16:49 +03:00
Timur Solodovnikov
e58a63b451 addressing PR comments 2023-05-01 16:13:45 -07:00
Alexey Milovidov
51847fbf10
Merge pull request #49321 from nickitat/rand_exp 
Presumably better buffer size for reading from fs
 2023-05-02 02:06:25 +03:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Timur Solodovnikov
c7295db43e nit 2023-05-01 13:59:38 -07:00
Robert Schulze
3d467febe0
Fix build 2023-05-01 20:58:10 +00:00
Timur Solodovnikov
6566ed7863 removed loop & added tests 2023-05-01 13:51:46 -07:00
Kseniia Sumarokova
044cfe5a22
Remove wrong assertion 2023-05-01 22:32:31 +02:00
kssenii
fbdccbd25f Merge remote-tracking branch 'origin/better-local-object-storage' into better-local-object-storage 2023-05-01 22:25:28 +02:00
kssenii
f325ba1794 Better 2023-05-01 21:10:37 +02:00
alesapin
0f6a4b973e
Merge branch 'master' into ttl_on_insert 2023-05-01 21:02:04 +02:00
alesapin
a3f9a8b87b Fix bug in removal of existing part directory 2023-05-01 20:32:01 +02:00
Nikita Mikhaylov
503f099afe
Merge branch 'master' into master 2023-05-01 18:50:44 +02:00
Timur Solodovnikov
fc5b0783fd fix for linter 2023-05-01 09:40:56 -07:00
Nikolay Degterinsky
65e743735a Merge remote-tracking branch 'upstream/master' into mongodb-array-type 2023-05-01 16:33:01 +00:00