Commit Graph

36937 Commits

Author SHA1 Message Date
Alexey Milovidov
97b6934ed6
Update ParquetBlockInputFormat.cpp 2023-02-02 02:42:21 +03:00
Alexey Milovidov
1682078f1a
Merge pull request #45873 from FFFFFFFHHHHHHH/dev_format
Allow a three-argument version for table function format
2023-02-02 02:40:31 +03:00
Suzy Wang
5b3054492d
Update src/Interpreters/Aggregator.h
Co-authored-by: Yakov Olkhovskiy <99031427+yakov-olkhovskiy@users.noreply.github.com>
2023-02-01 15:21:34 -05:00
Sema Checherinda
7c416477ac do not run wal on remote disks 2023-02-01 20:03:45 +01:00
Joanna Hulboj
e57492c214 Improve behaviour of conversion into Date for boundary value 65535 2023-02-01 18:22:06 +00:00
Nikolay Degterinsky
542f54cf2d
Merge pull request #45829 from Algunenano/fix_qualified_asterisk_children
Fix ASTQualifiedAsterisk cloning
2023-02-01 19:20:47 +01:00
kssenii
bbf060bf89 Fix test 2023-02-01 18:22:05 +01:00
Sema Checherinda
3e1b17e4cf
fix build 2023-02-01 17:09:43 +01:00
Anton Popov
9f26e16963 loose the assertion 2023-02-01 15:31:06 +00:00
Anton Popov
8dd6dbc452
Merge pull request #45857 from CurtizJ/fix-minor-mistake
Fix minor mistake after refactoring
2023-02-01 15:33:19 +01:00
Sema Checherinda
41a1dddc7a
Merge branch 'master' into better_postpone_reason 2023-02-01 15:16:34 +01:00
Han Fei
90153c11fc fix matching priority 2023-02-01 15:09:04 +01:00
Nikolai Kochetov
6cd0b51127
Merge pull request #45871 from ClickHouse/fix-ipv6-parser
Fix ipv6 parser
2023-02-01 14:28:54 +01:00
Antonio Andelic
88c1744975
Better 2023-02-01 14:25:58 +01:00
Sema Checherinda
db2aa48c91 do not block merges when old parts are droping in drop queries 2023-02-01 13:30:56 +01:00
Antonio Andelic
5de6f86c27 Fix clang-tidy error 2023-02-01 12:28:44 +00:00
Vladimir C
7c6281c446
Merge pull request #45581 from Avogar/fix-date-inference 2023-02-01 13:04:12 +01:00
Vladimir C
0d48eed68f
Merge pull request #45848 from Algunenano/fix_connection_timeouts_context_include 2023-02-01 12:53:50 +01:00
Vladimir C
dad838859b
Merge pull request #44489 from canhld94/ch_canh_fix_sparkbar 2023-02-01 12:50:00 +01:00
Igor Nikonov
04c9fcddcb
Merge pull request #45822 from taofengliu/planner_bug
A bug fix for Planner
2023-02-01 12:43:24 +01:00
Igor Nikonov
5143131179
Merge pull request #45817 from taofengliu/bug_fix
A bug fix for QueryTreeBuilder
2023-02-01 11:44:42 +01:00
Robert Schulze
216636f984
Make query cache global settings re-configurable 2023-02-01 10:35:19 +00:00
liuneng
17fc22a21e add parquet max_block_size setting 2023-02-01 18:29:20 +08:00
Robert Schulze
8a9493aeb9
Update QueryCache.cpp 2023-02-01 11:28:00 +01:00
Robert Schulze
f6259fbd65
Query cache: Improve logging 2023-02-01 10:24:17 +00:00
Robert Schulze
b512316586
Merge pull request #45682 from ClickHouse/rename-qrc-to-qc
Rename "Query Result Cache" to "Query Cache"
2023-02-01 11:23:29 +01:00
Raúl Marín
61dfebd299 Upstyle 2023-02-01 11:11:03 +01:00
Alexander Gololobov
e705f11ad1
Merge pull request #45786 from ClickHouse/delete_on_cluster
Support DELETE ON CLUSTER
2023-02-01 10:52:01 +01:00
Antonio Andelic
a3e3b65b32
Merge branch 'master' into keeper-use-fallocate 2023-02-01 09:05:49 +01:00
liuneng
cda9b0beea optimize parquet reader 2023-02-01 15:54:10 +08:00
robot-ch-test-poll2
202fa9fa37
Merge pull request #45859 from FArthur-cmd/show_engines_support
Add support for SHOW ENGINES query
2023-02-01 07:32:56 +01:00
FFFFFFFHHHHHHH
eca344eff1
Update src/TableFunctions/TableFunctionFormat.cpp
Co-authored-by: flynn <fenglv15@mails.ucas.ac.cn>
2023-02-01 14:12:36 +08:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring
Re-introduce io_uring read method
2023-02-01 06:41:32 +03:00
fhbai
d0fc3d9d4e allow a three-argument version for table function format 2023-02-01 11:17:14 +08:00
Alexey Milovidov
9b908a0be0 Fix trash around query kind, part 2 2023-02-01 03:31:31 +01:00
Alexey Milovidov
5c4db119fa Fix trash around query kind, part 1 2023-02-01 03:11:54 +01:00
Alexey Milovidov
c7f9cf6587
Update InterpreterShowEngineQuery.h 2023-02-01 04:57:58 +03:00
Yakov Olkhovskiy
3d64c84571 fix ipv6 parser 2023-02-01 01:02:58 +00:00
Alexey Milovidov
95e267561a
Update AggregateFunctionSparkbar.h 2023-02-01 00:46:37 +03:00
Vitaly Baranov
96b140cc95 Rename columns in system.backups: num_files, num_processed_files, processed_files_size
num_processed_files -> num_files (BACKUP) / files_read (RESTORE)
processed_files_size -> total_size (BACKUP) / bytes_read (RESTORE)
2023-01-31 22:45:41 +01:00
Alexey Milovidov
1cb7574498
Update AggregateFunctionSparkbar.h 2023-02-01 00:44:27 +03:00
Raúl Marín
0b201ebff2 Improve how the obfuscator deals with queries 2023-01-31 20:19:32 +01:00
Yakov Olkhovskiy
f4ef21cb2f allow implicit narrowing conversion UInt64 => IPv4 2023-01-31 19:04:21 +00:00
Alexey Milovidov
075dfe9005
Merge pull request #45750 from ucasfl/arrow-duration
Arrow support duration type
2023-01-31 20:34:38 +03:00
kssenii
4a1bdcf24c Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-31 18:11:26 +01:00
Antonio Andelic
ece92fa866
Update src/Coordination/Changelog.cpp
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
2023-01-31 17:11:18 +01:00
Han Fei
24b8322bc9 Merge branch 'master' into hanfei/regexp-refine 2023-01-31 17:03:51 +01:00
Anton Popov
1c4174750d fix mistake after refactoring 2023-01-31 15:48:14 +00:00
FArthur-cmd
a8e38738e9 add support for show engines query 2023-01-31 18:35:10 +03:00
Raúl Marín
7c31cb7adc Proper includes for ConnectionTimeoutsContext.h 2023-01-31 16:11:32 +01:00
Alexander Gololobov
96cb23a6a1 Break on first non-empty block 2023-01-31 15:49:56 +01:00
Antonio Andelic
8457d3bf3d Apply comments 2023-01-31 14:18:54 +00:00
Han Fei
716518f143
Merge branch 'master' into hanfei/gwp-asan 2023-01-31 15:01:25 +01:00
Antonio Andelic
1786237be6 Merge branch 'master' into keeper-use-fallocate 2023-01-31 13:53:47 +00:00
Vitaly Baranov
6165625e27
Update src/Parsers/ASTFunction.cpp
Co-authored-by: SmitaRKulkarni <64093672+SmitaRKulkarni@users.noreply.github.com>
2023-01-31 14:43:48 +01:00
Vitaly Baranov
c6be69568a
Update src/Parsers/ASTFunction.cpp
Co-authored-by: SmitaRKulkarni <64093672+SmitaRKulkarni@users.noreply.github.com>
2023-01-31 14:43:30 +01:00
Robert Schulze
5f91a78fda
Merge pull request #45652 from ClickHouse/block-delta-gorilla
Mark delta/doubledelta codec followed by Gorilla/FPC as suspicious
2023-01-31 14:06:57 +01:00
Raúl Marín
bacfe7ffa5 Fix ASTQualifiedAsterisk cloning 2023-01-31 14:02:46 +01:00
taiyang-li
7825ee95e9 merge master and solve conflicts 2023-01-31 20:49:59 +08:00
taofengliu
aae5d302be bug fix 2023-01-31 20:49:21 +08:00
Anton Popov
9f4658151e
Merge pull request #45799 from ClickHouse/func-iptypes-empty
Add empty/notEmpty function support for IP types
2023-01-31 13:37:23 +01:00
Alexander Tokmakov
51b0f66e6b
Merge pull request #45793 from ClickHouse/fix_part_check_cancellation
Fix race condition on a part check cancellation
2023-01-31 14:15:17 +03:00
FFFFFFFHHHHHHH
eb7df4e403 fix 2023-01-31 18:45:37 +08:00
刘陶峰
2014cc5fa7
Merge branch 'master' into bug_fix 2023-01-31 18:42:52 +08:00
taofengliu
95ebfbe0c7 bug fix 2023-01-31 18:34:17 +08:00
Robert Schulze
170fff16e4
Merge pull request #45816 from ClickHouse/minor-doc-fixes
Minor doc follow-up to #45382
2023-01-31 11:32:48 +01:00
Kseniia Sumarokova
7d53f8bbf6
Merge pull request #45591 from bharatnc/ncb/odbc-connection-pool-fixes
fixes to use the odbc_bridge_use_connection_pooling setting correctly
2023-01-31 11:31:59 +01:00
Robert Schulze
44a5e9cb17
Minor doc follow-up to #45382 2023-01-31 10:31:01 +00:00
Robert Schulze
fdd6c77480
Merge pull request #45382 from bigo-sg/improve_position
Add fastpath for function position when needle is empty
2023-01-31 11:22:31 +01:00
taiyang-li
d2e97fb94d remove columnar impl when instructions contains short 2023-01-31 18:13:01 +08:00
taiyang-li
2d7c357d61 implement columnar version for multiIf when instructions contains short 2023-01-31 18:00:31 +08:00
Robert Schulze
325c6bdf3d
Renaming: "Query Result Cache" --> "Query Cache"
Reasons:

- The cache will at some point store intermediate results as opposed to
  only query results. We should change the terminology now without
  having to worry about backward compat.

- Equivalent caches in MySQL (1) and Starrocks (2) are called "query
  cache".

- The new name is ca. 13.8% more catchy.

(1) https://dev.mysql.com/doc/refman/5.6/en/query-cache.html
(2) https://docs.starrocks.io/en-us/2.5/using_starrocks/query_cache
2023-01-31 09:54:34 +00:00
Robert Schulze
659a64a1d9
Merge pull request #45679 from ClickHouse/untangle-query-result-cache-settings
Untangle configuration of query result cache
2023-01-31 10:44:14 +01:00
Alexander Gololobov
f9133f3d85
Merge pull request #45791 from ClickHouse/fix_drop_hung
Fix bug in tables drop which can lead to potential query hung
2023-01-31 10:11:11 +01:00
FFFFFFFHHHHHHH
c64ffc6389 fix style 2023-01-31 15:59:35 +08:00
FFFFFFFHHHHHHH
0a6cc61fd9 Merge branch 'corrMatrix' of github.com:FFFFFFFHHHHHHH/ClickHouse into corrMatrix 2023-01-31 15:50:28 +08:00
FFFFFFFHHHHHHH
78f2d6fb25 fix 2023-01-31 15:44:33 +08:00
taiyang-li
4cf11d9a84 change as request 2023-01-31 10:48:02 +08:00
Duc Canh Le
e8ebd2e845 updateFrame returns size_t 2023-01-31 10:04:19 +08:00
Duc Canh Le
ae98847d31 Merge branch 'master' into ch_canh_fix_sparkbar 2023-01-31 10:01:16 +08:00
Alexey Milovidov
40b00432d2
Merge pull request #45737 from chhetripradeep/pchhetri/fix-45690
Set compression method and level for backup writer
2023-01-31 04:14:57 +03:00
Alexey Milovidov
7aa10a430a
Merge branch 'master' into hanfei/gwp-asan 2023-01-31 04:13:59 +03:00
Anton Popov
31e8b692f4 fix typo 2023-01-31 01:13:23 +00:00
Anton Popov
839cd614fb fix memory leak in azure sdk 2023-01-31 01:01:10 +00:00
Bharat Nallan
f1d6e3b908
Merge branch 'master' into ncb/odbc-connection-pool-fixes 2023-01-30 15:49:04 -08:00
Alexander Gololobov
93b82a2c44 Use multithreaded executor in isStorageTouchedByMutations() 2023-01-30 23:48:52 +01:00
Ilya Yatsishin
8d6df7ed58
Merge pull request #45785 from Algunenano/generate_random_types 2023-01-30 23:03:12 +01:00
Alexander Gololobov
4eea3de654 Do not restrict count() query to 1 thread in isStorageTouchedByMutations() 2023-01-30 22:29:28 +01:00
Yakov Olkhovskiy
79d82a3587 add empty/notEmpty function support for IP types 2023-01-30 20:37:08 +00:00
Alexey Milovidov
f46bfaa1c9
Merge pull request #45760 from ClickHouse/fix-trash
Remove trash
2023-01-30 22:53:32 +03:00
Vitaly Baranov
d95d8bcb26 Rename isCollectionNameArgument() -> isNamedCollectionName() and add comments. 2023-01-30 19:31:32 +01:00
Alexander Tokmakov
e42cd3163f fix race condition on a part check cancellation 2023-01-30 18:48:20 +01:00
Alexander Gololobov
863548114d force_wait flag is no longer needed 2023-01-30 18:38:28 +01:00
Pradeep Chhetri
455bd1a14a
Merge branch 'master' into pchhetri/fix-45690 2023-01-31 00:48:46 +08:00
Vitaly Baranov
2e3a3cc4dc
Merge pull request #45701 from vitlibar/add-setting-allow-head-object-request
Add new S3 setting allow_head_object_request
2023-01-30 17:41:09 +01:00
Bharat Nallan Chakravarthy
0d2e4fcc15 set use_connection_pooling from settings everywhere 2023-01-30 08:22:48 -08:00
alesapin
9ecf6e70a9 Make disk object storage compatible with other storages 2023-01-30 17:16:07 +01:00
Robert Schulze
abac59477b
Update src/Core/Settings.h
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
2023-01-30 17:12:01 +01:00
Robert Schulze
b42383f0d4
Update src/Core/Settings.h
Co-authored-by: Igor Nikonov <954088+devcrafter@users.noreply.github.com>
2023-01-30 17:11:53 +01:00
Han Fei
4971358de5 fix init 2023-01-30 17:07:01 +01:00
alesapin
be58d5d1af Fix bug in tables drop which can lead to potential query hung 2023-01-30 17:00:28 +01:00
Alexander Gololobov
de841b29c7 Support delete ON CLUSTER 2023-01-30 16:42:52 +01:00
Arthur Passos
7b1ceaa2c5
Merge branch 'master' into fix_cares_crash 2023-01-30 12:05:56 -03:00
Arthur Passos
513f430334 Add setting to enable/disable reverseDNSQuery function 2023-01-30 12:04:37 -03:00
Alexander Gololobov
386ae9266d Rewrite DELETE into ALTER UPDATE _row_exists=0 2023-01-30 15:46:17 +01:00
Raúl Marín
997fad4e8d GenerateRandom: Add support for maps 2023-01-30 15:23:22 +01:00
Robert Schulze
27b978381b
Use more speaking setting names 2023-01-30 14:20:43 +00:00
Pradeep Chhetri
deaa70fb14
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 21:35:16 +08:00
Raúl Marín
05d8cfc714 GenerateRandom: Add support to IPv4 and IPv6 types 2023-01-30 14:18:25 +01:00
Vladimir C
e7e8ae979f
Merge pull request #45271 from jh0x/feature-array-shuffle 2023-01-30 11:54:07 +01:00
Vitaly Baranov
6ee9971931 Mask sensitive info in named collection's overrides. 2023-01-30 11:33:21 +01:00
Robert Schulze
7cc1c19227
Fix typo 2023-01-30 10:25:16 +00:00
Robert Schulze
66392b873c
Merge pull request #45513 from aiven-sal/aiven-sal/siphash_pr
Keyed SipHash
2023-01-30 11:10:00 +01:00
Robert Schulze
8fa9db3c8b
Merge pull request #45757 from ClickHouse/rs-fix-typo
Fix typo + add boringssl comment
2023-01-30 11:06:57 +01:00
taiyang-li
c45111349f Merge branch 'master' into improve_multi_if 2023-01-30 16:32:55 +08:00
Vitaly Baranov
38910412c4
Merge pull request #42244 from AVMusorin/fix_backup_restore_num_files
Added num_processed_files and processed_files_size for backup and restore processes
2023-01-30 09:24:49 +01:00
taiyang-li
d25740da83 change as request 2023-01-30 16:13:12 +08:00
taiyang-li
5db514fb05 Merge branch 'master' into improve_position 2023-01-30 15:29:32 +08:00
taiyang-li
a9bc770505 remove ast optimizer 2023-01-30 15:20:34 +08:00
Smita Kulkarni
6cf2498609 Fixed clang-tidy build for comparing strings and updated to notify after adding subscriber if queue is already empty- Updated checking of SYSTEM SYNC REPLICA 2023-01-30 08:18:20 +01:00
taiyang-li
a728dd71ac update comments 2023-01-30 15:10:43 +08:00
taiyang-li
29e01c3792 fix bug 2023-01-30 15:06:01 +08:00
taiyang-li
7f30f91f0b fix bug 2023-01-30 14:32:23 +08:00
Alexey Milovidov
b72a5b95e2
Merge branch 'master' into pchhetri/fix-45690 2023-01-30 06:25:03 +03:00
taiyang-li
6810107105 fix style 2023-01-30 10:03:29 +08:00
Alexey Milovidov
0d49166b0f
Merge branch 'master' into fix-trash 2023-01-30 04:46:22 +03:00
Alexey Milovidov
a7299746c7
Merge pull request #45743 from ClickHouse/oom-message
Improve MEMERY_LIMIT_EXCEEDED exception message
2023-01-30 00:46:04 +03:00
Alexey Milovidov
04078dbed3 Remove trash 2023-01-29 22:43:36 +01:00
Robert Schulze
15ae2d1de5
Merge branch 'master' into aiven-sal/siphash_pr 2023-01-29 21:06:52 +01:00
Robert Schulze
c85cc3e003
Merge branch 'master' into block-delta-gorilla 2023-01-29 21:05:15 +01:00
Robert Schulze
e88aa18a8c
Fix typo 2023-01-29 20:01:30 +00:00
Vitaly Baranov
326f4d2a4f Fix using mutex for increaseProcessSize 2023-01-29 17:50:53 +01:00
Alexey Milovidov
3534c39dc2
Merge pull request #44923 from azat/bg-pool-catch
Catch exceptions in BackgroundSchedulePool
2023-01-29 19:44:48 +03:00
Alexey Milovidov
303fc4b863
Merge pull request #45744 from ClickHouse/fix-style-and-typo
Fix style and typo
2023-01-29 19:40:32 +03:00
alesapin
631c8fb155
Merge branch 'master' into add-setting-allow-head-object-request 2023-01-29 14:58:27 +01:00
Arthur Passos
ebf3145598 extern bad arguments 2023-01-29 10:18:21 -03:00
taiyang-li
aa3d67e2d6 fix bugs 2023-01-29 20:48:46 +08:00
Arthur Passos
f67560058d Add argument validation to reverseDNSQuerying and make stateless test more about function validation 2023-01-29 09:20:17 -03:00
taiyang-li
fa6dea8b6b remove useless code 2023-01-29 19:50:30 +08:00
taiyang-li
eeef2dae77 fix cores 2023-01-29 19:48:46 +08:00
flynn
801d6db486 Arrow support duration type 2023-01-29 10:55:31 +00:00
SmitaRKulkarni
809354dc30
Merge branch 'master' into 45508_Update_strategy_for_system_sync_replica 2023-01-29 11:28:21 +01:00
Robert Schulze
856eba0a4b
Mark delta/doubledelta codec followed by a time series codec as suspicious 2023-01-29 08:51:13 +00:00
taiyang-li
3ee792f4e2 Merge branch 'master' into improve_count_if 2023-01-29 15:46:23 +08:00
taiyang-li
952058e69e fix core 2023-01-29 15:42:42 +08:00
Pradeep Chhetri
9919fb0be9
Merge branch 'master' into pchhetri/fix-45690 2023-01-29 11:35:26 +08:00
Alexey Milovidov
76975c00d4
Merge pull request #43405 from azat/fs/use-access
Simply filesystem helpers to check is-readable/writable/executable
2023-01-29 06:21:00 +03:00
Alexey Milovidov
c3c1ed01d9
Merge branch 'master' into bg-pool-catch 2023-01-29 06:19:38 +03:00
Alexey Milovidov
49a59ff9bd Fix bad comment 2023-01-29 03:57:59 +01:00
Alexey Milovidov
9ad87f9917 Fix style and typo 2023-01-29 03:51:42 +01:00
taiyang-li
7f3114d806 merge master and solve conflicts 2023-01-29 09:59:16 +08:00
Dmitry Novik
ec1f6bfd37 Improve MEMERY_LIMIT_EXCEEDED exception message 2023-01-29 01:52:37 +00:00
Alexey Milovidov
f4eb19bd69
Update InterpreterSystemQuery.cpp 2023-01-29 04:43:24 +03:00
Smita Kulkarni
9b457a57a9 Fixed clang-tidy build - Updated checking of SYSTEM SYNC REPLICA 2023-01-28 21:43:41 +01:00
Saulius Valatka
374e40447c fix buffer alignment and improve error message for failed reads 2023-01-28 21:54:44 +02:00
Saulius Valatka
252a091702 update Exception creation 2023-01-28 21:54:44 +02:00
Saulius Valatka
64accde7bd check for null CQEs to silence clang-analyzer 2023-01-28 21:54:44 +02:00
Saulius Valatka
4b2fefef8b improve SQE submission error reporting, retry on EINTR/EGAIN 2023-01-28 21:54:44 +02:00
Saulius Valatka
8505b8c57a add profile events for failed/succeeded CQE completions 2023-01-28 21:54:44 +02:00
Saulius Valatka
8fa9a99ba1 implement pending request queue to prevent CQ overflows 2023-01-28 21:54:44 +02:00
Saulius Valatka
ac2c921bdf add initial io_uring support 2023-01-28 21:54:44 +02:00
Saulius Valatka
fb45ed038f add liburing to build 2023-01-28 21:54:44 +02:00
Pradeep Chhetri
8156a6761f Set compression method and level for backup writer
Signed-off-by: Pradeep Chhetri <pradeepchhetri4444@gmail.com>
2023-01-28 21:49:59 +08:00
freedomDR
5836a3f153 refactor coder 2023-01-28 04:27:11 +00:00
freedomDR
379850b6c4 add system sync file cache 2023-01-28 04:27:10 +00:00
Alexey Milovidov
bc2f454522
Merge branch 'master' into block-non-float-gorilla-v2 2023-01-28 03:30:12 +03:00
Alexey Milovidov
9b1b247f9b
Merge pull request #45585 from kitaisreal/low-cardinality-insert-fix
LowCardinality insert fix
2023-01-28 03:26:40 +03:00
Alexey Milovidov
657d9f69e7
Merge pull request #45686 from amosbird/issue_45590
Fix key description when encountering duplicate primary keys
2023-01-28 02:22:42 +03:00
Smita Kulkarni
2bbe08ce8b Updated destructor to notify even when queue empty - Updated checking of SYSTEM SYNC REPLICA 2023-01-27 22:37:42 +01:00
Joanna Hulboj
df030a56f0 FIXUP: Remove use of legacy exceptions api 2023-01-27 21:27:09 +00:00
Azat Khuzhin
ffd5617614 Improve logging for broken disks
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
6b42b66257 Simply filesystem helpers to check is-readable/writable/executable
Use one system call - faccessat(), over multiple system calls.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels
Add ability to ignore unknown keys in JSON object for named tuples
2023-01-27 21:11:05 +01:00
Joanna Hulboj
9a559b5475 FIXUP: More comments about shuffle 2023-01-27 20:07:56 +00:00
Joanna Hulboj
8791a44e01 FIXUP: Added info and test for materialized array 2023-01-27 20:07:56 +00:00
Joanna Hulboj
3b472eb2dd FIXUP: Darwin compilation issue 2023-01-27 20:07:56 +00:00
Joanna Hulboj
e1d281206f Clamp the limit for arrayPartialShuffle 2023-01-27 20:07:56 +00:00
Joanna Hulboj
b0ba8c02be FIXUP: Darwin compilation issue 2023-01-27 20:07:55 +00:00
Joanna Hulboj
d378e453c1 FIXUP: fix in arrayPartialShuffle 2023-01-27 20:07:55 +00:00
Joanna Hulboj
a8b78abc54 Added arrayPartialShuffle function 2023-01-27 20:07:55 +00:00
Joanna Hulboj
31eb936457 Added Fisher-Yates shuffle and partial-shuffle 2023-01-27 20:07:55 +00:00
Joanna Hulboj
09789b027f FIXUP: PR comments 2023-01-27 20:07:55 +00:00
Joanna Hulboj
a65b2cf861 FIXUP: Simplify logic by using permute function 2023-01-27 20:07:55 +00:00
Joanna Hulboj
c09a4dd132 FIXUP: Docs into code 2023-01-27 20:07:55 +00:00
Joanna Hulboj
8d8d1bb887 FIXUP: make clang-tidy happier 2023-01-27 20:07:55 +00:00
Joanna Hulboj
01624e2f23 FIXUP: style 2023-01-27 20:07:55 +00:00
Joanna Hulboj
2355780737 Minor formatting 2023-01-27 20:07:55 +00:00
Joanna Hulboj
4adb6288eb Add arrayShuffle function 2023-01-27 20:07:55 +00:00
Igor Nikonov
300f78df96
Merge pull request #45567 from ClickHouse/enable-remove-redundant-sorting
Enable query_plan_remove_redundant_sorting optimization by default
2023-01-27 19:14:36 +01:00
Vitaly Baranov
af74c008c4 Use one request to implement S3ObjectStorage::getObjectMetadata instead of two ones. 2023-01-27 18:42:37 +01:00
Arthur Passos
c586de599a string formatting 2023-01-27 14:01:34 -03:00
kssenii
9c4a97bbd1 Merge remote-tracking branch 'upstream/master' into storage-rabbitmq-fix-flush 2023-01-27 17:17:09 +01:00
Arthur Passos
39cbf4d4dc make random number generator thread safe 2023-01-27 12:14:07 -03:00
Arthur Passos
e559a6b1d2 address some comments 2023-01-27 12:07:00 -03:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings 2023-01-27 16:03:00 +01:00
Anton Popov
3f1db52d51 Merge remote-tracking branch 'upstream/master' into compact-parts-vertical-merge 2023-01-27 14:38:37 +00:00
Vitaly Baranov
d02b255b55 Add new setting "allow_head_object_request" to S3::RequestSettings. 2023-01-27 15:10:34 +01:00
Vitaly Baranov
f9282cfcac Make version_id an optional parameter again. 2023-01-27 15:10:19 +01:00
Vitaly Baranov
aea9ccdb60 Pass request settings to S3::getObjectInfo(). 2023-01-27 15:10:09 +01:00
Vitaly Baranov
a8304525ed Move getObjectInfo() to a separate header. 2023-01-27 15:09:38 +01:00
Nikolai Kochetov
313947e0b0
Merge branch 'master' into issue_45590 2023-01-27 15:08:28 +01:00
SmitaRKulkarni
b22fd40d92
Merge branch 'master' into 45508_Update_strategy_for_system_sync_replica 2023-01-27 15:00:47 +01:00
Anton Popov
f10e82355e
Merge pull request #45630 from CurtizJ/fix-performance-columns-description
Fix performance of short queries with `Array` columns
2023-01-27 14:59:55 +01:00
Alexander Tokmakov
ec0738ef31
Merge pull request #45692 from ClickHouse/tavplubix-patch-3
Fix build
2023-01-27 16:39:56 +03:00
Anton Popov
9c1717b42d fix computation of granularity in vertical merges 2023-01-27 13:35:04 +00:00
Robert Schulze
83593810ff
Make check work with Nullable / Array / Tuple 2023-01-27 13:02:54 +00:00
Alexander Tokmakov
f375b1246f
Merge pull request #45363 from ClickHouse/fix_hang_during_drop_in_zero_copy_replication
Fix no shared id during drop for the fourth time
2023-01-27 15:59:27 +03:00
Nikolai Kochetov
f6ad6296ba Restore. 2023-01-27 12:45:41 +00:00
Alexander Tokmakov
1494262a38
Update DataPartStorageOnDiskFull.cpp 2023-01-27 15:42:41 +03:00
Nikolai Kochetov
b716e2d754 A bit cleaner fix. 2023-01-27 12:37:23 +00:00
Smita Kulkarni
39966457d9 Updated to remove waiting ids till the removed log entry - Updated checking of SYSTEM SYNC REPLICA 2023-01-27 13:36:44 +01:00
alesapin
716d25c33f
Merge pull request #45619 from CurtizJ/refactoring-merge-tree-parts
Refactoring of code near merge tree parts
2023-01-27 13:36:33 +01:00
Alexander Tokmakov
c366806c3e
Merge pull request #45527 from ClickHouse/exception_message_patterns4
Better formatting for exception messages 2
2023-01-27 15:31:52 +03:00
Salvatore Mesoraca
59c17a7719
functions: hashing: add sipHash{64,128}Keyed 2023-01-27 13:00:54 +01:00
Salvatore Mesoraca
31e4d042f8
function: hashing: add generic support for keyed algos 2023-01-27 13:00:53 +01:00
Salvatore Mesoraca
2e72e27206
common: siphash: add support for custom keys 2023-01-27 13:00:53 +01:00
Robert Schulze
e30c38cab3
Fix up some leftovers 2023-01-27 10:43:43 +00:00
Maksim Kita
8e1e136d0c
Merge pull request #42976 from kitaisreal/analyzer-settings-push-down
Analyzer SETTINGS push down
2023-01-27 12:52:23 +03:00
Smita Kulkarni
a95609e0bc Updated to validate & remove each element instead of just last element - Updated checking of SYSTEM SYNC REPLICA 2023-01-27 10:35:12 +01:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Amos Bird
716516f84a
Fix test 2023-01-27 16:58:41 +08:00
Amos Bird
fd60954081
Fix key description on duplicate primary keys
This can happen in projections. See
https://github.com/ClickHouse/ClickHouse/issues/45590 for details.
2023-01-27 13:01:36 +08:00
Alexander Tokmakov
7af3c6d162 fix 2023-01-27 01:22:29 +01:00
Alexey Milovidov
5b257ab806
Merge pull request #45233 from ClickHouse/improve_week_day
Revert "Revert "Improve week day""
2023-01-27 02:44:17 +03:00
Alexey Milovidov
f401449bd9
Merge pull request #45661 from ClickHouse/generate-random-lowcardinality
Allow LowCardinality in GenerateRandom
2023-01-27 02:14:38 +03:00
Robert Schulze
032cdb986e
Merge pull request #45615 from ClickHouse/fix-gorilla
Fix codec pipeline Delta (or DoubleDelta) + Gorilla
2023-01-27 00:04:39 +01:00
Anton Popov
fb3f7409fa allow vertical merges from compact to wide parts 2023-01-26 22:18:04 +00:00
Robert Schulze
7d97fab2dc
Untangle query result cache settings
This PR modularizes the configuration options of the query result cache
(QRC).

1. Add a feature toggle "allow_experimental_query_result_cache = false"
   which controls whether the experimental QRC can be used at all. This
   configuration option will be removed once the QRC becomes
   non-experimental.

2. Modularize the existing two configuration settings
   "enable_experimental_query_result_cache" and
   "enable_experimental_query_result_cache_passive_usage" into three
   orthogonal settings:

   - "use_query_result_cache = false" controls whether a query (or all
     queries of the session) utilize the query result cache

   - settings "use_query_result_cache_passive_usage = true" and
     "use_query_result_cache_active_usage = true" control the way a
     query (or all queries of the session) utilize the query result
     cache: "passive" use is reading, "active" use is writing.
2023-01-26 21:17:48 +00:00
Igor Nikonov
211edc054e Fix check for sum*(Float) 2023-01-26 19:26:53 +00:00
Alexander Tokmakov
68a60ad4f6 fix 2023-01-26 20:20:56 +01:00
Alexander Tokmakov
061026c307 fix 2023-01-26 19:01:29 +01:00
Arthur Passos
ea38df2c28 add comments to the code 2023-01-26 13:54:12 -03:00
Vitaly Baranov
5b469eb91f
Merge pull request #45603 from vitlibar/fix-wiping-sensitive-info
Fix wiping sensitive info in logs
2023-01-26 15:44:24 +01:00
Alexey Milovidov
d942a4ddef Allow LowCardinality in GenerateRandom 2023-01-26 15:35:20 +01:00
Alexander Tokmakov
d7c697ee38 fix 2023-01-26 15:24:39 +01:00
Alexander Tokmakov
067b1f5f13 Merge branch 'master' into exception_message_patterns4 2023-01-26 15:20:58 +01:00
Igor Nikonov
ba92705ea1 Fix duplicated setting in changes history 2023-01-26 14:20:44 +00:00
Alexander Tokmakov
f676e9eaff
Merge pull request #45613 from azat/replicated-improve-log
Improve "at least part X is missing" error message
2023-01-26 16:48:18 +03:00
Anton Popov
92fa39798b Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-26 13:29:23 +00:00
Anton Popov
b58b73b0e7
Merge pull request #45529 from CurtizJ/fix-storage-s3-race
Try to fix test `test_storage_s3/test.py::test_wrong_s3_syntax` (race in `StorageS3`)
2023-01-26 14:21:32 +01:00
Igor Nikonov
105d72e299 Fix: sum*() with Nullable(Float) 2023-01-26 13:17:06 +00:00
Anton Popov
87af86e9a3 fix projections 2023-01-26 13:11:31 +00:00
Alexander Tokmakov
14db798191 fix 2023-01-26 13:56:16 +01:00
Maksim Kita
a19346b59a OptimizeGroupByFunctionKeysPass style fixes 2023-01-26 12:48:12 +01:00
Maksim Kita
32129ca7dc Fixed build 2023-01-26 12:47:50 +01:00
Maksim Kita
6d3a5241e8 QueryTreePassManager refactor passes to use QueryNode, UnionNode scope context 2023-01-26 12:47:50 +01:00
Maksim Kita
8e6593f367 Fixed code review issues 2023-01-26 12:46:58 +01:00
Maksim Kita
b538fae749 Analyzer SETTINGS push down 2023-01-26 12:46:58 +01:00
Maksim Kita
7a8a8dcd2f
Merge pull request #45415 from ClickHouse/redundant-group-by-keys
Remove redundant group by keys with constants
2023-01-26 14:45:25 +03:00
Anton Popov
b52cf17fa6
Merge pull request #45612 from ClickHouse/CurtizJ-patch-7
Remove useless code
2023-01-26 12:38:52 +01:00