Commit Graph

897 Commits

Author SHA1 Message Date
Anton Popov
bceda4cd29 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-23 14:03:34 +00:00
kssenii
bca73d4b0a Fix 2024-01-23 11:51:21 +01:00
kssenii
1aa8e62bb7 Fix 2024-01-22 18:26:44 +01:00
Michael Kolupaev
fd361273f0 Fix StorageURL forgetting headers on server restart 2024-01-19 11:35:12 -08:00
Smita Kulkarni
2ee6893312 Updated to return container for getObjectsNamespace 2024-01-05 10:58:04 +01:00
Anton Popov
482e01dea3 add docs 2023-12-28 17:36:56 +00:00
Anton Popov
e2905fcbe0 better marks of subcolumns and more tests 2023-12-27 17:43:25 +00:00
Anton Popov
57d61a7bc1 add table function 'mergeTreeIndex' 2023-12-21 22:05:53 +00:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token
Feature/s3 session token
2023-12-20 17:22:09 +01:00
Shani Elharrar
679a0e1300 StorageS3 / TableFunctionS3: Allow passing session_token to AuthSettings
This can help users that want to pass temporary credentials that
issued by AWS in order to load data from S3 without changing
configuration or creating an IAM User.

Fixes #57848
2023-12-19 08:06:36 +02:00
Nikita Mikhaylov
6360b76792 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-18 21:49:31 +00:00
Alexey Milovidov
69e6e59e96 Add a test for #49708 2023-12-18 08:34:53 +01:00
Nikita Mikhaylov
c979124cfe Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-08 16:25:02 +00:00
Vitaly Baranov
252de64af3
Merge pull request #57362 from aiven-sal/aiven-sal/dict_fix
Prevent dictionary's ACL bypass via dictionary() table function
2023-12-08 14:09:40 +01:00
Nikita Mikhaylov
04d167c6d9 Better 2023-12-05 13:34:37 +01:00
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Kruglov Pavel
30148972ed
Merge pull request #57328 from Avogar/size-virtual-column-table-functions
Add information about new _size virtual column in file/s3/url/hdfs/azure table functions
2023-11-29 15:05:28 +01:00
Salvatore Mesoraca
223db31cb6
Prevent dictionary ACL bypass via dictionary table function 2023-11-29 14:40:29 +01:00
Robert Schulze
7d26990752
Follow-up to #56490: Fix build with -DENABLE_LIBRARIES=0 2023-11-28 19:59:43 +00:00
avogar
4d9a1b50f9 Add information about new _size virtual column in file/s3/url/hdfs/azure table functions 2023-11-28 18:15:07 +00:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Ubuntu
a85cf758b0 Fuzz JSON table function
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
2023-11-28 01:58:24 +00:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
Alexey Milovidov
7a44e2f478 Miscellaneous 2023-11-10 05:36:44 +01:00
Alexey Milovidov
60a9974adc Fix build 2023-11-10 05:34:29 +01:00
Alexey Milovidov
cc39484f7f Merge branch 'master' into system-symbols 2023-11-09 23:05:55 +01:00
MikhailBurdukov
c391527c86
Select from system tables when table based on table function. (#55540)
* Select system tables from table function

* disable test in fasttest

* update test

* Using cached_columns in table_functions

* Review changes

* Fix
2023-11-09 16:50:10 +01:00
Alexey Milovidov
42b816342e Fix tidy 2023-11-07 00:09:59 +01:00
Alexey Milovidov
1c318891b8 Remove useless header files 2023-11-06 04:33:23 +01:00
avogar
f87938735a Fixes and improvements for Iceberg storage 2023-10-17 11:07:37 +00:00
Priyansh Agrawal
2562f66efd
Fix typo in TableFunctionS3.cpp 2023-10-07 00:55:08 +01:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
robot-clickhouse
1c8ee76ba2
Merge pull request #54513 from Avogar/formats-with-names-no-header
Fix possible parsing error in WithNames formats with disabled input_format_with_names_use_header
2023-09-12 17:58:03 +02:00
avogar
2d8f33bfa2 Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header 2023-09-11 14:55:37 +00:00
avogar
c6ef811b82 Fix tests 2023-09-07 11:05:06 +00:00
avogar
ab101eaff8 Fix possible error 'URI contains invalid characters' in s3 table function 2023-09-06 18:21:24 +00:00
Antonio Andelic
5a0c2ca108 Merge branch 'master' into archive-improvements-2 2023-08-28 08:34:42 +00:00
Antonio Andelic
8e1d38d377 Merge branch 'master' into archive-improvements-2 2023-08-24 13:03:36 +00:00
Antonio Andelic
83d4b819f3 Better support for reading from archives 2023-08-23 08:10:30 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Amos Bird
076a67bdaa
Consistent file management in CMake 2023-08-21 11:45:08 +08:00
Kseniia Sumarokova
47cccee657
Merge branch 'master' into working 2023-08-09 11:35:14 +02:00
Kseniia Sumarokova
11b5a3dd22
Update TableFunctionRemote.cpp 2023-08-07 11:46:14 +02:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster
Table function azureBlobStorageCluster
2023-08-07 09:16:52 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Jiyoung Yoo
608b5ace36 Additional fix for issue#40220 2023-08-05 12:17:53 -07:00
Jiyoung Yoo
da2cb99c12 Fix for issue #40220
improve error message for table function remote
2023-08-05 12:17:53 -07:00
Alexey Milovidov
e6c3224dfd
Merge pull request #50848 from LiuYangkuan/issue_#50808
Allow using cluster, clusterAllReplicas, remote, and remoteSecure without table name
2023-08-04 23:56:05 +03:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Antonio Andelic
8e7eb7f3fa Fix tests 2023-08-04 08:59:55 +00:00
Smita Kulkarni
2a681f1577 Removed unused function and fixed build after merge 2023-08-03 14:32:03 +02:00
Alexey Milovidov
dbf14b5e2d Fix wrong error code "BAD_GET" 2023-08-02 23:16:06 +02:00
Alexey Milovidov
bffe3a314e
Merge branch 'master' into issue_#50808 2023-08-03 00:06:06 +03:00
Alexey Milovidov
3f4faeab0b
Update TableFunctionRemote.cpp 2023-08-03 00:05:56 +03:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
alesapin
0ee9797fb8
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
2023-08-01 12:27:17 +02:00
Antonio Andelic
9fb86f134b Fix tests 2023-07-31 12:04:27 +00:00
Antonio Andelic
7df5c83046 Merge branch 'master' into add-reading-from-archives 2023-07-31 09:27:01 +00:00
Antonio Andelic
df45602165 Refactoring 2023-07-31 08:50:09 +00:00
Antonio Andelic
1fc1b6aae4 More fixes 2023-07-28 13:00:35 +00:00
Antonio Andelic
e83e0ec2cd Fix build 2023-07-28 12:26:56 +00:00
Antonio Andelic
720d587e85 Merge branch 'master' into add-reading-from-archives 2023-07-28 08:49:00 +00:00
chen
0c3118c9af
Merge branch 'master' into s3-url 2023-07-28 05:26:10 +08:00
Alexey Milovidov
cb30e78bec
Merge branch 'master' into issue_#50808 2023-07-27 07:51:55 +03:00
xiedeyantu
89f2e8cdea Fix S3 table function does not work for pre-signed URL 2023-07-26 23:02:57 +08:00
Alexey Milovidov
21382afa2b Check for punctuation 2023-07-25 06:10:04 +02:00
Azat Khuzhin
67095d2150 Fix comment for function argument in TableFunctionRemote
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 05:50:44 +02:00
SmitaRKulkarni
74e7ff9628
Merge branch 'master' into azure_blob_storage_sas_token 2023-07-23 18:21:06 +02:00
Kruglov Pavel
0fca64ced4
Merge pull request #51695 from Avogar/row-binary-with-defaults
Add RowBinaryWithDefaults format
2023-07-19 22:10:30 +02:00
Smita Kulkarni
671f8b34d0 Added test with all signatures and fixed style check 2023-07-17 17:18:14 +02:00
Smita Kulkarni
4a18ec62ea Addressed review comments on docs and function parameters 2023-07-17 14:52:11 +02:00
Smita Kulkarni
2d3a148ffd Added option to check if container exists before attempting to read/create it, added this flag for all table functions, only used in azureBlobStorage 2023-07-06 10:56:07 +02:00
Nikolay Degterinsky
8dfa773f44
Merge branch 'master' into headers-blacklist 2023-06-30 23:40:17 +02:00
avogar
34bf0284ad Add RowBinaryWithDefaults format 2023-06-30 16:18:30 +00:00
Nikolay Degterinsky
47480de25a Fix a crash in s3 and s3Cluster functions 2023-06-27 16:38:29 +00:00
Nikolay Degterinsky
ea11774939 Skip the analysis of headers argument with the new analyzer 2023-06-27 11:47:24 +00:00
Smita Kulkarni
9734871345 Merge branch 'master' into azure_table_function_cluster 2023-06-27 11:09:44 +02:00
SmitaRKulkarni
0762e981d8
Merge branch 'master' into azure_blob_storage_sas_token 2023-06-27 09:47:23 +02:00
Robert Schulze
cc3398159e
Restore Azure build on ARM (#51288) 2023-06-23 14:35:51 +02:00
Alexander Tokmakov
76e3d1e7b6
Revert "Fix a crash in s3 and s3Cluster functions" 2023-06-21 17:10:20 +03:00
Nikolay Degterinsky
150007bfc5
Merge branch 'master' into fix-s3-function 2023-06-21 03:04:59 +02:00
Nikolay Degterinsky
75b266e179 Fix crash in s3 and s3Cluster functions 2023-06-21 00:04:11 +00:00
Alexey Milovidov
3ed56120c1
Update TableFunctionRemote.cpp 2023-06-21 00:24:58 +03:00
Smita Kulkarni
641d1ecfcc Merge branch 'master' into azure_table_function_cluster 2023-06-19 15:27:21 +02:00
Smita Kulkarni
08b5196070 Updated to support passing sas token authentication 2023-06-18 19:54:31 +02:00
LiuYangkuan
83840da535 Allow using cluster, clusterAllReplicas, remote, and remoteSecure without table name. 2023-06-17 09:58:45 +08:00
Kseniia Sumarokova
31e08635bf
Merge branch 'master' into unify-priorities-pools 2023-06-15 12:51:45 +02:00
Smita Kulkarni
8650586131 Added tests and docs for azureBlobStorageCluster 2023-06-13 10:51:35 +02:00
JackyWoo
9d548315e8
Merge branch 'master' into support_redis 2023-06-13 09:34:32 +08:00
Kruglov Pavel
873cee9451
Merge pull request #49626 from alekseygolub/renamefile
Added option to rename files, loaded via TableFunctionFile, after successful processing
2023-06-12 15:01:22 +02:00
Smita Kulkarni
2d0152e93d Fixed issue with named collection 2023-06-12 13:38:01 +02:00
Smita Kulkarni
95d447d81f Updated name to azureBlobStorageCluster 2023-06-12 10:10:09 +02:00
Smita Kulkarni
791a05af61 Merge branch 'master' into azure_table_function_cluster 2023-06-12 09:58:49 +02:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis 2023-06-12 09:53:06 +08:00
Smita Kulkarni
a8b579a856 Rename azure_blob_storage to azureBlobStorage 2023-06-09 19:28:06 +02:00
pufit
55d228e78e
Merge branch 'master' into support_redis 2023-06-09 11:45:12 -04:00
Smita Kulkarni
590236030d Fixed cluster with distributed_processing 2023-06-09 15:17:08 +02:00