Commit Graph

940 Commits

Author SHA1 Message Date
divanik
8f44201f92 Preliminary commit 2024-03-12 16:22:33 +00:00
kssenii
bfc4f5e1d3 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-11 14:57:15 +01:00
Sema Checherinda
5c41727725 http connections pools 2024-03-10 10:00:18 +01:00
Dmitry Novik
5b28614f4c Fix TableFunctionExecutable::skipAnalysisForArguments 2024-03-07 14:50:37 +01:00
Anton Popov
f582797b36 Merge remote-tracking branch 'upstream/master' into HEAD 2024-03-06 14:14:42 +00:00
kssenii
0c293bce11 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-03-06 12:06:19 +08:00
Kruglov Pavel
4bdafed801
Merge pull request #60420 from HowePa/format_case_insensitive
Make all format names case insensitive.
2024-03-04 19:09:10 +01:00
Anton Popov
95611889dc fix tests 2024-03-01 18:44:33 +00:00
Anton Popov
3cdd3495fd
Merge pull request #60435 from CurtizJ/return-back-58140
Revert "Revert "Add table function `mergeTreeIndex`""
2024-02-28 00:52:44 +01:00
Anton Popov
d683977fe9 Revert "Revert "Add table function mergeTreeIndex""
This reverts commit 1e4199d704.
2024-02-26 22:47:39 +00:00
Alexander Tokmakov
1e4199d704
Revert "Add table function mergeTreeIndex" 2024-02-26 19:37:06 +01:00
HowePa
dbd8d35f01 use lower case in dict 2024-02-27 00:48:34 +08:00
Anton Popov
814cd53918
Merge pull request #58140 from CurtizJ/storage-merge-tree-index
Add table function `mergeTreeIndex`
2024-02-26 16:31:56 +01:00
Dmitry Novik
b5b7e02fd9
Merge branch 'master' into fix-analyzer-executable 2024-02-26 16:21:53 +01:00
HowePa
ea89fa0de9 replace to checkFormatName 2024-02-26 23:07:50 +08:00
HowePa
5fffe2508c update error message 2024-02-26 10:01:24 +08:00
HowePa
17f60b54cb single arg merge table func 2024-02-24 08:02:13 +08:00
Yakov Olkhovskiy
ef44da04fd third argument should be skipped too 2024-02-22 23:59:29 +00:00
Alexander Tokmakov
ec0986af0b skip sanity checks on secondary create query 2024-02-20 21:59:28 +01:00
kssenii
e23b929e18 Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-02-19 19:55:47 +01:00
kssenii
2e9b6545b6 Fix 2024-02-19 19:53:38 +01:00
kssenii
0552f44f70 Fixes after merge with master, move some part of code to object storage 2024-02-19 16:43:49 +01:00
Anton Popov
0aa8dafe0a Merge remote-tracking branch 'upstream/master' into HEAD 2024-02-19 14:07:55 +00:00
Alexey Milovidov
232fe0dd1b Fix inconsistent formatting of SELECT ... FROM (EXPLAIN ...) 2024-02-18 05:38:34 +01:00
kssenii
1cccb3ccdf Merge remote-tracking branch 'origin/master' into use-iobject-storage-for-table-engines-1 2024-02-16 15:21:10 +01:00
Kruglov Pavel
4d6f167e0c
Merge pull request #59092 from Avogar/auto-format-detection
Try to detect file format automatically during schema inference if it's unknown
2024-02-16 14:32:18 +01:00
kssenii
7577257df5 Fix cluster functions 2024-02-14 17:29:03 +01:00
kssenii
84b0fe670a Refactor data lakes 2024-02-14 15:50:43 +01:00
Alexey Milovidov
2b4949bd18 Cleanups 2024-02-14 00:21:13 +01:00
Kruglov Pavel
1dbfeafb42
Merge branch 'master' into auto-format-detection 2024-02-13 19:08:33 +01:00
kssenii
6d91d92601 Better 2024-02-12 20:22:24 +01:00
kssenii
3cca841038 Unite s3/hdfs/azure storage implementations into a single class on top of IObjectStorage 2024-02-09 21:32:04 +01:00
divanik
c8af01ceae Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/generate_series_function 2024-02-09 14:17:48 +00:00
divanik
79f9100353 To pull 2024-02-09 14:17:25 +00:00
divanik
623b425745 Add feature with the right author name 2024-02-06 21:34:09 +00:00
Daniil Ivanik
f91feb0dcb Initial working commit 2024-01-30 14:17:11 +01:00
Smita Kulkarni
3183026521 Merge branch 'master' into Azure_backup 2024-01-29 11:08:13 +01:00
Kruglov Pavel
46a6b84a5a
Merge branch 'master' into auto-format-detection 2024-01-25 22:11:07 +01:00
Maksim Kita
2a327107b6 Updated implementation 2024-01-25 14:31:49 +03:00
Kseniia Sumarokova
951c874aa9
Merge pull request #59080 from ClickHouse/data-lakes-survive-restart
Allow server to start with broken data lake table and fix itself lazily
2024-01-25 11:50:16 +01:00
avogar
11f1ea50d7 Fix tests 2024-01-24 17:55:31 +00:00
Smita Kulkarni
4d92eba316 Merge branch 'master' into Azure_backup 2024-01-24 11:13:57 +01:00
avogar
617cc514b7 Try to detect file format automatically during schema inference if it's unknown 2024-01-23 18:59:39 +00:00
Anton Popov
bceda4cd29 Merge remote-tracking branch 'upstream/master' into HEAD 2024-01-23 14:03:34 +00:00
kssenii
bca73d4b0a Fix 2024-01-23 11:51:21 +01:00
kssenii
1aa8e62bb7 Fix 2024-01-22 18:26:44 +01:00
Michael Kolupaev
fd361273f0 Fix StorageURL forgetting headers on server restart 2024-01-19 11:35:12 -08:00
Smita Kulkarni
2ee6893312 Updated to return container for getObjectsNamespace 2024-01-05 10:58:04 +01:00
Anton Popov
482e01dea3 add docs 2023-12-28 17:36:56 +00:00
Anton Popov
e2905fcbe0 better marks of subcolumns and more tests 2023-12-27 17:43:25 +00:00
Anton Popov
57d61a7bc1 add table function 'mergeTreeIndex' 2023-12-21 22:05:53 +00:00
Kruglov Pavel
ca7001d70f
Merge pull request #57850 from shanielh/feature/s3-session-token
Feature/s3 session token
2023-12-20 17:22:09 +01:00
Shani Elharrar
679a0e1300 StorageS3 / TableFunctionS3: Allow passing session_token to AuthSettings
This can help users that want to pass temporary credentials that
issued by AWS in order to load data from S3 without changing
configuration or creating an IAM User.

Fixes #57848
2023-12-19 08:06:36 +02:00
Nikita Mikhaylov
6360b76792 Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-18 21:49:31 +00:00
Alexey Milovidov
69e6e59e96 Add a test for #49708 2023-12-18 08:34:53 +01:00
Nikita Mikhaylov
c979124cfe Merge branch 'master' of github.com:ClickHouse/ClickHouse into remove-the-limit-for-connections-per-endpoint 2023-12-08 16:25:02 +00:00
Vitaly Baranov
252de64af3
Merge pull request #57362 from aiven-sal/aiven-sal/dict_fix
Prevent dictionary's ACL bypass via dictionary() table function
2023-12-08 14:09:40 +01:00
Nikita Mikhaylov
04d167c6d9 Better 2023-12-05 13:34:37 +01:00
JackyWoo
8a68d51261
Add index to table system.numbers (#50909) 2023-12-01 19:59:25 +01:00
zvonand
c329e382ab resolve conflicts 2023-11-29 16:03:07 +01:00
Kruglov Pavel
30148972ed
Merge pull request #57328 from Avogar/size-virtual-column-table-functions
Add information about new _size virtual column in file/s3/url/hdfs/azure table functions
2023-11-29 15:05:28 +01:00
Salvatore Mesoraca
223db31cb6
Prevent dictionary ACL bypass via dictionary table function 2023-11-29 14:40:29 +01:00
Robert Schulze
7d26990752
Follow-up to #56490: Fix build with -DENABLE_LIBRARIES=0 2023-11-28 19:59:43 +00:00
avogar
4d9a1b50f9 Add information about new _size virtual column in file/s3/url/hdfs/azure table functions 2023-11-28 18:15:07 +00:00
zvonand
c306d21b54 merge master + resolve conflicts 2023-11-28 15:51:21 +01:00
Ubuntu
a85cf758b0 Fuzz JSON table function
Create a table function `fuzzJSON`

An example query:
```
CREATE NAMED COLLECTION json_fuzzer AS json_str={};

SELECT *
FROM fuzzJSON(json_fuzzer, json_str = '{"students" : ["Alice", "Bob"]}', random_seed = 666, max_output_length = 128, probability = 0.9)
LIMIT 3

Query id: 7f802052-efb0-41b4-87fa-03b7dd290e9d

┌─json──────────────────────────────────────────────────────────────────────────────────┐
│ {"ade0yX":[9200406572736542991, true, "sm"]}                                          │
│ {"students":["Alice", "eSN3WO#a6NYTBe0$#OWwyIQ"], "cVoP2BuQugQ":17384271928263249403} │
│ {"students":["Alice", "Bob", "T+-k4+PJGkL%XRRaF2BoeN@&A"]}                            │
└───────────────────────────────────────────────────────────────────────────────────────┘
```

Next step:
* Generate invalid string

Fixes #35962

add Object('json')

use named collection
2023-11-28 01:58:24 +00:00
zvonand
5153798aeb Introduced fileCluster table function
Added fileCluster function
Added test and docs
2023-11-22 15:06:04 +01:00
Alexey Milovidov
7a44e2f478 Miscellaneous 2023-11-10 05:36:44 +01:00
Alexey Milovidov
60a9974adc Fix build 2023-11-10 05:34:29 +01:00
Alexey Milovidov
cc39484f7f Merge branch 'master' into system-symbols 2023-11-09 23:05:55 +01:00
MikhailBurdukov
c391527c86
Select from system tables when table based on table function. (#55540)
* Select system tables from table function

* disable test in fasttest

* update test

* Using cached_columns in table_functions

* Review changes

* Fix
2023-11-09 16:50:10 +01:00
Alexey Milovidov
42b816342e Fix tidy 2023-11-07 00:09:59 +01:00
Alexey Milovidov
1c318891b8 Remove useless header files 2023-11-06 04:33:23 +01:00
avogar
f87938735a Fixes and improvements for Iceberg storage 2023-10-17 11:07:37 +00:00
Priyansh Agrawal
2562f66efd
Fix typo in TableFunctionS3.cpp 2023-10-07 00:55:08 +01:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
robot-clickhouse
1c8ee76ba2
Merge pull request #54513 from Avogar/formats-with-names-no-header
Fix possible parsing error in WithNames formats with disabled input_format_with_names_use_header
2023-09-12 17:58:03 +02:00
avogar
2d8f33bfa2 Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header 2023-09-11 14:55:37 +00:00
avogar
c6ef811b82 Fix tests 2023-09-07 11:05:06 +00:00
avogar
ab101eaff8 Fix possible error 'URI contains invalid characters' in s3 table function 2023-09-06 18:21:24 +00:00
Antonio Andelic
5a0c2ca108 Merge branch 'master' into archive-improvements-2 2023-08-28 08:34:42 +00:00
Antonio Andelic
8e1d38d377 Merge branch 'master' into archive-improvements-2 2023-08-24 13:03:36 +00:00
Antonio Andelic
83d4b819f3 Better support for reading from archives 2023-08-23 08:10:30 +00:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Amos Bird
076a67bdaa
Consistent file management in CMake 2023-08-21 11:45:08 +08:00
Kseniia Sumarokova
47cccee657
Merge branch 'master' into working 2023-08-09 11:35:14 +02:00
Kseniia Sumarokova
11b5a3dd22
Update TableFunctionRemote.cpp 2023-08-07 11:46:14 +02:00
SmitaRKulkarni
75f81bdc44
Merge pull request #50795 from ClickHouse/azure_table_function_cluster
Table function azureBlobStorageCluster
2023-08-07 09:16:52 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Jiyoung Yoo
608b5ace36 Additional fix for issue#40220 2023-08-05 12:17:53 -07:00
Jiyoung Yoo
da2cb99c12 Fix for issue #40220
improve error message for table function remote
2023-08-05 12:17:53 -07:00
Alexey Milovidov
e6c3224dfd
Merge pull request #50848 from LiuYangkuan/issue_#50808
Allow using cluster, clusterAllReplicas, remote, and remoteSecure without table name
2023-08-04 23:56:05 +03:00
SmitaRKulkarni
1e3ae89161
Merge branch 'master' into azure_table_function_cluster 2023-08-04 21:39:32 +02:00
Antonio Andelic
8e7eb7f3fa Fix tests 2023-08-04 08:59:55 +00:00
Smita Kulkarni
2a681f1577 Removed unused function and fixed build after merge 2023-08-03 14:32:03 +02:00
Alexey Milovidov
dbf14b5e2d Fix wrong error code "BAD_GET" 2023-08-02 23:16:06 +02:00
Alexey Milovidov
bffe3a314e
Merge branch 'master' into issue_#50808 2023-08-03 00:06:06 +03:00
Alexey Milovidov
3f4faeab0b
Update TableFunctionRemote.cpp 2023-08-03 00:05:56 +03:00
Smita Kulkarni
2c47679918 Merge branch 'master' into azure_table_function_cluster 2023-08-02 14:19:45 +02:00