Commit Graph

854 Commits

Author SHA1 Message Date
Smita Kulkarni
2d0152e93d Fixed issue with named collection 2023-06-12 13:38:01 +02:00
Smita Kulkarni
95d447d81f Updated name to azureBlobStorageCluster 2023-06-12 10:10:09 +02:00
Smita Kulkarni
791a05af61 Merge branch 'master' into azure_table_function_cluster 2023-06-12 09:58:49 +02:00
JackyWoo
a1641aa25d
Merge branch 'master' into support_redis 2023-06-12 09:53:06 +08:00
Smita Kulkarni
a8b579a856 Rename azure_blob_storage to azureBlobStorage 2023-06-09 19:28:06 +02:00
pufit
55d228e78e
Merge branch 'master' into support_redis 2023-06-09 11:45:12 -04:00
Smita Kulkarni
590236030d Fixed cluster with distributed_processing 2023-06-09 15:17:08 +02:00
Smita Kulkarni
6328811097 Added first draft of azure blob storage cluster 2023-06-08 18:27:39 +02:00
Smita Kulkarni
d35573a206 Removed logs and small name fixes 2023-06-08 14:40:58 +02:00
Alexander Sapin
7d5b98f028 Remove logging add sleeps 2023-06-07 20:03:17 +02:00
serxa
2df0e0c669 Unify priorities for connections 2023-06-07 16:25:52 +00:00
Smita Kulkarni
99f0be8ef5 Refactored to StorageAzureBlob 2023-06-06 21:58:54 +02:00
alesapin
5637858182 Fix the most important check in the world 2023-06-06 21:06:45 +02:00
Smita Kulkarni
49b019b26d Refactored TableFunction name to TableFunctionAzureBlobStorage 2023-06-06 20:23:20 +02:00
Kruglov Pavel
b83b057045
Merge branch 'master' into renamefile 2023-06-06 19:38:05 +02:00
alesapin
454c23fecb Merge branch 'azure_table_function' of github.com:ClickHouse/ClickHouse into azure_table_function 2023-06-06 19:34:22 +02:00
alesapin
7100bc5152 Fixes for azure table function 2023-06-06 19:31:50 +02:00
Smita Kulkarni
b2db6b4789 Renamed to azure_blob_storage 2023-06-06 19:19:56 +02:00
alesapin
c910f0034b Some code for table function 2023-06-06 18:48:20 +02:00
Smita Kulkarni
cbe4ea67ae Removed unwanted code & debug lines 2023-06-06 16:42:56 +02:00
Smita Kulkarni
aa6f4e43c5 Fixed COLUMN_NOT_FOUND in block issue 2023-06-05 23:15:13 +02:00
Smita Kulkarni
dedb9067ce WIP : Azure Table Function, added read and StorageAzureSource 2023-06-05 20:36:17 +02:00
Kruglov Pavel
f87f98fb80
Merge pull request #47409 from Avogar/random-structure
Add new function generateRandomStructure
2023-06-02 18:50:35 +02:00
JackyWoo
b01db870d8 normalize redis table function db name 2023-06-02 10:05:54 +08:00
JackyWoo
bcf22c1ec7 fix code style 2023-06-02 10:05:54 +08:00
JackyWoo
f4f939162d new redis engine schema design 2023-06-02 10:05:54 +08:00
JackyWoo
8c822a7edf add tests to redis engine 2023-06-02 10:05:54 +08:00
JackyWoo
3c2b447472 move get configuration to RedisCommon 2023-06-02 10:05:54 +08:00
JackyWoo
ce203b5ce6 Check redis table structure 2023-06-02 10:05:54 +08:00
JackyWoo
9a495cbf99 Push down filter into Redis 2023-06-02 10:05:54 +08:00
JackyWoo
e91867373c Add table function Redis 2023-06-02 10:05:54 +08:00
JackyWoo
7398b22fa5 Add redis storage 2023-06-02 10:05:54 +08:00
nikitakeba
f604fb82b2
Merge branch 'master' into add-reading-from-archives-support 2023-05-29 23:34:19 +03:00
alekseygolub
63225b37a2
Merge branch 'ClickHouse:master' into renamefile 2023-05-29 16:52:41 +03:00
Nikita Keba
564691e25b add reading from archives 2023-05-25 00:00:32 +00:00
alekseygolub
c37b420045
Merge branch 'ClickHouse:master' into renamefile 2023-05-24 09:51:07 +03:00
avogar
4f85d6a1bb Merge branch 'master' of github.com:ClickHouse/ClickHouse into random-structure 2023-05-22 19:43:24 +00:00
avogar
88e4c93abc Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-22 19:19:57 +00:00
Nikolay Degterinsky
7bed59e1d2
Merge pull request #50000 from evillique/add-schema-inference
Add schema inference to more table engines
2023-05-22 17:24:30 +02:00
alekseygolub
c85c3afa1f Added option to rename files, loaded via TableFunctionFile, after success processing 2023-05-19 16:03:22 +00:00
Nikolay Degterinsky
ef45956713 Fix style 2023-05-19 01:31:45 +00:00
Nikolay Degterinsky
b8be714830 Add schema inference to more table engines 2023-05-19 00:44:27 +00:00
Kruglov Pavel
9dbe9507e7
Fix style 2023-05-16 12:55:20 +02:00
avogar
a3dfa40eab Fix 2023-05-16 10:07:21 +00:00
avogar
334f062fa0 fix style 2023-05-15 16:39:26 +00:00
avogar
f9e0eb47d7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-15 16:35:24 +00:00
Kruglov Pavel
550d7a01bc
Try to fix build 2023-05-15 17:55:02 +02:00
Kruglov Pavel
a07db551a7
Fix style 2023-05-15 13:46:36 +02:00
avogar
602b9a740e Make better, allow generateRandom without structure argument 2023-05-12 19:39:33 +00:00
avogar
93dd3a8ec9 Remove not used cpp file 2023-05-12 14:03:37 +00:00
avogar
70a8fd2c50 Fix schema inference with named collection, refactor Cluster table functions 2023-05-12 13:58:45 +00:00
Han Fei
07341a04fd
Merge pull request #49666 from hanfei1991/hanfei/regexp-dict-read
Support `dictionary` table function for `RegExpTreeDictionary`
2023-05-12 11:40:46 +02:00
avogar
3ee8de792c Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-05-11 12:46:20 +00:00
avogar
9096f62efc Merge branch 'master' of github.com:ClickHouse/ClickHouse into random-structure 2023-05-10 18:46:19 +00:00
Han Fei
2273884ded address comments 2023-05-10 17:42:08 +02:00
Han Fei
72fc567d4a
Merge branch 'master' into hanfei/regexp-dict-read 2023-05-08 16:20:12 +02:00
Han Fei
92e57817a2 Support dictionary table function for RegExpTreeDictionary 2023-05-08 16:14:08 +02:00
Robert Schulze
4529511799
Fix table function docs 2023-05-06 15:01:24 +00:00
Robert Schulze
45c28e1221
Introduce more fields for in-source function documentation 2023-05-05 21:30:21 +00:00
Alexey Milovidov
965956ad55
Merge pull request #47815 from jkaflik/add-gcs-table-function
Add Google Cloud Storage S3 compatible table function
2023-05-05 23:18:58 +03:00
Nikolay Degterinsky
7a727bbbe3
Merge pull request #49520 from IvanTakarlikov-st/it-grammar-fixes
Fix some grammar mistakes in documentation, code and tests
2023-05-05 15:45:58 +02:00
Kuba Kaflik
8a6084abd4 Fix syntax error for TableFunctionS3 2023-05-05 12:41:30 +02:00
Kuba Kaflik
ec30b0f2be Add function inline documentation 2023-05-05 10:14:06 +02:00
Alexey Milovidov
ab1a1ea5b7
Merge pull request #49490 from ClickHouse/fix-s3cluster-with-headers
Correctly handle s3Cluster arguments
2023-05-05 05:31:23 +03:00
Ivan Takarlikov
8873856ce5 Fix some grammar mistakes in documentation, code and tests 2023-05-04 13:35:18 -03:00
Kuba Kaflik
0672d75f72
Merge branch 'master' into add-gcs-table-function 2023-05-04 16:00:33 +02:00
Antonio Andelic
8769ac2187 Correctly append arguments 2023-05-04 08:30:45 +00:00
Alexey Milovidov
5367206057
Update TableFunctionS3.h 2023-04-27 23:24:36 +03:00
Alexey Milovidov
064dea4483
Merge branch 'master' into add-gcs-table-function 2023-04-27 16:59:09 +03:00
Alexey Milovidov
aec8f17614
Update TableFunctionS3.cpp 2023-04-27 16:58:18 +03:00
Alexey Milovidov
30f1bef6e8
Update TableFunctionS3.h 2023-04-27 16:57:42 +03:00
Alexander Tokmakov
332a736a59 Merge branch 'master' into clusters_is_active_column 2023-04-24 15:54:03 +02:00
avogar
2949ceced1 Fix adding structure to cluster table functions, make it better 2023-04-24 13:20:04 +00:00
Nikolay Degterinsky
d8d1b65324
Merge pull request #48605 from evillique/fix-logical-error-executable
Fix LOGICAL_ERROR in executable table function
2023-04-22 09:41:49 +02:00
Nikolay Degterinsky
31c6127d15 Fix 2023-04-21 22:39:59 +00:00
avogar
447189a6ca Better 2023-04-21 17:54:09 +00:00
avogar
944f54aadf Finish urlCluster, refactor code, reduce code duplication 2023-04-21 17:24:37 +00:00
Nikolay Degterinsky
7f9ddcf2ea Fix 2023-04-21 17:19:12 +00:00
avogar
c949f0ebf5 Merge branch 'master' of github.com:ClickHouse/ClickHouse into urlCluster 2023-04-21 14:13:33 +02:00
Larry Luo
58ca460663 remove trailing spaces. 2023-04-18 05:31:11 -07:00
Larry Luo
b929547ab2 fix build without parquet 2023-04-17 21:37:32 -07:00
Alexey Milovidov
2f4189f39c
Merge branch 'master' into add-gcs-table-function 2023-04-16 00:28:47 +03:00
Nikolay Degterinsky
10362c28bf Better 2023-04-13 08:58:51 +00:00
Nikolay Degterinsky
ed6efc5c6c Fix LOGICAL_ERROR in executable table function 2023-04-10 15:22:45 +00:00
Alexander Tokmakov
9ec91acef3 add some columns to system.clusters 2023-04-07 18:26:23 +02:00
kssenii
9b3d0ec86d Adjustments after conflicts 2023-04-03 19:53:34 +02:00
Kuba Kaflik
6f99195f82
Merge branch 'master' into add-gcs-table-function 2023-04-03 09:53:25 +02:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
kssenii
539414554f Fix s3 2023-03-30 15:32:38 +02:00
Antonio Andelic
7b1ad221b2 Address PR comments 2023-03-29 11:08:44 +00:00
kssenii
1573790fe7 Better 2023-03-28 20:51:25 +02:00
kssenii
13f29a7242 Better 2023-03-28 18:57:24 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Antonio Andelic
160aa186bb Add support for NOSIGN keyword and no_sign_request config 2023-03-28 07:05:35 +00:00
kssenii
36cc6fee51 Rewrite data lakes (part 1) 2023-03-24 22:35:12 +01:00
Kuba Kaflik
576efc1da3 register GCP function in factory 2023-03-22 06:58:09 +01:00
Kuba Kaflik
1c8883b971
Merge branch 'master' into add-gcs-table-function 2023-03-21 13:47:03 +01:00
Kuba Kaflik
e6ddfc3486 Update GCS table function docs 2023-03-21 09:51:37 +01:00
Kuba Kaflik
0f039f8359 Add Google Cloud Storage S3 compatible table function 2023-03-21 09:09:57 +01:00
kssenii
bb0beb7449 Merge remote-tracking branch 'upstream/master' into named-collections-finish 2023-03-17 13:02:36 +01:00
Kruglov Pavel
721fa96c03
Merge branch 'master' into random-structure 2023-03-15 14:28:13 +01:00
Nikolai Kochetov
396e1b45a4
Merge pull request #47433 from ClickHouse/apply-settings-for-explain-earlier
Apply settings for EXPLAIN earlier (in the same way we do for SELECT).
2023-03-14 11:52:20 +01:00
Maksim Kita
0358cb36d8 Fixed tests 2023-03-11 11:51:54 +01:00
Nikolai Kochetov
815c5aa87e
Merge branch 'master' into apply-settings-for-explain-earlier 2023-03-10 21:19:07 +01:00
Nikolai Kochetov
d2c28fb555 Apply settings for explain subquery as well. 2023-03-10 18:29:13 +00:00
avogar
067bfb8844 Add new function generateRandomStructure 2023-03-09 17:47:14 +00:00
Han Fei
b7eef62458
Merge pull request #45491 from azat/dist/async-send-refactoring
[RFC] Rewrite distributed sends to avoid using filesystem as a queue, use in-memory queue instead
2023-03-06 12:32:33 +01:00
kssenii
8f2d75cef8 Fix tests 2023-03-05 12:56:00 +01:00
Kseniia Sumarokova
386663953c
Merge branch 'master' into named-collections-finish 2023-03-03 12:23:38 +01:00
kssenii
cd7cd0526b Fix tests 2023-03-02 21:21:04 +01:00
Maksim Kita
3cd88003dd
Merge pull request #47101 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
Analyzer Planner fixes before enable by default
2023-03-02 22:16:39 +03:00
Kseniia Sumarokova
09444eeea1
Merge pull request #47006 from ucasfl/null
Table function null default table structure
2023-03-02 13:43:16 +01:00
Maksim Kita
47ece846bc Fixed tests 2023-03-01 18:05:07 +01:00
kssenii
4716273349 Fix test 2023-03-01 13:37:05 +01:00
Azat Khuzhin
b5434eac3b Rename StorageDistributedDirectoryMonitor to DistributedAsyncInsertDirectoryQueue
Since #44922 it is not a directory monitor anymore.

v2: Remove unused error codes
v3: Contains some header fixes due to conflicts with master
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-02-28 22:33:36 +01:00
flynn
e19f2f3c5b fix 2023-02-28 13:07:19 +00:00
flynn
6481e304f1 fix 2023-02-28 12:30:07 +00:00
flynn
73427afe96 Table function null default table structure 2023-02-28 11:44:30 +00:00
kssenii
d4e6fc4546 Fix test 2023-02-27 21:43:45 +01:00
kssenii
ad88251ee7 Fix tests 2023-02-27 17:42:04 +01:00
avogar
12a9ff36b2 Better exception messages when schema_inference_hints is ill-formatted 2023-02-27 15:20:56 +00:00
kssenii
c2bcc4119f Better 2023-02-24 20:57:37 +01:00
kssenii
96b57c8a65 Better support for equal keys 2023-02-24 20:38:40 +01:00
kssenii
d372bf9e12 Fix test 2023-02-24 11:47:22 +01:00
kssenii
b15be14792 Fix table function remote 2023-02-21 18:55:43 +01:00
kssenii
68e06ecb99 Replace for table function remote, and external storage 2023-02-21 14:33:37 +01:00
kssenii
a54b011670 Finish for mysql 2023-02-20 21:37:38 +01:00
Alexey Milovidov
5359dcc014
Merge pull request #46554 from ucasfl/iceberg-fix
fix build without avro
2023-02-19 14:35:29 +03:00
Maksim Kita
6dffe52e68
Merge pull request #46471 from kitaisreal/analyzer-planner-fixes-before-enable-by-default
Analyzer planner fixes before enable by default
2023-02-19 13:49:18 +03:00
flynn
7b4fbf33b3 fix 2023-02-19 03:47:14 +00:00
flynn
830398f0bd fix build without avro
fix
2023-02-18 17:32:35 +00:00
Maksim Kita
cbd961de98 Fixed code review issues 2023-02-18 17:06:00 +01:00
flynn
eae73a1511 fix 2023-02-16 13:42:19 +00:00
flynn
7f4c23ec8a fix 2023-02-16 12:48:22 +00:00
Maksim Kita
cd3e8482ae Analyzer TableFunctionExplain fix 2023-02-16 12:17:02 +01:00
Maksim Kita
2830877e22 Analyzer support table functions 2023-02-16 12:17:02 +01:00
flynn
ecc39978d7 fix conflict 2023-02-16 02:23:55 +00:00
Kruglov Pavel
4f380370a9
Fix s3Cluster schema inference in parallel distributed insert select (#46381)
* Fix s3Cluster schema inference in parallel distributed insert select
* Try fix flaky test
* Try SYSTEM SYNC REPLICA to avoid test flakiness
2023-02-15 15:30:43 +01:00
flynn
18cf72147e remove more redundant header files 2023-02-15 07:02:44 +00:00
flynn
e4e3adf160 fix 2023-02-15 05:05:46 +00:00
flynn
f31451822e fix 2023-02-15 03:56:01 +00:00
flynn
e05b4e9745 fix conflict 2023-02-14 13:49:28 +00:00
Antonio Andelic
5ab24285fc Fix arg parsing 2023-02-14 08:33:59 +00:00
Antonio Andelic
3a6ea861d8 Extract common argument parsing logic 2023-02-13 12:27:49 +00:00
flynn
d3dd9421da refactor and get rid of s3 2023-02-13 08:29:22 +00:00
flynn
37a850bd36 Merge branch 'master' of github.com:ClickHouse/ClickHouse into iceberg 2023-02-10 08:47:14 +00:00
flynn
db15634a01 fix conflict 2023-02-10 08:41:04 +00:00
Robert Schulze
e490ec91d9
Merge branch 'master' into rs/fix-fragile-linking 2023-02-09 11:33:59 +01:00
Ilya Yatsishin
9f480b8fa2
Merge pull request #46132 from azat/file-fd-schema-inference 2023-02-08 23:23:32 +01:00
robot-clickhouse-ci-1
99274f1db1
Merge pull request #46143 from ClickHouse/evillique-patch-2
Interpret `cluster_name` identifier in `s3Cluster` function as literal
2023-02-08 14:06:16 +01:00