Commit Graph

79087 Commits

Author SHA1 Message Date
Jakub Kuklis
b41ab197e8 Blob Storage endpoint url verification using re2 2021-12-10 22:04:37 +01:00
Jakub Kuklis
63ec8d4244 Adding multipart upload to WriteBuffer, retries in ReadBuffer, additional settings for buffers 2021-12-10 22:04:37 +01:00
Jakub Kuklis
02060791e3 Adding settings getter and applyNewSettings 2021-12-10 22:04:37 +01:00
Jakub Kuklis
3f28f2c62b Enabling local cache for DiskBlobStorage 2021-12-10 22:04:37 +01:00
Jakub Kuklis
e3daf8aa49 Increase default thread pool size 2021-12-10 22:04:37 +01:00
Jakub Kuklis
dbb98e3636 Code cleanup, leaving some debug information printing under #ifdef VERBOSE_DEBUG_MODE 2021-12-10 22:04:37 +01:00
Jakub Kuklis
8230f8039c Two column MergeTree table with Blob Storage disk work! Fixed buffer in ReadBufferFromBlobStorage to be permanent (class attribute) 2021-12-10 22:04:37 +01:00
Jakub Kuklis
2b4d3665ab Basic inserts and selects work for a MergeTree table with a Blob Disk, based on a single column table 2021-12-10 22:04:37 +01:00
Jakub Kuklis
4b51ddee1b Initial check with write and read works for the Blob Storage Disk 2021-12-10 22:04:37 +01:00
Youenn Lebras
bf4fca0351 Fix compilation issues with Azure in order to follow the main git and not a patched one. 2021-12-10 22:04:37 +01:00
Jakub Kuklis
4ddc3abfe3 Patch for fixing warnings triggered by Azure SDK, cd to contrib/azure and use 'git apply ../azure-cmake/azure_patch 2021-12-10 22:04:37 +01:00
Jakub Kuklis
c6412f24d8 Add azure-sdk-for-cpp as submodule in contrib/azure, linking the main repo here instead of a fork, needs to be updated eventually according to https://clickhouse.com/docs/en/development/contrib/#adding-third-party-libraries 2021-12-10 22:04:37 +01:00
Jakub Kuklis
03f85dee41 Managed to read markers file in SELECT, getting error for CODEC version now 2021-12-10 22:04:37 +01:00
Jakub Kuklis
482a10e62e Uploading to Blob Storage on INSERT seems to do something reasonable 2021-12-10 22:04:37 +01:00
Jakub Kuklis
c43b90c58c Progressing with WriteBufferFromBlobStorage 2021-12-10 22:04:37 +01:00
Jakub Kuklis
fb4c1d6686 Starting insertion pipeline 2021-12-10 22:04:37 +01:00
Jakub Kuklis
6436f5b04d Adding an authenticated client to DiskBlobStorage 2021-12-10 22:04:37 +01:00
Jakub Kuklis
ee1a568919 The following query passes without erors: CREATE TABLE ... ENGINE = MergeTree ... storage_policy = 'blob_storage', debug constants present in the code 2021-12-10 22:04:37 +01:00
Jakub Kuklis
cacdac7ba6 Moving implementation to the .cpp file 2021-12-10 22:04:37 +01:00
Jakub Kuklis
4f506c4fc6 Forgot about commiting this file 2021-12-10 22:04:37 +01:00
Jakub Kuklis
88b5feb59d Registering the Blob Storage Disk 2021-12-10 22:04:36 +01:00
Jakub Kuklis
20dda7f666 Giving Disk Blob Storage files proper names 2021-12-10 22:04:36 +01:00
Jakub Kuklis
0cf338e165 Skeleton for DiskBlobStorage 2021-12-10 22:04:36 +01:00
Jakub Kuklis
43f420cba8 Adding a flag to use Azure Blob Storage 2021-12-10 22:04:36 +01:00
Jakub Kuklis
ec4d2a9e03 Removing unused file 2021-12-10 22:04:36 +01:00
Jakub Kuklis
4711be1ab7 Cleaning azure-cmake CMakeLists.txt 2021-12-10 22:04:36 +01:00
Jakub Kuklis
81361640b9 Using internal curl library 2021-12-10 22:04:36 +01:00
Jakub Kuklis
162e2b334b Initial working example of Azure Blob Storage manipulation from within ClickHouse 2021-12-10 22:04:36 +01:00
Vitaly Baranov
b5b195f4e2
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-10 23:22:35 +03:00
Vitaly Baranov
82c2d8dd2c Add synchronization to ProtobufSchemas. 2021-12-10 23:18:47 +03:00
Alexey
750f2cc73b spelling 2021-12-10 20:18:08 +00:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
alesapin
5a542516e6
Merge pull request #32515 from ClickHouse/revert-32514-revert-32496-smaller_checks
Revert "Revert "Split long tests into multiple checks""
2021-12-10 22:30:04 +03:00
Azat Khuzhin
837ff82312 Suppress UBSan errors for avg() function
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/dd2ccd3b17e7c59ed9c8184f00f8dae85ee87d1f/fuzzer_astfuzzerubsan,actions//report.html
2021-12-10 22:23:39 +03:00
Azat Khuzhin
fa6090f588 Fix processing initial table (--table/stdin) in clickhouse-local
This patch will:
- fix the issue when table had been tried to create multiple times for
  --queries-files
- create these table for --interactive mode (before it works only if you
  had some queries already, i.e. when it run interactive after
  non-interactive)

This will also make ClientBase interface a little bit cleaner, by
removing one abstract method getQueryTextPrefix()
2021-12-10 22:08:03 +03:00
Kseniia Sumarokova
1865e37109
Merge pull request #32498 from Vxider/rename-window-view-functions
Rename window-view function to time window function
2021-12-10 22:07:53 +03:00
Kseniia Sumarokova
2cd5a15193
Update docker_compose_mongo.yml 2021-12-10 22:02:28 +03:00
Kseniia Sumarokova
fcce952434
Merge pull request #32416 from kssenii/update-mongo-contrb
Update mongodb in contrib
2021-12-10 22:00:01 +03:00
Azat Khuzhin
b1bc5c37c9 tests: split sum_ubsan into avg_ubsan 2021-12-10 21:51:43 +03:00
Azat Khuzhin
2045a4f245 clickhouse-test: use basename of the test for *.sh tests 2021-12-10 21:45:29 +03:00
Kruglov Pavel
764e205d36
Fix resetParser in MsgPack format 2021-12-10 21:37:08 +03:00
Christoph Wurm
3e5a6c8730 Add sections to Distributed documentation. 2021-12-10 18:29:15 +00:00
Vitaly Baranov
bef0cd259d
Merge pull request #31407 from lehasm/alexey-sm-DOCSUP-13314-document-GRPC
DOCSUP-13314: document GRPC protocol support
2021-12-10 21:21:42 +03:00
Vitaly Baranov
73092942ea Take into account nested structures while filling missing columns while reading protobuf. 2021-12-10 21:11:06 +03:00
vxider
8e3529818e update window view tests 2021-12-10 18:01:54 +00:00
avogar
1be84d80d4 Fix async inserts for some input formats 2021-12-10 20:54:08 +03:00
alesapin
9af044ad77
Update main.yml 2021-12-10 20:14:31 +03:00
tavplubix
5079134ffd
Update run.sh 2021-12-10 20:10:49 +03:00
Alexander Tokmakov
254d6c5d59 fix 2021-12-10 20:07:28 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00