Commit Graph

123392 Commits

Author SHA1 Message Date
alesapin
415b3826e0 Add event for tracking data parts lock 2023-08-24 15:28:38 +02:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749)
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
2023-08-24 16:07:26 +03:00
Alexander Tokmakov
8555250277
Merge pull request #53795 from ClickHouse/revert-53641-feat_53602
Revert "dateDiff: add support for plural units."
2023-08-24 15:37:28 +03:00
Alexander Tokmakov
59efbe4163
Revert "dateDiff: add support for plural units." 2023-08-24 15:35:18 +03:00
Anton Popov
19a52f19f1
Merge pull request #53547 from joelynch/shutdown-async-insert-queue-first
bugfix: Flush async insert queue first on shutdown
2023-08-24 13:59:12 +02:00
Kseniia Sumarokova
b12881b5da Fix after merge 2023-08-24 13:43:15 +02:00
Robert Schulze
8365a3623c
Force-enable analyzer 2023-08-24 10:53:41 +00:00
Robert Schulze
8c9fade58c
Merge remote-tracking branch 'rschu1ze/master' into skip_idx_bug_fix 2023-08-24 10:17:34 +00:00
Kseniia Sumarokova
a4f39fe134
Merge branch 'master' into fix-cache-logical-error 2023-08-24 12:00:18 +02:00
Alexander Tokmakov
e67c002cb0
Merge pull request #53782 from ClickHouse/revert-52762-planner-prepare-filters-for-analysis
Revert "Planner prepare filters for analysis"
2023-08-24 12:55:33 +03:00
Robert Schulze
2f31a2a568
Merge pull request #53764 from rschu1ze/parseDateTime-goes-booooom
Fix fuzzer crash in parseDateTime()
2023-08-24 11:54:23 +02:00
Alexander Tokmakov
011c7f7064
Revert "Planner prepare filters for analysis" 2023-08-24 12:52:03 +03:00
Kseniia Sumarokova
4caa60e642
Update test.py 2023-08-24 11:50:56 +02:00
Kseniia Sumarokova
4d2efd87b5
Merge pull request #53736 from kssenii/fix-s3-queue-test
Fix flaky test_storage_s3_queue/test.py::test_delete_after_processing
2023-08-24 11:47:56 +02:00
kssenii
3917e6400d Merge remote-tracking branch 'upstream/master' into add-some-metrics-for-cache 2023-08-24 11:44:16 +02:00
Kseniia Sumarokova
187706558a
Merge pull request #51622 from kssenii/system-sync-cache
Add `system sync filesystem cache` command
2023-08-24 11:42:32 +02:00
Mikhail Koviazin
a5eb1aa22f
Added functions array{Rotate,Shift}{Left,Right}
Fixes #52755 and #52895
2023-08-24 09:16:39 +00:00
robot-clickhouse-ci-2
28c5725714
Merge pull request #53612 from selfuppen/master
[doc/zh]: translate the last two parts of sparse-primary-index Chinese doc
2023-08-24 10:14:54 +02:00
selfuppen
d1d7f8ad26 [doc/zh]: apply all suggestions from code review 2023-08-24 14:31:20 +08:00
Selfuppen
c673bac0fe
Merge branch 'ClickHouse:master' into master 2023-08-24 11:29:22 +08:00
avogar
ecb0e9844c Disable cache in perf test 2023-08-23 21:01:18 +00:00
Kruglov Pavel
685ffc5856
Fix style 2023-08-23 22:51:14 +02:00
Mikhail f. Shiryaev
976c371c9a
Merge pull request #53762 from ClickHouse/reduce-get-parameter-calls
Reduce API calls to SSM client
2023-08-23 22:51:06 +02:00
Kruglov Pavel
f7e1abd774
Merge branch 'master' into cache-count 2023-08-23 22:31:49 +02:00
Kruglov Pavel
3404efcb21
Fix style 2023-08-23 22:20:14 +02:00
Kruglov Pavel
063c986680
Merge pull request #53637 from Avogar/fast-count-from-files
Optimize count from files in most input formats
2023-08-23 22:17:29 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client 2023-08-23 22:15:44 +02:00
Robert Schulze
7f534716ff
Fix fuzzer crash in parseDateTime() 2023-08-23 20:08:27 +00:00
avogar
54bb21be29 Fix test 2023-08-23 18:44:30 +00:00
avogar
894513f6cd Fix tests 2023-08-23 18:43:08 +00:00
Alexey Milovidov
5355c6fa18
Merge pull request #53758 from HarryLeeIBM/hlee-s390x-qpl
Fix QPL functional test for s390x
2023-08-23 20:50:50 +03:00
HarryLeeIBM
a029035296 Fix QPL functional test for s390x 2023-08-23 10:46:26 -07:00
Nikolai Kochetov
3a4a7d70a2
Merge pull request #52762 from kitaisreal/planner-prepare-filters-for-analysis
Planner prepare filters for analysis
2023-08-23 18:59:43 +02:00
Robert Schulze
9766d98fec
Merge remote-tracking branch 'rschu1ze/master' into boost-1.81 2023-08-23 16:05:42 +00:00
Alexey Milovidov
d475dc424e
Merge pull request #53701 from ClibMouse/feature/qemu-s390x-docs
Update s390x VSCode environment setup
2023-08-23 18:29:45 +03:00
Raúl Marín
93dac0c880 Support clang-18 (Wmissing-field-initializers) 2023-08-23 15:53:45 +02:00
Smita Kulkarni
262c39329b Updated to retry loading parts for azure TransportException 2023-08-23 15:50:11 +02:00
Smita Kulkarni
1a074ecf93 Updated to not mark part as broken for azure TransportException in loadDataPart 2023-08-23 15:33:01 +02:00
ltrk2
c2559026c4 Extend aspell dictionary 2023-08-23 06:22:11 -07:00
Smita Kulkarni
7fdf90ccf1 Added azure TransportException to retryable errors 2023-08-23 15:21:37 +02:00
avogar
68e3af56d4 Address comments 2023-08-23 13:19:15 +00:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Kruglov Pavel
7e362a2110
Merge branch 'master' into fast-count-from-files 2023-08-23 15:13:20 +02:00
Joe Lynch
075c0261e9
These queries need to be run in the same session 2023-08-23 15:00:00 +02:00
Joe Lynch
8d0824f1b8
Add test for flushing async insert queue 2023-08-23 15:00:00 +02:00
Joe Lynch
192c3ddb2d
Flush async insert queue first on shutdown
Fixes bug where on graceful shutdown the database catalog is shutdown
before queries in the async insert queue run, causing all the
queries to fail and data to be lost.
2023-08-23 15:00:00 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
Robert Schulze
b4dbde89aa
Fix expected results 2023-08-23 12:44:21 +00:00
Robert Schulze
a093f519fc
Merge remote-tracking branch 'rschu1ze/master' into skip_idx_bug_fix 2023-08-23 12:37:46 +00:00
Robert Schulze
5dec6f19f3
Merge pull request #51325 from xinhuitian/fix-annoy-index-update
Do not reset Annoy index during build-up with > 1 mark
2023-08-23 14:31:06 +02:00