Commit Graph

123263 Commits

Author SHA1 Message Date
Kseniia Sumarokova
4239154b44
Follow-up to #53611 2023-08-24 16:15:04 +02:00
Kruglov Pavel
cd3433f95a
Merge pull request #53407 from Avogar/tsv-single-carriage-return
Fix processing single carriage return in TSV file segmentation engine
2023-08-24 16:06:05 +02:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749)
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
2023-08-24 16:07:26 +03:00
Alexander Tokmakov
8555250277
Merge pull request #53795 from ClickHouse/revert-53641-feat_53602
Revert "dateDiff: add support for plural units."
2023-08-24 15:37:28 +03:00
Alexander Tokmakov
59efbe4163
Revert "dateDiff: add support for plural units." 2023-08-24 15:35:18 +03:00
Anton Popov
19a52f19f1
Merge pull request #53547 from joelynch/shutdown-async-insert-queue-first
bugfix: Flush async insert queue first on shutdown
2023-08-24 13:59:12 +02:00
Alexander Tokmakov
e67c002cb0
Merge pull request #53782 from ClickHouse/revert-52762-planner-prepare-filters-for-analysis
Revert "Planner prepare filters for analysis"
2023-08-24 12:55:33 +03:00
Robert Schulze
2f31a2a568
Merge pull request #53764 from rschu1ze/parseDateTime-goes-booooom
Fix fuzzer crash in parseDateTime()
2023-08-24 11:54:23 +02:00
Alexander Tokmakov
011c7f7064
Revert "Planner prepare filters for analysis" 2023-08-24 12:52:03 +03:00
Kseniia Sumarokova
4d2efd87b5
Merge pull request #53736 from kssenii/fix-s3-queue-test
Fix flaky test_storage_s3_queue/test.py::test_delete_after_processing
2023-08-24 11:47:56 +02:00
Kseniia Sumarokova
187706558a
Merge pull request #51622 from kssenii/system-sync-cache
Add `system sync filesystem cache` command
2023-08-24 11:42:32 +02:00
robot-clickhouse-ci-2
28c5725714
Merge pull request #53612 from selfuppen/master
[doc/zh]: translate the last two parts of sparse-primary-index Chinese doc
2023-08-24 10:14:54 +02:00
selfuppen
d1d7f8ad26 [doc/zh]: apply all suggestions from code review 2023-08-24 14:31:20 +08:00
Selfuppen
c673bac0fe
Merge branch 'ClickHouse:master' into master 2023-08-24 11:29:22 +08:00
Mikhail f. Shiryaev
976c371c9a
Merge pull request #53762 from ClickHouse/reduce-get-parameter-calls
Reduce API calls to SSM client
2023-08-23 22:51:06 +02:00
Kruglov Pavel
063c986680
Merge pull request #53637 from Avogar/fast-count-from-files
Optimize count from files in most input formats
2023-08-23 22:17:29 +02:00
Mikhail f. Shiryaev
0b9e7fa9c5
Reduce API calls to SSM client 2023-08-23 22:15:44 +02:00
Robert Schulze
7f534716ff
Fix fuzzer crash in parseDateTime() 2023-08-23 20:08:27 +00:00
Alexey Milovidov
5355c6fa18
Merge pull request #53758 from HarryLeeIBM/hlee-s390x-qpl
Fix QPL functional test for s390x
2023-08-23 20:50:50 +03:00
HarryLeeIBM
a029035296 Fix QPL functional test for s390x 2023-08-23 10:46:26 -07:00
Nikolai Kochetov
3a4a7d70a2
Merge pull request #52762 from kitaisreal/planner-prepare-filters-for-analysis
Planner prepare filters for analysis
2023-08-23 18:59:43 +02:00
Alexey Milovidov
d475dc424e
Merge pull request #53701 from ClibMouse/feature/qemu-s390x-docs
Update s390x VSCode environment setup
2023-08-23 18:29:45 +03:00
ltrk2
c2559026c4 Extend aspell dictionary 2023-08-23 06:22:11 -07:00
avogar
68e3af56d4 Address comments 2023-08-23 13:19:15 +00:00
Kruglov Pavel
7e362a2110
Merge branch 'master' into fast-count-from-files 2023-08-23 15:13:20 +02:00
Joe Lynch
075c0261e9
These queries need to be run in the same session 2023-08-23 15:00:00 +02:00
Joe Lynch
8d0824f1b8
Add test for flushing async insert queue 2023-08-23 15:00:00 +02:00
Joe Lynch
192c3ddb2d
Flush async insert queue first on shutdown
Fixes bug where on graceful shutdown the database catalog is shutdown
before queries in the async insert queue run, causing all the
queries to fail and data to be lost.
2023-08-23 15:00:00 +02:00
Robert Schulze
bea651e828
Merge pull request #53657 from rschu1ze/cache-improvements
Expose more settings from caches
2023-08-23 14:58:45 +02:00
Robert Schulze
5dec6f19f3
Merge pull request #51325 from xinhuitian/fix-annoy-index-update
Do not reset Annoy index during build-up with > 1 mark
2023-08-23 14:31:06 +02:00
robot-ch-test-poll1
c22ffa6195
Merge pull request #53529 from Avogar/filter-files-all-table-functions
Use filter by file/path before reading in url/file/hdfs table functins
2023-08-23 14:21:23 +02:00
kssenii
5d5cfa36db Merge remote-tracking branch 'upstream/master' into fix-s3-queue-test 2023-08-23 13:18:39 +02:00
kssenii
c8a12f798e Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-23 13:15:47 +02:00
Nikolai Kochetov
6d6d5f5878
Merge pull request #53738 from ClickHouse/fix-02862_sorted_distinct_sparse_fix
Fix broken `02862_sorted_distinct_sparse_fix`
2023-08-23 12:28:47 +02:00
Kruglov Pavel
fee323b122
Update src/Processors/Formats/IRowInputFormat.h
Co-authored-by: Michael Kolupaev <michael.kolupaev@clickhouse.com>
2023-08-23 12:15:47 +02:00
Kruglov Pavel
e193aec583
Merge branch 'master' into fast-count-from-files 2023-08-23 12:15:34 +02:00
Selfuppen
0222170715
Merge branch 'ClickHouse:master' into master 2023-08-23 18:03:19 +08:00
Kruglov Pavel
3d03ac5768
Merge pull request #53348 from ucasfl/scalar
Forbid use_structure_from_insertion_table_in_table_functions when execute Scalar
2023-08-23 12:02:44 +02:00
Kruglov Pavel
8e6b8fc2d0
Merge pull request #53470 from KevinyhZou/bug_fix_json_query_path_numberic
Fix JSON_QUERY Function parse error while path is all number
2023-08-23 12:01:55 +02:00
kssenii
aa21fc58ce Fix style check 2023-08-23 11:48:08 +02:00
Antonio Andelic
240d29b188 Fix broken test 2023-08-23 09:46:17 +00:00
kssenii
c47f5ebcd9 Minor change 2023-08-23 11:46:14 +02:00
Alexey Milovidov
b884fdb867
Merge pull request #53641 from irenjj/feat_53602
dateDiff: add support for plural units.
2023-08-23 12:45:35 +03:00
kssenii
325e2d3172 Merge remote-tracking branch 'upstream/master' into system-sync-cache 2023-08-23 11:44:19 +02:00
Alexey Milovidov
fdfefe58f3
Merge pull request #53650 from ClibMouse/feature/more-aggregate-functions-on-big-endian
Implement support for more aggregate functions on big-endian
2023-08-23 12:35:11 +03:00
Alexey Milovidov
6f515e8c52
Merge pull request #53648 from HarryLeeIBM/hlee-s390-mem-test
Fix memory usage functional test for s390x
2023-08-23 12:34:45 +03:00
kssenii
27b559bcda Fxi 2023-08-23 11:34:34 +02:00
Robert Schulze
ec8da30007
Merge pull request #53558 from rschu1ze/bump-openldap
Bump openldap to LTS version (v2.5.16)
2023-08-23 11:34:28 +02:00
Alexey Milovidov
07be40431c
Merge pull request #53678 from ClickHouse/helifu-master5
Resubmit #50171
2023-08-23 12:33:39 +03:00
Alexey Milovidov
8123508cca
Merge pull request #53695 from Algunenano/slow_on_client
Remove useless slow on client performance check
2023-08-23 12:33:14 +03:00