Commit Graph

7642 Commits

Author SHA1 Message Date
Raúl Marín
4703c463aa Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert 2023-08-31 14:37:02 +02:00
vdimir
d7dca71bee
Add fail point to cluster discovery initialization 2023-08-31 11:45:54 +00:00
slvrtrn
8483d1c701 Binary protocol tests 2023-08-31 13:26:27 +02:00
Robert Schulze
97d960ba1d
Merge pull request #53818 from arenadata/ADQM-1070
Add new hide_in_preprocessed attribute in configuration file
2023-08-31 13:00:16 +02:00
robot-ch-test-poll
10898ee96f
Merge pull request #54092 from arenadata/ADQM-1080
Increased log waiting timeout in test_profile_max_sessions_for_user
2023-08-31 06:04:51 +02:00
Alexey Gerasimchuck
3de967ecbe Increased log waiting timeout 2023-08-30 22:05:38 +00:00
slvrtrn
8378441248 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-30 19:00:51 +02:00
slvrtrn
f4dd6be8a8 WIP prepared statements 2023-08-30 18:59:39 +02:00
Alexander Tokmakov
5cfd1c6d63
Merge pull request #54066 from kssenii/fix-named-collections-access-type-change
Fix named_collection_admin alias
2023-08-30 18:34:03 +02:00
Victor Krasnov
6dd926b68b Rename back_table_up to backup_table 2023-08-30 18:53:07 +03:00
Alexander Tokmakov
4d70624ca3
Merge pull request #53907 from arenadata/ADQM-1126
Added validate_tcp_client_information server setting
2023-08-30 15:10:13 +02:00
kssenii
185e3819ac Fix 2023-08-30 13:41:18 +02:00
Alexey Gerasimchuck
a1687e618b backward compatibility changes + fixes 2023-08-29 23:50:41 +00:00
Alexander Tokmakov
e610a1867c
Revert "Fixed wrong python test name pattern" 2023-08-29 15:19:13 +02:00
Alexander Tokmakov
87890ef02d update tests 2023-08-29 14:35:30 +02:00
Roman Vasin
7ceb9ec5eb Fix flakiness in test_config_hide_in_preprocessed 2023-08-29 11:22:23 +00:00
Mikhail f. Shiryaev
25eda7f358
Merge pull request #53713 from arenadata/ADQM-1107
Fixed wrong python test name pattern
2023-08-29 12:38:12 +02:00
János Benjamin Antal
a1a45ee905
Merge pull request #53766 from ilejn/exceptions_kafka_consumers
system.kafka_consumers exception info improvements
2023-08-29 10:22:26 +02:00
Roman Vasin
8ad066ecd3 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-1070 2023-08-29 05:08:46 +00:00
Alexey Gerasimchuck
1069244d17 Fix in ci-runner.py 2023-08-28 22:05:36 +00:00
Raúl Marín
174f7a4e63 Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert 2023-08-28 16:27:45 +02:00
Antonio Andelic
4137cb916d Merge branch 'master' into keeper-batch-flushes 2023-08-28 13:14:06 +00:00
Roman Vasin
5f70361583 Add test for 1 value of hide_in_preprocessed 2023-08-28 12:59:43 +00:00
Roman Vasin
6ee3639966 Rename hide attribute into hide_in_preprocessed 2023-08-28 12:51:17 +00:00
Victor Krasnov
921f0c8b5d Merge branch 'master' into ADQM-987 2023-08-25 21:20:23 +03:00
Roman Vasin
8cfab6d53f Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-1070 2023-08-25 12:13:53 +00:00
kssenii
fe4e04a7ae Merge remote-tracking branch 'upstream/master' into parallelize-file-cache-metadata-download 2023-08-25 11:36:40 +02:00
Kruglov Pavel
1b4a907574
Try fix tests 2023-08-25 00:04:43 +02:00
Kruglov Pavel
44db5fa992
Merge branch 'master' into cache-count 2023-08-24 17:21:18 +02:00
Roman Vasin
b4e0ca3b0a Add test for nested nodes, add checks for presence of nodes in pre-processed config 2023-08-24 14:23:46 +00:00
Ilya Golshtein
f58b4a812d exceptions_kafka_consumers: code review suggestions are addressed 2023-08-24 13:10:21 +00:00
Arthur Passos
2bade7db08
Add global proxy setting (#51749)
* initial impl

* fix env ut

* move ut directory

* make sure no null proxy resolver is returned by ProxyConfigurationResolverProvider

* minor adjustment

* add a few tests, still incomplete

* add proxy support for url table function

* use proxy for select from url as well

* remove optional from return type, just returns empty config

* fix style

* style

* black

* ohg boy

* rm in progress file

* god pls don't let me kill anyone

* ...

* add use_aws guards

* remove hard coded s3 proxy resolver

* add concurrency-mt-unsafe

* aa

* black

* add logging back

* revert change

* imrpove code a bit

* helper functions and separate tests

* for some reason, this env test is not working..

* formatting

* :)

* clangtidy

* lint

* revert some stupid things

* small test adjusmtments

* simplify tests

* rename test

* remove extra line

* freaking style change

* simplify a bit

* fix segfault & remove an extra call

* tightly couple proxy provider with context..

* remove useless include

* rename config prefix parameter

* simplify provider a bit

* organize provider a bit

* add a few comments

* comment out proxy env tests

* fix nullptr in unit tests

* make sure old storage proxy config is properly covered without global context instance

* move a few functions from class to anonymous namespace

* fix no fallback for specific storage conf

* change API to accept http method instead of bool

* implement http/https distinction in listresolver, any still not implemented

* implement http/https distinction in remote resolver

* progress on code, improve tests and add url function working test

* use protcol instead of method for http and https

* small fix

* few more adjustments

* fix style

* black

* move enum to proxyconfiguration

* wip

* fix build

* fix ut

* delete atomicroundrobin class

* remove stale include

* add some tests.. need to spend some more time on the design..

* change design a bit

* progress

* use existing context for tests

* rename aux function and fix ut

* ..

* rename test

* try to simplify tests a bit

* simplify tests a bit more

* attempt to fix tests, accept more than one remote resolver

* use proper log id

* try waiting for resolver

* proper wait logic

* black

* empty

* address a few comments

* refactor tests

* remove old tests

* baclk

* use RAII to set/unset env

* black

* clang tidy

* fix env proxy not respecting any

* use log trace

* fix wrong logic in getRemoteREsolver

* fix wrong logic in getRemoteREsolver

* fix test

* remove unwanted code

* remove ClientConfigurationperRequest and auxilary classes

* remove unwanted code

* remove adapter test

* few adjustments and add test for s3 storage conf  with new proxy settings

* black

* use chassert for context

* Add getenv comment
2023-08-24 16:07:26 +03:00
Anton Popov
19a52f19f1
Merge pull request #53547 from joelynch/shutdown-async-insert-queue-first
bugfix: Flush async insert queue first on shutdown
2023-08-24 13:59:12 +02:00
Raúl Marín
1c98568df9 Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert 2023-08-24 12:22:42 +02:00
Kseniia Sumarokova
4caa60e642
Update test.py 2023-08-24 11:50:56 +02:00
Kseniia Sumarokova
4d2efd87b5
Merge pull request #53736 from kssenii/fix-s3-queue-test
Fix flaky test_storage_s3_queue/test.py::test_delete_after_processing
2023-08-24 11:47:56 +02:00
Antonio Andelic
322b53dd62 Merge branch 'master' into keeper-batch-flushes 2023-08-24 09:08:47 +00:00
Ilya Golshtein
94ae9f640f exceptions_kafka_consumers: test fix 2023-08-24 07:28:26 +00:00
Ilya Golshtein
ec0c12960a exceptions_kafka_consumers: stylecheck 2023-08-23 23:10:25 +00:00
Ilya Golshtein
e7213ef5b9 exceptions_kafka_consumers: new test, MV exceptions propagated 2023-08-23 22:46:04 +00:00
Vitaly Baranov
7b9d6c4b96 Add test. 2023-08-23 23:33:51 +02:00
Kruglov Pavel
3404efcb21
Fix style 2023-08-23 22:20:14 +02:00
avogar
894513f6cd Fix tests 2023-08-23 18:43:08 +00:00
Kruglov Pavel
592fa77987
Merge branch 'master' into cache-count 2023-08-23 15:18:02 +02:00
Joe Lynch
075c0261e9
These queries need to be run in the same session 2023-08-23 15:00:00 +02:00
Joe Lynch
8d0824f1b8
Add test for flushing async insert queue 2023-08-23 15:00:00 +02:00
robot-ch-test-poll1
c22ffa6195
Merge pull request #53529 from Avogar/filter-files-all-table-functions
Use filter by file/path before reading in url/file/hdfs table functins
2023-08-23 14:21:23 +02:00
kssenii
15f7df0000 Merge remote-tracking branch 'upstream/master' into parallelize-file-cache-metadata-download 2023-08-23 12:02:04 +02:00
kssenii
aa21fc58ce Fix style check 2023-08-23 11:48:08 +02:00
kssenii
27b559bcda Fxi 2023-08-23 11:34:34 +02:00
robot-clickhouse
ee5d7b1d95 Automatic style fix 2023-08-23 08:22:54 +00:00
Antonio Andelic
cceb2b2d57 Disable integration with async replication 2023-08-23 08:12:05 +00:00
Antonio Andelic
59557ddd7c Merge branch 'master' into keeper-batch-flushes 2023-08-23 08:11:43 +00:00
Roman Vasin
3950dc4619 Add test for hidden attributes 2023-08-23 07:47:28 +00:00
robot-clickhouse
2e2ffb7f17 Automatic style fix 2023-08-23 06:27:28 +00:00
Konstantin Bogdanov
45856df18c
Remove time.sleep(1) 2023-08-23 08:08:01 +02:00
avogar
30e8e4f6e0 Make test integration 2023-08-22 16:51:09 +00:00
Raúl Marín
abfd48bcd2 Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert 2023-08-22 17:01:22 +02:00
Victor Krasnov
258f9927b4 Merge branch 'master' into ADQM-987 2023-08-22 16:49:32 +03:00
Kruglov Pavel
c0bdd0e00b
Merge branch 'master' into cache-count 2023-08-22 14:42:22 +02:00
Alexey Milovidov
e6fb5a21cb
Merge pull request #53587 from dveeden/mysql_schema
Improve MySQL Compatibility by supporting SCHEMA()
2023-08-22 15:11:33 +03:00
avogar
b4145aeddc Cache number of rows in files for count in file/s3/url/hdfs/azure functions 2023-08-22 11:59:59 +00:00
Raúl Marín
6c76ad1ea4 Cleanup 2023-08-22 11:57:56 +02:00
alesapin
2a39dfdbe8
Merge pull request #53586 from chhetripradeep/pchhetri/fix-49400
Fix for flaky test_ssl_cert_authentication
2023-08-22 11:11:41 +02:00
Robert Schulze
583d9b33f0
Merge pull request #51446 from rschu1ze/recfgable-caches
Runtime-reconfigurable cache sizes
2023-08-21 23:27:21 +02:00
Robert Schulze
7068664299
Disable test 2023-08-21 21:26:28 +00:00
Michael Kolupaev
2f4d433e69 Parquet filter pushdown 2023-08-21 14:15:52 -07:00
Nikita Mikhaylov
145c99ee94
Merge pull request #53280 from evillique/better-stop-listen
Add EXCEPT clause to SYSTEM STOP LISTEN query
2023-08-21 19:03:49 +02:00
Robert Schulze
96c8b250ce
Allow to configure cache sizes at runtime 2023-08-21 13:51:10 +00:00
Kruglov Pavel
9d9bdde0e3
Merge branch 'master' into filter-files-all-table-functions 2023-08-21 14:26:59 +02:00
Victor Krasnov
a7813260c0 Merge branch 'master' into ADQM-987 2023-08-21 14:45:13 +03:00
Raúl Marín
f2d3c9c281 Merge remote-tracking branch 'blessed/master' into better_zk_retries_on_insert 2023-08-21 12:14:31 +02:00
Daniël van Eeden
7125969959 Add SCHEMA() to test_mysql_protocol 2023-08-21 10:03:30 +02:00
Igor Nikonov
b074e44c1b
Merge pull request #53005 from ClickHouse/fix-parallel-replicas-multiply-result
Parallel reading from replicas over Distributed
2023-08-21 01:10:53 +02:00
robot-clickhouse
57643a7e8b Automatic style fix 2023-08-20 20:05:02 +00:00
Igor Nikonov
f3af3bc641 Proper cluster name 2023-08-20 19:52:28 +00:00
robot-clickhouse
fc5637829b Automatic style fix 2023-08-20 19:47:17 +00:00
Igor Nikonov
622fec5f51 There is no need for zookeeper in the test 2023-08-20 19:35:12 +00:00
Igor Nikonov
a69ea02418 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-19 21:43:25 +00:00
Pradeep Chhetri
ce42e42d01 Fix for flaky test_ssl_cert_authentication 2023-08-19 21:01:24 +08:00
Kseniia Sumarokova
c0b8d7eddf
Merge pull request #50999 from ilejn/system_kafka_consumers
system.kafka_consumers table to monitor kafka consumers
2023-08-19 13:31:18 +04:00
Igor Nikonov
aebda10f7c Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-18 23:00:58 +00:00
Alexey Milovidov
7ad8ea78bb
Merge pull request #48990 from incfly/partition
Add partition to the system part_log and merge table.
2023-08-18 21:38:53 +03:00
Nikolai Kochetov
c99c3112ef
Merge pull request #53550 from ClickHouse/group_array_max_element_size
Add server setting `aggregate_function_group_array_max_element_size`.
2023-08-18 19:16:24 +02:00
Alexander Tokmakov
14590305ad
Merge pull request #52975 from aalexfvk/ignore_on_cluster_for_replicated_entity_queries
Ignore ON CLUSTER clause in queries for management of replicated entities (UDF and Access)
2023-08-18 19:29:41 +03:00
Alexander Tokmakov
334e014c2c Merge branch 'master' into ignore_on_cluster_for_replicated_entity_queries 2023-08-18 17:48:37 +02:00
Yakov Olkhovskiy
84cb358c14
Merge pull request #43210 from amosbird/storage_executable_stderr
Add different reactions when external command stderr has data
2023-08-18 11:17:46 -04:00
Alexander Tokmakov
4c3cb273a8
Merge pull request #53505 from arenadata/ADQM-1098
Added waiting for PostgreSQL compatibility port open in integrational tests.
2023-08-18 17:21:01 +03:00
robot-clickhouse
f1cb8a83fe Automatic style fix 2023-08-18 13:34:20 +00:00
Nikolai Kochetov
e9d8745971
Merge branch 'master' into group_array_max_element_size 2023-08-18 15:23:01 +02:00
Nikolai Kochetov
88e81a31fa Add server setting group_array_max_element_size. 2023-08-18 13:15:27 +00:00
Alexander Tokmakov
0bd378afd9
Merge pull request #53381 from bakwc/bakwc-patch-2
Fixed system.data_skipping_indices for MaterializedMySQL
2023-08-18 14:22:40 +03:00
Alexander Tokmakov
45157769a5
Merge pull request #53534 from ClickHouse/tavplubix-patch-8
Update test.py
2023-08-18 13:42:33 +03:00
Victor Krasnov
df6d627618 Add integration test 2023-08-18 10:39:59 +03:00
Amos Bird
69ca36bfdf
Fix black style again 2023-08-18 15:38:47 +08:00
Amos Bird
c43bf153f5
Refactor 2023-08-18 15:38:46 +08:00
Amos Bird
e49fb4f348
Fix style 2023-08-18 15:38:46 +08:00
Amos Bird
dd0c71b32a
Add error_exit_reaction 2023-08-18 15:38:46 +08:00
Amos Bird
476f3cedc1
Various reactions when executable stderr has data 2023-08-18 15:38:45 +08:00
Alexey Milovidov
e7d0edfce6
Merge pull request #53261 from bharatnc/ncb/truncate-db
support TRUNCATE DATABASE
2023-08-18 08:22:32 +03:00
Nikita Taranov
abcf01b809 impl 2023-08-17 23:51:58 +02:00
Igor Nikonov
06c98956b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 20:42:50 +00:00
Alexander Tokmakov
9c9941ca17
Update test.py 2023-08-17 22:58:23 +03:00
avogar
4c32097df3 Use filter by file/path before reading in url/file/hdfs table functions, reduce code duplication 2023-08-17 16:54:43 +00:00
Alexander Tokmakov
89c365803f
Merge pull request #53424 from ClickHouse/exception_message_patterns6
Less exceptions with runtime format string
2023-08-17 17:58:04 +03:00
Igor Nikonov
3e9ae1751e Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-17 14:45:37 +00:00
Filipp Ozinov
ce87451b66
Merge branch 'ClickHouse:master' into bakwc-patch-2 2023-08-17 18:37:00 +04:00
robot-clickhouse
c36f828f9f Automatic style fix 2023-08-17 11:42:56 +00:00
Igor Nikonov
df4ca32210 Fix: select correct number of replicas for shard on coordinator
+ more tests
2023-08-17 11:31:51 +00:00
Alexander Tokmakov
76702a03bb
Update materialized_with_ddl.py (#53494) 2023-08-17 13:08:27 +03:00
Alexander Tokmakov
9e69120bee fix 2023-08-17 12:03:38 +02:00
Filipp Ozinov
5003406ef7
Style 2023-08-17 13:52:21 +04:00
Filipp Ozinov
f402d80bce
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:51:41 +04:00
Filipp Ozinov
e609a9f3d1
Test for system.data_skipping_indices with MaterializedMySQL 2023-08-17 12:50:44 +04:00
Alexey Gerasimchuck
adc73beb93 Added waiting to other PostgreSQL tests 2023-08-17 08:24:17 +00:00
Alexey Gerasimchuck
6b44088a8b Added waiting for PostgreSQL port open 2023-08-17 07:51:44 +00:00
Alexey Milovidov
525cc46b0b
Merge pull request #53400 from rschu1ze/follow-up-52695
Follow-up to #52695: Move tests to a more appropriate place
2023-08-17 07:53:34 +03:00
robot-ch-test-poll3
30dadcfdcc
Merge pull request #53425 from ClickHouse/trash_for_rdb
Add trash for Replicated database
2023-08-17 04:11:40 +02:00
Igor Nikonov
49f7b4acd6 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-16 23:31:49 +00:00
Nikolay Degterinsky
a893f75884 Merge remote-tracking branch 'upstream/master' into better-stop-listen 2023-08-16 23:06:18 +00:00
Robert Schulze
1008d7a9ce
Merge remote-tracking branch 'rschu1ze/master' into follow-up-52695 2023-08-16 21:26:29 +00:00
Alexander Tokmakov
69bc4f5139 Merge branch 'master' into exception_message_patterns6 2023-08-16 22:58:24 +02:00
Alexander Tokmakov
970eb24067 fix 2023-08-16 22:57:49 +02:00
Jianfei Hu
8b8397de52 fix the missing column
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Jianfei Hu
4b3564b2b0 fix style py
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Jianfei Hu
7769dad0c4 Add integration test for partition.
Signed-off-by: Jianfei Hu <hujianfei258@gmail.com>
2023-08-16 17:49:28 +00:00
Alexander Tokmakov
c85e2eca31
Merge pull request #53305 from arenadata/ADQM-1011-integration_test_session_log
Added integration test for session_log using concurrrent GRPC/PostgreSQL/MySQL sessions
2023-08-16 14:12:11 +03:00
Alexander Tokmakov
23353f5aff fix 2023-08-16 12:06:36 +02:00
vdimir
652416c8ef
Merge pull request #53416 from ClickHouse/vdimir/test_distributed_inter_server_secret_analyzer 2023-08-16 12:01:37 +02:00
Alexander Tokmakov
ba44d7260e fix 2023-08-16 00:20:28 +02:00
Alexander Tokmakov
b32bdd1b0a
Merge pull request #53164 from ClickHouse/fixes_for_detached_parts
Fixes for detach/attach partition and broken detached parts cleanup
2023-08-16 00:09:13 +03:00
Igor Nikonov
f1e040447f Tests: there is no need for cluster_for_parallel_replicas setting in queries over distributed anymore 2023-08-15 17:14:36 +00:00
Robert Schulze
79e94031e4
Merge remote-tracking branch 'rschu1ze/master' into follow-up-52695 2023-08-15 17:11:28 +00:00
Alexander Tokmakov
f95c859959 rename setting 2023-08-15 15:47:11 +02:00
Alexey Gerasimchuck
0e1728801e black run 2023-08-15 13:31:53 +00:00
Alexey Gerasimchuck
2aa211acc2 Added integration test for session log 2023-08-15 13:26:39 +00:00
Igor Nikonov
1678cda8b3 Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-15 12:03:35 +00:00
Igor Nikonov
c85986a5da Update test 2023-08-14 23:06:48 +00:00
Igor Nikonov
c94994afcf Propagate setting cluster_for_parallel_replicas to shards 2023-08-14 22:50:46 +00:00
Alexander Tokmakov
5ab82cc019
Merge pull request #53430 from ClickHouse/merging_53177
Merging #53177
2023-08-15 00:39:09 +03:00
Alexander Tokmakov
1916aec2e2 add trash for Replicated database 2023-08-14 20:49:06 +02:00
Alexander Tokmakov
f0f2cd8c13 Merge branch 'master' into fixes_for_detached_parts 2023-08-14 19:20:45 +02:00
Igor Nikonov
709287fbdc Merge remote-tracking branch 'origin/master' into fix-parallel-replicas-multiply-result 2023-08-14 14:37:43 +00:00
vdimir
f8b1d7474d
Update test_distributed_inter_server_secret to pass with analyzer 2023-08-14 12:46:23 +00:00
Robert Schulze
9d5fcbf524
Follow-up to #52695: Move tests to a more appropriate place 2023-08-14 09:27:12 +00:00
robot-ch-test-poll4
a897896c0c
Merge pull request #53308 from arenadata/ADQM-1083
Added an integration test for client peak_memory_usage value
2023-08-12 16:33:19 +02:00
Alexey Milovidov
0792d36415
Merge pull request #53286 from arthurpassos/pin_coredns_version_and_fix_tests
Bring back **garbage** dns tests
2023-08-12 17:24:38 +03:00
robot-ch-test-poll
967067bbb8
Merge pull request #53250 from evillique/postgresql-single-quotes
Fix character escaping in the PostgreSQL engine
2023-08-12 13:15:49 +02:00
Alexey Milovidov
891bf7e164
Merge pull request #53155 from ClickHouse/vdimir/test_quorum_inserts
Attempt to fix test_insert_quorum by adding sync second replica
2023-08-12 03:35:54 +03:00
Alexey Milovidov
6fbf9b5eb3
Merge pull request #52821 from ClickHouse/improve-throttling-tests
Do not test upper bounds for throttlers
2023-08-12 03:24:00 +03:00