thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-24 00:22:29 +00:00
Code Issues Packages Projects Releases Wiki Activity
129,070 Commits 9,167 Branches 1,781 Tags 2.1 GiB
a139ae97eb
Commit Graph

8065 Commits

Author SHA1 Message Date
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Raúl Marín
297eda83fc Attemp to fix test_dictionaries_redis flakiness 2023-10-19 11:59:13 +02:00
Aleksandr Musorin
9a155ba747 Added test to check CapnProto cache 
Since current getting schema for CapnProto doesn't use cache, the
integration test was for the future if someone add cache.

Also, I was curious how schema cache affects performance and I compared reading binary files
with Protobuf (I guess it works the same for CapnProto).

```
for i in {1..1000}; do clickhouse-client -q \
  "select * from test.simple format Protobuf settings format_schema='/format_schemas/simple:KeyValuePair'" > simple-protobuf${i}.bin; done

clickhouse-client --time -q "select * from file('simple-protobuf{1..999}.bin', 'Protobuf') format Null settings format_schema = 'simple:KeyValuePair'"
```

Protobuf with cache and without works with approximately the same
time.
 2023-10-19 09:00:39 +02:00
Sema Checherinda
1308f26ccc Update test.py 2023-10-19 01:34:36 +02:00
robot-clickhouse
a2d4372ee8 Automatic style fix 2023-10-18 20:39:41 +00:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes 
Fixes for storage `S3Queue`
 2023-10-18 21:51:51 +02:00
Kseniia Sumarokova
998e068d73
Merge pull request #55774 from kssenii/fix-mat-pg-test 
Fix test test_postgresql_replica_database_engine_2/test.py::test_replica_consumer
 2023-10-18 21:49:29 +02:00
Sema Checherinda
dfdd2ee77c fix tests, to avoid timeouts do less retries 2023-10-18 16:36:45 +02:00
Kseniia Sumarokova
e4e92913cf
Merge pull request #55261 from azat/tests/fix-integration-results-parser 
Do not allow tests with state ERROR be overwritten by PASSED
 2023-10-18 16:13:19 +02:00
avogar
be9e84c194 Fix style 2023-10-18 11:09:39 +00:00
kssenii
663c2611ee Fix 2023-10-18 13:05:29 +02:00
kssenii
33118442dd Fix black check 2023-10-18 13:01:35 +02:00
kssenii
babbdd9202 Fxi 2023-10-18 12:08:47 +02:00
Kseniia Sumarokova
fff6a8dcc8
Temporarily disable flaky test 2023-10-18 11:35:53 +02:00
Alexey Milovidov
79eccfb642
Merge pull request #55678 from azat/fix-OR-resubmit 
Fix filtering by virtual columns with OR filter in query (resubmit)
 2023-10-17 20:33:19 +02:00
avogar
323486f9e8 Add tests 2023-10-17 18:10:47 +00:00
Kseniia Sumarokova
7cedfeff12
Merge pull request #55145 from kssenii/materialized-pg-allow-unique-identifier 
Allow to have several MaterializedPostgreSQL tables following the same Postgres table
 2023-10-17 18:47:32 +02:00
Smita Kulkarni
01a85522d9 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-17 11:39:20 +02:00
Kseniia Sumarokova
c220cc65d6
Update test.py 2023-10-17 11:35:15 +02:00
Kseniia Sumarokova
550a658236
Merge pull request #55144 from kssenii/fix-iceberg-metadata-parsing 
Fix storage Iceberg files retrieval
 2023-10-17 11:31:07 +02:00
kssenii
4464c86895 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-17 11:16:52 +02:00
robot-clickhouse
c68bf8058c
Automatic style fix 2023-10-17 00:14:20 +02:00
Konstantin Bogdanov
d38e75e358
Add a test case for param_-prefixed parameters for predefined query handlers 2023-10-17 00:14:20 +02:00
Konstantin Bogdanov
cf1c2a667e
Add a negative test case for query handler 2023-10-17 00:14:20 +02:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
Kseniia Sumarokova
3e9a1cf69f
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-16 22:18:52 +02:00
Kseniia Sumarokova
c31299d86c
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-16 22:18:23 +02:00
Kseniia Sumarokova
b525f1c28a
Update test.py 2023-10-16 17:30:20 +02:00
Azat Khuzhin
b0fbd79808 Fix test_system_merges after optimization for "x OR 1" conditions 
After the previous patch "x OR 1" will not execute "x", and because of
this test_system_merges::test_mutation_simple started to fail since
"sleep" function did not executed.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-16 15:57:34 +02:00
Raúl Marín
51837eff33 Enable test_query_is_lock_free[detach table] for the analyzer 2023-10-16 12:49:17 +00:00
kssenii
34d804686a Fix black check 2023-10-16 13:03:12 +02:00
kssenii
3cd175d11d Fix test 2023-10-16 13:01:36 +02:00
Antonio Andelic
a3360cb3f5
Merge pull request #55485 from guoxiaolongzte/keeper_client_add_get_all_children_number_command 
keeper_client add get_all_children_number command
 2023-10-16 08:45:38 +02:00
guoxiaolong
98af58d7cf fix test error 2023-10-16 10:02:31 +08:00
Kseniia Sumarokova
17ce951ed7
Update test.py 2023-10-15 18:12:01 +02:00
Kseniia Sumarokova
2015a0fc17
Merge branch 'master' into fix-iceberg-metadata-parsing 2023-10-15 18:03:53 +02:00
kssenii
f3056b1643 Add a test 2023-10-15 18:02:34 +02:00
Kseniia Sumarokova
e0668e9ea0
Update test.py 2023-10-15 14:19:44 +02:00
Kseniia Sumarokova
b26115eabe
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-15 14:17:32 +02:00
Kseniia Sumarokova
0cab773e7b
Merge pull request #55564 from kssenii/add-test-toast 
Add a test
 2023-10-15 14:12:57 +02:00
Nikolay Degterinsky
c1fba94d67 Resubmit #54421 
This reverts commit 3e60451ac7.
 2023-10-14 19:04:01 +00:00
Smita Kulkarni
13ffebf559 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-14 20:08:49 +02:00
robot-clickhouse-ci-1
b41bdf38e0
Merge pull request #55627 from azat/tests/fix-test_system_merges 
Fix flakiness of test_system_merges (by increasing sleep interval properly)
 2023-10-14 17:50:04 +02:00
Alexey Milovidov
8d8df4fe56
Merge pull request #55605 from ClickHouse/add_test_back2 
Add back a test that was removed by mistake
 2023-10-14 17:49:08 +02:00
Azat Khuzhin
0fb6ed5af7 Fix flakiness of test_system_merges (by increasing sleep interval properly) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/55418/769ed2e19d46fcb9cb6a678a0da6d6f2fc5d239e/integration_tests__tsan__[4_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-14 10:30:56 +02:00
Azat Khuzhin
e3976a5e50 Do not allow tests with state ERROR be overwritten by PASSED 
In the ERROR case there can be sanitizers issues, that should not be
hidden, like right now it is doing for
`test_s3_table_functions/test.py::test_s3_table_functions_timeouts`
test [1], but I was lucky enough to trigger this in [2].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55247/e99b0f46961733fa8ba10e490279dbcb0cdd67ad/integration_tests__asan__[5_6].html
  [2]: https://s3.amazonaws.com/clickhouse-test-reports/55245/918d65d6707c69ab541cdb56a076cdb83845d3ed/integration_tests__asan__[5_6].html

Though there could be also other issues, like with dependent services,
but still, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-14 09:34:00 +02:00
Smita Kulkarni
c15b85074f Updated to include compression in clickhouse_common_io 2023-10-13 20:23:46 +02:00
Kseniia Sumarokova
310e922b40
Merge branch 'master' into materialized-pg-allow-unique-identifier 2023-10-13 19:14:50 +02:00
Kseniia Sumarokova
4555f2dd7f
Merge branch 'master' into add-test-toast 2023-10-13 19:14:17 +02:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups" 
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
 2023-10-13 18:55:51 +02:00
Alexander Tokmakov
e40aa72883
Merge pull request #54826 from JackyWoo/lb_nearest_host_name 
Add load balancing hostname_levenshtein_distance
 2023-10-13 17:23:02 +02:00
Alexander Tokmakov
80778727d3 add back a test that was removed by mistake 2023-10-13 16:35:42 +02:00
kssenii
b6b124f5a9 Usability improvement 2023-10-13 14:16:56 +02:00
robot-clickhouse
a0491065e5 Automatic style fix 2023-10-13 11:40:14 +00:00
Smita Kulkarni
e8271685a9 Added basic test 2023-10-13 13:20:02 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
kssenii
34915a8a5e Fix black check 2023-10-12 19:47:39 +02:00
kssenii
ed520baa06 Fix black check 2023-10-12 19:42:09 +02:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups 
Add replica groups to Replicated database engine
 2023-10-12 18:14:42 +02:00
kssenii
049db971e6 Add a test 2023-10-12 17:59:00 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
kssenii
1917a882b7 Better 2023-10-12 16:36:19 +02:00
guoxiaolong
7d5c15dfc9 fix python CheckSytel 2023-10-12 22:01:37 +08:00
guoxiaolong
369ebf3c4f fix CheckSytel 2023-10-12 21:15:52 +08:00
guoxiaolong
6e927325e4 fix CheckSytel 2023-10-12 20:32:36 +08:00
Smita Kulkarni
c4326e3a45 Merge branch 'master' into Fix_azure_test_by_using_unique_names 2023-10-12 12:18:31 +02:00
JackyWoo
1f553f3d65 Merge branch 'master' into lb_nearest_host_name 2023-10-12 10:19:17 +08:00
guoxiaolong
8b47bf5e7e fix CheckSytel 2023-10-12 09:58:42 +08:00
avogar
6c91c2b860 Add documentation 2023-10-11 17:35:18 +00:00
robot-ch-test-poll1
80aa9cad51
Merge pull request #55479 from slvrtrn/fix-mysql-datetime-incompatibilities 
Fix MySQL text protocol DateTime formatting and LowCardinality(Nullable(T)) types reporting
 2023-10-11 16:56:26 +02:00
Arthur Passos
0baee0c612 remove useless http resolver 2023-10-11 10:52:31 -03:00
Arthur Passos
cd0c15759b fix tests 2023-10-11 10:10:19 -03:00
guoxiaolong
f7e64ff200 add test_keeper_client 2023-10-11 20:45:38 +08:00
alesapin
21e0cb0b18
Merge pull request #55468 from ClickHouse/fix_out_of_bound_disk_web 
Fix out of bound error in system.remote_data_paths + disk web
 2023-10-11 12:54:00 +02:00
slvrtrn
76da9cf780 Remove old Java client tests 
Revert Java client docker image JDK bump (no AArch64 available)
 2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime 
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
 2023-10-10 19:51:09 +02:00
Vitaly Baranov
2af66dd9e9
Merge pull request #55089 from vitlibar/improve-hiding-secrets-in-logs 
Improve hiding secrets in logs
 2023-10-10 19:02:40 +02:00
avogar
1afd655bbc Allow to save unparsed records and errors in RabbitMQ, NATS and FileLog engines 2023-10-10 16:21:33 +00:00
robot-clickhouse-ci-2
a9cb206044
Merge pull request #55453 from ClickHouse/update-rabbitq 
Fix test that never worked test_rabbitmq_random_detach
 2023-10-10 17:05:44 +02:00
robot-clickhouse
d500ebcb73 Automatic style fix 2023-10-10 14:21:35 +00:00
alesapin
b677318415 Add oneliner to test 2023-10-10 15:59:33 +02:00
Kruglov Pavel
5ded0005a3
Merge pull request #55064 from AVMusorin/system-drop-format-cache 
Allow drop cache for Protobuf format
 2023-10-10 14:23:11 +02:00
Robert Schulze
24fecaeb7d
Merge pull request #55427 from slvrtrn/mysql-boolean-format-fix 
Fix MySQL interface boolean representation
 2023-10-10 13:11:33 +02:00
alesapin
666c690b4f
Merge pull request #55309 from ClickHouse/fix_redundant_check 
Fix bug with inability to drop detached partition in replicated merge tree on top of S3 without zero copy
 2023-10-10 11:48:00 +02:00
robot-clickhouse
9640e09f38 Automatic style fix 2023-10-10 08:38:11 +00:00
Yatsishin Ilya
1f72bd85e9 fix test that never worked 2023-10-10 08:25:04 +00:00
Yatsishin Ilya
47512f7b40 try another fix 2023-10-10 07:42:30 +00:00
Alexey Milovidov
68ce6b9b00
Merge pull request #55424 from ClickHouse/update-rabbitq 
Updated RabbitMQ image and fixed log retrieval in failed tests.
 2023-10-10 03:32:21 +02:00
Alexey Milovidov
b50889a8ff
Merge pull request #55186 from ClickHouse/remove-in-memory-data-parts 
Remove the support for in memory data parts (part 2)
 2023-10-09 23:53:25 +02:00
Arthur Passos
63562cbb20 Merge branch 'master' into properly_split_remote_proxy_http_https 2023-10-09 17:58:29 -03:00
Alexey Milovidov
04ed4ece7a
Merge pull request #55208 from arthurpassos/add_option_to_set_env_variables_for_a_single_node_integration_tests 
Add option to set env variables for a single node in integration tests
 2023-10-09 22:37:04 +02:00
robot-clickhouse
1a67e61729 Automatic style fix 2023-10-09 19:10:41 +00:00
slvrtrn
e31cfdefa7 Report Bool as TINYINT in MySQL text and binary 2023-10-09 20:51:58 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
slvrtrn
b0b4f6c5b7 Fix MySQL interface boolean representation 2023-10-09 20:30:28 +02:00
Alexey Milovidov
df037e079d
Merge pull request #54873 from ClickHouse/remove-flaky-ssl-tests 
Remove tests
 2023-10-09 15:22:07 +02:00
Alexey Milovidov
ce8ead34a6
Update cluster.py 2023-10-09 16:00:02 +03:00
Alexey Milovidov
e0258582ae
Merge pull request #55338 from azat/fix-CreatingSetsTransform-data-race 
Fix data-race in CreatingSetsTransform (on errors) due to throwing shared exception
 2023-10-09 13:27:10 +02:00
Alexey Milovidov
b0d9a42835
Merge pull request #55355 from azat/tests/fix-test_max_rows_to_read_leaf_with_view 
Fix test_max_rows_to_read_leaf_with_view flakiness (due to prefer_localhost_replica)
 2023-10-09 13:19:50 +02:00
Aleksandr Musorin
8d0c961af0 Allow drop cache for protobuf format 
Before it was impossible to update Protobuf schema without server
restart. With this commit, it is enough to send query `SYSTEM DROP
SCHEMA FORMAT CACHE [FOR Protobuf]`.
 2023-10-09 10:41:15 +02:00
Azat Khuzhin
9f82eef1b6 Fix test_max_rows_to_read_leaf_with_view flakiness (due to prefer_localhost_replica) 
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/186bd9c85974f641a70581a704a43ebdb6d302a8/integration_tests__asan__analyzer__[4_6]/integration_run_parallel1_0.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-09 06:56:53 +02:00
Alexey Milovidov
8ac56a7b9f Remove old test 2023-10-09 01:09:03 +02:00
Alexey Milovidov
61caa9a660
Merge pull request #55245 from azat/bump-minio 
Upgrade MinIO to support accepting non signed requests
 2023-10-08 22:46:01 +02:00
Azat Khuzhin
dee435f8f4 Add a test for data-race in CreatingSetsTransform 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 21:45:44 +02:00
Azat Khuzhin
2a27a8b0bf tests/test_throttling: check the maximum execution time as well 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
c883da2b26 tests/test_throttling: adjust delays due to HTTPS usage 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
9c8096455e tests: switch test_throttling to S3 over https to make it more production like 
One interesting thing about S3 C++ SDK is that it can read file multiple
times for calculating checksums and signature, but the last is not done
for the https protocol, though the checksum "could".

And indeed it does, since default checksum algorithm (MD5) does not
support streaming, and so it always calculated, regardless of the
protocol, however everything else (CRC*/SHA*) supports streamming and
actually will not be calculated for https at all!

This will be fixed in the follow up patch.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:31:33 +02:00
Azat Khuzhin
4179ff7111 Adjust the test_storage_delta::test_multiple_log_files after MinIO upgrade 
After upgrade MinIO stopped handling of objects with leading slash:

    (Pdb) p minio_client.fput_object(bucket_name='root', object_name='/test_multiple_log_files/_delta_log/00000000000000000001.json', file_path='/test_multiple_log_files/_delta_log/00000000000000000001.json').http_headers
    HTTPHeaderDict({'Accept-Ranges': 'bytes', 'Content-Length': '0', 'ETag': '"f1f3276c787b3f6724b9a8edb313c4fa"', 'Server': 'MinIO', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Vary': 'Origin, Accept-Encoding', 'X-Amz-Id-2': '7987905dee74cdeb212432486a178e511309594cee7cb75f892cd53e35f09ea4', 'X-Amz-Request-Id': '178B9B0904A9640D', 'X-Content-Type-Options': 'nosniff', 'X-Xss-Protection': '1; mode=block', 'Date': 'Fri, 06 Oct 2023 19:22:27 GMT'})
    (Pdb) p list(minio_client.list_objects('root', '/test_multiple_log_files/_delta_log/'))
    []
    (Pdb) p minio_client.get_object(bucket_name='root', object_name='/test_multiple_log_files/_delta_log/00000000000000000001.json').read()
    b'{"commitInfo":{"timestamp":1696618985577,"operation":"WRITE","operationParameters":{"mode":"Overwrite","partitionBy":"[]"},"readVersion":0,"isolationLevel":"Serializable","isBlindAppend":false,"operationMetrics":{"numFiles":"1","numOutputRows":"100","numOutputBytes":"2459"},"engineInfo":"Apache-Spark/3.3.2 Delta-Lake/2.3.0","txnId":"2a69a4c9-f72e-4ac9-9374-bdff96707edf"}}\n{"add":{"path":"part-00000-9ff4728b-d5fe-49ac-a773-e2d6e01f4139-c000.parquet","partitionValues":{},"size":2459,"modificationTime":1696618985310,"dataChange":true,"stats":"{\\"numRecords\\":100,\\"minValues\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":0,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":\\"1\\"},\\"maxValues\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":99,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":\\"99\\"},\\"nullCount\\":{\\"col-ab7641d2-f0a9-4ffb-ae37-27087d13dfc8\\":0,\\"col-6cbfced4-5921-4e3b-9226-558171c11949\\":0}}"}}\n{"remove":{"path":"part-00000-7c29f5d9-e14d-419a-a273-58d07775e1e9-c000.parquet","deletionTimestamp":1696618985576,"dataChange":true,"extendedFileMetadata":true,"partitionValues":{},"size":2459}}\n'
    (Pdb) p list(minio_client.list_objects(bucket_name='root', prefix='test_multiple_log_files/', recursive=True))
    [<minio.datatypes.Object object at 0x7ffff1ec2fe0>, <minio.datatypes.Object object at 0x7ffff1ec39d0>, <minio.datatypes.Object object at 0x7ffff1ec2590>, <minio.datatypes.Object object at 0x7ffff1ec3dc0>, <minio.datatypes.Object object at 0x7ffff1ec3a00>, <minio.datatypes.Object object at 0x7ffff1ec3fa0>, <minio.datatypes.Object object at 0x7ffff1ec3f40>, <minio.datatypes.Object object at 0x7ffff1ec2770>]

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update 
Fix deadlock in LDAP assigned role update
 2023-10-08 00:38:10 +02:00
alesapin
ec69b28386 Black 2023-10-07 21:18:54 +02:00
alesapin
77d96e67d1 Merge branch 'fix_redundant_check' of github.com:ClickHouse/ClickHouse into fix_redundant_check 2023-10-07 21:18:39 +02:00
alesapin
aa130b74e5 Fix offsets bug 2023-10-07 21:18:23 +02:00
robot-clickhouse
041a9c8180 Automatic style fix 2023-10-07 17:27:42 +00:00
alesapin
eec64ba1d9 Fix bug with inability to drop detached partition in replicated merge tree on top of S3 without zero copy 2023-10-07 19:09:47 +02:00
JackyWoo
784fe880eb Merge branch 'master' into lb_nearest_host_name 2023-10-07 09:04:26 +08:00
Arthur Passos
d54186df30 tmp 2023-10-04 17:21:41 -03:00
Arthur Passos
5e158f8a7d fix black 2023-10-04 10:57:38 -03:00
Arthur Passos
c904cd42e4 add back import os 2023-10-04 10:27:28 -03:00
Arthur Passos
fec4c392af opsy 2023-10-03 14:22:25 -03:00
Arthur Passos
3412dc89c6 rename setting 2023-10-03 13:53:38 -03:00
Arthur Passos
032a74ec3a make sure instance env variables override global ones 2023-10-03 10:33:55 -03:00
Arthur Passos
9695bf5db9 Revert "rename setting" 
This reverts commit 0b97cd49e8.
 2023-10-02 18:26:31 -03:00
Arthur Passos
0b97cd49e8 rename setting 2023-10-02 18:21:20 -03:00
Arthur Passos
3813e59b49 minor 2023-10-02 18:19:41 -03:00
Arthur Passos
e74e7ae19a more docs 2023-10-02 16:09:35 -03:00
Arthur Passos
23074c2c03 add comment 2023-10-02 16:04:02 -03:00
Arthur Passos
5eda3dfc39 add exclusive_environment_variables option to inte gtests 2023-10-02 15:59:15 -03:00
Alexey Milovidov
9200b121ac
Merge pull request #55189 from ClickHouse/remove-meilisearch 
Remove Meilisearch
 2023-10-01 01:57:04 +03:00
Alexey Milovidov
5ef68f0b36 Fix integration test 2023-09-30 23:03:35 +02:00
Julian Maicher
7db4023928 style: Apply black formatter 2023-09-30 07:04:05 +02:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
180562adfb
Merge pull request #55132 from ClickHouse/fix_deadlock_backups 
Fix deadlock in backups
 2023-09-30 07:20:19 +03:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Alexey Milovidov
d8b5713023 Remove the removal of broken detached parts 2023-09-30 01:47:44 +02:00
alesapin
54c48df486 Fix test 2023-09-29 14:03:58 +02:00
Nikolai Kochetov
8468e90a01
Merge pull request #55105 from ClickHouse/split-compatibility-tests 
Clean data dir and always start an old server version in aggregate functions compatibility test.
 2023-09-29 13:47:14 +02:00
Alexey Milovidov
8f9a227de1
Merge pull request #54931 from yariks5s/s3_style_url 
s3-style URL fix
 2023-09-29 07:12:01 +03:00
Nikolay Degterinsky
6539d52b9e
Merge pull request #50372 from helifu/master3 
Support dynamic adjustment of log level in Keeper
 2023-09-28 23:47:49 +02:00
Sema Checherinda
f73eef9ed8
Merge pull request #54697 from CheSema/s3_retry_cancelation_point 
add cancelation point to s3 retries
 2023-09-28 19:01:09 +02:00
robot-clickhouse
87e434304c Automatic style fix 2023-09-28 15:47:24 +00:00
Nikolai Kochetov
1326d9935f Clean data dir and always start an old server version in aggregate functions compatibility test. 2023-09-28 15:28:26 +00:00
yariks5s
ad94e08b0b made using macroses 2023-09-28 15:17:15 +00:00
Igor Nikonov
6132382044
Merge pull request #54987 from ClickHouse/fix-test-parallel-replicas-over-distributed 
Fix test parallel replicas over distributed
 2023-09-28 14:20:57 +02:00
Vitaly Baranov
22cdc012d1 Add test cases. 2023-09-28 13:02:07 +02:00
Sema Checherinda
013a44db94 style fix 2023-09-28 00:15:14 +02:00
Sema Checherinda
e629a17218 add cancelation point to s3 retries 2023-09-28 00:15:06 +02:00
yariks5s
d94e989391 black check 2023-09-27 20:27:48 +00:00
yariks5s
adf1af63a5 added tests, moved domains to config 2023-09-27 18:53:05 +00:00
robot-clickhouse-ci-1
7a825c1417
Merge pull request #54427 from Avogar/json-object-as-tuple-inference 
Add new features to schema inference for JSON formats
 2023-09-27 20:12:45 +02:00
kssenii
c579f5b321 Fix style check 2023-09-27 20:10:05 +02:00
kssenii
e0ff76a7f9 Fix 2023-09-27 18:44:53 +02:00
JackyWoo
f3bf1f8da9 Fix code style 2023-09-27 12:56:06 +08:00
JackyWoo
5da03e8ba5 Add load balancing test_hostname_levenshtein_distance 2023-09-27 10:46:39 +08:00
Alexey Milovidov
9518f68683
Merge pull request #54976 from vitlibar/use-pregenerated-grpc-protocol-pb2 
Use pregenerated gRPC protocol pb2 files to fix test flakyness.
 2023-09-26 23:09:34 +03:00
Alexey Milovidov
29d3b34dfc
Merge pull request #54090 from ClickHouse/remove-current-status 
Remove CurrentStatusInfo
 2023-09-26 21:38:07 +03:00
George Gamezardashvili
0ce30ab6d5
SSH keys authentication (#41109) 
Added new type of authentication based on SSH keys. It works only for Native TCP protocol.

Co-authored-by: Nikita Mikhaylov <nikitamikhaylov@clickhouse.com>
Co-authored-by: Robert Schulze <robert@clickhouse.com>
 2023-09-26 17:50:19 +02:00
Vitaly Baranov
d39bd7154f Use pregenerated gRPC protocol pb2 files to fix test flakyness. 2023-09-26 17:28:19 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists 
Implement `createIfNotExists` in Keeper natively
 2023-09-26 16:04:51 +02:00
Kruglov Pavel
bea80ab5b7
Merge branch 'master' into json-object-as-tuple-inference 2023-09-26 15:23:08 +02:00
János Benjamin Antal
6d254aa557 Remove tests 2023-09-26 09:02:12 +00:00
avogar
6dcaa387b1 Fix style 2023-09-25 22:15:41 +00:00
avogar
cabb3ddaae Fix tests 2023-09-25 21:45:11 +00:00
Kruglov Pavel
92de61ca5b Use less attempts 2023-09-25 21:04:12 +02:00
avogar
4fb12f8703 Add retries to rests test_async_query_sending/test_async_connect 2023-09-25 21:04:12 +02:00
kssenii
3b54b6be88 Add system tables 2023-09-25 20:04:15 +02:00
Anton Popov
0ebc22e851
Merge branch 'master' into long-column-names 2023-09-25 16:55:14 +02:00
Igor Nikonov
5a62f4cb99 Merge remote-tracking branch 'origin/master' into fix-test-parallel-replicas-over-distributed 2023-09-25 12:22:35 +00:00
robot-clickhouse
6224a4fcfa Automatic style fix 2023-09-25 12:21:14 +00:00
Igor Nikonov
9a788c3cac Fix: sync replicas to get consisten result 2023-09-25 12:21:12 +00:00
Smita Kulkarni
b142756c5d Added fixture to delete all files 2023-09-25 14:08:05 +02:00
kssenii
e4256eb268 Better 2023-09-25 13:44:45 +02:00
kssenii
47050c2605 Merge remote-tracking branch 'upstream/master' into s3-queue-fixes 2023-09-25 13:42:52 +02:00
alesapin
75b2f90923
Merge pull request #54772 from Avogar/less-flaky-async-tests 
Add retries to rests test_async_query_sending/test_async_connect
 2023-09-25 12:05:11 +02:00
Smita Kulkarni
fab4594ccb Merge branch 'master' into Fix_azure_test_by_using_unique_names 2023-09-25 10:35:29 +02:00
Alexey Milovidov
580f3c1a01 Merge branch 'master' into remove-current-status 2023-09-24 20:56:17 +02:00
Alexey Milovidov
664ac27cf2
Merge pull request #54507 from ClickHouse/flush-logs-for-system-backup-logs-test 
Flush logs for system.backup_log test.
 2023-09-23 22:33:21 +03:00
Alexander Tokmakov
21ffbd88de
Merge pull request #54859 from ClickHouse/fix_zero_copy_locks 
Fix zero copy locks with hardlinks
 2023-09-22 18:27:03 +02:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Vitaly Baranov
3a2ca1f69c
Merge pull request #51261 from evillique/users-valid-until 
Add VALID UNTIL clause for users
 2023-09-22 12:38:30 +02:00
Antonio Andelic
316f42def6
Merge pull request #54745 from ClickHouse/keeper-reduce-batch-size 
Revert default batch size for Keeper
 2023-09-21 17:44:33 +02:00
Pavel Novitskiy
853e3f0aa7
Add drop table IF EMPTY (#48915) 2023-09-21 09:20:18 -04:00
Antonio Andelic
13815a96bf
Fix test 2023-09-21 09:07:40 +02:00
Alexander Tokmakov
ec80068611 add a test for no such key 2023-09-20 22:37:24 +02:00
Nikolai Kochetov
2dc2b2050e
Update test.py 2023-09-20 17:16:50 +02:00
Antonio Andelic
b65b1ee97b Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-20 13:56:36 +00:00
Alexey Milovidov
d31a6f253e
Merge pull request #54816 from azat/tests/fix-test_backup_restore_on_cluster 
Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness
 2023-09-20 13:30:19 +03:00
alesapin
2ff36b6e0c
Merge pull request #54768 from ClickHouse/better_exception_in_check_data_part 
Better exception message in checkDataPart
 2023-09-20 12:04:46 +02:00
Azat Khuzhin
56dca144cc Fix test_backup_restore_on_cluster/test.py::test_stop_other_host_during_backup flakiness 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-20 07:09:51 +02:00
alesapin
accbe24e08 Fix test 2023-09-19 18:42:46 +02:00
Kruglov Pavel
a02b6d03d7
Use less attempts 2023-09-19 13:32:49 +02:00
Anton Popov
624782bd8f Merge remote-tracking branch 'upstream/master' into HEAD 2023-09-18 23:13:20 +00:00
Smita Kulkarni
5cac9f6ac5 Fixed tests 2023-09-18 21:47:39 +02:00
avogar
838668e9df Add retries to rests test_async_query_sending/test_async_connect 2023-09-18 19:35:08 +00:00
robot-clickhouse
ca64e26994 Automatic style fix 2023-09-18 11:28:36 +00:00
Antonio Andelic
69333912d5 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-18 10:57:11 +00:00
Smita Kulkarni
b9781f0da1 Updated to use unique path names for different azure tests to avoid collision 2023-09-18 11:17:57 +02:00
Igor Nikonov
fae229e3ea Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-17 21:03:56 +00:00
robot-ch-test-poll1
a2ed5c2cae
Merge pull request #54174 from ClickHouse/vdimir/fix_hostname_const 
Fix hostname and co result constness in new analyzer
 2023-09-16 19:37:08 +02:00
robot-clickhouse
66c2ac9364 Automatic style fix 2023-09-16 00:32:32 +00:00
János Benjamin Antal
d975ee7608 Fix argument parsing bug 2023-09-16 00:07:54 +00:00
János Benjamin Antal
16e2f7f0b9 Add optional version argument to rm 2023-09-16 00:03:46 +00:00
kssenii
6846fe3c58 Fxi 2023-09-15 14:21:08 +02:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter 
Bugfix/local multiquery parameter
 2023-09-15 11:46:08 +02:00
vdimir
1aa18e0eb6
Analyzer: Remove constants from header in StorageDistributed 2023-09-14 16:44:18 +00:00
kssenii
342755d35e Better 2023-09-14 18:41:31 +02:00
kssenii
afcb0b2b9a Merge remote-tracking branch 'upstream/master' into s3-queue-fixes 2023-09-14 17:16:29 +02:00
Kseniia Sumarokova
eeb2c5b223
Merge pull request #53220 from valbok/double-to-single 
MaterializedMySQL: Introduce Character Set Introducers
 2023-09-14 13:18:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql 
Implement the MySQL binary protocol implementation for initial support of Tableau Online
 2023-09-14 12:27:11 +02:00
Antonio Andelic
6306180333
Merge pull request #53049 from ClickHouse/keeper-batch-flushes 
Try batching multiple flush requests in Keeper
 2023-09-14 11:39:33 +02:00
Val Doroshchuk
6cfbaf9f86 MaterializedMySQL: Introduce Character Set Introducers 
If some string literals are used in DDL, they might have `Character Set Introducers`
https://dev.mysql.com/doc/refman/8.0/en/charset-introducer.html
f.e. _utf8mb4'1' which is not parsable by current ParserStringLiteral.

Since we use utf8 by default, suggesting to automatically convert the string literals to utf8
before executing the query and avoid any charset introducers there.
Conversion from utf8 to utf8 is not needed and skipped.

Also it might convert double quotes to single quotes if any
which might solve issues with COMMENT and empty string literals "" in DEFAULT expressions.

SELECT _latin1"abc"; -- might be also valid for MySQL
... DEFAULT "",
... COMMENT "abc"

Currently no DEFAULT expressions are supported, not parsable at all,
but using this MR it allows to parse the expressions together with double quotes as string literals.
 2023-09-14 08:24:25 +02:00
bakam412
c5c3833a80 fix tests 2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d Fix LowCardinality/Nullable columns issues 2023-09-13 23:40:31 +02:00
slvrtrn
c0961d9378 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-13 19:33:11 +02:00
Nikolay Degterinsky
0998b0bbc7 Fixes 2023-09-13 03:14:02 +00:00
Nikolay Degterinsky
268c45d900 Merge remote-tracking branch 'upstream/master' into users-valid-until 2023-09-12 23:44:22 +00:00
pufit
85b23e9403 Increase default timeout in tests for keeper-client 2023-09-12 14:06:57 -04:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
pufit
a54a7b726d
Merge pull request #54201 from ClickHouse/pufit/keeper-client-reconfig 
Implementing `reconfig`, `sync`, `exists` commands for keeper-client
 2023-09-12 10:58:02 -04:00
Nikolai Kochetov
894024a830
Update test.py 2023-09-12 13:54:26 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Alexey Milovidov
e9daff6c2f
Merge pull request #54506 from azat/system.detached_parts-modification_time 
Add modification_time into system.detached_parts
 2023-09-12 04:53:59 +03:00
Alexey Milovidov
ee8db35d66
Merge pull request #51449 from ClickHouse/cbrace 
Fix data race in copyFromIStreamWithProgressCallback
 2023-09-12 04:51:13 +03:00
Sema Checherinda
0ea0799118
Merge pull request #54430 from CheSema/remove-recursive-with-projection 
reproduce and fix the bug in removeSharedRecursive
 2023-09-12 00:18:55 +02:00
Michael Kolupaev
df71dcd94d Fix data race in copyFromIStreamWithProgressCallback 2023-09-11 21:04:37 +00:00
pufit
4f5d132019 Fix timeout keeper-client 2023-09-11 14:46:40 -04:00
Azat Khuzhin
8cd6153c83 Add modification_time into system.detached_parts 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-09-11 20:29:55 +02:00
Nikolai Kochetov
d86d92fa2d Flush logs for system.backup_log test. 2023-09-11 12:58:04 +00:00
Antonio Andelic
1494eb3a86 Fix version parsing 2023-09-11 12:34:16 +00:00
Igor Nikonov
f3f3eddd52 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-11 12:13:45 +00:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
Mikhail f. Shiryaev
61f0683f1c
Merge pull request #54043 from ClickHouse/revert-53929-revert-53713-ADQM-1107 
undefined
 2023-09-11 11:34:18 +02:00
Sergei Trifonov
08bad4d440
Merge pull request #47009 from ClickHouse/disks-and-io-sheduler 2023-09-11 07:22:14 +02:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing 
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
 2023-09-11 06:18:47 +02:00
Igor Nikonov
3a78ba6de4 Fix, enable tests, make cluster_for_parallel_replicas empty by default 2023-09-09 21:36:39 +00:00
Mikhail f. Shiryaev
c7e058fa6e
Disable broken tests 2023-09-09 23:21:16 +02:00
Mikhail f. Shiryaev
b17dc582a5
Disable test_disk_over_web_server for analyzer 2023-09-09 23:21:15 +02:00
Mikhail f. Shiryaev
5f0d94d523
Disable broken tests to have the bug fixed 2023-09-09 23:21:14 +02:00
Mikhail f. Shiryaev
b610faf685
Revert "Revert "Fixed wrong python test name pattern"" 2023-09-09 23:21:14 +02:00
Igor Nikonov
9464433683 Merge remote-tracking branch 'origin/master' into pr-distributed-prefer-localhost-replica 2023-09-09 19:48:50 +00:00
Robert Schulze
4d2223defe
Merge pull request #54119 from mkmkme/mkmkme/aklomp-base64 
Replace Turbo-Base64 with aklomp/base64
 2023-09-09 16:24:26 +02:00
Sema Checherinda
1298dba0c6 fix the bug, add useful logs 2023-09-09 15:54:28 +02:00
Alexey Milovidov
2e2e226e1d
Merge pull request #54367 from Avogar/fix-flaky-azure-schema-cache-test 
Fix flaky test test_storage_azure_blob_storage/test.py::test_schema_iference_cache
 2023-09-08 23:48:44 +03:00
robot-ch-test-poll4
839f69c940
Merge pull request #53765 from vitlibar/sync-uuids-of-tables-on-replicas 
Sync UUIDs of tables on replicas after RESTORE
 2023-09-08 17:30:32 +02:00
kssenii
220a67eca7 Better 2023-09-08 16:38:05 +02:00
Antonio Andelic
5207997bd4 Merge branch 'master' into keeper-batch-flushes 2023-09-08 13:05:47 +00:00
Sema Checherinda
44e432deab style fix 2023-09-08 00:21:21 +02:00
Sema Checherinda
411a97ff36 reproduce a bug in removeSharedRecursive 2023-09-07 21:15:30 +00:00
Robert Schulze
46e1d05a89
Fix another test 2023-09-07 19:43:01 +00:00
kssenii
7338b560a8 S3Queue fixes 2023-09-07 19:17:21 +02:00