thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-10 01:25:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
136,901 Commits 9,099 Branches 1,774 Tags 2 GiB
a65ac96b04
Commit Graph

3645 Commits

Author SHA1 Message Date
kssenii
296afceed8 Merge remote-tracking branch 'origin/master' into fix-backup-restore-with-mv 2023-11-29 18:06:09 +01:00
kssenii
122146ca0f Update config (see https://github.com/ClickHouse/ClickHouse/pull/57257\#discussion_r1406629948) 2023-11-29 13:44:49 +01:00
Han Fei
824e9ef664 Merge branch 'master' into hanfei/sqllogic 2023-11-27 15:15:35 +01:00
Alexey Milovidov
f8ebe5134d
Merge pull request #55836 from azat/dist/limit-by-fix 
RFC: Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY
 2023-11-26 04:03:41 +01:00
Alexey Milovidov
91cc132feb
Merge pull request #56873 from ClickHouse/memory-for-client-in-stress-and-fuzzer 
Set limit for memory usage for client in Stress tests and ASTFuzzers
 2023-11-24 23:15:27 +01:00
Alexey Milovidov
bad410c6c4
Update run-fuzzer.sh 2023-11-24 23:10:48 +03:00
Alexey Milovidov
9e72cea249
Merge pull request #57128 from azat/tests/fix-logs-artifacts 
Fix system.*_log in artifacts on CI
 2023-11-24 21:05:46 +01:00
kssenii
69260e322e Randomize cache policy in ci 2023-11-23 16:57:13 +01:00
Azat Khuzhin
9b258f4b09 Do not symbolize traces for debug/sanitizer builds for sending to cloud 
debug/sanitizer builds is very slow and symbolizing can take awhile, for
example this increases the time for `system flush logs`, and likely make
`02152_http_external_tables_memory_tracking` flaky again (#53215):

    azat@s1:~/ch/tmp$ zstd -cdq clickhouse-server.log.zst | grep -a -e 2dd61ba3-5a26-4b38-8979-af82cf3ff8bd -e 75b3cbcb-1d09-44ac-a82b-317b4fabfea9 -e 75ad1065-51cc-4c94-95a2-f9dd22981edd -e dc991967-4443-458b-84f0-2646a8d32a76 | grep trace_log -A1
    2023.11.22 05:46:32.872164 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 308544
    2023.11.22 05:47:23.352098 [ 59150 ] {2dd61ba3-5a26-4b38-8979-af82cf3ff8bd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:47:46.158400 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 328185
    2023.11.22 05:48:38.392275 [ 59158 ] {75b3cbcb-1d09-44ac-a82b-317b4fabfea9} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:49:07.348590 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 347744
    2023.11.22 05:50:00.265529 [ 59150 ] {75ad1065-51cc-4c94-95a2-f9dd22981edd} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0
    --
    2023.11.22 05:50:25.743286 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.trace_log): Requested flush up to offset 367101
    2023.11.22 05:51:15.567347 [ 59158 ] {dc991967-4443-458b-84f0-2646a8d32a76} <Debug> SystemLogQueue (system.crash_log): Requested flush up to offset 0

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-23 14:49:28 +01:00
serxa
0fc25fbda8 Merge branch 'master' into async-loader-integration 2023-11-23 09:32:43 +00:00
Azat Khuzhin
3903b4bb39 Fix system.*_log in artifacts on CI 
For now it is broken due to #53086:

    Code: 701. DB::Exception: Requested cluster 'system_logs_export' not found: Cannot attach table `system`.`query_views_log_sender` from metadata file /var/lib/clickhouse/store/c05/c05d0eb0-ac48-4b02-aea4-f05cf4f875a5/query_views_log_sender.sql from query ATTACH TABLE system.query_views_log_sender UUID 'ffd9aed6-344c-4b1b-8444-287d82c5a712' (`pull_request_number` UInt32, `commit_sha` String, `check_start_time` DateTime('UTC'), `check_name` LowCardinality(String), `instance_type` LowCardinality(String), `instance_id` String, `event_date` Date, `event_time` DateTime, `event_time_microseconds` DateTime64(6), `view_duration_ms` UInt64, `initial_query_id` String, `view_name` String, `view_uuid` UUID, `view_type` Enum8('Default' = 1, 'Materialized' = 2, 'Live' = 3, 'Window' = 4), `view_query` String, `view_target` String, `read_rows` UInt64, `read_bytes` UInt64, `written_rows` UInt64, `written_bytes` UInt64, `peak_memory_usage` Int64, `ProfileEvents` Map(String, UInt64), `status` Enum8('QueryStart' = 1, 'QueryFinish' = 2, 'ExceptionBeforeStart' = 3, 'ExceptionWhileProcessing' = 4), `exception_code` Int32, `exception` String, `stack_trace` String) ENGINE = Distributed('system_logs_export', 'default', 'query_views_log_17512133378547479980') SETTINGS flush_on_detach = 0. (CLUSTER_DOESNT_EXIST)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-22 21:00:51 +01:00
Kseniia Sumarokova
d384762123
Merge branch 'master' into fs-cache-improvement 2023-11-21 11:24:52 +01:00
Alexey Milovidov
3c2cf5dc70 Enable Analyzer in Stress and Fuzz tests 2023-11-20 21:52:47 +01:00
Igor Nikonov
b9a28028e4
Merge branch 'master' into test-rabbitmq-with-secure-connection 2023-11-19 21:33:09 +01:00
serxa
9023f61349 Merge branch 'master' into async-loader-integration 2023-11-19 13:05:58 +00:00
Alexey Milovidov
32b4d6ccf8
Merge pull request #56619 from ClickHouse/access-control-and-named-collections-by-default 
Enable access and named collections control by default
 2023-11-18 09:22:16 +01:00
Alexander Tokmakov
dd626d51cb
Fix perf tests report when there are no tests (#56881) 
* fix perf tests report when there are no tests

* Automatic style fix

* Update docker/test/performance-comparison/compare.sh

---------

Co-authored-by: robot-clickhouse <robot-clickhouse@users.noreply.github.com>
 2023-11-17 16:36:19 +01:00
Raúl Marín
7074bdb3bb Merge remote-tracking branch 'blessed/master' into access-control-and-named-collections-by-default 2023-11-17 14:53:02 +01:00
Alexey Milovidov
b42db2ec29 Update fasttest 2023-11-17 13:50:13 +01:00
Nikita Mikhaylov
427d9fff70 Set limit for memory 2023-11-16 19:13:25 +01:00
Kseniia Sumarokova
a2ed756eec
Merge branch 'master' into fs-cache-improvement 2023-11-16 17:49:26 +01:00
Igor Nikonov
b9d083e68d Merge remote-tracking branch 'origin/master' into test-rabbitmq-with-secure-connection 2023-11-16 13:05:10 +00:00
Antonio Andelic
b05a3d02ed
Merge pull request #56788 from ClickHouse/fix-keeper-random-stress 
Fix randomization of Keeper configs in stress tests
 2023-11-16 11:32:05 +01:00
Vitaly Baranov
946e02ecbc
Merge pull request #56268 from vitlibar/add-script-backup-view 
Add an external utility to view backups and to extract information from them
 2023-11-16 11:17:16 +01:00
Antonio Andelic
052134b143 Better 2023-11-16 07:32:11 +00:00
Robert Schulze
44bd0598a3
Merge pull request #56799 from slvrtrn/fix-binary-mysql-nullable-columns 
Fix incorrect nullable columns reporting in MySQL binary protocol
 2023-11-16 01:12:46 +01:00
Vitaly Baranov
21a283049c Add the test for clickhouse_backupview to CI. 2023-11-15 17:40:53 +01:00
slvrtrn
9e3ba55070 Fix incorrect nullable columns reporting in MySQL binary protocol 2023-11-15 16:53:38 +01:00
Han Fei
d9a5e4fe40 Merge branch 'master' into hanfei/sqllogic 2023-11-15 14:53:14 +01:00
Antonio Andelic
a828410993 Fix randomization of Keeper configs in stress tests 2023-11-15 12:14:48 +00:00
Igor Nikonov
07452b613a Fix certificate's file names 2023-11-14 20:36:46 +00:00
Igor Nikonov
cd909ffc48 Test RabbitMQ with secure connection 2023-11-14 20:13:09 +00:00
SmitaRKulkarni
951d9ac144
Disable randomization of allow_experimental_block_number_column flag (#56474) 
Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-11-13 15:44:06 +01:00
Alexey Milovidov
0279345871
Merge pull request #56634 from ClickHouse/short-names 
Introduce short names for `clickhouse-client` and `clickhouse-local`
 2023-11-12 05:27:18 +01:00
Alexey Milovidov
67e4d22c56 Fix typo 2023-11-12 03:04:47 +01:00
Alexey Milovidov
ed0e3873a3 Add a test 2023-11-12 02:45:25 +01:00
Alexey Milovidov
e207b1b14a Merge branch 'master' into access-control-and-named-collections-by-default 2023-11-12 00:56:06 +01:00
Alexey Milovidov
527ca9a1fc
Merge branch 'master' into symbolize-trace-log 2023-11-11 09:38:02 +01:00
Alexey Milovidov
356ae52e9b Enable access and named collections control by default 2023-11-11 08:46:10 +01:00
Alexey Milovidov
e073eaf5ce Try LowCardinality 2023-11-11 08:23:58 +01:00
Alexey Milovidov
0064872bc7 Apply LowCardinality in more places 2023-11-11 07:46:56 +01:00
Alexey Milovidov
9824631044 Apply LowCardinality in more places 2023-11-11 07:46:35 +01:00
Alexey Milovidov
4460abafbe No idea why it did not work 2023-11-11 07:37:39 +01:00
Alexey Milovidov
629c5c0e45 Change tables version 2023-11-11 06:21:31 +01:00
Alexey Milovidov
fb0335efb0 What if I add some indices 2023-11-11 06:20:57 +01:00
Alexey Milovidov
6078ff20bb Symbolize trace_log for exporting 2023-11-11 05:52:44 +01:00
Antonio Andelic
e9542e4153
Merge pull request #54957 from ClickHouse/49507_Support_compression_for_keeper_protocol 
Support compression for keeper protocol
 2023-11-09 10:00:19 +01:00
kssenii
dbea50738b Merge remote-tracking branch 'origin/master' into fs-cache-improvement 2023-11-08 11:53:54 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
serxa
77dc2e63b1 randomize async_load_databases in stress tests 2023-11-03 17:15:51 +00:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978) 
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-01 15:09:39 +01:00
Kseniia Sumarokova
e5efc42633
Merge branch 'master' into fs-cache-improvement 2023-11-01 10:47:36 +01:00
Smita Kulkarni
3fdf0daf1b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-31 10:43:28 +01:00
Alexey Milovidov
0152908a10
Merge pull request #56113 from ClickHouse/unit-tests-remove-trash 
Remove old trash from unit tests
 2023-10-30 20:58:52 +01:00
Raúl Marín
39195d2715
Merge pull request #56074 from Algunenano/upgrade_test_force_shutdown 
Force shutdown in upgrade test
 2023-10-30 18:36:31 +01:00
Raúl Marín
b042e2d986
Merge pull request #55713 from ClickHouse/Randomize_block_number_column_in_ci 
Randomize block_number column setting in ci
 2023-10-30 12:30:51 +01:00
Raúl Marín
8e615e05f1 Merge remote-tracking branch 'blessed/master' into upgrade_test_force_shutdown 2023-10-30 10:29:42 +01:00
Alexey Milovidov
a1ef4e7d07 Remove old trash from unit tests 2023-10-30 03:26:18 +01:00
Han Fei
a19e5fe0db increase timeout for sqllogic-test 2023-10-28 16:55:25 +02:00
Alexey Milovidov
243499aad1
Merge pull request #55796 from ClickHouse/Fix_azurite_port 
Fix azurite port issue
 2023-10-28 00:40:24 +02:00
Han Fei
6a5b1a4830 try to work sqllogic-test out 2023-10-27 15:05:37 +02:00
Smita Kulkarni
13c90c0b86 Removed unwanted file and added chanegs to stress_test 2023-10-27 14:56:25 +02:00
Raúl Marín
e93f64670b Force shutdown in upgrade test 2023-10-27 11:16:00 +02:00
Nikita Mikhaylov
f5890a5b4c
Added healthcheck for LDAP (#55571) 2023-10-27 10:53:59 +02:00
Smita Kulkarni
d1d8f4b2e1 Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-26 16:56:03 +02:00
Raúl Marín
71dfdf5bfe
Merge pull request #56009 from Algunenano/stress_cont 
Stress tests: Try to wait until server is responsive after gdb detach
 2023-10-26 11:37:49 +02:00
Raúl Marín
62088772d2 Fuzzer: Use the known pid instead of reading the file 
The file might not exists yet
 2023-10-25 16:12:18 +02:00
Azat Khuzhin
ff7e9e16d5 Fix possible performance test error 
CI [1]:

    2023-10-24 12:18:27	 ++ rg -c array_fill.xml changed-test-definitions.txt
    2023-10-24 12:18:27	 + '[' '' -gt 0 ']'
    2023-10-24 12:18:27	 right/scripts/compare.sh: line 288: [: : integer expression expected

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/55944/da408df4a7296835897d7cef80d63f252df79b75/performance_comparison_[2_4]/compare.log

v1: use --include-zero
v2: revert to grep
v3: check exit code
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-24 13:51:57 +02:00
Smita Kulkarni
7b1c0c471c Merge branch 'master' into Fix_azurite_port 2023-10-23 22:13:56 +02:00
Smita Kulkarni
cd7c1d1f8c Updated to enable allow_experimental_block_numner_column for stress tests only 2023-10-23 16:59:12 +02:00
Azat Khuzhin
8609125f7a fuzzer/generate-test-j2: export missing product function 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-20 12:21:05 +02:00
Smita Kulkarni
af5349f76b Merge branch 'master' into 49507_Support_compression_for_keeper_protocol 2023-10-19 12:03:40 +02:00
Smita Kulkarni
c39ca0b549 Fixed clang-tidy and updated to randomize compression for stress test 2023-10-19 11:59:22 +02:00
kssenii
89272e0925 Fix upgrade check, randomize more settings 2023-10-19 11:23:56 +02:00
Alexey Milovidov
7cd10e1c4b
Merge pull request #55780 from ClickHouse/correct-grep-fuzzer 
Correctly grep fuzzer.log
 2023-10-19 05:50:38 +02:00
Smita Kulkarni
9d6cd0e9a2 Upadted to get free port for azurite 2023-10-18 22:20:39 +02:00
Antonio Andelic
2eabb260a7 Correctly grep fuzzer.log 2023-10-18 12:09:22 +00:00
Antonio Andelic
70d366a8eb Control feature flag randomization with env 2023-10-18 07:59:49 +00:00
Michael Kolupaev
ce7eca0615
DWARF input format (#55450) 
* Add ReadBufferFromFileBase::isRegularLocalFile()

* DWARF input format

* Review comments

* Changed things around ENABLE_EMBEDDED_COMPILER build setting

* Added 'ranges' column

* no-msan no-ubsan
 2023-10-16 17:00:07 -07:00
Han Fei
0167b76e98 fix structure does not match logs again 2023-10-14 16:01:32 +02:00
Han Fei
e3ceca06e0 cast extra column expression pull_request_number to Int32 2023-10-13 14:52:25 +02:00
Han Fei
54fb9a836e
Merge pull request #55503 from hanfei1991/hanfei/fix-export-logs-structure-mismatch 
fix lots of 'Structure does not match' warnings in ci
 2023-10-12 16:15:00 +02:00
Han Fei
9ab9075c2b update again 2023-10-12 13:59:33 +02:00
Han Fei
360ec55c7a update table ash 2023-10-11 23:30:38 +02:00
Han Fei
03d139764c fix lots of 'Structure does not match' warnings in ci 2023-10-11 15:54:42 +02:00
slvrtrn
76da9cf780 Remove old Java client tests 
Revert Java client docker image JDK bump (no AArch64 available)
 2023-10-10 20:35:51 +02:00
slvrtrn
e06d3ca1a5 Fix MySQL text protocol DateTime 
Introduce `removeLowCardinalityAndNullable` function
Fix incorrect removeLowCar/removeNullable usages
Add more MySQL text protocol tests
Deprecate old Java client tests
Use JDK 17 for test MySQL Java container
 2023-10-10 19:51:09 +02:00
Yatsishin Ilya
686c3b458d Updated RabbitMQ image and fixed log retrieval in failed tests. 2023-10-09 18:39:39 +00:00
Azat Khuzhin
ce9cdc408c Upgrade MinIO to support accepting non signed requests 
During fixing one issue with multiple reads of input files while sending
them to S3 this had been pops up.

The problem is in this place [1].

  [1]: 200caab82b/cmd/object-handlers.go (L1573-L1591)

And this had been added only in [2].

  [2]: https://github.com/minio/minio/pull/16484

But even this implementation is not complete, since it does not
correctly support STREAMING-UNSIGNED-PAYLOAD-TRAILER, but this will be
the first step, to see if there are still problems with newer MinIO.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-08 07:30:13 +02:00
Alexey Milovidov
b38d4b5b0f
Merge pull request #55119 from jmaicher/fix/54318/deadlock-ldap-role-update 
Fix deadlock in LDAP assigned role update
 2023-10-08 00:38:10 +02:00
Julian Maicher
19f8f365b2 test: Add IT that reproduces deadlock 2023-09-30 07:03:25 +02:00
Alexey Milovidov
5ebd8ef41d Remove Meilisearch 2023-09-30 06:02:38 +02:00
Kseniia Sumarokova
0b71fd0050
Merge pull request #55002 from kssenii/fix-broken-test 
Fix broken test
 2023-09-29 11:13:31 +02:00
Mikhail f. Shiryaev
f19c172c5e
Move to parsing json reports of google test 2023-09-28 09:39:56 +02:00
Kseniia Sumarokova
f5cc191cce
Update run.sh 2023-09-28 01:05:35 +02:00
kssenii
1f13e3ac92 Fix database replicated tests using the same paths for filesystem cache 2023-09-27 11:43:30 +02:00
Antonio Andelic
e7c8363f6f
Merge pull request #48855 from ClickHouse/keeper-operation-create-if-not-exists 
Implement `createIfNotExists` in Keeper natively
 2023-09-26 16:04:51 +02:00
Antonio Andelic
ce583cb7fe Fix upgrade tests 2023-09-25 13:21:37 +00:00
Antonio Andelic
176baa6695 Merge branch 'master' into keeper-operation-create-if-not-exists 2023-09-22 13:47:30 +00:00
Antonio Andelic
3dbb6dcf4e Better 2023-09-22 13:47:28 +00:00
Robert Schulze
5209bd2d51
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-21 14:45:55 +00:00
Mikhail f. Shiryaev
6acdd65c8e
Launch fast tests as the current user 2023-09-20 22:32:19 +02:00
Mikhail f. Shiryaev
16fc2739c6
Use xargs to parallel submodules 2023-09-20 19:09:06 +02:00
Mikhail f. Shiryaev
dd7096bc59
Speed up fast tests a little bit 2023-09-20 19:09:06 +02:00
Robert Schulze
cbcff6ef08
Merge remote-tracking branch 'rschu1ze/master' into clang-17 2023-09-20 09:15:58 +00:00
Mikhail f. Shiryaev
4882b99715
Merge pull request #54310 from ClickHouse/ci-libfuzzer-integration 
CI: libFuzzer integration
 2023-09-20 10:01:39 +02:00
Robert Schulze
d31a43a379
Remove Woboq 2023-09-18 17:44:04 +00:00
Robert Schulze
3a3a00f95e
Bump minimal required compiler to Clang 16 2023-09-18 17:44:04 +00:00
Yakov Olkhovskiy
dd6f12dd94 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
3a14bde95a cleanup, fix tee to escape non-decodable symbols 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
cd0c775355 review suggestions 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
d80ae88060 run docker 2023-09-17 16:36:50 +00:00
Yakov Olkhovskiy
b7a17bf8dd add libFuzzer tests, initial integration 2023-09-17 16:36:49 +00:00
avogar
d5889c8cc8 Move all tests/ci/*.lib files to stateless-tests image 2023-09-15 11:27:09 +00:00
Kruglov Pavel
8d01137d73
Merge pull request #54498 from bakam412/bugfix/local_multiquery_parameter 
Bugfix/local multiquery parameter
 2023-09-15 11:46:08 +02:00
Robert Schulze
a9ae813db0
Merge pull request #54115 from slvrtrn/simplified-prepared-statements-for-mysql 
Implement the MySQL binary protocol implementation for initial support of Tableau Online
 2023-09-14 12:27:11 +02:00
bakam412
c5c3833a80 fix tests 2023-09-14 11:12:44 +08:00
slvrtrn
44e1f6b53d Fix LowCardinality/Nullable columns issues 2023-09-13 23:40:31 +02:00
slvrtrn
dddea9219a Address the review comments 2023-09-12 18:39:03 +02:00
slvrtrn
611a75a87f Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-09-12 10:38:44 +02:00
Antonio Andelic
479ae52f9c Merge branch 'master' into keeper-batch-flushes 2023-09-11 11:36:23 +00:00
robot-clickhouse-ci-2
47c0f8c99f
Merge pull request #54179 from joelynch/http-query-timing 
Add elapsed_ns to HTTP headers X-ClickHouse-Progress and X-ClickHouse-Summary
 2023-09-11 06:18:47 +02:00
Joe Lynch
eed11c36a4
Add jq to fasttest container 2023-09-10 23:11:24 +02:00
Alexey Milovidov
aac645efdc
Merge pull request #54469 from ClickHouse/ci-instance-type 
Add `instance_type` column to CI Logs and the `checks` table
 2023-09-09 19:21:57 +03:00
Alexey Milovidov
0728df37e6 Add instance_type column to CI Logs and the checks table 2023-09-09 01:44:14 +02:00
Joe Lynch
a5b508d6c5
Fix json in header 2023-09-07 14:59:33 +02:00
Antonio Andelic
824b90f754 Merge branch 'master' into keeper-batch-flushes 2023-09-06 13:29:35 +00:00
Mikhail Koviazin
f98007a4ed
Replace Turbo-Base64 with aklomp/base64 
Closes #31643
 2023-09-06 13:01:38 +00:00
Alexander Tokmakov
735f543aeb
Follow-up to #54198 (#54246) 
* Update run.sh

* Update run.sh
 2023-09-05 14:55:41 +02:00
slvrtrn
4f4640ec90 Add DateTime64 support 2023-09-04 20:49:29 +02:00
Antonio Andelic
365bc584ec Merge branch 'master' into keeper-batch-flushes 2023-09-04 07:24:21 +00:00
Alexander Tokmakov
b08e8940e2
Update run.sh 2023-09-02 13:34:05 +02:00
Alexander Tokmakov
d9438b176c save system tables from s3 in the report 2023-09-01 23:04:35 +02:00
Antonio Andelic
5f1a75ceae Fix tests 2023-09-01 12:13:33 +00:00
Mikhail f. Shiryaev
d4f21704e4
Increase distributed_ddl_task_timeout 
Co-authored-by: alesapin <alesapin@clickhouse.com>
 2023-09-01 11:29:33 +02:00
Mikhail f. Shiryaev
c611007694
The external logs have had colliding arguments 2023-09-01 11:25:42 +02:00
Kseniia Sumarokova
54a715da2d
Update Dockerfile 2023-08-31 14:34:41 +02:00
Kseniia Sumarokova
f4c3807547
Update Dockerfile 
Better comment
 2023-08-31 14:27:35 +02:00
Kseniia Sumarokova
b2c44d85c0
Update Dockerfile 2023-08-31 14:25:43 +02:00
slvrtrn
8483d1c701 Binary protocol tests 2023-08-31 13:26:27 +02:00
Mikhail f. Shiryaev
ab3e9df57f
Address review points 2023-08-30 22:06:32 +02:00
Mikhail f. Shiryaev
f0c18d4bd7
Rework setup of CI logs export 2023-08-30 22:04:37 +02:00
Mikhail f. Shiryaev
a683d5e2f3
Replace defaul assingment by default usage 2023-08-30 22:04:34 +02:00
slvrtrn
8378441248 Merge remote-tracking branch 'origin' into simplified-prepared-statements-for-mysql 2023-08-30 19:00:51 +02:00
slvrtrn
f4dd6be8a8 WIP prepared statements 2023-08-30 18:59:39 +02:00
Mikhail f. Shiryaev
c111adb7ce
Replace dlcdn.apache.org by archive domain 2023-08-30 18:40:36 +02:00
Alexander Tokmakov
9180c631aa
Update setup_export_logs.sh 2023-08-25 21:03:24 +03:00
Kseniia Sumarokova
4239154b44
Follow-up to #53611 2023-08-24 16:15:04 +02:00
Raúl Marín
333fc76300 Remove useless slow on client check 2023-08-22 16:30:57 +02:00
alesapin
a4ad63baa2
Merge pull request #53512 from canhld94/allow_non_standalone_keeper_integration_test 
Allow non standalone keeper run in integration tests
 2023-08-22 13:20:37 +02:00
kssenii
951081c8fb Merge remote-tracking branch 'upstream/master' into fix-upgrade-check 2023-08-21 19:28:19 +02:00
Maksim Kita
034ff13a05 CMake small refactoring 2023-08-21 12:51:39 +03:00
kssenii
307e5d6b9b Fix 2023-08-20 10:37:20 +02:00
Maksim Kita
21f2b10f56 Test 2023-08-19 17:38:14 +03:00
kssenii
5382442da0 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-19 08:44:36 +04:00
Alexander Tokmakov
428810a5b2
Update setup_export_logs.sh 2023-08-18 13:37:29 +03:00
Alexander Tokmakov
fdca288a73 make sending logs less fragile 2023-08-17 16:49:50 +02:00
Duc Canh Le
2406e9a987 allow non standalone keeper run in integration tests 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-08-17 11:10:35 +00:00
Mikhail f. Shiryaev
b7866ce75f
Merge pull request #53493 from ClickHouse/update-style-checker 
Update style checker
 2023-08-17 12:56:20 +02:00
Alexey Milovidov
c3e6f7e9ae Leave only simplifications 2023-08-17 03:59:15 +02:00
Alexey Milovidov
857856b8b6 Leave only simplifications 2023-08-17 03:58:32 +02:00
Alexey Milovidov
64c829807c Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci-performance 2023-08-17 03:56:27 +02:00
Mikhail f. Shiryaev
3c36af111d
Update style checker 2023-08-17 00:03:58 +02:00
Mikhail f. Shiryaev
651a45b04d
Add tests for initd start 2023-08-16 01:03:29 +02:00
kssenii
164b4f0ae3 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-15 20:30:01 +04:00
Alexey Milovidov
e357702fd0 What will happen if I remove this? 2023-08-14 01:26:38 +02:00
Alexey Milovidov
e11e7c6218 Fix typos 2023-08-14 01:26:15 +02:00
Alexey Milovidov
3c6af254bc Remove something 2023-08-14 01:26:04 +02:00
Alexey Milovidov
957045c70b Maybe fix error 2023-08-13 20:15:30 +02:00
kssenii
c3b8bc0267 Merge remote-tracking branch 'upstream/master' into allowed-caches-dir-for-dynamic-disks 2023-08-13 21:14:42 +04:00
Alexey Milovidov
d1e50b1cbf Simplification 2023-08-13 06:48:19 +02:00
Alexey Milovidov
d434e58eae Fix errors 2023-08-13 06:45:41 +02:00
Alexey Milovidov
748a65b2bb Fix error 2023-08-13 06:35:32 +02:00
Alexey Milovidov
645834ffb6 Fix errors 2023-08-13 04:54:20 +02:00
Alexey Milovidov
8dc0884099 Fix error 2023-08-13 04:20:06 +02:00
Alexey Milovidov
7132571375 Fix error 2023-08-13 04:18:07 +02:00
Alexey Milovidov
49485a6770 Fix shellcheck 2023-08-13 02:43:51 +02:00
Alexey Milovidov
fd3d0f7fa4 Merge branch 'master' into export-logs-in-ci-performance 2023-08-13 02:43:37 +02:00
Alexey Milovidov
077cd535e2 Improvements 2023-08-13 02:38:48 +02:00
Alexey Milovidov
b84132f4cd Merge branch 'master' into export-logs-in-ci-fuzz 2023-08-13 02:17:30 +02:00
Alexey Milovidov
6fadb8e883
Merge pull request #53353 from ClickHouse/export-logs-in-ci-stress 
Export logs from CI in stress tests
 2023-08-13 03:07:46 +03:00
Alexey Milovidov
ec779ca246 Export logs from CI in performance (part 2) 2023-08-13 00:32:55 +02:00
Alexey Milovidov
9f9b794feb Export logs from CI in performance (preparation) 2023-08-13 00:32:55 +02:00
Alexey Milovidov
a3ae62a1d1
Fix YAML 2023-08-13 01:18:08 +03:00
Alexey Milovidov
87a40fb02c Fix YAML 2023-08-13 00:16:40 +02:00
Alexey Milovidov
d059465389
Merge pull request #52293 from ClickHouse/sqltest 
Add SQLTest
 2023-08-13 00:35:46 +03:00
Alexey Milovidov
afbb91600e Export logs from CI in fuzzer 2023-08-12 22:41:56 +02:00
Alexey Milovidov
176c16fcc5 Export logs from CI in stress tests 2023-08-12 22:30:18 +02:00
Alexey Milovidov
f314c29386 Export logs to CI from stateful tests 2023-08-12 21:58:17 +02:00
Alexey Milovidov
fc6fc234b2
Merge pull request #53086 from ClickHouse/export-logs-in-ci 
Add a script to export logs in CI
 2023-08-12 17:35:36 +03:00
Alexey Milovidov
0792d36415
Merge pull request #53286 from arthurpassos/pin_coredns_version_and_fix_tests 
Bring back **garbage** dns tests
 2023-08-12 17:24:38 +03:00
Alexey Milovidov
a1d3f1836e Fix shellcheck 2023-08-12 02:46:28 +02:00
Alexey Milovidov
3b85c5ed0e Put the script into the base Docker image 2023-08-12 02:14:58 +02:00
kssenii
44efd74c8d Change log level 2023-08-11 20:41:31 +02:00
Alexey Milovidov
736ff1c127 Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-11 01:25:49 +02:00
Arthur Passos
9781a8cee9 bring back dns tests, fix them by pining coredns version and modifying test_reverse_dns_query 2023-08-10 16:45:29 -03:00
Alexey Milovidov
561e043868
Merge branch 'master' into sqltest 2023-08-10 21:47:56 +03:00
Alexey Milovidov
269f54b49e
Merge branch 'master' into export-logs-in-ci 2023-08-10 16:56:14 +03:00
Alexey Milovidov
0ba3fea7fe Apply recommendations 2023-08-10 04:44:20 +02:00
Alexey Milovidov
8fba4d2c4a Protection if the repository is old 2023-08-10 04:41:19 +02:00
Alexey Milovidov
2a89587300 Address review comments 2023-08-10 04:32:39 +02:00
Alexey Milovidov
f2621e70ae Remove unrecognizable garbage from the performance test 2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f Remove unrecognizable garbage from the performance test 2023-08-10 03:26:11 +02:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072) 
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
 2023-08-07 23:25:16 +02:00
Alexey Milovidov
0bab88b7cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15 
Add `abort_on_error=1` to `TSAN_OPTIONS`
 2023-08-07 17:17:04 +03:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74 Maybe fix bash 2023-08-06 12:51:37 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1 Fix shellcheck 2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7 YAML is mandatory 2023-08-06 02:52:36 +02:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2 
tests: fix possible EADDRINUSE v2
 2023-08-05 13:39:25 +03:00
Nikita Taranov
555c90a50c add to integration tests 2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1 to TSAN_OPTIONS for stress tests 2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE 
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb tests: use explicit address for console to avoid EADDRINUSE 
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.

And even though this is a problem of MinIO I'm not a go developer to fix
it.

v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3 2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx 
Replace kssenii/nginx-test by clickhouse/nginx-dav
 2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc Disable for fasttest 2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49 Update dockerfile 2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd Merge branch 'allow-oom-stress-upgrade-checks' into move-regions 2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5 Allow OOM in Stress and Upgrade checks 2023-07-31 12:27:35 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions 2023-07-30 10:34:10 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile 2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6 Fix Docker 2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3 Change the default timezones in Docker test images 2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6 Fix Docker 2023-07-30 04:22:36 +02:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated 
Make shutdown of `ReplicatedMergeTree` tables more soft
 2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445) 
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone 
Randomize timezone in tests across non-deterministic around 1970 and default
 2023-07-24 22:47:52 +03:00
Azat Khuzhin
2389e0f0b6 Randomize timezone in tests across non-deterministic around 1970 and default 
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).

But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.

So to catch such issues in the PRs itself, let's randomize
session_timezone as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 06:13:12 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop 2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd Fix CI 2023-07-23 17:30:23 +02:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b Sanitize compose files in integration-tests-runner 2023-07-22 15:45:47 +02:00