Commit Graph

14175 Commits

Author SHA1 Message Date
kssenii
5c7b2b0aaf Update test 2021-12-14 07:59:47 +00:00
Azat Khuzhin
03dbbaca3e Disable 02127_connection_drain to run in parallel 2021-12-14 10:18:57 +03:00
Azat Khuzhin
33ffd343f3 Add ability to drain connections synchronously
This is mostly for testing, to avoid hiding errors.
2021-12-14 10:18:57 +03:00
Azat Khuzhin
ae122e430a tests/integration: fix waiting of mysql client container
healthy means that everything is OK and no need to wait.

And before it works only because mysql container was too slow to start
and wait_mysql_client_to_start() returns only when the status was
unhealthy/starting, which was obviously wrong.

Fixes: #20393 (cc @qoega)
2021-12-14 10:04:30 +03:00
Azat Khuzhin
1a134f5fc0 tests/integration: fix printing all available services in wait_mysql_client_to_start()
There is no docker-compose.yml in that place, since mysql client has
different name:

    2021-12-14 04:03:02 [ 862 ] DEBUG : Command:['docker-compose', 'ps', '--services', '--all'] (cluster.py:63, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Can't find a suitable configuration file in this directory or any (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        parent. Are you in the right directory? (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Supported filenames: docker-compose.yml, docker-compose.yaml (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:         (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Exitcode:1 (cluster.py:73, run_and_check)
2021-12-14 10:00:20 +03:00
Azat Khuzhin
01a57af774 tests/integration: fix wait_start()/start_clickhouse()
Execute query at least once, otherwise it may incorrectly detect that
the server is "alive".

Fixes: test_keeper_incorrect_config/test.py::test_duplicate_endpoint
CI: https://s3.amazonaws.com/clickhouse-test-reports/32536/559b01a2e43d09571195fb1cc08d83133f559203/integration_tests__asan__actions__[1/3].html
2021-12-14 09:45:46 +03:00
mergify[bot]
a5599d9fe2
Merge branch 'master' into watch-events-supports 2021-12-14 06:15:58 +00:00
mergify[bot]
96f6915233
Merge branch 'master' into wip_mv_into_join 2021-12-14 01:31:47 +00:00
mergify[bot]
2b181d7107
Merge branch 'master' into mongo-extend-auth-2 2021-12-13 22:21:10 +00:00
Kseniia Sumarokova
dadaeabda7
Merge pull request #32670 from CurtizJ/fix-reading-in-order
Fix reading in order of sorting key from `Distributed` and `Merge` tables
2021-12-14 00:42:48 +03:00
alexey-milovidov
b4f3600e84
Merge pull request #32720 from ClickHouse/Avogar-patch-1
Update backport.py
2021-12-13 20:44:47 +03:00
Kruglov Pavel
d065b8233d
Update backport.py 2021-12-13 20:40:06 +03:00
Kseniia Sumarokova
a9ca84ff7d
Merge pull request #32325 from stigsb/table-overrides
Add TABLE OVERRIDE feature for MaterializedMySQL databases
2021-12-13 20:39:42 +03:00
Kseniia Sumarokova
9eb2a4fe90
Merge pull request #32643 from nautaa/genarateRandom
support Date32 for genarateRandom engine
2021-12-13 20:38:41 +03:00
alexey-milovidov
fd9d40925a
Merge pull request #32640 from ClickHouse/fix-function-file
Fix surprisingly bad code in function `file`
2021-12-13 19:34:36 +03:00
Vxider
24b7b7b60c fix test 2021-12-13 16:26:01 +00:00
kssenii
ddbeadd104 Done 2021-12-13 16:09:18 +00:00
alesapin
242149d881 Rerun release workflows 2021-12-13 18:54:14 +03:00
Vxider
1f93d81259 update test 2021-12-13 15:47:37 +00:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency
Azure Blob Storage Disks
2021-12-13 18:28:48 +03:00
alesapin
949e68e2ac
Merge pull request #32696 from vdimir/trust-cont-lower
Check trusted contributors in lowercase
2021-12-13 18:20:16 +03:00
alesapin
856dd3735c Merge branch 'master' into add_performance_tests 2021-12-13 18:09:59 +03:00
vdimir
0c83b14c37
Check trusted contributors in lowercase 2021-12-13 17:34:17 +03:00
Anton Popov
0b68980977 fix MATERIALIZE TTL with WHERE and GROUP BY 2021-12-13 17:21:05 +03:00
Anton Popov
2f620fb6ac Merge branch 'test/issue_28280' of git://github.com/den-crane/ClickHouse into fix-add-ttl 2021-12-13 16:59:49 +03:00
Kruglov Pavel
52328f6abc
Merge pull request #32490 from ClickHouse/quote-more-identifiers
Fix issue with ambiguous query formatting in distributed queries.
2021-12-13 16:41:01 +03:00
Nikolai Kochetov
31f8ff4e9c Add test_s3_zero_copy_concurrent_merge 2021-12-13 16:34:04 +03:00
Raúl Marín
589b5a1fdc Merge remote-tracking branch 'blessed/master' into wip_mv_into_join 2021-12-13 14:05:46 +01:00
Jakub Kuklis
77f339caaf Cache test as the first test in the file 2021-12-13 13:41:17 +01:00
Anton Popov
745fd4fc16 fix reading in order from Distributed and Merge tables 2021-12-13 15:35:25 +03:00
Anton Popov
a241103714
Merge pull request #32359 from CurtizJ/fix-non-materialized-skip-index
Fix usage of non-materialized skip indexes
2021-12-13 14:43:58 +03:00
alesapin
fad904b0aa Merge branch 'master' into add_performance_tests 2021-12-13 14:32:35 +03:00
mergify[bot]
fa8f9671f4
Merge branch 'master' into fix-async-inserts 2021-12-13 11:13:20 +00:00
Raúl Marín
b25cfa0b4d InterpreterInsertQuery::buildChain: Make sure to keep the context alive 2021-12-13 11:50:46 +01:00
Jakub Kuklis
38e35a0ef5 Removing any extra work and correcting the cache path in the cache test 2021-12-13 10:52:02 +01:00
alesapin
1f5157e240
Merge pull request #32618 from ClickHouse/upload_logs_of_failed_task
CI: upload logs if task failed
2021-12-13 12:42:39 +03:00
mergify[bot]
77be64f1f4
Merge branch 'master' into genarateRandom 2021-12-13 09:18:52 +00:00
alesapin
b34f5210e7 Followup 2021-12-13 12:04:08 +03:00
alesapin
e2a2d1cdc3 Merge branch 'master' into add_performance_tests 2021-12-13 12:01:31 +03:00
Nikolai Kochetov
22e6fc1685
Merge pull request #32067 from amosbird/projection-fix23
Fix detaching parts with projections
2021-12-13 12:00:17 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
nautaa
7cb3d24847 support Date32 for genarateRandom engine 2021-12-13 15:52:12 +08:00
alesapin
c1d3323e25 Rerun workflows more times 2021-12-13 10:48:57 +03:00
mergify[bot]
47b18c959f
Merge branch 'master' into fix-non-materialized-skip-index 2021-12-13 07:03:02 +00:00
Alexey Milovidov
b5f175252d Add more tests 2021-12-13 08:52:10 +03:00
Alexey Milovidov
c188fc3244 Update test 2021-12-13 08:35:40 +03:00
Vxider
02ed0e46d6 update test 2021-12-13 04:20:39 +00:00
Vxider
caad9f6c79 small update 2021-12-12 17:30:44 +00:00
Vxider
6e23e9f5ca Ping CI 2021-12-12 15:37:56 +00:00
Alexander Tokmakov
62015ba610 Merge branch 'master' into upload_logs_of_failed_task 2021-12-12 15:20:25 +03:00
Alexander Tokmakov
e8613ba386 upload logs of failed task 2021-12-12 15:09:44 +03:00
Vxider
3f6fc6ce08 add window view watch events test 2021-12-12 11:46:40 +00:00
cmsxbc
8f9b6710df remove useless multiply restrictive row policies test 2021-12-12 09:54:07 +00:00
cmsxbc
fab1e53489 fix tests for multiply row policies on same column 2021-12-12 09:54:07 +00:00
cmsxbc
e4b405716f fix multiply row policies on same column 2021-12-12 09:54:07 +00:00
Kseniia Sumarokova
b8210c37ea
Merge pull request #32585 from kssenii/add-test-issue-28316
Add test for issue 28316
2021-12-12 12:28:54 +03:00
alexey-milovidov
b202bfac52
Merge pull request #32588 from ClickHouse/fix-bad-test-3
Fix bad test #32571
2021-12-12 12:13:36 +03:00
alexey-milovidov
26d606c158
Merge pull request #32456 from ClickHouse/fix-29890
Fix arraySlice with null args.
2021-12-12 06:38:17 +03:00
alexey-milovidov
71df622b1f
Merge pull request #31888 from ClickHouse/fix-31114
Remove LowCardinality from window function args.
2021-12-12 06:37:55 +03:00
alexey-milovidov
900e443900
Merge pull request #32589 from ClickHouse/fix-perf-test-5
Fix perf test `reinterpret_as`
2021-12-12 05:50:04 +03:00
alexey-milovidov
151834d743
Merge pull request #32417 from azat/local-atomic-db-fix
clickhouse-local: fix CREATE DATABASE with Atomic engine
2021-12-12 04:33:59 +03:00
alexey-milovidov
33674cbe58
Merge pull request #32535 from azat/avg-ubsan
Suppress UBSan errors for avg() function
2021-12-12 04:32:44 +03:00
Alexey Milovidov
d677a5ab67 Fix perf test 2021-12-12 04:31:56 +03:00
alexey-milovidov
b8a15b666d
Merge pull request #32571 from azat/mv-non-phys-table
Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers())
2021-12-12 03:55:51 +03:00
Alexey Milovidov
e58e69923c Fix bad test 2021-12-12 03:55:23 +03:00
Alexey Milovidov
d25b8f4147 Update tests 2021-12-12 03:45:21 +03:00
Alexey Milovidov
58ffe89643 Merge branch 'master' into quote-more-identifiers 2021-12-12 03:33:20 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
kssenii
a8484ec06d Add test 2021-12-12 00:47:21 +03:00
Vitaly Baranov
463ce1fcee
Merge pull request #27822 from filimonov/kafka_protobuf_issue26643
Test for issue #26643
2021-12-11 20:31:22 +03:00
Kseniia Sumarokova
3084d5eac0
Merge pull request #32503 from Vxider/fix-flaky-window-view-tests
Fix flaky window view tests
2021-12-11 17:11:26 +03:00
Vitaly Baranov
abe9dd3368
Merge pull request #32531 from vitlibar/fix-nested-array-sizes-for-missing-columns
Improve handling nested structures with missing columns while reading protobuf
2021-12-11 11:08:34 +03:00
mergify[bot]
1e28f7340e
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-11 08:05:20 +00:00
Azat Khuzhin
ca9c5dc4eb Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers())
Replace LOGICAL_ERROR with QUERY_IS_NOT_SUPPORTED_IN_MATERIALIZED_VIEW
in this case.
2021-12-11 11:04:47 +03:00
Kseniia Sumarokova
9ede6beca7
Merge pull request #32534 from azat/local-file-table-fix
Fix processing initial table (--table/stdin) in clickhouse-local
2021-12-11 10:45:19 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth
Allow empty credentials for mongo engine
2021-12-11 10:42:15 +03:00
Vxider
add1e8302e Ping CI 2021-12-11 04:39:13 +00:00
mergify[bot]
f4bcd87382
Merge branch 'master' into fix-flaky-window-view-tests 2021-12-11 02:13:24 +00:00
alexey-milovidov
8fdd7f329e
Merge pull request #32533 from azat/clickhouse-test-log-comment
clickhouse-test: use basename of the test for *.sh tests
2021-12-11 02:53:57 +03:00
alexey-milovidov
c90e588e24
Merge pull request #32506 from ClickHouse/fix-has-column-in-table-subquery
Fix queries with hasColumnInTable constant condition and non existing column
2021-12-11 02:50:06 +03:00
alexey-milovidov
17e5f5ccfe
Merge pull request #32508 from vdimir/issue_32458
Handle const column in JoinCommon::removeColumnNullability
2021-12-11 01:21:10 +03:00
Anton Popov
37837f3881
Merge pull request #32453 from kssenii/disable-optimizations-for-window-functions
Disable some optimizations for window functions
2021-12-11 00:37:24 +03:00
Jakub Kuklis
60e06ca34c Changing order of tests to check if that affects failing tests in the CI/CD 2021-12-10 22:04:38 +01:00
Jakub Kuklis
578aec97e9 Removing TODO and NOTE marks used mainly as hooks for review in the PR 2021-12-10 22:04:38 +01:00
Jakub Kuklis
69900ba417 Zero replication support test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
b5db3a307f Cache test, removing spurious imports 2021-12-10 22:04:38 +01:00
Jakub Kuklis
7351325f13 Simple check for files in cloud 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312e5b8c45 Abstracting utility functions from main integration tests for remote disks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
1d5c69b366 Minor tweaks to the test, disabling another slow one 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312ea92989 More integration tests, all pass, at least usually 2021-12-10 22:04:38 +01:00
Jakub Kuklis
afc64c14ce Merging test works correctly 2021-12-10 22:04:38 +01:00
Jakub Kuklis
6dca10e1c5 First integration tests, the one for merging fails for the moment 2021-12-10 22:04:38 +01:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
8afe69ff93 Comming back to StorageSharedKeyCredential for the integration test, get 400 Bad requests from Azurite when trying to create a container now 2021-12-10 22:04:38 +01:00
Jakub Kuklis
f180a7ba5f Solved Invalid storage account error with connection strings 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
008141de36 Enable authentication via StorageSharedKeyCredential 2021-12-10 22:04:38 +01:00
Jakub Kuklis
d51f979c7a Adding endpoint validation 2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57 Code cleanup addressing PR remarks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
Jakub Kuklis
5ed511f9da Working skeleton for Blob Storage integration test 2021-12-10 22:04:37 +01:00
Jakub Kuklis
24bafe4740 Starting an integration test for Blob Storage 2021-12-10 22:04:37 +01:00
Vitaly Baranov
b5b195f4e2
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-10 23:22:35 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
Azat Khuzhin
837ff82312 Suppress UBSan errors for avg() function
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/dd2ccd3b17e7c59ed9c8184f00f8dae85ee87d1f/fuzzer_astfuzzerubsan,actions//report.html
2021-12-10 22:23:39 +03:00
Azat Khuzhin
fa6090f588 Fix processing initial table (--table/stdin) in clickhouse-local
This patch will:
- fix the issue when table had been tried to create multiple times for
  --queries-files
- create these table for --interactive mode (before it works only if you
  had some queries already, i.e. when it run interactive after
  non-interactive)

This will also make ClientBase interface a little bit cleaner, by
removing one abstract method getQueryTextPrefix()
2021-12-10 22:08:03 +03:00
Azat Khuzhin
b1bc5c37c9 tests: split sum_ubsan into avg_ubsan 2021-12-10 21:51:43 +03:00
Azat Khuzhin
2045a4f245 clickhouse-test: use basename of the test for *.sh tests 2021-12-10 21:45:29 +03:00
Azat Khuzhin
9aeaa339c6 Make 01675_distributed_bytes_to_delay_insert less flaky (use http over client)
client is too heavy in debug builds, switching to http reduces test time
from 22s to 9s overall.

And also drop `_long` suffix form file name, since `clickhouse-test`
support `Tags` in tests.

CI: https://s3.amazonaws.com/clickhouse-test-reports/32303/24751e7d45d94541be854c86ce46d65c2e0f66da/stateless_tests__debug__actions_.html

v2: relax pattern
2021-12-10 21:43:45 +03:00
Vitaly Baranov
73092942ea Take into account nested structures while filling missing columns while reading protobuf. 2021-12-10 21:11:06 +03:00
vxider
8e3529818e update window view tests 2021-12-10 18:01:54 +00:00
avogar
1be84d80d4 Fix async inserts for some input formats 2021-12-10 20:54:08 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
Vxider
9b88794d82 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix-flaky-window-view-tests 2021-12-10 23:16:56 +08:00
kssenii
3e28581ea4 Extend test 2021-12-10 18:09:02 +03:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks
Split long tests into multiple checks
2021-12-10 17:42:14 +03:00
alesapin
751b2f3a7c
Merge pull request #32479 from Algunenano/01950_increase_timeout
01950_kill_large_group_by_query: Increase timeout
2021-12-10 16:38:36 +03:00
tavplubix
9867d75fec
Merge pull request #32464 from ClickHouse/fix-31538
Fix crash in case of MATERIALIZE COLUMN with no default expression.
2021-12-10 16:27:53 +03:00
alesapin
4eb2dee857 Don't use tmpfs 2021-12-10 16:09:00 +03:00
vdimir
ed4ea6fe3a
Handle const column in JoinCommon::removeColumnNullability 2021-12-10 15:57:36 +03:00
Nikolai Kochetov
7bf5c83561 Fix queries with hasColumnInTable constant condition and non existing column. 2021-12-10 15:45:04 +03:00
Mikhail f. Shiryaev
6cfb117732
Merge pull request #32421 from ClickHouse/test-16171
Add a test #16171
2021-12-10 13:23:29 +01:00
alexey-milovidov
13a3f85ece
Merge pull request #32497 from amosbird/replxxtest1
Add test for clickhouse-client history navigation
2021-12-10 15:11:04 +03:00
vdimir
a0488d21d2
Fix test_prometheus_endpoint 2021-12-10 14:58:46 +03:00
vxider
9aa98d7b99 fix flaky window view tests 2021-12-10 11:09:04 +00:00
alesapin
8f8f65e6e0 Fix clickhouse test 2021-12-10 13:30:12 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
tavplubix
79b1fdfee5 disable flaky tests 2021-12-10 13:14:45 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
94a557a80e Trying another host 2021-12-10 12:31:09 +03:00
Amos Bird
7638ce558f
Add test 2021-12-10 17:18:21 +08:00
alesapin
32f78f2ba4 Better check name 2021-12-10 12:09:11 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
alesapin
dc21d423d1
Merge pull request #32494 from ClickHouse/fix_integration_tests_images
Fix integration tests docker images path
2021-12-10 10:56:15 +03:00
alesapin
db83d82f5a Fix integration tests path 2021-12-10 10:54:37 +03:00
Alexey Milovidov
f1f66b7862 Add a test 2021-12-10 01:00:56 +03:00
Ilya Yatsishin
f51406743d
Merge pull request #32477 from Algunenano/02122_better_grep 2021-12-10 00:42:48 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448)
* attach gdb with sudo

* fix

* Update run.sh
2021-12-10 00:12:45 +03:00
Raúl Marín
ebdcf7e38e 01950_kill_large_group_by_query: Increase timeout 2021-12-09 19:26:29 +01:00
Raúl Marín
c155de5819 02122_parallel_formatting: Address grep binary warnings 2021-12-09 19:00:08 +01:00
Nikolai Kochetov
e41974fabf
Merge branch 'master' into fix-31538 2021-12-09 19:00:22 +03:00
Nikolai Kochetov
272c0bb35a Fix crash in case of MATERIALIZE COLUMN with no default expression. 2021-12-09 18:58:28 +03:00
alesapin
5b06e30ea2
Merge pull request #32462 from ClickHouse/automatic_rerun
Add automatic workflow rerun
2021-12-09 18:31:59 +03:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda
Fix 'APPLY lambda' parsing
2021-12-09 17:09:11 +03:00
Nikolai Kochetov
b3bd9e6a37 Fix arraySlice with null args. 2021-12-09 16:31:13 +03:00
alesapin
19f8b416bc Add automatic workflow rerun 2021-12-09 16:28:15 +03:00
Kseniia Sumarokova
2091008c15
Merge pull request #32324 from Vxider/rename-window-functions
Rename window functions in WindowView
2021-12-09 16:19:21 +03:00