thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-21 17:20:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
79,745 Commits 8,942 Branches 1,766 Tags 2 GiB
b41db62621
Commit Graph

14278 Commits

Author SHA1 Message Date
Azat Khuzhin
1a134f5fc0 tests/integration: fix printing all available services in wait_mysql_client_to_start() 
There is no docker-compose.yml in that place, since mysql client has
different name:

    2021-12-14 04:03:02 [ 862 ] DEBUG : Command:['docker-compose', 'ps', '--services', '--all'] (cluster.py:63, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Can't find a suitable configuration file in this directory or any (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        parent. Are you in the right directory? (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr: (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:        Supported filenames: docker-compose.yml, docker-compose.yaml (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Stderr:         (cluster.py:71, run_and_check)
    2021-12-14 04:03:03 [ 862 ] DEBUG : Exitcode:1 (cluster.py:73, run_and_check)
 2021-12-14 10:00:20 +03:00
Azat Khuzhin
01a57af774 tests/integration: fix wait_start()/start_clickhouse() 
Execute query at least once, otherwise it may incorrectly detect that
the server is "alive".

Fixes: test_keeper_incorrect_config/test.py::test_duplicate_endpoint
CI: https://s3.amazonaws.com/clickhouse-test-reports/32536/559b01a2e43d09571195fb1cc08d83133f559203/integration_tests__asan__actions__[1/3].html
 2021-12-14 09:45:46 +03:00
mergify[bot]
a5599d9fe2
Merge branch 'master' into watch-events-supports 2021-12-14 06:15:58 +00:00
mergify[bot]
96f6915233
Merge branch 'master' into wip_mv_into_join 2021-12-14 01:31:47 +00:00
mergify[bot]
2b181d7107
Merge branch 'master' into mongo-extend-auth-2 2021-12-13 22:21:10 +00:00
Kseniia Sumarokova
dadaeabda7
Merge pull request #32670 from CurtizJ/fix-reading-in-order 
Fix reading in order of sorting key from `Distributed` and `Merge` tables
 2021-12-14 00:42:48 +03:00
alexey-milovidov
b4f3600e84
Merge pull request #32720 from ClickHouse/Avogar-patch-1 
Update backport.py
 2021-12-13 20:44:47 +03:00
Kruglov Pavel
d065b8233d
Update backport.py 2021-12-13 20:40:06 +03:00
Kseniia Sumarokova
a9ca84ff7d
Merge pull request #32325 from stigsb/table-overrides 
Add TABLE OVERRIDE feature for MaterializedMySQL databases
 2021-12-13 20:39:42 +03:00
Kseniia Sumarokova
9eb2a4fe90
Merge pull request #32643 from nautaa/genarateRandom 
support Date32 for genarateRandom engine
 2021-12-13 20:38:41 +03:00
alexey-milovidov
fd9d40925a
Merge pull request #32640 from ClickHouse/fix-function-file 
Fix surprisingly bad code in function `file`
 2021-12-13 19:34:36 +03:00
Vxider
24b7b7b60c fix test 2021-12-13 16:26:01 +00:00
kssenii
ddbeadd104 Done 2021-12-13 16:09:18 +00:00
alesapin
242149d881 Rerun release workflows 2021-12-13 18:54:14 +03:00
Vxider
1f93d81259 update test 2021-12-13 15:47:37 +00:00
Kseniia Sumarokova
78ed383f15
Merge pull request #31505 from ContentSquare/azure_blob_storage_dependency 
Azure Blob Storage Disks
 2021-12-13 18:28:48 +03:00
alesapin
949e68e2ac
Merge pull request #32696 from vdimir/trust-cont-lower 
Check trusted contributors in lowercase
 2021-12-13 18:20:16 +03:00
alesapin
856dd3735c Merge branch 'master' into add_performance_tests 2021-12-13 18:09:59 +03:00
vdimir
0c83b14c37
Check trusted contributors in lowercase 2021-12-13 17:34:17 +03:00
Anton Popov
0b68980977 fix MATERIALIZE TTL with WHERE and GROUP BY 2021-12-13 17:21:05 +03:00
Anton Popov
2f620fb6ac Merge branch 'test/issue_28280' of git://github.com/den-crane/ClickHouse into fix-add-ttl 2021-12-13 16:59:49 +03:00
Kruglov Pavel
52328f6abc
Merge pull request #32490 from ClickHouse/quote-more-identifiers 
Fix issue with ambiguous query formatting in distributed queries.
 2021-12-13 16:41:01 +03:00
Nikolai Kochetov
31f8ff4e9c Add test_s3_zero_copy_concurrent_merge 2021-12-13 16:34:04 +03:00
Raúl Marín
589b5a1fdc Merge remote-tracking branch 'blessed/master' into wip_mv_into_join 2021-12-13 14:05:46 +01:00
Jakub Kuklis
77f339caaf Cache test as the first test in the file 2021-12-13 13:41:17 +01:00
Anton Popov
745fd4fc16 fix reading in order from Distributed and Merge tables 2021-12-13 15:35:25 +03:00
Anton Popov
a241103714
Merge pull request #32359 from CurtizJ/fix-non-materialized-skip-index 
Fix usage of non-materialized skip indexes
 2021-12-13 14:43:58 +03:00
alesapin
fad904b0aa Merge branch 'master' into add_performance_tests 2021-12-13 14:32:35 +03:00
mergify[bot]
fa8f9671f4
Merge branch 'master' into fix-async-inserts 2021-12-13 11:13:20 +00:00
Raúl Marín
b25cfa0b4d InterpreterInsertQuery::buildChain: Make sure to keep the context alive 2021-12-13 11:50:46 +01:00
Jakub Kuklis
38e35a0ef5 Removing any extra work and correcting the cache path in the cache test 2021-12-13 10:52:02 +01:00
alesapin
1f5157e240
Merge pull request #32618 from ClickHouse/upload_logs_of_failed_task 
CI: upload logs if task failed
 2021-12-13 12:42:39 +03:00
mergify[bot]
77be64f1f4
Merge branch 'master' into genarateRandom 2021-12-13 09:18:52 +00:00
alesapin
b34f5210e7 Followup 2021-12-13 12:04:08 +03:00
alesapin
e2a2d1cdc3 Merge branch 'master' into add_performance_tests 2021-12-13 12:01:31 +03:00
Nikolai Kochetov
22e6fc1685
Merge pull request #32067 from amosbird/projection-fix23 
Fix detaching parts with projections
 2021-12-13 12:00:17 +03:00
alesapin
cf281b10dc Split perf test into multiple checks 2021-12-13 11:59:58 +03:00
nautaa
7cb3d24847 support Date32 for genarateRandom engine 2021-12-13 15:52:12 +08:00
alesapin
c1d3323e25 Rerun workflows more times 2021-12-13 10:48:57 +03:00
mergify[bot]
47b18c959f
Merge branch 'master' into fix-non-materialized-skip-index 2021-12-13 07:03:02 +00:00
Alexey Milovidov
b5f175252d Add more tests 2021-12-13 08:52:10 +03:00
Alexey Milovidov
c188fc3244 Update test 2021-12-13 08:35:40 +03:00
Vxider
02ed0e46d6 update test 2021-12-13 04:20:39 +00:00
Vxider
caad9f6c79 small update 2021-12-12 17:30:44 +00:00
Azat Khuzhin
b3f1951c15 clickhouse-test: avoid failing with UNKNOWN status in some cases 
Like in:
- CREATE/DROP DATABASE failure
- Connection refused failure

Fixes: #32502
 2021-12-12 18:48:54 +03:00
Vxider
6e23e9f5ca Ping CI 2021-12-12 15:37:56 +00:00
Alexander Tokmakov
62015ba610 Merge branch 'master' into upload_logs_of_failed_task 2021-12-12 15:20:25 +03:00
Alexander Tokmakov
e8613ba386 upload logs of failed task 2021-12-12 15:09:44 +03:00
Vxider
3f6fc6ce08 add window view watch events test 2021-12-12 11:46:40 +00:00
cmsxbc
8f9b6710df remove useless multiply restrictive row policies test 2021-12-12 09:54:07 +00:00
cmsxbc
fab1e53489 fix tests for multiply row policies on same column 2021-12-12 09:54:07 +00:00
cmsxbc
e4b405716f fix multiply row policies on same column 2021-12-12 09:54:07 +00:00
Kseniia Sumarokova
b8210c37ea
Merge pull request #32585 from kssenii/add-test-issue-28316 
Add test for issue 28316
 2021-12-12 12:28:54 +03:00
alexey-milovidov
b202bfac52
Merge pull request #32588 from ClickHouse/fix-bad-test-3 
Fix bad test #32571
 2021-12-12 12:13:36 +03:00
alexey-milovidov
26d606c158
Merge pull request #32456 from ClickHouse/fix-29890 
Fix arraySlice with null args.
 2021-12-12 06:38:17 +03:00
alexey-milovidov
71df622b1f
Merge pull request #31888 from ClickHouse/fix-31114 
Remove LowCardinality from window function args.
 2021-12-12 06:37:55 +03:00
alexey-milovidov
900e443900
Merge pull request #32589 from ClickHouse/fix-perf-test-5 
Fix perf test `reinterpret_as`
 2021-12-12 05:50:04 +03:00
alexey-milovidov
151834d743
Merge pull request #32417 from azat/local-atomic-db-fix 
clickhouse-local: fix CREATE DATABASE with Atomic engine
 2021-12-12 04:33:59 +03:00
alexey-milovidov
33674cbe58
Merge pull request #32535 from azat/avg-ubsan 
Suppress UBSan errors for avg() function
 2021-12-12 04:32:44 +03:00
Alexey Milovidov
d677a5ab67 Fix perf test 2021-12-12 04:31:56 +03:00
alexey-milovidov
b8a15b666d
Merge pull request #32571 from azat/mv-non-phys-table 
Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers())
 2021-12-12 03:55:51 +03:00
Alexey Milovidov
e58e69923c Fix bad test 2021-12-12 03:55:23 +03:00
Alexey Milovidov
d25b8f4147 Update tests 2021-12-12 03:45:21 +03:00
Alexey Milovidov
58ffe89643 Merge branch 'master' into quote-more-identifiers 2021-12-12 03:33:20 +03:00
alesapin
eb51d9550d
Merge branch 'master' into add_performance_tests 2021-12-12 01:01:13 +03:00
kssenii
a8484ec06d Add test 2021-12-12 00:47:21 +03:00
Vitaly Baranov
463ce1fcee
Merge pull request #27822 from filimonov/kafka_protobuf_issue26643 
Test for issue #26643
 2021-12-11 20:31:22 +03:00
Kseniia Sumarokova
3084d5eac0
Merge pull request #32503 from Vxider/fix-flaky-window-view-tests 
Fix flaky window view tests
 2021-12-11 17:11:26 +03:00
Vitaly Baranov
abe9dd3368
Merge pull request #32531 from vitlibar/fix-nested-array-sizes-for-missing-columns 
Improve handling nested structures with missing columns while reading protobuf
 2021-12-11 11:08:34 +03:00
mergify[bot]
1e28f7340e
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-11 08:05:20 +00:00
Azat Khuzhin
ca9c5dc4eb Fix LOGICAL_ERROR for MATERIALIZED VIEW over table functions (i.e. numbers()) 
Replace LOGICAL_ERROR with QUERY_IS_NOT_SUPPORTED_IN_MATERIALIZED_VIEW
in this case.
 2021-12-11 11:04:47 +03:00
Kseniia Sumarokova
9ede6beca7
Merge pull request #32534 from azat/local-file-table-fix 
Fix processing initial table (--table/stdin) in clickhouse-local
 2021-12-11 10:45:19 +03:00
Kseniia Sumarokova
7e0bc290da
Merge pull request #32460 from kssenii/mongo-extend-auth 
Allow empty credentials for mongo engine
 2021-12-11 10:42:15 +03:00
Vxider
add1e8302e Ping CI 2021-12-11 04:39:13 +00:00
mergify[bot]
f4bcd87382
Merge branch 'master' into fix-flaky-window-view-tests 2021-12-11 02:13:24 +00:00
alexey-milovidov
8fdd7f329e
Merge pull request #32533 from azat/clickhouse-test-log-comment 
clickhouse-test: use basename of the test for *.sh tests
 2021-12-11 02:53:57 +03:00
alexey-milovidov
c90e588e24
Merge pull request #32506 from ClickHouse/fix-has-column-in-table-subquery 
Fix queries with hasColumnInTable constant condition and non existing column
 2021-12-11 02:50:06 +03:00
alexey-milovidov
17e5f5ccfe
Merge pull request #32508 from vdimir/issue_32458 
Handle const column in JoinCommon::removeColumnNullability
 2021-12-11 01:21:10 +03:00
Anton Popov
37837f3881
Merge pull request #32453 from kssenii/disable-optimizations-for-window-functions 
Disable some optimizations for window functions
 2021-12-11 00:37:24 +03:00
Jakub Kuklis
60e06ca34c Changing order of tests to check if that affects failing tests in the CI/CD 2021-12-10 22:04:38 +01:00
Jakub Kuklis
578aec97e9 Removing TODO and NOTE marks used mainly as hooks for review in the PR 2021-12-10 22:04:38 +01:00
Jakub Kuklis
69900ba417 Zero replication support test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
b5db3a307f Cache test, removing spurious imports 2021-12-10 22:04:38 +01:00
Jakub Kuklis
7351325f13 Simple check for files in cloud 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312e5b8c45 Abstracting utility functions from main integration tests for remote disks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
1d5c69b366 Minor tweaks to the test, disabling another slow one 2021-12-10 22:04:38 +01:00
Jakub Kuklis
312ea92989 More integration tests, all pass, at least usually 2021-12-10 22:04:38 +01:00
Jakub Kuklis
afc64c14ce Merging test works correctly 2021-12-10 22:04:38 +01:00
Jakub Kuklis
6dca10e1c5 First integration tests, the one for merging fails for the moment 2021-12-10 22:04:38 +01:00
Jakub Kuklis
e58f74d8dc Connecting to Azurite and invoking simple INSERTs works in the integration test 2021-12-10 22:04:38 +01:00
Jakub Kuklis
8afe69ff93 Comming back to StorageSharedKeyCredential for the integration test, get 400 Bad requests from Azurite when trying to create a container now 2021-12-10 22:04:38 +01:00
Jakub Kuklis
f180a7ba5f Solved Invalid storage account error with connection strings 2021-12-10 22:04:38 +01:00
Jakub Kuklis
abd685e14c Installing azure-storage-blob in the integration tests docker, raising exception when not connected to Azurite, changing ports in the Azurite docker 2021-12-10 22:04:38 +01:00
Jakub Kuklis
008141de36 Enable authentication via StorageSharedKeyCredential 2021-12-10 22:04:38 +01:00
Jakub Kuklis
d51f979c7a Adding endpoint validation 2021-12-10 22:04:38 +01:00
Jakub Kuklis
910db6ca57 Code cleanup addressing PR remarks 2021-12-10 22:04:38 +01:00
Jakub Kuklis
639d8a2b38 Running Azurite docker in the integration test for Blob Storage support 2021-12-10 22:04:37 +01:00
Jakub Kuklis
5ed511f9da Working skeleton for Blob Storage integration test 2021-12-10 22:04:37 +01:00
Jakub Kuklis
24bafe4740 Starting an integration test for Blob Storage 2021-12-10 22:04:37 +01:00
Vitaly Baranov
b5b195f4e2
Merge branch 'master' into kafka_protobuf_issue26643 2021-12-10 23:22:35 +03:00
Alexander Tokmakov
dfa31a6577 fix 2021-12-10 22:38:34 +03:00
Azat Khuzhin
837ff82312 Suppress UBSan errors for avg() function 
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/dd2ccd3b17e7c59ed9c8184f00f8dae85ee87d1f/fuzzer_astfuzzerubsan,actions//report.html
 2021-12-10 22:23:39 +03:00
Azat Khuzhin
fa6090f588 Fix processing initial table (--table/stdin) in clickhouse-local 
This patch will:
- fix the issue when table had been tried to create multiple times for
  --queries-files
- create these table for --interactive mode (before it works only if you
  had some queries already, i.e. when it run interactive after
  non-interactive)

This will also make ClientBase interface a little bit cleaner, by
removing one abstract method getQueryTextPrefix()
 2021-12-10 22:08:03 +03:00
Azat Khuzhin
b1bc5c37c9 tests: split sum_ubsan into avg_ubsan 2021-12-10 21:51:43 +03:00
Azat Khuzhin
2045a4f245 clickhouse-test: use basename of the test for *.sh tests 2021-12-10 21:45:29 +03:00
Azat Khuzhin
9aeaa339c6 Make 01675_distributed_bytes_to_delay_insert less flaky (use http over client) 
client is too heavy in debug builds, switching to http reduces test time
from 22s to 9s overall.

And also drop `_long` suffix form file name, since `clickhouse-test`
support `Tags` in tests.

CI: https://s3.amazonaws.com/clickhouse-test-reports/32303/24751e7d45d94541be854c86ce46d65c2e0f66da/stateless_tests__debug__actions_.html

v2: relax pattern
 2021-12-10 21:43:45 +03:00
Vitaly Baranov
73092942ea Take into account nested structures while filling missing columns while reading protobuf. 2021-12-10 21:11:06 +03:00
vxider
8e3529818e update window view tests 2021-12-10 18:01:54 +00:00
avogar
1be84d80d4 Fix async inserts for some input formats 2021-12-10 20:54:08 +03:00
alesapin
84bccb83bd Trying to add debug info 2021-12-10 19:38:20 +03:00
alesapin
a6e55b00e3
Revert "Revert "Split long tests into multiple checks"" 2021-12-10 18:39:02 +03:00
alesapin
dcbba460c1
Revert "Split long tests into multiple checks" 2021-12-10 18:38:42 +03:00
Vxider
9b88794d82 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix-flaky-window-view-tests 2021-12-10 23:16:56 +08:00
kssenii
3e28581ea4 Extend test 2021-12-10 18:09:02 +03:00
alesapin
a2aa0bc6cc
Merge pull request #32496 from ClickHouse/smaller_checks 
Split long tests into multiple checks
 2021-12-10 17:42:14 +03:00
alesapin
751b2f3a7c
Merge pull request #32479 from Algunenano/01950_increase_timeout 
01950_kill_large_group_by_query: Increase timeout
 2021-12-10 16:38:36 +03:00
tavplubix
9867d75fec
Merge pull request #32464 from ClickHouse/fix-31538 
Fix crash in case of MATERIALIZE COLUMN with no default expression.
 2021-12-10 16:27:53 +03:00
alesapin
4eb2dee857 Don't use tmpfs 2021-12-10 16:09:00 +03:00
vdimir
ed4ea6fe3a
Handle const column in JoinCommon::removeColumnNullability 2021-12-10 15:57:36 +03:00
Nikolai Kochetov
7bf5c83561 Fix queries with hasColumnInTable constant condition and non existing column. 2021-12-10 15:45:04 +03:00
Mikhail f. Shiryaev
6cfb117732
Merge pull request #32421 from ClickHouse/test-16171 
Add a test #16171
 2021-12-10 13:23:29 +01:00
alexey-milovidov
13a3f85ece
Merge pull request #32497 from amosbird/replxxtest1 
Add test for clickhouse-client history navigation
 2021-12-10 15:11:04 +03:00
vdimir
a0488d21d2
Fix test_prometheus_endpoint 2021-12-10 14:58:46 +03:00
vxider
9aa98d7b99 fix flaky window view tests 2021-12-10 11:09:04 +00:00
alesapin
8f8f65e6e0 Fix clickhouse test 2021-12-10 13:30:12 +03:00
alesapin
2c7bb56a2c Split integration tests into parts 2021-12-10 13:22:29 +03:00
tavplubix
79b1fdfee5 disable flaky tests 2021-12-10 13:14:45 +03:00
alesapin
f655b43f5a Merge branch 'master' into add_performance_tests 2021-12-10 12:32:43 +03:00
alesapin
94a557a80e Trying another host 2021-12-10 12:31:09 +03:00
Amos Bird
7638ce558f
Add test 2021-12-10 17:18:21 +08:00
alesapin
32f78f2ba4 Better check name 2021-12-10 12:09:11 +03:00
alesapin
4c1babee05 Split long functional tests to multiple checks 2021-12-10 12:07:24 +03:00
alesapin
dc21d423d1
Merge pull request #32494 from ClickHouse/fix_integration_tests_images 
Fix integration tests docker images path
 2021-12-10 10:56:15 +03:00
alesapin
db83d82f5a Fix integration tests path 2021-12-10 10:54:37 +03:00
Alexey Milovidov
f1f66b7862 Add a test 2021-12-10 01:00:56 +03:00
Ilya Yatsishin
f51406743d
Merge pull request #32477 from Algunenano/02122_better_grep 2021-12-10 00:42:48 +03:00
tavplubix
85e53b1b1f
Try fix attaching gdb in tests (#32448) 
* attach gdb with sudo

* fix

* Update run.sh
 2021-12-10 00:12:45 +03:00
Raúl Marín
ebdcf7e38e 01950_kill_large_group_by_query: Increase timeout 2021-12-09 19:26:29 +01:00
Raúl Marín
c155de5819 02122_parallel_formatting: Address grep binary warnings 2021-12-09 19:00:08 +01:00
Nikolai Kochetov
e41974fabf
Merge branch 'master' into fix-31538 2021-12-09 19:00:22 +03:00
Nikolai Kochetov
272c0bb35a Fix crash in case of MATERIALIZE COLUMN with no default expression. 2021-12-09 18:58:28 +03:00
alesapin
5b06e30ea2
Merge pull request #32462 from ClickHouse/automatic_rerun 
Add automatic workflow rerun
 2021-12-09 18:31:59 +03:00
kssenii
f5a77fca39 Done 2021-12-09 14:44:25 +00:00
Kruglov Pavel
ef42cd6821
Merge pull request #32138 from Avogar/fix-apply-lambda 
Fix 'APPLY lambda' parsing
 2021-12-09 17:09:11 +03:00
Nikolai Kochetov
b3bd9e6a37 Fix arraySlice with null args. 2021-12-09 16:31:13 +03:00
alesapin
19f8b416bc Add automatic workflow rerun 2021-12-09 16:28:15 +03:00
Kseniia Sumarokova
2091008c15
Merge pull request #32324 from Vxider/rename-window-functions 
Rename window functions in WindowView
 2021-12-09 16:19:21 +03:00
kssenii
0bf7330ddc Update test 2021-12-09 15:40:14 +03:00
alesapin
08c699cbdd
Merge pull request #32438 from ClickHouse/fix_image_for_integration_tests 
Fix images names in integration tests
 2021-12-09 15:38:50 +03:00
alesapin
af6ce89e95 Better report 2021-12-09 15:02:13 +03:00
kssenii
40c9ffdfff Disable 2021-12-09 14:15:23 +03:00
Nikita Mikhaylov
dbf5091016
Parallel reading from replicas (#29279) 2021-12-09 13:39:28 +03:00
alesapin
7ea7aa8db8 Fix build check 2021-12-09 12:17:03 +03:00
alesapin
67d89929a3 Add ramdrive 2021-12-09 12:04:05 +03:00
alesapin
b62de9b2f4 Merge branch 'master' into add_performance_tests 2021-12-09 11:40:32 +03:00
mergify[bot]
b11a1ded8d
Merge branch 'master' into rename-window-functions 2021-12-09 08:10:41 +00:00
alesapin
fad3158bf7 Fix images names in integration tests 2021-12-09 10:55:51 +03:00
Alexey Milovidov
e52851d0ed Add a test #16171 2021-12-09 01:15:35 +03:00
Kruglov Pavel
fc382afacb Update test 2021-12-08 21:29:50 +03:00
avogar
417bd12629 Fix 'APPLY lambda' parsing 2021-12-08 21:29:50 +03:00
Azat Khuzhin
5fad4f6204 clickhouse-local: fix CREATE DATABASE with Atomic engine 
Before it fails to create due to "metadata" directory had not been
created, since metadata_path is different for Atomic database, see
InterpreterCreateQuery.cpp.
 2021-12-08 21:23:00 +03:00
Anton Popov
d8367334a3 Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-08 18:26:19 +03:00
Mikhail f. Shiryaev
03927f5fc6
Revert "graphite: split tagged/plain rollup rules (for merges perfomance)" 
This reverts commit 303552f515.
 2021-12-08 15:49:21 +01:00
Nikita Mikhaylov
9a6a1379fd
Merge pull request #32358 from nikitamikhaylov/mutation-livelock 
Fixed empty mutations livelock
 2021-12-08 15:43:19 +03:00
Anton Popov
ef58a43c4f better test 2021-12-08 15:36:19 +03:00
Nikolai Kochetov
4e6bf2456c
Merge pull request #32327 from ClickHouse/revert-32326-revert-32122-add-test-with-many-mutations 
Revert "Revert "Add a test with 20000 mutations in one query""
 2021-12-08 14:23:39 +03:00
Nikolai Kochetov
07b2d69ea2 Another try. 2021-12-08 14:22:43 +03:00
Kruglov Pavel
e0a8c5a4ac
Merge pull request #32348 from CurtizJ/fix-materialize-column 
Add cast to `MATERIALIZE COLUMN`
 2021-12-08 11:13:17 +03:00
mergify[bot]
ed0c36bf32
Merge branch 'master' into rename-window-functions 2021-12-07 21:04:53 +00:00
mergify[bot]
f0d6fe53c9
Merge branch 'master' into mutation-livelock 2021-12-07 18:29:07 +00:00
Nikolai Kochetov
2c6cb902c4 Revert "Better fix." 
This reverts commit f07fc08a49.
 2021-12-07 20:54:49 +03:00
Anton Popov
dd7387729b fix usage of non-materialized skip indexes 2021-12-07 20:21:27 +03:00
tavplubix
4f46ac6b30
Remove LeaderElection (#32140) 
* remove LeaderElection

* try fix tests

* Update test.py

* Update test.py
 2021-12-07 19:55:55 +03:00
Nikita Mikhaylov
76f91c2c6c Done 2021-12-07 16:50:57 +00:00
Anton Popov
ef7ae7cb75 fix MATERIALIZE COLUMN in case when data type of expression is not equal to data type of column 2021-12-07 16:45:30 +03:00
Nikolai Kochetov
877716b2b0
Update 02125_many_mutations.sh 2021-12-07 15:46:19 +03:00
tavplubix
6c16348faa
Fix division by zero in avgWeighted with Decimal argument (#32303) 
* fix division by zero

* Update src/AggregateFunctions/AggregateFunctionAvg.h

Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>

* remove trash

* Update AggregateFunctionAvg.h

Co-authored-by: Dmitry Novik <n0vik@clickhouse.com>
 2021-12-07 13:32:26 +03:00
tavplubix
523e23cfcd
Merge pull request #32164 from azat/stress-ignore-mem-limit 
Fix stress tests
 2021-12-07 13:10:17 +03:00
Nikolai Kochetov
deb6a06ce4
Update 02125_many_mutations.sh 2021-12-07 12:18:26 +03:00
Mikhail f. Shiryaev
5fc20b3e6a
Merge pull request #25122 from msaf1980/rollup_rules_type 
GraphiteMergeTree Rollup rules type
 2021-12-07 10:18:08 +01:00
Nikolai Kochetov
5717458f0c
Revert "Revert "Add a test with 20000 mutations in one query"" 2021-12-07 12:12:41 +03:00
Nikolai Kochetov
9b9d524359
Revert "Add a test with 20000 mutations in one query" 2021-12-07 12:12:20 +03:00
Stig Bakken
bb521cd363 Add TABLE OVERRIDE feature for MaterializedMySQL databases 2021-12-07 09:45:02 +01:00
vxider
c4c517bb8a rename window functions 2021-12-07 08:14:00 +00:00
dongyifeng
9df664e1c9
fix bug when remove unneeded columns in subquery (#32289) 2021-12-07 11:09:39 +03:00
Kseniia Sumarokova
e2cf5c6075
Merge pull request #32232 from Vxider/fix-window-view-parser 
Fix window view parser
 2021-12-06 23:33:43 +03:00
Kseniia Sumarokova
7e261245d3
Merge pull request #32256 from taiyang-li/default_for_hdfs 
Support default expression for storage hdfs and optimize fetching when source is column oriented
 2021-12-06 23:32:01 +03:00
Nikolai Kochetov
ca5b6ce654
Merge pull request #32122 from ClickHouse/add-test-with-many-mutations 
Add a test with 20000 mutations in one query
 2021-12-06 22:09:26 +03:00
Nikolai Kochetov
f07fc08a49 Better fix. 2021-12-06 22:08:32 +03:00
tavplubix
657db07795
Merge pull request #32288 from ClickHouse/fix_xml_dict_cyclic_dependency 
Fix cyclic dependency with XML dictionary and StorageDictionary
 2021-12-06 20:02:38 +03:00
Nikolai Kochetov
ce568bff90 Merge branch 'master' into fix-31114 2021-12-06 19:47:13 +03:00
msaf1980
303552f515
graphite: split tagged/plain rollup rules (for merges perfomance) 2021-12-06 16:49:08 +01:00
vxider
ee8a160790 enable window view tests 2021-12-06 14:26:39 +00:00
vxider
2f4f2d9d5e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2021-12-06 14:06:00 +00:00
Alexander Tokmakov
7797a72907 fix false-positive ciclyc dependency with XML dict 2021-12-06 16:35:43 +03:00
mergify[bot]
52904a4973
Merge branch 'master' into default_for_hdfs 2021-12-06 13:19:49 +00:00
Kruglov Pavel
007e323515
Merge pull request #31820 from kitaisreal/fix-recursive-user-defined-functions-crash 
Fix recursive user defined functions crash
 2021-12-06 13:52:56 +03:00
Kruglov Pavel
64263a043a
Merge pull request #32190 from Avogar/fix-parsing-quoted-null 
Fix parsing error in NaN deserialization for Quoted escaping rule.
 2021-12-06 12:29:02 +03:00
Kruglov Pavel
cc71c537bc
Merge pull request #32204 from Avogar/skip-quoted-values 
Improve skiping unknown fields with Quoted escaping rule in Template/CustomSeparated formats
 2021-12-06 12:28:14 +03:00
alexey-milovidov
50c23a9fd6
Merge pull request #31123 from amosbird/repl-improvement 
Better clickhouse-client multiline input
 2021-12-06 12:22:13 +03:00
vxider
5bab484422 increase sleep time in tests 2021-12-06 08:50:10 +00:00
Nikolai Kochetov
91c4c89c66
Merge pull request #31636 from Algunenano/pull_timeout 
Check max_execution_time in the pipeline and pulling executors
 2021-12-06 11:33:39 +03:00
Kseniia Sumarokova
cf2c602374
Merge pull request #32257 from kssenii/disable-window-view-sqltests 
Disable window view tests temporarily because still flacky
 2021-12-06 11:18:40 +03:00
Vladimir C
c502454088
Merge pull request #32185 from kitaisreal/range-hashed-dictionary-added-update-field-support 2021-12-06 10:57:47 +03:00
kssenii
2220d1784c Disable 2021-12-06 10:49:44 +03:00
Maksim Kita
b9718b8450
Merge pull request #32118 from kitaisreal/fix-test-executable-storage-input 
Fix flacky test test_executable_storage_input
 2021-12-06 10:39:30 +03:00
Azat Khuzhin
d68d01988e clickhouse-test: apply --client-option in get_stacktraces_from_clickhouse() 2021-12-06 09:02:56 +03:00
taiyang-li
9d1e63be0f 1. support default expression for storage hdfs; 2. optimize storage hdfs when format is column oriented 2021-12-06 11:54:45 +08:00
Azat Khuzhin
428e34d811 Fix versioning of aggregate functions (fixes performance tests) 2021-12-05 21:45:07 +03:00
Vitaly Baranov
d709782088
Merge pull request #31988 from vitlibar/fix-skipping-columns-while-writing-protobuf 
Fix skipping columns while writing protobuf
 2021-12-05 18:01:11 +03:00
Maksim Kita
4077d769e7
Merge pull request #31949 from Algunenano/parser_speedup 
Speedup query parsing
 2021-12-05 16:24:45 +03:00
Denny Crane
bee41ee39a test for #28280 2021-12-04 21:15:53 -04:00
Vitaly Baranov
15e3dbe3f2 Fix skipping columns in Nested while writing protobuf. 2021-12-04 18:00:02 +03:00
vxider
c522c06755 fix windowview parser 2021-12-04 12:30:04 +00:00
Kseniia Sumarokova
ae214ffc5b
Merge pull request #32222 from kssenii/fix-remaining-window-tests 
Add missing timezones to some tests
 2021-12-04 12:29:06 +03:00
alexey-milovidov
d4c7f24744
Merge pull request #32203 from Algunenano/master_i32186 
Add test for #32186
 2021-12-04 00:54:21 +03:00
kssenii
1cc5dd7979 Fix 2021-12-03 23:36:35 +03:00
Kseniia Sumarokova
d38d2ba14f
Merge pull request #32178 from kssenii/fix-window-view-tests 
Fix window view tests
 2021-12-03 18:45:44 +03:00
Raúl Marín
d1f0b249d3 Fix style 2021-12-03 14:50:33 +01:00
mergify[bot]
ca59d823cf
Merge branch 'master' into fix-parsing-quoted-null 2021-12-03 13:39:27 +00:00
avogar
7549619b25 Improve skiping unknown fields with Quoted escaping rule in Template/CustomSeparated formats 2021-12-03 16:25:35 +03:00
Raúl Marín
0c1e89b043 Add test 2021-12-03 14:18:01 +01:00
kssenii
adaa32b41b Fix inner table name 2021-12-03 15:52:57 +03:00
avogar
4f136cb30c Fix NaN deserialization for Quoted escaping rule 2021-12-03 15:37:39 +03:00
alesapin
a625dd41e8
Merge branch 'master' into better_logs 2021-12-03 15:31:45 +03:00
Maksim Kita
4bbb02bbae RangeHashedDictionary added update_field support 2021-12-03 14:06:58 +03:00
kssenii
0470525ea3 Fix 2021-12-03 13:39:27 +03:00
mergify[bot]
48ed754fab
Merge branch 'master' into use_ccache_in_fast_test 2021-12-03 10:28:03 +00:00
Constantine Peresypkin
7c90d4f8e3 refactor CI tests 2021-12-03 12:22:50 +02:00
Maksim Kita
ca2a70cd8d
Merge pull request #32080 from azat/cast-fix-ubsan 
Fix CAST from Nullable with cast_keep_nullable
 2021-12-03 13:05:38 +03:00
alesapin
caa481aba8 Use ccache in fast test 2021-12-03 12:28:17 +03:00
alesapin
99a5ca2646 Fix style (got tired of it) 2021-12-03 12:19:39 +03:00
Kruglov Pavel
17d6f539b3
Merge pull request #32019 from azat/dist-desc 
Fix excessive DESC TABLE for remote() over identifier
 2021-12-03 12:15:05 +03:00
mergify[bot]
51b8148cc0
Merge branch 'master' into fix-test-executable-storage-input 2021-12-03 09:11:05 +00:00
Maksim Kita
74979a5f01
Merge pull request #31095 from amosbird/addprojection 
Function name normalization for ALTER queries
 2021-12-03 12:07:07 +03:00
SuperDJY
5d7dfc6eb9
fix storage join settings with persistency (#32066) 2021-12-03 12:06:58 +03:00
Kruglov Pavel
3d047747ed
Merge pull request #32123 from Avogar/fix-tests 
Change test 02117_custom_separated_with_names_and_types
 2021-12-03 12:06:50 +03:00
alesapin
ec0bfa7bcf Better output for some actions 2021-12-03 11:33:16 +03:00
alesapin
7699d3f35e
Merge pull request #32162 from azat/double-gz 
tests/ci: do not compress logs twice
 2021-12-03 10:20:35 +03:00
alesapin
83c086b051
Merge pull request #32120 from ClickHouse/add_one_more_group 
Move fuzzers and unit tests to another group
 2021-12-03 10:14:09 +03:00
Kseniia Sumarokova
a8dcbc988a
Merge pull request #32129 from kssenii/fix-postgres-tests 
fixing postgres tests
 2021-12-03 09:15:20 +03:00
alexey-milovidov
b7fb21e6f0
Merge pull request #32163 from azat/clickhouse-test-random 
clickhouse-test: do not use random generator with shared state
 2021-12-03 06:53:57 +03:00
Azat Khuzhin
344298f403 Fix CAST from Nullable with cast_keep_nullable 
UBsan report [1]:

    SELECT toUInt32OrDefault(toNullable(0)) SETTINGS cast_keep_nullable = 1

    ../src/Common/assert_cast.h:50:12: runtime error: downcast of address 0x000029461170 which does not point to an object of type 'const DB::ColumnNullable'
    0x000029461170: note: object is of type 'DB::ColumnVector<unsigned int>'
     00 00 00 00  a0 51 3d 09 00 00 00 00  01 00 00 00 00 00 00 00  a0 3f 4e 29 00 00 00 00  a4 3f 4e 29
                  ^~~~~~~~~~~~~~~~~~~~~~~
                  vptr for 'DB::ColumnVector<unsigned int>'
        0 0x1e3e279d in DB::ColumnNullable const& assert_cast<DB::ColumnNullable const&, DB::IColumn const&>(DB::IColumn const&) obj-x86_64-linux-gnu/../src/Common/assert_cast.h:50:12
        1 0x1e3e279d in DB::ColumnNullable::insertRangeFrom(DB::IColumn const&, unsigned long, unsigned long) obj-x86_64-linux-gnu/../src/Columns/ColumnNullable.cpp:167:43
        2 0x12db4507 in DB::FunctionCastOrDefault::executeImpl() const (/src/ch/tmp/32019/clickhouse-ubsan+0x12db4507)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32019/9e1222a50b1805f696f4205e451365f8acdbc8a5/fuzzer_astfuzzerubsan,actions//report.html

And w/o -fsanitize=undefined:

    SELECT toUInt32OrDefault(toNullable(1), toNullable(toUInt32(1))) SETTINGS cast_keep_nullable = 1

    Received exception:
    Code: 12. DB::Exception: Parameters start = 0, length = 1 are out of bound in ColumnVector<T>::insertRangeFrom method (data.size() = 0).: While processing toUInt32OrDefault(toNullable(1), toNullable(toUInt32(1))). (PARAMETER_OUT_OF_BOUND)
 2021-12-03 02:02:42 +03:00
Anton Popov
f6be3d16fd
Merge pull request #24820 from kssenii/versioning 
Versioning of aggregate function states
 2021-12-03 01:41:44 +03:00
Azat Khuzhin
9276384977 clickhouse-test: do not use random generator with shared state 
Recently (#32094) test database had been overlapped, and random prefix
for database had been increased from 6 to 8.

But actually 6 bytes for random prefix should be enough (with existing
alphabet (0-9a-z) it is 36**6=2'176'782'336), and the real reason of
this overlap is that random generator by default uses shared state [1]:

    The functions supplied by this module are actually bound methods of
    a hidden instance of the random.Random class. You can instantiate your
    own instances of Random to get generators that don’t share state.

  [1]: https://docs.python.org/3/library/random.html

I've played a little bit with random in python, and using default random
generator it generates non-unique strings pretty fast, just in a few
runs, but using SystemRandom (that uses /dev/urandom) it takes ~1 minute.

Test:

```sh
    $ while /tmp/test.py | LANG=c sort -S5G | LANG=c uniq -d | tee /dev/stderr | wc -l | fgrep -q -x -c 0; do :; done
```

```python
    #!/usr/bin/env python3

    import multiprocessing
    import string
    import random

    def random_str(length=6):
        alphabet = string.ascii_lowercase + string.digits
        return ''.join(random.SystemRandom().choice(alphabet) for _ in range(length))

    def worker(_):
        print(random_str())

    with multiprocessing.Pool(processes=2) as pool:
        pool.map(worker, range(0, int(10e3)))
```

So let's switch to SystemRandom and use 6-byte prefix.
 2021-12-03 01:29:23 +03:00
Azat Khuzhin
bfaaa79cfc tests/ci: do not compress logs twice 
Cc: @alesapin
 2021-12-03 01:28:32 +03:00
kssenii
06312a2df9 Fix 2021-12-02 22:48:21 +03:00
mergify[bot]
e2cb91b560
Merge branch 'master' into add_one_more_group 2021-12-02 19:28:13 +00:00
alesapin
45021bd35c
Merge pull request #32121 from ClickHouse/add_assertion_in_keeper 
Add check for duplicate hostnames and IDs in KeeperConfig
 2021-12-02 22:24:46 +03:00
alesapin
f2140be90b Fix CI 2021-12-02 22:03:59 +03:00