Commit Graph

18910 Commits

Author SHA1 Message Date
alesapin
62e7a89f26 Proper fix for ipv4/ipv6 conversion error 2022-06-29 17:53:08 +02:00
Maksim Kita
45c18145ec Fixed tests 2022-06-29 17:51:27 +02:00
Nikita Taranov
41460dcaca
quick fix for 02112_with_fill_interval
Seems like the problem is that now data more often come to FillingTransform in multiple chunks. Don't know why it affects the results, will continue investigation.
2022-06-29 17:37:29 +02:00
Yatsishin Ilya
f4691b0b00 fix black 2022-06-29 15:08:24 +00:00
Yatsishin Ilya
6f6e814542 Fix test_dictionaries_postgresql 2022-06-29 14:18:12 +00:00
mergify[bot]
36139eacd7
Merge branch 'master' into dictinct_in_order_optimization 2022-06-29 13:37:16 +00:00
Igor Nikonov
3627c6ff36 Perf tests with high cardinality 2022-06-29 13:13:39 +00:00
Yatsishin Ilya
c86c6cc2d9 Improve postgres tests. Fix flaky test_postgresql_database_engine 2022-06-29 12:54:45 +00:00
Anton Popov
c5e0869c46
fix flaky test 2022-06-29 14:20:26 +02:00
Anton Popov
e78814f3bb
Merge pull request #38371 from CurtizJ/fix-distint-with-limit
Fix `DISTINCT` with `LIMIT` in distributed queries
2022-06-29 14:02:41 +02:00
Alexander Tokmakov
8246e55002
Merge pull request #38486 from azat/fix-parts-removal
Fix parts removal after incorrect server shutdown
2022-06-29 14:17:59 +03:00
Kruglov Pavel
b9813bcdea
Merge pull request #38356 from kssenii/fix-rabbitmq-with-peekable
Fix RabbitMQ with formats based on PeekableReadBuffer
2022-06-29 13:06:10 +02:00
mergify[bot]
9482c99ab8
Merge branch 'master' into sql-insert-format 2022-06-29 11:03:07 +00:00
Alexander Tokmakov
c3573532c0
Merge pull request #38487 from ClickHouse/add_some_tsa_annotations
Add some TSA annotations
2022-06-29 13:57:10 +03:00
Mikhail f. Shiryaev
498a9cc8d4
Terminate instance if docker does not start on post-hook 2022-06-29 12:54:33 +02:00
Alexander Tokmakov
ceb66ade4b
Merge pull request #38335 from ClickHouse/deprecate_ordinary_database
Deprecate Ordinary database and old *MergeTree syntax
2022-06-29 13:42:59 +03:00
Kruglov Pavel
5cc662f227
Merge pull request #38511 from azat/fix-schema_inference_with_globs
tests: fix 02305_schema_inference_with_globs flakiness
2022-06-29 12:39:38 +02:00
Maksim Kita
23e09b5e9b
Merge pull request #35166 from zhangjmruc/sql_compatible_create_drop_index
Support SQL compatible create/drop index syntax
2022-06-29 12:30:28 +02:00
Mikhail f. Shiryaev
80e7abd0fe
Merge pull request #38548 from excitoon-favorites/ci-integration-tests-test
Don't spoil return code of integration tests runner with redundant tee
2022-06-29 11:18:53 +02:00
Maksim Kita
00372e4646 Fixed tests 2022-06-29 11:05:36 +02:00
Alexander Tokmakov
2aa6c66a2e
Merge pull request #38488 from azat/fix-02335_column_ttl_expired_column_optimization
tests: cleanup tmp data in 02335_column_ttl_expired_column_optimization
2022-06-29 12:05:23 +03:00
Alexey Milovidov
0d27672ac8
Merge pull request #38440 from xiedeyantu/allow_trailing_comma
Allow trailing comma in columns list
2022-06-29 09:47:09 +03:00
Alexey Milovidov
dea3b5bfce
Revert "Non Negative Derivative window function" 2022-06-29 08:56:15 +03:00
Kseniia Sumarokova
71e9363baf
Fix black 2022-06-29 07:32:27 +02:00
Vladimir Chebotarev
f7ef571842 Don't spoil return code of integration tests runner with redundant tee. 2022-06-29 06:11:09 +03:00
jianmei zhang
d6b0bc2942 Add test case 2022-06-29 11:08:05 +08:00
lgbo-ustc
ee30c4a3f7 update test scripts 2022-06-29 10:23:00 +08:00
lgbo-ustc
7274169c33 update test scripts 2022-06-29 10:03:10 +08:00
Nikita Taranov
f5d26572df
Quick fix for aggregation pipeline (#38295) 2022-06-29 01:16:30 +02:00
Azat Khuzhin
4a52d3f6b9 tests: update reference for 00597_push_down_predicate_long
CI: https://s3.amazonaws.com/clickhouse-test-reports/37887/6b4613c88056f3901f6d8a832c9e2bc15e22206d/stateless_tests__aarch64__actions_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-28 22:53:03 +03:00
Azat Khuzhin
563fac5333 tests: add a test for incorrect header in UNION queries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-28 22:53:03 +03:00
Azat Khuzhin
1648cd0eb0 tests: cleanup tmp data in 02335_column_ttl_expired_column_optimization
v2: remove trap usage as requested by @tavplubix
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-28 22:43:09 +03:00
Julian Gilyadov
d0d72e0b5e
Implement L2Squared Distance and Norm 2022-06-28 15:28:58 -04:00
Maksim Kita
2b11c0daa9 Updated tests 2022-06-28 19:26:15 +02:00
Mikhail f. Shiryaev
e1ac7477c9
Avoid killing terminate-instances task 2022-06-28 17:51:47 +02:00
mergify[bot]
4a1fefb42d
Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:49:52 +00:00
Alexander Tokmakov
e23f1fa774
Merge pull request #38269 from excitoon-favorites/integrationtestsfixes
Don't try to kill empty list of containers in `integration/runner` II
2022-06-28 17:35:48 +03:00
Alexander Tokmakov
4f54abf67f better names for macros 2022-06-28 16:27:18 +02:00
Anton Popov
58c8facebb minor fixes 2022-06-28 14:21:21 +00:00
mergify[bot]
bed1f68c74
Merge branch 'master' into sql-insert-format 2022-06-28 14:20:31 +00:00
Alexander Tokmakov
021bdc335e Merge branch 'master' into add_some_tsa_annotations 2022-06-28 15:42:01 +02:00
Alexander Tokmakov
428628238f Merge branch 'master' into deprecate_ordinary_database 2022-06-28 15:40:33 +02:00
Alexander Tokmakov
b134f53118 fix tests 2022-06-28 14:39:22 +02:00
Alexander Tokmakov
2f45a6ebaa
Update test.py 2022-06-28 15:18:30 +03:00
Alexander Tokmakov
2386554746
Merge pull request #38490 from ClickHouse/test-handle-full-queue
Handle full queue exception in tests
2022-06-28 15:03:10 +03:00
Alexander Tokmakov
07cecd4e66
Merge pull request #38516 from ClickHouse/fix_flaky_store_cleanup
Try to fix flaky test
2022-06-28 14:56:54 +03:00
kssenii
4c99f608b3 Fix 2022-06-28 13:18:21 +02:00
Kruglov Pavel
ccdeaea2f0
Update 01378_alter_rename_with_ttl_zookeeper.sql 2022-06-28 13:06:49 +02:00
avogar
3b4ecc93bc Fix test and style 2022-06-28 10:48:20 +00:00
Azat Khuzhin
9f147bde39 tests: allow 02305_schema_inference_with_globs to run in parallel
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-28 13:45:55 +03:00
Azat Khuzhin
1f42bf9bb3 tests: fix 02305_schema_inference_with_globs flakiness
Order of files on disk is not guarantee to match with:
- order of creation
- lexical order

So sometimes 02305_data4.jsonl comes first and 2 rows is enough to get
schema.

Reorganize checks a little to avoid flakiness.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-28 13:45:55 +03:00
Alexander Tokmakov
0c51bd9c23 fix flaky test 2022-06-28 12:38:36 +02:00
Mikhail f. Shiryaev
94f932add1
A tiny improvement in logging 2022-06-28 10:27:25 +02:00
larryluogit
3e48c1d765
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-27 22:40:43 -04:00
Alexander Tokmakov
851534c9f7 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 23:47:49 +02:00
Azat Khuzhin
e70cff2cea Fix parts removal after incorrect server shutdown
Before this patch, and after transaction support had been added #24258,
if the server had not removed old parts on shutdown, then they will left
forever.

Fixes: #24258 (cc @tavplubix)
v2: use Tx::PrehistoricTID over removePartsFromWorkingSet() from ctor
v3: apply black to new test
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-06-27 23:56:25 +03:00
Dmitry Novik
c24c041b12 Handle full queue exception in tests 2022-06-27 20:54:52 +00:00
Alexander Tokmakov
f4883f1f7e add some TSA aanotations 2022-06-27 22:48:27 +02:00
mergify[bot]
a9c1b68034
Merge branch 'master' into dictinct_in_order_optimization 2022-06-27 20:16:00 +00:00
Vladimir Chebotarev
89dc2844db Fix for integration tests fix. 2022-06-27 23:13:40 +03:00
avogar
9bb68bc6de Add SQLInsert output format 2022-06-27 18:31:57 +00:00
Yakov Olkhovskiy
d5f65ece9b
Merge pull request #38105 from arenadata/ADQM-419
Add kerberosInit function as a replacement for kinit executable calls in Kafka and HDFS
2022-06-27 14:19:24 -04:00
Alexander Tokmakov
2283436d24
Merge pull request #38344 from Algunenano/implicit_transactions
Add implicit_transaction setting
2022-06-27 18:50:37 +03:00
Alexander Tokmakov
fe1b1aa77b fix my favorite check 2022-06-27 16:16:06 +02:00
Alexander Tokmakov
88dbbcb15d fix tests 2022-06-27 16:10:00 +02:00
Alexander Tokmakov
bec921c9d9
Merge pull request #38265 from ClickHouse/cleanup_garbage_in_store_dir
Add background cleanup of store/ subdirs
2022-06-27 16:53:13 +03:00
Alexander Tokmakov
7c37079a96 Merge branch 'master' into deprecate_ordinary_database 2022-06-27 14:46:59 +02:00
Mikhail f. Shiryaev
6a67ba91cf
Add public hostname for runner 2022-06-27 14:46:28 +02:00
Mikhail f. Shiryaev
f2611c3707
Refresh team keys for each runner 2022-06-27 14:45:50 +02:00
Mikhail f. Shiryaev
9dffe573bb
Reduce amount of docker logs on the runner 2022-06-27 14:44:59 +02:00
Alexander Tokmakov
c4d815c60b
Update test.py 2022-06-27 15:44:20 +03:00
Anton Kozlov
5f81bcd84f
CLICKHOUSE-1331 Rewrite tuple functions as literals in backwards-compatibility mode (#38096)
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-06-27 14:13:21 +02:00
Mikhail f. Shiryaev
7297e468d5
Migrate team-keys lambda to zip archives deployment 2022-06-27 14:00:32 +02:00
Nikita Taranov
2487ba7f00
Move updateInputStream to ITransformingStep (#37393) 2022-06-27 13:16:52 +02:00
mergify[bot]
da52780cb5
Merge branch 'master' into implicit_transactions 2022-06-27 09:46:34 +00:00
Maksim Kita
3ebe6a03b1
Revert "Revert "Fix optimization in PartialSortingTransform (SIGSEGV and possible incorrect result)"" 2022-06-27 10:37:19 +02:00
lgbo-ustc
44b68dd651 update test case 2022-06-27 16:23:04 +08:00
xiedeyantu
c768e22e24 update 2022-06-27 13:17:22 +08:00
Vladimir Chebotarev
2b19e69930 Don't try to kill empty list of containers in integration/runner. 2022-06-27 06:12:10 +03:00
lgbo-ustc
a3cb066eff update test case 2022-06-27 09:38:12 +08:00
Igor Nikonov
edd29707ca Some polishing 2022-06-26 21:44:10 +00:00
Igor Nikonov
68927dd60c Adapt distinct for sorted chunks to handle sorted stream, so we can use
it for final distinct as well
2022-06-26 14:52:36 +00:00
larryluogit
b32cf5da4a
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-26 10:21:21 -04:00
Larry Luo
8dd6f09cf1 fix style check error 2022-06-26 07:19:22 -07:00
xiedeyantu
7e660933f0 add allow trailing comma test 2022-06-26 21:39:53 +08:00
mergify[bot]
f63c959679
Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-26 13:35:10 +00:00
Igor Nikonov
aca6a6f1b0 Merge remote-tracking branch 'origin/master' into dictinct_in_order_optimization 2022-06-26 09:45:59 +00:00
Igor Nikonov
1140cf6fb5 Fixes:
+ test warning
+ proper capacity for column positions array in DistinctTransform
2022-06-26 09:43:31 +00:00
Alexey Milovidov
b3098822e0
Merge pull request #38171 from ClickHouse/hyper-to-vectorscan
Replace hyperscan by vectorscan
2022-06-26 10:01:45 +03:00
Mikhail f. Shiryaev
1d661d0bad
Merge pull request #38343 from ClickHouse/integration-tests-proxy
Upload logs for getting all tests command
2022-06-25 14:08:45 +02:00
Kseniia Sumarokova
901e8cfc6c
Update test.py 2022-06-25 11:24:11 +02:00
Kseniia Sumarokova
0d626982ee
Merge pull request #38369 from kssenii/fix-pg-compatibility
Fix postgres database engine possible incompatibility on upgrade
2022-06-25 11:18:46 +02:00
Kseniia Sumarokova
3c70e07fe9
Merge pull request #38366 from kssenii/fix-pg-ndim-with-schema
Fix postgres engine not using pg schema when retrieving array dimension size
2022-06-25 11:14:01 +02:00
Alexey Milovidov
0654684bd4 Fix wrong implementation of filesystem* functions 2022-06-25 06:10:50 +02:00
larryluogit
a21e4117da
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-24 22:58:43 -04:00
Alexey Milovidov
370a0eb458
Merge pull request #38159 from zvonand/zvonand-base58
Add Base58 encoding/decoding
2022-06-25 02:35:28 +03:00
mergify[bot]
b65cf4e1fe
Merge branch 'master' into dictinct_in_order_optimization 2022-06-24 22:52:14 +00:00
Igor Nikonov
d5c6f5c18f Fixes
+ flaky test with explain pipeline
+ consider sort direction from read order info in sort description
  (ReadFromMergeTree step)
2022-06-24 22:49:27 +00:00
Alexander Gololobov
189d0fffb8
Merge pull request #37165 from ClickHouse/merge_tree_reader
Merge tree reader support for multiple read/filter steps: row level filter, prewhere, ...
2022-06-24 21:32:31 +02:00
Andrey Zvonov
ea73d9c492
Merge branch 'master' into zvonand-base58 2022-06-24 21:37:20 +03:00
Kseniia Sumarokova
a003d01295
Update test.py 2022-06-24 19:35:23 +02:00
Alexander Tokmakov
94dd80e900 fix tests 2022-06-24 19:10:33 +02:00
Alexander Tokmakov
31dcc7634e Merge branch 'master' into deprecate_ordinary_database 2022-06-24 18:16:07 +02:00
Alexander Tokmakov
379fecf7f9 try suppress failures with MaterializedPostgreSQL 2022-06-24 17:15:15 +02:00
Anton Popov
5e89a7025c
Merge pull request #38279 from kssenii/add-cache-command
Add describe query to show cache settings from config, add show caches query
2022-06-24 16:31:12 +02:00
Kruglov Pavel
0201d62090
Merge pull request #38173 from Avogar/fix-short-circuit
Fix bug with nested short-circuit functions
2022-06-24 16:04:17 +02:00
mergify[bot]
53b1d2ca95
Merge branch 'master' into merge_tree_reader 2022-06-24 13:39:00 +00:00
Alexander Tokmakov
b75828768b Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-24 15:32:42 +02:00
Alexander Tokmakov
36af27b7c0
Merge pull request #38377 from ClickHouse/revert-36103-uring
Revert "Add support for io_uring read method"
2022-06-24 16:29:35 +03:00
mergify[bot]
36b93772b9
Merge branch 'master' into merge_tree_reader 2022-06-24 13:22:53 +00:00
zvonand
fdb4eb2552 fixed tests 2022-06-24 17:23:01 +05:00
Alexander Gololobov
d1f5645882
Merge pull request #38354 from ClickHouse/list_recursive
Added --recursive to clickhouse-disks list
2022-06-24 13:56:29 +02:00
alesapin
2a50b35e9b
Merge pull request #38351 from ClickHouse/fix_test
Followup test fix for ban projections
2022-06-24 12:16:48 +02:00
Igor Nikonov
8e1587acb8 Fix: flaky test 2022-06-24 09:34:54 +00:00
Alexander Tokmakov
cfe0e434e5
Revert "Add support for io_uring read method" 2022-06-24 12:19:41 +03:00
Robert Schulze
2c828338f4
Replace hyperscan by vectorscan
This commit migrates ClickHouse to Vectorscan. The first 10 min of
[0] explain the reasons for it.

(*) Addresses (but does not resolve) #38046

(*) Config parameter names (e.g. "max_hyperscan_regexp_length") are
    preserved for compatibility. Likewise, error codes (e.g.
    "ErrorCodes::HYPERSCAN_CANNOT_SCAN_TEXT") and function/class names (e.g.
    "HyperscanDeleter") are preserved as vectorscan aims to be a drop-in
    replacement.

[0] https://www.youtube.com/watch?v=KlZWmmflW6M
2022-06-24 10:47:52 +02:00
Andrey Zvonov
c18d09a617
Merge branch 'master' into zvonand-base58 2022-06-24 07:05:49 +03:00
Anton Popov
a2158066f2 fix distinct with limit in distributed queries 2022-06-24 02:32:40 +00:00
Alexander Gololobov
addfe5f209 Added test for list --recursive 2022-06-24 03:51:39 +02:00
kssenii
6cb1d60883 Fix 2022-06-24 03:24:54 +02:00
Kseniia Sumarokova
0b1ce49b6f
Update 02344_describe_cache.sql 2022-06-24 03:02:13 +02:00
kssenii
a3823c67ee Fix 2022-06-24 02:44:22 +02:00
Kseniia Sumarokova
867982a9fd
Update test.py 2022-06-24 01:49:47 +02:00
Kseniia Sumarokova
ac4ad66985
Update 02344_describe_cache.sql 2022-06-24 00:05:07 +02:00
Alexey Milovidov
812ab9bd6b
Merge pull request #36103 from sauliusvl/uring
Add support for io_uring read method
2022-06-24 00:34:29 +03:00
larryluogit
fd60065720
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-23 17:32:18 -04:00
Alexander Tokmakov
3f4a09478d
Revert "Fix optimization in PartialSortingTransform (SIGSEGV and possible incorrect result)" 2022-06-23 23:01:11 +03:00
Alexander Tokmakov
74f38710a8 Merge branch 'master' into cleanup_garbage_in_store_dir 2022-06-23 21:43:28 +02:00
Alexander Tokmakov
09f09bd96d apply trash-formatter 2022-06-23 21:40:05 +02:00
kssenii
6fbd49f554 Merge master 2022-06-23 21:40:01 +02:00
Alexander Tokmakov
dbf2763788 automatically convert system database to Atomic 2022-06-23 21:38:43 +02:00
Alexander Tokmakov
0d304f7b8c fix tests 2022-06-23 21:19:07 +02:00
Larry Luo
f52dd0ead8 Merge branch 'add-tlsv1_3-test' of github.com:ClibMouse/ClickHouse into add-tlsv1_3-test 2022-06-23 12:16:16 -07:00
Larry Luo
1239ee4b31 update ssl config 2022-06-23 12:11:18 -07:00
larryluogit
0258200f59
Merge branch 'ClickHouse:master' into add-tlsv1_3-test 2022-06-23 15:05:26 -04:00
kssenii
fe0ab845f5 Update tests 2022-06-23 21:00:44 +02:00
Kseniia Sumarokova
40a4742f93
Merge pull request #38319 from kssenii/fix-access-for-drop-fs-cache
Add access check and on cluster option for system drop fs cache
2022-06-23 20:56:44 +02:00
Larry Luo
191936a806 clean up comments 2022-06-23 11:50:06 -07:00
kssenii
e362e4fff1 Fix 2022-06-23 20:48:32 +02:00
Larry Luo
2339906e2a Adding TLS V13 Test 2022-06-23 11:30:00 -07:00
Alexey Milovidov
e7c8023ef5
Merge pull request #38201 from ClickHouse/revert-35914-FIPS_compliance
Revert "ClickHouse's boringssl module updated to the official version of the FIPS compliant."
2022-06-23 20:22:03 +03:00
alesapin
345c899983 Suppress 2022-06-23 18:38:43 +02:00
alesapin
24974d177d Followup 2022-06-23 18:36:10 +02:00
Mikhail f. Shiryaev
20614b3678
Improve runners AMI and init scripts
- Install CloudWatch agent and atop
- Update runner version, that supports hooks
- Provide start and complete job hooks
- Will update docker version implicitly to 20.10.17~3
2022-06-23 18:25:15 +02:00
Mikhail f. Shiryaev
dfae6a5634
Upload logs for getting all tests command 2022-06-23 18:14:42 +02:00
Igor Nikonov
2fd5467f36 Merge remote-tracking branch 'origin/master' into dictinct_in_order_optimization 2022-06-23 16:04:08 +00:00
kssenii
94a9af4191 Add test 2022-06-23 17:54:11 +02:00
mergify[bot]
174d8577fa
Merge branch 'master' into merge_tree_reader 2022-06-23 15:16:51 +00:00
Kruglov Pavel
ce7cc22b93
Merge pull request #38337 from ClickHouse/Avogar-patch-1
Try to fix 02305_schema_inference_with_globs
2022-06-23 16:59:54 +02:00
Maksim Kita
b7439a36f6
Merge pull request #38324 from azat/fix-partial-sort
Fix optimization in PartialSortingTransform (SIGSEGV and possible incorrect result)
2022-06-23 16:08:52 +02:00