Commit Graph

12645 Commits

Author SHA1 Message Date
Kseniia Sumarokova
5dab184d8b
Update 02051_symlinks_to_user_files.sh 2021-10-17 18:21:43 +03:00
Nikolai Kochetov
2a95d7fc87
Merge pull request #29918 from amosbird/projection-improve5
Add primary key to minmax_count_projection
2021-10-17 14:04:18 +03:00
Kseniia Sumarokova
e1969e2693
Merge pull request #30288 from kssenii/fix-local-syntax-exception
Fix throwing syntax exception in clickhouse-local
2021-10-17 12:16:40 +03:00
kssenii
059fc1de69 Allow symlinks in file storage 2021-10-17 09:11:06 +00:00
alexey-milovidov
3e9cf0b5ba
Merge pull request #30243 from Algunenano/multiIf_shortcircuit_fix
Fix crash with shortcircuit and LowCardinality in multiIf
2021-10-17 06:16:09 +03:00
Alexey Milovidov
04d8f611d2 Merge branch 'master' into clickhouse-obfuscator-2 2021-10-17 05:52:13 +03:00
alexey-milovidov
b253f6122a
Merge pull request #30218 from azat/clickhouse-test-fix-hung-check
Fix --hung-check in clickhouse-test
2021-10-17 03:15:51 +03:00
Maksim Kita
0dd8c70d28
Merge pull request #30242 from kitaisreal/added-hashed-array-dictionary
Added HashedArray dictionary
2021-10-17 01:18:43 +03:00
kssenii
8b0359584a Update test 2021-10-16 19:08:37 +00:00
Raúl Marín
662b5d40e9 Adjust the tests to do less work 2021-10-16 20:35:41 +02:00
Denis Glazachev
329d81a0ef Various fixes to install procedure 2021-10-16 20:03:45 +03:00
alexey-milovidov
3d2fb2f67b
Merge pull request #30275 from kssenii/fix-local-query-stage
--stage for clickhouse-local
2021-10-16 18:42:28 +03:00
WangZengrui
6752be4c4e fix bug and add test 2021-10-16 23:11:45 +08:00
Azat Khuzhin
612a21cc97 clickhouse-test: do not propagate CLICKHOUSE_PORT_HTTP to clickhouse-client 2021-10-16 17:59:56 +03:00
Azat Khuzhin
c6e61e9497 clickhouse-test: use splitlines() over split('\n') 2021-10-16 17:59:56 +03:00
Azat Khuzhin
3102d24872 Fix --hung-check in clickhouse-test
JSONEachRow cannot be parsed with a simple json.loads(), instead it
should be passed to json.loads() line by line.

Fixes: #30065
2021-10-16 17:59:56 +03:00
Anton Popov
1a947d30bf add perf test 2021-10-16 16:43:10 +03:00
alesapin
9418eda122
Merge pull request #30111 from ClickHouse/remove_trash
Remove trash from MergeTreeReadPool
2021-10-16 15:41:41 +03:00
kssenii
c79c0526ff Fix clickhouse-local syntax exception 2021-10-16 12:20:14 +00:00
Raúl Marín
c5b09b4907 Tag resource heavy tests as no-parallel 2021-10-16 13:03:51 +02:00
kssenii
9525437499 Less threads in local, fix Ok. printing 2021-10-16 10:25:39 +00:00
Amos Bird
77a2022cf5
Add primary key to minmax_count_projection 2021-10-16 18:13:41 +08:00
kssenii
6c0eaf76da Query stage for local 2021-10-16 08:43:18 +00:00
alexey-milovidov
8359a82a0d
Merge pull request #30149 from azat/disable-fsync_metadata-on-ci
Disable fsync_metadata on CI
2021-10-15 23:01:00 +03:00
Maksim Kita
fceb763228 Fixed test 2021-10-15 23:00:30 +03:00
Raúl Marín
01fbd52758 Fix crash with shortcircuit and locardinality in multiIf 2021-10-15 18:52:23 +02:00
Maksim Kita
33ef3edcfa Updated tests 2021-10-15 18:54:41 +03:00
Maksim Kita
c9638bacbf Added HashedArray dictionary 2021-10-15 18:53:17 +03:00
avogar
be4fc79d32 Better handling exceptions, update tests 2021-10-15 18:30:32 +03:00
mergify[bot]
477ea62257
Merge branch 'master' into remove-sample-by 2021-10-15 15:14:17 +00:00
Nikita Mikhaylov
d1138a8a25
Merge pull request #29691 from azat/fix-merge-mutate-memory-tracking
Fix memory tracking for merges and mutations
2021-10-15 13:53:52 +03:00
Maksim Kita
27fdeef4b6
Merge pull request #29650 from kitaisreal/add-default-database-visitor-support-dict-get
AddDefaultDatabaseVisitor support dictGet
2021-10-15 12:28:58 +03:00
liang.huang
f82d79854c
Merge branch 'ClickHouse:master' into master 2021-10-15 16:11:15 +08:00
lhuang09287750
766e08567c complete date32 comparison with date/datetime/string and give a test file 2021-10-15 08:09:37 +00:00
alesapin
4ab6f7d771 Finally fix test 2021-10-15 10:39:31 +03:00
Maksim Kita
8db2c844d3 Fixed test 2021-10-15 02:07:52 +03:00
Azat Khuzhin
ae980fcd62 Move 01200_mutations_memory_consumption out from bugs 2021-10-15 01:43:27 +03:00
Azat Khuzhin
5d5f94f456 Mark 01200_mutations_memory_consumption as long and allow run in fasttest 2021-10-15 01:43:27 +03:00
Azat Khuzhin
a063097fdf Fix INSERT SELECT incorrectly fills MATERIALIZED column based of Nullable column
Required columns of the default expression should not be converted to NULL,
since this map value to default and MATERIALIZED values will not work.

Consider the following structure:
- A Nullable(Int64)
- X Int64 materialized coalesce(A, -1)

With recursive_null_as_default=true you will get:

    _CAST(coalesce(A, -1), 'Int64') AS X, NULL AS A

And this will ignore default expression.

Fixes: #23524 (Cc: @kssenii)
Fixes: #29729 (Cc: @tavplubix)
Backport: 21.7+
2021-10-15 01:36:09 +03:00
Azat Khuzhin
bb8105951f Disable fsync_metadata on CI
Sometimes we see that pretty simple queries like CREATE DATABASE can
take > 30 seconds, let's try to disable fsync.

CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(address).html#fail1
CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(release).html#fail1
2021-10-15 00:53:34 +03:00
Maksim Kita
a51ab78c68 Fixed style check 2021-10-14 23:13:41 +03:00
Maksim Kita
83879415b4 Fixed tests 2021-10-14 22:12:06 +03:00
Azat Khuzhin
d030e08d05 Make test_MemoryTracking::test_http not flaky
By comparing only megabytes in the memory changes, instead of bytes as
before, since it may be tricky at least due to max_untracked_memory and
how thread pool handle it.

It should be safe, since originally it was written in #16121 which fixes
issue #15932, which has ~4MB consumption of memory per request.
2021-10-14 21:06:39 +03:00
Azat Khuzhin
56ab0e31e6 Add description for test_MemoryTracking 2021-10-14 21:06:22 +03:00
Dmitry Novik
4ebb2455d8 Delete 01939_network_send_bytes_metrics test 2021-10-14 17:56:34 +03:00
mergify[bot]
92dd528c78
Merge branch 'master' into remove_trash 2021-10-14 14:14:07 +00:00
Anton Popov
476d7a411f allow to remove SAMPLE BY expression 2021-10-14 17:05:20 +03:00
avogar
5daed60eae Skip test in case of replicated database 2021-10-14 16:43:23 +03:00
Kruglov Pavel
9b909f3f30 Try to fix test 2021-10-14 16:43:23 +03:00
avogar
5d16dc7f9a Try to fix tests, update capnp lib to eliminate problem with UB sanitizer 2021-10-14 16:43:23 +03:00
avogar
f88a2ad653 Handle exception when cannot extract value from struct, add test for it 2021-10-14 16:43:23 +03:00
Kruglov Pavel
17ed293470 Fix test 2021-10-14 16:43:22 +03:00
avogar
ed8818a773 Fix style, better check in enum comparison 2021-10-14 16:43:22 +03:00
Kruglov Pavel
c97f375728 Fix style 2021-10-14 16:43:22 +03:00
avogar
ce22f534c4 Add CapnProto output format, refactor CapnProto input format 2021-10-14 16:43:22 +03:00
Nikolay Degterinsky
f29261741c Add test 2021-10-14 16:34:30 +03:00
avogar
a1a4df2501 Fix handling exception 'unrecognised option' in clickhouse-local and client 2021-10-14 16:34:05 +03:00
Maksim Kita
4ed28d8e52
Merge pull request #29981 from kitaisreal/added-function-tokens
Added function tokens
2021-10-14 15:36:06 +03:00
Anton Popov
4d020c96e0 support nullable arguments in function initializeAggregation 2021-10-14 15:09:06 +03:00
Anton Popov
6c1da023f7
Merge pull request #30142 from kitaisreal/polygon-dictionary-support-read
Polygon dictionary support read
2021-10-14 15:03:10 +03:00
Anton Popov
5802037f1e
Merge pull request #29916 from ucasfl/format-alter
Format improvement of AlterQuery
2021-10-14 14:30:08 +03:00
Denny Crane
6a0ee3d23e
test for rename atomic hanging (#30080)
* test for rename atomic hanging

* test for rename atomic hanging

* Update 02096_rename_atomic_hang.sql

* Update 02096_rename_atomic_hang.sql

Co-authored-by: tavplubix <tavplubix@gmail.com>
2021-10-14 13:31:34 +03:00
alesapin
90ff7f05fd Start keeper asynchronously if has connection to other nodes 2021-10-14 13:21:41 +03:00
Maksim Kita
96bee8d241 Fixed test 2021-10-14 13:20:52 +03:00
Maksim Kita
6c6dd7a0c8
Merge pull request #30056 from orloffv/orloffv.JSONExtractKeys
Add JSONExtractKeys function
2021-10-14 12:50:19 +03:00
alesapin
01ac2fea79
Update 00167_read_bytes_from_fs.sql 2021-10-14 12:44:41 +03:00
Maksim Kita
f589084a94
Merge pull request #29899 from Enmk/Governance/dictionary_comment
Governance/dictionary comment
2021-10-14 12:35:10 +03:00
Maksim Kita
baf75065e3
Update 02024_create_dictionary_with_comment.sql 2021-10-14 12:34:52 +03:00
Maksim Kita
8d544a55b7
Merge pull request #30075 from kitaisreal/sql-user-defined-functions-fix-alias
SQL user defined functions fix alias
2021-10-14 11:15:32 +03:00
alesapin
386d47cb22 Fix typo 2021-10-14 10:49:29 +03:00
Maksim Kita
e6bca4d928 Updated test 2021-10-14 00:08:16 +03:00
Maksim Kita
90bac4c318 Fixed tests 2021-10-14 00:08:16 +03:00
Maksim Kita
66f2163b60 Added function tokens 2021-10-14 00:08:15 +03:00
Maksim Kita
62c5c48a3f Updated tests 2021-10-14 00:02:27 +03:00
mergify[bot]
b3c2229ad9
Merge branch 'master' into remove_trash 2021-10-13 19:57:27 +00:00
mergify[bot]
f29ea07b1c
Merge branch 'master' into clickhouse-test-http-interface 2021-10-13 16:46:26 +00:00
Maksim Kita
5802213722 PolygonDictionary support read method 2021-10-13 19:31:59 +03:00
Maksim Kita
ab5826eb40 System data skipping indices size fix test names 2021-10-13 19:19:51 +03:00
Maksim Kita
84eddf2498 Added tests 2021-10-13 18:12:56 +03:00
alesapin
2473bc5aff Fix test 2021-10-13 18:12:04 +03:00
alesapin
1801ea4955 Merge branch 'master' into remove_trash 2021-10-13 18:10:31 +03:00
Dmitry Novik
a8fa3914b5 Fix 01939_network_send_bytes_metrics 2021-10-13 17:54:46 +03:00
Vitaly Orlov
573076588d Fix reference 2021-10-13 16:04:08 +03:00
alesapin
d2dfbb5ab6 Remove trash from MergeTreeReadPool 2021-10-13 15:25:44 +03:00
Nikolai Kochetov
3ac2766c13
Merge pull request #30086 from ClickHouse/fix-global-in-with-totals
Add test with GLOBAL IN and totals.
2021-10-13 15:12:54 +03:00
tavplubix
7742b96497
Remove metadata leftovers on drop database (#30054)
* remove metadata leftovers on drop database

* Update InterpreterDropQuery.cpp

* Update DatabaseCatalog.cpp
2021-10-13 13:34:18 +03:00
Nikolai Kochetov
038ca829e4 Add test with GLOBAL IN and totals. 2021-10-13 12:07:58 +03:00
mergify[bot]
cfda5592fe
Merge branch 'master' into fix-writing-storage-log-marks 2021-10-13 07:18:33 +00:00
Alexey Milovidov
798d8c7c17 Fix test 2021-10-13 03:16:09 +03:00
Alexey Milovidov
0ad20e6613 Fix test 2021-10-13 03:14:44 +03:00
Azat Khuzhin
e5bc573250 clickhouse-test: fix hung check in stress test by using system database 2021-10-13 00:19:16 +03:00
Vitaly Orlov
4d2b34a7f0
Review fixes 2021-10-13 00:08:00 +03:00
Azat Khuzhin
8d7798fa2e clickhouse-test: do not guard CREATE DATABASE with try/catch
Since it will not configure testcase args and fail eventually, and later
we have a try/catch anyway, this should be enough.
2021-10-12 22:39:43 +03:00
Azat Khuzhin
40d210367f clickhouse-test: fix catching of timeouts 2021-10-12 22:33:41 +03:00
Azat Khuzhin
427c428a27 clickhouse-test: process some options regardless --client 2021-10-12 22:30:34 +03:00
Azat Khuzhin
8dc8674298 clickhouse-test: process --client-option 2021-10-12 22:30:16 +03:00
Azat Khuzhin
fe90c979b5 clickhouse-test: fix redirect to stderr
Before #29856 `CREATE DATABASE` overwrites it.

Reported-by: @amosbird
2021-10-12 22:18:39 +03:00
Azat Khuzhin
50b95bd89d clickhouse-test: passthrough log_comment for DROP DATABASE too 2021-10-12 21:09:48 +03:00
Azat Khuzhin
e2e62ce273 clickhouse-test: replace clickhouse-driver with http interface (via http.client)
Cons of clickhouse-driver:
- it is one more extra dependency
- it does not have correct timeouts (only for socket operations, and
  this is not the same, so we need to set timeout by ourself)
- it is one more thing which can break (@alesapin)
2021-10-12 21:08:33 +03:00
Kseniia Sumarokova
bb15b57753
Merge pull request #30016 from ucasfl/sample-by-tuple
Fix  crash of sample by tuple()
2021-10-12 19:46:21 +03:00
Vitaly Orlov
65c6605c2c
Add JSONExtractKeys function 2021-10-12 18:00:25 +03:00
Nikita Mikhaylov
7c67d764c0
Merge pull request #29934 from ClickHouse/remove-bayes-ab
Remove function bayesAB
2021-10-12 18:00:25 +03:00
avogar
9c7bef4c9d Remove unused headers and handle exception 'unrecognised option' in clickhouse-local 2021-10-12 17:11:43 +03:00
alexey-milovidov
9a1f930b2f
Merge pull request #30010 from ClickHouse/ppc64le
Add cross-build for PowerPC 64le
2021-10-12 16:17:41 +03:00
Nikolai Kochetov
c36bb9206e
Merge pull request #29879 from amosbird/queryidholderfix
Fix potential leak of query_id_holder
2021-10-12 15:42:02 +03:00
Vitaly Baranov
4a4d913cfd
Merge pull request #29954 from vitlibar/fix-flaky-test_grpc_protocol
gRPC: Fix releasing query ID and session ID at the end of query processing
2021-10-12 13:32:27 +03:00
Vladimir C
969999ff10
Merge pull request #29544 from Algunenano/join_deadlock 2021-10-12 12:34:04 +03:00
Vladimir C
cb176cf9ad
Add long tag to 02033_join_engine_deadlock_long 2021-10-12 12:33:54 +03:00
tavplubix
984cf391cc
Merge pull request #30007 from azat/00992_system_parts_race_condition_zookeeper_long
Ignore parallel removing warning in 00992_system_parts_race_condition_zookeeper_long
2021-10-12 12:27:10 +03:00
Maksim Kita
ec898f1a94
Merge pull request #28633 from darkkeks/normalize-utf8-nfc
Add normalizeUTF8 function with NFC normalization
2021-10-12 12:25:07 +03:00
Vladimir C
11e37e7640
Merge pull request #28746 from amosbird/allowalias 2021-10-12 12:17:58 +03:00
Maksim Kita
91a48e9651
Merge pull request #29896 from kitaisreal/system-data-skipping-indices-added-size
System table data skipping indices added size
2021-10-12 12:16:57 +03:00
alesapin
2b3a0c892d
Merge pull request #29992 from ClickHouse/more_timeouts_in_scripts
More timeouts in test scripts
2021-10-12 10:14:21 +03:00
feng lv
b5d69d599e fix sample by tuple()
add tests

fix

fix

fix
2021-10-12 05:19:32 +00:00
Kseniia Sumarokova
198adc7ecd
Merge pull request #29837 from havardk/gtidupdate
MaterializedMySQL: Update GTID set at end of transaction
2021-10-12 08:01:18 +03:00
Alexey Milovidov
75547e64a5 Add to packager 2021-10-12 02:10:58 +03:00
Azat Khuzhin
381d666e4b Ignore parallel removing warning in 00992_system_parts_race_condition_zookeeper_long
CI: https://clickhouse-test-reports.s3.yandex.net/0/6c7fbf0b888db9c1272478189f0ff40212a3e7c9/functional_stateless_tests_(release,_databaseordinary)/test_run.txt.out.log
2021-10-11 23:10:21 +03:00
Vladimir C
e6c088fe05
Mark join_engine_deadlock as long test 2021-10-11 17:58:08 +03:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
Amos Bird
f4269ce417
Allow optimize_arithmetic_operations_in_aggregate_functions when alias is used. 2021-10-11 20:47:34 +08:00
alesapin
59a78830f9 Better timeouts in clickhouse-test 2021-10-11 14:46:01 +03:00
alesapin
95a69b9f4b Make test non endless 2021-10-11 14:05:52 +03:00
Maksim Kita
b0d887a0fe Added tests 2021-10-11 14:00:10 +03:00
Amos Bird
a07ce98121
Use system.text_log in test 2021-10-11 18:07:00 +08:00
Maksim Kita
61a725f531 Fixed tests 2021-10-11 11:39:50 +03:00
Maksim Kita
ce0c41e1ad Fixed tests 2021-10-11 11:39:50 +03:00
Maksim Kita
e05d041537 Tests naming fix 2021-10-11 11:34:58 +03:00
Vasily Nemkov
2c55807b2a Create dictionary with comment 2021-10-11 11:26:59 +03:00
Amos Bird
ebfb013ea1
Fix potential leak of query_id_holder 2021-10-11 15:56:00 +08:00
Vladimir C
dc4bb920d3
Merge branch 'master' into join_deadlock 2021-10-11 10:18:17 +03:00
Vladimir C
d2b8d293b4
Merge pull request #29976 from hexiaoting/dev_quantile_fuse2 2021-10-11 10:06:40 +03:00
Vladimir C
6c7fbf0b88
Merge pull request #29956 from azat/fix-tuple-filter 2021-10-11 10:02:47 +03:00
Vitaly Baranov
e74a4a8b6c
Merge pull request #28934 from vitlibar/allow-macros-in-rabbitmq-settings-test
Add test for expanding macros in RabbitMQ settings.
2021-10-11 08:32:24 +03:00
hexiaoting
aabe52e3e9 Fix bug for quantile fusion 2021-10-11 10:39:55 +08:00
alexey-milovidov
c64ca7be08
Merge pull request #29947 from azat/stateless-tests-fixes-v21.10
Stateless flaky tests fixes
2021-10-11 01:09:57 +03:00
alexey-milovidov
765f7b692c
Merge pull request #29919 from azat/integration-tests-fixes-v21.10
Fix flaky integration tests (test_backup_restore/test_input_format_parallel_parsing_memory_tracking)
2021-10-11 00:14:06 +03:00
mergify[bot]
c07a49ba89
Merge branch 'master' into remove-bayes-ab 2021-10-10 21:10:57 +00:00
Vitaly Baranov
07aea95a75 Fix rabbitmq tests. 2021-10-11 00:00:12 +03:00
Azat Khuzhin
6c33eaee32 Fix filtering by tuple (some conditions was lost during analyzing)
Fixes: #29281
Fixes: test_cluster_copier/test_three_nodes.py::test
2021-10-10 22:37:52 +03:00
Vitaly Baranov
1dda596689 Fix releasing query ID and session ID at the end of query processing. 2021-10-10 17:34:45 +03:00
tavplubix
1aeb5d55dd
Grep server log even if it contains binary data (#29903)
* grep server log even if it contains binary data

* Update cluster.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2021-10-10 12:55:37 +03:00
tavplubix
ca8625f1a3
Merge pull request #29923 from ClickHouse/fix_tests_replication_check
Fix some flaky tests
2021-10-10 12:53:54 +03:00
Azat Khuzhin
0c5d26b647 Make 01085_max_distributed_connections less flaky 2021-10-10 09:57:27 +03:00
Azat Khuzhin
38de183379 Make 00984_parser_stack_overflow less flaky
According to query_log/trace_log the problem is real:

    2021.10.10 07:52:37.702364 [ 3736 ] {c6a219f2-3df8-4474-8324-bb307ee7a7a9} <Debug> executeQuery: (from [::1]:38096) (comment: /usr/share/clickhouse-test/queries/0_stateless/00984_parser_stack_overflow.sh) SELECT [[[...
    2021.10.10 07:53:11.407949 [ 3736 ] {c6a219f2-3df8-4474-8324-bb307ee7a7a9} <Error> executeQuery: Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth ...

From trace_log:

    2021-10-10 07:52:37.958938 DB::Dwarf::findDebugInfoOffset
    2021-10-10 07:53:12.583248 DB::Dwarf::findDebugInfoOffset

CI: https://clickhouse-test-reports.s3.yandex.net/29928/2bab572caf91d2fc8962f409fea34149ecec8c95/functional_stateless_tests_(debug).html#fail1
2021-10-10 09:57:26 +03:00
feng lv
1229a8b528 fix 2021-10-10 04:12:24 +00:00
Alexey Milovidov
2a20bf4909 Remove function bayesAB #26233 2021-10-10 04:16:32 +03:00
Maksim Kita
daf9cf12d9
Merge pull request #29755 from Joeywzr/new_func
add function getOSKernelVersion
2021-10-10 01:12:54 +03:00
Maksim Kita
b9969232f5
Update 02095_function_get_os_kernel_version.sql 2021-10-10 01:12:36 +03:00
Alexander Tokmakov
c61f09c4dc fix test for replication consistency 2021-10-09 21:12:15 +03:00
alexey-milovidov
ee577e1ab4
Merge pull request #29155 from FArthur-cmd/add_CORS
Add Cors support
2021-10-09 20:18:17 +03:00