Commit Graph

15245 Commits

Author SHA1 Message Date
Alexey Milovidov
83136f3515 Allow \r in the middle of the line in format Regexp 2022-02-01 02:49:26 +03:00
Dmitry Novik
3a0ed0f8f5
Merge pull request #33324 from azat/buffer-different-structure
Simplify different block structure (i.e. after ALTER) support for Buffer
2022-02-01 02:19:49 +03:00
Amos Bird
ec7d367814
DiskLocal checker
Add DiskLocal checker so that ReplicatedMergeTree can recover data when some of its disks are broken.
2022-02-01 05:55:27 +08:00
alesapin
dd61d1c2de
Merge pull request #34172 from ClickHouse/fix_race_in_some_engines
Fix benign race condition for storage HDFS, S3, URL
2022-01-31 22:41:54 +03:00
alesapin
75d73d2785
Merge pull request #34139 from ClickHouse/fix_buf_s3_low_cardinality
Fix bug with bounded S3 reads and LowCardinality
2022-01-31 22:41:14 +03:00
avogar
6229ec530d Fix some perf tests 2022-01-31 21:07:20 +03:00
avogar
058ef356ac Fix schema inference for table runction s3 2022-01-31 19:39:20 +03:00
Nikolai Kochetov
321fa4a9e8
Merge pull request #33291 from ClickHouse/add-pool-to-s3-write-buffer
Add pool to WriteBufferFromS3
2022-01-31 19:37:40 +03:00
tavplubix
d0ea72f878
Merge pull request #34005 from nicelulu/system_on_cluster
Supports all types of SYSTEM query ON CLUSTER clause.
2022-01-31 19:26:32 +03:00
alesapin
ace8169732 Fix kafka test 2022-01-31 19:18:34 +03:00
alesapin
b6828f1b4a Supress some tests for S3 2022-01-31 19:09:25 +03:00
Mikhail f. Shiryaev
424900bf1f
Add authorisation for dockerhub proxy container 2022-01-31 15:50:05 +01:00
alesapin
1adc7538fe Fix benign race condition for storage HDFS, S3, URL 2022-01-31 13:50:28 +03:00
alesapin
c3f7dece5e
Update tests/integration/test_s3_low_cardinality_right_border/test.py
Co-authored-by: Kseniia Sumarokova <54203879+kssenii@users.noreply.github.com>
2022-01-31 12:36:58 +03:00
tavplubix
afca3b81bf
Update 02179_dict_reload_on_cluster.sql 2022-01-31 11:54:57 +03:00
Alexey Milovidov
3efff5910c Close #10197 2022-01-30 20:45:53 +03:00
alesapin
9eea8e3183 Fix missed change 2022-01-30 18:22:35 +03:00
alesapin
969987e66b Merge branch 'master' into add_func_tests_over_s3 2022-01-30 18:21:32 +03:00
alesapin
cb45a348f1 Merge branch 'master' into fix_buf_s3_low_cardinality 2022-01-30 17:30:55 +03:00
alesapin
c219a53b4a Add func tests run with s3 2022-01-30 17:28:52 +03:00
Amos Bird
556cce9f3c
We need highlight to use Lexer 2022-01-30 19:48:34 +08:00
zhangxiao871
7f2f7fa993 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-30 13:46:52 +08:00
zhangxiao871
dd395c5721 Better test. 2022-01-30 13:46:11 +08:00
taiyang-li
c9d5251e12 finish dev 2022-01-30 09:10:27 +08:00
Maksim Kita
cfd3421e4f Dictionary PRIMARY KEY parsing fix 2022-01-29 15:50:10 +00:00
alesapin
7ada8227cf Fix bug with bounded S3 reads and LowCardinality 2022-01-29 18:28:40 +03:00
Maksim Kita
f3453024ff
Merge pull request #34060 from amosbird/optimizetupleorderby
Make ORDER BY tuple almost as fast as ORDER BY columns
2022-01-29 15:58:09 +01:00
Anton Popov
b950a12cb3
Merge pull request #34068 from CurtizJ/fix-async-insert-native
Fix asynchronous inserts with `Native` format
2022-01-29 01:24:53 +03:00
Anton Popov
7c3d6f5fda
Update 02187_async_inserts_all_formats.sh 2022-01-29 01:24:30 +03:00
alexey-milovidov
6535b75322
Merge pull request #34001 from azat/memory-tracker-fix
Fix memory accounting for queries that uses < max_untracker_memory
2022-01-29 00:59:53 +03:00
FArthur-cmd
cb4ad97d45 add test 2022-01-28 17:37:52 +00:00
avogar
3f5365f1a9 Fix test 2022-01-28 20:07:13 +03:00
avogar
8858b6bf86 Small improvement in schema inference from stdin in local 2022-01-28 19:17:35 +03:00
Azat Khuzhin
0e1c6b6b9c Make 01810_max_part_removal_threads_long more accurate
v0: After parts removing stop attach/detach for each remove, there are only
    11 threads, primary query and 10 for removal.

    CI: https://s3.amazonaws.com/clickhouse-test-reports/34001/8cace291d17fa9553a98b2a1e8bf15b30fe5a1bd/stateless_tests__debug__actions__[3/3].html

v2: Make 01810_max_part_removal_threads_long more deterministic

    Sometimes, if removing parts will be too fast (like in [1]), then it may
    use less threads, since thread pool will reuse existing, so increase
    number of rows per part and compare threads directly w/o throwIf().

      [1]: https://s3.amazonaws.com/clickhouse-test-reports/34001/e74b6379a58c4607bdb54cd4c457410166e869ca/stateless_tests_flaky_check__address__actions_.html

v3: Less flaky 01810_max_part_removal_threads_long
v4: Make check not strict in 01810_max_part_removal_threads_long

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-28 16:25:33 +03:00
Nikolai Kochetov
1c9f026178 Merge branch 'master' into add-pool-to-s3-write-buffer 2022-01-28 16:01:42 +03:00
mergify[bot]
c9a1c9a896
Merge branch 'master' into system_on_cluster 2022-01-28 10:42:26 +00:00
alexey-milovidov
f6684dbc62
Merge pull request #32304 from devcrafter/deduplication_token_7461
insert_deduplication_token setting for INSERT statement
2022-01-28 13:03:55 +03:00
zhangxiao871
7b51e0b8b6 Better test 2022-01-28 18:00:52 +08:00
Vitaly Baranov
484743edff
Merge pull request #33201 from azat/client-interactive-suggest
Client interactive suggest (extract info from CREATE queries)
2022-01-28 16:30:16 +07:00
Kruglov Pavel
842de427d8
Merge pull request #33984 from Avogar/fix-orc
Fix segfault while parsing corrupted ORC file
2022-01-28 12:03:38 +03:00
Kruglov Pavel
efa8775ea6
Merge pull request #33960 from Avogar/autodetect-format
Detect format and schema from stdin in clickhouse-local
2022-01-28 12:02:15 +03:00
Azat Khuzhin
d621e63782 Update reference for 01881_total_bytes_storage_buffer
Since now Buffer does not store empty Block

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-28 11:10:00 +03:00
Nikolai Kochetov
94999e86c2
Merge pull request #33392 from azat/_shard_num
Replace old _shard_num implementation with shardNum() function
2022-01-28 11:02:19 +03:00
zhangxiao871
78e2794ada Fix START MERGES and add test 2022-01-28 14:30:57 +08:00
Anton Popov
6c0959b907 fix asynchronous inserts with Native format 2022-01-28 03:25:15 +03:00
alexey-milovidov
6bcac01021
Update 02124_insert_deduplication_token_multiple_blocks_replica.sh 2022-01-27 23:07:09 +03:00
alexey-milovidov
855db84a22
Update 02124_insert_deduplication_token_multiple_blocks.sh 2022-01-27 23:06:55 +03:00
alexey-milovidov
63d8d75001
Merge pull request #33957 from azat/fix-getauxval
Fix getauxval() in glibc-compatibility and fix some leaks (after LSan started to work)
2022-01-27 23:05:23 +03:00
alexey-milovidov
ea55c9a0ae
Merge pull request #33938 from CurtizJ/fix-mismatched-columns
Fix 'Not found column' exception in distributed queries with arrays and tuples
2022-01-27 22:58:48 +03:00
alexey-milovidov
cd2305eb57
Merge pull request #33956 from CurtizJ/fix-nested-tuples
Fix reading of nested tuples
2022-01-27 22:58:11 +03:00
alexey-milovidov
2c85373966
Merge pull request #34058 from FArthur-cmd/26686_test_final_modifier
Small test for `FINAL`
2022-01-27 22:55:41 +03:00
alexey-milovidov
5a4ad04ae6
Merge pull request #33505 from zvonand/issue_14648
Fix fromUnixTimestamp64 functions
2022-01-27 22:54:53 +03:00
Nikolai Kochetov
7406721cb6 Try to fix race in test. 2022-01-27 18:38:39 +00:00
FArthur-cmd
dc8de1577a remove executable mode from sql file 2022-01-27 18:35:24 +00:00
FArthur-cmd
5970f622d6 Rewrite to SQL test 2022-01-27 18:35:22 +00:00
FArthur-cmd
84565cf464 Add test to prevent error in future 2022-01-27 18:35:13 +00:00
mergify[bot]
3f9ed4fb0b
Merge branch 'master' into fix-orc 2022-01-27 18:22:52 +00:00
mergify[bot]
260942e0f0
Merge branch 'master' into hlee-issue-7334 2022-01-27 14:30:13 +00:00
Nikolay Degterinsky
c5ca5b608e
Merge pull request #33314 from evillique/classification
Merge functions for text classification
2022-01-27 17:15:08 +03:00
Amos Bird
faee95b897
Make ORDER BY tuple almost as fast as ORDER BY columns
We have special optimizations for multiple column ORDER BY: https://github.com/ClickHouse/ClickHouse/pull/10831 . It's beneficial to also apply to tuple columns.

Before:

select * from numbers(300000000) order by (1 - number , number + 1 , number) limit 10;
2.613 sec.

After:

select * from numbers(300000000) order by (1 - number , number + 1 , number) limit 10;
0.755 sec

No tuple:

select * from numbers(300000000) order by 1 - number , number + 1 , number limit 10;
0.755 sec
2022-01-27 21:42:08 +08:00
mergify[bot]
ad146a67ff
Merge branch 'master' into _shard_num 2022-01-27 13:11:42 +00:00
Azat Khuzhin
e04b862673 Add echo for 01570_aggregator_combinator_simple_state
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-27 15:24:17 +03:00
mergify[bot]
eb1bf824be
Merge branch 'master' into fix-mismatched-columns 2022-01-27 12:23:48 +00:00
Raúl Marín
cb1524d4d9 Less flaky test_inconsistent_parts_if_drop_while_replica_not_active 2022-01-27 12:47:52 +01:00
Kruglov Pavel
a0a17735d4
Fix test 2022-01-27 13:58:40 +03:00
Mikhail f. Shiryaev
88629657ca
Merge pull request #34012 from ClickHouse/pr_description
Pr description
2022-01-27 11:09:17 +01:00
zhangxiao871
d1bc65d684 Fix test. 2022-01-27 16:10:31 +08:00
HarryLeeIBM
d656da1506 Issue 7334: also remove one unnecessary test 2022-01-26 10:43:45 -05:00
Mikhail f. Shiryaev
22eddff0d5
Add a comment about broken logic for skipping checks 2022-01-26 15:30:59 +01:00
Mikhail f. Shiryaev
462e95d0fa
Replace labels_from_ip by pr_event_from_api 2022-01-26 15:03:30 +01:00
Kruglov Pavel
057001714f
Update 02182_format_and_schema_from_stdin.sh 2022-01-26 16:53:51 +03:00
mergify[bot]
f978ca276d
Merge branch 'master' into fix-orc 2022-01-26 13:12:34 +00:00
Mikhail f. Shiryaev
6fa6588cb5
Add info about body for a failed check 2022-01-26 14:03:01 +01:00
Kruglov Pavel
662ea9d024
Merge pull request #33927 from kitaisreal/range-hashed-dictionary-refactoring
RangeHashedDictionary refactoring
2022-01-26 15:26:57 +03:00
Mikhail f. Shiryaev
99e0ce1ab8
Add get_with_retries helper to build_download_helper.py 2022-01-26 13:20:08 +01:00
Mikhail f. Shiryaev
7cde981531
Apply black formatter to build_download_helper.py 2022-01-26 12:10:20 +01:00
Mikhail f. Shiryaev
1ecee3aa8e
Apply black formatter to pr_info 2022-01-26 12:09:35 +01:00
zhangxiao871
1bd74dda63 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into yandex-master 2022-01-26 17:40:32 +08:00
zhangxiao871
20b669f330 Supports all types of SYSTEM query ON CLUSTER clause. 2022-01-26 17:40:00 +08:00
zvonand
3879137994 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-26 12:33:21 +03:00
tavplubix
9e91a9dfd1
Merge pull request #33429 from zzsmdfj/MaterializeMySQL_support_set_and_other_dataType
MaterializeMySQL support SET YEAR TIME GEOMETRY dataType
2022-01-26 11:29:46 +03:00
alesapin
677a7f1133
Merge pull request #33990 from ClickHouse/cancel-lambda
Cancel lambda
2022-01-26 10:51:21 +03:00
Maksim Kita
43604a2e8f Fixed tests 2022-01-25 21:56:29 +00:00
Maksim Kita
bf768a94e8
Merge pull request #33971 from Avogar/fix-ipv6
Fix parsing IPv6 from query parameter and fix IPv6 to string conversion
2022-01-25 22:45:11 +01:00
alesapin
0105f7e0bc
Merge pull request #33988 from ClickHouse/keeper_and_access
Fix clickhouse server start when replicated access storage depend on keeper
2022-01-25 22:54:43 +03:00
HarryLeeIBM
8b24688afb Issue 7334: Fixed utf8 string case-insensitive searching issue 2022-01-25 13:56:05 -05:00
Mikhail f. Shiryaev
62ddfbe4ab
Use workflow names instead of ID 2022-01-25 18:32:13 +01:00
Mikhail f. Shiryaev
604af8d3b8
Apply black to cancel lambda 2022-01-25 18:28:17 +01:00
Maksim Kita
0cc8b9462b
Merge pull request #33977 from vitlibar/fix-checking-access-for-system-command
Fix checking access for the SYSTEM command.
2022-01-25 17:07:36 +01:00
Maksim Kita
4507f883e6
Merge pull request #33976 from azat/fix-00985_merge_stack_overflow
Disable parallel run for 00985_merge_stack_overflow
2022-01-25 15:12:47 +01:00
alesapin
b8c6481d4c Fix clickhouse server start when replicated access storage depend on keeper 2022-01-25 16:40:12 +03:00
Vitaly Baranov
cc38fe3fb6 Fix checking access for the SYSTEM command. 2022-01-25 18:54:59 +07:00
mergify[bot]
c859945b62
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-25 11:43:54 +00:00
Ilya Yatsishin
fe84167c99
Merge pull request #33983 from ClickHouse/docker-green-on-retry
Fix dependencies tree for docker image check
2022-01-25 14:43:00 +03:00
Kruglov Pavel
1b19139f74
Merge pull request #31862 from Avogar/fix-lz4
Try to fix lz4 compression
2022-01-25 14:34:45 +03:00
avogar
356de038ae Fix segfault while parsing corrupted file 2022-01-25 14:31:49 +03:00
Maksim Kita
d9e079da4e Added tests 2022-01-25 11:13:37 +00:00
Maksim Kita
bcbd956b83 RangeHashedDictionary change layout structure 2022-01-25 11:13:37 +00:00
Mikhail f. Shiryaev
fb908a31e2
Fix dependencies tree for docker image check 2022-01-25 12:09:10 +01:00
Nikolay Degterinsky
5edbae6734 Merge branch 'master' into classification 2022-01-25 10:22:47 +00:00
Azat Khuzhin
922b758298 Disable parallel run for 00985_merge_stack_overflow
Since parallel queries to system.columns may fail with
TOO_DEEP_RECURSION too.

CI: https://s3.amazonaws.com/clickhouse-test-reports/33201/0013a2fdee26fc11a34ebffaf10f69d7cfff9b3a/fast_test__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-25 12:54:43 +03:00
Yatsishin Ilya
bc10e08fb4 add missing space 2022-01-25 09:07:04 +00:00
Kruglov Pavel
7873b4475f
Merge branch 'master' into autodetect-format 2022-01-25 10:56:52 +03:00
Kruglov Pavel
9f12f4af13
Merge pull request #33302 from Avogar/formats-with-suffixes
Allow to create new files on insert for File/S3/HDFS engines
2022-01-25 10:56:15 +03:00
avogar
a6740d2f9a Detect format and schema for stdin in clickhouse-local 2022-01-25 10:25:37 +03:00
avogar
ad01d68f36 Fix parsing IPv6 from query parameter and fix IPv6 to string conversion 2022-01-25 10:09:17 +03:00
zvonand
70b5db0d20 Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-25 09:38:50 +03:00
Maksim Kita
c1db61b4ed
Merge pull request #33946 from azat/build-cleanup
Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES)
2022-01-24 23:42:04 +01:00
Anton Popov
56d2b52693 fix reading of nested tuples 2022-01-24 18:44:11 +03:00
Mikhail f. Shiryaev
57b4655fa2
Fix style for pr_info 2022-01-24 16:34:01 +01:00
Mikhail f. Shiryaev
8e8ee8f8d1
Add style-checker-aarch64 to metrics lambda 2022-01-24 15:50:34 +01:00
Azat Khuzhin
4a0facd341 Remove MAKE_STATIC_LIBRARIES (in favor of USE_STATIC_LIBRARIES)
There is no more MAKE_*, so remove this alias.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-01-24 17:28:33 +03:00
mergify[bot]
604b85d861
Merge branch 'master' into no-clickhouse-test-deb-in-stateless 2022-01-24 14:05:17 +00:00
achimbab
8c52b45482
Merge branch 'ClickHouse:master' into ttest_confidence_intervals 2022-01-24 22:56:05 +09:00
Mikhail f. Shiryaev
7a1f471d6f
Add tests for process_image_with_parrents 2022-01-24 14:55:57 +01:00
Mikhail f. Shiryaev
70d997cbda
Fix pylint issues 2022-01-24 14:54:37 +01:00
Mikhail f. Shiryaev
18ef029ed3
Fix issue with building from non-existing tags 2022-01-24 14:54:29 +01:00
Mikhail f. Shiryaev
3531318388
Add tests for get_changed_docker_images 2022-01-24 14:52:07 +01:00
Mikhail f. Shiryaev
aa296c36bb
Fix dummy PRInfo 2022-01-24 14:51:56 +01:00
Anton Popov
6cbcfd706f fix conversion function to literal 2022-01-24 15:28:15 +03:00
Yatsishin Ilya
3a55f7a7d6 Do not use clickhouse-test.deb in stateless 2022-01-24 11:53:42 +00:00
alexey-milovidov
6ee0b18979
Merge pull request #33920 from ClickHouse/fix-if-combinator
Fix aggregate function combinator `-If` with `Nullable` filter argument
2022-01-24 11:43:11 +03:00
Anton Popov
3567e18f6e fix 'Not found column' exception in distributed queries with arrays and tuples 2022-01-24 10:46:30 +03:00
alesapin
48c19e88a5
Merge pull request #33926 from ClickHouse/fix_flaky_test
Fix test_replica_is_active flaky test
2022-01-24 10:19:10 +03:00
achimbab
5d70734132
Merge branch 'master' into ttest_confidence_intervals 2022-01-24 11:57:56 +09:00
Maksim Kita
7fffe5846f
Merge pull request #33924 from kitaisreal/sql-user-defined-functions-invalid-lambda-crash-fix
SQLUserDefinedFunctions invalid lambda additional cases
2022-01-23 22:06:49 +01:00
zvonand
86cc9419ba Merge branch 'master' of github.com:ClickHouse/ClickHouse into issue_14648 2022-01-23 22:30:31 +03:00
alesapin
57dae1e308
Merge pull request #33162 from azat/integration-tests-status
Fix status of SKIPPED integration tests (was incorrectly marked as ERROR)
2022-01-23 21:46:59 +03:00
Maksim Kita
818966c1a2
Merge pull request #33921 from bharatnc/ncb/h3-improve
explicitly checkAndGetColumn for remaining H3 funcs
2022-01-23 18:08:30 +01:00
Maksim Kita
243a280936 Updated tests 2022-01-23 17:02:43 +00:00
alesapin
51a6d08bff Fix test_replica_is_active flaky test 2022-01-23 19:31:09 +03:00
bharatnc
6faad9366b fix tests 2022-01-23 06:29:57 -08:00
Maksim Kita
f76536c079
Merge pull request #33914 from kitaisreal/dictionaries-added-support-for-date-time-64
Dictionaries added support for DateTime64
2022-01-23 13:21:22 +01:00
Maksim Kita
c66d5c6dd0
Merge pull request #33794 from kitaisreal/support-cast-from-map-to-array-of-tuple
Support cast from Map to Array of Tuple
2022-01-23 13:10:28 +01:00
Alexey Milovidov
4d30e6eab6 Fix aggregate function combinator -If with Nullable filter argument 2022-01-23 08:27:29 +03:00
Maksim Kita
4ec2861d82
Merge pull request #33907 from ClickHouse/more-retries-in-ci
Add more retries in CI for AWS "spot" instances
2022-01-23 00:57:35 +01:00
Maksim Kita
2d84d5f74d
Merge pull request #33918 from kitaisreal/dictionaries-updated-support-for-empty-attributes
Dictionaries updated support for empty attributes
2022-01-23 00:56:10 +01:00
mergify[bot]
d0286f9c22
Merge branch 'master' into more-retries-in-ci 2022-01-22 21:04:09 +00:00
Maksim Kita
4be393fba5 Support cast from Map to Array of Tuple 2022-01-22 20:40:18 +00:00
Maksim Kita
d1376684ae Added tests 2022-01-22 20:01:56 +00:00
Maksim Kita
b7605367d9 Added tests 2022-01-22 18:25:28 +00:00
Anton Popov
6861adadcf
Merge pull request #33637 from azat/fix-optimize_aggregation_in_order
RFC: Fix "Chunk should have AggregatedChunkInfo in GroupingAggregatedTransform"
2022-01-22 19:05:39 +03:00
alexey-milovidov
d7a63dfda6
Merge pull request #33677 from ucasfl/fix-sumif
Fix sumIf rewrite
2022-01-22 17:12:13 +03:00
Vitaly Baranov
539b4f9b23
Merge pull request #33575 from vitlibar/fix-testflows
Fix testflows tests
2022-01-22 18:59:05 +07:00
Vitaly Baranov
4c2f190ed5 Fix the order of destruction: a table which is used as a source for a dictionary
should be destroyed after destroying the dictionary.
2022-01-22 18:55:07 +07:00
Vitaly Baranov
4ae0f0a673 Revert changes related to clickhouse_version in regression.py 2022-01-22 18:55:07 +07:00
Vitaly Baranov
14a32ba584 Apply a patch made by Vitaly Zakaznikov. 2022-01-22 18:55:07 +07:00
Vitaly Baranov
77774cd1bd Add comments about other tests which should be fixed. 2022-01-22 18:55:07 +07:00
Vitaly Baranov
291600b565 Fix running kerberos tests. 2022-01-22 18:55:07 +07:00
Vitaly Baranov
04a05777c9 Enable RBAC and LDAP tests. 2022-01-22 18:55:07 +07:00