Commit Graph

21888 Commits

Author SHA1 Message Date
Maksim Kita
efc2433347 Added IN function Set table support 2022-10-24 10:22:19 +02:00
Maksim Kita
ce9ea7ca0b Fixed tests 2022-10-24 10:22:19 +02:00
Maksim Kita
2995fb7944 Added support for building sets for IN function 2022-10-24 10:22:19 +02:00
Maksim Kita
85193ede42 Added UNION support 2022-10-24 10:22:19 +02:00
Maksim Kita
0da0019634 Added ARRAY JOIN support 2022-10-24 10:22:19 +02:00
Maksim Kita
89e5b09e7f Updated JOIN tests 2022-10-24 10:22:19 +02:00
Maksim Kita
fd101281c8 Added join_use_nulls test 2022-10-24 10:22:19 +02:00
Maksim Kita
b32092f24a JOIN support join_use_nulls, USING 2022-10-24 10:22:19 +02:00
Maksim Kita
40cb904a3d Added support for JOIN, ARRAY JOIN 2022-10-24 10:22:19 +02:00
Maksim Kita
1717d16fa4 Improved lambda matcher support 2022-10-24 10:22:19 +02:00
Maksim Kita
062e17052f Added support for IN function 2022-10-24 10:22:19 +02:00
Maksim Kita
2148d0e58d Added support for arrayJoin function 2022-10-24 10:22:19 +02:00
Maksim Kita
635bd44413 Added support for table functions 2022-10-24 10:22:18 +02:00
Maksim Kita
25888cbac1 Fixed tests 2022-10-24 10:22:18 +02:00
Maksim Kita
569fb36097 Added support for table ALIAS columns 2022-10-24 10:22:18 +02:00
Maksim Kita
425eb16514 Added EXPLAIN QUERY TREE tests 2022-10-24 10:22:18 +02:00
Maksim Kita
dd28b58864 Added support for subqueries 2022-10-24 10:22:18 +02:00
Maksim Kita
6a5276e45e Updated tests 2022-10-24 10:22:18 +02:00
Maksim Kita
2d61c45f94 Added support for multiple expressions with same alias 2022-10-24 10:22:18 +02:00
Maksim Kita
d835f70fdc Added support for STRICT column transformers 2022-10-24 10:22:18 +02:00
Maksim Kita
9d4c508b39 Added lambda tests 2022-10-24 10:22:18 +02:00
Maksim Kita
bd11c617b8 Added tests 2022-10-24 10:22:18 +02:00
Alexey Milovidov
f84ed91d10
Merge pull request #42598 from ClickHouse/evillique-patch-1
Fix possible segfault in expression parser
2022-10-24 09:26:42 +02:00
Alexey Milovidov
fab999d646
Merge pull request #42586 from azat/tests/obfuscator-fixes
tests: avoid model overlap for obfuscator
2022-10-24 09:26:20 +02:00
Nikolay Degterinsky
30f4f33e79 Add test 2022-10-24 01:39:40 +00:00
Nikolay Degterinsky
8b6f84cbc6 Add test 2022-10-24 01:25:19 +00:00
Azat Khuzhin
bcc8d9f9d9 Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32
* upstream/master:
  Fix strange code in date monotonicity
  Add a test
  Fix error
  Add tests
  Remove trash
2022-10-23 07:45:10 +02:00
Quanfa Fu
b07f65343d Add functions: domainRFC, topLevelDomainRFC, domainWithoutWWWRFC... 2022-10-23 12:01:26 +08:00
Alexey Milovidov
ebf330ca1a
Merge pull request #42573 from ClickHouse/remove-trash-6
Remove trash
2022-10-23 01:31:10 +02:00
Alexey Milovidov
6c69bdd34d
Merge pull request #42574 from ClickHouse/strange-date-monotonicity
Fix strange code in date monotonicity
2022-10-23 01:30:52 +02:00
Azat Khuzhin
a63dee2763 Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32 2022-10-22 23:32:15 +02:00
Azat Khuzhin
9a9bbac19b tests: avoid model overlap for obfuscator
In case of stress tests it is possible, and there is LOGICAL_ERROR in
case of error, which will create core dump.

Actually on CI [1] there error was likely this:

    stress_test_run_17.txt:/usr/share/clickhouse-test/queries/1_stateful/00175_obfuscator_schema_inference.sh: line 18: /tmp/clickhouse-test/1_stateful/model.bin: No such file or directory

So the file had been removed by another concurrent test.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42190/56bc85746fa0b553e43c2253250404cfcca46855/stress_test__ubsan_.html

Note, that actually it is enough just to change the name in this two
tests, however let's make them even more error-resistant.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-22 21:14:49 +02:00
Robert Schulze
b746224217
Merge pull request #42554 from arenadata/ADQM-604
Add support of Date32 arguments for dateName function
2022-10-22 17:20:10 +02:00
Azat Khuzhin
56bc85746f Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32
Conflicts:
- src/Interpreters/ProcessList.cpp
2022-10-22 16:49:08 +02:00
Nikolai Kochetov
5c32cd157d
Merge pull request #42362 from ClickHouse/fix-race-condition-finish-cancel
Fix data race in query finish/cancel
2022-10-22 14:58:42 +02:00
Alexey Milovidov
7bf1f4cdfa Fix strange code in date monotonicity 2022-10-22 09:02:20 +02:00
Azat Khuzhin
dbb4f8216f Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32
Conflicts:
- src/Functions/GregorianDate.h
2022-10-22 08:20:05 +02:00
Alexey Milovidov
0bb91ed3b4 Add a test 2022-10-22 07:41:08 +02:00
Alexey Milovidov
cb611e698a Add tests 2022-10-22 07:38:03 +02:00
Alexey Milovidov
5fd7409ce1
Merge branch 'master' into morton_coding 2022-10-22 04:39:13 +02:00
Nikolay Degterinsky
22f87e2bf9
Merge pull request #42549 from evillique/disks-better-logs
Better logs in clickhouse-disks
2022-10-22 04:31:44 +02:00
Alexey Milovidov
acc96a5ace
Merge pull request #42464 from ClickHouse/julian_day_ubsan
Fix UBSan report in Julian Day functions
2022-10-22 04:15:12 +02:00
Azat Khuzhin
4eeb7337ed Merge remote-tracking branch 'upstream/master' into build/shorten-64-to-32
Conflicts:
- src/Common/intExp.h
- src/Functions/DateTimeTransforms.h
- src/Functions/FunctionsConversion.h
2022-10-21 22:51:56 +02:00
Alexey Milovidov
f64a48874a
Merge pull request #42197 from ClickHouse/add-test-658
Add a test for #658
2022-10-21 21:56:51 +02:00
Alexey Milovidov
592fbb3eaf
Merge pull request #42367 from ClickHouse/revert-40217
Revert #40217
2022-10-21 21:56:15 +02:00
Alexey Milovidov
3beace607b
Merge pull request #42465 from ClickHouse/decimal-asan
Fix buffer overflow in Decimal scale
2022-10-21 21:55:20 +02:00
Kseniia Sumarokova
c0889e5832
Merge pull request #42418 from KinderRiven/max_cache_download_limit
Supports limiting the size of cached data to avoid negative optimization
2022-10-21 19:36:08 +02:00
Vitaly Baranov
2033ea1216 Support subqueries in row policy filters. 2022-10-21 15:42:29 +02:00
Alexander Tokmakov
5ffd026261
Merge pull request #42529 from azat/tests/integration/fix-sanitizer-reports
Fix sanitizer reports in integration tests
2022-10-21 16:01:43 +03:00
Alexander Tokmakov
1343f62e8f
Update test.py 2022-10-21 15:59:27 +03:00
Azat Khuzhin
0365bc56aa Add backward compatiblity check for some functions
* State of aggregate functions

This test goes though all aggregate functions that:
- has only one argument
- support string as an argument

And do a simple check by creating the aggregate state with one string.

Yes this is not covers everything (does not cover functions with
different number of arguments, types, different states in case of
multiple values - uniqCombined, but as for uniqCombined it will be
checked via uniqHLL12), but at least something.

And about type, String had been selected, since it more likely that
there will be used some hash function internally.

* Function(String)

Check every function which has only one argument, and it's type is
String.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-21 13:25:43 +02:00
Robert Schulze
2d448c139c
Merge pull request #42308 from arenadata/ADQM-584
Add support of Date32 arguments for date_diff function
2022-10-21 13:18:44 +02:00
Antonio Andelic
f3016fb86b Throw exception on invalid values 2022-10-21 09:15:24 +00:00
Antonio Andelic
3091d609fa
Merge branch 'master' into optimize-partitions-in-background 2022-10-21 11:01:41 +02:00
Alexey Milovidov
48694def2c
Merge branch 'master' into revert-40217 2022-10-21 05:49:34 +02:00
Alexey Milovidov
ff26251477 Merge branch 'master' into fix-race-condition-finish-cancel 2022-10-21 04:14:21 +02:00
Alexey Milovidov
6290aeaf64
Merge branch 'master' into fix-flaky-test 2022-10-21 01:57:51 +02:00
Alexey Milovidov
a7d2fd2cc5
Merge branch 'master' into decimal-asan 2022-10-21 01:28:34 +02:00
Alexey Milovidov
6c31bcad0a
Merge pull request #42417 from amosbird/issue_42408
Correct implementation of AggregateState comparison
2022-10-21 01:20:50 +02:00
Nikolay Degterinsky
d7d0794d2f Better logs in clickhouse-disks 2022-10-20 23:17:29 +00:00
Alexey Milovidov
8c5e6a8d6c
Merge pull request #42512 from ClickHouse/has-any-tuple
Add a test for #13653
2022-10-21 00:03:36 +02:00
Alexey Milovidov
bd80e6a10b
Merge pull request #42511 from ClickHouse/add-test-16827
Add a test for #16827
2022-10-21 00:03:04 +02:00
Alexey Milovidov
ba5c3d122f Remove old test 2022-10-20 23:59:43 +02:00
Alexey Milovidov
445487e073 Merge branch 'master' into add-test-658 2022-10-20 23:55:15 +02:00
Alexander Tokmakov
5fef8bdc8e
Merge branch 'master' into tests/00705_drop_create_merge_tree 2022-10-20 21:33:36 +03:00
Nikolai Kochetov
57ffcb7ed0 Revert "Merge pull request #41681 from ClickHouse/revert-41268-disable-s3-parallel-write-for-part-moves-to-disk-s3"
This reverts commit 7956c2becf, reversing
changes made to 57be648984.
2022-10-20 19:51:27 +02:00
Robert Schulze
9b7294ef45
Merge remote-tracking branch 'origin/master' into revert-40217 2022-10-20 15:27:31 +00:00
Nikita Mikhaylov
9a73eb2fbb
Add functions to generate random values according to the distribution (#42411) 2022-10-20 17:25:28 +02:00
Alexander Tokmakov
905a4ded42
Merge pull request #42535 from ClickHouse/tavplubix-patch-7
Disable `test_storage_nats`, because it's permanently broken
2022-10-20 16:58:46 +03:00
Alexander Tokmakov
5b03bbce2e
Merge pull request #41981 from ClickHouse/fixes_for_replicated_merge_tree2
Some fixes for ReplicatedMergeTree
2022-10-20 16:57:51 +03:00
Alexander Tokmakov
89ff3d4731
Update test.py 2022-10-20 16:54:52 +03:00
Azat Khuzhin
c399b021cf Fix sanitizer reports in integration tests
Before they was ignored because first there was a check for a sign of
sanitizer (==================), but it was done by
clickhouse-server.log, while sanitizer write to stderr.log.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-20 15:45:40 +02:00
Roman Vasin
5a725a2182 Add tests for Date32 2022-10-20 13:43:01 +00:00
Robert Schulze
469d6ad624
Merge pull request #42485 from ClickHouse/fix-bad_cast-in-annoy
Fix bad_cast in Annoy index
2022-10-20 15:27:58 +02:00
Robert Schulze
52eefe1ffd
Fix 02403_enable_extended_results_for_datetime_functions 2022-10-20 13:25:48 +00:00
Alexander Tokmakov
f814a17fa2
Merge branch 'master' into improve_replica_recovery 2022-10-20 15:52:48 +03:00
Alexander Tokmakov
68c18abfbb
Merge pull request #42406 from ClickHouse/template_format_better_error
Better error message for unsupported delimiters in custom formats
2022-10-20 15:52:08 +03:00
Alexander Tokmakov
d668a82829
Merge branch 'master' into improve_replica_recovery 2022-10-20 14:25:09 +03:00
Nikita Mikhaylov
0d07aeec2f
Fix logical error from welchTTest (#42487) 2022-10-20 13:09:02 +02:00
Kseniia Sumarokova
4f374f64f3
Merge pull request #42472 from KinderRiven/rename_test
rename filesystem_query_cache
2022-10-20 11:27:45 +02:00
Sema Checherinda
87db1b534b
Update 00463_long_sessions_in_http_interface.sh
no -c option in grep in busy loop.
2022-10-20 10:50:32 +02:00
Azat Khuzhin
e2417eb518 tests: fix 00705_drop_create_merge_tree flakiness
CI caught tiemout for this test [1]:

    2022.10.19 16:43:46.238264 [ 24048 ] {aea0ff2a-f8de-498a-bd9f-0b8069a49f48} <Error> executeQuery: Code: 60. DB::Exception: Table test_orfkwn0y.table doesn't exist. (UNKNOWN_TABLE) (version 22.10.1.1) (from [::1]:60028) (comment: 00705_drop_create_merge_tree.sh) (in query: DROP TABLE table), Stack trace (when copying this message, always include the lines below):
    ...
    2022.10.19 16:53:34.484777 [ 24042 ] {aec5a80a-4492-429b-87fb-7dbf5ffb5d67} <Debug> executeQuery: (from [::1]:57944) (comment: 00705_drop_create_merge_tree.sh) DROP DATABASE test_orfkwn0y  (stage: Complete)

But as you can see there is huge delay between last query from the test
and final DROP DATABASE.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/42457/65cd040d1565bb7b2a9ba515041c3a139d31a4f9/stateless_tests__tsan__[1/3]/runlog.log

Apparently it is the same issue in bash [1].

  [1]: https://gist.github.com/azat/affbda3f8c6b5c38648d4ab105777d88

Anyway it is easier to simply invoke clickhouse-client only two times,
since each invocation is very slow (~1-2 sec) in debug build.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-10-20 09:35:56 +02:00
Antonio Andelic
9d7e44409a
Merge pull request #41342 from ClickHouse/keeper-upload-snapshot-to-s3
Upload Keeper snapshots to S3
2022-10-20 09:14:59 +02:00
Antonio Andelic
77eb353839
Merge pull request #42243 from ClickHouse/use-multiread-more
Use MultiRead where possible
2022-10-20 09:04:54 +02:00
KinderRiven
9e59735b81 fix show cache 2022-10-20 03:13:15 +00:00
Alexey Milovidov
b4d241b54d Add a test for #13653 2022-10-20 01:39:08 +02:00
Alexey Milovidov
81750a81e7 Add a test for #16827 2022-10-20 01:17:11 +02:00
Kruglov Pavel
1b27c7ebe0
Merge pull request #42130 from azat/dist/EINTR-fix
Fix possible timeout exception for distributed queries with use_hedged_requests=0
2022-10-19 22:00:38 +02:00
Alexander Tokmakov
e4f93149ff fix another issue 2022-10-19 17:24:50 +02:00
Sema Checherinda
0338fd4e8d
Update 00463_long_sessions_in_http_interface.reference
It is really should be 1 here. The query fails with exception "DB::Exception: Table default.t doesn't exist". The count of matches Exception is 1.
2022-10-19 17:19:00 +02:00
Alexander Tokmakov
8942c18caa fix test 2022-10-19 17:10:31 +02:00
Nikolai Kochetov
d85bfe6ea3
Merge pull request #42322 from ClickHouse/additional-filters-and-distributed
Fix additional_table_filters for Distributed.
2022-10-19 17:09:51 +02:00
Alexander Tokmakov
84ef32e33f Merge branch 'master' into improve_replica_recovery 2022-10-19 16:28:01 +02:00
Alexander Tokmakov
f958c155f3
Merge branch 'master' into fixes_for_replicated_merge_tree2 2022-10-19 17:25:24 +03:00
Constantine Peresypkin
5b3b11b517 add Morton Coding (ZCurve) 2022-10-19 15:59:25 +02:00
Robert Schulze
42f680849c
Fix bad_cast in Annoy index
- Problem originally found by data type fuzzer
  https://s3.amazonaws.com/clickhouse-test-reports/42180/2f83d8790581dce0ffeec56c137b1d13160cfa7b/fuzzer_astfuzzermsan//report.html

- This commit restricts which data types are allowed for Annoy indexes
  (similar things are done for other index types).
2022-10-19 13:40:39 +00:00
Antonio Andelic
05e6b94b54 Polishing 2022-10-19 12:59:28 +00:00
Antonio Andelic
e5408aac99 Simplify logic 2022-10-19 12:34:20 +00:00
Vitaly Baranov
f82dc5ba44
Merge pull request #42333 from vitlibar/backup-to-s3
Implement backup to S3
2022-10-19 13:32:22 +02:00
Nikolay Degterinsky
486780ba80
Merge pull request #42044 from zvonand/zvonand-csv-dates
Fix Date from CSV parsing
2022-10-19 13:10:12 +02:00