thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-21 17:20:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
86,511 Commits 8,942 Branches 1,766 Tags 2 GiB
cefa64a846
Commit Graph

10520 Commits

Author SHA1 Message Date
何李夫
09c04e4993
Improve the pipeline description for JOIN (#35612) 
Improve the pipeline description for JOIN
 2022-04-04 13:56:41 +02:00
Maksim Kita
e6c9a36ac7
Merge pull request #35733 from kitaisreal/ipv6-invalid-insert-test 
Added test for insert of invalid IPv6 value
 2022-04-04 12:28:16 +02:00
Azat Khuzhin
99528e296c Rename need_data_elapsed_us/port_full_elapsed_us to input_wait_us/output_wait_us 
$ gg -e need_data_ -e port_full_  | cut -d: -f1 | sort -u | xargs sed -i -e s/port_full_/output_wait_/g -e s/need_data_/input_wait_/g -e s/getPortFull/getOutputWait/g -e s/getNeedData/getInputWait/g

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-04 13:19:43 +03:00
Azat Khuzhin
0d06dab362 tests: cover processors_profile_log 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-04 13:19:43 +03:00
Nikolai Kochetov
19819c72f8
Merge pull request #35290 from bigo-sg/function_enumerate_streams 
Add function getTypeSerializationStreams
 2022-04-04 12:09:53 +02:00
alesapin
803a1a2a9c Fix tests and check 2022-04-04 11:19:02 +02:00
Anton Popov
11e18a16f3
Merge pull request #35724 from Avogar/fix-order 
Improve schema inference for JSONEachRow and TSKV formats
 2022-04-04 11:00:21 +02:00
Azat Khuzhin
93bbe9641a Fix formatting of INSERT ... COMPRESSION 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-04 10:33:12 +03:00
Azat Khuzhin
9a76efb850 Fix formatting of INSERT INFILE queries (missing quotes) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-04 10:33:12 +03:00
Antonio Andelic
d96b682a55 Refactor 2022-04-04 07:24:42 +00:00
taiyang-li
f4772d3b8f chmod a+x 02250_hints_for_columns/02250_hints_for_projections 2022-04-04 07:24:42 +00:00
taiyang-li
10bbb96512 fix stateless test 2022-04-04 07:24:42 +00:00
taiyang-li
9dd1a76fd8 fix stateless tests 2022-04-04 07:24:42 +00:00
taiyang-li
fd9a10ef53 add hints for projections 2022-04-04 07:24:42 +00:00
Alexey Milovidov
d9e5ca2119
Merge pull request #34394 from holadepo/last_day 
Add toLastDayOfMonth function
 2022-04-04 07:02:08 +03:00
mergify[bot]
4d9bb9f6fd
Merge branch 'master' into test/crash_35551 2022-04-04 03:59:10 +00:00
Alexey Milovidov
86558bba5a Move tests to bugs 2022-04-04 00:52:43 +02:00
Habibullah Oladepo
2dd7420fc7 Add tests for toLastDayOfMonth 2022-04-03 23:42:39 +01:00
alesapin
a8c1ccdb20 Forbit to reset non existing settings 2022-04-03 18:29:24 +02:00
alesapin
7b35920d4c Make more alters of nested types metadata-only 2022-04-03 14:03:34 +02:00
Alexey Milovidov
5a47958744
Merge pull request #35736 from CurtizJ/quota-written-bytes 
Add quota for written bytes
 2022-04-03 05:26:49 +03:00
Azat Khuzhin
195b4c47ea Avoid processing per-column TTL multiple times 
Before this patch ttl.txt will not be written for per-column TTLs, and
hence it will be calculated every time after server restart of
DETACH/ATTACH cycle (note, that it will work w/o restart since in-memory
representation will avoid this).

v2: convert test to .sh to get correct current database over default for MV
v3: extract UUID to avoid error like in [1]:
    [ 490 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) []: Code: 349. DB::Exception: Cannot convert NULL value to non-Nullable type: While processing query_id LIKE concat('%', CAST(_CAST(NULL, 'Nullable(UUID)') AS uuid, 'String'), '%'): while pushing to view test_0hc2ro.this_text_log (c64e5af4-059e-4330-a728-354ecf83c031). (CANNOT_INSERT_NULL_IN_ORDINARY_COLUMN)
    [1]: https://s3.amazonaws.com/clickhouse-test-reports/35820/a512d322b024d37d2f1082c4833f59f86057555f/stateless_tests_flaky_check__address__actions_.html
v4: add no-parallel to avoid issues with disappeared underlying table while pushing to text_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-04-02 15:19:39 +03:00
Kruglov Pavel
860b1a1b1b
Update 02248_nullable_custom_types_to_string.sql 2022-04-02 14:04:04 +02:00
mergify[bot]
1e43e26fa1
Merge branch 'master' into fix-order 2022-04-02 12:00:29 +00:00
avogar
3ae36ac483 Fix tests 2022-04-02 11:59:32 +00:00
Kruglov Pavel
60c2b54dc9
Fix test 2022-04-02 13:55:37 +02:00
Kruglov Pavel
f7902ae2d1
Fix test 2022-04-02 13:53:30 +02:00
Kruglov Pavel
687e9e7aeb
Merge pull request #35760 from Avogar/insert-from-input 
Improve schema inference for insert select from table functions
 2022-04-02 13:50:48 +02:00
avogar
b815c38d38 Update test reference file 2022-04-02 11:45:48 +00:00
Anton Popov
687942ce70 more strict quota for written bytes 2022-04-01 15:02:49 +00:00
Yakov Olkhovskiy
38993f215f
Merge pull request #35706 from yakov-olkhovskiy/ephemeral-35641 
Allow EPHEMERAL without explicit default expression
 2022-04-01 10:49:29 -04:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Alexander Tokmakov
6591d1ceb7 Merge branch 'master' into mvcc_prototype 2022-04-01 15:38:46 +02:00
zzsmdfj
79c75d8a71 to #34966_fix_dateTime_deserialize 2022-04-01 20:18:28 +08:00
zzsmdfj
ececee3817 to #34966_fix_dateTime_deserialize 2022-04-01 20:13:34 +08:00
Anton Popov
075bcf3f5f
Merge pull request #35803 from Avogar/fix-formats-with-names 
Fix bug in indexes of not presented columns in -WithNames formats
 2022-04-01 13:33:35 +02:00
Kseniia Sumarokova
cafff71d2f
Merge pull request #35799 from evillique/extract-parser-fix 
Fix extract function parser
 2022-04-01 10:59:39 +02:00
alesapin
f2c6387a8d
Merge pull request #35381 from kssenii/remote-filesystem-cache-fixes 
Cache fixes for high concurrency on corner cases
 2022-04-01 10:48:31 +02:00
Kseniia Sumarokova
d3b3294872
Merge pull request #35365 from bigo-sg/improve_access_type 
Improve check access in table functions
 2022-04-01 10:47:02 +02:00
Antonio Andelic
8cc18c851d
Merge pull request #35705 from ClickHouse/is-secure-client-info 
Added `is_secure` column to `query_log`
 2022-04-01 08:27:20 +02:00
jewisliu
9a4cc78dfb support ALTER TABLE t DETACH PARTITION ALL syntax 2022-04-01 13:13:07 +08:00
Alexey Milovidov
5c6b84c398
Merge pull request #35586 from kssenii/fix-virtual-columns-s3 
Fix s3 engine getting virtual columns
 2022-04-01 04:43:32 +03:00
mergify[bot]
864d6c3eaf
Merge branch 'master' into test/crash_35551 2022-04-01 01:32:56 +00:00
Alexander Tokmakov
44a8622851 fix test 2022-03-31 18:32:20 +02:00
Anton Popov
e74d5f9d4c
Update 01825_type_json_partitions.sql 2022-03-31 18:30:19 +02:00
kssenii
603dcbb1b7 Extend test 2022-03-31 18:23:15 +02:00
avogar
ab2a963287 Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-read-bools-as-numbers 2022-03-31 14:09:43 +00:00
mergify[bot]
24ade25d61
Merge branch 'master' into improve-schema-inference 2022-03-31 13:42:47 +00:00
Anton Popov
42acb1dc29 fix inserts to columns of type Object in partitioned tables 2022-03-31 13:30:01 +00:00
kssenii
74ec5eb1cc Fix checks 2022-03-31 14:35:40 +02:00
avogar
836e7dae67 Fix bug in indexes of not presented columns in -WithNames formats 2022-03-31 12:24:40 +00:00
Nikolay Degterinsky
eb88a5f29e Add test 2022-03-31 12:20:48 +00:00
Nikita Mikhaylov
5f27f690f4 Revert "Added support for schema inference for hdfsCluster (#35602)" 
This reverts commit f6bfdcc0c9.
 2022-03-31 14:19:56 +02:00
Kruglov Pavel
d166bb5115
Update 02245_format_string_stack_overflow.sql 2022-03-31 13:47:15 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
avogar
74f0988657 Fix tests 2022-03-31 11:34:06 +00:00
avogar
a41c73fcf6 Fix tests 2022-03-31 11:25:52 +00:00
avogar
63946ccb32 Fix tests 2022-03-31 11:14:30 +00:00
Kruglov Pavel
4db5043ed4
Fix test 2022-03-31 12:50:53 +02:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster (#35602) 2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
Kseniia Sumarokova
0b20329156
Merge pull request #35727 from kssenii/fix-any-all 
Fix any/all(subquery)
 2022-03-31 10:05:37 +02:00
Antonio Andelic
e336302650 Merge branch 'master' into is-secure-client-info 2022-03-31 06:58:16 +00:00
taiyang-li
a5765dccb1 Merge branch 'master' into function_enumerate_streams 2022-03-31 12:21:00 +08:00
taiyang-li
70087bc959 Merge branch 'master' into improve_access_type 2022-03-31 12:19:17 +08:00
Yakov Olkhovskiy
8e00cc2aca fix messed commit 2022-03-30 23:52:48 -04:00
Yakov Olkhovskiy
3b40b56e56 refactored to remove parsers rependency on datatypes 2022-03-30 23:47:16 -04:00
Nikolay Degterinsky
f055d7b692
Merge pull request #34055 from palegre-tiny/groupSortedArray 
Add groupSortedArray() function
 2022-03-31 01:20:15 +03:00
Kruglov Pavel
4ec3c35e14
Merge pull request #35755 from Avogar/fix-custom-to-string 
Fix bug in conversion from custom types to string
 2022-03-31 00:06:48 +02:00
alesapin
5a55913f45
Merge pull request #35720 from ClickHouse/parallel_stateful 
Try to run stateful tests in parallel
 2022-03-30 23:42:44 +02:00
Alexander Gololobov
1d7059175b
Merge pull request #35681 from tonickkozlov/patch-2 
[test] Adds clean-up for functional test 02167
 2022-03-30 23:09:51 +02:00
Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY (#33439) 
* use AggregationMethod ctor with reserve

* add new settings

* add HashTablesStatistics

* support queries with limit

* support distributed and with external aggregation

* add new profile events

* add some tests

* add perf test

* export cache stats through AsynchronousMetrics

* rm redundant trace

* fix style

* fix 02122_parallel_formatting test

* review fixes

* fix 02122_parallel_formatting test

* apply also to two-level HTs

* try simpler strategy

* increase max_size_to_preallocate_for_aggregation for experiment

* fixes

* Revert "increase max_size_to_preallocate_for_aggregation for experiment"

This reverts commit 6cf6f75704.

* fix test

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
 2022-03-30 22:47:51 +02:00
Alexander Gololobov
8f7329d7dd
Removed debug print 2022-03-30 20:10:25 +02:00
kssenii
c1ae5814a7 Merge master 2022-03-30 17:59:36 +02:00
tavplubix
c34d512586
Update 00484_preferred_max_column_in_block_size_bytes.sql 2022-03-30 18:36:37 +03:00
kssenii
d810853b78 Fix path in test 2022-03-30 17:35:59 +02:00
kssenii
099fa0e668 Merge master 2022-03-30 17:33:32 +02:00
kssenii
0fc92fe2aa Get rid of all "remote" mentions 2022-03-30 17:15:29 +02:00
mergify[bot]
4813f0b305
Merge branch 'master' into is-secure-client-info 2022-03-30 15:12:56 +00:00
kssenii
b30948dd53 Relax test 2022-03-30 17:12:23 +02:00
Alexander Gololobov
6e1036de50
Fix user file path extraction 
It turned out that $CLICHOUSE_CLIENT could produce more verbose output that was not properly parsed. I made a change that should fix this parsing.
 2022-03-30 16:12:13 +02:00
Maksim Kita
12ec3522e6
Merge pull request #35745 from azat/fix-tests-v22.3 
Tests fixes
 2022-03-30 15:44:25 +02:00
avogar
265fbaaa5a Fix tests 2022-03-30 13:23:43 +00:00
Kruglov Pavel
8c05a3dffc
Update 01825_type_json_parallel_insert.sql 2022-03-30 15:00:32 +02:00
avogar
849596c7a2 Improve schema inference for insert select queries 2022-03-30 12:44:53 +00:00
tavplubix
cf8332e109
Update 00170_s3_cache.reference 2022-03-30 14:38:21 +03:00
Anton Popov
d53858758d fix tests 2022-03-30 11:32:08 +00:00
Antonio Andelic
7bc5731025 Merge branch 'master' into is-secure-client-info 2022-03-30 11:26:05 +00:00
avogar
af4bfec051 Fix bug in conversion from custom types to string 2022-03-30 11:19:03 +00:00
Maksim Kita
371cdc956a Added input format settings for parsing invalid IPv4, IPv6 addresses as default values 2022-03-30 12:54:19 +02:00
Vladimir C
31c367d3cd
Merge pull request #35651 from amosbird/columntransformerrename 2022-03-30 12:37:30 +02:00
kssenii
98ad3f4a91 Fix tests, rename some remote mentions 2022-03-30 12:21:59 +02:00
tavplubix
531942ce5c
Update 00170_s3_cache.sql 2022-03-30 12:43:34 +03:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
Azat Khuzhin
2a099d90fe tests: make 02152_http_external_tables_memory_tracking more stable 
After settings randomization, it can not reach max_untracked_memory,
i.e. due to max_block_size=67990 for example (like in [1]).

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35683/c609426d091ea8b9f2d37f8d7fcbf9e759cc94e5/stateless_tests__release__actions_.html

Fix this, by settings max_untracked_memory to 0, to track any
allocations.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-30 11:06:07 +03:00
Azat Khuzhin
b264bdcf5e tests: wait for left queries in 00417_kill_query 
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/c244ee7cbb61fea384679e18a577ff579060288b/stateless_tests__release__s3_storage__actions_/runlog.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-03-30 11:06:07 +03:00
Antonio Andelic
b70456879e Add tests for is_secure in query_log 2022-03-30 06:39:40 +00:00
taiyang-li
47f3e9330e merge master and fix conflict 2022-03-30 11:06:51 +08:00
taiyang-li
e76ed3acde Merge branch 'master' into improve_access_type 2022-03-30 11:04:57 +08:00
Anton Popov
a842a81aba
Merge pull request #35690 from CurtizJ/flatten-tuple 
Add function `flattenTuple`
 2022-03-30 00:24:36 +02:00
Anton Popov
1cba31c305
Merge pull request #35687 from CurtizJ/dynamic-columns-7 
Fix reading from type object
 2022-03-30 00:21:32 +02:00
Alexander Tokmakov
6191eaa983 fix some flaky tests 2022-03-29 23:12:06 +02:00
Anton Popov
caacc7d385 add quota for written bytes 2022-03-29 18:21:29 +00:00
Anton Popov
74cafe154a
fix flaky test 02246_async_insert_quota 2022-03-29 19:58:59 +02:00
kssenii
f0e0d97752 Fix lask of query id in merges 2022-03-29 19:49:42 +02:00
avogar
3fc36627b3 Allow to infer and parse bools as numbers in JSON input formats 2022-03-29 17:37:31 +00:00
Kseniia Sumarokova
e2370d9622
Update 02235_remote_fs_cache_stress.sh 2022-03-29 19:11:36 +02:00
mergify[bot]
87303368fc
Merge branch 'master' into patch-2 2022-03-29 17:07:12 +00:00
Maksim Kita
f1f4e85c4b Added test for insert of invalid IPv6 value 2022-03-29 19:02:59 +02:00
Anton Kozlov
7da5d4f145
Updated a comment that clarifies the expected error 2022-03-29 17:27:12 +01:00
tavplubix
f3e580e876
Merge pull request #35711 from kssenii/fix-local-drop-db 
Fix dropping non-empty database in clickhouse local
 2022-03-29 18:39:01 +03:00
Kruglov Pavel
5a5aa3ab31
Update test 2022-03-29 17:35:29 +02:00
kssenii
a2e950bd3b Fix 2022-03-29 17:34:50 +02:00
avogar
ce97ccbfb9 Improve schema inference for JSONEachRow and TSKV formats 2022-03-29 14:47:51 +00:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8 run stateful tests in parallel 2022-03-29 15:24:29 +02:00
Yakov Olkhovskiy
f68f0cce04
Update 02205_ephemeral_1.reference 
tests without default is added
 2022-03-29 09:24:00 -04:00
Yakov Olkhovskiy
0f10a2de9c
Update 02205_ephemeral_1.sql 
tests without default added
 2022-03-29 09:20:05 -04:00
Dmitry Novik
8f935a72d6
Merge pull request #33230 from CurtizJ/read_in_order_max_rows_to_read 
Proper handle of 'max_rows_to_read' in case of reading in order of sorting key
 2022-03-29 15:16:34 +02:00
avogar
97f5033ea9 Fix tests 2022-03-29 13:07:37 +00:00
mergify[bot]
343588de2c
Merge branch 'master' into improve-schema-inference 2022-03-29 13:06:00 +00:00
taiyang-li
67c3c0be3d Merge branch 'master' into improve_access_type 2022-03-29 20:42:57 +08:00
Anton Popov
9610139477
Merge pull request #35629 from CurtizJ/dynamic-columns-5 
Support schema inference for type `Object` in format `JSONEachRow`
 2022-03-29 14:17:09 +02:00
Kruglov Pavel
8edf6e7448
Mark test 02242_optimize_to_subcolumns_no_storage as backward incompatible for version 22.3.2.1 2022-03-29 14:15:19 +02:00
Anton Popov
c59926dcc7 fix tests 2022-03-29 12:13:02 +00:00
tavplubix
ec496faae8
Merge pull request #35688 from ClickHouse/tavplubix-patch-4 
Fix flaky 01037_polygon_dicts_correctness_fast
 2022-03-29 15:07:10 +03:00
Anton Popov
d42632dc13
Merge pull request #32928 from bigo-sg/rocksdb_metacache 
Speed up parts loading process of MergeTree by metadata cache
 2022-03-29 14:05:22 +02:00
Alexander Gololobov
bf376ee2f5
Merge pull request #35628 from ClickHouse/make_date 
Implementation of makeDate and makeDate32
 2022-03-29 13:35:26 +02:00
taiyang-li
834ac3a1b9 Merge remote-tracking branch 'ck/master' into rocksdb_metacache 2022-03-29 18:32:06 +08:00
kssenii
98fe1ca1ec Fix 2022-03-29 12:05:27 +02:00
Anton Popov
5d8988ad4e
Merge pull request #35645 from CurtizJ/fix-quotas-async-inserts 
Fix usage of quota with async inserts
 2022-03-29 11:54:24 +02:00
Nikolai Kochetov
86690f18ee
Merge pull request #35667 from amosbird/projection-fix2 
Another fix of projection part check
 2022-03-29 10:22:01 +02:00
taiyang-li
db436ad621 Merge branch 'master' into function_enumerate_streams 2022-03-29 11:35:21 +08:00
Amos Bird
3ab8fc1e7b
Fix projection part check 
Fix projection part check when projection part type is different from
parent part type.
 2022-03-29 10:39:07 +08:00
kssenii
44157e5c80 Merge master 2022-03-29 02:19:32 +02:00
kssenii
c6b1f86306 Merge with master 2022-03-29 02:03:28 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
Anton Popov
cd3cc60d5d fix fasttest 2022-03-28 21:13:20 +00:00
mergify[bot]
bf5a9dcb7a
Merge branch 'master' into groupSortedArray 2022-03-28 20:57:07 +00:00
mergify[bot]
9efc8bda78
Merge branch 'master' into remote-filesystem-cache-fixes 2022-03-28 20:53:29 +00:00
kssenii
1d49a85963 Merge master 2022-03-28 22:51:56 +02:00
Alexander Gololobov
b49993f993 Fixes according to the code review 2022-03-28 22:47:39 +02:00
kssenii
a2013ebe2b Better 2022-03-28 22:40:27 +02:00
Kseniia Sumarokova
9a8e9198e5
Merge pull request #35593 from kssenii/named-collections-fix 
Fix headers with named collections, add compression_method
 2022-03-28 22:10:32 +02:00
Kruglov Pavel
fddeecdd69
Fix fast test 2022-03-28 21:59:43 +02:00
alesapin
10f29ff7f9
Merge pull request #35679 from Avogar/fix-tests 
Fix flaky tests 02149_read_in_order_fixed_prefix and 02177_issue_31009
 2022-03-28 21:42:17 +02:00
Anton Popov
24c0cf86d4 add function 'flattenTuple' 2022-03-28 19:32:12 +00:00
alesapin
438e44e68d
Merge pull request #35659 from ClickHouse/fix_flaky_test 
Fix multiple flaky tests
 2022-03-28 21:18:37 +02:00
Anton Popov
6cbdc6af00 remove obsolete parameter 2022-03-28 18:44:53 +00:00
Vladimir C
ecdd89e811
Merge pull request #35666 from vdimir/fix-fuse 2022-03-28 20:40:43 +02:00