Commit Graph

10806 Commits

Author SHA1 Message Date
Vladimir C
77dac8e490
Merge pull request #36179 from CurtizJ/dynamic-columns-10 2022-04-13 15:57:32 +02:00
avogar
348cae0d16 Fix possible segfault in schema inference for JSON formats 2022-04-13 12:34:40 +00:00
Kruglov Pavel
03fc08cec3
Merge pull request #36137 from azat/client-profile-events
ProfileEvents fixes
2022-04-13 12:27:39 +02:00
Nikolai Kochetov
362fcfd2b8
Merge pull request #36075 from ClickHouse/fix-limit-push-down-over-window
Disable LIMIT push down through WINDOW functions.
2022-04-13 11:57:37 +02:00
Kseniia Sumarokova
d9ce08915a
Merge pull request #36130 from yuuch/support_MySQL_style_FORMAT_Vertical_before_semicolon
support  '\G;' at the end of query
2022-04-13 10:39:40 +02:00
Kseniia Sumarokova
9c0e96f111
Merge pull request #36175 from kssenii/fixing-s3-tests-1
Fix flacky test 01161_all_system_tables under s3 storage
2022-04-13 10:34:42 +02:00
Anton Popov
b066585cae
Apply suggestions from code review
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
2022-04-12 22:12:58 +02:00
Yakov Olkhovskiy
c675e21872 tests updated 2022-04-12 15:49:08 -04:00
Azat Khuzhin
891c601589 Fix ProfileEvents overlaps (for multiple queries) in clickhouse-local
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 22:27:12 +03:00
Anton Popov
0679d4814d allow to convert empty string to objects 2022-04-12 18:58:40 +00:00
tavplubix
303ecc6f7d
Merge pull request #36136 from ClickHouse/transactions_fix_1
Minor fix for transactions
2022-04-12 21:38:47 +03:00
Azat Khuzhin
097e2f626d Do not overlap profile events snapshots for queries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 20:54:56 +03:00
Azat Khuzhin
d9dd8f5f65 Fix filtering out snapshots from profile events
This fixes POSITION_OUT_OF_BOUND error:

    $ clickhouse-client --print-profile-events --profile-events-delay-ms=-1 -n -q 'select sleep(1); select 1'
    0
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] ContextLock: 9 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] FunctionExecute: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] MemoryTrackerUsage: 2132102 (gauge)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] NetworkReceiveElapsedMicroseconds: 139 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] NetworkSendBytes: 4850 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] NetworkSendElapsedMicroseconds: 1844 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] Query: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] RWLockAcquiredReadLocks: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] SelectQuery: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] SelectedBytes: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:48 [ 0 ] SelectedRows: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] OSCPUVirtualTimeMicroseconds: 1842 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] OSReadChars: 426 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] OSWriteChars: 322 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] RealTimeMicroseconds: 1002689 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] SleepFunctionCalls: 1 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] SleepFunctionMicroseconds: 1000000 (increment)
    [p1.azat.localdomain] 2022.04.12 19:31:49 [ 0 ] UserTimeMicroseconds: 1843 (increment)
    1
    Error on processing query: Code: 11. DB::Exception: Position out of bound in Block::erase(), max position = 5. (POSITION_OUT_OF_BOUND) (version 22.4.1.1)
    (query: select 1)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 20:54:56 +03:00
Azat Khuzhin
1fa3e6a426 Fix printing ProfileEvents on client for multiple queries
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 20:54:56 +03:00
Azat Khuzhin
d46eaadacc tests: do not use process substution in 02050_client_profile_events
bash does not waits then and so if the next line will be executed fast
enough, result of process substituted command can appers in stdout after
it.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 20:54:56 +03:00
Azat Khuzhin
75789eb9a7 tests: improve 02050_client_profile_events
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-12 20:54:56 +03:00
Maksim Kita
aa0464d81e Fixed tests 2022-04-12 18:50:51 +02:00
kssenii
cefa64a846 Fix 2022-04-12 17:56:22 +02:00
Maksim Kita
9b332c1e31 Fix early_constant_folding performance test 2022-04-12 17:06:21 +02:00
Kruglov Pavel
2436ab8990
Merge pull request #36083 from Avogar/fix-tests
Try to avoid timeoutes in parallel parsing tests
2022-04-12 16:19:42 +02:00
mergify[bot]
0b3c15c07a
Merge branch 'master' into projection-fix1 2022-04-12 13:49:28 +00:00
jewisliu
b2c10611d1 support UNSIGNED modifier with unused parameters of INT 2022-04-12 19:49:57 +08:00
Kseniia Sumarokova
97baa250b6
Merge pull request #36131 from ClickHouse/kssenii-patch-3
Update 01171_mv_select_insert_isolation_long.sh
2022-04-12 11:56:13 +02:00
mergify[bot]
46b9a1ef80
Merge branch 'master' into client-trailing-space 2022-04-11 22:07:37 +00:00
Yakov Olkhovskiy
783dbb2e63
Merge branch 'master' into dev_materialized_view 2022-04-11 17:47:35 -04:00
Yakov Olkhovskiy
155a2a0d42
Merge pull request #35349 from yakov-olkhovskiy/interpolate-feature
Interpolate feature
2022-04-11 11:15:50 -04:00
Anton Popov
471e945efe
Merge pull request #35934 from ClickHouse/make_date
Implementation of makeDateTime() and makeDateTime64() #30895
2022-04-11 16:38:23 +02:00
Alexander Tokmakov
38c80940fd slightly beter fix 2022-04-11 16:25:59 +02:00
tavplubix
983052951a
Merge pull request #36128 from ClickHouse/fix_flaky_00971_01003
Fix flaky tests 00971 and 01003
2022-04-11 16:45:38 +03:00
Alexander Gololobov
f730ff9805 Added queries with _part_offset and another virtual column 2022-04-11 15:38:22 +02:00
Kseniia Sumarokova
991d6d18df
Update 01171_mv_select_insert_isolation_long.sh 2022-04-11 15:08:51 +02:00
Kruglov Pavel
5ceb96be87
Fix tests 2022-04-11 14:56:49 +02:00
Kruglov Pavel
9ce069c8b5
Fix tests 2022-04-11 14:56:32 +02:00
yuuch
36e2809fd7 support '\G;' at the end of query 2022-04-11 20:46:52 +08:00
Alexander Tokmakov
5c0d15e017 fix flaky tests 2022-04-11 12:52:26 +02:00
Vladimir C
1a604cd279
Merge pull request #36058 from xiedeyantu/master 2022-04-11 10:45:50 +02:00
jewisliu
3521292fad Auto assign numbers for Enum elements 2022-04-10 11:57:25 +08:00
xiedeyantu
5efd8a4ec0 If data type has DEFAULT NULL in table definition, make data type Nullable 2022-04-09 15:00:41 +08:00
tavplubix
faae540a85
Merge pull request #24258 from ClickHouse/mvcc_prototype
MVCC prototype for MergeTree
2022-04-08 22:02:13 +03:00
Anton Popov
ebcfe2fdc8 fix one more case with nested arrays 2022-04-08 18:29:26 +00:00
avogar
833836e8da Try to avoid timeoutes in parallel parsing tests 2022-04-08 16:46:11 +00:00
Anton Popov
6364b6f78f Merge remote-tracking branch 'upstream/master' into dynamic-columns-9 2022-04-08 15:05:51 +00:00
Anton Popov
3fce23357c fix insertion of complex json with nested arrays 2022-04-08 14:58:02 +00:00
Yakov Olkhovskiy
87c2b3e2cf fixed Nullable, tests added 2022-04-08 10:52:10 -04:00
Nikolai Kochetov
2deec53162 Disable LIMIT push down through WINDOW functions. 2022-04-08 13:39:54 +00:00
Kruglov Pavel
d7b88d7683
Merge pull request #35582 from Avogar/improve-schema-inference
Improve schema inference and add some fixes
2022-04-08 13:44:52 +02:00
Alexander Tokmakov
141fbc6980 Merge branch 'master' into mvcc_prototype 2022-04-08 13:38:11 +02:00
Alexander Tokmakov
49c35f3261 Merge branch 'master' into mvcc_prototype 2022-04-08 13:34:40 +02:00
Vitaly Baranov
45dea9933b
Merge pull request #35883 from azat/format-settings
Do not allow SETTINGS after FORMAT for INSERT queries
2022-04-08 12:38:14 +02:00
alesapin
1ba77786ea
Merge pull request #36054 from ClickHouse/fix-flaky-test
Fix flaky test
2022-04-08 12:08:21 +02:00
alesapin
8ec802bc62
Merge pull request #35475 from kssenii/remote-fs-cache-improvements
Allow to write remote fs cache on all write operations. Add `system.remote_filesystem_cache` table. Add `drop remote filesystem cache (<path>)` query. Add `system.remote_data_paths` table.
2022-04-08 12:06:26 +02:00
Vladimir C
265fa90689
Merge pull request #36033 from vdimir/cross-join-empty-list 2022-04-08 11:59:21 +02:00
Azat Khuzhin
44bf8ba568 Remove trailing whitespace in default client_name
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-08 08:09:47 +03:00
kssenii
0b7af1f26c Fix checks 2022-04-08 01:58:55 +02:00
Alexander Tokmakov
6a46da93ae Merge branch 'master' into mvcc_prototype 2022-04-07 23:22:19 +02:00
Alexey Milovidov
2623b05e59 Fix flaky test 2022-04-07 22:58:29 +02:00
Alexander Tokmakov
2e2e2b9190 fix a race condition 2022-04-07 18:17:43 +02:00
Kseniia Sumarokova
5f9bc1c68e
Merge pull request #35987 from awakeljw/fork_chmaster
[Improvement] improvement in PARTITION ALL
2022-04-07 17:36:35 +02:00
Azat Khuzhin
33d99c8ffb Introduce compatiblity mode for SETTINGS after FORMAT
Add allow_settings_after_format_in_insert setting, OFF by default.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
v2: s/parser_settings_after_format_compact/allow_settings_after_format_in_insert/ (suggested by vitlibar)
v3: replace ParserSettings with a flag (requested by vitlibar)
2022-04-07 16:36:34 +03:00
Azat Khuzhin
c5ffbc688e Do not allow SETTINGS after FORMAT for INSERT queries
Parsing SETTINGS after FORMAT, that has been introduced in [1], can
interpret SETTING as some values, which is misleading.

  [1]: https://github.com/ClickHouse/ClickHouse/pull/4174/files#diff-ba7bd0657630b1cd94cf6ed364bd857338096f49f66dc82918438d6745753775R106

Note, that we are touching only INSERT queries, not SELECT, since this
is a backward incompatible change, and in case of modifying SELECT it
can break too much.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Fixes: #35100
Fixes: #20343
2022-04-07 16:29:36 +03:00
Alexander Tokmakov
7f54e7b422 Merge branch 'master' into mvcc_prototype 2022-04-07 15:14:06 +02:00
avogar
1c783ed88a Resolve conflicts 2022-04-07 12:17:48 +00:00
Kruglov Pavel
73adbb4c15
Merge pull request #35986 from amosbird/better-scalar1
Fix performance regression of scalar query
2022-04-07 14:07:59 +02:00
Alexander Tokmakov
8290ffa88d Merge branch 'master' into mvcc_prototype 2022-04-07 13:50:42 +02:00
avogar
d2017a63b1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into improve-schema-inference 2022-04-07 11:36:40 +00:00
vdimir
eb7ac4c3a6
Handle empty expression list in cross join 2022-04-07 11:32:32 +00:00
Kruglov Pavel
f3f8f27db5
Merge pull request #35735 from Avogar/allow-read-bools-as-numbers
Allow to infer and parse bools as numbers in JSON input formats
2022-04-07 13:20:49 +02:00
Nikolai Kochetov
82583b9349 Update 02245_format_string_stack_overflow 2022-04-07 13:07:18 +02:00
tavplubix
c463e82a69
Merge pull request #36008 from ClickHouse/tavplubix-patch-4
Fix 02248_nullable_custom_types_to_string
2022-04-07 14:05:18 +03:00
Kruglov Pavel
4b8c8e08a4
Merge pull request #36009 from ClickHouse/Avogar-patch-4
Fix flaky test 00155_long_merges
2022-04-07 12:59:57 +02:00
alesapin
379eca0db2
Merge pull request #36001 from ClickHouse/Avogar-patch-3
Make test 00159_parallel_formatting_tsv_and_friends.sh more stable
2022-04-07 12:45:57 +02:00
Alexander Gololobov
42d4a84a6f More tests for corner cases 2022-04-07 12:34:26 +02:00
tavplubix
6e9c028bbb
Merge pull request #35956 from Algunenano/limit_dns_retries
DNS cache: Add option to drop elements after several consecutive failures
2022-04-07 13:20:36 +03:00
Nikolai Kochetov
3e1b3f14c0
Merge pull request #34355 from azat/processors-profiling
Profiling on Processors level
2022-04-07 12:13:14 +02:00
Amos Bird
9cf5935604
Fix broken SET reuse during projection analysis. 2022-04-07 17:46:49 +08:00
jewisliu
77edd41b2e [Improvement] improvement in PARTITION ALL
1. ASTPartition::formatImpl should output ALL while executing ALTER TABLE t DETACH PARTITION ALL
2. prohibit PARTITION ALL excepte DETACH PARTITION ALL
2022-04-07 17:37:01 +08:00
Kseniia Sumarokova
99a55a2304
Merge pull request #35995 from vdimir/rename_join_ordinary_to_atomic
Create parent directories in DiskLocal::replaceFile
2022-04-07 10:23:40 +02:00
Yakov Olkhovskiy
7dbe8bc2dc major bugs fixed, tests added, docs updated 2022-04-07 01:21:24 -04:00
Alexander Gololobov
81d150ed43 Implementation of makeDateTime() and makeDateTime64() 2022-04-07 00:30:18 +02:00
mergify[bot]
585cff1e95
Merge branch 'master' into limit_dns_retries 2022-04-06 18:23:17 +00:00
Kruglov Pavel
87e0656c3b
Fix flaky test 00155_long_merges 2022-04-06 19:44:37 +02:00
tavplubix
45b284d098
Update 02248_nullable_custom_types_to_string.sql 2022-04-06 20:22:24 +03:00
Kruglov Pavel
57ddb18f86
Make test 00159_parallel_formatting_tsv_and_friends.sh more stable 2022-04-06 16:04:55 +02:00
Kruglov Pavel
ec2213493f
Merge branch 'master' into allow-read-bools-as-numbers 2022-04-06 14:53:02 +02:00
Yakov Olkhovskiy
c73115ffb4
Merge pull request #35840 from zzsmdfj/issue/#34966_fix_dateTime_deserialize
to #34966_fix_dateTime_deserialize
2022-04-06 08:10:23 -04:00
Amos Bird
53628092e2
Fix test 2022-04-06 20:04:13 +08:00
Kruglov Pavel
9141066de3
Merge branch 'master' into improve-schema-inference 2022-04-06 13:51:07 +02:00
vdimir
4cb7b7e49b
Create parent directories in DiskLocal::replaceFile 2022-04-06 11:15:37 +00:00
Kruglov Pavel
ab5c912ad4
Merge pull request #35613 from ClickHouse/Avogar-patch-3
Check all logs for crashes, logical errors, etc in backward compatibility check
2022-04-06 12:58:37 +02:00
Vladimir C
2ebae2d722
Merge pull request #35682 from CurtizJ/dynamic-columns-6 2022-04-06 11:48:07 +02:00
Raúl Marín
9e7ffcce59 Add test to check DNS profile events 2022-04-06 11:09:08 +02:00
Kseniia Sumarokova
0e1637dfaf
Merge pull request #35354 from kssenii/enable-testmode-by-default
Remove testmode option, enable it unconditionally
2022-04-06 10:06:08 +02:00
Yakov Olkhovskiy
c7d72b92da explicit timezone added to test 2022-04-05 20:32:52 -04:00
Alexey Milovidov
eb1953f91e
Merge pull request #35638 from den-crane/test/crash_35551
test for crash _join_with_nullable_lowcardinality #35551
2022-04-06 03:28:18 +03:00
kssenii
d59d4eda4f Fix tests 2022-04-06 01:58:16 +02:00
Yakov Olkhovskiy
ea9ce3ea18 'T' is added as delimiter, tests added 2022-04-05 19:50:16 -04:00
Yakov Olkhovskiy
90c4cd3de7
Merge branch 'master' into interpolate-feature 2022-04-05 14:39:07 -04:00
Maksim Kita
2c12c93d9e
Merge pull request #35918 from kitaisreal/jit-profile-events-added-test
JIT ProfileEvents added test
2022-04-05 20:37:23 +02:00
Nikolai Kochetov
def33323a0
Merge pull request #35788 from amosbird/better-projection1
Improve minmax_count_projection
2022-04-05 19:59:45 +02:00
Maksim Kita
6eff1d2b02 Fixed tests 2022-04-05 17:30:03 +02:00
Alexander Tokmakov
1fe50ad201 Merge branch 'master' into mvcc_prototype 2022-04-05 14:38:02 +02:00
Maksim Kita
c3c284e6e6
Merge pull request #35917 from kitaisreal/executable-user-defined-function-fix
Executable user defined functions prevent executing during analysis
2022-04-05 14:05:52 +02:00
kssenii
42c5721d9f Fix tests with wide parts enabled 2022-04-05 13:03:25 +02:00
kssenii
4bfac4ec99 Remove more testmode mentions 2022-04-05 12:17:34 +02:00
Nikolai Kochetov
4479b68980
Merge pull request #35623 from nickitat/function_calculation_after_sorting_and_limit
Functions calculation after sorting
2022-04-05 12:09:56 +02:00
Maksim Kita
fd1c8103a0 Fixed tests 2022-04-05 11:47:45 +02:00
Alexander Tokmakov
da00beaf7f Merge branch 'master' into mvcc_prototype 2022-04-05 11:14:42 +02:00
Azat Khuzhin
c6f182163a Require mutations for per-table TTL only when it had been changed
Before this patch only per-column TTL did not requires mutation if it
had not been changed, after per-table TTL will also check whether it had
been changed or not.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-05 11:08:35 +03:00
Amos Bird
5bc09550d8
Fix tests 2022-04-05 15:56:39 +08:00
Amos Bird
f87b25f2d7
Fix tests 2022-04-05 15:56:38 +08:00
Amos Bird
163664fad7
Improve minmax_count_projection 2022-04-05 15:56:37 +08:00
Vladimir C
54b4049ea5
Merge pull request #35794 from awakeljw/fork_chmaster 2022-04-05 09:44:45 +02:00
kssenii
3fd462bc05 Merge master 2022-04-05 00:06:18 +02:00
Alexey Milovidov
9d5c13c71d
Merge pull request #35886 from azat/format-insert-infile-fix
Fix formatting of INSERT INFILE queries (missing quotes)
2022-04-05 00:47:54 +03:00
alesapin
1e4fe5e3b5
Merge pull request #35882 from ClickHouse/more_metadata_alters
Make more alters of nested types metadata-only
2022-04-04 20:11:31 +02:00
Anton Popov
3a6bee309b
Skip test with ordinary database 2022-04-04 19:10:56 +02:00
Vladimir C
b80f24957e
Merge pull request #35674 from vdimir/asof-key-null-issue-35565 2022-04-04 16:56:04 +02:00
Anton Popov
bd93be65aa
Merge pull request #35820 from azat/columns-ttl-fix
Avoid processing per-column TTL multiple times
2022-04-04 16:42:50 +02:00
Maksim Kita
a46495de5c JIT ProfileEvents added test 2022-04-04 16:22:16 +02:00
Anton Popov
d08d4a2437
Merge pull request #35806 from CurtizJ/dynamic-columns-8
Fix inserts to columns of type `Object` in partitioned tables
2022-04-04 16:16:54 +02:00
Maksim Kita
482c8f667c Added tests 2022-04-04 16:10:19 +02:00
Antonio Andelic
db75bf6f5d
Merge pull request #35852 from ClickHouse/bigo-sg-add_hints
Refactoring of hints for column descriptor
2022-04-04 15:37:08 +02:00
alesapin
3ccf99c3d7
Merge pull request #35884 from ClickHouse/don_t_allow_to_reset_settings
Forbid to reset non existing settings
2022-04-04 15:27:34 +02:00
Nickita Taranov
ce40d84eef more fixes 2022-04-04 14:33:58 +02:00
Nickita Taranov
5590f78dfe update remerge_sort_lowered_memory_bytes_ratio 2022-04-04 14:33:57 +02:00
Nickita Taranov
a39427f00b clean up 2022-04-04 14:33:57 +02:00
Nickita Taranov
85fbf6cc62 update one more test 2022-04-04 14:33:57 +02:00
Nickita Taranov
b07f35ce28 fix test 2022-04-04 14:33:57 +02:00
Nickita Taranov
3308b9d3af disable test temporarily 2022-04-04 14:33:57 +02:00
Nickita Taranov
eedcd61479 fix 2022-04-04 14:33:57 +02:00
Nickita Taranov
b095838444 stash 2022-04-04 14:33:57 +02:00
Nickita Taranov
4c51329ad6 stash 2022-04-04 14:33:57 +02:00
Alexander Tokmakov
a2167f12b8 Merge branch 'master' into mvcc_prototype 2022-04-04 14:24:23 +02:00
何李夫
09c04e4993
Improve the pipeline description for JOIN (#35612)
Improve the pipeline description for JOIN
2022-04-04 13:56:41 +02:00
Maksim Kita
e6c9a36ac7
Merge pull request #35733 from kitaisreal/ipv6-invalid-insert-test
Added test for insert of invalid IPv6 value
2022-04-04 12:28:16 +02:00
Azat Khuzhin
99528e296c Rename need_data_elapsed_us/port_full_elapsed_us to input_wait_us/output_wait_us
$ gg -e need_data_ -e port_full_  | cut -d: -f1 | sort -u | xargs sed -i -e s/port_full_/output_wait_/g -e s/need_data_/input_wait_/g -e s/getPortFull/getOutputWait/g -e s/getNeedData/getInputWait/g

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Azat Khuzhin
0d06dab362 tests: cover processors_profile_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 13:19:43 +03:00
Nikolai Kochetov
19819c72f8
Merge pull request #35290 from bigo-sg/function_enumerate_streams
Add function getTypeSerializationStreams
2022-04-04 12:09:53 +02:00
alesapin
803a1a2a9c Fix tests and check 2022-04-04 11:19:02 +02:00
Anton Popov
11e18a16f3
Merge pull request #35724 from Avogar/fix-order
Improve schema inference for JSONEachRow and TSKV formats
2022-04-04 11:00:21 +02:00
Azat Khuzhin
93bbe9641a Fix formatting of INSERT ... COMPRESSION
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 10:33:12 +03:00
Azat Khuzhin
9a76efb850 Fix formatting of INSERT INFILE queries (missing quotes)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-04 10:33:12 +03:00
Antonio Andelic
d96b682a55 Refactor 2022-04-04 07:24:42 +00:00
taiyang-li
f4772d3b8f chmod a+x 02250_hints_for_columns/02250_hints_for_projections 2022-04-04 07:24:42 +00:00
taiyang-li
10bbb96512 fix stateless test 2022-04-04 07:24:42 +00:00
taiyang-li
9dd1a76fd8 fix stateless tests 2022-04-04 07:24:42 +00:00
taiyang-li
fd9a10ef53 add hints for projections 2022-04-04 07:24:42 +00:00
Alexey Milovidov
d9e5ca2119
Merge pull request #34394 from holadepo/last_day
Add toLastDayOfMonth function
2022-04-04 07:02:08 +03:00
mergify[bot]
4d9bb9f6fd
Merge branch 'master' into test/crash_35551 2022-04-04 03:59:10 +00:00
Alexey Milovidov
86558bba5a Move tests to bugs 2022-04-04 00:52:43 +02:00
Habibullah Oladepo
2dd7420fc7 Add tests for toLastDayOfMonth 2022-04-03 23:42:39 +01:00
alesapin
a8c1ccdb20 Forbit to reset non existing settings 2022-04-03 18:29:24 +02:00
alesapin
7b35920d4c Make more alters of nested types metadata-only 2022-04-03 14:03:34 +02:00
Alexey Milovidov
5a47958744
Merge pull request #35736 from CurtizJ/quota-written-bytes
Add quota for written bytes
2022-04-03 05:26:49 +03:00
Azat Khuzhin
195b4c47ea Avoid processing per-column TTL multiple times
Before this patch ttl.txt will not be written for per-column TTLs, and
hence it will be calculated every time after server restart of
DETACH/ATTACH cycle (note, that it will work w/o restart since in-memory
representation will avoid this).

v2: convert test to .sh to get correct current database over default for MV
v3: extract UUID to avoid error like in [1]:
    [ 490 ] {} <Error> void DB::SystemLog<DB::TextLogElement>::flushImpl(const std::vector<LogElement> &, uint64_t) []: Code: 349. DB::Exception: Cannot convert NULL value to non-Nullable type: While processing query_id LIKE concat('%', CAST(_CAST(NULL, 'Nullable(UUID)') AS uuid, 'String'), '%'): while pushing to view test_0hc2ro.this_text_log (c64e5af4-059e-4330-a728-354ecf83c031). (CANNOT_INSERT_NULL_IN_ORDINARY_COLUMN)
    [1]: https://s3.amazonaws.com/clickhouse-test-reports/35820/a512d322b024d37d2f1082c4833f59f86057555f/stateless_tests_flaky_check__address__actions_.html
v4: add no-parallel to avoid issues with disappeared underlying table while pushing to text_log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-02 15:19:39 +03:00
Kruglov Pavel
860b1a1b1b
Update 02248_nullable_custom_types_to_string.sql 2022-04-02 14:04:04 +02:00
mergify[bot]
1e43e26fa1
Merge branch 'master' into fix-order 2022-04-02 12:00:29 +00:00
avogar
3ae36ac483 Fix tests 2022-04-02 11:59:32 +00:00
Kruglov Pavel
60c2b54dc9
Fix test 2022-04-02 13:55:37 +02:00
Kruglov Pavel
f7902ae2d1
Fix test 2022-04-02 13:53:30 +02:00
Kruglov Pavel
687e9e7aeb
Merge pull request #35760 from Avogar/insert-from-input
Improve schema inference for insert select from table functions
2022-04-02 13:50:48 +02:00
avogar
b815c38d38 Update test reference file 2022-04-02 11:45:48 +00:00
Anton Popov
687942ce70 more strict quota for written bytes 2022-04-01 15:02:49 +00:00
Yakov Olkhovskiy
38993f215f
Merge pull request #35706 from yakov-olkhovskiy/ephemeral-35641
Allow EPHEMERAL without explicit default expression
2022-04-01 10:49:29 -04:00
kssenii
6c8e073a61 Merge master 2022-04-01 16:48:29 +02:00
Alexander Tokmakov
6591d1ceb7 Merge branch 'master' into mvcc_prototype 2022-04-01 15:38:46 +02:00
zzsmdfj
79c75d8a71 to #34966_fix_dateTime_deserialize 2022-04-01 20:18:28 +08:00
zzsmdfj
ececee3817 to #34966_fix_dateTime_deserialize 2022-04-01 20:13:34 +08:00
Anton Popov
075bcf3f5f
Merge pull request #35803 from Avogar/fix-formats-with-names
Fix bug in indexes of not presented columns in -WithNames formats
2022-04-01 13:33:35 +02:00
Kseniia Sumarokova
cafff71d2f
Merge pull request #35799 from evillique/extract-parser-fix
Fix extract function parser
2022-04-01 10:59:39 +02:00
alesapin
f2c6387a8d
Merge pull request #35381 from kssenii/remote-filesystem-cache-fixes
Cache fixes for high concurrency on corner cases
2022-04-01 10:48:31 +02:00
Kseniia Sumarokova
d3b3294872
Merge pull request #35365 from bigo-sg/improve_access_type
Improve check access in table functions
2022-04-01 10:47:02 +02:00
Antonio Andelic
8cc18c851d
Merge pull request #35705 from ClickHouse/is-secure-client-info
Added `is_secure` column to `query_log`
2022-04-01 08:27:20 +02:00
jewisliu
9a4cc78dfb support ALTER TABLE t DETACH PARTITION ALL syntax 2022-04-01 13:13:07 +08:00
Alexey Milovidov
5c6b84c398
Merge pull request #35586 from kssenii/fix-virtual-columns-s3
Fix s3 engine getting virtual columns
2022-04-01 04:43:32 +03:00
mergify[bot]
864d6c3eaf
Merge branch 'master' into test/crash_35551 2022-04-01 01:32:56 +00:00
Alexander Tokmakov
44a8622851 fix test 2022-03-31 18:32:20 +02:00
Anton Popov
e74d5f9d4c
Update 01825_type_json_partitions.sql 2022-03-31 18:30:19 +02:00
kssenii
603dcbb1b7 Extend test 2022-03-31 18:23:15 +02:00
avogar
ab2a963287 Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-read-bools-as-numbers 2022-03-31 14:09:43 +00:00
mergify[bot]
24ade25d61
Merge branch 'master' into improve-schema-inference 2022-03-31 13:42:47 +00:00
Anton Popov
42acb1dc29 fix inserts to columns of type Object in partitioned tables 2022-03-31 13:30:01 +00:00
kssenii
74ec5eb1cc Fix checks 2022-03-31 14:35:40 +02:00
avogar
836e7dae67 Fix bug in indexes of not presented columns in -WithNames formats 2022-03-31 12:24:40 +00:00
Nikolay Degterinsky
eb88a5f29e Add test 2022-03-31 12:20:48 +00:00
Nikita Mikhaylov
5f27f690f4 Revert "Added support for schema inference for hdfsCluster (#35602)"
This reverts commit f6bfdcc0c9.
2022-03-31 14:19:56 +02:00
Kruglov Pavel
d166bb5115
Update 02245_format_string_stack_overflow.sql 2022-03-31 13:47:15 +02:00
mergify[bot]
f9a0692e2c
Merge branch 'master' into Avogar-patch-3 2022-03-31 11:45:31 +00:00
avogar
74f0988657 Fix tests 2022-03-31 11:34:06 +00:00
avogar
a41c73fcf6 Fix tests 2022-03-31 11:25:52 +00:00
avogar
63946ccb32 Fix tests 2022-03-31 11:14:30 +00:00
Kruglov Pavel
4db5043ed4
Fix test 2022-03-31 12:50:53 +02:00
Nikita Mikhaylov
f6bfdcc0c9
Added support for schema inference for hdfsCluster (#35602) 2022-03-31 12:47:36 +02:00
Alexander Tokmakov
5a50ad9de3 Merge branch 'master' into mvcc_prototype 2022-03-31 11:35:04 +02:00
Kseniia Sumarokova
0b20329156
Merge pull request #35727 from kssenii/fix-any-all
Fix any/all(subquery)
2022-03-31 10:05:37 +02:00
Antonio Andelic
e336302650 Merge branch 'master' into is-secure-client-info 2022-03-31 06:58:16 +00:00
taiyang-li
a5765dccb1 Merge branch 'master' into function_enumerate_streams 2022-03-31 12:21:00 +08:00
taiyang-li
70087bc959 Merge branch 'master' into improve_access_type 2022-03-31 12:19:17 +08:00
Yakov Olkhovskiy
8e00cc2aca fix messed commit 2022-03-30 23:52:48 -04:00
Yakov Olkhovskiy
3b40b56e56 refactored to remove parsers rependency on datatypes 2022-03-30 23:47:16 -04:00
Nikolay Degterinsky
f055d7b692
Merge pull request #34055 from palegre-tiny/groupSortedArray
Add groupSortedArray() function
2022-03-31 01:20:15 +03:00
Kruglov Pavel
4ec3c35e14
Merge pull request #35755 from Avogar/fix-custom-to-string
Fix bug in conversion from custom types to string
2022-03-31 00:06:48 +02:00
alesapin
5a55913f45
Merge pull request #35720 from ClickHouse/parallel_stateful
Try to run stateful tests in parallel
2022-03-30 23:42:44 +02:00
Alexander Gololobov
1d7059175b
Merge pull request #35681 from tonickkozlov/patch-2
[test] Adds clean-up for functional test 02167
2022-03-30 23:09:51 +02:00
Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY (#33439)
* use AggregationMethod ctor with reserve

* add new settings

* add HashTablesStatistics

* support queries with limit

* support distributed and with external aggregation

* add new profile events

* add some tests

* add perf test

* export cache stats through AsynchronousMetrics

* rm redundant trace

* fix style

* fix 02122_parallel_formatting test

* review fixes

* fix 02122_parallel_formatting test

* apply also to two-level HTs

* try simpler strategy

* increase max_size_to_preallocate_for_aggregation for experiment

* fixes

* Revert "increase max_size_to_preallocate_for_aggregation for experiment"

This reverts commit 6cf6f75704.

* fix test

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-03-30 22:47:51 +02:00
Alexander Gololobov
8f7329d7dd
Removed debug print 2022-03-30 20:10:25 +02:00
kssenii
c1ae5814a7 Merge master 2022-03-30 17:59:36 +02:00
tavplubix
c34d512586
Update 00484_preferred_max_column_in_block_size_bytes.sql 2022-03-30 18:36:37 +03:00
kssenii
d810853b78 Fix path in test 2022-03-30 17:35:59 +02:00
kssenii
099fa0e668 Merge master 2022-03-30 17:33:32 +02:00
kssenii
0fc92fe2aa Get rid of all "remote" mentions 2022-03-30 17:15:29 +02:00
mergify[bot]
4813f0b305
Merge branch 'master' into is-secure-client-info 2022-03-30 15:12:56 +00:00
kssenii
b30948dd53 Relax test 2022-03-30 17:12:23 +02:00
Alexander Gololobov
6e1036de50
Fix user file path extraction
It turned out that $CLICHOUSE_CLIENT could produce more verbose output that was not properly parsed. I made a change that should fix this parsing.
2022-03-30 16:12:13 +02:00
Maksim Kita
12ec3522e6
Merge pull request #35745 from azat/fix-tests-v22.3
Tests fixes
2022-03-30 15:44:25 +02:00
avogar
265fbaaa5a Fix tests 2022-03-30 13:23:43 +00:00
Kruglov Pavel
8c05a3dffc
Update 01825_type_json_parallel_insert.sql 2022-03-30 15:00:32 +02:00
avogar
849596c7a2 Improve schema inference for insert select queries 2022-03-30 12:44:53 +00:00
tavplubix
cf8332e109
Update 00170_s3_cache.reference 2022-03-30 14:38:21 +03:00
Anton Popov
d53858758d fix tests 2022-03-30 11:32:08 +00:00
Antonio Andelic
7bc5731025 Merge branch 'master' into is-secure-client-info 2022-03-30 11:26:05 +00:00
avogar
af4bfec051 Fix bug in conversion from custom types to string 2022-03-30 11:19:03 +00:00
Maksim Kita
371cdc956a Added input format settings for parsing invalid IPv4, IPv6 addresses as default values 2022-03-30 12:54:19 +02:00
Vladimir C
31c367d3cd
Merge pull request #35651 from amosbird/columntransformerrename 2022-03-30 12:37:30 +02:00
kssenii
98ad3f4a91 Fix tests, rename some remote mentions 2022-03-30 12:21:59 +02:00
tavplubix
531942ce5c
Update 00170_s3_cache.sql 2022-03-30 12:43:34 +03:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
Azat Khuzhin
2a099d90fe tests: make 02152_http_external_tables_memory_tracking more stable
After settings randomization, it can not reach max_untracked_memory,
i.e. due to max_block_size=67990 for example (like in [1]).

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35683/c609426d091ea8b9f2d37f8d7fcbf9e759cc94e5/stateless_tests__release__actions_.html

Fix this, by settings max_untracked_memory to 0, to track any
allocations.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 11:06:07 +03:00
Azat Khuzhin
b264bdcf5e tests: wait for left queries in 00417_kill_query
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/c244ee7cbb61fea384679e18a577ff579060288b/stateless_tests__release__s3_storage__actions_/runlog.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 11:06:07 +03:00
Antonio Andelic
b70456879e Add tests for is_secure in query_log 2022-03-30 06:39:40 +00:00
taiyang-li
47f3e9330e merge master and fix conflict 2022-03-30 11:06:51 +08:00
taiyang-li
e76ed3acde Merge branch 'master' into improve_access_type 2022-03-30 11:04:57 +08:00
Anton Popov
a842a81aba
Merge pull request #35690 from CurtizJ/flatten-tuple
Add function `flattenTuple`
2022-03-30 00:24:36 +02:00
Anton Popov
1cba31c305
Merge pull request #35687 from CurtizJ/dynamic-columns-7
Fix reading from type object
2022-03-30 00:21:32 +02:00
Alexander Tokmakov
6191eaa983 fix some flaky tests 2022-03-29 23:12:06 +02:00
Anton Popov
caacc7d385 add quota for written bytes 2022-03-29 18:21:29 +00:00
Anton Popov
74cafe154a
fix flaky test 02246_async_insert_quota 2022-03-29 19:58:59 +02:00
kssenii
f0e0d97752 Fix lask of query id in merges 2022-03-29 19:49:42 +02:00
avogar
3fc36627b3 Allow to infer and parse bools as numbers in JSON input formats 2022-03-29 17:37:31 +00:00
Kseniia Sumarokova
e2370d9622
Update 02235_remote_fs_cache_stress.sh 2022-03-29 19:11:36 +02:00
mergify[bot]
87303368fc
Merge branch 'master' into patch-2 2022-03-29 17:07:12 +00:00
Maksim Kita
f1f4e85c4b Added test for insert of invalid IPv6 value 2022-03-29 19:02:59 +02:00
Anton Kozlov
7da5d4f145
Updated a comment that clarifies the expected error 2022-03-29 17:27:12 +01:00
tavplubix
f3e580e876
Merge pull request #35711 from kssenii/fix-local-drop-db
Fix dropping non-empty database in clickhouse local
2022-03-29 18:39:01 +03:00
Kruglov Pavel
5a5aa3ab31
Update test 2022-03-29 17:35:29 +02:00
kssenii
a2e950bd3b Fix 2022-03-29 17:34:50 +02:00
avogar
ce97ccbfb9 Improve schema inference for JSONEachRow and TSKV formats 2022-03-29 14:47:51 +00:00
Alexander Tokmakov
287d858fda Merge branch 'master' into mvcc_prototype 2022-03-29 16:24:12 +02:00
Alexander Tokmakov
c37945b2c8 run stateful tests in parallel 2022-03-29 15:24:29 +02:00
Yakov Olkhovskiy
f68f0cce04
Update 02205_ephemeral_1.reference
tests without default is added
2022-03-29 09:24:00 -04:00
Yakov Olkhovskiy
0f10a2de9c
Update 02205_ephemeral_1.sql
tests without default added
2022-03-29 09:20:05 -04:00
Dmitry Novik
8f935a72d6
Merge pull request #33230 from CurtizJ/read_in_order_max_rows_to_read
Proper handle of 'max_rows_to_read' in case of reading in order of sorting key
2022-03-29 15:16:34 +02:00
avogar
97f5033ea9 Fix tests 2022-03-29 13:07:37 +00:00
mergify[bot]
343588de2c
Merge branch 'master' into improve-schema-inference 2022-03-29 13:06:00 +00:00
taiyang-li
67c3c0be3d Merge branch 'master' into improve_access_type 2022-03-29 20:42:57 +08:00
Anton Popov
9610139477
Merge pull request #35629 from CurtizJ/dynamic-columns-5
Support schema inference for type `Object` in format `JSONEachRow`
2022-03-29 14:17:09 +02:00
Kruglov Pavel
8edf6e7448
Mark test 02242_optimize_to_subcolumns_no_storage as backward incompatible for version 22.3.2.1 2022-03-29 14:15:19 +02:00
Anton Popov
c59926dcc7 fix tests 2022-03-29 12:13:02 +00:00
tavplubix
ec496faae8
Merge pull request #35688 from ClickHouse/tavplubix-patch-4
Fix flaky 01037_polygon_dicts_correctness_fast
2022-03-29 15:07:10 +03:00
Anton Popov
d42632dc13
Merge pull request #32928 from bigo-sg/rocksdb_metacache
Speed up parts loading process of MergeTree by metadata cache
2022-03-29 14:05:22 +02:00
Alexander Gololobov
bf376ee2f5
Merge pull request #35628 from ClickHouse/make_date
Implementation of makeDate and makeDate32
2022-03-29 13:35:26 +02:00
taiyang-li
834ac3a1b9 Merge remote-tracking branch 'ck/master' into rocksdb_metacache 2022-03-29 18:32:06 +08:00
kssenii
98fe1ca1ec Fix 2022-03-29 12:05:27 +02:00
Anton Popov
5d8988ad4e
Merge pull request #35645 from CurtizJ/fix-quotas-async-inserts
Fix usage of quota with async inserts
2022-03-29 11:54:24 +02:00
Nikolai Kochetov
86690f18ee
Merge pull request #35667 from amosbird/projection-fix2
Another fix of projection part check
2022-03-29 10:22:01 +02:00
taiyang-li
db436ad621 Merge branch 'master' into function_enumerate_streams 2022-03-29 11:35:21 +08:00
Amos Bird
3ab8fc1e7b
Fix projection part check
Fix projection part check when projection part type is different from
parent part type.
2022-03-29 10:39:07 +08:00
kssenii
44157e5c80 Merge master 2022-03-29 02:19:32 +02:00
kssenii
c6b1f86306 Merge with master 2022-03-29 02:03:28 +02:00
Nikita Mikhaylov
85282f1b4d
Made schema inference work with s3Cluster table function (#35544) 2022-03-29 00:46:35 +02:00
Anton Popov
cd3cc60d5d fix fasttest 2022-03-28 21:13:20 +00:00
mergify[bot]
bf5a9dcb7a
Merge branch 'master' into groupSortedArray 2022-03-28 20:57:07 +00:00
mergify[bot]
9efc8bda78
Merge branch 'master' into remote-filesystem-cache-fixes 2022-03-28 20:53:29 +00:00
kssenii
1d49a85963 Merge master 2022-03-28 22:51:56 +02:00
Alexander Gololobov
b49993f993 Fixes according to the code review 2022-03-28 22:47:39 +02:00
kssenii
a2013ebe2b Better 2022-03-28 22:40:27 +02:00
Kseniia Sumarokova
9a8e9198e5
Merge pull request #35593 from kssenii/named-collections-fix
Fix headers with named collections, add compression_method
2022-03-28 22:10:32 +02:00
Kruglov Pavel
fddeecdd69
Fix fast test 2022-03-28 21:59:43 +02:00
alesapin
10f29ff7f9
Merge pull request #35679 from Avogar/fix-tests
Fix flaky tests 02149_read_in_order_fixed_prefix and 02177_issue_31009
2022-03-28 21:42:17 +02:00
Anton Popov
24c0cf86d4 add function 'flattenTuple' 2022-03-28 19:32:12 +00:00
alesapin
438e44e68d
Merge pull request #35659 from ClickHouse/fix_flaky_test
Fix multiple flaky tests
2022-03-28 21:18:37 +02:00
Anton Popov
6cbdc6af00 remove obsolete parameter 2022-03-28 18:44:53 +00:00
Vladimir C
ecdd89e811
Merge pull request #35666 from vdimir/fix-fuse 2022-03-28 20:40:43 +02:00
Alexander Tokmakov
208b242188 Merge branch 'master' into mvcc_prototype 2022-03-28 19:58:06 +02:00
tavplubix
9a650456eb
Update 01037_polygon_dicts_correctness_fast.sh 2022-03-28 20:42:51 +03:00
Anton Popov
d677635cd8
Merge pull request #35592 from CurtizJ/dynamic-columns-4
Add parallel parsing and schema inference for format `JSONAsObject`
2022-03-28 19:29:55 +02:00
Anton Popov
0e4af89f69 fix reading from type object 2022-03-28 17:23:34 +00:00
Alexander Gololobov
93021e387e Implementation of makeDate and makeDate32 2022-03-28 18:57:24 +02:00
Anton Popov
bbfe8a2ca7 fix possible loss of subcolumns in type Object 2022-03-28 15:36:05 +00:00
Anton Kozlov
8143526cd2
[test] Adds clean-up for functional test 02167
Running this test twice now doesn't result in a failure due to the fact that the temporary file is being cleaned up
2022-03-28 16:11:20 +01:00
alesapin
9c3e9a2c9b
Update tests/queries/0_stateless/01108_restart_replicas_rename_deadlock_zookeeper.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2022-03-28 17:11:20 +02:00
avogar
1f028dd48e Fix flaky tests 02149_read_in_order_fixed_prefix and 02177_issue_31009 2022-03-28 14:13:56 +00:00
tavplubix
e0dbe1785c
Merge pull request #35657 from ClickHouse/fix_flaky_test_1532
Fix flaky test `01532_primary_key_without_order_by_zookeeper`
2022-03-28 17:08:12 +03:00
tavplubix
1eef2d7c26
Update 01532_primary_key_without_order_by_zookeeper.sql 2022-03-28 16:56:25 +03:00
alesapin
e75a0a594d Better fix for procfs_metrics 2022-03-28 15:39:02 +02:00
Kruglov Pavel
9f2cba498c
Fix timeouts in 01514_parallel_formatting test 2022-03-28 15:34:32 +02:00
mergify[bot]
f09ebea2d8
Merge branch 'master' into read_in_order_max_rows_to_read 2022-03-28 13:30:34 +00:00
vdimir
a216bc26c1
Correct check asof join key nullability 2022-03-28 13:29:34 +00:00
alesapin
51ef88e5dd Fix 00385 2022-03-28 15:29:13 +02:00
taiyang-li
38702be40c Merge remote-tracking branch 'ck/master' into rocksdb_metacache 2022-03-28 21:03:22 +08:00