Commit Graph

18129 Commits

Author SHA1 Message Date
alesapin
be1c3c132b Fix some trash 2022-05-27 16:08:49 +02:00
Anton Popov
abc90fad8d fix WITH FILL with negative itervals 2022-05-27 12:42:51 +00:00
alesapin
32167cb6fb Turn on s3 tests 2022-05-27 14:36:12 +02:00
Azat Khuzhin
735d2dfebd tests: fix 01317_no_password_in_command_line flakiness (and make it race free)
Before it was possible not to check if the query was gone already, also
it checks all processes not only the process of the client for the
possible password.

v2: make it parallel aware
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-27 15:27:48 +03:00
Anton Popov
d68c30a92e fix tests 2022-05-27 12:27:25 +00:00
alesapin
6d6779f17a
Merge pull request #37139 from ClickHouse/i_object_storage
Separate object storage operations from disks
2022-05-27 13:59:50 +02:00
alesapin
461bb42fb8 Fix flaky test 2022-05-27 13:40:07 +02:00
Azat Khuzhin
2613149f6b Fix converting types for UNION queries (may produce LOGICAL_ERROR)
CI founds [1]:

    2022.02.20 15:14:23.969247 [ 492 ] {} <Fatal> BaseDaemon: (version 22.3.1.1, build id: 6082C357CFA6FF99) (from thread 472) (query_id: a5187ff9-962a-4e7c-86f6-8d48850a47d6) (query: SELECT 0., round(avgWeighted(x, y)) FROM (SELECT toDate(toDate('214748364.8', '-922337203.6854775808', '-0.1', NULL) - NULL, 10.000100135803223, '-2147483647'), 255 AS x, -2147483647 AS y UNION ALL SELECT y, NULL AS x, 2147483646 AS y)) Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/26d0e5438c86e52a145aaaf4cb523c399989a878/fuzzer_astfuzzerdebug,actions//report.html

The problem is that subqueries returns different headers:
- first query  -- x, y
- second query -- y, x

v2: Make order of columns strict only for UNION
    https://s3.amazonaws.com/clickhouse-test-reports/34775/9cc8c01a463d18c471853568b2f0af659a4e643f/stateless_tests__address__actions__[2/2].html
    Fixes: 00597_push_down_predicate_long
v3: add no-backward-compatibility-check for the test
Fixes: #37569
Resubmit: #34775
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit a813f5996e)
2022-05-27 14:11:57 +03:00
Kseniia Sumarokova
f5d69506b4
Merge pull request #37516 from KinderRiven/improve_local_cache
Control cache downloads to avoid negative optimization of local caches
2022-05-27 11:53:17 +02:00
Antonio Andelic
e1772c571c Compress clickhouse logs 2022-05-27 07:10:20 +00:00
Alexey Milovidov
393846e1ee Fix test 2022-05-27 04:08:04 +02:00
Dmitry Novik
3a9239b79f
Revert "RFC: Fix converting types for UNION queries (may produce LOGICAL_ERROR)" 2022-05-27 04:05:32 +02:00
Alexey Milovidov
faa519300e Fix more tests 2022-05-27 02:20:16 +02:00
Alexey Milovidov
d71780d34c Fix some tests 2022-05-27 02:18:38 +02:00
Alexey Milovidov
69a1a0c6d7
Merge branch 'master' into time-zone-in-stateless-tests 2022-05-27 03:04:42 +03:00
Alexey Milovidov
86afa3a245
Merge pull request #37502 from ClickHouse/array_norm_dist_fixes
Renamed arrayXXNorm/arrayXXDistance functions to XXNorm/XXDistance and fixed some overflow cases
2022-05-27 00:56:29 +03:00
Alexander Tokmakov
eb71dd4c78
Merge pull request #37547 from ClickHouse/followup_37398
Follow-up to #37398
2022-05-26 20:29:41 +03:00
mergify[bot]
8f7b9623c6
Merge branch 'master' into build-report 2022-05-26 16:59:22 +00:00
mergify[bot]
5e6d22055d
Merge branch 'master' into tiny_fixes_for_jepsen 2022-05-26 16:50:18 +00:00
Dmitry Novik
673a521d0b
Merge pull request #34775 from azat/union-type-cast
RFC: Fix converting types for UNION queries (may produce LOGICAL_ERROR)
2022-05-26 17:28:23 +02:00
alesapin
85c7b55b81 Slightly better jepsen tests 2022-05-26 16:54:46 +02:00
alesapin
8ae277a1c4 Fix test 2022-05-26 15:25:48 +02:00
KinderRiven
55379f0d03 fix config 2022-05-26 20:59:31 +08:00
Alexander Tokmakov
e8f33fb0d9 fix flaky tests 2022-05-26 14:17:05 +02:00
Maksim Kita
3a92e61827
Merge pull request #37148 from kitaisreal/dictionary-get-descendants-performance-improvement
Dictionary getDescendants performance improvement
2022-05-26 12:29:17 +02:00
KinderRiven
286c13317f fix stateless test 2022-05-26 17:38:42 +08:00
KinderRiven
ab4614dee5 fix 2022-05-26 16:39:50 +08:00
KinderRiven
f5a186c774 add test for local cache download 2022-05-26 16:36:26 +08:00
Dmitry Novik
5c3c994d2a
Merge pull request #37493 from ClickHouse/grouping-sets-optimization-fix
Fix ORDER BY optimization in case of GROUPING SETS
2022-05-26 02:25:02 +02:00
Anton Popov
f488efd27e fix tests 2022-05-26 00:03:31 +00:00
Dmitry Novik
3c1b6609ae Add comments and make tests more verbose 2022-05-25 21:23:35 +00:00
mergify[bot]
49cce189e3
Merge branch 'master' into floating_seconds 2022-05-25 21:08:55 +00:00
Mikhail f. Shiryaev
e1ed2aa3dc
Add failed builds to the build report 2022-05-25 23:00:33 +02:00
alesapin
1db9cf480b Merge remote-tracking branch 'origin/master' into i_object_storage 2022-05-25 22:50:22 +02:00
alesapin
4410d3d15f Better test 2022-05-25 22:49:54 +02:00
Maksim Kita
58cd1bd3ec
Merge pull request #36843 from bharatnc/ncb/h3-unidirectionaledges-funcs
add h3 unidirectional edge functions
2022-05-25 22:46:40 +02:00
Maksim Kita
bee3c30f66
Merge pull request #37524 from kitaisreal/geo-distance-functions-improve-performance
Geo distance functions improve performance
2022-05-25 22:40:40 +02:00
Maksim Kita
b12b363158 Fixed build of hierarchical index for HashedArrayDictionary 2022-05-25 22:40:19 +02:00
Alexander Gololobov
168b47d0ad Use same norm and distance function names for tuples and arrays 2022-05-25 22:39:59 +02:00
Alexander Gololobov
b065839f44 always return Float64 2022-05-25 22:27:00 +02:00
alesapin
6f5c86e55e Merge branch 'master' into i_object_storage 2022-05-25 20:49:01 +02:00
Azat Khuzhin
a813f5996e Fix converting types for UNION queries (may produce LOGICAL_ERROR)
CI founds [1]:

    2022.02.20 15:14:23.969247 [ 492 ] {} <Fatal> BaseDaemon: (version 22.3.1.1, build id: 6082C357CFA6FF99) (from thread 472) (query_id: a5187ff9-962a-4e7c-86f6-8d48850a47d6) (query: SELECT 0., round(avgWeighted(x, y)) FROM (SELECT toDate(toDate('214748364.8', '-922337203.6854775808', '-0.1', NULL) - NULL, 10.000100135803223, '-2147483647'), 255 AS x, -2147483647 AS y UNION ALL SELECT y, NULL AS x, 2147483646 AS y)) Received signal Aborted (6)

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/0/26d0e5438c86e52a145aaaf4cb523c399989a878/fuzzer_astfuzzerdebug,actions//report.html

The problem is that subqueries returns different headers:
- first query  -- x, y
- second query -- y, x

v2: Make order of columns strict only for UNION
    https://s3.amazonaws.com/clickhouse-test-reports/34775/9cc8c01a463d18c471853568b2f0af659a4e643f/stateless_tests__address__actions__[2/2].html
    Fixes: 00597_push_down_predicate_long
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-05-25 20:31:47 +03:00
Nikolai Kochetov
ff98c24d44
Merge pull request #37048 from Avogar/fix-array-map-nothing
Add default implementation for Nothing in functions
2022-05-25 19:10:40 +02:00
alesapin
0a3597da72
Merge pull request #34915 from ianton-ru/MDB-16962
Fix collision of S3 operation log revision
2022-05-25 18:15:31 +02:00
avogar
4c9812d4c1 Allow to skip some of the first rows in CSV/TSV formats 2022-05-25 15:00:11 +00:00
Anton Popov
16e839ac71 add profile events for introspection of part types 2022-05-25 14:54:49 +00:00
mergify[bot]
f49552d48e
Merge branch 'master' into grouping-sets-optimization-fix 2022-05-25 13:03:54 +00:00
Maksim Kita
45da28ecae Improve performance of geo distance functions 2022-05-25 14:22:22 +02:00
Maksim Kita
9a9df26eec Fixed tests 2022-05-25 11:44:37 +02:00
Maksim Kita
6c033f340b Fixed tests 2022-05-25 11:44:37 +02:00
Kseniia Sumarokova
b50d4549c9
Merge pull request #37356 from amosbird/partition-prune-for-s3
"Partition pruning" for s3
2022-05-25 11:03:07 +02:00
avogar
9518c41dda Try to fix tests 2022-05-25 09:01:12 +00:00
avogar
f782fa31c6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into check-format-on-storage-creation 2022-05-25 08:42:54 +00:00
Bharat Nallan Chakravarthy
c586c91c09 add more tests 2022-05-25 07:16:45 +05:30
Bharat Nallan Chakravarthy
57cfc0bd04 check for validity of h3 index 2022-05-25 06:17:15 +05:30
Igor Nikonov
04e2737a57
Merge pull request #37337 from ClickHouse/column_decl_null_before_default_value
Column declaration: [NOT] NULL right after type 

+ fixed: data_type_default_nullable=true, it didn't make columns nullable
         if the column declaration contains default expression w/o type

Issue #37229
2022-05-24 21:16:25 +02:00
Alexander Gololobov
2ff747785e
Merge pull request #37394 from ClickHouse/array_norm_dist_fixes
Do computations on the raw input data without copying to Eigen::Matrix
2022-05-24 20:59:04 +02:00
Dmitry Novik
c4dc0f7cda Fix ORDER BY optimization in case of GROUPING SETS 2022-05-24 18:56:22 +00:00
Robert Schulze
7348a0eb28
Merge pull request #37251 from ClickHouse/non_const_like
Support non-constant SQL functions (NOT) (I)LIKE and MATCH
2022-05-24 20:28:31 +02:00
Alexander Tokmakov
13bdabce3a
Update 02302_join_auto_lc_nullable_bug.sql 2022-05-24 21:21:12 +03:00
Mikhail f. Shiryaev
749eac120e
Merge pull request #37477 from ClickHouse/sync-workflows-paths
Sync workflows paths for PR and DocsCheck
2022-05-24 19:35:45 +02:00
Kruglov Pavel
0c3bcfa122
Merge pull request #36884 from Algunenano/http_proper_summary_and_exception
HTTP: Always return summary data and exception (when possible)
2022-05-24 18:33:24 +02:00
Maksim Kita
3c0c322d7c
Merge pull request #37480 from kitaisreal/dynamic-dispatch-infrastructure-improvements
Dynamic dispatch infrastructure style fixes
2022-05-24 18:13:53 +02:00
Raúl Marín
cd4020fa2f Reduce flakiness 2022-05-24 17:13:53 +02:00
Raúl Marín
a86aa43baa Merge remote-tracking branch 'blessed/master' into floating_seconds_2 2022-05-24 17:10:45 +02:00
Vladimir C
0eaf22b370
Merge pull request #37453 from vdimir/join_auto_lc_nullable_bug 2022-05-24 16:28:23 +02:00
Alexander Tokmakov
229d35408b
Merge pull request #37398 from ClickHouse/fixes_for_transactions
Fixes for transactions
2022-05-24 15:28:01 +03:00
Maksim Kita
e6e4b2826d Dynamic dispatch infrastructure style fixes 2022-05-24 14:25:29 +02:00
Kruglov Pavel
6c9a524f6b
Merge pull request #37192 from Avogar/formats-with-names
Improve performance and memory usage for select of subset of columns for some formats
2022-05-24 13:28:14 +02:00
Kruglov Pavel
9c87424cd7
Merge pull request #37458 from Avogar/fix-parquet-nested
Fix named tuples output in ORC/Arrow/Parquet formats
2022-05-24 13:24:05 +02:00
alesapin
ea19f1f18c
Merge pull request #37440 from ClickHouse/fix-keeper-force-recovery-one-node
Fix `clickhouse-keeper` force recovery for single node cluster
2022-05-24 13:03:56 +02:00
Amos Bird
1ee02a4ac5
No parallel testing 2022-05-24 18:57:56 +08:00
Amos Bird
c25ef92139
Fix tests 2022-05-24 18:57:55 +08:00
Amos Bird
093d315756
partition pruning for s3 2022-05-24 18:57:55 +08:00
Mikhail f. Shiryaev
b4c0f7a621
Simplify labels check 2022-05-24 12:57:06 +02:00
Mikhail f. Shiryaev
90425dedd1
Fail release on status == failure 2022-05-24 11:14:17 +02:00
Mikhail f. Shiryaev
3af9a699d5
Fix ssh-agent socket in docker image 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
249af9c69a
Run container as user, print stdout 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
21d6fc54d5
Do not check docs_release.py for changed files 2022-05-24 11:14:16 +02:00
Mikhail f. Shiryaev
501a8158a5
Don't fail docker images on dispatch or other events 2022-05-24 11:14:14 +02:00
Maksim Kita
712b000f2a
Merge pull request #37443 from kitaisreal/functions-normalize-utf8-fix
Functions normalize utf8 fix
2022-05-24 11:11:15 +02:00
李扬
e33cfc889c
Fix bug of datetime64 parsed from string '1969-12-31 23:59:59.123' (#37039) 2022-05-24 10:47:17 +02:00
Alexander Gololobov
65fbda436a Do computations on the raw input data without copying to Eigen::Matrix 2022-05-24 10:24:50 +02:00
Alexander Gololobov
6094000d7c
Merge pull request #37437 from ClickHouse/norm_distance_perf
Perf test for Norm and Distance functions for arrays and tuples
2022-05-24 10:17:35 +02:00
Igor Nikonov
838a6c6f61 Column declaration: [NOT] NULL right after type
+ fixed: data_type_default_nullable=true, it didn't make columns nullable
         if the column declaration contains default expression w/o type

Issue #37229
2022-05-23 22:03:45 +00:00
Maksim Kita
293295815c Fixed tests 2022-05-23 23:44:05 +02:00
mergify[bot]
51ff49a0ee
Merge branch 'master' into i_object_storage 2022-05-23 20:29:49 +00:00
Azat Khuzhin
1b3df39311 tests: fix table in 01710_projection_aggregation_in_order
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Follow-up for: #37342
2022-05-23 23:16:37 +03:00
avogar
3651ef93fe Fix performance test 2022-05-23 17:42:13 +00:00
Alexander Tokmakov
6bc68c0cbc Merge branch 'master' into fixes_for_transactions 2022-05-23 18:49:21 +02:00
Alexander Gololobov
d0f5551c9f Parameterized with norm kind 2022-05-23 18:27:41 +02:00
Alexander Gololobov
2658a9eeeb Test with max_threads=1 2022-05-23 18:06:07 +02:00
Antonio Andelic
e91e7fdba7 Fix style 2022-05-23 15:33:29 +00:00
avogar
c4f3d8bce1 Fix test 2022-05-23 15:24:58 +00:00
Vladimir C
14a820c2a9
Merge pull request #37336 from vdimir/fix_clash_const_aggegate_join 2022-05-23 17:09:30 +02:00
Kruglov Pavel
b73d49158d
Fix test 2022-05-23 17:01:45 +02:00
Maksim Kita
9de54040ad
Merge pull request #37449 from kitaisreal/range-hashed-dictionary-added-range-cast-test
RangeHashedDictionary added test
2022-05-23 16:49:10 +02:00
avogar
d40b0461c5 Update test 2022-05-23 14:25:43 +00:00
avogar
ce4adb447f Fix named tuples output in ORC/Arrow/Parquet formats 2022-05-23 14:21:08 +00:00
vdimir
dabb150a95
Fix cast lowcard of nullable in JoinSwitcher 2022-05-23 13:05:59 +00:00
avogar
37b66c8a9e Check format name on storage creation 2022-05-23 12:48:48 +00:00
Maksim Kita
94772f9cfc Added performance tests 2022-05-23 14:43:13 +02:00
Maksim Kita
41cb5b4afc RangeHashedDictionary added test 2022-05-23 14:35:26 +02:00
Alexander Gololobov
70cc27ecac Test with different element types 2022-05-23 14:08:15 +02:00
Mikhail f. Shiryaev
bc145294a6
Merge pull request #37441 from ClickHouse/website-content
Release website content
2022-05-23 12:51:14 +02:00
Maksim Kita
fa76f9af34 Update tests 2022-05-23 12:42:00 +02:00
Maksim Kita
d35654226a Fixed tests 2022-05-23 12:42:00 +02:00
Maksim Kita
585b86446e Added hierarchical_index_bytes_allocated column in system.dictionaries 2022-05-23 12:42:00 +02:00
Antonio Andelic
87d445295f
Merge pull request #37342 from azat/projections-optimize_aggregation_in_order-fix
Fix projections with GROUP/ORDER BY in query and optimize_aggregation_in_order
2022-05-23 12:29:16 +02:00
Maksim Kita
e44fec0127 Added tests 2022-05-23 12:21:59 +02:00
Kruglov Pavel
f539fb835d
Merge branch 'master' into formats-with-names 2022-05-23 12:14:20 +02:00
Kruglov Pavel
ce48e8e102
Merge pull request #36975 from Avogar/json-columns-formats
Add columnar JSON formats
2022-05-23 12:11:28 +02:00
Kruglov Pavel
754e675ec3
Merge pull request #37253 from Avogar/fix-defaults
Fix inserting defaults for missing values in columnar formats
2022-05-23 12:10:14 +02:00
Kruglov Pavel
9bc74439c1
Merge pull request #37327 from Avogar/arrow-strings
Allow to use String type instead of Binary in Arrow/Parquet/ORC formats
2022-05-23 12:05:33 +02:00
Antonio Andelic
c268296fc6 Fix single node force recovery and add tests 2022-05-23 09:53:46 +00:00
Mikhail f. Shiryaev
cfe98c4aba
Fix publishing of content.clickhouse.com
- Publish only benchmarks and data
- Minimize clickhouse/docs-release
- Run it as a normal user
- Speed up running by not redownload virtual env deps
- Clean out docs and blog buildging
- Minimize docs/tools/requirements.txt
2022-05-23 11:50:02 +02:00
Vasily Nemkov
e481a707aa Fixed test 2022-05-23 11:51:57 +03:00
Alexander Gololobov
7897a5bac7 Perf test for Norm and Distance fuctions for arrays and tuples 2022-05-23 10:18:24 +02:00
Robert Schulze
e25ca139cd
Implement SQL functions (NOT) (I)LIKE() + MATCH() with non-const needles
With this commit, SQL functions LIKE and MATCH and their variants can
work with non-const needle arguments. E.g.

  create table tab
    (id UInt32, haystack String, needle String)
    engine = MergeTree()
    order by id;

  insert into tab values
  (1, 'Hello', '%ell%')
  (2, 'World', '%orl%')

  select id, haystack, needle, like(haystack, needle)
  from tab;

For that, methods vectorVector() and vectorFixedVector() were added to
MatchImpl. The existing code for const needles has an optimization where
the compiled regexp is cached. The new code expects a different needle
per row and consequently does not cache the regexp.
2022-05-23 09:41:28 +02:00
Alexey Milovidov
698e5e5352
Merge pull request #37415 from Joeywzr/gen_uuid
Generate multiple columns with UUID
2022-05-23 00:29:42 +03:00
Alexey Milovidov
d32d45e12e
Merge pull request #37400 from ndchikin/window_frame_fix
WindowTransform::moveRowNumber fix
2022-05-22 20:35:00 +03:00
Alexey Milovidov
3b046472fe
Update 02306_window_move_row_number_fix.sql 2022-05-22 20:33:07 +03:00
alesapin
c8d92b87c8 Merge branch 'master' into i_object_storage 2022-05-22 12:16:10 +02:00
Memo
aa503f699a fix tests 2022-05-22 13:43:05 +08:00
Memo
3a17180a4f fix tests 2022-05-22 13:42:36 +08:00
Yakov Olkhovskiy
d878f193d8
Merge pull request #37013 from mnutt/hashid
Add hashid support
2022-05-21 17:14:54 -04:00
Kseniia Sumarokova
ec2a1c8ba5
Merge pull request #37188 from Vxider/wv-alter
ALTER TABLE MODIFY QUERY support for WindowView
2022-05-21 22:59:32 +02:00
Vasily Nemkov
c12f826d22 Implemented changing comment to a ReplicatedMergeTree table 2022-05-21 20:08:30 +03:00
Memo
942af133e5 init 2022-05-21 23:54:12 +08:00
Alexander Tokmakov
d4974ddaf0 fix test 2022-05-20 22:59:55 +02:00
ndchikin
4859108feb WindowTransform::moveRowNumber fix 2022-05-20 20:49:10 +00:00
Alexander Tokmakov
44f2d4529a better waiting, add fault injection 2022-05-20 22:10:01 +02:00
Alexey Milovidov
c77b078c2c
Merge pull request #37367 from ClickHouse/grouping-sets-with-rollup-cube
Disable WITH ROLLUP/CUBE for GROUPING SETS
2022-05-20 22:34:56 +03:00
alesapin
d414d85654 Fix hdfs bug 2022-05-20 17:43:48 +02:00
Dmitry Novik
8c42a7c8f7
Update 02304_grouping_sets_with_rollup_cube.sql 2022-05-20 17:38:35 +02:00
avogar
566d1b15fd Merge branch 'master' of github.com:ClickHouse/ClickHouse into formats-with-names 2022-05-20 13:54:52 +00:00
avogar
6e2df9ecc4 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-defaults 2022-05-20 13:15:34 +00:00
Michael Nutt
23dbf1b257 Merge branch 'master' into hashid 2022-05-20 08:42:01 -04:00
vdimir
23a85d3406
Perserve constness in ExpressionActionsChain::JoinStep 2022-05-20 11:31:58 +00:00
avogar
a6a430c5ee Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-columns-formats 2022-05-20 11:08:30 +00:00
avogar
bb2fb48ad7 Fix tests 2022-05-20 10:53:20 +00:00
Vxider
020a868810 rename test 2022-05-20 10:53:06 +00:00
Vxider
063f11642e update test 2022-05-20 10:50:38 +00:00
Vxider
956459eba2 Merged with master 2022-05-20 10:50:21 +00:00
mergify[bot]
1ac4199e78
Merge branch 'master' into arrow-strings 2022-05-20 10:43:33 +00:00
Kruglov Pavel
4dd447b232
Merge pull request #37332 from Avogar/schema-inference-with-globs
Apply input_format_max_rows_to_read_for_schema_inference for all files in globs in total
2022-05-20 12:42:32 +02:00
Alexander Tokmakov
12bbb7de87 fix race on TID allocation 2022-05-20 12:41:44 +02:00
alesapin
654b27e307 Merge branch 'master' into i_object_storage 2022-05-20 11:56:13 +02:00
Kseniia Sumarokova
ee295038fa
Merge pull request #37214 from Vxider/wv-engine
Change ENGINE behavior in WindowView
2022-05-20 11:14:19 +02:00
Sergei Trifonov
2450ab9079
Merge pull request #36686 from azat/disk-least-used
Implement least_used load balancing algorithm for disks inside volume
2022-05-20 09:16:07 +02:00