Commit Graph

24628 Commits

Author SHA1 Message Date
Alexey Milovidov
c4805591e4
Update 01076_parallel_alter_replicated_zookeeper.sh 2023-01-30 00:43:03 +03:00
Alexey Milovidov
4e8f3077a5 Fix flaky test, @alesapin please help! 2023-01-29 22:42:09 +01:00
Alexey Milovidov
4ae2824e58
Merge pull request #44226 from azat/ci/more-robust
More robust CI parsers
2023-01-29 19:44:16 +03:00
Alexey Milovidov
303fc4b863
Merge pull request #45744 from ClickHouse/fix-style-and-typo
Fix style and typo
2023-01-29 19:40:32 +03:00
alesapin
8d05b1ec4a
Merge pull request #45657 from ClickHouse/improve-release-script
Improve release script
2023-01-29 11:46:02 +01:00
Azat Khuzhin
b1b4aaeef6 ci: more robust results parsers
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 09:06:03 +01:00
Azat Khuzhin
e7df64df77 clickhouse-test: replace NUL byte to avoid breaking CSV parser
On CI [1]:

    022-12-12 12:49:55 01910_client_replxx_container_overflow_long:                            [ FAIL ] 2.25 sec. - return code: 1
    2022-12-12 12:49:55 send: spawn id exp4 not open
    2022-12-12 12:49:55     while executing
    ...
    Traceback (most recent call last):
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 327, in <module>
        state, description, test_results, additional_logs = process_results(
      File "/home/ubuntu/actions-runner/_work/_temp/stateless_debug/ClickHouse/tests/ci/functional_test_check.py", line 173, in process_results
        test_results = list(csv.reader(results_file, delimiter="\t"))  # type: ignore
    _csv.Error: line contains NUL
    INFO:root:Update Mergeable Check by Stateless tests (asan)
    Error: Process completed with exit code 1.

      [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/3669487007/jobs/6221215715

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Azat Khuzhin
d5f7adb4cd clickhouse-test: trim debuglog to the first 100 lines as other logs
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-29 08:59:37 +01:00
Alexey Milovidov
76975c00d4
Merge pull request #43405 from azat/fs/use-access
Simply filesystem helpers to check is-readable/writable/executable
2023-01-29 06:21:00 +03:00
Alexey Milovidov
1ce44c3404
Merge pull request #45713 from azat/clickhouse-test-flush
Add missing SYSTEM FLUSH LOGS for clickhouse-test
2023-01-29 06:14:40 +03:00
Alexey Milovidov
fb764b6bf3 Fix style and typo 2023-01-29 03:53:42 +01:00
Alexey Milovidov
9ad87f9917 Fix style and typo 2023-01-29 03:51:42 +01:00
Alexey Milovidov
fecccc87f6
Merge branch 'master' into sys_sync_func 2023-01-28 20:12:32 +03:00
Azat Khuzhin
73fe6aad9b tests: add missing allow_suspicious_codecs in 02536_delta_gorilla_corruption
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-28 13:04:04 +01:00
freedomDR
34ad5dc840
update tests result 2023-01-28 06:42:07 +00:00
freedomDR
4b3d07f69f add test 2023-01-28 04:27:10 +00:00
Alexey Milovidov
bc2f454522
Merge branch 'master' into block-non-float-gorilla-v2 2023-01-28 03:30:12 +03:00
Alexey Milovidov
657d9f69e7
Merge pull request #45686 from amosbird/issue_45590
Fix key description when encountering duplicate primary keys
2023-01-28 02:22:42 +03:00
Azat Khuzhin
3903b442fb tests: fix broken disk emulation in test_jbod_ha
The problem with chmod 000 is that it is simply ignored for the owner of
the namespace (verified with kprobe for security_capable [1]),
previously it worked only cause there was a check for uid explicitly in
FS::canRead/canWrite.

  [1]: cat-10561   [001]  1340776.172944: security_capable_retprobe: (capable_wrt_inode_uidgid+0x40/0x70 <- security_capable) arg1=0xffffffff

0xffffffff is -1 and it is EPERM

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
e6695196aa tests/integration: add SYS_ADMIN capability for mount/remount
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Azat Khuzhin
1e3f33ad4b tests/integration: fix --privileged passthrough
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:11:10 +01:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels
Add ability to ignore unknown keys in JSON object for named tuples
2023-01-27 21:11:05 +01:00
Azat Khuzhin
9456f4f83f Add missing SYSTEM FLUSH LOGS for clickhouse-test
CI: https://s3.amazonaws.com/clickhouse-test-reports/45150/718ad72871e7d6788242b06822918057723939f7/bugfix_validate_check.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 21:09:13 +01:00
Igor Nikonov
300f78df96
Merge pull request #45567 from ClickHouse/enable-remove-redundant-sorting
Enable query_plan_remove_redundant_sorting optimization by default
2023-01-27 19:14:36 +01:00
Nikolai Kochetov
313947e0b0
Merge branch 'master' into issue_45590 2023-01-27 15:08:28 +01:00
Robert Schulze
83593810ff
Make check work with Nullable / Array / Tuple 2023-01-27 13:02:54 +00:00
Alexander Tokmakov
c366806c3e
Merge pull request #45527 from ClickHouse/exception_message_patterns4
Better formatting for exception messages 2
2023-01-27 15:31:52 +03:00
Nikolai Kochetov
b05838cc32
Update 02540_duplicate_primary_key.sql
Remove LowCardinality
2023-01-27 12:18:00 +01:00
Amos Bird
deacfadc89
Fix another test 2023-01-27 18:01:27 +08:00
Maksim Kita
8e1e136d0c
Merge pull request #42976 from kitaisreal/analyzer-settings-push-down
Analyzer SETTINGS push down
2023-01-27 12:52:23 +03:00
Mikhail f. Shiryaev
4635a62cec
Merge pull request #45476 from ClickHouse/automerge
Another attempt to fix automerge, or at least to have debug footprint
2023-01-27 10:06:24 +01:00
Azat Khuzhin
d21fa27379 Enable simdjson in fasttest (should be pretty lightweight)
The library and callers are pretty lightweight, so as tests for
JSONExtact, so this should be OK

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Azat Khuzhin
1a8437f2c9 Add ability to ignore unknown keys in JSON object for named tuples
This can be useful in case your input JSON is complex, while you need
only few fields in it.

This behaviour is controlled by the
input_format_json_ignore_unknown_keys_in_named_tuple setting name, that
is turned OFF by default.

This will, almost, allow to parse gharchive dataset without jq. "almost"
because of two things:
- Tuple cannot be Nullable, so such keys with Tuple type in ClickHouse
  cannot be `null` in JSON
- You cannot use dot.dot notation to extract columns for file() engine,
  only tupleElement()

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-01-27 10:01:08 +01:00
Amos Bird
fd60954081
Fix key description on duplicate primary keys
This can happen in projections. See
https://github.com/ClickHouse/ClickHouse/issues/45590 for details.
2023-01-27 13:01:36 +08:00
Alexey Milovidov
5b257ab806
Merge pull request #45233 from ClickHouse/improve_week_day
Revert "Revert "Improve week day""
2023-01-27 02:44:17 +03:00
Alexey Milovidov
f401449bd9
Merge pull request #45661 from ClickHouse/generate-random-lowcardinality
Allow LowCardinality in GenerateRandom
2023-01-27 02:14:38 +03:00
Robert Schulze
032cdb986e
Merge pull request #45615 from ClickHouse/fix-gorilla
Fix codec pipeline Delta (or DoubleDelta) + Gorilla
2023-01-27 00:04:39 +01:00
Alexander Tokmakov
08379ca840 fix 2023-01-26 21:11:39 +01:00
Igor Nikonov
211edc054e Fix check for sum*(Float) 2023-01-26 19:26:53 +00:00
Alexander Tokmakov
68a60ad4f6 fix 2023-01-26 20:20:56 +01:00
Robert Schulze
94864a10e6
Disable test in asan builds (too slow) 2023-01-26 19:12:20 +00:00
Alexander Tokmakov
061026c307 fix 2023-01-26 19:01:29 +01:00
Vitaly Baranov
5b469eb91f
Merge pull request #45603 from vitlibar/fix-wiping-sensitive-info
Fix wiping sensitive info in logs
2023-01-26 15:44:24 +01:00
Alexey Milovidov
2659818a66 Add a test 2023-01-26 15:42:17 +01:00
Mikhail f. Shiryaev
975b3a2de8
Suppress the stderr of running commands by default 2023-01-26 15:24:38 +01:00
Mikhail f. Shiryaev
cc691c30af
Delete --no-release-branch argument, move creating release to the end 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
398b215556
Make Release._create_tag independent on checked out ref 2023-01-26 15:24:37 +01:00
Mikhail f. Shiryaev
81d419e4a2
Add --dry-run option for release.py 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
1ec9b60c27
Add fail on new minor versions>=13 2023-01-26 15:24:36 +01:00
Mikhail f. Shiryaev
bf3b497d22
Always update version and _git after new checkout 2023-01-26 15:24:35 +01:00