Commit Graph

1974 Commits

Author SHA1 Message Date
robot-clickhouse
4289336c27 Auto version update to [21.12.1.1] [54457] 2021-11-02 00:56:45 +03:00
Kruglov Pavel
9a1275cb10
Merge pull request #30178 from Avogar/tsv-csv
Refactor and improve TSV, CSV, JSONCompactEachRow, RowBinary formats. Fix bugs in formats
2021-11-02 00:38:30 +03:00
alesapin
dbfa17aabf Add correct S3 2021-11-01 13:32:56 +03:00
avogar
4e63311bb6 Try fix perf test 2021-11-01 12:13:29 +03:00
alexey-milovidov
15b9d65221
Merge pull request #30662 from azat/conf-clickhouse
Switch everything left from `<yandex>` to `<clickhouse>`
2021-10-31 14:56:51 +03:00
tavplubix
059c1ebf36
Merge pull request #30847 from ClickHouse/fix_30802
Disable check for ZooKeeper session uptime by default
2021-10-29 20:18:25 +03:00
Alexander Tokmakov
d095cfe4c1 disable check for zk session uptime by default 2021-10-29 14:45:09 +03:00
alesapin
4eca493ab8 Fix fuzzer on master 2021-10-29 13:47:29 +03:00
alesapin
11b70a285c
Merge pull request #30795 from ClickHouse/make_fuzzer_check_less_hardcoded
Trying to make fuzzer check less hardcoded
2021-10-29 10:21:36 +03:00
alesapin
ddac7a51e2
Merge pull request #30729 from ClickHouse/trying_actions
Add functional tests to github actions
2021-10-29 09:49:31 +03:00
mergify[bot]
65df198e9b
Merge branch 'master' into conf-clickhouse 2021-10-28 22:19:42 +00:00
alesapin
ffc8dbd085
Update run-fuzzer.sh 2021-10-28 23:06:04 +03:00
alesapin
313584e553
Update run-fuzzer.sh 2021-10-28 19:12:47 +03:00
mergify[bot]
a94b8902dd
Merge branch 'master' into trying_actions 2021-10-28 15:57:28 +00:00
alesapin
0651a1f0e9
Update run-fuzzer.sh 2021-10-28 17:03:40 +03:00
alesapin
542196128b Trying to make fuzzer check less hardcoded 2021-10-28 12:29:50 +03:00
alesapin
c0b2f92123 Add stateful test 2021-10-28 12:26:59 +03:00
Azat Khuzhin
9eef2ad0c2 perf: reduce number of times the query will run
Before this patch:

- upstream/master and PR's *with* perf tests or pef scripts changes:
  --runs=13 --max-queries=0

- PRs *without* perf changes:
  --runs=7 --max-queries=20

- PRs w/ only perf tests changes:
  --runs-13 --max-queries=0 <list of perf tests>

After:

- upstream/master and PR's *with* perf tests changes:
  --runs=13 --max-queries=0

- PRs *without* perf changes:
  --runs=7 --max-queries=10

- PRs w/ only perf tests changes:
  --runs-13 --max-queries=0 <list of perf tests>

So to underline, now we will not look at perf scripts changes anymore,
and we will also decrease number of random queries to run to 10.
2021-10-27 23:20:51 +03:00
Azat Khuzhin
7957079f95 perf: disable query/memory profiling for non prewarm queries 2021-10-27 23:20:51 +03:00
Azat Khuzhin
190459db33 perf: add queries with errors during process too to the perf artifacts
Sometimes queries fails with timeout, and you will not get any perf
metrics for it before this patch.

Example: https://clickhouse-test-reports.s3.yandex.net/30611/5ff6c5536558821824d5fdf25a75729e5b82060d/performance_comparison/report.html#partial-queries.flat_dictionary.5
2021-10-27 23:20:51 +03:00
Azat Khuzhin
722d528218 perf: pin clickhouse-driver to 0.2.1 for tzlocal <0.3 to avoid warning
CI report [1]:

    /usr/local/lib/python3.6/dist-packages/clickhouse_driver/columns/datetimecolumn.py:199: PytzUsageWarning: The zone attribute is specific to pytz's interface; please migrate to a new time zone provider. For more details on how to do so, see https://pytz-deprecation-shim.readthedocs.io/en/latest/migration.html

  [1]: https://clickhouse-test-reports.s3.yandex.net/30626/dfc85841134aa96b4e04c401462898eb305e8657/performance_comparison/report.html#changes-in-performance.format_date_time.1
2021-10-27 23:20:51 +03:00
Azat Khuzhin
90ea2de9bb Add unidiff into style image 2021-10-27 10:03:24 +03:00
Azat Khuzhin
b41c77f4f8 Add boto3 to style image 2021-10-27 10:03:24 +03:00
Azat Khuzhin
944437caf6 Add PyGithub into style image 2021-10-27 10:03:23 +03:00
Azat Khuzhin
da90df5658 docker: switch <yandex> to <clickhouse> 2021-10-26 08:53:14 +03:00
Azat Khuzhin
8f015764a7 Add metadata for *_log into tests artifacts
This will allow to use artifacts as-is, i.e.:

    clickhouse-local --path /path/to/log/artifact

v2: convert database to Ordinary to avoid extra symlinks dependencies.
2021-10-23 20:17:01 +03:00
alesapin
9e8dfdb089
Merge pull request #28851 from ClickHouse/trying_actions
Trying github actions
2021-10-20 12:55:53 +03:00
alesapin
6d8853698b Merge branch 'master' into trying_actions 2021-10-19 17:45:37 +03:00
vdimir
acf416900d
Minor fix in clickhouse/kerberized-hadoop Dockerfile 2021-10-19 16:45:03 +03:00
vdimir
1d78f1c63b
Fix ca-bundle.crt in clickhouse/kerberized-hadoop 2021-10-19 16:40:06 +03:00
vdimir
36bb4033ba
Whitespace change in kerberized_hadoop/Dockerfile 2021-10-19 12:44:55 +03:00
Alexey Milovidov
2cef9983fa Remove recursive submodules 2021-10-18 02:29:04 +03:00
mergify[bot]
f29ea07b1c
Merge branch 'master' into clickhouse-test-http-interface 2021-10-13 16:46:26 +00:00
tavplubix
a16ce6b54b
Merge pull request #30030 from ClickHouse/tavplubix-patch-3
Attach trace_log to stateless tests report as is
2021-10-13 13:21:39 +03:00
Dmitry Novik
fa9cdd5c5f Use original whitespaces in test_results.tsv 2021-10-12 23:31:31 +03:00
Dmitry Novik
0507391010 Do not stop CI tests processing if clickhouse-test return 1 2021-10-12 23:30:07 +03:00
Dmitry Novik
a30573fc0a Add FAIL message to test_results.tsv 2021-10-12 23:29:15 +03:00
Azat Khuzhin
071a5af96e Revert "docker: add pandas/clickhouse_driver into test images"
This reverts commit e07a6f3fc0.
2021-10-12 21:06:26 +03:00
tavplubix
f3c9f4be6c
Update run.sh 2021-10-12 14:38:41 +03:00
alesapin
3ae960e04b Review fixes 2021-10-11 16:40:12 +03:00
alesapin
9ad919d91a More timeouts in stress test 2021-10-11 13:25:54 +03:00
alexey-milovidov
268c155b7d
Merge pull request #29856 from azat/clickhouse-test-python-client
Rewrite clickhouse-test to use python clickhouse_driver
2021-10-09 17:58:40 +03:00
alexey-milovidov
f6a0983068
Merge pull request #29781 from azat/fuzzer-server-pid-v2
Simplify obtaining of server pid in fuzzer tests
2021-10-08 00:35:25 +03:00
Azat Khuzhin
e07a6f3fc0 docker: add pandas/clickhouse_driver into test images 2021-10-08 00:09:37 +03:00
Azat Khuzhin
aeb670dbe0 Simplify obtaining of server pid in fuzzer tests 2021-10-05 21:05:49 +03:00
Kseniia Sumarokova
ead99b5911
Update docker_compose_minio.yml 2021-10-05 11:39:08 +03:00
kssenii
4962677a8b Update minio 2021-10-05 08:18:16 +00:00
Nikita Mikhaylov
731d6c5755
Merge pull request #29513 from azat/fuzzer-fix-server-pid
Fix server pid (hence exit code and attaching with gdb) in fuzzer tests
2021-10-04 19:59:24 +03:00
Azat Khuzhin
74a7a0603d test/fuzzer: print stacktrace
To get the stacktrace for errors w/o it [1]:

    SET max_parser_depth = 4000

    Got boring AST
    Code: 306. DB::Exception: Maximum parse depth (1000) exceeded. Consider rising max_parser_depth parameter. (TOO_DEEP_RECURSION)

  [1]: https://clickhouse-test-reports.s3.yandex.net/29513/769bfbe71f22c392458eced655080a0bbd442e02/fuzzer_ubsan/fuzzer.log
2021-10-02 12:49:44 +03:00
Azat Khuzhin
769bfbe71f Fix server pid in fuzzer tests
Previously it was the pid of the subshell 40 while it should be the pid
of the clickhouse-server 39:

Here we see that the server pid is 39:

    2021-09-28 11:02:34	 + pgrep -f clickhouse-server
    2021-09-28 11:02:34	 39

Here we see that the 40 is the pid of subshell:

    2021-09-28 11:02:45	 ch/docker/test/fuzzer/run-fuzzer.sh: line 90:    39 Killed                  clickhouse-server --config-file db/config.xml -- --path db 2>&1
    2021-09-28 11:02:45	         40 Done                    | tail -100000 > server.log

And here we see that server_pid variable is 40:

    2021-09-28 11:02:45	 + server_exit_code=0
    2021-09-28 11:02:45	 + wait 40

v2: wait in background to call wait in foreground and ensure that the
process is alive, since w/o job control this is the only way to obtain
the exit code
2021-10-01 21:05:30 +03:00