Commit Graph

75719 Commits

Author SHA1 Message Date
Azat Khuzhin
9eef2ad0c2 perf: reduce number of times the query will run
Before this patch:

- upstream/master and PR's *with* perf tests or pef scripts changes:
  --runs=13 --max-queries=0

- PRs *without* perf changes:
  --runs=7 --max-queries=20

- PRs w/ only perf tests changes:
  --runs-13 --max-queries=0 <list of perf tests>

After:

- upstream/master and PR's *with* perf tests changes:
  --runs=13 --max-queries=0

- PRs *without* perf changes:
  --runs=7 --max-queries=10

- PRs w/ only perf tests changes:
  --runs-13 --max-queries=0 <list of perf tests>

So to underline, now we will not look at perf scripts changes anymore,
and we will also decrease number of random queries to run to 10.
2021-10-27 23:20:51 +03:00
Azat Khuzhin
7957079f95 perf: disable query/memory profiling for non prewarm queries 2021-10-27 23:20:51 +03:00
Azat Khuzhin
190459db33 perf: add queries with errors during process too to the perf artifacts
Sometimes queries fails with timeout, and you will not get any perf
metrics for it before this patch.

Example: https://clickhouse-test-reports.s3.yandex.net/30611/5ff6c5536558821824d5fdf25a75729e5b82060d/performance_comparison/report.html#partial-queries.flat_dictionary.5
2021-10-27 23:20:51 +03:00
Azat Khuzhin
722d528218 perf: pin clickhouse-driver to 0.2.1 for tzlocal <0.3 to avoid warning
CI report [1]:

    /usr/local/lib/python3.6/dist-packages/clickhouse_driver/columns/datetimecolumn.py:199: PytzUsageWarning: The zone attribute is specific to pytz's interface; please migrate to a new time zone provider. For more details on how to do so, see https://pytz-deprecation-shim.readthedocs.io/en/latest/migration.html

  [1]: https://clickhouse-test-reports.s3.yandex.net/30626/dfc85841134aa96b4e04c401462898eb305e8657/performance_comparison/report.html#changes-in-performance.format_date_time.1
2021-10-27 23:20:51 +03:00
Anton Popov
2bb586bed3
Merge pull request #30541 from gyuton/gyuton-DOCSUP-14941-Document-asynchronous-insert-mode
DOCSUP-14941-Document-asynchronous-inserts
2021-10-27 20:25:17 +03:00
Vitaly Baranov
697776186a
Merge pull request #30725 from azat/fix-gtest_disk_encrypted
Fix gtest_disk_encrypted (for new readFile/createReadBufferFromFileBase() interfaces)
2021-10-27 19:49:23 +03:00
Maksim Kita
a332a4d15f
Merge pull request #30501 from kitaisreal/hashed-array-dictionary-optimize-read-multiple-attributes
HashedArrayDictionary optimize read multiple attributes
2021-10-27 18:45:07 +03:00
tavplubix
ac4a9bcf23
Fix 00975_move_partition_merge_tree (#30717)
* Revert "Fix race between MOVE PARTITION and merges/mutations for MergeTree"

This reverts commit e9ce859b02.

* fix

* Update StorageMergeTree.cpp

Co-authored-by: alesapin <alesapin@gmail.com>
2021-10-27 18:19:41 +03:00
tavplubix
d07d53f1b1
Merge pull request #29328 from aiven/kmichel-recover-replica-race
Fix hanging DDL queries on Replicated database
2021-10-27 16:43:21 +03:00
tavplubix
d7c69f6c02
Merge pull request #29202 from aiven/kmichel-replicated-database-alter-attach
Allow non-replicated ALTER TABLE FETCH/ATTACH in Replicated databases
2021-10-27 16:42:54 +03:00
gyuton
527474da64 Fix wording 2021-10-27 16:21:50 +03:00
gyuton
456d548b6b
Apply suggestions from code review
Co-authored-by: Anton Popov <pad11rus@gmail.com>
2021-10-27 16:17:56 +03:00
Maksim Kita
db18cb194c
Merge pull request #30736 from kitaisreal/dictionary-source-unknown-column-name-in-dictionary-fix
DictionarySource unknown column name in dictionary fix
2021-10-27 14:10:54 +03:00
tavplubix
7b66cc754e
Merge pull request #30723 from azat/fix-test_part_uuid
Fix test_part_uuid::test_part_uuid_wal
2021-10-27 14:08:28 +03:00
alesapin
9430f774d2
Merge pull request #30677 from ClickHouse/better_check_for_started_node 2021-10-27 12:51:13 +03:00
alexey-milovidov
9f9b4968d7
Merge pull request #30663 from ClickHouse/fix_five_years_old_bug
Fix case-insensetive search in UTF8 strings
2021-10-27 12:10:12 +03:00
Maksim Kita
9e5337b5d4 DictionarySource unknown column name in dictionary fix 2021-10-27 11:51:47 +03:00
alesapin
0b70edec9b
Merge pull request #30733 from azat/style-check-ci-scripts
Run pylint over python scripts for github actions
2021-10-27 11:36:43 +03:00
Maksim Kita
fd002e327c Updated HashedArrayDictionary 2021-10-27 11:26:42 +03:00
alesapin
fc19a06a99
Merge pull request #30646 from ianton-ru/MDB-14537-2
Retry on Yandex.S3 throttle
2021-10-27 11:18:38 +03:00
alesapin
2af950d4d5
Merge pull request #30658 from ClickHouse/std_mutex_alter_lock
Change `alter_lock` from `RWLock` to `std::timed_mutex`
2021-10-27 11:14:11 +03:00
alesapin
a29711f1d0
Merge pull request #30651 from ClickHouse/fix_intersecting_parts_to_do
Fix intersecting parts in `parts_to_do`
2021-10-27 10:52:21 +03:00
alesapin
8749f4a31a
Merge pull request #29043 from nvartolomei/nv/parts-uuid-move-shard-kill
Part movements between shards improvements and cancel support
2021-10-27 10:46:00 +03:00
alesapin
ce22666c2a
Merge pull request #30727 from azat/fix-docker_images_check
tests/ci/docker_images_check: add missing time import
2021-10-27 10:19:34 +03:00
Azat Khuzhin
d8a64a7ece tests/ci: fix wrong-import-order pylint warning 2021-10-27 10:14:39 +03:00
Azat Khuzhin
5930714ccd tests/ci/version_helper.py: fix pylint warnings 2021-10-27 10:03:25 +03:00
Azat Khuzhin
161f48c2c8 tests/ci/style_check.py: fix pylint warnings 2021-10-27 10:03:25 +03:00
Azat Khuzhin
e933e05662 tests/ci/s3_helper.py: fix pylint warnings 2021-10-27 10:03:25 +03:00
Azat Khuzhin
ce7e18fcb7 tests/ci/run_check.py: fix pylint warnings 2021-10-27 10:03:24 +03:00
Azat Khuzhin
4e2ffbd38c tests/ci/report.py: fix pylint warnings 2021-10-27 10:03:24 +03:00
Azat Khuzhin
bcac58acde tests/ci/pvs_check.py: fix pylint warnings 2021-10-27 10:03:24 +03:00
Azat Khuzhin
a90e477e41 tests/ci/pr_info.py: fix pylint warnings 2021-10-27 10:03:24 +03:00
Azat Khuzhin
90ea2de9bb Add unidiff into style image 2021-10-27 10:03:24 +03:00
Azat Khuzhin
b41c77f4f8 Add boto3 to style image 2021-10-27 10:03:24 +03:00
Azat Khuzhin
0c9c15e06b tests/ci/finish_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
3dd09db096 tests/ci/fast_test_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
2a3fe5f798 tests/ci/docker_images_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
e581cdb933 tests/ci/compress_files.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
d1c49bbdcb tests/ci/build_report_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
c47617a612 tests/ci/build_check.py: fix pylint warnings 2021-10-27 10:03:23 +03:00
Azat Khuzhin
944437caf6 Add PyGithub into style image 2021-10-27 10:03:23 +03:00
Azat Khuzhin
fa50dd885c Run pylint for ci scripts 2021-10-27 10:03:23 +03:00
Azat Khuzhin
13850ba257 tests/ci/docker_images_check: add missing time import 2021-10-27 10:01:53 +03:00
Kseniia Sumarokova
57626438b0
Merge pull request #30469 from kirillikoff/kirillikoff-DOCSUP-13264
DOCSUP-13264: Document the SQL-statements INTERSECT, EXCEPT and ANY, ALL operators
2021-10-27 09:48:12 +03:00
Azat Khuzhin
9936ee5181 Update gtest_disk_encrypted for new readFile() interface 2021-10-27 09:37:26 +03:00
Azat Khuzhin
7ce01b328e Update gtest_disk_encrypted for new createReadBufferFromFileBase() interface 2021-10-27 09:37:26 +03:00
Azat Khuzhin
d0a031014e Fix test_part_uuid::test_part_uuid_wal
CI: https://clickhouse-test-reports.s3.yandex.net/30716/ca41267a4d5d7e1da3dd584c98a9143e15f394cf/integration_tests_(asan).html#fail1
2021-10-27 09:28:10 +03:00
Cody Baker
b764b6ce21
Update hardware page colors (#30719)
Replaces yellow with a light gray
2021-10-27 00:08:05 +03:00
alesapin
44684a8dff
Merge pull request #30678 from ClickHouse/fix_keeper_test
Fix keeper zookeeper converter test
2021-10-26 23:03:30 +03:00
Nikita Mikhaylov
aae30a9e37
Fix fuzzer build (#30344) 2021-10-26 20:30:34 +03:00