thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-11 17:02:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
137,470 Commits 9,299 Branches 1,782 Tags 2.1 GiB
8ff21d7e47
Commit Graph

3645 Commits

Author SHA1 Message Date
Alexey Milovidov
2a89587300 Address review comments 2023-08-10 04:32:39 +02:00
Alexey Milovidov
f2621e70ae Remove unrecognizable garbage from the performance test 2023-08-10 03:27:07 +02:00
Alexey Milovidov
6edf4a777f Remove unrecognizable garbage from the performance test 2023-08-10 03:26:11 +02:00
Alexey Milovidov
10bc51514b Merge branch 'allow-creating-system-tables-at-startup' into export-logs-in-ci 2023-08-09 04:28:50 +02:00
Alexey Milovidov
afdef1a21a Merge branch 'master' into allow-creating-system-tables-at-startup 2023-08-09 04:28:04 +02:00
Alexey Milovidov
ede1b17c48
Merge branch 'master' into sqltest 2023-08-09 05:10:47 +03:00
Sema Checherinda
796f874116
metrics_perf_events_enabled turn off in perf tests (#52072) 
* metrics_perf_events_enabled turn off in perf tests

* turn on metrics_perf_events_enabled for heating and profile requests

* close_perf_descriptors fix the condition

* do not read opend but disabled perf event

* Revert "do not read opend but disabled perf event"

This reverts commit eeab1c9c63.
 2023-08-07 23:25:16 +02:00
Alexey Milovidov
0bab88b7cb Merge branch 'master' of github.com:ClickHouse/ClickHouse into export-logs-in-ci 2023-08-07 18:58:32 +02:00
Alexey Milovidov
06f557a62b Merge branch 'master' of github.com:ClickHouse/ClickHouse into allow-creating-system-tables-at-startup 2023-08-07 18:58:18 +02:00
Alexey Milovidov
4696254887
Merge pull request #53065 from ClickHouse/nickitat-patch-15 
Add `abort_on_error=1` to `TSAN_OPTIONS`
 2023-08-07 17:17:04 +03:00
Alexey Milovidov
fbb2be21cc Slightly better 2023-08-06 13:04:35 +02:00
Alexey Milovidov
695516ae74 Maybe fix bash 2023-08-06 12:51:37 +02:00
Antonio Andelic
cafa5ef2f3 Merge branch 'master' into add-reading-from-archives 2023-08-06 10:21:47 +00:00
Alexey Milovidov
f0a632f1f1 Fix shellcheck 2023-08-06 05:17:39 +02:00
Alexey Milovidov
f1eee292c9 Enable export (first try) 2023-08-06 04:38:04 +02:00
Alexey Milovidov
32a038cfd7 YAML is mandatory 2023-08-06 02:52:36 +02:00
Alexey Milovidov
6825b008e7
Merge pull request #52906 from azat/tests/fix-EADDRINUSE-v2 
tests: fix possible EADDRINUSE v2
 2023-08-05 13:39:25 +03:00
Nikita Taranov
555c90a50c add to integration tests 2023-08-04 23:26:52 +02:00
Nikita Taranov
06717fa3dd
Add abort_on_error=1 to TSAN_OPTIONS for stress tests 2023-08-04 22:58:22 +02:00
Ilya Yatsishin
0f63a90206
Merge branch 'master' into create-index-unique-noop 2023-08-04 17:53:57 +02:00
Alexey Milovidov
65e8ee8fb7 Fix paths 2023-08-03 15:28:18 +02:00
Antonio Andelic
96bad0537a Merge branch 'master' into add-reading-from-archives 2023-08-03 08:36:42 +00:00
Azat Khuzhin
344d648cab tests: adjust net.ipv4.ip_local_port_range for some services to avoid EADDRINUSE 
As it turns out, docker does not pass through the sysctls, so adjust
this for know users of unprivileged ports (>32K):
- HDFS
- kafka

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:17:49 +02:00
Azat Khuzhin
d2a264c9bb tests: use explicit address for console to avoid EADDRINUSE 
The problem is that MinIO uses dynamic port for console address by
default, which may be below ip_local_port_range, and in this case it ca
be reused in a short time, sicne first MinIO allocates the socket, then
close this socket, and only after try to bind to it.

And even though this is a problem of MinIO I'm not a go developer to fix
it.

v2: use long notation of the 127.0.0.1 (that version of MinIO on CI
cannot handle 127.1, while 2023-07-21T21-12-44Z can)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-08-02 21:17:49 +02:00
Alexey Milovidov
a98e869912 Merge branch 'master' into sqltest 2023-08-02 20:08:39 +02:00
Antonio Andelic
e366ca61f5 Merge branch 'master' into add-reading-from-archives 2023-08-01 15:33:20 +00:00
Mikhail f. Shiryaev
a330a7ac38
PyYAML>=5.4 conflicts with cython 3 2023-08-01 17:30:53 +02:00
Mikhail f. Shiryaev
0931e87989
Merge branch 'master' into sqltest 2023-08-01 16:14:28 +02:00
Kseniia Sumarokova
40ce9cf9ed
Merge pull request #51843 from ClickHouse/kssenii-nginx 
Replace kssenii/nginx-test by clickhouse/nginx-dav
 2023-08-01 11:36:20 +02:00
Antonio Andelic
fe6202c1cc Disable for fasttest 2023-07-31 17:49:34 +00:00
Antonio Andelic
76331a9b49 Update dockerfile 2023-07-31 14:20:03 +00:00
Antonio Andelic
6a1cf5c683 Extend tests 2023-07-31 13:27:06 +00:00
Alexey Milovidov
0866d0a5bd Merge branch 'allow-oom-stress-upgrade-checks' into move-regions 2023-07-31 12:29:10 +02:00
Alexey Milovidov
7c49105cd5 Allow OOM in Stress and Upgrade checks 2023-07-31 12:27:35 +02:00
Alexey Milovidov
7ad4f13caf
Merge branch 'master' into move-regions 2023-07-30 10:34:10 +03:00
Alexey Milovidov
424fe43090
Update Dockerfile 2023-07-30 06:57:11 +03:00
Alexey Milovidov
ecfde7edc6 Fix Docker 2023-07-30 05:20:51 +02:00
Alexey Milovidov
972653cde3 Change the default timezones in Docker test images 2023-07-30 05:18:52 +02:00
Alexey Milovidov
1deebd3ae6 Fix Docker 2023-07-30 04:22:36 +02:00
Alexander Tokmakov
4d03c23166
Merge pull request #51851 from ClickHouse/add_delay_for_replicated 
Make shutdown of `ReplicatedMergeTree` tables more soft
 2023-07-26 12:59:37 +03:00
Kruglov Pavel
93e10077ba
Fix attaching gdb in stress tests (#51445) 
* Fix attaching gdb in stress tests

* Fix

* Update run.sh

* Try remove run_with_retry

* Return run_with_retry

* Don't set -e in run_with_retry if it was't set before

* Update tests/ci/utils.lib

* Fix bash

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
 2023-07-26 12:53:19 +03:00
Alexander Tokmakov
6bbed6262e
Merge branch 'master' into add_delay_for_replicated 2023-07-26 12:48:48 +03:00
Alexey Milovidov
34ff0e0ea9
Merge pull request #52184 from azat/tests/randomize-timezone 
Randomize timezone in tests across non-deterministic around 1970 and default
 2023-07-24 22:47:52 +03:00
Azat Khuzhin
2389e0f0b6 Randomize timezone in tests across non-deterministic around 1970 and default 
There was some cases when some patches to the datetime code leads to
flaky tests, due to the tests itself had been runned using regular
timezone (TZ).

But if you will this tests with something "specific" (that is not
strictly defined around 1970 year), those tests will fail.

So to catch such issues in the PRs itself, let's randomize
session_timezone as well.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-24 06:13:12 +02:00
Ilya Yatsishin
7a24ed195d
Merge branch 'master' into create-index-unique-noop 2023-07-23 20:47:11 +02:00
Alexey Milovidov
4c1f8f38cd Fix CI 2023-07-23 17:30:23 +02:00
alesapin
d1fa105d60
Merge branch 'master' into add_delay_for_replicated 2023-07-23 00:12:29 +02:00
Mikhail f. Shiryaev
cf01800a63 Sort DOCKER_*_TAG stuff 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
c6e9f621f1 Replace kssenii/nginx-test:1.1 by clickhouse/nginx-dav 2023-07-22 15:45:47 +02:00
Mikhail f. Shiryaev
8c0113e02b Sanitize compose files in integration-tests-runner 2023-07-22 15:45:47 +02:00
alesapin
6416fb6eed
Merge branch 'master' into add_delay_for_replicated 2023-07-22 12:11:39 +02:00
Alexey Milovidov
de2016261e Get rid of it 2023-07-22 05:08:27 +02:00
Alexey Milovidov
e5797b7fea
Merge pull request #51514 from azat/tests/fix-integration-tests 
Fix running integration tests with spaces in it's names
 2023-07-22 03:38:51 +03:00
Alexey Milovidov
999cce12b1 Merge branch 'master' into sqltest 2023-07-22 01:55:54 +02:00
Alexey Milovidov
fa44f84377 Fix style 2023-07-20 04:50:18 +02:00
Alexey Milovidov
f458108c44 Fix style 2023-07-19 22:15:23 +02:00
Yatsishin Ilya
bb4924ab63 Multiple sqllogictest improvements 2023-07-19 12:24:31 +00:00
Ilya Golshtein
4259176f24 test_for_basic_auth_registry - original zk configuration restored 2023-07-19 08:32:45 +00:00
Ilya Golshtein
aa2b7e248d test_for_basic_auth_registry - fix port in test_kafka_formats 2023-07-19 08:32:45 +00:00
Ilya Golshtein
83569688cb test_for_basic_auth_registry - UnknownTopicOrPartitionException 2023-07-19 08:32:45 +00:00
Ilya Golshtein
66581d091a test_for_basic_auth_registry - both tests works, simplifications 2023-07-19 08:32:45 +00:00
Ilya Golshtein
db8e96147a test_for_basic_auth_registry - started, but only auth test works 2023-07-19 08:32:45 +00:00
Ilya Golshtein
fb3a860d7f test_for_basic_auth_registry - one kafka instance again 2023-07-19 08:32:45 +00:00
Ilya Golshtein
e3523cb1a4 test_for_basic_auth_registry - attempt to have two kafka instances 2023-07-19 08:32:45 +00:00
Ilya Golshtein
8b0fc82834 test_for_basic_auth_registry - mock up 2023-07-19 08:32:44 +00:00
robot-clickhouse
891c01e6ab Automatic style fix 2023-07-19 02:37:02 +00:00
Alexey Milovidov
9b10e0a5bc Improvement 2023-07-19 04:09:19 +02:00
Alexey Milovidov
fe59729537 Improvement 2023-07-19 04:01:00 +02:00
Alexey Milovidov
76677e009b Improvement 2023-07-19 04:00:50 +02:00
Alexey Milovidov
50dac21483 Improvement 2023-07-19 03:54:09 +02:00
Alexey Milovidov
2255307a47 Improvement 2023-07-19 03:49:47 +02:00
Alexey Milovidov
fcf4a6ea88 Fix error 2023-07-19 03:48:48 +02:00
Alexey Milovidov
174166b233 Fix error 2023-07-19 03:47:41 +02:00
Alexey Milovidov
df5abcf685 Update Docker 2023-07-19 03:45:43 +02:00
Alexey Milovidov
8e3bd222f0 Add SQLTest 2023-07-19 03:42:32 +02:00
Nikita Mikhaylov
11cc8b4adf
Merge branch 'master' into add_delay_for_replicated 2023-07-17 19:04:29 +02:00
Azat Khuzhin
6f6562c96b Fix running integration tests with spaces in it's names 
Previously they were simply ignored, and not only them, but all the
tests in that group, here is an example [1]

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51448/4ed462ac7834a8180f92ca7d7d3c076e687bfca9/integration_tests__asan__[4_6].html

Note, that I've replaced PYTEST_OPTS with handled by pytest itself
PYTEST_ADDOPTS, since "sh -c $PYTEST_OPTS" does not allows you to
preserve the arguments correctly.

v5: use double quotes for PYTEST_ADDOPTS value
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-17 17:17:21 +02:00
Azat Khuzhin
2720e9177d Fix flakiness of test_keeper_s3_snapshot 
This is part of "Why my PR is not merged?" patch set series.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-13 14:25:24 +02:00
robot-clickhouse-ci-1
4666838a5d
Merge pull request #49438 from azat/build/unwind 
Force libunwind usage (removes gcc_eh support)
 2023-07-09 05:38:34 +02:00
Azat Khuzhin
a10aa9ad50 Force libunwind usage (removes gcc_eh support) 
libunwind is reentrant and signal safe, and works faster then then
gcc_eh (plus it has some custom patches for problems that have been
found during it's usage in ClickHouse).

gcc_eh may be missing in the system (if gcc was not installed), and
even if it exists clickhouse uses -nodefaultlibs, so some care should be
made to make it work.

Also this library is tiny and there shouln't be any problem to require
it always (there is already tendency to require some contrib libraries,
i.e. poco).

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-07-08 20:55:50 +02:00
Alexey Milovidov
c828db5720 Allow OOM in AST Fuzzer with Sanitizers 2023-07-08 05:57:23 +02:00
Alexey Milovidov
cf66be571f
Merge branch 'master' into remove-useless-packages 2023-07-07 13:44:13 +03:00
Antonio Andelic
c390c900c5
Merge branch 'master' into upgrade-check-fix-2 2023-07-06 21:10:41 +02:00
Alexander Sapin
9ae0dc730c Review fixes + enable in ci 2023-07-06 17:15:26 +02:00
Mikhail f. Shiryaev
6bbaade4a6
Update sccache, do not fail on connection error 2023-07-06 16:09:52 +02:00
Antonio Andelic
085f7caccf Move config changes after configure 2023-07-06 06:30:47 +00:00
Alexey Milovidov
75d051dd55 Remove useless packages 2023-07-06 01:49:53 +02:00
Alexey Milovidov
70bcf28f4a
Merge pull request #51839 from ClickHouse/fix-upgrade-test-disks 
Fix disk config for upgrade tests
 2023-07-06 00:35:18 +03:00
Antonio Andelic
1124c7ae8b Correctly move config 2023-07-05 12:42:36 +00:00
Mikhail f. Shiryaev
bcc569b9e3
Add temporary pin for docker-ce 2023-07-05 10:28:57 +02:00
Mikhail f. Shiryaev
35c1321952
Version mypy=1.4.1 falsly reports unused ignore comment 2023-07-04 13:05:41 +02:00
Alexander Tokmakov
ce5ca7d2a5
Merge pull request #51502 from ClickHouse/fix_logical_error_on_mutation 
Fix a logical error on mutation
 2023-07-03 12:52:59 +03:00
Antonio Andelic
aeea3dc824 Add odbcinst dep to sqllogic docker 2023-07-03 07:40:05 +00:00
Alexander Tokmakov
43dba76cbf
Merge branch 'master' into fix_logical_error_on_mutation 2023-07-02 19:30:00 +03:00
Antonio Andelic
c06afc53b4 Make scripts backwards compatible 2023-07-02 09:57:06 +00:00
Antonio Andelic
00aeb407e5 Wait with retries 2023-06-30 14:52:21 +00:00
Alexander Tokmakov
d572eff106
Merge branch 'master' into fix_logical_error_on_mutation 2023-06-30 15:12:35 +03:00
Alexey Milovidov
1e6f6b522c
Merge pull request #51180 from ClickHouse/update-tests-docker 
Update tests' docker containers
 2023-06-30 11:24:59 +03:00
Antonio Andelic
447a4e7b2a
Merge branch 'master' into add-retries-for-zk-create 2023-06-29 20:38:37 +02:00
Antonio Andelic
d1bb8f24c0 Retry chroot creation in ZK 2023-06-29 15:18:32 +00:00
Mikhail f. Shiryaev
340262814a
Avoid additional maven requests for spark tests 2023-06-29 12:24:19 +02:00
Alexander Tokmakov
296f9968c0 fix 2023-06-28 23:20:02 +02:00
Mikhail f. Shiryaev
406896f9a9
Create cgroupsv2 subtree for docker-in-docker 2023-06-28 22:19:41 +02:00
Mikhail f. Shiryaev
91dc6dfe34
Update mysql-php-client to the recent rolling version 2023-06-28 22:19:39 +02:00
Mikhail f. Shiryaev
ead81879b4
Update integration tests runner too 2023-06-28 22:19:32 +02:00
Mikhail f. Shiryaev
edcf981c48
Update mysql odbc connector 2023-06-28 22:19:31 +02:00
Mikhail f. Shiryaev
5a8ce1f2fe
Do not upload the binaries for fast-tests to tests-reports 2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
b68d8fa76e
Update the OS version for builder and testers docker images 2023-06-28 22:19:30 +02:00
Mikhail f. Shiryaev
7b4e6faece
Speedup the submodules cloning 2023-06-28 22:19:28 +02:00
Mikhail f. Shiryaev
45cd7f35cd
Use clickhouse/integration-helper from changed images 2023-06-28 22:11:48 +02:00
Alexey Milovidov
de58339c3b Merge branch 'fix-perf-tests-jemalloc' of github.com:azat/ClickHouse into many-fixes 2023-06-27 05:35:26 +02:00
Alexey Milovidov
4ee74ec213 Two tests are twice longer in average with Analyzer and sometimes failing 2023-06-26 02:19:52 +02:00
Azat Khuzhin
5871ca0836 Fix performance tests due to warnings from jemalloc about Per-CPU arena disabled 
jemalloc can show the following warning:

    Number of CPUs detected is not deterministic. Per-CPU arena disabled

It will be shown if one of the following returns different number of
CPUs:
- _SC_NPROCESSORS_ONLN
- _SC_NPROCESSORS_CONF
- sched_getaffinity()

And actually for my CPU linux returns different numbers, because there
are more possible CPUs then online, from dmesg:

    smpboot: Allowing 128 CPUs, 64 hotplug CPUs

And from sysfs:

    # grep . /sys/devices/system/cpu/{possible,online,offline}
    /sys/devices/system/cpu/possible:0-127
    /sys/devices/system/cpu/online:0-63
    /sys/devices/system/cpu/offline:64-127

From ACPI:

    # acpidump -o acpi
    # acpixtract -a acpi
    # iasl -d *.dat
    # grep -e 'Processor Enabled' apic.dsl | sort | uniq -c
        64                            Processor Enabled : 0
        64                            Processor Enabled : 1

So I guess this is the same as what happened in this perf run [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/51360/5d43a64112711b339b82b1c0e8df7882546a1a3c/performance_comparison_[4_4]/report.html

P.S. personally I, just use cmdline=possible_cpus=64 to fix this for my
setup.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-06-25 09:37:37 +02:00
Alexander Tokmakov
f973bd7516 suppress check for covered parts in zk 2023-06-20 23:53:32 +02:00
Alexander Tokmakov
bca0d76cbf
Merge pull request #50107 from ClickHouse/rmt_better_background_tasks_scheduling 
Improve scheduling of background tasks in ReplicatedMergeTree
 2023-06-20 16:25:19 +03:00
Alexander Tokmakov
5dd9b10c8e fix 2023-06-19 20:14:28 +02:00
Yatsishin Ilya
b472480d48 Fix branch name 2023-06-19 10:06:56 +00:00
Mikhail f. Shiryaev
5d4a3ac0c6
Do not spam sqlancer build log 2023-06-16 00:44:42 +02:00
Mikhail f. Shiryaev
60ab05e86f
Sqlancer has changed master to main 2023-06-16 00:28:09 +02:00
Alexander Tokmakov
ffde5affeb
Merge pull request #50929 from ClickHouse/fix_illegal_column_timezone 
Fix 'Illegal column timezone' in stress tests
 2023-06-14 17:56:57 +03:00
Mikhail f. Shiryaev
0bc624dc02
Fix the statless tests image for old commits 2023-06-13 17:53:19 +02:00
Alexander Tokmakov
5368fa72ca
Merge pull request #50487 from Avogar/add-gdb-to-stateless-tests 
Attach gdb in stateless tests
 2023-06-13 17:04:17 +03:00
Alexander Tokmakov
3a2fa65075 fix 'Illegal column timezone' in stress tests 2023-06-13 16:02:54 +02:00
alesapin
a614aa3b03 More leftovers 2023-06-10 16:06:37 +02:00
alesapin
20b66689f3 Fix test 2023-06-10 13:34:51 +02:00
Kruglov Pavel
5b3cece42e
Fix shellcheck 2023-06-06 12:23:00 +02:00
Sema Checherinda
990652119e
Merge pull request #50361 from nickitat/fail_perf_on_too_many_slow 
Fail perf tests when too many queries slowed down
 2023-06-06 11:33:04 +02:00
avogar
e8c6c7967b Move attaching gdb to separate lib 2023-06-05 18:21:40 +00:00
Nikita Taranov
4506299d73 impl 2023-06-02 23:14:09 +02:00
avogar
8973259678 Test attach gdb in stateless tests 2023-06-02 15:00:24 +00:00
Alexander Tokmakov
1544067fb3
Update run.sh 2023-06-01 23:28:19 +03:00
何李夫
e4c8c4cecf
Add zookeeper name in endpoint id (#49780) 
* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

Here is some infomation:
1.old table:
  CREATE TABLE a1 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
2.new table:
  CREATE TABLE a2 (`id` UInt64)
  ENGINE = ReplicatedMergeTree('aux1:/clickhouse/tables/default/a1/{shard}', '{replica}')
  ORDER BY (id);
3.error info:
  <Error> executeQuery: Code: 220. DB::Exception: Duplicate interserver IO endpoint:
          DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (DUPLICATE_INTERSERVER_IO_ENDPOINT)
  <Error> InterserverIOHTTPHandler: Code: 221. DB::Exception: No interserver IO endpoint
          named DataPartsExchange:/clickhouse/tables/default/a1/01/replicas/02.
          (NO_SUCH_INTERSERVER_IO_ENDPOINT)

* Revert "Add zookeeper name in endpoint id"

This reverts commit 9deb75b249619b7abdd38e3949ca8b3a76c9df8e.

* Add zookeeper name in endpoint id

When we migrate a replicated table from one zookeeper cluster to
another (the reason why we migration is that zookeeper's load is
too high), we will create a new table with the same zpath, but it
will fail and the old table will be in trouble.

* Fix incompatible with a new setting

* add a test, fix other issues

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

* Update 02735_system_zookeeper_connection.reference

* Update 02735_system_zookeeper_connection.sql

* Update run.sh

* Remove the 'no-fasttest' tag

* Update 02442_auxiliary_zookeeper_endpoint_id.sql

---------

Co-authored-by: Alexander Tokmakov <tavplubix@clickhouse.com>
Co-authored-by: Alexander Tokmakov <tavplubix@gmail.com>
 2023-05-25 12:50:14 +03:00
Azat Khuzhin
73661c3a46 Move tunnings for woboq codebrowser to cmake out from build.sh 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-18 18:18:30 +02:00
Mikhail f. Shiryaev
e79c1cdb1a
Attempt to increas parallelism for codebrowser_generator 2023-05-12 19:22:51 +02:00
Mikhail f. Shiryaev
65d1ae77ee
Use updated upstream woboq 2023-05-12 19:22:49 +02:00
Mikhail f. Shiryaev
eb122487ad
Add logs to the report, do not chown unnecessary 2023-05-12 19:22:48 +02:00
Mikhail f. Shiryaev
ec701d96c7
Rework the codebrowser build directories structure 2023-05-12 19:22:47 +02:00
Mikhail f. Shiryaev
7614c1c848
Move the command for codebrowser into a script 2023-05-12 19:22:45 +02:00
Azat Khuzhin
a0cc5b7e47 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-10 16:28:36 +02:00
Han Fei
d17aa828b3
Merge pull request #49361 from hanfei1991/hanfei/fiu 
support named fault injection and add a simple test
 2023-05-10 15:51:51 +02:00
Han Fei
505d9be7b2 address comments 2023-05-10 13:56:17 +02:00
Azat Khuzhin
be39e8e566 Merge remote-tracking branch 'u/master' into build/llvm-16 
Conflicts:
	docker/test/codebrowser/Dockerfile
 2023-05-09 20:40:43 +02:00
Mikhail f. Shiryaev
780b5a6f97
Fix a wrong built generator removal, use depth=1 2023-05-09 12:36:02 +02:00
Azat Khuzhin
bf17c819c3 docker: fix path to clang builtin headers for woboq code browser 
By default woboq uses $version.$minor.$patch, while clang simply uses
$version:

    CMake Error at generator/CMakeLists.txt:77 (message):
      Could not find any clang builtins headers in
      /usr/lib/llvm-16/lib/clang/16.0.4/include

    # ls -d /usr/lib/llvm-16/lib/clang/16/include
    /usr/lib/llvm-16/lib/clang/16/include

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-09 10:31:55 +02:00
Azat Khuzhin
08b8b7e587 docker: remove symlink for libclang (not required anymore) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-09 10:30:02 +02:00
Azat Khuzhin
82536fedde docker: install libclang-16-dev for woboq code browser 
Otherwise you will get the following error:

    CMake Error at /usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake:792 (message):
      The imported target "clangBasic" references the file

         "/usr/lib/llvm-16/lib/libclangBasic.a"

      but this file does not exist.  Possible reasons include:

      * The file was deleted, renamed, or moved to another location.

      * An install or uninstall procedure did not complete successfully.

      * The installation package was faulty and contained

         "/usr/lib/llvm-16/lib/cmake/clang/ClangTargets.cmake"

      but not all the files it references.

    Call Stack (most recent call first):
      /usr/lib/llvm-16/lib/cmake/clang/ClangConfig.cmake:20 (include)
      generator/CMakeLists.txt:7 (Find_Package)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-09 10:25:50 +02:00
Han Fei
64b67b9a37 Merge branch 'master' into hanfei/fiu 2023-05-09 01:14:30 +02:00
Azat Khuzhin
c525d13272 Enable back thread fuzzuer under TSan 
Since initial issue got resolved [1].

  [1]: https://github.com/google/sanitizers/issues/1540

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-05-08 22:35:09 +02:00
Azat Khuzhin
c37fe64040 Merge remote-tracking branch 'u/master' into build/llvm-16 2023-05-08 22:33:52 +02:00
Dmitry Novik
a3b3b78eb0 EXPECTED_TO_FAIL -> NOT_FAILED 2023-05-05 17:53:15 +00:00
Dmitry Novik
0baaaaba42 KNOWN_BROKEN -> BROKEN 2023-05-05 17:43:54 +00:00
Dmitry Novik
5422e3058f Use more specific test status 2023-05-05 16:19:01 +00:00
Dmitry Novik
b13e3abc4d Improve CI check for Analyzer 2023-05-05 15:17:16 +00:00
alesapin
08039024a2
Merge pull request #49492 from ClickHouse/add_server_jepsen_image 
Fixes in server jepsen image
 2023-05-04 12:02:27 +02:00
alesapin
412b161104
Merge pull request #48791 from kssenii/better-local-object-storage 
Make local object storage work consistently with s3 object storage, fix problem with append, make it configurable as independent storage
 2023-05-04 11:47:43 +02:00
alesapin
27f9384717 Followup 2023-05-03 23:33:19 +02:00
alesapin
c1d8fab2da Fxi 2023-05-03 21:05:19 +02:00
alesapin
6e8934f856 Improve image for local run 2023-05-03 14:40:18 +02:00
Han Fei
d608ba41e7 try to fix 2023-05-02 00:05:36 +02:00
Kseniia Sumarokova
d4aa96e262
Merge branch 'master' into better-local-object-storage 2023-04-28 21:05:05 +02:00
Kseniia Sumarokova
45e2d296f9
Merge branch 'master' into better-local-object-storage 2023-04-27 14:54:04 +02:00
robot-clickhouse
3448b112d8 Automatic style fix 2023-04-27 12:31:00 +00:00
Alexey Milovidov
8eae3ed3a5 Fix garbage #48719 2023-04-27 13:48:23 +02:00
Kseniia Sumarokova
c4abe66d77
Update run.sh 2023-04-25 12:25:49 +02:00
kssenii
f38dfc9206 Update run.sh 2023-04-23 12:49:22 +02:00
Kseniia Sumarokova
370aa60159
Update run.sh 2023-04-21 22:10:06 +02:00
robot-clickhouse
eda1379180 Automatic style fix 2023-04-21 19:04:36 +00:00
Dmitry Novik
5fef967872 Make error message better 2023-04-21 18:11:54 +00:00
Dmitry Novik
1fdee1a2ab
Merge branch 'master' into analyzer-ci 2023-04-21 15:43:16 +02:00
kssenii
e58c16318f Merge remote-tracking branch 'upstream/master' into better-local-object-storage 2023-04-21 12:49:40 +02:00
kssenii
88f412ad23 Fix upgrade check, fix integration test 2023-04-21 12:44:08 +02:00
Mikhail f. Shiryaev
634cf010b9
Merge pull request #48935 from ClickHouse/fasttests-build-time 
Add building stage to the fasttests report, respect existing status on rerun
 2023-04-20 15:50:18 +02:00
Mikhail f. Shiryaev
c80d8081d2
Add building stage to the fasttests report 2023-04-19 13:35:28 +02:00
Mikhail f. Shiryaev
95eb78a593
Using a proper --tls=false option to disable TLS 2023-04-19 13:33:15 +02:00
Mikhail f. Shiryaev
6a6a028a51
Reduce docker image size, fix slow startup 2023-04-19 09:44:53 +02:00
Dmitry Novik
308970da83 Add logging 2023-04-18 13:53:13 +00:00
Dmitry Novik
b2ed99f6b3
Merge branch 'master' into analyzer-ci 2023-04-18 13:07:45 +02:00
Dmitry Novik
6197d3d55f Pass volume only for analyzer 2023-04-18 00:12:30 +00:00
Sema Checherinda
0354a964cd turn on all CI back 2023-04-17 14:07:56 +02:00
Sema Checherinda
c3b9d5fe6e introduce sqllogic runner 2023-04-16 13:57:24 +02:00
Dmitry Novik
3df33d74f5 Get rid of another docker image 2023-04-13 17:22:12 +02:00
kssenii
4bf01c611c Fix 2023-04-13 16:56:11 +02:00
kssenii
6f53784f22 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-04-13 15:56:40 +02:00
robot-clickhouse
fa7b72570b Automatic style fix 2023-04-12 17:09:37 +00:00
Dmitry Novik
360fc59694 Handle known broken tests 2023-04-12 16:46:30 +00:00
Azat Khuzhin
a1272e8536 Pass existing TSAN_OPTIONS to integration tests and append new options 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-10 15:17:43 +02:00
Azat Khuzhin
61bf70be12 Add second_deadlock_stack=1 for TSan on CI 
To improve TSan reports.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-04-10 15:05:57 +02:00
kssenii
00282483c9 Address remaining review comments 2023-04-07 18:29:55 +02:00
kssenii
c40f17a276 One more attempt 2023-04-06 20:09:06 +02:00
kssenii
4a94074f71 Try fix java errors in CI 2023-04-06 15:11:45 +02:00
kssenii
44b9bc5a91 Remove redundant from dockerd-entrypoint.sh 2023-04-05 14:40:30 +02:00
kssenii
319417062f Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-30 18:29:46 +02:00
Mikhail f. Shiryaev
79177e1988
Enable sccache in fasttests 2023-03-29 23:33:29 +02:00
Mikhail f. Shiryaev
612d1d8876
Install sccache in binary-builder and fasttests 2023-03-29 23:33:24 +02:00
kssenii
fcc8e4223c Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-29 14:13:27 +02:00
kssenii
04b28bf822 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-28 15:39:24 +02:00
Raúl Marín
ff209db129
Merge branch 'master' into zk_inject_timeout 2023-03-27 19:46:10 +02:00
Raúl Marín
c47dcb0805 Enable ZK fault injection on new servers (but not during startup) 2023-03-27 15:07:59 +02:00
robot-clickhouse
6ac86ed3e0
Merge pull request #47945 from ClickHouse/artifacts-s3-prefix 
Artifacts s3 prefix
 2023-03-26 00:15:50 +01:00
Mikhail f. Shiryaev
290ee6bbf1
Merge pull request #47790 from CurtizJ/apply-black-to-all-files 
Apply black formatter to all python scripts
 2023-03-24 14:20:50 +03:00
Mikhail f. Shiryaev
4f2c336cfc
Update black version, run it for the repository 2023-03-24 11:54:38 +01:00
Alexander Tokmakov
4dde73c3eb
Merge pull request #47917 from ClickHouse/fix_terminate_in_check_thread 
Fix terminate in parts check thread
 2023-03-24 04:22:00 +03:00
Mikhail f. Shiryaev
3b9213fb5a
Use variables in URLs, migrate to RPs prefix 2023-03-24 00:01:03 +01:00
Mikhail f. Shiryaev
9a2a091c76
Get rid of temporary COMMON_BUILD_PREFIX 2023-03-23 16:39:16 +01:00
Anton Popov
0ee8dfad53 apply black formatter 2023-03-23 15:33:23 +00:00
Alexander Tokmakov
5b263b9ffe fix 2023-03-23 15:36:17 +01:00
Nikita Mikhaylov
301e26b23d
Parallel replicas. Part 2.5 (#47858) 2023-03-22 13:05:38 +01:00
Anton Popov
21f5d20b9e apply black to all python scripts 2023-03-20 17:30:20 +00:00
Alexey Milovidov
0f7f620100 Update one more place 2023-03-19 01:07:11 +01:00
Alexey Milovidov
89a76c2d77 Use LLVM 16 2023-03-18 23:45:57 +01:00
kssenii
f776f4ff46 Merge remote-tracking branch 'upstream/master' into better-tests-for-data-lakes 2023-03-17 19:45:28 +01:00
Alexander Tokmakov
d11aee2b0c
Merge branch 'master' into fix_993 2023-03-17 21:28:23 +03:00
Alexander Tokmakov
d621b2c4ad fix intersecting parts, better fault injections 2023-03-16 21:28:07 +01:00
Azat Khuzhin
f540a14fae ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881 ci/upgrade: remove obsolete function call 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7 ci/upgrade: fix creating system database with Ordinary engine 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:12:32 +01:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper 
Fix Keeper with `force_sync = false`
 2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9 Use force_sync=true in upgrade check 2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880 suppress expected errors from test 01111 in Upgrade check 2023-03-08 15:27:43 +01:00
Alexander Tokmakov
d34f00f437
Update run.sh 2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa Suppress "Cannot flush" for Distributed tables in upgrade check 
CI reports [1]:

    2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
    2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Kruglov Pavel
261c3aa86d
Update 2023-02-27 16:42:29 +01:00
avogar
ff67fc4b06 Remove llvm-9 from dependencies 2023-02-24 16:59:27 +00:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests (#46641) 
* Avoid OOM in perf tests

At some point perf tests started to fail for one setup on CI [1]:

    /home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed                  python3 performance_comparison_check.py "$CHECK_NAME"
    Error: Process completed with exit code 137.

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-23 14:05:18 +01:00
Alexander Tokmakov
dcf8aeab8f
Update stress 2023-02-21 22:16:05 +03:00
Alexander Tokmakov
97e9df0148
Update stress 2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests (#41534) 
* Update stress

* fix

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-02-21 15:36:23 +03:00
Alexander Tokmakov
669c4e94d5
Update compare.sh 2023-02-20 17:35:30 +03:00
Azat Khuzhin
5a5f99a27e Add CPU flamegraphs for perf tests 
In Real profiler there is too much noise (polling, cond vars, ...)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress 
Revert "Merge pull request #38212 from azat/no-stress"
 2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress" 
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
 2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses 
Fix stress tests statuses
 2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e fix stress tests statuses 2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh 2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh 2023-02-14 13:10:18 +01:00
Azat Khuzhin
dc5d7809b6 Do not continue perf tests in case of exception in create_query/fill_query 
Previously due to using of threading.Thread, exception had been
ignored, and perf test simply continues, yes it will show some errors,
but it also may show that the test became faster, while it is because
the underlying table was empty.

Replace threading.Thread with a SafeThread (inline implementation) that
simply rethrow exception in join.

Here is an example of such report [1], look at the ip_trie test.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/2101b66570cbb9eb9a492afa8ab82d562c34336b/performance_comparison_[3/4]/report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-13 17:31:15 +01:00
serxa
c17dc8e284 fix 2023-02-11 16:48:47 +00:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler 2023-02-11 10:30:26 +01:00
Kruglov Pavel
38fbf88ea7
Merge branch 'master' into split-bc-check 2023-02-10 18:28:49 +01:00
Kruglov Pavel
43e660ebd2
Update run.sh 2023-02-10 18:28:19 +01:00
Alexander Tokmakov
9c20e42807
Update run.sh 2023-02-10 14:25:26 +03:00
Alexander Tokmakov
d61c665cd5
Update run.sh 2023-02-10 14:01:48 +03:00
Kruglov Pavel
4067453602
Update run.sh 2023-02-10 11:57:02 +01:00
serxa
f61f95fcec Replace background executor scheduler merges and mutations with round-robin 2023-02-09 18:54:15 +00:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
de1c4f5764 fix disabled by mistake hung check 2023-02-08 22:37:22 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075) 
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
 2023-02-08 12:04:11 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings 
Allow to randomize merge tree settings in tests
 2023-02-04 02:59:52 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd 
Add systemd.service for clickhouse-keeper
 2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2 2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation 2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
4c86e9125b
Add necessary dependency for sanitizers 2023-02-02 13:40:04 +01:00
robot-clickhouse
ddbc8ceee8 Automatic style fix 2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d better context for stress tests failures 2023-02-02 01:02:12 +01:00
Alexander Tokmakov
283057493b
Merge pull request #45869 from ClickHouse/stress_report_add_context 
Add some context to stress test failures
 2023-02-01 16:19:08 +03:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring 
Re-introduce io_uring read method
 2023-02-01 06:41:32 +03:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Alexey Milovidov
b18dc419b7
Merge pull request #45691 from ClickHouse/tavplubix-patch-2 
Suppress TOO_MANY_PARTS in BC check
 2023-01-29 04:22:42 +03:00
Saulius Valatka
fb45ed038f add liburing to build 2023-01-28 21:54:44 +02:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels 
Add ability to ignore unknown keys in JSON object for named tuples
 2023-01-27 21:11:05 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings 2023-01-27 16:03:00 +01:00
Kruglov Pavel
81875fe559
Update run.sh 2023-01-27 14:45:10 +01:00
Alexander Tokmakov
87c1937039
Update run.sh 2023-01-27 15:28:40 +03:00
Azat Khuzhin
d21fa27379 Enable simdjson in fasttest (should be pretty lightweight) 
The library and callers are pretty lightweight, so as tests for
JSONExtact, so this should be OK

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 10:01:08 +01:00
avogar
dc0c1c33bb Update 2023-01-26 14:50:59 +00:00
Anton Popov
92fa39798b Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-26 13:29:23 +00:00
Alexander Tokmakov
9b670946db Merge branch 'master' into exception_message_patterns5 2023-01-26 00:41:32 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Kruglov Pavel
61d836b79d
Update run.sh 2023-01-25 18:59:50 +01:00
Alexander Tokmakov
ae795d87b2 fix 2023-01-25 16:06:40 +01:00
avogar
09951c70c4 Fix 2023-01-24 16:45:07 +00:00
Alexander Tokmakov
bfd2ee1918
Update stress 2023-01-24 14:36:29 +03:00
Anton Popov
08b2e524c7 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-23 15:34:53 +00:00
Azat Khuzhin
9d88f4df27 stress: remove unused --client-cmd 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-23 13:47:59 +01:00
Robert Schulze
40ced78a7e
Update report.py 2023-01-22 20:01:55 +01:00
Robert Schulze
de8fc04b03
Performance report: "Partial queries" --> "Backward-incompatible queries 2023-01-22 17:43:27 +00:00
Nikolay Degterinsky
97900e9613
Merge pull request #45479 from evillique/astfuzzer-retries 
Add more retries to AST Fuzzer
 2023-01-22 13:45:38 +01:00
avogar
fd9b735505 Merge with master, add some fixes 2023-01-20 20:22:03 +00:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Nikolay Degterinsky
c2ac4fece0 Add more retries to AST Fuzzer 2023-01-20 16:46:24 +00:00
Alexander Tokmakov
1413b9537c make error patterns more useful 2023-01-17 20:04:25 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern 
Add a column with a message pattern to text_log
 2023-01-17 20:19:32 +03:00
Alexey Milovidov
ec8c38c174 Add review suggestion 2023-01-13 22:53:17 +01:00
Alexey Milovidov
167d980fe2 Fix GitHub 2023-01-13 22:52:05 +01:00
Alexander Tokmakov
2d7773fccc Merge branch 'master' into text_log_add_pattern 2023-01-13 20:33:46 +01:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-13 05:22:18 +03:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type 
Rework CI reports to have a class and clarify the logic
 2023-01-12 18:20:40 +01:00
Anton Popov
ca80240d84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-12 12:13:45 +00:00
Ilya Yatsishin
a927ecfe04
Merge pull request #45201 from ClickHouse/qoega-patch-5 2023-01-12 10:08:02 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-12 07:17:03 +03:00
Alexey Milovidov
c75c6c2298
Update run-fuzzer.sh 2023-01-12 07:16:10 +03:00
Alexey Milovidov
703f223e50 Remove trash from stress test 2023-01-12 04:56:20 +01:00
Mikhail f. Shiryaev
9219dc1c6e
Make sqlancer lighter by some optimizations 2023-01-11 22:43:10 +01:00
Ilya Yatsishin
ca367a6a64
Add CACHE_INVALIDATOR for sqlancer builds 2023-01-11 22:24:01 +01:00
Alexander Tokmakov
8fa1b070c6 minor cleanup in stress/run.sh 2023-01-10 19:55:06 +01:00
Alexey Milovidov
8d82f1f59e Fix trash 2023-01-10 02:59:55 +01:00
Alexey Milovidov
17445fdd96 Fix Fuzzer script 2023-01-10 02:57:56 +01:00
Alexey Milovidov
62c0385da9 Fix Fuzzer script 2023-01-10 02:55:57 +01:00
Mikhail f. Shiryaev
84861c2b7c
Add TODO to style-check image 2023-01-09 12:10:26 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
0b5bb118d9 Fix bash 2023-01-09 07:01:20 +01:00
Alexey Milovidov
4b2f651f72 Fix bash 2023-01-09 04:34:30 +01:00
Alexey Milovidov
e8d661b511 Merge branch 'master' into break-ci 2023-01-09 04:34:10 +01:00
Alexey Milovidov
f374d3a44e Fix performance test 2023-01-09 01:59:48 +01:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
Alexey Milovidov
e9d5bd7df3 Fix tar 2023-01-09 01:56:25 +01:00
Alexey Milovidov
93525229a9 Fix trash in Stress test 2023-01-08 23:02:49 +01:00
Alexey Milovidov
06e2fa7ebc
Merge branch 'master' into max_memory_usage_in_stress_test 2023-01-08 10:23:01 +03:00
Alexey Milovidov
3f01910446 Fix error 2023-01-08 07:59:31 +01:00
Alexey Milovidov
51038be3d5 Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
fa1d595059
Merge pull request #44819 from ClickHouse/modern-tools 
Modern tools, part 1
 2023-01-08 09:50:39 +03:00
Alexey Milovidov
b9d6ce02dc Set max memory usage for queries in the stress test 2023-01-08 06:04:56 +01:00
Alexey Milovidov
b9777fb439 Fix OOM in Fuzzer 2023-01-08 05:57:29 +01:00
Alexey Milovidov
9254c62281 Merge branch 'modern-tools' of github.com:ClickHouse/ClickHouse into modern-tools 2023-01-08 03:21:00 +01:00
Alexey Milovidov
e298035d08 Fix performance test 2023-01-08 03:20:42 +01:00
Alexey Milovidov
983bd527dd Merge branch 'master' into modern-tools 2023-01-08 03:19:30 +01:00
Alexey Milovidov
e07dd44f79
Merge pull request #45026 from ClickHouse/fix-fuzzer-3 
Fix false positive in Fuzzer, alternative variant
 2023-01-08 04:59:13 +03:00
Alexey Milovidov
bf57564ec5 Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-08 02:26:09 +01:00
Alexey Milovidov
d22f25b72f
Merge pull request #45025 from ClickHouse/fix-fuzzer-2 
Fix false positive in Fuzzer
 2023-01-08 04:24:22 +03:00
Alexey Milovidov
cc32bec83b Fix false positive in Fuzzer, alternative variant 2023-01-08 01:20:11 +01:00
Alexey Milovidov
c308c40eed Fix false positive in Fuzzer 2023-01-08 01:14:46 +01:00
Alexey Milovidov
2065871b87
Merge branch 'master' into no-adduser 2023-01-07 23:24:40 +03:00
Alexey Milovidov
a9324c0517 More ok cases for Fuzzer 2023-01-07 02:23:15 +01:00
Alexey Milovidov
869428f228 Remove adduser dependency 2023-01-07 01:45:54 +01:00
Alexey Milovidov
3211f63911 Add dmesg.log to Fuzzer 2023-01-07 01:18:35 +01:00
Alexey Milovidov
772b6b69a9 Fix strange trash in Fuzzer 2023-01-07 00:40:01 +01:00
Alexey Milovidov
42f25cb6a6
Amend 2023-01-07 00:57:47 +03:00
Alexey Milovidov
22fcabd229
Remove expert-level grep usages. 2023-01-07 00:57:11 +03:00
Alexey Milovidov
36f4d30820 Fix GitHub 2023-01-05 19:28:58 +01:00
Alexey Milovidov
e54d30a812
Merge branch 'master' into modern-tools 2023-01-05 21:24:47 +03:00
Ilya Yatsishin
a28d6fb490
Merge pull request #44848 from qoega/green-ci-2 
Pre-pulling images for integration tests to detect broken infrastructure earlier
 2023-01-05 17:29:39 +01:00
Yatsishin Ilya
932a2f9e09 revert minio changes 2023-01-05 09:12:56 +00:00
Alexey Milovidov
9756d46ad7
Merge branch 'master' into fix-integration-base 2023-01-05 00:02:51 +03:00
Yatsishin Ilya
9cf599e58b Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 15:49:22 +00:00
avogar
a7dbbff426 Merge branch 'split-bc-check' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-04 15:06:38 +00:00
avogar
f1ca7e54d5 Make better 2023-01-04 15:06:16 +00:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
Alexey Milovidov
52b3fd223d
Merge branch 'master' into perf_log_sync_time 2023-01-04 05:29:27 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code 
What if I will remove two lines of code?
 2023-01-04 04:50:52 +03:00
Ilya Yatsishin
49155d9614
Merge pull request #44711 from qoega/green-ci-1 
Improve some integration tests and add pytest-random
 2023-01-03 22:39:54 +01:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
cb8e7c8059
Merge pull request #44824 from ClickHouse/stress-test-less-oom 
Less OOM in stress test
 2023-01-03 22:12:34 +03:00
Alexey Milovidov
453dac69c7
Merge pull request #44855 from ClickHouse/fuzzer-more-cases-of-oom 
More cases of OOM in Fuzzer
 2023-01-03 22:11:38 +03:00
Mikhail f. Shiryaev
5257ff627b Optimize and fix zookeeper downloading and installation 2023-01-03 19:32:12 +01:00
Alexey Milovidov
803c7e4443 Fix GitHub 2023-01-03 17:47:15 +01:00
Alexey Milovidov
a695629e51
Merge branch 'master' into modern-tools 2023-01-03 19:44:25 +03:00
Pradeep Chhetri
fa234878d6
Cleanup setup_minio.sh (#44858) 2023-01-03 14:29:50 +01:00
Alexey Milovidov
8125f3adc0 More cases of OOM in Fuzzer 2023-01-03 01:17:28 +01:00
Alexey Milovidov
b975b22f8b
Merge branch 'master' into stress-test-less-oom 2023-01-02 22:32:41 +03:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code 2023-01-02 22:15:36 +03:00
Alexey Milovidov
557396db15 Merge with master 2023-01-02 20:09:50 +01:00
Yatsishin Ilya
fb9e363204 remove unnecessary change 2023-01-02 17:06:07 +00:00
Yatsishin Ilya
631c55e379 Fix compose files to work without correct environment 2023-01-02 16:45:50 +00:00
Yatsishin Ilya
f779fe3c0a Improve some integration tests 2023-01-02 12:43:16 +01:00
Alexey Milovidov
f7fbaf9c99
Merge pull request #44829 from ClickHouse/adjust-css-in-fuzz-report 
Adjust CSS
 2023-01-02 05:41:18 +03:00
Alexey Milovidov
47ae8c5c79 Remove more lines 2023-01-02 02:06:11 +01:00
Alexey Milovidov
bb6c28b07c Fix something strange 2023-01-02 01:51:15 +01:00
Alexey Milovidov
4171003b1a Adjust CSS 2023-01-02 01:28:05 +01:00
Alexey Milovidov
75d363c264
Update docker/test/fuzzer/run-fuzzer.sh 
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
 2023-01-02 03:09:05 +03:00
Alexey Milovidov
a39d0f6a50 Fix two typos 2023-01-02 00:11:15 +01:00
Alexey Milovidov
6e946cc757 Less OOM in stress test 2023-01-01 23:22:26 +01:00
Alexey Milovidov
f99ff1f33b
Merge branch 'master' into modern-tools 2023-01-01 22:55:44 +03:00
Alexey Milovidov
0b324ab836 Modern tools 2023-01-01 20:53:06 +01:00
Alexey Milovidov
ea4df8a692 Stash 2023-01-01 20:50:51 +01:00
Alexey Milovidov
f4dc658901 Fix grep 2023-01-01 17:11:44 +01:00
Alexey Milovidov
d4d0647ccd
Merge pull request #44812 from ClickHouse/remove-testflows 
Remove the remainings of TestFlows
 2023-01-01 18:15:39 +03:00
Alexey Milovidov
ea04181d11 Remove remainings of TestFlows 2023-01-01 03:17:31 +01:00
Alexey Milovidov
01acbafb37
Merge pull request #44769 from ClickHouse/fatal-fuzz 
Print fatal messages in Fuzzer
 2023-01-01 01:10:54 +03:00
Alexey Milovidov
e2c00cefb8
Merge pull request #44810 from ClickHouse/stress-test-is-a-trash 
Fix total trash in stress test
 2023-01-01 01:09:02 +03:00
Alexey Milovidov
7434a2cbbb
Merge pull request #44807 from ClickHouse/fix-typo-in-stress-test 
Retry packages download if GitHub returned HTTP 500.
 2023-01-01 01:08:48 +03:00
Alexey Milovidov
a7ccc618c6 Fix total trash in stress test 2022-12-31 15:40:06 +01:00
Alexey Milovidov
78ed8a6d69 GitHub is unreliable; copy-paste code from Stackoverflow to solve it 2022-12-31 14:45:44 +01:00
Alexey Milovidov
d4a35f7682 Fix typo in stress test 2022-12-31 14:31:40 +01:00
Alexey Milovidov
be3ab1562c
Update run-fuzzer.sh 2022-12-31 16:23:53 +03:00
Alexey Milovidov
8f7a84c964 Print fatal messages in Fuzzer 2022-12-30 22:16:30 +01:00
Alexey Milovidov
234193acc9 Print fatal messages in Fuzzer 2022-12-30 22:13:47 +01:00
alesapin
acad2fac63 Remove database ordinary from stress test 2022-12-30 18:48:25 +01:00
Raúl Marín
91dea53dbe Perf test: Log the time spent waiting for file sync 2022-12-30 12:03:43 +01:00
Alexey Milovidov
e54bf36a3e
Merge pull request #44722 from ClickHouse/rename_file 
Rename log in stress test
 2022-12-30 01:44:48 +03:00
Alexey Milovidov
f84064d05a
Merge pull request #44720 from ClickHouse/improve-fuzzer 
A few improvements to AST Fuzzer
 2022-12-30 01:43:55 +03:00
Alexey Milovidov
f423dced5a Debug deadlock in stress test 2022-12-29 20:06:09 +01:00
alesapin
9eeb7db2f3 Rename log in stress test 2022-12-29 19:33:32 +01:00
Alexey Milovidov
79ae191611 A few improvements to AST Fuzzer 2022-12-29 18:55:28 +01:00
Alexey Milovidov
eb9cff33ca
Merge pull request #44669 from ClickHouse/remove-questdb 
Remove questdb (it makes a little sense but the test was flaky)
 2022-12-29 01:55:55 +03:00
alesapin
3eda778707 Better 2022-12-28 14:29:27 +01:00
Alexey Milovidov
f30272279c Whitespace 2022-12-28 12:41:44 +01:00
Alexey Milovidov
135a32c606
Merge branch 'master' into faster-startup-bc-check 2022-12-27 23:17:24 +03:00
alesapin
f93c52ac69 Add +x flag for run-fuzzer.sh 2022-12-27 19:48:58 +01:00
Alexey Milovidov
735fe5b189
Merge pull request #44282 from nickitat/set_mem_limit_for_fuzz_tests 
Set memory limit for server in AST fuzz tests
 2022-12-27 16:05:26 +03:00
Alexey Milovidov
44de7195d1
Merge branch 'master' into fix-fuzzer-html 2022-12-27 15:35:54 +03:00
Alexey Milovidov
bfe895975e
Merge pull request #44575 from ClickHouse/minimal-changes 
Non-significant changes
 2022-12-27 15:34:27 +03:00
Alexey Milovidov
9645941cdf
Merge pull request #44616 from ClickHouse/sanitizer-out-of-memory 
Do not fail the AST fuzzer if sanitizer is out of memory
 2022-12-27 15:15:26 +03:00
Alexey Milovidov
05c27f4e15
Merge pull request #44603 from ClickHouse/runlog 
Rename `runlog.log` to `run.log` in tests
 2022-12-27 15:14:05 +03:00
alesapin
338c554525 Push 2022-12-27 13:00:14 +01:00
alesapin
e4e6cccbf8 Remove garbage 2022-12-27 12:59:09 +01:00
Alexey Milovidov
b85409f976 Do not fail if sanitizer is out of memory 2022-12-26 22:46:37 +01:00
Alexey Milovidov
a0753cbca2 Disable analyzer in fuzz and stress tests 2022-12-26 19:04:10 +01:00
Alexey Milovidov
91c1f9de8f Faster server startup after stress test 2022-12-26 18:13:50 +01:00
Alexey Milovidov
6ba360be71 Rename runlog.log to run.log 2022-12-26 16:29:32 +01:00
Roman Vasin
483e26cf2f
Merge branch 'master' into ADQM-634 2022-12-26 15:34:38 +03:00
Alexey Milovidov
fe73b0f648
Update run-fuzzer.sh 2022-12-25 22:14:25 +03:00
alesapin
211c6062bc Fix 2022-12-25 19:37:02 +01:00
Alexey Milovidov
31bd775073
Update run-fuzzer.sh 2022-12-25 19:53:26 +03:00
Alexey Milovidov
51503fc9e4 Fuzzer HTML: fix trash 2022-12-25 16:19:42 +01:00
Alexey Milovidov
f22fc35900 Minimal changes 2022-12-25 14:18:05 +01:00
alesapin
bd19c6b699 Make BC check optional (if env var set) 2022-12-24 17:46:22 +01:00
Alexander Tokmakov
f2b177880f print stats in tests 2022-12-23 16:04:29 +01:00
Nikita Taranov
c79c80f841 better 2022-12-20 19:56:29 +01:00
Anton Popov
56187c5f0e Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-20 13:37:23 +00:00
kssenii
7509bb2d3f Fix 2022-12-19 21:29:35 +01:00
Mikhail f. Shiryaev
815ba5b48f
Add check for submodules sanity 2022-12-19 17:36:03 +01:00
Roman Vasin
64c0c6ae99 Refactor test_kerberos_auth test 2022-12-19 11:28:49 +00:00
Alexey Milovidov
87b4a32d59
Merge pull request #43392 from azat/tests/pdb 
Improve pytest --pdb experience by preserving dockerd on SIGINT
 2022-12-17 04:24:10 +03:00
Alexey Milovidov
a3dc5e8b0a
Merge pull request #44132 from azat/bump-libdivide 
Bump libdivide (to gain some new optimizations)
 2022-12-17 04:07:08 +03:00
Anton Popov
b6f2754afb Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-16 14:37:34 +00:00
Nikita Taranov
7058a5e7ed impl 2022-12-15 18:37:04 +01:00
Roman Vasin
e2ced517dd Add integration test test_kerberos_auth 2022-12-14 13:39:23 +00:00
Alexander Tokmakov
3f336190a7
Update run.sh 2022-12-14 14:21:21 +03:00
Anton Popov
87e02a1744 Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-14 02:08:10 +00:00
Alexander Tokmakov
f68a407636
Update docker/test/stress/run.sh 
Co-authored-by: Alexander Gololobov <440544+davenger@users.noreply.github.com>
 2022-12-13 18:58:02 +03:00
Alexander Tokmakov
49f3e8e19b
Update run.sh 2022-12-13 18:47:13 +03:00
Alexander Tokmakov
371e85d854
Merge pull request #44157 from ClickHouse/fix_session_expired_on_startup 
Ignore "session expired" errors after BC check
 2022-12-13 15:10:36 +03:00
Azat Khuzhin
cdfe62f303 Update libdivide 
This will includes at least [1].

  [1]: https://github.com/ridiculousfish/libdivide/pull/94

v2: Define LIBDIVIDE_* macros mutually exclusive
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-13 10:45:01 +01:00
Alexander Tokmakov
469406c494 ignore session expired errors after BC check 2022-12-12 14:02:14 +01:00
Sema Checherinda
9a3aecd4c1 set max-tries bigger when backward compatibility check runs, old version still drop parts at shutdown 2022-12-05 16:05:14 +01:00
Sema Checherinda
dc52a40c04 decrease stop max-tries back to default, do not clear old parts at shutdown 2022-12-05 16:05:14 +01:00
Anton Popov
5d9077cdb6 Merge remote-tracking branch 'upstream/master' into HEAD 2022-12-02 12:06:45 +00:00
Mikhail f. Shiryaev
8897aa7fe8
Merge pull request #43132 from ClickHouse/strict-typing-ci 
Enable strict typing check in tests/ci
 2022-12-01 14:37:25 +01:00
Mikhail f. Shiryaev
1c5610bf65
Changes during the review 2022-12-01 14:06:17 +01:00
Azat Khuzhin
4c1fb543e1
Sync everything to persistent storage to avoid writeback affects perf tests (#43530) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-12-01 13:42:59 +01:00
Alexey Milovidov
54e27d4230
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-30 00:25:25 +01:00
Alexander Tokmakov
ac578efc05
Update run.sh 2022-11-29 20:16:59 +03:00
Mikhail f. Shiryaev
9cb2aa1c46
Add python mypy check to CI 2022-11-29 16:50:22 +01:00
Mikhail f. Shiryaev
e46f615176
Simplify checks list in style-check image 2022-11-29 16:50:22 +01:00
Robert Schulze
829958e13a
Merge branch 'master' into build-libcxx-and-libcxxabi-from-llvm-project 2022-11-28 16:09:14 +01:00
Alexander Tokmakov
9a948dc05a
Merge pull request #43593 from ClickHouse/fix_fuzzer_run 
Remove code that I do not understand
 2022-11-28 18:01:11 +03:00
Azat Khuzhin
ca16f5136f stress: use --max-tries only since 22.12 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Azat Khuzhin
2c36b52050 stress: increase timeout for server waiting after TERM 
Greater timeout after TERM may reduce about of KILL, let's try.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2022-11-27 09:40:39 +01:00
Alexander Tokmakov
cdbd1cb158 fix 2022-11-26 18:45:50 +01:00