thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-04 21:42:39 +00:00
Code Issues Packages Projects Releases Wiki Activity
117,593 Commits 9,185 Branches 1,782 Tags 2.3 GiB
415749f64c
Commit Graph

3132 Commits

Author SHA1 Message Date
Azat Khuzhin
f540a14fae ci/upgrade: store system.*_log tables on local filesystem (and fix artifacts) 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:13:05 +01:00
Azat Khuzhin
55296c4881 ci/upgrade: remove obsolete function call 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:13:04 +01:00
Azat Khuzhin
7e1db1a7f7 ci/upgrade: fix creating system database with Ordinary engine 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-14 14:12:32 +01:00
Antonio Andelic
83a3243758
Merge pull request #47065 from ClickHouse/debug-keeper 
Fix Keeper with `force_sync = false`
 2023-03-10 09:27:13 +01:00
Antonio Andelic
1d78c1b6d9 Use force_sync=true in upgrade check 2023-03-09 14:45:26 +00:00
kssenii
0240ad4c68 Add spark to tests, rewrite tests, fix bug 2023-03-08 15:45:35 +01:00
Alexander Tokmakov
0fb537e880 suppress expected errors from test 01111 in Upgrade check 2023-03-08 15:27:43 +01:00
Alexander Tokmakov
d34f00f437
Update run.sh 2023-03-03 15:02:05 +03:00
Azat Khuzhin
3ad05848fa Suppress "Cannot flush" for Distributed tables in upgrade check 
CI reports [1]:

    2023.03.01 04:39:00.185189 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:
    2023.03.01 04:39:00.242066 [ 358842 ] {} <Error> StorageDistributed (dist_01555): Cannot flush: Code: 279. DB::NetException: All connection tries failed. Log:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/47042/0e0a24234aa3409bb7799cc9a4b7a72bb006a923/upgrade_check__asan_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-03-01 17:38:08 +01:00
Mikhail f. Shiryaev
9a48539fbe
Rebuild stateful tests image 2023-02-28 20:20:04 +01:00
Kruglov Pavel
261c3aa86d
Update 2023-02-27 16:42:29 +01:00
avogar
ff67fc4b06 Remove llvm-9 from dependencies 2023-02-24 16:59:27 +00:00
avogar
e52a995e46 Fix style 2023-02-24 16:58:36 +00:00
avogar
8c6cf28c01 Make better 2023-02-24 16:43:28 +00:00
avogar
6b7d3bf07b Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-24 13:52:22 +00:00
Azat Khuzhin
b8b6d597ae
Avoid OOM in perf tests (#46641) 
* Avoid OOM in perf tests

At some point perf tests started to fail for one setup on CI [1]:

    /home/ubuntu/actions-runner/_work/_temp/f8fce7b1-8bc4-49c8-a203-c96867f4420a.sh: line 5: 1882659 Killed                  python3 performance_comparison_check.py "$CHECK_NAME"
    Error: Process completed with exit code 137.

  [1]: https://github.com/ClickHouse/ClickHouse/actions/runs/4230936986/jobs/7349818625

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Switch perf tests to ubuntu 22.04 for parallel with --memsuspend

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-23 14:05:18 +01:00
Alexander Tokmakov
dcf8aeab8f
Update stress 2023-02-21 22:16:05 +03:00
Alexander Tokmakov
97e9df0148
Update stress 2023-02-21 19:10:44 +03:00
Alexander Tokmakov
b5e6d74d48
More interesting settings for Stress Tests (#41534) 
* Update stress

* fix

---------

Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
 2023-02-21 15:36:23 +03:00
Alexander Tokmakov
669c4e94d5
Update compare.sh 2023-02-20 17:35:30 +03:00
Azat Khuzhin
5a5f99a27e Add CPU flamegraphs for perf tests 
In Real profiler there is too much noise (polling, cond vars, ...)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-17 06:07:28 +01:00
Alexey Milovidov
e66c05e008
Merge pull request #38750 from azat/revert-no-stress 
Revert "Merge pull request #38212 from azat/no-stress"
 2023-02-16 22:13:17 +03:00
Vladimir C
3f424301cd
Merge pull request #45484 from azat/clickhouse-test-bin-fix 2023-02-16 14:31:11 +01:00
Azat Khuzhin
bddead1ea2 Revert "Merge pull request #38212 from azat/no-stress" 
This reverts commit 24d5be1669, reversing
changes made to a756b4be27.

After #38717 there is no need in --no-stress, since there will be no
such checks for previous releases that fails.

Reverts: #38212
Requires: #38717
 2023-02-15 22:11:35 +01:00
Alexey Milovidov
556d5cbeb3
Merge branch 'master' into clickhouse-test-bin-fix 2023-02-15 17:13:40 +03:00
Sergei Trifonov
b7a4fa8bd9
Merge branch 'master' into round-robin-merge-scheduler 2023-02-14 20:39:02 +01:00
Alexander Tokmakov
3da91637cd
Merge pull request #46406 from ClickHouse/fix_stress_tests_statuses 
Fix stress tests statuses
 2023-02-14 16:25:17 +03:00
Alexander Tokmakov
f6f459c12e fix stress tests statuses 2023-02-14 13:12:53 +01:00
Kseniia Sumarokova
ce83c60337
Update run.sh 2023-02-14 13:11:25 +01:00
Kseniia Sumarokova
6e44105dd6
Update run.sh 2023-02-14 13:10:18 +01:00
Azat Khuzhin
dc5d7809b6 Do not continue perf tests in case of exception in create_query/fill_query 
Previously due to using of threading.Thread, exception had been
ignored, and perf test simply continues, yes it will show some errors,
but it also may show that the test became faster, while it is because
the underlying table was empty.

Replace threading.Thread with a SafeThread (inline implementation) that
simply rethrow exception in join.

Here is an example of such report [1], look at the ip_trie test.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/45654/2101b66570cbb9eb9a492afa8ab82d562c34336b/performance_comparison_[3/4]/report.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-02-13 17:31:15 +01:00
serxa
c17dc8e284 fix 2023-02-11 16:48:47 +00:00
Sergei Trifonov
fbedf4d520
Merge branch 'master' into round-robin-merge-scheduler 2023-02-11 10:30:26 +01:00
Kruglov Pavel
38fbf88ea7
Merge branch 'master' into split-bc-check 2023-02-10 18:28:49 +01:00
Kruglov Pavel
43e660ebd2
Update run.sh 2023-02-10 18:28:19 +01:00
Alexander Tokmakov
9c20e42807
Update run.sh 2023-02-10 14:25:26 +03:00
Alexander Tokmakov
d61c665cd5
Update run.sh 2023-02-10 14:01:48 +03:00
Kruglov Pavel
4067453602
Update run.sh 2023-02-10 11:57:02 +01:00
serxa
f61f95fcec Replace background executor scheduler merges and mutations with round-robin 2023-02-09 18:54:15 +00:00
avogar
53a3cfc9e0 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-02-09 13:24:19 +00:00
Alexander Tokmakov
de1c4f5764 fix disabled by mistake hung check 2023-02-08 22:37:22 +01:00
Robert Schulze
b79ead9c84
Move poco to base/poco/ (#46075) 
* Replicate poco into base/poco/

* De-register poco submodule

* Build poco from ClickHouse

* Exclude poco from stylecheck

* Exclude poco from whitespace check

* Exclude poco from typo check

* Remove x bit from sources/headers (the style check complained)

* Exclude poco from duplicate include check

* Fix fasttest

* Remove contrib/poco-cmake/*

* Simplify poco build descriptions

* Remove poco stuff not used by ClickHouse

* Glob poco sources

* Exclude poco from clang-tidy
 2023-02-08 12:04:11 +01:00
Alexey Milovidov
22bd0b6f69
Merge pull request #38983 from CurtizJ/randomize-mt-settings 
Allow to randomize merge tree settings in tests
 2023-02-04 02:59:52 +01:00
Mikhail f. Shiryaev
cd2e1cfada
Merge pull request #45568 from ClickHouse/keeper-systemd 
Add systemd.service for clickhouse-keeper
 2023-02-03 23:08:02 +01:00
Alexander Tokmakov
352ccfb156
Merge branch 'master' into stress_report_add_context2 2023-02-03 18:44:53 +03:00
Nikita Mikhaylov
33877b5e00
Parallel replicas. Part [2] (#43772) 2023-02-03 14:34:18 +01:00
Mikhail f. Shiryaev
dc00bce9cf
Add tests for packages' installation 2023-02-03 12:16:16 +01:00
Mikhail f. Shiryaev
4c86e9125b
Add necessary dependency for sanitizers 2023-02-02 13:40:04 +01:00
robot-clickhouse
ddbc8ceee8 Automatic style fix 2023-02-02 00:59:49 +00:00
Alexander Tokmakov
03109f942d better context for stress tests failures 2023-02-02 01:02:12 +01:00
Alexander Tokmakov
283057493b
Merge pull request #45869 from ClickHouse/stress_report_add_context 
Add some context to stress test failures
 2023-02-01 16:19:08 +03:00
Alexey Milovidov
bf9f62dcbd
Merge pull request #38456 from sauliusvl/iouring 
Re-introduce io_uring read method
 2023-02-01 06:41:32 +03:00
Alexander Tokmakov
472aa12ba3 add some context to stress test failures 2023-02-01 01:25:31 +01:00
Alexey Milovidov
b18dc419b7
Merge pull request #45691 from ClickHouse/tavplubix-patch-2 
Suppress TOO_MANY_PARTS in BC check
 2023-01-29 04:22:42 +03:00
Saulius Valatka
fb45ed038f add liburing to build 2023-01-28 21:54:44 +02:00
Kruglov Pavel
96700abbe1
Merge pull request #45678 from azat/formats/json-parse-tupels 
Add ability to ignore unknown keys in JSON object for named tuples
 2023-01-27 21:11:05 +01:00
Anton Popov
d8fe2bcbaa
Merge branch 'master' into randomize-mt-settings 2023-01-27 16:03:00 +01:00
Kruglov Pavel
81875fe559
Update run.sh 2023-01-27 14:45:10 +01:00
Alexander Tokmakov
87c1937039
Update run.sh 2023-01-27 15:28:40 +03:00
Azat Khuzhin
d21fa27379 Enable simdjson in fasttest (should be pretty lightweight) 
The library and callers are pretty lightweight, so as tests for
JSONExtact, so this should be OK

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-27 10:01:08 +01:00
avogar
dc0c1c33bb Update 2023-01-26 14:50:59 +00:00
Anton Popov
92fa39798b Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-26 13:29:23 +00:00
Alexander Tokmakov
9b670946db Merge branch 'master' into exception_message_patterns5 2023-01-26 00:41:32 +01:00
avogar
ced2f69a01 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-25 19:47:27 +00:00
Kruglov Pavel
61d836b79d
Update run.sh 2023-01-25 18:59:50 +01:00
Alexander Tokmakov
ae795d87b2 fix 2023-01-25 16:06:40 +01:00
avogar
09951c70c4 Fix 2023-01-24 16:45:07 +00:00
Alexander Tokmakov
bfd2ee1918
Update stress 2023-01-24 14:36:29 +03:00
Anton Popov
08b2e524c7 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-23 15:34:53 +00:00
Azat Khuzhin
9d88f4df27 stress: remove unused --client-cmd 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-01-23 13:47:59 +01:00
Robert Schulze
40ced78a7e
Update report.py 2023-01-22 20:01:55 +01:00
Robert Schulze
de8fc04b03
Performance report: "Partial queries" --> "Backward-incompatible queries 2023-01-22 17:43:27 +00:00
Nikolay Degterinsky
97900e9613
Merge pull request #45479 from evillique/astfuzzer-retries 
Add more retries to AST Fuzzer
 2023-01-22 13:45:38 +01:00
avogar
fd9b735505 Merge with master, add some fixes 2023-01-20 20:22:03 +00:00
avogar
d34c8f8432 Merge branch 'master' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-20 19:28:15 +00:00
Nikolay Degterinsky
c2ac4fece0 Add more retries to AST Fuzzer 2023-01-20 16:46:24 +00:00
Alexander Tokmakov
1413b9537c make error patterns more useful 2023-01-17 20:04:25 +01:00
Alexander Tokmakov
8b13b85ea0
Merge pull request #44543 from ClickHouse/text_log_add_pattern 
Add a column with a message pattern to text_log
 2023-01-17 20:19:32 +03:00
Alexey Milovidov
ec8c38c174 Add review suggestion 2023-01-13 22:53:17 +01:00
Alexey Milovidov
167d980fe2 Fix GitHub 2023-01-13 22:52:05 +01:00
Alexander Tokmakov
2d7773fccc Merge branch 'master' into text_log_add_pattern 2023-01-13 20:33:46 +01:00
Alexey Milovidov
dff5e3eafd
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-13 05:22:18 +03:00
Yakov Olkhovskiy
842a34666c
Merge pull request #44594 from arenadata/ADQM-634 
Add keytab parameter in kerberos section of config.xml
 2023-01-12 15:07:45 -05:00
Ilya Yatsishin
0be3dbad3c
Merge pull request #44883 from ClickHouse/ci-report-type 
Rework CI reports to have a class and clarify the logic
 2023-01-12 18:20:40 +01:00
Anton Popov
ca80240d84 Merge remote-tracking branch 'upstream/master' into HEAD 2023-01-12 12:13:45 +00:00
Ilya Yatsishin
a927ecfe04
Merge pull request #45201 from ClickHouse/qoega-patch-5 2023-01-12 10:08:02 +01:00
Alexey Milovidov
d4c0746647
Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-12 07:17:03 +03:00
Alexey Milovidov
c75c6c2298
Update run-fuzzer.sh 2023-01-12 07:16:10 +03:00
Alexey Milovidov
703f223e50 Remove trash from stress test 2023-01-12 04:56:20 +01:00
Mikhail f. Shiryaev
9219dc1c6e
Make sqlancer lighter by some optimizations 2023-01-11 22:43:10 +01:00
Ilya Yatsishin
ca367a6a64
Add CACHE_INVALIDATOR for sqlancer builds 2023-01-11 22:24:01 +01:00
Alexander Tokmakov
8fa1b070c6 minor cleanup in stress/run.sh 2023-01-10 19:55:06 +01:00
Alexey Milovidov
8d82f1f59e Fix trash 2023-01-10 02:59:55 +01:00
Alexey Milovidov
17445fdd96 Fix Fuzzer script 2023-01-10 02:57:56 +01:00
Alexey Milovidov
62c0385da9 Fix Fuzzer script 2023-01-10 02:55:57 +01:00
Mikhail f. Shiryaev
84861c2b7c
Add TODO to style-check image 2023-01-09 12:10:26 +01:00
Roman Vasin
2995c6d866 Merge branch 'master' of github.com:ClickHouse/ClickHouse into ADQM-634 2023-01-09 08:26:45 +00:00
Alexey Milovidov
0b5bb118d9 Fix bash 2023-01-09 07:01:20 +01:00
Alexey Milovidov
4b2f651f72 Fix bash 2023-01-09 04:34:30 +01:00
Alexey Milovidov
e8d661b511 Merge branch 'master' into break-ci 2023-01-09 04:34:10 +01:00
Alexey Milovidov
f374d3a44e Fix performance test 2023-01-09 01:59:48 +01:00
Alexey Milovidov
03ae644ea3 Fix performance test 2023-01-09 01:58:42 +01:00
Alexey Milovidov
e9d5bd7df3 Fix tar 2023-01-09 01:56:25 +01:00
Alexey Milovidov
93525229a9 Fix trash in Stress test 2023-01-08 23:02:49 +01:00
Alexey Milovidov
06e2fa7ebc
Merge branch 'master' into max_memory_usage_in_stress_test 2023-01-08 10:23:01 +03:00
Alexey Milovidov
3f01910446 Fix error 2023-01-08 07:59:31 +01:00
Alexey Milovidov
51038be3d5 Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
4694dad87c Break CI 2023-01-08 07:59:31 +01:00
Alexey Milovidov
fa1d595059
Merge pull request #44819 from ClickHouse/modern-tools 
Modern tools, part 1
 2023-01-08 09:50:39 +03:00
Alexey Milovidov
b9d6ce02dc Set max memory usage for queries in the stress test 2023-01-08 06:04:56 +01:00
Alexey Milovidov
b9777fb439 Fix OOM in Fuzzer 2023-01-08 05:57:29 +01:00
Alexey Milovidov
9254c62281 Merge branch 'modern-tools' of github.com:ClickHouse/ClickHouse into modern-tools 2023-01-08 03:21:00 +01:00
Alexey Milovidov
e298035d08 Fix performance test 2023-01-08 03:20:42 +01:00
Alexey Milovidov
983bd527dd Merge branch 'master' into modern-tools 2023-01-08 03:19:30 +01:00
Alexey Milovidov
e07dd44f79
Merge pull request #45026 from ClickHouse/fix-fuzzer-3 
Fix false positive in Fuzzer, alternative variant
 2023-01-08 04:59:13 +03:00
Alexey Milovidov
bf57564ec5 Merge branch 'master' into add-dmesg-log-to-fuzzer 2023-01-08 02:26:09 +01:00
Alexey Milovidov
d22f25b72f
Merge pull request #45025 from ClickHouse/fix-fuzzer-2 
Fix false positive in Fuzzer
 2023-01-08 04:24:22 +03:00
Alexey Milovidov
cc32bec83b Fix false positive in Fuzzer, alternative variant 2023-01-08 01:20:11 +01:00
Alexey Milovidov
c308c40eed Fix false positive in Fuzzer 2023-01-08 01:14:46 +01:00
Alexey Milovidov
2065871b87
Merge branch 'master' into no-adduser 2023-01-07 23:24:40 +03:00
Alexey Milovidov
a9324c0517 More ok cases for Fuzzer 2023-01-07 02:23:15 +01:00
Alexey Milovidov
869428f228 Remove adduser dependency 2023-01-07 01:45:54 +01:00
Alexey Milovidov
3211f63911 Add dmesg.log to Fuzzer 2023-01-07 01:18:35 +01:00
Alexey Milovidov
772b6b69a9 Fix strange trash in Fuzzer 2023-01-07 00:40:01 +01:00
Alexey Milovidov
42f25cb6a6
Amend 2023-01-07 00:57:47 +03:00
Alexey Milovidov
22fcabd229
Remove expert-level grep usages. 2023-01-07 00:57:11 +03:00
Alexey Milovidov
36f4d30820 Fix GitHub 2023-01-05 19:28:58 +01:00
Alexey Milovidov
e54d30a812
Merge branch 'master' into modern-tools 2023-01-05 21:24:47 +03:00
Ilya Yatsishin
a28d6fb490
Merge pull request #44848 from qoega/green-ci-2 
Pre-pulling images for integration tests to detect broken infrastructure earlier
 2023-01-05 17:29:39 +01:00
Yatsishin Ilya
932a2f9e09 revert minio changes 2023-01-05 09:12:56 +00:00
Alexey Milovidov
9756d46ad7
Merge branch 'master' into fix-integration-base 2023-01-05 00:02:51 +03:00
Yatsishin Ilya
9cf599e58b Merge remote-tracking branch 'origin/master' into green-ci-2 2023-01-04 15:49:22 +00:00
avogar
a7dbbff426 Merge branch 'split-bc-check' of github.com:ClickHouse/ClickHouse into split-bc-check 2023-01-04 15:06:38 +00:00
avogar
f1ca7e54d5 Make better 2023-01-04 15:06:16 +00:00
Kruglov Pavel
c69fe38f62
Merge branch 'master' into split-bc-check 2023-01-04 15:17:02 +01:00
Alexey Milovidov
52b3fd223d
Merge branch 'master' into perf_log_sync_time 2023-01-04 05:29:27 +03:00
Alexey Milovidov
3a027d285f
Merge pull request #44828 from ClickHouse/remove-two-lines-of-code 
What if I will remove two lines of code?
 2023-01-04 04:50:52 +03:00
Ilya Yatsishin
49155d9614
Merge pull request #44711 from qoega/green-ci-1 
Improve some integration tests and add pytest-random
 2023-01-03 22:39:54 +01:00
avogar
64df6ca520 Split stress test and backward compatibility check 2023-01-03 19:22:31 +00:00
Alexey Milovidov
cb8e7c8059
Merge pull request #44824 from ClickHouse/stress-test-less-oom 
Less OOM in stress test
 2023-01-03 22:12:34 +03:00
Alexey Milovidov
453dac69c7
Merge pull request #44855 from ClickHouse/fuzzer-more-cases-of-oom 
More cases of OOM in Fuzzer
 2023-01-03 22:11:38 +03:00
Mikhail f. Shiryaev
5257ff627b Optimize and fix zookeeper downloading and installation 2023-01-03 19:32:12 +01:00
Alexey Milovidov
803c7e4443 Fix GitHub 2023-01-03 17:47:15 +01:00
Alexey Milovidov
a695629e51
Merge branch 'master' into modern-tools 2023-01-03 19:44:25 +03:00
Pradeep Chhetri
fa234878d6
Cleanup setup_minio.sh (#44858) 2023-01-03 14:29:50 +01:00
Alexey Milovidov
8125f3adc0 More cases of OOM in Fuzzer 2023-01-03 01:17:28 +01:00
Alexey Milovidov
b975b22f8b
Merge branch 'master' into stress-test-less-oom 2023-01-02 22:32:41 +03:00
Alexey Milovidov
ca117d5b94
Merge branch 'master' into remove-two-lines-of-code 2023-01-02 22:15:36 +03:00
Alexey Milovidov
557396db15 Merge with master 2023-01-02 20:09:50 +01:00
Yatsishin Ilya
fb9e363204 remove unnecessary change 2023-01-02 17:06:07 +00:00