Commit Graph

1432 Commits

Author SHA1 Message Date
Alexander Kuzmenkov
268c80520f
Update run-fuzzer.sh 2020-11-03 11:09:14 +03:00
Alexander Kuzmenkov
a25996ed8d Upload perf test results to the CI database 2020-11-03 02:10:19 +03:00
a.palagashvili
8098f86e3e added record for fasttest 2020-11-03 01:05:50 +03:00
Azat Khuzhin
b2e2322895 Add system.errors table
Contains error codes with number of times they have been triggered.

Columns:

-   `name` ([String](../../sql-reference/data-types/string.md)) — name of the error (`errorCodeToName`).
-   `code` ([Int32](../../sql-reference/data-types/int-uint.md)) — code number of the error.
-   `value` ([UInt64](../../sql-reference/data-types/int-uint.md)) - number of times this error has been happened.

**Example**

``` sql
SELECT *
FROM system.errors
WHERE value > 0
ORDER BY code ASC
LIMIT 1

┌─name─────────────┬─code─┬─value─┐
│ CANNOT_OPEN_FILE │   76 │     1 │
└──────────────────┴──────┴───────┘
2020-10-29 10:55:38 +03:00
alesapin
1c9e24b5e2 Merge branch 'master' into system_fetches_table 2020-10-28 10:20:04 +03:00
Alexander Kuzmenkov
ba34145817
Merge pull request #16425 from filimonov/minumum
Fix typos reported by codespell
2020-10-28 08:07:18 +03:00
Vitaliy Zakaznikov
d4e640daae Updating TestFlows to 1.6.59
Updating AES encryption requirements.py to include Specification
Updating AES regression.py to link Specification
Fixing typos in LDAP authentication SRS
2020-10-27 18:50:59 -04:00
alesapin
dca35b1913 Add awesome test for fetch 2020-10-27 15:24:10 +03:00
Mikhail Filimonov
41971e073a
Fix typos reported by codespell 2020-10-27 12:04:03 +01:00
Alexander Kuzmenkov
e27dd538fd performance comparison 2020-10-26 19:35:37 +03:00
Alexander Kuzmenkov
60db7c2aa5 fix a typo in test name 2020-10-26 19:17:54 +03:00
alesapin
6226377ac3
Merge pull request #16261 from ClickHouse/check_flaky_test
Checking flaky stateless tests
2020-10-26 18:07:36 +03:00
alesapin
1be7a182de
Revert "Revert "Optionally upload clickhouse binary in fast test"" 2020-10-26 14:08:37 +03:00
alesapin
7b456e6663 Merge branch 'check_flaky_test' of github.com:ClickHouse/ClickHouse into check_flaky_test 2020-10-26 09:23:52 +03:00
alesapin
265f84fd88 Merge branch 'master' into check_flaky_test 2020-10-26 09:23:21 +03:00
alexey-milovidov
e00f6c4a0d
Merge branch 'master' into total_memory_tracker-by-default 2020-10-24 21:17:53 +03:00
Nikita Mikhaylov
58b4342998
Merge pull request #15874 from nikitamikhaylov/welch-t-test
Student and Welch t-test
2020-10-24 15:13:12 +03:00
alexey-milovidov
1a1a6350aa
Merge pull request #16285 from sundy-li/cmake-roaring
try use cmake version for croaring instead of amalgamation.sh
2020-10-24 11:07:32 +03:00
alexey-milovidov
0748377ab1
Revert "Optionally upload clickhouse binary in fast test" 2020-10-24 07:59:08 +03:00
alexey-milovidov
fe0f6a9e01
Merge pull request #16288 from ClickHouse/upload_binary_in_fasttest
Optionally upload clickhouse binary in fast test
2020-10-24 07:27:32 +03:00
Azat Khuzhin
6e5b04fad8 Make 01540_MemoryTracking integration
01540_MemoryTracking is failing on CI for the following reasons:
- log_queries (fixed, by adding log_queries=0)
- profilers (fixed)
- but what can't be fixed is metric_log and so on, so we need separate
  instance with separate configuration (sigh).
2020-10-24 02:27:29 +03:00
nikitamikhaylov
0064a75916 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-23 23:06:15 +03:00
Azat Khuzhin
3f594ed3ad Add a test for memory drift in user memory tracker (max_memory_usage_for_user) 2020-10-23 22:13:34 +03:00
Azat Khuzhin
6c42ad564c Add a test for MemoryTracking drift
v2: disable query profiling and logging in 01540_MemoryTracking
    (This should make MemoryTracker drift zero).
2020-10-23 21:11:22 +03:00
alesapin
f0ef7dd1e9 Change default to zero 2020-10-23 16:31:45 +03:00
alesapin
a73a908264 Optionally upload clickhouse binary 2020-10-23 16:31:00 +03:00
Alexander Tokmakov
b29cfa7f82 fix test with uuid 2020-10-23 15:32:57 +03:00
sundy-li
f407504a7a try use cmake version for croaring instead of amalgamation.sh 2020-10-23 19:42:21 +08:00
Alexander Kuzmenkov
4476117ac6
Merge pull request #15144 from ClickHouse/aku/numa-perf
Perf test: bind server to one NUMA node
2020-10-23 14:10:35 +03:00
Alexander Kuzmenkov
acc5e3906a
Merge pull request #15476 from ClickHouse/aku/fasttest-debug
fix some tests for split build
2020-10-23 14:05:03 +03:00
alesapin
0abb62107a Exclude some tests from flaky check run 2020-10-23 13:18:06 +03:00
alexey-milovidov
121ebfdc81
Merge pull request #16249 from traceon/access-storage-added-log
Add a log message after an access storage is added
2020-10-23 09:17:10 +03:00
Vitaliy Zakaznikov
e743d2fd26 * Fixing tests in the tests/testflows/ldap/external_user_directory/tests/authentications.py suite
* Moving TestFlows runs to use classic output format for stdout
* Moving to TestFlows 1.6.57
* Updating LDAP test code styling
2020-10-22 19:14:58 -04:00
Alexander Kuzmenkov
b77e776db4 fixes 2020-10-22 20:30:50 +03:00
Alexander Kuzmenkov
0275e9c010 work around docker weirdness 2020-10-22 19:42:31 +03:00
alesapin
d91db2473e Fix bash 2020-10-22 17:33:23 +03:00
Alexander Kuzmenkov
ac7af67ede fixup 2020-10-22 15:52:43 +03:00
alesapin
369365bdb0 Fix run.sh 2020-10-21 23:11:35 +03:00
alesapin
dcf9a8cff0 Remove comment 2020-10-21 19:39:39 +03:00
Alexander Kuzmenkov
8cd560d5ad Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 19:13:56 +03:00
Alexander Kuzmenkov
6293d1dbbe Merge remote-tracking branch 'origin/master' into HEAD 2020-10-21 18:39:59 +03:00
Alexander Kuzmenkov
a678f03229 fixup 2020-10-21 18:21:54 +03:00
Alexander Kuzmenkov
c10dada3d4 try node 1 2020-10-21 18:06:42 +03:00
alesapin
ad655bcfc0 Add stateless flaky check 2020-10-21 17:23:45 +03:00
alesapin
a7f989193a Merge branch 'master' into stateless_test_flaky_check 2020-10-21 17:21:25 +03:00
alexey-milovidov
2b00b5391a
Merge pull request #11844 from Enmk/AES_encrypt_decrypt
encrypt and decrypt functions
2020-10-20 22:57:35 +03:00
Alexander Kuzmenkov
7f7e6e809d debug and -Og again 2020-10-20 20:48:55 +03:00
Alexander Kuzmenkov
abcb3c2ff9
Update report.py 2020-10-20 20:06:51 +03:00
Alexander Kuzmenkov
6b0225ab8c
Update README.md 2020-10-20 19:52:37 +03:00
Alexander Kuzmenkov
4080ad3cba Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 15:32:32 +03:00
Alexander Kuzmenkov
242ec7e56c make some tests faster 2020-10-20 15:12:06 +03:00
Alexander Kuzmenkov
c4acb227e4 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-20 00:44:05 +03:00
nikitamikhaylov
8a39b65fa2 fix build and tests 2020-10-19 19:15:22 +03:00
nikitamikhaylov
7a97329209 Merge branch 'master' of github.com:ClickHouse/ClickHouse into welch-t-test 2020-10-19 18:54:26 +03:00
Nikita Mikhaylov
846492d7a5
Revert "scipy" 2020-10-19 18:41:57 +03:00
Alexander Kuzmenkov
764f19820b max threads 2020-10-19 17:39:52 +03:00
Alexander Kuzmenkov
38a2dd55ce fix numactl parameters 2020-10-19 17:31:02 +03:00
Alexander Kuzmenkov
1829bd09cb Merge remote-tracking branch 'origin/master' into HEAD 2020-10-19 17:27:36 +03:00
Alexander Kuzmenkov
defcd29b31
Merge pull request #16036 from ClickHouse/stress_test_improvemets
Minor improvements of stress test
2020-10-19 16:12:30 +03:00
Alexander Kuzmenkov
0c1f8e6018
Merge pull request #16086 from ClickHouse/aku/integration-warnings
remove warnings in integration tests
2020-10-19 15:58:15 +03:00
Vasily Nemkov
4124538b56 Merge remote-tracking branch 'upstream/master' into AES_encrypt_decrypt 2020-10-18 00:00:13 +03:00
Alexander Kuzmenkov
12bb7a05ba
Merge pull request #16034 from ClickHouse/aku/fasttest-improve
Make the Fast Test easier to run locally
2020-10-16 23:29:04 +03:00
tavplubix
eb483fc72f
Update run.sh 2020-10-16 20:31:05 +03:00
Nikita Mikhaylov
650fe9a9c5
Merge pull request #16093 from nikitamikhaylov/fasttest
scipy
2020-10-16 19:53:34 +03:00
nikitamikhaylov
c65a2d638f done 2020-10-16 19:50:35 +03:00
Alexander Kuzmenkov
7581267c01 remove warnings in integration tests 2020-10-16 18:27:45 +03:00
Alexander Kuzmenkov
2241ea9f33 not sure what's going on... 2020-10-16 17:44:59 +03:00
Alexander Kuzmenkov
0825b8f4c2 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-16 17:41:40 +03:00
tavplubix
149c74b2b8
trigger CI 2020-10-15 23:48:10 +03:00
nikitamikhaylov
a80bbf6e0e fasttest + rm .py 2020-10-15 22:54:17 +03:00
Alexander Tokmakov
95ad45a3b0 minor improvements of stress test 2020-10-15 21:14:04 +03:00
Alexander Kuzmenkov
f46887dcaa improve fasttest usability 2020-10-15 20:29:07 +03:00
alesapin
e6650ed642 Fix options passing to functional tests scripts 2020-10-15 14:56:12 +03:00
tavplubix
04206db7da
Merge pull request #15974 from ClickHouse/merging_14295
Merging #14295
2020-10-14 23:51:42 +03:00
nikitamikhaylov
b1e1553061 style + docker + tests 2020-10-14 22:43:08 +03:00
nikitamikhaylov
2d29eab934 better 2020-10-14 22:00:20 +03:00
Alexander Kuzmenkov
aafec3d777 fixup 2020-10-14 21:53:35 +03:00
nikitamikhaylov
575354a6d3 add scipy to dockerfile 2020-10-14 21:52:23 +03:00
Alexander Kuzmenkov
c6a30e3b3f fixup 2020-10-14 18:53:14 +03:00
Alexander Kuzmenkov
4f14d40489 Fix server logs in fast test 2020-10-14 17:12:04 +03:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata""
This reverts commit c65d1e5c70.
2020-10-14 15:19:29 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
robot-clickhouse
554fa482e6 Auto version update to [20.11.1.1] [54442] 2020-10-10 18:39:58 +03:00
nvartolomei
0e4fd5f24b
Use https protocol for llvm repository in fasttest 2020-10-05 16:27:03 +01:00
alesapin
0b67ee8e54 Trying with clang-9 2020-10-05 14:35:23 +03:00
alesapin
a940298eb4 One more fix 2020-10-05 13:54:36 +03:00
alesapin
0c73b3b99f Fix woboq codebrowser image 2020-10-05 13:20:06 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Alexander Kuzmenkov
9bbc962c83 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 19:19:09 +03:00
Alexander Kuzmenkov
72c3ee74e8
Merge pull request #15479 from ClickHouse/aku/docker-shellcheck
Check docker scripts with shellcheck
2020-10-01 18:27:59 +03:00
Alexander Kuzmenkov
13c325597a Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 13:57:04 +03:00
Alexander Kuzmenkov
74f8e41b55 calculate on all nodes 2020-10-01 13:56:56 +03:00
Alexander Kuzmenkov
d0dff5b738 fixes 2020-10-01 12:27:05 +03:00
Alexander Kuzmenkov
eb3669e82f more fixes 2020-09-30 20:39:38 +03:00
Alexander Kuzmenkov
499e0766e5 Check docker scripts with shellcheck 2020-09-30 20:06:46 +03:00
Alexander Kuzmenkov
c5d1f51f58 just split 2020-09-30 19:14:20 +03:00
Alexander Kuzmenkov
af051ec2d9 fasttest compat with old script 2020-09-30 18:13:53 +03:00
Alexander Kuzmenkov
22a0ec0892 try split debug -Og build in fasttest 2020-09-30 17:55:40 +03:00
Alexander Kuzmenkov
8cfe24ac56 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-30 17:51:52 +03:00
Alexander Kuzmenkov
9194f1d7e5 fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
0516af03ce fasttest fixup 3 2020-09-30 17:51:48 +03:00
Alexander Kuzmenkov
aa543a2d3d quotes 2020-09-30 17:40:24 +03:00
Alexander Kuzmenkov
2523101302
Merge pull request #15230 from ClickHouse/aku/debug-perf
debug perf test run time
2020-09-30 15:05:32 +03:00
Alexander Kuzmenkov
9f63e882c7 fixup 2020-09-30 15:03:52 +03:00
Alexander Kuzmenkov
1617442242 fixup 2020-09-30 14:55:24 +03:00
Alexander Kuzmenkov
824d5b093c bind everything to node 0 2020-09-30 14:32:49 +03:00
Alexander Kuzmenkov
b1abed7d37 Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-30 14:22:20 +03:00
Alexander Kuzmenkov
b204bcd4b4 fasttest fixup 2 2020-09-29 23:11:20 +03:00
Alexander Kuzmenkov
f8047102fe fixup 2020-09-29 22:06:45 +03:00
Alexander Kuzmenkov
6062c55569 fasttest fixup 2020-09-29 21:59:45 +03:00
Alexander Kuzmenkov
e943a22d28 allow fast test to run locally 2020-09-29 21:02:44 +03:00
Alexander Kuzmenkov
dc15bceadc Merge remote-tracking branch 'origin/aku/debug-perf' into HEAD 2020-09-29 16:41:38 +03:00
Alexander Kuzmenkov
ac4f0cdf22 fix 2020-09-29 14:07:31 +03:00
alesapin
a1f4d38019 Add ability to run tests multiple time in stateless image 2020-09-29 12:44:28 +03:00
Alexander Tokmakov
a7d3a024c7 Revert "Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka""
This reverts commit c298c633a7.
2020-09-29 11:56:37 +03:00
Alexander Kuzmenkov
6671b26f20 fixes 2020-09-28 21:43:47 +03:00
Alexander Kuzmenkov
3d1456a55d Merge remote-tracking branch 'origin/master' into HEAD 2020-09-28 21:19:53 +03:00
alesapin
071ff6c9af
Merge pull request #15063 from azat/symbolizers-settings-for-non-server
Set sanitizers options in the current shell too
2020-09-28 17:44:39 +03:00
Alexander Kuzmenkov
c48d212320 performance comparison 2020-09-28 15:09:08 +03:00
Alexander Kuzmenkov
1e7a0f0e5f typo 2020-09-28 14:44:49 +03:00
alesapin
fff9e5d592 Merge branch 'master' into azat-symbolizers-settings-for-non-server 2020-09-28 12:31:05 +03:00
Alexander Tokmakov
b0d99217fb Merge branch 'master' into write_structure_of_table_functions 2020-09-27 14:26:47 +03:00
Alexander Kuzmenkov
425150e783
bind to different nodes 2020-09-25 13:19:37 +03:00
Alexander Kuzmenkov
3ff16325d8 fix the profiler 2020-09-25 12:52:09 +03:00
Alexander Kuzmenkov
40209f9ed2 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-25 11:28:47 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
Alexander Kuzmenkov
4ed4205647
Update run.sh 2020-09-24 19:54:09 +03:00
tavplubix
1c9398c5ee
Merge pull request #15215 from ClickHouse/better_image_for_stateless
Better images for CI tests
2020-09-24 18:54:34 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
Alexander Kuzmenkov
651518566a performance comparison 2020-09-24 16:24:44 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
alesapin
cc305cf886 Fix fuzzer image 2020-09-24 15:34:03 +03:00
Alexander Kuzmenkov
dee34a834f debug perf test run time 2020-09-24 14:46:03 +03:00
Alexander Kuzmenkov
41ad365eaf
Increase fast test threads to 8
Tests don't often fail in parallel (1/10 runs), so we can make them faster.
2020-09-24 14:11:59 +03:00
Alexander Kuzmenkov
26abe8cb30
Update compare.sh 2020-09-24 12:24:30 +03:00
alesapin
4f3eb4532a Add missed changes 2020-09-24 11:37:20 +03:00
alesapin
bb8a2e1617 Better clickhouse-configs 2020-09-24 11:18:36 +03:00
alesapin
a85bb16c66 Remove zookeeper from CI images 2020-09-24 10:33:22 +03:00
Alexander Kuzmenkov
c2b11221a3 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:56:15 +03:00
Alexander Kuzmenkov
21f9cc65c9 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:54:55 +03:00
Alexander Kuzmenkov
179807b0b4 performance comparison 2020-09-23 23:45:39 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov
d96c89972c
Update compare.sh 2020-09-23 12:04:13 +03:00
Alexander Kuzmenkov
bb51aade56
Update docker/test/performance-comparison/compare.sh
Co-authored-by: Azat Khuzhin <a3at.mail@gmail.com>
2020-09-23 12:02:22 +03:00
Alexander Kuzmenkov
833c07f1f7
Update compare.sh 2020-09-23 11:31:18 +03:00
Alexander Kuzmenkov
2b6f4134eb Parallel create/fill in perf test 2020-09-23 11:22:54 +03:00
Alexander Kuzmenkov
5eaa2a08d4
Update report.py 2020-09-23 10:28:28 +03:00
alesapin
01237170af Fix fast test CMakeOptions 2020-09-22 17:25:48 +03:00
Alexander Kuzmenkov
0b01e62050 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 14:29:54 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
Alexander Tokmakov
639466afdb fix docker images 2020-09-22 10:45:08 +03:00
Azat Khuzhin
3fd85430f2 Set sanitizers options in the current shell too
/etc/environment will not be read in current shell, so export variables
from that file manually, to make clickhouse-local/clickhouse-client use
them too.
2020-09-21 23:57:45 +03:00
Alexander Kuzmenkov
4696e22799
Update perf.py 2020-09-21 22:08:41 +03:00
alexey-milovidov
5e56f14d5f
Merge pull request #15027 from ClickHouse/perf-test-separate-profiler
Separate profile runs in performance test
2020-09-21 21:07:14 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
alesapin
084b40affe
Merge pull request #15069 from ClickHouse/fix_test_images
Use llvm-symbolizer-11 in all test images.
2020-09-21 17:02:27 +03:00
Alexander Kuzmenkov
679c5278e4 reword the diagnostic about short queries in perf test 2020-09-21 15:14:47 +03:00
Alexander Kuzmenkov
2f8d7ae208 fix the conditions 2020-09-21 15:01:27 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
alesapin
1bd76c820c Back to 19.10 2020-09-21 12:05:10 +03:00
alesapin
fd469f1266 Remove redundant file 2020-09-21 10:41:23 +03:00
alesapin
27613f8346 Fix symbolizers path in test images 2020-09-21 10:38:11 +03:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
Alexey Milovidov
ef800b5083 Perf test: development 2020-09-19 21:21:29 +03:00
Alexey Milovidov
35e8a895b6 Calculate profiler data in separate query runs 2020-09-19 20:38:21 +03:00
Alexey Milovidov
03aec83aec Remove obsolete code from performance test 2020-09-19 19:27:37 +03:00
Alexander Tokmakov
1ca9a92b21 Merge branch 'master' into write_structure_of_table_functions 2020-09-18 21:09:23 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
Alexander Kuzmenkov
840586bd98
Merge pull request #14386 from ClickHouse/aku/perf-short
[wip] an experiment with short queries in perf test
2020-09-18 17:54:50 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Alexander Kuzmenkov
cfc975d759
Merge pull request #14724 from ClickHouse/aku/perf-some
Run only some queries in perf tests, not all combos
2020-09-18 13:13:28 +03:00
Alexander Kuzmenkov
7f029ee03c
Update perf.py 2020-09-18 11:27:27 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Alexander Kuzmenkov
4fc86f05da some fixes + docs + report queries that are not short 2020-09-17 19:21:59 +03:00
Alexander Kuzmenkov
b1d7df80cd Merge remote-tracking branch 'origin/master' into HEAD 2020-09-17 18:20:14 +03:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
7a6f7a872a forgotten docker changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
Alexander Kuzmenkov
ada1c7c4a0 fixup 2020-09-17 13:15:46 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
Alexander Kuzmenkov
dda88eebd1
test again 2020-09-16 18:35:27 +03:00
Alexander Kuzmenkov
d55e3cd214
Update perf.py 2020-09-16 14:39:44 +03:00
Alexander Kuzmenkov
3b8ca1f262
Update compare.sh 2020-09-16 12:16:07 +03:00
Alexander Kuzmenkov
c5c5faf8ee fixup 2020-09-16 12:06:42 +03:00
Alexander Kuzmenkov
e333a7bad4 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-16 12:05:22 +03:00
alesapin
d144421214 Disable lto for glibc-compatibility 2020-09-16 10:46:38 +03:00
alexey-milovidov
018f596d21
Merge pull request #14685 from ClickHouse/remap-executable
Attempt to make performance test more reliable
2020-09-15 15:09:47 +03:00
Alexander Kuzmenkov
df95f91d7c Merge remote-tracking branch 'origin/master' into HEAD 2020-09-15 13:53:50 +03:00
Alexander Kuzmenkov
24dd33d5cb
Update compare.sh 2020-09-15 13:44:21 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
Alexey Milovidov
b87c108246 Enable remap in performance tests 2020-09-14 21:14:28 +03:00
Alexander Kuzmenkov
ab6bc1ed59
Update compare.sh 2020-09-14 20:25:17 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Alexander Kuzmenkov
b3138605c7 performance comparison 2020-09-14 19:16:59 +03:00
Vasily Nemkov
b980cf354a Moving to TestFlows version 1.6.46 2020-09-14 18:24:57 +03:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
Vitaliy Zakaznikov
bb1d126ce5 Updating TestFlows to 1.6.45 to fix stability issues with multi line commands. 2020-09-10 22:54:40 +03:00
Alexander Kuzmenkov
8689797efc Run only some queries in perf tests, not all combos 2020-09-10 19:57:26 +03:00
Alexander Kuzmenkov
26348ad014 fixup 2020-09-10 18:48:39 +03:00
Alexander Kuzmenkov
ca2a33008b faster 2020-09-10 17:55:54 +03:00
Nikita Mikhaylov
44726c37c3
Merge branch 'master' into fix-executable-dictionary-source-hangup 2020-09-09 23:01:41 +04:00
Alexander Tokmakov
d278d849e4 Merge branch 'master' into write_structure_of_table_functions 2020-09-09 17:12:35 +03:00
Alexander Tokmakov
b68782d285 enable more tests with Atomic database 2020-09-09 16:32:50 +03:00
Anton Popov
032f4ba6f3
Merge pull request #14532 from CurtizJ/fix-redis-test
Rework test for redis dictionary
2020-09-09 02:38:09 +03:00
robot-clickhouse
8def718661 Auto version update to [20.10.1.1] [54440] 2020-09-08 17:04:41 +03:00
alesapin
c40ba48822 Raise on error 2020-09-08 11:49:24 +03:00
alesapin
1a1bccf416 Add sleeps 2020-09-08 11:45:22 +03:00
alesapin
73253f058d Add sleep 2020-09-08 11:45:01 +03:00
alesapin
0193a132d4 Add retries to s3 downloader 2020-09-08 11:43:02 +03:00
Anton Popov
9493532fdb rework test for redis dictionary 2020-09-07 14:16:47 +03:00
Alexander Kuzmenkov
f7d631bf82 use fasttest script from sources 2020-09-07 13:19:01 +03:00
Alexey Milovidov
04a6965006 Fix error with executable dictionary source 2020-09-07 09:40:01 +03:00
Alexander Kuzmenkov
0904433c87 Temporarily remove UInt256 perf test broken in https://github.com/ClickHouse/ClickHouse/pull/14229
Also add one more timeout to perf test runner.
2020-09-07 09:33:57 +03:00
Alexander Kuzmenkov
1978968067 performance comparison 2020-09-07 02:49:34 +03:00
Vitaly Baranov
81db73f066
Merge pull request #13647 from qoega/integration-explicit-configs
Add explicit main_configs, user_configs and dictionaries in integration tests
2020-09-04 20:16:00 +03:00
Alexander Tokmakov
ed5f827708 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 16:38:57 +03:00
alesapin
5d897231e1
Merge pull request #14432 from ClickHouse/minor-changes-in-stateful-tests
Wait for clickhouse-server to start in stateful tests
2020-09-04 13:12:32 +03:00
Alexander Tokmakov
b840d741d0 Merge branch 'master' into write_structure_of_table_functions 2020-09-04 13:00:07 +03:00
Alexander Tokmakov
df09bf3cb6 add suppressions for leak sanitizer 2020-09-03 22:50:26 +03:00
alexey-milovidov
fb56d0b9a3
Update run.sh 2020-09-03 21:21:27 +03:00
Alexander Kuzmenkov
29b97ff259
Merge pull request #14430 from ClickHouse/aku/perf4
[wip] perf experiment no.4 -- geomean
2020-09-03 21:13:07 +03:00
Vasily Nemkov
9ba4613381 Excluding tests from fasttest runs since they depend on external libraries: OpenSSL 2020-09-03 16:12:32 +03:00
Yatsishin Ilya
14b61e87d9 mysql bin log 2020-09-03 13:27:17 +03:00
Yatsishin Ilya
fc075e65da Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-03 11:49:48 +03:00
Alexey Milovidov
cd812d94de Wait for clickhouse-server to start in stateful tests 2020-09-03 04:54:50 +03:00
Alexander Kuzmenkov
a321d6970c adjust report and increase time 2020-09-03 04:42:25 +03:00
Alexander Kuzmenkov
8e8e195e45 geomean 2020-09-03 03:58:40 +03:00
alesapin
12f76d9448
Merge pull request #14325 from azat/suppress-wget-output
Suppress superfluous wget (-nv) output
2020-09-02 14:59:28 +03:00
Yatsishin Ilya
5ab9f249e5 Merge branch 'try-dns-fix' into integration-explicit-configs 2020-09-02 12:53:10 +03:00
Yatsishin Ilya
6902bbce50 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-09-02 12:48:07 +03:00
Yatsishin Ilya
5d39b8ce04 unnecessary change 2020-09-02 11:39:16 +03:00
Alexander Kuzmenkov
00c924b0dd whitespace 2020-09-02 06:31:53 +03:00
Alexander Kuzmenkov
5fcb9bd163 short queries 2020-09-02 06:29:36 +03:00
Alexander Kuzmenkov
e622e108f7 readme 2020-09-02 06:29:16 +03:00
Alexander Kuzmenkov
0db5b4a72c Remove concurrent benchmark from the perf test
It's not stable enough and has only secondary utility.
2020-09-02 02:43:23 +03:00
Alexander Kuzmenkov
f6cfb96748
Merge pull request #14346 from ClickHouse/aku/fuzzer
Don't let the fuzzer change max_execution_time
2020-09-02 01:59:50 +03:00
Anton Popov
7c3712c121
Merge pull request #13688 from it1804/master
Redis dictionary support for simple Redis requirepass authorization
2020-09-02 01:43:02 +03:00
Alexander Kuzmenkov
a6486490a2 performance comparison 2020-09-01 22:05:57 +03:00
Alexander Kuzmenkov
0b70abe542 Don't let the fuzzer change max_execution_time 2020-09-01 18:51:46 +03:00
Alexander Kuzmenkov
2f3bb5844a
Merge branch 'master' into suppress-wget-output 2020-09-01 16:59:04 +03:00
Alexander Kuzmenkov
4620ac4c0d
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:20 +03:00
Alexander Kuzmenkov
4e58f00305
Update docker/test/fuzzer/run-fuzzer.sh 2020-09-01 16:57:13 +03:00
Alexander Kuzmenkov
73d433a7dd
Merge pull request #14316 from ClickHouse/aku/html-fuzzer
Add a HTML report for AST Fuzzer
2020-09-01 16:46:30 +03:00
Azat Khuzhin
2d7cb03120 Suppress superfluous wget (-nv) output
Since for dowloading some of files wget logging may take 50% of overall
log [1].

  [1]: https://clickhouse-builds.s3.yandex.net/14315/c32ff4c98cb3b83a12f945eadd180415b7a3b269/clickhouse_build_check/build_log_761119955_1598923036.txt
2020-09-01 10:25:13 +03:00
Yatsishin Ilya
6cb893f073 Draft. 2020-09-01 09:38:23 +03:00
Alexander Kuzmenkov
33c5815eb3 Add a HTML report for AST Fuzzer 2020-09-01 02:33:42 +03:00
robot-clickhouse
e2fa0eae2f Auto version update to [20.9.1.1] [54439] 2020-08-31 23:07:41 +03:00
Alexander Kuzmenkov
bc8765d5ad
Merge pull request #14095 from azat/DistributedFilesToInsert-fix
Fix DistributedFilesToInsert metric (zeroed when it should not)
2020-08-31 18:58:30 +03:00
Alexander Kuzmenkov
b601dd4596 cosmetic fixes for performance report 2020-08-29 01:46:04 +03:00
Alexander Kuzmenkov
bb28320107 cosmetic fixes in performance report 2020-08-29 01:14:48 +03:00
Azat Khuzhin
a384194216 Add a test for DistributedFilesToInsert 2020-08-27 22:00:35 +03:00
Ilya Yatsishin
7509991d82
Merge pull request #14167 from qoega/docker-test-base
Switch docker tests to use test-base
2020-08-27 16:45:55 +03:00
alexey-milovidov
e1cf919c93
Merge pull request #14112 from vzakaznikov/testflows_increase_compose_http_timeout_and_retry_docker_compose_up
testflows: adding retry logic when bringing up docker-compose cluster
2020-08-27 15:51:16 +03:00
Alexander Tokmakov
65a69ff6ad move docker-compose files 2020-08-27 14:46:19 +03:00
Yatsishin Ilya
bfe4e94806 Switch docker tests to use test-base 2020-08-27 13:17:17 +03:00
Alexey Milovidov
fe5cfe3151 Increase number of threads in stress test 2020-08-26 23:39:02 +03:00
Alexey Milovidov
0bfe78636c Increase number of threads in stress test 2020-08-26 23:38:20 +03:00
alexey-milovidov
f62037e9dc
Update stress 2020-08-26 20:45:36 +03:00
Alexey Milovidov
07596b5323 Limit stress test to one hour 2020-08-26 20:44:03 +03:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
alexey-milovidov
5d31442fa8
Delete perf.py.orig 2020-08-26 03:26:54 +03:00
Konstantin Podshumok
cda4472ebc
dockerfiles: verify 3rd party apt repos, disable LLVM in PVS check
Signed-off-by: Konstantin Podshumok <kpp.live+signed@gmail.com>
2020-08-25 20:16:44 +03:00
alexey-milovidov
ad64cea4aa
Merge pull request #13980 from ClickHouse/fix-stress-test-2
Attempt to fix stress test
2020-08-24 22:03:32 +03:00
Ilya Yatsishin
20bff27eef
Merge pull request #13995 from qoega/stateless-unbundled
Separate stateless unbundled image
2020-08-24 19:49:27 +03:00
Alexander Kuzmenkov
a348bc4641 performance comparison 2020-08-24 17:15:11 +03:00
Yatsishin Ilya
f2182db765 Separate stateless unbundled image 2020-08-24 13:05:56 +03:00
Alexey Milovidov
d44982072c More robust 2020-08-24 03:14:24 +03:00
Alexey Milovidov
1fb4294cdf Attempt to fix stress test 2020-08-24 00:13:21 +03:00
Alexey Milovidov
f4bf99fadc Better output of stress test 2020-08-23 23:48:27 +03:00
Yatsishin Ilya
7dcdde0775 Add docker test base separately to have :latest build available 2020-08-20 20:54:51 +03:00
Alexander Kuzmenkov
5c8013b083
Merge pull request #13892 from ClickHouse/aku/timeout-perf
Avoid timeouts in perf test
2020-08-20 18:14:26 +03:00
Alexander Kuzmenkov
3a0bdfa5f3 Publish list of tests that failed the concurrent fast test 2020-08-20 03:13:44 +03:00
Alexander Kuzmenkov
f43457454e warn on undefined shell variables 2020-08-19 18:34:23 +03:00
Alexander Kuzmenkov
e9ad81b362 shellcheck 2020-08-19 18:31:13 +03:00
Alexander Kuzmenkov
000326b627 Avoid timeouts in perf test 2020-08-19 18:08:23 +03:00
tavplubix
d95470f7c3
Update docker/test/stress/run.sh 2020-08-18 20:52:54 +03:00
Yatsishin Ilya
8fd70835d5 Merge remote-tracking branch 'origin' into integration-explicit-configs 2020-08-18 17:31:41 +03:00
Nikita Mikhaylov
e7f8c0af52 done 2020-08-18 15:28:38 +03:00
Alexander Kuzmenkov
ce0dfe3fea Fix server restart in fasttest
Remove the server data before sequential test run, so that there is no
interference from the failed parallel run.

Also fix some shellcheck warning.
2020-08-18 13:24:37 +03:00
alexey-milovidov
3e6acf1329
Experiment with start/stop in stress test (#13779)
* Experiment with start/stop in stress test

* Support other installation options in "clickhouse start"

* Better diagnostics in install script

* Fixup

* Fixup

* Better diagnostics in stress test

* Update run.sh
2020-08-18 12:43:02 +03:00
Alexey Milovidov
47889b0f2b Install codespell 2020-08-16 14:59:16 +03:00
Ivan A. Torgashov
1006c4f11b Update tests for Redis dictionary requirepass authorization support 2020-08-15 14:18:17 +05:00
Alexey Milovidov
0140093b17 Fix fast test 2020-08-15 10:11:19 +03:00
Alexander Kuzmenkov
ecc40b7c75
Merge pull request #13724 from qoega/docker-style
Add docker image for style check, add check for docker files placement
2020-08-15 03:01:39 +03:00
Alexander Kuzmenkov
1cbfd1327a
trigger the CI 2020-08-15 01:40:40 +03:00
Yatsishin Ilya
ab337b243a Add docker for style check 2020-08-14 16:09:23 +03:00
Alexander Tokmakov
128b19fdba Merge branch 'master' into use_atomic_engine_for_system_db 2020-08-14 13:47:44 +03:00
Yatsishin Ilya
73e9f4d421 update test_materialize_mysql_database test 2020-08-13 21:20:47 +03:00
Alexander Tokmakov
a5d74c44f1 run stress tests with Atomic database 2020-08-13 20:55:12 +03:00
Ilya Yatsishin
e6420c82ca
mysql/postgresql: move Dockerfiles and docker_compose to docker/test (#13448)
* mysql/postgresql: move Dockerfiles and docker_compose to docker/test
* Build client containers in CI
* pass tag to docker_compose
2020-08-12 18:04:36 +03:00
Yatsishin Ilya
730056a9f0 fix 2020-08-12 15:22:31 +03:00
Yatsishin Ilya
f663f794b0 Merge remote-tracking branch 'qoega/integration-explicit-configs' into integration-explicit-configs 2020-08-12 14:58:41 +03:00
Alexander Kuzmenkov
6fdfe65694 performance comparison 2020-08-12 11:55:51 +03:00
Yatsishin Ilya
160776f183 Add explicit main_configs, user_configs and dictionaries in integration tests. 2020-08-12 11:55:04 +03:00
Alexander Kuzmenkov
89b712a180 performance comparison 2020-08-12 08:40:03 +03:00
Yatsishin Ilya
fdd18e540d move reference files 2020-08-12 07:06:23 +03:00
Alexander Kuzmenkov
7547b850d6 performance comparison 2020-08-11 17:14:24 +03:00
Alexander Kuzmenkov
5a97f0c19e performance comparison 2020-08-11 14:53:25 +03:00
Yatsishin Ilya
e3f7fea33a fix 2020-08-11 11:31:26 +03:00
Yatsishin Ilya
1d0e4ca670 pass tag to docker_compose 2020-08-10 16:35:08 +03:00
Yatsishin Ilya
1884cfe110 Merge remote-tracking branch 'origin/master' into docker-mysql-postgres 2020-08-10 11:12:22 +03:00
robot-clickhouse
a82c0f5371 Auto version update to [20.8.1.1] [54438] 2020-08-07 21:45:49 +03:00
Yatsishin Ilya
70fca95a5a mysql/postgresql: move Dockerfiles and docker_compose to docker/test 2020-08-07 11:42:04 +03:00
Alexander Kuzmenkov
11727864dd performance comparison 2020-08-07 04:25:45 +03:00
Alexander Kuzmenkov
dbb65a8bd7 performance comparison 2020-08-06 16:28:51 +03:00
Alexander Kuzmenkov
a92438eff2 performance comparison 2020-08-06 02:33:32 +03:00
Alexander Kuzmenkov
88aa371e0c performance comparison 2020-08-06 02:02:52 +03:00
Alexander Kuzmenkov
d1554e76ec Merge remote-tracking branch 'origin/master' into HEAD 2020-08-06 00:59:25 +03:00
Alexander Kuzmenkov
ff3f378e8a try to rebuild package for 2b7c0167cb 2020-08-06 00:58:56 +03:00
Alexander Kuzmenkov
9cac8a7244 performance comparison 2020-08-05 19:07:37 +03:00
Alexander Kuzmenkov
7945041a9a perf test error summary 2020-08-05 18:56:51 +03:00
alesapin
63391bbb66
Merge pull request #13382 from Enmk/fasttest-fix-query_masking_rules.xml
Keep original query_masking_rules.xml when performing fasttests
2020-08-05 17:47:33 +03:00
alesapin
a18461091f
Merge pull request #13384 from ClickHouse/fix_fast_test_server_kill
Better kill in fast test
2020-08-05 17:42:52 +03:00
alesapin
87c56f9556 Symlink for server logs 2020-08-05 16:15:06 +03:00
alesapin
c862ae93d1 Replace backticks with modern alternative 2020-08-05 16:10:47 +03:00
alesapin
68a9499e92 Simplier kill clickhouse server 2020-08-05 15:59:52 +03:00
alesapin
cdad1e718f Better kill in fast test 2020-08-05 15:37:54 +03:00
Vasily Nemkov
baed365c19 Keep original query_masking_rules.xml when performing fasttests 2020-08-05 15:14:20 +03:00
alexey-milovidov
d94e556455
Merge pull request #13321 from ClickHouse/restart_server_with_timeout
Restart server in stress test with timeout
2020-08-05 00:43:45 +03:00
alexey-milovidov
18ef0c0c96
Update run.sh, thanks @azat 2020-08-04 20:54:09 +03:00
alesapin
bd0322421b Better timeout 2020-08-04 17:28:35 +03:00
alesapin
caf0bcdc86 More timeouts 2020-08-04 11:48:47 +03:00
alesapin
ee5153bbc4 Restart server in stress test with timeout 2020-08-04 11:47:20 +03:00
alesapin
b69e6b935b
Wait with retries in fast test (#13284) 2020-08-03 21:05:35 +03:00
alexey-milovidov
935533e841
Merge pull request #13193 from ClickHouse/aku/spurious-perf
Fix some spurious perf test failures
2020-08-03 01:02:53 +03:00
Azat Khuzhin
8cbcd4027a Exclude 01413_rows_events from the fasttest (TRUNCATE query_log) 2020-08-02 13:30:00 +03:00
Azat Khuzhin
37c3f44dbe fasttest: use arrays for skip list (to make it more patch friendly)
Plus it looks better.
2020-08-02 13:29:31 +03:00
Vitaly Baranov
18b21511a9
Merge pull request #13013 from vitlibar/implement-custom-settings
Implement custom settings
2020-08-02 05:01:14 +03:00
Alexander Kuzmenkov
dd475fe82c
Update report.py 2020-08-01 13:10:36 +03:00
Alexander Kuzmenkov
a317f995be performance comparison 2020-07-31 22:58:38 +03:00
Vitaly Baranov
0fcee34322 Add test. 2020-07-31 20:57:49 +03:00
Alexander Kuzmenkov
1d954581eb Fix some spurious perf test failures 2020-07-31 19:28:04 +03:00
Alexander Kuzmenkov
6f861294f4 query fuzzer 2020-07-31 18:57:01 +03:00
Ilya Yatsishin
1566c8a92b
Merge pull request #12285 from qoega/rework-integrational
Rework integrational configuration paths
2020-07-31 15:34:21 +03:00
Alexander Kuzmenkov
e2e4fc9848 align numbers to the right in perf report 2020-07-31 13:59:15 +03:00
Alexander Kuzmenkov
42e5f8ec44
Update compare.sh 2020-07-31 03:49:36 +03:00
Alexander Kuzmenkov
db15108005 add times speedup/slowdown to changed tests table 2020-07-31 01:14:20 +03:00
Alexander Kuzmenkov
0e70e21b58
Update run-fuzzer.sh 2020-07-30 22:04:15 +03:00
Alexander Kuzmenkov
3d13da1c24 query fuzzer 2020-07-30 20:07:10 +03:00
Alexander Kuzmenkov
96125111fe
Merge pull request #13085 from ClickHouse/aku/fuzzer-error-code
Fix the AST fuzzer error message
2020-07-30 19:53:21 +03:00
Alexander Kuzmenkov
0e20507539
Update compare.sh 2020-07-30 17:26:47 +03:00
Alexander Kuzmenkov
f0fda359de pipefail 2020-07-30 16:43:22 +03:00
Alexander Kuzmenkov
b2b94ba13d
Update run-fuzzer.sh 2020-07-30 16:35:24 +03:00
Alexander Kuzmenkov
65771ad516 Fix the AST fuzzer error message 2020-07-29 20:05:38 +03:00
alesapin
5c1aa52f40 Better check for failed tests 2020-07-29 14:39:08 +03:00
alesapin
26ff008898 Remove test 2020-07-29 14:34:42 +03:00
alesapin
3a0d44b5b9 Merge branch 'master' into rerun_failed_in_fast_test 2020-07-29 12:54:18 +03:00
Yatsishin Ilya
58b6621dd3 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-29 10:24:26 +03:00
Alexander Kuzmenkov
e0c207d6b4
Update entrypoint.sh 2020-07-28 16:15:41 +03:00
Yatsishin Ilya
b5722493f5 less changes 2020-07-28 16:11:29 +03:00
Yatsishin Ilya
7ca2a54e74 fix 2020-07-28 16:08:08 +03:00
Yatsishin Ilya
99ff6cae27 Merge remote-tracking branch 'origin/master' into rework-integrational 2020-07-28 14:35:51 +03:00
alesapin
d39318c8fe Grep in correct file 2020-07-28 14:23:49 +03:00
alesapin
3eb77ab076 Better kill 2020-07-28 14:22:25 +03:00
alesapin
a75657d88e Better 2020-07-28 14:18:08 +03:00
alesapin
8ff9e6c9de Rerun tests in fast test 2020-07-28 14:16:06 +03:00
alesapin
ff358be3d6
Merge pull request #12739 from ClickHouse/qoega-patch-1
Fix MySQL broken link
2020-07-27 19:51:01 +03:00
Alexander Kuzmenkov
b6f2fde37e performance comparison 2020-07-27 14:20:45 +03:00
Ilya Yatsishin
0517449e28
Update docker/test/integration/base/Dockerfile 2020-07-27 13:01:26 +03:00
alexey-milovidov
49beef860d
Merge pull request #12733 from ClickHouse/aku/perf-version
Choose proper old version for perf comparison
2020-07-24 15:24:00 +03:00
Alexander Kuzmenkov
9475b27936
Update run-fuzzer.sh 2020-07-24 00:07:23 +03:00
Ilya Yatsishin
c2e0954f26
Fix MySQL broken link 2020-07-23 22:33:55 +03:00
Alexander Kuzmenkov
acf1e5fe7e Choose proper old version for perf comparison 2020-07-23 18:17:11 +03:00
Alexander Kuzmenkov
15cd448afa
Update compare.sh 2020-07-23 17:59:32 +03:00
Alexander Kuzmenkov
186b2c3b1b Support different query log format in perf test 2020-07-23 16:32:03 +03:00
Alexander Kuzmenkov
2b7c0167cb
Update compare.sh 2020-07-22 21:02:56 +03:00
Alexander Kuzmenkov
c25348ded9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-22 16:19:20 +03:00
Alexander Kuzmenkov
72167aa746
Update Dockerfile 2020-07-22 16:18:57 +03:00
alesapin
26a6f7993d
Merge pull request #12637 from qoega/helper_container
Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI
2020-07-22 11:50:51 +03:00
Alexander Kuzmenkov
9f49bf2d82 fixup 2020-07-22 01:09:54 +03:00
Alexander Kuzmenkov
9956285091
Update run-fuzzer.sh 2020-07-22 01:02:05 +03:00
Yatsishin Ilya
9633215684 Do not build helper_container image inside integrational tests. Part 1: build helper_container in CI 2020-07-21 17:40:48 +03:00
Alexander Kuzmenkov
b26de8d2d1 Query fuzzer 2020-07-21 16:53:50 +03:00
Alexander Kuzmenkov
3d89f0e9df Perf test: bind server to one NUMA node 2020-07-21 15:41:14 +03:00
alesapin
e7a4bc8dae Even less tests in fasttest 2020-07-20 19:55:36 +03:00
alesapin
619f5f6180 Less tests in fast test 2020-07-20 19:44:48 +03:00
Alexander Kuzmenkov
abec684daf query fuzzer 2020-07-20 14:57:16 +03:00
Alexander Kuzmenkov
37b3cef4cb
Update run-fuzzer.sh 2020-07-17 21:41:33 +03:00
Alexander Kuzmenkov
039cf36acb Minor fixes for query fuzzer 2020-07-16 21:05:34 +03:00
alesapin
a4666df090 Even less tests in fasttest 2020-07-16 14:16:08 +03:00
alesapin
f7ffd2da36 Remove memory limiting tests 2020-07-16 14:12:47 +03:00
Vitaly Baranov
000b197ad1
Merge pull request #11234 from traceon/ldap-per-user-authentication
Add LDAP authentication support
2020-07-16 13:17:21 +03:00
alesapin
f7792d0145
Merge pull request #12294 from ClickHouse/fasttest
Add image for fast tests run (with clone, build, etc.)
2020-07-16 11:21:53 +03:00
alesapin
c86b2a407f
Merge pull request #12526 from Enmk/test_config_fix
Retain existing config.d/query_masking_rules.xml from server package
2020-07-16 11:16:56 +03:00
Denis Glazachev
59cb758cf7 Merge branch 'master' into ldap-per-user-authentication 2020-07-16 02:29:24 +04:00
Vitaliy Zakaznikov
0ef9fc9022 Moving to TestFlows version 1.6.39 2020-07-15 22:13:43 +02:00
alesapin
e35c49faa2 Merge branch 'master' into fasttest 2020-07-15 22:35:46 +03:00
alesapin
d6da417e71 Disable live view tests 2020-07-15 22:34:44 +03:00
alexey-milovidov
e7cf3f4e70
Merge pull request #12464 from ianton-ru/s3_profile_events
add profiling events from S3 request to system.events and system.quer…
2020-07-15 19:33:15 +03:00
alesapin
74181a30ae One more test to skip 2020-07-15 17:56:21 +03:00
alesapin
4892706d95 Simplify build configuration 2020-07-15 17:40:51 +03:00
alesapin
54255c10e1
Merge pull request #12496 from ClickHouse/restart_server_after_stress
Check server able to restart after stress
2020-07-15 17:23:27 +03:00
Alexander Kuzmenkov
00acf4173c Fixes for perf test after #12469 2020-07-15 16:38:02 +03:00
Vasily Nemkov
78f69bbfc4 Retain existing config.d/query_masking_rules.xml that come from server package 2020-07-15 16:11:43 +03:00
alesapin
3ab7bdbbbb One more test to skip 2020-07-15 15:16:59 +03:00
alesapin
ba05bb1b39 Better tests for parallel run 2020-07-15 14:47:51 +03:00
Anton Ivashkin
4c8498c115 Merge master 2020-07-15 14:16:10 +03:00
alesapin
530ad951bc Less tests 2020-07-15 12:29:31 +03:00
alesapin
a061418dab Remove redundant cmd 2020-07-15 12:23:50 +03:00
alesapin
ecea1e0292 Run tests in parallel 2020-07-15 11:49:50 +03:00
alesapin
00d2219808 Merge branch 'master' into fasttest 2020-07-15 11:35:15 +03:00
alesapin
43ba417132 Better submodules update 2020-07-15 11:34:38 +03:00
alesapin
a31109f023 Better submdoules 2020-07-14 21:44:57 +03:00
alesapin
c483de8a35 Check result in separate file 2020-07-14 18:00:24 +03:00
alesapin
c400048a48 Check server able to restart in stateless tests 2020-07-14 17:47:23 +03:00
Alexander Kuzmenkov
57ad000c62
Update README.md 2020-07-14 16:46:19 +03:00
Anton Ivashkin
52fea6a5a3 Merge master 2020-07-14 15:56:38 +03:00
alesapin
0740b88d6b Merge branch 'master' into fasttest 2020-07-14 15:19:05 +03:00
alesapin
86a6a5e2c6 Less tests to run 2020-07-14 15:17:35 +03:00
robot-clickhouse
0f23642a3d Auto version update to [20.7.1.1] [54437] 2020-07-13 18:26:03 +03:00
Alexander Kuzmenkov
d9ac91b34d query fuzzer 2020-07-13 18:16:54 +03:00
Alexander Kuzmenkov
028abb9dc4 query fuzzer 2020-07-13 16:58:48 +03:00
Alexander Kuzmenkov
5a15e03400 Improve data layout in perf test
Also fix a bad test query found with new data.
2020-07-13 14:31:15 +03:00
Alexander Kuzmenkov
c13425f0e9 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-13 14:29:10 +03:00
Anton Ivashkin
26fca949bd add profiling events from S3 request to system.events and system.query_log 2020-07-13 11:27:11 +03:00
alexey-milovidov
26d32f2ce5
Merge pull request #12412 from Jokser/s3-https
S3 HTTPS integration tests
2020-07-12 03:36:37 +03:00
Pavel Kovalenko
5a42dca252 Trigger integration-test-runner image rebuild. 2020-07-11 12:16:10 +03:00
Pavel Kovalenko
d4826a3df7 Replace build with proper images in docker_compose_minio.yml 2020-07-10 23:38:48 +03:00
Pavel Kovalenko
f43428a4d5 S3 HTTPS integration test. 2020-07-10 22:42:18 +03:00
alesapin
d69f925c30 Fix build 2020-07-10 22:28:21 +03:00
alesapin
d2fcbe1f4e Fix build 2020-07-10 22:27:12 +03:00
alesapin
69d6ad0a62 Disable bunch of tests 2020-07-10 22:12:25 +03:00
alesapin
a9824fd650 Better cmake and less libraries 2020-07-10 22:08:18 +03:00
alesapin
df176c633e Disable msgpack 2020-07-10 21:27:10 +03:00
alesapin
b70c3b607f No long tests 2020-07-10 20:44:29 +03:00
alesapin
0b1a1867a6 Less dependencies 2020-07-10 20:21:24 +03:00
alesapin
57d03bfbc0 Disable secure ports 2020-07-10 18:47:20 +03:00
Alexander Kuzmenkov
cd09cf8c0b Merge remote-tracking branch 'origin/master' into HEAD 2020-07-10 17:18:24 +03:00
Alexander Kuzmenkov
eb6fbdfd4b query fuzzer 2020-07-10 17:16:16 +03:00
alesapin
ce96262a2c
Update run.sh 2020-07-10 16:21:58 +03:00
Alexander Kuzmenkov
0fe4c37033 query fuzzer 2020-07-10 14:11:49 +03:00
alesapin
4ab5edadb7 Less libraries 2020-07-10 12:47:50 +03:00
Alexander Kuzmenkov
7af916e44a fuzzer docker image 2020-07-09 21:30:22 +03:00
Alexander Kuzmenkov
bbcdf12e4f fuzzer container fix 2020-07-09 20:19:36 +03:00
alesapin
51aaa8800d Don't skip libs 2020-07-09 18:34:19 +03:00
Alexander Kuzmenkov
e06b675801 fixes in fuzzer docker image 2020-07-09 14:55:54 +03:00
Alexander Kuzmenkov
761b03f17d add docker image for fuzzer 2020-07-09 14:21:55 +03:00
Alexander Kuzmenkov
394cf20673 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-09 13:46:54 +03:00
alesapin
960a730c7a Merge branch 'master' into fasttest 2020-07-09 13:14:09 +03:00
alexey-milovidov
1536e89abe
Merge pull request #12287 from ClickHouse/fix_skip_list_option_old_branches
Fix skip lists for old branches
2020-07-09 04:25:35 +03:00
alesapin
e0ff6bd6d7 Less libraries to build 2020-07-08 19:59:47 +03:00
alesapin
6378c79539 Fix script 2020-07-08 19:02:19 +03:00
alesapin
f30e2ea464 Tmp version 2020-07-08 18:25:02 +03:00
alesapin
80d9816e00 Add brotli 2020-07-08 17:22:17 +03:00
alesapin
6e79e88149 Add curl 2020-07-08 16:49:09 +03:00
alesapin
069880a003 Prototype 2020-07-08 16:06:35 +03:00
alesapin
c0dea3ab1c Ignore testflows exit code 2020-07-08 15:52:54 +03:00
Alexander Kuzmenkov
cec35a0e1d
Update README.md 2020-07-08 15:07:01 +03:00
Alexander Kuzmenkov
c9162f6e77
Update README.md 2020-07-08 15:05:49 +03:00
Alexander Kuzmenkov
344e2713fa
Update README.md 2020-07-08 14:52:06 +03:00
Alexander Kuzmenkov
bd14d06476
Update README.md 2020-07-08 14:25:43 +03:00
Alexander Kuzmenkov
41addf9173 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-08 13:22:06 +03:00
alesapin
dc8051f737 Fixes 2020-07-08 12:47:14 +03:00
alesapin
9ea3bdd054 Fix skip lists for old branches 2020-07-08 11:41:39 +03:00
Yatsishin Ilya
79e4c6ff83 Merge remote-tracking branch 'origin' into rework-integrational 2020-07-08 10:36:38 +03:00
alesapin
f54351635a
Merge pull request #12090 from vzakaznikov/adding-tests-in-testflows
Adding a simple example of using TestFlows.
2020-07-07 22:58:11 +03:00
Alexander Kuzmenkov
f514d0da77
Revert "Run perf tests with memory sampling (for allocations >1M)" 2020-07-07 19:59:42 +03:00
alesapin
042a3aa8d1
Merge pull request #12168 from qoega/compose-inside-docker
Place common docker compose files to integration docker container
2020-07-07 18:43:27 +03:00
alesapin
e89ccfd5bf No color 2020-07-07 16:11:19 +03:00
alesapin
f5a7d8a5c7 Add runner for testflows 2020-07-07 15:35:06 +03:00
Alexander Kuzmenkov
a3826e5443
Merge pull request #12142 from azat/perf-memory-sampling
Run perf tests with memory sampling (for allocations >1M)
2020-07-07 01:35:33 +03:00
Yatsishin Ilya
0c7a261bc6 Place common docker compose files to integration docker container 2020-07-06 16:45:54 +03:00
Yatsishin Ilya
d23f0008ee Merge branch 'master', remote-tracking branch 'origin' into rework-integrational 2020-07-06 14:51:15 +03:00
Alexander Kuzmenkov
432cadae15 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-06 11:44:09 +03:00
alexey-milovidov
1719ab1ec5
Merge pull request #12041 from azat/curl-proper-cmake
Rewrite curl dependency in a more ch compatible way
2020-07-06 06:31:51 +03:00
Azat Khuzhin
307c3c92a5 Run perf tests with memory sampling (for allocations >1M)
This is to know the memory allocation size distribution, that can be
obtained later from left-metric-log.tsv.

This is an attempt to tune tcmalloc (new CPP version by google) to use
lock-free part of the allocator for typical allocations (and it is a bad
idea just to increase kMaxSize there, since number of allocation for
each size class is also important).

P.S. hope that this file will be applied, if no, then the same effect
can be reached by tunning defaults in Settings.h

Refs: #11590
Cc: @akuzm
2020-07-05 12:43:12 +03:00
alesapin
a2b6d58053
Merge pull request #11069 from kssenii/add-storage-rabbitmq-read-only
Add storage RabbitMQ
2020-07-04 10:38:50 +03:00
Yatsishin Ilya
3790c8ccd9 wip 2020-07-03 18:43:48 +03:00
alesapin
5098df8d0b Make skip-list optional 2020-07-03 14:15:30 +03:00
Alexander Kuzmenkov
10b6f98ca6 fixup 2020-07-03 11:39:43 +03:00
Alexander Kuzmenkov
7d8a31aff3 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-03 10:09:20 +03:00
Azat Khuzhin
0700a705bc Rewrite curl dependency in a more ch compatible way
- add support of unbundled curl
- add CURL::libcurl libraries
- avoid explicit linkage of daemon with curl (added with sentry)
- set CACHE variables for non-direct users:
  - mariadb-connector-c
  - aws-s3-cmake
  - sentry-native

Cc: @alexey-milovidov
Cc: @alesapin (requires docker image update)
Cc: @abyss7

Refs: #11300
Refs: #8011
Refs: #8905

v2: replace cmake/find/curl.cmake with proper contrib/curl-cmake (as
pointed by @abyss7, cmake/find/*.cmake is deprecated)
2020-07-03 00:57:08 +03:00
Alexander Kuzmenkov
9e02a0d879
Merge pull request #11991 from ClickHouse/aku/perf-partial
perf test: report queries with new functions separately
2020-07-02 17:12:46 +03:00
alesapin
64583ceb22 Merge branch 'master' into add-storage-rabbitmq-read-only 2020-07-02 16:08:29 +03:00
alesapin
1fb90f3811
Merge pull request #12052 from ClickHouse/test_image_changes
Test image changes
2020-07-02 15:01:06 +03:00
alesapin
4c3ae82273 Better PVS image 2020-07-02 12:02:15 +03:00
Alexander Kuzmenkov
f50f8d936e Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:19:26 +03:00
Alexander Kuzmenkov
41088c3416 Merge remote-tracking branch 'origin/master' into HEAD 2020-07-02 10:13:11 +03:00
Alexander Kuzmenkov
99514a7e24 fixup 2020-07-02 10:13:02 +03:00
alesapin
f0b012c94b Remove garbage from images 2020-07-01 23:07:11 +03:00
Alexander Kuzmenkov
baec4093dd
Merge pull request #11993 from ClickHouse/aku/more-jemalloc-tweaks
jemalloc: set muzzy_decay_ms = 10s
2020-06-30 22:51:21 +03:00
alesapin
41142c5e95 Test image changes 2020-06-30 13:34:20 +03:00
Alexander Kuzmenkov
7e2f6937e0 fixup 2020-06-30 12:45:19 +03:00
Alexander Kuzmenkov
b5f9e9de78 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 12:28:14 +03:00
Alexander Kuzmenkov
a4152cfb00 Merge remote-tracking branch 'origin/master' into HEAD 2020-06-30 08:55:56 +03:00
Alexander Kuzmenkov
588ff8fcc1
Merge pull request #11989 from ClickHouse/aku/long-perf
Try to enable long perf tests
2020-06-30 08:52:29 +03:00
Alexander Kuzmenkov
6d67c77e68 fixup 2020-06-29 17:09:51 +03:00
Alexander Kuzmenkov
1b49feae6b Fixup 2020-06-29 11:29:40 +03:00
alesapin
fb891ee4eb
Revert "[experiment] maybe fix warnings in integration tests" 2020-06-28 16:20:57 +03:00
Alexander Kuzmenkov
960c455e0e performance comparison 2020-06-27 04:15:58 +03:00
Alexander Kuzmenkov
8b82ff215f muzzy decay 10 ms 2020-06-27 04:08:21 +03:00