Commit Graph

1883 Commits

Author SHA1 Message Date
Alexander Tokmakov
422e083c96 move more code 2021-02-26 14:43:58 +03:00
alesapin
56d9d99d1c Fix style and bayan 2021-02-26 09:59:40 +03:00
Alexander Tokmakov
d46fee0f04 Merge branch 'master' into stress_test_results 2021-02-26 00:24:22 +03:00
alesapin
84102a22e7 Trying to make testkeeper better in single server mode 2021-02-25 23:30:55 +03:00
Alexander Tokmakov
fbbb0c4b69 fix 2021-02-25 19:11:43 +03:00
Alexander Tokmakov
3632c1d879 add flacky check runner 2021-02-24 19:41:44 +03:00
alesapin
5b888e1193 Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-22 23:52:26 +03:00
tavplubix
72b67c07c4
trigger CI 2021-02-22 17:43:06 +03:00
Alexander Tokmakov
487b162343 fix 2021-02-22 16:53:43 +03:00
Azat Khuzhin
91c4ebaf0b Merge remote-tracking branch 'upstream/master' into yamllint 2021-02-22 08:52:54 +03:00
alexey-milovidov
e1c4ba0169
Merge pull request #21016 from azat/integration-test_materialize_mysql_database
Preserve mysql logs in test_materialize_mysql_database
2021-02-21 22:28:19 +03:00
Azat Khuzhin
9a26409147 Fix performance tests (by avoid sharding status file for right and left server)
Since cp -al (hard links):

    2021.02.21 01:09:09.991771 [ 243 ] {} <Information> StatusFile: Status file right/db/status already exists - unclean restart. Contents:
    PID: 241
    Started at: 2021-02-21 01:09:09
    Revision: 54448

    2021.02.21 01:09:09.992007 [ 243 ] {} <Error> Application: DB::Exception: Cannot lock file right/db/status. Another server instance in same directory is already running.
2021-02-21 10:56:48 +03:00
Azat Khuzhin
e922690453 Fix yamllint issues 2021-02-20 23:25:21 +03:00
Alexander Tokmakov
eaed15b5e1 process result of func and unit tests 2021-02-20 23:04:24 +03:00
Azat Khuzhin
e1bc8bb587 Wrap lines in Dockerfile for style image 2021-02-20 22:20:52 +03:00
Azat Khuzhin
d909adc8b9 Add yamllint into style docker image 2021-02-20 22:20:52 +03:00
Azat Khuzhin
4784d09d17 tests/integration: increase verbosity for test_materialize_mysql_database 2021-02-20 22:09:01 +03:00
Azat Khuzhin
6873ad1983 tests/integration: fix yamllint issues in docker-compose.yaml for mysql 2021-02-20 22:09:01 +03:00
tavplubix
a697b578bc
Merge pull request #16193 from ClickHouse/database_replicated
DatabaseReplicated: continuation of #10485
2021-02-20 19:39:34 +03:00
Alexander Tokmakov
6d9990f378 Merge branch 'stress_test_results' of https://github.com/ClickHouse/ClickHouse into stress_test_results 2021-02-20 19:28:36 +03:00
Alexander Tokmakov
694d89ad81 fix 2021-02-20 19:27:04 +03:00
Alexander Tokmakov
b62a29728f Merge branch 'master' into stress_test_results 2021-02-20 16:22:43 +03:00
Alexander Tokmakov
863c099254 fix 2021-02-20 15:57:07 +03:00
alesapin
c61769311e Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-20 10:22:22 +03:00
alesapin
a860e3e758
Merge pull request #20864 from azat/fasttest-backtrace-on-failure
Improve backtrace catching on server failures in CI for fast-tests
2021-02-20 10:20:56 +03:00
tavplubix
f5fc082ed0
Update run.sh 2021-02-19 22:39:42 +03:00
tavplubix
3509fe88d8
Merge pull request #20878 from ClickHouse/fix_18926
Fix COM_FIELD_LIST response in MySQL protocol
2021-02-19 19:25:54 +03:00
Alexander Tokmakov
033f55f498 fix 2021-02-19 17:38:20 +03:00
alexey-milovidov
ceacae4ee4
Merge pull request #20462 from azat/stress-backtrace-on-failure
Improve backtrace catching on server failures in CI for stress tests
2021-02-19 17:33:29 +03:00
alesapin
068c9cfbf7 Fix logs level 2021-02-19 17:13:29 +03:00
alesapin
ea27c3ca32 Add gdb to fasttest image 2021-02-19 16:41:46 +03:00
kssenii
1c5b10de41 Use fixed version for aerospike 2021-02-19 10:42:25 +00:00
Alexander Tokmakov
4493c39bf7 fix 2021-02-19 12:57:09 +03:00
Alexander Tokmakov
afed8a8192 process stress test results 2021-02-19 01:08:44 +03:00
Alexander Tokmakov
8097532cb7 Merge branch 'master' into database_replicated 2021-02-18 17:42:06 +03:00
Alexander Tokmakov
1bad1e3a7c fix dockerfile 2021-02-18 17:37:51 +03:00
Alexander Tokmakov
97f4c457ec fix MySQL COMM_FIELD_LIST response 2021-02-18 16:27:51 +03:00
alesapin
1245710aed Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-18 15:27:01 +03:00
zlx19950903
c92e613b82
Add a function htmlOrXmlCoarseParse to extract content from html or xml format string. (#19600)
* add html and xml coarse parse

* add test file

* add conditional check: hyperscan

* fix style error

* add conditional check

* bug fix

* delete unit

* typos check fix

* add unit test

* style check fix

* fix build error: case style

* acradis_skip test fix

* LINT error fix

* Remove comments

Co-authored-by: guojiantao <guojiantao15@mails.ucas.ac.cn>
Co-authored-by: Ivan <5627721+abyss7@users.noreply.github.com>
Co-authored-by: Ivan Lezhankin <ilezhankin@yandex-team.ru>
2021-02-18 15:05:55 +03:00
alesapin
abe5d9df1e
Merge pull request #20627 from ClickHouse/fix_fast_test_retry
Fix fasttest retry for failed tests
2021-02-18 11:41:21 +03:00
Vitaly Baranov
3cbb325913
Merge pull request #20506 from vitlibar/refactor-protobuf-format-io
Improved serialization in Protobuf format.
2021-02-18 11:31:37 +03:00
Azat Khuzhin
ee18f6a7ec test/fasttest: collect diagnosis by attaching with gdb in background
Otherwise sometimes stacktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/20477/8ad20fcee5aaa642c2a2dd873d02103692d554f4/fast_test.html#fail1
2021-02-18 00:14:00 +03:00
Azat Khuzhin
65f2b6a044 test/fasttest: add gdb into docker image 2021-02-18 00:14:00 +03:00
Azat Khuzhin
770c3406df test/stress: fix permissions for clickhouse directories 2021-02-18 00:13:03 +03:00
Azat Khuzhin
63eff6e8c8 test/stress: improve backtrace catching on server failures
Otherwise sometimes stracktraces may be lost [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/19580/6aecb62416ece880cbb8ee3a803e14d841388dde/stress_test_(thread).html#fail1
2021-02-18 00:13:03 +03:00
Azat Khuzhin
f483cd091a test/stress: use clickhouse builtin start/stop to run server from the same user
This will allow to attach with gdb for better diagnosis.
2021-02-18 00:13:03 +03:00
Vitaly Baranov
18e036d19b Improved serialization for data types combined of Arrays and Tuples.
Improved matching enum data types to protobuf enum type.
Fixed serialization of the Map data type.
Omitted values are now set by default.
2021-02-17 20:50:09 +03:00
alesapin
bb4ced05f9 Fix fast test 2021-02-17 17:52:32 +03:00
alesapin
e0980fd0b7 Fix fasttest retry for failed tests 2021-02-17 17:41:21 +03:00
tavplubix
dd02106a08
Update run.sh 2021-02-17 12:01:41 +03:00
Alexander Tokmakov
1aac7b3471 Merge branch 'master' into database_replicated 2021-02-17 00:39:56 +03:00
Alexander Tokmakov
6c9771484b add hung check to stress test 2021-02-16 22:39:25 +03:00
Nikolai Kochetov
a475ac9be8
Merge pull request #20139 from sonirico/master
Add 'access_management' configuration to initial setup
2021-02-16 13:21:13 +03:00
Alexander Tokmakov
bf6f64a3fb Merge branch 'master' into database_replicated 2021-02-16 01:28:19 +03:00
Alexander Tokmakov
9c7cf9e92e remove some debug code 2021-02-15 13:26:34 +03:00
alesapin
f80137626a
Merge pull request #19580 from ClickHouse/in_memory_raft
In memory coordination inside ClickHouse
2021-02-13 10:19:23 +03:00
alesapin
5f32f65211 Merge branch 'master' into in_memory_raft 2021-02-11 23:09:29 +03:00
filimonov
47c8537f63
Add libnss_files to alpine image
It seems it's needed to make some of DNS-related features work
properly in certain scenarios (things like getting proper FQDN, reverse DNS lookup).
2021-02-11 12:56:26 +01:00
Alexander Kuzmenkov
308fbd2ba5
Update run-fuzzer.sh 2021-02-11 10:45:51 +03:00
Alexander Kuzmenkov
2571dac984
Merge pull request #20111 from ClickHouse/aku/window-prototype
RANGE OFFSET window frame
2021-02-11 10:39:21 +03:00
Ivan
be831d09f7
Update Pytest check (#18972)
* [WIP]

* Update skip-list

* Update ci_config.json

* Do not sync inserts for test

* Fix more tests

* Fix another test

* Enable one more test

* More fixed tests

* More test fixes

* Do not absolutize server path for now

* More test fixes

* Unset CLICKHOUSE_LOG_COMMENT where necessary

* Remove debugging set -e

* Fix more tests

* Fix test reference

* Fix style check
2021-02-10 21:09:13 +03:00
Alexander Kuzmenkov
739990d075 fix fast test 2021-02-10 15:44:07 +03:00
Alexander Kuzmenkov
c18749a704 fix a bug and add some tests 2021-02-09 17:44:04 +03:00
Alexander Tokmakov
5e0cbfe972 Merge branch 'master' into database_replicated 2021-02-08 23:01:12 +03:00
alesapin
d5ee7d33e9 Merge branch 'master' into in_memory_raft 2021-02-08 10:30:31 +03:00
Marquitos
27933e714b Add 'access_management' configuration to initial setup 2021-02-05 17:39:41 +01:00
alesapin
6247d59c32 Use fixed version 2021-02-05 18:30:45 +03:00
alesapin
92a4c4e318 Add librdkafka to integration tests runner 2021-02-05 18:28:20 +03:00
alesapin
9c04d912ec Merge branch 'master' into in_memory_raft 2021-02-04 11:50:32 +03:00
Alexey Milovidov
82ab793731 Fix missing type check in StorageEmbeddedRocksDB 2021-02-03 20:35:23 +03:00
Alexander Tokmakov
d010f97db0 Merge branch 'master' into database_replicated 2021-02-03 20:13:25 +03:00
alexey-milovidov
12be9d51a9
Merge pull request #20012 from ClickHouse/filimonov-docker-host-patch-1
Update entrypoint.sh
2021-02-03 10:36:00 +03:00
alexey-milovidov
830b0eb36e
Merge pull request #19974 from qoega/kerberized-hdfs-port-clash
Fixed port clash from test_storage_kerberized_hdfs test.
2021-02-03 10:16:14 +03:00
filimonov
5e350bb761
Update entrypoint.sh
Fix for #20002
2021-02-02 23:36:09 +01:00
Yatsishin Ilya
19d6e867c6 HDFS test had a clash with 9000 ClickHouse port. 2021-02-02 12:08:47 +03:00
alesapin
0aca40d8cb Merge branch 'master' into in_memory_raft 2021-02-01 14:30:11 +03:00
robot-clickhouse
cd82eed093 Auto version update to [21.3.1.1] [54448] 2021-02-01 12:50:56 +03:00
Alexey Milovidov
ddd4a7b1b5 Add exception for fast test 2021-01-31 08:33:41 +03:00
Azat Khuzhin
2430551f1c style-check: count stderr as an error too
Since there were precedents
2021-01-29 22:30:56 +03:00
Azat Khuzhin
3001608f2c check-style: fix typo (s/pytest/pylint) in docker image 2021-01-29 22:30:37 +03:00
alesapin
8116d039f9 Merge branch 'master' into in_memory_raft 2021-01-29 18:55:46 +03:00
alesapin
048938effe
Merge pull request #19806 from ClickHouse/dont_run_all_tests_in_parallel
Don't run all stateless tests in parallel
2021-01-29 18:34:56 +03:00
alesapin
941f60a7b5 Temporary retrun dicttoxml to integration tests runner 2021-01-29 16:17:17 +03:00
alesapin
e4f9a4ea65 Merge branch 'master' into in_memory_raft 2021-01-29 15:56:54 +03:00
alesapin
626a23afc7 Fix option 2021-01-29 15:51:10 +03:00
alesapin
bcc3c4193e
Merge pull request #19697 from qoega/easier-macro-xml-generate
No more dicttoxml with excessive logs in integration tests
2021-01-29 12:00:20 +03:00
Alexander Kuzmenkov
348bbe85b2
Merge pull request #19715 from ClickHouse/aku/flaky-parallel
Run tests in parallel in flaky check
2021-01-28 19:16:28 +03:00
alexey-milovidov
9f95fd9c62
Merge pull request #19752 from ClickHouse/fuzzer-more-reliable
Make Fuzzer more reliable
2021-01-28 18:06:27 +03:00
alexey-milovidov
77e86901b8
Merge pull request #19751 from azat/docker-lsof
Add missing lsof for fasttest docker image
2021-01-28 12:06:43 +03:00
alesapin
c3db529543 Merge branch 'master' into in_memory_raft 2021-01-28 12:01:54 +03:00
Alexey Milovidov
4c0c2d03fb Make Fuzzer more reliable 2021-01-28 10:22:18 +03:00
Azat Khuzhin
d9ca77d90e Add missing lsof for fasttest docker image 2021-01-28 09:58:35 +03:00
Alexey Milovidov
442c6d758a Fuzzer: better messages. 2021-01-28 04:09:47 +03:00
Alexander Kuzmenkov
8070562bd0 Run tests in parallel in flaky check 2021-01-27 18:24:39 +03:00
alesapin
dd54e5afe8 Merge branch 'master' into in_memory_raft 2021-01-27 15:32:16 +03:00
alexey-milovidov
3296ad29e2
Merge pull request #19676 from azat/clickhouse-test-fix
clickhouse-test tiny cleanup
2021-01-27 15:12:18 +03:00
Yatsishin Ilya
d21d838604 No more dicttoxml with excessive logs 2021-01-27 12:50:11 +03:00
Azat Khuzhin
93d375f67a Check clickhouse-test with pylint during style check 2021-01-27 00:14:23 +03:00
alesapin
6441d3200b Merge branch 'master' into in_memory_raft 2021-01-26 14:14:39 +03:00
Amos Bird
a2ceca3fa1
Fix recursive propagation 2021-01-26 10:29:12 +08:00
Alexander Tokmakov
3146a1a954 fix 2021-01-25 21:59:23 +03:00
alesapin
46ca832aa1 Enable nuraft in fast test 2021-01-25 18:53:13 +03:00
alesapin
eccd9a29de Build NuRaft even in fast test 2021-01-25 18:32:59 +03:00
alesapin
18fb642e45 Check for hung queries in fast test 2021-01-25 11:53:04 +03:00
alexey-milovidov
9e34739b0e
Update run-fuzzer.sh 2021-01-25 05:45:58 +03:00
Alexey Milovidov
716594fc8d Maybe better 2021-01-24 19:42:37 +03:00
Alexey Milovidov
a69911a2dc More diagnostics in fuzzer #19108 2021-01-24 02:59:00 +03:00
Alexey Milovidov
47b4b94cc4 More diagnostics in fuzzer #19108 2021-01-24 00:45:17 +03:00
alexey-milovidov
ab6343ff1f
Merge pull request #19474 from ClickHouse/aes-fix-strange-code
Fix insufficient args check in AES functions
2021-01-23 22:05:01 +03:00
Alexey Milovidov
d1bd4ef793 Merge branch 'master' of github.com:yandex/ClickHouse into blns 2021-01-23 12:08:38 +03:00
Alexey Milovidov
6b06fbe791 Fix fast test 2021-01-23 05:43:33 +03:00
alexey-milovidov
feebf64cb1
Merge pull request #19397 from ClickHouse/aes-msan
Fix MSan report in AES functions
2021-01-23 04:47:36 +03:00
Alexey Milovidov
f7db6e10d3 Fix very strange code in AES functions 2021-01-23 02:35:40 +03:00
Alexey Milovidov
4452abf0fc Merge branch 'master' into aes-remove-complications 2021-01-23 02:30:09 +03:00
Alexander Kuzmenkov
6027827974
Update run-fuzzer.sh 2021-01-23 02:05:18 +03:00
Alexey Milovidov
bbe3c54f34 Merge branch 'aes-msan' into aes-remove-complications 2021-01-23 00:48:45 +03:00
alexey-milovidov
819483fd9a
Merge pull request #19396 from ClickHouse/fuzz-limit-memory
Limit max memory usage in fuzz testing
2021-01-22 21:09:25 +03:00
Alexey Milovidov
76ef420d15 Update fast test 2021-01-22 21:05:25 +03:00
alexey-milovidov
21455ae646
Merge pull request #19374 from filimonov/docker_openshift
Allow docker to be executed with arbitrary uid
2021-01-22 17:28:44 +03:00
alexey-milovidov
04b950ecbd
Update Dockerfile.alpine 2021-01-22 17:28:36 +03:00
alexey-milovidov
8fdb9d9018
Update Dockerfile 2021-01-22 17:28:25 +03:00
alexey-milovidov
136e9652d0
Update query-fuzzer-tweaks-users.xml 2021-01-22 17:16:08 +03:00
Ilya Yatsishin
41a4f54bcc
Update docker/test/fuzzer/query-fuzzer-tweaks-users.xml 2021-01-22 15:36:15 +03:00
Alexander Kuzmenkov
3048fa8414
Update run-fuzzer.sh 2021-01-22 13:21:29 +03:00
Alexander Kuzmenkov
8c0e207c9c
Update run-fuzzer.sh 2021-01-22 13:20:45 +03:00
Ilya Yatsishin
c54c47405b
Merge pull request #19363 from qoega/sqlancer-rename
SQLancer binary changed its name
2021-01-22 12:35:06 +03:00
Alexey Milovidov
af5c3a5034 Limit max memory usage in fuzz testing 2021-01-22 03:13:47 +03:00
Alexander Kuzmenkov
963699d9c8
Update run-fuzzer.sh 2021-01-22 02:26:49 +03:00
Alexander Kuzmenkov
b0fca03d79
Update run-fuzzer.sh 2021-01-22 01:13:48 +03:00
Alexander Kuzmenkov
56687b2d84
Update run.sh 2021-01-21 23:29:01 +03:00
Alexander Kuzmenkov
e9e3314026
Update run-fuzzer.sh 2021-01-21 23:05:35 +03:00
Yatsishin Ilya
a623084eb0 Merge remote-tracking branch 'origin' into sqlancer-rename 2021-01-21 20:36:52 +03:00
Mikhail Filimonov
fb98e3f8dc
Allow docker to be executed with arbitrary uid 2021-01-21 18:25:09 +01:00
Yatsishin Ilya
4ac080b2ca SQLancer binary changed its name 2021-01-21 17:53:28 +03:00
alesapin
fe6b964b32 Revert "Revert "Auto version update to [21.2.1.1] [54446]""
This reverts commit 42f63e14b5.
2021-01-21 12:39:46 +03:00
Alexander Kuzmenkov
7b4d1fba6a
Update run-fuzzer.sh 2021-01-20 20:18:02 +03:00
Alexey Milovidov
ea0052aba5 Fix error in fuzzer 2021-01-20 03:02:58 +03:00
Alexander Kuzmenkov
20dd97b4b4
Update run-fuzzer.sh 2021-01-19 21:02:31 +03:00
Alexander Kuzmenkov
f5931a2289
Merge pull request #19236 from ClickHouse/aku/echo-leading
Make `-- { echo }` hint preserve leading comments
2021-01-19 20:20:58 +03:00
Yatsishin Ilya
a565638129 stop server 2021-01-19 17:37:27 +03:00
Yatsishin Ilya
2e9c27eaf6 fix tar 2021-01-19 14:42:56 +03:00
Yatsishin Ilya
2a924c1186 ls 2021-01-19 13:31:23 +03:00
Yatsishin Ilya
3ae8d37e83 better 2021-01-19 12:48:05 +03:00
Yatsishin Ilya
b32f6cdf10 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-19 11:20:12 +03:00
alexey-milovidov
eabc90075c
Update run-fuzzer.sh 2021-01-18 21:57:45 +03:00
alexey-milovidov
179158ac5a
Update run-fuzzer.sh 2021-01-18 18:24:05 +03:00
Yatsishin Ilya
e590509d67 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-18 17:24:59 +03:00
Alexander Kuzmenkov
c153268da7 Make -- { echo } hint preserve leading comments. 2021-01-18 15:15:46 +03:00
Alexey Milovidov
3289078ead Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-18 14:04:00 +03:00
Alexey Milovidov
c595a3deaa Update images.json 2021-01-17 23:57:30 +03:00
Alexey Milovidov
2c96fc53f5 Make symbolizers available in fuzzer Docker image 2021-01-17 23:54:00 +03:00
alexey-milovidov
b3d137471e
Merge branch 'master' into aggressive-fuzz-new-tests 2021-01-16 23:56:44 +03:00
Alexey Milovidov
909873b45c Prepare Fuzzer to run with different builds 2021-01-16 23:54:39 +03:00
alexey-milovidov
ea5e7d98a4
Update run-fuzzer.sh 2021-01-16 23:47:01 +03:00
alexey-milovidov
41c77b4775
Update run-fuzzer.sh 2021-01-16 22:01:29 +03:00
alexey-milovidov
b226a4ed4d
Update run-fuzzer.sh 2021-01-16 19:36:08 +03:00
Alexey Milovidov
52a05f4b5d Extreme fuzzing of newly added tests 2021-01-16 18:03:32 +03:00
alexey-milovidov
6689f6e675
Merge pull request #19096 from filimonov/docker_fix_uid_gid
Docker: fix uid/gid of the clickhouse user
2021-01-15 20:59:39 +03:00
alexey-milovidov
e0c90cd20e
Update Dockerfile.alpine 2021-01-15 20:59:12 +03:00
alexey-milovidov
c846f76ffa
Update Dockerfile 2021-01-15 20:58:51 +03:00
Alexander Kuzmenkov
1b37d7716f
Update run-fuzzer.sh 2021-01-15 18:06:51 +03:00
Yatsishin Ilya
fd309086c6 add logs to output 2021-01-15 17:36:27 +03:00
Yatsishin Ilya
28b1447738 fix 2021-01-15 16:01:22 +03:00
Yatsishin Ilya
ea1f15f619 Merge remote-tracking branch 'origin' into add-sqlancer-test-docker 2021-01-15 15:25:46 +03:00
Yatsishin Ilya
ea853cea6c fix 2021-01-15 14:03:59 +03:00
alesapin
dfc1e8ef1d Also upload query log 2021-01-15 10:53:37 +03:00
Mikhail Filimonov
0d23f3f16a
Docker: fix uid/gid of the clickhouse user
Explicitly set uid / gid of clickhouse user & group to the fixed values 101.

It is especially important for rootless containers: in that case entrypoint can't do chown
and owners of mounted volumes should be configured externally.

We do that in advance at the begining of Dockerfile before any packages will be installed
to prevent picking those uid / gid by some unrelated software.

The same uid / gid (101) is used both for alpine and ubuntu.

Number 101 is used by default in openshift, and was used by all clickhouse-server docker images
before 20.10. In 20.11 it was changed (by accident) to 999.
2021-01-14 23:37:27 +01:00
alesapin
cabfa3b7df
Merge pull request #19055 from ClickHouse/more_debug_for_writer
More debug for stateless tests writer
2021-01-15 00:26:42 +03:00
alesapin
b6170c1326 No logs 2021-01-15 00:18:50 +03:00
alesapin
8da81a4791 No errors 2021-01-15 00:15:48 +03:00
alesapin
490326e6b0 Fix symlinks 2021-01-14 19:24:06 +03:00
Yatsishin Ilya
8b2768fbb0 More tests 2021-01-14 18:37:15 +03:00
Mikhail Filimonov
6bec839ab3
Touch dockerfiles to trigger rebuild 2021-01-14 12:46:24 +01:00
Mikhail Filimonov
7be81c3a71
Fix images dependencies 2021-01-14 12:45:56 +01:00
alesapin
29685aac3c More debug for stateless tests writer 2021-01-14 13:42:51 +03:00
alexey-milovidov
fc5e09d6b8
Merge pull request #18954 from filimonov/docker-entrypoint
Docker: better clickhouse-server  entrypoint
2021-01-14 11:33:38 +03:00
alexey-milovidov
7d7af00afb
Merge pull request #19015 from nikitamikhaylov/defaults-for-file-engine
Added tests for defaults in URL and File engine
2021-01-14 10:12:27 +03:00
Nikita Mikhailov
3d62d6503b better 2021-01-13 18:34:16 +03:00
Ilya Yatsishin
038f52d08b
Merge pull request #19006 from qoega/add-sqlancer-test-docker 2021-01-13 15:14:18 +03:00
Yatsishin Ilya
3f17fac469 Add docker to run SQLancer in CI 2021-01-13 12:49:52 +03:00
filimonov
f8dc5cc740
Update alpine-build.sh 2021-01-11 18:35:20 +01:00
Mikhail Filimonov
9f22bcefb0
Docker: better server entrypoint 2021-01-11 18:24:49 +01:00
Danila Kutenin
e5ec4e21b6 Fix Darwin build 2021-01-11 09:04:34 +00:00
Alexey Milovidov
42f63e14b5 Revert "Auto version update to [21.2.1.1] [54446]"
This reverts commit bc2593688e.
2021-01-11 11:32:52 +03:00
robot-clickhouse
bc2593688e Auto version update to [21.2.1.1] [54446] 2021-01-11 11:12:11 +03:00
Alexey Milovidov
c7d4d12f72 Auto version update to [21.1.0] [54445] 2021-01-11 03:51:08 +03:00
alexey-milovidov
fdff71a36f
Merge pull request #18770 from ClickHouse/fix-query-fuzzer
Query Fuzzer: fix some cultural issues
2021-01-06 20:02:30 +03:00
Alexey Milovidov
4f726784c9 Fix shellcheck 2021-01-06 04:56:10 +03:00
Alexey Milovidov
b6a733c2dd Do not allow Fuzzer to enable LLVM 2021-01-06 04:07:59 +03:00
Alexey Milovidov
822682f2f8 Fix exit code 2021-01-06 03:56:51 +03:00
Alexey Milovidov
7f074cb491 Remove half of strange code from query fuzzer 2021-01-06 00:20:39 +03:00
Alexey Milovidov
6ecf4fe921 More robust stateful test 2021-01-05 03:02:40 +03:00
Azat Khuzhin
de7909211d Try using top_level_domains from the patched performance archive
If there is top_level_domains list in the upstream/master, use from the
patched version (this is required to run all performance tests for
upstream/master in the PR).
2021-01-02 17:27:03 +03:00
Azat Khuzhin
469b631ca6 Fix performance comparison
In #18113 the top_level_domains list copying was moved into
docker/packager/binary/build.sh, this was done to avoid symlinks (since
Dockerfile cannot dereference them).

But the patch was wrong, since it copied into the root (/), which is not
included into performance.tgz and also compare.sh was not modified.

This wasn't showed up with CI checks since the docker image wasn't
updated and it still included that top_level_domains, once it was
modified the image was updated and it became broken.

Cc: @akuzm
2021-01-02 17:09:20 +03:00
Yatsishin Ilya
011d2b4631 disable couple checks for now 2020-12-29 17:57:12 +03:00
Yatsishin Ilya
a25fa1996b fix style checks 2020-12-29 17:57:12 +03:00
alesapin
e81485653b
Merge pull request #18491 from ClickHouse/add_nuraft
Add NuRaft to contrib
2020-12-26 16:19:05 +03:00
alesapin
b4cac6a8a4 Fix unbundled, splitted and disable freebsd build 2020-12-25 15:36:49 +03:00
alesapin
c9bbde649c
Merge pull request #18312 from ClickHouse/simplier_coverage
Make single image for building coverage report
2020-12-25 10:18:39 +03:00
Yatsishin Ilya
ce1e2b18a3 Fix codespell warnings. Split style checks. Update style checks docker 2020-12-24 13:17:52 +03:00
alesapin
e68bafd508 Merge branch 'master' into simplier_coverage 2020-12-24 12:39:33 +03:00
alesapin
58d0e8901e Remove hardcoded tests 2020-12-23 14:05:59 +03:00
Nikolai Kochetov
af7f5c9518
Merge pull request #17868 from ClickHouse/async-read-from-socket
Async read from socket
2020-12-23 12:20:42 +03:00
alesapin
f0b2bf9247 Merge branch 'master' into simplier_coverage 2020-12-22 18:37:15 +03:00
alesapin
4b28d6d030 Merge branch 'master' into enable_thread_fuzzer_for_flaky_check 2020-12-22 16:36:51 +03:00
alesapin
41229b8bc9 Run small tests 2020-12-22 14:52:48 +03:00
alesapin
b184141e20 Collect client coverage 2020-12-22 12:22:49 +03:00
alesapin
2d28c8cb60 Better runner 2020-12-22 11:20:57 +03:00
Alexey Milovidov
5bdf287910 Check for conflict markers in docs 2020-12-22 00:55:54 +03:00
alesapin
b10f13f34a More thread fuzzer 2020-12-21 23:24:16 +03:00
alesapin
8bbb678758 Correctly forward env 2020-12-21 23:12:01 +03:00
alesapin
8f2d4f2d1e Fix user 2020-12-21 18:46:36 +03:00
alesapin
24cb824bfe Simplify coverage images 2020-12-21 15:09:27 +03:00
alesapin
fdf18ceec0 Remove new line 2020-12-21 13:08:06 +03:00
alesapin
643739df6b Trying to enable thread fuzzer in flaky check 2020-12-21 13:06:36 +03:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
Ivan
57763e6867
Enable Pytest framework for stateless tests (#17902) 2020-12-18 16:26:11 +03:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
alesapin
799997db35
Merge pull request #16621 from arenadata/ADQM-148
HDFS configuration and Kerberos Authenticaiton
2020-12-17 23:16:58 +03:00
Ilya Golshtein
832d99515b tag for yandex/clickhouse-kerberized-hadoop 2020-12-17 12:05:49 +03:00
Alexander Kuzmenkov
170cd132da
Merge pull request #18113 from azat/tld-list-symlink-fix
Avoid using symlinks for top_level_domains
2020-12-16 20:49:43 +03:00
Ilya Golshtein
a5a33f1963 rpm rebuilddb and yum update in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
39877b1a6f yum clean all in kerberized_hadoop/Dockerfile 2020-12-16 14:48:33 +03:00
Ilya Golshtein
a4dad0acb7 CentOS 6 became too old 2020-12-16 14:48:33 +03:00
Ilya Golshtein
09d1e89674 yandex/clickhouse-kerberized-hadoop + missed header 2020-12-16 14:48:33 +03:00
Ilya Golshtein
7e97814859 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString 2020-12-16 14:48:33 +03:00
Ilya Golshtein
d9166a0645 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities 2020-12-16 14:48:33 +03:00
Ilya Golshtein
eb10948ca2 kerberized_hdfs cluster started 2020-12-16 14:48:33 +03:00
alesapin
86fc9ea4df Update base image to 20.04 2020-12-15 23:18:53 +03:00
Azat Khuzhin
95c35b318e Avoid using symlinks for top_level_domains
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
2020-12-15 21:58:46 +03:00
Nikolai Kochetov
4905201985 Merge branch 'master' into async-read-from-socket 2020-12-15 21:04:47 +03:00
alesapin
554fd738e9 Remove strange line 2020-12-15 18:22:21 +03:00
alesapin
ccabb4680d Fix dependencies 2020-12-15 18:19:56 +03:00
Alexander Kuzmenkov
fe6f477881 Build utils in CI, at least in split build
Currently we don't build them at all, so they were broken by https://github.com/ClickHouse/ClickHouse/pull/17988
2020-12-14 20:39:52 +03:00
Alexander Kuzmenkov
5f424f7c5c
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 20:08:32 +03:00
alexey-milovidov
19af691aa6
Merge pull request #17738 from vklimontovich/docker-cli-example
Docker cli example
2020-12-14 19:44:13 +03:00
filimonov
b08842d44e
Update README.md 2020-12-14 16:54:37 +01:00
filimonov
1436986a86
Update README.md 2020-12-14 16:53:58 +01:00
filimonov
bca41bb7fd
Update README.md 2020-12-14 16:50:48 +01:00
Alexander Kuzmenkov
e7f93b5563
Merge pull request #18058 from azat/perf-test-zk-port-fix
Remove test_keeper_server in perf tests
2020-12-14 17:54:47 +03:00
Alexander Kuzmenkov
2edabd5519
Update zzz-perf-comparison-tweaks-config.xml 2020-12-14 17:45:58 +03:00
Nikolai Kochetov
8de5cd5bc7 Merge branch 'master' into async-read-from-socket 2020-12-14 17:45:38 +03:00
Nikolai Kochetov
75ac87c241 Fixing build. 2020-12-14 17:42:12 +03:00
Azat Khuzhin
653ddab63e Remove test_keeper_server in perf tests
To avoid port overlaps for right and left server (anyway it is not
used).
2020-12-14 10:59:01 +03:00
alexey-milovidov
e7ffae89e9
Update build.sh 2020-12-14 02:31:35 +03:00
alexey-milovidov
52f03d942e
Update Dockerfile 2020-12-14 02:31:18 +03:00
Azat Khuzhin
6f2c559398 Convert top_level_domains_lists.xml into regular file
docker/test/performance-comparison/config/config.d is not allowed to has
symlinks, since it is copied with the COPY docker command.
2020-12-10 21:01:17 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
2020-12-09 21:08:31 +03:00
Azat Khuzhin
8a4b29495b perf: override top_level_domains_path via command line arguments 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00