Commit Graph

395 Commits

Author SHA1 Message Date
Vitaliy Zakaznikov
f72845fb9d Increase LDAP verification cooldown performance tests timeout to 600 sec. 2021-06-16 19:25:59 -04:00
Alexey Milovidov
1c1d141a2a Disable LDAP testflows, they are flaky 2021-06-17 01:26:13 +03:00
alexey-milovidov
444302f563
Merge pull request #25278 from vzakaznikov/enable_ldap_tests_with_new_ldap_role_mapping_deadlock_fix_test
Enable TestFlows LDAP tests
2021-06-16 08:31:53 +03:00
MyroTk
8169399589 Rounding precision controlled by one variable 2021-06-15 18:42:05 +02:00
MyroTk
1d64786e81 Removing commented code 2021-06-15 18:14:19 +02:00
MyroTk
f44bdc0b75 Changes to rounding and naming. Enabling the extended datatypes tests. 2021-06-15 18:09:10 +02:00
Vitaliy Zakaznikov
33f270c2dc Adding test to check adding LDAP user to an LDAP group
that maps to an unknown RBAC role while already having
other role being mapped.
2021-06-14 19:00:29 -04:00
Vitaliy Zakaznikov
07f0ee39ab Enabling LDAP tests. 2021-06-14 18:20:19 -04:00
Vitaliy Zakaznikov
62d4c51524 Updating tests to support new preprocessed configs name that
start with an underscore.
2021-06-14 18:19:36 -04:00
alexey-milovidov
fea7917917
Merge pull request #25144 from vzakaznikov/testflows_windows_functions_add_lag_and_lead_in_frame_tests
Adding leadInFrame/lagInFrame window functions TestFlows tests
2021-06-12 03:00:18 +03:00
Vitaliy Zakaznikov
a5d5f13497 Adding test to check default window function frame. 2021-06-09 15:48:22 -04:00
Vitaliy Zakaznikov
bc4b696bf9 Adding tests for lagInFrame. 2021-06-09 15:32:21 -04:00
Vitaliy Zakaznikov
9ef8ed5061 Disabling extended precision data types tests until tests
are updated to implement rounding of the results.
2021-06-09 08:58:34 -04:00
Vitaliy Zakaznikov
12a44efc81 Adding leadInFrame window functions tests. 2021-06-09 08:56:55 -04:00
Vitaliy Zakaznikov
9e99e20765 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_windows_functions_add_lag_and_lead_in_frame_tests 2021-06-07 09:43:14 -04:00
MyroTk
0ac21f14a5 Adding snapshots for output comparison. 2021-06-01 21:07:42 +02:00
Vitaliy Zakaznikov
41cd58efb1 Adding window functions requirements for leadInFrame, lagInFrame and default frame. 2021-05-31 20:50:39 -04:00
alexey-milovidov
a7e95b4ee2
Merge pull request #24504 from vzakaznikov/testflows_check_add_saving_clickhouse_logs
Adding support to save clickhouse server logs in TestFlows check
2021-05-27 08:05:55 +03:00
Vitaliy Zakaznikov
7800f934ab Adding gzip compression of clickhouse logs. 2021-05-26 17:16:24 -04:00
Vitaliy Zakaznikov
774171c61c Another try to move clickhouse logs to /test_output folder. 2021-05-26 16:25:23 -04:00
Vitaliy Zakaznikov
3fb4ba3885 Fixing the way we move clickhouse logs to the /test_output folder. 2021-05-26 14:11:56 -04:00
MyroTk
a33188c3d5 Rounding to make expected values consistent. 2021-05-25 17:21:17 +02:00
MyroTk
b2dc82128c Specifying inclusive and exclusive boundaries in the requirements. 2021-05-24 15:04:58 +02:00
MyroTk
07ce7ec40c Remove nodes clickhouse2 and clickhouse3, and zookeeper. 2021-05-21 17:58:04 +02:00
MyroTk
740189893c Removing more config files. Updating wording in requirements. Added toDecimal256 tests to check max and min for every scale value. 2021-05-21 17:27:24 +02:00
alexey-milovidov
907fcf9f05
Delete macros.xml 2021-05-20 20:18:02 +03:00
MyroTk
7ed3b5f967 Removing unnecessary SSL files. 2021-05-20 19:06:27 +02:00
MyroTk
fa1c324356 Testflows tests for Extended Precision Data Types: Int128, UInt128, Int256, UInt256, Decimal256 2021-05-20 18:42:26 +02:00
Vitaliy Zakaznikov
03ebd18d01 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-user-dn-detection 2021-05-18 14:08:28 -04:00
Vitaliy Zakaznikov
58685dc9fa Disabling RBAC module.
Removing debugging code.
2021-05-13 10:04:08 -04:00
Vitaliy Zakaznikov
7e899fff76 Comment 4 to retrigger CI/CD pipeline to check test stability. 2021-05-12 23:42:20 -04:00
Vitaliy Zakaznikov
086a30a198 Comment 3 to retrigger CI/CD pipeline to check test stability. 2021-05-12 19:36:26 -04:00
Andrey Z
631af2d2f2 try123123 2021-05-12 22:57:12 +03:00
Vitaliy Zakaznikov
889d406341 Commint to retrigger CI/CD pipeline to check test stability. 2021-05-12 15:55:29 -04:00
Andrey
7f4a9a9312
Merge branch 'master' into kerberos_tests 2021-05-12 22:49:35 +03:00
Vitaliy Zakaznikov
e55b4117be Updating helpers/cluster.py to increase timeout and add polling
when getting control shell.
2021-05-12 12:34:28 -04:00
Vitaliy Zakaznikov
258525167f Commint to retrigger CI/CD pipeline to check test stability. 2021-05-12 08:15:09 -04:00
Vitaliy Zakaznikov
3d32363f39 Xfailing new fails in aes encryption module.
Adding basic execution of aes encryption module features in parallel.
2021-05-11 19:45:03 -04:00
Vitaliy Zakaznikov
2541f2cb25 Updating run_scenario method to not launch new parallel tests
if top test is terminating.
2021-05-11 17:17:08 -04:00
Vitaliy Zakaznikov
042625a8e2 Debug commit to run all modules 4 times to check stability. 2021-05-11 09:13:04 -04:00
Vitaliy Zakaznikov
f964f8b9c0 Adding retries when trying to obtain a terminal to a container. 2021-05-11 08:56:14 -04:00
Vitaliy Zakaznikov
e0375204f1 Removing hard coded SKIP flag and xfailed it instead. 2021-05-10 17:09:26 -04:00
Vitaliy Zakaznikov
bce80f1256 Updating docker and docker-compose versions.
Updating and enabling datetime64 extended range tests.
2021-05-10 16:59:47 -04:00
Vitaliy Zakaznikov
c0a4770ee7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:11:48 -04:00
Vitaliy Zakaznikov
1a83604d23 Fixing issue with getting node service docker container id. 2021-05-10 09:26:24 -04:00
Vitaliy Zakaznikov
06c60158b8 Increasing timeouts. 2021-05-09 12:34:56 -04:00
alexey-milovidov
4ada91574b
Merge branch 'master' into fixing_testflows_window_function_distributed_tests 2021-05-09 18:29:33 +03:00
Vitaliy Zakaznikov
c5948c3ba7 Updating timeouts in LDAP tests. 2021-05-08 20:33:22 -04:00
alexey-milovidov
a34c927fb2
Merge branch 'master' into tests_dt64_ext 2021-05-08 23:29:18 +03:00
Vitaliy Zakaznikov
b85205aa30 Enabling testflows window function tests. 2021-05-08 15:22:03 -04:00
Vitaliy Zakaznikov
b303ebc7e3 Fixing window functions distributed tests by moving to using deterministic sharding key. 2021-05-08 15:06:31 -04:00
Vitaliy Zakaznikov
f886e2cebb Removing rand() as a sharding key to avoid instability in window function tests and
instead moved to using deterministic sharding key.
2021-05-08 15:00:54 -04:00
Alexey Milovidov
b64f5b0419 Disable unreliable TestFlows 2021-05-08 16:40:54 +03:00
Vitaliy Zakaznikov
945ff2c338 Fixing styling errors. 2021-05-07 19:28:20 -04:00
Vitaliy Zakaznikov
1dd5e7d986 Fixing intro to window functions SRS. 2021-05-07 17:45:08 -04:00
Vitaliy Zakaznikov
4b87ae684c Adding 'clean' script to clean up _instances folders.
Updating RBAC to run on the latest master.
Fixing ldap SRS reference issue.
2021-05-07 15:40:58 -04:00
Vitaliy Zakaznikov
04a9dbeb2b Fixing SRS reference and updating requirements. 2021-05-07 15:37:29 -04:00
Vitaliy Zakaznikov
0b95bfb38e Adding support to run modules in parallel.
Adding fixes to ldap and rbac tests.
Adding user_dn_detection tests in LDAP role mapping.
2021-05-07 09:14:40 -04:00
Vitaliy Zakaznikov
f067237fdd Fixing range frame tests for distributed tables. 2021-05-06 18:16:24 -04:00
Vitaliy Zakaznikov
bb2213fdac Updating range datetime tests for distributed tables. 2021-05-05 18:31:16 -04:00
Vitaliy Zakaznikov
75bd55073d Fixing rows frame tests for distributed tables. 2021-05-05 18:01:12 -04:00
Vitaliy Zakaznikov
89de7c5847 Updates to tests. 2021-05-05 15:47:32 -04:00
Vitaliy Zakaznikov
0d67461f2d Updates. 2021-05-05 15:00:08 -04:00
Vitaliy Zakaznikov
ee4296510d Updates to fix more tests with distributed tables. 2021-05-05 14:34:51 -04:00
Vitaliy Zakaznikov
acd6d91092 * Starting to fix tests with distributed tables
* Removing tabs
2021-04-27 18:50:52 -04:00
Vitaliy Zakaznikov
334959aaf3 Updates for latest master. 2021-04-27 14:15:15 -04:00
Vitaliy Zakaznikov
81126efe1d Adding TestFlows window functions test suite. 2021-04-27 08:55:01 -04:00
Andrey Z
f3b4bf4f5f Updated tests 2021-04-22 14:17:35 +03:00
zvonand
f32abced02 Merge branch 'kerberos_tests' of github.com:zvonand/ClickHouse into kerberos_tests 2021-04-22 13:49:29 +03:00
zvonand
835c6f9e26 u 2021-04-22 13:48:47 +03:00
alexey-milovidov
e3af501de2
Update regression.py 2021-04-22 01:17:26 +03:00
Vitaliy Zakaznikov
5942e293f1 Crossing out failing map type tests. 2021-04-21 16:29:41 -04:00
Vitaliy Zakaznikov
279d33d71b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_map_type_tests 2021-04-21 13:49:36 -04:00
Vitaliy Zakaznikov
0e5c58c8b2 Adding user DN detection tests. 2021-04-19 19:00:30 -04:00
Andrey Z
66721557a3 Merge branch 'kerberos_tests' of github.com:zvonand/ClickHouse into kerberos_tests 2021-04-15 14:01:52 +03:00
Andrey Z
4037076867 Try ping with kerberos 2021-04-15 13:56:37 +03:00
Andrey
bcd217bc10
Update date_time_functions.py 2021-04-14 14:09:51 +03:00
Andrey
f70dbedddc
Merge branch 'master' into kerberos_tests 2021-04-14 13:49:19 +03:00
songenjie
96a95b05db fix suggests 2021-04-14 10:14:13 +08:00
Andrey Z
9f3eab9880 Fixed + simple ping test 2021-04-14 03:11:40 +03:00
songenjie
564136ec46 [clickhouse][server][dll][alter]support fetch part 2021-04-13 12:40:33 +08:00
Andrey Z
7d931ea2dc mistake 2021-04-12 14:40:13 +03:00
Andrey Z
2b5db5301a Fix 2021-04-12 14:38:02 +03:00
Andrey Z
a0da349b47 Fix bug 2021-04-12 14:08:39 +03:00
Andrey Z
680d722f22 All tests ready 2021-04-11 01:30:48 +03:00
Andrey Z
26108e2cb0 type conversion tests fixed 2021-04-10 20:05:49 +03:00
Andrey Z
63ff322215 All datetime funcs cleared 2021-04-10 14:54:15 +03:00
Andrey Z
4ab98688c9 New tests fixes 2021-04-09 16:32:10 +03:00
zvonand
6ab4a6f141 new fix 2021-04-09 12:03:58 +03:00
zvonand
ada7c03df7 New fixes 2021-04-08 15:05:10 +03:00
zvonand
35c585a200 Fix 2021-04-08 01:03:54 +03:00
zvonand
7b05bb1413 Fixed test structure 2021-04-07 22:10:41 +03:00
zvonand
9368d98945 Fixed addHours 2021-04-07 21:14:44 +03:00
Andrey Z
e84bdc6ddd Some tests resolved 2021-04-07 18:28:55 +03:00
Andrey
4548b86de8
Fixed existing XFails 2021-04-07 15:59:08 +03:00
zvonand
4f64f07ba1 Style fix 2021-04-07 14:24:22 +03:00
Andrey Z
0d6a6f4066 Resolved licences 2021-04-07 11:12:14 +03:00
Andrey Z
d601ac56de Updated tests 2021-04-07 01:48:09 +03:00
Andrey Z
86ef5907a7 Master pull 2021-04-07 01:09:50 +03:00
Alexey Milovidov
b5ecfaa3c2 Remove TestFlows (2) 2021-04-02 01:41:28 +03:00
Andrey Z
15a106c35a Updated requirements 2021-04-01 12:59:20 +03:00
Andrey Z
80a7688b62 mastermerge 2021-04-01 12:54:15 +03:00
MyroTk
9fd3cd2a21 Adding memory info to testflows RBAC 2021-03-31 08:34:52 +02:00
alexey-milovidov
0bad6adc48
Merge pull request #21551 from vzakaznikov/testflows_use_yandex_docker_repo
Updating docker/test/testflows/runner/dockerd-entrypoint.sh to use Yandex dockerhub-proxy
2021-03-22 02:27:50 +03:00
Andrey Z
5813a99900 Continious execution enabled 2021-03-17 19:47:42 +03:00
zvonand
b972dbd08e Reduced number of tests to essential-only 2021-03-15 12:06:17 +03:00
zvonand
d7393b0071 Merge branch 'master' into kerberos_tests 2021-03-15 11:53:53 +03:00
Vitaly Baranov
d6e0342c30 Improvements in implementations of the classes AccessRights and GrantedRoles. 2021-03-14 19:12:35 +03:00
zvonand
246e0dc1cf Enabled kerberos tests 2021-03-12 13:02:46 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
Denis Glazachev
290a6d273e
Add Kerberos support for authenticating existing users when accessing over HTTP 2021-03-11 23:41:10 +03:00
Vitaliy Zakaznikov
e9e4c68d12 Fixing retention precision for failing RBAC tests. 2021-03-10 07:22:18 -05:00
MyroTk
9dd232cf90 Graphite updates for all tests 2021-03-09 17:54:56 +01:00
MyroTk
084aac07c0 Graphite config fix 2021-03-09 17:07:45 +01:00
MyroTk
1293316264 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into tfs_rbac_row_policy 2021-03-09 17:07:17 +01:00
zvonand
aecd5c6d23 Added testflows tests for datetime64 extended range 2021-03-09 17:56:32 +03:00
Vitaliy Zakaznikov
3a5f4abd33 Adding test to check selecting key when key has integer type. 2021-03-07 11:53:45 -05:00
Vitaliy Zakaznikov
d3fdb15368 Adding select by key tests for value and key with string type. 2021-03-07 11:24:03 -05:00
Vitaliy Zakaznikov
80ba5c9964 Updated requirements for using keys and values subcolums with inline defined
map to use the word MAY instead of SHALL.
2021-03-07 10:02:15 -05:00
Vitaliy Zakaznikov
2ad584d9ab Updating requirement to use MAY 2021-03-07 09:56:46 -05:00
Vitaliy Zakaznikov
4db7d47e1c Updating requirements to use the word MAY instead of SHALL where
behavior is not fully defined.
2021-03-07 09:52:42 -05:00
Vitaliy Zakaznikov
8b0bda5968 Fixing performance test by removing assertion. 2021-03-07 09:11:59 -05:00
Vitaliy Zakaznikov
3b7adc8373 Updating requirements based on the review. 2021-03-05 08:48:18 -05:00
Vitaliy Zakaznikov
3e225dbcec Merge branch 'testflows_map_type_tests' of https://github.com/vzakaznikov/ClickHouse into testflows_map_type_tests 2021-03-03 14:09:23 -05:00
Vitaliy Zakaznikov
b1d043b7db Fixing configs based on review comments. 2021-03-03 14:09:04 -05:00
MyroTk
af54d857c8 Deleting old requirement 2021-03-02 01:59:31 +01:00
MyroTk
2d8321342f Minor syntax fixes 2021-03-01 17:37:11 +01:00
MyroTk
5d6b5bc276 TFS tests 2021-03-01 17:29:42 +01:00
Alexander Tokmakov
0937127ea4 fix 2021-02-27 14:01:04 +03:00
Alexander Tokmakov
fb42dec355 fix 2021-02-27 01:20:49 +03:00
Azat Khuzhin
bc1a316b28 Bump zookeeper version to 3.6.2 in tests
3.4.12 was released 1.05.2018
2021-02-26 23:41:43 +03:00
alexey-milovidov
8e770a8501
Update docker-compose.yml 2021-02-23 16:41:26 +03:00
Vitaliy Zakaznikov
4a085d7c21 Removing unused table types. 2021-02-22 15:06:45 -05:00
Vitaliy Zakaznikov
d1f8f52f16 Adding Map type tests in TestFlows 2021-02-22 15:04:34 -05:00
Azat Khuzhin
e922690453 Fix yamllint issues 2021-02-20 23:25:21 +03:00
Vitaliy Zakaznikov
64261c7720 Fixing reference to LDAP role mapping specification 2021-01-30 15:24:20 -05:00
Vitaliy Zakaznikov
eebff7155c Adding SRS source for LDAP role mapping. 2021-01-29 19:43:33 -05:00
Vitaliy Zakaznikov
8545ce1111 Adding support for retrying docker-compose start, stop and restart commands.
Fixing ldap tests to use large tail value to accomodate changes in exception length.
2021-01-29 17:55:08 -05:00
Vitaliy Zakaznikov
01d3d0aeca Fixing requirement names. 2021-01-27 10:01:47 -05:00
Vitaliy Zakaznikov
48884d2231 Adding tests to check passing invalid data types
to encrypt and aes_encrypt_mysql functions.
2021-01-27 09:27:34 -05:00
Vitaliy Zakaznikov
79cc2e4c1c Updating AES encryption SRS.
Adding test for LowCardinality(FixedString(N)) data type for plaintext.
2021-01-27 08:20:44 -05:00
Vitaliy Zakaznikov
edd4ca8c72 Starting to update AES encryption tests to support changes to
the supported data types by the encrypt plaintext parameter.
2021-01-26 14:54:26 -05:00
Vitaliy Zakaznikov
f7e61c1ed1 Enabling all TestFlows modules.
Increasing clickhouse container health check timeouts.
2021-01-18 17:03:31 -05:00
Denis Glazachev
30ab2830e0 Merge branch 'master' into ldap-role-mapping
* master: (605 commits)
  DOCSUP-4710: Added support numeric parameters in number and string data types (#18696)
  DOCSUP-5604: Edit and translate to Russian (#18929)
  Update version_date.tsv after release 21.1.2.15
  Usability improvement of clickhouse-test
  Update jit_large_requests.xml
  Update README.md
  Update images.json
  Make symbolizers available in fuzzer Docker image
  Update Dragonbox
  Speed up aggregate function sum
  Fix MSan report in Kerberos library
  Fix MSan error in rocksdb #19213
  Add more Fuzzer tasks
  Fixes
  Update comment for curl dependency for aws
  Disable curl for mariadb-connector-c (it is not required)
  Fix TSan
  Skip test for ANTLR
  DistributedBlockOutputStream: add more comments
  DistributedBlockOutputStream: Remove superfluous brackets for string construction
  ...
2021-01-18 22:55:05 +04:00
Alexey Milovidov
015e392bb7 Disable TestFlows due to low reliability 2021-01-16 11:58:23 +03:00
MyroTk
489d9d186a Looping RBAC several times 2021-01-14 21:25:37 +01:00
MyroTk
0df681a58b Moving SYSTEM SHUTDOWN out of parallel 2021-01-14 17:57:44 +01:00
MyroTk
944d53d691 Running RBAC just once 2021-01-13 18:20:29 +01:00
MyroTk
43f350c0d1 Enabling RBAC tests to look for fails. Adding new tests 2021-01-13 15:55:48 +01:00
Alexey Milovidov
0421cc8dc2 Remove TestFlows due to timeouts 2021-01-10 03:49:29 +03:00