Commit Graph

358 Commits

Author SHA1 Message Date
Vitaliy Zakaznikov
3d32363f39 Xfailing new fails in aes encryption module.
Adding basic execution of aes encryption module features in parallel.
2021-05-11 19:45:03 -04:00
Vitaliy Zakaznikov
2541f2cb25 Updating run_scenario method to not launch new parallel tests
if top test is terminating.
2021-05-11 17:17:08 -04:00
Vitaliy Zakaznikov
042625a8e2 Debug commit to run all modules 4 times to check stability. 2021-05-11 09:13:04 -04:00
Vitaliy Zakaznikov
f964f8b9c0 Adding retries when trying to obtain a terminal to a container. 2021-05-11 08:56:14 -04:00
Vitaliy Zakaznikov
e0375204f1 Removing hard coded SKIP flag and xfailed it instead. 2021-05-10 17:09:26 -04:00
Vitaliy Zakaznikov
bce80f1256 Updating docker and docker-compose versions.
Updating and enabling datetime64 extended range tests.
2021-05-10 16:59:47 -04:00
Vitaliy Zakaznikov
c0a4770ee7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_modules_in_parallel 2021-05-10 14:11:48 -04:00
Vitaliy Zakaznikov
1a83604d23 Fixing issue with getting node service docker container id. 2021-05-10 09:26:24 -04:00
Vitaliy Zakaznikov
06c60158b8 Increasing timeouts. 2021-05-09 12:34:56 -04:00
alexey-milovidov
4ada91574b
Merge branch 'master' into fixing_testflows_window_function_distributed_tests 2021-05-09 18:29:33 +03:00
Vitaliy Zakaznikov
c5948c3ba7 Updating timeouts in LDAP tests. 2021-05-08 20:33:22 -04:00
alexey-milovidov
a34c927fb2
Merge branch 'master' into tests_dt64_ext 2021-05-08 23:29:18 +03:00
Vitaliy Zakaznikov
b85205aa30 Enabling testflows window function tests. 2021-05-08 15:22:03 -04:00
Vitaliy Zakaznikov
b303ebc7e3 Fixing window functions distributed tests by moving to using deterministic sharding key. 2021-05-08 15:06:31 -04:00
Vitaliy Zakaznikov
f886e2cebb Removing rand() as a sharding key to avoid instability in window function tests and
instead moved to using deterministic sharding key.
2021-05-08 15:00:54 -04:00
Alexey Milovidov
b64f5b0419 Disable unreliable TestFlows 2021-05-08 16:40:54 +03:00
Vitaliy Zakaznikov
945ff2c338 Fixing styling errors. 2021-05-07 19:28:20 -04:00
Vitaliy Zakaznikov
1dd5e7d986 Fixing intro to window functions SRS. 2021-05-07 17:45:08 -04:00
Vitaliy Zakaznikov
4b87ae684c Adding 'clean' script to clean up _instances folders.
Updating RBAC to run on the latest master.
Fixing ldap SRS reference issue.
2021-05-07 15:40:58 -04:00
Vitaliy Zakaznikov
04a9dbeb2b Fixing SRS reference and updating requirements. 2021-05-07 15:37:29 -04:00
Vitaliy Zakaznikov
0b95bfb38e Adding support to run modules in parallel.
Adding fixes to ldap and rbac tests.
Adding user_dn_detection tests in LDAP role mapping.
2021-05-07 09:14:40 -04:00
Vitaliy Zakaznikov
f067237fdd Fixing range frame tests for distributed tables. 2021-05-06 18:16:24 -04:00
Vitaliy Zakaznikov
bb2213fdac Updating range datetime tests for distributed tables. 2021-05-05 18:31:16 -04:00
Vitaliy Zakaznikov
75bd55073d Fixing rows frame tests for distributed tables. 2021-05-05 18:01:12 -04:00
Vitaliy Zakaznikov
89de7c5847 Updates to tests. 2021-05-05 15:47:32 -04:00
Vitaliy Zakaznikov
0d67461f2d Updates. 2021-05-05 15:00:08 -04:00
Vitaliy Zakaznikov
ee4296510d Updates to fix more tests with distributed tables. 2021-05-05 14:34:51 -04:00
Vitaliy Zakaznikov
acd6d91092 * Starting to fix tests with distributed tables
* Removing tabs
2021-04-27 18:50:52 -04:00
Vitaliy Zakaznikov
334959aaf3 Updates for latest master. 2021-04-27 14:15:15 -04:00
Vitaliy Zakaznikov
81126efe1d Adding TestFlows window functions test suite. 2021-04-27 08:55:01 -04:00
Andrey Z
f3b4bf4f5f Updated tests 2021-04-22 14:17:35 +03:00
zvonand
f32abced02 Merge branch 'kerberos_tests' of github.com:zvonand/ClickHouse into kerberos_tests 2021-04-22 13:49:29 +03:00
zvonand
835c6f9e26 u 2021-04-22 13:48:47 +03:00
alexey-milovidov
e3af501de2
Update regression.py 2021-04-22 01:17:26 +03:00
Vitaliy Zakaznikov
5942e293f1 Crossing out failing map type tests. 2021-04-21 16:29:41 -04:00
Vitaliy Zakaznikov
279d33d71b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_map_type_tests 2021-04-21 13:49:36 -04:00
Vitaliy Zakaznikov
0e5c58c8b2 Adding user DN detection tests. 2021-04-19 19:00:30 -04:00
Andrey Z
66721557a3 Merge branch 'kerberos_tests' of github.com:zvonand/ClickHouse into kerberos_tests 2021-04-15 14:01:52 +03:00
Andrey Z
4037076867 Try ping with kerberos 2021-04-15 13:56:37 +03:00
Andrey
bcd217bc10
Update date_time_functions.py 2021-04-14 14:09:51 +03:00
Andrey
f70dbedddc
Merge branch 'master' into kerberos_tests 2021-04-14 13:49:19 +03:00
songenjie
96a95b05db fix suggests 2021-04-14 10:14:13 +08:00
Andrey Z
9f3eab9880 Fixed + simple ping test 2021-04-14 03:11:40 +03:00
songenjie
564136ec46 [clickhouse][server][dll][alter]support fetch part 2021-04-13 12:40:33 +08:00
Andrey Z
7d931ea2dc mistake 2021-04-12 14:40:13 +03:00
Andrey Z
2b5db5301a Fix 2021-04-12 14:38:02 +03:00
Andrey Z
a0da349b47 Fix bug 2021-04-12 14:08:39 +03:00
Andrey Z
680d722f22 All tests ready 2021-04-11 01:30:48 +03:00
Andrey Z
26108e2cb0 type conversion tests fixed 2021-04-10 20:05:49 +03:00
Andrey Z
63ff322215 All datetime funcs cleared 2021-04-10 14:54:15 +03:00
Andrey Z
4ab98688c9 New tests fixes 2021-04-09 16:32:10 +03:00
zvonand
6ab4a6f141 new fix 2021-04-09 12:03:58 +03:00
zvonand
ada7c03df7 New fixes 2021-04-08 15:05:10 +03:00
zvonand
35c585a200 Fix 2021-04-08 01:03:54 +03:00
zvonand
7b05bb1413 Fixed test structure 2021-04-07 22:10:41 +03:00
zvonand
9368d98945 Fixed addHours 2021-04-07 21:14:44 +03:00
Andrey Z
e84bdc6ddd Some tests resolved 2021-04-07 18:28:55 +03:00
Andrey
4548b86de8
Fixed existing XFails 2021-04-07 15:59:08 +03:00
zvonand
4f64f07ba1 Style fix 2021-04-07 14:24:22 +03:00
Andrey Z
0d6a6f4066 Resolved licences 2021-04-07 11:12:14 +03:00
Andrey Z
d601ac56de Updated tests 2021-04-07 01:48:09 +03:00
Andrey Z
86ef5907a7 Master pull 2021-04-07 01:09:50 +03:00
Alexey Milovidov
b5ecfaa3c2 Remove TestFlows (2) 2021-04-02 01:41:28 +03:00
Andrey Z
15a106c35a Updated requirements 2021-04-01 12:59:20 +03:00
Andrey Z
80a7688b62 mastermerge 2021-04-01 12:54:15 +03:00
MyroTk
9fd3cd2a21 Adding memory info to testflows RBAC 2021-03-31 08:34:52 +02:00
alexey-milovidov
0bad6adc48
Merge pull request #21551 from vzakaznikov/testflows_use_yandex_docker_repo
Updating docker/test/testflows/runner/dockerd-entrypoint.sh to use Yandex dockerhub-proxy
2021-03-22 02:27:50 +03:00
Andrey Z
5813a99900 Continious execution enabled 2021-03-17 19:47:42 +03:00
zvonand
b972dbd08e Reduced number of tests to essential-only 2021-03-15 12:06:17 +03:00
zvonand
d7393b0071 Merge branch 'master' into kerberos_tests 2021-03-15 11:53:53 +03:00
Vitaly Baranov
d6e0342c30 Improvements in implementations of the classes AccessRights and GrantedRoles. 2021-03-14 19:12:35 +03:00
zvonand
246e0dc1cf Enabled kerberos tests 2021-03-12 13:02:46 +03:00
tavplubix
2acbfd834a
Merge branch 'master' into stress_test_results 2021-03-12 12:11:33 +03:00
Denis Glazachev
290a6d273e
Add Kerberos support for authenticating existing users when accessing over HTTP 2021-03-11 23:41:10 +03:00
Vitaliy Zakaznikov
e9e4c68d12 Fixing retention precision for failing RBAC tests. 2021-03-10 07:22:18 -05:00
MyroTk
9dd232cf90 Graphite updates for all tests 2021-03-09 17:54:56 +01:00
MyroTk
084aac07c0 Graphite config fix 2021-03-09 17:07:45 +01:00
MyroTk
1293316264 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into tfs_rbac_row_policy 2021-03-09 17:07:17 +01:00
zvonand
aecd5c6d23 Added testflows tests for datetime64 extended range 2021-03-09 17:56:32 +03:00
Vitaliy Zakaznikov
3a5f4abd33 Adding test to check selecting key when key has integer type. 2021-03-07 11:53:45 -05:00
Vitaliy Zakaznikov
d3fdb15368 Adding select by key tests for value and key with string type. 2021-03-07 11:24:03 -05:00
Vitaliy Zakaznikov
80ba5c9964 Updated requirements for using keys and values subcolums with inline defined
map to use the word MAY instead of SHALL.
2021-03-07 10:02:15 -05:00
Vitaliy Zakaznikov
2ad584d9ab Updating requirement to use MAY 2021-03-07 09:56:46 -05:00
Vitaliy Zakaznikov
4db7d47e1c Updating requirements to use the word MAY instead of SHALL where
behavior is not fully defined.
2021-03-07 09:52:42 -05:00
Vitaliy Zakaznikov
8b0bda5968 Fixing performance test by removing assertion. 2021-03-07 09:11:59 -05:00
Vitaliy Zakaznikov
3b7adc8373 Updating requirements based on the review. 2021-03-05 08:48:18 -05:00
Vitaliy Zakaznikov
3e225dbcec Merge branch 'testflows_map_type_tests' of https://github.com/vzakaznikov/ClickHouse into testflows_map_type_tests 2021-03-03 14:09:23 -05:00
Vitaliy Zakaznikov
b1d043b7db Fixing configs based on review comments. 2021-03-03 14:09:04 -05:00
MyroTk
af54d857c8 Deleting old requirement 2021-03-02 01:59:31 +01:00
MyroTk
2d8321342f Minor syntax fixes 2021-03-01 17:37:11 +01:00
MyroTk
5d6b5bc276 TFS tests 2021-03-01 17:29:42 +01:00
Alexander Tokmakov
0937127ea4 fix 2021-02-27 14:01:04 +03:00
Alexander Tokmakov
fb42dec355 fix 2021-02-27 01:20:49 +03:00
Azat Khuzhin
bc1a316b28 Bump zookeeper version to 3.6.2 in tests
3.4.12 was released 1.05.2018
2021-02-26 23:41:43 +03:00
alexey-milovidov
8e770a8501
Update docker-compose.yml 2021-02-23 16:41:26 +03:00
Vitaliy Zakaznikov
4a085d7c21 Removing unused table types. 2021-02-22 15:06:45 -05:00
Vitaliy Zakaznikov
d1f8f52f16 Adding Map type tests in TestFlows 2021-02-22 15:04:34 -05:00
Azat Khuzhin
e922690453 Fix yamllint issues 2021-02-20 23:25:21 +03:00
Vitaliy Zakaznikov
64261c7720 Fixing reference to LDAP role mapping specification 2021-01-30 15:24:20 -05:00
Vitaliy Zakaznikov
eebff7155c Adding SRS source for LDAP role mapping. 2021-01-29 19:43:33 -05:00
Vitaliy Zakaznikov
8545ce1111 Adding support for retrying docker-compose start, stop and restart commands.
Fixing ldap tests to use large tail value to accomodate changes in exception length.
2021-01-29 17:55:08 -05:00
Vitaliy Zakaznikov
01d3d0aeca Fixing requirement names. 2021-01-27 10:01:47 -05:00
Vitaliy Zakaznikov
48884d2231 Adding tests to check passing invalid data types
to encrypt and aes_encrypt_mysql functions.
2021-01-27 09:27:34 -05:00
Vitaliy Zakaznikov
79cc2e4c1c Updating AES encryption SRS.
Adding test for LowCardinality(FixedString(N)) data type for plaintext.
2021-01-27 08:20:44 -05:00
Vitaliy Zakaznikov
edd4ca8c72 Starting to update AES encryption tests to support changes to
the supported data types by the encrypt plaintext parameter.
2021-01-26 14:54:26 -05:00
Vitaliy Zakaznikov
f7e61c1ed1 Enabling all TestFlows modules.
Increasing clickhouse container health check timeouts.
2021-01-18 17:03:31 -05:00
Denis Glazachev
30ab2830e0 Merge branch 'master' into ldap-role-mapping
* master: (605 commits)
  DOCSUP-4710: Added support numeric parameters in number and string data types (#18696)
  DOCSUP-5604: Edit and translate to Russian (#18929)
  Update version_date.tsv after release 21.1.2.15
  Usability improvement of clickhouse-test
  Update jit_large_requests.xml
  Update README.md
  Update images.json
  Make symbolizers available in fuzzer Docker image
  Update Dragonbox
  Speed up aggregate function sum
  Fix MSan report in Kerberos library
  Fix MSan error in rocksdb #19213
  Add more Fuzzer tasks
  Fixes
  Update comment for curl dependency for aws
  Disable curl for mariadb-connector-c (it is not required)
  Fix TSan
  Skip test for ANTLR
  DistributedBlockOutputStream: add more comments
  DistributedBlockOutputStream: Remove superfluous brackets for string construction
  ...
2021-01-18 22:55:05 +04:00
Alexey Milovidov
015e392bb7 Disable TestFlows due to low reliability 2021-01-16 11:58:23 +03:00
MyroTk
489d9d186a Looping RBAC several times 2021-01-14 21:25:37 +01:00
MyroTk
0df681a58b Moving SYSTEM SHUTDOWN out of parallel 2021-01-14 17:57:44 +01:00
MyroTk
944d53d691 Running RBAC just once 2021-01-13 18:20:29 +01:00
MyroTk
43f350c0d1 Enabling RBAC tests to look for fails. Adding new tests 2021-01-13 15:55:48 +01:00
Alexey Milovidov
0421cc8dc2 Remove TestFlows due to timeouts 2021-01-10 03:49:29 +03:00
Vitaliy Zakaznikov
4f0068bdde Fixing inproper usage of And step. 2021-01-07 18:42:54 -05:00
Vitaliy Zakaznikov
38bc0f8348 Updating verification cooldown performance and valid verification cooldown value ldap unavailable
tests to fix fails due to timing issues caused by slow test executions.
2021-01-06 08:16:01 -05:00
Denis Glazachev
8893fbcf8e Rename {username} to {user_name}
Add caching/checking of search_params
Adjust comments/doc
Use special authentication logic from ExternalAuthenticators::checkLDAPCredentials
2021-01-06 07:40:47 +04:00
Denis Glazachev
c8cf51b81e Merge branch 'master' into ldap-role-mapping
* master: (620 commits)
  Add test for some possible ambiguities in syntax
  Update PushingToViewsBlockOutputStream.h
  [For #18707] MySQL compatibility: support DIV and MOD operators
  Mark another flaky test
  Remove some headers
  Mark some TestFlows as flaky
  Fix error
  Fix errors
  One more test
  Arcadia does not support distributed queries
  Add a test for #14974
  Added a test from #15641
  More robust stateful test
  Update tests
  Remove bad code in HashJoin
  Update test
  Don't allow conversion between UUID and numeric types
  Remove pink screen with confusing questions about Kerberos
  Do not throw from Parser
  Fix the unexpected behaviour of show tables when antlr parser enabled (#18431)
  ...

# Conflicts:
#	programs/server/config.xml
#	src/Access/Authentication.cpp
#	src/Access/Authentication.h
2021-01-06 03:42:02 +04:00
Alexey Milovidov
38b3d28443 Mark another flaky test 2021-01-05 06:26:53 +03:00
Alexey Milovidov
0b65605c34 Mark some TestFlows as flaky 2021-01-05 05:30:24 +03:00
Vitaliy Zakaznikov
d53919d832 Updating ldap/external_user_directory/requirements/requirements.py 2020-12-23 14:46:47 -05:00
Vitaliy Zakaznikov
13e633c1ad Regenerating ldap/authentication/requirements/requirements.py 2020-12-23 13:17:18 -05:00
Vitaliy Zakaznikov
c12695ceed Merge branch 'master' of https://github.com/traceon/ClickHouse into ldap-role-mapping 2020-12-23 09:38:08 -05:00
Vitaliy Zakaznikov
26ca04c92d Merge branch 'master' of https://github.com/traceon/ClickHouse into ldap-cache-login 2020-12-23 08:17:12 -05:00
Vitaliy Zakaznikov
b641b64d39 Removing Altinity internal issue references. 2020-12-19 18:01:30 -05:00
Vitaliy Zakaznikov
dcbf080047 Updating requirements and tests as CFB1 and CFB8 modes are no longer supported. 2020-12-19 17:19:01 -05:00
Vitaliy Zakaznikov
b751144709 Adding back running of aes_encryption module. 2020-12-19 10:04:28 -05:00
Vitaliy Zakaznikov
38f0f25ab2 Reverting back aes-encryption tests. 2020-12-19 10:03:18 -05:00
Vitaliy Zakaznikov
d3abc0d664 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into simplify_testflows_aes_encryption_requirements 2020-12-19 08:09:00 -05:00
alexey-milovidov
086916a853
Update regression.py 2020-12-19 03:32:50 +03:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
alexey-milovidov
8491bcad22
Delete requirements.py 2020-12-18 18:02:19 +03:00
Vitaliy Zakaznikov
f3a8f5dc45 Merging requirements for AES encryption functions.
Updating aes_encryption tests to use new requirements.
Updating TestFlows version to 1.6.72.
2020-12-18 09:06:36 -05:00
Alexey Milovidov
2b09856ce5 Temporarily remove TestFlows before #18208 2020-12-18 06:40:36 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
Vitaliy Zakaznikov
766dd763ec Fixing requirement name in tests/testflows/example/tests/example.py 2020-12-17 18:16:33 -05:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
Vitaly Baranov
da18af96a3 Fix access rights required for the merge() table function. 2020-12-17 12:29:07 +03:00
Alexey Milovidov
d5471cda52 Attempt to remove TestFlows 2020-12-17 08:10:20 +03:00
Alexander Tokmakov
f9f7da5f97 fix 2020-12-11 15:06:19 +03:00
Vitaliy Zakaznikov
c0d529c49d Small fix to the test/testflows/README.md 2020-12-04 19:27:41 -05:00
Vitaliy Zakaznikov
4cd6ee04d8 Updating TestFlows README.md to include "How To Debug Why Test Failed" section. 2020-12-04 19:11:11 -05:00
MyroTk
e2c6430a6e Testflows RBAC ACCESS MANAGEMENT tests. 2020-12-04 18:36:32 +01:00
Vitaliy Zakaznikov
b6c2743103 Updating TestFlows tests to support changes for LDAP role mapping. 2020-12-03 22:52:35 -05:00
MyroTk
2cbf2d8f7b New RBAC testflows tests for SHOW, TRUNCATE, KILL, and OPTIMIZE.
Updates to old tests.
2020-12-01 05:58:45 +01:00
Vitaly Baranov
65719da0d8
Merge pull request #16977 from MyroTk/rbac_attach_create_drop_detach_testflows
RBAC Testflows tests for ATTACH, CREATE, DROP, and DETACH
2020-11-24 18:31:44 +03:00
Tai White
c1662b6a4b Added line removed by mistake 2020-11-23 21:21:30 +01:00
Tai White
2bc32fe292 Added verification cooldown requirements and tests to the ldap/external_user_directory SRS and test files 2020-11-20 23:21:13 +01:00
Tai White
43fce34eec Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-cache-login 2020-11-20 20:56:36 +01:00
Vitaliy Zakaznikov
dbb5f6722e Moving to using TestFlows version 1.6.65
Fixing unstable test in tests/testflows/ldap/external_user_directory/tests/authentications.py
2020-11-17 20:22:43 -05:00
Tai White
61339ea3fc fixed header for SRS in /ldap/authentication requirements 2020-11-18 01:36:35 +01:00