Commit Graph

294 Commits

Author SHA1 Message Date
Vitaliy Zakaznikov
38bc0f8348 Updating verification cooldown performance and valid verification cooldown value ldap unavailable
tests to fix fails due to timing issues caused by slow test executions.
2021-01-06 08:16:01 -05:00
Denis Glazachev
8893fbcf8e Rename {username} to {user_name}
Add caching/checking of search_params
Adjust comments/doc
Use special authentication logic from ExternalAuthenticators::checkLDAPCredentials
2021-01-06 07:40:47 +04:00
Denis Glazachev
c8cf51b81e Merge branch 'master' into ldap-role-mapping
* master: (620 commits)
  Add test for some possible ambiguities in syntax
  Update PushingToViewsBlockOutputStream.h
  [For #18707] MySQL compatibility: support DIV and MOD operators
  Mark another flaky test
  Remove some headers
  Mark some TestFlows as flaky
  Fix error
  Fix errors
  One more test
  Arcadia does not support distributed queries
  Add a test for #14974
  Added a test from #15641
  More robust stateful test
  Update tests
  Remove bad code in HashJoin
  Update test
  Don't allow conversion between UUID and numeric types
  Remove pink screen with confusing questions about Kerberos
  Do not throw from Parser
  Fix the unexpected behaviour of show tables when antlr parser enabled (#18431)
  ...

# Conflicts:
#	programs/server/config.xml
#	src/Access/Authentication.cpp
#	src/Access/Authentication.h
2021-01-06 03:42:02 +04:00
Alexey Milovidov
38b3d28443 Mark another flaky test 2021-01-05 06:26:53 +03:00
Alexey Milovidov
0b65605c34 Mark some TestFlows as flaky 2021-01-05 05:30:24 +03:00
Vitaliy Zakaznikov
d53919d832 Updating ldap/external_user_directory/requirements/requirements.py 2020-12-23 14:46:47 -05:00
Vitaliy Zakaznikov
13e633c1ad Regenerating ldap/authentication/requirements/requirements.py 2020-12-23 13:17:18 -05:00
Vitaliy Zakaznikov
c12695ceed Merge branch 'master' of https://github.com/traceon/ClickHouse into ldap-role-mapping 2020-12-23 09:38:08 -05:00
Vitaliy Zakaznikov
26ca04c92d Merge branch 'master' of https://github.com/traceon/ClickHouse into ldap-cache-login 2020-12-23 08:17:12 -05:00
Vitaliy Zakaznikov
b641b64d39 Removing Altinity internal issue references. 2020-12-19 18:01:30 -05:00
Vitaliy Zakaznikov
dcbf080047 Updating requirements and tests as CFB1 and CFB8 modes are no longer supported. 2020-12-19 17:19:01 -05:00
Vitaliy Zakaznikov
b751144709 Adding back running of aes_encryption module. 2020-12-19 10:04:28 -05:00
Vitaliy Zakaznikov
38f0f25ab2 Reverting back aes-encryption tests. 2020-12-19 10:03:18 -05:00
Vitaliy Zakaznikov
d3abc0d664 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into simplify_testflows_aes_encryption_requirements 2020-12-19 08:09:00 -05:00
alexey-milovidov
086916a853
Update regression.py 2020-12-19 03:32:50 +03:00
alexey-milovidov
3261392f16
Merge pull request #18208 from vzakaznikov/update_testflows_version_to_1.6.72
Updating TestFlows version to the latest 1.6.72
2020-12-18 18:03:00 +03:00
alexey-milovidov
8491bcad22
Delete requirements.py 2020-12-18 18:02:19 +03:00
Vitaliy Zakaznikov
f3a8f5dc45 Merging requirements for AES encryption functions.
Updating aes_encryption tests to use new requirements.
Updating TestFlows version to 1.6.72.
2020-12-18 09:06:36 -05:00
Alexey Milovidov
2b09856ce5 Temporarily remove TestFlows before #18208 2020-12-18 06:40:36 +03:00
Alexey Milovidov
1be41beca0 Merge branch 'master' into boringssl2 2020-12-18 05:59:30 +03:00
Vitaliy Zakaznikov
766dd763ec Fixing requirement name in tests/testflows/example/tests/example.py 2020-12-17 18:16:33 -05:00
Vitaliy Zakaznikov
7db2652ab3 Updating TestFlows test version to the latest 1.6.72
Re-generating all requirements.py
2020-12-17 18:02:07 -05:00
Vitaly Baranov
da18af96a3 Fix access rights required for the merge() table function. 2020-12-17 12:29:07 +03:00
Alexey Milovidov
d5471cda52 Attempt to remove TestFlows 2020-12-17 08:10:20 +03:00
Alexander Tokmakov
f9f7da5f97 fix 2020-12-11 15:06:19 +03:00
Vitaliy Zakaznikov
c0d529c49d Small fix to the test/testflows/README.md 2020-12-04 19:27:41 -05:00
Vitaliy Zakaznikov
4cd6ee04d8 Updating TestFlows README.md to include "How To Debug Why Test Failed" section. 2020-12-04 19:11:11 -05:00
MyroTk
e2c6430a6e Testflows RBAC ACCESS MANAGEMENT tests. 2020-12-04 18:36:32 +01:00
Vitaliy Zakaznikov
b6c2743103 Updating TestFlows tests to support changes for LDAP role mapping. 2020-12-03 22:52:35 -05:00
MyroTk
2cbf2d8f7b New RBAC testflows tests for SHOW, TRUNCATE, KILL, and OPTIMIZE.
Updates to old tests.
2020-12-01 05:58:45 +01:00
Vitaly Baranov
65719da0d8
Merge pull request #16977 from MyroTk/rbac_attach_create_drop_detach_testflows
RBAC Testflows tests for ATTACH, CREATE, DROP, and DETACH
2020-11-24 18:31:44 +03:00
Tai White
c1662b6a4b Added line removed by mistake 2020-11-23 21:21:30 +01:00
Tai White
2bc32fe292 Added verification cooldown requirements and tests to the ldap/external_user_directory SRS and test files 2020-11-20 23:21:13 +01:00
Tai White
43fce34eec Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap-cache-login 2020-11-20 20:56:36 +01:00
Vitaliy Zakaznikov
dbb5f6722e Moving to using TestFlows version 1.6.65
Fixing unstable test in tests/testflows/ldap/external_user_directory/tests/authentications.py
2020-11-17 20:22:43 -05:00
Tai White
61339ea3fc fixed header for SRS in /ldap/authentication requirements 2020-11-18 01:36:35 +01:00
Tai White
e42ea7b8b9 Deleted ldap directory added by mistake.
Added verification cooldown tests to the ldap/authentication feature.
2020-11-17 19:41:28 +01:00
MyroTk
151f84d845 Updating XFails 2020-11-13 19:44:32 +01:00
MyroTk
bf68f35ee6 RBAC Testflows tests for ATTACH, CREATE, DROP, and DETACH 2020-11-13 08:59:50 +01:00
Denis Glazachev
0e704ec278
Merge branch 'master' into ldap-cache-login 2020-11-10 00:10:22 +04:00
MyroTk
d78d07f825 xfails for ALTER MOVE 2020-11-07 01:48:29 +01:00
MyroTk
381ed50bef Enabling existing testflows tests. 2020-11-07 01:39:22 +01:00
MyroTk
02a071e88f RBAC Testflows - Instrumenting server log for debug and new ALTER tests 2020-11-05 17:51:17 +01:00
Vitaliy Zakaznikov
e6d04b4780 Merge branch 'master' of https://github.com/traceon/ClickHouse into ldap-cache-login 2020-11-03 16:53:23 -05:00
Vitaliy Zakaznikov
d4e640daae Updating TestFlows to 1.6.59
Updating AES encryption requirements.py to include Specification
Updating AES regression.py to link Specification
Fixing typos in LDAP authentication SRS
2020-10-27 18:50:59 -04:00
Vitaliy Zakaznikov
2953795330 Fixing bug in LDAP add_config method where log size was grabbed before container was stopped.
Updating ldap/external_user_directory/tests/authentications.py to reduce test time.
2020-10-27 18:45:04 -04:00
MyroTk
19ffffa153 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_RBAC_tests 2020-10-26 15:52:34 +01:00
Vitaliy Zakaznikov
1567a3976b Adding requirements related to the LDAP login cache feature.
Updated syntax tests.
Linked specifications to ldap/authentication and ldap/external_user_directory features.
2020-10-26 09:28:46 -04:00
Vitaliy Zakaznikov
be95d3d854 Fixing another issue in LDAP tests. 2020-10-25 21:09:14 -04:00
Vitaliy Zakaznikov
4bcbcfed1f Fixing procedure of getting log file size in LDAP tests.
Increasing default timeouts.
2020-10-25 09:40:19 -04:00
MyroTk
6b64ac8536 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_RBAC_tests 2020-10-24 01:00:07 +02:00
MyroTk
d42a049d9d small fixes 2020-10-24 00:59:38 +02:00
Vitaliy Zakaznikov
e743d2fd26 * Fixing tests in the tests/testflows/ldap/external_user_directory/tests/authentications.py suite
* Moving TestFlows runs to use classic output format for stdout
* Moving to TestFlows 1.6.57
* Updating LDAP test code styling
2020-10-22 19:14:58 -04:00
MyroTk
0da6e855c0 getuid changes in common and specification 2020-10-22 00:04:09 +02:00
MyroTk
3447420761 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_RBAC_tests 2020-10-21 23:08:23 +02:00
alexey-milovidov
2b00b5391a
Merge pull request #11844 from Enmk/AES_encrypt_decrypt
encrypt and decrypt functions
2020-10-20 22:57:35 +03:00
MyroTk
e5bff1e0d4 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_RBAC_tests 2020-10-20 00:35:54 +02:00
MyroTk
70fb557ff8 xfails change 2020-10-19 21:49:03 +02:00
MyroTk
34beb9308b increase timeout 2020-10-19 18:48:39 +02:00
Vasily Nemkov
f0d5ade1c1 Fixed argument checks and updated tests accordingly 2020-10-17 19:50:58 +03:00
MyroTk
f62ec33c73 docker-down timeout increase 2020-10-16 19:24:56 +02:00
MyroTk
2efc9dd4e2 cleanup 2020-10-15 22:33:25 +02:00
MyroTk
708fedbcf8 testflows RBAC tests for views, distributed tables, public tables, and privileges: alter, updated select, updated insert, and show tables 2020-10-15 22:23:49 +02:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Vitaliy Zakaznikov
f34274dc08 Updating requirements and adding restart tests for LDAP external user directory test suite. 2020-10-12 19:54:07 -04:00
Vitaliy Zakaznikov
1103ce0d78 Updating exit codes and messages in failing tests. 2020-10-08 15:36:03 -04:00
Vitaliy Zakaznikov
eb1b3e39e7 Adding additional parallel login tests to the external user directory feature. 2020-10-02 17:40:24 -04:00
Denis Glazachev
44916af70a Merge branch 'master' into ldap-any-user-authentication
* master: (279 commits)
  Convert to python3 (#15007)
  update en and ru docs: add 128/256 types (#15515)
  Drop unused code for numeric_limits<int128> in MergeTreeDataSelectExecutor (#15519)
  Fix comment
  More defaults on defaults
  Recursive defaults
  Fix bash
  Update ActionsVisitor.cpp
  Don't add memcpy for sanitizers builds
  Fix gRPC build scripts.
  Neutrialize thinlto's memcpy libcall gen.
  Revert "Add fno-builtin-memcpy"
  Throw an error when a single parameter is passed to ReplicatedMergeTree instead of ignoring it
  Update SECURITY.md
  Update tsan_suppressions.txt
  Update ActionsVisitor.cpp
  remove unrelated changes
  Update SECURITY.md
  fixes
  Update ActionsVisitor.cpp
  ...
2020-10-03 00:45:57 +04:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
Vitaliy Zakaznikov
80c334a5ac Fixing user_lookup_priority test. 2020-10-01 07:21:38 -04:00
Vitaliy Zakaznikov
8a707b1bb4 Adding paralle login of rbac users test. 2020-09-30 21:40:07 -04:00
Vitaliy Zakaznikov
581a14be50 Adding SRS source for LDAP external user directory.
Small updates to helpers/cluster.py.
Updating link in the ldap/authentication/requirements/requirements.md.
2020-09-30 22:48:32 +02:00
Vitaliy Zakaznikov
162541217f Updating tests to match changes in the behavior. 2020-09-29 22:58:09 +02:00
Denis Glazachev
8f2c23e6de Merge branch 'master' into ldap-any-user-authentication
* master: (224 commits)
  Update in.md
  Add a test for embedded configs
  Allow to run without /proc/self/maps
  Update adopters.md
  More convenient
  Enable embedded configs for AArch64
  More results
  More handy
  More handy
  Added a comment
  Adjustments
  Adjustments
  Adjustments
  Added new results
  Step 1: make adding hardware benchmark results more convenient
  Revert "Avoid deadlocks in Log/TinyLog"
  Fix MSan report in QueryLog
  add some disabled tests from arcadia to skip_list.json
  Update skip_list.json
  Bump CI. [2]
  ...

# Conflicts:
#	docker/test/testflows/runner/Dockerfile
2020-09-25 17:33:50 +04:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
Alexey Milovidov
799a675b5d Merge branch 'master' into AES_encrypt_decrypt 2020-09-17 21:42:51 +03:00
Vitaliy Zakaznikov
320add7047 Adding source for the SRS. 2020-09-15 14:57:36 +03:00
Vitaliy Zakaznikov
f727f7bc99 * Updating config.xml files to remove users_config and access_control_path parameter
definition as these are now defined inside the user_directories section and
  cause a test failure due to https://github.com/ClickHouse/ClickHouse/issues/14511.
* Removing the usage of `EXISTS` clauses used in tests outside of clean ups.
2020-09-09 16:14:02 +02:00
Denis Glazachev
59e0c10aaf Merge branch 'master' into ldap-any-user-authentication 2020-09-03 19:36:19 +04:00
Vitaliy Zakaznikov
85b913deaa Adding regression tests for LDAP external user directory. 2020-09-03 16:53:09 +02:00
Vitaliy Zakaznikov
af23a27f9f Reorganizing ldap tests. 2020-09-03 15:53:34 +02:00
alexey-milovidov
bfa5a9ef03
Merge pull request #13987 from vitlibar/fix-grant-all-on-table
Fix GRANT ALL statement when executed on a non-global level
2020-09-02 05:06:32 +03:00
Vitaliy Zakaznikov
266b231a3c Adding AES encryption tests in TestFlows. 2020-09-01 12:42:23 +03:00
Vitaliy Zakaznikov
a321cf2be6 Fixing step name issue. 2020-08-26 19:13:16 -04:00
Vitaliy Zakaznikov
ece2513695 Fixing error when setting env variable. 2020-08-26 14:02:12 -04:00
Vitaliy Zakaznikov
eb01601944 Adding retry login when bringing docker-compose cluster
Moving to using testflows version 1.6.42
2020-08-26 10:00:12 -04:00
Vitaly Baranov
0f3351d983 Fix testflows checks. 2020-08-26 13:22:08 +03:00
Vitaly Baranov
ad03ff3887 Rename storages users.xml=>users_xml, disk=>local_directory. 2020-08-16 16:42:57 +03:00
Vitaliy Zakaznikov
dfb7cb999e Updating healthcheck parameters. 2020-08-15 19:52:27 -04:00
Vitaliy Zakaznikov
6a517be3b2 * Moving to standard healthcheck parameters.
* Adding docker-compose pull and docker-compose down before executing docker-compose up.
* Adding docker-compose ps if any of the containers are unhealthy.
2020-08-15 14:24:33 -04:00
Vitaliy Zakaznikov
d25d67fcac Adding missing certificates and dhparam.pem for openldap4. 2020-08-15 13:22:46 -04:00
Vitaliy Zakaznikov
64e9095b9a Fixing issue with CREATE and DROP USER command by quoting user argument. 2020-08-13 09:54:12 -04:00
Vitaliy Zakaznikov
67df35962e Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into ldap_create_user_identified_with_ldap_server 2020-08-13 08:49:33 -04:00
Vitaliy Zakaznikov
55c70e6ecb Fixing test clickhouse/ldap authentication/user authentications/rbac=True/login after user cn changed in ldap. 2020-08-13 07:40:11 -04:00
Vitaliy Zakaznikov
034c680a05 * Adding Markdown source for the requirements
* Adding a requirement to be able to add users identified
  with an LDAP server using RBAC
* Updating requirements.py
2020-08-12 16:55:46 -04:00
Vitaliy Zakaznikov
96d10a76d8 Updating LDAP user authentication suite to check user
authentications when users are added using RBAC.
2020-08-12 16:30:26 -04:00
Vitaliy Zakaznikov
5b677e1536 Incresing health-check timeouts for clickhouse nodes in the all the modules.
Adding support to dump docker-compose logs if unhealthy containers found.
2020-08-11 14:09:36 +02:00
vladimir golovchenko
a45a85f9e5 Fixed tests: added the missed types of interval (WEEK, MONTH, QUARTER, YEAR) to CREATE/ALTER QUOTA statements. 2020-08-08 01:22:58 -07:00
MyroTk
71ac6aa855 Adding RBAC testing to INSERT and expanding tables for testing SELECT 2020-08-04 19:33:02 +00:00
Vitaly Baranov
0c5b0abfe2
Merge pull request #13061 from ritaank/select_pr
Added testing for RBAC functionality of SELECT privilege
2020-08-04 13:51:32 +03:00
Vitaliy Zakaznikov
3d5ff68611 Applying ldap test fixes. 2020-08-04 01:19:22 +02:00
ritaank
62dd8d91c9 whitespace cleanup 2020-08-03 03:40:58 -07:00
ritaank
4910435f6c select.py: requirements cleanup + syntax update 2020-08-03 03:24:05 -07:00
ritaank
14befce49b Merge branch 'master' into select_pr 2020-08-02 22:36:08 -07:00
ritaank
a9a6e23641 Merge branch 'master' of github.com:ritaank/ClickHouse into select_pr 2020-08-02 22:31:17 -07:00
MyroTk
822de7ebc8 Correct syntax tests to match master 2020-07-30 19:44:41 +00:00
MyroTk
757611e0b0 Syntax tests to match master 2020-07-30 19:22:21 +00:00
MyroTk
e72f8c9506 Updated requirements.md to include github links instead of gitlab 2020-07-30 19:17:34 +00:00
MyroTk
e583c573b1 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into insert_pr 2020-07-30 19:13:10 +00:00
Vitaliy Zakaznikov
c93acd0935 Fixing links to the git repository. 2020-07-30 21:00:47 +02:00
MyroTk
158afe06a2 Updating requirements for the INSERT RBAC tests 2020-07-30 18:22:46 +00:00
MyroTk
4d5a8ee9a6 Updated requirements for the INSERT RBAC tests 2020-07-30 16:18:57 +00:00
Vitaliy Zakaznikov
4596d262cc Updating expected error messages to fix failing tests. 2020-07-30 14:09:07 +02:00
Vitaliy Zakaznikov
29ed1aa670 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into testflows_rbac_syntax_tests 2020-07-29 19:16:23 -04:00
MyroTk
a82ac93d24 Updated to include ipv6 hosts 2020-07-29 17:16:06 +00:00
root
06f88a3caa Updated formating of insert.py tests 2020-07-29 16:09:43 +00:00
root
0f6b6b9eb7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into insert_pr 2020-07-29 15:10:57 +00:00
ritaank
1c6fe68adf adding tests for GRANT SELECT 2020-07-29 01:01:16 -07:00
Vitaliy Zakaznikov
fc89cc5caa Adding extra xfails for some ldap tests. 2020-07-28 20:16:55 -04:00
Vitaliy Zakaznikov
afe4532095 Updating README.md. 2020-07-28 16:44:46 -04:00
Vitaliy Zakaznikov
a03d1d1381 * Adding requirements markdown source.
* Updating README.md to include an example of how to run selected tests.
2020-07-28 16:41:10 -04:00
root
58ffc5263e Added functionality tests to INSERT privilege 2020-07-28 20:14:52 +00:00
Vitaliy Zakaznikov
72f403bb14 Increasing shell default timeout to 120 sec. 2020-07-24 10:05:13 -04:00
Vitaliy Zakaznikov
015250816d Adding execution of the rbac.regression module. 2020-07-22 07:35:54 -04:00
Vitaliy Zakaznikov
086d133df7 * Fixing issue with configs missings in the config.d folder
* Fixing import in alter_quota.py
2020-07-21 14:40:43 -04:00
Vitaliy Zakaznikov
644ccd33cb * Adding rbac module
* Adding rbac syntax tests
2020-07-21 13:51:02 -04:00
Vitaliy Zakaznikov
1426a708bc Fixing tests to support changing configuration via server restart. 2020-07-15 18:45:50 +02:00
Vitaliy Zakaznikov
749deaf122 Adding wait for config reload message when deleting old configuration file. 2020-07-14 17:00:19 +02:00
Vitaliy Zakaznikov
2c3ae1600f Adding -n 0 to the tail command. 2020-07-14 13:44:40 +02:00
Vitaliy Zakaznikov
e57e51e812 * Removing hard coded sleep. 2020-07-13 22:38:06 +02:00
Vitaliy Zakaznikov
7d1b0a06f2 * Moving to updating configs without restart. 2020-07-13 22:36:56 +02:00
Vitaliy Zakaznikov
a012ae3a70 * Updating exitcodes in server_config.py.
* Addintion positive check when user password in LDAP changes.
2020-07-09 22:01:53 +02:00
Denis Glazachev
5a4762bb8a
Merge branch 'master' into ldap-per-user-authentication 2020-07-09 14:50:02 +04:00
Vitaliy Zakaznikov
58b91a1d0b Updating tests to match new exit codes. 2020-07-08 17:41:34 +02:00
alesapin
c7729e465a Hide nonzero error code on testflows runner 2020-07-08 13:10:53 +03:00
Vitaliy Zakaznikov
e5a3002b75 Adding ldap regression tests. 2020-07-08 00:05:34 +02:00
Denis Glazachev
917b56c094
Merge branch 'master' into ldap-per-user-authentication 2020-07-08 00:51:44 +04:00
alesapin
f5a7d8a5c7 Add runner for testflows 2020-07-07 15:35:06 +03:00
Vitaliy Zakaznikov
3f9dd7f62b Fix small typo. 2020-07-02 21:02:15 +02:00
Vitaliy Zakaznikov
464eb70ca4 Removing unnecessary text. 2020-07-02 20:52:17 +02:00
Vitaliy Zakaznikov
a233aa257d Small changes to the SRS template. 2020-07-02 20:48:17 +02:00
Vitaliy Zakaznikov
321bad14ee Adding a template of the SRS with the notes how to use it. 2020-07-02 20:41:28 +02:00
Vitaliy Zakaznikov
22aabf8da3 Adding a simple example of using TestFlows. 2020-07-02 17:58:13 +02:00
Vitaliy Zakaznikov
45d819949a * Moving testflows tests into tests/testflows directory.
* Adding a simple README.md.
2020-07-02 17:08:35 +02:00