thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-18 21:51:57 +00:00
Code Issues Packages Projects Releases Wiki Activity
30f96dc525
ClickHouse/tests/integration/test_quota/test.py

370 lines
19 KiB
Python
Raw Normal View History

Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
import os
import re
import time
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
import pytest
from helpers.cluster import ClickHouseCluster
from helpers.test_tools import assert_eq_with_retry, TSV
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
cluster = ClickHouseCluster(__file__)
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
instance = cluster.add_instance('instance', user_configs=["configs/users.d/assign_myquota.xml",
"configs/users.d/drop_default_quota.xml",
"configs/users.d/quota.xml"])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
def check_system_quotas(canonical):
canonical_tsv = TSV(canonical)
r = TSV(instance.query("SELECT * FROM system.quotas ORDER BY name"))
print("system_quotas: {},\ncanonical: {}".format(r, TSV(canonical_tsv)))
assert r == canonical_tsv
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
def system_quota_limits(canonical):
canonical_tsv = TSV(canonical)
r = TSV(instance.query("SELECT * FROM system.quota_limits ORDER BY quota_name, duration"))
print("system_quota_limits: {},\ncanonical: {}".format(r, TSV(canonical_tsv)))
assert r == canonical_tsv
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
def system_quota_usage(canonical):
canonical_tsv = TSV(canonical)
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
query = "SELECT quota_name, quota_key, duration, queries, max_queries, errors, max_errors, result_rows, max_result_rows," \
"result_bytes, max_result_bytes, read_rows, max_read_rows, read_bytes, max_read_bytes, max_execution_time " \
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
"FROM system.quota_usage ORDER BY duration"
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
r = TSV(instance.query(query))
print("system_quota_usage: {},\ncanonical: {}".format(r, TSV(canonical_tsv)))
assert r == canonical_tsv
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
def system_quotas_usage(canonical):
canonical_tsv = TSV(canonical)
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
query = "SELECT quota_name, quota_key, is_current, duration, queries, max_queries, errors, max_errors, result_rows, max_result_rows, " \
"result_bytes, max_result_bytes, read_rows, max_read_rows, read_bytes, max_read_bytes, max_execution_time " \
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
"FROM system.quotas_usage ORDER BY quota_name, quota_key, duration"
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
r = TSV(instance.query(query))
print("system_quotas_usage: {},\ncanonical: {}".format(r, TSV(canonical_tsv)))
assert r == canonical_tsv
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
def copy_quota_xml(local_file_name, reload_immediately=True):
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
script_dir = os.path.dirname(os.path.realpath(__file__))
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
instance.copy_file_to_container(os.path.join(script_dir, local_file_name),
'/etc/clickhouse-server/users.d/quota.xml')
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
if reload_immediately:
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
instance.query("SYSTEM RELOAD CONFIG")
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
@pytest.fixture(scope="module", autouse=True)
def started_cluster():
try:
cluster.start()
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("CREATE TABLE test_table(x UInt32) ENGINE = MergeTree ORDER BY tuple()")
instance.query("INSERT INTO test_table SELECT number FROM numbers(50)")
yield cluster
finally:
cluster.shutdown()
@pytest.fixture(autouse=True)
def reset_quotas_and_usage_info():
try:
yield
finally:
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("DROP QUOTA IF EXISTS qA, qB")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
copy_quota_xml('simpliest.xml') # To reset usage info.
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
copy_quota_xml('normal_limits.xml')
def test_quota_from_users_xml():
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", [31556952],
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quotas_usage(
[["myQuota", "default", 1, 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 1, 1000, 0, "\N", 50, "\N", 200, "\N", 50, 1000, 200, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT COUNT() from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 2, 1000, 0, "\N", 51, "\N", 208, "\N", 50, 1000, 200, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_simpliest_quota():
# Simpliest quota doesn't even track usage.
copy_quota_xml('simpliest.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[]", 0,
"['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits("")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_tracking_quota():
# Now we're tracking usage.
copy_quota_xml('tracking.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, "\N", "\N", "\N", "\N", "\N", "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 0, "\N", 0, "\N", 0, "\N", 0, "\N", 0, "\N", 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 1, "\N", 0, "\N", 50, "\N", 200, "\N", 50, "\N", 200, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT COUNT() from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 2, "\N", 0, "\N", 51, "\N", 208, "\N", 50, "\N", 200, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_exceed_quota():
# Change quota, now the limits are tiny so we will exceed the quota.
copy_quota_xml('tiny_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1, 1, 1, "\N", 1, "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 0, 1, 0, 1, 0, 1, 0, "\N", 0, 1, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
assert re.search("Quota.*has\ been\ exceeded", instance.query_and_get_error("SELECT * from test_table"))
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_usage([["myQuota", "default", 31556952, 1, 1, 1, 1, 0, 1, 0, "\N", 50, 1, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Change quota, now the limits are enough to execute queries.
copy_quota_xml('normal_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 1, 1000, 1, "\N", 0, "\N", 0, "\N", 50, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 2, 1000, 1, "\N", 50, "\N", 200, "\N", 100, 1000, 200, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_add_remove_interval():
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", [31556952],
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Add interval.
copy_quota_xml('two_intervals.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']",
"[31556952,63113904]", 0, "['default']", "[]"]])
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"],
["myQuota", 63113904, 1, "\N", "\N", "\N", 30000, "\N", 20000, 120]])
system_quota_usage([["myQuota", "default", 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"],
["myQuota", "default", 63113904, 0, "\N", 0, "\N", 0, "\N", 0, 30000, 0, "\N", 0, 20000, 120]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 1, 1000, 0, "\N", 50, "\N", 200, "\N", 50, 1000, 200, "\N", "\N"],
["myQuota", "default", 63113904, 1, "\N", 0, "\N", 50, "\N", 200, 30000, 50, "\N", 200, 20000, 120]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Remove interval.
copy_quota_xml('normal_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", [31556952],
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 1, 1000, 0, "\N", 50, "\N", 200, "\N", 50, 1000, 200, "\N", "\N"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", 31556952, 2, 1000, 0, "\N", 100, "\N", 400, "\N", 100, 1000, 400, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Remove all intervals.
copy_quota_xml('simpliest.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[]", 0,
"['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits("")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quota_usage(
[["myQuota", "default", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Add one interval back.
copy_quota_xml('normal_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", [31556952],
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
system_quota_usage([["myQuota", "default", 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_add_remove_quota():
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", [31556952],
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quotas_usage(
[["myQuota", "default", 1, 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Add quota.
copy_quota_xml('two_quotas.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"],
["myQuota2", "4590510c-4d13-bf21-ec8a-c2187b092e73", "users.xml", "['client_key','user_name']",
"[3600,2629746]", 0, "[]", "[]"]])
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"],
["myQuota2", 3600, 1, "\N", "\N", 4000, 400000, 4000, 400000, 60],
["myQuota2", 2629746, 0, "\N", "\N", "\N", "\N", "\N", "\N", 1800]])
system_quotas_usage(
[["myQuota", "default", 1, 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Drop quota.
copy_quota_xml('normal_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quotas_usage(
[["myQuota", "default", 1, 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Drop all quotas.
copy_quota_xml('no_quotas.xml')
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
check_system_quotas("")
system_quota_limits("")
system_quotas_usage("")
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
# Add one quota back.
copy_quota_xml('normal_limits.xml')
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
system_quotas_usage(
[["myQuota", "default", 1, 31556952, 0, 1000, 0, "\N", 0, "\N", 0, "\N", 0, 1000, 0, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
def test_reload_users_xml_by_timer():
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
check_system_quotas([["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", "['user_name']", "[31556952]",
0, "['default']", "[]"]])
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
system_quota_limits([["myQuota", 31556952, 0, 1000, "\N", "\N", "\N", 1000, "\N", "\N"]])
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
time.sleep(1) # The modification time of the 'quota.xml' file should be different,
# because config files are reload by timer only when the modification time is changed.
Add an integration test for quotas.
2019-11-16 13:54:41 +00:00
copy_quota_xml('tiny_limits.xml', reload_immediately=False)
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert_eq_with_retry(instance, "SELECT * FROM system.quotas", [
["myQuota", "e651da9c-a748-8703-061a-7e5e5096dae7", "users.xml", ['user_name'], "[31556952]", 0, "['default']",
"[]"]])
assert_eq_with_retry(instance, "SELECT * FROM system.quota_limits",
[["myQuota", 31556952, 0, 1, 1, 1, "\N", 1, "\N", "\N"]])
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
def test_dcl_introspection():
assert instance.query("SHOW QUOTAS") == "myQuota\n"
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert instance.query(
"SHOW CREATE QUOTA") == "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000 TO default\n"
assert instance.query(
"SHOW CREATE QUOTAS") == "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000 TO default\n"
assert re.match(
"myQuota\\tdefault\\t.*\\t31556952\\t0\\t1000\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t1000\\t0\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert re.match(
"myQuota\\tdefault\\t.*\\t31556952\\t1\\t1000\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t1000\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
Add new command SHOW ACCESS.
2020-06-10 23:08:37 +00:00
expected_access = "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000 TO default\n"
assert expected_access in instance.query("SHOW ACCESS")
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
# Add interval.
copy_quota_xml('two_intervals.xml')
assert instance.query("SHOW QUOTAS") == "myQuota\n"
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert instance.query(
"SHOW CREATE QUOTA") == "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000, FOR RANDOMIZED INTERVAL 2 year MAX result_bytes = 30000, read_bytes = 20000, execution_time = 120 TO default\n"
assert re.match(
"myQuota\\tdefault\\t.*\\t31556952\\t1\\t1000\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t1000\\t200\\t\\\\N\\t.*\\t\\\\N\n"
"myQuota\\tdefault\\t.*\\t63113904\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t30000\\t0\\t\\\\N\\t0\\t20000\\t.*\\t120",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
# Drop interval, add quota.
copy_quota_xml('two_quotas.xml')
assert instance.query("SHOW QUOTAS") == "myQuota\nmyQuota2\n"
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert instance.query(
"SHOW CREATE QUOTA myQuota") == "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000 TO default\n"
assert instance.query(
"SHOW CREATE QUOTA myQuota2") == "CREATE QUOTA myQuota2 KEYED BY client_key, user_name FOR RANDOMIZED INTERVAL 1 hour MAX result_rows = 4000, result_bytes = 400000, read_rows = 4000, read_bytes = 400000, execution_time = 60, FOR INTERVAL 1 month MAX execution_time = 1800\n"
assert instance.query(
"SHOW CREATE QUOTAS") == "CREATE QUOTA myQuota KEYED BY user_name FOR INTERVAL 1 year MAX queries = 1000, read_rows = 1000 TO default\n" \
"CREATE QUOTA myQuota2 KEYED BY client_key, user_name FOR RANDOMIZED INTERVAL 1 hour MAX result_rows = 4000, result_bytes = 400000, read_rows = 4000, read_bytes = 400000, execution_time = 60, FOR INTERVAL 1 month MAX execution_time = 1800\n"
assert re.match(
"myQuota\\tdefault\\t.*\\t31556952\\t1\\t1000\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t1000\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
# Drop all quotas.
copy_quota_xml('no_quotas.xml')
assert instance.query("SHOW QUOTAS") == ""
assert instance.query("SHOW CREATE QUOTA") == ""
assert instance.query("SHOW QUOTA") == ""
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
def test_dcl_management():
copy_quota_xml('no_quotas.xml')
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
assert instance.query("SHOW QUOTA") == ""
Add explicit main_configs, user_configs and dictionaries in integration tests.
2020-08-12 08:55:04 +00:00
Simplify DCL for creating quotas.
2020-04-08 03:09:40 +00:00
instance.query("CREATE QUOTA qA FOR INTERVAL 15 MONTH MAX QUERIES 123 TO CURRENT_USER")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert instance.query(
"SHOW CREATE QUOTA qA") == "CREATE QUOTA qA FOR INTERVAL 5 quarter MAX queries = 123 TO default\n"
assert re.match(
"qA\\t\\t.*\\t39446190\\t0\\t123\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert re.match(
"qA\\t\\t.*\\t39446190\\t1\\t123\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
instance.query(
"ALTER QUOTA qA FOR INTERVAL 15 MONTH MAX QUERIES 321, MAX ERRORS 10, FOR INTERVAL 0.5 HOUR MAX EXECUTION TIME 0.5")
assert instance.query(
"SHOW CREATE QUOTA qA") == "CREATE QUOTA qA FOR INTERVAL 30 minute MAX execution_time = 0.5, FOR INTERVAL 5 quarter MAX queries = 321, errors = 10 TO default\n"
assert re.match(
"qA\\t\\t.*\\t1800\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t.*\\t0.5\n"
"qA\\t\\t.*\\t39446190\\t1\\t321\\t0\\t10\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert re.match(
"qA\\t\\t.*\\t1800\\t1\\t\\\\N\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t.*\\t0.5\n"
"qA\\t\\t.*\\t39446190\\t2\\t321\\t0\\t10\\t100\\t\\\\N\\t400\\t\\\\N\\t100\\t\\\\N\\t400\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
instance.query(
"ALTER QUOTA qA FOR INTERVAL 15 MONTH NO LIMITS, FOR RANDOMIZED INTERVAL 16 MONTH TRACKING ONLY, FOR INTERVAL 1800 SECOND NO LIMITS")
assert re.match(
"qA\\t\\t.*\\t42075936\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t0\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert re.match(
"qA\\t\\t.*\\t42075936\\t1\\t\\\\N\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("ALTER QUOTA qA RENAME TO qB")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert instance.query(
"SHOW CREATE QUOTA qB") == "CREATE QUOTA qB FOR RANDOMIZED INTERVAL 16 month TRACKING ONLY TO default\n"
assert re.match(
"qB\\t\\t.*\\t42075936\\t1\\t\\\\N\\t0\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t50\\t\\\\N\\t200\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
instance.query("SELECT * from test_table")
Format and optimize imports in integration test files This PR formats all the `*.py` files found under the `tests/integration` folder. It also reorders the imports and cleans up a bunch of unused imports. The formatting also takes care of other things like wrapping lines and fixing spaces and indents such that the tests look more readable.
2020-09-16 04:26:10 +00:00
assert re.match(
"qB\\t\\t.*\\t42075936\\t2\\t\\\\N\\t0\\t\\\\N\\t100\\t\\\\N\\t400\\t\\\\N\\t100\\t\\\\N\\t400\\t\\\\N\\t.*\\t\\\\N\n",
instance.query("SHOW QUOTA"))
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
instance.query("DROP QUOTA qB")
Improve system tables for quotas. Remove function currentQuota().
2020-05-08 12:50:45 +00:00
assert instance.query("SHOW QUOTA") == ""
Add DCL to manage quotas.
2019-12-01 22:01:05 +00:00
def test_users_xml_is_readonly():
assert re.search("storage is readonly", instance.query_and_get_error("DROP QUOTA myQuota"))
Reference in New Issue Copy Permalink