thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 19:32:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
83,726 Commits 9,319 Branches 1,783 Tags 2.1 GiB
11ae0d144b
Commit Graph

204 Commits

Author SHA1 Message Date
Maksim Kita
93ecbf3ae4 Added tests 2021-09-17 18:42:59 +03:00
Filatenkov Artur
c23fe5baf6
Improve codec for encr 19896 (#27476) 
* change syntax of encrypted command

* commit all encrypted changes

* correct encryption

* correct config for test

* add tests and correct code style and typos

* correct test

* fix unbundled build

* add log warning messages

* improve code according to review comments

* correct nonce

* correct errors found by fuzzing

* improve codec AES_128_GCM_SIV. Add AES_256_GCM_SIV. Add sections for last in tests. Improve documentation

* Update CompressionCodecEncrypted.h

* Update 01683_codec_encrypted.sql

* correct compression factory after changes in master

* correct behavior with wrong key in data

* correct fuzzer

* add connection for fuzzer with fix for compression_encrypted

* refactor code

* add load from config with throwing errors on server start

* fix typos and check style

* Update Server.cpp

* correct loading and reading

* refactor code. fix uninitialized value

* refactor code

* move defines from server to cpp file

* correct build

* remove repeated code

* correct namespace

* fix code style
 2021-09-13 11:25:36 +03:00
Vitaly Baranov
70c6623036
Merge branch 'master' into governance/session_log 2021-09-07 10:12:54 +03:00
alesapin
7b2d4a3ace
Merge pull request #28559 from ClickHouse/add_test_logs_level 
Test log level for CI
 2021-09-06 10:49:59 +03:00
Maksim Kita
69fa28f332 Fixed tests 2021-09-04 14:29:40 +03:00
alesapin
8b8b0043c1 Fix logger conf 2021-09-03 14:20:09 +03:00
alesapin
497c225203 Test log level for CI 2021-09-03 13:07:40 +03:00
mergify[bot]
b81d479de4
Merge branch 'master' into stress-thread-fuzzer 2021-08-31 11:56:30 +00:00
Vasily Nemkov
c902afddde Added system.session_log table 
Which logs all the info about LogIn, LogOut and LogIn Failure events.
Additional info that is logged:
- User name
- event type (LogIn, LogOut, LoginFailure)
- Event date\time\time with microseconds
- authentication type (same as for IDENTIFIED BY of CREATE USER statement)
- array of active settings profiles upon login
- array of active roles upon login
- array of changed settings with corresponding values
- client address and port
- interface (TCP\HTTP\MySQL\PostgreSQL, etc.)
- client info (name, version info)
- optional LoginFailure reason text message.

Added some tests to verify that events are properly saved with all necessary info via following interfaces:
- TCP
- HTTP
- MySQL

Known limitations
- Not tested against named HTTP sessions, PostgreSQL and gRPC, hence those are not guaranteed to work 100% properly.
 2021-08-30 18:28:28 +03:00
alesapin
b4646f5016
Update keeper_port.xml 2021-08-30 12:49:11 +03:00
tavplubix
703101fe4d
Merge pull request #27931 from ClickHouse/wait_for_all_replicas_timeouts 
Avoid too long waiting for inactive replicas
 2021-08-27 14:31:36 +03:00
Azat Khuzhin
91621cfcd2 Fix reading of custom TLD w/o new line at EOF 
Fixes: #28177
 2021-08-27 00:43:21 +03:00
mergify[bot]
d75fbdf5f1
Merge branch 'master' into stress-thread-fuzzer 2021-08-21 11:12:52 +00:00
Alexander Tokmakov
9ef0b00803 fix config 2021-08-20 17:12:42 +03:00
mergify[bot]
02b4e56e6a
Merge branch 'master' into break_some_tests 2021-08-20 13:24:17 +00:00
Alexander Tokmakov
59eb3aa9a9 avoid too long waiting for inactive replicas 2021-08-20 15:59:57 +03:00
tavplubix
64bfe21a1b
Fix test 00443_preferred_block_size_bytes.sh (#27846) 
* Update 00443_preferred_block_size_bytes.sh

* Update clickhouse-test

* Update clickhouse-test

* Update database_replicated.xml
 2021-08-20 00:25:14 +03:00
alesapin
e75dc73c65 Bigger startup timeout 2021-08-18 11:14:32 +03:00
Alexander Tokmakov
285a5848b5 fix 2021-08-13 14:27:55 +03:00
Maksim Kita
1f1795a305
Merge pull request #26978 from Algunenano/improve_executable_dictionary 
01674_executable_dictionary_implicit_key: executable_dictionary: Use printf
 2021-08-02 12:54:08 +03:00
alexey-milovidov
71d20659c9
Merge pull request #27007 from ClickHouse/tavplubix-patch-2-1 
Set insert_quorum_timeout to 1 minute for tests.
 2021-07-31 04:55:00 +03:00
mergify[bot]
1d4e2564bc
Merge branch 'master' into improve_executable_dictionary 2021-07-30 16:45:39 +00:00
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896) 
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
 2021-07-30 12:12:33 +03:00
tavplubix
5a526ed078
Update timeouts.xml 2021-07-30 12:02:13 +03:00
Raúl Marín
8f8df8bf7b Test with printf instead 2021-07-29 19:22:57 +02:00
Raúl Marín
89a26f6d84 executable_dictionary: Use echo -e 2021-07-29 18:29:21 +02:00
Vadim Volodin
918a4e8ab3 Supported cluster macros inside table function 'cluster' 2021-07-29 12:12:29 +03:00
Alexander Tokmakov
c74bfbf991 Merge branch 'master' into mvcc_prototype 2021-07-28 22:21:48 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
Alexey Milovidov
09449cc101 Whitespaces 2021-07-21 04:47:56 +03:00
Alexander Tokmakov
4165ba2a01 add system.zookeeper_log 2021-07-09 17:05:35 +03:00
Alexander Tokmakov
0de6e90a34 fix tests 2021-06-21 20:29:32 +03:00
Alexander Tokmakov
c873714698 improve replicated database tests 2021-06-15 23:52:29 +03:00
Alexander Tokmakov
9d8ebd5782 run tests with Replicated database in parallel 2021-06-11 15:28:27 +03:00
Alexander Tokmakov
02d966dcc9 fix 2021-05-31 21:28:36 +03:00
Alexander Tokmakov
19337dc227 add config 2021-05-18 22:40:34 +03:00
Azat Khuzhin
73ab415c4c Preserve errors for INSERT into Distributed 
Before this patch (and after #22208) the INSERT may fail with "Cannot
schedule a task" because the pool in DistributedBlockOutputStream
already throws exception and simply fail in writeSuffix().
 2021-04-28 22:33:29 +03:00
Azat Khuzhin
91fc2fc87f tests/config/config.d/clusters.xml: fix indent 2021-04-28 21:26:12 +03:00
alesapin
b67cb5392b Missed setting 2021-04-14 22:48:52 +03:00
alesapin
f13eade50e Upload keeper logs from stateless tests 2021-04-14 18:04:57 +03:00
alesapin
eb1228bba0 Don't fail if directories already exists 2021-04-07 23:00:14 +03:00
alesapin
80d441ec95 Reset timeouts to default 2021-04-06 19:11:29 +03:00
tavplubix
0bb3b90c50
Update database_replicated.xml 2021-04-01 20:06:49 +03:00
Alexander Tokmakov
24fc120076 Merge branch 'master' into test_multiple_nodes 2021-03-30 10:40:38 +03:00
alesapin
5e3ebb3e0e
Merge pull request #22274 from ClickHouse/rename_keeper 
Rename NuKeeper and TestKeeper to Keeper in all places
 2021-03-30 10:39:22 +03:00
flynn
858d1fe593
Fix table function clusterAllReplicas return wrong _shard_num (#21498) 
* Fix deadlock in delete mutations when predicate contains table itself

* Fix table function clusterAllReplicas return wrong _shard_num

fix build on gcc-10

better

update test

fix

fix

fix

fix

fix

fix cluster config

Co-authored-by: alesapin <alesapin@gmail.com>
 2021-03-29 23:21:08 +03:00
Alexander Tokmakov
9925110713 rename other occurrances 2021-03-29 23:04:50 +03:00
Alexander Tokmakov
ccd31d1b72 Merge remote-tracking branch 'ch/rename_keeper' into test_multiple_nodes 2021-03-29 22:44:40 +03:00
alesapin
be132a32a2 More renames 2021-03-29 11:24:56 +03:00
Alexander Tokmakov
fdae70df6c fix tests 2021-03-18 15:50:03 +03:00
tavplubix
710c491f63
Update database_replicated.xml 2021-03-17 19:50:56 +03:00
Alexander Tokmakov
ff79be8af9 fix 2021-03-16 23:01:20 +03:00
Alexander Tokmakov
ab07b3b516 Merge branch 'distributed_ddl_improvements' into test_multiple_nodes 2021-03-15 21:22:24 +03:00
Alexander Tokmakov
e62e256e77 fix 2021-03-13 13:22:48 +03:00
Alexander Tokmakov
8e00ff7898 try run two nodes with Replicated db and NuKeeper 2021-03-13 04:25:13 +03:00
Alexander Tokmakov
4d19c84d90 Merge branch 'master' into distributed_ddl_improvements 2021-03-09 20:06:41 +03:00
Alexander Tokmakov
5c5d11cfce enable some tests 2021-03-09 03:48:37 +03:00
Alexander Tokmakov
163e27b299 support query and session settings for distributed DDL 2021-03-09 01:57:53 +03:00
Alexander Tokmakov
5070b5b85b detach permanently setting for Replicated db 2021-03-09 00:34:52 +03:00
Alexander Tokmakov
2022b90919 configurable output mode for distributed DDL 2021-03-08 23:35:09 +03:00
alesapin
f555e65cc8 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-08 22:30:17 +03:00
Maksim Kita
492c3d0899
Merge pull request #21321 from kitaisreal/dictionary-source-executable-pool 
Added ExecutablePool dictionary source
 2021-03-08 01:36:33 +03:00
alesapin
ef192ec310 Merge branch 'master' into persistent_nukeeper_snapshot_storage 2021-03-07 10:31:06 +03:00
alexey-milovidov
af90658369
Merge pull request #21432 from azat/flaky-distributed-tests 
Fix flaky tests with distributed queries
 2021-03-06 02:04:07 +03:00
Maksim Kita
af0d2c245b Fixed tests 2021-03-05 13:17:46 +03:00
Maksim Kita
d3615aca67 Added tests 2021-03-05 13:17:46 +03:00
Azat Khuzhin
205ebc7cff Tune idle_connection_timeout to avoid reconnects 
There may be 1 hour between two different distributed queries in tests
(see [1] and [2]), if this will happen then the connection may be closed
already due to idle_connection_timeout.

  [1]: https://clickhouse-test-reports.s3.yandex.net/21432/572d5862961ffda88125679e3a5ea684c316b223/functional_stateless_tests_(debug).html#fail1
  [2]: https://clickhouse-test-reports.s3.yandex.net/21432/572d5862961ffda88125679e3a5ea684c316b223/functional_stateless_tests_(antlr_debug).html#fail1

Let's tune it to avoid such issues and override other settings in tests.

Another option is to execute SYSTEM RELOAD CONFIG before each test...
 2021-03-04 22:48:09 +03:00
Azat Khuzhin
7794ac66d4 Fix flaky tests with distributed queries 
There was few attempts to fix this [1] and [2], but it still pops up
sometimes, for example here [3].

  [1]: 009f57fc2f / #11211
  [2]: cdb6bed8b9 / #14198
  [3]: https://clickhouse-test-reports.s3.yandex.net/21318/38be9ff43ac4c46ce6e803fc125d910bde1d4c71/functional_stateless_tests_(release,_databasereplicated).html#fail1

Let's use more generic approach, and do not hide any errors (and see
does increasing timeout will be enough).
 2021-03-04 22:48:04 +03:00
alesapin
39de525c74 Simplify config 2021-03-04 16:49:22 +03:00
alesapin
9e7a848169 Simplify config 2021-03-04 16:48:06 +03:00
alesapin
7556a3d723 Enable snapshots 2021-03-04 11:00:26 +03:00
alesapin
0f733828c2 Missed config 2021-03-03 19:44:06 +03:00
alesapin
5b888e1193 Merge branch 'master' into persistent_nukeeper_log_storage 2021-02-22 23:52:26 +03:00
alesapin
e447dd72f4 Disable snapshots 2021-02-21 17:00:10 +03:00
alesapin
5bf8c42e04 Fix config 2021-02-21 10:18:39 +03:00
alesapin
331de3d653 Trying to add tests more stable 2021-02-21 00:08:19 +03:00
alesapin
5b597fdf44 Force sync setting and ability to start with broken log 2021-02-18 13:23:48 +03:00
alesapin
d3e87701d4 Persistent storage 2021-02-16 22:02:18 +03:00
Alexander Tokmakov
bf6f64a3fb Merge branch 'master' into database_replicated 2021-02-16 01:28:19 +03:00
Alexander Tokmakov
9c7cf9e92e remove some debug code 2021-02-15 13:26:34 +03:00
alesapin
c1550814ca Disable snapshots for tests 2021-02-15 10:30:08 +03:00
alesapin
b130fbfd78 Add coordination settings 2021-02-09 17:47:18 +03:00
alesapin
9979181c02 Merge branch 'master' into in_memory_raft 2021-02-02 17:05:20 +03:00
alesapin
b4a3795473 Fix config path 2021-02-02 15:38:08 +03:00
alesapin
d265e3b419 Less timeouts 2021-02-02 11:02:25 +03:00
alesapin
365bf65f5a Fix install script 2021-02-01 17:14:59 +03:00
Maksim Kita
dafb0ef4e9 ExecutableDictionarySource added implicit_key option 2021-02-01 12:35:47 +03:00
alesapin
dea4b5009b Some server initialization 2021-01-25 15:29:12 +03:00
Alexander Kuzmenkov
170cd132da
Merge pull request #18113 from azat/tld-list-symlink-fix 
Avoid using symlinks for top_level_domains
 2020-12-16 20:49:43 +03:00
alesapin
d873439846
Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel 
Collect list of non-parallel test
 2020-12-16 19:29:32 +03:00
Azat Khuzhin
95c35b318e Avoid using symlinks for top_level_domains 
Move the main copy into the tests/config and ship it to the perf tests
via the perf package.
 2020-12-15 21:58:46 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD 
Add ability to use custom TLD list
 2020-12-11 12:42:19 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config 
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
8875767b87 Add a test for custom TLD 2020-12-09 21:08:30 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
Alexey Milovidov
a5f43ada94 Add missing config link 2020-12-07 23:36:47 +03:00
alesapin
b68aa1c76d Merge branch 'master' into run_func_tests_in_parallel 2020-12-03 17:22:09 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
alesapin
d199a2bf76 Merge branch 'master' into complete_zk_api 2020-11-27 14:55:55 +03:00