Commit Graph

6737 Commits

Author SHA1 Message Date
PHO
6425dd001a
Add a codec AES_128_GCM_SIV for encrypting columns on disk (#19896)
* Add a codec Encrypted() for encrypting columns on disk

While this is implemented as a compression codec, it does not actually compress data. It instead encrypts data on disk. The key is obtained by executing a user-specified command at the server startup, or if it's not specified the codec refuses to process any data. For now the only supported cipher is 'AES-128-GCM-SIV'.
2021-07-30 12:12:33 +03:00
alesapin
cae5502d51
Merge pull request #26963 from ClickHouse/fix_bad_partition_id
Add simple validation for partition id before drop partition
2021-07-30 11:21:28 +03:00
alexey-milovidov
4545fa15f7
Merge pull request #26975 from Algunenano/fix_quota_test
Fix 01600_quota_by_forwarded_ip
2021-07-30 08:45:05 +03:00
Maksim Kita
c5349f6d8c
Merge pull request #26901 from Algunenano/fix_client_secure
Tests: Fix CLICKHOUSE_CLIENT_SECURE with the default config
2021-07-29 21:43:42 +03:00
Raúl Marín
b4cd34b5fb Make the test parallelizable 2021-07-29 20:01:57 +02:00
Raúl Marín
ee4759ce86 Fix 01600_quota_by_forwarded_ip
The test was assuming clickhouse-local and curl would connect using the same address
2021-07-29 17:47:16 +02:00
tavplubix
c18c16855a
Merge pull request #26913 from PolyProgrammist/table-function-cluster-macros
Supported cluster macros inside table function 'cluster'
2021-07-29 18:43:36 +03:00
tavplubix
8aa5df7ceb
Update 01154_move_partition_long.sh 2021-07-29 16:40:33 +03:00
alesapin
21599ffefc Simple validation for partition id before drop partition 2021-07-29 16:11:05 +03:00
Alexander Kuzmenkov
55e1d1b592 the reference was correct after all, I just confused the sides of the
diff
2021-07-29 15:49:37 +03:00
Vasily Nemkov
ec77ba8bfc Updated extractAllGroupsHorizontal - flexible limit on number of matches per row.
If it is not set via third argument, it deafults to previously hardcoded
value 1000.
2021-07-29 15:36:55 +03:00
alesapin
bb77342606 Add test 2021-07-29 15:33:28 +03:00
Alexander Kuzmenkov
7c9467d7a7 fix window function partition boundary search
It was horribly broken and many test references were wrong. I'm
surprised I never noticed this.
2021-07-29 15:18:10 +03:00
Raúl Marín
0505e2e589 Add tests 2021-07-29 13:03:14 +02:00
tavplubix
4a3ade1aa5
Merge pull request #26814 from ClickHouse/fix_lost_aggregate_function_parameters
Fix lost parameters of aggregate functions
2021-07-29 13:43:05 +03:00
tavplubix
f8b6815ade
Merge pull request #26847 from ClickHouse/check_aggregate_function_parameters
Check aggregate function parameters in -Merge combinator
2021-07-29 13:42:52 +03:00
Vadim Volodin
918a4e8ab3 Supported cluster macros inside table function 'cluster' 2021-07-29 12:12:29 +03:00
alexey-milovidov
905eed2429
Merge pull request #26915 from Algunenano/fix_01854
Improve test compatibility (00646_url_engine and 01854_HTTP_dict_decompression)
2021-07-29 01:20:17 +03:00
alexey-milovidov
5ed60ee6bf
Merge pull request #26918 from Algunenano/01921_timezone
01921_datatype_date32: Adapt it to work under Pacific/Fiji
2021-07-29 01:19:33 +03:00
Alexander Tokmakov
764701c3f3 allow mismatching parameters for some functions 2021-07-28 20:55:13 +03:00
Raúl Marín
46b162c595 01921_datatype_date32: Adapt it to work under Pacific/Fiji 2021-07-28 18:16:32 +02:00
Raúl Marín
0bb2eb3f4f More PR comments 2021-07-28 18:05:37 +02:00
Raúl Marín
92ed6f5cc9 Improvements from PR review 2021-07-28 17:48:40 +02:00
Raúl Marín
3a1081ddee Same for 00646_url_engine 2021-07-28 17:21:18 +02:00
Raúl Marín
62a9a89ced Improve 01854_HTTP_dict_decompression compatibility
127.0.0.1 192.168.1.193 might return multiple ip addresses, so take the first one
2021-07-28 17:18:55 +02:00
alesapin
d91380cd71 Fix bug when default column reference non materialized column 2021-07-28 15:04:42 +03:00
Raúl Marín
d2a8ec9b93 Fix CLICKHOUSE_CLIENT_SECURE with the default config 2021-07-28 14:03:35 +02:00
alesapin
1277db4435
Merge pull request #26129 from ClickHouse/system_zookeeper_log
Add system.zookeeper_log table
2021-07-28 11:22:29 +03:00
Alexander Tokmakov
ebcf0844f5 fix_tests 2021-07-27 20:30:25 +03:00
Alexander Tokmakov
378dcef813 fixes 2021-07-27 19:57:28 +03:00
Kseniia Sumarokova
b5dce17707
Merge pull request #26821 from azat/rocksdb-improvements
Add system.rocksdb and read rocksdb/rocksdb_TABLE options from config
2021-07-27 17:31:12 +03:00
alexey-milovidov
d7b2404119
Merge pull request #15408 from ClickHouse/random_timezone_for_stateless_tests
Use random timezone in stateless and stateful tests
2021-07-27 16:18:14 +03:00
kevin wan
a56a3c793c
Merge branch 'master' into profile-default-database 2021-07-27 21:08:08 +08:00
万康
720f8805f9 refactor 2021-07-27 20:32:04 +08:00
Alexander Kuzmenkov
ece7d000dd
Merge pull request #26736 from Algunenano/ch_local_remote_localhost
CH local: Treat localhost:port as a remote database
2021-07-27 15:30:54 +03:00
Alexander Kuzmenkov
7e737d9568
Merge pull request #26334 from ryzuo/ryzuo
Implementation of window function nth_value
2021-07-27 15:02:29 +03:00
tavplubix
41f1a1c4e7
Update query_test.py 2021-07-27 12:41:35 +03:00
Alexey Milovidov
2872b7fec6 Fix for Antarctica/Casey 2021-07-27 09:53:58 +03:00
Alexey Milovidov
6d64cf8de2 Fix test 2021-07-27 06:55:59 +03:00
Alexey Milovidov
04196d1cd6 Fix for Sydney 2021-07-27 05:33:03 +03:00
Azat Khuzhin
c7d2a5aad8 Add system.rocksdb table (with various rocksdb internals)
v2: fix USE_ROCKSDB check (there is #cmakedefine01 so it is either 0/1,
so we should not check with #ifdef)
2021-07-26 23:13:59 +03:00
Raúl Marín
2b410c744a Ignore ASAN warning 2021-07-26 17:28:32 +02:00
Alexander Tokmakov
304c367912 fix groupUniqArray 2021-07-26 17:57:49 +03:00
Alexander Tokmakov
5c9f69ea17 fix parameters with combinators 2021-07-26 17:37:47 +03:00
mergify[bot]
2929cf3ba8
Merge branch 'master' into system_zookeeper_log 2021-07-26 08:40:55 +00:00
Alexey Milovidov
7a9588bf0e Fix for Beirut 2021-07-26 09:47:34 +03:00
Alexey Milovidov
aa40f9d35a Fix test 2021-07-26 09:36:49 +03:00
Alexey Milovidov
b42089da83 Fix test 2021-07-26 07:03:38 +03:00
Alexey Milovidov
f695eda25d Fix test 2021-07-26 06:27:39 +03:00
Alexey Milovidov
53b17c316b Add another test for heredoc 2021-07-25 22:18:42 +03:00
Maksim Kita
6faa95fed0 Updated test 2021-07-25 22:11:27 +03:00
Maksim Kita
197bda1ff1 Heredoc updated tests 2021-07-25 22:01:25 +03:00
Alexey Milovidov
650cbd2484 GraphiteMergeTree: respect timezone for rounding #5098 2021-07-25 04:27:40 +03:00
Alexey Milovidov
7a157cb2b6 Fix a couple of tests 2021-07-25 01:58:31 +03:00
Alexey Milovidov
5460035176 Fix test 2021-07-25 01:55:23 +03:00
alexey-milovidov
22fa1efacb
Merge pull request #26777 from ClickHouse/bolonini-read-from-file
Merging #25960 (Bolonini/read_from_file)
2021-07-25 01:33:34 +03:00
Alexey Milovidov
1c432d505a Fix style 2021-07-25 01:25:48 +03:00
alexey-milovidov
ec949e4c66
Merge pull request #26607 from azat/bench-round-robin
Add round-robin support for clickhouse-benchmark
2021-07-24 20:17:35 +03:00
Alexey Milovidov
774f6d2617 Allow to read file descriptor multiple times in File storage 2021-07-24 19:50:03 +03:00
Alexey Milovidov
456801ccb8 Merge branch 'pipe_reading' of github.com:BoloniniD/ClickHouse into bolonini-read-from-file 2021-07-24 19:24:22 +03:00
alexey-milovidov
adb92c1b70
Merge pull request #26656 from azat/bench-hang-on-EMFILE-fix
Avoid hanging clickhouse-benchmark if connection fails (i.e. on EMFILE)
2021-07-24 19:02:46 +03:00
alexey-milovidov
fa6b22e3f5
Merge pull request #26715 from Algunenano/fix_hostname_test
01946_test_wrong_host_name_access: Clear DNS in the end
2021-07-24 18:56:22 +03:00
alexey-milovidov
0318a089a0
Merge pull request #26740 from Cas-pian/grant_by_replace
remove uncessary Exception
2021-07-24 18:54:11 +03:00
Alexey Milovidov
ccde0211dc Update test 2021-07-24 18:45:33 +03:00
Alexey Milovidov
4d7434f16d Fix test 2021-07-24 18:40:22 +03:00
Alexey Milovidov
db43bb1b44 Fix parquet test 2021-07-24 18:12:39 +03:00
Alexey Milovidov
83ff27e455 Update parquet test 2021-07-24 17:41:13 +03:00
Alexey Milovidov
d6c1593b22 Correct read of Date and UInt16 as DateTime in Arrow format 2021-07-24 17:36:21 +03:00
alexey-milovidov
039bb1cc5e
Merge pull request #26720 from azat/part_log-fix-event_time_microseconds
Fix event_time_microseconds for REMOVE_PART in system.part_log
2021-07-24 15:09:37 +03:00
Alexey Milovidov
f56269243e Merge branch 'master' into random_timezone_for_stateless_tests 2021-07-24 13:55:21 +03:00
BoloniniD
07c57edbfc Merge branch 'master' of github.com:ClickHouse/ClickHouse into pipe_reading 2021-07-23 23:39:38 +03:00
Caspian
e724e972fe remove uncessary Exception 2021-07-23 21:37:55 +08:00
Maksim Kita
f6f8bea689
Merge pull request #26671 from kitaisreal/mysql-dictionaries-support-for-custom-query
Lexer introduce heredoc
2021-07-23 16:20:54 +03:00
Vitaly Baranov
67d4da224a
Merge pull request #26384 from Cas-pian/grant_by_replace
add grant by replace support
2021-07-23 14:40:47 +03:00
Raúl Marín
383c982715 CH local: Treat localhost:port as a remote database 2021-07-23 13:16:35 +02:00
Maksim Kita
7e08748c5b Updated tests 2021-07-23 11:13:51 +03:00
Azat Khuzhin
00e2083421 Fix event_time_microseconds for REMOVE_PART in system.part_log 2021-07-23 00:59:08 +03:00
Maksim Kita
222915c275 Fixed code review issues 2021-07-23 00:07:22 +03:00
Nikolai Kochetov
3c17a62686
Merge pull request #26590 from ClickHouse/remove-some-more-streams
Remove some streams.
2021-07-22 21:28:50 +03:00
ryzuo
4d36d54c81 Update the implementaion of nth_value
Make nth_value for nullable values for out of frame rows, as the same
fashion as lagInFrame just does.
2021-07-23 00:34:08 +08:00
Raúl Marín
cb50fd9521 01946_test_wrong_host_name_access: Clear DNS in the end
Leaves a better env and avoids future errors in the logs
2021-07-22 18:21:17 +02:00
alexey-milovidov
3f5016a617
Merge pull request #26410 from mathalex/master
Add queryID and initialQueryID functions
2021-07-22 18:28:38 +03:00
alexey-milovidov
e83ca20ac3
Merge pull request #26684 from ClickHouse/fix-flaky-test-24
Fix flaky test `mutation_stuck_after_replace_partition`
2021-07-22 15:37:38 +03:00
alexey-milovidov
c3206f6c85
Merge pull request #26470 from ClickHouse/fix-flaky-test-20
Fix flaky test `distributed_ddl_output_mode`
2021-07-22 15:32:22 +03:00
Alexander Kuzmenkov
60ca9990e5
Merge pull request #26668 from ClickHouse/aku/window-materialize
materialize all columns in window transform
2021-07-22 13:42:36 +03:00
Nikolai Kochetov
5ffd99dfd4
Merge pull request #25674 from amosbird/distributedreturnconnection
Drain connection asynchronously
2021-07-22 11:04:49 +03:00
Azat Khuzhin
dac13793e7 Disable 01955_clickhouse_benchmark_connection_hang under UBsan
UBsan does not works reliable when the RLIMIT_NOFILE exceeded.
2021-07-22 10:09:37 +03:00
Azat Khuzhin
3f0dd40c69 Avoid hanging clickhouse-benchmark if connection fails (i.e. on EMFILE) 2021-07-22 10:08:49 +03:00
ryzuo
94d4fb9dfc Cleanup the incomplete fix of nullability return value of lagInFrame/leadInFrame 2021-07-22 10:37:29 +08:00
ryzuo
df9ec5655c Add missing test back in 01591_window_function 2021-07-22 10:30:10 +08:00
ryzuo
fd0c016423 Make tests of nth_value pass 2021-07-22 10:22:24 +08:00
ryzuo
4eb053a303 Implementaion of window function nth_value.
1. Implemented the window function nth_value
2. Make the return type of lag/lead, and nth_value functions to be
ColumnNullable, thus the returned value can be null if it is out
of frame.
2021-07-22 10:19:19 +08:00
Alexey Milovidov
ba06e8ccd0 Fix flaky test mutation_stuck_after_replace_partition 2021-07-22 03:39:23 +03:00
Alexey Milovidov
ed341b64e4 Disable parallel formatting 2021-07-22 03:24:35 +03:00
alexey-milovidov
2796aa333f
Merge pull request #26618 from ClickHouse/fix-flaky-test-22
Fix flaky test 01509_check_many_parallel_quorum_inserts
2021-07-22 02:58:07 +03:00
alexey-milovidov
f9581893d8
Merge pull request #26658 from azat/skip_unavailable_shards-excessive-attempts
Fix excessive connect attempts with skip_unavailable_shards
2021-07-22 02:12:32 +03:00
Vladimir
576b407804
Support conditions in JOIN ON section (#24420)
* Try to enforce table identification in CollectJoinOnKeysMatcher

* Support filtering conditions in JOIN ON for HashJoin

* Correct handle non equi join

* Update test 00878_join_unexpected_results

* Join on filters calculated as one row before join

* Do not lookup key in hash join if condition for row is not hold

* better

* Support filtering conditions in JOIN ON for MergeJoin

* Support Nullable mask in JOIN ON section

* Fix style in Interpreters/TableJoin.cpp

* Change return type of getColumnAsMask in join_common to ColumnPtr

* Handle Nullable(Nothing) type in JOIN ON section, add test cases

* Fix type cast JoinCommon::getColumnAsMask

* Check type if conditions in JOIN ON section, support functions

* Update tests with JOIN ON

* Style changes, add comments for conditions in JOIN ON section

* Add test cases for join on condtions

* JOIN ON key1 = key2 AND (cond1 OR cond2)

* Remove CollectJoinOnKeysVisitor has_join_keys

* Add test cases for join on nullable/lc conditions

* Fix style

* Change error code 48 to 403 in join on tests

* Fix whitespace
2021-07-21 20:03:33 +03:00
Caspian
eab4cb3cdc use new syntax, update docs 2021-07-21 23:08:38 +08:00
Maksim Kita
49983883cc Added tests 2021-07-21 16:41:45 +03:00
Alexander Kuzmenkov
7f0fec6d5d materialize all columns in window transform 2021-07-21 16:06:50 +03:00