thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-17 13:13:36 +00:00
Code Issues Packages Projects Releases Wiki Activity
53,195 Commits 9,138 Branches 1,774 Tags 2.1 GiB
8140fbd0fb
Commit Graph

5019 Commits

Author SHA1 Message Date
Maksim Kita
5d6036e9c8 Fixed style issues 2020-12-13 14:38:56 +03:00
alexey-milovidov
bce02de691
Merge pull request #17539 from azat/remerge_sort_lowered_memory_bytes_ratio 
Add remerge_sort_lowered_memory_bytes_ratio setting
 2020-12-13 04:38:50 +03:00
alexey-milovidov
8df4789113
Merge pull request #17845 from kitaisreal/space-saving-remove-last-element-from-map-fix 
SpaceSaving remove last element from map fix
 2020-12-13 04:09:51 +03:00
alexey-milovidov
04e222f6f3
Merge pull request #17986 from azat/fwd-decl 
More forward declaration for generic headers
 2020-12-13 01:12:05 +03:00
alexey-milovidov
4887d59b06
Merge pull request #18027 from Jokser/fix-flappy-log-family-s3 
Fix flappy test_log_family_s3
 2020-12-13 00:39:41 +03:00
Maksim Kita
0dcbcec19a Added tests 2020-12-13 00:29:09 +03:00
Alexey Milovidov
ef064696e7 Add perf test 2020-12-13 00:17:37 +03:00
alexey-milovidov
2eabd41749
Merge pull request #17659 from nautaa/master 
add function to escape charaters for XML
 2020-12-12 23:43:41 +03:00
Azat Khuzhin
41bc43325b Make 01290_max_execution_speed_distributed less flaky 2020-12-12 17:43:10 +03:00
Pavel Kovalenko
c2c497e290 Use s3 disk explicitly for log tables in test_log_family_s3. 2020-12-12 16:44:19 +03:00
Maksim Kita
07c8293043 Added tests 2020-12-12 15:08:46 +03:00
alexey-milovidov
0d6fe7121d
Merge pull request #17887 from sundy-li/trivial_count-fix 
disable optimize_trivial_count in query with array join
 2020-12-12 02:44:07 +03:00
alexey-milovidov
adbe8e1ebb
Merge pull request #17903 from ClickHouse/attach_table_from_path 
Implement ATTACH TABLE name FROM 'path/to/data/'
 2020-12-12 02:42:53 +03:00
alexey-milovidov
656a9222ac
Merge pull request #18000 from ClickHouse/filimonov-kafka-flaky-test 
kafka test_premature_flush_on_eof flap
 2020-12-12 02:29:26 +03:00
Pavel Kovalenko
59a5e63417 Merge remote-tracking branch 'origin/master' into s3-adaptive-single-part-upload 
# Conflicts:
#	src/Disks/S3/DiskS3.cpp
#	src/Disks/S3/DiskS3.h
#	src/Disks/S3/registerDiskS3.cpp
#	src/IO/WriteBufferFromS3.cpp
#	src/IO/WriteBufferFromS3.h
 2020-12-11 18:28:41 +03:00
Kruglov Pavel
a8c1d17f83
Merge pull request #16935 from ucasFL/agg-func-setting-null-for-empty 
`aggregate_functions_null_for_empty` move OrNull ahead
 2020-12-11 17:11:39 +03:00
Kruglov Pavel
6300cd285f
Merge pull request #17909 from Jokser/disk-s3-send-metadata 
Ability to set metadata when put S3 object
 2020-12-11 17:01:14 +03:00
Maksim Kita
4ae5619714 Optimized erase in HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bf5d75853c Added erase into HashTable 2020-12-11 16:54:08 +03:00
Maksim Kita
bfceb06659 Fixed test 2020-12-11 16:54:08 +03:00
Maksim Kita
d8b78682e1 SpaceSaving remove last element from map fix 2020-12-11 16:54:08 +03:00
Alexander Tokmakov
ed355f8663 fix 2020-12-11 16:50:45 +03:00
Vitaly Baranov
1b3893bcab User with allow_ddl=0 cannot do DDL but can grant DDL. 2020-12-11 16:38:49 +03:00
Vitaly Baranov
648be453a4 User with allow_introspection_functions=0 cannot call introspection functions but can grant INTROSPECTION. 2020-12-11 16:38:49 +03:00
Alexander Tokmakov
58a31e4882 Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-11 16:14:03 +03:00
Alexander Tokmakov
f9f7da5f97 fix 2020-12-11 15:06:19 +03:00
Alexander Kuzmenkov
fb1221148d
Merge pull request #17748 from azat/custom-TLD 
Add ability to use custom TLD list
 2020-12-11 12:42:19 +03:00
filimonov
8e2ca9518b
Update test.py 
adjusting timeouts a bit, in the good hope that it will prevent flakiness of the test.
 2020-12-11 10:13:03 +01:00
nauta
00dc104025 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse 2020-12-11 16:15:40 +08:00
Amos Bird
5b1e5679b4
Add -SimpleState combinator 2020-12-11 11:43:56 +08:00
alexey-milovidov
2fb7ce8340
Revert "Date vs DateTime64 comparison" 2020-12-11 01:09:01 +03:00
alexey-milovidov
c35c52be87
Merge pull request #17867 from ucasFL/mergetree-setting 
Add settings `min_compress_block_size` and `max_compress_block_size` to MergeTreeSettings
 2020-12-10 22:54:05 +03:00
Kruglov Pavel
9a785dbbf5
Merge branch 'master' into disk-s3-send-metadata 2020-12-10 20:17:41 +03:00
Vladimir Chebotarev
39d867e56d
Added proper authentication for S3 client (#16856) 2020-12-10 12:19:42 +03:00
alesapin
dd9f4bfc8a
Merge pull request #16877 from ClickHouse/complete_zk_api 
Fake in-memory ZooKeeper server inside ClickHouse
 2020-12-10 10:47:54 +03:00
Azat Khuzhin
f68a231a46 Fix installing top_level_domains for tests 2020-12-10 10:19:51 +03:00
Nikita Mikhaylov
80d4af9a73
Merge pull request #17874 from nikitamikhaylov/calendar-date 
Merging #17750
 2020-12-10 00:19:04 +03:00
Azat Khuzhin
0f1d9f3a6f Put top_level_domains into the docker/test/performance-comparison/config 
Since in docker/test/performance-comparison there is Dockerfile that is
runned from that directory, so it cannot COPY anything outside of it.
 2020-12-09 21:08:31 +03:00
Azat Khuzhin
352a1eea34 Use new top_level_domains_path 2020-12-09 21:08:31 +03:00
Azat Khuzhin
9b6b2b175f perf: merge custom_tld.xml/first_significant_subdomain.xml into url_hits.xml 
v2: smaller table for *firstSignificantSubdomain* (max_threads=1)
 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8b6256dc4b Add performance test for custom TLD 
And seems works with the same speed as default (that uses gperf):

- cutToFirstSignificantSubdomain

    SELECT cutToFirstSignificantSubdomain(URL)
    FROM datasets.hits
    SETTINGS max_threads = 1
    FORMAT Null
    SETTINGS max_threads = 1

    0 rows in set. Elapsed: 0.904 sec. Processed 8.87 million rows, 762.68 MB (9.82 million rows/s., 843.61 MB/s.)

- cutToFirstSignificantSubdomainCustom

    SELECT cutToFirstSignificantSubdomainCustom(URL, 'public_suffix_list')
    FROM datasets.hits
    SETTINGS max_threads = 1
    FORMAT Null
    SETTINGS max_threads = 1

    0 rows in set. Elapsed: 0.909 sec. Processed 8.87 million rows, 762.68 MB (9.76 million rows/s., 838.83 MB/s.)
 2020-12-09 21:08:30 +03:00
Azat Khuzhin
8875767b87 Add a test for custom TLD 2020-12-09 21:08:30 +03:00
alesapin
850f903d40 Merge branch 'master' into complete_zk_api 2020-12-09 18:18:38 +03:00
Pavel Kovalenko
db7a87089b Adaptive choose of single/multi part upload in WriteBufferFromS3. 2020-12-09 17:09:04 +03:00
alesapin
4d1f528806
Merge pull request #17918 from ClickHouse/revert-17120-fix_granularity_on_block_borders 
Revert "Fix index granularity calculation on block borders"
 2020-12-09 14:46:56 +03:00
Nikolai Kochetov
6a9e1ce436
Merge pull request #17895 from Enmk/DateTime64_DateTime_comparison 
Date vs DateTime64 comparison
 2020-12-09 14:22:26 +03:00
alesapin
7783ddb3af
Revert "Fix index granularity calculation on block borders" 2020-12-09 14:05:48 +03:00
feng lv
91c3de9664 fix 
fix

fix
 2020-12-09 09:13:51 +00:00
feng lv
7546c611fb add test 2020-12-09 08:11:14 +00:00
feng lv
e95e443246 fix 
fix
 2020-12-09 04:32:28 +00:00
feng lv
9b2bb1820a Merge branch 'master' of github.com:ClickHouse/ClickHouse into agg-func-setting-null-for-empty 2020-12-09 02:28:49 +00:00
alexey-milovidov
8ff30b87a6
Merge pull request #15930 from kitaisreal/clickhouse-client-and-local-added-queries-file-parameter 
Clickhouse client and clickhouse local added queries-file parameter
 2020-12-08 21:44:19 +03:00
Pavel Kovalenko
dfbb31174e Ability to set metadata when put S3 object 2020-12-08 21:31:57 +03:00
Vitaly Baranov
f6f336ac78
Merge pull request #17888 from vitlibar/retrieve-logs-from-grpc 
Retrieve logs from grpc
 2020-12-08 20:54:02 +03:00
alesapin
8b0fe1404a Tiny sleeps 2020-12-08 17:50:10 +03:00
alesapin
3d0dbbe411 Fix build 2020-12-08 17:49:18 +03:00
alesapin
91e3162e09 More correct session close 2020-12-08 17:28:51 +03:00
Vasily Nemkov
0c2d73adcb Fixed comparing Date and DateTime64 2020-12-08 17:17:02 +03:00
Alexander Tokmakov
04ceaa66f2 implement ATTACH TABLE name FROM 'path/to/data/ 2020-12-08 17:15:23 +03:00
Ivan
0ba712a2d3
Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-08 16:45:51 +03:00
alesapin
f4231d552e Banch of fixes 2020-12-08 16:28:39 +03:00
nauta
ab5f397022 add encodeXMLComponent function 2020-12-08 21:02:09 +08:00
Kruglov Pavel
e19eb6f17a
Merge branch 'master' into optimize-data-on-insert 2020-12-08 15:57:46 +03:00
alexey-milovidov
d9b52f94f7
Merge pull request #17637 from amosbird/buildid 
reload symbols and fix build-id
 2020-12-08 14:55:35 +03:00
alexey-milovidov
ab10cb4bf9
Merge pull request #17707 from ClickHouse/quota-by-x-forwarded-for 
Allow quotas to be keyed by proxy-forwarded IP address; add support for PROXY protocol
 2020-12-08 14:48:05 +03:00
sundy-li
d4d913edb0 update tests 2020-12-08 19:18:43 +08:00
Vasily Nemkov
5556c48298 Added test for DateTime vs DateTime64 comparison 2020-12-08 13:51:50 +03:00
Nikolai Kochetov
7d77a7ba24
Merge pull request #16952 from Enmk/DateTime64_fixes_comparison 
Fixed comparison of DateTime64 with different scales
 2020-12-08 12:40:41 +03:00
sundy-li
d9176263aa disable optimize_trivial_count in query with array join 2020-12-08 16:00:12 +08:00
Alexey Milovidov
fa08c59d14 Fix bad test 2020-12-08 02:09:47 +03:00
Vitaly Baranov
ad01e877be Mark grpc protocol's tests as non-flaky. 2020-12-07 23:40:02 +03:00
Vitaly Baranov
559afe028f Retrieve logs from grpc library and pass them to our logging system. 2020-12-07 23:39:55 +03:00
Alexey Milovidov
a5f43ada94 Add missing config link 2020-12-07 23:36:47 +03:00
Vitaly Baranov
b8faa1663f Fix configs in tests. 2020-12-07 22:02:18 +03:00
Alexey Milovidov
af55793e69 Better test 2020-12-07 19:57:08 +03:00
Alexey Milovidov
b762398616 Better test 2020-12-07 19:43:32 +03:00
Maksim Kita
ae56223611 Added queries-file parameter. Updated tests. 2020-12-07 19:29:17 +03:00
Maksim Kita
963ee5211b Added queries-file parameter. Fixed code review issues 2020-12-07 19:29:17 +03:00
Maksim Kita
f5d1a9e59a Clickhouse client and local added queries-file parameter 2020-12-07 19:29:17 +03:00
alexey-milovidov
584fb97ed2
Merge pull request #17832 from kitaisreal/clickhouse-benchmark-added-query-parameter 
Clickhouse-benchmark added query parameter
 2020-12-07 19:26:16 +03:00
alesapin
b5d2559626
Merge pull request #17709 from kssenii/better-startup 
rabbitmq: fix startup with no connection
 2020-12-07 19:08:18 +03:00
alesapin
5f35279c09
Merge pull request #17856 from ClickHouse/fix_test_log_s3 
Kill network container with retries in integration tests
 2020-12-07 19:07:02 +03:00
nikitamikhaylov
a8616ea262 better 2020-12-07 18:47:57 +03:00
Alexey Milovidov
1ed329017b Merge branch 'master' into quota-by-x-forwarded-for 2020-12-07 18:22:19 +03:00
PHO
3c90065158 Add functions toMJD and fromMJD 
These functions convert between Proleptic Gregorian calendar date and Modified Julian Day number.
 2020-12-07 16:00:32 +03:00
alesapin
371cb23946 Merge branch 'master' into run_func_tests_in_parallel 2020-12-07 13:30:41 +03:00
alesapin
57f40e4260
Merge pull request #17458 from ClickHouse/merge-expressions 
Merge expressions
 2020-12-07 12:34:19 +03:00
alesapin
710550f8e5 Kill container with retries 2020-12-07 12:25:27 +03:00
Maksim Kita
ee33323d1e Added tests 2020-12-07 11:35:44 +03:00
alesapin
0c43246216 Merge branch 'master' into complete_zk_api 2020-12-07 10:24:55 +03:00
alexey-milovidov
dd8362a5eb
Merge pull request #17570 from vdimir/typo_01018_ip_dictionary 
Fix mixed statements in 01018_ip_dictionary.sql
 2020-12-07 02:22:55 +03:00
alexey-milovidov
4df1983d64
Merge pull request #17571 from vdimir/ip-dict-accept-alias 
IP dictionary works with aliased types `IPv4` and `IPv6` (close #6804)
 2020-12-07 02:19:32 +03:00
Alexey Milovidov
a63d4f0db3 Merge branch 'master' into amosbird-buildid 2020-12-07 02:17:29 +03:00
Azat Khuzhin
c3a4e5e7b7 Fix max_distributed_connections (one more time) 
With prefer_localhost_replica=1 max_distributed_connections uses
max_threads before this patch.

Fixes: #14936
Previous fix: #9673
 2020-12-07 01:19:53 +03:00
Anton Popov
7aaa2c052f
Merge branch 'master' into merging-map 2020-12-05 22:41:46 +03:00
Vitaliy Zakaznikov
c0d529c49d Small fix to the test/testflows/README.md 2020-12-04 19:27:41 -05:00
Vitaliy Zakaznikov
4cd6ee04d8 Updating TestFlows README.md to include "How To Debug Why Test Failed" section. 2020-12-04 19:11:11 -05:00
Anton Popov
60b0cbb1c1
Merge pull request #15939 from Avogar/optimize_final_optimization 
Optimize final optimization
 2020-12-05 02:26:27 +03:00
alexey-milovidov
37accc3d2c
Merge pull request #17804 from MyroTk/tfs_pr_access_management 
Testflows RBAC ACCESS MANAGEMENT tests.
 2020-12-05 01:56:56 +03:00
alexey-milovidov
61a53f38fd
Merge pull request #17805 from azat/fix-test_ttl_move-flaky 
Fix flaky test_ttl_move
 2020-12-05 01:53:24 +03:00
Alexander Kuzmenkov
b54d50fa7f
Merge pull request #17459 from azat/countMatches-pull 
Add countMatches function
 2020-12-05 00:01:47 +03:00
Azat Khuzhin
ea64ec390f Fix flaky test_ttl_move 
- replace sleep() with waiting for the message in log
- due to previous paragaph, use unique table names
- increase sleep timeout in some places
 2020-12-04 21:27:50 +03:00
MyroTk
e2c6430a6e Testflows RBAC ACCESS MANAGEMENT tests. 2020-12-04 18:36:32 +01:00
Pavel Kruglov
905ba78adc Merge branch 'master' of github.com:ClickHouse/ClickHouse into optimize-data-on-insert 2020-12-04 18:56:46 +03:00
alesapin
278bbf6d51 Merge branch 'master' into complete_zk_api 2020-12-04 16:48:19 +03:00
alesapin
7c2a04d77d
Merge pull request #17671 from ClickHouse/update_integration_tests_image 
Update docker image in integration tests runner
 2020-12-04 15:51:08 +03:00
Azat Khuzhin
68c4da1203 Use max_threads=2 for countMatches to keep it under 2 seconds 
Although I don't like this idea.
 2020-12-04 07:54:34 +03:00
Ivan
315ff4f0d9
ANTLR4 Grammar for ClickHouse and new parser (#11298) 2020-12-04 05:15:44 +03:00
Alexey Milovidov
d92606d362 Better test 2020-12-03 23:23:09 +03:00
alesapin
b68aa1c76d Merge branch 'master' into run_func_tests_in_parallel 2020-12-03 17:22:09 +03:00
Anton Popov
cd1917c7a6
Merge branch 'master' into optimize_final_optimization 2020-12-03 16:52:51 +03:00
Alexey Milovidov
00dc21b0b9 Better tests 2020-12-03 13:02:20 +03:00
tavplubix
b25546ea50
Merge pull request #17614 from TCeason/add_mysql_killed_test_for_materializemysql 
add integration test: MySQL killed while insert for MaterializeMySQL ENGINE
 2020-12-03 12:55:43 +03:00
Alexey Milovidov
3e2447391b Support for PROXY protocol 2020-12-03 00:05:51 +03:00
Ivan
278cde366c
Update arcadia_skip_list.txt 2020-12-02 22:55:48 +03:00
alexey-milovidov
85f4045160
Merge pull request #17144 from fibersel/issue-16791 
introduce zstd compression (for data import/export)
 2020-12-02 22:41:07 +03:00
Alexey Milovidov
a25baebc5a Added a test 2020-12-02 22:20:11 +03:00
kssenii
ebab21178e Fix, add test 2020-12-02 18:45:30 +00:00
Azat Khuzhin
5365718f01
Fix optimize_distributed_group_by_sharding_key for query with OFFSET only (#16996) 
* Fix optimize_distributed_group_by_sharding_key for query with OFFSET only

* Fix 01244_optimize_distributed_group_by_sharding_key flakiness
 2020-12-02 20:11:39 +03:00
Alexander Tokmakov
a0ef3a113a Merge branch 'master' into allow_atomic_database_inside_materialize_mysql 2020-12-02 18:29:02 +03:00
tavplubix
7e2f7ba623
trigger CI 2020-12-02 18:03:15 +03:00
alesapin
5065d9c64b Merge branch 'master' into update_integration_tests_image 2020-12-02 13:58:24 +03:00
alesapin
93ea2f5b1f Merge branch 'master' into complete_zk_api 2020-12-02 11:30:09 +03:00
TCeason
08d36f862d
Merge branch 'master' into add_mysql_killed_test_for_materializemysql 2020-12-02 13:25:07 +08:00
alesapin
51f49e3d47 Check output of cluster start cmd 2020-12-01 23:23:32 +03:00
Azat Khuzhin
cb68d5b5e7 Add performance test for countMatches() function 2020-12-01 22:26:07 +03:00
Azat Khuzhin
cbd4434a33 Add a test for countMatches()/countMatchesCaseInsensitive() 2020-12-01 22:25:28 +03:00
alexey-milovidov
de77715cb6
Merge pull request #17662 from vitlibar/mark-grpc-protocol-tests-as-flaky 
Mark grpc protocol's tests as flaky.
 2020-12-01 22:05:17 +03:00
alexey-milovidov
1cdf5012c9
Merge pull request #17657 from MyroTk/master 
RBAC testflows tests for SHOW, TRUNCATE, KILL, and OPTIMIZE.
 2020-12-01 20:57:31 +03:00
Nikita Mikhaylov
519b886641
Merge pull request #17634 from nikitamikhaylov/scipy-arcadia 
Try to fix Yandex Synchronization check
 2020-12-01 17:59:49 +03:00
Alexander Kuzmenkov
5ad15e2018
Merge pull request #17109 from azat/perf-AggregatingMergeTree-INSERT 
Improve performance of AggregatingMergeTree w/ SimpleAggregateFunction(String) in PK
 2020-12-01 16:27:36 +03:00
Anton Popov
12604ce0e6 Merge branch 'dev_map2' of git://github.com/hexiaoting/ClickHouse into merging-map 2020-12-01 14:52:30 +03:00
tavplubix
0b5261b1af
Merge pull request #17622 from TCeason/add_clickhouse_killed_test_for_materializemysql 
add integration test: ClickHouse killed while insert for MaterializeMySQL ENGINE
 2020-12-01 12:52:52 +03:00
Vitaly Baranov
7f093c4f9a Mark grpc protocol's tests as flaky. 2020-12-01 12:38:51 +03:00
alexey-milovidov
0739ed8f97
Merge pull request #17597 from ClickHouse/fix-grpc-tests 
Fix GRPC tests
 2020-12-01 10:27:11 +03:00
alexey-milovidov
2644f446ab
Merge pull request #17453 from azat/memory-tracking-exception-locking 
Do not allow to throw MEMORY_LIMIT_EXCEEDED if there is uncaught exception
 2020-12-01 10:25:17 +03:00
MyroTk
2cbf2d8f7b New RBAC testflows tests for SHOW, TRUNCATE, KILL, and OPTIMIZE. 
Updates to old tests.
 2020-12-01 05:58:45 +01:00
Amos Bird
7e1d71305a
fix test 2020-12-01 10:15:38 +08:00
Vasily Nemkov
87945fb68b Merge branch 'master' into HEAD 2020-11-30 23:25:57 +03:00
nikitamikhaylov
1037a994a8 done 2020-11-30 15:53:37 +03:00
taichong
5b9d9376c3 add integration test: ClickHouse killed while insert for MaterializeMySQL ENGINE 2020-11-30 17:33:31 +08:00
Alexander Kuzmenkov
8fd0810142
Update aggregating_merge_tree_simple_aggregate_function_string.xml 
`system stop merges` w/o table name has global effect, so the rest of the tests is affected. Also `optimize` is more suitable here so that the end result is the same every time.
 2020-11-30 12:31:30 +03:00
Alexander Kuzmenkov
d9dd9341ce Fix the OpenTelemetry test 2020-11-30 12:11:17 +03:00
taichong
6d8cf30f5d add integration test: MySQL killed while insert for MaterializeMySQL ENGINE 2020-11-30 16:31:09 +08:00
alesapin
6d2a007b79 Merge branch 'master' into complete_zk_api 2020-11-30 10:58:25 +03:00
alesapin
25f40db2fb
Merge pull request #17499 from ClickHouse/concurrent_mutation_and_random_kill 
Fix kill mutation on concurrent alter queries
 2020-11-30 10:51:50 +03:00
alexey-milovidov
46e685e1b8
Merge pull request #17565 from ClickHouse/fix-multiline-queries-with-comments 
Fix multiline queries with comments in interactive mode
 2020-11-30 09:38:41 +03:00
alexey-milovidov
df90cbd7d3
Merge pull request #17563 from ClickHouse/parser-alter-missing-code 
Allow query parameters in UPDATE statement.
 2020-11-30 09:38:14 +03:00
Alexey Milovidov
1711d428eb Fix GRPC tests 2020-11-30 09:34:46 +03:00
Alexey Milovidov
7f1a8b15fd Fix bad test 2020-11-29 21:21:59 +03:00