thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-11-19 22:22:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
60,553 Commits 9,144 Branches 1,778 Tags 2 GiB
cad54d4e2c
Commit Graph

7455 Commits

Author SHA1 Message Date
alesapin
83255cbd64 Add option to reuse same binary 2021-03-23 15:19:37 +03:00
alesapin
0c525b4ec4 Add an ability to run from .deb and .tgz package 2021-03-23 15:07:21 +03:00
Vitaly Baranov
090e558da4
Merge pull request #21844 from Avogar/catboost-deadlock 
Fix deadlock in first catboost model execution
 2021-03-23 15:01:04 +03:00
Maksim Kita
82660d008d Added test reference 2021-03-23 15:00:38 +03:00
Maksim Kita
75f5679bf0 Cast to enum nullable fix 2021-03-23 14:58:00 +03:00
vdimir
38a6dba3e3
Add option strict_increase to windowFunnel 2021-03-23 14:23:48 +03:00
alesapin
36898bdc4a
Merge pull request #21142 from Jokser/unfreeze-partitions 
Add ALTER TABLE UNFREEZE command.
 2021-03-23 14:05:38 +03:00
Alexey Milovidov
8d0210b510 Expose DateTime64 minmax part index in system.parts and system.parts_columns #18244 2021-03-23 01:16:41 +03:00
Alexey Milovidov
c94841bca5 Fix UBSan report in intDiv #21769 2021-03-23 00:38:25 +03:00
Anton Popov
90f9150829 fix test 2021-03-23 00:10:46 +03:00
Alexey Milovidov
e6c85df04b Add a test for #7963 2021-03-22 23:50:04 +03:00
Alexey Milovidov
3952a8e976 Fix UBSan report in addMonths 2021-03-22 23:42:09 +03:00
Alexey Milovidov
81e91734f6 Add a test for #17080 2021-03-22 23:14:05 +03:00
Alexey Milovidov
855d36be45 Add a test for #16924 2021-03-22 23:12:01 +03:00
Alexey Milovidov
8f87914bae Add a test for #16222 2021-03-22 23:07:15 +03:00
alesapin
ef82333089 Merge branch 'master' into jepsen_for_nukeeper 2021-03-22 23:06:26 +03:00
Alexey Milovidov
43c36462f0 Add a test for #15784 2021-03-22 23:04:07 +03:00
alesapin
9845ff6694 Move db to separate file 2021-03-22 23:03:51 +03:00
Alexey Milovidov
a9c25579ce More tests 2021-03-22 22:53:39 +03:00
Alexey Milovidov
84be58453b Add function timezoneOf and fix inconsistencies 2021-03-22 22:50:04 +03:00
Pavel Kruglov
dbc5018000 Update tests for hedged requests 2021-03-22 22:18:06 +03:00
Alexey Milovidov
fb08bc46bf Add a test for #11720 2021-03-22 22:15:57 +03:00
Alexey Milovidov
5d8b74e02e Also fix #13845 2021-03-22 21:49:12 +03:00
Alexey Milovidov
b88f67ed12 Add a test for #21991 2021-03-22 21:46:22 +03:00
Alexander Kuzmenkov
b0284f20c3
Merge branch 'master' into aku/laglead 2021-03-22 21:16:27 +03:00
Alexander Kuzmenkov
2f5dbf57b6
Merge pull request #21839 from kssenii/add-postgres-connection-pool 
Add connection pool for postgres engine
 2021-03-22 19:49:51 +03:00
tavplubix
5dfd0045a6
Merge branch 'master' into distributed_ddl_improvements 2021-03-22 18:13:19 +03:00
Alexander Kuzmenkov
ac5fdda999
Merge pull request #21915 from ClickHouse/aku/window-mt-order 
disable optimize_read_in_order for window functions
 2021-03-22 17:21:00 +03:00
Maksim Kita
8be263062d
Merge pull request #21910 from kitaisreal/table-function-dictionary 
Added table function dictionary
 2021-03-22 16:08:56 +03:00
Nikita Mikhaylov
330e74b665
Merge pull request #21890 from kitaisreal/polygon-dictionary-added-nullable-support 
PolygonDictionary added nullable support
 2021-03-22 14:49:28 +03:00
alesapin
bf3a4361ca Followup fix 2021-03-22 13:49:47 +03:00
alesapin
043b3cc7b5 Fix startup when leadership changed 2021-03-22 13:45:22 +03:00
alesapin
5ec7dbbdad Add lightweight run and fix queue workload 2021-03-22 13:06:09 +03:00
alesapin
27b90007aa Merge branch 'master' into jepsen_for_nukeeper 2021-03-22 11:20:00 +03:00
alexey-milovidov
0bad6adc48
Merge pull request #21551 from vzakaznikov/testflows_use_yandex_docker_repo 
Updating docker/test/testflows/runner/dockerd-entrypoint.sh to use Yandex dockerhub-proxy
 2021-03-22 02:27:50 +03:00
Maksim Kita
868766ac47
Merge pull request #21848 from den-crane/tests/issue_17302 
test for #17302
 2021-03-21 22:20:25 +03:00
Maksim Kita
d248e6bd56
Update 01763_long_ttl_group_by.sql 2021-03-21 20:42:02 +03:00
Maksim Kita
257e0455dd Fixed tests 2021-03-21 18:10:12 +03:00
Maksim Kita
249d4a1843 Fixed tests 2021-03-21 18:10:12 +03:00
Maksim Kita
df9223e13b PolygonDictionary added nullable support 2021-03-21 18:09:47 +03:00
kssenii
3b32c8fe9a Block on empty connection pool 2021-03-19 21:00:45 +00:00
Maksim Kita
95c87d4ded
Merge pull request #21884 from kitaisreal/system-dictionaries-updated 
Improve system.dictionaries table
 2021-03-19 22:49:49 +03:00
alesapin
3159b9dacf Disable zookeeper logger 
Better
 2021-03-19 21:55:35 +03:00
kssenii
50743b19c4 Add one more test 2021-03-19 16:12:33 +00:00
Alexander Kuzmenkov
590259a7a5 disable optimize_read_in_order for window functions 2021-03-19 17:29:09 +03:00
Vladimir
c8b5be636f
Merge pull request #21438 from arenadata/ADQM-170 2021-03-19 17:06:55 +03:00
Alexander Tokmakov
1845df25f3 fix possibly dangling reference to Context 2021-03-19 17:02:48 +03:00
Alexander Kuzmenkov
78c56b8913
Merge pull request #21886 from Avogar/hedged 
Add profile event in hedged requests and change timeout from sec to ms.
 2021-03-19 15:50:33 +03:00
Maksim Kita
32831e37ba Added table function dictionary 2021-03-19 15:47:27 +03:00
alesapin
0bf8979932 Remove redundant code from counter 2021-03-19 15:27:49 +03:00
alesapin
95cf05b0ad Fix style and add sync 2021-03-19 15:25:44 +03:00
tavplubix
4ec71c6897
Merge pull request #16608 from ClickHouse/tavplubix-patch-1 
Add soft task timeout for Intergation tests
 2021-03-19 15:25:21 +03:00
alesapin
2c00b48f85 Add an ability to run N random tests 2021-03-19 15:10:18 +03:00
Kruglov Pavel
e45b44fe8c
Restart tests 2021-03-19 14:16:19 +03:00
alesapin
260a978636 Check linearizeability for queue workload 2021-03-19 13:46:14 +03:00
Maksim Kita
a53c90e509 Upated system.dictionaries table 2021-03-19 12:43:57 +03:00
alesapin
58eac8a8b4 Add non-symmetric network partitioners 2021-03-19 12:40:59 +03:00
Nikolai Kochetov
bc63d4244b
Merge pull request #21856 from ClickHouse/aggregator-no-more-keys-batch 
Batch aggregation for overflow rows.
 2021-03-19 11:52:55 +03:00
Maksim Kita
f340e71913
Merge pull request #21859 from kitaisreal/ddl-dictionary-current-database-name 
DDL dictionary use current database name
 2021-03-19 11:39:51 +03:00
alesapin
81c408cb7f Return meta and storage from snapshot 2021-03-19 11:08:43 +03:00
Alexander Kuzmenkov
b5e344bf49
Update date_time_long.xml 2021-03-19 02:19:58 +03:00
Alexander Kuzmenkov
1beba597ca Merge remote-tracking branch 'origin/master' into HEAD 2021-03-19 02:11:08 +03:00
Alexander Kuzmenkov
6aa9039f7d float frames and lag/lead_in_frame 2021-03-19 02:05:43 +03:00
alesapin
2654147113 Fix on fix 2021-03-19 00:14:43 +03:00
alesapin
0137a6baac Add test founding bug 2021-03-18 23:55:11 +03:00
kssenii
f1ef87d966 Fix 2021-03-18 20:04:54 +00:00
Pavel Kruglov
2a24d4f295 Add init.py 2021-03-18 20:27:37 +03:00
Pavel Kruglov
d380454044 Change read_data_timeout from sec to ms, add profile event for hedged requests and better process receiving packets 2021-03-18 20:16:17 +03:00
Alexander Tokmakov
d7482373d3 fix 2021-03-18 19:59:51 +03:00
Maksim Kita
85a9ab7d87 Fixed test 2021-03-18 19:32:04 +03:00
tavplubix
93ee8cc78b
Merge pull request #21819 from TCeason/fix_integration_MaterializeMySQL 
fix integration MaterializeMySQL test
 2021-03-18 19:22:31 +03:00
Maksim Kita
140fa855c4
Update 01760_ddl_dictionary_use_current_database_name.sql 2021-03-18 18:11:21 +03:00
Alexander Kuzmenkov
c821c0c27a
Merge pull request #21761 from ClickHouse/aku/chunk-no-columns 
fix incorrect number of rows for Chunks with no columns in PartialSor…
 2021-03-18 17:58:09 +03:00
Alexander Tokmakov
4ea3178efc fix 2021-03-18 17:51:09 +03:00
Maksim Kita
5324d75505 Fixed tests 2021-03-18 17:12:25 +03:00
alesapin
f3ff437a39 Add all nodes killer/stop, one multitransaction request and counter test 2021-03-18 14:32:45 +03:00
Maksim Kita
0f95bcac0b DDL dictionary use current database name 2021-03-18 14:30:12 +03:00
Maksim Kita
cf985a86c4 test 2021-03-18 14:25:13 +03:00
Nikolai Kochetov
03cb0299a9
Merge pull request #21841 from ClickHouse/fix-21773 
Fix wrong column order after  filter push down.
 2021-03-18 13:30:22 +03:00
Maksim Kita
18ed9c5c67 SSDCacheDictionary remove max_stored_keys option 2021-03-18 12:55:17 +03:00
Nikolai Kochetov
b957162ca5 Add perftest. 2021-03-18 12:38:37 +03:00
kssenii
b135b814fb less crazy test 2021-03-18 07:02:12 +00:00
TCeason
1f5904fea9 fix integration MaterializeMySQL test 
https://github.com/ClickHouse/ClickHouse/pull/21759
 2021-03-18 14:08:26 +08:00
Denis Zhuravlev
597370e9bc mark the test long 2021-03-17 23:27:36 -03:00
Denis Zhuravlev
ff9e74bf2a test for #17302 2021-03-17 20:29:24 -03:00
tavplubix
0826004353
Merge branch 'master' into tavplubix-patch-1 2021-03-17 22:31:35 +03:00
Pavel Kruglov
53095bb6e4 Add model 2021-03-17 22:31:23 +03:00
Alexander Tokmakov
f0c930bf9d remove query timeouts 2021-03-17 22:28:18 +03:00
alexey-milovidov
04c957962f
Merge pull request #21724 from azat/tests-replicated-merge-tree-zk-path 
Do not overlap zookeeper path for ReplicatedMergeTree in stateless *.sh tests
 2021-03-17 22:11:14 +03:00
Pavel Kruglov
bf888b7e5f Fix deadlock in first catboost model execution 2021-03-17 21:57:40 +03:00
Maksim Kita
bc22f4f6eb Updated implementation 2021-03-17 20:14:36 +03:00
Nikolai Kochetov
6397099d3c Added test. 2021-03-17 20:08:49 +03:00
kssenii
51cb89973d Add test 2021-03-17 13:57:55 +00:00
Nikita Mikhaylov
f51b41b7a4
Merge pull request #21710 from kssenii/replica-priorities 
Support replicas priority for postgres dictionary source
 2021-03-17 16:02:00 +03:00
Pavel Kovalenko
7ba1b8dbd5 Fixed flaky test_merge_tree_s3::test_insert_same_partition_and_merge 2021-03-17 16:00:22 +03:00
alesapin
2ee58ed82f Fix style 2021-03-17 16:00:08 +03:00
alesapin
7c4fdd79cf Add unique-ids workload 2021-03-17 15:58:01 +03:00
kevin wan
accc3d0d38
fix 'str' object has no attribute 'decode' in python3 2021-03-17 20:08:30 +08:00
alesapin
ecd081144c Add missing hammer-time nemesis 2021-03-17 14:54:26 +03:00
alesapin
341e223419 Better corruption nemesises, options 2021-03-17 14:35:37 +03:00
Nikolai Kochetov
05a9f8a793
Update 01755_shard_pruning_with_literal.sql 2021-03-17 12:34:59 +03:00
Nikolai Kochetov
3a3f800f6e
Merge pull request #21579 from azat/dist-query-zero-shards-fix 
Fix optimize_skip_unused_shards for zero shards case
 2021-03-17 11:54:08 +03:00
Nikolai Kochetov
4f1f344d4d
Merge pull request #21529 from azat/system.errors-improvements 
Add last_error_time/last_error_message/last_error_stacktrace/remote columns for system.errors
 2021-03-17 11:51:29 +03:00
alesapin
d9f835a242 Finally corrupted logs 2021-03-17 11:13:52 +03:00
alexey-milovidov
d02726bcac
Merge pull request #9404 from Enmk/DateTime64_extended_range 
Date time64 extended range
 2021-03-17 11:06:03 +03:00
alesapin
46af999f3a Trying to add corruption nemesis 2021-03-17 10:11:55 +03:00
tavplubix
d42b442b83
Update ci-runner.py 2021-03-17 03:57:33 +03:00
tavplubix
ccf46d8269
Update ci-runner.py 2021-03-17 02:16:03 +03:00
tavplubix
a093980767
Merge pull request #21711 from kssenii/non-default-schema 
Support non-default table schema for postgres storage/table-function
 2021-03-17 02:10:32 +03:00
tavplubix
5d73a96a51
Update ci-runner.py 2021-03-17 00:39:38 +03:00
alesapin
82b2c34c40 Remove strange file 2021-03-16 23:27:09 +03:00
Azat Khuzhin
9921e7ca28 Add 01545_system_errors into skip_list.parallel 
https://clickhouse-test-reports.s3.yandex.net/21529/2ce2772d35eb3d81628f4d294d5799e9f05333fd/functional_stateless_tests_flaky_check_(address).html#fail1
 2021-03-16 22:31:49 +03:00
Azat Khuzhin
cc87bcfb63 Fix errorCodeToName() for signed integers 
- https://clickhouse-test-reports.s3.yandex.net/21529/2ce2772d35eb3d81628f4d294d5799e9f05333fd/functional_stateless_tests_(address).html#fail1
- https://clickhouse-test-reports.s3.yandex.net/21529/2ce2772d35eb3d81628f4d294d5799e9f05333fd/functional_stateless_tests_(ubsan).html#fail1
- https://clickhouse-test-reports.s3.yandex.net/21529/2ce2772d35eb3d81628f4d294d5799e9f05333fd/stress_test_(address).html#fail1
 2021-03-16 22:31:49 +03:00
Azat Khuzhin
259e5ba88e Separate accounting of remote exceptions in system.errors 2021-03-16 22:31:46 +03:00
Alexander Tokmakov
5037d2c10d add timeout for the whole task 2021-03-16 20:48:45 +03:00
Alexander Tokmakov
3ba6dc2aee Merge branch 'master' into tavplubix-patch-1 2021-03-16 20:05:07 +03:00
tavplubix
848bb59175
Merge pull request #21728 from ClickHouse/fix_alter_decimal 
Fix alter modify for decimal columns when type size doesn't change
 2021-03-16 20:01:35 +03:00
Ilya Golshtein
518103f851 old Avro test data removed 2021-03-16 19:39:58 +03:00
alesapin
54fbea68a1 Add hammer-time nemesis 2021-03-16 17:53:49 +03:00
Pavel Kovalenko
a43c85b105 Add test for freeze/unfreeze partition with old MergeTree syntax 2021-03-16 16:36:05 +03:00
Alexey Milovidov
1dd730d2d6 Fix perf test 2021-03-16 15:59:14 +03:00
alesapin
63873f46bb Create persistent nodes in tests 2021-03-16 15:40:28 +03:00
alesapin
8cf8265d47 Style 2021-03-16 15:37:46 +03:00
alesapin
6454479edd Add useful util for state dump 2021-03-16 14:44:43 +03:00
Nikita Mikhaylov
2e13c767a0
Merge pull request #21149 from nikitamikhaylov/pp-for-csv-with-names 
Support parallel parsing for *WithNames types
 2021-03-16 14:38:03 +03:00
Nikita Mikhaylov
7d7a2bc724
Merge pull request #21630 from nikitamikhaylov/pf-local 
Parallel formatting for clickhouse-local
 2021-03-16 14:37:40 +03:00
kssenii
f8a99804c1 Add double quotes 2021-03-16 11:15:43 +00:00
Alexey Milovidov
ea049b2cc0 Merge branch 'master' into DateTime64_extended_range 2021-03-16 14:08:02 +03:00
alexey-milovidov
f52e29cfec
Merge pull request #21624 from vdimir/storage-s3-fail 
Try to fix test_storage_s3: crash in WriteBufferFromS3
 2021-03-16 13:38:48 +03:00
kssenii
4bdfc799f5 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into non-default-schema 2021-03-16 10:05:10 +00:00
Nikolai Kochetov
e8d7349c79
Merge branch 'master' into dist-query-zero-shards-fix 2021-03-16 12:00:08 +03:00
alesapin
f49d6404f3 Trying to add new nemesis 2021-03-16 11:03:47 +03:00
Pavel Kovalenko
39f3b17041 Merge remote-tracking branch 'origin/master' into unfreeze-partitions 2021-03-16 10:56:24 +03:00
alesapin
23a7c00ba4
Merge branch 'master' into fix_alter_decimal 2021-03-16 10:24:46 +03:00
alesapin
8fd3fbc5b3
Merge pull request #20387 from Avogar/optimize-on-insert 
Don't create empty parts on INSERT
 2021-03-16 10:20:34 +03:00
Azat Khuzhin
a03a9051e1 Mark some tests as long 
From [1] and [2]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/21724/dacb6066237b78511ad5f07cc65045b8cf4e5e7b/functional_stateless_tests_flaky_check_(address).html#fail1
  [2]: https://clickhouse-test-reports.s3.yandex.net/21724/ee8ece157987f3cd8b68ca4a5b7df709f4688208/functional_stateless_tests_flaky_check_(address)/test_run.txt.out.log
  [3]: https://clickhouse-test-reports.s3.yandex.net/21724/e4485ce0b1d1b21c4360bbdecacd2485d1634a91/functional_stateless_tests_flaky_check_(address)/test_run.txt.out.log
 2021-03-16 09:52:31 +03:00
Amos Bird
f00e108410
Fix scalar subquery index analysis 2021-03-16 14:07:30 +08:00
Azat Khuzhin
05a8c73eb9 Do not overlap zookeeper path for ReplicatedMergeTree in stateless *.sh tests 
Found with stress tests for 00626_replace_partition_from_table_zookeeper [1]:

    2021.03.15 00:59:48.200106 [ 27417 ] {0f47dbeb-938a-4560-8408-a7cc7b3bafb8} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON test_31.dst_r1
    ...
    2021.03.15 00:59:48.403227 [ 27417 ] {0f47dbeb-938a-4560-8408-a7cc7b3bafb8} <Debug> test_31.dst_r1: This table /clickhouse/test_00626/dst_1 is already created, will add new replica
    2021.03.15 00:59:48.736450 [ 83006 ] {b2db1355-3ec3-4e3a-9c79-f93f27c6e658} <Trace> ContextAccess (default): Access granted: CREATE TABLE ON test_31.dst_r2
    ...
    2021.03.15 00:59:48.851768 [ 83006 ] {b2db1355-3ec3-4e3a-9c79-f93f27c6e658} <Debug> test_31.dst_r2: This table /clickhouse/test_00626/dst_1 is already created, will add new replica
    ...
    2021.03.15 00:59:48.919059 [ 366 ] {} <Debug> test_31.dst_r2 (ReplicatedMergeTreeQueue): Loading queue from /clickhouse/test_00626/dst_1/replicas/2/queue
    2021.03.15 00:59:48.919948 [ 366 ] {} <Debug> test_31.dst_r2 (ReplicatedMergeTreeQueue): Having 3 queue entries to load, 0 entries already loaded.
    2021.03.15 00:59:48.921833 [ 366 ] {} <Trace> test_31.dst_r2 (ReplicatedMergeTreeQueue): Loaded queue
    ...
    2021.03.15 00:59:51.904230 [ 246952 ] {59753eea-3896-45ca-8625-fdaa094ee9ef} <Trace> ContextAccess (default): Access granted: SYSTEM SYNC REPLICA ON test_31.dst_r2
    ...
    2021.03.15 01:04:51.913683 [ 246952 ] {59753eea-3896-45ca-8625-fdaa094ee9ef} <Error> InterpreterSystemQuery: SYNC REPLICA test_31.dst_r2: Timed out!

  [1]: https://clickhouse-test-reports.s3.yandex.net/21716/402bf77783cbda48a9ee1b748bfce3c52ef8fe11/stress_test_(memory)/test_run.txt.out.log

But the problem is more generic, so fix all tests.
 2021-03-16 07:22:32 +03:00
Azat Khuzhin
e6b9740a69 Add $CLICKHOUSE_TEST_ZOOKEEPER_PREFIX (for *.sh stateless tests) 2021-03-16 07:22:32 +03:00
Azat Khuzhin
54f124aae4 Cleanup 00626_replace_partition_from_table_zookeeper 2021-03-16 07:22:32 +03:00
Anton Popov
ecd9220c77 minor fixes 2021-03-16 02:28:11 +03:00
Alexander Kuzmenkov
3c16ea0bc8 fix incorrect number of rows for Chunks with no columns in PartialSortingTransform 2021-03-16 01:59:12 +03:00
Alexey Milovidov
f48bf2aaba Fix issue 2021-03-15 23:29:35 +03:00
Alexey Milovidov
845f4afbf4 Fix parsing of pre-epoch time 2021-03-15 21:09:05 +03:00
Alexey Milovidov
badd5165da Fix UBSan report in rounding to years intervals 2021-03-15 20:36:49 +03:00
Anton Popov
840417c957
Merge pull request #21685 from Avogar/reload-cluster-config 
Update clusters only if their configs were updated
 2021-03-15 20:09:58 +03:00
Alexey Milovidov
eaeb4a3bf0 Merge branch 'master' into DateTime64_extended_range 2021-03-15 16:59:32 +03:00
Nikita Mikhaylov
c92d8c776c try to avoid race in grpc server 2021-03-15 15:14:58 +03:00
alesapin
31ec24255e Fix skip list 2021-03-15 14:24:52 +03:00
alesapin
307b89f6b0 fix skip list 2021-03-15 14:20:11 +03:00
alesapin
42ccee286a Merge branch 'master' into jepsen_for_nukeeper 2021-03-15 14:17:13 +03:00
tavplubix
984050e0d1
Merge pull request #21661 from Avogar/path-param 
Add test for path as a query parameter in system.zookeeper
 2021-03-15 13:13:36 +03:00
Vitaly Baranov
6153f52811
Merge pull request #21641 from vitlibar/allowed-grantees 
Add new clause GRANTEES for CREATE/ALTER USER
 2021-03-15 12:47:22 +03:00
Ilya Golshtein
abcf581005 avro bug with format_setting reference and a typo in kafka test 2021-03-15 12:19:33 +03:00
alesapin
caccc6da37 Add missing tests 2021-03-15 12:01:26 +03:00
alesapin
d502a217e5 Merge branch 'master' into Avogar-optimize-on-insert 2021-03-15 11:38:25 +03:00
tavplubix
6a265f468e
Merge branch 'master' into distributed_ddl_improvements 2021-03-15 11:24:14 +03:00
alesapin
69b8ded578 Fix alter modify for decimal columns when type size doesn't change 2021-03-15 11:22:15 +03:00
alexey-milovidov
adbf032235
Merge pull request #21713 from ClickHouse/modulo-ubsan 
Fix UBSan report in modulo by constant
 2021-03-14 23:19:12 +03:00
Vitaly Baranov
37ce6e26d3 Add a new clause GRANTEES to commands CREATE USER and ALTER USER. 2021-03-14 19:12:42 +03:00
Vitaly Baranov
d6e0342c30 Improvements in implementations of the classes AccessRights and GrantedRoles. 2021-03-14 19:12:35 +03:00
alesapin
dad5238d7d
Merge pull request #16240 from ianton-ru/s3_zero_copy_replication 
S3 zero copy replication
 2021-03-14 18:19:37 +03:00
Alexey Milovidov
b3d2948081 Fix UBSan report in modulo by constant 2021-03-14 17:31:07 +03:00
Maksim Kita
c94ee3151d
Merge pull request #21182 from ikarishinjieva/fix_#21170 
fix #21170
 2021-03-14 17:24:39 +03:00
Ilya Golshtein
a579fcb424 kafka/avro works against table 2021-03-14 15:55:44 +03:00
alexey-milovidov
f1223e7548
Merge pull request #21674 from azat/fix-flaky-test_replace_partition 
Fix flaky test_replace_partition
 2021-03-14 14:11:11 +03:00
Maksim Kita
40d2ec7924
Merge pull request #19816 from kitaisreal/range-hashed-dictionary-support-has-keys 
RangeHashed dictionary support dictHas function
 2021-03-14 13:44:06 +03:00
kssenii
797063ae0f Support non-default table schema for postgres storage/table-function 2021-03-14 10:35:10 +00:00
alexey-milovidov
edbaf756a0
Merge pull request #21696 from azat/stress-tests-fixes 
Tests fixes (that was found by stress tests)
 2021-03-14 12:31:57 +03:00
alexey-milovidov
c9f14052bc
Merge pull request #21700 from azat/clickhouse-test-fix-log-comment 
Fix log_comment for *.sh in clickhouse-test
 2021-03-14 12:29:57 +03:00
alexey-milovidov
53e21443eb
Merge branch 'master' into DateTime64_extended_range 2021-03-14 12:27:17 +03:00
kssenii
8eea6a87e9 Support replicas priority for postgres dictionary source 2021-03-14 08:51:24 +00:00
Pavel Kruglov
e116e75d2c Fix style 2021-03-14 02:36:40 +03:00
Pavel Kruglov
3e3b5c64bf add init file 2021-03-14 02:34:32 +03:00
Maksim Kita
98192f1234
Update 01280_ssd_complex_key_dictionary.sql 2021-03-14 01:28:53 +03:00
Pavel Kruglov
d83b4d3ab6 Try fix flacky test 2021-03-13 23:44:06 +03:00
Maksim Kita
b1398e6ffa Updated test 2021-03-13 23:26:01 +03:00
Maksim Kita
084bd03672
Merge pull request #21692 from azat/dict-ip_trie-access_to_key_from_attributes 
Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes
 2021-03-13 23:13:26 +03:00
alesapin
06eb2d8dfd
Merge branch 'master' into s3_zero_copy_replication 2021-03-13 22:32:54 +03:00
Azat Khuzhin
334520557c Fix log_comment for *.sh in clickhouse-test 
setdefault will set it only once
 2021-03-13 18:15:16 +03:00
Anton Popov
68b3cbbfe9 fix conversions for fields in function 'arrayElement' for type Map 2021-03-13 17:49:43 +03:00
alexey-milovidov
38c068725d
Merge pull request #21691 from azat/clickhouse-test-fix 
Fix error message in clickhouse-test
 2021-03-13 15:20:31 +03:00
alexey-milovidov
36935a335f
Merge pull request #21102 from Enmk/governance/query_log 
Added Grant, Revoke and System query_kind for system.query_log
 2021-03-13 15:16:32 +03:00
Maksim Kita
ee8c51f65e Fixed tests 2021-03-13 14:58:31 +03:00
Maksim Kita
add444f71c Fixed broken test 2021-03-13 14:58:31 +03:00
Maksim Kita
854bfaf366 RangeHashed dictionary support has function 2021-03-13 14:57:56 +03:00
Azat Khuzhin
833dbf1225 Mark 01294_lazy_database_concurrent_recreate_reattach_and_show_tables as long 2021-03-13 13:43:17 +03:00
Maksim Kita
79b061ac3c
Merge pull request #21668 from kitaisreal/dictionary-attributes-unique-names 
DictionaryStructure fix non unique attribute names
 2021-03-13 12:31:33 +03:00
Azat Khuzhin
2d66a5c393 Fix hang check for 00966_live_view_watch_events_http 
If INSERT was failed then WATCH EVENTS will hang:

    2021.03.12 23:45:33.666223 [ 1901 ] {} <Trace> DynamicQueryHandler: Request URI: /?allow_experimental_live_view=1&query=WATCH%20test.lv%20EVENTS
    ...
    2021.03.12 23:45:34.119465 [ 35492 ] {55f2c8ec-df9f-4e97-9acc-385ed5b5fde2} <Error> executeQuery: Code: 241, e.displayText() = DB::Exception: Memory limit (for user) exceeded: would use 153.99 MiB (attempt to allocate chunk of 4194729 bytes), maximum: 150.00 MiB (version 21.4.1.6239) (from [::1]:43910) (in query: INSERT INTO test.mt VALUES ), Stack trace (when copying this message, always include the lines below):
    ...

Hung check:

    elapsed:              597.835824299
    is_cancelled:         0
    query:                WATCH test.lv EVENTS
    thread_ids:           [1901]

gdb:

    Thread 133 (Thread 0x7f26ac95b700 (LWP 1901)):
    0  0x00007f2793d447b1 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/x86_64-linux-gnu/libpthread.so.0
    1  0x0000000008cbd5c5 in __tsan::call_pthread_cancel_with_cleanup(int (*)(void*, void*, void*), void*, void*, void*, void (*)(void*), void*) ()
    2  0x0000000008c4f134 in cond_wait(__tsan::ThreadState*, unsigned long, __tsan::ScopedInterceptor*, int (*)(void*, void*, void*), void*, void*, void*) ()
    3  0x0000000008c4f339 in pthread_cond_timedwait ()
    4  0x000000001831c8b6 in std::__1::__libcpp_condvar_timedwait (__cv=0x7b5801053520, __m=0x189, __ts=0x7f26ac9132b8) at ../contrib/libcxx/include/__threading_support:442
    5  std::__1::condition_variable::__do_timed_wait (this=0x7b5801053520, lk=..., tp=...) at ../contrib/libcxx/src/condition_variable.cpp:74
    6  0x00000000134fe7f2 in std::__1::condition_variable::wait_for<long long, std::__1::ratio<1l, 1000000l> > (this=this@entry=0x7b5801053520, __lk=..., __d=...) at ../contrib/libcxx/include/__mutex_base:462
    7  0x00000000134fe2c9 in DB::LiveViewEventsBlockInputStream::tryReadImpl (this=this@entry=0x7b5c0070ff98, blocking=false) at ../src/Storages/LiveView/LiveViewEventsBlockInputStream.h:180
    8  0x00000000134fd6e4 in DB::LiveViewEventsBlockInputStream::readImpl (this=0x189) at ../src/Storages/LiveView/LiveViewEventsBlockInputStream.h:115
    9  0x0000000012285593 in DB::IBlockInputStream::read (this=0x7b5c0070ff98) at ../src/DataStreams/IBlockInputStream.cpp:58
    10 0x00000000122afc7e in DB::copyDataImpl<std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&>(DB::IBlockInputStream&, DB::IBlockOutputStream&, std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&) (from=..., to=..., is_cancelled=..., progress=...) at ../src/DataStreams/copyData.cpp:26
    11 0x00000000122af8e1 in DB::copyData(DB::IBlockInputStream&, DB::IBlockOutputStream&, std::__1::function<bool ()> const&, std::__1::function<void (DB::Block const&)> const&) (from=..., to=..., is_cancelled=..., progress=...) at ../src/DataStreams/copyData.cpp:73
    12 0x0000000012cfc5e2 in DB::executeQuery(DB::ReadBuffer&, DB::WriteBuffer&, bool, DB::Context&, std::__1::function<void (std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&)>) (istr=..., ostr=..., allow_into_outfile=false, context=..., set_result_details=...) at ../src/Interpreters/executeQuery.cpp:1033
    13 0x000000001357941d in DB::HTTPHandler::processQuery (this=this@entry=0x7b1c006f41b0, context=..., request=..., params=..., response=..., used_output=..., query_scope=...) at ../src/Server/HTTPHandler.cpp:772
    14 0x000000001357c507 in DB::HTTPHandler::handleRequest (this=<optimized out>, request=..., response=...) at ../src/Server/HTTPHandler.cpp:910
    15 0x00000000135f3081 in DB::HTTPServerConnection::run (this=<optimized out>) at ../src/Server/HTTP/HTTPServerConnection.cpp:48
    16 0x00000000161f9e73 in Poco::Net::TCPServerConnection::start (this=0x7b8c01554000) at ../contrib/poco/Net/src/TCPServerConnection.cpp:43
    17 0x00000000161fa59f in Poco::Net::TCPServerDispatcher::run (this=<optimized out>) at ../contrib/poco/Net/src/TCPServerDispatcher.cpp:113
    18 0x0000000016361732 in Poco::PooledThread::run (this=<optimized out>) at ../contrib/poco/Foundation/src/ThreadPool.cpp:199
    19 0x000000001635fcd0 in Poco::(anonymous namespace)::RunnableHolder::run (this=<optimized out>) at ../contrib/poco/Foundation/src/Thread.cpp:55
    20 0x000000001635e4d8 in Poco::ThreadImpl::runnableEntry (pThread=0x7b5400082538) at ../contrib/poco/Foundation/src/Thread_POSIX.cpp:345
    21 0x0000000008c4e36d in __tsan_thread_start_func ()
    22 0x00007f2793d3d609 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0
    23 0x00007f2793c64293 in clone () from /lib/x86_64-linux-gnu/libc.so.6

Cc: @vzakaznikov
 2021-03-13 11:32:55 +03:00
Azat Khuzhin
68dff2d954 Mark 01018_ip_dictionary as long 
https://clickhouse-test-reports.s3.yandex.net/21692/481d897cadb6b1a309478f24a46efe506b7108d6/functional_stateless_tests_flaky_check_(address).html#fail1
 2021-03-13 11:06:49 +03:00
Azat Khuzhin
a301aa64da Do not use system-wide SYSTEM STOP TTL MERGES, use per-table instead 
Fixes 01294_lazy_database_concurrent_recreate_reattach_and_show_tables
 2021-03-13 10:37:26 +03:00
Azat Khuzhin
1ce9293e97 Fix 01035_lc_empty_part_bug under stress tests 
Found in [1]:

    2021.03.12 23:32:58.897190 [ 436606 ] {97a08a8f-4630-44f8-ba18-a94c6fabbded} <Information> test_13.lc_empty_part_bug: Waiting mutation: mutation_3.txt
    ...
    2021.03.12 23:32:58.900444 [ 374 ] {} <Debug> test_13.lc_empty_part_bug: Current max source part size for mutation is 0 but part size 1. Will not mutate part all_1_1_0_2. Max size depends not only on available space, but also on settings 'number_of_free_entries_in_pool_to_execute_mutation' and 'background_pool_size'
    ...

Hang check:

    query:                alter table lc_empty_part_bug modify column s LowCardinality(String);
    elapsed:              2156.396613506

  [1]: https://clickhouse-test-reports.s3.yandex.net/21511/d7d9638ceb6bd702f34a88ee54f8f83197e90af5/stress_test_(address).html#fail1
 2021-03-13 10:31:19 +03:00
Azat Khuzhin
481d897cad Fix SIGSEGV on not existing attributes from ip_trie with access_to_key_from_attributes 
Found with fuzzer [1]:

  [1]: https://clickhouse-test-reports.s3.yandex.net/21674/2e99dad56213413a72969d47650050b42cbcc073/fuzzer_asan/report.html#fail1
 2021-03-13 09:08:45 +03:00
Azat Khuzhin
eb3710c164 Fix error message in clickhouse-test 
{} was not replaced:

    Cannot get server pid with {}, got {}: {} lsof -i tcp:9000 -s tcp:LISTEN -Fp | awk '/^p[0-9]+$/{print substr($0, 2)}' b'306\n1025011\n' invalid literal for int() with base 10: b'306\n1025011\n'
 2021-03-13 08:43:41 +03:00
Pavel Kruglov
58e415c7d4 Update clusters only if their configs were updated 2021-03-13 00:17:19 +03:00
alesapin
ba9e1e5a8d Some initial code 
Add some java magic

Allow to connect with old session id

More angry nemesis and fixes

Angry

Fix style

Split to files

Better wrappers

Better structure

Add set test and split to separate files (I think something broken now)

Better

Missed files
 2021-03-12 22:07:57 +03:00
alexey-milovidov
f6bedf55e9
Merge pull request #21642 from azat/fsync_part_directory-horizontal-merge-fix 
Fix fsync_part_directory for horizontal merge
 2021-03-12 21:22:55 +03:00
Azat Khuzhin
2e99dad562 Tiny "machine" cleanup of test_replace_partition 2021-03-12 21:10:16 +03:00
Azat Khuzhin
5af5c90b8b Fix test_replace_partition flakiness 
test_replace_partition/test.py::test_replace_after_replace_failover
statistics:

```sql
┌──────ymd─┬─success─┬─failure─┐
│ 20200613 │      40 │       2 │
│ 20200614 │      98 │       2 │
│ 20200615 │     126 │       9 │
│ 20200616 │     141 │      10 │
│ 20200617 │     119 │       7 │
│ 20200618 │      87 │      12 │
│ 20200619 │      81 │       9 │
...
│ 20210305 │      60 │      28 │
│ 20210306 │      69 │       7 │
│ 20210307 │      42 │       0 │
│ 20210308 │      53 │       8 │
│ 20210309 │     137 │      23 │
│ 20210310 │      84 │      14 │
│ 20210311 │      81 │      20 │
└──────────┴─────────┴─────────┘
```
 2021-03-12 21:10:16 +03:00
Vasily Nemkov
f4246e7be5
Merge branch 'master' into governance/query_log 2021-03-12 18:31:08 +03:00