Commit Graph

3585 Commits

Author SHA1 Message Date
bharatnc
380c2bee7a TraceLog - add tests for event_time_microseconds 2020-09-25 10:39:37 -07:00
bharatnc
69e0d59c64 TextLog - add tests for field event_time_microsec 2020-09-25 10:39:37 -07:00
bharatnc
16ba71e2ec Rename test_test_log_level to include related tests 2020-09-25 10:39:37 -07:00
tavplubix
5d8de1f65d
Update ci_config.json 2020-09-25 20:31:01 +03:00
alesapin
8f9ec30315 Delete flaky test 2020-09-25 19:23:57 +03:00
alesapin
af0bb5bd26 One more time 2020-09-25 19:15:34 +03:00
Denis Zhuravlev
3eee9e31dd more tests for #11767 (from #11407 #15294) 2020-09-25 12:48:51 -03:00
alesapin
f9b971efa5
Merge pull request #15291 from ClickHouse/supress_lazy_pipes_fds
Trying to supress race in LazyPipeFDs
2020-09-25 18:38:46 +03:00
alesapin
ada193e7b7 Add diff 2020-09-25 16:33:33 +03:00
alesapin
54fa67838e Add flaky test 2020-09-25 16:32:00 +03:00
alesapin
86322fa3e1 Add test 2020-09-25 15:36:02 +03:00
Anton Popov
085f63a9bf fix hang of queries with a lot of subqueries to same mysql table 2020-09-25 14:12:48 +03:00
alesapin
d3f3867445
Update tsan_suppressions.txt 2020-09-25 13:46:38 +03:00
tavplubix
b96157e32b
Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 13:42:39 +03:00
Alexander Tokmakov
3f717ea1c4 fix skip lists 2020-09-25 13:39:59 +03:00
feng lv
92f7847b1d add test 2020-09-25 16:00:51 +08:00
alesapin
61ab1a264d Suppress race 2020-09-25 10:56:30 +03:00
alesapin
6d86544911 Trying to supress race in LazyPipeFDs 2020-09-25 10:55:41 +03:00
alesapin
9bf27fb42a
Merge pull request #15110 from nikitamikhaylov/split-huge-dictionary-test
Splitting test_dictionaries_all_layouts_and_sources
2020-09-25 10:16:28 +03:00
alesapin
2bacb6f6c8
Merge pull request #15220 from amosbird/fixjgc
Fix joinGet crash with LowCardinality types
2020-09-25 10:09:05 +03:00
alexey-milovidov
049f21091e
Update clickhouse-test 2020-09-25 08:05:50 +03:00
Alexey Milovidov
161ee1df3e Fail more quickly in clickhouse-test if server does not respond 2020-09-25 05:27:13 +03:00
Alexey Milovidov
85bfdbad24 Add a test for embedded configs 2020-09-25 05:12:51 +03:00
alexey-milovidov
13529265c4
Revert "Avoid deadlocks in Log/TinyLog" 2020-09-25 02:28:57 +03:00
Alexander Tokmakov
fb826557b7 Merge branch 'master' into enable_atomic_database_by_default 2020-09-25 02:04:01 +03:00
tavplubix
c268464f9f
add some disabled tests from arcadia to skip_list.json 2020-09-24 22:38:58 +03:00
tavplubix
0306c586a2
Update skip_list.json 2020-09-24 21:40:50 +03:00
alesapin
646e843105 100% lld-11 for clang-11 builds 2020-09-24 19:26:04 +03:00
tavplubix
1c9398c5ee
Merge pull request #15215 from ClickHouse/better_image_for_stateless
Better images for CI tests
2020-09-24 18:54:34 +03:00
Vitaly Baranov
0605808ed1
Merge pull request #14492 from vitlibar/use-previous-users-xml-if-failed-to-reload
Use previous users.xml if failed to reload
2020-09-24 16:25:19 +03:00
tavplubix
c298c633a7
Revert "Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka" 2020-09-24 16:10:24 +03:00
Alexander Kuzmenkov
813a876e93
Merge pull request #14962 from ClickHouse/log-avoid-deadlock
Avoid deadlocks in Log/TinyLog
2020-09-24 13:54:11 +03:00
Alexander Tokmakov
e7a764c2c5 fix flacky test 2020-09-24 13:49:36 +03:00
alesapin
f8ab9896e7 One more time 2020-09-24 13:32:49 +03:00
alesapin
912d45c443 Fix readme 2020-09-24 13:31:21 +03:00
alesapin
7277cbe1e6 Fix readme 2020-09-24 13:29:04 +03:00
alesapin
24cb88f808 Add readme 2020-09-24 13:28:13 +03:00
alesapin
2846645fa3 Update install.sh 2020-09-24 13:22:00 +03:00
alesapin
b8861ad6cc Move config files to directories 2020-09-24 13:21:34 +03:00
Artem Zuikov
8adb9c9224
test for fixed issue (#15189) 2020-09-24 12:39:55 +03:00
Amos Bird
a2845acf37
Fix joinGet crash with LowCardinality types. 2020-09-24 17:29:52 +08:00
Alexander Kuzmenkov
dfcc55b578
Merge pull request #15159 from 4ertus2/bigint
Back decimal_casts perf test
2020-09-24 11:35:46 +03:00
Alexander Kuzmenkov
8cbfd69adf
Update decimal_casts.xml 2020-09-24 11:35:35 +03:00
alesapin
0936a3c1f8 Install script for CI 2020-09-24 11:35:16 +03:00
Alexander Kuzmenkov
70e6b4093f
Update arcadia_skip_list.txt 2020-09-24 11:34:20 +03:00
alesapin
96c419974c Merge branch 'master' into codecs_for_nested_types 2020-09-24 10:28:20 +03:00
alesapin
7e6536097f
Merge pull request #15192 from ClickHouse/fix_storage_buffer_alter
Fix insert into storage Buffer after alter.
2020-09-24 10:22:58 +03:00
Alexander Kuzmenkov
9b29e31d64 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-23 23:58:43 +03:00
nikitamikhaylov
c64ac8596c better 2020-09-23 22:36:47 +03:00
nikitamikhaylov
2d4bdcfec0 file and executables 2020-09-23 22:31:47 +03:00
Alexander Tokmakov
f0f91f84af Merge branch 'master' into enable_atomic_database_by_default 2020-09-23 21:50:15 +03:00
Alexander Tokmakov
a8266a3d3c fix DDDL with cross-replication and Atomic 2020-09-23 21:28:59 +03:00
alexey-milovidov
3bc09bb867
Merge pull request #15178 from amosbird/dtcf
Fix performance issue when doing datetime comparison
2020-09-23 20:33:23 +03:00
Ilya Yatsishin
7dad84ea6b
Merge pull request #14265 from arenadata/ADQM-160
Test and doc for PR12771 krb5 + cyrus-sasl + kerberized kafka
2020-09-23 19:02:58 +03:00
Alexander Kuzmenkov
9f137e77e7
Update decimal_casts.xml 2020-09-23 18:41:52 +03:00
alesapin
1eb8f0a495 Fix bug in storage buffer during alter 2020-09-23 15:06:54 +03:00
Artem Zuikov
626c2dad9f
test for fixed issue (#15166) 2020-09-23 13:17:31 +03:00
Artem Zuikov
25e9d11e2f
Add test for fixed issue (#15164) 2020-09-23 13:16:59 +03:00
alesapin
74671c909c Merge branch 'master' into codecs_for_nested_types 2020-09-23 13:12:23 +03:00
Alexander Kuzmenkov
d2427a121f
Update decimal_casts.xml 2020-09-23 10:15:51 +03:00
Amos Bird
ee45395942
Fix datetime comparison 2020-09-23 10:29:55 +08:00
alexey-milovidov
cf24789c1b
Update 01505_log_distributed_deadlock.sql 2020-09-22 21:25:31 +03:00
Anton Popov
4b795c7b6a
temporarily run test with wide parts only 2020-09-22 18:58:14 +03:00
Artem Zuikov
f80ffc4dce restore decimal_casts perf test 2020-09-22 18:56:24 +03:00
alesapin
d56a455ea5 Remove outdated test 2020-09-22 17:47:07 +03:00
Alexander Tokmakov
7fcf20e48c enable more tests 2020-09-22 17:29:09 +03:00
nikitamikhaylov
c9cfdffcd7 mongo uri 2020-09-22 16:52:56 +03:00
Nikolai Kochetov
62ef40394a
Merge pull request #14856 from ClickHouse/query-plan-for-creating-sets
Query plan for creating sets
2020-09-22 16:19:20 +03:00
alesapin
9b6b5ae08d More tests 2020-09-22 16:16:42 +03:00
alesapin
fd394f699c Better comments 2020-09-22 15:49:55 +03:00
alesapin
96d06c6ae6 Less changes 2020-09-22 15:16:15 +03:00
Alexander Kuzmenkov
4937159f85
Merge pull request #14990 from ClickHouse/aku/longer-perf
If perf test definition changed, run everything + longer (as in master)
2020-09-22 13:25:49 +03:00
Alexander Kuzmenkov
e646aa306f
Update columns_hashing.xml 2020-09-22 13:25:16 +03:00
Alexander Kuzmenkov
ba12e68d70
Update insert_values_with_expressions.xml 2020-09-22 13:23:10 +03:00
Artem Zuikov
2280482530
Keep LowCardinality in MergeJoin left key result type (#15088) 2020-09-22 13:16:22 +03:00
Alexander Kuzmenkov
d7c7619cd8 add test for https://github.com/ClickHouse/ClickHouse/issues/14570 2020-09-22 13:14:36 +03:00
Alexander Kuzmenkov
c0241b617a Merge remote-tracking branch 'origin/master' into HEAD 2020-09-22 13:14:31 +03:00
Alexander Tokmakov
dc1cc11764 Merge branch 'master' into enable_atomic_database_by_default 2020-09-22 12:40:32 +03:00
alesapin
b57708c3dd Merge branch 'master' into codecs_for_nested_types 2020-09-22 09:52:31 +03:00
Alexander Tokmakov
91cbd49e85 fix tests 2020-09-22 00:09:50 +03:00
nikitamikhaylov
d87f3660ee done 2020-09-21 23:19:46 +03:00
Alexey Milovidov
6e596b9c7d Added a test for Enum conversion in Distributed table if one shard is local 2020-09-21 21:15:41 +03:00
Alexey Milovidov
1e65105b06 Merge branch 'master' into log-avoid-deadlock 2020-09-21 21:09:06 +03:00
alexey-milovidov
7744eccd0a
Merge pull request #15064 from den-crane/tests/CTE
more tests for CTE
2020-09-21 20:41:53 +03:00
Alexander Kuzmenkov
1eb5137bbf
Merge pull request #15062 from ClickHouse/add-test-4476
Add a test for #4476
2020-09-21 20:41:25 +03:00
alesapin
e87b961095 Trying to add same logic for compact parts 2020-09-21 20:35:09 +03:00
Ilya Golshtein
494e59e7c1 DOCKER_KERBEROS_KDC_TAG 2020-09-21 19:12:31 +03:00
alesapin
e37099f65e Better test 2020-09-21 18:45:51 +03:00
alesapin
8517dda807 First working test 2020-09-21 17:47:10 +03:00
Alexander Kuzmenkov
4dae587e2d fix test 2020-09-21 15:02:34 +03:00
Alexander Kuzmenkov
85be1f1685 Merge remote-tracking branch 'origin/master' into HEAD 2020-09-21 14:57:25 +03:00
Alexander Tokmakov
13e41cdd20 try enable atomic database by default 2020-09-21 13:55:34 +03:00
Denis Zhuravlev
aa25df9d45 order by added for quieries with limit 2020-09-20 19:43:19 -03:00
alexey-milovidov
3e0509af69
Merge pull request #13573 from amosbird/rms
specific ReplicatedMergeTree settings
2020-09-21 01:36:33 +03:00
Denis Zhuravlev
fe0f8117af more tests for CTE 2020-09-20 19:22:57 -03:00
Alexey Milovidov
6e1bd79d51 Add a test for #4476 2020-09-21 00:25:47 +03:00
alexey-milovidov
8630d1baf4
Merge pull request #15033 from amosbird/fixstringkey
Fix incorrect key condition of fixed strings.
2020-09-20 19:51:24 +03:00
alexey-milovidov
55eb533fda
Merge pull request #15034 from amosbird/fff
Improve performance of grouping by single LowCardinality(FixedString)
2020-09-20 19:42:38 +03:00
alexey-milovidov
a4337635cc
Update single_fixed_string_groupby.xml 2020-09-20 19:42:11 +03:00
alexey-milovidov
7b35a6a59a
Merge pull request #15028 from ClickHouse/fix-bar
Fix buffer overflow in "bar" function
2020-09-20 19:04:15 +03:00
alexey-milovidov
3f5d7843f6
Merge pull request #15029 from ClickHouse/cast-single-argument
Proper exception message for wrong number of arguments of CAST
2020-09-20 19:03:47 +03:00
alexey-milovidov
bf81dcbd2f
Merge pull request #15031 from den-crane/test/01475_mutation_with_if
more tests for mutation nullable
2020-09-20 19:02:51 +03:00
Vitaly Baranov
a288674867 Fix testflows tests. 2020-09-20 18:49:56 +03:00
alesapin
5ffee8808a
Alter remove column properties and TTLs (#14742) 2020-09-20 16:27:33 +03:00
Amos Bird
8ca4d6634e
better fixed string group by support 2020-09-20 15:20:09 +08:00
Amos Bird
fcee786320
Fix incorrect key condition of fixed strings. 2020-09-20 11:53:29 +08:00
Denis Zhuravlev
cd53a70163 constant output order 2020-09-19 18:40:14 -03:00
Denis Zhuravlev
71568130d8 more tests for #14646 2020-09-19 18:33:02 -03:00
Alexey Milovidov
5a47e64685 Proper exception message for wrong number of arguments of CAST 2020-09-19 22:34:24 +03:00
Alexey Milovidov
ace6130585 Added a test 2020-09-19 22:28:43 +03:00
Alexey Milovidov
194c8da69a Tweak test 2020-09-19 19:49:24 +03:00
alexey-milovidov
55544939b3
Update 01494_storage_join_persistency.sql 2020-09-19 19:39:47 +03:00
alexey-milovidov
a0ffdb1f45
Update 01493_storage_set_persistency.sql 2020-09-19 19:39:24 +03:00
alexey-milovidov
2cab30ba8d
Merge pull request #14521 from hexiaoting/dev_like
Add new feature: SHOW DATABASES like 'xxx'
2020-09-19 16:34:37 +03:00
alexey-milovidov
acbdc51460
Merge pull request #14771 from amosbird/withsub
First attempt of supporting CTE
2020-09-19 16:25:34 +03:00
Vitaly Baranov
33efb36714 Use previous users.xml if failed to reload. 2020-09-19 16:21:12 +03:00
Alexey Milovidov
3003ebabc2 Merge branch 'master' into Vxider-disable_set_and_join_persistency 2020-09-19 15:51:40 +03:00
alexey-milovidov
eb9ee723c3
Merge pull request #11913 from ClickHouse/compact-parts-by-default
Enable compact parts by default for small parts
2020-09-19 15:31:15 +03:00
Alexey Milovidov
da87861285 Another test 2020-09-19 15:15:47 +03:00
tavplubix
6e0bdaf46d
Merge pull request #14535 from zhang2014/fix/datetime
ISSUES-4006 support decimal data type for MaterializedMySQL
2020-09-19 14:05:32 +03:00
Alexey Milovidov
4d06bc62b1 Allow concurrent reads while writing to TinyLog 2020-09-19 14:02:11 +03:00
Alexey Milovidov
111acdc63b Continuation 2020-09-19 14:02:11 +03:00
Alexey Milovidov
8a8284ce31 Avoid deadlocks in Log/TinyLog 2020-09-19 14:02:11 +03:00
alexey-milovidov
c1402d62db
Merge pull request #14892 from vzakaznikov/fix_test_distributed_over_live_view2
Fixing tests/integration/test_distributed_over_live_view/test.py
2020-09-19 13:59:05 +03:00
alexey-milovidov
65517da62b
Merge pull request #14495 from nikitamikhaylov/update-permutation-bugfix-3
updatePermumation with Nullable
2020-09-19 13:53:55 +03:00
alexey-milovidov
0d26228599
Merge pull request #15002 from 4ertus2/bugs
Fix crash in RIGHT or FULL JOIN switch
2020-09-19 13:45:10 +03:00
alexey-milovidov
1fcebce926
Merge pull request #15000 from Jokser/disable-ttl-move-on-insert
Option to disable TTL move on data part insert
2020-09-19 13:45:02 +03:00
alexey-milovidov
3463d97f8c
Merge pull request #14973 from amosbird/bm2
Ignore key constraints when doing mutations.
2020-09-19 13:44:30 +03:00
alexey-milovidov
988b20a32c
Merge pull request #14684 from azat/parallel-distributed_ddl
Allow parallel execution of distributed DDL
2020-09-18 22:18:17 +03:00
Pavel Kovalenko
1fc3aa3ea8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 22:10:49 +03:00
Pavel Kovalenko
77be35a2b8 Fixed test_disabled_ttl_move_on_insert test 2020-09-18 21:59:56 +03:00
Amos Bird
d842cb704f
Allow mutations to work with key constraints. 2020-09-19 02:40:02 +08:00
Pavel Kovalenko
da04a130ed Add option to disable ttl move on data part insert - minor fixes. 2020-09-18 20:45:30 +03:00
tavplubix
1762535ffc
Merge pull request #14797 from Vxider/add_tablefunction_null
Add table function null
2020-09-18 20:34:35 +03:00
Artem Zuikov
28afbafa08 fix crash in RIGHT or FULL JOIN switch 2020-09-18 19:25:20 +03:00
Pavel Kovalenko
0da19ab46d Add option to disable ttl move on data part insert 2020-09-18 18:30:00 +03:00
Alexander Kuzmenkov
8995140ffb Merge remote-tracking branch 'origin/master' into HEAD 2020-09-18 18:06:41 +03:00
alesapin
e38b537017
Merge pull request #11684 from ClickHouse/manual-write-duplicate-parts-to-replicas
Don't ignore duplicate parts written to replicas
2020-09-18 16:50:00 +03:00
Alexander Kuzmenkov
e7b9319e12 If perf test definition changed, run everything + longer (as in master)
Also some other perf test fixes
2020-09-18 16:28:46 +03:00
Nikolai Kochetov
e5dfc38bfe Skip 01455_shard_leaf_max_rows_bytes_to_read for arcadia. 2020-09-18 16:13:04 +03:00
Vxider
c9249f77c7 rename persistency to persistent 2020-09-18 20:58:27 +08:00
Vxider
0c535062fc rename disable_persistency to persistency 2020-09-18 20:48:55 +08:00
Nikolai Kochetov
c7aff19937
Merge pull request #14221 from hagen1778/settings-leaf-limits
[settings]: introduce new query complexity settings for leaf-nodes
2020-09-18 14:05:10 +03:00
Artem Zuikov
0520b05001
Speedup wide integers (#14859) 2020-09-18 12:51:44 +03:00
alesapin
748fb74de2 Fix build type for integration tests 2020-09-18 10:02:55 +03:00
Vxider
fb31544d4a add blank line to the end of file 2020-09-18 09:39:15 +08:00
Vxider
848664c4af rewrite performance test to functional test 2020-09-18 09:34:51 +08:00
Anton Popov
d1e90e0e4b fix tests 2020-09-18 03:05:51 +03:00
alexey-milovidov
76a3cc2dae
Merge pull request #14937 from filimonov/finalizeAggregation_statefullness
Fix enable_optimize_predicate_expression for finalizeAggregation
2020-09-18 01:24:02 +03:00
alexey-milovidov
cf5db5e4dc
Merge pull request #14888 from azat/client-imporove-INSERT-error-message
Improve error message for INSERT via clickhouse-client
2020-09-18 01:13:22 +03:00
alesapin
dc677b93fb Comments and fix test 2020-09-17 22:30:17 +03:00
Alexander Tokmakov
06ff6d2eda better 01193_metadata_loading 2020-09-17 19:28:44 +03:00
zhang2014
64032e22a2 Merge branch 'master' into fix/datetime 2020-09-18 00:28:09 +08:00
Alexander Kuzmenkov
652163c07c
Merge pull request #14883 from ClickHouse/aku/ignore-thresholds
Adjust ignore thresholds for unstable perf tests
2020-09-17 18:14:53 +03:00
Alexander Kuzmenkov
5539c6ecaa
Merge pull request #14928 from ClickHouse/aku/special-builds
Move non-essential builds to special
2020-09-17 17:19:32 +03:00
Vitaly Baranov
3356d75b23
Merge pull request #13156 from azat/cluster-secure
Secure inter-cluster query execution (with initial_user as current query user) [v3]
2020-09-17 17:11:00 +03:00
alexey-milovidov
496df5b3e9
Merge pull request #14678 from sundy-li/patch-2
dynamic zookeeper config when session expired
2020-09-17 17:05:22 +03:00
Mikhail Filimonov
22bd22702e
Fix enable_optimize_predicate_expression for finalizeAggregation
finalizeAggregation was wrongly marked as stateful, preventing pushing the conditions down.
2020-09-17 15:59:14 +02:00
Vxider
1322a1ce7a add blank line to end of file 2020-09-17 21:53:39 +08:00
Ilya Golshtein
624a4c4d55 kdc Dockerfile integrated 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1862f58cf5 forgotten empty clickhouse_path dir 2020-09-17 16:51:34 +03:00
Ilya Golshtein
75836acddc code review changes 2020-09-17 16:51:34 +03:00
Ilya Golshtein
bcdb2277bd distutils=>shutil 2020-09-17 16:51:34 +03:00
Ilya Golshtein
23853cc8cf fix conflict resolution mistake 2020-09-17 16:51:34 +03:00
Ilya Golshtein
96c2a7c77e kerberized kafka test works after merge 2020-09-17 16:51:34 +03:00
Ilya Golshtein
1808a1e36c short krb ticket lifetime, Dockerile renamed 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c227f91636 remove_files improved, proper docker images, tiny cleanup 2020-09-17 16:51:34 +03:00
Ilya Golshtein
a2e72ec37a test via runner is Ok, switched to custom images 2020-09-17 16:51:34 +03:00
Ilya Golshtein
2d5c31d588 test_storage_kerberized_kafka cleanup + negative test 2020-09-17 16:51:34 +03:00
Ilya Golshtein
c12fa26fe3 kerberized kafka test works 2020-09-17 16:51:34 +03:00
alexey-milovidov
2413caa7d5
Merge pull request #14889 from ClickHouse/extract-all-groups-empty-match
Fix error in "extractAllGroups" function
2020-09-17 16:02:30 +03:00
Alexander Kuzmenkov
946d364b10 Move non-essential builds to special
Special builds have lower CI priority and start later. If some tests
fail, they won't start at all, so we'll save some CI time.
2020-09-17 14:41:14 +03:00
alesapin
40b2f203b6 Merge branch 'master' into manual-write-duplicate-parts-to-replicas 2020-09-17 13:21:00 +03:00
alesapin
50c55eb2d2
Merge pull request #14846 from ClickHouse/add_clang_11
Move to clang-11 in CI builds
2020-09-17 13:14:00 +03:00
alexey-milovidov
2886b38c03
Merge branch 'master' into fix_test_distributed_over_live_view2 2020-09-17 13:06:39 +03:00
Alexander Kuzmenkov
36538ce08f Don't account for short queries, we'll deal with them separately.
New query:

```
WITH ceil(max(q[3]), 1) AS h
SELECT concat('sed -i s\'/^<test.*$/<test max_ignored_relative_change="', toString(h), '">/g\' tests/performance/', test, '.xml') AS s
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05) AND (old > 0.2)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY test DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT PrettySpace
```
2020-09-17 13:00:51 +03:00
roman
b41421cb1c [settings]: introduce new query complexity settings for leaf-nodes
The new setting should allow to control query complexity on leaf nodes
excluding the final merging stage on the root-node. For example, distributed
query that reads 1k rows from 5 shards will breach the `max_rows_to_read=5000`,
while effectively every shard reads only 1k rows. With setting `max_rows_to_read_leaf=1500`
this limit won't be reached and query will succeed since every shard reads
not more that ~1k rows.
2020-09-17 10:37:05 +01:00
Nikolai Kochetov
339521fadb
Update test.py 2020-09-17 11:48:27 +03:00
alesapin
f104c382f8
Merge pull request #14887 from azat/StorageFile-write-to-fd
Fix SIGSEGV for an attempt to INSERT into StorageFile(fd)
2020-09-17 10:25:02 +03:00
alesapin
4348dca960
Update ci_config.json 2020-09-17 10:07:58 +03:00
alesapin
73544a3781
Merge pull request #14845 from ClickHouse/fix_alias_array
Fix recursive column defaults
2020-09-17 10:02:39 +03:00
sundy-li
544b2cb20d add configChanged method for zookeeper
fix logic error && skip reload testkeeper
2020-09-17 13:33:45 +08:00
Azat Khuzhin
13088d9bef Fix 00900_parquet_load (update exception message on INSERT failures) 2020-09-17 08:05:56 +03:00
Vitaliy Zakaznikov
bf9feb6865 Removing usage of time.sleep in tests/integration/test_distributed_over_live_view/test.py 2020-09-16 22:07:58 -04:00
Azat Khuzhin
138e953429 Fix SIGSEGV for an attempt to INSERT into StorageFile(fd) 2020-09-17 01:26:34 +03:00
Alexey Milovidov
c37b55c3b1 Fix error in "extractAllGroups" function 2020-09-17 00:19:58 +03:00
Azat Khuzhin
7d046b24e6 Improve error message for INSERT via clickhouse-client
With '\n...' after the query [1] clickhouse-client prefer data from the
INSERT over from stdin, and produce very tricky message:

    Code: 27. DB::Exception: Cannot parse input: expected '\n' before: ' ': (at row 1)

Well for TSV it is ok, but for RowBinary:

    Code: 33. DB::Exception: Cannot read all data. Bytes read: 1. Bytes expected: 4.

So improve error message by adding the source of data for INSERT.

  [1]: clickhouse-client -q "INSERT INTO data FORMAT TSV\n " <<<2
2020-09-17 00:16:51 +03:00
Anton Popov
8e9828d2ff Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-16 21:07:35 +03:00
alexey-milovidov
84b210f93e
Merge pull request #14864 from bharatnc/ncb/format-integration-tests
Format and cleanup imports form all *.py integration test files
2020-09-16 20:40:57 +03:00
Nikolai Kochetov
d0debd51c0 Add sorting to fix test. 2020-09-16 20:00:44 +03:00
alesapin
e173658422 Fix integration test 2020-09-16 19:53:58 +03:00
Alexander Kuzmenkov
0f8aec59a3 Adjust ignore thresholds for unstable perf tests
Based on historical data.

```
SELECT
    test,
    ceil(max(q[3]), 1) AS h
FROM
(
    SELECT
        test,
        query_index,
        count(*),
        min(event_time),
        max(event_time) AS t,
        arrayMap(x -> floor(x, 3), quantiles(0, 0.5, 0.95, 1)(stat_threshold)) AS q,
        median(stat_threshold) AS m
    FROM perftest.query_metrics
    WHERE (metric = 'client_time') AND (abs(diff) < 0.05)
    GROUP BY
        test,
        query_index,
        query_display_name
    HAVING (t > '2020-09-01 00:00:00') AND (m > 0.1)
    ORDER BY m DESC
)
GROUP BY test
ORDER BY h DESC
FORMAT TSV

cryptographic_hashes	1.3
collations	0.8
joins_in_memory_pmj	0.8
joins_in_memory	0.7
merge_tree_simple_select	0.7
set_index	0.7
decimal_casts	0.7
website	0.6
logical_functions_medium	0.5
count	0.5
merge_tree_many_partitions	0.5
decimal_aggregates	0.5
codecs_int_insert	0.5
column_column_comparison	0.5
insert_parallel	0.4
parse_engine_file	0.4
read_in_order_many_parts	0.4
logical_functions_small	0.4
parallel_insert	0.3
parallel_index	0.3
push_down_limit	0.3
jit_large_requests	0.3
select_format	0.3
arithmetic	0.3
merge_tree_huge_pk	0.3
materialized_view_parallel_insert	0.3
columns_hashing	0.3
if_array_string	0.3
random_string	0.2
random_printable_ascii	0.2
set	0.2
empty_string_serialization	0.2
```

To apply:
```
sed 's/^\(.*\)        \(.*\)$/sed -i "s\/^<test.*$\/<test max_ignored_relative_change="'"'"\2">\/g" tests\/performance\/\1.xml/g' ../bad.tsv | bash
```
2020-09-16 18:27:51 +03:00
tavplubix
faa5190f11
Update arcadia_skip_list.txt 2020-09-16 18:17:16 +03:00
Amos Bird
3e576a29c9
explict column list in columns matcher (#14775) 2020-09-16 15:44:05 +03:00
tavplubix
28a6b7e622
Merge pull request #14831 from bharatnc/ncb/fix-timespec-construct
construct query_start_time & query_start_time_microseconds from the same timespec
2020-09-16 15:42:19 +03:00
alesapin
a12521dd4d Remove clang-11 build for release 2020-09-16 14:27:29 +03:00
alesapin
d9057eb2c1
Merge pull request #14855 from ClickHouse/fix_flaky_test_6
Flaky tests fixes
2020-09-16 09:47:51 +03:00
bharatnc
b75963d370 Format and optimize imports in integration test files
This PR formats all the `*.py` files found under the `tests/integration`
folder. It also reorders the imports and cleans up a bunch of unused
imports.

The formatting also takes care of other things like wrapping lines and
fixing spaces and indents such that the tests look more readable.
2020-09-15 23:10:54 -07:00
alexey-milovidov
7fb0291c09
Merge pull request #14854 from zhang2014/fix/ISSUES-14809
ISSUES-14809 fix MaterializeMySQL empty transaction unstable test case
2020-09-16 00:44:51 +03:00
alesapin
3b34345abb Less flaky tests 2020-09-15 18:42:46 +03:00
Vitaly Baranov
74d5b43fe6
Merge pull request #14828 from vitlibar/change-columns-of-system-user-directories
Add 'params' column to system.user_directories table.
2020-09-15 18:25:50 +03:00
alesapin
813a6e991c Remove wait_for_mutation from test 2020-09-15 18:16:29 +03:00
alesapin
6130cd7365 More stable test_no_ttl_merges_in_busy_pool 2020-09-15 17:53:55 +03:00
zhang2014
1c659de8b1 ISSUES-14809 fix MaterializeMySQL empty transaction test failure 2020-09-15 22:44:18 +08:00
Anton Popov
3e855daefd Merge remote-tracking branch 'upstream/master' into HEAD 2020-09-15 15:31:29 +03:00
Anton Popov
63db2ca68d fix test 2020-09-15 15:30:07 +03:00
alesapin
eaf5e293ad Move to clang-11 in most CI builds 2020-09-15 14:37:51 +03:00
alesapin
8828a78174 Fix alias on default columns 2020-09-15 14:17:58 +03:00
hexiaoting
023daddbea Fix bug for LineAsString Format 2020-09-15 18:13:39 +08:00
Nikolai Kochetov
c1f61984e5
Merge pull request #14513 from amosbird/mf1
Binary operator monotonicity
2020-09-15 12:45:23 +03:00
Vxider
03346a0a30 add performance test 2020-09-15 17:35:38 +08:00
Vxider
9b98ec2cc0 add functional test 2020-09-15 17:16:48 +08:00
tavplubix
1d8ee50769
Merge pull request #14628 from ClickHouse/enable_some_tests_with_database_atomic
Enable more tests with Atomic database
2020-09-15 12:13:40 +03:00
alesapin
a75254766e
Merge pull request #14609 from ClickHouse/update_to_gcc_10
Update default build to gcc-10
2020-09-15 09:49:43 +03:00
bharatnc
90e0ef9b70 QueryLog,QueryThreadLOg - better test for query_start_time_microseconds 2020-09-14 20:04:29 -07:00
Amos Bird
4770175aa3
more tests 2020-09-15 10:02:26 +08:00
Anton Popov
f725f8deee fix more tests 2020-09-15 02:14:14 +03:00
Vitaly Baranov
0f53b449fd Add 'params' column to system.user_directories table. 2020-09-15 01:51:53 +03:00
Azat Khuzhin
0159c74f21 Secure inter-cluster query execution (with initial_user as current query user) [v3]
Add inter-server cluster secret, it is used for Distributed queries
inside cluster, you can configure in the configuration file:

  <remote_servers>
      <logs>
          <shard>
              <secret>foobar</secret> <!-- empty -- works as before -->
              ...
          </shard>
      </logs>
  </remote_servers>

And this will allow clickhouse to make sure that the query was not
faked, and was issued from the node that knows the secret. And since
trust appeared it can use initial_user for query execution, this will
apply correct *_for_user (since with inter-server secret enabled, the
query will be executed from the same user on the shards as on initator,
unlike "default" user w/o it).

v2: Change user to the initial_user for Distributed queries if secret match
v3: Add Protocol::Cluster package
v4: Drop Protocol::Cluster and use plain Protocol::Hello + user marker
v5: Do not use user from Hello for cluster-secure (superfluous)
2020-09-15 01:36:28 +03:00
Azat Khuzhin
2fce2b21a8 Use pytest.raises(match=) in test_allowed_client_hosts
Since pytest.raises() produces excinfo not exception, hence at least
str(excinfo.value) should be used to match the exception message.
2020-09-15 01:36:28 +03:00
Azat Khuzhin
65e48663e7 Drop policy on start in 01308_row_policy_and_trivial_count_query 2020-09-15 01:36:22 +03:00
Alexander Tokmakov
da6beb1a91 Merge branch 'master' into enable_some_tests_with_database_atomic 2020-09-14 23:00:14 +03:00
alesapin
58f4e5f967
Merge pull request #14755 from vitlibar/fix-permission-denied-in-integration-tests
Fix access denied on opening file /var/lib/clickhouse/status in integration tests.
2020-09-14 22:08:21 +03:00
Nikolai Kochetov
d418ee48a4
Merge pull request #14783 from amosbird/fix3
Fix signedness conversion monotonicity
2020-09-14 21:40:51 +03:00
Alexander Kuzmenkov
9e3797b252
Merge pull request #14710 from ClickHouse/aku/faster-perf
Do less runs in perf test
2020-09-14 19:17:34 +03:00
Ildus Kurbangaliev
67b49862d9
Add mapPopulateSeries function (#13166) 2020-09-14 19:11:50 +03:00
Vitaly Baranov
cae5a23a43
Merge pull request #13837 from vitlibar/add-user-directories-section-to-default-config
Add the section <user_directories> to the default config.
2020-09-14 16:47:32 +03:00
alexey-milovidov
752e3f8197
Merge pull request #14453 from amosbird/apply2
column transformers in insert select
2020-09-14 16:46:01 +03:00
Anton Popov
ac9ba23bdf fix more tests 2020-09-14 15:49:04 +03:00
Artem Zuikov
d274125c74
Fix wide integer left shift + refactoring (#14697) 2020-09-14 14:56:43 +03:00
Amos Bird
5998570762
Fix signedness conversion monotonicity 2020-09-14 18:12:41 +08:00
Amos Bird
654245af3c
Fix signedness conversion monotonicity 2020-09-14 18:11:40 +08:00
Alexander Kuzmenkov
3113aa6cfe Avoid extra error in perf report on broken queries 2020-09-14 10:59:45 +03:00
Alexander Kuzmenkov
c701a15271 fixup 2020-09-14 10:27:46 +03:00
alesapin
0c04f4d008
Update cluster.py 2020-09-14 10:01:20 +03:00
alesapin
336430d3c2
Merge pull request #14646 from ClickHouse/if_bug
Fix bug in if function when then clause contain const nullable column
2020-09-14 09:51:40 +03:00
Nikolai Kochetov
109fd9d6d7
Merge pull request #13015 from amosbird/jgmko
Refactor joinGet and implement multi-key lookup.
2020-09-13 22:39:48 +03:00
Amos Bird
34b9547ce1
Binary operator monotonicity 2020-09-13 21:55:12 +08:00
Amos Bird
016f707ea1
column transformers in insert select 2020-09-13 10:21:13 +08:00
Amos Bird
882b2a3348
CTE 2020-09-13 09:39:17 +08:00
Vitaly Baranov
421eeeccef Add the section user_directories to the default config. 2020-09-12 23:04:28 +03:00
alesapin
8242a94880
Update ci_config.json 2020-09-12 15:42:07 +03:00
alexey-milovidov
c2f762e20a
Merge pull request #14748 from vitlibar/skip-access-storages-with-same-path
Skip access storages with same path while reading the main config.
2020-09-12 14:20:02 +03:00
alesapin
ecbcbad0d9 Fix flaky test 2020-09-12 10:07:08 +03:00
alesapin
2c6567eb88
Merge pull request #14745 from kssenii/fix-rabbit-tests-crash
Fix crashes in RabbitMQ tests
2020-09-12 09:53:14 +03:00
Vitaly Baranov
1e849f2975 Fix permission denied on opening file /var/lib/clickhouse/status in integration tests. 2020-09-12 03:18:18 +03:00
Azat Khuzhin
9c7f3a9a74 Add test_distributed_ddl_parallel 2020-09-12 02:33:17 +03:00
Vitaly Baranov
e2c2a679ef Skip access storages with same path while reading the main config. 2020-09-12 01:34:46 +03:00
Nikita Mikhaylov
fcad11e48f
Merge pull request #14746 from nikitamikhaylov/arcadia-fix
Disable test in Arcadia
2020-09-11 22:56:21 +04:00
alesapin
36019596c1 Disable flaky test 2020-09-11 20:08:23 +03:00