Commit Graph

615 Commits

Author SHA1 Message Date
Anton Popov
80cf8881da add perf test for different part types 2020-05-06 18:52:56 +03:00
Alexander Tokmakov
00458c9a7d trigger CI 2020-05-06 15:31:50 +03:00
Nikolai Kochetov
b662b02f8c Added test. 2020-05-06 15:17:17 +03:00
Nikolai Kochetov
bd9df858ed
Merge pull request #10660 from ClickHouse/fix-10566
Fix 10566
2020-05-06 11:56:44 +03:00
alexey-milovidov
b33fd6f2ee
Trigger CI 2020-05-06 05:15:57 +03:00
alexey-milovidov
935132480a
Merge pull request #10670 from vzakaznikov/fix_01246_insert_into_watch_live_view
Trying to fix tests/queries/0_stateless/01246_insert_into_watch_live_view.py test
2020-05-06 05:12:31 +03:00
Anton Popov
19528007fd fix multiple usages of 'IN' operator with the same set 2020-05-06 03:57:44 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Артем Стрельцов
50d2b4c26f code review fixes & added exception in case lifetime parameter presence in config 2020-05-06 02:43:06 +03:00
Alexander Tokmakov
d35150ecf3 fix http readonly request stucks on client close 2020-05-05 23:32:34 +03:00
FawnD2
a228d1d60d Rename tests 2020-05-05 18:58:23 +03:00
FawnD2
ea87bd1c64 Merge branch 'master' into arrow-io-format 2020-05-05 18:52:44 +03:00
Vasily Nemkov
87b2d90725 extractAllGroups(haystack, re_needle) function
Function that extracts from haystack all matching non-overlapping groups with regular expressions,
and put those into Array(Array(String)) column.

Example:
:) SELECT extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)');

┌─extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)')─┐
│ [['abc','def','"jkl mno"'],['111','222','"444 foo bar"']]                                      │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
2020-05-05 17:41:31 +03:00
FawnD2
b8dd822ebc Remove stateful test 2020-05-05 15:57:56 +03:00
alexey-milovidov
c54f6d5a66
Merge pull request #10546 from kyprizel/master
Lexer, ast, checksum and column specs fuzzers added
2020-05-05 14:50:55 +03:00
FawnD2
67d4e51e7e Add tests 2020-05-05 05:06:19 +03:00
Vitaliy Zakaznikov
23021b7af1 Trying to fix tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-04 21:28:08 -04:00
alexey-milovidov
09756a036a
Merge pull request #10645 from ClickHouse/check-suspicious-codecs
Check for suspicious codecs #4966
2020-05-04 23:33:59 +03:00
alexey-milovidov
d37cb297bc
Merge pull request #10039 from abyss7/pytest
Add new build for query tests using pytest
2020-05-04 23:18:02 +03:00
Nikolai Kochetov
22d3bba59a Added perftest. 2020-05-04 21:14:31 +03:00
Nikolai Kochetov
84ea10cc0a Added test. 2020-05-04 20:25:50 +03:00
Vitaliy Zakaznikov
2568588f4e Removing hex output in exceptions in uexpect.py.
Fixing and re-enabling 00979_live_view_watch_continuous_aggregates.py test.
2020-05-04 12:03:52 -04:00
Azat Khuzhin
7ab0c3493c Add integration test for kafka consumer hang
This test triggers heartbeat failrues which leads to
REBALANCE_IN_PROGRESS which causes hang.
2020-05-04 18:46:30 +03:00
Alexey Milovidov
7ddad8cc01 Fix integration test 2020-05-04 17:51:29 +03:00
Alexey Milovidov
8a8014fa39 Added a test 2020-05-04 17:46:11 +03:00
Alexey Milovidov
301c6137e4 Better exception messages; fixed error; updated tests 2020-05-04 17:25:54 +03:00
Azat Khuzhin
fc5f0bfe52 Enable librdkafka debugging in test_storage_kafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
12871bf26e Drop resolved TODO from test_storage_kafka 2020-05-04 17:23:09 +03:00
Alexey Milovidov
c52ab89918 Fix OOM in ASan stress test 2020-05-04 03:36:55 +03:00
alexey-milovidov
788b436275
Merge pull request #10640 from ClickHouse/fix-http-code-parse-error
Fix http code in case of some parse errors.
2020-05-04 02:00:47 +03:00
alexey-milovidov
72ca31511f
Merge pull request #10604 from vzakaznikov/fix_timeouts_in_new_live_view_tests
Fixing hard coded timeouts in new live view tests.
2020-05-04 01:55:35 +03:00
Alexey Milovidov
12f1b055be Added a test #10636 2020-05-03 23:51:52 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Nikolay Degterinsky
2b46159a6f Merge branch 'layout_direct' of github.com:kekekekule/ClickHouse into dict_direct 2020-05-03 15:12:39 +03:00
Azat Khuzhin
14fccf572f Fix false-positive failures of the test_distributed_storage_configuration
After first INSERT for disk2 there should not be created any per-shard
directory, so find(1) should report an error, like:

  find: '/disk2/data/test/dist_foo/default@127%2E0%2E0%2E2:9000': No such file or directory"

But sometimes output can be fixed, and output of wc(1) will goes first
and python's int() will parse it and not fail, but if find(1) stderr
will goes first the int() will fail to parse.

And here is an example of such mixing:

  $ docker run --name alpine --rm -it alpine top
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  foo
  0
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  0
  foo
2020-05-03 14:48:00 +03:00
Azat Khuzhin
0a75dc626b Add some comments int test_distributed_storage_configuration 2020-05-03 14:46:44 +03:00
alexey-milovidov
e6a8521dc9
Trigger CI 2020-05-03 04:46:06 +03:00
Артем Стрельцов
d05f82a82a forgot to update the correct answer... 2020-05-03 02:35:43 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies
S3 with dynamic proxy configuration
2020-05-03 01:25:13 +03:00
alexey-milovidov
67efc7f066
Merge pull request #10560 from Enmk/DateTime64_fixes
Fixed comparing DateTime64 in WHERE against String value
2020-05-03 00:54:11 +03:00
Артем Стрельцов
c82b1fc0fe fixed (hope) test flapping 2020-05-02 23:26:22 +03:00
Alexey Milovidov
a473c0397d Disable flacky test #10576 2020-05-02 23:18:41 +03:00
alexey-milovidov
db4c2352e1
Merge pull request #10569 from zhang2014/fix/ISSUES-10551
ISSUES-10551 add backward compatibility for create bloom filter index
2020-05-02 22:25:29 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format
Add JSONAsStringRowInputFormat
2020-05-02 22:17:22 +03:00
alexey-milovidov
229f666dea
Merge pull request #10611 from azat/optimize_skip_unused_shards-LowCardinality
Fix optimize_skip_unused_shards with LowCardinality
2020-05-02 22:14:33 +03:00
alexey-milovidov
ea7038b1b0
Update 01270_optimize_skip_unused_shards_low_cardinality.sql 2020-05-02 22:14:20 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache
Improve DROP DNS CACHE
2020-05-02 22:10:58 +03:00
Артем Стрельцов
5ba6572210 fixed problem with dictGetString and Float32 2020-05-02 20:58:24 +03:00
Vitaliy Zakaznikov
fb4d8d7495 Removing extra expect in tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-02 12:17:16 -04:00
Vitaliy Zakaznikov
fa17d9f487 Updating again tests/queries/0_stateless/01246_insert_into_watch_live_view.py. 2020-05-02 12:15:26 -04:00
alexey-milovidov
7769ff5bc9
Merge pull request #10617 from ClickHouse/lower-memory-usage-in-tests
Lower memory usage in tests
2020-05-02 14:40:07 +03:00
Alexey Milovidov
baf9cc99df Update test reference 2020-05-02 14:38:53 +03:00
Артем Стрельцов
a012c18240 improved test to cover more cases 2020-05-02 14:31:07 +03:00
Vitaliy Zakaznikov
e8e94b53bf Updating tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-02 07:28:52 -04:00
Артем Стрельцов
25d7f76e4f fixed bug & created functional test for new layout 2020-05-02 04:03:29 +03:00
Vitaliy Zakaznikov
9cbadbf7d7 Increasing number of requests HTTP server can serve in case
more than one connection is needed for the query.
2020-05-01 19:13:50 -04:00
alexey-milovidov
ddefb89d86
Update 00154_avro.sql 2020-05-01 23:13:18 +03:00
Alexander Kazakov
e9baaa439b
Implementation of new system metrics provider (Procfs) (#10544)
* New metrics provider (Procfs) + Refactored TasksStatsCounters

* Trivial statless test that ProcFS is provided

* Trivial perf test for ProcfsMetricsProvider

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-05-01 21:47:41 +03:00
Alexey Milovidov
c15fe728fd Lower memory usage in tests #10277 2020-05-01 21:26:52 +03:00
Avogar
697d5b07ce Fix build and style errors. Update test. 2020-05-01 19:41:14 +03:00
Vitaliy Zakaznikov
7fabd54c2b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_timeouts_in_new_live_view_tests 2020-05-01 11:41:44 -04:00
Vitaliy Zakaznikov
71e8e23bde Adding missing expect to the 01246_insert_into_watch_live_view test. 2020-05-01 11:39:00 -04:00
Vitaliy Zakaznikov
47ce872296 Fixing hard coded timeouts in new live view tests. 2020-05-01 11:39:00 -04:00
alesapin
ed46b98dc4 Change port for internal http server in 00646 test 2020-05-01 16:43:18 +03:00
Alexey Milovidov
4933a6a974 Temporarily remove live view tests #10604 (waiting for fix) 2020-05-01 16:15:06 +03:00
Vasily Nemkov
86edceeb81 Comparison between DateTime64 and String values (just like for DateTime) 2020-05-01 15:52:18 +03:00
Alexander Kuzmenkov
f4aac4322c Add performance test for sumMap(Tuple). 2020-05-01 10:48:45 +03:00
Azat Khuzhin
c648c300bf Fix optimize_skip_unused_shards with LowCardinality 2020-05-01 02:39:58 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
Avogar
6464a1a902 Add JSONAsStringRowInputFormat 2020-04-30 23:16:09 +03:00
Ivan Blinkov
d91c97d15d
[docs] replace underscores with hyphens (#10606)
* Replace underscores with hyphens

* remove temporary code

* fix style check

* fix collapse
2020-04-30 21:19:18 +03:00
Yatsishin Ilya
58ddff7f2f use -q parameter for curl 2020-04-30 17:06:20 +03:00
Vitaliy Zakaznikov
f2d8ac7ece Increasing timeout when opening a client in tests/queries/0_stateless/helpers/client.py. 2020-04-30 09:46:36 -04:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2
Fix index corruption in merges with compact parts.
2020-04-30 12:15:25 +03:00
alesapin
8ce4f3510a
Merge pull request #10562 from azat/clickhouse-test-python2
Force clickhouse-test to use python2
2020-04-30 12:11:11 +03:00
Alexander Kuzmenkov
7f5b57c6c5
Merge pull request #10559 from ClickHouse/aku/summap-experiment
Merge pull request #10000 (sumMap for Tuple argument)
2020-04-30 11:56:04 +03:00
alesapin
5e2afad549
Merge pull request #10477 from ClickHouse/refactor_istorage
Remove getColumn and hasColumn from IStorage, better virtuals.
2020-04-30 10:42:52 +03:00
Azat Khuzhin
faea8afa22 Revert behaviour with duplicates in 01213_optimize_skip_unused_shards_DISTINCT
Since now optimization is done only under
optimize_distributed_group_by_sharding_key.
2020-04-30 10:13:19 +03:00
Alexander Kuzmenkov
a3843e1f42 performance comparison 2020-04-30 08:10:34 +03:00
Alexander Kuzmenkov
d952e5aba2 performance comparison 2020-04-29 20:26:28 +03:00
alesapin
69fdf2a6a3 Review fixes and better test 2020-04-29 15:15:23 +03:00
Artem Zuikov
5fc28edb16 test fo fixed issue #7798 2020-04-29 14:37:30 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
2020-04-29 12:15:54 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Alexander Kuzmenkov
15e94d3de9 performance comparison 2020-04-29 09:30:37 +03:00
zhang2014
8ac709b5d3 ISSUES-10551 add backward compatibility for create bloom filter index 2020-04-29 11:57:28 +08:00
Azat Khuzhin
038235684d Add optimize_distributed_group_by_sharding_key and disable it by default
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
2020-04-29 00:09:25 +03:00
Azat Khuzhin
989ae58a0c Force clickhouse-test to use python2 2020-04-28 22:45:22 +03:00
Azat Khuzhin
007170481a Add a test for ALIAS with type different to the type of column 2020-04-28 22:42:21 +03:00
Vitaliy Zakaznikov
4749122734 Adding support to auto set output_format_enable_streaming option
based on the query type.
2020-04-28 17:50:50 +02:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk (#10467) 2020-04-28 16:55:50 +03:00
Eldar Zaitov
f40603441b Add miniman fuzzing documentation, fix code style. 2020-04-28 13:34:57 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436
Merging #7572
2020-04-28 12:40:48 +03:00
Alexander Kuzmenkov
ed1576507b performance comparison 2020-04-28 10:45:56 +03:00
Eldar Zaitov
670ed4bf1b lexer, ast, checksum and column specs fuzzers added 2020-04-28 02:12:18 +03:00
Alexander Tokmakov
5a1d22a363 remove redundant configs from test 2020-04-28 02:05:15 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Vitaliy Zakaznikov
2312c097ea Merge branch 'insert_into_watch_from_live_view' of https://github.com/vzakaznikov/ClickHouse into insert_into_watch_from_live_view 2020-04-27 17:34:47 +02:00
Vitaliy Zakaznikov
9d28066539 Adding 00979_live_view_watch_continuous_aggregates.py test. 2020-04-27 17:34:12 +02:00
Nikolai Kochetov
32baa073b5 Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view 2020-04-27 17:49:50 +03:00
Anton Popov
eaf80c5f18 add integration test for compact parts 2020-04-27 16:37:05 +03:00
Alexey Milovidov
f34a6dc482 Added a test for #4469 2020-04-27 16:13:23 +03:00
Vitaliy Zakaznikov
26532f4617 Updating 01247_insert_into_watch_live_view_url.py to fix hanging
issue if for some reason test fails.
2020-04-27 14:02:37 +02:00
zhang2014
81230944a4 ISSUES-5436 add integration test 2020-04-27 18:49:32 +08:00
alexey-milovidov
436e4e3f5e
Merge pull request #10502 from oandrew/avro-nested2
Avro nested fields - support complex types
2020-04-27 13:44:58 +03:00
alexey-milovidov
4a60cc6b2c
Merge pull request #10515 from ClickHouse/compare-date-time-with-string-literal
Use time zone when comparing DateTime with string literal
2020-04-27 13:10:27 +03:00
Azat Khuzhin
4e09d812ef Add a test for GROUP BY sharding_key optimization over Distributed-on-Distributed 2020-04-27 01:31:00 +03:00
Azat Khuzhin
20b4eed9a1 Disable GROUP BY sharding_key optimization for WITH ROLLUP/CUBE/TOTALS 2020-04-27 01:30:54 +03:00
Alexey Milovidov
73b5df4de5 Added a test from @reqq #5155 2020-04-27 01:19:20 +03:00
Alexey Milovidov
cac130ad3b Use time zone when comparing DateTime with string literal 2020-04-27 01:13:51 +03:00
Alexey Milovidov
2f06a7b4c1 Added a test from @baloo-bear #5873 2020-04-27 00:26:03 +03:00
Alexey Milovidov
d40fb6b5d3 Added a test from @nvartolomei #6229 2020-04-27 00:09:30 +03:00
alexey-milovidov
11bb3e3afa
Merge pull request #10513 from ClickHouse/fix-fractional-timezones-overflow
Fix overflow at beginning of unix epoch for fractional timezones
2020-04-26 21:33:53 +03:00
alexey-milovidov
fe4992741c
Merge pull request #10514 from ClickHouse/move-old-bug-to-test
Move old bug to test
2020-04-26 21:33:07 +03:00
alexey-milovidov
c6ae6a7ba8
Merge pull request #10418 from ClickHouse/fix_logical_error_in_diagnostic_info
Better diagnostic info in input formats
2020-04-26 20:26:59 +03:00
alexey-milovidov
4c17542096
Merge pull request #10465 from kekekekule/ddl_settings
Add custom settings support in DDL-queries for CREATE DICTIONARY
2020-04-26 20:25:29 +03:00
alexey-milovidov
0a9bcae0ed
Merge pull request #10511 from ClickHouse/fix-ubsan-datetime64
Fixed UBSan for DateTime64; added a test
2020-04-26 20:17:01 +03:00
Alexey Milovidov
38e55c7883 Move old bug to test 2020-04-26 19:39:48 +03:00
Alexey Milovidov
1a4181b4ac Removed already fixed bug (already having a test) 2020-04-26 19:34:33 +03:00
Alexey Milovidov
08d8c350b7 Fix overflow at beginning of unix epoch for fractional timezones #9335 2020-04-26 19:22:44 +03:00
Alexey Milovidov
a70637ab4b Fixed UBSan; added a test 2020-04-26 17:57:45 +03:00
alexey-milovidov
62e2f10959
Merge pull request #10474 from hczhcz/patch-0422
Fix overflow in simpleLinearRegression
2020-04-26 17:34:57 +03:00
Vitaliy Zakaznikov
f35c7a8bf0 Updating 01247_insert_into_watch_live_view_url to check
CSV, JSONEachRow and JSONEachRowWithProgress output formats
2020-04-26 16:23:55 +02:00
Vitaliy Zakaznikov
369b4d53ef Adding support for output_format_enable_streaming format setting. 2020-04-26 15:44:11 +02:00
Vitaliy Zakaznikov
cf8bc71b21 Adding support to set HTTP_SERVER_HOST using an env variable of the same name. 2020-04-26 14:04:28 +02:00
Vitaliy Zakaznikov
c09126e80f Updating 01247_insert_into_watch_live_view_url.py test
Updating httpechoserver.py
2020-04-26 13:48:43 +02:00
Alexey Milovidov
1f0bd79d37 Update test 2020-04-26 04:15:35 +03:00
Alexey Milovidov
6bedcfc3f0 Update test 2020-04-26 04:08:19 +03:00
Alexey Milovidov
d01bd44f14 Merge branch 'master' into execute-query-flush-format-2 2020-04-26 03:31:46 +03:00
alexey-milovidov
8820b43606
Merge pull request #10479 from Avogar/markdown_format
Markdown format
2020-04-26 03:25:48 +03:00
Andrew Onyshchuk
e7ba75ce98 Avro nested fields - support complex types 2020-04-25 17:42:49 -05:00
Vitaliy Zakaznikov
f571a6b229 Adding 01247_insert_into_watch_live_view_url.py test case. 2020-04-25 17:21:36 -04:00
Vitaliy Zakaznikov
edc3268851 Adding 01246_insert_into_watch_live_view.py test case. 2020-04-25 11:03:42 -04:00
Avogar
13f6981bb0 Update markdown test reference 2020-04-25 00:17:33 +03:00
tavplubix
7928f2eaa1
Merge pull request #7512 from ClickHouse/database_atomic
DatabaseAtomic
2020-04-24 22:28:18 +03:00
Alexander Tokmakov
53dcce55e9 better diagnostic info in input formats 2020-04-24 15:03:48 +03:00
hcz
541cd638ba Fix overflow in simpleLinearRegression 2020-04-24 16:33:09 +08:00
Артем Стрельцов
69fef04a4b added test 2020-04-24 02:12:45 +03:00
Alexander Kuzmenkov
1bf02d459c performance comparison 2020-04-23 23:19:04 +03:00
Alexander Tokmakov
04d6b59ac0 Merge branch 'master' into database_atomic 2020-04-23 17:31:37 +03:00
Ivan Lezhankin
7cc0ad2884 Merge branch 'master' into pytest 2020-04-23 13:34:51 +03:00
alexey-milovidov
1ecfa27cd3
Merge pull request #10441 from ClickHouse/remove_casts_from_defaults
Remove CAST from DEFAULT expressions during table creation.
2020-04-23 12:36:12 +03:00
zhang2014
0070f75218 ISSUES-5436 fix integration test failure & add test 2020-04-23 17:11:20 +08:00
alexey-milovidov
829a7a551c
Merge pull request #10446 from CurtizJ/fix-mysql-test
Fix mysql integration test
2020-04-23 00:25:25 +03:00
Alexander Tokmakov
1833ac7f16 fixes 2020-04-22 23:43:10 +03:00
Alexander Kuzmenkov
11f07a32f3 performance comparison 2020-04-22 23:17:52 +03:00
Nikita Mikhaylov
3cf2016867
Merge pull request #10188 from nikitamikhaylov/quorum_bug
insert_quorum vs drop partition or ttl
2020-04-23 00:11:57 +04:00
Anton Popov
47213ebfe1 fix mysql test 2020-04-22 23:09:07 +03:00
alesapin
dadeb3d8b9 Remove casts from tests references 2020-04-22 20:14:34 +03:00
alexey-milovidov
f5fe39944e
Merge pull request #10431 from zhang2014/fix/ISSUES-9623
ISSUES-9623 add some check for BloomFilter index
2020-04-22 20:04:13 +03:00