Commit Graph

665 Commits

Author SHA1 Message Date
Alexey Milovidov
978d38f34a Raised threshold for one of tests 2020-05-09 04:42:52 +03:00
alexey-milovidov
699ef4ff52
Merge pull request #10741 from hczhcz/patch-0422
Fix OrNull and OrDefault
2020-05-09 04:38:32 +03:00
Alexey Milovidov
666fd29d82 Fix performance test errors 2020-05-09 04:28:31 +03:00
alexey-milovidov
5992bae69a
Merge pull request #10736 from ClickHouse/extract-groups-range-check
Added range check for extractGroups function
2020-05-09 04:21:56 +03:00
Baudouin Giard
be2cf70da8 Fix serialize/deserialize of denominator of Average functions
Use writeBinary/readBinary to serialize/deserialize the denominator of Average functions.

Previously it would be transmitted as an unsigned int, which means its value would get corrupted when doing an avgWeighted over a floating point number.

Note: this commit is not backwards compatible!

Signed-off-by: Baudouin Giard <bgiard@bloomberg.net>
2020-05-08 15:10:47 -04:00
Nikolai Kochetov
869c933972 Added test. 2020-05-08 19:15:49 +03:00
Ivan
85d783c247
Poco contrib refactoring (#10396)
* Remove config_common.h
* Refactor libcpuid contrib
* Remove support for libcpuinfo
* Define USE_CPUID in Arcadia
* Refactor Poco libraries
2020-05-08 17:11:19 +03:00
Pavel Kovalenko
5cc0927874 Add comment explaining protocol for proxy resolver configuration. 2020-05-08 14:07:26 +03:00
Pavel Kovalenko
8602f7b47c Minor updates in proxy resolver parameters naming. 2020-05-08 13:58:56 +03:00
Pavel Kovalenko
6165c2aa99 Add possibility to use proxy resolver in DiskS3. 2020-05-08 13:53:12 +03:00
hcz
8a60e22223 Fix OrNull and OrDefault 2020-05-08 17:52:54 +08:00
Nikolai Kochetov
766ca03d85
Merge pull request #10728 from ClickHouse/fix-10489
Added test for #10721.
2020-05-08 11:58:29 +03:00
Alexey Milovidov
e6b08799a0 Update test 2020-05-08 02:34:48 +03:00
Alexey Milovidov
a366e6924b Fix typo in test 2020-05-08 02:33:31 +03:00
Alexey Milovidov
1f0d95e5c3 Added range check for extractGroups function 2020-05-08 02:31:15 +03:00
Alexander Tokmakov
2cb4c91c02 fix dockerfiles 2020-05-08 00:08:19 +03:00
Nikolai Kochetov
9605e80a8e Added test. 2020-05-07 18:26:57 +03:00
Nikolai Kochetov
6ef3400894 Added test. 2020-05-07 16:14:16 +03:00
Anton Popov
5fe74b1a3e
Merge pull request #10686 from CurtizJ/fix-nultiple-sets
Fix multiple usages of 'IN' operator
2020-05-07 15:39:41 +03:00
alexey-milovidov
3e583ef45e
Merge pull request #10712 from ClickHouse/merging-extract-groups
Merging #10534
2020-05-07 15:34:41 +03:00
alexey-milovidov
9ef730b7a6
Merge pull request #10553 from qoega/curl-no-curlrc
Add -q option to curl requests to disable .curlrc use on developer servers
2020-05-07 15:18:56 +03:00
Ilya Yatsishin
22a908a5cc
remove unnecessary change 2020-05-07 14:53:40 +03:00
tavplubix
04a24c59dc
Add tests with DatabaseAtomic (#10714)
* add tests with DatabaseAtomic

* fix
2020-05-07 14:29:58 +03:00
Alexey Milovidov
d98bc1175c Added another test 2020-05-07 04:39:25 +03:00
Alexey Milovidov
861237f225 Update test 2020-05-07 04:33:53 +03:00
Alexey Milovidov
05077fed34 Changed tabs to spaces in test 2020-05-07 04:00:34 +03:00
Alexey Milovidov
15c1c96a4b Added performance test 2020-05-07 03:59:04 +03:00
alexey-milovidov
9c17bbf541
Merge pull request #10713 from ClickHouse/mark-variable-performance-tests
Mark some performance tests with very high variance
2020-05-07 02:49:58 +03:00
Anton Popov
e3a8712e15 added a test from @cloudXane 2020-05-07 01:48:44 +03:00
Anton Popov
cbbd8e521c fix usage of primary key wrapped into a function with 'FINAL' modifier and 'ORDER BY' optimization 2020-05-07 01:27:35 +03:00
alexey-milovidov
eeac7aa313
Merge pull request #10622 from kekekekule/layout_direct
Add direct layout for dictionaries
2020-05-07 01:05:29 +03:00
alexey-milovidov
d0b61f9d61
Merge pull request #10711 from ClickHouse/h3-range-check
Range check in function h3EdgeAngle
2020-05-07 01:00:57 +03:00
Артем Стрельцов
b2993c314c fixes relevant to review 2020-05-07 00:59:31 +03:00
Alexey Milovidov
665c9270ca Fix error in performance test 2020-05-07 00:57:26 +03:00
Alexey Milovidov
6e2505210f Mark some performance tests with very high variance 2020-05-07 00:53:25 +03:00
Alexey Milovidov
786e08c401 Mark some performance tests with very high variance 2020-05-07 00:52:03 +03:00
alexey-milovidov
4df7dd8c2b
Merge pull request #10656 from azat/kafka-consumer-hang
Kafka cleanup
2020-05-07 00:20:31 +03:00
alexey-milovidov
75b0303903
Merge pull request #10684 from ClickHouse/fix_7939
Fix http readonly request stucks on client close
2020-05-06 23:01:45 +03:00
Alexey Milovidov
97211e56d3 Added a test 2020-05-06 22:38:02 +03:00
Anton Popov
2be5c7c420
Merge pull request #10704 from CurtizJ/polymorphic-parts-2
Add perf test for different part types
2020-05-06 22:33:16 +03:00
alexey-milovidov
01e7c6bbcf
Merge pull request #10534 from Enmk/multiExtractAll
extractAllGroups(haystack, re_needle) function
2020-05-06 22:23:36 +03:00
Nikolai Kochetov
ff8014fa39 Try fix perftest. 2020-05-06 21:53:40 +03:00
alexey-milovidov
e4b3234df9
Merge pull request #10664 from ClickHouse/fix-10655
Fix 10655
2020-05-06 21:34:10 +03:00
alexey-milovidov
f2705cf608
Merge pull request #10698 from ClickHouse/fix-10674
Do not filter totals
2020-05-06 21:30:11 +03:00
Anton Popov
387041a97e Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-05-06 19:22:07 +03:00
Anton Popov
80cf8881da add perf test for different part types 2020-05-06 18:52:56 +03:00
Alexander Tokmakov
00458c9a7d trigger CI 2020-05-06 15:31:50 +03:00
Nikolai Kochetov
b662b02f8c Added test. 2020-05-06 15:17:17 +03:00
Anton Popov
4878c91d07 in-memory parts: better restore from wal 2020-05-06 14:57:38 +03:00
Nikolai Kochetov
bd9df858ed
Merge pull request #10660 from ClickHouse/fix-10566
Fix 10566
2020-05-06 11:56:44 +03:00
alexey-milovidov
b33fd6f2ee
Trigger CI 2020-05-06 05:15:57 +03:00
alexey-milovidov
935132480a
Merge pull request #10670 from vzakaznikov/fix_01246_insert_into_watch_live_view
Trying to fix tests/queries/0_stateless/01246_insert_into_watch_live_view.py test
2020-05-06 05:12:31 +03:00
Anton Popov
19528007fd fix multiple usages of 'IN' operator with the same set 2020-05-06 03:57:44 +03:00
Артем Стрельцов
1428188e21 fixed test for direct layout & fixed data load for FileDictionarySource 2020-05-06 03:52:13 +03:00
Артем Стрельцов
50d2b4c26f code review fixes & added exception in case lifetime parameter presence in config 2020-05-06 02:43:06 +03:00
Alexander Tokmakov
d35150ecf3 fix http readonly request stucks on client close 2020-05-05 23:32:34 +03:00
FawnD2
a228d1d60d Rename tests 2020-05-05 18:58:23 +03:00
FawnD2
ea87bd1c64 Merge branch 'master' into arrow-io-format 2020-05-05 18:52:44 +03:00
Vasily Nemkov
87b2d90725 extractAllGroups(haystack, re_needle) function
Function that extracts from haystack all matching non-overlapping groups with regular expressions,
and put those into Array(Array(String)) column.

Example:
:) SELECT extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)');

┌─extractAllGroups('abc=111, def=222, "jkl mno"="444 foo bar"', '("[^"]+"|\\w+)=("[^"]+"|\\w+)')─┐
│ [['abc','def','"jkl mno"'],['111','222','"444 foo bar"']]                                      │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
2020-05-05 17:41:31 +03:00
FawnD2
b8dd822ebc Remove stateful test 2020-05-05 15:57:56 +03:00
alexey-milovidov
c54f6d5a66
Merge pull request #10546 from kyprizel/master
Lexer, ast, checksum and column specs fuzzers added
2020-05-05 14:50:55 +03:00
FawnD2
67d4e51e7e Add tests 2020-05-05 05:06:19 +03:00
Vitaliy Zakaznikov
23021b7af1 Trying to fix tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-04 21:28:08 -04:00
Anton Popov
b3cfce523c in-memory parts: test for basic functionality 2020-05-05 04:24:51 +03:00
alexey-milovidov
09756a036a
Merge pull request #10645 from ClickHouse/check-suspicious-codecs
Check for suspicious codecs #4966
2020-05-04 23:33:59 +03:00
alexey-milovidov
d37cb297bc
Merge pull request #10039 from abyss7/pytest
Add new build for query tests using pytest
2020-05-04 23:18:02 +03:00
Nikolai Kochetov
22d3bba59a Added perftest. 2020-05-04 21:14:31 +03:00
Nikolai Kochetov
84ea10cc0a Added test. 2020-05-04 20:25:50 +03:00
Vitaliy Zakaznikov
2568588f4e Removing hex output in exceptions in uexpect.py.
Fixing and re-enabling 00979_live_view_watch_continuous_aggregates.py test.
2020-05-04 12:03:52 -04:00
Azat Khuzhin
7ab0c3493c Add integration test for kafka consumer hang
This test triggers heartbeat failrues which leads to
REBALANCE_IN_PROGRESS which causes hang.
2020-05-04 18:46:30 +03:00
Alexey Milovidov
7ddad8cc01 Fix integration test 2020-05-04 17:51:29 +03:00
Alexey Milovidov
8a8014fa39 Added a test 2020-05-04 17:46:11 +03:00
Alexey Milovidov
301c6137e4 Better exception messages; fixed error; updated tests 2020-05-04 17:25:54 +03:00
Azat Khuzhin
fc5f0bfe52 Enable librdkafka debugging in test_storage_kafka 2020-05-04 17:23:09 +03:00
Azat Khuzhin
12871bf26e Drop resolved TODO from test_storage_kafka 2020-05-04 17:23:09 +03:00
Alexey Milovidov
c52ab89918 Fix OOM in ASan stress test 2020-05-04 03:36:55 +03:00
alexey-milovidov
788b436275
Merge pull request #10640 from ClickHouse/fix-http-code-parse-error
Fix http code in case of some parse errors.
2020-05-04 02:00:47 +03:00
alexey-milovidov
72ca31511f
Merge pull request #10604 from vzakaznikov/fix_timeouts_in_new_live_view_tests
Fixing hard coded timeouts in new live view tests.
2020-05-04 01:55:35 +03:00
Alexey Milovidov
12f1b055be Added a test #10636 2020-05-03 23:51:52 +03:00
Nikolay Degterinsky
a3e557a5d2 documentation is added & added 'direct' layout into integragion test 2020-05-03 15:55:22 +03:00
Nikolay Degterinsky
2b46159a6f Merge branch 'layout_direct' of github.com:kekekekule/ClickHouse into dict_direct 2020-05-03 15:12:39 +03:00
Azat Khuzhin
14fccf572f Fix false-positive failures of the test_distributed_storage_configuration
After first INSERT for disk2 there should not be created any per-shard
directory, so find(1) should report an error, like:

  find: '/disk2/data/test/dist_foo/default@127%2E0%2E0%2E2:9000': No such file or directory"

But sometimes output can be fixed, and output of wc(1) will goes first
and python's int() will parse it and not fail, but if find(1) stderr
will goes first the int() will fail to parse.

And here is an example of such mixing:

  $ docker run --name alpine --rm -it alpine top
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  foo
  0
  $ docker exec alpine sh -c 'echo foo >&2 | wc -c'
  0
  foo
2020-05-03 14:48:00 +03:00
Azat Khuzhin
0a75dc626b Add some comments int test_distributed_storage_configuration 2020-05-03 14:46:44 +03:00
alexey-milovidov
e6a8521dc9
Trigger CI 2020-05-03 04:46:06 +03:00
Артем Стрельцов
d05f82a82a forgot to update the correct answer... 2020-05-03 02:35:43 +03:00
alexey-milovidov
a235533d5f
Merge pull request #10576 from Jokser/s3-with-dynamic-proxies
S3 with dynamic proxy configuration
2020-05-03 01:25:13 +03:00
alexey-milovidov
67efc7f066
Merge pull request #10560 from Enmk/DateTime64_fixes
Fixed comparing DateTime64 in WHERE against String value
2020-05-03 00:54:11 +03:00
Артем Стрельцов
c82b1fc0fe fixed (hope) test flapping 2020-05-02 23:26:22 +03:00
Alexey Milovidov
a473c0397d Disable flacky test #10576 2020-05-02 23:18:41 +03:00
alexey-milovidov
db4c2352e1
Merge pull request #10569 from zhang2014/fix/ISSUES-10551
ISSUES-10551 add backward compatibility for create bloom filter index
2020-05-02 22:25:29 +03:00
alexey-milovidov
250a44a47f
Merge pull request #10607 from Avogar/json_as_string_format
Add JSONAsStringRowInputFormat
2020-05-02 22:17:22 +03:00
alexey-milovidov
229f666dea
Merge pull request #10611 from azat/optimize_skip_unused_shards-LowCardinality
Fix optimize_skip_unused_shards with LowCardinality
2020-05-02 22:14:33 +03:00
alexey-milovidov
ea7038b1b0
Update 01270_optimize_skip_unused_shards_low_cardinality.sql 2020-05-02 22:14:20 +03:00
alexey-milovidov
d38ea6fc1c
Merge pull request #10608 from ClickHouse/fix_drop_dns_cache
Improve DROP DNS CACHE
2020-05-02 22:10:58 +03:00
Артем Стрельцов
5ba6572210 fixed problem with dictGetString and Float32 2020-05-02 20:58:24 +03:00
Vitaliy Zakaznikov
fb4d8d7495 Removing extra expect in tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-02 12:17:16 -04:00
Vitaliy Zakaznikov
fa17d9f487 Updating again tests/queries/0_stateless/01246_insert_into_watch_live_view.py. 2020-05-02 12:15:26 -04:00
alexey-milovidov
7769ff5bc9
Merge pull request #10617 from ClickHouse/lower-memory-usage-in-tests
Lower memory usage in tests
2020-05-02 14:40:07 +03:00
Alexey Milovidov
baf9cc99df Update test reference 2020-05-02 14:38:53 +03:00
Артем Стрельцов
a012c18240 improved test to cover more cases 2020-05-02 14:31:07 +03:00
Vitaliy Zakaznikov
e8e94b53bf Updating tests/queries/0_stateless/01246_insert_into_watch_live_view.py 2020-05-02 07:28:52 -04:00
Артем Стрельцов
25d7f76e4f fixed bug & created functional test for new layout 2020-05-02 04:03:29 +03:00
Vitaliy Zakaznikov
9cbadbf7d7 Increasing number of requests HTTP server can serve in case
more than one connection is needed for the query.
2020-05-01 19:13:50 -04:00
alexey-milovidov
ddefb89d86
Update 00154_avro.sql 2020-05-01 23:13:18 +03:00
Alexander Kazakov
e9baaa439b
Implementation of new system metrics provider (Procfs) (#10544)
* New metrics provider (Procfs) + Refactored TasksStatsCounters

* Trivial statless test that ProcFS is provided

* Trivial perf test for ProcfsMetricsProvider

Co-authored-by: alexey-milovidov <milovidov@yandex-team.ru>
2020-05-01 21:47:41 +03:00
Alexey Milovidov
c15fe728fd Lower memory usage in tests #10277 2020-05-01 21:26:52 +03:00
Avogar
697d5b07ce Fix build and style errors. Update test. 2020-05-01 19:41:14 +03:00
Vitaliy Zakaznikov
7fabd54c2b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into fix_timeouts_in_new_live_view_tests 2020-05-01 11:41:44 -04:00
Vitaliy Zakaznikov
71e8e23bde Adding missing expect to the 01246_insert_into_watch_live_view test. 2020-05-01 11:39:00 -04:00
Vitaliy Zakaznikov
47ce872296 Fixing hard coded timeouts in new live view tests. 2020-05-01 11:39:00 -04:00
alesapin
ed46b98dc4 Change port for internal http server in 00646 test 2020-05-01 16:43:18 +03:00
Alexey Milovidov
4933a6a974 Temporarily remove live view tests #10604 (waiting for fix) 2020-05-01 16:15:06 +03:00
Vasily Nemkov
86edceeb81 Comparison between DateTime64 and String values (just like for DateTime) 2020-05-01 15:52:18 +03:00
Alexander Kuzmenkov
f4aac4322c Add performance test for sumMap(Tuple). 2020-05-01 10:48:45 +03:00
Azat Khuzhin
c648c300bf Fix optimize_skip_unused_shards with LowCardinality 2020-05-01 02:39:58 +03:00
Alexander Tokmakov
9ca144cab9 drop access cache on DROP DNS CACHE 2020-05-01 01:29:47 +03:00
Avogar
6464a1a902 Add JSONAsStringRowInputFormat 2020-04-30 23:16:09 +03:00
Ivan Blinkov
d91c97d15d
[docs] replace underscores with hyphens (#10606)
* Replace underscores with hyphens

* remove temporary code

* fix style check

* fix collapse
2020-04-30 21:19:18 +03:00
Anton Popov
aa723d245f Merge remote-tracking branch 'upstream/master' into polymorphic-parts 2020-04-30 18:27:39 +03:00
Yatsishin Ilya
58ddff7f2f use -q parameter for curl 2020-04-30 17:06:20 +03:00
Vitaliy Zakaznikov
f2d8ac7ece Increasing timeout when opening a client in tests/queries/0_stateless/helpers/client.py. 2020-04-30 09:46:36 -04:00
alesapin
15e8f37839
Merge pull request #10531 from CurtizJ/polymorphic-parts-2
Fix index corruption in merges with compact parts.
2020-04-30 12:15:25 +03:00
alesapin
8ce4f3510a
Merge pull request #10562 from azat/clickhouse-test-python2
Force clickhouse-test to use python2
2020-04-30 12:11:11 +03:00
Alexander Kuzmenkov
7f5b57c6c5
Merge pull request #10559 from ClickHouse/aku/summap-experiment
Merge pull request #10000 (sumMap for Tuple argument)
2020-04-30 11:56:04 +03:00
alesapin
5e2afad549
Merge pull request #10477 from ClickHouse/refactor_istorage
Remove getColumn and hasColumn from IStorage, better virtuals.
2020-04-30 10:42:52 +03:00
Azat Khuzhin
faea8afa22 Revert behaviour with duplicates in 01213_optimize_skip_unused_shards_DISTINCT
Since now optimization is done only under
optimize_distributed_group_by_sharding_key.
2020-04-30 10:13:19 +03:00
Alexander Kuzmenkov
a3843e1f42 performance comparison 2020-04-30 08:10:34 +03:00
Alexander Kuzmenkov
d952e5aba2 performance comparison 2020-04-29 20:26:28 +03:00
Anton Popov
42997bce86 im-memory parts: replication 2020-04-29 20:14:49 +03:00
alesapin
69fdf2a6a3 Review fixes and better test 2020-04-29 15:15:23 +03:00
Artem Zuikov
5fc28edb16 test fo fixed issue #7798 2020-04-29 14:37:30 +03:00
Nikolai Kochetov
a9d63d4520
Merge pull request #10498 from vzakaznikov/insert_into_watch_from_live_view
Adding support for INSERT INTO table WATCH query to build streaming systems using LIVE VIEW tables
2020-04-29 12:15:54 +03:00
Pavel Kovalenko
e5e84960ea S3 with proxy integration test and fixes. 2020-04-29 11:40:29 +03:00
Alexander Kuzmenkov
15e94d3de9 performance comparison 2020-04-29 09:30:37 +03:00
zhang2014
8ac709b5d3 ISSUES-10551 add backward compatibility for create bloom filter index 2020-04-29 11:57:28 +08:00
Anton Popov
1789d6fa82 add a test just in case 2020-04-29 02:07:11 +03:00
Azat Khuzhin
038235684d Add optimize_distributed_group_by_sharding_key and disable it by default
I know at least one way to fool that optimization, by using as sharding
key something like `if(col1>0, col1, col2)` (although this is not common
sharding key I would say, but can be useful if this will work
correctly), so let's disable it by default.
2020-04-29 00:09:25 +03:00
Azat Khuzhin
989ae58a0c Force clickhouse-test to use python2 2020-04-28 22:45:22 +03:00
Azat Khuzhin
007170481a Add a test for ALIAS with type different to the type of column 2020-04-28 22:42:21 +03:00
Vitaliy Zakaznikov
4749122734 Adding support to auto set output_format_enable_streaming option
based on the query type.
2020-04-28 17:50:50 +02:00
Artem Zuikov
e34a9457e6
Improve right table insert for Partial MergeJoin on disk (#10467) 2020-04-28 16:55:50 +03:00
Eldar Zaitov
f40603441b Add miniman fuzzing documentation, fix code style. 2020-04-28 13:34:57 +03:00
tavplubix
11c3493676
Merge pull request #10547 from ClickHouse/zhang2014/feature/ISSUES-5436
Merging #7572
2020-04-28 12:40:48 +03:00
Alexander Kuzmenkov
ed1576507b performance comparison 2020-04-28 10:45:56 +03:00
Eldar Zaitov
670ed4bf1b lexer, ast, checksum and column specs fuzzers added 2020-04-28 02:12:18 +03:00
Alexander Tokmakov
5a1d22a363 remove redundant configs from test 2020-04-28 02:05:15 +03:00
Alexander Tokmakov
e72a484beb minor fixes 2020-04-28 02:05:15 +03:00
Vitaliy Zakaznikov
2312c097ea Merge branch 'insert_into_watch_from_live_view' of https://github.com/vzakaznikov/ClickHouse into insert_into_watch_from_live_view 2020-04-27 17:34:47 +02:00
Vitaliy Zakaznikov
9d28066539 Adding 00979_live_view_watch_continuous_aggregates.py test. 2020-04-27 17:34:12 +02:00
Nikolai Kochetov
32baa073b5 Merge remote-tracking branch 'upstream/master' into insert_into_watch_from_live_view 2020-04-27 17:49:50 +03:00