Commit Graph

3813 Commits

Author SHA1 Message Date
alexey-milovidov
cb89e506a4
Merge pull request #5353 from yandex/aku/detached-parts-5164
Add system.detached_parts table.
2019-05-25 16:08:33 +03:00
alexey-milovidov
980c564db6
Merge pull request #5339 from sundy-li/feature/sequence64
Make sequenceMatch aggregate functions support other unsigned Integer types
2019-05-25 15:59:36 +03:00
alexey-milovidov
0c38226a25
Merge pull request #5366 from abyss7/storage-merge-sample
Check that underlying tables support sampling for StorageMerge
2019-05-25 15:44:02 +03:00
alexey-milovidov
fbbe3c1246
Merge pull request #5359 from andyyzh/fix_bitmap_issue_5244
Fixed bitmap functions produce wrong result
2019-05-25 15:43:38 +03:00
alexey-milovidov
bffe621d94
Merge pull request #5407 from kvap/all-columns-required-in-limit-by
Mark all input columns in LIMIT BY as required output
2019-05-25 15:13:01 +03:00
alexey-milovidov
9e24c8d19a
Merge pull request #5396 from 4ertus2/ast
Support IN in CrossToInnerJoin push down predicates
2019-05-25 14:07:45 +03:00
proller
6c1cb02172 CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT (#5397)
* CLICKHOUSE-4523 Fix "Column '0' already exists" in SELECT .. PREWHERE on column with DEFAULT

* fix style

* Fix build

* Update iostream_debug_helpers.cpp

* Update evaluateMissingDefaults.cpp
2019-05-25 14:03:12 +03:00
alesapin
7822db5884 Small performance test documentation. (#5408)
* Docs for performance tests

* docfix

* Better formating

* More English

* Run example

* Update README.md
2019-05-25 13:46:08 +03:00
Alexander Kozhikhov
a63ad11ee7 LinearRegression without -State modifier now simply returns its weights 2019-05-25 02:18:44 +03:00
Alexander Kozhikhov
ef3e47c037 small perf test for linear regression 2019-05-25 01:41:33 +03:00
alesapin
b6b1049850 Merge branch 'master' of github.com:yandex/ClickHouse 2019-05-24 18:09:32 +03:00
alesapin
0b450597be Fix meaningless (untested) performance tests 2019-05-24 18:09:21 +03:00
akuzm
7b927c4648
clickhouse-test improvements (#5352)
* Print error messages to stderr.

It makes it possible to redirect output to /dev/null and see only the
failed tests.

* Show an error message if we failed to find the queries dir.

* Treat 'distributed' and 'global' the same way as 'shard' in test names.

Some tests that need to run distributed queries do not use the
'shard' marker. It seems easier to support another two markers than
to rename the tests.
2019-05-24 15:07:26 +03:00
alexey-milovidov
9d7754e332
Merge pull request #5391 from yandex/rename-regression-methods
Rename regression methods.
2019-05-24 13:01:50 +03:00
alesapin
f4198ce262 Add order by to avoid flaps 2019-05-24 12:12:55 +03:00
alesapin
37313d64ee
Merge pull request #5367 from yandex/apply-substitutions-for-create-prepare-drop-query
[WIP] Add ability to make substitutions in create, fill and drop query in performance tests.
2019-05-24 11:59:01 +03:00
Constantin S. Pan
cbc0f56af1 Mark all input columns in LIMIT BY as required output
The query analyzer only marks the actual arguments of LIMIT BY as required
output for the LimitBy step in the pipeline. This is fine, unless the query is
distributed, in which case the first stage might remove a column that is used
at the second stage (e.g. for ORDER BY) but is not part of the final select.

Prevent removal of any columns in LimitBy by marking all input columns as
required output.
2019-05-24 09:53:09 +01:00
stavrolia
14ac3de76b Add limit to loop test 2019-05-24 11:38:49 +03:00
proller
3bb18d1dc2 Merge remote-tracking branch 'upstream/master' into fix15 2019-05-23 21:38:38 +03:00
stavrolia
17a6e9cffa Loop type of tests 2019-05-23 19:06:21 +03:00
chertus
333c9aeecc support IN in CrossToInnerJoin push down 2019-05-23 19:01:17 +03:00
stavrolia
3a1d3b0025 Try type of test - once 2019-05-23 18:31:23 +03:00
Nikolai Kochetov
54a52853e8 Remane regression methods. 2019-05-23 14:51:25 +03:00
stavrolia
e9425fdfeb Merge branch 'apply-substitutions-for-create-prepare-drop-query' of https://github.com/yandex/ClickHouse into apply-substitutions-for-create-prepare-drop-query 2019-05-23 13:38:48 +03:00
stavrolia
eb3340dba2 add test with selecting of different formats 2019-05-23 13:37:19 +03:00
alesapin
3425610f79
Update parse_engine_file.xml 2019-05-23 11:45:47 +03:00
stavrolia
a1719b101e Fix name of test 2019-05-22 18:34:16 +03:00
stavrolia
3469f80172 add config file for test of parsing files in different formats 2019-05-22 14:09:44 +03:00
alesapin
36cf6fa8f9
Merge pull request #5360 from filimonov/integration_tests_runner_improvements
more fixes for integration tests dockerfiles
2019-05-22 11:58:02 +03:00
proller
6cb4485473
Rename aggregate functions TSgroup* to timeSeriesGroup* (#5307) 2019-05-21 18:33:54 +03:00
Ivan Lezhankin
28bddf9a4a [StorageMerge] check that underlying tables support sampling 2019-05-21 16:04:34 +03:00
Alexander Kuzmenkov
43655a8db7 Add system.detached_parts table.
https://github.com/yandex/ClickHouse/issues/5164
2019-05-21 15:06:36 +03:00
alesapin
a08fee57b7
Merge pull request #5356 from comunodi/fix_test_without_zk
Fix replication_without_zookeeper test
2019-05-21 13:40:24 +03:00
alesapin
3340ae66ba More stable perf tests 2019-05-21 13:03:36 +03:00
alesapin
91907d2450 Add more information about stages in 00926 test 2019-05-21 13:00:02 +03:00
Oleg Favstov
fe74521710 Use pytest's raises instead of try/except clause 2019-05-21 11:30:39 +03:00
alesapin
09ad1732b3
Update test.py 2019-05-21 11:15:47 +03:00
Mikhail Filimonov
8a1d773ced more dockerfile fixes 2019-05-21 08:17:46 +02:00
Guillaume Tassery
d94ce121e2 update test 2019-05-21 10:53:53 +07:00
Andy Yang
a62f7e2fea Fixed bitmap functions produce wrong result 2019-05-21 10:58:38 +08:00
Oleg Favstov
896e995fe8 Fix test that doesn't assert anything 2019-05-20 23:59:07 +03:00
alexey-milovidov
1b86f28f08
Merge pull request #5350 from 4ertus2/bugs
Fix decimal conversion in IN
2019-05-20 22:01:56 +03:00
proller
50b74deeb4 CLICKHOUSE-4509 Fix error codes in DataPartsExchange 2019-05-20 20:04:36 +03:00
chertus
187311add0 add decimal to decimal convertion in IN 2019-05-20 18:51:54 +03:00
Mikhail Filimonov
8fe7633b62 Fixing "the input device is not a TTY" for test runner 2019-05-20 11:48:36 +02:00
Mikhail Filimonov
464cff4665 Sereval improvements in integration tests runner 2019-05-20 10:11:53 +02:00
sundy-li
66c60c2985 better tests 2019-05-20 12:31:52 +08:00
sundy-li
6843254ce4 Make sequenceMatch support other unsigned integer types 2019-05-20 12:02:54 +08:00
alexey-milovidov
02937294ce
Merge pull request #5311 from azat-archive/SimpleAggregateFunction-Arena-fix
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE
2019-05-19 13:12:38 +03:00
Danila Kutenin
295a4a8684
Merge pull request #5330 from yandex/format_function
Format function added
2019-05-19 12:07:57 +03:00
Azat Khuzhin
4e8370b0b0
Fix SimpleAggregateFunction for String longer MAX_SMALL_STRING_SIZE
SimpleAggregateFunction do not pass arena to the
add_function -> getAddressOfAddFunction(), hence next crash happens:
  (gdb) bt
  #0  DB::Arena::alloc (size=64, this=0x0) at ../dbms/src/Common/Arena.h:124
  #1  DB::SingleValueDataString::changeImpl (this=0x7f97424a27d8, value=..., arena=0x0) at ../dbms/src/AggregateFunctions/AggregateFunctionMinMaxAny.h:274
  #2  0x0000000005ea5319 in DB::AggregateFunctionNullUnary<true>::add (arena=<optimized out>, row_num=<optimized out>, columns=<optimized out>, place=<optimized out>, this=<optimized out>) at ../dbms/src/AggregateFunctions/AggregateFunctionNull.h:43
  #3  DB::IAggregateFunctionHelper<DB::AggregateFunctionNullUnary<true> >::addFree (that=<optimized out>, place=<optimized out>, columns=<optimized out>, row_num=<optimized out>, arena=<optimized out>) at ../dbms/src/AggregateFunctions/IAggregateFunction.h:131
  #4  0x000000000679772f in DB::AggregatingSortedBlockInputStream::addRow (this=this@entry=0x7f982de19c00, cursor=...) at ../dbms/src/Common/AlignedBuffer.h:31
  #5  0x0000000006797faa in DB::AggregatingSortedBlockInputStream::merge (this=this@entry=0x7f982de19c00, merged_columns=..., queue=...) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:140
  #6  0x0000000006798979 in DB::AggregatingSortedBlockInputStream::readImpl (this=0x7f982de19c00) at ../dbms/src/DataStreams/AggregatingSortedBlockInputStream.cpp:78
  #7  0x000000000622db55 in DB::IBlockInputStream::read (this=0x7f982de19c00) at ../dbms/src/DataStreams/IBlockInputStream.cpp:56
  #8  0x0000000006613bee in DB::MergeTreeDataMergerMutator::mergePartsToTemporaryPart (this=this@entry=0x7f97ec65e1a0, future_part=..., merge_entry=..., time_of_merge=<optimized out>, disk_reservation=<optimized out>, deduplicate=<optimized out>) at /usr/include/c++/8/bits/shared_ptr_base.h:1018
  #9  0x000000000658f7a4 in DB::StorageReplicatedMergeTree::tryExecuteMerge (this=0x7f97ec65b810, entry=...) at /usr/include/c++/8/bits/unique_ptr.h:342
  #10 0x00000000065940ab in DB::StorageReplicatedMergeTree::executeLogEntry (this=0x7f97ec65b810, entry=...) at ../dbms/src/Storages/StorageReplicatedMergeTree.cpp:910
  <snip>

  (gdb) f 1
  (gdb) p MAX_SMALL_STRING_SIZE
  $1 = 48
  (gdb) p capacity
  $2 = 64
  (gdb) p value
  $3 = {data = 0x7f97242fcbd0 "HHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHHH", size = 61}

v2: avoid leaking of allocated by Arena memory on the intermediate step

Fixes: 8f8d2c048e ("Merge pull request #4629 from bgranvea/simple_aggregate_function")
2019-05-19 03:32:55 +03:00
alexey-milovidov
2254b171a7
Merge pull request #5313 from yandex/fix-external-query-in-with-single-element
Fix external queries with IN operator.
2019-05-19 03:12:57 +03:00
alexey-milovidov
e73fc1bd0f
Merge pull request #5320 from sundy-li/feature/funnel64
Make windowFunnel support other Unsigned Integer Types
2019-05-18 23:47:12 +03:00
Danila Kutenin
fca6e4fd38 constant string handling 2019-05-18 18:09:52 +03:00
Danila Kutenin
84b04dc8ea format function added 2019-05-18 15:29:10 +03:00
Danila Kutenin
a48cf9abe5 format function added 2019-05-18 14:30:50 +03:00
Danila Kutenin
4e3a607267 format function added 2019-05-18 14:30:36 +03:00
alexey-milovidov
24b16da9fd
Merge pull request #5235 from vitlibar/improve-new-json-functions
Improve new json functions
2019-05-18 12:51:41 +03:00
alexey-milovidov
8b9b305a5f
Merge pull request #5325 from abyss7/issue-5286
Allow to shadow virtual column '_table' in Merge engine
2019-05-18 00:17:34 +03:00
alexey-milovidov
34f36e2891
Merge pull request #5304 from 4ertus2/funcs
Support quantile(s) and median for Decimal
2019-05-17 23:03:27 +03:00
Danila Kutenin
e0b90de474
Merge pull request #5322 from yandex/to_valid_utf8
toValidUTF8 function added
2019-05-17 22:48:32 +03:00
Ivan Lezhankin
7b6c78402d Allow to shadow virtual column '_table' in Merge engine 2019-05-17 20:40:51 +03:00
Danila Kutenin
0d3422fa8a toValidUTF8 function added 2019-05-17 15:55:21 +03:00
alesapin
7a9dfbbb53 More stable perf tests 2019-05-17 14:42:41 +03:00
sundy-li
760bc5708d support unsigned integer type in windowFunnel Aggregate function 2019-05-17 19:17:52 +08:00
Alexey Milovidov
efd882aa29 Better logic 2019-05-16 22:55:18 +03:00
Vitaly Baranov
823d862ceb Add a setting to disable simdjson. 2019-05-16 22:39:49 +03:00
Alexey Milovidov
842d62463b Added more tests 2019-05-16 22:26:32 +03:00
Vitaly Baranov
cb459c79aa Add a test case with incorrect JSON. 2019-05-16 20:43:01 +03:00
Vitaly Baranov
8ab4e4dcfe Use rapidjson when AVX2 instructions are not available. 2019-05-16 20:40:24 +03:00
Artem Zuikov
c3588fd5da
Merge pull request #5291 from 4ertus2/nulls
Add toDecimalOrZero and toDecimalOrNull fuctions
2019-05-16 18:53:17 +03:00
chertus
fdcbf509bb support quantile(s)ExactWeighted for Decimal 2019-05-16 17:33:13 +03:00
Vitaly Baranov
ae4f472bc7 Add tests cases and fix documentation for JSON functions. 2019-05-16 16:48:19 +03:00
chertus
50c35a70db support quanitle, quantiles, median for Decimal 2019-05-16 15:53:33 +03:00
chertus
ab517cdf4d Merge branch 'master' into decimal 2019-05-16 14:22:52 +03:00
Yuriy
a51c293ec6 merged 'origin/master' into mysql 2019-05-16 14:19:05 +03:00
Vitaly Baranov
f4942007e1 Add function JSONExtractKeysAndValues(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
c93bd31695 Simplify template implementation. 2019-05-16 14:09:22 +03:00
Vitaly Baranov
76bda0342b Move ExtraArg to the end of arguments of JSONExtract(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
d003682626 Implement function JSONExtractRaw(). 2019-05-16 14:09:22 +03:00
Vitaly Baranov
8be2e728c0 Use capital letters in the names of json functions: jsonHas => JSONHas 2019-05-16 14:09:22 +03:00
Vitaly Baranov
0d26ac8583 Reimplement indices in objects in more straightforward way 2019-05-16 14:09:22 +03:00
chertus
2739a3f6d0 Merge branch 'master' into nulls 2019-05-16 14:02:12 +03:00
Yuriy
ff4937859e added MySQL wire protocol presentational format 2019-05-16 06:34:04 +03:00
alexey-milovidov
dcc88f3a0c
Merge pull request #5284 from 4ertus2/bugs
fix decimal quoted csv input
2019-05-16 00:07:23 +03:00
chertus
5f19c0981d add toDecimalOrZero and toDecimalOrNull fuctions 2019-05-15 21:50:35 +03:00
alesapin
d477cc0df4 Fix incorrect performance tests 2019-05-15 19:44:25 +03:00
Yangkuan Liu
0760a3436f add AggregateFunction TSgroup{Rate}Sum (#4542) 2019-05-15 19:16:25 +03:00
chertus
720f8667e4 fix decimal quoted csv input 2019-05-15 16:51:17 +03:00
chertus
02f01a5104 throw Decimal overflow for Inf and NaN 2019-05-15 15:28:44 +03:00
svladykin
2ca74ec259 minor tests fix 2019-05-15 13:54:58 +03:00
Vitaly Baranov
9620e2e223
Merge pull request #5003 from Enmk/geohash_support
Implementation of geohashEncode and geohashDecode functions;
2019-05-14 20:01:22 +03:00
Artem Zuikov
aba710a70e
Merge pull request #5260 from 4ertus2/joins
Fix perf regression: do not add right join key to result if possible
2019-05-14 15:33:54 +03:00
chertus
ba202c2b06 fix whitespaces 2019-05-14 12:47:21 +03:00
Nikolai Kochetov
6165be54fc
Merge pull request #4943 from Quid37/master
Regression methods
2019-05-14 11:47:33 +03:00
chertus
20e7de7cce fix perf regression: do not add right join key to result if possible 2019-05-13 21:58:15 +03:00
Alexander Kozhikhov
003a0fbadf conflict fix 2019-05-13 17:43:47 +03:00
alesapin
5aec6dd011 Fix banch of flapping perf tests. Improve average speed calculation 2019-05-13 17:09:11 +03:00
Alexander Kozhikhov
9b4f322fd8 Merge branch 'master' of https://github.com/yandex/ClickHouse 2019-05-13 16:50:56 +03:00
Guillaume Tassery
1ae8948177 Merge branch 'master' of https://github.com/yandex/ClickHouse into send_header 2019-05-13 13:35:12 +07:00
Guillaume Tassery
e2f70714a1 update tests 2019-05-13 12:07:18 +07:00
Guillaume Tassery
1b30f91c42 Return to old implementation of read and write values for progress 2019-05-13 11:48:09 +07:00
Nikita Vasilev
ee3c50e1a0 mayBeTrueOnGranule 2019-05-12 20:08:28 +03:00
Nikita Vasilev
3e02eaf28d fix null minmax 2019-05-12 20:01:36 +03:00
svladykin
22389d4eca Support for bitmapHasAny and bitmapHasAll functions. 2019-05-12 17:47:31 +03:00
alexey-milovidov
9ce2dd8803
Merge pull request #5238 from janplus/if-nullable-bug
Fix if, multiIf's nullable bug.
2019-05-12 11:47:37 +03:00
alexey-milovidov
f7343ecb6f
Merge pull request #4639 from IvanKush/feat/parallel-alter-modify
feat alter:  parallelize processing of parts in alter modify
2019-05-12 00:39:46 +03:00
ivan-kush
5f6ab5eb10 tsan? 2019-05-11 21:30:24 +03:00
ivan-kush
ebdd5af7ab add test 2019-05-11 21:12:24 +03:00
Vasily Nemkov
e4988110ec Implementation of geohashEncode and geohashDecode functions;
Function signatures:
 * geohashEncode(float lon, float lat, int precision) => string

 * geohashDecode(string encoded) => (float llon, float lat)

With test cases and documentation;
2019-05-10 14:59:24 +03:00
吴健
bd43e8bada Fix if, multiIf's nullable bug. 2019-05-10 18:42:44 +08:00
alexey-milovidov
001e4bfe76
Merge pull request #5209 from PerformanceVision/rename_mv
Support rename operation for MaterializeView storage
2019-05-09 23:10:41 +03:00
alexey-milovidov
9f5e1a5b80
Merge pull request #5228 from andyyzh/fix_bitmap_issue_5220
Fix bitmap functions crash the server bug segfault
2019-05-09 23:06:57 +03:00
alexey-milovidov
a1cb9a2d67
Merge pull request #5152 from janplus/bug-null-in
Fix null problem in FunctionIn
2019-05-09 19:22:41 +03:00
alexey-milovidov
8f8d2c048e
Merge pull request #4629 from bgranvea/simple_aggregate_function
SimpleAggregateFunction data type
2019-05-09 18:45:59 +03:00
Andy Yang
4b66622601 Fix bitmap functions crash the server bug segfault 2019-05-09 17:24:36 +08:00
alexey-milovidov
31655abc09
Merge pull request #5204 from proller/fix25
CLICKHOUSE-4511 Fix forcerestart with systemd
2019-05-09 12:19:47 +03:00
proller
5b28a86930 Add comment 2019-05-09 12:03:06 +03:00
Vitaly Baranov
7ace113ac0 Use custom cmake file for simdjson and fix build 2019-05-08 16:20:25 +03:00
hcz
682ce99133 Return strings in jsonType 2019-05-08 16:20:25 +03:00
hcz
706f335042 Format code and update tests 2019-05-08 16:20:25 +03:00
hcz
560246c0c3 Add Simdjson API 2019-05-08 16:20:25 +03:00
吴健
3893a4943d Fix nulls_in test case. 2019-05-07 16:27:24 +08:00
Guillaume Tassery
b91fd18704 Update test reference 2019-05-07 14:36:05 +07:00
Guillaume Tassery
55dc86ef74 Support rename operation for MaterializeView storage 2019-05-07 13:54:55 +07:00
Guillaume Tassery
6dcaadc620 Merge remote-tracking branch 'upstream/master' into send_header 2019-05-06 17:18:41 +07:00
hcz
4f3e164c73 Fix and add tests 2019-05-06 12:08:54 +08:00
Danila Kutenin
2abf420fac
Merge pull request #5198 from yandex/ngram_vector_vector_distance
Ngram vector_vector distance added
2019-05-06 02:49:59 +03:00
Danila Kutenin
f613c06c47 ngram vector_vector distance added 2019-05-05 23:48:46 +03:00
zhang2014
7c54df39b8 ISSUES-5190 add performance test from Denny Crane 2019-05-06 01:19:12 +08:00
Danila Kutenin
173884c04f Perf test for upcoming review for regexp matching 2019-05-05 12:27:57 +03:00
Danila Kutenin
ca4f098362 fix hyperscan to treat regular expressions as utf-8 expressions 2019-05-05 09:51:59 +03:00
Alexey Milovidov
eb0a8d1709 More robust test 2019-05-05 02:42:36 +03:00
Alexey Milovidov
b2f44beeb4 Addition to prev revision 2019-05-05 02:39:37 +03:00
Alexey Milovidov
a924e1c5fb Now the test reproduces the issue clearly 2019-05-05 02:38:40 +03:00
Alexey Milovidov
4dc5671482 Merge branch 'master' into system_columns_race_condition 2019-05-03 03:21:49 +03:00
alexey-milovidov
9e3c80d2ed
Merge pull request #5170 from yandex/cidr-to-range-better-code
Cidr to range better code
2019-05-02 19:29:36 +03:00
Alexey Milovidov
0a072ccc57 Added a test for race condition 2019-05-02 18:13:57 +03:00
Alexey Milovidov
6a271adad3 Added max_parts_in_total threshold to MergeTree tables 2019-05-02 17:48:54 +03:00
Alexey Milovidov
a04849476f Added performance test for "basename" function #5136 2019-05-02 16:11:58 +03:00
Alexey Milovidov
9d814f3ce1 Added performance test #5170 2019-05-02 16:09:48 +03:00
Alexey Milovidov
0381a6a1ec Better code for CIDR to range functions #5095 2019-05-02 01:09:24 +03:00
alexey-milovidov
2dccdb18eb
Merge pull request #5095 from PerformanceVision/CIDR_MASK
Functions for calculate lower and high range of an IP address using a CIDR mask
2019-05-02 01:00:29 +03:00
alexey-milovidov
d4b4a9425b
Merge pull request #5154 from yandex/fix-low-cardinality-keys-in-set-index
LowCardinality keys in set index
2019-05-01 20:19:04 +03:00
Nikolai Kochetov
be91f09417 Merge branch 'master' into fix-low-cardinality-keys-in-set-index 2019-04-30 20:26:18 +03:00
Alexey Milovidov
b02588eb62 Move performance tests for convenience 2019-04-30 20:11:43 +03:00
alexey-milovidov
cd16c3a3c9
Update 00931_low_cardinality_set_index_in_key_condition.sql 2019-04-30 19:21:33 +03:00
alexey-milovidov
e7ec3b9eb8
Merge pull request #5136 from PerformanceVision/basename
Add a basename function
2019-04-30 19:15:35 +03:00
Nikolai Kochetov
0b7bf0c794 Added test. #5031 2019-04-30 13:46:04 +03:00
吴健
acbeedad38 Fix null problem in FunctionIn 2019-04-30 11:50:30 +08:00