Commit Graph

3748 Commits

Author SHA1 Message Date
alesapin
056d794fe4 One more test case 2020-10-16 13:56:04 +03:00
Pavel Kovalenko
a474bdcabf Merge remote-tracking branch 'origin/master' into idempotent-part-move 2020-10-16 13:02:40 +03:00
Mike
e89a3b5d09
Fixing arrayIndex functions when right operand is LC but left is not (#16038) 2020-10-16 12:08:44 +03:00
vivarum
1d9df13b47
Merge branch 'master' into enable-parsing-of-input-enum-values-by-id-10682 2020-10-16 11:07:01 +03:00
Vasily Kozhukhovskiy
107d1a2ce5 update tests checking parsing of inserted enum values by numeric enum ids 2020-10-16 10:52:14 +03:00
alesapin
07c12116e2
Merge pull request #16007 from CurtizJ/fix-complex-key-direct
Allow to use direct layout for dictionaries with complex keys
2020-10-16 10:03:10 +03:00
Alexey Milovidov
1cca8d09c5 Added a test for query parameter of type UUID 2020-10-16 02:36:28 +03:00
Maksim Kita
9bd30b041a Parser allow specify primary key in column list 2020-10-15 23:33:00 +03:00
Nikita Mikhaylov
6512d84b31
Merge pull request #15985 from CurtizJ/redis-cached-dict
Add support of cache layout for Redis dictionaries with complex key
2020-10-15 22:35:36 +03:00
Kruglov Pavel
5aba639430 Update test 2020-10-15 22:01:18 +03:00
sundy-li
153be93544 sub ReadonlyReplica when detach readonly tables 2020-10-15 22:01:18 +03:00
Alexander Kuzmenkov
f46887dcaa improve fasttest usability 2020-10-15 20:29:07 +03:00
Anton Popov
9c9ad2cc85
Merge branch 'master' into fix-complex-key-direct 2020-10-15 18:53:59 +03:00
Anton Popov
9ad80d6568 skip test in arcadia 2020-10-15 18:52:42 +03:00
Vitaly Baranov
5f261cec3c
Merge pull request #15199 from filimonov/non_delimited_protobuf
ProtobufSingle format
2020-10-15 16:58:39 +03:00
Alexander Kuzmenkov
f7f59ca23f
Merge pull request #15982 from vitlibar/fix-ambiguity-in-parsing-of-settings-profiles
Fix ambiguity in parsing of settings profiles.
2020-10-15 16:23:32 +03:00
alesapin
2002289003 Fix bug in alter primary key for replicated versioned collapsing merge tree 2020-10-15 16:02:39 +03:00
Nikolai Kochetov
963ce315b2
Merge pull request #15454 from azat/dict-prealloc
Speedup hashed/sparse_hashed dictionary loading by preallocating the hash table
2020-10-15 15:03:53 +03:00
Anton Popov
424dd3147c allow to use direct layout for dictionaries with complex keys 2020-10-15 14:59:41 +03:00
Denis Zhuravlev
059b0608b4 test for bug 5346 2020-10-14 23:48:55 -03:00
tavplubix
04206db7da
Merge pull request #15974 from ClickHouse/merging_14295
Merging #14295
2020-10-14 23:51:42 +03:00
Anton Popov
3050b2e67b add support of cache layout for redis dictionaries with complex key 2020-10-14 22:57:07 +03:00
tavplubix
0deda56e2b
trigger sync check 2020-10-14 22:41:19 +03:00
alexey-milovidov
1d309c34c8
Merge pull request #15497 from filipecaixeta/master
Add an SQL function formatReadableTimeDelta to format time delta
2020-10-14 22:36:57 +03:00
Vitaly Baranov
2f13fcb4b7 Fix ambiguity in parsing of settings profiles. 2020-10-14 20:30:24 +03:00
Alexander Kuzmenkov
cb15e72229 make some perf tests slower 2020-10-14 18:39:27 +03:00
Vasily Nemkov
a6f36fc53b Performance tests for encrypt and decrypt functions 2020-10-14 16:33:07 +03:00
Vasily Nemkov
8984f4b8c2 Empty string optimization for encryption 2020-10-14 16:33:07 +03:00
Vitaly Baranov
a33d84f3a4
Update 00825_protobuf_format_output.sh 2020-10-14 16:32:33 +03:00
Alexey Milovidov
5e502c52b3 Merge branch 'master' into AES_encrypt_decrypt 2020-10-14 16:30:23 +03:00
Vitaly Baranov
fc285bf82c
Update 00825_protobuf_format_output.sh
Fix the error code after resolving conflict
2020-10-14 16:30:15 +03:00
Vitaly Baranov
997570780d
Merge branch 'master' into non_delimited_protobuf 2020-10-14 16:26:57 +03:00
Alexander Kuzmenkov
71a860dc8f
Merge pull request #15873 from den-crane/tests/14053_max_length_alias
test for a bug from #14053
2020-10-14 15:49:55 +03:00
Denis Glazachev
6eec447a64 Merge branch 'master' into ldap-any-user-authentication
* master: (189 commits)
  Fix ugly links in docs
  Update Internals.cpp
  Whitespace
  Fix ugliness in docs
  better
  better backticks
  Try fix tests.
  Fetch helper image before run
  Fetch helper image before run
  Fetch helper image before run
  Update version_date.tsv after release 20.7.4.11
  Update version_date.tsv after release 20.8.4.11
  Update 01515_with_global_and_with_propagation.sql
  fix compilation error
  Supress pvs
  Update version_date.tsv after release 20.9.3.45
  Add missed file
  fix thread restart for parallel quorum inserts
  Update openssl
  Fix race in openssl
  ...
2020-10-14 16:46:37 +04:00
Alexey Milovidov
87fe8f2a00 Merge branch 'master' into filipecaixeta-master 2020-10-14 15:27:58 +03:00
Anton Popov
7470ac98bb
Merge pull request #15855 from hexiaoting/dev_fetch
Add Support for OFFSET_FETCH_CLAUSE
2020-10-14 15:21:28 +03:00
Alexander Tokmakov
72b1339656 Revert "Revert "Write structure of table functions to metadata""
This reverts commit c65d1e5c70.
2020-10-14 15:19:29 +03:00
alexey-milovidov
f3655fb9eb
Merge pull request #15945 from azat/tests-lv-fix-flackiness
Fix flackiness of LIVE VIEW tests by increasing timeout for HTTPConnection
2020-10-14 14:13:40 +03:00
tavplubix
c65d1e5c70
Revert "Write structure of table functions to metadata" 2020-10-14 13:59:29 +03:00
alesapin
d51deaeecf Fix flaky 01509_parallel_quorum_insert_no_replicas 2020-10-14 10:49:50 +03:00
Azat Khuzhin
628e2b472c Fix flackiness of LIVE VIEW tests by increasing timeout for HTTPConnection
Trace from [1]:

    2020-10-13 01:37:06 00966_live_view_watch_events_http:                                      [ FAIL ] - return code 1
    2020-10-13 01:37:06 Exception in thread Thread-2:
    2020-10-13 01:37:06 Traceback (most recent call last):
    2020-10-13 01:37:06   File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner
    2020-10-13 01:37:06     self.run()
    2020-10-13 01:37:06   File "/usr/lib/python3.7/threading.py", line 870, in run
    2020-10-13 01:37:06     self._target(*self._args, **self._kwargs)
    2020-10-13 01:37:06   File "/usr/share/clickhouse-test/queries/0_stateless/helpers/httpexpect.py", line 48, in reader
    2020-10-13 01:37:06     data = response.read(1).decode()
    2020-10-13 01:37:06   File "/usr/lib/python3.7/http/client.py", line 457, in read
    2020-10-13 01:37:06     n = self.readinto(b)
    2020-10-13 01:37:06   File "/usr/lib/python3.7/http/client.py", line 491, in readinto
    2020-10-13 01:37:06     return self._readinto_chunked(b)
    2020-10-13 01:37:06   File "/usr/lib/python3.7/http/client.py", line 586, in _readinto_chunked
    2020-10-13 01:37:06     chunk_left = self._get_chunk_left()
    2020-10-13 01:37:06   File "/usr/lib/python3.7/http/client.py", line 554, in _get_chunk_left
    2020-10-13 01:37:06     chunk_left = self._read_next_chunk_size()
    2020-10-13 01:37:06   File "/usr/lib/python3.7/http/client.py", line 514, in _read_next_chunk_size
    2020-10-13 01:37:06     line = self.fp.readline(_MAXLINE + 1)
    2020-10-13 01:37:06   File "/usr/lib/python3.7/socket.py", line 589, in readinto
    2020-10-13 01:37:06     return self._sock.recv_into(b)
    2020-10-13 01:37:06 socket.timeout: timed out

  [1]: https://clickhouse-test-reports.s3.yandex.net/15879/f7bf94b5d361d0a54e85673c14e630cfdf8dbe01/functional_stateless_tests_(release,_polymorphic_parts_enabled)/test_run.txt.out.log
2020-10-14 01:21:51 +03:00
alexey-milovidov
56e7e6ed62
Merge pull request #15886 from zhang2014/fix/ISSUES-12513
ISSUES-12513 fix difference expressions with same alias when analyze queries again
2020-10-14 00:55:11 +03:00
alexey-milovidov
f60ccb4edf
Merge pull request #14295 from ClickHouse/write_structure_of_table_functions
Write structure of table functions to metadata
2020-10-13 23:56:09 +03:00
alexey-milovidov
fc83bd1088
Merge branch 'master' into setting-date-time-output-format 2020-10-13 23:48:27 +03:00
alexey-milovidov
173ee78122
Merge pull request #15876 from azat/connections_with_failover_max_tries-endless-loop
Fix query hang with connections_with_failover_max_tries = 0 (endless loop)
2020-10-13 23:47:34 +03:00
Alexey Milovidov
da4e4c5cdb Merge branch 'master' into filipecaixeta-master 2020-10-13 23:44:48 +03:00
Pavel Kruglov
be0cb31d21 Add tests and comments 2020-10-13 21:55:03 +03:00
Nikolai Kochetov
5aba92a6bf Added test. 2020-10-13 18:19:35 +03:00
alesapin
f64344f7c5
Merge pull request #15890 from ClickHouse/fix_test_many_parallel_quorum_inserts
Fix test 01509_check_many_parallel_quorum_inserts
2020-10-13 14:29:55 +03:00
Maksim Kita
adaae8a12c Added OutputFormat setting date_time_output_format 2020-10-13 13:59:43 +03:00
Vitaly Baranov
13896cf4c9
Merge pull request #15875 from vitlibar/rbac-fix-deadlock
Fix possible deadlocks in RBAC
2020-10-13 12:58:57 +03:00
Nikita Mikhaylov
835c480056
Merge pull request #15858 from ClickHouse/fix_alter_default_validation
Fix alter default validation
2020-10-13 12:47:18 +03:00
tavplubix
6c1d59cd49
Merge pull request #15743 from azat/Atomic-DROP-TABLE-hang-fix
Fix DROP TABLE hangs with Atomic engine
2020-10-13 12:40:36 +03:00
alesapin
700b6b8a38 Fix test 01509_check_many_parallel_quorum_inserts 2020-10-13 10:14:31 +03:00
zhang2014
14ef354a16 ISSUES-12513 try fix test failure 2020-10-13 14:52:05 +08:00
alesapin
321a7ae6bf
Merge pull request #15852 from ClickHouse/fix_reverse_processor
Fix block structure mismatch after ALTER
2020-10-13 09:49:26 +03:00
zhang2014
72f8153f01 ISSUES-12513 add stateless test 2020-10-13 13:48:16 +08:00
Vitaliy Zakaznikov
f34274dc08 Updating requirements and adding restart tests for LDAP external user directory test suite. 2020-10-12 19:54:07 -04:00
Vitaly Baranov
6a58bb5c23 Enable rbac tests with thread sanitizer. 2020-10-13 01:03:51 +03:00
alexey-milovidov
4798234002
Merge pull request #15843 from ClickHouse/check-executable-files
Check for executable bit on non-executable files
2020-10-12 23:54:00 +03:00
Azat Khuzhin
9613144fa8 Move 01521_connections_with_failover_max_tries_0 to 01521_distributed_query_hang
This will fix style check error:

    /place/sandbox-data/tasks/4/8/795063184/ClickHouse/tests/queries/0_stateless/01521_connections_with_failover_max_tries_0.reference
    /place/sandbox-data/tasks/4/8/795063184/ClickHouse/tests/queries/0_stateless/01521_connections_with_failover_max_tries_0.sql
    Tests should not be named with "fail" in their names. It makes looking at the results less convenient when you search for "fail" substring in browser.
2020-10-12 23:30:37 +03:00
Azat Khuzhin
2947eff878 Fix query hang with connections_with_failover_max_tries = 0 (endless loop) 2020-10-12 22:07:26 +03:00
Azat Khuzhin
8fbf50d672 Add 01509_dictionary_preallocate into arcadia_skip_list
An attempt to fix "Yandex synchronization check (only for Yandex employees)"
2020-10-12 21:50:56 +03:00
Azat Khuzhin
91787e6a7e Add a test with recursive DROP TABLE (mv w/o explicit inner table) 2020-10-12 21:46:07 +03:00
Azat Khuzhin
ea12ca42c7 Add a stress test for DROP TABLE 2020-10-12 21:46:07 +03:00
Denis Zhuravlev
f4b681fbcc test for bug from #14053 2020-10-12 13:07:22 -03:00
Mikhail Filimonov
87a8ba63f7
Few more CR fixes 2020-10-12 15:05:40 +02:00
tavplubix
748b75ab1b
Merge pull request #15767 from ClickHouse/fix_materialize_mysql_count_v2
Try fix select count() for MaterializeMySQL (another way)
2020-10-12 14:41:38 +03:00
Nikolai Kochetov
2a62a91af4
Merge pull request #15662 from ClickHouse/fix-15529
Fix read from Buffer table with empty nested table with different types.
2020-10-12 14:12:11 +03:00
alesapin
6732e5c217 Fix alter default validation 2020-10-12 14:02:35 +03:00
hexiaoting
39367be57a Add Support for OFFSET_FETCH_CLAUSE 2020-10-12 16:46:49 +08:00
alesapin
5b5dd4fb28 Fix order by desc after alter 2020-10-12 11:28:47 +03:00
alesapin
106040a720 Disable rbac tests with thread sanitizer 2020-10-12 10:04:46 +03:00
Mikhail Filimonov
e17d4e1eeb
Tests and some docs 2020-10-12 07:51:46 +02:00
Mikhail Filimonov
b602d18dd8
ProtobufSingle input format
Allows to read Single protobuf message at once (w/o length-delemeters).
2020-10-12 07:51:36 +02:00
Alexey Milovidov
78c42d5dcd Remove executable bit from non-executable files 2020-10-11 19:21:29 +03:00
Alexey Milovidov
b9c3b4c79e More tests 2020-10-11 19:00:50 +03:00
Alexey Milovidov
4428ece196 Update reference 2020-10-11 18:32:34 +03:00
Alexey Milovidov
fa3b257579 Remove tabs from test 2020-10-11 18:32:03 +03:00
Alexey Milovidov
2b90472869 Remove executable bit from non-executable files 2020-10-11 18:30:20 +03:00
Alexey Milovidov
905bb859a5 Add performance test 2020-10-11 18:25:29 +03:00
Alexey Milovidov
8a252ebef8 Merge remote-tracking branch 'origin/master' into filipecaixeta-master 2020-10-11 17:29:50 +03:00
alexey-milovidov
2e3046991b
Merge pull request #15757 from filimonov/fix-kafka-no-holes-flap
fix flap in no_holes_when_write_suffix_failed
2020-10-11 14:38:45 +03:00
alexey-milovidov
a8708338f2
Merge pull request #15809 from amosbird/c1
add print_query_id support for native client
2020-10-11 13:29:35 +03:00
Amos Bird
ff665c362f
Add print query id support to client 2020-10-11 10:09:08 +08:00
bharatnc
8739f219c6 Fix incorrect flag in Integration tests README 2020-10-10 17:52:50 -07:00
filimonov
e167e4ec00
Update 01360_materialized_view_with_join_on_query_log.sql
see https://github.com/ClickHouse/ClickHouse/pull/14723#issuecomment-691009172
2020-10-10 23:41:33 +02:00
filimonov
1ce0d4dbc2
Update test.py
similar change for test_kafka_duplicates_when_commit_failed
2020-10-10 23:36:59 +02:00
alexey-milovidov
c2069ad3ee
Merge pull request #15035 from azat/jemalloc-percpu-arena-fix
Update jemalloc to fix percpu_arena with affinity mask
2020-10-10 23:19:56 +03:00
Alexey Milovidov
9ca9855f96 Merge branch 'master' into filipecaixeta-master 2020-10-10 20:52:34 +03:00
alexey-milovidov
1f6c2c8efc
Merge pull request #15803 from ucasFL/tid-function
Add `tid` and `logTrace` function
2020-10-10 19:37:04 +03:00
Mikhail Filimonov
60f4e561fb
fix test_kafka_produce_key_timestamp 2020-10-10 17:01:22 +02:00
feng lv
9438f2f4d2 fix
fix

fix
2020-10-10 19:21:11 +08:00
feng lv
ec87254abe add test 2020-10-10 10:48:15 +08:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master
Improvement of Quorum Inserts in ClickHouse
2020-10-09 22:43:53 +03:00
alexey-milovidov
165402209a
Merge pull request #15779 from ClickHouse/fix_race_openssl
Fix fake race openssl
2020-10-09 22:37:11 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
2020-10-09 22:28:14 +03:00
Nikolai Kochetov
ef3640c3f7
Merge pull request #15451 from amosbird/scopewith
Global WITH and WITH propagation.
2020-10-09 22:16:45 +03:00
alesapin
35165c8ea4
Merge pull request #15756 from CurtizJ/fix-prewhere-with-virtuals
Fix prewhere with virtual columns
2020-10-09 18:07:41 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00