thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-09-29 13:10:48 +00:00
Code Issues Packages Projects Releases Wiki Activity
49,469 Commits 8,958 Branches 1,767 Tags 1.8 GiB
41f1fd8fa0
Commit Graph

3653 Commits

Author SHA1 Message Date
Mikhail Filimonov
b602d18dd8
ProtobufSingle input format 
Allows to read Single protobuf message at once (w/o length-delemeters).
 2020-10-12 07:51:36 +02:00
Alexey Milovidov
78c42d5dcd Remove executable bit from non-executable files 2020-10-11 19:21:29 +03:00
Alexey Milovidov
b9c3b4c79e More tests 2020-10-11 19:00:50 +03:00
Alexey Milovidov
4428ece196 Update reference 2020-10-11 18:32:34 +03:00
Alexey Milovidov
fa3b257579 Remove tabs from test 2020-10-11 18:32:03 +03:00
Alexey Milovidov
2b90472869 Remove executable bit from non-executable files 2020-10-11 18:30:20 +03:00
Alexey Milovidov
905bb859a5 Add performance test 2020-10-11 18:25:29 +03:00
Alexey Milovidov
8a252ebef8 Merge remote-tracking branch 'origin/master' into filipecaixeta-master 2020-10-11 17:29:50 +03:00
alexey-milovidov
2e3046991b
Merge pull request #15757 from filimonov/fix-kafka-no-holes-flap 
fix flap in no_holes_when_write_suffix_failed
 2020-10-11 14:38:45 +03:00
alexey-milovidov
a8708338f2
Merge pull request #15809 from amosbird/c1 
add print_query_id support for native client
 2020-10-11 13:29:35 +03:00
Amos Bird
ff665c362f
Add print query id support to client 2020-10-11 10:09:08 +08:00
bharatnc
8739f219c6 Fix incorrect flag in Integration tests README 2020-10-10 17:52:50 -07:00
filimonov
e167e4ec00
Update 01360_materialized_view_with_join_on_query_log.sql 
see https://github.com/ClickHouse/ClickHouse/pull/14723#issuecomment-691009172
 2020-10-10 23:41:33 +02:00
filimonov
1ce0d4dbc2
Update test.py 
similar change for test_kafka_duplicates_when_commit_failed
 2020-10-10 23:36:59 +02:00
alexey-milovidov
c2069ad3ee
Merge pull request #15035 from azat/jemalloc-percpu-arena-fix 
Update jemalloc to fix percpu_arena with affinity mask
 2020-10-10 23:19:56 +03:00
Alexey Milovidov
9ca9855f96 Merge branch 'master' into filipecaixeta-master 2020-10-10 20:52:34 +03:00
alexey-milovidov
1f6c2c8efc
Merge pull request #15803 from ucasFL/tid-function 
Add `tid` and `logTrace` function
 2020-10-10 19:37:04 +03:00
Mikhail Filimonov
60f4e561fb
fix test_kafka_produce_key_timestamp 2020-10-10 17:01:22 +02:00
feng lv
9438f2f4d2 fix 
fix

fix
 2020-10-10 19:21:11 +08:00
feng lv
ec87254abe add test 2020-10-10 10:48:15 +08:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master 
Improvement of Quorum Inserts in ClickHouse
 2020-10-09 22:43:53 +03:00
alexey-milovidov
165402209a
Merge pull request #15779 from ClickHouse/fix_race_openssl 
Fix fake race openssl
 2020-10-09 22:37:11 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries 
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
 2020-10-09 22:28:14 +03:00
Nikolai Kochetov
ef3640c3f7
Merge pull request #15451 from amosbird/scopewith 
Global WITH and WITH propagation.
 2020-10-09 22:16:45 +03:00
alesapin
35165c8ea4
Merge pull request #15756 from CurtizJ/fix-prewhere-with-virtuals 
Fix prewhere with virtual columns
 2020-10-09 18:07:41 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00
alesapin
7f3b9b1993 Fetch helper image before run 2020-10-09 17:42:03 +03:00
alesapin
3ac7b5aba8 Fetch helper image before run 2020-10-09 17:39:32 +03:00
alesapin
bdab187c45 Fetch helper image before run 2020-10-09 17:38:31 +03:00
Nikolai Kochetov
d8f805c706
Update 01515_with_global_and_with_propagation.sql 2020-10-09 15:38:08 +03:00
alesapin
b82038b65b Add missed file 2020-10-09 14:20:54 +03:00
alesapin
f12382ad93 Fix race in openssl 2020-10-09 12:08:49 +03:00
alesapin
1096f5215c Merge branch 'alexelex-master' of github.com:alexelex/ClickHouse into alexelextry3 2020-10-09 10:20:46 +03:00
alesapin
fbd7141fed Fix flaky tests 2020-10-09 10:19:17 +03:00
alesapin
66b7748b63
Merge pull request #15763 from ClickHouse/fix_race_condition_in_mysql_pool 
Fix race condition in MySQL pool
 2020-10-09 09:43:25 +03:00
Alexander Tokmakov
a6178cc876 try fix select count() for MaterializeMySQL 2020-10-08 23:39:24 +03:00
tavplubix
7b5f2b2bb0
Merge pull request #15701 from ClickHouse/better_clone_replica 
Improvements in lost replica recovery
 2020-10-08 23:19:23 +03:00
alesapin
de722cd57c Fix race condition in MySQL pool 2020-10-08 18:50:09 +03:00
Anton Popov
156a0f68bb
Merge pull request #15741 from CurtizJ/add-check-with-wide-parts 
Run check with wide parts and release build
 2020-10-08 18:20:44 +03:00
Alexandra Latysheva
22d2251351 remove old quorum_with_merge test (rc) 2020-10-08 14:47:05 +00:00
alesapin
c8bb623733 Add test for merged part 2020-10-08 17:35:20 +03:00
tavplubix
bf36ffde33
Update 01194_http_query_id.sh 2020-10-08 16:48:23 +03:00
alesapin
c6d8b94ad6 Add some tests 2020-10-08 16:29:13 +03:00
alexey-milovidov
8ae2bc06a1
Merge pull request #15378 from amosbird/realfix 
Fix multiple column transformers.
 2020-10-08 16:26:48 +03:00
Anton Popov
4bc40421e2
Merge pull request #15731 from CurtizJ/fix-tranform-null-in 
Fix assertion with setting transform_null_in
 2020-10-08 16:12:56 +03:00
Anton Popov
1a6d2bc538 fix prewhere with virtuals columns 2020-10-08 15:59:47 +03:00
Anton Popov
8b4566ba75
Update skip_list.json 2020-10-08 14:37:39 +03:00
alesapin
c569c7e21b
Merge pull request #15755 from ClickHouse/disable_cassandra_tests_with_tsan 
Disable cassandra tests with thread sanitizer
 2020-10-08 14:33:51 +03:00
alesapin
f953c1be87 Disable cassandra tests with thread sanitizer 2020-10-08 13:48:53 +03:00
alexey-milovidov
9b9a5d9dc8
Merge pull request #15643 from azat/remove-obsolete-settings 
Remove obsolete settings
 2020-10-08 13:30:36 +03:00
alexey-milovidov
ca9a09cb2a
Merge pull request #15745 from azat/01514_distributed_cancel_query_on_error-flacky 
Fix 01514_distributed_cancel_query_on_error flackiness
 2020-10-08 12:58:00 +03:00
Amos Bird
c9ab87ed17
Fix explain syntax 2020-10-08 17:06:04 +08:00
Amos Bird
ac102540d0
Global WITH and WITH propagation. 2020-10-08 15:03:34 +08:00
alesapin
3f5dc37095
Merge pull request #15681 from ClickHouse/improvement_in_test 
Add stderr log to test_grant_and_revoke
 2020-10-08 09:51:54 +03:00
alesapin
4fbe925490
Merge pull request #15686 from ClickHouse/fix_race_mariadb 
Fix race in mariadb
 2020-10-08 09:42:41 +03:00
Azat Khuzhin
983303243b Fix 01514_distributed_cancel_query_on_error flackiness 2020-10-08 01:58:31 +03:00
alexey-milovidov
e465ce3d49
Merge pull request #15642 from azat/force_data_skipping_indices 
Implement force_data_skipping_indices setting
 2020-10-07 23:14:51 +03:00
Anton Popov
e0bc669423 run check with wide parts 2020-10-07 21:53:34 +03:00
alesapin
d093d4c535
Merge pull request #15675 from ClickHouse/fix_races_in_hdfs 
Fix races in libhdfs
 2020-10-07 20:39:40 +03:00
Nikolai Kochetov
54e77e906e
Merge pull request #15717 from ClickHouse/fix-array-join-optimisation-for-mv 
Fix array join optimisation for MV
 2020-10-07 20:19:35 +03:00
Anton Popov
eb7f139cb1
Rename 01507_transform_null_in.refernce to 01507_transform_null_in.reference 2020-10-07 19:27:04 +03:00
Anton Popov
cc451e41f5 fix assertion with transform_null_in 2020-10-07 18:36:34 +03:00
Latysheva Alexandra
a0de2bd09c
Merge pull request #13 from alexelex/quorum_inserts_2 
Functional tests for parallel quorum inserts
 2020-10-07 21:26:40 +06:00
Alexandra Latysheva
dd20dadd20 functional tests fixes 2020-10-07 15:24:03 +00:00
Alexandra Latysheva
1de7dbafd9 added 3 functional tests for parallel quorum inserts 2020-10-07 14:55:08 +00:00
Artem Zuikov
403a5320f5
enable bigint float division (#15691) 2020-10-07 14:32:57 +03:00
tavplubix
041015545c
Merge pull request #15537 from ClickHouse/mutation_hangs_after_replace_partition 
Fix mutation may hang after REPLACE/DROP PARTITION
 2020-10-07 14:25:29 +03:00
Nikolai Kochetov
cbf43a870d Added test. 2020-10-07 13:43:06 +03:00
alexey-milovidov
e00961f882
Merge pull request #15657 from Jokser/disk-s3-write-error-handling 
Proper error handling during insert into MergeTree with S3
 2020-10-07 11:17:32 +03:00
Alexander Tokmakov
ea16370024 improvements in lost replica recovery 2020-10-07 02:29:33 +03:00
Azat Khuzhin
75e612fc16 Use full featured parser for force_data_skipping_indices 2020-10-07 01:44:14 +03:00
Azat Khuzhin
ef6d12967f Implement force_data_skipping_indices setting 2020-10-07 01:42:31 +03:00
Azat Khuzhin
7298cf3ecc Remove obsolete settings from tests 2020-10-07 00:56:22 +03:00
alesapin
ade916570b Add log config 2020-10-06 19:01:13 +03:00
tavplubix
767a525031
trigger CI 2020-10-06 17:24:34 +03:00
alesapin
a453e8dbe1 Add stderr log to test_grant_and_revoke 2020-10-06 17:07:00 +03:00
alesapin
db03a894e5 Change test to run flaky check 2020-10-06 16:29:50 +03:00
Azat Khuzhin
9594e463b4
Cancel other processors on query exception (#15578) 
* Add a test for canceling distributed queries on error

* Cancel other processors on exception in PipelineExecutor

Fixes: 01514_distributed_cancel_query_on_error
 2020-10-06 14:24:55 +03:00
Nikolai Kochetov
563ad62e1c Update test. 2020-10-06 13:44:05 +03:00
Nikolai Kochetov
765db4196f Add test. 2020-10-06 13:35:34 +03:00
Pavel Kovalenko
69b4bc6f33 Proper error handling during insert into MergeTree with S3. 2020-10-06 12:38:00 +03:00
Artem Zuikov
bad8171f24
Fix distributed IN without database on initiator (#15538) 2020-10-06 11:18:25 +03:00
alesapin
ced9812054
Merge pull request #15622 from qoega/switch-special-to-clang-11 
Check binary, darwin, aarch64, freebsd builds with clang-11
 2020-10-06 10:36:55 +03:00
Alexander Tokmakov
418766e92b fix another bug in mutations 2020-10-05 22:16:28 +03:00
Alexander Tokmakov
30a18f7567 make it better 2020-10-05 16:52:03 +03:00
Anton Popov
a49591b250
Merge pull request #15543 from azat/optimize_aggregation_in_order-fix-memory-usage 
[RFC] Significantly reduce memory usage in AggregatingInOrderTransform
 2020-10-05 16:34:12 +03:00
Yatsishin Ilya
4c91bc7166 Check binary, darwin, aarch64, freebsd builds with clang-11 2020-10-05 15:27:19 +03:00
alexey-milovidov
2fcf2e0fbe
Merge pull request #15443 from ucasFL/pretty_row_numbers 
Add setting `output_format_pretty_row_numbers`
 2020-10-05 11:49:55 +03:00
alexey-milovidov
4d427e822f
Merge pull request #15590 from azat/check-MADV_DONTNEED-for-jemalloc 
Check MADV_DONTNEED (for jemalloc), maybe broken under qemu
 2020-10-05 08:01:29 +03:00
Azat Khuzhin
d4e7c90306 Update expectations for 01103_check_cpu_instructions_at_startup 2020-10-04 11:20:29 +03:00
alexey-milovidov
53ce5e3892
Merge pull request #15551 from azat/for-user-limits-over-distributed 
Pass through *_for_user settings via Distributed with cluster-secure
 2020-10-04 04:18:20 +03:00
filipe
146f973437 add maximum_unit arg to formatReadableTimeDelta function 2020-10-03 19:38:51 -03:00
alexey-milovidov
6f3aab8f09
Merge pull request #15319 from bharatnc/ncb/fix-14509 
Fix bug in queries like SELECT toStartOfDay(today())
 2020-10-03 17:02:57 +03:00
alexey-milovidov
f7b390465b
Merge branch 'master' into realfix 2020-10-03 16:54:23 +03:00
Azat Khuzhin
84583faa43 Fix test_distributed_inter_server_secret under ASAN 
And also cover both cases:
- settings from DDL
- settings from TCP protocol
 2020-10-03 11:16:31 +03:00
alexey-milovidov
9551562889
Merge pull request #15442 from ClickHouse/add_alter_version 
Add ability to alter version column in VersionedCollapsingMergeTree.
 2020-10-03 05:40:15 +03:00
alexey-milovidov
75fb73956e
Merge pull request #15238 from ianton-ru/multi_delete_in_s3 
Use S3 multi object delete
 2020-10-03 03:48:06 +03:00
alexey-milovidov
cb708212a8
Merge pull request #15536 from ClickHouse/fix_ilike 
Separate cache for ilike after like
 2020-10-03 02:07:40 +03:00
Azat Khuzhin
f25c1742b8 Pass through *_for_user settings via Distributed with cluster-secure 
In cluster-secure case the user on shards (remote) is equal to the user
on the initiator, so those settings can be safely applied.
 2020-10-03 02:04:47 +03:00
Azat Khuzhin
d9ac79c094 Regression for memory usage for optimize_aggregation_in_order 2020-10-03 00:56:58 +03:00