Commit Graph

2290 Commits

Author SHA1 Message Date
Alexey Milovidov
2b90472869 Remove executable bit from non-executable files 2020-10-11 18:30:20 +03:00
Alexey Milovidov
8a252ebef8 Merge remote-tracking branch 'origin/master' into filipecaixeta-master 2020-10-11 17:29:50 +03:00
alexey-milovidov
2e3046991b
Merge pull request #15757 from filimonov/fix-kafka-no-holes-flap
fix flap in no_holes_when_write_suffix_failed
2020-10-11 14:38:45 +03:00
alexey-milovidov
a8708338f2
Merge pull request #15809 from amosbird/c1
add print_query_id support for native client
2020-10-11 13:29:35 +03:00
Amos Bird
ff665c362f
Add print query id support to client 2020-10-11 10:09:08 +08:00
filimonov
e167e4ec00
Update 01360_materialized_view_with_join_on_query_log.sql
see https://github.com/ClickHouse/ClickHouse/pull/14723#issuecomment-691009172
2020-10-10 23:41:33 +02:00
alexey-milovidov
c2069ad3ee
Merge pull request #15035 from azat/jemalloc-percpu-arena-fix
Update jemalloc to fix percpu_arena with affinity mask
2020-10-10 23:19:56 +03:00
Alexey Milovidov
9ca9855f96 Merge branch 'master' into filipecaixeta-master 2020-10-10 20:52:34 +03:00
alexey-milovidov
1f6c2c8efc
Merge pull request #15803 from ucasFL/tid-function
Add `tid` and `logTrace` function
2020-10-10 19:37:04 +03:00
feng lv
9438f2f4d2 fix
fix

fix
2020-10-10 19:21:11 +08:00
feng lv
ec87254abe add test 2020-10-10 10:48:15 +08:00
alexey-milovidov
0fd007ad9e
Merge pull request #15601 from alexelex/alexelex-master
Improvement of Quorum Inserts in ClickHouse
2020-10-09 22:43:53 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
2020-10-09 22:28:14 +03:00
Nikolai Kochetov
ef3640c3f7
Merge pull request #15451 from amosbird/scopewith
Global WITH and WITH propagation.
2020-10-09 22:16:45 +03:00
alesapin
35165c8ea4
Merge pull request #15756 from CurtizJ/fix-prewhere-with-virtuals
Fix prewhere with virtual columns
2020-10-09 18:07:41 +03:00
Nikolai Kochetov
d8f805c706
Update 01515_with_global_and_with_propagation.sql 2020-10-09 15:38:08 +03:00
Anton Popov
156a0f68bb
Merge pull request #15741 from CurtizJ/add-check-with-wide-parts
Run check with wide parts and release build
2020-10-08 18:20:44 +03:00
Alexandra Latysheva
22d2251351 remove old quorum_with_merge test (rc) 2020-10-08 14:47:05 +00:00
alesapin
c8bb623733 Add test for merged part 2020-10-08 17:35:20 +03:00
tavplubix
bf36ffde33
Update 01194_http_query_id.sh 2020-10-08 16:48:23 +03:00
alesapin
c6d8b94ad6 Add some tests 2020-10-08 16:29:13 +03:00
alexey-milovidov
8ae2bc06a1
Merge pull request #15378 from amosbird/realfix
Fix multiple column transformers.
2020-10-08 16:26:48 +03:00
Anton Popov
4bc40421e2
Merge pull request #15731 from CurtizJ/fix-tranform-null-in
Fix assertion with setting transform_null_in
2020-10-08 16:12:56 +03:00
Anton Popov
1a6d2bc538 fix prewhere with virtuals columns 2020-10-08 15:59:47 +03:00
Anton Popov
8b4566ba75
Update skip_list.json 2020-10-08 14:37:39 +03:00
alexey-milovidov
9b9a5d9dc8
Merge pull request #15643 from azat/remove-obsolete-settings
Remove obsolete settings
2020-10-08 13:30:36 +03:00
Amos Bird
c9ab87ed17
Fix explain syntax 2020-10-08 17:06:04 +08:00
Amos Bird
ac102540d0
Global WITH and WITH propagation. 2020-10-08 15:03:34 +08:00
Azat Khuzhin
983303243b Fix 01514_distributed_cancel_query_on_error flackiness 2020-10-08 01:58:31 +03:00
alexey-milovidov
e465ce3d49
Merge pull request #15642 from azat/force_data_skipping_indices
Implement force_data_skipping_indices setting
2020-10-07 23:14:51 +03:00
Anton Popov
e0bc669423 run check with wide parts 2020-10-07 21:53:34 +03:00
Nikolai Kochetov
54e77e906e
Merge pull request #15717 from ClickHouse/fix-array-join-optimisation-for-mv
Fix array join optimisation for MV
2020-10-07 20:19:35 +03:00
Anton Popov
eb7f139cb1
Rename 01507_transform_null_in.refernce to 01507_transform_null_in.reference 2020-10-07 19:27:04 +03:00
Anton Popov
cc451e41f5 fix assertion with transform_null_in 2020-10-07 18:36:34 +03:00
Latysheva Alexandra
a0de2bd09c
Merge pull request #13 from alexelex/quorum_inserts_2
Functional tests for parallel quorum inserts
2020-10-07 21:26:40 +06:00
Alexandra Latysheva
dd20dadd20 functional tests fixes 2020-10-07 15:24:03 +00:00
Alexandra Latysheva
1de7dbafd9 added 3 functional tests for parallel quorum inserts 2020-10-07 14:55:08 +00:00
Artem Zuikov
403a5320f5
enable bigint float division (#15691) 2020-10-07 14:32:57 +03:00
tavplubix
041015545c
Merge pull request #15537 from ClickHouse/mutation_hangs_after_replace_partition
Fix mutation may hang after REPLACE/DROP PARTITION
2020-10-07 14:25:29 +03:00
Nikolai Kochetov
cbf43a870d Added test. 2020-10-07 13:43:06 +03:00
Azat Khuzhin
75e612fc16 Use full featured parser for force_data_skipping_indices 2020-10-07 01:44:14 +03:00
Azat Khuzhin
ef6d12967f Implement force_data_skipping_indices setting 2020-10-07 01:42:31 +03:00
Azat Khuzhin
7298cf3ecc Remove obsolete settings from tests 2020-10-07 00:56:22 +03:00
tavplubix
767a525031
trigger CI 2020-10-06 17:24:34 +03:00
Azat Khuzhin
9594e463b4
Cancel other processors on query exception (#15578)
* Add a test for canceling distributed queries on error

* Cancel other processors on exception in PipelineExecutor

Fixes: 01514_distributed_cancel_query_on_error
2020-10-06 14:24:55 +03:00
Nikolai Kochetov
563ad62e1c Update test. 2020-10-06 13:44:05 +03:00
Nikolai Kochetov
765db4196f Add test. 2020-10-06 13:35:34 +03:00
Artem Zuikov
bad8171f24
Fix distributed IN without database on initiator (#15538) 2020-10-06 11:18:25 +03:00
Alexander Tokmakov
418766e92b fix another bug in mutations 2020-10-05 22:16:28 +03:00
Alexander Tokmakov
30a18f7567 make it better 2020-10-05 16:52:03 +03:00
Anton Popov
a49591b250
Merge pull request #15543 from azat/optimize_aggregation_in_order-fix-memory-usage
[RFC] Significantly reduce memory usage in AggregatingInOrderTransform
2020-10-05 16:34:12 +03:00
alexey-milovidov
2fcf2e0fbe
Merge pull request #15443 from ucasFL/pretty_row_numbers
Add setting `output_format_pretty_row_numbers`
2020-10-05 11:49:55 +03:00
alexey-milovidov
4d427e822f
Merge pull request #15590 from azat/check-MADV_DONTNEED-for-jemalloc
Check MADV_DONTNEED (for jemalloc), maybe broken under qemu
2020-10-05 08:01:29 +03:00
Azat Khuzhin
d4e7c90306 Update expectations for 01103_check_cpu_instructions_at_startup 2020-10-04 11:20:29 +03:00
filipe
146f973437 add maximum_unit arg to formatReadableTimeDelta function 2020-10-03 19:38:51 -03:00
alexey-milovidov
6f3aab8f09
Merge pull request #15319 from bharatnc/ncb/fix-14509
Fix bug in queries like SELECT toStartOfDay(today())
2020-10-03 17:02:57 +03:00
alexey-milovidov
f7b390465b
Merge branch 'master' into realfix 2020-10-03 16:54:23 +03:00
alexey-milovidov
9551562889
Merge pull request #15442 from ClickHouse/add_alter_version
Add ability to alter version column in VersionedCollapsingMergeTree.
2020-10-03 05:40:15 +03:00
alexey-milovidov
cb708212a8
Merge pull request #15536 from ClickHouse/fix_ilike
Separate cache for ilike after like
2020-10-03 02:07:40 +03:00
Azat Khuzhin
d9ac79c094 Regression for memory usage for optimize_aggregation_in_order 2020-10-03 00:56:58 +03:00
Alexander Tokmakov
bd790f399f simplify test 2020-10-02 22:34:37 +03:00
alesapin
77c9f7af79
Merge pull request #15532 from ClickHouse/substitute_defaults_recursively
Fix defaults substitution for absent columns which depend on other defaults
2020-10-02 21:42:01 +03:00
Alexander Tokmakov
c3e9317d32 add test draft 2020-10-02 20:48:13 +03:00
Alexander Tokmakov
6b2da861dc Merge branch 'master' into write_structure_of_table_functions 2020-10-02 20:46:58 +03:00
Azat Khuzhin
9cb3c743bd
Convert to python3 (#15007) 2020-10-02 19:54:07 +03:00
feng lv
ac1f0b9947 add test 2020-10-02 23:34:14 +08:00
alesapin
7d75866722 Add tests 2020-10-02 17:29:20 +03:00
alesapin
7d41afa342 More defaults on defaults 2020-10-02 15:51:01 +03:00
alesapin
c0d1416bbd
Merge pull request #15516 from nvartolomei/nv/error-out-for-wrong-parameters-replicatedmergetree
Throw an error when a single parameter is passed to ReplicatedMergeTree instead of ignoring it
2020-10-02 10:18:28 +03:00
Nicolae Vartolomei
eb1d253355 Throw an error when a single parameter is passed to ReplicatedMergeTree instead of ignoring it 2020-10-01 17:59:50 +01:00
Alexander Kuzmenkov
bc66dc99d1 Merge remote-tracking branch 'origin/master' into HEAD 2020-10-01 12:28:30 +03:00
filipe
077ee81177 add an SQL function formatReadableTimeDelta to format time delta 2020-09-30 23:55:46 -03:00
Azat Khuzhin
5af69d2c17 Add a test for jemalloc percpu_arena 2020-10-01 01:58:57 +03:00
Artem Zuikov
0f6a6453fe
Remove multiple_joins_rewriter v1 (#15472) 2020-09-30 23:11:49 +03:00
Artem Zuikov
0ac18a382f
Fix JOIN with GROUP BY over StorageMerge (#15242) 2020-09-30 23:11:27 +03:00
alesapin
ac9f0ff4da More strict check for version column 2020-09-30 22:44:35 +03:00
Alexander Kuzmenkov
e45edd57f2 Add reinterpretAsUUID function 2020-09-30 20:19:32 +03:00
Nikolai Kochetov
45618c9d4c
Merge pull request #15437 from ClickHouse/azat-ThreadPool-UAF-fixes
Destroy resources captured by lambda after `ThreadFromGlobalPool::join()`
2020-09-30 16:50:30 +03:00
alexey-milovidov
0c07c2d3a3
Merge pull request #15089 from ClickHouse/codecs_for_nested_types
Codecs for nested types
2020-09-30 07:18:19 +03:00
alexey-milovidov
b6bccfc4f4
Merge pull request #14776 from Vxider/disable_set_and_join_persistency
Support memory only mode for StorageJoin and StorageSet.
2020-09-30 04:35:43 +03:00
alexey-milovidov
ac989f3a8f
Merge pull request #15285 from ucasFL/now-with-timezone
function `now` allow an argument with timezone
2020-09-30 04:32:36 +03:00
alexey-milovidov
3fd272f0f0
Update 01497_now_support_timezone.reference 2020-09-30 03:46:06 +03:00
alexey-milovidov
c7fe323373
Update 01497_now_support_timezone.sql 2020-09-30 03:45:57 +03:00
alexey-milovidov
6be274b338
Merge pull request #15312 from den-crane/tests/pr11767
more tests for #11767 (from #11407 #15294)
2020-09-30 01:46:10 +03:00
alexey-milovidov
9f944424cf
Merge pull request #15364 from ClickHouse/format-raw-blob
Add format RawBLOB
2020-09-30 01:14:40 +03:00
Artem Zuikov
4fd1db73a1
Faster 256-bit multiplication (#15418) 2020-09-29 20:52:34 +03:00
Nikolai Kochetov
33487c0e4a
Merge pull request #15422 from ClickHouse/query-plan-header-remove-columns
Remove column from header descriotion for EXPLAIN PLAN
2020-09-29 15:51:09 +03:00
alesapin
65a05a970d Better message on error 2020-09-29 15:07:01 +03:00
Nikolai Kochetov
7270de2b0a Added test. 2020-09-29 11:12:43 +03:00
Azat Khuzhin
d553e56db7 Add a test for UAF in ThreadPool (triggered under ASAN) 2020-09-29 11:01:24 +03:00
alesapin
bd531bb045
Merge pull request #15396 from ClickHouse/yet_another_retry
Fix some flaky tests: test_mysql_federated and 00652_replicated_mutations_zookeeper
2020-09-29 09:51:41 +03:00
Alexander Kuzmenkov
51b9aaf4d8
Merge pull request #15363 from ClickHouse/format-regexp-raw
Add support for "Raw" column format for Regexp format
2020-09-28 20:03:32 +03:00
tavplubix
4578d89819
Merge pull request #15348 from ClickHouse/replicate_default_args
Continuation of #14791
2020-09-28 18:53:02 +03:00
tavplubix
421d3b0b86
Merge pull request #14760 from bharatnc/ncb/event_time_microsec_p2
add event_time_microseconds field for system.{trace,text,query,query_thread}_log tables
2020-09-28 18:34:21 +03:00
alesapin
a526a767df Fix some flaky tests 2020-09-28 14:17:07 +03:00
Nikita Mikhaylov
72e4b10c00
Merge pull request #14842 from hexiaoting/hxt_dev
Fix bug for LineAsString Format
2020-09-28 14:02:23 +03:00
Amos Bird
8eb8175258
Fix multiple column transformers. 2020-09-28 17:53:39 +08:00
Alexey Milovidov
79f510d63a Fix error in LowCardinality; add test 2020-09-28 03:22:50 +03:00
Alexey Milovidov
a7ddd8489a Added format RawBLOB 2020-09-28 03:11:19 +03:00
Alexey Milovidov
b800a7fdf1 Add support for "Raw" column format for Regexp format 2020-09-28 01:09:32 +03:00