Commit Graph

49789 Commits

Author SHA1 Message Date
alexey-milovidov
165402209a
Merge pull request #15779 from ClickHouse/fix_race_openssl
Fix fake race openssl
2020-10-09 22:37:11 +03:00
Alexey Milovidov
bd805300bb Whitespace 2020-10-09 22:33:23 +03:00
Alexey Milovidov
e0d6918d28 Fix ugliness in docs 2020-10-09 22:29:42 +03:00
Azat Khuzhin
064f901ea8 Add ability to preallocate hashtables for hashed/sparsehashed dictionaries
preallocation can be used only when we know number of rows, and for this
we need:
- source clickhouse
- no filtering (i.e. lack of <where>), since filtering can filter
  too much rows and eventually it may allocate memory that will
  never be used.

For sparse_hash the difference is quite significant, preallocated
sparse_hash hashtable allocates ~33% faster (7.5 seconds vs 5 seconds
for insert, and the difference is more significant for higher number of
elements):

    $ ninja bench-sparse_hash-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...ch/hashtable-bench/.cmake/bench-sparse_hash
    sparse_hash/insert: 7.574 <!--
    sparse_hash/find  : 2.14426
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   9710.51 msec (user+sys)

    $ time ninja bench-sparse_hash-preallocate-run
    [1/1] cd /src/ch/hashtable-bench/.cmake && ...-bench/.cmake/bench-sparse_hash-preallocate
    sparse_hash/insert: 5.0522 <!--
    sparse_hash/find  : 2.14024
    sparse_hash/maxrss: 174MiB
    sparse_hash/time:   7192.06 msec (user+sys)

P.S. the difference for sparse_hashed dictionary with 4e9 elements
(uint64, uint16) is ~18% (4975.905 vs 4103.569 sec)

v2: do not reallocate the dictionary from the progress callback
    Since this will access hashtable in parallel.
v3: drop PREALLOCATE() and do this only for source=clickhouse and empty
    <where>
2020-10-09 22:28:14 +03:00
Nikolai Kochetov
ef3640c3f7
Merge pull request #15451 from amosbird/scopewith
Global WITH and WITH propagation.
2020-10-09 22:16:45 +03:00
alexey-milovidov
2ace9cc697
Merge pull request #15635 from yulu86/zh-optimize
Optimize Chinese tutorial to make it more human readable
2020-10-09 22:08:42 +03:00
Azat Khuzhin
f4f79aa84a Add HashTable::reserve() (for preallocated hashed/sparse_hashed dictionaries) 2020-10-09 21:53:57 +03:00
nikitamikhaylov
b45a4a2cd1 better 2020-10-09 20:44:54 +03:00
nikitamikhaylov
d0b610c6b2 better backticks 2020-10-09 19:58:45 +03:00
filipe
09b5e1dbc3 fix FunctionsFormatting error for ARM 2020-10-09 13:46:59 -03:00
Nikolai Kochetov
3898a8ac5f Try fix tests. 2020-10-09 19:05:11 +03:00
feng lv
8a1a41f77b add tid function 2020-10-09 23:49:14 +08:00
alesapin
35165c8ea4
Merge pull request #15756 from CurtizJ/fix-prewhere-with-virtuals
Fix prewhere with virtual columns
2020-10-09 18:07:41 +03:00
Mikhail Filimonov
5fb549ca24
fix flap in no_holes_when_write_suffix_failed 2020-10-09 17:06:36 +02:00
alesapin
7f3b9b1993 Fetch helper image before run 2020-10-09 17:42:03 +03:00
alesapin
824d0b2b57 Merge branch 'alexelex-master' of github.com:alexelex/ClickHouse into alexelextry3 2020-10-09 17:41:19 +03:00
alesapin
3ac7b5aba8 Fetch helper image before run 2020-10-09 17:39:32 +03:00
alesapin
bdab187c45 Fetch helper image before run 2020-10-09 17:38:31 +03:00
robot-clickhouse
88f8af51f0 Update version_date.tsv after release 20.7.4.11 2020-10-09 16:42:47 +03:00
nikitamikhaylov
88a5302759 Merge branch 'master' of github.com:ClickHouse/ClickHouse into copier-backquotes 2020-10-09 16:26:31 +03:00
robot-clickhouse
7a1aa597e9 Update version_date.tsv after release 20.8.4.11 2020-10-09 16:17:41 +03:00
Nikolai Kochetov
d8f805c706
Update 01515_with_global_and_with_propagation.sql 2020-10-09 15:38:08 +03:00
Alexandra Latysheva
f6f33168aa fix compilation error 2020-10-09 12:11:21 +00:00
Nikolai Kochetov
9328cea4f1 Supress pvs 2020-10-09 14:35:58 +03:00
robot-clickhouse
9594213f99 Update version_date.tsv after release 20.9.3.45 2020-10-09 14:33:05 +03:00
alesapin
b82038b65b Add missed file 2020-10-09 14:20:54 +03:00
Alexandra Latysheva
c4584b5638 Merge branch 'alexelex-master' of github.com:alexelex/ClickHouse into alexelex-master 2020-10-09 11:20:36 +00:00
Alexandra Latysheva
0594a77b57 fix thread restart for parallel quorum inserts 2020-10-09 11:20:20 +00:00
alesapin
efaa7ad1d2 Update openssl 2020-10-09 12:31:01 +03:00
alesapin
f12382ad93 Fix race in openssl 2020-10-09 12:08:49 +03:00
Nikolai Kochetov
a7fb2e38a5 Use ColumnWithTypeAndName as function argument instead of Block. 2020-10-09 10:41:28 +03:00
alesapin
1096f5215c Merge branch 'alexelex-master' of github.com:alexelex/ClickHouse into alexelextry3 2020-10-09 10:20:46 +03:00
alesapin
fbd7141fed Fix flaky tests 2020-10-09 10:19:17 +03:00
alesapin
66b7748b63
Merge pull request #15763 from ClickHouse/fix_race_condition_in_mysql_pool
Fix race condition in MySQL pool
2020-10-09 09:43:25 +03:00
robot-clickhouse
af0b96466a Update version_date.tsv after release 20.8.4.11 2020-10-09 02:39:25 +03:00
filipe
3861a03927 fix pvs check 2020-10-08 20:14:54 -03:00
robot-clickhouse
9aff247afe Update version_date.tsv after release 20.7.4.11 2020-10-09 00:04:34 +03:00
robot-clickhouse
17b953ae6d Update version_date.tsv after release 20.3.20.6 2020-10-09 00:00:56 +03:00
Denis Glazachev
e348ec17b2 Refactor role handling 2020-10-09 00:57:23 +04:00
Alexander Tokmakov
a6178cc876 try fix select count() for MaterializeMySQL 2020-10-08 23:39:24 +03:00
tavplubix
7b5f2b2bb0
Merge pull request #15701 from ClickHouse/better_clone_replica
Improvements in lost replica recovery
2020-10-08 23:19:23 +03:00
Vitaliy Zakaznikov
1103ce0d78 Updating exit codes and messages in failing tests. 2020-10-08 15:36:03 -04:00
alexey-milovidov
c693c653a5
Merge pull request #15639 from GrigoryPervakov/tmp-s3-merge
Use tmp disk for vertical merge files
2020-10-08 20:58:07 +03:00
alexey-milovidov
9649eae1e8
Merge pull request #15747 from Artemeey/patch-2
Update index.md
2020-10-08 20:57:49 +03:00
alesapin
16fa71a4c9 Missed comment 2020-10-08 20:46:59 +03:00
alesapin
70f2a3328d Better atomic operations on refcount 2020-10-08 20:45:18 +03:00
robot-clickhouse
20b3de3d76 Update version_date.tsv after release 20.9.3.45 2020-10-08 20:38:31 +03:00
alesapin
de722cd57c Fix race condition in MySQL pool 2020-10-08 18:50:09 +03:00
Alexandra Latysheva
6877f4aa9c for parallel and non-parallel quorum insertion at the same time 2020-10-08 15:35:41 +00:00
Anton Popov
156a0f68bb
Merge pull request #15741 from CurtizJ/add-check-with-wide-parts
Run check with wide parts and release build
2020-10-08 18:20:44 +03:00