Commit Graph

74771 Commits

Author SHA1 Message Date
feng lv
9378b93e41 fix 2021-10-17 14:49:27 +00:00
feng lv
8b7721ae6f Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into filelog-engine 2021-10-16 05:14:11 +00:00
Anton Popov
d2ba3bcaa4
Merge pull request #28363 from amosbird/fastload2
Speed up part loading for JBOD
2021-10-16 02:37:32 +03:00
Maksim Kita
d3cb99701d
Merge pull request #30228 from kitaisreal/functions-json-updated
FunctionsJSON updated
2021-10-16 02:06:34 +03:00
Maksim Kita
99dd492ff2
Merge pull request #30241 from kitaisreal/complex-key-hashed-dictionary-read-fix-keys-copying
ComplexKeyHashedDictionary fix keys copy
2021-10-16 02:03:37 +03:00
alexey-milovidov
9ffbb48486
Merge pull request #29998 from FArthur-cmd/Check
Update BoringSSL
2021-10-16 00:46:23 +03:00
Maksim Kita
a35d7096d8 Added concept HasIndexOperator 2021-10-15 23:26:09 +03:00
Maksim Kita
6f682d54b2 Fixed test 2021-10-15 23:21:18 +03:00
alexey-milovidov
50b54b37ca
Merge pull request #30072 from ClickHouse/client-profile-msg
Fix hardware utilization info printing in client
2021-10-15 23:05:43 +03:00
alexey-milovidov
8359a82a0d
Merge pull request #30149 from azat/disable-fsync_metadata-on-ci
Disable fsync_metadata on CI
2021-10-15 23:01:00 +03:00
Maksim Kita
429c7a57be
Merge pull request #30238 from kitaisreal/flat-hashed-dictionary-fix-bytes-allocated-for-nullable-attributes
FlatDictionary, HashedDictionary fix bytes_allocated calculation for nullable attributes
2021-10-15 22:59:06 +03:00
Maksim Kita
87b5710173
Merge pull request #30239 from kitaisreal/polygon-dictionary-fix-bytes-allocated
PolygonDictionary fix bytes_allocated
2021-10-15 22:52:27 +03:00
alexey-milovidov
f31bf32687
Update CHANGELOG.md 2021-10-15 22:37:25 +03:00
Ivan Blinkov
574970a852
Update clickhouse-v21.10-released.md 2021-10-15 18:37:38 +03:00
Maksim Kita
8dde0a5dfb ComplexKeyHashedDictionary fix keys copy 2021-10-15 18:35:20 +03:00
Maksim Kita
f3c568fbe6 PolygonDictionary fix bytes_allocated 2021-10-15 18:33:10 +03:00
Maksim Kita
09b8d697bd Flat Hashed dictionary fix bytes_allocated for nullable attributes 2021-10-15 18:26:56 +03:00
Ivan Blinkov
f0452b34d5
Update clickhouse-v21.10-released.md 2021-10-15 18:21:02 +03:00
Ivan Blinkov
a374d8a2a8
Merge pull request #30186 from flickerbox/crb-blog-post-v21-10
Add blog post for v21.10 release
2021-10-15 18:19:25 +03:00
Artur Filatenkov
f69daace7b attemp to fix build 2021-10-15 16:01:28 +03:00
Maksim Kita
a744097fb6 Fixed build 2021-10-15 15:34:13 +03:00
Nikita Mikhaylov
d1138a8a25
Merge pull request #29691 from azat/fix-merge-mutate-memory-tracking
Fix memory tracking for merges and mutations
2021-10-15 13:53:52 +03:00
Maksim Kita
97fa53d6b2
Merge pull request #27961 from amosbird/indexcache
Dedicated Mark/Uncompressed cache for skip indices
2021-10-15 13:31:44 +03:00
Maksim Kita
65aec857ec FunctionsJSON updated 2021-10-15 13:12:59 +03:00
Maksim Kita
7beaeb8b13
Merge branch 'master' into indexcache 2021-10-15 12:59:09 +03:00
Ivan Blinkov
20798ac9f1
Merge pull request #30221 from Tentoshka/patch-1
Translation external-dicts-dict-sources.md
2021-10-15 12:57:08 +03:00
Maksim Kita
27fdeef4b6
Merge pull request #29650 from kitaisreal/add-default-database-visitor-support-dict-get
AddDefaultDatabaseVisitor support dictGet
2021-10-15 12:28:58 +03:00
Maksim Kita
8d9f593a61
Merge pull request #30217 from azat/fix-clang-tidy-json
Fix clang-tidy warnings in FunctionsJSON code
2021-10-15 12:27:24 +03:00
Nikolay Degterinsky
6b9a1ab60b
Merge pull request #30222 from PaVeL-Ekt/patch-2
Fixed a typo in the string-functions.md
2021-10-15 12:10:24 +03:00
Pavel
49e9ea40ac
Update string-functions.md 2021-10-15 14:02:57 +05:00
Tentoshka
0d635cf34e
Translation external-dicts-dict-sources.md
Translation of untranslated texts
2021-10-15 15:55:03 +07:00
Nikolai Kochetov
769be69f15
Merge pull request #30029 from karnevil13/karnevil-DOCSUP-14788
DOCSUP-14788: Edit and translate to Russian
2021-10-15 11:38:43 +03:00
Kseniia Sumarokova
0e228a2369
Merge pull request #30189 from azat/fix-INSERT-SELECT-MATERIALIZED
Fix INSERT SELECT incorrectly fills MATERIALIZED column based of Nullable column
2021-10-15 10:48:23 +03:00
Azat Khuzhin
07adc847db Fix clang-tidy warnings in FunctionsJSON code 2021-10-15 10:11:03 +03:00
Maksim Kita
8db2c844d3 Fixed test 2021-10-15 02:07:52 +03:00
Azat Khuzhin
2a7a1d8df5 Avoid losing any allocations context from merges/mutations 2021-10-15 01:43:28 +03:00
Azat Khuzhin
8a209a78d7 Set query_id for mutations/merges
This will allow to distinguish allocations in trace_log.
2021-10-15 01:43:28 +03:00
Azat Khuzhin
3477ab52a7 Add StorageID::getShortName() 2021-10-15 01:43:28 +03:00
Azat Khuzhin
8cc45bea7b Avoid accounting memory from another mutation/merge
Before this path it was possible that one merge/mutation may account
memory from another, due to ThreadStatus::untracked_memory.

And this cause flakiness of 01200_mutations_memory_consumption.
2021-10-15 01:43:28 +03:00
Azat Khuzhin
fd38cbb0df Fix memory tracking for merges and mutations (by destroying earlier)
It fixes only some tiny allocations, and so it should not affect any
huge mutations/merges.

And plus, this should not be a real fix, since peak_memory_usage is
obtained before even destrying this objects, and destroing objects will
unlikely update peak memory usage (although it is possible).

v0: do this in dtors
v2: do this earlier
2021-10-15 01:43:27 +03:00
Azat Khuzhin
e4b39ca99c Remove unused Block member from MutateTask
v0: Fix excessive memory usage in MutateTask
    This is relevant only for 01200_mutations_memory_consumption test, since
    this is just a block.
v2: just remove unused Block member, since other part had been fixed in #29768
2021-10-15 01:43:27 +03:00
Azat Khuzhin
ae980fcd62 Move 01200_mutations_memory_consumption out from bugs 2021-10-15 01:43:27 +03:00
Azat Khuzhin
5d5f94f456 Mark 01200_mutations_memory_consumption as long and allow run in fasttest 2021-10-15 01:43:27 +03:00
Azat Khuzhin
a063097fdf Fix INSERT SELECT incorrectly fills MATERIALIZED column based of Nullable column
Required columns of the default expression should not be converted to NULL,
since this map value to default and MATERIALIZED values will not work.

Consider the following structure:
- A Nullable(Int64)
- X Int64 materialized coalesce(A, -1)

With recursive_null_as_default=true you will get:

    _CAST(coalesce(A, -1), 'Int64') AS X, NULL AS A

And this will ignore default expression.

Fixes: #23524 (Cc: @kssenii)
Fixes: #29729 (Cc: @tavplubix)
Backport: 21.7+
2021-10-15 01:36:09 +03:00
alexey-milovidov
bc1662b9fe
Merge pull request #29946 from azat/log-fix-data-race
Fix data-race between LogSink::writeMarks() and LogSource in StorageLog
2021-10-15 01:30:58 +03:00
alexey-milovidov
8d694cbcdc
Merge pull request #29959 from azat/log-data-race-file-checker-fix
Fix possible data-race between FileChecker and StorageLog/StorageStripeLog
2021-10-15 01:30:23 +03:00
alexey-milovidov
9a57fbc9e8
Merge pull request #30150 from azat/test_MemoryTracking-flap
Make test_MemoryTracking::test_http not flaky
2021-10-15 01:28:59 +03:00
karnevil13
8ec43b7c70 fixed type-conversion-functions en-ru 2021-10-15 00:56:21 +03:00
Azat Khuzhin
bb8105951f Disable fsync_metadata on CI
Sometimes we see that pretty simple queries like CREATE DATABASE can
take > 30 seconds, let's try to disable fsync.

CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(address).html#fail1
CI: https://clickhouse-test-reports.s3.yandex.net/30065/e5bc573250d3d6938937739b05d6f8cf618722db/functional_stateless_tests_(release).html#fail1
2021-10-15 00:53:34 +03:00
Maksim Kita
5b5ba5fbc8
Merge pull request #30179 from kitaisreal/clickhouse-local-support-sql-user-defined-functions
Support SQL user defined functions for clickhouse-local
2021-10-14 23:14:18 +03:00