alesapin
852608c937
Don't abort on Auth request
2021-05-15 18:01:00 +03:00
alesapin
83627de2b8
Merge branch 'master' into standalone_keeper
2021-05-15 17:15:06 +03:00
alexey-milovidov
a9a66f6572
Merge pull request #24139 from Algunenano/aiotest_fix_tmpfs
...
TestReadAfterAIO: Use the current path instead of /tmp for temporal files
2021-05-15 17:04:41 +03:00
Azat Khuzhin
1cdeafe473
Remove superfluous trailing whitespace in Markdown format
2021-05-15 16:08:17 +03:00
Azat Khuzhin
a44ddd2064
Update distributed_group_by_no_merge description
2021-05-15 15:03:13 +03:00
Kseniia Sumarokova
6bcc99e5e6
Whitespace
2021-05-15 10:56:46 +03:00
Kseniia Sumarokova
9e65f376cc
Fix PVS check
2021-05-15 10:05:31 +03:00
Kseniia Sumarokova
1d73cd6406
Fix PVS check
2021-05-15 09:05:27 +03:00
Raúl Marín
e358a0963c
Clearer code based on review
2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84
TestReadAfterAIO: Use the local path instead of /tmp for temporal files
...
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/ ), making the
test fail:
```
[ RUN ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[ FAILED ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```
Instead create the tmp folder in the local path and delete it at the end
2021-05-15 02:13:51 +02:00
Maksim Kita
e785029ead
Merge pull request #24116 from hexiaoting/dev_explain
...
Fix bug for explain pipeline
2021-05-15 01:41:27 +03:00
mergify[bot]
d31021ea4f
Merge branch 'master' into fix-kafka-with-parquet
2021-05-14 21:10:12 +00:00
Maksim Kita
0b4b5eb808
FunctionComparison remove constant result for non constant arguments optimization
2021-05-15 00:03:26 +03:00
Maksim Kita
18894005ac
Update ExpressionJIT.cpp
2021-05-15 00:03:26 +03:00
Maksim Kita
f42b25e65c
Update ExpressionJIT.cpp
2021-05-15 00:03:26 +03:00
Maksim Kita
26be39f419
CompileExpressions comparison function constant case fix
2021-05-15 00:03:26 +03:00
Kruglov Pavel
1a2e3e605a
Merge pull request #21770 from taylor12805/arrow_array
...
Arrow array
2021-05-14 23:44:48 +03:00
Alexander Tokmakov
df5f3fbc9d
review suggestions
2021-05-14 19:11:40 +03:00
feng lv
8c82e3f1b9
fix style
...
fix
2021-05-14 15:50:05 +00:00
Amos Bird
a113acc40c
Fix empty key
2021-05-14 22:54:14 +08:00
Amos Bird
8de016d33a
Fix empty key projection query analysis
2021-05-14 22:26:26 +08:00
Alexander Tokmakov
41776ba5d9
fix
2021-05-14 15:55:30 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level
...
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
6f16d92cfe
Update Settings.h
2021-05-14 15:50:30 +03:00
Nikolai Kochetov
bb11cde871
Merge pull request #24108 from ClickHouse/actions-dag-calc-header
...
Calculate header from ActionsDAG
2021-05-14 13:55:00 +03:00
Pavel Kruglov
484cac6193
Return include_indices, fix arrays and add more tests
2021-05-14 13:50:10 +03:00
Alexander Tokmakov
970ad94851
Merge branch 'master' into fix_intersecting_parts
2021-05-14 13:17:02 +03:00
alesapin
f8ddf511c5
Merge branch 'master' into standalone_keeper
2021-05-14 13:05:55 +03:00
Nikolai Kochetov
782f02b1dc
Review fixes.
2021-05-14 13:01:27 +03:00
Nikolai Kochetov
a1e9202b93
Review fixes.
2021-05-14 12:30:32 +03:00
Maksim Kita
7eee500ef9
Merge pull request #24068 from azat/preserve-dict-for-shutdown
...
Preserve dictionaries until storage shutdown
2021-05-14 11:48:40 +03:00
alesapin
d4c6a5a05e
Better logging
2021-05-14 11:38:53 +03:00
alesapin
67e4393769
If table was not active set readonly mode
2021-05-14 11:32:41 +03:00
Ilya Yatsishin
e345b8b868
Merge pull request #24077 from abel-cheng/feature/splitByRegexp
...
add function splitByRegexp
2021-05-14 10:43:08 +03:00
Ilya Yatsishin
19fb0d2033
Merge pull request #24091 from Enmk/now64_timezone_fix
...
Fixed now64(): added second optional argument for timezone.
2021-05-14 10:36:40 +03:00
Maksim Kita
b0bad25dd3
Merge pull request #24111 from kitaisreal/hash-table-performance
...
Added hash table benchmarks
2021-05-14 10:29:12 +03:00
kssenii
55c573f920
Fix
2021-05-14 07:11:32 +00:00
hexiaoting
396f60f292
Fix bug for explain pipeline
2021-05-14 14:43:51 +08:00
Pavel Kruglov
46a7cc5f1d
Remove include_indices
2021-05-14 00:52:29 +03:00
Maksim Kita
1f9c9eda45
Added hash table benchmarks
2021-05-13 23:40:47 +03:00
Azat Khuzhin
aeb2c5d88a
Preserve dictionaries until storage shutdown
...
v2: Context::loadEmbeddedDictionaries()
v3: Context::loadDictionaries()
2021-05-13 22:03:00 +03:00
Pavel Kruglov
bbe470a670
Remove fillArrowArray from .h file
2021-05-13 21:15:55 +03:00
Nikolai Kochetov
bc4ccdece6
Fix tests.
2021-05-13 21:07:47 +03:00
Vasily Nemkov
1330ef7567
Fixed converting const DateTime to DateTime64 in WHERE
2021-05-13 20:16:00 +03:00
Vasily Nemkov
22e304f88c
Fixed clang-tidy style check
2021-05-13 20:15:24 +03:00
Pavel Kruglov
25ceb1df65
Final fixes
2021-05-13 20:00:13 +03:00
alexey-milovidov
d340e33e2b
Merge pull request #23844 from excitoon-favorites/s3morecorrectclient
...
Better handling of HTTP errors in `PocoHTTPClient`
2021-05-13 19:21:09 +03:00
tavplubix
780b7cc8e1
Merge pull request #23863 from Algunenano/mutation_logs
...
Reduce the amount of logs that StorageMergeTree::selectPartsToMutate outputs in busy systems.
2021-05-13 19:02:23 +03:00
Alexander Tokmakov
eaffe6848b
fix
2021-05-13 17:24:07 +03:00
Alexander Tokmakov
2da12f0b59
fix intersection of drop range and merge
2021-05-13 17:04:36 +03:00
Vasily Nemkov
3119660406
Fixed now64(): added second optional argument for timezone.
2021-05-13 16:51:32 +03:00
Nikolai Kochetov
d78be51fb4
Calculate header for ActionsDAG
2021-05-13 16:38:18 +03:00
alesapin
3abc891107
Merge pull request #24037 from amosbird/dh
...
Run check_*_compiler_flag earlier
2021-05-13 15:32:23 +03:00
mergify[bot]
1b181606e8
Merge branch 'master' into arrow_array
2021-05-13 12:23:48 +00:00
Pavel Kruglov
ff6e4bf91a
Remove debug output
2021-05-13 15:21:39 +03:00
Alexander Tokmakov
e114c7eb8b
fix virtual parts in REPLACE_RANGE
2021-05-13 14:29:59 +03:00
Vladimir
454b77c654
Update SplitByRegexpImpl
2021-05-13 13:27:29 +03:00
Kseniia Sumarokova
135bed27f5
Merge pull request #23196 from Amesaru/progress_bar_for_LocalServer
...
Progress bar for local server
2021-05-13 13:13:53 +03:00
kssenii
7115045317
Tiny changes
2021-05-13 09:39:57 +00:00
Pavel Kruglov
ec214bb04c
Try fix tests again
2021-05-13 12:23:59 +03:00
Maksim Kita
f3ee14d24a
Merge pull request #24066 from azat/buffer-total-lock-contention
...
Do not acquire lock for total_bytes/total_rows for Buffer engine
2021-05-13 11:15:06 +03:00
alesapin
bfa23d7e02
Merge branch 'master' into standalone_keeper
2021-05-13 11:03:07 +03:00
alesapin
c484cb4f37
Merge pull request #24073 from ClickHouse/fix_snapshot_race
...
Fix concurrent snapshot read/write
2021-05-13 10:47:41 +03:00
kssenii
0cb0bd48f7
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes
2021-05-13 06:36:51 +00:00
Vladimir Chebotarev
a3f7992442
Fixed typo.
2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b
Better handling of HTTP errors in PocoHTTPClient.
2021-05-13 08:46:16 +03:00
Alexander Kuzmenkov
220f5b512e
try even smaller value
2021-05-13 06:15:44 +03:00
abel-wang
51c1d7c7ba
split into characters when split by '' & add docs
2021-05-13 11:15:38 +08:00
abel-wang
99b9fe6c33
add function splitByRegexp
2021-05-13 10:37:09 +08:00
feng lv
c6f8ab9826
fix
2021-05-13 02:05:53 +00:00
alexey-milovidov
020cececc4
Merge pull request #24051 from georgthegreat/thread-local-arc
...
Enable thread_local in Arcadia build
2021-05-13 01:34:22 +03:00
Maksim Kita
5e1e968ef8
Merge pull request #24064 from davenger/uuid_build_fix
...
Generate ya.make for missing UUID.cpp
2021-05-13 00:41:13 +03:00
Azat Khuzhin
074b57fe82
Do not acquire lock for total_bytes/total_rows for Buffer engine
...
When Buffer() is under preassure, acquiring per-layer lock may take
significant time. And so the following query may take significant amount of time:
SELECT total_bytes, total_rows FROM system.tables WHERE engine='Buffer'
2021-05-12 23:38:00 +03:00
Azat Khuzhin
26a1277609
Fix typo for IStorage::totalRows() comment
2021-05-12 23:38:00 +03:00
alesapin
f2a8b5b2c6
Fix concurrent snapshot read/write
2021-05-12 23:28:01 +03:00
Alexander Kuzmenkov
833f48751a
Merge pull request #24048 from ClickHouse/aku/insert-select-bytes
...
for trivial INSERT SELECT, adjust block size in bytes as well
2021-05-12 22:33:35 +03:00
Pavel Kruglov
86f061976e
Some fixes
2021-05-12 22:02:56 +03:00
Amesaru
a95028bb43
UpdateProgress fix
2021-05-12 21:25:16 +03:00
Alexander Gololobov
748d1b6e9c
Generate ya.make for missing UUID.cpp
2021-05-12 20:32:29 +03:00
Amesaru
e21899c854
Merge remote-tracking branch 'origin/progress_bar_for_LocalServer' into progress_bar_for_LocalServer
2021-05-12 19:26:42 +03:00
Amesaru
40cced96f4
UpdateProgress static
2021-05-12 19:25:12 +03:00
Nikolai Kochetov
690410009c
Restor is_temporary flag for fetched part.
2021-05-12 19:17:01 +03:00
Pavel Kruglov
8ed6ad7c55
Refactor, support all types in array, add nested arrays support, more tests
2021-05-12 19:06:08 +03:00
alesapin
9f5f29f0aa
Remove accident changes
2021-05-12 17:16:45 +03:00
alesapin
43ee9f0a3a
Check for directory owner
2021-05-12 17:05:44 +03:00
kssenii
047f8a4e3c
Correct merge
2021-05-12 13:10:06 +00:00
alesapin
41eadf9127
Something working
2021-05-12 16:04:34 +03:00
Alexander Kuzmenkov
f6cb9f95df
lower two-level aggregation threshold for uniq test to avoid jitter
2021-05-12 16:01:48 +03:00
kssenii
8eb9e72f66
Fix bug
2021-05-12 12:33:04 +00:00
Anton Popov
46ce4b7a88
Merge pull request #24016 from MaxWk/order-by-with-fill-datetime64
...
support for order by fill with DateTime64
2021-05-12 14:44:36 +03:00
Yuriy Chernyshov
5a2bd0b6ba
Enable thread_local in Arcadia build
2021-05-12 13:33:38 +03:00
Alexander Kuzmenkov
2536247754
Update src/Interpreters/InterpreterInsertQuery.cpp
2021-05-12 12:42:21 +03:00
Alexander Kuzmenkov
70d4ee3cde
for trivial INSERT SELECT, adjust block size in bytes as well
2021-05-12 12:40:39 +03:00
alesapin
ed3f89a7be
Merge pull request #23980 from kssenii/add-postgres-schema
...
Add missing table schema for postgres dictionary
2021-05-12 10:50:49 +03:00
alesapin
d5462df2f9
Merge pull request #24017 from ClickHouse/fix_bug_with_snapshots_read
...
Better error codes in Keeper when no leader alive
2021-05-12 10:15:58 +03:00
Maksim Kita
ffdc2b22a5
Merge pull request #24022 from amosbird/fixalias
...
Make `prefer_column_name_to_alias` setting more standard
2021-05-12 09:54:04 +03:00
Nikolai Kochetov
a1ba67e029
Merge pull request #20202 from amosbird/projection
...
Projections
2021-05-12 09:38:07 +03:00
Amos Bird
d22ab2028f
Run check_*_compiler_flag earlier
2021-05-12 12:14:25 +08:00
万康
aa43d3cff9
fix tests and code style
2021-05-12 11:44:45 +08:00
alexey-milovidov
41012b5ba4
Merge pull request #23793 from fuwhu/feature/fix-session-expired-when-selecting-system-tables
...
fix session expired while executing Tables
2021-05-12 01:18:36 +03:00
alexey-milovidov
d422e0199b
Merge pull request #24019 from Avogar/rename-uniq-theta
...
Rename uniqThetaSketch to uniqTheta
2021-05-12 01:17:18 +03:00
Maksim Kita
2b833f4bce
Merge pull request #24021 from kitaisreal/fix-arena-with-free-lists-test
...
Fix ArenaWithFreeLists test
2021-05-11 22:00:45 +03:00
Amos Bird
62153e7030
Fix
2021-05-12 02:30:16 +08:00
Maksim Kita
d33f4750e1
Fix ArenaWithFreeLists test
2021-05-11 21:22:50 +03:00
Vladimir
124766f3ac
Merge pull request #24013 from vdimir/issue-24010
...
Finalize CompressedWriteBuffer in TemporaryFileStream
2021-05-11 21:19:12 +03:00
Maksim Kita
72d46beca0
Merge pull request #23979 from azat/dict-preallocate
...
Reimplement preallocate for hashed/sparse_hashed dictionaries
2021-05-11 20:15:46 +03:00
feng lv
9035e3a643
fix test and conflict
2021-05-11 16:22:24 +00:00
Egor Savin
e51e13db61
Merge branch 'master' into progress_bar_for_LocalServer
2021-05-11 18:36:06 +03:00
Pavel Kruglov
704bbe0aeb
Raname uniqThetaSketch to uniqTheta
2021-05-11 17:39:35 +03:00
Amesaru
fa8e904987
WriteProgress fix
2021-05-11 17:24:04 +03:00
kssenii
850b6f02cb
Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk
2021-05-11 14:22:30 +00:00
Amesaru
6dd475cc76
Convert ProgressBar into a struct
2021-05-11 17:14:57 +03:00
Nikolai Kochetov
817bc1377c
Fix part check for projections.
2021-05-11 17:07:19 +03:00
alesapin
591abbaded
Better error codes in Keeper while no leader alive
2021-05-11 16:54:36 +03:00
万康
36fc6432ce
support for order by fill with DateTime64
2021-05-11 21:03:32 +08:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard
2021-05-11 15:36:40 +03:00
Fuwang Hu
a312dd414c
Merge branch 'master' into feature/fix-session-expired-when-selecting-system-tables
2021-05-11 20:04:36 +08:00
Nikolai Kochetov
a7d717d767
Remove unused code.
2021-05-11 14:59:56 +03:00
fuwhu
bf0b0e2edc
disable select_sequential_consistency when getting total rows and bytes in TablesBlockSource::generate
2021-05-11 19:49:48 +08:00
Nikolai Kochetov
89f16014b8
fix fetch for projection.
2021-05-11 14:44:59 +03:00
Amos Bird
074c2ead9c
Fix
2021-05-11 18:22:23 +08:00
Amos Bird
5e9fab6d10
Comment debug info out
2021-05-11 18:12:29 +08:00
Amos Bird
5836e2e277
Fix issues in normal projection
2021-05-11 18:12:29 +08:00
Amos Bird
dfa5629071
Remove projection type ast
2021-05-11 18:12:29 +08:00
Amos Bird
51d685bb9c
Even more fixes
2021-05-11 18:12:29 +08:00
Amos Bird
ddd4256a15
More fixes
2021-05-11 18:12:28 +08:00
Amos Bird
718c284437
Fix more tests
2021-05-11 18:12:28 +08:00
Amos Bird
ba17acbd63
Fix tests
2021-05-11 18:12:28 +08:00
Amos Bird
a3fd0b6f2e
Fix tests
2021-05-11 18:12:28 +08:00
Amos Bird
42f161b1dc
Fix more
2021-05-11 18:12:28 +08:00
Amos Bird
012eb56e3b
fix ya make (projection only)
2021-05-11 18:12:28 +08:00
Amos Bird
ef918aeaff
Rebase and fix
2021-05-11 18:12:28 +08:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection
...
TODO set index analysis in projection
2021-05-11 18:12:27 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order
2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns
2021-05-11 18:12:27 +08:00
Amos Bird
35961c0c5d
Use ActionsDAG to rewrite projection queries
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
bf95b684a7
Remove copy constructor from ProjectionDescription
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks.
2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests
2021-05-11 18:12:27 +08:00
Nikolai Kochetov
c2396c5144
Disable read-in-order optimization in case of projections.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
95431168c2
Try to enable normal projections.
2021-05-11 18:12:26 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
427f444ba4
Fix prewhere.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3d36fb57eb
Cleanup code.
2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster.
2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage
2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections
...
TODO (suggested by Nikolai)
1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies
3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)
Also need to figure out how prewhere works for projections, and
row_filter_policies.
wip
2021-05-11 18:12:23 +08:00
vdimir
adb5fe2f30
Finalize CompressedWriteBuffer in TemporaryFileStream
2021-05-11 12:23:35 +03:00
vdimir
7ccf47cdfd
Add Settings to AggregateFunctionSumCount/AggregateFunctionDeltaSumTimestamp
2021-05-11 12:22:00 +03:00
Maksim Kita
fdaffe869d
Merge pull request #24007 from ClickHouse/fix-bad-code-2
...
Fix bad code
2021-05-11 12:03:53 +03:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again
...
Add uniqThetaSketch again
2021-05-11 11:24:43 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue
...
Add _partition_value virtual column
2021-05-11 11:23:00 +03:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings
2021-05-11 11:18:24 +03:00
alexey-milovidov
066d02dd2f
Merge pull request #23631 from ClickHouse/normalize-bigint
...
Make big integers production ready.
2021-05-11 11:07:52 +03:00
Alexander Kuzmenkov
6b6caba9cf
Merge pull request #23726 from ClickHouse/aku/fuzzer-typo
...
fix a typo in query formatting check in fuzzer
2021-05-11 05:44:49 +03:00
Alexey Milovidov
eb8a4ffe4b
Fix bad code
2021-05-11 02:43:58 +03:00
Alexey Milovidov
b2ca5cd98b
Merge branch 'master' into normalize-bigint
2021-05-11 02:05:40 +03:00
alexey-milovidov
6d0bd4f7d2
Merge pull request #23969 from ClickHouse/aku/long-trace-id
...
support longer query ids in trace log for perf tests
2021-05-10 23:35:40 +03:00
alexey-milovidov
59448eb319
Merge pull request #24004 from kitaisreal/compile-dag-fix-sip-hash
...
CompileDAG fix Sip hash
2021-05-10 23:33:28 +03:00
Alexey Milovidov
b9b3e4b60a
Fix style and wording in #23946
2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source
...
Add support for HTTP compression in dictionary source.
2021-05-10 22:52:07 +03:00
Maksim Kita
a4d7e190ac
CompileDAG fix Sip hash
2021-05-10 22:47:07 +03:00
Alexey Milovidov
94592f0d54
Whitespaces
2021-05-10 21:16:06 +03:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions
...
Enable "compile_expressions" by default
2021-05-10 21:09:18 +03:00
Alexander Tokmakov
eef899ae63
better code, add test
2021-05-10 21:03:37 +03:00
mergify[bot]
f5e77d7200
Merge branch 'master' into aku/fuzzer-typo
2021-05-10 17:54:19 +00:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path
...
Better handling of URI's in `PocoHTTPClient`
2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp
2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp
2021-05-10 20:20:05 +03:00
Maksim Kita
9d90b586ff
Merge pull request #23990 from kitaisreal/dictionaries-dict-get-or-null-handle-empty-rows-execute
...
Function dictGetOrNull handle empty rows execute
2021-05-10 20:05:26 +03:00
alexey-milovidov
ab33b80edc
Merge pull request #23962 from azat/external-group-by-overflow-row-fix
...
Fix SIGSEGV for external GROUP BY and overflow row
2021-05-10 20:02:05 +03:00
chou.fan
8990120eb7
add array nullable datatype support in ArrowColumnToCHColumn and fix select from array datatype misplaced bug
2021-05-10 14:17:52 +01:00
Maksim Kita
71b994b417
CompileDAG updated SipHash
2021-05-10 15:56:55 +03:00
万康
308b964ca4
enable DateTime64 to be version column
2021-05-10 20:30:52 +08:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions
2021-05-10 12:14:08 +03:00
Maksim Kita
e72c139bf6
Fixed code review issues
2021-05-10 11:09:32 +03:00
Maksim Kita
3d005537cf
Function dictGetOrNull handle empty rows execute
2021-05-10 11:08:26 +03:00
Maksim Kita
f2a2f85f63
Merge pull request #23981 from ucasFL/type
...
use LowCardinality for AsynchronousMetricLog name column
2021-05-10 10:58:58 +03:00
Azat Khuzhin
920378a12a
Fix google-default-arguments in IDictionarySource with loadAllWithSizeHint()
2021-05-10 07:41:49 +03:00
Azat Khuzhin
808d1a0215
Reimplement preallocate for hashed/sparse_hashed dictionaries
...
It was initially implemented in #15454 , but was reverted in #21948 (due
to higher memory usage).
This implementation differs from the initial, since now there is
separate attribute to enable preallocation, before it was done
automatically, but this has problems with duplicates in the source.
Plus this implementation does not uses dynamic_cast, instead it extends
IDictionarySource interface.
2021-05-10 07:41:48 +03:00
Azat Khuzhin
efcde4c84f
Decrease log level in IPAddressDictionary for duplicated records
...
After RELOAD DICTIONARY had been changed to capture the logs (by
attaching query's thread group) the 01852_dictionary_found_rate_long
fails because of this warning.
But it does not looks like it should be a warning, so change to trace.
2021-05-10 07:41:48 +03:00
Maksim Kita
8bc511eaa0
Fix LLVMExecutableFunction called with const arguments
2021-05-10 01:02:54 +03:00
Alexey Milovidov
18b7e38994
Remove redundant template
2021-05-10 00:26:34 +03:00
Alexey Milovidov
11ba22b43f
UUID in dictionaries
2021-05-10 00:02:08 +03:00
Alexey Milovidov
f4db7b63b4
Fix error
2021-05-09 23:13:19 +03:00
FArthur-cmd
cf4dc8a395
refactor style
2021-05-09 22:02:37 +03:00
FArthur-cmd
6363a5dd96
use path to define compression type
2021-05-09 21:58:08 +03:00
alexey-milovidov
1ea637d996
Merge pull request #23970 from ClickHouse/pvs-studio-fixes-6
...
PVS-Studio fixes, part 6
2021-05-09 21:45:19 +03:00
Alexey Milovidov
1fece08673
Fix gcc build
2021-05-09 20:19:07 +03:00
Alexey Milovidov
02fd1d4bc3
Fix clang-tidy
2021-05-09 20:02:37 +03:00
Alexey Milovidov
ab94a559da
Fix clang-tidy
2021-05-09 20:02:22 +03:00
feng lv
683af72cc8
use LowCardinality for AsynchronousMetricLog name column
2021-05-09 16:25:28 +00:00
Alexey Milovidov
ce4bf58029
Merge with master
2021-05-09 19:01:38 +03:00
Alexey Milovidov
9753ddc8a0
Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint
2021-05-09 18:54:29 +03:00
kssenii
d6582f5fe5
Table schema for dict
2021-05-09 15:42:54 +00:00
Alexey Milovidov
6d55812df5
Add TODO
2021-05-09 18:05:20 +03:00
Alexey Milovidov
5618352512
Fix clang-tidy
2021-05-09 17:48:36 +03:00
Alexey Milovidov
28c4ef29b1
Fix clang-tidy
2021-05-09 17:48:11 +03:00
Azat Khuzhin
4c47d91c94
Attach background thread for dictionary reload to the reload query
2021-05-09 14:30:31 +03:00
FArthur-cmd
bd519075b7
adding checking url in HTTPSource
2021-05-09 14:27:11 +03:00
Azat Khuzhin
80f4059deb
Drop unused getDictionaryConfigurationFromAST.h
2021-05-09 14:25:45 +03:00
Maksim Kita
e517436ba4
Merge pull request #23961 from kitaisreal/array-difference-decimal-math-overflow
...
Function arrayDifference decimal math overflow
2021-05-09 14:04:35 +03:00
Alexey Milovidov
fa678fc7a6
utils/generate-ya-make/generate-ya-make.sh
2021-05-09 03:28:33 +03:00
Alexey Milovidov
f476a5c5d7
utils/generate-ya-make/generate-ya-make.sh
2021-05-09 03:28:10 +03:00
Alexey Milovidov
9ccf7f4864
Maybe fix error
2021-05-09 01:55:05 +03:00
Alexey Milovidov
2be03d2e57
Maybe fix error
2021-05-09 01:54:46 +03:00
Alexey Milovidov
903c306e04
Fix some PVS-Studio warnings
2021-05-09 01:10:10 +03:00
Alexey Milovidov
ab9b116310
Fix some PVS-Studio warnings
2021-05-09 01:09:16 +03:00
Alexey Milovidov
ce9eda6a87
Fix warnings by PVS-Studio
2021-05-08 23:57:08 +03:00
Alexey Milovidov
e23a0d8f7e
Fix warnings by PVS-Studio
2021-05-08 23:57:08 +03:00
Alexey Milovidov
367f7fe6c9
Fix warnings by PVS-Studio
2021-05-08 23:57:08 +03:00
Alexey Milovidov
58de177ed3
Fix warnings by PVS-Studio
2021-05-08 23:56:17 +03:00
Alexey Milovidov
513c6891db
Fix warnings by PVS-Studio
2021-05-08 23:54:49 +03:00
Alexey Milovidov
037d06bb2a
Fix warnings by PVS-Studio
2021-05-08 23:50:12 +03:00
Alexey Milovidov
f6be177540
Add TODO
2021-05-08 23:07:19 +03:00
Alexey Milovidov
e81eadab59
Support UUID and UInt256 in aggregate functions
2021-05-08 23:07:04 +03:00
Alexey Milovidov
3b767b4a64
Fix strange code
2021-05-08 22:41:14 +03:00
Alexey Milovidov
c412820e9c
Fix warnings by PVS-Studio
2021-05-08 22:40:57 +03:00
Alexey Milovidov
9ad4157dbb
Fix strange code
2021-05-08 22:40:23 +03:00
Maksim Kita
0b67f593e0
Merge pull request #23963 from azat/dict-hit_rate-nan
...
Use 0 over nan for hit_rate in case of 0 queries to the cache dictionary
2021-05-08 22:38:21 +03:00
Maksim Kita
99c25feafe
Merge pull request #23965 from azat/aggregator-logs
...
Round floats in Aggregator log messages
2021-05-08 22:38:02 +03:00
Alexey Milovidov
8a804f1e35
Fix warnings by PVS-Studio
2021-05-08 22:30:58 +03:00
Alexey Milovidov
d057bcf42c
Fix error (amend)
2021-05-08 22:28:55 +03:00
Alexey Milovidov
883c826d3f
Minor code modification
2021-05-08 22:17:46 +03:00
Alexey Milovidov
fa5205b4c7
Get rid of ugly notation
2021-05-08 22:05:08 +03:00
Alexey Milovidov
49160ae1ba
Big integers and UUID in dictionaries
2021-05-08 22:01:59 +03:00
Alexey Milovidov
49c0e18e45
Fix build
2021-05-08 21:46:41 +03:00
Alexey Milovidov
2d3647c5b0
Merge branch 'master' into normalize-bigint
2021-05-08 21:22:32 +03:00
Alexey Milovidov
c9fb8ca026
Fix deprecated header
2021-05-08 21:19:45 +03:00
Alexey Milovidov
ac9b43f103
Fix error
2021-05-08 21:16:46 +03:00
Alexey Milovidov
2b4f4e08c3
Fix error
2021-05-08 21:16:25 +03:00
Alexey Milovidov
aa25ffa9e3
Fix error
2021-05-08 21:15:23 +03:00
Alexey Milovidov
52bea2630b
Fix error
2021-05-08 21:15:00 +03:00
Alexey Milovidov
8e8160be28
Fix error
2021-05-08 21:11:47 +03:00
Alexey Milovidov
b96087025e
Fix error
2021-05-08 21:11:31 +03:00
Maksim Kita
2a630b68a4
Fixed FunctionComparison with special edge case
2021-05-08 21:04:21 +03:00
Maksim Kita
0a2ea38cc9
Merge pull request #23916 from azat/dict-found_rate
...
Measure found rate for dictionaries
2021-05-08 19:23:52 +03:00
Alexey Milovidov
ad88819ee4
Fix a bunch of warnings from PVS-Studio
2021-05-08 19:13:10 +03:00
Alexey Milovidov
f805f4aa4f
Fix error found by PVS-Studio
2021-05-08 19:13:00 +03:00
Alexey Milovidov
3025f9e141
More fixes for PVS-Studio
2021-05-08 19:12:49 +03:00
Alexey Milovidov
e905883c75
More fixes for PVS-Studio
2021-05-08 19:12:31 +03:00
Alexey Milovidov
022667a190
Fix some PVS-Studio warnings
2021-05-08 19:12:19 +03:00
Alexey Milovidov
8d62c42eb9
A bunch of changes for PVS-Studio
2021-05-08 19:11:50 +03:00
Alexey Milovidov
bdc372cb9a
Fix bad code (found by PVS-Studio)
2021-05-08 19:11:40 +03:00
Alexey Milovidov
8b9c058141
Fix bad code in Keeper (found by PVS-Studio)
2021-05-08 19:11:31 +03:00
Alexey Milovidov
241c7a94da
Fix bad code in Keeper (found by PVS-Studio)
2021-05-08 19:11:08 +03:00
Alexey Milovidov
7ca0f46708
Add suppressions for PVS-Studio
2021-05-08 19:10:56 +03:00
Alexey Milovidov
78a2df5900
Fix low quality code in Qualtile (found by PVS-Studio)
2021-05-08 19:10:38 +03:00
Alexey Milovidov
125b2ab214
Suppressions for PVS-Studio
2021-05-08 19:10:23 +03:00
Alexey Milovidov
604daa9581
Fix a bunch of warnings from PVS-Studio
2021-05-08 19:09:17 +03:00
Maksim Kita
9b405b4c07
Fixed FunctionComparison for constants
2021-05-08 18:47:08 +03:00
Alexey Milovidov
f59c55abb5
Fix error found by PVS-Studio
2021-05-08 18:35:38 +03:00
Alexey Milovidov
45dea86395
More fixes for PVS-Studio
2021-05-08 18:35:09 +03:00
Alexander Kuzmenkov
308c4657ce
support longer query ids in trace log for perf tests
2021-05-08 18:20:42 +03:00
Alexey Milovidov
2fbecf36ca
More fixes for PVS-Studio
2021-05-08 18:20:40 +03:00
Azat Khuzhin
69e395bede
Round floats in AggregatingTransform log messages
2021-05-08 18:01:57 +03:00
Azat Khuzhin
6b11319cdf
Round floats in Aggregator log messages
2021-05-08 18:01:24 +03:00
Alexey Milovidov
3e8deef6fe
Fix some PVS-Studio warnings
2021-05-08 17:54:08 +03:00
Azat Khuzhin
21f08a1aa9
Use 0 over nan for hit_rate in case of 0 queries to the cache dictionary
2021-05-08 17:51:22 +03:00
Azat Khuzhin
4cecc238d6
Fix SIGSEGV for external GROUP BY and overflow row
...
Overflow row is used for GROUP BY if all of the above is true:
- WITH TOTALS is requested
- max_rows_to_group_by > 0
- group_by_overflow_mode = any
- totals_mode != after_having_exclusive
And in case of overflow row and external GROUP BY, once the temporary
file dumps to disk it resets without_key data variant to nullptr, so any
subsequent dump to disk will cause SIGSEGV.
Fix this, by recreating without_key data variant after dumping to disk,
instead of reseting to nullptr.
And also add sanity check (LOGICAL_ERROR) to make error more
deterministic in case of such error.
Found with fuzzer [1].
[1]: https://clickhouse-test-reports.s3.yandex.net/23929/e7027e052998540ee660d186727e20f9555b729d/fuzzer_ubsan/report.html#fail1
2021-05-08 17:48:24 +03:00
Alexey Milovidov
9e1a5f41fc
A bunch of changes for PVS-Studio
2021-05-08 17:43:03 +03:00
Maksim Kita
1bb4988b1f
Fixed FunctionsComparison constant result with non constant arguments
2021-05-08 17:39:35 +03:00
Maksim Kita
6dc0dcdfa4
Fixed code review issues
2021-05-08 17:39:35 +03:00
Maksim Kita
dd44d93f49
Fixed compile expressions
2021-05-08 17:39:35 +03:00
alexey-milovidov
b76503a4ea
Update ActionsDAG.cpp
2021-05-08 17:39:35 +03:00
Maksim Kita
21d8684aaf
Added CHJIT documentation
2021-05-08 17:39:35 +03:00
Maksim Kita
050cb74ed0
Fix compiled if statement
2021-05-08 17:39:35 +03:00
Maksim Kita
8df4e866f3
Fixed clickhouse-client log
2021-05-08 17:39:35 +03:00
Maksim Kita
72d610be2e
Updated CHJIT interface to be more thread safe
2021-05-08 17:39:35 +03:00
Maksim Kita
7778172a1f
Fixed compilable function
2021-05-08 17:39:35 +03:00
Maksim Kita
4db7e49ccf
Fixed Date, DateTime native type
2021-05-08 17:39:35 +03:00
Maksim Kita
16a07f61ae
Refactored CompileDAG build algorithm
2021-05-08 17:39:35 +03:00
Maksim Kita
8828599380
Fixed style check
2021-05-08 17:39:35 +03:00
Maksim Kita
c79d7eae21
Refactored interfaces
2021-05-08 17:39:35 +03:00
Maksim Kita
24798ef07c
Updated interfaces
2021-05-08 17:39:34 +03:00
Maksim Kita
d2eecfe593
Updated Nullable default implementation
2021-05-08 17:39:34 +03:00
Maksim Kita
8d6c282e0a
Fixed test
2021-05-08 17:39:34 +03:00
Maksim Kita
af06f5b68b
Fixed UUID test
2021-05-08 17:39:34 +03:00
Maksim Kita
97d87eb518
Fixed JITMemoryManager
2021-05-08 17:39:34 +03:00
Maksim Kita
e40aa26611
Fixed MSan
2021-05-08 17:39:34 +03:00
Maksim Kita
baf1978124
CHJIT updated thread safe interface
2021-05-08 17:39:34 +03:00
Maksim Kita
2b58357a77
Fixed tests
2021-05-08 17:39:34 +03:00
Maksim Kita
69fdcdcc4a
Fixed tests
2021-05-08 17:39:34 +03:00
Maksim Kita
231433d951
Fixed style check
2021-05-08 17:39:34 +03:00
Maksim Kita
ca9a23abbc
Fix build
2021-05-08 17:39:34 +03:00
Maksim Kita
e58e956092
Enable llvm in fast test
2021-05-08 17:39:34 +03:00
Maksim Kita
3ec4409d52
Added CHJIT
2021-05-08 17:39:34 +03:00
Maksim Kita
ca44ff2ede
Updated example
2021-05-08 17:39:34 +03:00
Maksim Kita
c264e42542
Updated example
2021-05-08 17:39:34 +03:00
Maksim Kita
9f88fea760
Updated test
2021-05-08 17:39:34 +03:00
Maksim Kita
6b70cbd53c
Added jit example
2021-05-08 17:39:34 +03:00
Maksim Kita
fe7af99701
CMake USE_EMBEDDED_COMPILER ON by default
2021-05-08 17:39:34 +03:00
Maksim Kita
9daf5b8308
Updated Settings
2021-05-08 17:39:34 +03:00
Alexey Milovidov
78867a53c6
Fixed build
2021-05-08 17:39:34 +03:00
Alexey Milovidov
996cdd327c
Addition to prev. revision
2021-05-08 17:39:34 +03:00
Alexey Milovidov
e862580898
Added comment
2021-05-08 17:39:34 +03:00
Alexey Milovidov
f7830eb7b3
Unpoison data generated by JIT-ed functions for MSan
2021-05-08 17:39:34 +03:00
Alexey Milovidov
aa727e941d
Fix bad code (found by PVS-Studio)
2021-05-08 17:21:36 +03:00
Alexey Milovidov
8da7d43c99
Fix bad code in Keeper (found by PVS-Studio)
2021-05-08 17:13:32 +03:00
Alexey Milovidov
e9c7aa5ab5
Remove some code
2021-05-08 17:12:26 +03:00
Alexey Milovidov
afae68a019
Fix bad code in Keeper (found by PVS-Studio)
2021-05-08 17:10:06 +03:00
Alexey Milovidov
de1bc6d9f1
Add suppressions for PVS-Studio
2021-05-08 17:09:40 +03:00
Azat Khuzhin
763597001b
Count found keys for RangeHashedDictionary
2021-05-08 17:09:01 +03:00
Azat Khuzhin
d115a6842d
Count found keys for PolygonDictionary
2021-05-08 17:09:01 +03:00
Azat Khuzhin
97dc954add
Count found keys for IPAddressDictionary
2021-05-08 17:09:01 +03:00
Azat Khuzhin
d07581d82d
Count found keys for CacheDictionary
2021-05-08 17:09:01 +03:00
Azat Khuzhin
b767d9faac
Count found keys for DirectDictionary (plus utils changes)
2021-05-08 17:09:01 +03:00
Azat Khuzhin
a6a1bf2847
Count found keys for FlatDictionary
2021-05-08 17:09:01 +03:00
Azat Khuzhin
c80a06def3
Count found keys for HashedDictionary (plus utils changes for descendants)
2021-05-08 17:09:01 +03:00
Azat Khuzhin
e08389b2d2
Add interface for rate of found elements in the dictionaries
...
- IDictionary abstraction
- skeleton implementation into each dictionary
- system.dictionaries.found_rate
- documentation changes
2021-05-08 17:09:01 +03:00
Alexey Milovidov
eeaf65c043
Fix low quality code in Qualtile (found by PVS-Studio)
2021-05-08 17:05:58 +03:00
Maksim Kita
108c2022d9
Function arrayDifference decimal math overflow
2021-05-08 17:01:30 +03:00
Alexey Milovidov
9d9256d499
Suppressions for PVS-Studio
2021-05-08 17:01:25 +03:00
alexey-milovidov
680860aae7
Merge pull request #23912 from azat/CU
...
Cleanup IDatabase.h from extra headers
2021-05-08 16:42:56 +03:00
Alexey Milovidov
47a4c101b9
Merge branch 'master' into normalize-bigint
2021-05-08 16:41:15 +03:00
tavplubix
f8c7725ef5
Merge pull request #23742 from ClickHouse/update_metadata_on_replica_recovery
...
Update metadata on replica recovery
2021-05-08 16:34:03 +03:00
Maksim Kita
80dbb7ca4f
Merge pull request #23948 from azat/dict-range-min-max-check
...
Check MIN/MAX attributes in the list of dictionary attributes
2021-05-08 16:07:26 +03:00
mwish
9328ec9c50
[Init] initialize commit
2021-05-08 18:07:39 +08:00
FArthur-cmd
acb09f01d4
fixing details in code style and moving tests
2021-05-08 12:46:50 +03:00
Maksim Kita
c4be98566a
Merge pull request #23928 from kreuzerkrieg/DropUnnecessaryPorts
...
Drop unnecessary ports where applicable
2021-05-08 12:03:09 +03:00
Maksim Kita
b617c57ce8
Merge pull request #23929 from azat/dict-cache-source-dups-fix
...
Fix keys metrics accounting for CACHE() dictionary with duplicates in the source
2021-05-08 11:56:20 +03:00
FArthur-cmd
13a6e03849
solving style-check problems
2021-05-08 10:15:14 +03:00
Azat Khuzhin
8e9655d513
Check MIN/MAX attributes in the list of dictionary attributes
...
This way there will be proper exception instead of std::out_of_range
2021-05-08 08:59:47 +03:00
Alexey Milovidov
06e79e914c
Overcome gcc limitation
2021-05-08 03:29:51 +03:00
Alexey Milovidov
04d85db385
Fix weird error in code
2021-05-08 02:42:52 +03:00
Alexey Milovidov
55f86851f1
Less strange templates
2021-05-08 02:35:11 +03:00
FArthur-cmd
4ea9851e99
fixing dictionary http source by adding wrapper
2021-05-08 02:20:30 +03:00
Alexey Milovidov
734df081da
Fix terrible exception message
2021-05-08 02:12:48 +03:00
Alexey Milovidov
923d20a70e
Refuse to support covar/corr for extended numberic types (speedup build)
2021-05-08 01:16:17 +03:00
Alexey Milovidov
18ba924c80
Fix style
2021-05-08 01:11:09 +03:00
Alexey Milovidov
ca18f8bef1
Fix division of big integers; add a test
2021-05-08 00:47:23 +03:00
Kseniia Sumarokova
e6ac136c32
Merge pull request #23909 from kssenii/postgres-fixes
...
Fix postgres connections issue
2021-05-08 00:07:21 +03:00
Alexey Milovidov
7dfb7664f7
Messing with the code (removed trash)
2021-05-07 21:16:27 +03:00
Alexey Milovidov
bebdabc0ca
Support Map with UUID keys
2021-05-07 20:42:16 +03:00
Alexey Milovidov
7443e660ea
Remove unused headers
2021-05-07 20:13:00 +03:00
Alexey Milovidov
9db3cd57bb
Supposedly fix error with shifts; add a test
2021-05-07 20:12:14 +03:00
Alexander Tokmakov
11124f7015
fix
2021-05-07 20:09:39 +03:00
Alexey Milovidov
c404e6db2f
Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint
2021-05-07 18:25:12 +03:00
Alexander Tokmakov
24bcd9f7c6
better comments, fix pvs warnings
2021-05-07 16:39:21 +03:00
Anton Popov
01e99ab72e
Merge pull request #23871 from CurtizJ/cast-operator
...
Add postgres-like cast operator
2021-05-07 16:29:22 +03:00
alexey-milovidov
fd56e0a984
Merge pull request #23919 from ucasFL/hint-enum
...
Add hints for enum names
2021-05-07 16:12:16 +03:00
kssenii
912878ad7f
Review fixes
2021-05-07 12:05:34 +00:00
kssenii
8662078b35
Review fixes
2021-05-07 09:55:18 +00:00
Azat Khuzhin
e398635cb3
Make StorageS3.cpp self compilable (missing AbstractConfiguration.h)
2021-05-07 10:07:44 +03:00
Alexey Milovidov
6651e5e951
Fix test
2021-05-07 04:51:35 +03:00
Alexey Milovidov
9c0dacd063
Fix error
2021-05-07 04:45:29 +03:00
Alexey Milovidov
a1855f3d5b
Fix style
2021-05-07 04:43:02 +03:00
Alexey Milovidov
160aaec112
Fix error
2021-05-07 04:19:18 +03:00
Alexey Milovidov
f9472600ff
Map for UUID
2021-05-07 03:24:58 +03:00
