thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-14 02:12:21 +00:00
Code Issues Packages Projects Releases Wiki Activity
64,542 Commits 9,330 Branches 1,783 Tags 2.1 GiB
6650c67b01
Commit Graph

13753 Commits

Author SHA1 Message Date
alesapin
5a0d0a1717 Much simplier isLocalAddress 2021-05-17 18:31:44 +03:00
kssenii
71fcbefdc7 Add final to class 2021-05-17 14:38:48 +00:00
kssenii
8c955680ad Add comments and remove adjusted deserializarion 2021-05-17 14:33:04 +00:00
Nikolai Kochetov
2e3e56f353 Update IFunction.cpp 2021-05-17 17:27:06 +03:00
Anton Ivashkin
8ed4a5de62 Fix Zero Copy after merge master 2021-05-17 16:01:08 +03:00
kssenii
26fa920ad5 Fix clang tidy, slightly improve writeSuffix 2021-05-17 12:32:48 +00:00
Raúl Marín
439f161764 Fix GCC 11 build 
../src/IO/HashingWriteBuffer.h:20:34: error: expected ‘)’ before ‘block_size_’
   20 |     IHashingBuffer<Buffer>(size_t block_size_ = DBMS_DEFAULT_HASHING_BLOCK_SIZE)
 2021-05-17 14:04:08 +02:00
alesapin
5563a0d7f3 Fix style 2021-05-17 14:44:47 +03:00
alesapin
023b592f97 Fix style 2021-05-17 14:42:14 +03:00
alesapin
d8994350c1 Useful comments 2021-05-17 14:39:37 +03:00
Ilya Yatsishin
8ede5c736a
Merge pull request #23992 from MaxWk/enable-datatime64-version-column 
enable DateTime64 to be version column
 2021-05-17 14:34:15 +03:00
alesapin
77b1aeaac2 Use same zookeeper object to have an exception if something went wrong 2021-05-17 14:30:23 +03:00
alesapin
67d34c0136 merge with master 2021-05-17 14:13:18 +03:00
alesapin
17f229857c Merge branch 'master' into nvartolomei-parts-move 2021-05-17 13:52:48 +03:00
张中南
3d1992ea50 fix wrong typo at StorageMemory 2021-05-17 18:24:01 +08:00
kssenii
a8748a55df Fix abnormal termination when hdfs goes away 2021-05-17 09:55:23 +00:00
tavplubix
42d5400e36
Update StorageSystemStackTrace.cpp 2021-05-17 12:07:50 +03:00
Kruglov Pavel
64e7994987
Merge pull request #23887 from kssenii/rabbitmq-fixes 
RabbitMQ: allow user to define specific queue settings, its own exchange, user-managed queues; add cleanup on drop table
 2021-05-17 12:01:12 +03:00
Anton Ivashkin
39a30b77fe Merge master 2021-05-17 11:47:48 +03:00
hexiaoting
c5c7b2db97 Fix bug for update nested columns with const condition 2021-05-17 16:34:50 +08:00
Maksim Kita
0adc5883c0 Fixed style check 2021-05-17 11:13:15 +03:00
Maksim Kita
cf43a3efe2 Updated LRUHashMap benchmarks 2021-05-17 11:08:22 +03:00
alesapin
eae2df6478
Merge pull request #23997 from ClickHouse/fix_intersecting_parts 
Try fix intersecting parts
 2021-05-17 10:46:58 +03:00
Maksim Kita
84fc1e0c3d Fixed style check 2021-05-17 10:32:29 +03:00
Maksim Kita
d923d9e6ef Function move file 2021-05-17 10:30:42 +03:00
alesapin
62004cf0d9 Merge branch 'master' into standalone_keeper 2021-05-17 10:14:58 +03:00
Vitaly Baranov
1dc415596c Fix race condition in ContextAccess. 2021-05-17 10:03:26 +03:00
Nikolai Kochetov
98e6c27a95
Merge pull request #24168 from amosbird/projection-fix3 
Fix distributed processing when using projection
 2021-05-17 09:45:39 +03:00
Maksim Kita
20cced0a4c
Merge pull request #24155 from kitaisreal/function-refactoring 
IFunction refactoring
 2021-05-17 09:26:57 +03:00
abel-wang
4edd5fbb35 Add thread_name in system.stack_trace 2021-05-17 12:44:57 +08:00
kssenii
e524d11222 Remove setting 2021-05-16 20:16:10 +00:00
kssenii
57da32472b Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-16 18:39:51 +00:00
kssenii
807684812e Fix clang tidy 2021-05-16 18:18:11 +00:00
kssenii
d44f1680da Use unsigned type for (de)serialization 2021-05-16 18:09:55 +00:00
Maksim Kita
843aa1ae28
Merge pull request #24169 from ucasFL/style 
fix tiny code style
 2021-05-16 18:20:34 +03:00
Maksim Kita
fa24fe82e1 Fixed FunctionConversion tests 2021-05-16 18:17:05 +03:00
Amos Bird
07b1be5a76
Fix distributed processing when using projection 2021-05-16 22:40:06 +08:00
feng lv
fb3a627bd3 fix tiny code style 2021-05-16 14:14:59 +00:00
alesapin
29726b5510
Merge pull request #24122 from ClickHouse/fix_table_startup 
Set readonly mode if restarting thread failed to activate replica
 2021-05-16 16:45:51 +03:00
Azat Khuzhin
5a8d61954a Call IStorage::flush() for each table on DETACH DATABASE before shutdown 2021-05-16 13:28:35 +03:00
Azat Khuzhin
23981ffd0e Introduce IStorage::flushAndShutdown() 2021-05-16 13:23:53 +03:00
Azat Khuzhin
f20799f683 Destroy Buffer() tables before others (within one database) 
This will reduce amount of data that may be lost at shutdown.

v2: replace dynamic_cast with IStorage::isBuffer (@kitaisreal)
v3: replace IStorage::isBuffer with IStorage::flush (@alexey-milovidov)
v4: flush() for StorageProxy/StorageTableFunction
 2021-05-16 13:23:53 +03:00
kssenii
22b6d0eb25 Adjust modulo recursively 2021-05-16 09:20:59 +00:00
Amos Bird
e5cd597111
Fix add projection to replicated mergetree 2021-05-16 16:49:38 +08:00
Nikolai Kochetov
093b7e120a
Merge pull request #24062 from amosbird/projection-fix1 
Fix empty key projection query analysis
 2021-05-16 07:37:03 +03:00
kssenii
c7f51fe60e Modulo adjustment for partition key 2021-05-15 19:51:02 +00:00
Maksim Kita
196ca14c3a
Merge pull request #24150 from azat/whitespaces 
Fix a few trailing whitespaces in output
 2021-05-15 22:39:16 +03:00
kssenii
d303975a1c ModuloLegacy function 2021-05-15 18:45:19 +00:00
Maksim Kita
947f28d430 IFunction refactoring 2021-05-15 20:33:15 +03:00
Kseniia Sumarokova
99e2f83c69
Merge pull request #23548 from ucasFL/table-comment 
Implement table comments
 2021-05-15 19:56:16 +03:00
alesapin
bae419be36 Fix typo 2021-05-15 18:29:07 +03:00
Maksim Kita
3dd7401985
Merge pull request #23412 from godliness/fix-kafka-with-parquet 
Fix kafka storage does not work with parquet format messages
 2021-05-15 18:15:58 +03:00
RedClusive
5e725510e7 Merge branch 'master' of github.com:ClickHouse/ClickHouse into feature-quantileBfloat16 2021-05-15 15:03:47 +00:00
alesapin
852608c937 Don't abort on Auth request 2021-05-15 18:01:00 +03:00
alesapin
83627de2b8 Merge branch 'master' into standalone_keeper 2021-05-15 17:15:06 +03:00
alexey-milovidov
a9a66f6572
Merge pull request #24139 from Algunenano/aiotest_fix_tmpfs 
TestReadAfterAIO: Use the current path instead of /tmp for temporal files
 2021-05-15 17:04:41 +03:00
Azat Khuzhin
1cdeafe473 Remove superfluous trailing whitespace in Markdown format 2021-05-15 16:08:17 +03:00
Azat Khuzhin
a44ddd2064 Update distributed_group_by_no_merge description 2021-05-15 15:03:13 +03:00
Kseniia Sumarokova
6bcc99e5e6
Whitespace 2021-05-15 10:56:46 +03:00
Kseniia Sumarokova
9e65f376cc
Fix PVS check 2021-05-15 10:05:31 +03:00
Kseniia Sumarokova
1d73cd6406
Fix PVS check 2021-05-15 09:05:27 +03:00
Raúl Marín
e358a0963c Clearer code based on review 2021-05-15 03:03:38 +02:00
Raúl Marín
0ddfc3df84 TestReadAfterAIO: Use the local path instead of /tmp for temporal files 
/tmp might be mounted as tmpfs (default in ArchLinux) which is incompatible with
O_DIRECT (https://lore.kernel.org/lkml/459D290B.1040703@tmr.com/t/), making the
test fail:

```
[ RUN      ] ReadBufferAIOTest.TestReadAfterAIO
unknown file: Failure
C++ exception with description "Cannot open file /tmp/filei6ZsCa/foo, errno: 22, strerror: Invalid argument" thrown in the test body.
[  FAILED  ] ReadBufferAIOTest.TestReadAfterAIO (0 ms)
```

Instead create the tmp folder in the local path and delete it at the end
 2021-05-15 02:13:51 +02:00
Maksim Kita
e785029ead
Merge pull request #24116 from hexiaoting/dev_explain 
Fix bug for explain pipeline
 2021-05-15 01:41:27 +03:00
mergify[bot]
d31021ea4f
Merge branch 'master' into fix-kafka-with-parquet 2021-05-14 21:10:12 +00:00
Maksim Kita
0b4b5eb808 FunctionComparison remove constant result for non constant arguments optimization 2021-05-15 00:03:26 +03:00
Maksim Kita
18894005ac Update ExpressionJIT.cpp 2021-05-15 00:03:26 +03:00
Maksim Kita
f42b25e65c Update ExpressionJIT.cpp 2021-05-15 00:03:26 +03:00
Maksim Kita
26be39f419 CompileExpressions comparison function constant case fix 2021-05-15 00:03:26 +03:00
Kruglov Pavel
1a2e3e605a
Merge pull request #21770 from taylor12805/arrow_array 
Arrow array
 2021-05-14 23:44:48 +03:00
Alexander Tokmakov
df5f3fbc9d review suggestions 2021-05-14 19:11:40 +03:00
feng lv
8c82e3f1b9 fix style 
fix
 2021-05-14 15:50:05 +00:00
Amos Bird
a113acc40c
Fix empty key 2021-05-14 22:54:14 +08:00
Amos Bird
8de016d33a
Fix empty key projection query analysis 2021-05-14 22:26:26 +08:00
Alexander Tokmakov
41776ba5d9 fix 2021-05-14 15:55:30 +03:00
Alexander Kuzmenkov
5ed6a273d3
Merge pull request #24058 from ClickHouse/aku/uniq-two-level 
lower two-level aggregation threshold for uniq test to avoid jitter
 2021-05-14 15:50:48 +03:00
Alexander Kuzmenkov
6f16d92cfe
Update Settings.h 2021-05-14 15:50:30 +03:00
Nikolai Kochetov
bb11cde871
Merge pull request #24108 from ClickHouse/actions-dag-calc-header 
Calculate header from ActionsDAG
 2021-05-14 13:55:00 +03:00
Pavel Kruglov
484cac6193 Return include_indices, fix arrays and add more tests 2021-05-14 13:50:10 +03:00
Alexander Tokmakov
970ad94851 Merge branch 'master' into fix_intersecting_parts 2021-05-14 13:17:02 +03:00
alesapin
f8ddf511c5 Merge branch 'master' into standalone_keeper 2021-05-14 13:05:55 +03:00
Nikolai Kochetov
782f02b1dc Review fixes. 2021-05-14 13:01:27 +03:00
Nikolai Kochetov
a1e9202b93 Review fixes. 2021-05-14 12:30:32 +03:00
Maksim Kita
7eee500ef9
Merge pull request #24068 from azat/preserve-dict-for-shutdown 
Preserve dictionaries until storage shutdown
 2021-05-14 11:48:40 +03:00
alesapin
d4c6a5a05e Better logging 2021-05-14 11:38:53 +03:00
alesapin
67e4393769 If table was not active set readonly mode 2021-05-14 11:32:41 +03:00
Ilya Yatsishin
e345b8b868
Merge pull request #24077 from abel-cheng/feature/splitByRegexp 
add function splitByRegexp
 2021-05-14 10:43:08 +03:00
Ilya Yatsishin
19fb0d2033
Merge pull request #24091 from Enmk/now64_timezone_fix 
Fixed now64(): added second optional argument for timezone.
 2021-05-14 10:36:40 +03:00
Maksim Kita
b0bad25dd3
Merge pull request #24111 from kitaisreal/hash-table-performance 
Added hash table benchmarks
 2021-05-14 10:29:12 +03:00
kssenii
55c573f920 Fix 2021-05-14 07:11:32 +00:00
hexiaoting
396f60f292 Fix bug for explain pipeline 2021-05-14 14:43:51 +08:00
Pavel Kruglov
46a7cc5f1d Remove include_indices 2021-05-14 00:52:29 +03:00
Maksim Kita
1f9c9eda45 Added hash table benchmarks 2021-05-13 23:40:47 +03:00
Azat Khuzhin
aeb2c5d88a Preserve dictionaries until storage shutdown 
v2: Context::loadEmbeddedDictionaries()
v3: Context::loadDictionaries()
 2021-05-13 22:03:00 +03:00
Pavel Kruglov
bbe470a670 Remove fillArrowArray from .h file 2021-05-13 21:15:55 +03:00
Nikolai Kochetov
bc4ccdece6 Fix tests. 2021-05-13 21:07:47 +03:00
Vasily Nemkov
1330ef7567 Fixed converting const DateTime to DateTime64 in WHERE 2021-05-13 20:16:00 +03:00
Vasily Nemkov
22e304f88c
Fixed clang-tidy style check 2021-05-13 20:15:24 +03:00
Pavel Kruglov
25ceb1df65 Final fixes 2021-05-13 20:00:13 +03:00
alexey-milovidov
d340e33e2b
Merge pull request #23844 from excitoon-favorites/s3morecorrectclient 
Better handling of HTTP errors in `PocoHTTPClient`
 2021-05-13 19:21:09 +03:00
tavplubix
780b7cc8e1
Merge pull request #23863 from Algunenano/mutation_logs 
Reduce the amount of logs that StorageMergeTree::selectPartsToMutate outputs in busy systems.
 2021-05-13 19:02:23 +03:00
Alexander Tokmakov
eaffe6848b fix 2021-05-13 17:24:07 +03:00
Alexander Tokmakov
2da12f0b59 fix intersection of drop range and merge 2021-05-13 17:04:36 +03:00
Vasily Nemkov
3119660406 Fixed now64(): added second optional argument for timezone. 2021-05-13 16:51:32 +03:00
Nikolai Kochetov
d78be51fb4 Calculate header for ActionsDAG 2021-05-13 16:38:18 +03:00
alesapin
3abc891107
Merge pull request #24037 from amosbird/dh 
Run check_*_compiler_flag earlier
 2021-05-13 15:32:23 +03:00
mergify[bot]
1b181606e8
Merge branch 'master' into arrow_array 2021-05-13 12:23:48 +00:00
Pavel Kruglov
ff6e4bf91a Remove debug output 2021-05-13 15:21:39 +03:00
Alexander Tokmakov
e114c7eb8b fix virtual parts in REPLACE_RANGE 2021-05-13 14:29:59 +03:00
Vladimir
454b77c654
Update SplitByRegexpImpl 2021-05-13 13:27:29 +03:00
Kseniia Sumarokova
135bed27f5
Merge pull request #23196 from Amesaru/progress_bar_for_LocalServer 
Progress bar for local server
 2021-05-13 13:13:53 +03:00
kssenii
7115045317 Tiny changes 2021-05-13 09:39:57 +00:00
Pavel Kruglov
ec214bb04c Try fix tests again 2021-05-13 12:23:59 +03:00
Maksim Kita
f3ee14d24a
Merge pull request #24066 from azat/buffer-total-lock-contention 
Do not acquire lock for total_bytes/total_rows for Buffer engine
 2021-05-13 11:15:06 +03:00
alesapin
bfa23d7e02 Merge branch 'master' into standalone_keeper 2021-05-13 11:03:07 +03:00
alesapin
c484cb4f37
Merge pull request #24073 from ClickHouse/fix_snapshot_race 
Fix concurrent snapshot read/write
 2021-05-13 10:47:41 +03:00
kssenii
0cb0bd48f7 Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into rabbitmq-fixes 2021-05-13 06:36:51 +00:00
Vladimir Chebotarev
a3f7992442 Fixed typo. 2021-05-13 08:46:16 +03:00
Vladimir Chebotarev
b738e25f5b Better handling of HTTP errors in PocoHTTPClient. 2021-05-13 08:46:16 +03:00
Alexander Kuzmenkov
220f5b512e
try even smaller value 2021-05-13 06:15:44 +03:00
abel-wang
51c1d7c7ba split into characters when split by '' & add docs 2021-05-13 11:15:38 +08:00
abel-wang
99b9fe6c33 add function splitByRegexp 2021-05-13 10:37:09 +08:00
feng lv
c6f8ab9826 fix 2021-05-13 02:05:53 +00:00
alexey-milovidov
020cececc4
Merge pull request #24051 from georgthegreat/thread-local-arc 
Enable thread_local in Arcadia build
 2021-05-13 01:34:22 +03:00
Maksim Kita
5e1e968ef8
Merge pull request #24064 from davenger/uuid_build_fix 
Generate ya.make for missing UUID.cpp
 2021-05-13 00:41:13 +03:00
Azat Khuzhin
074b57fe82 Do not acquire lock for total_bytes/total_rows for Buffer engine 
When Buffer() is under preassure, acquiring per-layer lock may take
significant time. And so the following query may take significant amount of time:

    SELECT total_bytes, total_rows FROM system.tables WHERE engine='Buffer'
 2021-05-12 23:38:00 +03:00
Azat Khuzhin
26a1277609 Fix typo for IStorage::totalRows() comment 2021-05-12 23:38:00 +03:00
alesapin
f2a8b5b2c6 Fix concurrent snapshot read/write 2021-05-12 23:28:01 +03:00
Alexander Kuzmenkov
833f48751a
Merge pull request #24048 from ClickHouse/aku/insert-select-bytes 
for trivial INSERT SELECT, adjust block size in bytes as well
 2021-05-12 22:33:35 +03:00
Pavel Kruglov
86f061976e Some fixes 2021-05-12 22:02:56 +03:00
Amesaru
a95028bb43 UpdateProgress fix 2021-05-12 21:25:16 +03:00
Alexander Gololobov
748d1b6e9c Generate ya.make for missing UUID.cpp 2021-05-12 20:32:29 +03:00
Amesaru
e21899c854 Merge remote-tracking branch 'origin/progress_bar_for_LocalServer' into progress_bar_for_LocalServer 2021-05-12 19:26:42 +03:00
Amesaru
40cced96f4 UpdateProgress static 2021-05-12 19:25:12 +03:00
Nikolai Kochetov
690410009c Restor is_temporary flag for fetched part. 2021-05-12 19:17:01 +03:00
Pavel Kruglov
8ed6ad7c55 Refactor, support all types in array, add nested arrays support, more tests 2021-05-12 19:06:08 +03:00
alesapin
9f5f29f0aa Remove accident changes 2021-05-12 17:16:45 +03:00
alesapin
43ee9f0a3a Check for directory owner 2021-05-12 17:05:44 +03:00
kssenii
047f8a4e3c Correct merge 2021-05-12 13:10:06 +00:00
alesapin
41eadf9127 Something working 2021-05-12 16:04:34 +03:00
Alexander Kuzmenkov
f6cb9f95df lower two-level aggregation threshold for uniq test to avoid jitter 2021-05-12 16:01:48 +03:00
kssenii
8eb9e72f66 Fix bug 2021-05-12 12:33:04 +00:00
Anton Popov
46ce4b7a88
Merge pull request #24016 from MaxWk/order-by-with-fill-datetime64 
support for order by fill with DateTime64
 2021-05-12 14:44:36 +03:00
Yuriy Chernyshov
5a2bd0b6ba Enable thread_local in Arcadia build 2021-05-12 13:33:38 +03:00
Alexander Kuzmenkov
2536247754
Update src/Interpreters/InterpreterInsertQuery.cpp 2021-05-12 12:42:21 +03:00
Alexander Kuzmenkov
70d4ee3cde for trivial INSERT SELECT, adjust block size in bytes as well 2021-05-12 12:40:39 +03:00
alesapin
ed3f89a7be
Merge pull request #23980 from kssenii/add-postgres-schema 
Add missing table schema for postgres dictionary
 2021-05-12 10:50:49 +03:00
alesapin
d5462df2f9
Merge pull request #24017 from ClickHouse/fix_bug_with_snapshots_read 
Better error codes in Keeper when no leader alive
 2021-05-12 10:15:58 +03:00
Maksim Kita
ffdc2b22a5
Merge pull request #24022 from amosbird/fixalias 
Make `prefer_column_name_to_alias` setting more standard
 2021-05-12 09:54:04 +03:00
Nikolai Kochetov
a1ba67e029
Merge pull request #20202 from amosbird/projection 
Projections
 2021-05-12 09:38:07 +03:00
Amos Bird
d22ab2028f
Run check_*_compiler_flag earlier 2021-05-12 12:14:25 +08:00
万康
aa43d3cff9 fix tests and code style 2021-05-12 11:44:45 +08:00
alexey-milovidov
41012b5ba4
Merge pull request #23793 from fuwhu/feature/fix-session-expired-when-selecting-system-tables 
fix session expired while executing Tables
 2021-05-12 01:18:36 +03:00
alexey-milovidov
d422e0199b
Merge pull request #24019 from Avogar/rename-uniq-theta 
Rename uniqThetaSketch to uniqTheta
 2021-05-12 01:17:18 +03:00
Maksim Kita
2b833f4bce
Merge pull request #24021 from kitaisreal/fix-arena-with-free-lists-test 
Fix ArenaWithFreeLists test
 2021-05-11 22:00:45 +03:00
Amos Bird
62153e7030
Fix 2021-05-12 02:30:16 +08:00
Maksim Kita
d33f4750e1 Fix ArenaWithFreeLists test 2021-05-11 21:22:50 +03:00
Vladimir
124766f3ac
Merge pull request #24013 from vdimir/issue-24010 
Finalize CompressedWriteBuffer in TemporaryFileStream
 2021-05-11 21:19:12 +03:00
Maksim Kita
72d46beca0
Merge pull request #23979 from azat/dict-preallocate 
Reimplement preallocate for hashed/sparse_hashed dictionaries
 2021-05-11 20:15:46 +03:00
feng lv
9035e3a643 fix test and conflict 2021-05-11 16:22:24 +00:00
Egor Savin
e51e13db61
Merge branch 'master' into progress_bar_for_LocalServer 2021-05-11 18:36:06 +03:00
Pavel Kruglov
704bbe0aeb Raname uniqThetaSketch to uniqTheta 2021-05-11 17:39:35 +03:00
Amesaru
fa8e904987 WriteProgress fix 2021-05-11 17:24:04 +03:00
kssenii
850b6f02cb Merge branch 'master' of https://github.com/ClickHouse/ClickHouse into hdfs-idisk 2021-05-11 14:22:30 +00:00
Amesaru
6dd475cc76 Convert ProgressBar into a struct 2021-05-11 17:14:57 +03:00
Nikolai Kochetov
817bc1377c Fix part check for projections. 2021-05-11 17:07:19 +03:00
alesapin
591abbaded Better error codes in Keeper while no leader alive 2021-05-11 16:54:36 +03:00
万康
36fc6432ce support for order by fill with DateTime64 2021-05-11 21:03:32 +08:00
alesapin
46e136b5c4
Merge branch 'master' into nv/parts-uuid-move-shard 2021-05-11 15:36:40 +03:00
Fuwang Hu
a312dd414c
Merge branch 'master' into feature/fix-session-expired-when-selecting-system-tables 2021-05-11 20:04:36 +08:00
Nikolai Kochetov
a7d717d767 Remove unused code. 2021-05-11 14:59:56 +03:00
fuwhu
bf0b0e2edc disable select_sequential_consistency when getting total rows and bytes in TablesBlockSource::generate 2021-05-11 19:49:48 +08:00
Nikolai Kochetov
89f16014b8 fix fetch for projection. 2021-05-11 14:44:59 +03:00
Amos Bird
074c2ead9c
Fix 2021-05-11 18:22:23 +08:00
Amos Bird
5e9fab6d10
Comment debug info out 2021-05-11 18:12:29 +08:00
Amos Bird
5836e2e277
Fix issues in normal projection 2021-05-11 18:12:29 +08:00
Amos Bird
dfa5629071
Remove projection type ast 2021-05-11 18:12:29 +08:00
Amos Bird
51d685bb9c
Even more fixes 2021-05-11 18:12:29 +08:00
Amos Bird
ddd4256a15
More fixes 2021-05-11 18:12:28 +08:00
Amos Bird
718c284437
Fix more tests 2021-05-11 18:12:28 +08:00
Amos Bird
ba17acbd63
Fix tests 2021-05-11 18:12:28 +08:00
Amos Bird
a3fd0b6f2e
Fix tests 2021-05-11 18:12:28 +08:00
Amos Bird
42f161b1dc
Fix more 2021-05-11 18:12:28 +08:00
Amos Bird
012eb56e3b
fix ya make (projection only) 2021-05-11 18:12:28 +08:00
Amos Bird
ef918aeaff
Rebase and fix 2021-05-11 18:12:28 +08:00
Amos Bird
9c069ebdbf
support prewhere, row_filter, read_in_order and decent projection selection 
TODO set index analysis in projection
 2021-05-11 18:12:27 +08:00
Amos Bird
f7f949c1f9
Fix aggregation keys order 2021-05-11 18:12:27 +08:00
Amos Bird
e1e560765c
Fix missing columns 2021-05-11 18:12:27 +08:00
Amos Bird
35961c0c5d
Use ActionsDAG to rewrite projection queries 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
bf95b684a7
Remove copy constructor from ProjectionDescription 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
29d7038e30
Add ProjectionDescription::Type enum. Remove some checks. 2021-05-11 18:12:27 +08:00
Amos Bird
ebaf42a448
Reformat and fix some tests 2021-05-11 18:12:27 +08:00
Nikolai Kochetov
c2396c5144
Disable read-in-order optimization in case of projections. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
672cfedd13
Disable normal projection by the number of granules. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
95431168c2
Try to enable normal projections. 2021-05-11 18:12:26 +08:00
Amos Bird
483bd165e7
Check if pipeline is simple and add more comments 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
427f444ba4
Fix prewhere. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3d36fb57eb
Cleanup code. 2021-05-11 18:12:26 +08:00
Nikolai Kochetov
3296c9292f
Try to merge projectons faster. 2021-05-11 18:12:26 +08:00
Amos Bird
cd6414639e
add metadata_snapshot to getQueryProcessingStage 2021-05-11 18:12:26 +08:00
Amos Bird
264cff6415
Projections 
TODO (suggested by Nikolai)

1. Build query plan fro current query (inside storage::read) up to WithMergableState
2. Check, that plan is simple enough: Aggregating - Expression - Filter - ReadFromStorage (or simplier)
3. Check, that filter is the same as filter in projection, and also expression calculates the same aggregation keys as in projection
4. Return WithMergableState if projection applies

3 will be easier to do with ActionsDAG, cause it sees all functions, and dependencies are direct (but it is possible with ExpressionActions also)

Also need to figure out how prewhere works for projections, and
row_filter_policies.

wip
 2021-05-11 18:12:23 +08:00
vdimir
adb5fe2f30
Finalize CompressedWriteBuffer in TemporaryFileStream 2021-05-11 12:23:35 +03:00
vdimir
7ccf47cdfd
Add Settings to AggregateFunctionSumCount/AggregateFunctionDeltaSumTimestamp 2021-05-11 12:22:00 +03:00
Maksim Kita
fdaffe869d
Merge pull request #24007 from ClickHouse/fix-bad-code-2 
Fix bad code
 2021-05-11 12:03:53 +03:00
Kruglov Pavel
fb038c1985
Merge pull request #23894 from pingyu/datasketches-uniq-again 
Add uniqThetaSketch again
 2021-05-11 11:24:43 +03:00
Kruglov Pavel
49e7ed6e60
Merge pull request #23673 from amosbird/partitionvalue 
Add _partition_value virtual column
 2021-05-11 11:23:00 +03:00
vdimir
905e54a0af
Merge branch 'master' into create-aggregate-func-settings 2021-05-11 11:18:24 +03:00
alexey-milovidov
066d02dd2f
Merge pull request #23631 from ClickHouse/normalize-bigint 
Make big integers production ready.
 2021-05-11 11:07:52 +03:00
Alexander Kuzmenkov
6b6caba9cf
Merge pull request #23726 from ClickHouse/aku/fuzzer-typo 
fix a typo in query formatting check in fuzzer
 2021-05-11 05:44:49 +03:00
Alexey Milovidov
eb8a4ffe4b Fix bad code 2021-05-11 02:43:58 +03:00
Alexey Milovidov
b2ca5cd98b Merge branch 'master' into normalize-bigint 2021-05-11 02:05:40 +03:00
alexey-milovidov
6d0bd4f7d2
Merge pull request #23969 from ClickHouse/aku/long-trace-id 
support longer query ids in trace log for perf tests
 2021-05-10 23:35:40 +03:00
alexey-milovidov
59448eb319
Merge pull request #24004 from kitaisreal/compile-dag-fix-sip-hash 
CompileDAG fix Sip hash
 2021-05-10 23:33:28 +03:00
Alexey Milovidov
b9b3e4b60a Fix style and wording in #23946 2021-05-10 23:32:30 +03:00
Maksim Kita
4a22924ed5
Merge pull request #23946 from FArthur-cmd/8912-fix-dict-http-source 
Add support for HTTP compression in dictionary source.
 2021-05-10 22:52:07 +03:00
Maksim Kita
a4d7e190ac CompileDAG fix Sip hash 2021-05-10 22:47:07 +03:00
Alexey Milovidov
94592f0d54 Whitespaces 2021-05-10 21:16:06 +03:00
alexey-milovidov
066acc71b6
Merge pull request #8482 from ClickHouse/enable-compile-expressions 
Enable "compile_expressions" by default
 2021-05-10 21:09:18 +03:00
Alexander Tokmakov
eef899ae63 better code, add test 2021-05-10 21:03:37 +03:00
mergify[bot]
f5e77d7200
Merge branch 'master' into aku/fuzzer-typo 2021-05-10 17:54:19 +00:00
alexey-milovidov
0400070924
Merge pull request #23822 from excitoon-favorites/equalsignins3path 
Better handling of URI's in `PocoHTTPClient`
 2021-05-10 20:25:18 +03:00
alexey-milovidov
5397b1d0c3
Update PocoHTTPClient.cpp 2021-05-10 20:22:09 +03:00
alexey-milovidov
5685738d08
Update PocoHTTPClient.cpp 2021-05-10 20:20:05 +03:00
Maksim Kita
9d90b586ff
Merge pull request #23990 from kitaisreal/dictionaries-dict-get-or-null-handle-empty-rows-execute 
Function dictGetOrNull handle empty rows execute
 2021-05-10 20:05:26 +03:00
alexey-milovidov
ab33b80edc
Merge pull request #23962 from azat/external-group-by-overflow-row-fix 
Fix SIGSEGV for external GROUP BY and overflow row
 2021-05-10 20:02:05 +03:00
chou.fan
8990120eb7 add array nullable datatype support in ArrowColumnToCHColumn and fix select from array datatype misplaced bug 2021-05-10 14:17:52 +01:00
Maksim Kita
71b994b417 CompileDAG updated SipHash 2021-05-10 15:56:55 +03:00
万康
308b964ca4 enable DateTime64 to be version column 2021-05-10 20:30:52 +08:00
Vladimir
d02d14fa00
Merge pull request #23846 from excitoon-favorites/s3regions 2021-05-10 12:14:08 +03:00
Maksim Kita
e72c139bf6 Fixed code review issues 2021-05-10 11:09:32 +03:00
Maksim Kita
3d005537cf Function dictGetOrNull handle empty rows execute 2021-05-10 11:08:26 +03:00
Maksim Kita
f2a2f85f63
Merge pull request #23981 from ucasFL/type 
use LowCardinality for AsynchronousMetricLog name column
 2021-05-10 10:58:58 +03:00
Azat Khuzhin
920378a12a Fix google-default-arguments in IDictionarySource with loadAllWithSizeHint() 2021-05-10 07:41:49 +03:00
Azat Khuzhin
808d1a0215 Reimplement preallocate for hashed/sparse_hashed dictionaries 
It was initially implemented in #15454, but was reverted in #21948 (due
to higher memory usage).

This implementation differs from the initial, since now there is
separate attribute to enable preallocation, before it was done
automatically, but this has problems with duplicates in the source.

Plus this implementation does not uses dynamic_cast, instead it extends
IDictionarySource interface.
 2021-05-10 07:41:48 +03:00
Azat Khuzhin
efcde4c84f Decrease log level in IPAddressDictionary for duplicated records 
After RELOAD DICTIONARY had been changed to capture the logs (by
attaching query's thread group) the 01852_dictionary_found_rate_long
fails because of this warning.
But it does not looks like it should be a warning, so change to trace.
 2021-05-10 07:41:48 +03:00
Maksim Kita
8bc511eaa0 Fix LLVMExecutableFunction called with const arguments 2021-05-10 01:02:54 +03:00
Alexey Milovidov
18b7e38994 Remove redundant template 2021-05-10 00:26:34 +03:00
Alexey Milovidov
11ba22b43f UUID in dictionaries 2021-05-10 00:02:08 +03:00
Alexey Milovidov
f4db7b63b4 Fix error 2021-05-09 23:13:19 +03:00
FArthur-cmd
cf4dc8a395 refactor style 2021-05-09 22:02:37 +03:00
FArthur-cmd
6363a5dd96 use path to define compression type 2021-05-09 21:58:08 +03:00
alexey-milovidov
1ea637d996
Merge pull request #23970 from ClickHouse/pvs-studio-fixes-6 
PVS-Studio fixes, part 6
 2021-05-09 21:45:19 +03:00
Alexey Milovidov
1fece08673 Fix gcc build 2021-05-09 20:19:07 +03:00
Alexey Milovidov
02fd1d4bc3 Fix clang-tidy 2021-05-09 20:02:37 +03:00
Alexey Milovidov
ab94a559da Fix clang-tidy 2021-05-09 20:02:22 +03:00
feng lv
683af72cc8 use LowCardinality for AsynchronousMetricLog name column 2021-05-09 16:25:28 +00:00
Alexey Milovidov
ce4bf58029 Merge with master 2021-05-09 19:01:38 +03:00
Alexey Milovidov
9753ddc8a0 Merge branch 'master' of github.com:yandex/ClickHouse into normalize-bigint 2021-05-09 18:54:29 +03:00
kssenii
d6582f5fe5 Table schema for dict 2021-05-09 15:42:54 +00:00
Alexey Milovidov
6d55812df5 Add TODO 2021-05-09 18:05:20 +03:00