thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-16 11:22:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
79,890 Commits 9,338 Branches 1,783 Tags 2.1 GiB
29d28c531f
Commit Graph

21098 Commits

Author SHA1 Message Date
Maksim Kita
dd0d3de050
Merge pull request #32970 from kitaisreal/loops-remove-postfix-increment 
Loops remove postfix increment
 2021-12-20 19:51:07 +03:00
Maksim Kita
daa23a2827
Merge pull request #32973 from kitaisreal/short-circuit-throw-if-support 
Short circuit evaluation function throwIf support
 2021-12-20 19:50:53 +03:00
Vitaly Baranov
e61d3eef0c
Merge pull request #32747 from vitlibar/improve-grpc-compression 
Improve gRPC compression support
 2021-12-20 19:44:58 +03:00
avogar
ba6a513db0 Fix tuple output in CSV format 2021-12-20 19:27:09 +03:00
Antonio Andelic
bc52758e4d Explicitly default move/copy constructors 2021-12-20 17:05:08 +01:00
Antonio Andelic
25f88356e4 Add hints for SET query and HTTP request param settings 2021-12-20 16:57:09 +01:00
Nikolai Kochetov
7dea7b7f76 Decrease log level for some s3 messages. 2021-12-20 18:18:54 +03:00
Kseniia Sumarokova
a5f28e51e5
Try fix style check 2021-12-20 18:09:20 +03:00
Maksim Kita
02b6ad52ef FunctionThrowIf fixed exception 2021-12-20 16:55:15 +03:00
Maksim Kita
ebff389701
Merge pull request #32972 from kitaisreal/containers-iteration-fix-erase 
Containers iteration fix erase
 2021-12-20 16:47:19 +03:00
avogar
e31c18e9f8 Fix hdfs url check 2021-12-20 16:09:48 +03:00
Maksim Kita
60d4295d8a FunctionThrowIf added comment 2021-12-20 16:00:43 +03:00
Maksim Kita
51477adf1b Updated additional cases 2021-12-20 15:55:07 +03:00
Nikolai Kochetov
2e62f086a1
Merge pull request #32751 from ClickHouse/fix-32668 
Apply some more optimizations to NO_QUERY ast.
 2021-12-20 15:47:25 +03:00
Kruglov Pavel
abbab7ff87
Merge pull request #32929 from kreuzerkrieg/get_ORC_right 
Stop reading incomplete stripes and skip rows.
 2021-12-20 15:31:48 +03:00
alesapin
5958cac72c
Merge pull request #32493 from azat/fix-02050_client_profile_events 
Fix 02050_client_profile_events flakiness
 2021-12-20 15:02:02 +03:00
Maksim Kita
20e4ce3314 Short circuit evaluation function throwIf support 2021-12-20 14:49:05 +03:00
Maksim Kita
3feab5a975 Containers iteration fix erase 2021-12-20 13:42:31 +03:00
Maksim Kita
51826c14a0 Dictionaries added Date32 type support 2021-12-20 13:39:07 +03:00
Maksim Kita
7785eac384 Loops remove postfix increment 2021-12-20 13:32:13 +03:00
Kseniia Sumarokova
967738ff8f
Merge pull request #32749 from kssenii/table-override-pg 
Support Table Override clause for MaterializedPostgreSQL too
 2021-12-20 13:11:47 +03:00
Maksim Kita
2eb9b3118e
Merge pull request #32805 from kitaisreal/cache-dictionary-dictionary-source-access-race-fix 
CacheDictionary dictionary source access race fix
 2021-12-20 12:50:16 +03:00
save-my-heart
1abe978455 fix wrong modification_time after move part 2021-12-20 16:29:06 +08:00
凌涛
0efc01be05 add test 2021-12-20 13:53:08 +08:00
kssenii
965e2bfb21 Fix 2021-12-20 08:43:07 +03:00
bharatnc
b9787f730e use prefix increment for rows 2021-12-19 20:32:52 -08:00
bharatnc
15c555c161 simplify looping in S2 functions 
Previously replaced range based for loops in H3 functions with simple
for loops based on review. Similarly doing the same for the S2 functions
also.
 2021-12-19 20:00:28 -08:00
Azat Khuzhin
1d25ec3e82 Merge ProfileEvents in case they were not printed 
That way with --profile-events-delay-ms=-1 you will always get totals.

Plus, this will fix periodic failures, that can be reproduced by
limitting CPU (5% is enough in my setup), i.e.:

    $ systemd-run --collect --unit ch -p CPUQuota=5% --user clickhouse-server
    $ while clickhouse-client --print-profile-events --profile-events-delay-ms=-1 -q 'select * from numbers (1e5) format Null' |& tee /dev/stderr | fgrep 'SelectedRows: 131010 (increment)'; do :; done

And as a bonus it will make 02050_client_profile_events deterministic.
 2021-12-19 23:43:05 +03:00
Azat Khuzhin
6aebc3e94c Do not loose ProfileEvents in case of thread destroyed before 
v2: drop std::move and add copy ctor for ProfileEvents::Counter::Snapshot
v2: remove std::move
 2021-12-19 23:43:05 +03:00
Azat Khuzhin
909ce68b5a Do not suppress exception in ThreadStatus::~ThreadStatus() 2021-12-19 23:43:05 +03:00
kreuzerkrieg
f06c37d206 Stop reading incomplete stripes and skip rows. 2021-12-19 18:41:32 +02:00
Vitaly Baranov
02d6cea857 Lz4DeflatingWriteBuffer now supports changes in the nested buffer between calls. 2021-12-19 16:29:57 +03:00
Vitaly Baranov
708439b036 Support customized compression for input/output data in gRPC protocol. 2021-12-19 16:29:44 +03:00
alexey-milovidov
13d1377ad7
Update src/Functions/ReplaceRegexpImpl.h 
Co-authored-by: Vladimir C <vdimir@clickhouse.com>
 2021-12-19 12:59:28 +03:00
Alexey Milovidov
0d6e8e90eb Proper fix for #30245 2021-12-19 12:44:42 +03:00
alexey-milovidov
cee850b3be
Revert "fix replaceRegexpAll bug" 2021-12-19 11:32:34 +03:00
alexey-milovidov
d1d872329c
Merge pull request #32940 from nkolotov/fix_segfault_object_used_after_move 
Fixed segfault when smart pointer is dereferenced after move.
 2021-12-19 09:36:43 +03:00
alexey-milovidov
d3a1ffd05d
Merge pull request #32529 from dmthuc/fix_groupBitmapAnd_function_distributed_table 
fix groupBitmapAnd function on distributed table
 2021-12-19 08:28:26 +03:00
alexey-milovidov
74c2a38ea5
Merge pull request #32592 from ClickHouse/strange-code-tcphandler 
Fix strange code in TCPHandler
 2021-12-19 08:11:43 +03:00
mergify[bot]
4580af9f79
Merge branch 'master' into fix_segfault_object_used_after_move 2021-12-19 04:33:03 +00:00
N. Kolotov
b059154a81 Fixed segfault when smart pointer is dereferenced after move. 2021-12-18 23:13:42 +03:00
Denny Crane
293191247f
Update RemoteQueryExecutor.h 2021-12-18 15:50:16 -04:00
Denny Crane
aa52eff0ec
fix typo 2021-12-18 15:48:23 -04:00
Vladimir C
778cd76987
Merge pull request #32914 from vdimir/issue_32487 2021-12-18 10:18:51 +03:00
alexey-milovidov
5cd56b127f
Merge pull request #32912 from cmsxbc/fix-wrong-cases-in-gtest-parser 
fix wrong testcase in gtest_Parser
 2021-12-18 07:51:16 +03:00
alexey-milovidov
8571501cf7
Update AggregateFunctionTopK.cpp 2021-12-18 07:49:35 +03:00
kssenii
e6ebb55c4e Move to Interpreters 2021-12-17 22:19:10 +03:00
kssenii
dd902b6875 Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-17 22:03:58 +03:00
alexey-milovidov
6b97af4c63
Merge pull request #26869 from taylor12805/grouping-sets-dev 
Grouping sets dev
 2021-12-17 20:50:15 +03:00
Nikolai Kochetov
ffdcf52a9e
Merge pull request #32858 from ClickHouse/fix-has-column-in-table-subquery-2 
Always apply const-condition-if optimization.
 2021-12-17 20:39:30 +03:00
Nikolai Kochetov
93a33d52dc Merge branch 'fix-32668' of github.com:yandex/ClickHouse into fix-32668 2021-12-17 20:37:29 +03:00
Nikolai Kochetov
c8a92c046f Another try 2021-12-17 20:36:37 +03:00
Kseniia Sumarokova
f6e7e11742
Merge pull request #32907 from kssenii/url-better 
Better handling of globs for url storage
 2021-12-17 19:08:38 +03:00
Harry-Lee
ef36befd78 Issue 135: Fix null pointer dereference 2021-12-17 10:56:19 -05:00
root
6b3366dc70 [Issue #129] Fix Weak Regular Expression [v21.3-insecure] 
Problem Descripton:
==================
The “key_regexp” constant in the “DiskS3” class contains a regular expression (RegEx) for checking a key path.
However, the RegEx starts and ends with “.*”.
This is a wildcard that an attacker could use to exploit this file path check by padding the beginning and end with whatever path they’d like.

Recommendation:
==============
Tighten up the RegEx by replacing the “.*” at the beginning and end with more specific items.

Fix:
===
Replace the .* at the end with $ as there is no need to continue after the key file.
Leave the beginning .* as is because the path for the key can have any characters or in any path of the system.
 2021-12-17 10:30:16 -05:00
kssenii
40c266840c Fixes 2021-12-17 18:16:29 +03:00
Dao
2fb554c61f increase version to resolve conflict with master branch 2021-12-17 23:09:08 +08:00
vdimir
1eb032ac83
Style AggregateFunctionTopK.cpp 2021-12-17 18:04:59 +03:00
minhthucdao
001900655e
Merge branch 'master' into fix_groupBitmapAnd_function_distributed_table 2021-12-17 23:03:47 +08:00
Dao
52af96627c introduce new version and add test 2021-12-17 22:59:02 +08:00
vdimir
5c487b3bdc
Fix types for topKWeightedState 2021-12-17 17:54:12 +03:00
Kseniia Sumarokova
70937088e9
Merge pull request #32886 from kssenii/azure-rename 
Rename files and code from BlobStorage to AzureBlobStorage
 2021-12-17 16:59:08 +03:00
cmsxbc
ce6987ad4d
fix wrong testcase in gtest_Parser 2021-12-17 20:59:50 +08:00
alesapin
da1d04767c
Merge pull request #32366 from bigo-sg/keepersizeopt 
performance improve of keeper sizeInBytes calculation.
 2021-12-17 15:34:55 +03:00
Nikolai Kochetov
20b88d9b4c Always apply const if optimixation. 2021-12-17 15:31:30 +03:00
alesapin
6bd7e425c6
Merge pull request #22535 from CurtizJ/sparse-serialization 
Sparse serialization and ColumnSparse
 2021-12-17 15:26:17 +03:00
kssenii
b1794a47c3 StorageURL improve 2021-12-17 14:03:37 +03:00
Nikolai Kochetov
7b56e97cf8 Revert "Add debug logging" 
This reverts commit 49a9bc6b90.
 2021-12-17 13:26:05 +03:00
kssenii
ed42620530 Rename BlobStorage to AzureBlobStorage 2021-12-17 12:24:05 +03:00
Kseniia Sumarokova
77b3ebe44e
Merge pull request #32734 from kssenii/mysql-fix-timeouts 
Allow to control connection timeouts for mysql
 2021-12-17 10:13:33 +03:00
zzsmdfj
e9eed1f927 to #15182_MaterializeMySQL_support_bit_type 2021-12-17 15:03:24 +08:00
zhanglistar
e4006b2cfd
Merge branch 'ClickHouse:master' into keepersizeopt 2021-12-17 14:35:19 +08:00
tavplubix
db01e94f66
Merge pull request #32802 from ClickHouse/fix_restart_unavailable_mysql 
Fix restarting with unavailable MySQL
 2021-12-17 08:57:15 +03:00
alexey-milovidov
7dbdcf91bf
Merge pull request #32814 from ClickHouse/fix_skipped_mutations 
Fix skipping of some mutations
 2021-12-17 08:53:36 +03:00
kssenii
97222be3d9 Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-17 01:14:28 +03:00
kssenii
ca283a4bb8 Fix optimization with lazy seek 2021-12-17 00:18:28 +03:00
alexey-milovidov
6cb54b4092
Merge pull request #31965 from azat/connection-drain-pull 
Add ability to drain connections synchronously
 2021-12-16 23:40:31 +03:00
Nikolai Kochetov
96384fe4f3
Update WindowTransform.cpp 2021-12-16 21:20:39 +03:00
Nikolai Kochetov
82f94a35f9
Update WindowTransform.cpp 2021-12-16 21:20:01 +03:00
Nikolai Kochetov
e56553ef11
Update InterpreterSelectQuery.cpp 2021-12-16 21:18:35 +03:00
Nikolai Kochetov
e28bcbfcea Fix MV query with multiple chunk result. 2021-12-16 21:17:05 +03:00
Nikolai Kochetov
49a9bc6b90 Add debug logging 2021-12-16 20:29:04 +03:00
Nikolai Kochetov
4799f07922
Merge branch 'master' into fix-has-column-in-table-subquery-2 2021-12-16 19:02:58 +03:00
Nikolai Kochetov
1b8ed6276a Allow string for constant if consition optmization. 2021-12-16 19:00:59 +03:00
Anton Popov
7e39fd14c2 fix test 2021-12-16 16:44:55 +03:00
mergify[bot]
4722bc6649
Merge branch 'master' into fix_skipped_mutations 2021-12-16 13:25:00 +00:00
mergify[bot]
cf37a1ba07
Merge branch 'master' into fix_restart_unavailable_mysql 2021-12-16 13:17:13 +00:00
Dmitry Novik
0f3e2bb32f Fix removing constant columns 2021-12-16 15:39:25 +03:00
凌涛
bf1098484e modify code style 2021-12-16 20:31:06 +08:00
凌涛
ad34217873 Add hints for clickhouse client options 2021-12-16 20:19:00 +08:00
Anton Popov
2945eac8c9 fix build 2021-12-16 15:05:42 +03:00
mergify[bot]
214f072c48
Merge branch 'master' into fix_echo_option_not_used_in_batch_mode 2021-12-16 11:57:23 +00:00
alesapin
c338bee718
Revert "Fix build issue related to azure blob storage" 2021-12-16 14:37:12 +03:00
alesapin
c0cebaea79
Merge pull request #32788 from amosbird/buildfix 
Fix build issue related to azure blob storage
 2021-12-16 13:45:22 +03:00
Vladimir C
2f2d98d8be
Merge pull request #32811 from Algunenano/materialized_view_scalar_subqueries 2021-12-16 13:35:22 +03:00
N. Kolotov
adf5fcdd0a Fixed --echo option is not used by clickhouse-client in batch mode with single query. 2021-12-16 13:10:49 +03:00
Maksim Kita
858d9f0f5f StorageLiveView fix function style 2021-12-16 12:29:20 +03:00
Maksim Kita
33374f8b0a
Merge pull request #31062 from Enmk/Governance/view_comment 
Views with comment
 2021-12-16 12:27:12 +03:00
Kseniia Sumarokova
947ef81f53
Update ReadWriteBufferFromHTTP.h 2021-12-16 09:14:09 +03:00
zhanglistar
bc4a2ca073
Update KeeperStorage.cpp 
modify potential overflow sub.
 2021-12-16 09:25:38 +08:00
alexey-milovidov
6d82644094
Update DatabaseMySQL.cpp 2021-12-16 02:02:36 +03:00
alexey-milovidov
6083869b5d
Merge pull request #32669 from Algunenano/wip_mv_into_join 
Fix LOGICAL_ERROR when the target of a materialized view is a JOIN or a SET table
 2021-12-16 02:01:31 +03:00
alexey-milovidov
c7a5fb7582
Merge pull request #32507 from DMokhnatkin/apache-arrow-fix 
The proper handler for apache arrow column duplication
 2021-12-16 01:55:13 +03:00
alexey-milovidov
d112b30d78
Merge pull request #32291 from cmsxbc/fix-multiply-row-policies-on-same-column 
Fix broken select query with multiply row policies on same column
 2021-12-16 01:52:12 +03:00
alexey-milovidov
5293555d4d
Merge pull request #31797 from aiven/kmichel-fix-base64encode-too-fast 
Fix base64Encode adding trailing bytes on small strings
 2021-12-16 01:35:22 +03:00
kssenii
7583c8007e Some review fixes 2021-12-16 00:38:46 +03:00
mergify[bot]
41ae7c8eb1
Merge branch 'master' into fix_IP_conversion 2021-12-15 19:19:47 +00:00
Alexander Tokmakov
1b02136941 fix skipping of some mutations 2021-12-15 21:19:29 +03:00
Dmitry Novik
64b0365848 Fix build 2021-12-15 20:40:36 +03:00
Raúl Marín
c61277fbac Move the logic to the saving part instead 
This way we can reuse scalars from other queries (non MVs) and
leave the door open for future improvements
 2021-12-15 17:47:17 +01:00
Raúl Marín
f367634271 Do not use scalar cache when processing MV blocks 2021-12-15 17:25:30 +01:00
Dmitrii Mokhnatkin
2147658432
Proper handler for apache arrow column duplication 2021-12-15 18:30:32 +03:00
Maksim Kita
655cc20525
Merge pull request #32758 from kitaisreal/sql-user-defined-functions-support-subqueries 
SQLUserDefinedFunctions support subqueries
 2021-12-15 15:57:20 +03:00
Maksim Kita
ac3cb8c12b CacheDictionary dictionary source access race fix 2021-12-15 15:55:28 +03:00
kssenii
dc1f0c58fa Merge remote-tracking branch 'upstream/master' into table-override-pg 2021-12-15 15:27:58 +03:00
Anton Popov
ec46cbef20
Merge pull request #32756 from CurtizJ/fix-index-hypothesis 
Fix race in skipping index of type `hypothesis`
 2021-12-15 15:26:35 +03:00
Alexander Tokmakov
07bfbc26d6 fix restarting with unavailable mysql 2021-12-15 15:08:08 +03:00
alesapin
31600cdcf9 Clang-tidy mocking me 2021-12-15 13:02:17 +03:00
gulige
b244a4b9e5
Merge branch 'ClickHouse:master' into master 2021-12-15 17:14:37 +08:00
Amos Bird
9c9f4a3e6c
build fix 2021-12-15 16:55:18 +08:00
alesapin
d1dcd0adbf Followup 2021-12-15 11:44:18 +03:00
mergify[bot]
3a7179756f
Merge branch 'master' into fix-32668 2021-12-15 08:31:10 +00:00
kssenii
2e813fe3cd Update defaults 2021-12-15 08:18:43 +00:00
alesapin
2e8b75ade4 Fix configs 2021-12-15 10:45:27 +03:00
alesapin
2753fe01a3 Merge branch 'master' into fix_special_build_check 2021-12-15 10:35:28 +03:00
gulige
574bee9040
fix code refactoring as @kitaisreal suggested 2021-12-15 11:48:12 +08:00
gulige
c0aa1c3405
missing code refactoring as @kitaisreal suggested 2021-12-15 10:58:58 +08:00
gulige
c90bfaf78c
code refactoring as @kitaisreal suggested 
Better to not use emplace with std::npos, just find element, if it already exists then checkColumnStructure, after that we can safely update index_by_name and insert element.
 2021-12-15 10:23:34 +08:00
alexey-milovidov
de66f669b6
Merge pull request #32755 from cmsxbc/fix-fuzzbits-with-multiply-same-fixedstring 
fix crash fuzzbits with multiply same fixedstring
 2021-12-15 03:58:59 +03:00
mergify[bot]
003aeda627
Merge branch 'master' into fix-multiply-row-policies-on-same-column 2021-12-15 00:05:49 +00:00
mergify[bot]
4300f77532
Merge branch 'master' into fix_IP_conversion 2021-12-14 20:12:34 +00:00
Anton Popov
2e388a72da
Merge pull request #32742 from nautaa/flush_in_memory_part 
flush all InMemoryDataParts when wal is not enabled
 2021-12-14 23:09:10 +03:00
Kseniia Sumarokova
bf415378be
Merge pull request #32607 from Vxider/watch-events-supports 
Events clause support for Window View watch query
 2021-12-14 23:08:24 +03:00
Dmitry Novik
e8a96b53b1 Remove unused code 2021-12-14 22:44:54 +03:00
Dmitry Novik
56a3f4a000 Cleanup code 2021-12-14 22:15:14 +03:00
kssenii
47f549166d Table Override for PostgreSQL 2021-12-14 20:36:43 +03:00
mergify[bot]
c915b26a17
Merge branch 'master' into fix-multiply-row-policies-on-same-column 2021-12-14 16:21:35 +00:00
alesapin
d7663b2179 Merge branch 'master' into fix_special_build_check 2021-12-14 19:08:28 +03:00
alesapin
884801e1bd Fixing 2021-12-14 19:08:08 +03:00
Anton Popov
16312e7e4a Merge remote-tracking branch 'upstream/master' into HEAD 2021-12-14 18:58:17 +03:00
Maksim Kita
c4bc72672e SQLUserDefinedFunctions support subqueries 2021-12-14 18:46:21 +03:00
mergify[bot]
cda4b6d68b
Merge branch 'master' into fix-fuzzbits-with-multiply-same-fixedstring 2021-12-14 15:43:10 +00:00
Anton Popov
84d6715e3d fix race in skipping index of type hypothesis 2021-12-14 18:28:55 +03:00
cmsxbc
0b4a9ebce0
fix fuzzbits with multiply same fixedstring 2021-12-14 23:26:18 +08:00
Maksim Kita
233505b665
Merge pull request #32536 from azat/sparse_hashed-dict-fix 
Fix sparse_hashed dict performance with sequential keys (wrong hash function)
 2021-12-14 17:44:47 +03:00
Nikolai Kochetov
d394f0e753 Allpy some more optimizations to NO_QUERY ast. 2021-12-14 17:19:18 +03:00
alesapin
9974f10631 Fix clang tidy 2021-12-14 15:34:20 +03:00
nautaa
a96da58360 fix 2021-12-14 20:11:43 +08:00
nautaa
5545793555 Merge branch 'flush_in_memory_part' of github.com:nautaa/ClickHouse into flush_in_memory_part 2021-12-14 19:42:15 +08:00
nautaa
3469fb8165 fix 2021-12-14 19:40:35 +08:00