thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-19 21:03:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
160,178 Commits 9,338 Branches 1,784 Tags 2.2 GiB
f8431372dc
Commit Graph

1361 Commits

Author SHA1 Message Date
avogar
6ee197ea59 Don't use serializations cache in const Dynamic column methods 2024-08-27 13:01:37 +00:00
Kruglov Pavel
a34191f3b1
Merge pull request #68681 from Avogar/fix-variant-permutation 
Fix ColumnVariant permutation
 2024-08-24 11:56:23 +00:00
Kruglov Pavel
d477bef82d
Merge pull request #68686 from Avogar/fix-structure-comparison-json 
Fix structure comparison between 2 JSON columns
 2024-08-24 11:56:12 +00:00
avogar
5d6b861ff0 Fix index with limit=0 2024-08-23 13:49:36 +00:00
Kruglov Pavel
2b20b2d4de
Update src/Columns/ColumnDynamic.cpp 
Co-authored-by: Dmitry Novik <mrnovikd@gmail.com>
 2024-08-23 15:02:43 +02:00
Kruglov Pavel
6f5210644b
Update src/Columns/ColumnObject.cpp 
Co-authored-by: Alexander Gololobov <davenger@clickhouse.com>
 2024-08-23 14:43:09 +02:00
avogar
1165ae756d Make dynamic structure selection more consistent 2024-08-23 12:16:16 +00:00
avogar
ca880ccdee Fix structure comparison between 2 JSON columns 2024-08-21 20:47:48 +00:00
avogar
38f9ef6bc9 Fix ColumnVariant permutation 2024-08-21 19:08:07 +00:00
Nikita Taranov
26743d9d08
Merge branch 'master' into better_parallel_hash2 2024-08-19 00:43:16 +02:00
avogar
32f4b1f891 Add aggregate functions distinctDynamicTypes/distinctJSONPaths/distinctJSONPathsAndTypes 2024-08-16 17:49:38 +00:00
Kruglov Pavel
39bc050e5f
Merge pull request #66444 from Avogar/json-data-type 
Implement new JSON data type.
 2024-08-16 10:29:29 +00:00
Nikita Taranov
42f67904d6 better 2024-08-15 21:58:03 +01:00
Nikita Taranov
9592847587 use index() 2024-08-15 21:57:49 +01:00
Kruglov Pavel
da4da13667
Fix style 2024-08-14 22:50:14 +02:00
avogar
7251bc59f8 Fix tidy build 2024-08-14 20:22:19 +00:00
李扬
2eaa9b9ae8
Merge branch 'ClickHouse:master' into opt_lc_name 2024-08-14 16:58:13 +08:00
avogar
217963757e Fix 2024-08-13 23:21:24 +00:00
avogar
55ede2dab6 Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-13 21:19:17 +00:00
avogar
c75112827c Fis style 2024-08-13 18:05:27 +00:00
avogar
6d2f17ea3b Add more tests 2024-08-13 17:12:38 +00:00
avogar
710cf1a223 Calculate statistics for paths in shared data 2024-08-13 13:55:57 +00:00
avogar
2896dd51d8 Implemenet prepareForSquashing for ColumnObject 2024-08-13 09:52:43 +00:00
Kruglov Pavel
01b2e67f2e
Merge branch 'master' into json-data-type 2024-08-12 23:32:35 +02:00
avogar
83cb991f75 Fix special build 2024-08-12 21:30:30 +00:00
avogar
8136e6a452 Update new prepareForSquashing method for ColumnDynamic 2024-08-12 21:29:26 +00:00
avogar
03182c7a8f Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-dynamic 2024-08-12 20:29:24 +00:00
Kruglov Pavel
ba85cc8d59
Merge pull request #67043 from Avogar/improve-squashing 
Improve columns squashing for String/Array/Map/Variant/Dynamic types
 2024-08-12 17:14:15 +00:00
avogar
44e267ec76 Fix conflicts and style check 2024-08-12 15:58:40 +00:00
avogar
cfd854882b Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 15:57:57 +00:00
avogar
44d4784da5 Use std::string_view for lookups in hash table 2024-08-12 15:52:39 +00:00
Kruglov Pavel
bba4a90a9c
Merge branch 'master' into better-dynamic 2024-08-12 17:28:09 +02:00
avogar
a329456146 Fix review comments 2024-08-12 13:47:10 +00:00
avogar
9296d4ecfb Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-08-12 11:55:39 +00:00
avogar
38f3131e11 Fix review comments 2024-08-12 11:39:36 +00:00
Yakov Olkhovskiy
9a45c136b8 merge master 2024-08-10 13:53:32 +00:00
Yakov Olkhovskiy
c1b5b908ba hide Field::get in private, only use Field::safeGet 2024-08-10 13:01:55 +00:00
avogar
d243feea21 Fix special builds 2024-08-10 11:21:28 +00:00
avogar
805a2e33bf Fix unit tests 2024-08-10 00:47:43 +00:00
avogar
c61eef4a76 Reimplement Dynamic type 2024-08-09 21:17:49 +00:00
taiyang-li
cfc10961ed fix getName() style for columnlowcardinality and columnunique 2024-08-09 15:56:36 +08:00
taiyang-li
6bab57caa7 Merge branch 'master' into opt_lc_name 2024-08-09 14:33:54 +08:00
taiyang-li
80633baab2 Merge remote-tracking branch 'origin/master' into short_circut_func 2024-08-07 12:06:13 +08:00
taiyang-li
f1dd46e940 Merge branch 'master' into short_circut_func 2024-08-07 11:51:36 +08:00
Kruglov Pavel
2c5687f3a4
Merge pull request #67122 from Avogar/variant-aggregate-column 
Fix crash with Variant + AggregateFunction type
 2024-08-05 10:49:22 +00:00
taiyang-li
94611dbddc keep ColumnLowCardinality::getName() the same style with other columns 2024-08-05 11:48:46 +08:00
avogar
aaa7750bf9 Handle dynamic columns in typed paths 2024-08-01 11:24:50 +00:00
avogar
9d14053cfe Proper fix for short circuit execution with nested dictGetOrDefaultt 2024-07-31 12:17:56 +00:00
avogar
a1ececb24c Fix use-of-unitialized-value 2024-07-30 11:51:48 +00:00
avogar
9581e39ddd Fix first batch of review 2024-07-29 12:14:53 +00:00
avogar
cd06945a03 Fix crash with Variant + AggregateFunction type 2024-07-25 13:05:25 +00:00
avogar
2381c3dbca Fix and rewrite tests 2024-07-24 19:11:51 +00:00
avogar
f37f228af9 Improve columns squashing for String/Array/Map/Variant/Dynamic types 2024-07-24 13:10:20 +00:00
avogar
ea15ad4ff5 Fix 2024-07-23 14:45:54 +00:00
avogar
3cb35efb31 Try to improve insert speed 2024-07-23 13:31:59 +00:00
avogar
bc7fd604b7 Fix tests, builds and docs 2024-07-23 10:10:15 +00:00
avogar
6e159791c2 Fix failing tests, add even more tests 2024-07-22 19:26:44 +00:00
avogar
a8e34f07a8 Fix debug build 2024-07-22 16:26:40 +00:00
avogar
300073f51d Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-07-22 15:35:57 +00:00
Nikita Taranov
c15699e32d
Merge pull request #66652 from ClickHouse/separate_macro_for_debug_or_san_build 
Introduce separate DEBUG_OR_SANITIZER_BUILD macro
 2024-07-22 14:52:13 +00:00
avogar
2626880f6e Fix special builds and tests 2024-07-22 14:28:07 +00:00
Alexey Milovidov
2beed8c304
Merge pull request #66579 from ClickHouse/fix-weak-hash-for-sparce 
Fix weak hash for sparse
 2024-07-21 04:32:17 +00:00
avogar
1ce13df07c Fix build 2024-07-20 21:47:45 +00:00
Kruglov Pavel
74670e7d20
Merge branch 'master' into json-data-type 2024-07-20 20:52:51 +02:00
avogar
519494a9d0 Add tests, docs, implement new syntax sugar for Array(JSON), fix small ugs 2024-07-20 18:51:20 +00:00
lgbo-ustc
09cf5b1188 column_length is not updated in ColumnTuple::insertManyFrom 2024-07-19 20:25:36 +08:00
Nikita Taranov
5608914bca impl 2024-07-17 16:59:31 +01:00
Nikolai Kochetov
05874d0b85 Fixing style. 2024-07-17 15:37:55 +00:00
Nikolai Kochetov
9b1e5c81d5
Merge branch 'master' into fix-weak-hash-for-sparce 2024-07-17 15:25:18 +02:00
Nikolai Kochetov
baade8baf4 Replace updateWeakHash to getWeakHash 2024-07-17 13:23:44 +00:00
Nikolai Kochetov
4dea89df76 Cleanup. 2024-07-16 13:50:58 +00:00
Nikolai Kochetov
04f3c29b60 Fix crash. 2024-07-16 13:47:38 +00:00
avogar
47e3e99924 Avoid calling type->getName 2024-07-16 10:06:21 +00:00
Nikolai Kochetov
2bc65fe208 Make ColumnSparse::updateWeakHash32 consistent with internal column. 2024-07-16 09:44:05 +00:00
avogar
43d86f9066 Unify SKIP and SKIP PREFIX hints, improve JSON parsing 2024-07-15 14:46:08 +00:00
avogar
8394c8ee67 Fix build 2024-07-12 16:43:08 +00:00
avogar
83037f534e Fix style 2024-07-12 16:07:38 +00:00
avogar
4848ad3fad Merge branch 'master' of github.com:ClickHouse/ClickHouse into json-data-type 2024-07-12 14:56:00 +00:00
avogar
dfc3db23b1 Implement new JSON data type 2024-07-12 14:38:14 +00:00
Sema Checherinda
a8e55ac816 Merge branch 'master' into revert-66134-revert-61601-chesema-dedup-matview 2024-07-11 18:01:12 +02:00
Alexey Milovidov
3c93091bd8
Merge pull request #65687 from ClickHouse/checks_for_column_type 
Introduce type contract checks in `IColumn`
 2024-07-10 23:40:34 +00:00
Kruglov Pavel
f3bfe8d881
Merge branch 'master' into data-types-binary-encoding 2024-07-09 12:27:06 +02:00
Nikita Taranov
1e48831d76 better 2024-07-08 18:21:06 +01:00
Sema Checherinda
f371daa7a7 Merge branch 'master' into revert-66134-revert-61601-chesema-dedup-matview 2024-07-08 18:56:36 +02:00
Nikita Taranov
b3993532a9 compareAt 2024-07-08 17:17:39 +01:00
Nikita Taranov
1b45ac30a2 insertFrom 2024-07-08 17:14:25 +01:00
Nikita Taranov
3be0ab5c4b insertManyFrom 2024-07-08 17:05:55 +01:00
Nikita Taranov
24dc3b4020 insertRangeFrom 2024-07-08 16:57:00 +01:00
Nikita Taranov
7dc3ae381f better 2024-07-08 15:51:13 +01:00
Nikita Taranov
55f363d5f0 better 2024-07-08 15:51:13 +01:00
Nikita Taranov
f972e80589 fix 2024-07-08 15:51:13 +01:00
Nikita Taranov
286f2abca2 try fix 2024-07-08 15:51:13 +01:00
Nikita Taranov
2302fcf9ac fix build 2024-07-08 15:51:13 +01:00
Nikita Taranov
dd1b85e63d add type check 2024-07-08 15:51:13 +01:00
Nikita Taranov
93d0f7a485 refactor 2024-07-08 15:51:12 +01:00
Michael Kolupaev
d4a4e4ec2d Fix crash when adding empty tuple to query cache 2024-07-05 22:43:33 +00:00
Sema Checherinda
5e4a244faf
Revert "Revert "insertion deduplication on retries for materialised views"" 2024-07-05 16:52:51 +02:00
Sema Checherinda
77e60543fd
Revert "insertion deduplication on retries for materialised views" 2024-07-05 14:58:17 +02:00
Kruglov Pavel
6239f7d62f
Merge branch 'master' into data-types-binary-encoding 2024-07-05 13:20:31 +02:00
taiyang-li
b3483d78b6 fix conflicts 2024-07-05 11:00:18 +08:00
taiyang-li
fc2f7001ca merge master and solve conflicts 2024-06-24 11:08:38 +08:00
taiyang-li
3cef295711 merge master and solve conflicts 2024-06-24 11:04:43 +08:00
avogar
b1f45da3eb Implement binary encoding for ClickHouse data types 2024-06-21 18:20:35 +00:00
Alexey Milovidov
d46e8fc84b Merge branch 'master' into fp16 2024-06-16 14:44:53 +02:00
Sema Checherinda
aab99ed70a Merge branch 'master' into chesema-dedup-matview 2024-06-14 16:43:26 +02:00
Nikita Taranov
dc1d710b82
Merge pull request #64783 from canhld94/fix_vertical_final2 
Remove bad optimization in vertical final implementation and re-enable vertical final
 2024-06-14 11:17:33 +00:00
Alexey Milovidov
efb31c1d3f
Merge pull request #60556 from HappenLee/master 
Remove useless virtual func call in ColumnNullable
 2024-06-14 11:11:40 +00:00
Sema Checherinda
979e84513b Merge branch 'master' into chesema-dedup-matview 2024-06-13 18:56:46 +02:00
Duc Canh Le
7f60444934 Merge branch 'master' into fix_vertical_final2 
Fix CI
 2024-06-11 03:34:53 +00:00
Raúl Marín
078f5f4ee0 Fix bug in short circuit evaluation 2024-06-07 13:10:12 +02:00
Alexey Milovidov
78506304b7
Merge pull request #55061 from amosbird/support-empty-tuple-2 
Support empty tuple [second implementation]
 2024-06-05 02:00:03 +02:00
Sema Checherinda
7794fd9ebc Merge branch 'master' into chesema-dedup-matview 2024-06-04 17:27:23 +02:00
Duc Canh Le
2d72e194fb remove bad optimization and re-enable vertical final 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2024-06-04 08:19:07 +00:00
Igor Markelov
52eb917ef0 Merge branch 'master' into add-compression-sorts-optimization 2024-06-03 20:47:04 +00:00
Raúl Marín
ee416a6862
Merge pull request #63723 from Algunenano/ifunction_column_size 
Add a bunch of important asserts
 2024-06-03 14:04:02 +00:00
Amos Bird
6fe266bc09
Fix build 2024-06-03 16:06:40 +08:00
Amos Bird
162a6c5685
Update src/Columns/ColumnTuple.cpp 
Co-authored-by: vdimir <vdimir@clickhouse.com>
 2024-06-03 16:05:45 +08:00
Amos Bird
d5835b6eea
Update src/Columns/ColumnTuple.h 
Co-authored-by: vdimir <vdimir@clickhouse.com>
 2024-06-03 16:05:45 +08:00
Amos Bird
f397853577
Fix more tests 2024-06-03 16:05:44 +08:00
Amos Bird
1826159c37
Fix tests 2024-06-03 16:05:44 +08:00
Amos Bird
7bec19a82d
Address reviews 2024-06-03 16:05:44 +08:00
Amos Bird
b2d6610d5f
Support empty tuple. 2024-06-03 16:05:42 +08:00
Alexey Milovidov
6e08f415c4 Preparation 2024-06-02 04:26:14 +02:00
Alexey Milovidov
ece972d3dc Merge branch 'master' into fp16 2024-06-02 02:57:44 +02:00
Sema Checherinda
96992b75e6 Merge branch 'master' into chesema-dedup-matview 2024-05-30 13:28:46 +02:00
Igor Markelov
f3563d81bd Merge branch 'master' into add-compression-sorts-optimization 2024-05-30 01:57:32 +00:00
Jiebin Sun
010c2cad1c Replace the offsets.size() in Iterator with offsets_size to avoid frequent call of size() 
The `isDefault()` of Iterator in sparse column will frequently use size() to check
the boundary. We can use the offsets_size instead as offsets will not change in the
Iterator.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
 2024-05-29 22:38:10 +08:00
Alexey Milovidov
2f1fb6c5d8
Merge pull request #64426 from jiebinn/SparseColumnIteratorIncrease 
Reduce the redundant `isDefault()` of `ColumnSparse::filter` to improve performance
 2024-05-29 02:23:27 +02:00
Sema Checherinda
3dbd290f21 Merge branch 'master' into chesema-dedup-matview 2024-05-28 18:33:00 +02:00
Igor Markelov
ee60ec52cc Merge branch 'master' into add-compression-sorts-optimization 2024-05-28 12:34:49 +00:00
Anton Popov
fe2c7efc41
Merge pull request #64311 from CurtizJ/sparse-columns-vertical-merge 
Do not convert sparse columns to full on vertical merge
 2024-05-28 11:21:21 +00:00
Jiebin Sun
48ca5d48b1 Reduce the redundant isDefault() of ColumnSparse::filter to improve performance 
Add two methods in the Interator of ColumnSparse. Replace the `++offset_it`
with `offset_it.increaseCurrentRow()` and `offset_it.increaseCurrentOffset()`,
to remove the redundant `isDefault()` in `++` of `Interator` and reuse the
following `isDefault()`.

Test the patch with Q10 of ClickBench on 80x2 vCPUs and the QPS has got
9.6% performance gain.

Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
 2024-05-28 00:43:39 +08:00
Robert Schulze
335a0844f5
Cosmetics and docs 2024-05-27 09:41:29 +00:00
Igor Markelov
1cc5b62c4b Add estimateCardinalityInPermutedRange for ColumnLowCardinality 2024-05-26 19:40:17 +00:00
Igor Markelov
47b347c96c Add estimateCardinalityInPermutedRange for ColumnNullable 2024-05-26 19:26:55 +00:00
Igor Markelov
9412b5debd Add estimateCardinalityInPermutedRange for ColumnVector 2024-05-26 19:23:17 +00:00
Igor Markelov
9202e46ff5 Add estimateCardinalityInPermutedRange for ColumnFixedString 2024-05-26 17:05:56 +00:00
Igor Markelov
11e4fbcf2c Change to .size() usage 2024-05-26 16:38:58 +00:00
Igor Markelov
3b6a2902fe Merge branch 'add-compression-sorts-optimization' of github.com:ElderlyPassionFruit/ClickHouse into add-compression-sorts-optimization 2024-05-26 15:36:36 +00:00
Robert Schulze
b909989e0f
Polish and document stuff 2024-05-26 15:10:26 +00:00
Igor Markelov
bd02ef23e3 Merge branch 'master' into add-compression-sorts-optimization 2024-05-26 14:45:54 +00:00
Michael Kolupaev
ee3e7f2fd0
Merge pull request #60361 from copperybean/gcmaster-parquet 
A native parquet reader for primitive types
 2024-05-24 04:50:12 +00:00
Anton Popov
0383fa5164 do not convert sparse columns to full on vertical merge 2024-05-23 18:45:31 +00:00
Raúl Marín
a64ce7de69 Tidy 2024-05-23 11:23:23 +02:00
Igor Markelov
63d7a59bf8 Fix logical error 2024-05-22 20:50:11 +00:00
Igor Markelov
cac53af37c Fix style 2024-05-22 17:02:56 +00:00
Igor Markelov
904ed2fc8a Fix style 2024-05-22 16:49:36 +00:00
avogar
48cab9e9db Fix tests 2024-05-22 15:53:32 +00:00
Igor Markelov
be4f007e9d Refactor EqualRange 2024-05-22 15:38:50 +00:00
Igor Markelov
a9c07ca436 Remove sampling 2024-05-22 10:56:29 +00:00