vdimir
0f1a7c252d
better TemporaryDataOnDisk
2022-09-29 09:51:46 +00:00
vdimir
9f3f34548c
Allow to create temporaty streams on leaf TemporaryDataOnDisk
2022-09-29 09:51:45 +00:00
vdimir
858769584f
Fix MergeSortingTransform
2022-09-29 09:51:43 +00:00
vdimir
15c7a3be34
Temp data on disk: build
2022-09-29 09:51:41 +00:00
vdimir
c0898ce289
Use abstraction for temporary data on disk in Sort and Aggregation
2022-09-29 09:51:41 +00:00
vdimir
ac39bbb3f1
[wip] Common interface for temporary data on disk
2022-09-29 09:51:40 +00:00
Robert Schulze
f24fab7747
Fix some #include atrocities
2022-09-28 13:49:28 +00:00
Robert Schulze
fd86829824
Consolidate config_core.h into config.h
...
Less duplication, less confusion ...
2022-09-28 13:31:57 +00:00
avogar
2583e6d3ce
Use string_view
2022-09-28 13:14:54 +00:00
Robert Schulze
09c62f6728
Consolidate config_formats.h into config.h
...
Less duplication, less confusion ...
2022-09-28 12:59:05 +00:00
Robert Schulze
78fc36ca49
Generate config.h into ${CONFIG_INCLUDE_PATH}
...
This makes the target location consistent with other auto-generated
files like config_formats.h, config_core.h, and config_functions.h and
simplifies the build of clickhouse_common.
2022-09-28 12:48:26 +00:00
Kruglov Pavel
f1ac2d66be
Merge branch 'master' into json-object-each-row
2022-09-28 14:15:02 +02:00
avogar
1bd7e531db
Better exception message for duplicate column names in schema inference
2022-09-28 12:07:25 +00:00
Kruglov Pavel
3dc54272ed
Merge branch 'master' into improve-combinators
2022-09-26 13:03:32 +02:00
Igor Nikonov
5aa92e470a
Merge branch 'master' into distinct_in_order_wo_order_by
2022-09-23 11:34:54 +02:00
Igor Nikonov
6551966dc7
Change the way reading in order is requested from plan optimizations
2022-09-22 20:47:00 +00:00
Igor Nikonov
9ea277c047
Remove unnecessary method from ReadFromMergeTree
2022-09-22 19:52:02 +00:00
Igor Nikonov
6f7d0fec52
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-22 19:38:34 +00:00
Nikolai Kochetov
00965ce17a
Fixing race.
2022-09-22 17:57:04 +00:00
avogar
6a1cb604c4
Style
2022-09-22 17:06:56 +00:00
avogar
4f32ef9bb7
Add docs
2022-09-22 17:04:42 +00:00
avogar
d3d06251a3
Add setting to obtain object name as column value in JSONObjectEachRow format
2022-09-22 16:48:54 +00:00
avogar
f23a77156f
Check file path for path traversal attacks in errors logger for input formats
2022-09-22 13:56:51 +00:00
Kruglov Pavel
2c83abaaba
Merge pull request #41614 from ClickHouse/Avogar-patch-1
...
Fix typos in JSON formats after #40910
2022-09-22 10:58:47 +02:00
Igor Nikonov
8c93a9adda
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-22 07:40:14 +00:00
Alexey Milovidov
1d1898bc88
Merge pull request #41586 from Algunenano/fix_missing_read_bytes_in_mv
...
Fix read bytes/rows in X-ClickHouse-Summary with materialized views
2022-09-22 07:32:16 +03:00
Alexey Milovidov
2a75e025f2
Merge pull request #40715 from ClickHouse/compress-marks
...
Merging #37693 : Compress marks and primary key
2022-09-22 07:30:34 +03:00
Alexey Milovidov
45afacdae4
Merge pull request #41186 from ClickHouse/fix-three-fourth-of-trash
...
Fix more than half of the trash
2022-09-22 07:28:26 +03:00
Nikolai Kochetov
446453bdf5
Fix a destruction order for views ThreadStatus
2022-09-21 18:37:40 +00:00
Nikita Taranov
100c055510
Prefetching in aggregation ( #39304 )
...
* impl
* stash
* clean up
* do not apply when HT is small
* make branch static
* also in merge
* do not hardcode look ahead value
* fix
* apply to methods with cheap key calculation
* more tests
* silence tidy
* fix build
* support HashMethodKeysFixed
* apply during merge only for cheap
* stash
* fixes
* rename method
* add feature flag
* cache prefetch threshold value
* fix
* fix
* Update HashMap.h
* fix typo
* 256KB as default l2 size
Co-authored-by: Alexey Milovidov <milovidov@clickhouse.com>
2022-09-21 18:59:07 +02:00
Nikolai Kochetov
1204f643f1
Merge pull request #41576 from ClickHouse/fix-partial-sort-optimisation-bug-from-41182
...
Fix a bug with missing rows after partial sort optimization
2022-09-21 16:47:18 +02:00
Nikolai Kochetov
7e0914c3ce
Merge pull request #41588 from ClickHouse/pipeline-stuck-and-offset
...
Fix possible pipeline stuck exception for queries with OFFSET
2022-09-21 16:42:42 +02:00
Igor Nikonov
c849dd4c76
Merge pull request #41574 from ClickHouse/igor/use_only_input_order_info
...
ReadFromMergeTree: reading in order only if input order info is provided
2022-09-21 15:36:51 +02:00
Arthur Passos
cf1ed58710
Use separate functions for parquet time32 and time64
2022-09-21 14:56:11 +02:00
Vladimir C
efa34b4013
Fix style
2022-09-21 14:56:11 +02:00
Arthur Passos
c0914a39a7
Add Parquet Time32/64 conversion to CH DateTime32/64
2022-09-21 14:56:11 +02:00
Kruglov Pavel
dcb8fbc3f8
Fix JSONEachRow
2022-09-21 14:25:34 +02:00
Kruglov Pavel
95135e1e31
Fix typos in JSON formats after #40910
2022-09-21 14:24:26 +02:00
Kruglov Pavel
22e11aef2d
Merge pull request #40910 from Avogar/new-json-formats
...
Add new JSON formats, add improvements and refactoring
2022-09-21 14:19:08 +02:00
Alexey Milovidov
45bd3cfc30
Merge branch 'master' into fix-three-fourth-of-trash
2022-09-20 21:27:41 +02:00
Igor Nikonov
f579da5b30
Merge remote-tracking branch 'origin/master' into igor/use_only_input_order_info
2022-09-20 15:01:33 +00:00
Nikolai Kochetov
0df2a31911
Fix possible pipeline stuck exception for queries with OFFSET
2022-09-20 14:58:53 +00:00
Igor Nikonov
757736679f
Fix build
2022-09-20 14:53:45 +00:00
Nikolai Kochetov
2b46735c42
Fix a bug with missing rows after partial sort optimisation #41182
2022-09-20 14:08:39 +00:00
avogar
b86aec41d4
Remove unused file after renaming
2022-09-20 13:54:54 +00:00
avogar
868ce8bc16
Fix comments, make better naming, add docs, add setting output_format_json_quote_64bit_floats
2022-09-20 13:49:17 +00:00
Igor Nikonov
394c2f708d
ReadFromMergeTree: reading in order only if input order info is provided
...
- remove checking optimize*in*order settings, input order info should be
set only if a corresponding optimization is enabled and applicable
2022-09-20 13:30:27 +00:00
Raúl Marín
133345eb37
Fix missing read bytes/rows in X-ClickHouse-Summary
2022-09-20 15:12:44 +02:00
Igor Nikonov
88b60f861f
Do not overwrite direction by distinct in order optimization
...
+ tests
2022-09-20 11:27:37 +00:00
Igor Nikonov
aca810ba62
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-19 18:34:38 +00:00
Igor Nikonov
78bb598d64
Handling DISTINCT in order on top of other read in order optimization
2022-09-19 18:33:05 +00:00
Kruglov Pavel
47f6f09ce0
Merge branch 'master' into improve-combinators
2022-09-19 14:31:12 +02:00
Igor Nikonov
81a46b6346
Merge remote-tracking branch 'origin/master' into fix_sort_desc_when_read_in_order
2022-09-19 09:40:23 +00:00
Igor Nikonov
54c2fed9cc
Update: use type explicitly
2022-09-19 09:31:45 +00:00
Alexey Milovidov
45b6052b20
Merge branch 'master' into compress-marks
2022-09-19 10:57:05 +02:00
Igor Nikonov
b4a3ac926f
Fix typo
2022-09-19 08:26:44 +00:00
Alexey Milovidov
730655d4fd
Fix 8/9 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
91baedf03a
Fix 6/7 of trash
2022-09-19 08:53:20 +02:00
Alexey Milovidov
84f42e0874
Fix 3/4 of trash
2022-09-19 08:50:53 +02:00
Alexey Milovidov
81e8cb4be6
Merge branch 'master' into fix-bug-orc
2022-09-19 06:38:17 +03:00
Alexey Milovidov
d4b9fe41be
Merge pull request #41457 from ClickHouse/remove-trash-5
...
Remove trash from Field
2022-09-19 06:36:48 +03:00
Igor Nikonov
785c33bf7d
Updating sort description for ReadFromMergeTree correctly
2022-09-18 23:35:21 +00:00
Igor Nikonov
e888859396
Fix: correct sort description for ReadFromMergeTree with read in order
...
optimization
2022-09-18 22:21:13 +00:00
Kruglov Pavel
519bcbb3be
Merge pull request #41236 from Avogar/fix-totals-extremes
...
Don't output totals/extremes in all row formats, update docs
2022-09-18 14:55:07 +02:00
Alexey Milovidov
8764fa4439
Fix very strange behavior of Apache ORC
2022-09-18 08:25:25 +02:00
Alexey Milovidov
791de6592b
Remove trash from Field
2022-09-18 05:16:08 +02:00
Alexey Milovidov
ada7a44ae4
Remove -WithTerminatingZero methods
2022-09-17 05:34:18 +02:00
Alexey Milovidov
c09604bef2
Merge pull request #41363 from kitaisreal/small-style-fixes
...
Small style fixes
2022-09-17 00:19:00 +03:00
Nikita Taranov
6f186d3dd2
Do not return empty blocks from ConvertingAggregatedToChunksTransform ( #41152 )
...
* impl
* add test
* update test
2022-09-16 21:54:36 +02:00
avogar
0101cc2e56
Support complex combinators in window transform, arrayReduce*, initializeAggregation and Aggregate functons versionning
2022-09-16 19:07:36 +00:00
Igor Nikonov
24de5530d6
Remove unnecessary headers
2022-09-16 17:16:32 +00:00
Igor Nikonov
b34ec6453b
Fix review comments
...
+ one more test
2022-09-16 17:11:08 +00:00
Kruglov Pavel
2d4a6b38af
Merge branch 'master' into fix-totals-extremes
2022-09-16 15:03:59 +02:00
Igor Nikonov
eeecaf7a31
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-16 10:30:52 +00:00
Igor Nikonov
ba1f7de243
Fix review comments
2022-09-16 10:30:30 +00:00
Alexey Milovidov
da01982652
Merge pull request #41046 from azat/build/llvm-15
...
Switch to llvm/clang 15
2022-09-16 07:31:06 +03:00
Maksim Kita
276d3628e9
Small style fixes
2022-09-15 13:05:18 +02:00
Igor Nikonov
da75d28019
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-15 10:54:42 +00:00
Kruglov Pavel
73cf72a5a4
Merge pull request #41309 from Avogar/fix-msgpack
...
Add column type check before UUID insertion in MsgPack format
2022-09-15 11:37:57 +02:00
Igor Nikonov
f011f72114
Try to apply optimization only if optimizer reaches pre distinct node
...
+ more comments
2022-09-14 20:55:49 +00:00
Igor Nikonov
bab5744a1d
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-14 17:54:46 +00:00
Igor Nikonov
d91ea0c5ab
Fix + tests
2022-09-14 17:54:05 +00:00
avogar
59e7eb084c
Add column type check before UUID insertion in MsgPack format
2022-09-14 11:15:10 +00:00
Kruglov Pavel
3396ff6c3a
Merge pull request #40516 from zjial/record_errors_for_import_by_csv
...
Record errors while reading text formats (CSV, TSV).
2022-09-14 12:52:32 +02:00
Igor Nikonov
c1dc77cd50
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-13 18:24:48 +00:00
Igor Nikonov
1be5a79e9f
Exclude const columns in distinct when matching with sorting key
...
+ tests
2022-09-13 18:23:55 +00:00
Igor Nikonov
c04d46bc96
Update data stream properties after reading in order applied
...
+ tests
2022-09-13 17:50:43 +00:00
Kruglov Pavel
110be0688e
Merge pull request #40909 from ClickHouse/Avogar-patch-1
...
Make better exception message in schema inference
2022-09-13 14:44:29 +02:00
Kruglov Pavel
17621b5607
Merge branch 'master' into fix-totals-extremes
2022-09-13 14:36:31 +02:00
Igor Nikonov
c129b31d7b
Test fix
2022-09-13 09:40:23 +00:00
zhenjial
5841d9e9b0
sync before destruct
2022-09-13 15:53:24 +08:00
zhenjial
67c08e3e22
sync before destruct
2022-09-13 15:06:22 +08:00
zhenjial
16c8cd0bd3
wait write finish
2022-09-13 14:19:40 +08:00
zhongyuankai
1477bb132f
Merge branch 'master' into compress_marks_and_primary_key
2022-09-13 11:05:57 +08:00
Igor Nikonov
1c9c303cce
Fix typos
2022-09-12 21:11:05 +00:00
Igor Nikonov
7502be3b75
Fixes
2022-09-12 20:11:24 +00:00
Kruglov Pavel
702ddff5f6
Fix style
2022-09-12 19:38:34 +02:00
Kruglov Pavel
060adfbe93
Merge branch 'master' into new-json-formats
2022-09-12 19:37:46 +02:00
avogar
8ac2fc7b26
Don't outout totals/extremes in all row formats, update docs
2022-09-12 17:21:40 +00:00
Igor Nikonov
bdd7c7c2c1
Merge remote-tracking branch 'origin/master' into distinct_in_order_wo_order_by
2022-09-12 17:02:23 +00:00
