李扬
|
465962df7f
|
Support orc filter push down (file + stripe + rowgroup level) (#55330)
* support orc filter push down
* update orc lib version
* replace setqueryinfo with setkeycondition
* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536
* refactor source with key condition
* fix building error
* remove std::cout
* update orc
* update orc version
* fix bugs
* improve code
* upgrade orc lib
* fix code style
* change as requested
* add performance tests for orc filter push down
* add performance tests for orc filter push down
* fix all bugs
* fix default as null issue
* add uts for null as default issues
* upgrade orc lib
* fix failed orc lib uts and fix typo
* fix failed uts
* fix failed uts
* fix ast fuzzer tests
* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html
* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm
* fix wrong performance tests
* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html
* add some comments
* add some comments
* inline range::equals and range::less
* fix data race of key condition
* trigger ci
|
2023-10-24 12:08:17 -07:00 |
|
Kruglov Pavel
|
6dcc756948
|
Fix for azure
|
2023-10-16 12:38:55 +02:00 |
|
avogar
|
3e08800cb5
|
Forbid special columns for file/s3/url/... storages, fix insert into ephemeral columns from files
|
2023-09-20 16:25:55 +00:00 |
|
Robert Schulze
|
f5e8028bb1
|
Merge pull request #54642 from rschu1ze/broken-re2st
Remove broken lockless variant of re2
|
2023-09-17 15:30:57 +02:00 |
|
Robert Schulze
|
7b378dbad3
|
Remove broken lockless variant of re2
|
2023-09-14 16:40:42 +00:00 |
|
avogar
|
2d8f33bfa2
|
Fix parsing error in WithNames formats while reading subset of columns with disabled input_format_with_names_use_header
|
2023-09-11 14:55:37 +00:00 |
|
avogar
|
c4f8113a78
|
Fix tests
|
2023-08-24 15:05:45 +00:00 |
|
Kruglov Pavel
|
685ffc5856
|
Fix style
|
2023-08-23 22:51:14 +02:00 |
|
Kruglov Pavel
|
f7e1abd774
|
Merge branch 'master' into cache-count
|
2023-08-23 22:31:49 +02:00 |
|
avogar
|
894513f6cd
|
Fix tests
|
2023-08-23 18:43:08 +00:00 |
|
Kruglov Pavel
|
592fa77987
|
Merge branch 'master' into cache-count
|
2023-08-23 15:18:02 +02:00 |
|
Kruglov Pavel
|
7e362a2110
|
Merge branch 'master' into fast-count-from-files
|
2023-08-23 15:13:20 +02:00 |
|
robot-ch-test-poll1
|
c22ffa6195
|
Merge pull request #53529 from Avogar/filter-files-all-table-functions
Use filter by file/path before reading in url/file/hdfs table functins
|
2023-08-23 14:21:23 +02:00 |
|
Kruglov Pavel
|
67c5c0203b
|
Merge branch 'master' into fast-count-from-files
|
2023-08-22 15:03:48 +02:00 |
|
avogar
|
7f9e81d504
|
Clean up
|
2023-08-22 12:55:00 +00:00 |
|
Kruglov Pavel
|
c0bdd0e00b
|
Merge branch 'master' into cache-count
|
2023-08-22 14:42:22 +02:00 |
|
avogar
|
b4145aeddc
|
Cache number of rows in files for count in file/s3/url/hdfs/azure functions
|
2023-08-22 11:59:59 +00:00 |
|
Michael Kolupaev
|
2f4d433e69
|
Parquet filter pushdown
|
2023-08-21 14:15:52 -07:00 |
|
avogar
|
47304bf7aa
|
Optimize count from files in most input formats
|
2023-08-21 12:30:52 +00:00 |
|
avogar
|
8e445b5461
|
Fixes
|
2023-08-18 17:49:40 +00:00 |
|
avogar
|
4c32097df3
|
Use filter by file/path before reading in url/file/hdfs table functions, reduce code duplication
|
2023-08-17 16:54:43 +00:00 |
|
SmitaRKulkarni
|
1e3ae89161
|
Merge branch 'master' into azure_table_function_cluster
|
2023-08-04 21:39:32 +02:00 |
|
Smita Kulkarni
|
5cdc50b9ba
|
Fixed style
|
2023-08-03 11:31:15 +02:00 |
|
Anton Popov
|
ff137773e7
|
Merge branch 'master' into formats-with-subcolumns
|
2023-08-02 15:24:56 +02:00 |
|
Smita Kulkarni
|
2c47679918
|
Merge branch 'master' into azure_table_function_cluster
|
2023-08-02 14:19:45 +02:00 |
|
alesapin
|
0ee9797fb8
|
Merge pull request #51141 from ClickHouse/azure_blob_storage_sas_token
Azure blob storage sas token
|
2023-08-01 12:27:17 +02:00 |
|
Kruglov Pavel
|
0d34e97dbe
|
Merge branch 'master' into formats-with-subcolumns
|
2023-07-26 13:30:35 +02:00 |
|
Smita Kulkarni
|
342af64428
|
Fixed issue when multiple requests attempt to create same container
|
2023-07-18 18:20:03 +02:00 |
|
SmitaRKulkarni
|
e4fb9e88f8
|
Merge branch 'master' into azure_table_function_cluster
|
2023-07-17 17:23:38 +02:00 |
|
SmitaRKulkarni
|
3bb7db45c4
|
Merge branch 'master' into azure_blob_storage_sas_token
|
2023-07-17 17:23:29 +02:00 |
|
Smita Kulkarni
|
56e45ba384
|
Added test for select query when container does not exist
|
2023-07-06 11:17:04 +02:00 |
|
Smita Kulkarni
|
2d3a148ffd
|
Added option to check if container exists before attempting to read/create it, added this flag for all table functions, only used in azureBlobStorage
|
2023-07-06 10:56:07 +02:00 |
|
avogar
|
d11cd0dc30
|
Fix tests
|
2023-07-05 17:56:03 +00:00 |
|
Kruglov Pavel
|
a2805f8f44
|
Merge branch 'master' into formats-with-subcolumns
|
2023-07-04 23:27:03 +02:00 |
|
avogar
|
98aa6b317f
|
Support reading subcolumns from file/s3/hdfs/url/azureBlobStorage table functions
|
2023-07-04 21:17:26 +00:00 |
|
avogar
|
f88c1fdf44
|
Fixes
|
2023-06-29 11:59:09 +00:00 |
|
avogar
|
4eeb431003
|
Merge branch 'master' of github.com:ClickHouse/ClickHouse into better-progress-bar-2
|
2023-06-28 18:53:08 +00:00 |
|
Smita Kulkarni
|
223b954205
|
Fixed glob iterator for table function cluster path without regex characters
|
2023-06-28 11:09:19 +02:00 |
|
Smita Kulkarni
|
81b5ad3b26
|
Fixed else if syntax error
|
2023-06-27 16:51:17 +02:00 |
|
Nikita Mikhaylov
|
dc0dc227e0
|
Merge pull request #51455 from ClickHouse/many-fixes
Many fixes
|
2023-06-27 13:57:17 +02:00 |
|
Smita Kulkarni
|
9734871345
|
Merge branch 'master' into azure_table_function_cluster
|
2023-06-27 11:09:44 +02:00 |
|
SmitaRKulkarni
|
0762e981d8
|
Merge branch 'master' into azure_blob_storage_sas_token
|
2023-06-27 09:47:23 +02:00 |
|
SmitaRKulkarni
|
dcf581a985
|
Merge pull request #50936 from ClickHouse/Fix_race_azure_blob_storage_iterator
Fix race azure blob storage iterator
|
2023-06-27 09:27:45 +02:00 |
|
Smita Kulkarni
|
8dafd66c8d
|
Updated creating container using connection string
|
2023-06-26 16:35:16 +02:00 |
|
Smita Kulkarni
|
56c73cab0d
|
Fix azure test fails and updated to work without create privileges
|
2023-06-26 13:30:22 +02:00 |
|
Alexey Milovidov
|
b8e6bd3299
|
Merge branch 'master' into refactor-subqueries-for-in
|
2023-06-26 06:05:12 +03:00 |
|
avogar
|
21baa18969
|
Fix azure
|
2023-06-23 14:16:09 +00:00 |
|
avogar
|
c679dd400e
|
Make better
|
2023-06-23 13:43:40 +00:00 |
|
Smita Kulkarni
|
b5ad349c4f
|
Removed unwanted atomic variables to non atomic
|
2023-06-23 14:34:24 +02:00 |
|
Smita Kulkarni
|
db8120722f
|
Separated functionality of Iterator into GlobIterator and KeysIterator, added test for filter by file
|
2023-06-23 12:00:20 +02:00 |
|