thevar1able/ClickHouse
1
0
Fork 0
mirror of https://github.com/ClickHouse/ClickHouse.git synced 2024-12-13 01:41:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
130,829 Commits 9,322 Branches 1,783 Tags 2.1 GiB
febdd542f8
Commit Graph

11778 Commits

Author SHA1 Message Date
Kseniia Sumarokova
e428e4ed7a
Merge branch 'master' into cache-config-improvement 2023-11-13 10:09:58 +01:00
Alexey Milovidov
82c461031e Fix build 2023-11-13 10:09:23 +01:00
Alexey Milovidov
9a7f5ab0a1 Better use of build cache 2023-11-13 08:54:24 +01:00
Alexey Milovidov
a044c61c79 Merge branch 'master' of github.com:ClickHouse/ClickHouse into system-symbols 2023-11-13 03:27:37 +01:00
robot-ch-test-poll
0d8af2c119
Merge pull request #56545 from rschu1ze/qc-alias 
Fix handling of aliases in query cache
 2023-11-13 02:17:41 +01:00
Robert Schulze
bea529c9a1
Try to stabilize test results 2023-11-12 15:11:38 +00:00
Robert Schulze
91f53514d9
Incorporate review feedback 2023-11-12 15:11:38 +00:00
Robert Schulze
52c825db44
Query cache: Allow to ignore non-deterministic queries 
Fixes: #56504
 2023-11-12 15:11:38 +00:00
Robert Schulze
3f49e1c5ed
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-12 11:43:19 +00:00
Robert Schulze
90711b1b99
Fix test failures 2023-11-12 11:06:58 +00:00
Alexey Milovidov
bd78cc3445 Merge branch 'master' into system-symbols 2023-11-12 00:15:55 +01:00
Alexey Milovidov
744570f825
Merge pull request #56616 from ClickHouse/remove-dependencies 
Remove dependencies
 2023-11-11 09:38:55 +01:00
Alexey Milovidov
c52a91caf6 Remove dependencies 2023-11-11 06:59:20 +01:00
Alexey Milovidov
58319f08be Merge branch 'master' into system-symbols 2023-11-11 04:12:37 +01:00
Alexey Milovidov
3bec4dce8e Merge branch 'master' into remove-cpp-templates-2 2023-11-11 00:50:32 +01:00
Yakov Olkhovskiy
477c90729d Merge remote-tracking branch 'origin/master' into fix-analyzer-mv-scalars 2023-11-10 19:06:30 +00:00
Yakov Olkhovskiy
7baca92766 Merge remote-tracking branch 'origin/master' into fix-analyzer-mv-scalars 2023-11-10 14:14:22 +00:00
Robert Schulze
8ad124ef64
Fix #56258, attempt II 2023-11-10 14:03:13 +00:00
kssenii
b898e90bc1 Better 2023-11-10 14:31:00 +01:00
Nikolay Degterinsky
a6ebeb8422
Merge pull request #56484 from evillique/fix-on-cluster 
Fix ON CLUSTER queries without database on initial node
 2023-11-10 13:40:41 +01:00
Nikolay Degterinsky
07b2cdb614
Merge pull request #56491 from evillique/fix-alter-comment-on-cluster 
Fix ALTER COMMENT queries ON CLUSTER
 2023-11-10 13:35:26 +01:00
kssenii
a7fb6a30f8 Better 2023-11-10 13:29:01 +01:00
kssenii
214ac112a7 Looks fixed 2023-11-10 12:48:03 +01:00
Nikolai Kochetov
687eaeb186
Update InterpreterExplainQuery.cpp 2023-11-10 12:34:25 +01:00
Nikolai Kochetov
d233743200
Merge pull request #56531 from kitaisreal/analyzer-log-used-row-policies 
Analyzer log used row policies
 2023-11-10 12:26:11 +01:00
Kseniia Sumarokova
7c0e243278
Merge branch 'master' into fix-backup-restore-with-mv 2023-11-10 11:44:19 +01:00
Kseniia Sumarokova
ecd98006ce
Merge pull request #56306 from ClickHouse/fix-backup-restore-flatten-nested 
Fix restore from backup with `flatten_nested` and `data_type_default_nullable`
 2023-11-10 11:43:17 +01:00
Kseniia Sumarokova
e48df94772
Merge pull request #56377 from ClickHouse/minor-improvements-for-s3-queue 
Minor improvements for S3Queue
 2023-11-10 11:28:09 +01:00
Yakov Olkhovskiy
2544a15c94 optimization, comment 2023-11-10 05:59:24 +00:00
Alexey Milovidov
7fb04acc03 Miscellaneous 2023-11-10 06:13:21 +01:00
Alexey Milovidov
e5df9de12b Merge branch 'remove-cpp-templates-2' into system-symbols 2023-11-10 05:28:45 +01:00
Alexey Milovidov
8c253b9e3e Remove C++ templates 2023-11-10 05:25:02 +01:00
Alexey Milovidov
2b7346d755 Better warning message 2023-11-09 23:38:30 +01:00
Alexey Milovidov
d86c5ba28b Better warning message 2023-11-09 23:37:18 +01:00
kssenii
c28c1ac4a2 Allow getting cache configuration from named collection 2023-11-09 18:39:16 +01:00
Maksim Kita
bf37f05ccd Analyzer log used row policies 2023-11-09 19:43:31 +03:00
Maksim Kita
6fb7d44b62 Analyzer support EXPLAIN ESTIMATE 2023-11-09 19:43:14 +03:00
kssenii
b141726ad7 Fix for data_type_default_nullable 2023-11-09 17:21:12 +01:00
kssenii
ae09b16701 Debug logging 2023-11-09 17:05:11 +01:00
kssenii
41a880e57c Review fix 2023-11-09 16:03:51 +01:00
Nikolai Kochetov
0bfa2b6975
Merge pull request #56254 from ClickHouse/aggregate-by-partition-analyzer 
Properly process aliases for aggregation-by-partition optimization.
 2023-11-09 12:49:25 +01:00
Nikolay Degterinsky
96f558f51a Fix ALTER COMMENT queries ON CLUSTER 2023-11-09 06:19:00 +00:00
Nikolay Degterinsky
cc0d447c52 Fix ON CLUSTER queries without local database 2023-11-08 23:30:35 +00:00
Robert Schulze
cba4810910
Simplify a little bit 2023-11-08 22:10:34 +00:00
kssenii
93e22e85d1 Better 2023-11-08 17:16:56 +01:00
kssenii
dbea50738b Merge remote-tracking branch 'origin/master' into fs-cache-improvement 2023-11-08 11:53:54 +01:00
Robert Schulze
38c76eb709
Merge remote-tracking branch 'rschu1ze/master' into pcg 2023-11-08 09:43:27 +00:00
flynn
468d5493fa Merge branch 'master' of github.com:ClickHouse/ClickHouse into alter 2023-11-08 07:31:23 +00:00
Nikita Taranov
c52571223e better 2023-11-07 22:04:13 +01:00
Robert Schulze
e46dbcb2f1
Use pcg/randomSeed() random generator/seed instead of std::mt19937/std::random_device 2023-11-07 18:54:50 +00:00
kssenii
9178fd4ad1 Fix case with replicated database 2023-11-07 16:02:51 +01:00
serxa
19aa1375fc Merge branch 'master' into async-loader-integration 2023-11-07 10:25:38 +00:00
vdimir
43bf718318
Fix crash in filterPushDown 2023-11-07 09:44:14 +00:00
Duc Canh Le
1fa6130072 small refactor 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-11-07 01:27:53 +00:00
kssenii
10571d905a Fix 2023-11-06 18:32:29 +01:00
Nikita Taranov
1f2f51844f smart fix 2023-11-06 17:32:11 +01:00
Robert Schulze
5cfcf98d4a
Merge pull request #56277 from rschu1ze/show-columns-connection-type 
Make type names in `SHOW COLUMNS` dependent on connection type
 2023-11-06 16:24:27 +01:00
kssenii
f2c0434c4d Merge remote-tracking branch 'origin/master' into minor-improvements-for-s3-queue 2023-11-06 15:51:11 +01:00
kssenii
da21413354 Better shutdown 2023-11-06 15:47:57 +01:00
serxa
96c902b30f fix ddl worker startup 2023-11-06 14:46:01 +00:00
Alexander Tokmakov
eba52b318d
Merge pull request #56272 from ClickHouse/rdb_fix_rare_logical_error 
Fix rare logical error in Replicated database
 2023-11-06 14:14:55 +01:00
serxa
d50747847d rework AsyncLoaderPoolId.h to match settings and metrics 2023-11-06 13:08:27 +00:00
serxa
6babc8e934 rename metrics for new pools to match settings 2023-11-06 12:24:00 +00:00
Duc Canh Le
4c21ba7b6f tables auto initialize new disks without restart 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-11-06 10:26:48 +00:00
Robert Schulze
049c811a38
Make type names in SHOW COLUMNS dependent only on connection type 2023-11-05 21:20:20 +00:00
flynn
cc5179078c remove unused code 
Fix
 2023-11-05 02:30:10 +00:00
Alexey Milovidov
cd94d02455 Merge branch 'master' into coverage 2023-11-04 21:49:59 +01:00
flynn
83689c2a04 Support create and materialized index in the same alter query 2023-11-04 14:35:39 +00:00
Nikolay Degterinsky
35d785592b
Merge pull request #56232 from evillique/fix-startup-crash 
Fix a crash during table loading on startup
 2023-11-03 23:28:16 +01:00
Nikita Taranov
5040a3b6d3 do seek before calling isContentCached() 2023-11-03 22:52:12 +01:00
Dmitry Novik
23564148f9 Merge remote-tracking branch 'origin/master' into parallel-window 2023-11-03 17:53:51 +00:00
kssenii
ea5796fcb6 Fix 2023-11-03 16:46:55 +01:00
Kruglov Pavel
81b1ca22bb
Merge pull request #51823 from canhld94/ch_add_max_execution_time_leaf 
Add a setting max_execution_time_leaf to limit the execution time on shard for distributed query
 2023-11-03 13:31:15 +01:00
Nikolai Kochetov
8707b75ad8
Merge pull request #56274 from ClickHouse/fix-union-with-view 
Fix incomplete query result for UNION in view() function.
 2023-11-03 12:45:58 +01:00
vdimir
55a1baf029
Merge pull request #56022 from ClickHouse/vdimir/check_all_tables 
Add CHECK query for all the tables
 2023-11-03 10:10:42 +01:00
Nikolai Kochetov
f08c13a2ba Fix incomplete query result for UNION in view() function. 2023-11-02 18:33:57 +00:00
Yakov Olkhovskiy
ba72cf4dc6 early session ID release 2023-11-02 17:34:46 +00:00
Alexander Tokmakov
0ce1560e5d retry if table replica being restarted 2023-11-02 18:30:32 +01:00
serxa
c1c390348e DatabaseCatalog::getTable() should also wait 2023-11-02 17:07:21 +00:00
serxa
e97edf5285 Merge branch 'master' into async-loader-integration 2023-11-02 14:56:32 +00:00
Antonio Andelic
33d0974262 Check if system_logs exist 2023-11-02 14:46:06 +00:00
Nikolai Kochetov
5b6bf58730 Proper process aliases for aggregation-by-partition optimization. 2023-11-02 11:19:37 +00:00
Duc Canh Le
1929901c7d better implementation 
Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
 2023-11-02 07:30:44 +00:00
Nikolay Degterinsky
f3dd317edd Fix a crash during table loading on startup 2023-11-02 02:41:09 +00:00
Nikolay Degterinsky
1af52d3b00 Better 2023-11-02 00:42:57 +00:00
Alexey Milovidov
10d3a9b818
Update SelectStreamFactory.cpp 2023-11-01 22:51:14 +03:00
Alexey Milovidov
b2187d4b2e
Merge branch 'master' into ch_add_max_execution_time_leaf 2023-11-01 19:57:34 +01:00
Kseniia Sumarokova
12d85ac697
Merge pull request #56194 from ClickHouse/add-sharing-for-cache-keys 
Shard fs cache keys
 2023-11-01 17:48:15 +01:00
Azat Khuzhin
c25d6cd624
Rename directory monitor concept into background INSERT (#55978) 
* Limit log frequence for "Skipping send data over distributed table" message

After SYSTEM STOP DISTRIBUTED SENDS it will constantly print this
message.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename directory monitor concept into async INSERT

Rename the following query settings (with preserving backward
compatiblity, by keeping old name as an alias):
- distributed_directory_monitor_sleep_time_ms -> distributed_async_insert_sleep_time_ms
- distributed_directory_monitor_max_sleep_time_ms -> distributed_async_insert_max_sleep_time_ms
- distributed_directory_monitor_batch -> distributed_async_insert_batch_inserts
- distributed_directory_monitor_split_batch_on_failure -> distributed_async_insert_split_batch_on_failure

Rename the following table settings (with preserving backward
compatiblity, by keeping old name as an alias):
- monitor_batch_inserts -> async_insert_batch
- monitor_split_batch_on_failure -> async_insert_split_batch_on_failure
- directory_monitor_sleep_time_ms -> async_insert_sleep_time_ms
- directory_monitor_max_sleep_time_ms -> async_insert_max_sleep_time_ms

And also update all the references:

    $ gg -e directory_monitor_ -e monitor_ tests docs | cut -d: -f1 | sort -u | xargs sed -e 's/distributed_directory_monitor_sleep_time_ms/distributed_async_insert_sleep_time_ms/g' -e 's/distributed_directory_monitor_max_sleep_time_ms/distributed_async_insert_max_sleep_time_ms/g' -e 's/distributed_directory_monitor_batch_inserts/distributed_async_insert_batch/g' -e 's/distributed_directory_monitor_split_batch_on_failure/distributed_async_insert_split_batch_on_failure/g' -e 's/monitor_batch_inserts/async_insert_batch/g' -e 's/monitor_split_batch_on_failure/async_insert_split_batch_on_failure/g' -e 's/monitor_sleep_time_ms/async_insert_sleep_time_ms/g' -e 's/monitor_max_sleep_time_ms/async_insert_max_sleep_time_ms/g' -i

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Rename async_insert for Distributed into background_insert

This will avoid amigibuity between general async INSERT's and INSERT
into Distributed, which are indeed background, so new term express it
even better.

Mostly done with:

    $ git di HEAD^ --name-only | xargs sed -i -e 's/distributed_async_insert/distributed_background_insert/g' -e 's/async_insert_batch/background_insert_batch/g' -e 's/async_insert_split_batch_on_failure/background_insert_split_batch_on_failure/g' -e 's/async_insert_sleep_time_ms/background_insert_sleep_time_ms/g' -e 's/async_insert_max_sleep_time_ms/background_insert_max_sleep_time_ms/g'

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Mark 02417_opentelemetry_insert_on_distributed_table as long

CI: https://s3.amazonaws.com/clickhouse-test-reports/55978/7a6abb03a0b507e29e999cb7e04f246a119c6f28/stateless_tests_flaky_check__asan_.html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-11-01 15:09:39 +01:00
Nikolai Kochetov
4deaf7cefb
Merge pull request #56134 from yariks5s/force_optimize_projection_name 
Implementing force_optimize_projection_name
 2023-11-01 13:12:10 +01:00
kssenii
f51f6d1357 Shard cache keys 2023-11-01 11:31:49 +01:00
Kseniia Sumarokova
e5efc42633
Merge branch 'master' into fs-cache-improvement 2023-11-01 10:47:36 +01:00
Kseniia Sumarokova
7740fdf052
Merge pull request #56165 from ClickHouse/more-profile-events-for-cache 
More metrics for fs cache
 2023-11-01 10:46:00 +01:00
Kseniia Sumarokova
e8a3478a12
Merge pull request #56168 from ClickHouse/fs-cache-minor-refactoring 
FileCache minor changes
 2023-11-01 10:10:13 +01:00
Kseniia Sumarokova
7f71c8f07c
Fix build 2023-10-31 19:21:06 +01:00
kssenii
30db41e053 Review fixes 2023-10-31 17:01:55 +01:00
yariks5s
8a2f95629f fixed suggestions 2023-10-31 13:16:02 +00:00
kssenii
eed15e5344 Get rid of public inheritance 2023-10-31 13:45:34 +01:00
kssenii
17dda0d8c3 More metrics for fs cache3 2023-10-31 12:36:16 +01:00
Nikolai Kochetov
0523e6cbd0
Merge pull request #53282 from ClickHouse/planner-prepare-filters-for-analysis-2 
Support skip_unused_shards in Analyzer
 2023-10-31 11:33:59 +01:00
Raúl Marín
f3a3ec53f6
Merge pull request #56124 from den-crane/patch-64 
Beautify `show merges`
 2023-10-31 11:02:10 +01:00
Smita Kulkarni
ce36a6475d Fixed cland tidy build 2023-10-31 10:12:31 +01:00
Han Fei
1237cef26d address comments 2023-10-31 00:53:46 +01:00
yariks5s
c53faedc4a style fix 2023-10-30 17:56:17 +00:00
yariks5s
03236c48ed init 2023-10-30 16:21:50 +00:00
Denny Crane
b7a90af5e1
Update InterpreterShowTablesQuery.cpp 2023-10-30 09:36:11 -03:00
vdimir
5b01ed6698
upd 2023-10-30 11:51:31 +00:00
robot-clickhouse
cb0cf67d67
Merge pull request #56057 from amosbird/fix-56031 
Fix missing scalar issue when evaluating subqueries inside table functions
 2023-10-30 12:31:15 +01:00
Nikolai Kochetov
554ceb4e1d Merge branch 'master' into planner-prepare-filters-for-analysis-2 2023-10-30 11:56:30 +01:00
Han Fei
19cdc6dfe2 Merge branch 'master' into hanfei/statistic 2023-10-30 04:53:18 +01:00
Alexey Milovidov
3631e476eb
Merge pull request #54947 from amosbird/minmax-combinator 
Introduce -ArgMin/-ArgMax combinators.
 2023-10-30 03:35:28 +01:00
Alexey Milovidov
88440d4c07
Merge pull request #54568 from JackyWoo/optimize_uniq_to_count2 
Resubmit optimization uniq to count
 2023-10-30 01:33:36 +01:00
Alexey Milovidov
64b6e68a50
Merge pull request #55683 from amosbird/issue-55653 
Reuse granule during skip index reading
 2023-10-30 00:51:51 +01:00
Alexey Milovidov
6eff22568f
Revert "Add function getHttpHeader" 2023-10-29 19:50:39 +03:00
Alexey Milovidov
70e3dd808c Granular code coverage with introspection 2023-10-29 02:07:24 +01:00
Alexey Milovidov
744b1db084
Merge pull request #56090 from ClickHouse/intervals_comparison 
Throw an error when comparing time intervals with different units
 2023-10-28 14:56:55 +02:00
Alexey Milovidov
d9a18faab8
Merge pull request #55679 from ClickHouse/allow-final-custom-key-parallel-replicas 
Allow FINAL with parallel replicas with custom key
 2023-10-28 00:40:03 +02:00
Alexey Milovidov
6eb89ac785 Merge remote-tracking branch 'origin/master' into intervals_comparison 2023-10-27 23:05:55 +02:00
Alexey Milovidov
fbb919c269 Fix typo 2023-10-27 23:05:46 +02:00
Bharat Nallan Chakravarthy
c892e2c01d add hostname column to remaining tables 2023-10-27 11:02:51 -07:00
Bharat Nallan Chakravarthy
1285ee74df add hostname to few more tables 2023-10-27 11:02:51 -07:00
Bharat Nallan Chakravarthy
d86b751283 fix tests 2023-10-27 11:02:51 -07:00
Bharat Nallan Chakravarthy
382487a52b add hostname field to system log tables 2023-10-27 11:02:51 -07:00
Amos Bird
3eca59d62d
Revert "Fix error code" 
This reverts commit ca4fa430b3.
 2023-10-27 23:46:43 +08:00
vdimir
659dfbfc3d
fix 2023-10-27 15:22:11 +00:00
vdimir
60c93cefbe
Add test for CHECK ALL TABLES 2023-10-27 15:22:11 +00:00
vdimir
faffdba8a2
Split source and worker processors in InterpreterCheckQuery 2023-10-27 15:22:10 +00:00
vdimir
c1ae369919
wip CHECK query for all tables 2023-10-27 15:22:10 +00:00
Amos Bird
ca4fa430b3
Fix error code 2023-10-27 21:30:48 +08:00
frinkr
18c50c11b3
Multithreading after window functions (#50771) 
* feat: Preserve number of streams after evaluation the window functions to allow parallel stream processing

* fix style

* fix style

* fix style

* setting query_plan_preserve_num_streams_after_window_functions default true

* fix tests by SETTINGS query_plan_preserve_num_streams_after_window_functions=0

* fix test references

* Resize the streams after the last window function, to keep the order between WindowTransforms (and WindowTransform works on single stream anyway).

* feat: Preserve number of streams after evaluation the window functions to allow parallel stream processing

* fix style

* fix style

* fix style

* setting query_plan_preserve_num_streams_after_window_functions default true

* fix tests by SETTINGS query_plan_preserve_num_streams_after_window_functions=0

* fix test references

* Resize the streams after the last window function, to keep the order between WindowTransforms (and WindowTransform works on single stream anyway).

* add perf test

* perf: change the dataset from 50M to 5M

* rename query_plan_preserve_num_streams_after_window_functions -> query_plan_enable_multithreading_after_window_functions

* update test reference

* fix clang-tidy

---------

Co-authored-by: Nikita Taranov <nikita.taranov@clickhouse.com>
 2023-10-27 12:36:28 +02:00
serxa
62f51166b0 fix conflicts 2023-10-27 09:07:05 +00:00
Sergei Trifonov
a5d7c2b6a2
Merge branch 'master' into async-loader-integration 2023-10-27 10:39:12 +02:00
Amos Bird
829fc61e77
Add scalars in all cases 2023-10-27 01:41:02 +08:00
Alexander Tokmakov
c588a7f386 Merge branch 'master' into make_code_worse 2023-10-26 17:39:10 +02:00
robot-ch-test-poll
da42f2eb0f
Merge pull request #55887 from ucasfl/fix-union-distinct 
Fix normalize ASTSelectWithUnionQuery strip FORMAT of the query
 2023-10-26 13:53:58 +02:00
vdimir
1d5f75fd71
Merge pull request #53404 from ClickHouse/vdimir/check_table_improvements2 
Improve CHECK TABLE system query, support checking part
 2023-10-26 10:57:44 +02:00
robot-ch-test-poll3
90c8efa23f
Merge pull request #55979 from kitaisreal/add-show-setting-query 
Add SHOW SETTING query
 2023-10-26 09:09:25 +02:00
Nikolay Degterinsky
3c690337ec Improvements 2023-10-26 03:17:30 +00:00
Alexey Milovidov
bb5a60dc19
Merge pull request #55893 from ClickHouse/revert-partial-result-2 
Revert "Revert "Revert "Add settings for real-time updates during query execution"""
 2023-10-25 22:20:28 +02:00
Maksim Kita
901294d352 Fixed code review issues 2023-10-25 21:41:26 +03:00
Alexander Tokmakov
0f4260bf26 fix some bad code by making it worse 2023-10-25 19:51:51 +02:00
Maksim Kita
82d4d52b06 Add SHOW SETTING query 2023-10-25 18:49:00 +03:00
flynn
229762e4c1 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-union-distinct 2023-10-25 13:10:56 +00:00
Raúl Marín
6068277af9
Merge pull request #55815 from jetgm/master 
Add SHOW MERGES
 2023-10-25 11:44:30 +02:00
Robert Schulze
665dfe6135
Merge pull request #55278 from kitaisreal/context-added-tsa 
Context added TSA
 2023-10-25 10:41:00 +02:00
Raúl Marín
bee9eb5df4
Merge pull request #55962 from Algunenano/show_databases_limit 
Fix `SHOW DATABASES LIMIT <N>`
 2023-10-25 10:27:43 +02:00
Smita Kulkarni
d6c63e07ce Fixed expression 2023-10-25 10:23:22 +02:00
Smita Kulkarni
efbcac4e60 Bug fix explain ast with parameterized view 2023-10-25 10:21:06 +02:00
jetgm
ca766e3033 update doc and change order by 2023-10-25 11:08:25 +08:00
serxa
08e63f2a24 fix build 2023-10-24 21:49:15 +00:00
李扬
465962df7f
Support orc filter push down (file + stripe + rowgroup level) (#55330) 
* support orc filter push down

* update orc lib version

* replace setqueryinfo with setkeycondition

* fix issue https://github.com/ClickHouse/ClickHouse/issues/53536

* refactor source with key condition

* fix building error

* remove std::cout

* update orc

* update orc version

* fix bugs

* improve code

* upgrade orc lib

* fix code style

* change as requested

* add performance tests for orc filter push down

* add performance tests for orc filter push down

* fix all bugs

* fix default as null issue

* add uts for null as default issues

* upgrade orc lib

* fix failed orc lib uts and fix typo

* fix failed uts

* fix failed uts

* fix ast fuzzer tests

* fix bug of uint64 overflow in https://s3.amazonaws.com/clickhouse-test-reports/55330/de22fdcaea2e12c96f300e95f59beba84401712d/fuzzer_astfuzzerubsan/report.html

* fix asan fatal caused by reused column vector batch in native orc input format. refer to https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__asan__[4_4].htm

* fix wrong performance tests

* disable 02892_orc_filter_pushdown on aarch64. https://s3.amazonaws.com/clickhouse-test-reports/55330/be39d23af2d7e27f5ec7f168947cf75aeaabf674/stateless_tests__aarch64_.html

* add some comments

* add some comments

* inline range::equals and range::less

* fix data race of key condition

* trigger ci
 2023-10-24 12:08:17 -07:00
Maksim Kita
0e176fa0ed Fixed code review issues 2023-10-24 19:39:25 +03:00
Robert Schulze
1375733643
Merge pull request #55955 from rschu1ze/test-bug-43644 
Test for Bug 43644
 2023-10-24 16:16:52 +02:00
Kruglov Pavel
62b154930a
Merge pull request #53504 from filimonov/ignore_max_distributed_connections_for_async_remote 
Disable logic max_threads=max_distributed_connections when async_socket_for_remote=1
 2023-10-24 14:15:21 +02:00
serxa
749cdb9954 Merge branch 'master' into async-loader-integration 2023-10-24 10:09:49 +00:00
serxa
d3f54a29e3 add startup waits in all DDL queries and global DDL worker 2023-10-24 10:09:10 +00:00
Robert Schulze
38a2ba5769
Cosmetics 2023-10-24 09:53:20 +00:00
Raúl Marín
70adb4ca17 Fix SHOW DATABASES LIMIT <N> 2023-10-24 11:42:20 +02:00
Robert Schulze
b361b8e3e3
Merge remote-tracking branch 'rschu1ze/master' into test-bug-43644 2023-10-24 08:53:10 +00:00
Robert Schulze
db1cca592e
Test for Bug 43644 2023-10-23 20:47:58 +00:00
Kseniia Sumarokova
699de2317a
Merge pull request #55863 from jrdi/describe-load-metadata-threads 
Add load_metadata_threads to describe filesystem cache
 2023-10-23 21:40:52 +02:00
vdimir
643fef589d
Revert "[remove before merging] Shuffle CHECK TABLE results" 
This reverts commit 8bb2378952.
 2023-10-23 12:33:36 +00:00
Duc Canh Le
5923e1b116
Cache cast function in set during execution (#55712) 
* Cache cast function in set during execution

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* minor fix for performance test

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* Update src/Interpreters/castColumn.cpp

Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>

* improvement

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

* fix use-after-free

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>

---------

Signed-off-by: Duc Canh Le <duccanh.le@ahrefs.com>
Co-authored-by: Nikita Taranov <nickita.taranov@gmail.com>
 2023-10-23 13:31:44 +02:00
vdimir
8bb2378952
[remove before merging] Shuffle CHECK TABLE results 2023-10-23 10:56:06 +00:00
vdimir
3332f70275
upd 2023-10-23 10:56:06 +00:00
vdimir
d254c4e4a0
Do no check ast in InterpreterCheckQuery to use max_threads 2023-10-23 10:13:26 +00:00
vdimir
8f0d7954ff
IStorage::checkDataNext returns optional 2023-10-23 10:12:30 +00:00
vdimir
9d840c6532
Use single thread for check table with check_query_single_value_result=0 2023-10-23 09:36:41 +00:00
vdimir
fe95c0d0e4
Improve CHECK TABLE system query 
Resubmit PR #52745
 2023-10-23 09:35:26 +00:00
Maksim Kita
d363e062f1 Updated implementation 2023-10-23 12:00:29 +03:00
Maksim Kita
ba37880208 Context added TSA 2023-10-23 12:00:29 +03:00
Jordi Villar
839c05e3b8 Add load_metadata_threads to describe filesystem cache 2023-10-23 09:01:12 +02:00
jetgm
6fbc5277b6 improve query 2023-10-23 09:56:19 +08:00
flynn
b42c633706 Merge branch 'master' of github.com:ClickHouse/ClickHouse into fix-union-distinct 2023-10-22 16:00:12 +00:00
Alexey Milovidov
7ec4b99e94 Revert partial result 2023-10-21 03:14:22 +02:00
Alexey Milovidov
3d0631a37d
Merge pull request #55871 from Algunenano/predicate_pushdown 
Disable predicate pushdown if the CTE contains stateful functions
 2023-10-21 01:36:24 +02:00
Aleksei Filatov
0a1f3f205c
Add external HTTP Basic authenticator (#55199) 2023-10-20 19:24:19 +02:00
Anton Popov
5819bcd07a
Support asynchronous inserts for native protocol (#54730) 
* support async insert for native protocol

* use separate queue for async inserts via native protocol

* fix test

* better logging for async inserts and more tests

* disable mixed internal and external data in async inserts

* fix tests

* fix quota in async inserts

* disable async insert for secondary query of distributed
 2023-10-20 18:39:48 +02:00
flynn
fda36deec3 Fix normalize ASTSelectWithUnionQuery strip FORMAT of the query 2023-10-20 16:33:21 +00:00
Raúl Marín
c690a3af8b Disable predicate pushdown if the CTE contains stateful functions 2023-10-20 15:04:42 +02:00
Azat Khuzhin
6da75a47c5 Fix "Cannot find column X in source stream" for Distributed queries with LIMIT BY 
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
 2023-10-19 18:38:29 +02:00
Raúl Marín
4a53943926 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-19 15:20:50 +00:00
Raúl Marín
3873a935f4
Merge pull request #55739 from Algunenano/use_default_format_on_http_exception 
Respect default format when using http_write_exception_in_output_format
 2023-10-19 13:47:36 +02:00
jetgm
bde5c5a4a8 add show merges 2023-10-19 18:17:28 +08:00
Robert Schulze
8b1e7a1ea1
Merge pull request #55771 from zhongyuankai/only_cache_initial_query 
Query Cache: Only cache initial query
 2023-10-18 22:55:52 +02:00
Kseniia Sumarokova
4e0122a299
Merge pull request #54422 from kssenii/s3-queue-fixes 
Fixes for storage `S3Queue`
 2023-10-18 21:51:51 +02:00
zhongyuankai
d73afed7d5 fix style 2023-10-18 23:09:38 +08:00
Robert Schulze
945dcb865a
Merge pull request #55617 from slvrtrn/mysql-string-blob-vs-text-config 
MySQL compatibility: allow to configure String/FixedString BLOB vs TEXT mapping
 2023-10-18 10:57:18 +02:00
huzhicheng
0b52d29cd8 Query Cache: Only cache initial query 2023-10-18 16:56:17 +08:00
Amos Bird
602f01f651
Reuse granule during skip index reading 2023-10-18 14:40:34 +08:00
slvrtrn
c19ca5c4d5 Address PR feedback 2023-10-17 19:19:35 +02:00
kssenii
5d8b1cea91 Fix 2023-10-17 19:19:19 +02:00
Han Fei
4b23142775
Merge branch 'master' into hanfei/statistic 2023-10-17 16:40:31 +02:00
vdimir
b5693d3fa6
Merge pull request #55602 from ClickHouse/vdimir/fix_cyclic_aliases_crash 
Fix crash in QueryNormalizer with cyclic aliases
 2023-10-17 16:31:37 +02:00
Han Fei
d2ac16749a refinement 2023-10-17 16:25:01 +02:00
Raúl Marín
b4a4c1e02e Only change headers if necessary 2023-10-17 16:02:06 +02:00
Raúl Marín
e500dc22e4 Respect default format when using http_write_exception_in_output_format 2023-10-17 14:14:58 +02:00
kssenii
d837aa675f Fix 2023-10-17 13:14:28 +02:00
kssenii
8cff5f5bdb Merge remote-tracking branch 'origin/fs-cache-improvement' into fs-cache-improvement 2023-10-17 11:44:26 +02:00
kssenii
7515853ad4 Fix build 2023-10-17 11:43:51 +02:00
Robert Schulze
96a82df75a
Merge pull request #55616 from HarryLeeIBM/hlee-fts-max-rows 
Inverted index: Replace setting density with `max_rows_in_postings_list`
 2023-10-17 11:36:46 +02:00
Raúl Marín
3eaf752284 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-17 11:36:39 +02:00
HarryLeeIBM
fb8cd298d1 Code refactoring according to code review 2023-10-16 17:52:39 -07:00
Kseniia Sumarokova
96c518be5b
Merge branch 'master' into s3-queue-fixes 2023-10-16 22:19:13 +02:00
Kseniia Sumarokova
6889e04f10
Merge branch 'master' into fs-cache-improvement 2023-10-16 22:18:00 +02:00
robot-ch-test-poll1
aca98cf725
Merge pull request #53774 from helifu/master13 
Display reloaded values of server settings
 2023-10-16 21:17:17 +02:00
kssenii
09072097ec Better 2023-10-16 17:09:12 +02:00
serxa
e214b73844 create async_loader once 2023-10-16 14:57:06 +00:00
Antonio Andelic
55b8b1440d Allow FINAL with parallel replicas with custom key 2023-10-16 14:04:05 +00:00
Raúl Marín
f799f5d7a1 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-16 15:07:11 +02:00
serxa
0e17da22eb Merge branch 'master' into async-loader-integration 2023-10-16 11:08:29 +00:00
kssenii
43c5e173de Merge remote-tracking branch 'upstream/master' into fs-cache-improvement 2023-10-16 13:06:28 +02:00
vdimir
d7c77420b6
QueryNormalizer only checks stack size 2023-10-16 10:33:04 +00:00
Kseniia Sumarokova
a4bd6891e1
Merge pull request #55164 from ClickHouse/vdimir/fix_file_cache_tmp_write_buffer 
Fix file cache temporary file segment range in FileSegment::reserve
 2023-10-16 11:44:46 +02:00
alesapin
697c1e3bb0
Merge pull request #55604 from ClickHouse/evillique-partition-parameters 
Implement query paramenters support in partition expression
 2023-10-16 10:26:02 +02:00
Antonio Andelic
b6b92f46cc
Merge pull request #55541 from ClickHouse/sample-segfault 
Better exception messages but without SEGFAULT
 2023-10-16 08:43:52 +02:00
alesapin
3b02748cb6 Fix some typos 2023-10-15 15:43:02 +02:00
Alexey Milovidov
50ee412b19
Merge pull request #55625 from ClickHouse/preparation-key-condition 
KeyCondition: preparation
 2023-10-14 22:13:39 +02:00
Alexey Milovidov
0a3e431c87 Additional changes 2023-10-14 04:50:30 +02:00
Alexey Milovidov
6d8f28aad0 Merge branch 'master' into better-depth-check 2023-10-14 01:48:59 +02:00
slvrtrn
447631976e Add MySQL String BLOB vs TEXT configuration 2023-10-13 20:36:14 +02:00
HarryLeeIBM
25545d504d Replace setting density to max_rows_in postings_list for full text search 2023-10-13 10:31:21 -07:00
Alexander Tokmakov
3e60451ac7 Revert "Merge pull request #54421 from evillique/cluster-groups" 
This reverts commit 211c80e1a0, reversing
changes made to b53a98217c.
 2023-10-13 18:55:51 +02:00
Mikhail f. Shiryaev
e816ec7d6a
Merge branch 'master' into vdimir/fix_file_cache_tmp_write_buffer 2023-10-13 18:15:52 +02:00
Alexander Tokmakov
f95b0eb553
Merge pull request #54828 from canhld94/ddl_worker_host_cache 
Caching skip-able entries in DDLWorker
 2023-10-13 17:34:15 +02:00
alesapin
47d48d81e0 Implement feature 2023-10-13 16:22:18 +02:00
vdimir
ba5cd016dd
Fix crash in QueryNormalizer with cyclic aliases 2023-10-13 14:03:36 +00:00
Dmitry Novik
d4be706ed4 Merge remote-tracking branch 'origin/master' into parallel-window 2023-10-13 13:20:38 +00:00
Raúl Marín
c5bd29792a Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 15:05:47 +02:00
Antonio Andelic
a83ebb1862 Merge branch 'master' into sample-segfault 2023-10-13 12:53:32 +00:00
kssenii
a9c0c20cad Update documentation 2023-10-13 13:21:50 +02:00
kssenii
bfe174f71b Fix test 2023-10-13 12:57:57 +02:00
vdimir
e64abfc557
Merge pull request #49555 from ClickHouse/vdimir/analyzer_fix_join_tests 
Fixing join tests with analyzer
 2023-10-13 12:29:58 +02:00
kssenii
d64b990712 Merge remote-tracking branch 'origin/master' into s3-queue-fixes 2023-10-13 12:13:56 +02:00
Raúl Marín
500dab9569 Merge remote-tracking branch 'blessed/master' into parallel_replicas_row_estimation 2023-10-13 10:12:57 +02:00
Dmitry Novik
cec02c60e8 Merge remote-tracking branch 'origin/master' into parallel-window 2023-10-12 22:45:30 +00:00
robot-clickhouse-ci-1
211c80e1a0
Merge pull request #54421 from evillique/cluster-groups 
Add replica groups to Replicated database engine
 2023-10-12 18:14:42 +02:00
Nikolay Degterinsky
20e16be27b Fixes & improvements 2023-10-12 15:02:08 +00:00
Han Fei
42dc61abf5 Merge branch 'master' into hanfei/statistic 2023-10-12 16:19:45 +02:00
Antonio Andelic
470c858f21
Update src/Interpreters/InterpreterSelectQuery.cpp 2023-10-12 16:06:00 +02:00
vdimir
3aac663bd2
fix 2023-10-12 10:46:58 +00:00
vdimir
dcdcdc5a86
fix style check 2023-10-12 10:45:57 +00:00
vdimir
94fa777b8d
Fix 01890_materialized_distributed_join 
Function getHeaderForProcessingStage handle join on top of query tree
 2023-10-12 10:45:57 +00:00
Antonio Andelic
5d5d4a8443 Check if storage is nullptr 2023-10-12 09:50:04 +00:00
robot-clickhouse-ci-1
c40a79f0b4
Merge pull request #54813 from lingtaolf/feature/function-getClientHttpHeader 
Add function getHttpHeader
 2023-10-12 10:13:20 +02:00
Robert Schulze
7b14392675
Merge pull request #55481 from rschu1ze/better-use-mysql-types-in-show-columns 
Make `use_mysql_types_in_show_columns` affect only `SHOW COLUMNS`
 2023-10-12 00:36:46 +02:00
Robert Schulze
db75a41d10
+ comment 2023-10-11 15:50:13 +00:00
Robert Schulze
a7c7a25e0f
Fix a leftover 2023-10-11 15:49:16 +00:00
Igor Nikonov
62060a0603 Merge remote-tracking branch 'origin/master' into pr-coordinator-usage-cleanup 2023-10-11 15:11:15 +00:00
Igor Nikonov
9d95f4e1b6 Cleanup: parallel replica coordinator usage 2023-10-11 15:04:59 +00:00