Commit Graph

85584 Commits

Author SHA1 Message Date
taiyang-li
acb9f1632e suppoort skip splits in orc and parquet 2022-04-06 16:40:22 +08:00
taiyang-li
43e8af697a fix code style 2022-04-06 11:41:16 +08:00
taiyang-li
539ce5f1b8 Merge branch 'master' into use_minmax_index 2022-03-31 12:27:32 +08:00
Nikolay Degterinsky
f055d7b692
Merge pull request #34055 from palegre-tiny/groupSortedArray
Add groupSortedArray() function
2022-03-31 01:20:15 +03:00
Kruglov Pavel
4ec3c35e14
Merge pull request #35755 from Avogar/fix-custom-to-string
Fix bug in conversion from custom types to string
2022-03-31 00:06:48 +02:00
alesapin
5a55913f45
Merge pull request #35720 from ClickHouse/parallel_stateful
Try to run stateful tests in parallel
2022-03-30 23:42:44 +02:00
Alexander Gololobov
1d7059175b
Merge pull request #35681 from tonickkozlov/patch-2
[test] Adds clean-up for functional test 02167
2022-03-30 23:09:51 +02:00
Nikita Taranov
30f2a942c5
Predict size of hash table for GROUP BY (#33439)
* use AggregationMethod ctor with reserve

* add new settings

* add HashTablesStatistics

* support queries with limit

* support distributed and with external aggregation

* add new profile events

* add some tests

* add perf test

* export cache stats through AsynchronousMetrics

* rm redundant trace

* fix style

* fix 02122_parallel_formatting test

* review fixes

* fix 02122_parallel_formatting test

* apply also to two-level HTs

* try simpler strategy

* increase max_size_to_preallocate_for_aggregation for experiment

* fixes

* Revert "increase max_size_to_preallocate_for_aggregation for experiment"

This reverts commit 6cf6f75704.

* fix test

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-03-30 22:47:51 +02:00
Alexander Gololobov
8f7329d7dd
Removed debug print 2022-03-30 20:10:25 +02:00
alesapin
02574bd05b
Merge pull request #35766 from ClickHouse/resurrect_official_flag
Resurrect build hash
2022-03-30 19:34:19 +02:00
alesapin
b388bb8448
Merge pull request #35718 from ClickHouse/fail_build_check_in_error_status
Fail CI checks in case of errors in checks (not failed tests)
2022-03-30 19:28:22 +02:00
alesapin
fcd4e0be65 Black 2022-03-30 19:15:27 +02:00
tavplubix
82a32194bf
Merge pull request #35768 from ClickHouse/tavplubix-patch-2
Fix 00484_preferred_max_column_in_block_size_bytes
2022-03-30 19:17:12 +03:00
Dmitry Novik
597c1a6523
Merge pull request #35719 from ClickHouse/memory-overcommit-test-fix
Try to fix test_global_overcommit_tracker flakyness
2022-03-30 18:15:40 +02:00
tavplubix
c34d512586
Update 00484_preferred_max_column_in_block_size_bytes.sql 2022-03-30 18:36:37 +03:00
tavplubix
60ecd49313
Merge pull request #35754 from ClickHouse/fix-ci-script-style-check
Fix stylecheck
2022-03-30 18:06:33 +03:00
alesapin
8980994faa Resurrect build hash 2022-03-30 16:29:13 +02:00
Alexander Gololobov
6e1036de50
Fix user file path extraction
It turned out that $CLICHOUSE_CLIENT could produce more verbose output that was not properly parsed. I made a change that should fix this parsing.
2022-03-30 16:12:13 +02:00
Maksim Kita
12ec3522e6
Merge pull request #35745 from azat/fix-tests-v22.3
Tests fixes
2022-03-30 15:44:25 +02:00
Kruglov Pavel
771f34d793
Merge pull request #35691 from Avogar/fix-matview
Fix creating materialized view with subquery after server restart
2022-03-30 14:57:14 +02:00
tavplubix
cf8332e109
Update 00170_s3_cache.reference 2022-03-30 14:38:21 +03:00
avogar
af4bfec051 Fix bug in conversion from custom types to string 2022-03-30 11:19:03 +00:00
Nikolai Kochetov
d3697625a9 Fix stylecheck 2022-03-30 10:55:49 +00:00
Vladimir C
31c367d3cd
Merge pull request #35651 from amosbird/columntransformerrename 2022-03-30 12:37:30 +02:00
tavplubix
531942ce5c
Update 00170_s3_cache.sql 2022-03-30 12:43:34 +03:00
mergify[bot]
9a391f2fed
Merge branch 'master' into parallel_stateful 2022-03-30 09:40:12 +00:00
alesapin
b19ecf60ad Fix style 2022-03-30 11:30:21 +02:00
alesapin
b5bce6d4dd
Merge pull request #35722 from ClickHouse/new_branch
Resurrect automatic labelling
2022-03-30 11:26:41 +02:00
mergify[bot]
c2d26e0dd4
Merge branch 'master' into new_branch 2022-03-30 09:22:01 +00:00
alesapin
c510ede8dd Fixup 2022-03-30 11:19:11 +02:00
alesapin
2a1b331c0d Fix build check 2022-03-30 11:15:54 +02:00
alesapin
cf6898d05b Merge branch 'master' into fail_build_check_in_error_status 2022-03-30 11:08:24 +02:00
alesapin
bcf64a73d1 Followup 2022-03-30 11:00:45 +02:00
alesapin
68ec0d92c0 Remove if category changed 2022-03-30 10:58:52 +02:00
Azat Khuzhin
2a099d90fe tests: make 02152_http_external_tables_memory_tracking more stable
After settings randomization, it can not reach max_untracked_memory,
i.e. due to max_block_size=67990 for example (like in [1]).

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35683/c609426d091ea8b9f2d37f8d7fcbf9e759cc94e5/stateless_tests__release__actions_.html

Fix this, by settings max_untracked_memory to 0, to track any
allocations.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 11:06:07 +03:00
Azat Khuzhin
b264bdcf5e tests: wait for left queries in 00417_kill_query
CI: https://s3.amazonaws.com/clickhouse-test-reports/0/c244ee7cbb61fea384679e18a577ff579060288b/stateless_tests__release__s3_storage__actions_/runlog.log
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 11:06:07 +03:00
Azat Khuzhin
7d140c9a59 clickhouse-test: increase timeout for obtaining processlist
Sometimes 30 seconds is not enough on CI [1]:

    2022.03.29 04:46:09.805406 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Debug> executeQuery: (from [::1]:33506)  SELECT * FROM system.processes WHERE query NOT LIKE '%system.processes%' AND Settings['log_comment'] = '02016_order_by_with_fill_monotonic_functions_removal.sql' AND current_database = 'test_7fqp6w'
    2022.03.29 04:46:09.866100 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Trace> ContextAccess (default): Access granted: SELECT(is_initial_query, user, query_id, address, port, initial_user, initial_query_id, initial_address, initial_port, interface, os_user, client_hostname, client_name, client_revision, client_version_major, client_version_minor, client_version_patch, http_method, http_user_agent, http_referer, forwarded_for, quota_key, distributed_depth, elapsed, is_cancelled, read_rows, read_bytes, total_rows_approx, written_rows, written_bytes, memory_usage, peak_memory_usage, query, thread_ids, ProfileEvents, Settings, current_database) ON system.processes
    2022.03.29 04:46:12.787395 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Trace> InterpreterSelectQuery: FetchColumns -> Complete
    2022.03.29 04:46:19.749163 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Test> ParallelFormattingOutputFormat: Parallel formatting is being used
    2022.03.29 04:46:37.923282 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Information> executeQuery: Read 15 rows, 44.20 KiB in 28.117172383 sec., 0 rows/sec., 1.57 KiB/sec.
    2022.03.29 04:46:40.020586 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Debug> DynamicQueryHandler: Done processing query
    2022.03.29 04:46:40.033535 [ 3885 ] {ae06ad04-f9fa-44d4-adeb-9e91aaf9bfa9} <Debug> MemoryTracker: Peak memory usage (for query): 4.00 MiB.

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/32928/ddd5bebe555ce8feebcdd339e47fc45184c20dd1/stateless_tests__thread__actions__[1/3].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-03-30 11:05:59 +03:00
Antonio Andelic
03a09dc914
Merge pull request #35571 from ClickHouse/parallel-s3-downloading
Parallel S3 downloading
2022-03-30 08:14:49 +02:00
Antonio Andelic
d85ed8f2a9
Merge pull request #35655 from ClickHouse/exception-compile-time-message-check
Use compile-time check for `Exception` messages
2022-03-30 08:11:32 +02:00
taiyang-li
0af6fdb576 fix building 2022-03-30 11:28:21 +08:00
taiyang-li
fcfabf4a0c Merge remote-tracking branch 'ck/master' into use_minmax_index 2022-03-30 11:23:24 +08:00
Anton Popov
a842a81aba
Merge pull request #35690 from CurtizJ/flatten-tuple
Add function `flattenTuple`
2022-03-30 00:24:36 +02:00
Anton Popov
1cba31c305
Merge pull request #35687 from CurtizJ/dynamic-columns-7
Fix reading from type object
2022-03-30 00:21:32 +02:00
tavplubix
e3d772abd0
Merge pull request #35725 from ClickHouse/revert-35683-llvm-cmake-fix
Revert "Fix enable LLVM for JIT compilation in CMake"
2022-03-30 00:18:14 +03:00
Alexander Tokmakov
6191eaa983 fix some flaky tests 2022-03-29 23:12:06 +02:00
Nikolai Kochetov
8c28926c67
Merge pull request #35737 from ClickHouse/change-ci-checks-server
Update ci checks server.
2022-03-29 21:23:56 +02:00
Nikolai Kochetov
3849e63ab1 Change database 2022-03-29 19:06:50 +00:00
Nikolai Kochetov
0810737637 Fix style 2022-03-29 18:58:16 +00:00
Nikolai Kochetov
bb82f77477 Fix check. 2022-03-29 18:46:48 +00:00
Maksim Kita
27aba472dd
Merge pull request #35671 from pdai/patch-1
fix typo
2022-03-29 20:46:02 +02:00