Commit Graph

135202 Commits

Author SHA1 Message Date
Han Fei
658d074c39 Merge branch 'master' into hanfei/keeperrocks 2024-02-28 15:30:52 +01:00
Nikolai Kochetov
c3f925da0a
Merge pull request #60164 from kitaisreal/copy-s3-file-gcp-fallback-to-buffer-copy
Copy S3 file GCP fallback to buffer copy
2024-02-22 12:53:15 +01:00
Nikolai Kochetov
0e6b55ad35
Merge pull request #60220 from kitaisreal/system-backups-system-backup-log-add-query-id-and-error-stacktrace
Tables system.backups and system.backup_log add query_id and error stacktrace
2024-02-22 12:43:52 +01:00
Kseniia Sumarokova
fb7924cdb1
Merge pull request #60233 from ClickHouse/hide-sensitive-info-in-s3-queue
Hide sensitive info for s3queue
2024-02-22 11:37:15 +01:00
Robert Schulze
2d2acd6bf9
Merge pull request #60202 from rschu1ze/vector-dot-product
Vectorize `dotProduct`
2024-02-22 11:19:31 +01:00
Robert Schulze
ae597d86dd
Merge remote-tracking branch 'rschu1ze/master' into vector-dot-product 2024-02-22 10:16:28 +00:00
Alexey Milovidov
659d960990
Merge pull request #60245 from Algunenano/enforce_cloud_sync
Make cloud sync required
2024-02-22 10:11:01 +01:00
Azat Khuzhin
a4f765cae7
Improve performance of SELECTs with active mutations (#59531)
* Configure keeper for perf tests

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Improve performance of SELECTs with active mutations

getAlterMutationCommandsForPart() can be a hot path for query execution
when there are pending mutations.

- LOG_TEST - it is not only check one bool, but actually a bunch of
  atomics as well.

- Return std::vector over std::map (map is not required there) - no
  changes in performance.

- Copy only RENAME_COLUMN (since only this mutation is required by
  AlterConversions).

And here are results:

run|result
-|-
SELECT w/o ALTER|queries: 1565, QPS: 355.259, RPS: 355.259
SELECT w/ ALTER unpatched|queries: 2099, QPS: 220.623, RPS: 220.623
SELECT w/ ALTER and w/o LOG_TEST|queries: 2730, QPS: 235.859, RPS: 235.859
SELECT w/ ALTER and w/o LOG_TEST and w/ RENAME_COLUMN only|queries: 2995, QPS: 290.982, RPS: 290.982

But there are still room for improvements, at least MergeTree engines
could implement getStorageSnapshotForQuery().

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>

* Add AlterConversions::supportsMutationCommandType(), flatten vector<vector<MutationCommand>>

* Work around what appears to be a clang static analysis bug

---------

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
Co-authored-by: Michael Kolupaev <michael.kolupaev@clickhouse.com>
2024-02-22 08:51:10 +00:00
Antonio Andelic
1b238d1180
Merge pull request #59460 from ClickHouse/keeper-logs-cache
Keeper log cache
2024-02-22 09:03:41 +01:00
Raúl Marín
9f23f478c4 Merge remote-tracking branch 'blessed/master' into enforce_cloud_sync 2024-02-21 20:35:02 +01:00
Raúl Marín
82ba2ebdb2 Revert "Generate a conflict"
This reverts commit 5fc28c536c.
2024-02-21 20:34:56 +01:00
Alexander Tokmakov
64a80f1011
Fix default path when path is not specified in config (#59654)
* Update Server.cpp

* Update SentryWriter.cpp

* Update Keeper.cpp

* Update SentryWriter.cpp
2024-02-21 20:33:39 +01:00
Max K
e7a560f94d
Merge pull request #59939 from ClickHouse/ci_integration_tests_to_mysql8_migration
CI: integration tests to mysql80
2024-02-21 20:33:00 +01:00
Raúl Marín
10be5da3fb
Merge pull request #60253 from ClickHouse/revert-59032-cpu-scheduler-and-cc
Revert "Support resource request canceling"
2024-02-21 20:20:19 +01:00
Raúl Marín
453d4d30cf
Revert "Support resource request canceling" 2024-02-21 20:19:00 +01:00
Raúl Marín
5fc28c536c Generate a conflict 2024-02-21 19:18:47 +01:00
Raúl Marín
07c9deed41 Make cloud sync required 2024-02-21 18:40:00 +01:00
Max K
613bb8f387
Merge pull request #60236 from ClickHouse/ci_aarch_style_checker_for_run_confog
CI: use aarch runner for runconfig job
2024-02-21 18:14:01 +01:00
Max Kainov
da50758eb6 CI: use aarch style checker for CI config job
#do_not_test
2024-02-21 16:59:41 +00:00
Robert Schulze
5d6bc6f566
Merge pull request #60235 from rschu1ze/doc-lin-reg
Docs: Correct variable names for `simpleLinearRegression`
2024-02-21 17:47:00 +01:00
Raúl Marín
33cd7c25b1
Merge pull request #60154 from Algunenano/settings_check
Add setting history check to stateless tests
2024-02-21 17:37:26 +01:00
Nikolai Kochetov
0e9d7f3540
Merge pull request #60037 from ClickHouse/fix-01656_test_query_log_factories_info-for-analyzer
Fix 01656_test_query_log_factories_info with analyzer.
2024-02-21 17:37:15 +01:00
Robert Schulze
5ea3afb06e
Docs: Correct variable names for simpleLinearRegression
Fixes: #59729
2024-02-21 16:29:47 +00:00
Antonio Andelic
c309e643ea
Merge pull request #60210 from ClickHouse/fix-backup-user-specific-auth
Fix `test_backup_restore_s3/test.py::test_user_specific_auth`
2024-02-21 17:19:41 +01:00
Max K
a0b8704238
Merge pull request #60234 from ClickHouse/ci_parallel_replica_random_sanitizer
CI: random sanitizer for parallel repl in PR wf
2024-02-21 17:18:32 +01:00
Max Kainov
f827469207 CI: random sanitizer for parallel repl in PR wf 2024-02-21 16:08:03 +00:00
Max K
8baab83b94
Merge pull request #60229 from ClickHouse/ci_random_job_pick
CI: random job pick support
2024-02-21 16:51:35 +01:00
kssenii
c05c3944d1 Hide sensitive info for s3queue 2024-02-21 16:49:53 +01:00
Max Kainov
47ab81bbab CI: support for random job pick
#no_merge_commit
 #no_ci_cache
2024-02-21 15:39:57 +00:00
Sergei Trifonov
19e81c20ca
Merge pull request #59032 from ClickHouse/cpu-scheduler-and-cc
Support resource request canceling
2024-02-21 16:16:24 +01:00
Kruglov Pavel
0ee2826baa
Merge pull request #60231 from kitaisreal/backups-delete-suspicious-file
Backups delete suspicious file
2024-02-21 16:15:52 +01:00
Maksim Kita
5ba371662f Backups delete suspicious file 2024-02-21 18:10:27 +03:00
Igor Nikonov
a0105e94ba
Merge pull request #60077 from ClickHouse/cleanup-connection-pool-priority
Cleanup: less confusion between config priority and balancing priority in connection pools
2024-02-21 15:22:08 +01:00
serxa
1ac94813ed review fixes 2024-02-21 14:14:45 +00:00
serxa
f92ec2cd5d Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:37 +00:00
serxa
bf90da7057 Merge branch 'master' into cpu-scheduler-and-cc 2024-02-21 14:05:01 +00:00
Sergei Trifonov
6e3fddf4a3
Merge pull request #59313 from ClickHouse/abstract-concurrency-control
Split `ISlotControl` from `ConcurrencyControl`
2024-02-21 15:04:03 +01:00
Kruglov Pavel
10535132c3
Merge pull request #59385 from Avogar/fix-bad-types-check
Fix validating suspicious/experimental types in nested types
2024-02-21 14:38:01 +01:00
Igor Nikonov
0ead912127
Merge pull request #60158 from ClickHouse/fix-slowdown-count-side-effect
Fix: custom key failover test flakiness
2024-02-21 12:55:46 +01:00
Robert Schulze
8f0f8bf294
Fix typo 2024-02-21 11:54:20 +00:00
Igor Nikonov
58b9d937e8
Merge pull request #60143 from ClickHouse/test-insert-over-http-query-log
Tests: query log for inserts over http
2024-02-21 12:54:12 +01:00
Maksim Kita
ae91c655a0 Tables system.backups and system.backup_log add query_id and error stacktrace 2024-02-21 14:36:58 +03:00
Max Kainov
9f51e840db CI: integration tests to mysql80
#ci_set_integration
 #no_merge_commit
2024-02-21 11:05:47 +00:00
Robert Schulze
9f37f17900
Further refactorings to make the code more similar to arrayDistance.cpp 2024-02-21 10:59:58 +00:00
Raúl Marín
c1754d3cd1
Merge pull request #60179 from ClickHouse/add-test-44318
Add a test for #44318
2024-02-21 11:42:59 +01:00
Antonio Andelic
b4c7e1d01f
Merge pull request #60216 from ClickHouse/revert-59697-check-stack-size-in-parser
Revert "Check stack size in Parser"
2024-02-21 11:37:49 +01:00
Antonio Andelic
fee1565780
Revert "Check stack size in Parser" 2024-02-21 11:33:08 +01:00
Antonio Andelic
104421431a
Merge pull request #60215 from ClickHouse/revert-60109-tests/integration-query-retries
Revert "Do not retry queries if container is down in integration tests"
2024-02-21 11:15:10 +01:00
Antonio Andelic
199da94176
Revert "Do not retry queries if container is down in integration tests" 2024-02-21 11:13:41 +01:00
Raúl Marín
68a12a5fe3
Merge pull request #60188 from Algunenano/nullable_arrayReduce
Fix arrayReduce with nullable aggregate function name
2024-02-21 10:56:14 +01:00