Commit Graph

120235 Commits

Author SHA1 Message Date
zvonand
c0f9dbbacb shorten 2023-08-02 15:51:27 +02:00
zvonand
e851be78bc fix fs_error on attempt to read unavailable dirs 2023-07-31 23:56:07 +02:00
Alexander Tokmakov
dd491eeae2
Merge pull request #52514 from azat/tests/fix-test_version_update_after_mutation
Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop
2023-07-24 15:23:12 +03:00
Azat Khuzhin
0401dc453e Fix flakiness of test_version_update_after_mutation by enabling force_remove_data_recursively_on_drop
Since there can be some leftovers:

    2023.07.24 07:08:25.238066 [ 140 ] {} <Error> Application: Code: 219. DB::Exception: Cannot drop: filesystem error: in remove: Directory not empty ["/var/lib/clickhouse/data/system/"]. Probably database contain some detached tables or metadata leftovers from Ordinary engine. If you want to remove all data anyway, try to attach database back and drop it again with enabled force_remove_data_recursively_on_drop setting: Exception while trying to convert database system from Ordinary to Atomic. It may be in some intermediate state. You can finish conversion manually by moving the rest tables from system to .tmp_convert.system.9396432095832455195 (using RENAME TABLE) and executing DROP DATABASE system and RENAME DATABASE .tmp_convert.system.9396432095832455195 TO system. (DATABASE_NOT_EMPTY), Stack trace (when copying this message, always include the lines below):

    0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000e68af57 in /usr/bin/clickhouse
    1. ? @ 0x000000000cab443c in /usr/bin/clickhouse
    2. DB::DatabaseOnDisk::drop(std::shared_ptr<DB::Context const>) @ 0x000000001328d617 in /usr/bin/clickhouse
    3. DB::DatabaseCatalog::detachDatabase(std::shared_ptr<DB::Context const>, String const&, bool, bool) @ 0x0000000013524a6c in /usr/bin/clickhouse
    4. DB::InterpreterDropQuery::executeToDatabaseImpl(DB::ASTDropQuery const&, std::shared_ptr<DB::IDatabase>&, std::vector<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>, std::allocator<StrongTypedef<wide::integer<128ul, unsigned int>, DB::UUIDTag>>>&) @ 0x0000000013bc05e4 in /usr/bin/clickhouse
    5. DB::InterpreterDropQuery::executeToDatabase(DB::ASTDropQuery const&) @ 0x0000000013bbc6b8 in /usr/bin/clickhouse
    6. DB::InterpreterDropQuery::execute() @ 0x0000000013bbba22 in /usr/bin/clickhouse
    7. ? @ 0x00000000140b13a5 in /usr/bin/clickhouse
    8. DB::executeQuery(String const&, std::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x00000000140ad20e in /usr/bin/clickhouse
    9. ? @ 0x00000000140d2ef0 in /usr/bin/clickhouse
    10. DB::maybeConvertSystemDatabase(std::shared_ptr<DB::Context>) @ 0x00000000140d0aaf in /usr/bin/clickhouse
    11. DB::Server::main(std::vector<String, std::allocator<String>> const&) @ 0x000000000e724e55 in /usr/bin/clickhouse
    12. Poco::Util::Application::run() @ 0x0000000017ead086 in /usr/bin/clickhouse
    13. DB::Server::run() @ 0x000000000e714a5d in /usr/bin/clickhouse
    14. Poco::Util::ServerApplication::run(int, char**) @ 0x0000000017ec07b9 in /usr/bin/clickhouse
    15. mainEntryClickHouseServer(int, char**) @ 0x000000000e711a26 in /usr/bin/clickhouse
    16. main @ 0x0000000008cf13cf in /usr/bin/clickhouse
    17. __libc_start_main @ 0x0000000000021b97 in /lib/x86_64-linux-gnu/libc-2.27.so
    18. _start @ 0x00000000080705ae in /usr/bin/clickhouse
     (version 23.7.1.2012)

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-24 10:34:50 +02:00
Alexey Milovidov
b225f9c34b
Merge pull request #52450 from ClickHouse/remove-to-decimal-string
Remove `toDecimalString`
2023-07-24 08:40:51 +03:00
Alexey Milovidov
f17844e9c2
Merge pull request #51037 from azat/dist/optimize_skip_unused_shards-join-fix
Fix optimize_skip_unused_shards with JOINs
2023-07-24 08:31:00 +03:00
Alexey Milovidov
a1a79eee0f
Merge pull request #51383 from ClickHouse/fix-potentially-bad-code
Remove suspicious code
2023-07-24 06:46:31 +03:00
Alexey Milovidov
eb5038f3e9
Merge pull request #52295 from ClickHouse/allow_vertical_merges_from_compact_to_wide_parts
Enable `allow_vertical_merges_from_compact_to_wide_parts` by default
2023-07-24 06:44:33 +03:00
robot-ch-test-poll4
a104ce6b3b
Merge pull request #52467 from hanfei1991/hanfei/refine-52451
do not throw exception in OptimizedRegularExpressionImpl::analyze
2023-07-24 05:38:54 +02:00
robot-ch-test-poll2
2b0c423d7d
Merge pull request #52499 from ClickHouse/try-fix-join-ast-fuzz-asan
Try to fix asan wanring in HashJoin
2023-07-24 02:10:59 +02:00
Alexey Milovidov
1bc83afa54
Merge branch 'master' into fix-potentially-bad-code 2023-07-24 03:02:57 +03:00
Alexey Milovidov
e8b271e878
Merge pull request #51916 from ClickHouse/maybe-better-tests
Maybe better tests
2023-07-24 03:01:39 +03:00
Alexey Milovidov
ffc3028438
Merge pull request #52146 from ClickHouse/more-changes
Fix ORDER BY tuple of WINDOW functions (and slightly more changes)
2023-07-24 03:00:35 +03:00
Alexey Milovidov
706da4d530
Merge pull request #51973 from ClickHouse/integration-tests-fix-disaster-2
Fix disaster in integration tests, part 2
2023-07-24 02:57:39 +03:00
Alexey Milovidov
d7cdfb47d3 Fix merge 2023-07-24 01:56:04 +02:00
Alexey Milovidov
5c15e6021b Merge branch 'master' into remove-to-decimal-string 2023-07-24 01:51:43 +02:00
robot-ch-test-poll4
fb045b0d86
Merge pull request #52498 from ClickHouse/dont_shutdown_interserver_before_tables
Don't shutdown interserver before tables
2023-07-24 01:45:25 +02:00
robot-clickhouse
dba7a0dffc Automatic style fix 2023-07-23 23:18:19 +00:00
Alexey Milovidov
40f5649811 Fix test 2023-07-24 01:02:11 +02:00
Alexey Milovidov
890bda177d Merge branch 'master' into allow_vertical_merges_from_compact_to_wide_parts 2023-07-24 00:57:48 +02:00
Han Fei
40992de98d
Merge branch 'master' into hanfei/refine-52451 2023-07-23 23:48:12 +02:00
Igor Nikonov
c0f16dcf03 Test from fuzzer 2023-07-23 21:10:12 +00:00
alesapin
e02948580b Don't shutdown interserver before tables 2023-07-23 22:38:59 +02:00
robot-clickhouse-ci-2
66c0015b87
Merge pull request #52050 from arenadata/ADQM-982
Subsequence string matching (new hasSubsequence() function)
2023-07-23 21:18:27 +02:00
Alexey Milovidov
7ff3579115
Merge pull request #49631 from ClickHouse/sparse-columns-by-default
Enable Sparse columns by default
2023-07-23 21:18:05 +03:00
Alexey Milovidov
5c2eb2d749
Merge pull request #52438 from ClickHouse/fix_remove_redundant_distinct_with_view
Fix: remove redundant distinct with views
2023-07-23 21:16:49 +03:00
robot-ch-test-poll4
1d6e85da91
Merge pull request #52084 from valbok/conv-charsets
MaterializedMySQL: Introduce charset conversion
2023-07-23 18:36:30 +02:00
Kseniia Sumarokova
b6ef57d32e
Merge pull request #52378 from kgoralski/filesystemCacheSizeLimitMetric
New metric - Filesystem cache size limit
2023-07-23 18:12:11 +02:00
Kseniia Sumarokova
a1782ea70e
Merge pull request #52211 from kssenii/fix-race-in-disk-web
Fix race in Web disk
2023-07-23 18:07:25 +02:00
Alexey Milovidov
4f5096c921
Merge pull request #52395 from azat/rust/reproducible-builds
Reproducible builds for Rust
2023-07-23 19:03:26 +03:00
Alexey Milovidov
13ca31edd4
Merge pull request #52418 from ClickHouse/kssenii-patch-8
Fix flaky gtest_lru_file_cache.cpp
2023-07-23 19:02:58 +03:00
Alexey Milovidov
2b25a81925
Merge pull request #52496 from ClickHouse/revert-52419-implement_borders_for_sampling_memory_profiler
Revert "Add an ability to specify allocations size for sampling memory profiler"
2023-07-23 19:01:03 +03:00
Alexey Milovidov
43bd6d1b83
Revert "Add an ability to specify allocations size for sampling memory profiler" 2023-07-23 19:00:49 +03:00
Alexey Milovidov
9d2e8e24ff
Merge pull request #52491 from azat/idatabase-cleanup
Remove skip_startup_tables from IDatabase::loadStoredObjects()
2023-07-23 18:28:44 +03:00
Alexey Milovidov
e3c85613c9
Merge pull request #52432 from amosbird/fix_52405
Fix normal projection with merge table
2023-07-23 18:27:51 +03:00
Han Fei
282258a855 fix style 2023-07-23 11:29:29 +02:00
Azat Khuzhin
8013cb1f78 Remove skip_startup_tables from IDatabase::loadStoredObjects()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-23 08:47:50 +02:00
Alexey Milovidov
045bb3e1f3
Merge pull request #50738 from ClickHouse/pufit/keeper-client-dns-resolve
More accurate DNS resolve for the keeper connection
2023-07-23 01:46:57 +03:00
Han Fei
ef0dca6261 fix style 2023-07-23 00:37:34 +02:00
Alexey Milovidov
d9d8782684
Merge branch 'master' into dist/optimize_skip_unused_shards-join-fix 2023-07-23 01:29:38 +03:00
Alexey Milovidov
0ef6453935
Merge pull request #52148 from azat/tests/EADDRINUSE
Fix possible EADDRINUSE ("Address already in use") in integration tests
2023-07-23 01:27:47 +03:00
Igor Nikonov
2d33661594
Merge branch 'master' into fix-potentially-bad-code 2023-07-22 22:48:07 +02:00
Azat Khuzhin
0b258dda4e Reproducible builds for Rust
From now on cargo will not download anything from the internet during
builds. This step had been moved for docker image builds (via cargo
vendor).

And now cargo inside docker.io/clickhouse/binary-builder will not use
any crates from the internet, so we don't need to add --offline for
cargo commands in cmake (corrosion_import_crate()).

Also the docker build command had been adjusted to allow following
symlinks inside build context, by using tar, this is required for Rust
packages.

Note, that to make proper Cargo.lock that could be vendored I did the
following:
- per-project locks had been removed (since there is no automatic way to
  sync the workspace Cargo.lock with per-project Cargo.lock, since cargo
  update/generate-lockfile will use only per-project Cargo.toml files
  apparently, -Z minimal-versions does not helps either)
- and to generate Cargo.lock with less changes I've pinned version in
  the Cargo.toml strictly, i.e. not 'foo = "0.1"' but 'foo = "=0.1"'
  then the Cargo.lock for workspace had been generated and afterwards
  I've reverted this part.

Plus I have to update the dependencies afterwards, since otherwise there
are conflicts with dependencies for std library. Non trivial.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2023-07-22 22:46:22 +02:00
robot-ch-test-poll3
c9eb144e15
Merge pull request #50826 from ucasfl/is_obsolete
Add a column is_obsolete to system.settings and similar tables
2023-07-22 22:43:11 +02:00
Alexey Milovidov
d25cd0d0b6 Partial revert 2023-07-22 20:21:33 +02:00
Alexey Milovidov
378da4b8f6 Merge branch 'master' into maybe-better-tests 2023-07-22 20:20:51 +02:00
Alexey Milovidov
6aabb1d94f
Merge pull request #52445 from ClickHouse/session-timezone-caveats
Add a note about potential caveats for the "session_timezone" setting
2023-07-22 21:18:00 +03:00
Igor Nikonov
82adef03ab Merge remote-tracking branch 'origin/master' into fix_remove_redundant_distinct_with_view 2023-07-22 18:10:24 +00:00
Igor Nikonov
2c6bc31847 Test is not dependent on new analyzer 2023-07-22 18:07:22 +00:00
Alexey Milovidov
89d646cef0
Merge pull request #52127 from ClickHouse/fix-system-licenses
Enumerate hard forks in the `system.licenses` table.
2023-07-22 20:54:31 +03:00