Commit Graph

87498 Commits

Author SHA1 Message Date
Vitaly Baranov
ed0af9d4a0 Improve shutdown with async backup/restore. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
97cd68239f Change represenation of shards inside backup. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
4de4fff590 Fix tests. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
042dc4abb2 Rename settings shard -> shard_num, replica -> replica_num. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
129eca7307 CREATE queries generated by RESTORE command is now considered as internal. 2022-04-25 16:34:34 +02:00
Vitaly Baranov
68a020ecea Implement BACKUP/RESTORE ON CLUSTER. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
030f3e488c Add shard_index and replica_index to params of executeDDLQueryOnCluster(). 2022-04-25 16:34:33 +02:00
Vitaly Baranov
3477665659 Add shard_index and replica_index to params of getRewrittenASTWithoutOnCluster(). 2022-04-25 16:34:33 +02:00
Vitaly Baranov
144d3aefeb Add system table system.backups; implement async mode for commands BACKUP & RESTORE 2022-04-25 16:34:33 +02:00
Vitaly Baranov
ec5b89a6ac Revert backup version 2. Add parameter data_file_path to handle duplicate files more easily without introducing a new backup format. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
c92a8925e3 Refactoring of backup implementation to support archives more easily. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
3966ee1e30 Use SeekableReadBuffer instead of ReadBuffer in IBackupEntry. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
f14613f433 Implemented backup version 2: now files in backups are named by their checksums.
It will allow to store duplicate files only one time.
2022-04-25 16:34:33 +02:00
Vitaly Baranov
acd28d8a1d Implement RESTORE for replicated tables. 2022-04-25 16:34:33 +02:00
Vitaly Baranov
6c3333b50b RESTORE TABLE doesn't create containing database anymore 2022-04-25 16:34:33 +02:00
Vitaly Baranov
d20b3d78c5 Rename some restore settings. 2022-04-25 16:34:17 +02:00
Vitaly Baranov
88b0cf3ca0 Fix TemporaryFileOnDisk 2022-04-25 16:33:38 +02:00
Vitaly Baranov
6743eb6bef Correct error messages shown by File & Disk backup engines. 2022-04-25 16:33:38 +02:00
Sergei Trifonov
fa5da60b72
Merge pull request #36629 from ClickHouse/serxa-patch-1
fix typo
2022-04-25 16:07:22 +02:00
Sergei Trifonov
ad9d57807f
fix typo 2022-04-25 16:06:14 +02:00
Yatsishin Ilya
06b724b940 Version history benchmarks 2022-04-25 13:57:31 +00:00
Azat Khuzhin
3c43914f9a tests: simplify 01834_alias_columns_laziness_filimonov
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 16:51:39 +03:00
Mikhail f. Shiryaev
824335ca33
Filter out sychronized events globbaly 2022-04-25 14:45:11 +02:00
Yakov Olkhovskiy
579e8105a3
Merge pull request #36468 from ClickHouse/decouple_ParserAttachAccessEntity
Refactoring dependency for ParserAttachAccessEntity
2022-04-25 08:28:17 -04:00
Mikhail f. Shiryaev
f53040b95e
Merge pull request #36559 from ClickHouse/performance-rebalance
Use just index to split performance tests by group
2022-04-25 14:15:23 +02:00
alesapin
46ac2f3e36
Merge pull request #36607 from ClickHouse/exclude_bc_test
Exclude test `02271_fix_column_matcher_and_column_transformer` from bc check
2022-04-25 14:00:13 +02:00
Azat Khuzhin
23347a878d tests: update 01173_transaction_control_queries
Since now on INSERT failures reconnect does not happens.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 14:42:30 +03:00
Azat Khuzhin
01329d7d08 Explicit disconnect in case of error during Ping <-> Pong
v2: fix lifetime of the socket for TimeoutSetter
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 14:42:29 +03:00
Azat Khuzhin
a939a20443 client: gracefully handle client exceptions for INSERT queries
In other words avoid reconnect in this case, like in [1]:

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/36587/3dc8aa8caa8918f8e4a42dea72da2b94ed5e17ca/fast_test__actions_.html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 14:42:29 +03:00
Azat Khuzhin
53be9c5d0c client: add a message on reconnect (under warning log level)
This will make debugging tests easier, since sometimes it is possible
for server to hung for a few seconds, and this leads to client
reconnect, which can leave the query in backround, like in [1] ([2]).

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/35865/0cb3770d104b5f673d1d0d1076ac3fd3619fee9e/stateless_tests__debug__actions__%5B2/3%5D.html
  [2]: https://github.com/ClickHouse/ClickHouse/pull/35865#issuecomment-1099516534

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 14:42:29 +03:00
Kseniia Sumarokova
2106a7b895
Merge pull request #36489 from awakeljw/fork_chmaster
fix ConvertDecimalType unexpected behavior
2022-04-25 13:23:54 +02:00
Nikolai Kochetov
0fa63a8d65
Merge pull request #36549 from ClickHouse/interpolate-alias-fix
Avoid projections if INTERPOLATE with expressions is present
2022-04-25 13:18:00 +02:00
Kruglov Pavel
34c342fdd3
Merge pull request #36205 from Avogar/improve-globs
Some refactoring around schema inference with globs
2022-04-25 13:14:46 +02:00
Robert Schulze
62aba875f5
Make arch detection more robust
- Properly handle the case that we are on an unsupported but unlisted
  arch, e.g. mips. Before, we would simply continue
  configuration/compilation with no architecture set.

- CMake variable "ARCH_ARM" could in theory be replaced by
  "ARCH_AARCH64". This would need refactoring in dependent CMakeLists,
  therefore not doing it now.
2022-04-25 13:08:17 +02:00
Robert Schulze
730ce1806c
Simplify using RECONFIGURE_MESSAGE_LEVEL
The behavior stays the same, but we are using the same logic that is
used elsewhere too.
2022-04-25 12:56:57 +02:00
Robert Schulze
63221c8779
Update outdated clang-tidy instructions 2022-04-25 12:56:45 +02:00
Robert Schulze
c33d66a31a
Sync allowed clang-tidy versions with documentation 2022-04-25 12:56:21 +02:00
tavplubix
7246101f61
better fix for tests 2022-04-25 13:51:33 +03:00
Robert Schulze
017fde4136
Update required CMake version in build.md 2022-04-25 12:48:54 +02:00
Robert Schulze
2b3340861b
Remove support for ancient CMake
The first line in CMakeLists.txt says the minimum CMake version is
3.14. Therefore removing special code for earlier CMake versions.
2022-04-25 12:48:24 +02:00
Nikolai Kochetov
d5b2d28f7b
Merge pull request #36579 from amosbird/refactor-executor1
Small refactoring of Processors and QueryPipeline
2022-04-25 12:47:59 +02:00
Mikhail f. Shiryaev
71942b6504
Merge pull request #36604 from ClickHouse/check-style-in-docs
Check style in docs, fixes the issue affected #36596
2022-04-25 12:25:36 +02:00
Mikhail f. Shiryaev
f3aaff773a
Disable broken performance test 2022-04-25 11:26:05 +02:00
alesapin
a8f3f9704e Exclude test from bc check 2022-04-25 11:20:22 +02:00
Antonio Andelic
d60384d336
Merge pull request #36469 from bigo-sg/fix_ranger_generator
Fix bug of range generator
2022-04-25 10:52:34 +02:00
Mikhail f. Shiryaev
099093c64c
Check style in documentation PRs 2022-04-25 09:42:55 +02:00
Azat Khuzhin
278101fc0c Add a comment for taskstruct netlink interface rounding to KiB
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 08:49:17 +03:00
Azat Khuzhin
35613e3010 tests: adopt 01268_procfs_metrics for difference between proc and taskstruct
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 08:49:17 +03:00
Azat Khuzhin
aaa222821c tests: simplify 01268_procfs_metrics
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2022-04-25 08:49:08 +03:00
Azat Khuzhin
d161b798a8 Strict taskstats parser
This will unhide possible issues (since sometimes statistics is
inaccurate).

Also before this patch TASKSTATS_TYPE_AGGR_TGID had been handled, while
it not correct to take into account, but it was not requested anyway.

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
(cherry picked from commit bfa65b651a)
2022-04-25 07:56:54 +03:00