Commit Graph

11488 Commits

Author SHA1 Message Date
Kseniia Sumarokova
352e9d7397
Merge pull request #71542 from ClickHouse/rest-catalog
Integrate with Iceberg REST Catalog
2024-12-12 10:04:24 +00:00
Robert Schulze
ccbbce2b72
Merge pull request #72992 from ClickHouse/revert-72690-add_totalbytes_of_inactive_parts
Revert "Add total_bytes_with_inactive to system.tables"
2024-12-11 15:58:50 +00:00
kssenii
c2cf17c2dd Merge remote-tracking branch 'origin/master' into rest-catalog 2024-12-10 19:35:55 +01:00
Nikita Fomichev
787cf7db89
Merge pull request #68154 from ClickHouse/mv4-test
Add integration tests for Refreshable Materialized Views (mv4)
2024-12-10 13:20:42 +00:00
Pavel Kruglov
8f0baa593b
Merge pull request #72108 from Avogar/format-inference-load
Add inferred format name to create query in File/S3/URL/HDFS/Azure engines
2024-12-10 13:14:58 +00:00
Kseniia Sumarokova
85f86196c4
Merge pull request #72990 from jsc0218/BetterPGArrayEmptyHint
Better PG Empty Array Prompt
2024-12-10 10:51:52 +00:00
Robert Schulze
c56ece0780
Revert "Add total_bytes_with_inactive to system.tables" 2024-12-09 22:55:34 +01:00
jsc0218
04d59c7a7c fix 2024-12-09 19:44:59 +00:00
kssenii
43e6678212 Review fixes, fix test 2024-12-09 19:18:10 +01:00
Kseniia Sumarokova
63603cc6d7
Merge pull request #72810 from ClickHouse/disable-metadata-deletion-in-s3-queue
Better deletion of metadata in s3queue
2024-12-09 16:35:48 +00:00
Nikita Fomichev
eb42bbbf74 RMV: fix tests with replicated db 2024-12-09 17:05:04 +01:00
Nikita Fomichev
610ee9e2c9 RMV: fix tests with replicated db 2024-12-09 17:05:03 +01:00
Nikita Fomichev
d01515ce05 RMV: add jinja2 dependency 2024-12-09 17:05:03 +01:00
Michael Kolupaev
1f1a9faa69 Some fixes 2024-12-09 17:05:03 +01:00
Nikita Fomichev
6d72f4774e Tests: add RMV tests 2024-12-09 17:05:03 +01:00
Nikita Fomichev
92a9199c76 Tests: add RMV tests 2024-12-09 17:05:03 +01:00
Nikita Fomichev
c9c8c9d267 Tests: add RMV tests 2024-12-09 17:05:03 +01:00
kssenii
246f73e584 Merge remote-tracking branch 'origin/master' into rest-catalog 2024-12-09 12:00:42 +01:00
kssenii
0087ad3fe5 Fix test 2024-12-09 11:52:40 +01:00
Kseniia Sumarokova
1ab0aaa65f
Merge pull request #72896 from ClickHouse/fix-flaky-test-s3-queue
Fix flaky test
2024-12-09 10:45:31 +00:00
Shichao Jin
f36eb17bf6
Merge pull request #72690 from nauu/add_totalbytes_of_inactive_parts
Add total_bytes_with_inactive to system.tables
2024-12-07 01:12:27 +00:00
kssenii
924e274cf2 Merge remote-tracking branch 'origin/master' into disable-metadata-deletion-in-s3-queue 2024-12-06 17:33:30 +01:00
kssenii
9b28d404e2 Review fixes 2024-12-06 17:31:42 +01:00
kssenii
bd577939b1 Fix 2024-12-06 16:36:02 +01:00
Andrey Zvonov
9b0f33b897
Merge branch 'ClickHouse:master' into hotfix-72756 2024-12-06 13:43:26 +01:00
Kseniia Sumarokova
02f27e53f7
Merge pull request #72858 from ClickHouse/fix-backup-resotre-of-empty-file-with-plain-rewr
Fix backup/restore with plain rewritable disk in case there are empty files in backup
2024-12-06 10:53:16 +00:00
Julia Kartseva
8694ce5456 try fix test_backup_restore_s3 2024-12-05 23:37:29 +00:00
Pavel Kruglov
613bbd4019
Merge branch 'master' into format-inference-load 2024-12-05 19:25:21 +01:00
kssenii
13dbd31608 Fix backup/restore of empty file 2024-12-05 19:08:38 +01:00
Mikhail Artemenko
55d6a7f603
Merge pull request #72593 from azat/config-zk-sync
Ensure that ClickHouse will see ZooKeeper changes on config reloads
2024-12-05 17:44:51 +00:00
Mikhail f. Shiryaev
65d895a6db
Merge pull request #72835 from ClickHouse/limit-integration-tests-memory
Limit the docker memory to {HOST_MEM-2G}, preventing OOMs
2024-12-05 15:20:03 +00:00
Vladimir Cherkasov
d88f39c7e9
Merge pull request #67323 from kirillgarbar/ch-disks-remove
Reduce memory usage for removeSharedRecursive operation
2024-12-05 13:58:53 +00:00
Alexander Tokmakov
d22174e3bf
Merge pull request #72685 from ClickHouse/rdb_fix_flatten_nested
Fix flatten_nested when recovering a Replicated database
2024-12-05 13:26:50 +00:00
Mikhail f. Shiryaev
726054d161
Print the argparse help with defaults 2024-12-05 13:15:36 +01:00
Mikhail f. Shiryaev
5b1d454f2e
Make docker container memory a CLI argument 2024-12-05 13:14:33 +01:00
Mikhail f. Shiryaev
9489137e23
Fix typing warnings 2024-12-05 12:39:52 +01:00
Mikhail f. Shiryaev
90d655dd96
Limit the docker memory to {HOST_MEM-2G} 2024-12-05 12:32:43 +01:00
Miсhael Stetsyuk
4346ccb434
Merge pull request #72637 from ClickHouse/startup-scripts-execution-state
add `StartupScriptsExecutionState` metric
2024-12-05 10:43:04 +00:00
Daniil Ivanik
9f425ebe73
Merge pull request #69445 from ClickHouse/divanik/add_schema_evolution_concise
Make simple schema evolution for Iceberg data format
2024-12-05 10:22:55 +00:00
Kseniia Sumarokova
777b016d6a
Merge pull request #72738 from ClickHouse/s3queue-avoid-no-such-key
Fix no-such-key in s3queue in certain case
2024-12-04 22:32:37 +00:00
Azat Khuzhin
1aa320c0ca tests: allow nested with_replace_config()
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 22:54:44 +01:00
Andrey Zvonov
8bf03e8a21 small test update 2024-12-04 19:53:40 +00:00
Kseniia Sumarokova
fe01be106c
Update test.py 2024-12-04 19:38:26 +01:00
Azat Khuzhin
47397a45c5 tests: make test_config_substitutions idempotent
Now the following passed:

    $ bin=$(which clickhouse); g=$PWD; docker run --privileged -it --rm --volume=$bin:/clickhouse --volume=$bin:/usr/share/clickhouse_fresh --volume=/dev/null:/usr/bin/clickhouse-odbc-bridge --volume=/dev/null:/usr/share/clickhouse-odbc-bridge_fresh --volume=$g/programs/server:/clickhouse-config --volume=$g:/ClickHouse --volume=$g/docker/test/integration/runner/compose:/compose:ro --volume=clickhouse-integration-tests:/var/lib/docker -e PYTEST_ADDOPTS='-vvv -s --pdb --count 2 test_config_substitutions/test.py' --name ch clickhouse/integration-tests-runner

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
f1e909e309 Remove config_reload_sync_zookeeper (issue sync unconditionally)
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
c9291949ba Enable config_reload_sync_zookeeper for test_config_substitutions
This should fix flakiness of `test_config_substitutions/test.py::test_config_multiple_zk_substitutions` [1].

  [1]: https://s3.amazonaws.com/clickhouse-test-reports/71406/af822de0bf896dcb0a28f55889d12611bd38171a/integration_tests__asan__old_analyzer__[1_6].html

Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
ac0fb050f1 Add ability to sync ZooKeeper before reloading the config
Otherwise it is not deterministic wether ClickHouse will see this
change, i.e. if you created znode just before `SYSTEM RELOAD CONFIG` it
is not 100% that the ClickHouse will see it.

Refs: apache/zookeeper@8ee17324ce
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
kssenii
03f44e8920 Merge remote-tracking branch 'origin/master' into disable-metadata-deletion-in-s3-queue 2024-12-04 17:41:26 +01:00
kssenii
7fc60d84cc Better deletion of keeper metadata in s3queue 2024-12-04 17:39:04 +01:00
Andrey Zvonov
bd74ac343b fix black 2024-12-04 15:40:43 +00:00