Mikhail f. Shiryaev
90d655dd96
Limit the docker memory to {HOST_MEM-2G}
2024-12-05 12:32:43 +01:00
Miсhael Stetsyuk
4346ccb434
Merge pull request #72637 from ClickHouse/startup-scripts-execution-state
...
add `StartupScriptsExecutionState` metric
2024-12-05 10:43:04 +00:00
Daniil Ivanik
9f425ebe73
Merge pull request #69445 from ClickHouse/divanik/add_schema_evolution_concise
...
Make simple schema evolution for Iceberg data format
2024-12-05 10:22:55 +00:00
Kseniia Sumarokova
777b016d6a
Merge pull request #72738 from ClickHouse/s3queue-avoid-no-such-key
...
Fix no-such-key in s3queue in certain case
2024-12-04 22:32:37 +00:00
Azat Khuzhin
1aa320c0ca
tests: allow nested with_replace_config()
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 22:54:44 +01:00
Andrey Zvonov
8bf03e8a21
small test update
2024-12-04 19:53:40 +00:00
Kseniia Sumarokova
fe01be106c
Update test.py
2024-12-04 19:38:26 +01:00
Azat Khuzhin
47397a45c5
tests: make test_config_substitutions idempotent
...
Now the following passed:
$ bin=$(which clickhouse); g=$PWD; docker run --privileged -it --rm --volume=$bin:/clickhouse --volume=$bin:/usr/share/clickhouse_fresh --volume=/dev/null:/usr/bin/clickhouse-odbc-bridge --volume=/dev/null:/usr/share/clickhouse-odbc-bridge_fresh --volume=$g/programs/server:/clickhouse-config --volume=$g:/ClickHouse --volume=$g/docker/test/integration/runner/compose:/compose:ro --volume=clickhouse-integration-tests:/var/lib/docker -e PYTEST_ADDOPTS='-vvv -s --pdb --count 2 test_config_substitutions/test.py' --name ch clickhouse/integration-tests-runner
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
f1e909e309
Remove config_reload_sync_zookeeper (issue sync unconditionally)
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
c9291949ba
Enable config_reload_sync_zookeeper for test_config_substitutions
...
This should fix flakiness of `test_config_substitutions/test.py::test_config_multiple_zk_substitutions` [1].
[1]: https://s3.amazonaws.com/clickhouse-test-reports/71406/af822de0bf896dcb0a28f55889d12611bd38171a/integration_tests__asan__old_analyzer__[1_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
Azat Khuzhin
ac0fb050f1
Add ability to sync ZooKeeper before reloading the config
...
Otherwise it is not deterministic wether ClickHouse will see this
change, i.e. if you created znode just before `SYSTEM RELOAD CONFIG` it
is not 100% that the ClickHouse will see it.
Refs: apache/zookeeper@8ee17324ce
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-12-04 17:42:35 +01:00
kssenii
03f44e8920
Merge remote-tracking branch 'origin/master' into disable-metadata-deletion-in-s3-queue
2024-12-04 17:41:26 +01:00
kssenii
7fc60d84cc
Better deletion of keeper metadata in s3queue
2024-12-04 17:39:04 +01:00
Andrey Zvonov
bd74ac343b
fix black
2024-12-04 15:40:43 +00:00
Kseniia Sumarokova
d9da4e4235
Update test.py
2024-12-04 16:27:11 +01:00
Andrey Zvonov
c239adec36
add test
2024-12-04 14:59:58 +00:00
divanik
30ccc96c93
Resolve conflicts
2024-12-04 12:29:09 +00:00
Kseniia Sumarokova
e94a42c576
Update test.py
2024-12-04 11:38:01 +01:00
Antonio Andelic
373d6acbdd
Merge pull request #72730 from ClickHouse/fix-keeper-internal-ssl
...
Fix advanced SSL configuration for Keeper's internal communication
2024-12-04 08:20:57 +00:00
kssenii
7bee0a4872
Speed up the test
2024-12-03 18:29:50 +01:00
kssenii
bd284fbb0d
Add a test
2024-12-03 18:17:25 +01:00
divanik
f1219d3e8e
Merge branch 'master' of github.com:ClickHouse/ClickHouse into divanik/add_schema_evolution_concise
2024-12-03 15:27:45 +00:00
Vladimir Cherkasov
902a42fead
Merge branch 'master' into ch-disks-remove
2024-12-03 14:23:17 +01:00
Antonio Andelic
340b0a9860
Fix style
2024-12-03 13:18:52 +01:00
kssenii
f8696aa010
Merge remote-tracking branch 'origin/master' into rest-catalog
2024-12-03 12:21:59 +01:00
Antonio Andelic
d65f440679
Fix advanced SSL configuration for Keeper's internal communication
2024-12-03 09:44:17 +01:00
Michael Kolupaev
bc267d4427
Merge remote-tracking branch 'origin/master' into ssett
2024-12-03 06:51:08 +00:00
nauu
94b4a5190f
Change * to a specific column,because if the new version of system.tables adds a new column,it will cause an identifier error
2024-12-03 11:37:42 +08:00
Yakov Olkhovskiy
617af1d3c0
Merge pull request #71297 from lzydmxy/force-connect-on-retry
...
Force_connected for retry resume connection establisher
2024-12-03 01:21:31 +00:00
Alexander Tokmakov
12ac21f10f
fix flatten_nested when recovering a Replicated db
2024-12-02 11:08:43 +01:00
Raúl Marín
0a5a0a2973
Merge pull request #72402 from Algunenano/keeper_fault
...
Better error message on bad keeper snapshots
2024-12-02 09:24:16 +00:00
robot-clickhouse
fad3f2ff00
Automatic style fix
2024-11-29 17:54:14 +00:00
Michael Stetsyuk
b512997e50
better test
2024-11-29 17:45:55 +00:00
vdimir
0a5bc248fd
Merge branch 'master' into vdimir/join_select_inner_table
2024-11-29 15:50:25 +00:00
Mikhail Artemenko
b81ee27750
Merge pull request #71406 from azat/automatic-external-aggregation
...
Automatic GROUP/ORDER BY to disk based on the memory usage
2024-11-29 12:27:43 +00:00
Alexey Katsman
d7167bd103
Merge pull request #72548 from alexkats/dict
...
Add source query validation for dictionaries
2024-11-29 11:25:40 +00:00
alesapin
d25b15a3b1
Merge pull request #72613 from ClickHouse/nopctest
...
Remove flaky test_page_cache
2024-11-29 10:16:13 +00:00
Michael Kolupaev
29b722df29
Remove flaky test_page_cache
2024-11-28 21:09:12 +00:00
Pablo Marcos
d8a235b785
Merge pull request #67733 from Zawa-ll/66073-system-load-primary-key-rebase
...
Added statement `SYSTEM LOAD PRIMARY KEY`
2024-11-28 16:02:31 +00:00
Alex Katsman
23086e1424
Add source query validation for dictionaries
2024-11-28 15:38:07 +00:00
Azat Khuzhin
bdb39a6fef
Change logic of automatic ORDER/GROUP BY to be based on available memory
...
- remove max_bytes_ratio_before_external_{order,group_by}_for_server
- change the way max_bytes_ratio_before_external_{order,group_by} works
Note, that it is not enough to transform ratio to bytes in
executeQuery(), since in this case it will not work for merges and
internal queries, plus, you have to reset them for Distributed engine
and update it for Merge/View/...
This patch also introduce some helpers (see MemoryTrackerUtils) and
adjust Aggregator::Params constructor to accept Settings object instead
of tons of arguments.
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
db1f459cc4
tests: disable test_max_bytes_ratio_before_external_order_group_by_for_server under TSan
...
The problem is that TSan has some memory overhead which increases
process RSS to 10Gi in the middle of the query and it will fail.
Another option is to avoid syncing with RSS too frequently, but I doubt
that it is significant to run this test under TSan
v1: increase memory to 20Gi
Fixes: https://s3.amazonaws.com/clickhouse-test-reports/71406/b33be86dee3c7616e9193c339837b9e250810557/integration_tests__tsan__[6_6].html
v2: instead just disable under TSan
Fixes: https://s3.amazonaws.com/clickhouse-test-reports/71406/df68cf7362d825c3d83991fd74c391a49e73a8b1/integration_tests__tsan__[6_6].html
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Azat Khuzhin
02aa6eac82
Cover max_bytes_ratio_before_external_{order,group_by}_for_server
...
Signed-off-by: Azat Khuzhin <a.khuzhin@semrush.com>
2024-11-28 16:01:53 +01:00
Pablo Marcos
f1f5304484
Update test_grant_and_revoke/test_with_table_engine_grant.py::test_grant_all_on_table
2024-11-28 08:59:49 +00:00
Igor Nikonov
97bd43894d
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-28 08:12:31 +00:00
Vitaly Baranov
e7e30d67fb
Merge pull request #72552 from vitlibar/increase-timeout-in-test_short_disconnection_doesnt_stop_restore
...
Increase timeout in test_short_disconnection_doesnt_stop_restore
2024-11-27 20:17:22 +00:00
robot-clickhouse
dbf217f32a
Automatic style fix
2024-11-27 19:57:56 +00:00
Igor Nikonov
10d721991e
Remove local_plan duplication
2024-11-27 19:46:41 +00:00
Igor Nikonov
ff2f791e57
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-27 19:24:42 +00:00
Vladimir Cherkasov
9344c1e679
Merge branch 'master' into vdimir/join_select_inner_table
2024-11-27 18:05:07 +01:00
Vitaly Baranov
6657d04553
Increase timeout in test_short_disconnection_doesnt_stop_restore.
2024-11-27 17:42:28 +01:00
Nikita Taranov
d59fe5fd7f
Merge pull request #70788 from ClickHouse/parallel_hash_by_def
...
Use `parallel_hash` join algorithm by default
2024-11-27 16:18:02 +00:00
Vladimir Cherkasov
d77794d285
Merge branch 'master' into vdimir/join_select_inner_table
2024-11-27 11:05:26 +01:00
Robert Schulze
e9f083b26d
Merge pull request #71997 from allmazz/delete_old_mongodb_integration
...
Get rid of the legacy mongodb integration
2024-11-26 21:51:46 +00:00
Konstantin Bogdanov
ca2d9ccef5
Merge pull request #72429 from ClickHouse/fix-backups-except-tables-formatting
...
Fix `BACKUP ... EXCEPT TABLES` queries formatting and parsing
2024-11-26 18:08:19 +00:00
Vladimir Cherkasov
96be57aed2
Merge branch 'master' into vdimir/join_select_inner_table
2024-11-26 18:40:18 +01:00
Robert Schulze
6a899f97eb
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-26 17:33:41 +00:00
Raúl Marín
dd092411ff
Merge pull request #72455 from Algunenano/rename_setting
...
Rename allowed_feature_tier to allow_feature_tier
2024-11-26 15:54:01 +00:00
vdimir
a8b0b748d0
Resubmit #68682 , att2
2024-11-26 12:59:38 +00:00
Robert Schulze
45e1702f82
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-26 12:44:06 +00:00
Robert Schulze
2ed07b21d3
Fix test_mask_sensitive_info
2024-11-26 12:43:08 +00:00
Raúl Marín
575e17758d
Adjust tests
2024-11-26 13:34:00 +01:00
Vladimir Cherkasov
37cd162397
Merge pull request #72357 from aalexfvk/fix_move_zero_copy_part_test
...
Remove flaky test test_move_shared_lock_fail_keeper_unavailable and extend the stable one
2024-11-26 11:39:23 +00:00
Raúl Marín
b487f59496
Rename allowed_feature_tier to allow_feature_tier
2024-11-26 12:30:57 +01:00
Igor Nikonov
53fcfe4180
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-26 10:54:28 +00:00
Igor Nikonov
2b1b4d0516
fix test_parallel_replicas_all_marks_read
2024-11-26 10:54:23 +00:00
kssenii
7a584f4340
Merge remote-tracking branch 'origin/master' into rest-catalog
2024-11-26 11:11:54 +01:00
Kseniia Sumarokova
ecd1fcb21a
Merge pull request #71301 from MikhailBurdukov/fix_zombies_in_lib_bridge
...
Fixed zombie processes after library bridge crash.
2024-11-26 10:03:14 +00:00
robot-clickhouse
7ed67942e8
Automatic style fix
2024-11-26 04:14:42 +00:00
Konstantin Bogdanov
b2d358c27b
Add tests
2024-11-26 05:06:14 +01:00
robot-clickhouse
8226903918
Automatic style fix
2024-11-25 21:41:10 +00:00
Igor Nikonov
38132c1451
Update test_parallel_replicas_protocol
2024-11-25 21:32:57 +00:00
Igor Nikonov
62b256422a
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-25 20:53:05 +00:00
Nikita Taranov
879035e841
Merge branch 'master' into parallel_hash_by_def
2024-11-25 20:18:04 +01:00
Nikita Taranov
63e9204c52
fix
2024-11-25 19:30:35 +01:00
kssenii
1e80f58b4a
Merge remote-tracking branch 'origin/master' into rest-catalog
2024-11-25 19:28:27 +01:00
kssenii
8239663c05
Add experimental flag
2024-11-25 19:23:19 +01:00
Raúl Marín
4585a6225c
Revert "Resubmit #68682 "
2024-11-25 19:20:14 +01:00
Robert Schulze
17f27275ae
Merge remote-tracking branch 'ClickHouse/master' into delete_old_mongodb_integration
2024-11-25 17:23:15 +00:00
Vladimir Cherkasov
95b21f4a44
Merge pull request #71577 from ClickHouse/vdimir/join_select_inner_table
...
Resubmit #68682
2024-11-25 13:24:51 +00:00
kssenii
1016add3d8
Add comments, fix test
2024-11-25 14:22:54 +01:00
kssenii
6540a7e5d7
Merge remote-tracking branch 'origin/master' into rest-catalog
2024-11-25 12:59:47 +01:00
Aleksei Filatov
bf102d2a00
Remove flaky test and extend stable one
2024-11-24 14:26:38 +00:00
Alexey Milovidov
2379629fd4
Merge pull request #72304 from ClickHouse/fix_postgres_utility
...
Fix check in `test_postgresql_replica_database_engine_2`
2024-11-24 01:52:59 +00:00
Igor Nikonov
d146c76745
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-22 23:02:33 +00:00
robot-clickhouse
7dead112d1
Automatic style fix
2024-11-22 20:11:27 +00:00
Nikita Taranov
b3344558c1
fix
2024-11-22 21:01:05 +01:00
Vladimir Cherkasov
26de447039
Merge pull request #70603 from zwy991114/check-table-structure-completely-setting
...
Add setting enforce_index_structure_match_on_partition_manipu..
2024-11-22 16:30:34 +00:00
avogar
e3266bf7f5
Merge branch 'master' of github.com:ClickHouse/ClickHouse into format-inference-load
2024-11-22 12:25:25 +00:00
robot-clickhouse
3af404f2c9
Automatic style fix
2024-11-21 15:53:25 +00:00
divanik
438aa415a6
Resolve issues
2024-11-21 15:42:47 +00:00
Igor Nikonov
207f1c29e6
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-21 13:43:59 +00:00
Vladimir Cherkasov
95e72b7588
Merge branch 'master' into vdimir/join_select_inner_table
2024-11-21 12:42:38 +01:00
MikhailBurdukov
ea375aecb3
Increase timeout
2024-11-21 09:53:31 +00:00
MikhailBurdukov
4cc8d36419
Redesigned
2024-11-21 09:53:30 +00:00
MikhailBurdukov
cb4741f770
Fix zombie processes after library brigde crash.
2024-11-21 09:53:30 +00:00
Antonio Andelic
cc3c7e74ae
Merge pull request #70523 from ClickHouse/randomize-keeper-feature-flasgs-keeper
...
Randomize Keeper feature flags in integration tests
2024-11-21 08:20:07 +00:00
Alexey Milovidov
25bd73ea5e
Merge pull request #72023 from ClickHouse/fix-bind
...
Fix comments
2024-11-21 05:03:24 +00:00
Igor Nikonov
fd35a5ab9b
Fix test_parallel_replicas_all_marks_read
2024-11-20 22:57:09 +00:00
Igor Nikonov
808436a75d
Merge remote-tracking branch 'origin/master' into pr-skip-index-analysis-on-workers
2024-11-20 22:08:23 +00:00
