Hot Backup Copy (Replication) fails and retries some large clients - Connect IT Community

/* * These styles apply ONLY to the header and footer assets. */ * { padding: 0; margin: 0; box-sizing: border-box; } .super-nav { display: flex; justify-content: flex-end; align-items: center; margin: 0 auto; max-width: 1264px; padding-left: 40px; padding-right: 40px; height: 40px; text-align: right; } .super-nav a { color: #34427c; margin-right: 20px; padding: 10px; text-decoration: none; } .super-nav a:hover, .super-nav a:focus { background-color: #f7f9fa; } .footer { background: #f5f5f6; color: #555a62; font-size: 14px; line-height: 1.5; padding: 0; } .footer-image { background-image: url("/themes/kaseya/assets/images/footerImage.png"); height: 500px; background-repeat: no-repeat; background-size: cover; margin-top: -100px; } .footer-wrap { padding-left: 18px; padding-right: 18px; max-width: 1236px; margin: 0 auto; } .footer-main-content { background-color: #000; padding: 100px 0; } .footer .footer-col-title { color: #ffffff; font-weight: 700; font-size: 13px; padding-bottom: 10px; text-transform: uppercase; } .footer .footer-link { color: #9b9ca0; text-decoration: none; } .footer .footer-link:hover, .footer .footer-link:focus, .footer .footer-link:active { text-decoration: underline; } .footer-main-content .footer-link { padding-top: 10px; } .footer-row { display: flex; flex-wrap: wrap; justify-content: space-between; align-items: center; margin: -3px; } .footer-main-content-row { align-items: flex-start; } .footer-bottom-content { padding: 10px; align-items: center; } .footer-col { padding: 0 3px; display: flex; flex-direction: column; } .footer-col-copyRight { justify-content: flex-start; color: #9b9ca0; flex: 1; display: flex; } .footer-last-col { flex-direction: row; } .footer-last-col .footer-link { padding-right: 10px; text-transform: uppercase; } @media screen and (max-width: 768px) { .super-nav { padding-right: 0; } .footer-image { height: 250px; } .footer-main-content { padding: 40px 0; } .footer .footer-col-title { padding-top: 10px; } .footer-row:not(.footer-main-content-row) { display: block; } .footer-col:not(.footer-main-content-col) { width: 100%; text-align: center; padding: 10px 0; } .footer-main-content-col { width: 50%; } .footer-last-col { flex-direction: column; } .footer-last-col .footer-link { padding-bottom: 10px; } } /*# sourceMappingURL=styles.css.map */ Ask the Community Groups

Hot Backup Copy (Replication) fails and retries some large clients - Connect IT Community | Kaseya

SUMMARY

Hot Backup Copy (Replication) will have a large job in progress, then fail and start from the beginning. This may be successful or continue to retry.

ISSUE

Hot backup copy jobs (formerly called replication), may process normally for most clients, but fail and retry for some others. Those jobs may complete normally, or, may continue to restart. This can be especially common on very large backups.

A specific type of network timeout, where certain results of database requests against the target were not returned properly, can cause a postCheckOffset error in logs. In some cases, detecting and retrying the transaction may result in success.

For more information on Hot Backup Copy (Replication) issues see Unitrends KB 5030 - Hot Backup Copy (Replication) Overview, Setup and Error Troubleshooting

RESOLUTION

Upgrade the sources and target to release 9.0.0-13 or later and then retry replication.

To verify the replication target is on release 9.0.0-13 or higher, run the following command from a command shell on the source appliance:

psql -c "select * from bp.managers"

If you are a Unitrends Cloud customer and find your target to be on a release prior to 9.0.0-13, please contact Unitrends Support.

This issue is difficult to troubleshoot as it requires access to the target, reset of log levels, increased log retention, and reproduction of the issue live. If an upgrade to release 9.0.0-13 or later has not resolved backup copy failures, please contact Unitrends Support.

CAUSE

In release 9.0.0-13 and later, reliability improvements allow for proper retries, especially on network connections where reliability may be a concern. Note: these issues may not be directly related to the local network, ISP connection, or hardware in use. While the fix for this issue is on the replication target, not the source, both ends must be upgraded for the benefit.

To confirm this error was occurring requires access to the replication target vaultServer logs.

When reviewing the vaultserver logs for a job that failed, the following output may be seen:

vaultServer.c:2916: blockCheckOffset: call putBackupsHashValues return 0, backup_no 798, epoch 1461976349, nu mber entries 1024.

Log level 2 for VaultServer is required to completely troubleshoot this condition.