How to Configure Veeam Kasten for Kubernetes Dashboard to Use a New Certificate

Purpose This article documents how to troubleshoot and replace the certificate used by the Veeam Kasten for Kubernetes Dashboard. Scenario Example The Veeam Kasten for Kubernetes Dashboard becomes inaccessible due to an expired certificate, resulting in an HTTP ERROR 401 , indicating a lack of...

How to Patch Veeam Kasten for Kubernetes CR used by Red Hat Marketplace Operator

Purpose This article provides an easy way to patch the Veeam Kasten for Kubernetes operand and make changes to the Veeam Kasten for Kubernetes configuration in an operator-based installation. Solution Veeam Kasten for Kubernetes is available for installation in an OCP cluster through either helm...

Veeam Kasten for Kubernetes - vSphere Block Mode Exports Failure With Error 14009

Challenge During vSphere block mode export, in certain situations, it might be observed that the folders/objects get created in the storage bucket. However, the export job remains stuck, and the following error message is seen in the debug logs: "Open virtual disk file failed. The error code is...

How to Clean Up Veeam Kasten for Kubernetes Orphaned Volumes on GKE k8s 1.28.x

Purpose This guide provides instructions on how to clean up Veeam Kasten for Kubernetes provisioned PVs that are not deleted, causing orphaned volumes in the GKE k8s 1.28 release. It has been observed on GKE running k8s 1.28, Veeam Kasten for Kubernetes provisioned PVs using in-tree provisioner...

Upgrading Veeam Kasten for Kubernetes Fails With Parse Error

Challenge When upgrading to Veeam Kasten for Kubernetes 6.5.3 or higher the upgrade fails with: parse error at k10/templates/v0services.yaml:128: function "continue" not defined Cause This issue is related to the Helm binary version that is installed. Solution To resolve this issue, download the...

Backup Failing With `Too many snapshots` When Using Longhorn as a Storage Provisioner

Challenge Veeam Kasten for Kubernetes backup action for longhorn volumes fails with the error message: too many snapshots created Cause When integrating with CSI-based volumes, Veeam Kasten for Kubernetes employs VolumeSnapshot resources to create snapshots during backup operations. With Longhorn...

How to Enable Veeam Kasten for Kubernetes Disaster Recovery using CLI

Purpose This article provides step-by-step instructions on how to enable Veeam Kasten for Kubernetes Disaster Recovery KDR using CLI. Veeam Kasten for Kubernetes Documentation - Disaster Recovery Solution 1. Replace in the following command and run it to create a DR secret with a passphrase: Note...

Alternate Repository for Veeam Kasten for Kubernetes Container Images

Solution This article documents an alternate location where Kasten's images are stored. Kasten's container images are hosted on the Google Container Registry gcr.io/kasten-images; however, this location may be inaccessible due to country-specific or company-imposed firewalls. If allowing access t...

How to Configure Veeam Intelligent Diagnostics Log Location

Purpose This article documents how to change the location where Veeam Intelligent Diagnostics stores the logs it collects--allowing customers to configure both where those logs are stored temporarily on the Veeam Backup Server before being transferred to the Veeam ONE server and where those logs...

Resolving Pending State During Cluster Removal with k10multicluster Tool

Challenge This article helps in finding and deleting long-running finalizers that are waiting on other resources and can cause deletions to appear stuck in the terminating state. Description: When Kubernetes attempts to delete the cluster object that has finalizers "dist.kio.kasten.io/debootstrap...

How to Add a Blueprint Target Using Execution Hooks From the Policy API

Purpose This article explains how to set resources other than namespaces as the hooks for blueprint subjects. By default, hooks sets the namespace as the target for the blueprint unless specified otherwise. Solution Veeam Kasten for Kubernetes supports kanister execution hooks through Policy API...

How to Configure AWS Application Loadbalancer (ALB) for Veeam Kasten for Kubernetes

Purpose This article provides an example of configuring AWS Application Loadbalancer ALB for accessing the Veeam Kasten for Kubernetes UI. Note: This documentation assumes that the ALB ingress controller has already been installed and configured. Solution What is an ALB An Application Load Balanc...

Veeam Recovery Orchestrator Vulnerability (CVE-2024-29855)

Veeam Software Security Commitment Veeam® is committed to ensuring its products protect customers from potential risks. As part of that commitment, we operate a Vulnerability Disclosure Program VDP for all Veeam products and perform extensive internal code audits. When a vulnerability is...

How to Enable Changed Block Tracking for Guest Cluster on vSphere with Tanzu

Purpose Changed Block Tracking is a VMware feature that tracks changes in virtual disks. Veeam Kasten for Kubernetes uses this feature in vSphere with Tanzu Guest Clusters to efficiently back up Persistent Volumes. Enabling Changed Block Tracking in each Supervisor Cluster where Veeam Kasten for...

How to Properly Off-Board a Namespace From Veeam Kasten for Kubernetes Backups

Purpose This article documents the procedure to properly off-board a namespace in Veeam Kasten for Kubernetes. Solution 1. Check all restorepointcontents for the policy using the following command: Replace with the actual policy name. kubectl get restorepointcontents -l k10.kasten.io/policyName=...

How to ‘Transform’ Multiple Resources with Regex

Purpose Veeam Kasten makes use of the 'Transforms' feature to migrate applications between different clusters, between different storage backends, and many other use cases. Transforms enable modifications to Kubernetes resources on restore. The ability to move an application across clusters is an...

Troubleshooting '401 - Unauthorized' or 'x509' Errors When Accessing the Veeam Kasten for Kubernetes Dashboard

Challenge When attempting to access the Veeam Kasten for Kubernetes dashboard the following error occurs despite using the cacertconfigmap.name helm value: 401 - Unauthorized This issue may also manifest as errors related to x509 in the gateway pod or auth-svc pod logs: x509: certificate signed b...

What Data Does Veeam Kasten for Kubernetes Include in the Phone Home Reports

Purpose This article documents what data is included in the phone home reports sent by Veeam Kasten for Kubernetes. Solution The data is divided into the following sections Basic Data Infrastructure Data Run Time Data for Billing Purposes Additional Metrics Profiles Artifact Metrics Basic Data...

Debugging Backups with Longhorn CSI

Challenge Veeam Kasten for Kubernetes backup job that doesn't complete while using Longhorn CSI drivers is never-ending even after the proper installation of CSI snapshotter components and controllers. No errors are noticed generally for this issue. The job waits for the volumesnapshot object in...

How to Override Volume storageClass During Export

Purpose This article documents how to configure a Veeam Kasten for Kubernetes export parameter to specify the storageClass that is created and used during exports. Solution The ExporterStorageClassName parameter can be used for namespaces that have PersistentVolumeClaims PVCs using a single...

How to Configure EKS Clusters to Use AWS IAM Users/Roles for Veeam Kasten for Kubernetes Access

Purpose Follow this guide to provide appropriate Veeam Kasten for Kubernetes role-based access using AWS IAM users or roles. Solution Description Veeam Kasten for Kubernetes integrates with whatever authentication mechanism customers use to access their Kubernetes clusters. Since EKS natively...

Job For .local Domain Fails When Using Ubuntu-base VMware Backup Proxy

Challenge Backup of VMware VMs fails when using an Ubuntu-based Linux VMware Proxy, and the VMware environment is added to Veeam with an FQDN ending in .local e.g., esxi.somedomain.local. In the Task Log, errors related to NFC connectivity can be found: Processing Error: NFC storage connection is...

How to Configure PXE Booting of Veeam Agent for Linux Recovery Media

Veeam Agent for Linux Version Requirement Starting with Veeam Agent for Linux 6.1.2, the Veeam Recovery Media is designed to be capable of use in PXE booting.veeam-recovery iso released after 22-May-2024 Purpose This article documents how to configure Linux to PXE boot the Veeam Agent for Linux...

VSS Snapshot Creation Delay on Server with DFSR Enabled

Article Applicability The issue described in this article affects earlier versions of Veeam Agent for Microsoft Windows VAW, however, the solution provided will only work with VAW 6.1.2 and higher. Challenge When backing up a server with the DFS feature enabled, the VSS snapshot creation step in...

Backup fails with "Invalid argument Asynchronous request operation has failed. Failed to open storage for read/write access"

Challenge When attempting to write a restore point VBK or VIB to a Linux repository with a 4k logical block size, the task fails with the error: Invalid argument Asynchronous request operation has failed. Failed to open storage for read/write access Cause This error occurs when the storage device...

Veeam Data Cloud Authentication Error

Challenge On or after May 18th 2024, attempting to login to the Veeam Data Cloud VDC console using a previously functioning bookmark or outdated hyperlink may result in login errors, such as: Veeam Data Cloud encountered an error retrieving the user profile. Please try again and contact support i...

Veeam Backup Enterprise Manager Vulnerabilities (CVE-2024-29849, CVE-2024-29850, CVE-2024-29851, CVE-2024-29852)

Veeam Software Security Commitment Veeam® is committed to ensuring its products protect customers from potential risks. As part of that commitment, we operate a Vulnerability Disclosure Program VDP for all Veeam products and perform extensive internal code audits. When a vulnerability is...

Veeam Agent for Microsoft Windows Vulnerability (CVE-2024-29853)

Veeam Software Security Commitment Veeam® is committed to ensuring its products protect customers from potential risks. As part of that commitment, we operate a Vulnerability Disclosure Program VDP for all Veeam products and perform extensive internal code audits. When a vulnerability is...

New Readiness Check - Multiple Veeam Backup Servers Are Required by One Recovery Plan

Article Applicability This article documents a new Plan Readiness Check parameter in Veeam Recovery Orchestrator 7.1. Purpose This article documents a new addition to the Plan Readiness Check in Veeam Recovery Orchestrator VRO v7.1. This new check will be part of the Plan Readiness Check for all...

How to Configure WDS to PXE Boot Veeam Agent for Microsoft Windows Recovery Media

Purpose This article documents a method to configure Windows Deployment Services WDS to PXE boot the Veeam Agent for Microsoft Windows Recovery Media over a network. Solution General Guidance Disclaimer The information provided below is intended only as general guidance. The method and...

"HTTP protocol is not supported, please use HTTPS." Error When Adding Object Storage

Challenge When attempting to add an S3-compatible Object Storage Repository, the wizard displays the error: HTTP protocol is not supported, please use HTTPS. If the service point is then modified to change to HTTPS, the wizard then displays the error: Failed to retrieve certificate from...

Public Folder Backup Hangs

Challenge An Exchange backup job that contains a public folder mailbox runs in an endless cycle, continuously getting changed items from one of the public folders. In the job logs, you can see multiple entries in the following format: Changed items: 0, deleted items: 0, read state changes: 100...

Veeam Service Provider Console Vulnerability ( CVE-2024-29212 )

Patch Reissue - 2024-05-28 On May 28th, 2024, Veeam issued an enhanced update to address this critical vulnerability in Veeam Service Provider Console VSPC. Although our initial patch, issued on May 7th, effectively addressed the primary concern, a subsequent review identified an area for further...

Explorer for Microsoft Teams: "System event messages are unsupported."

Challenge When exploring Teams channel messages, some messages are listed with an empty Author and Subject value. Attempting to preview one of these messages causes the following warning to be displayed: System event messages are unsupported. Cause This warning occurs because system messages cann...

Guest File Restore from Backup of Linux on Power Machine Fails to Mount

Challenge When restoring files and folders from a Veeam Agent for Linux backup of a Linux on Power machine that was using the BTRFS filesystem, if a temporary helper appliance or non-Linux on Power machine is used, the mount operation step of the restore will fail with: Fuse mount failed: Failed ...

Backup fails with: "The system cannot find the file specified." or "The device is not ready."

Version Applicability This article does not list specific versions of Veeam products because the underlying issue stems from a problem with the Microsoft Volume Shadow Copy Service and is independent of any Veeam product versions. As such, the issue can affect environments regardless of the Veeam...

How to Change Initial Management Port for Veeam Plug-ins for Enterprise Applications

Purpose This article documents how to change the default port used by the Plugin Manager 6791 for Veeam Plug-ins for Enterprise Applications: Veeam Plug-in for SAP HANA Veeam Plug-in for Oracle RMAN Veeam Plug-in for SAP on Oracle Veeam Plug-in for Microsoft SQL Server Veeam Plug-in for IBM Db2...

Failed to upgrade host components. Error 1920.Service Veeam WAN Accelerator Service failed to start.

Challenge The Veeam WAN Accelerator component upgrade fails with the following error: Failed to upgrade host components. Error: ''Error 1920.Service Veeam WAN Accelerator Service VeeamWANSvc failed to start. Verify that you have sufficient privileges to start system services.' The Components Upda...

Exchange Backup Fails With: "Failed to get folder properties. Not allowed to access Non IPM folder"

Veeam Data Cloud for Microsoft 365 Customers Customers utilizing Veeam Data Cloud for Microsoft 365 , please be advised that no actions are required to address this issue. All the necessary actions were implemented in the Veeam Data Cloud backend on 2024-04-04. Challenge A backup job in Veeam...

Error downloading plug-in. Make sure that the URL is reachable and the registered thumbprint is correct. Certificate doesn't support 'digitalSignature' KeyUsage

Challenge Attempting to deploy the Veeam Plug-in for VMware vSphere Client through Veeam Backup Enterprise Manager fails with the error: Error downloading plug-in. Make sure that the URL is reachable and the registered thumbprint is correct. Certificate doesn't support 'digitalSignature' KeyUsage...

Unable to complete the action because this backup agent is centrally managed by your system administrator.

Challenge Upon logging into Windows, a pop-up dialog box displays the error: Unable to complete the action because this backup agent is centrally managed by your system administrator. Cause This occurs when Veeam Agent for Microsoft Windows is initially installed on a Windows machine in Standalon...

How to Collect Process Dumps and Logs

Article Applicability This article was created to complement KB1727 and provide customers with specific instructions to collect information that will: Help Veam Support identify if the job or task is actually stuck or if it is working on something in the background. Help the Development team...

Azure Bill Forecast High After Subscribing to Veeam Data Cloud

Challenge After subscribing to Veeam Data Cloud for Microsoft 365 via Microsoft Marketplace, the Cost Analysis chart within the Microsoft Azure portal displays a forecasted future cost much higher than expected. Cause The forecast chart in the Cost Analysis tile uses a simplified algorithm for...

403 Forbidden Message When Accessing Veeam Data Cloud App

Challenge Attempting to load the Veeam Data Cloud app webpage fails with the error: 403 Forbidden Microsoft-Azure-Application-Gateway/v2 Cause The HTTP status code "403 forbidden--you don't have permission to access this resource" is displayed when a web server recognizes a user's request but is...

Release Information for Veeam Backup for Microsoft Azure 6 Patch 1

Requirements Please confirm that you are running version Veeam Backup for Microsoft Azure 6 build 6.0.0.234 or later before upgrading. You can find the currently installed build number Server version in the About section under Configuration | Support Information | Updates. After installing Veeam...

Release Information for Veeam Backup for AWS 7 Patch 1

Requirements Please confirm that you are running version Veeam Backup for AWS 7 build 7.0.0.615 or later before upgrading. You can find the currently installed build number Server Version in the About section under Configuration | Support Information | Updates. After installing Veeam Backup for A...

Release Information for Veeam Backup for Google Cloud 5 Patches

Requirements Please confirm that you are running version Veeam Backup for Google Cloud 5 build 5.0.0.1297 or later before upgrading. You can find the currently installed build number Server version in the About section under Configuration | Support Information | Updates. After installing Veeam...

"Established connection failed because connected host has failed to respond :10005"

Challenge A Windows Agent Backup or Windows Agent Policy type job within Veeam Backup & Replication fails with either of the following errors. A Veeam Agent Backup operating in Managed by backup server fails with the error: Error: Managed session has failed: A connection attempt failed because th...

Granular sudo Permissions Required for Management of Linux-base Tape Server

Purpose This article provides an example of a granular 'sudo' configuration for the Linux account that Veeam Backup & Replication will use when managing a Linux-based Tape Server. Solution The Linux user account used by Veeam Backup & Replication to connect to the Linux-based Tape Server use the...

Veeam Data Cloud for Microsoft 365 Release Information and Build Numbers

These release notes apply to the original Veeam Data Cloud for Microsoft 365 platform, which is now in maintenance mode. Maintenance and stability updates will continue to be delivered, but no new features are planned. As a result, the release notes in this article will no longer be updated...