Category Archives: Veeam

Error: Unable to delete backup in the Capacity Tier because it is immutable

I was recently involved with a Veeam deployment that was running into problems during testing, their only performance tier had run out of space. Though this wasn’t unexpected as the disk provisioned was undersized and just temporary until testing was finished, it was preventing new backups from finishing successfully.

The full performance tier belonged to a Scale-Out Backup Repository that was also configured with a capacity tier (copy + move mode) backed by an immutable AWS S3 bucket. Worth mentioning those backup files in the capacity tier were still within the immutability retention period.

According to the user guide “If you use the scale-out backup repository, keep in mind that the Delete from disk operation will remove the backups not only from the performance tier but also from the capacity and archive tier. If you want to remove backups from the performance tier only, you should move those backups to the capacity tier instead. For details, see Moving to Capacity Tier.”

Attempting to perform a “Delete from disk” operation was failing with the error “Error: Unable to delete backup in the Capacity Tier because it is immutable”.

Continue reading

Pay the ransom and hope for the best…

Ransomware isn’t sexy but it’s certainly an important topic in today’s IT security landscape, with unprecedented growth and relentless evolution, organisations need to constantly keep one step ahead of bad actors eager to make a buck by exfiltrating and encrypting your important data.

Ransomware attacks mainly occur because IT is a complex and everchanging environment, organisations are busy modernising their applications from monolithic designs to new highly distributed container-based services. The remote workforce is now connected more than ever, with the ability to access data hosted across multiple cloud providers, connecting from virtually any device, at any hour of the day. IT departments are being asked to do more with less each and every year while ransomware attacks are on the rise and becoming more costly than ever before.

If you’re questioning whether or not your organisation could be targeted by ransomware, it’s a question of when not if

Beyond encryption of data, some ransomware is taking it a step further and making ransom of leaking data, this is otherwise known as data exfiltration. Unfortunately, stopping ransomware prior to an attack is difficult and at best, inconsistent. No single product or service has all the solutions to the challenges raised by these attacks, instead, it’s recommended to take a multi-layered approach. Apply best practices, keep systems up to date, enforce good data hygiene, configure event logging, and identify anomalies (indicators of compromise) to provide the best chance of discovering an attack as early as possible.

Continue reading

VeeamON 2022

VeeamON 2022, the best data protection conference of the year is about to kick off in Las Vegas and virtually. This will be the 6th time Veeam has run the event with attendees able to access both virtually and in person.

VeeamON 2022 Conference

VeeamON provides glimpses into product roadmaps, with hours of technical content ranging from demos to deep dives of virtually every Veeam product and feature. Hot topics such as v12, Ransomware, Kubernetes, cloud-native backups, Salesforce and Microsoft 365 will be covered by Veeam experts including fellow Veeam Vanguards.

For those who can’t make it in person, virtual attendance is free, running from May 16 – 19 with AMERs, EMEA and APJ specific sessions to ensure easy access for those joining.

With 2 days of awesome content, you might not make it to every session on your agenda. Fortunately, Veeam makes it easy to replay recorded sessions from the VeeamON website after the conference has finished.

To learn more and register, check out the following link;

Veeam Vanguard 2022

I received some positive news the other day concerning my Veeam Vanguard 2022 application, I’ve been renewed for another year in the Program. As a Veeam enthusiast, there is no better thing than being a Vanguard member.

For those who haven’t heard about the Vanguard program before, it’s awarded to those who have contributed to the Veeam community.

I recommend anyone interested in becoming a Vanguard to get involved in the Veeam community, whether it be through Veeam Use Groups, the Veeam subreddit or even the Veeam community forums and apply to the Vanguard program during the next intakes.

There are a couple of benefits of becoming a Vanguard including access to roadmaps, betas, free keys, awesome swag and access to those in the know at Veeam.  

You can find all the Veeam Vanguards from past and present at the following link: Veeam Vanguard List.

Veeam Backup Repository / Microsoft Azure Object Storage

Sending Veeam backups to object storage such as Azure Blob has become a hot topic in the last few years. According to Veeam’s quarterly report for the end of 2021, Veeam customers moved over 500 PB of backups just into the top 3 cloud object storage vendors alone.

With many organisations starting to dip their Veeam toes into object storage I thought I would write a bit more about the subject. This blog post is aimed at helping backup administrators who wish to better understand from a Veeam perspective working with public cloud object storage, specifically Azure Blob.

Compared to the traditional NAS or disk-based block storage Object Storage is a completely different shift in how data is stored and accessed. For example, in object storage, it’s intended that files are not modified. In fact, there is no way to modify part of an object’s data and any change requires deletion and replacement of the whole object.

In Azure terminology, objects are stored in a ‘Blob’, which can be thought of as similar to a volume on a disk but far more scalable. Blob storage is a pay-per-use service. Charges are monthly for the amount of data stored, accessing that data, and in the case of cool and archive tiers, a minimum required retention period. In case you haven’t realised, Blob storage is Microsoft’s object storage solution.

There are numerous methods we can utilise to leverage Microsoft Azure Blob with Veeam Backup & Replication. For example, Azure Blob can be used as an Archive Tier target within a SOBR (Scale-Out Backup Repository) for long-term retention of backups, an archive repository for Veeam NAS Backups and some readers may even be familiar with the external repositories function.

The most popular method is using Blob as a Veeam Capacity Tier which is configurable within a Veeam Scale-Out Backup Repository.

Why is Azure Blob so popular?

Continue reading

Improved Veeam Visio Stencils

Veeam makes available, for free, Visio stencils available from their website here which are useful for creating Veeam diagrams in Microsoft Visio. These stencils enable specific Veeam components to be illustrated in greater detail instead of relying on generic stencils found in the stock Visio library. I’ve been using these Veeams stencils for several years now while they’ve proven themselves to be beneficial they aren’t short of a few quirks and issues.

Recently, a colleague of mine, David Summers, mentioned he has been working on improving the Azure Visio stencils and could help improve the Veeam stencils the same tool he has developed. For those interested, David has had quite an interesting journey around Azure Services Visio stencils which is definitely worth a read over at his GitHub David-Summers/Azure-Design

After passing the Veeam stencils through his tool, the following changes were implemented.

  1. Icons are now sorted alphabetically
  2. New connections points have been added (North/North East/East/South East/etc)
  3. New Connection points are relative to the centre/size of each icon
  4. Text box is now placed at the bottom of each stencil icon, instead of the middle
  5. Text box will now dynamically resize it’s width and height based on the amount of text
  6. To make icons stand out, drop shadow has been enabled on all icons, this is a personal preference and can easily be disabled
  7. Bonus PNG and SVG icons have been split out so third-party programs outside of Visio that support PNG and SVG can make use of them

The improved Veeam Visio stencils can be downloaded below;

Improved Veeam Vison Stencil

Simulating Veeam disk actions with DiskSpd

Did you know that you can use DiskSpd to measure and simulate Veeam disk operations such as Active Full, Forward Incremental, Synthetic Fulls, even SureBackup and restore operations? By simulating Veeam disk operations, we can use this tool for troubleshooting Veeam backup and/or restore performance issues.

I wanted to try the tool myself so I’ve recorded some of the results after testing DiskSpd on my home desktop PC.

Continue reading

VBEM – Service Unavailable – HTTP Error 503. The service is unavailable

Was recently troubleshooting an issue with the Veeam Backup Enterprise Management (VBEM) web portal showing ‘Service Unavailable – HTTP Error 503. The service is unavailable’. Checking Windows event logs. the following error was recorded.

Turns out this is a known problem when VBEM is deployed on a machine that also has System Center Operations Manager (SCOM) agent installed.

To resolve this issue, it requires temporarily uninstaling the SCOM agent, restarting the VBEM service, verifying the VBEM portal works then finally reinstalling the SCOM agent using a particular method detailed below.

Continue reading

Converting Hyper-V VMs to VMware using Veeam

I recently had the opportunity to migrate a small regional office from Hyper-V to VMware by leveraging Instant VM Recovery of Workloads to VMware vSphere VMs available in Veeam Backup & Replication v10. With this latest Instant VM Recovery, Veeam can instantly recover any Veeam backup created by any Veeam product to a VMware vSphere VM. In other words, physical servers, workstations, virtual machines or cloud instance Veeam backups can now be restored to VMware. Veeam even handles the P2V/V2V conversion automatically with it’s own built-in logic. How good is that!

To get started, a backup was taken of the source Hyper-V VMs prior to the scheduled outage window. During the outage window, the source Hyper-V VMs being migrated are powered down and the Veeam backup job is run again to ensure all changes to the VM disks have been backed up. Once the backup has completed, the source VM should not be powered on again.

To start the migration process, browse to the backups, right-click the VM to be migrated and click ‘Instant VM Recovery’ then ‘VMware…’

At the next screen, ensure the selected restore point matches the time for when the VM was shut down and the last backup ran.

Continue reading

Error Failed to publish VM %VMNAME% Error: One or more errors occurred.

While attempting to instantly recover a Hyper-V VM to an ESXi host, Veeam encountered the following error, ‘failed to publish VM %name% Error: One or more errors occurred’.

Some Veeam users were discussing the same symptoms when ‘Server for NFS’ feature is enabled on the Veeam forums. In this particular case, the VBR/repository role is configured on a StoreEasy 1460 which runs Windows Storage Server 2016 standard and ‘Server for NFS’ feature was indeed enabled.

Continue reading