VDA upgrade service fails when upgrading CU version

VDA does not upgrade when upgrading to next CU version. In Studio the upgrade starts, goes into In-Progress and moves to completed however, the installed version does not change. After a minute or two, the status moves back to upgrade available...