This is normal. There is a KB article talking about this behavior and is to be expected when you have two video cards assigned to a VM. You have to RDP to the VM or use the Horizon View Direct Connect piece to login to the VM after adding a vGPU adapter.
-Craig