Regedit "Cannot Delete (keyname): Error while deleting key"

I am trying to delete a registry key in regedit and keep getting this error:

Cannot delete (keyname): Error while deleting key.

I am an admin and have checked the permissions for the key and all parent and child keys. I have full control but the same error still shows.

Any help is appreciated.