That is because the group is not empty :-)
You need to set GroupsMustBeEmpty to false with blasadmin if you want to be able to do this
Mike - No, The group is empty. I am not sure if it has some dependencies.
If you browse the group with RBACAdmin does it still show empty
Use blasadmin utility
set ConfigManagerUI GroupsMustBeEmpty false
and try to delete the folder from depot.