Deleting a solution without removing the solution references has its own side effects always. This may be a framework issue. Atleast one can disable the solution from Implementation Manager before deleting it. That can be one approach of being on safe side.
I've also observed that studio's behaving differently when you select Delete option from the contextual menu (right click) of an object and using a DEL key on your keyboard.