The only way to delete a diagram is to "Open" the diagrams popup