I much prefer this to deleting photos from the internal story editor, because that is buggy once you have more than one "page" of photos. Far too many times I've had a photo on the screen - up on the viewer AND also highlighted, hit "delete", confirmed it - and a completely different photo has been deleted.
I had that happen too, and I totally though it was me being dumb or something. Should've known it was the game being stupid.