Nary a prob.
Just go to your gallery - navigate to the picture you want to get rid of then
In the upper right click the IMAGE TOOLS dropdown and select EDIT IMAGE
On the image edit page you can chose to delete, rotate etc - you can actually save a few steps and just use the REPLACE IMAGE option.
(EDIT: i went ahead and removed the duplicate post for you)