My 2 cents.


First of all, that is NOT a milk snake. Wrong coloring and milk snakes do NOT have fangs. The snake you left pics of has fangs. And just looking at it, I am making an educated guess..looks like a baby copper head..in that case, get rid of it NOW. THEY ARE POISONOUS!!! Where I grew up we had copper heads and I have seen a great many of them, that looks like a copper head to me. I left a link for you to compare it to a copper head, the colors match and so does the checkered belly.
http://sites.state.pa.us/Fish/copprhe.htm


Here is another link, this is an Osage copper head, looks just like what you have.
http://www.geocities.com/copperheadjunkie/OsageJH.jpg