So I dug it up yesterday, and probably should have dug all the way around where the skull was first. Instead when I hit the antlers I used them to wriggle the rest out of the ground, and it looks like most of the skull broke away, which is disappointing, but not a huge deal. Now it just needs a little cleaning up.