They go over the Rainbow Bridge into dog heaven. From there, they can hop to their human souls whenever they want, as soon as they join them (which is usually later).
In the meantime, my friend's dog died. She laughed in her grief when she said it was so nice to know that her darling had the best company in dog heaven through Nuka.... :-)