Problems with the civilization next to me

I'm having problems with a neighbor that has a lot more ships than I, around 5 for every ship that I have. This will stop my grow and kill the fun of nextcolony for me. Waiting to see what happens but the future of my civilization looks dark.