Everyone has a different attitude to this.
I don't like to read books several times. I think it's a "waste of time", because I'd rather have something new to read in that time.
But my wife often picks a book from our shelves that she has already read.

And as weisser-rabe has already written, some books are simply for short-term entertainment. You can then also pass them on with a clear conscience.