there is always like a few seconds of a complete numbness

there are, although that is a bit different than sleep paralysis.

I don't think that the panic attack is part of it

people get scared when experiencing sleep paralysis because not being able to move is not a pleasant sensation, and they might think something is wrong with them.

Thanks for stopping by @aschatria!