Well, it depends on if you actually go there, like walking through a doorway, or if you meditate and send the not-meaty parts there. Then your body stays in the human world, but it's just...breathing and otherwise not functional. All the rest of you is in the Spirit World. And then you can't really touch things or have a physical effect.