Yeah, you “can” go to different realities. That’s a thing. But mostly that’s in service to whatever aims you have in the city itself. Like running an errand for someone powerful, or seeking out some powerful magic.
I also don’t know much about Planescape so it might be that bringing that previous understanding shifts the game’s focus on its own.