I don't think it's limited to that and the databook never said he couldn't it said that with in a certain range, the jutsu user can switch himself with the location of a target object in an instant or If the user switches himself with other objects in close-range combat, the user can evade enemy attacks in an instant or can also attack by switching himself with a kunai or other weapon. An object really is a material thing that can be seen and touched. If Sasuke can make a portal with ameno to a different dimension it means that he can warp people as well and We've seen him warp people and himself. So if he can do this and he can control where he makes the portal then it should possible for him to warp a brain that he can see.

dat logic