That's their fault and risk. Sasuke only wanted Danzo's head. They should just ask what he want and take him to Danzo. But nawww, It's biology to attack a person who don't belong there in the first place. So there is no "innocent" here.They attacked Sasuke because Sasuke intended to kill others, is there some kind of disconnect going on here?