Well, as established earlier.. visual quoes are actually left behind.
Kyros gladiator statue, is still there! And apparently no one removed it.
Which also means that any photos, written letters, posessions will still be there. They don't just vanish, people just.. ignore those items apparently.
I think more.. people becomes unaware of the persons excistence, they simply, stop seeing them or see the clues, ignore all of it, and then fill in the blanks with some kind of explanation that fits the picture best.
Just a theory, but maybe it's kind of like the doctor who episode where, there is some-thing in the corner of your sight of vision.. but some-how you are impulsed to simply ignore it and move on being unaware.
It is an interesting problematic issue though, I did wonder when the plot point first came up, whether one of the Straw hats would be turned, and as it turned out, Robin did.
Don't ask me why, but for some reason I thought Usopp would be the one being turned into a toy, then the question came to mind.
Wouldn't the crew start to question just who kept Merry sailing when Franky wasn't there, or who build Namis clima tact? Those events would still have happened, I just think.. the straw-hats would have exsperienced an impuls to ignore and not remember. I think..