Ok, so I'm at Episode 24. Amane Misa was given a piece of the death note, allowing her to see Rem, however, she never gained her memories back related to the Death Note.
On the other hand, once Light touched the Death Note, he gained all his memories.
Why did Light remember everything after...