I totally agree with you, or I used to when I was younger. Now I still believe in one conciousness, "God" but think that we are all different parts of it. After death, when united to the One conciousness again, we share the memories/experiences of everyone else as we are all parts of the One.
I'd be interested to know what you make of that idea?