Rand, Mat, and Perrin; Reborn?

After reading and listening to the many books and audio books, I have kicked aside a previous theory that their past memories are something that came to them after receiving their special talents. Mat especially got caught on my early radar and felt that he was given the memories of others to fill in his memory lapse.

After carefully reading and listening, it seems that Mat's thoughts and memories are actually those of his own. He was speaking the old tongue long before he realized it. Long before he took the dagger from Shadar Logoth, and again, long before he met the Aelfinn and the Eelfinn.

So what are your impressions on this?