Ayn Rand's opinion on genius was similar. She said that what was unique to genius was the ability to very easily shift between different levels of abstraction.

I would not refer to this as "memory", but as understanding. Memory is of course involved in understanding, but it is not sufficient for it, and does not by itself enable the ability to shift.