Integrated Circuits:
First concieved...1949
First fabricated...1958
The informal "computer chip" leaves the meaning open to interpretation, but likely because the original author of that statement is ignorant. That wording has been passed around a half-dozen web sites with no clear provenance.
Yes, integrated circuits were not new technology in the Apollo era. Entire CPUs on one integrated circuit, not quite yet. But the point is that after you make the qualitative leap to that type of circuit encapsulation, the rest of the argument is just scale. Even today we're still piling more and more functions into single IC packages. There hasn't been any
qualitative shift of that ilk since 1960 or so.
AGC memory? Sufficient to it's task. They weren't trying to run Call of Duty on it.
Even computer-literate people today are only now reacquainting themselves (via the Raspberry Pi and the Arduino) with the notion of embedded digital microcontrollers. Embedded systems are not engineered the same way general-purpose computers are, although they use some of the same techniques and components.
One of my assignments in college was a minimal guidance system. I used simple, custom ALU components and only twelve words of erasable storage. You can use only six words if you don't need to change the flight path after launch. There was at least one pre-Apollo missile guidance system that used drum storage as its primary memory. Eldon Hall's book goes into appreciable detail about the AGC's hardware pedigree.