[ExI] GATO

[Rafal Smigrodzki]

I commented on the Lex Friedman interview with Oriol Vinyals on YouTube:

The tokens seem to be analogous to the patterns of neural activation in the
brain that are sent over long-range intracortical pathways. Long-range
connections underlie conscious processing and allow cross-modality
inference. Packets of information sent over the long-range connections
represent usually the highest-level features recognized by local cortical
networks and recurrent processing of such features in multiple cortical
areas allows the extraction of ever more complex and abstract
representations of multi-modality patterns of information. This is
fascinatingly similar to GATO which extracts features of inputs in
different special purpose modules in the form of tokens and proceeds to
extract higher level features by juxtaposing tokens sent from different
modules. Very clever and very brain-like.

-- 
Rafal Smigrodzki, MD-PhD
Schuyler Biotech PLLC
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20220728/d4055db2/attachment-0001.htm>