<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
Here is a diagram (because I'm generally a visual person, and can
usually understand things if I can draw them):<br>
<br>
<img src="cid:part1.TNHCUPzQ.FqP2NKz3@zaiboc.net" alt=""><br>
<br>
A very general, high-level and crude diagram that tries to
illustrate the concept of 'symbol grounding' as I understand it,
from these discussions we've been having. Plus an arrow representing
output of speech or text, or anything really, that the system is
capable of outputting (obviously there's a hell of a lot going on in
every single element in the diagram, that I'm ignoring for
simplicity's sake).<br>
<br>
As far as I understand, the 'symbol grounding' occurs between the
conceptual models (built up from sensory inputs and memories) and
the language centres (containing linguistic 'tokens', or symbols),
as we've previously agreed.<br>
<br>
There are two arrows here because the models can be based on or
include data from the language centres as well as from the
environment. The symbols (tokens) in the language centres represent,
and are 'grounded in', the conceptual models (these are the object
and action models I've discussed earlier, and likely other types of
models, too, and would include a 'self-model' if the system has one,
linked to the token "I").<br>
<br>
The sensory inputs are of various modalities like vision, sounds,
text, and so-on (whatever the system's sensors are capable of
perceiving and encoding), and of course will be processed in a
variety of ways to extract 'features' and combine them in various
ways, etc.<br>
<br>
I didn't include something to represent Memory, to keep things as
simple as possible.<br>
<br>
So, could we say that this diagram illustrates, in a very general
way, what's going on in a human? in a LLM AI? Both? Neither?<br>
<br>
Would you say it's broadly correct, or missing something, or
incorrect in another way?<br>
<br>
Ben<br>
<br>
<br>
</body>
</html>