13 Comments
User's avatar
Radan's avatar

Love it! Yesterday morning I went for a long run and started thinking about agents, Alan Kay and LLMs. :) In particular I started thinking about a presentation of his where he talked about building computer systems that are more like biological systems rather than like machines: https://www.youtube.com/watch?v=NdSD07U5uBs&t=1486s

And I started thinking about a system of self correcting LLM agents. All very vague, very unclear ... and now I see that you already built it! :) I'm playing with it now, very interesting to explore!

Scott Werner's avatar

Ah very cool, I hadn't seen that talk yet. Will watch it tonight :)

Curious to hear how it goes and if there are any features you wish it had! Should have some new updates coming soon to make the system a lot more useful, and will put up a followup post with cool examples. If you build anything you'd like me to share, let me know!

Sublius's avatar

Semiotics is calling you. Pick up.

Scott Werner's avatar

Interesting! Have a starting point you'd recommend?

Sublius's avatar

Sure, Paul Kockelman “Last Words: Large Language Models and the AI Apocalypse.”

Eleanor Berger's avatar

Cool! Here’s an example of taking message-passing seriously. https://elite-ai-assisted-coding.dev/p/intellimorphic-ai-agents-and-live-environments

Scott Werner's avatar

Wow! Yes! I'm excited to dig into this!

I'd mostly been thinking of using this for building "agentic" systems in a different way with a different paradigm. I hadn't really thought of giving this capability to basically all objects you see or interact with on a screen. I can definitely see how something like this could be a huge solve for the problems vibe coders run into...

Eleanor Berger's avatar

Ditto, also excited to see prompt objects. I think in general this is an important direction and I haven’t seen many others doing work in this area.

Scott Werner's avatar

Same! You're the first other person I've come across building along this line of thinking haha

MetalMonkey's avatar

If I could, I'd insert the gif of the aliens in Toy Story going 'ooooooo' here. This is very interesting and makes me want to play!

Trust the fun!

Scott Werner's avatar

I've got a few things I'm planning on adding next like being able to receive messages from outside the environment and enabling more rich types for messages (images, audio, etc). If you do get a chance to play around and notice something missing, please let me know!

mako's avatar

One of, if not the main reason the actor model was interesting is that it made it easy to describe security patterns (capability handles), where you could control access by having actors mediate access to other actors. But LLMs can't be secured (which arguably means the whole agentic web thing can't really happen)

Zachary Conner's avatar

If an object can self-modify, is there anything that fundamentally differentiates it from any other object? Are there aspects of it that are immutable / assigned by the program? I would say the prompt/goal, but that is somewhat mutated by any new message entering the LLM’s context window.