Talking to blobs
Every utterance — typed or spoken — goes to a language model together with a short description of the scene: the projects’ names, aliases and colors, where each blob is on the screen, what each one is doing, and the last few lines of the conversation. The model answers with who you mean, what you want, and a clean task for the agent. Code then checks the answer and carries it out.
Who: ways to address a blob
Section titled “Who: ways to address a blob”| How | Examples |
|---|---|
| Name | “Lantern, …” — in any grammatical form your language has |
| Alias | a second name you give the project in the editor |
| Color | “Blue, …”, “the red one, …” |
| Place on the screen | “Top left, …”, “the one on the right, …”, “the middle one, …” |
| Color and place | “Blue on the right, …” |
| Context | no name at all: “and add tests too” goes to the project you just talked to |
The place is worked out from the blobs’ real positions: “left” is the leftmost, “top” the topmost, “middle” the one nearest the center of all blobs.
What: intents
Section titled “What: intents”| You say | blu does |
|---|---|
| “Blue, make a menu” | starts a task |
| “Blue, no, change the sidebar instead” | refines the current task |
| “Bot, what’s up?” | tells the status |
| “Lantern, show the result” / “collapse” | opens or closes the result |
| “Blue, stop the task” | cancels the task |
| “Be quiet” | silences the voice — does not cancel anything |
| “A new blob”, “create a project Shop” | creates a blob |
Cancelling is always explicit: only “stop the task” (or the button) stops an agent.
Answering the agent
Section titled “Answering the agent”When an agent finishes with a question (“Should I use the existing icons or draw new ones?”), just answer: “the first one”, “use the existing ones”. blu knows which project asked and turns the short answer into a task the agent understands, in the same conversation.
Languages
Section titled “Languages”Speak and type in any language. The task for the agent is written in the language of the phrase, the voice answers in the language you speak. The language hint for the models is in Settings ▸ Voice ▸ Voice and command language.