Designing with AI
Designing with AI
How an AI designs in Brickworks: Claude or another AI on your own key, the assistant panel, sketches, and asking about a selection.
An AI can design a whole model from a sentence, change a part of one, or answer a question about it: Claude, or another AI on your own API key. It builds with the same real parts and the same checks you do: the app decides whether each part fits and holds, so what goes on the baseplate is buildable. There is no AI in the window until you turn the assistant on (Connect Claude).
Ways to bring an AI
| Way | You need | Where it runs |
|---|---|---|
| The Claude connector | Any Claude plan (on the free one, its one custom connector) | claude.ai, the Claude desktop and mobile apps, building in your open Brickworks tab |
| ChatGPT | A ChatGPT plan that can add a custom MCP server | chatgpt.com, building in your open Brickworks tab |
| Claude Code | Claude Code, signed in to your plan | Your terminal, or started by the desktop app for you |
| Your API key | A key from the Anthropic Console | The assistant panel itself |
| Another AI on your own key | A key from OpenAI, Google, OpenRouter or another provider, or a model on your own computer | The assistant panel, chosen in Settings › AI |
The assistant panel
The panel on the right is where you talk to Claude in the app. Describe what you want (a red fire engine with a ladder that lifts) and press Build it. You watch it build: each part goes down as Claude places it, and the status bar says what it is doing. When it has finished, the whole design is one step of Undo.
Your API key
Paste a key from the Anthropic Console into the panel. It is checked with Anthropic before it is kept, in this browser or for this visit only, and is sent nowhere but Anthropic.
Model and effort
Choose which Claude designs and how hard it thinks. Higher effort takes longer and costs more; medium effort costs about a third of the default. The panel offers only the combinations Anthropic accepts.
On your Claude plan, in the panel
In the desktop app, with Claude Code installed and signed in, the panel can design on your Claude plan instead of a key: it starts Claude Code for you and points it at this window. A new design of a whole model is then made twice at once, the second in a copy of the app with no window, and the better of the two is kept as the model; Undo brings back the other.
Another AI on your own key
Tools › Settings…, then AI…, chooses who designs: Claude, as above, or another AI on your own API key. The other AI is given the same instructions and the same tools Claude is, builds in the window as Claude does, is held to the same checks, and answers the same fresh look at its first save.
- Provider: OpenAI, the Anthropic API, Google Gemini, OpenRouter, Mistral, Groq, Together, DeepSeek, xAI, or a server that speaks OpenAI's Chat Completions: Ollama, LM Studio or vLLM on your own computer, or any other at an Address you give.
- API key: paste it in. Show shows it while you type; once kept, the field is cleared and only its fingerprint is shown (
sk-pro…abcd). Remember on this device keeps it; untick it to keep it for this visit only. Forget the key deletes it. - Model: the provider's own list, asked for as soon as there is a key; type to filter it, or type a model's id and press Enter to use one not listed.
- Temperature, the most a reply may write, and the reasoning effort, where the model takes them.
- Test asks the model for one tool call and to name the colour of one small picture, and says plainly what works: an AI that cannot call tools cannot design, and one that cannot see pictures cannot judge its own work. Each test costs less than a cent.
- Design with it goes back to the assistant panel, ready for your brief. The panel then designs with the AI you chose.
The app then names the AI wherever it said Claude for the one designing: the toolbar says GPT-6.1 Sol working while it works, its steps in Edit › History are its own (GPT-6.1 Sol's submit design), and Ask GPT-6.1 Sol about this… asks it about the selection. A design goes down brick by brick while the AI is still writing it, as Claude's does in the panel, and gives way to the checked model when it is done. OpenAI's own models are reached through OpenAI's Responses API, which hands the model the pictures it asks for as the answer to its own call, and carries its reasoning from one step to the next.
Where your key is kept
The panel says this beside the key, for where you are:
| Where | How the key is kept |
|---|---|
| The desktop app | On this computer only, in a file encrypted to it, so a copy taken elsewhere cannot be read. Programs running as you could still reach it, so a key with a spending limit is safest. |
| A browser | In this browser's storage for brickworks.diy, scrambled but not secret: anyone using this browser could recover it. Untick Remember on a shared computer. |
| For this visit only | Nowhere on the device; gone when the tab or app closes. |
| From the environment (desktop) | Read from the provider's environment variable the app was started with, and not kept by Brickworks. |
Everywhere, the key is sent only to the provider you chose (or the address you gave), never to Brickworks, and never logged or saved with a model.
From the command line
The desktop app can design one brief with another AI and quit, the key read from the provider's environment variable or the one kept, never printed:
./brickworks.x86_64 -- --ask-provider="a red tower" --provider=openai --provider-model=<model> --out=tower.ldr--provider-base=URL names a server of your own.
Sketch first
Sketch first, beside Build it, asks for three quick massings of the idea, each under 150 parts, on a cheaper model. Pick the silhouette you mean on its card with Design this one, and the full design is built from it at your own model and effort. It is the cheap way to find out whether the brief was understood.
Ask about the selection
Select some parts, right-click one and choose Ask Claude about this… (or Ctrl+K): make this wing longer, why does this fall off?, add a door here. Claude may change only the selected parts and the space just round them, or a bigger box if it asks and you allow it. Everything else stays where it is, and a change that reaches outside is refused whole. In View › Stress, a red part's menu has Ask Claude to brace this.
Reference pictures
For a real subject, a landmark, a vehicle or an animal, Claude can look up a reference picture from Wikimedia Commons and design from it. Only the picture's address goes out, from your browser.
Read on: how the AI works, and fresh eyes, the second look every new design gets.