Use this repo as a template to create Make Real style apps like makereal.tldraw.com. To get started:
npm install
to install dependencies.env.local
file that contains OPENAI_API_KEY=your api key here
npm run dev
Make Real is built with tldraw, a very good React library for creating whiteboards and other infinite canvas experiences.
To use it, first draw a mockup for a piece of UI. When you're ready, select the drawing, and press the Make Real button. We'll capture an image of your selection, and send it to OpenAI's GPT-4V along with instructions to turn it into a HTML file.
We take the HTML response and add it to a tldraw custom shape. The custom shape shows the response in an iframe so that you can interact with it on the canvas. If you want to iterate on the response, annotate the iframe, select it all, and press 'Make Real' again.
To change how Make Real works, start from the makeReal()
function. From there, you can change the prompt that gets sent to gpt-4.
If you'd like Make Real to create something other than HTML, you'll need to
either update the PreviewShape
to
display something different, or use one of tldraw's built-in shapes like image
or text.
For prototyping or at least until the vision APIs are able to support higher usage limits, we've also included the RiskyButCoolAPIKeyInput
, similar to the one found on makereal.tldraw.com. Please use this as carefully and ethically as you can, as users should be reluctant to add API keys to public sites.