Minimal API with AI - Githubissues

Koeng101 / dnadesign

A Go package for designing DNA.

Other

23 stars 0 forks source link

Minimal API with AI #66

Closed Koeng101 closed 1 month ago

Koeng101 commented 6 months ago

My dream for DnaDesign is to integrate AI systems for designing DNA - the other API request is a means to this end. However, I want the end-to-end pipeline to exist, and then the rest of the functions can be added. This is meant to be an end-to-end example with deployment details:

Have an AI system that can look at a user prompt and decide how to add information to it
Have a chatbox system working with hyperscript/htmx (this should be as simple as possible)
Have the simplest code integration (just fasta reading with attachments)
Have actual deployment working (thinking just k3s with digitalocean)

I think after this point is where it gets interesting, because it can be used for things.

Koeng101 commented 6 months ago

What is a minimally viable API here?

I would say:

Can open attachments
Can figure out if the user needs information or if the user needs code to be written
Can figure out what needs to be injected into context window for users code
Can generate code
Can execute generated code
Can return results to user

Koeng101 commented 6 months ago

[ ] Can open attachments
[ ] Can figure out if the user needs information or if the user needs code to be written
[X] Can figure out what needs to be injected into context window for users code
[X] Can generate code
[X] Can execute generated code
[ ] Can return results to user

Koeng101 commented 6 months ago

The biggest problem here is that I have to do a crap ton of massaging and prompt engineering to get a proper output. I think I really just need a fine tune for my desired output (lua using the library, with the particular output I'm looking for). This just takes a lot of examples, which I think would be healthy to make.

Koeng101 commented 5 months ago

As an update: figured more of this out in a separate repo, going to merge soon. Got lua generation working reliably.

Koeng101 commented 1 month ago

As an update:

I need this to realistically be a C library so I can interoperate with Python. I like writing Go and am good at it - the simplicity is really a driving factor. When it comes to biological applications, if performance is REALLY needed, can just drop into C. But being able to use this package in python is pretty essential for AI to be able to use it well, and for integration with larger systems.