search

pixeltable / pixeltable

Pixeltable — AI Data infrastructure providing a declarative, incremental approach for multimodal workloads.
https://docs.pixeltable.com
Apache License 2.0
76 stars 14 forks source link

Initial Integration with Gemini #299

Open brucearctor opened 1 month ago

brucearctor commented 1 month ago

See: https://ai.google.dev/api?lang=python

Might warrant sub-issues as Gemini does alot.

pierrebrunelle commented 1 month ago

@brucearctor could you share more about the use cases you are trying to cover with these Google integrations so we can discuss prioritizing them accordingly? Some are fairly easy and others require scoping.

For instance, here's how the integration with Mistral AI was done:

brucearctor commented 1 month ago

@pierrebrunelle -- My use case is "creating an extension for pixeltable" :-)

Maybe some useful context:

I want to get to know more about pixeltable. I noticed that these the integrations were lacking, so thought creating a list of items todo would be a good place to start. Esp. as then the individual issues [ like this ] serve as a place for discussion, and can be closed by relevant PRs once those occur.

I imagined one of the best ways to get to know intricacies of pixeltable would be by contributing something. I am a GDE [ https://developers.google.com/community/experts ], so helping with a Google integration wouldn't be a bad place to spend some cycles.

Glad to hear that these integrations might be of interest. Not requesting prioritization for your team to create the integrations, but glad there are people to check with. I'm still surveying the overview/community, but these things in https://github.com/pixeltable/pixeltable/tree/main/pixeltable/functions [ and the associated tests ] do appear as straightforward enough wrappers. So, agreed that many shouldn't be too big a lift.

Somewhat related, a contributing guide seemed absent, so I created https://github.com/pixeltable/pixeltable/pull/305 and imagine continuing to extend that as makes sense. Easy enough to document a journey to make it easy enough for the next person trying down that path. I also, started a discussion: https://github.com/orgs/pixeltable/discussions/295 ... as there doesn't seem to be clear heuristics for when things go in differing files, and no mailing list archives to search for prior discussions of the community [ ex: https://lists.apache.org/list.html?dev@parquet.apache.org ]

pierrebrunelle commented 1 month ago

I imagined one of the best ways to get to know intricacies of pixeltable would be by contributing something. I am a GDE [ https://developers.google.com/community/experts ], so helping with a Google integration wouldn't be a bad place to spend some cycles. [...] these things in https://github.com/pixeltable/pixeltable/tree/main/pixeltable/functions [ and the associated tests ] do appear as straightforward enough wrappers. So, agreed that many shouldn't be too big a lift.

It'd be indeed. These API Inference integrations are a great way to get started and we usually always build a notebook alongside it that lives in the tutorials section, e.g. https://github.com/pixeltable/pixeltable/blob/main/docs/release/tutorials/working-with-mistralai.ipynb