search

10up / classifai

Supercharge WordPress Content Workflows and Engagement with Artificial Intelligence.
https://classifaiplugin.com
GNU General Public License v2.0
581 stars 53 forks source link

Integration with Tainacan plugin #360

Closed mateuswetah closed 1 year ago

mateuswetah commented 2 years ago

Describe your question

Hi! Hope this is the place to discuss this, if not, let me now.

I am one of the developers of the Tainacan plugin, a solution for digital archives management and exposition built on WordPress. We are a small team with a modest open source community, but with increasing number of museums and cultural archive institutions on active usage.

Recently, a user opened an issue in our repository requesting, among other things, an integration with ClassifAI. She was particularly interested on having the automatic description extraction from images. As I explained there, we don't exactly use the WordPress media gallery page to source our repository items media because they are uploaded to a different folder structure, where we can keep privacy levels. But we do use a good portion of their upload and attachment flow. Actually, our media gallery modals are inherited from WordPress customize media frames, as you may have a clue here.

So while I understand there might be blockers to a possible integration, I also have a feeling that we might be a few steps close to it... Would you help me understand if there is a way for it? I am not aware of ClassifAI internals, but I can give details about our flow it that helps. We have previously worked on integrating our code to other plugins, such as the ElasticPress.

Code of Conduct

dkotter commented 1 year ago

@mateuswetah I see Jeff chimed in on the .org thread but to follow up here, the user in that thread is using our OCR and automatic alt text features. Both of these fire on the core wp_generate_attachment_metadata filter. So if you're plugin makes use of that filter (which is fired by the core wp_generate_attachment_metadata function) things should work.

mateuswetah commented 1 year ago

Hey @dkotter, thank you for the reply!

In fact we could follow up that conversation and their project is running OK now. But in their case, we ended up making a migration of data as they initially uploaded data to the WordPress default gallery instead of our plugins version of it.

Would you mind keeping this issue open while we investigate during next week if we are using this filter correctly? If I understand, I should be able to simulate what you guys do by creating my own wp_generate_attachmen_metadata filter as I don't have a working classfAI plugin to test it.

dkotter commented 1 year ago

Would you mind keeping this issue open while we investigate during next week if we are using this filter correctly

Yeah, that's totally fine.

If I understand, I should be able to simulate what you guys do by creating my own wp_generate_attachmen_metadata filter as I don't have a working classfAI plugin to test it.

Yes, that should work. For reference, here's where we hook into that filter ourselves and it ends up calling this method.

mateuswetah commented 1 year ago

Hey @dkotter, I did some tests here and in fact the usage of the filter is working and should be enough. Further integrations would require efforts from our side, such as converting your tags or image metadata to our own metadata scheme.

Thank you for the attention and good work. I'm a fan of the 10up Gutenberg documentation that you guys did BTW, its a great source for me!