search

damus-io / damus

iOS nostr client
GNU General Public License v3.0
2k stars 289 forks source link

add alt text during image upload (WIP) #2639

Open alltheseas opened 2 weeks ago

alltheseas commented 2 weeks ago

user story

As a Damus user who has just uploaded an image prior to posting a note, I would like to include a text description, so that the image is more accessible.

acceptance criteria

  1. after upload, when image is previewed the user who uploaded the image has a method to add alt text to the image

example via BS

image image image

@fishcakeday does NB accept and store alt text for images?

fishcakeday commented 2 weeks ago

We have the capabilities and technically nip96 supports it, but it is not enabled at this time since I have not even thought about proper spam protection and filtering in that area. We do support it for the accounts in the form of description and title. What is the specific use case for this, I had an idea of generating it using the AI and one of the vision models.

alltheseas commented 2 weeks ago

A while ago there was accessibility feedback. There is a ways to go in terms of accessibility for Damus. So primary benefit is making images more accessible.

Secondary benefit would be metadata, that NB and Damus could use in an image search.

Yes, agree, have to think carefully on how this avenue can be abused.

Interested to hear more about your computer vision solution to auto-label images.

jb55 commented 2 weeks ago

On Tue, Nov 05, 2024 at 07:50:39PM -0800, alltheseas wrote:

@fishcakeday does NB accept and store alt text for images?

they don't need to accept or store anything. we can just include it as note imeta data