mediar-ai / screenpipe

open source 24/7 screen & voice recording for the age of superintelligence
https://screenpi.pe
MIT License
8.61k stars 484 forks source link

return frames in /search endpoint result #201

Closed louis030195 closed 1 month ago

louis030195 commented 2 months ago

most of the code is here to do this https://github.com/jasonjmcghee/xrem/blob/122079b5441040816d94b336114eb43da35751f5/src-tauri/src/core/video.rs#L7

jsut need to do some plumbing

/bounty 50

algora-pbc[bot] commented 2 months ago

💎 $100 bounty • Screenpi.pe

Steps to solve:

  1. Start working: Comment /attempt #201 with your implementation plan
  2. Submit work: Create a pull request including /claim #201 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

Thank you for contributing to mediar-ai/screenpipe!

Add a bounty • Share on socials

Attempt Started (GMT+0) Solution
🟢 @devashishTaneja Aug 26, 2024, 7:17:45 PM WIP
louis030195 commented 2 months ago

use cases: multimodal responses + multimodal processing after search results

devashishTaneja commented 2 months ago

/attempt #201

devashishTaneja commented 2 months ago

Hi @louis030195, I was able to crack this but the frame returned in /search endpoint has a massive payload which significantly degrades the performance of the API.

louis030195 commented 2 months ago

@devashishTaneja base64?

louis030195 commented 2 months ago

@devashishTaneja can you make the frame return optional with a path param to avoid unnecessary slow down and then return base64 image

louis030195 commented 2 months ago

also feel free to send pr so i can give feedback on code

louis030195 commented 1 month ago

/bounty 100

@devashishTaneja any news?

louis030195 commented 1 month ago

done myself