KenjiPcx / IdeaGen

0 stars 0 forks source link

Build a pipeline that scrapes products from ProductHunt #2

Open KenjiPcx opened 6 days ago

KenjiPcx commented 6 days ago

Steps

  1. Scrape products from product hunt using a python pipeline and crawl4ai
  2. Enrich the data using an llm agent
    • What kind of problems can this product solve
  3. Return in a json file for now or setup supabase if got capacity