Pragament / python_scrapers

GNU Affero General Public License v3.0
0 stars 2 forks source link

Use Python or nodejs: Scrape from zepto/blinkit/big_basket- create a single output JSON file of all vegetables & fruits #3

Open ndubbaka opened 1 week ago

ndubbaka commented 1 week ago
  1. https://www.bigbasket.com/cl/fruits-vegetables
  2. https://blinkit.com/cn/fresh-vegetables/cid/1487/1489
  3. https://www.zeptonow.com/cn/fruits-vegetables/all/cid/64374cfe-d06f-4a01-898e-c07c46462c36/scid/e78a8422-5f20-4e4b-9a9f-22a0e53962e3 code to scrape from zepto is at https://github.com/Pragament/ecommerce-aggregator-backend/blob/zepto_vikas_before_urbangroc/index.js git branch: zepto_vikas_before_urbangroc

fork repositories:

fetch foodNutrients for each vegetable & fruit(leave foodNutrients empty if not found in usda.gov API) from https://api.nal.usda.gov/fdc/v1/foods/search?api_key=DEMO_KEY&query=**_watermelon_**&dataType=Survey%20(FNDDS) Look for "raw" in the results(description) Image

{
  "vegetables": [
    {
      "fdcId": 2709270,
      "foodCode": 63149010,
      "foodCategory": "Melons",
      "foodCategoryId": 3306088,
      "name": "tomato",
      "price": 83.5,
      "measurement": {
        "value": 2,
        "unit": "Pcs"
      },
      "manufacturer": "Organic",
      "foodNutrients": [
        {
          "nutrientId": 1003,
          "nutrientName": "Protein",
          "nutrientNumber": "203",
          "unitName": "G",
          "value": 0.61,
          "rank": 600,
          "indentLevel": 1,
          "foodNutrientId": 34388749
        }
      ]
    }
  ],
  "fruits": [
    {}
  ]
}