zytedata / zyte-common-items

Contains the common item definitions used in Zyte.
BSD 3-Clause "New" or "Revised" License
9 stars 6 forks source link

Add zyte common items for social media post. #62

Closed kishan3 closed 8 months ago

kishan3 commented 1 year ago

Doc: https://docs.google.com/spreadsheets/d/1zSMSjyS0kkVcSTE-iV5U3U2SIP1QMv6PhgMNJC8Qq6M/edit\#gid\=1425038735 Unified schema: https://github.com/scrapinghub/unified-schema/pull/279

kishan3 commented 1 year ago

Hi @asadurski @lopuhin please review. Thanks.

kishan3 commented 11 months ago

Thanks @lopuhin @Gallaecio I made the suggested changes can you please check?

codecov-commenter commented 11 months ago

Codecov Report

Merging #62 (c1fc711) into main (d6765ee) will not change coverage. The diff coverage is 0.00%.

:exclamation: Current head c1fc711 differs from pull request most recent head f716be8. Consider uploading reports for the commit f716be8 to get more accurate results

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #62 +/- ## ===================================== Coverage 0.00% 0.00% ===================================== Files 9 9 Lines 1395 1458 +63 ===================================== - Misses 1395 1458 +63 ``` | [Files](https://app.codecov.io/gh/zytedata/zyte-common-items/pull/62?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None) | Coverage Δ | | |---|---|---| | [zyte\_common\_items/\_\_init\_\_.py](https://app.codecov.io/gh/zytedata/zyte-common-items/pull/62?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-enl0ZV9jb21tb25faXRlbXMvX19pbml0X18ucHk=) | `0.00% <ø> (ø)` | | | [zyte\_common\_items/items.py](https://app.codecov.io/gh/zytedata/zyte-common-items/pull/62?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-enl0ZV9jb21tb25faXRlbXMvaXRlbXMucHk=) | `0.00% <0.00%> (ø)` | | | [zyte\_common\_items/components.py](https://app.codecov.io/gh/zytedata/zyte-common-items/pull/62?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-enl0ZV9jb21tb25faXRlbXMvY29tcG9uZW50cy5weQ==) | `0.00% <0.00%> (ø)` | | | [zyte\_common\_items/pages.py](https://app.codecov.io/gh/zytedata/zyte-common-items/pull/62?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=None#diff-enl0ZV9jb21tb25faXRlbXMvcGFnZXMucHk=) | `0.00% <0.00%> (ø)` | |
lopuhin commented 11 months ago

@kishan3 there looks to be a build failing due to docstring issue https://github.com/zytedata/zyte-common-items/actions/runs/6720157548/job/18263131704?pr=62#step:5:83

kishan3 commented 11 months ago

@kishan3 there looks to be a build failing due to docstring issue https://github.com/zytedata/zyte-common-items/actions/runs/6720157548/job/18263131704?pr=62#step:5:83

Thanks @lopuhin I fixed it now.

kishan3 commented 11 months ago

Thanks @Gallaecio for the detailed review. I updated the code as per suggestions.

kishan3 commented 11 months ago

Looks good to me. +1 to merge once this new type is covered in https://docs.zyte.com/zyte-api/usage/extract.html#request-fields (no strong opinion against merging before that, though).

Thanks, will wait for this new type to appear in docs. Is there a place I can track it's progress or maybe I can contribute to adding it?

Gallaecio commented 11 months ago

Is there a place I can track it's progress or maybe I can contribute to adding it?

@lopuhin Probably knows best when it will be available in Zyte API. Then you can add it to docs.zyte.com if you want.

Gallaecio commented 11 months ago

I have just realized that we don’t really need to wait for Zyte API automatic extraction support, since we already have classes here that are not yet supported. What we should aim for is to have the schema in https://docs.zyte.com/zyte-data/schemas/index.html, which is what the classes here are meant to follow.

kishan3 commented 8 months ago

Thanks @Gallaecio @wRAR!!