emory-libraries / ezpaarse-platforms

Platforms parsers, scrapers and PKBs for ezPAARSE
3 stars 3 forks source link

UN Comtrade #262

Open eipeele opened 6 years ago

eipeele commented 6 years ago

Example:star::star: :

https://comtrade-un-org.proxy.library.emory.edu/

Priority:

Medium

Subscriber (Library):

Woodruff

ezPAARSE

Analysis: http://ang.couperin.org/platforms/to_be_completed/

lisahamlett commented 4 years ago

https://comtrade-un-org.proxy.library.emory.edu/data/doc/UpgradePlan Site is undergoing an upgrade, so let's wait until it's done before writing this one. A bunch of the pages are misbehaving and generally being problematic in the logs.

lisahamlett commented 4 years ago

Website is still jacked up. Will check back in January after project is supposed to be completed.

lisahamlett commented 2 years ago

Okay, @avejohnson...

Ignore the class advertisement that pops up at the beginning ("TrainForTrade E-Learning Course on Statistics of International Trade in Services") and see what you can find on this one.

You can look at the logs at http://proxy.library.emory.edu/admin Click everything you can click and give me the best link resource for everything: TOC, Article, Journal, Image, etc. Feel free to note anything you're not sure about and we can make an decision on it. Resource Types: https://github.com/emory-libraries/ezpaarse-platforms/blob/master/rtype.json Resource Formats: https://github.com/emory-libraries/ezpaarse-platforms/blob/master/mime.json

lisahamlett commented 2 years ago

Examples for Avery:

TOC;HTML
https://comtrade.un.org:443/pb/

BOOK;PDF
https://comtrade.un.org:443/pb/downloads/2021/VolI2021.pdf

ABS;HTML (Not sure)
https://unstats.un.org:443/unsd/trade/data/tables.asp

TABLE;PDF
http://unstats.un.org:80/unsd/trade/imts/Historical%20data%201900-1960.pdf

TABLE;XLSX (not valid format)
http://unstats.un.org:80/unsd/trade/imts/UNSD%20Annual%20Totals%20Table%20(ATT)%202000-2015%20(as%20of%2017%20Jan%202017).xlsx

DATA;HTML
https://comtrade.un.org:443/data/da

Reference refers to wiki:
https://unstats-un-org.proxy.library.emory.edu/wiki/display/comtrade
avejohnson commented 2 years ago

DATA;HTML https://comtrade.un.org:443/Data/ https://comtrade.un.org:443/data/da https://comtrade.un.org:443/Data/mbs https://comtrade.un.org:443/data/daplus https://comtrade.un.org:443/survey/Reports/

DATA;HTML (broken page, not sure) https://comtrade.un.org:443/labs/data-explorer/

ARTICLE;HTML https://comtrade.un.org:443/data/doc/api/ https://comtrade.un.org:443/data/doc/API_MBS

TOC;HTML (not sure) https://comtrade.un.org:443/labs/

TOC;HTML https://comtrade.un.org:443/data/dev/portal/

DATA;HTML (not sure) https://comtrade.un.org:443/api/swagger/ui/index