slurpcode / slurp

One repo to rule them all !!?!?!! 🤓 😎
https://slurp.rtfd.io/
GNU General Public License v3.0
54 stars 75 forks source link

💭 Scraping config file discussion 💭 #206

Open jbampton opened 4 years ago

jbampton commented 4 years ago

For the website profiles we scrape we need to store the profile user names in a config file.

I was previously using CSV on another project.

We could use XML, JSON, YAML, CSV or ?

Andrew-Colman commented 4 years ago

Json

prestonhunter commented 4 years ago

As a data storage format, CSV has problems, but it is more easily and more widely used than the other formats you mention (XML, JSON, YAML). If the file must be prepared manually, then CSV is a sensible format to use. If the file is to be prepared only using a tool, then the tool can do the work, and a different format may be a better option.