disinfoRG / ZeroScraper

Web scraper made by 0archive.
https://0archive.tw
MIT License
10 stars 2 forks source link

Create db using utf8mb4 format #122

Open bwlynch opened 4 years ago

bwlynch commented 4 years ago

While testing out the application by scraping sites from the current Airtable, I was getting errors due to the fact that the database wasn't using utf8mb4 format and so couldn't input chinese characters, specifically in the raw_data column in the ArticleSnapshot table. I assume there's a way to specify that in during the database creation and was thinking it might be worth it do so.