dotnetcore middlware fixes

ervwalter commented 5 years ago

I fixed several issues with the .NET core version of the middleware.

googlebot and bingbot were missing from the list of crawlers. This had been fixed in the .NET version but not the .NET core version
.gitignore was missing a lot of things leading to potential commits of things like .suo files, obj/ folders, and bin/ folders. Note, this standard .gitignore for VS is leaving .npgk and packages folders out, but some of those have already been committed previously. Not sure if you want these committed or excluded.
the .net core middleware was throwing an error when the service returned 301/302 or 404, but these are valid responses from the service. See https://prerender.io/documentation/best-practices for examples of why these might occur.

ervwalter commented 5 years ago

Also just added .ico, .map, and .json to the DefaultIgnoredExtensions list

chriskooken commented 5 years ago

Can we get this merged in?

dingyuliang / prerender-dotnet