rflechner / ScrapySharp

reborn of https://bitbucket.org/rflechner/scrapysharp
MIT License
346 stars 75 forks source link

Added a parsing step by comma for servers still sending back CSV for … #23

Open johnrey1 opened 5 years ago

johnrey1 commented 5 years ago

…multiple cookies #1

ran into same issue getting back a multi-cookie list where origin server separated by comma.

added a split on comma before the regex step

johnrey1 commented 4 years ago

added a few unit tests. it's been a long time looking at the code. I tried to find the host server I used that returned me CSV cookies. I couldnt find it. It's not standard to use CSV, just semi-colon separated. But I have run across old web servers that do. I changed the code a bit, and created a separate regex to use in the case where a ';' does not exist in the cookie string.

let me know if this works!