Add big5 encoding support

[FocacciaSyin]

Same Request working on Postman & Browse ,Could you please help me confirm the following information?

Get URL: https://ezfund.moneydj.com/w/query/result/djjson/SearchJSON.djjson?P1=ezfund&P2=False&P3=False&P4=False&P5=0&m=0&Change=1&companycode=CATH

ErrorMessage: The character set provided in ContentType is invalid. Cannot read content as string using an invalid character set. at System.Net.Http.HttpContent.ReadBufferAsString(ArraySegment1, HttpContentHeaders) + 0x17f at System.Net.Http.HttpContent.ReadBufferedContentAsString() + 0xa5 at System.Net.Http.HttpContent.<>c.<ReadAsStringAsync>b__30_0(HttpContent) + 0xe at System.Net.Http.HttpContent.<WaitAndReturnAsync>d__612.MoveNext() + 0x135 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() + 0x21 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task) + 0x70 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task) + 0x38 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task) + 0x17 at Nightingale.Core.Client.NightingaleClient.d8.MoveNext() + 0x1a4 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() + 0x21 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task) + 0x70 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task) + 0x38 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task) + 0x17 at Nightingale.Core.Client.NightingaleClient.d7.MoveNext() + 0x2e7 --- End of stack trace from previous location where exception was thrown --- at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() + 0x21 at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task) + 0x70 at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task) + 0x38 at System.Runtime.CompilerServices.TaskAwaiter.ValidateEnd(Task) + 0x17 at Nightingale.Core.Services.RequestSender.d__5.MoveNext() + 0x152

[dpaulino]

Thanks for creating an issue. I'll investigate soon

[dpaulino]

Jotting down notes from my investigation:

• it seems the crash occurs when trying to read the content as string
• the request itself returns successfully, but the crash occurs when trying to display the string result
• issue seems encoding related. It seems that the response's charset is BIG5, and the c# httpclient ReadAsStringAsync() method doesn't seem to support this encoding out of the box
• more info on encodings: https://docs.microsoft.com/en-us/dotnet/api/system.text.encoding?view=net-5.0#remarks

I may need to manually add big5 encoding support following this repo: https://github.com/chenrensong/Encoding.UWP

[dpaulino]

Note to self:

• Error occurs in NightingaleClient.cs >string content = await httpResponse.Content.ReadAsStringAsync();
• Fix would be to add big5 encoding support as in previous comment, then somehow use that encoding when reading the response content