[Proposal]: Support response streaming

[mike820324]

In some condition, we should not buffer the data in our proxy, but instead just stream the data to the client.

It is related to Issue #49.

For more reference, checkout http://docs.mitmproxy.org/en/latest/features/responsestreaming.html

[chhsiao90]

I think change to response stream depend on the response size is reasonable. So maybe we should just follow how mitmproxy doing to do with this!

[mike820324]

mitmproxy has the following ways to enable dest stream.

• by command line options.
• by plugin script.

If one specify the command line options, than every connection will use stream mode. The drawback is that, we can not modify the response content since it it already gone, but we can still view it.

[mike820324]

https://http2.golang.org/clockstream also supper from this issue.

[mike820324]

There are some factors that we can consider to use response streaming.

• Response size: if the header has a Content-Length, we can use this value and compare with a user defined value. (If it is using chunked encoded data, no lunk to predict the body size. )
• Adding a command line options that will enable body streaming for all the http traffic.

If using the response streaming, some of the functionality of plugin script may work properly, which may need to disabled.

[chhsiao90]

Agreed! Just the same way how mitmproxy doing

[mike820324]

I think this feature should wait for #119 complete.

[chhsiao90]

Completely agreed!