latis-data / latis3

Apache License 2.0
8 stars 1 forks source link

latis.input.StreamSourceSuite.Redirect failing #671

Closed lindholc closed 5 months ago

lindholc commented 6 months ago

The failure:

org.http4s.ember.core.EmberException$MessageTooLong: HTTP Header Section Exceeds Max Size: 4096 Bytes

The length of the headers is indeed over 4096:

curl -Is https://github.com | wc -c
4185

Given that we've encountered a header section this large "in the wild", maybe we should increase from the default.

An aside: I think a better way to test this would be to create http4s routes that contain a redirect and produce a client from that, but we don't have a way to inject a client into HttpStreamSource.

lindholc commented 6 months ago

After some light searching I think it would be reasonable to bump this to 8K.