Open rgranit opened 2 months ago
I don't know about AWS lambda, but I guess you could deploy it on fargate/ECS. We have deployed it on Azure container
@rgranit never tried, but I'd be happy to hear if you manage. There are a few other issues opened about it, but I don't remember there was any conclusive information.
Hi @rgranit
I've experimented with Lambda setups for GROBID. Although it works, the cold-start times are problematic. We've opted to use ECS Fargate directly with the public docker images.
I do think it is possible to get a Lambda runtime working with acceptable cold-starts though. My lack of familiarity with the Java runtimes and environment is keeping me from exploring further, but the Lambda SnapStart [0] (only available for Java) could potentially get you what you want, if you build a custom runtime for it. Simply using the public docker images are not suitable for the Lambda Firecraker VMs
[0] https://docs.aws.amazon.com/lambda/latest/dg/snapstart.html
Hi,
Does anyone know if it is possible to run this grobid on AWS Lamda? and if so, how much time it takes to load?