aplocher
commented
4 years ago I modified the code to use the "Exec" stuff instead, and I'm having the same exact problem.
IDockerClient client = new DockerClientConfiguration(new Uri("https://docker-server:2376"), credentials).CreateClient();
// Create Container
var response = await client.Containers.CreateContainerAsync(new CreateContainerParameters
{
Image = "jbarlow83/ocrmypdf:latest",
AttachStdin = true,
AttachStdout = true,
AttachStderr = false,
OpenStdin = true,
HostConfig = new HostConfig
{
CPUCount = 4
},
Entrypoint = new string[] { "bash" }
});
await client.Containers.StartContainerAsync(response.ID, new ContainerStartParameters());
var execContainer = await client.Exec.ExecCreateContainerAsync(response.ID, new ContainerExecCreateParameters
{
AttachStdin = true,
AttachStdout = true,
AttachStderr = false,
Detach = false,
Privileged = true,
Cmd = new string[] { "/usr/local/bin/ocrmypdf", "--redo-ocr", "-", "-" }
});
var stream = await client.Exec.StartAndAttachContainerExecAsync(execContainer.ID, true);
var inputFile = @"C:\temp\test.pdf";
var outputFile = @"C:\temp\test-2.pdf";
var inputBytes = File.ReadAllBytes(inputFile);
var outputStream = new MemoryStream();
// Write bytes to STDIN
var writeTask = Task.Run(async () =>
{
await stream.WriteAsync(inputBytes, 0, inputBytes.Length, CancellationToken.None);
stream.CloseWrite();
});
// Read bytes from STDOUT to MemoryStream
var readTask = Task.Run(async () =>
{
//var buffer = new byte[81920];
var buffer = ArrayPool<byte>.Shared.Rent(81920);
try
{
// Copied from MultiplexedStream.CopyOutputToAsync method:
for (; ; )
{
// Exception is thrown here after "await WaitContainerAsync" below:
var result = await stream.ReadOutputAsync(buffer, 0, buffer.Length, default(CancellationToken)).ConfigureAwait(false);
if (result.EOF)
return;
if (result.Count == 0)
return;
await outputStream.WriteAsync(buffer, 0, result.Count, default(CancellationToken)).ConfigureAwait(false);
}
// End CopyOutputToAsync
}
finally
{
ArrayPool<byte>.Shared.Return(buffer);
}
});
await readTask;
await writeTask;
// Write MemoryStream to file
if (File.Exists(outputFile))
File.Delete(outputFile);
outputStream.Position = 0;
using (var filestream = File.Create(outputFile))
{
await outputStream.CopyToAsync(filestream);
}
xplicit
fbozkurtt
matt-cassinelli
Output of
dotnet --info:What version of Docker.DotNet?:
Steps to reproduce the issue:
What actually happened?:
When I provide a large(ish) input, the following exception will occur on
ReadOutputAsyncWhat did you expect to happen?:
I expected the read to succeed, like it does with smaller files.
Additional information:
This docker instance takes a PDF file through STDIN and produces another PDF file (OCR'ed) to STDOUT.
This docker client command is exactly what I'm trying to replicate with Docker.DotNet but am unable to (with LARGER PDFs, small files work fine):
I've used various combinations of the code from issue #223 but he seemed to solve his issue (which was different from mine).
I also thought the Pull-Request from Issue #388 might be helpful, but when I use
PeekI get an exception "_stream isn't a peekable stream"This works without an exception with an 8mb test file, but another 20mb test file fails with this exception. Both files work fine from the docker CLI.
Basically, I'm wondering if I'm doing something wrong (and if so, how can I fix it?) - or is this an issue with Docker.DotNet? Thank you!