exporting layer via WPS fails

[landryb]

I've enabled WPS in geoserver, including gs:DownloadEstimator,gs:Download - trying to export a vector layer from geoserver fails.

I see 4 requests being done, all successful, but no file is sent to the user.

• GET https://FQDN/geoserver/ows?service=WPS&version=1.0.0&REQUEST=DescribeProcess&IDENTIFIER=gs%3ADownloadEstimator%2Cgs%3ADownload

  <?xml version="1.0" encoding="UTF-8"?><wps:ProcessDescriptions xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="en" service="WPS" version="1.0.0" xsi:schemaLocation="http://www.opengis.net/wps/1.0.0 http://schemas.opengis.net/wps/1.0.0/wpsAll.xsd"><ProcessDescription wps:processVersion="1.0.0" statusSupported="true" storeSupported="true"><ows:Identifier>gs:DownloadEstimator</ows:Identifier><ows:Title>Estimator Process</ows:Title><ows:Abstract>Checks if the input file does not exceed the limits</ows:Abstract><DataInputs><Input maxOccurs="1" minOccurs="1"><ows:Identifier>layerName</ows:Identifier><ows:Title>layerName</ows:Title><ows:Abstract>Original layer to download</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>filter</ows:Identifier><ows:Title>filter</ows:Title><ows:Abstract>Optional Vectorial Filter</ows:Abstract><ComplexData><Default><Format><MimeType>text/xml; subtype=filter/1.0</MimeType></Format></Default><Supported><Format><MimeType>text/xml; subtype=filter/1.0</MimeType></Format><Format><MimeType>text/xml; subtype=filter/1.1</MimeType></Format><Format><MimeType>text/plain; subtype=cql</MimeType></Format></Supported></ComplexData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetCRS</ows:Identifier><ows:Title>targetCRS</ows:Title><ows:Abstract>Target CRS</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>RoiCRS</ows:Identifier><ows:Title>RoiCRS</ows:Title><ows:Abstract>Region Of Interest CRS</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>ROI</ows:Identifier><ows:Title>ROI</ows:Title><ows:Abstract>Region Of Interest</ows:Abstract><ComplexData><Default><Format><MimeType>text/xml; subtype=gml/3.1.1</MimeType></Format></Default><Supported><Format><MimeType>text/xml; subtype=gml/3.1.1</MimeType></Format><Format><MimeType>text/xml; subtype=gml/2.1.2</MimeType></Format><Format><MimeType>application/wkt</MimeType></Format><Format><MimeType>application/gml-3.1.1</MimeType></Format><Format><MimeType>application/gml-2.1.2</MimeType></Format><Format><MimeType>application/json</MimeType></Format></Supported></ComplexData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>cropToROI</ows:Identifier><ows:Title>cropToROI</ows:Title><ows:Abstract>Crop to ROI</ows:Abstract><LiteralData><ows:DataType>xs:boolean</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetSizeX</ows:Identifier><ows:Title>targetSizeX</ows:Title><ows:Abstract>X Size of the Target Image (applies to raster data only), or native resolution if missing</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AllowedValues><ows:Range ows:rangeClosure="closed-open"><ows:MinimumValue>1.0</ows:MinimumValue></ows:Range></ows:AllowedValues></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetSizeY</ows:Identifier><ows:Title>targetSizeY</ows:Title><ows:Abstract>Y Size of the Target Image (applies to raster data only), or native resolution if missing</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AllowedValues><ows:Range ows:rangeClosure="closed-open"><ows:MinimumValue>1.0</ows:MinimumValue></ows:Range></ows:AllowedValues></LiteralData></Input><Input maxOccurs="2147483647" minOccurs="0"><ows:Identifier>selectedBands</ows:Identifier><ows:Title>selectedBands</ows:Title><ows:Abstract>Band Selection Indices</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AnyValue/></LiteralData></Input></DataInputs><ProcessOutputs><Output><ows:Identifier>result</ows:Identifier><ows:Title>result</ows:Title><LiteralOutput><ows:DataType>boolean</ows:DataType></LiteralOutput></Output></ProcessOutputs></ProcessDescription><ProcessDescription wps:processVersion="1.0.0" statusSupported="true" storeSupported="true"><ows:Identifier>gs:Download</ows:Identifier><ows:Title>Enterprise Download Process</ows:Title><ows:Abstract>Downloads Layer Stream and provides a ZIP.</ows:Abstract><DataInputs><Input maxOccurs="1" minOccurs="1"><ows:Identifier>layerName</ows:Identifier><ows:Title>layerName</ows:Title><ows:Abstract>Original layer to download</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>filter</ows:Identifier><ows:Title>filter</ows:Title><ows:Abstract>Optional Vector Filter</ows:Abstract><ComplexData><Default><Format><MimeType>text/xml; subtype=filter/1.0</MimeType></Format></Default><Supported><Format><MimeType>text/xml; subtype=filter/1.0</MimeType></Format><Format><MimeType>text/xml; subtype=filter/1.1</MimeType></Format><Format><MimeType>text/plain; subtype=cql</MimeType></Format></Supported></ComplexData></Input><Input maxOccurs="1" minOccurs="1"><ows:Identifier>outputFormat</ows:Identifier><ows:Title>outputFormat</ows:Title><ows:Abstract>Output Format Mime-Type</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetCRS</ows:Identifier><ows:Title>targetCRS</ows:Title><ows:Abstract>Optional Target CRS</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>RoiCRS</ows:Identifier><ows:Title>RoiCRS</ows:Title><ows:Abstract>Optional Region Of Interest CRS</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>ROI</ows:Identifier><ows:Title>ROI</ows:Title><ows:Abstract>Optional Region Of Interest (Polygon)</ows:Abstract><ComplexData><Default><Format><MimeType>text/xml; subtype=gml/3.1.1</MimeType></Format></Default><Supported><Format><MimeType>text/xml; subtype=gml/3.1.1</MimeType></Format><Format><MimeType>text/xml; subtype=gml/2.1.2</MimeType></Format><Format><MimeType>application/wkt</MimeType></Format><Format><MimeType>application/gml-3.1.1</MimeType></Format><Format><MimeType>application/gml-2.1.2</MimeType></Format><Format><MimeType>application/json</MimeType></Format></Supported></ComplexData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>cropToROI</ows:Identifier><ows:Title>cropToROI</ows:Title><ows:Abstract>Crop to ROI</ows:Abstract><LiteralData><ows:DataType>xs:boolean</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>interpolation</ows:Identifier><ows:Title>interpolation</ows:Title><ows:Abstract>Interpolation function to use when reprojecting / scaling raster data.  Values are NEAREST (default), BILINEAR, BICUBIC2, BICUBIC</ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetSizeX</ows:Identifier><ows:Title>targetSizeX</ows:Title><ows:Abstract>X Size of the Target Image (applies to raster data only), or native resolution if missing</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AllowedValues><ows:Range ows:rangeClosure="closed-open"><ows:MinimumValue>1.0</ows:MinimumValue></ows:Range></ows:AllowedValues></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetSizeY</ows:Identifier><ows:Title>targetSizeY</ows:Title><ows:Abstract>Y Size of the Target Image (applies to raster data only), or native resolution if missing</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AllowedValues><ows:Range ows:rangeClosure="closed-open"><ows:MinimumValue>1.0</ows:MinimumValue></ows:Range></ows:AllowedValues></LiteralData></Input><Input maxOccurs="2147483647" minOccurs="0"><ows:Identifier>selectedBands</ows:Identifier><ows:Title>selectedBands</ows:Title><ows:Abstract>Band Selection Indices</ows:Abstract><LiteralData><ows:DataType>xs:int</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>writeParameters</ows:Identifier><ows:Title>writeParameters</ows:Title><ows:Abstract>Optional writing parameters</ows:Abstract><ComplexData><Default><Format><MimeType>text/xml</MimeType></Format></Default><Supported><Format><MimeType>text/xml</MimeType></Format></Supported></ComplexData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>minimizeReprojections</ows:Identifier><ows:Title>minimizeReprojections</ows:Title><ows:Abstract>When dealing with a Heterogeneous CRS mosaic, avoid reprojections of the granules within the ROI, having their nativeCRS equal to the targetCRS</ows:Abstract><LiteralData><ows:DataType>xs:boolean</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>bestResolutionOnMatchingCRS</ows:Identifier><ows:Title>bestResolutionOnMatchingCRS</ows:Title><ows:Abstract>When dealing with a Heterogeneous CRS mosaic given a ROI and a TargetCRS, with no target size being specified, get the best  resolution of data having nativeCrs matching the TargetCRS</ows:Abstract><LiteralData><ows:DataType>xs:boolean</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>resolutionsDifferenceTolerance</ows:Identifier><ows:Title>resolutionsDifferenceTolerance</ows:Title><ows:Abstract>the parameter allows to specify a tolerance value to control the use of native resolution of the data, when no target size has been specified and granules are reprojected. If  the percentage difference between original and reprojected coverages resolutions is below the specified tolerance value, native resolutions is the same for all the requested granules, the unit of measure is the same for native and target CRS, the reprojected coverage will be forced to use native resolutions</ows:Abstract><LiteralData><ows:DataType>xs:double</ows:DataType><ows:AnyValue/></LiteralData></Input><Input maxOccurs="1" minOccurs="0"><ows:Identifier>targetVerticalCRS</ows:Identifier><ows:Title>targetVerticalCRS</ows:Title><ows:Abstract>Optional Target VerticalCRS </ows:Abstract><LiteralData><ows:AnyValue/></LiteralData></Input></DataInputs><ProcessOutputs><Output><ows:Identifier>result</ows:Identifier><ows:Title>result</ows:Title><ComplexOutput><Default><Format><MimeType>application/zip</MimeType></Format></Default><Supported><Format><MimeType>application/zip</MimeType></Format></Supported></ComplexOutput></Output></ProcessOutputs></ProcessDescription></wps:ProcessDescriptions>

• POST on https://FQDN/geoserver/ows?service=WPS&version=1.0.0&REQUEST=Execute with

  <?xml version="1.0" encoding="UTF-8"?><wps:Execute version="1.0.0" service="WPS" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.opengis.net/wps/1.0.0" xmlns:wfs="http://www.opengis.net/wfs" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:gml="http://www.opengis.net/gml" xmlns:ogc="http://www.opengis.net/ogc" xmlns:wcs="http://www.opengis.net/wcs/1.1.1" xmlns:dwn="http://geoserver.org/wps/download" xmlns:xlink="http://www.w3.org/1999/xlink" xsi:schemaLocation="http://www.opengis.net/wps/1.0.0 http://schemas.opengis.net/wps/1.0.0/wpsAll.xsd"><ows:Identifier>gs:DownloadEstimator</ows:Identifier><wps:DataInputs><wps:Input><ows:Identifier>layerName</ows:Identifier><wps:Data><wps:LiteralData>geor:aerodrome</wps:LiteralData></wps:Data></wps:Input></wps:DataInputs></wps:Execute>

  returns

  <?xml version="1.0" encoding="UTF-8"?><wps:ExecuteResponse xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" service="WPS" serviceInstance="https://georchestra.dev.craig.fr/geoserver/ows?" version="1.0.0"><wps:Process wps:processVersion="1.0.0"><ows:Identifier>gs:DownloadEstimator</ows:Identifier><ows:Title>Estimator Process</ows:Title><ows:Abstract>Checks if the input file does not exceed the limits</ows:Abstract></wps:Process><wps:Status creationTime="2022-02-07T09:30:09.300Z"><wps:ProcessSucceeded>Process succeeded.</wps:ProcessSucceeded></wps:Status><wps:ProcessOutputs><wps:Output><ows:Identifier>result</ows:Identifier><ows:Title>Download Limits are respected or not!</ows:Title><wps:Data><wps:LiteralData>true</wps:LiteralData></wps:Data></wps:Output></wps:ProcessOutputs></wps:ExecuteResponse>

• POST https://FQDN/geoserver/ows?service=WPS&version=1.0.0&REQUEST=Execute with

  <?xml version="1.0" encoding="UTF-8"?><wps:Execute version="1.0.0" service="WPS" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://www.opengis.net/wps/1.0.0" xmlns:wfs="http://www.opengis.net/wfs" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:gml="http://www.opengis.net/gml" xmlns:ogc="http://www.opengis.net/ogc" xmlns:wcs="http://www.opengis.net/wcs/1.1.1" xmlns:dwn="http://geoserver.org/wps/download" xmlns:xlink="http://www.w3.org/1999/xlink" xsi:schemaLocation="http://www.opengis.net/wps/1.0.0 http://schemas.opengis.net/wps/1.0.0/wpsAll.xsd"><ows:Identifier>gs:Download</ows:Identifier><wps:DataInputs><wps:Input><ows:Identifier>layerName</ows:Identifier><wps:Data><wps:LiteralData>geor:aerodrome</wps:LiteralData></wps:Data></wps:Input><wps:Input><ows:Identifier>outputFormat</ows:Identifier><wps:Data><wps:LiteralData>application/zip</wps:LiteralData></wps:Data></wps:Input><wps:Input><ows:Identifier>cropToROI</ows:Identifier><wps:Data><wps:LiteralData>false</wps:LiteralData></wps:Data></wps:Input></wps:DataInputs><wps:ResponseForm><wps:ResponseDocument storeExecuteResponse="true" status="true"><wps:Output mimeType="application/zip" asReference="true"><ows:Identifier>result</ows:Identifier></wps:Output></wps:ResponseDocument></wps:ResponseForm></wps:Execute>

  returns

  <?xml version="1.0" encoding="UTF-8"?><wps:ExecuteResponse xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" service="WPS" serviceInstance="https://georchestra.dev.craig.fr/geoserver/ows?" statusLocation="https://georchestra.dev.craig.fr/geoserver/ows?service=WPS&amp;version=1.0.0&amp;request=GetExecutionStatus&amp;executionId=31669d01-03cf-4252-8dd2-8bae8326bf00" version="1.0.0"><wps:Process wps:processVersion="1.0.0"><ows:Identifier>gs:Download</ows:Identifier><ows:Title>Enterprise Download Process</ows:Title><ows:Abstract>Downloads Layer Stream and provides a ZIP.</ows:Abstract></wps:Process><wps:Status creationTime="2022-02-07T09:30:09.992Z"><wps:ProcessAccepted>Process accepted.</wps:ProcessAccepted></wps:Status></wps:ExecuteResponse>

• GET https://FQDN/geoserver/ows?service=WPS&version=1.0.0&REQUEST=GetExecutionStatus&executionId=31669d01-03cf-4252-8dd2-8bae8326bf00 returns

  <?xml version="1.0" encoding="UTF-8"?><wps:ExecuteResponse xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:ows="http://www.opengis.net/ows/1.1" xmlns:wps="http://www.opengis.net/wps/1.0.0" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" service="WPS" serviceInstance="https://georchestra.dev.craig.fr/geoserver/ows?" statusLocation="https://georchestra.dev.craig.fr/geoserver/ows?service=WPS&amp;version=1.0.0&amp;request=GetExecutionStatus&amp;executionId=31669d01-03cf-4252-8dd2-8bae8326bf00" version="1.0.0"><wps:Process wps:processVersion="1.0.0"><ows:Identifier>gs:Download</ows:Identifier><ows:Title>Enterprise Download Process</ows:Title><ows:Abstract>Downloads Layer Stream and provides a ZIP.</ows:Abstract></wps:Process><wps:Status creationTime="2022-02-07T09:30:09.992Z"><wps:ProcessSucceeded>Process succeeded.</wps:ProcessSucceeded></wps:Status><wps:ProcessOutputs><wps:Output><ows:Identifier>result</ows:Identifier><ows:Title>Zipped output files to download</ows:Title><wps:Reference href="https://georchestra.dev.craig.fr/geoserver/ows?service=WPS&amp;version=1.0.0&amp;request=GetExecutionResult&amp;executionId=31669d01-03cf-4252-8dd2-8bae8326bf00&amp;outputId=result.zip&amp;mimetype=application%2Fzip" mimeType="application/zip"/></wps:Output></wps:ProcessOutputs></wps:ExecuteResponse>

at that point no other request seems done, and the user has zero feedback. From my understanding the url pointed at by wps:Reference is the process result and should be fetched ?

Trying to manually fetch https://FQDN/geoserver/ows?service=WPS&version=1.0.0&request=GetExecutionResult&executionId=31669d01-03cf-4252-8dd2-8bae8326bf00&outputId=result.zip&mimetype=application/zip Yields Unknown output result.zip for execution id 31669d01-03cf-4252-8dd2-8bae8326bf00, either the execution was never submitted or too much time elapsed since the process completed but i guess i was too late (eg 25mn later) ?

if there's no WPS available (eg user not connected and gets a 401 on the DescribeProcess), ms2 fallbacks to WFS download which works.

[tdipisa]

@landryb it seems properly working on our DEV. Can you please let me know if you still have the same problem and, if yes, some step to reproduce it (in our DEV possibly)?

[landryb]

I see that it currently works fine on https://georchestra.geo-solutions.it/mapstore/#/ - i've also tested it in my wip testing instance running 98b95eb and it also works fine. So something probably fixed the issue since then, closing. Thanks !