Polling Trigger Does Not Appear to Respect MAX File Size

[jhorbulyk]

Component Bug Report

Description

Polling Trigger Does Not Appear to Respect MAX File Size

Component Version

• Version of the component running when the below steps to reproduce were performed: 1.4.7
• Platform version running when/installation name where the below steps were reproduced: 22.16
• Credentials used: Elastic.io SFTP server (and .env file)

Steps to Reproduce

1. Create a file that is slightly larger than the max allowed upload size of 100 MB. For example in Unix run the command dd if=/dev/zero of=minNotAllowed.file bs=104857601 count=1
2. Upload this file to an otherwise empty folder in the SFTP server.
3. Create a flow with a single step: SFTP.PollFiles
   • Directory Name: Point to directory created above
   • Emit Behaviour: Emit Individually
   • Leave other fields blank
4. Generate a sample

Actual Result

• A sample is generated like

  {
  "type": "-",
  "name": "minNotAllowed.file",
  "size": 104857601,
  "modifyTime": "2022-04-25T15:57:58.000Z",
  "accessTime": "2022-04-25T16:04:57.000Z",
  "rights": {
  "user": "rw",
  "group": "r",
  "other": "r"
  },
  "owner": 1002,
  "group": 1002,
  "attachment_url": "http://maester-service.platform.svc.cluster.local:3002/objects/802548b2-eedf-4b8c-be02-cb633adea92e?storage_type=maester",
  "directory": "/www/jacob/MinNotAllowed",
  "path": "/www/jacob/MinNotAllowed/minNotAllowed.file"
  }

• An attachment is created in maester

Expected Result

• An error is produced since the file size of 104857601 is larger than the max allowed file size of 104857600
• No maester attachment is created.

Workaround(s)

Be honest and don't upload too big files.

[jhorbulyk]

It looks like the MAX_FILE_SIZE env var has been set to 104857600 on app.elastic.io which the component interprets as 104857600 MB = 100 TB. This is likely the problem.