search

fabiogouw / spark-aws-messaging

A custom sink provider for Apache Spark that sends the content of a dataframe to an AWS SQS
MIT License
21 stars 5 forks source link

Failure to access a queue that belongs to another AWS account. #2

Closed roboverall closed 3 years ago

roboverall commented 3 years ago

The databricks instance we are using belongs to one AWS account and the SQS queue that belongs to another AWS account. The cross account permissions created have been tested and we have established this is not the issue.

The failure is:

com.amazonaws.services.sqs.model.QueueDoesNotExistException: The specified queue does not exist for this wsdl version. (Service: AmazonSQS; Status Code: 400; Error Code: AWS.SimpleQueueService.NonExistentQueue.

The issue seems to be with the GetQueueUrl method

Could the following parameter "QueueOwnerAWSAccountId" for the GetQueueUrl method be made available?

fabiogouw commented 3 years ago

Thanks for your contribution, the changes have been released in the 0.4.0 version of this lib!