Workflows · To Tasks · to_aws_sqs

Purpose

Uploads data to the Amazon Simple Queue Service (SQS).

Limitation

Only supports database as a source in the extract part of the configuration.

Method of use

Before you can upload data to Amazon SQS you have to give Workflows access. Follow the steps below:

Have the Amazon Cloud administrator create an IAM account (if you don't have one already)
Hand him the message queue you want to access
Make sure to activate `Programmatic access`
Make sure the following policies are added:
1. `AmazonSQSFullAccess` - Minimum required access.
Send Access Key ID and Secret Access Key back to Onesecondbefore staff. They will add it to Workflows.
You should now be able to download data cloud objects from Amazon S3

Configuration

Example usage

load:
    conn_id: aws_s3
    mapping:
        QueueUrl: QueueUrl
        MessageBody: MessageBody
        DelaySeconds: DelaySeconds
        MessageAttributes: MessageSystemAttributes
        MessageDeduplicationId: MessageDeduplicationId
        MessageGroupId: MessageGroupId

Properties

property	type	mandatory	description
`conn_id`	string	no	Connection string as handed to you by the Onesecondbefore team. Default is `aws_s3`
`mapping`	object	yes	Contains the mappings from the dataset to the service. See below for mapping options.

Mappings

mapping	type (in dataset)	mandatory	description
`QueueUrl`	string	yes	Contains the field name in the dataset that contains the `QueueUrl` of the message queue.
`MessageBody`	object	yes	Contains the message body.
`DelaySeconds`	integer	no	Contains the message body.
`MessageAttributes`	object	no	Contains the message attributes.
`MessageDeduplicationId`	string	no	Contains the message deduplication ID.
`MessageGroupId`	string	no	Contains the message group ID.

Details

item	description
`API`	Amazon SQS REST API
`To type`	Data upload