Workflows · From Tasks · from_url

Purpose

Imports data from a URL.

Method of use

If the URL needs a username and password to get to the data, please share them with a Onesecondbefore employee to add it as a connection.

Configuration

Example usage

extract:
    conn_id: url
    url: https://api-live.adyen.com/reports/download/Company/Onesecondbefore/payments_accounting_report_{{ task.start_date.strftime('%Y_%m_%d') }}.csv

Properties

property	type	required	description
`conn_id`	string	no	Connection string as handed to you by the Onesecondbefore team.
`url`	string	yes	Url to download the data from.

Details

item	description
`Pre-formatted schema`	No. This from task does not come with a pre-formatted schema. Define `file` and it is required to define the `schema` if you use Snowflake. BigQuery can auto-detect the source file.