Skip to main content

Connection Workflows

This page explains the high-level workflow of connections and ETL workflows.

1. Create a Connection​

Creating a connection is the first step of connecting a Macrometa document collection to an external data source or target. In the Macrometa web console, you can perform this task either in the Connections section or while creating a new document collection. For example, you might connect to a MongoDB source or a PostgresSQL target.

2. Create an ETL Workflow​

Once you have created a connection, you can create a workflow between a document collection and a specific table in an external data source.

  • To create a source workflow, which means that the collection would import records from the external data source, you must define it when you create a new document collection.
  • To create a target workflow, which means that the collection would export records to the external data source, you must create a collection and add at least one record to it. After that, you can add targets in the Collection Settings screen. A collection can have multiple targets.

3. Transform the Data​

While creating an ETL workflow, after the connection is validated, you can add a transformation that will act on every record as it moves in or out of the collection.