writeback.png

Write data updates back to a source, e.g. a SaaS application or any other destination, or set up a data sync between one or more sources and destinations. This is called writeback, reverse ETL or data sync.

Data syncs (also called writebacks or Reverse ETL) keep data in sync between one or more sources and one or more destinations, for example syncing customer records between a CRM and an Accounting SaaS platform.

Data syncs are implemented in Peliqan by writing low-code Python scripts (”Data apps”) that are scheduled to run for example every 5 minutes (near real-time), every hour or every day.

Patterns

Peliqan provides a wide range of features to make these data syncs robust, stable and efficient by offering a set of patterns to implement these data syncs.

data sync patterns.png

<aside> ☝ It’s important to notice that not every pattern can be used for every source or destination because of the limitations of the APIs from the connected platforms. However, because Peliqan uses the data warehouse as the central repository, the patterns are more generic and much more robust compare to direct data syncs between A and B.

</aside>

Data sync topics

Writeback basics

Incremental processing

Matching records & avoiding duplicates

Processing manual data edits

Writeback examples per connector