Sensor on Admin Consult
Introduction
Keeping data consistent between different systems is not easy but it is important. Inconsistent data leads to higher error rates in processes, loss of time and stress when an explanation for the differences cannot be found quickly. Ideally, which software is leading and where the “single source of truth” is located should be determined for each type of data. Once it has been determined where the data should be maintained, you can start technically connecting other systems to this source to share information consistently.
APPROACH
Numerix built a link for such a leading system so that all subsequent systems receive the latest changes at a fixed interval. Via the REST API of the leading system, the ‘events’ in that system are interpreted every minute. This sensor then launches the appropriate jobs so that the information remains consistent everywhere.
In this concrete application, the master data of all customers and projects are written to an accounting package and a CRM system every minute. Furthermore, project managers immediately receive an e-mail when there is an interesting change to their project. The power of this sensor is that you can go very far in the actions associated with an event.
[sensor that scans events and launches jobs]
For this solution, the choice was made to use Dagster. Dagster's built-in sensor functionality proved extremely suitable for the question we were asked. Dagster is an open source data orchestrator that is free to use when you take care of the infrastructure yourself. Moreover, it has a very clear web portal that allows you to analyse the performance of the links at a glance.
[dagster single pane of glass]