AUGUST - 2022CIOAPPLICATIONS.COM 19This data is then available for consumption in the downstream systems.Our pipeline is also equipped with a notification system using an SQS or SNS message that alerts downstream consumers when the data is available to retrieve and process. As all data status flows into our dataset monitoring environment, clients can easily track their datasets through the pipeline in real-time, using our user interface. They can view the name of the dataset and access information regarding when the data landed, when the process was completed, how long it took, and if it succeeded or failed to reach a data warehouse or data lake. With this visibility, clients can assess the reason for a particular data landing failure and automatically trigger a support team via email for proactive resolution. Could you elaborate on a particular client success story?A large foreign country pension fund had several investment groups that wished to move from fundamental to analytical investment strategies by leveraging big data and their internal system data. However, the existing internal system data was scattered across many on-premise databases, and the big data sets were yet to be acquired from third parties. This gave rise to a need for a robust solution to ingest their internal and external data into a centralized data store.We collaborated with them and offered our IData pipeline running on AWS and leveraging S3 object-store technology. The pension fund and technology team were soon able to work together to register their datasets and immediately ingest those for availability by downstream systems and analysts. This empowered data analysts to leverage these datasets, along with internal investment models, and make responsive data-driven investment decisions. How is IData a cut above the rest in the industry?We believe in delivering an end-to-end data pipeline where clients can plug in our solution and get up and running seamlessly in a few days. Another aspect where we outshine the others is that we can assist clients who do not want to write their own configurations. In such cases, we provide our UI where they can leverage our wizard that automatically generates the JSON configuration. Our goal ultimately is to offer a convenient, seamless, and independently deployable pipeline that organizations can leverage to securely access a single source of truth. Our pipeline can help eliminate over 12 months' worth of PoC and eventual data technology implementation. Most importantly, clients need not configure and maintain the servers as the solution is built, using IaC, and runs in a serverless environment
<
Page 9 |
Page 11 >