QUIXOTIC 360 is a SaaS platform for energy marketers (and communities). It automates repetitive processes and optimizes communication with the distributor, generating, exchanging and interpreting XML files in a bidirectional and end-to-end manner. They also bill energy, which places them between a back office and an ERP.
The technical challenge was urgent: extract and manage information from a daily amount of 8 million data generated in Salesforce and collected by a bot.
The objective was to implement a telemetry project that required interpolation, loss calculations, obtaining the best measurements and the ability to visualize data through queries, visual representations and an API. This large amount of data made manual data processing impossible, generating operational and human costs.
An AWS cloud solution was implemented, storing the data in Amazon S3 bucket, and managing it with AWS Step Functions workflows and AWS Glue ETL jobs, including vital interpolation and loss calculations via Lambda functions. Post-processing, data was stored in Amazon DynamoDB tables for optimization. The data was then loaded into Amazon DynamoDB tables. Data visualization and querying was enabled through Amazon Athena and a query API was developed with the API Gateway service.
This cloud-based solutionempowered QUIXOTIC 360 to conquerdata processing challenges, improving their analysis capabilities and getting a breakdown of the best measures of their data.
Results and Benefits
Increased data processing capacity. Including interpolation and loss calculations, improving data quality and reliability.
Facilitating data visualization and analytics for end users through AmazonAthena, driving collaboration and data-driven decision making.
Implementation of an API with API Gateway for programmatic access to data, promoting integration with other systems and applications.
Improved data quality and accessibility. Resulting in competitive advantage, operational efficiency and better utilization of data assets.
© Copyright - | magic beans | All Rights Reserved | Powered by: valkirias