GasNet Leading Data Transformation: From Excel to a Modern Data Platform on AWS

Lack of Data Strategy and Manual Reporting

GasNet aimed to transform its business into a fully data-driven organization but lacked the experience and know-how to realize this vision. They needed a partner to guide them through the entire data transformation process.

Despite using Power BI for reporting, most analyses and reports were still manually processed in Excel. Report creators extracted data from multiple systems, validated it when necessary, and manually adjusted it. This led to time-consuming data processing that had to be repeated every month, causing frequent inconsistencies and inaccuracies in reports. The same metric could show different results, leading to doubts about data reliability.

More than 60 employees were involved in report creation, representing a significant resource burden. With the proposed optimization, GasNet anticipated saving up to 20 FTE (full-time equivalents). Frequent manual data retrievals from primary systems and up to 500 manual corrections annually were key reasons for centralizing and automating data processes.

Additionally, without a reliable data foundation, calculating heat consumption for billing was very challenging, especially with the increasing use of biogas of varying quality. The company also required comprehensive data to prepare for the introduction of hydrogen.

Project Challenges:

• Most reports were manually processed in Excel.
• Approximately 70% of the time was spent preparing and correcting data.
• Report results were often unreliable due to inaccurate and inconsistent data.
• Calculating network capacity for connecting new customers was labour-intensive and time-consuming.
• Calculating combustion heat for billing became nearly impossible with the growing number of biogas plants.
• Data preparation for further use hindered quick responses to new situations, forcing users to seek unsystematic solutions.

Data Strategy Development and Platform and Solution Implementation

The data transformation process began with workshops led by Adastra specialists, where the team introduced current trends, and technological possibilities, then recommended approaches to data transformation, including how to optimize GasNet’s data processes effectively.

Data Strategy:

For four months, the team analyzed the state of data processing, department needs, source systems, and processes related to data management.

At the end of the analysis, Adastra developed a comprehensive target solution proposal, which included creating a centralized source of trusted data, implementing effective data governance processes, and a detailed technical plan for implementation.

Based on the positive experience from the strategy development phase, GasNet selected Adastra for the implementation phase.

Data on AWS:

Since GasNet was already using AWS for its infrastructure, expanding to additional platform services in the AWS Cloud was a natural step. The chosen architecture was a lakehouse model using S3, Glue, and Redshift.

The first version of the report was completed within four months, including the setup of the target data architecture. The first use case was successfully completed in six months.

In parallel with building the data platform, Adastra initiated work on key data governance components, including creating a data catalog, business glossary, and data quality management.

Key Project Focus Areas:

Key Outcomes:

GasNet is now well-prepared for future challenges and innovations in the energy sector.

Implementation of the Platform:

Throughout the implementation, individual parts of the data platform were gradually built, and data was prepared to support end users. This approach allowed for the progressive reduction of dependency on manual data processing, enabling employees to focus more on data analysis and insights. By applying proper data platform usage rules, GasNet achieved greater data consistency, accuracy, and availability. The process also involved the introduction of data governance and the creation of appropriate data layers to eliminate duplication and erroneous links.

The project also contributed to developing internal capacities, allowing for more efficient data sharing across the organization. This not only resulted in technological improvements, but also in a significant strategic shift in how GasNet uses data as a key resource for business decisions.

Key Measures and Steps:

Thanks to these measures, GasNet could focus more on managing its gas infrastructure and improve its readiness for future challenges and changing market conditions.

GasNet Is a Data-Driven Company

The project delivered a fully functional data platform, an internal team of experts, and processes that allow GasNet to continue developing its data strategy and managing its data independently.

GasNet now has:

Key Processes in Data Governance:
Ensuring data quality and management for effective decision-making.

Data Platform:
A centralized repository encompassing most of the key data required for business management.

Internal Data Platform Development Team:
A team of experts who continually develop and manage the data infrastructure.

All Tools for Standardized Reporting using Power BI:
Most reports can now be generated directly by business users, allowing BICC to focus more on data engineering, management, and support.

Data on Gas Leaks, Vehicle Fleet Operations, and Office Building Energy Use:
This data is utilized for more efficient operations and ESG reporting.

Data for Calculating Combustion Heat for Various Gas Types (LNG, Biogas, Hydrogen):
Essential for accurate consumption billing.

The project with GasNet is a prime example of how a comprehensive data strategy and centralized data sharing can significantly improve processes and transform an organization into a modern, data-driven company. GasNet is now capable of further developing the platform on its own, with support from external consultants, enhancing its adaptability and readiness for future changes and challenges.