From Legacy to Leading: A Government’s Journey to Cloud-Driven Innovation (Peter Rizvi, Cloudera)

April 24, 2024

Cloudera is a hybrid data platform that operates in various cloud environments as well as on-premises. It provides secure data management and cloud-native data analytics. What are the experiences with clients from the public sector? We’re going to discuss this with my guest, Peter Rizvi, account executive at Cloudera.

• What are the government’s main concerns about cloud platforms?
• Do they need additional data security and governance measures?
• How does Cloudera help government address challenges without requiring extensive infrastructure changes?

Watch the interview

Listen to the podcast 

Read the podcast as an interview

Ivana Karhanová: Peter, welcome to the studio.

Peter Rizvi: Thank you so much for having me. It’s a pleasure to be here.

Ivana Karhanová: What are the main concerns of government agencies regarding cloud platforms?

Peter Rizvi: Government agencies face a variety of worries and challenges, even before addressing the topic of the public cloud. Data sovereignty is a significant concern, particularly due to the sensitivity of the data involved, including personal, administrative, healthcare, and infrastructure-related data. Governments are cautious about where and how their data is stored and managed, especially regarding national security. Currently, there’s a preference for keeping data within their own infrastructure and borders, particularly in regions like Central and Eastern Europe.

Ivana Karhanová: So, essentially, they prefer to keep it within their own borders and infrastructure.

Peter Rizvi: Exactly. In regions like Germany, the UK, and the United States, governments are more open to public cloud approaches, mainly because cloud vendors have data centers within the country, ensuring data doesn’t leave its borders. However, in areas like the Czech Republic, Slovakia, and Hungary, there’s hesitance to move data across borders. At Cloudera, our challenge is to provide governments with the flexibility and benefits of a public cloud-like setup while maintaining data on-premises. We also need to prepare them for a potential shift to public cloud in the future.

Ivana Karhanová: Do you believe they’ll eventually transition to the public cloud?

Peter Rizvi: I do. With the possibility of hyper scalers opening data centers locally, the shift to the public cloud is likely, though it may not encompass all types of data. A hybrid approach might be more common, offering the government the benefits of the public cloud while addressing their data management challenges, such as lack of flexibility and slow adoption of new technologies.

Ivana Karhanová: So, in essence, a public cloud setup could address some of these challenges and provide more agility in scaling up data platforms.

Peter Rizvi: Exactly. Public cloud environments facilitate innovation and scalability, which can be particularly advantageous for government projects that often face lengthy planning and procurement processes. By leveraging the infrastructure provided by cloud vendors, governments can accelerate innovation and adapt more quickly to technological advancements.

Ivana Karhanová: Do government agencies require additional measures for data security and governance?

Peter Rizvi: Data security and governance should be top priorities for any organization, regardless of the sector. However, government regulations often demand stricter adherence to data management practices. That said, it doesn’t mean other sectors should have less secure data platforms. The approach may vary based on specific industry regulations and needs.

Ivana Karhanová: So, it’s about tailoring solutions to meet the unique requirements of different industries?

Peter Rizvi: Yes, indeed. It’s also about the internal culture of data management within organizations and how access to data is controlled. For instance, in the government, access rights to data are typically more stringent, reflecting legal and compliance obligations.

Ivana Karhanová: Right, like ensuring sensitive information such as tax details remains protected.

Peter Rizvi: Exactly, although it can vary by country.

Ivana Karhanová: Your documents state that 72% of government agencies are uncertain about the location of their data. How is this possible?

Peter Rizvi: It’s a significant challenge stemming from data silos present not only in government but also in large enterprises. Each agency or organization within a government structure may have its own data policies and management practices, leading to fragmentation and difficulty in tracking data across the board.

Ivana Karhanová: Like different data warehouses within the same organization.

Peter Rizvi: Each agency or organization within a government structure may have its own data policies and management practices, leading to fragmentation and difficulty in tracking data. There might not be a centralized repository or data governance strategy, exacerbating the issue.

Ivana Karhanová: So, essentially, there’s a lack of communication and centralized governance within government agencies?

Peter Rizvi: Exactly. Additionally, there are challenges with shadow IT and differing approaches to data management within individual organizations. The sheer volume and variety of data collected by governments pose another significant challenge, making it difficult to classify and manage effectively.

Ivana Karhanová: Indeed, managing such diverse data sets can be daunting.

Peter Rizvi: Absolutely. Many governments still rely on legacy IT infrastructures, hindering their ability to modernize data management practices.

Ivana Karhanová: You mentioned that only 33% of agencies claim they can fully classify their data. Why is this?

Peter Rizvi: The vast and diverse nature of the data collected by governments makes classification challenging. Traditional infrastructure further complicates matters by not facilitating efficient data management and organization.

Ivana Karhanová: Can Cloudera help governments address these challenges without requiring extensive infrastructure changes?

Peter Rizvi: We take a case-by-case approach. While we can’t always replace existing systems entirely, we can assist with data governance and provide tools to help governments derive value from their data. We’ve worked with public sector clients globally, helping them innovate and modernize their data management practices.

Ivana Karhanová: It sounds like Cloudera’s solutions can make a significant impact on government data management.

Peter Rizvi: Absolutely. We’ve seen remarkable innovations within the public sector, often surpassing private sector projects. For instance, one of our government clients in Hungary implemented a unified data warehouse and data lake concept five years ago, showcasing forward-thinking strategies in data management.

They essentially pioneered what we now call a data lake house, a modern data architecture approach. Back then, this Hungarian government agency created the hybrid data lake, as they called it, really ahead of their time. These days, we’re advocating for a shift to data lake houses for our enterprise and private sector customers. We have various components supporting this approach, such as Iceberg, an open-source tool we’re excited about. But some government customers have been working towards this goal for many years.

Ivana Karhanová: What are the most common use cases you address?

Peter Rizvi: It’s challenging to pinpoint one, but in Central Europe, we often work with government finance and banking sectors, dealing with tax data, transactional data, and reporting to entities like the European Central Bank. The energy sector, especially IoT for power distribution, is significant due to regional energy crises. Also, the defense and security sector, which aspires to be more data-driven, is a focus area for us.

Ivana Karhanová: How long do you think it will take for these sectors to become truly data-driven?

Peter Rizvi: It’s an ongoing journey with continuous improvement. Becoming completely data-driven is a never-ending process, as organizations discover more use cases and opportunities for leveraging data.

Ivana Karhanová: So, it’s a journey of continuous discovery.

Peter Rizvi: Exactly.

Ivana Karhanová: Can you compare the approach to digitalization and cloud usage across different countries?

Peter Rizvi: Countries with native cloud data centers are more inclined towards public cloud adoption, including the government. Central and Eastern Europe showcases a strong open-source culture, with professionals leveraging advanced AI and big data tools. Open-source technologies play a significant role in both private and public sector digitalization efforts. Cloudera helps organizations package and enhance their existing open-source tools for enterprise-ready solutions, maximizing their value.

Ivana Karhanová: That’s fascinating. Do you have any other inspiring stories like the one about the Hungarian agency building the data lake?

Peter Rizvi: There are many stories, although the government sector values privacy, so there’s limited information we can share. One notable project in the Czech Republic focuses on the energy sector, aiming to optimize energy distribution using smart meter data. This initiative promises cost savings, environmental benefits, and improved customer service through innovative use cases and substantial investments in data-driven solutions.

Ivana Karhanová: It’s impressive to see such innovation in traditionally viewed sectors.

Peter Rizvi: Absolutely. These companies are far from old school based on my experience.

Ivana Karhanová: Can you share similar stories from other countries to inspire the Czech Republic?

Peter Rizvi: Certainly. In the United Kingdom, we collaborate with the West Midlands Police Force, improving response times to distress calls and gathering real-time data from officers on the ground. While it’s challenging to quantify the impact, such initiatives ultimately save lives.

Ivana Karhanová: So the focus is on improving response times and overall efficiency.

Peter Rizvi: Exactly. Moving to the Americas, where these technologies are more established, there’s a wealth of inspiration to draw from. I wouldn’t say that certain countries are years ahead of us in technology. The infrastructure may differ, but innovation is global. A notable example is NiFi, a tool developed by the US government, specifically the NSA, which later contributed to the open-source community. It’s now widely used for real-time data streaming worldwide.

Ivana Karhanová: Moving on to smart cities, how can the public sector contribute data to these initiatives?

Peter Rizvi: Smart cities encompass various aspects, such as energy efficiency, e-citizenship, healthcare, and public transport. It’s a cultural shift towards leveraging data for efficient governance. We’ve collaborated with Dubai on their Smart City project, focusing on energy distribution and demographic data.

Ivana Karhanová: Can these projects be achieved without cloud technology?

Peter Rizvi: Cloud technology offers flexibility and scalability, making it easier to handle sudden data demands. While cloud solutions may offer quicker innovation, private cloud tools are increasingly capable of achieving similar outcomes. It ultimately depends on the scale and specific needs of the project.

Ivana Karhanová: Thank you for sharing your insights with us.

Peter Rizvi: Thank you very much.