By using this site, you agree to the Privacy Policy and Terms of Use.
Accept

News Junction

Notification Show More
Font ResizerAa
  • Home
  • World News
    World NewsShow More
    Joe Biden diagnosed with prostate cancer
    Joe Biden diagnosed with prostate cancer
    May 19, 2025
    Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
    Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
    May 19, 2025
    ‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
    ‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
    May 18, 2025
    The US Treasury just shocked Americans with a 8B surplus — its 2nd biggest monthly surplus in history
    The US Treasury just shocked Americans with a $258B surplus — its 2nd biggest monthly surplus in history
    May 18, 2025
    Fire in India’s Hyderabad kills at least 17 people
    Fire in India’s Hyderabad kills at least 17 people
    May 18, 2025
  • Business
    BusinessShow More
    Ukraine blows up bridges to consolidate its positions in Russia
    Ukraine blows up bridges to consolidate its positions in Russia
    August 18, 2024
    Commentary: AI phones from Google and Apple will erode trust in everything
    Commentary: AI phones from Google and Apple will erode trust in everything
    August 18, 2024
    The most famous Indian Dishes – Insights Success
    The most famous Indian Dishes – Insights Success
    August 18, 2024
    Life on the road as a female long rides cyclist
    Life on the road as a female long rides cyclist
    August 18, 2024
    UK inflation rises to 2.2%
    UK inflation rises to 2.2%
    August 18, 2024
  • Cryptocurrency
    CryptocurrencyShow More
    BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
    BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
    May 19, 2025
    Ethereum back to K in May? Latest rebound says ETH price ‘still has more gas’
    Ethereum back to $3K in May? Latest rebound says ETH price ‘still has more gas’
    May 18, 2025
    ‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
    ‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
    May 18, 2025
    Retired artist loses M in crypto to Coinbase impersonator
    Retired artist loses $2M in crypto to Coinbase impersonator
    May 18, 2025
    BPEP gains steam as Eric Trump eyes cheap BTC to rival Saylor
    BPEP gains steam as Eric Trump eyes cheap BTC to rival Saylor
    May 18, 2025
  • Technology
    TechnologyShow More
    How to Improve Your Spotify Recommendations
    How to Improve Your Spotify Recommendations
    August 18, 2024
    X says it’s closing operations in Brazil
    X says it’s closing operations in Brazil
    August 18, 2024
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    August 18, 2024
    Scientists Want to See Videos of Your Cat for a New Study
    Scientists Want to See Videos of Your Cat for a New Study
    August 18, 2024
    OpenAI’s new voice mode let me talk with my phone, not to it
    OpenAI’s new voice mode let me talk with my phone, not to it
    August 18, 2024
  • Entertainment
  • Sports News
  • People
  • Trend
Reading: Kubernetes at 10: Building stateful app storage and data protection
Share
Font ResizerAa

News Junction

  • World News
  • Business
  • Technology
  • Cryptocurrency
  • Trend
  • Entertainment
Search
  • Recent Headlines in Entertainment, World News, and Cryptocurrency – NewsJunction
  • World News
  • Business
  • Cryptocurrency
  • Technology
  • Entertainment
  • Sports News
  • People
  • Trend
Have an existing account? Sign In
Follow US
News Junction > Blog > Technology > Kubernetes at 10: Building stateful app storage and data protection
Kubernetes at 10: Building stateful app storage and data protection
Technology

Kubernetes at 10: Building stateful app storage and data protection

Published June 26, 2024
Share
8 Min Read
SHARE

Contents
What was the market like when Kubernetes first launched?How did you get involved in storage for Kubernetes?When did you realise that Kubernetes was in the leading position in the market?When you looked at Kubernetes, how did you approach data and storage?What issues first came up around data and storage with Kubernetes for you?What had to change?How did you get involved around Kubernetes operators?What happened around operators that made them a success for data and storage?How did this support more cloud-native approaches? What were the consequences?Kubernetes is now 10. How do you think about it today?What problems still exist around Kubernetes when it comes to data and storage?Any other anecdotes or information to share?

Kubernetes is 10 years’ old. Mid-2024 sees the 10th birthday of the market-leading container orchestration platform.

That decade started as containers emerged as a new way to virtualise applications, but storage and data protection functionality was practically non-existent. Now, Kubernetes offers a mature container platform for cloud-native applications, with all that’s required for the storage of stateful data.

We mark the first decade of Kubernetes with a series of interviews with engineers who helped develop Kubernetes and tackle challenges in storage and data protection – including the use of Kubernetes Operators – as we look forward to a future characterised by artificial intelligence (AI) workloads.

Here, Michelle Au, a software engineer at Google focusing on Kubernetes storage development, talks about getting involved in work such as adding support for snapshots and operators, which add functionality and complexity beyond Kubernetes’ core for advanced services such as in storage and data protection. 

What was the market like when Kubernetes first launched?

Kubernetes was an early incumbent in the space. Containers were just becoming popular and companies were starting to explore the area. There were many alternative workload orchestration projects like Mesosphere, Docker Swarm, Cloud Foundry and Nomad.

How did you get involved in storage for Kubernetes?

In 2017, I joined the Kubernetes team at Google and began working on projects as part of the SIG [special interest group] storage community. Before that, I had only heard about Kubernetes through the grapevine but never actually used it. But I thought it would be a great opportunity to be able to participate in an open source project that was reshaping the industry. 

When did you realise that Kubernetes was in the leading position in the market?

At the beginning that wasn’t the case. But seeing the exponential growth of workloads year after year, and hearing all the success stories, especially with stateful workloads, is something that makes me very proud of what we’ve built. 

When you looked at Kubernetes, how did you approach data and storage?

When I started learning about Kubernetes, the biggest strengths that immediately popped out at me were the declarative API [application programming interface] and reconciliation design paradigm, workload portability across environments, and standardisation of workload deployment best practices. All these strengths of Kubernetes were also goals that guided me when designing Kubernetes storage features. 

What issues first came up around data and storage with Kubernetes for you?

When I joined the team, running stateful workloads were primarily limited to small-scale deployments in the cloud. There were still many friction points in terms of storage ecosystem support as well as scheduling, maintenance and disruption management. Running these workloads successfully required many custom-built processes especially around day two challenges.

One of my first projects was to add support for local storage. While working on that, I realised there was a broader issue of data locality awareness and decided to tackle the problem more broadly by introducing the notion of storage topology to the Kubernetes scheduler. This simplified the process of provisioning stateful workloads to be fault tolerant across failure domains whether you’re running in the cloud or on-premise.

Beyond that, we started moving from day one problems to day two problems. Snapshots support was a major gap in Kubernetes yet is critical to any disaster recovery strategy. 

What had to change?

Implementing snapshots was surprisingly non-trivial. Mapping an imperative operation to a declarative API required multiple rounds of brainstorming, storage vendors had slightly different semantics, and there was also the question of how to handle application consistency. But in the end we were able to reach consensus and deliver this critical capability that further strengthened Kubernetes’ stateful workload readiness. 

How did you get involved around Kubernetes operators?

As part of the Google Kubernetes Engine (GKE) team, I have worked closely with customers and partners that are looking to run operators on our platform. I also joined the Data on Kubernetes community as a representative of the Kubernetes project and GKE to better understand the pain points that users face today and help relay those issues back to the Kubernetes project. 

What happened around operators that made them a success for data and storage?

The advent of Custom Resources really changed the game for operators. It made it possible to develop a Kubernetes-style declarative API for your specific use case. Many stateful workloads have a number of intricate and involved operational processes that cannot be easily abstracted in Kubernetes’ core, such as configuring HA [high availability] and replication, and managing disruption and upgrade processes. Operators are now able to orchestrate this complexity for end-users. 

How did this support more cloud-native approaches? What were the consequences?

Declarative APIs can easily enable GitOps or config-as-code paradigms. Operators for stateful workloads make it easier to automate provisioning, upgrades and other maintenance operations, with the added benefit of being compatible with how organisations manage all their other Kubernetes workloads. 

Kubernetes is now 10. How do you think about it today?

Kubernetes has come a long way from “no way I would run a database on Kubernetes” to “I’m running databases at petabyte scale with automated rolling upgrades”. Kubernetes has become a stable platform to run some of the most demanding workloads, and that has shown as the project has shifted focus from big workload-enabling features to efforts that improve reliability and stability over the past few years. 

What problems still exist around Kubernetes when it comes to data and storage?

Ecosystem discovery is a challenge. There are many vendors in the space, and as an end-user, it’s time-consuming and difficult to evaluate all the options. I think this is where the Data on Kubernetes community can help. They have hosted talks and blogs on a wide variety of stateful workloads that range from introductory to advanced topics.

The growth of AI/ML has also introduced new challenges. AI/ML workloads have very different data patterns and requirements than traditional databases, and typically use object storage and file storage instead of block storage.

Also, multi-cloud or hybrid environments are a reality, which adds additional requirements for cross-environment portability. I have seen our Kubernetes storage abstractions continue to hold up to these new use cases, although I think there is still room for enhancements, especially around data lifecycle and management. 

Any other anecdotes or information to share?

We are always looking for more contributors and participants in Kubernetes SIG-storage as well as Data in Kubernetes. Please join these communities if you are interested in sharing your stories or contributing to the project.

#Kubernetes #Building #stateful #app #storage #data #protection

TAGGED:appbuildingDataKubernetesprotectionstatefulstorage
Share This Article
Facebook Twitter Pinterest Whatsapp Whatsapp LinkedIn Email Copy Link Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Selma Blair Turns Heads With Necktie Made of Blonde Braided Hair Selma Blair Turns Heads With Necktie Made of Blonde Braided Hair
Next Article Another Kansas City romance? Hallmark to make Chiefs-inspired Christmas movie Another Kansas City romance? Hallmark to make Chiefs-inspired Christmas movie
- Advertisement -

Latest Post

Joe Biden diagnosed with prostate cancer
Joe Biden diagnosed with prostate cancer
World News
BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
Cryptocurrency
Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
World News
Ethereum back to K in May? Latest rebound says ETH price ‘still has more gas’
Ethereum back to $3K in May? Latest rebound says ETH price ‘still has more gas’
Cryptocurrency
‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
World News
‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
Cryptocurrency
- Advertisement -

You Might Also Like

Snapchat is expanding further into generative AI with ‘Dreams’
Technology

Snapchat is expanding further into generative AI with ‘Dreams’

August 21, 2023
Data on Russian prisoners disappears from US database
World News

Data on Russian prisoners disappears from US database

August 1, 2024
Farcaster hype grows, Bluesky opens to the public and SEC’s Hester Peirce is open to new token proposals
Technology

Farcaster hype grows, Bluesky opens to the public and SEC’s Hester Peirce is open to new token proposals

February 9, 2024
This article is real — but AI-generated deepfakes look damn close and are scamming people
Technology

This article is real — but AI-generated deepfakes look damn close and are scamming people

February 8, 2024

About Us

NEWS JUNCTION (NewsJunction.xyz) Your trusted destination for global news. Stay informed with our timely and accurate reporting on diverse topics, including politics, technology, science, entertainment, sports, and more. Count on us for unbiased and reliable updates at your fingertips.

Quick Link

  • About
  • Disclaimer
  • Privacy Policy
  • Terms of Use
  • Contact

Top Categories

  • World News
  • Business
  • Technology
  • Entertainment
  • Cryptocurrency
  • Sports News
  • Trend
  • People

Subscribe

Subscribe to our newsletter to get our newest articles instantly!

    © 2023 News Junction.
    • Blog
    • Advertise
    • Contact
    Welcome Back!

    Sign in to your account

    Username or Email Address
    Password

    Lost your password?