By using this site, you agree to the Privacy Policy and Terms of Use.
Accept

News Junction

Notification Show More
Font ResizerAa
  • Home
  • World News
    World NewsShow More
    Pro-EU candidate wins Romanian presidential election rerun — RT World News
    Pro-EU candidate wins Romanian presidential election rerun — RT World News
    May 19, 2025
    Joe Biden diagnosed with prostate cancer
    Joe Biden diagnosed with prostate cancer
    May 19, 2025
    Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
    Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
    May 19, 2025
    ‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
    ‘Final Destination: Bloodlines’ tops box office while The Weeknd’s movie falters
    May 18, 2025
    The US Treasury just shocked Americans with a 8B surplus — its 2nd biggest monthly surplus in history
    The US Treasury just shocked Americans with a $258B surplus — its 2nd biggest monthly surplus in history
    May 18, 2025
  • Business
    BusinessShow More
    Ukraine blows up bridges to consolidate its positions in Russia
    Ukraine blows up bridges to consolidate its positions in Russia
    August 18, 2024
    Commentary: AI phones from Google and Apple will erode trust in everything
    Commentary: AI phones from Google and Apple will erode trust in everything
    August 18, 2024
    The most famous Indian Dishes – Insights Success
    The most famous Indian Dishes – Insights Success
    August 18, 2024
    Life on the road as a female long rides cyclist
    Life on the road as a female long rides cyclist
    August 18, 2024
    UK inflation rises to 2.2%
    UK inflation rises to 2.2%
    August 18, 2024
  • Cryptocurrency
    CryptocurrencyShow More
    New Zealand Man Arrested In 5 Million Crypto Scam Probe
    New Zealand Man Arrested In $265 Million Crypto Scam Probe
    May 19, 2025
    BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
    BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
    May 19, 2025
    Ethereum back to K in May? Latest rebound says ETH price ‘still has more gas’
    Ethereum back to $3K in May? Latest rebound says ETH price ‘still has more gas’
    May 18, 2025
    ‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
    ‘Bitcoin Standard’ author backs funding dev to make spamming Bitcoin costly
    May 18, 2025
    Retired artist loses M in crypto to Coinbase impersonator
    Retired artist loses $2M in crypto to Coinbase impersonator
    May 18, 2025
  • Technology
    TechnologyShow More
    How to Improve Your Spotify Recommendations
    How to Improve Your Spotify Recommendations
    August 18, 2024
    X says it’s closing operations in Brazil
    X says it’s closing operations in Brazil
    August 18, 2024
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    August 18, 2024
    Scientists Want to See Videos of Your Cat for a New Study
    Scientists Want to See Videos of Your Cat for a New Study
    August 18, 2024
    OpenAI’s new voice mode let me talk with my phone, not to it
    OpenAI’s new voice mode let me talk with my phone, not to it
    August 18, 2024
  • Entertainment
  • Sports News
  • People
  • Trend
Reading: Riding the cloud database wave
Share
Font ResizerAa

News Junction

  • World News
  • Business
  • Technology
  • Cryptocurrency
  • Trend
  • Entertainment
Search
  • Recent Headlines in Entertainment, World News, and Cryptocurrency – NewsJunction
  • World News
  • Business
  • Cryptocurrency
  • Technology
  • Entertainment
  • Sports News
  • People
  • Trend
Have an existing account? Sign In
Follow US
News Junction > Blog > Technology > Riding the cloud database wave
Riding the cloud database wave
Technology

Riding the cloud database wave

Published July 22, 2024
Share
10 Min Read
SHARE

Contents
The hybrid approachData integrationInteroperabilityData qualitySetting the scene for AI

It would seem that the adoption of cloud databases – those delivered via a cloud consumption model – is ramping up.

Referred to as dbPaaS (database platform as a service) by analyst Gartner, the market for cloud databases is dominated by public cloud providers. Amazon Web Services (AWS), Microsoft, Google, Oracle and Alibaba are among the leaders identified by the analyst firm in its Magic quadrant for cloud database management systems, published in December 2023. Broadly speaking, these providers offer a range of data management capabilities. Other leaders identified by Gartner include MongoDB, which specialises in non-relational database technology, and Snowflake and Databricks, which focus on data warehouses and data lakes.

According to Gartner’s August 2023 Forecast analysis: Database management systems, worldwide, the market for database management systems (DBMS) is set to grow at a compound annual growth rate of 16.8% through 2027 to reach $203.6bn, accounting for 27% of the total infrastructure software market spend in 2027. The forecast shows that the percentage of spending on cloud dbPaaS will grow from 55% of the total DBMS market in 2022 to 73.5% by 2027.

According to Gartner, the transition of DBMS software purchasing – moving from legacy, centralised IT groups to decentralised lines of business within an enterprise – is driving this increase in DBMS spending. Traditionally, with centralised IT services, different areas of a business shared a DBMS. Gartner notes that they now have been given the freedom to choose their DBMS based on their own unit’s criteria and then build their own databases rather than using shared systems.

However, Forrester vice-president and principal analyst Noel Yuhanna warns that some cloud databases are built on proprietary technology, which makes it challenging to migrate to other databases. There is also a lack of visibility in cost. “Without monitoring and management, excessive usage of the infrastructure can lead to unexpected costs,” he says. Yuhanna recommends IT decision-makers consider the ability to customise cloud databases compared with on-premise databases, since some impose customisation constraints.

The hybrid approach

There are instances where IT decision-makers will look at options to ringfence their public cloud database platform in a specific region. However, there will clearly be use cases where – perhaps to comply with regional data and privacy regulations – data stores and databases need to be deployed on-premise.

Hyperconverged infrastructure providers such as Nutanix, for instance, offer pay-per-use database-as-a-service offerings, which give IT decision-makers automation tools for database management and the ability to deploy across hybrid IT environments, including public and private clouds.

Certain use cases require a combination of on-premise and public cloud databases. For instance, MongoDB recently put into preview its Atlas Edge Server, which gives developers the capability to deploy and operate distributed applications in the cloud and at the edge. Atlas Edge Server provides a local instance of MongoDB with a synchronisation server that runs on local or remote infrastructure. According to MongoDB, this significantly reduces the complexity and risk involved in managing applications in edge environments.

Data integration

Among the terms often used when looking at an enterprise data architecture is the data pipeline. Teams responsible for data need to provide a way to ingest data from corporate IT systems that may be in silos, including databases and enterprise applications. This data ingestion process often involves complex and fragile data connectors, which can sometimes fail, leading to operational disruptions.

An example of what dbPaaS providers are offering is Databricks’ recently introduced LakeFlow tool, which automates the deployment, operation and monitoring of pipelines at scale in production with built-in support for continuous integration/delivery (CI/CD) and advanced workflows that support triggering, branching and conditional execution. 

The data connectivity part of LakeFlow, called Connect, supports MySQL, Postgres, SQL Server and Oracle, as well as enterprise applications such as Salesforce, Dynamics, SharePoint, Workday and NetSuite.

The extract, translate and load (ETL) component of Databricks’ LakeFlow tool offers what the company claims is a real-time mode for low-latency streaming without any code changes. The final part of the tool offers automated orchestration, data health and delivery. According to Databricks, it provides enhanced control flow capabilities and full observability to help detect, diagnose and mitigate data issues for increased pipeline reliability.

Interoperability

By its very nature, a dbPaaS is deployed on top of a public cloud platform, which means IT buyers risk being locked into whatever their public cloud provider chooses to do.

Snowflake’s recent announcement to make its Polaris Catalog open source is an attempt to provide greater platform interoperability with the Apache Iceberg table format.

Originally developed by Netflix, Iceberg is described as a table format for large, slow-moving tabular data. It provides metadata describing database tables. One benefit is that it offers a standard way for enterprises to run analytics across multiple data lakes.

At its annual user conference in June 2024, Snowflake said it would provide enterprises and the entire Iceberg community with new levels of choice, flexibility and control over their data, with full enterprise security and Apache Iceberg interoperability with AWS, Confluent, Dremio, Google Cloud, Microsoft Azure and Salesforce, among others.

At the time, Christian Kleinerman, executive vice-president of product at Snowflake, said: “Organisations want open storage and interoperable query engines without lock-in. Now, with the support of industry leaders, we are further simplifying how any organisation can easily access their data across diverse systems with increased flexibility and control.”

Snowflake’s goal is to offer the Apache Iceberg community a way to harness their data through an open and neutral approach, which, according to Kleinerman, offers “cross-engine interoperability on that data”.

Data quality

A key area that can hold back enterprise IT projects is the quality of data. In a recent blog, Stephen Catanzano, senior analyst of data platforms at Enterprise Strategy Group, points to research conducted by the analyst firm that shows 79% of organisations recognise the need to use artificial intelligence (AI) in mission-critical processes to better compete, but 62% of line-of-business stakeholders only somewhat trust their organisation’s data.

“This disparity between needing AI and trusting data needs to close quickly. We found that most organisations are heavily focused on data quality as part of data governance to gain trust and to deliver decision-making-ready data to decision-empowered employees,” writes Catanzano.

The blog discusses Informatica’s Cloud Data Access Management (CDAM) product, which, according to Catanzano, represents a path towards helping organisations achieve their goals in terms of data quality and governance. “With data becoming increasingly pivotal in driving business outcomes, it has become imperative for organisations to have robust governance mechanisms in place,” he writes.  

When CDAM was announced, Brett Roscoe, senior vice-president and general manager of data governance at Informatica, blogged that the product provides AI-powered data governance, which enables organisations to deploy analytics and AI with automated, policy-based security and privacy controls driven by metadata intelligence. 

Setting the scene for AI

Assuming Gartner’s forecast is a fair indication of where the database market is heading, it would seem that central IT control of enterprise databases is being replaced by each business unit choosing the most appropriate database to meet their specific requirements. The fact that cloud databases tend to be easier to deploy and potentially offer a lower total cost of ownership makes them attractive to IT buyers.

As Forrester’s Yuhanna points out, they also offer IT leaders a way to streamline IT operations and a quicker way to deploy database applications. He adds: “There is a significant correlation between the adoption of cloud-based DBMS and the rate of AI adoption.” 

#Riding #cloud #database #wave

TAGGED:Clouddatabaseridingwave
Share This Article
Facebook Twitter Pinterest Whatsapp Whatsapp LinkedIn Email Copy Link Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Philippines ‘to assert our rights’ after China sea deal Philippines ‘to assert our rights’ after China sea deal
Next Article Portugal plans to raise share of renewables in electricity consumption to 93% by 2030 Portugal plans to raise share of renewables in electricity consumption to 93% by 2030
- Advertisement -

Latest Post

Pro-EU candidate wins Romanian presidential election rerun — RT World News
Pro-EU candidate wins Romanian presidential election rerun — RT World News
World News
New Zealand Man Arrested In 5 Million Crypto Scam Probe
New Zealand Man Arrested In $265 Million Crypto Scam Probe
Cryptocurrency
Joe Biden diagnosed with prostate cancer
Joe Biden diagnosed with prostate cancer
World News
BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
BTC Nears Bullish Golden Cross as Moody’s Downgrades U.S., Citing Debt Concerns
Cryptocurrency
Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
Mark Carney meets Pope Leo XIV after inaugural mass at the Vatican – National
World News
Ethereum back to K in May? Latest rebound says ETH price ‘still has more gas’
Ethereum back to $3K in May? Latest rebound says ETH price ‘still has more gas’
Cryptocurrency
- Advertisement -

You Might Also Like

Discord will now let you stream Xbox gameplay directly to servers and DMs
Technology

Discord will now let you stream Xbox gameplay directly to servers and DMs

August 2, 2023
Scalability and Flexibility: Public Cloud vs Private Cloud – Insights Success
Business

Scalability and Flexibility: Public Cloud vs Private Cloud – Insights Success

July 28, 2023
Scotland and Ireland rock formation dating back ‘hundreds of millions of years’ shows historic global freeze, study says | Science & Tech News
Technology

Scotland and Ireland rock formation dating back ‘hundreds of millions of years’ shows historic global freeze, study says | Science & Tech News

August 16, 2024
DEI backlash: Stay up-to-date on the latest legal and corporate challenges
Technology

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

February 10, 2024

About Us

NEWS JUNCTION (NewsJunction.xyz) Your trusted destination for global news. Stay informed with our timely and accurate reporting on diverse topics, including politics, technology, science, entertainment, sports, and more. Count on us for unbiased and reliable updates at your fingertips.

Quick Link

  • About
  • Disclaimer
  • Privacy Policy
  • Terms of Use
  • Contact

Top Categories

  • World News
  • Business
  • Technology
  • Entertainment
  • Cryptocurrency
  • Sports News
  • Trend
  • People

Subscribe

Subscribe to our newsletter to get our newest articles instantly!

    © 2023 News Junction.
    • Blog
    • Advertise
    • Contact
    Welcome Back!

    Sign in to your account

    Username or Email Address
    Password

    Lost your password?