MariaDB MariaDB handles 25 billion queries per hour!

BoostN · Mar 9, 2018

I work as developer on the ServiceNow platform. Most of you probably have no idea what it is, but it's basically a giant ticketing system that over the past 5 years as spread to an entire automation platform. It was interesting to see this article. Since it's a SaaS product, my company doesn't touch the hardware/backend to the system as it's all in the cloud!

How ServiceNow deploys MariaDB to handle 25 billion queries per hour

Anyone running MariaDB to that capacity here?

eva2000 · Mar 9, 2018

Thanks for sharing @BoostN that's some MySQL query load there !

They're running MariaDB TX Enterprise Edition it seems but doesn't mention if it's MariaDB 10.1 or 10.2 based ? I assume MariaDB 10.2 ?

The IT service desk software-as-a-service (SaaS) vendor is specifically running MariaDB TX, which is the enterprise version of its open source database, packaging up a range of tools and services for managing, backing up and monitoring core MariaDB technology, and is paid for on a subscription basis.

ServiceNow runs MariaDB at a pretty unprecedented scale: nearly 85,000 databases globally to be exact. That's 84,876 instances of MariaDB, running 176,686,129 InnoDB tables and processing those 25 billion queries per hour.

Previously it was running on an open source version of MySQL, but started to push it to its limits three years ago. Fortunately moving to MariaDB was a "drop-in replacement," said Tim Yim, director of operations at ServiceNow, using the open source vendor's favoured phrase when it comes to moving customers off of its Oracle-owned rival.
Click to expand...

That is some scaling ! Even if it's 25 billion queries/hr divide by 84,876 MariaDB server instances = 294,547 queries/hr per MariaDB server instance

MariaDB TX Introducing MariaDB TX 2.0: Born of the Community. Raised in the Enterprise. | MariaDB

Looks like MariaDB TX bundles MariaDB 10.2 + MariaDB MaxScale

MariaDB TX is a single offering for MariaDB Server, MariaDB MaxScale, database connectors, services and tools. The MariaDB TX 2.0 package includes the newly released MariaDB Server 10.2 and MariaDB MaxScale 2.1. MariaDB TX is part of a larger effort by MariaDB to offer complete solutions to support specific workload needs, whether transactional, analytical or developer focused. The company has also delivered a new package for large-scale analytics, MariaDB AX, an easy, fast, scalable and open source data warehousing solution.
Click to expand...

New Features Make MariaDB TX 2.0 the Most Feature-Rich Open Source Database

MariaDB TX 2.0 adds new database features that increase agility, scalability and security to support the broadest range of new and existing use cases. MariaDB TX 2.0 key new features include:

JSON Support to Enable Broader Use Cases: JSON is the emerging standard for developers building web, mobile and IoT applications. However, NoSQL databases built to support JSON are too functionally limited to support the majority of enterprise use cases. Meanwhile, relational databases have been slow to provide complete JSON support. MariaDB TX 2.0 adds a comprehensive set of 24 JSON functions, enabling the increased flexibility and speed that comes with using JSON, with the reliability and security that comes with using a relational database.

Data Masking and Result Set Limiting for Enhanced Security: The proliferation of ever more sophisticated cyber threats demands ongoing investment in database security. Historically, open source vendors have fallen short of delivering solutions that provide robust, enterprise-grade security. MariaDB TX 2.0 adds new security enhancements previously only available in proprietary offerings. MariaDB data masking is a new feature which masks sensitive data before returning query results, protecting data that is classified as personal identifiable, personal sensitive or commercially sensitive data, common requirements for HIPAA/PCI compliance. Newly introduced result set limiting prevents Denial of Service attacks by specifying a maximum number or rows or data that can be returned in a query, prepared statement or stored procedure to prevent service interruptions.

MyRocks for Better Performance and Scale-out Capabilities: Developers are increasingly tasked with building applications that can scale to meet web demand. Scalability and performance are central to any web, mobile or IoT application. MariaDB TX 2.0 introduces alpha support for Facebook’s MyRocks, a transactional storage engine optimized for flash storage. Applications built on MariaDB TX 2.0 can utilize MyRocks for 2x better compression, faster replication and data loading.

SQL Compatibility with Common Table Expressions and Window Functions: MariaDB TX 2.0 adds several new features that enhance query functionality, including common table expressions and window functions. Common table expressions make complex queries easier to read and easier to maintain by breaking queries down into simpler building blocks. Window functions eliminate expensive subqueries and self-joins, making queries easier to read and improving overall query performance.

Click to expand...

Log in / Register

Forums

Join the community today

MariaDB MariaDB handles 25 billion queries per hour!

BoostN Active Member

eva2000 Administrator Staff Member

.

Log in / Register

Useful Searches

Join the community today

MariaDB MariaDB handles 25 billion queries per hour!

BoostN Active Member

eva2000 Administrator Staff Member

.