How MogDB Accelerates Self-Evolution and Application in Database Innovation

The database, which occupies a core position in IT architecture, is an important hub connecting upper-layer applications and underlying resources, akin to the “memory system” of a person, used for storing and retrieving data. Its importance is self-evident. It can be said that the database is one of the three cores in the modern information technology field, alongside chips and operating systems, and is the “crown jewel” of foundational software, while also serving as an important guarantee for the secure and stable operation of information systems.

In recent years, domestic databases have shown a trend of accelerated growth. Taking the openGauss series of databases as an example, Frost & Sullivan’s “Key Industry Database Application Research Report” indicates that in 2023, the market share of offline centralized openGauss databases in China’s database market reached 21.9%, and it has been widely applied in ten key industries including finance, government, and telecommunications. Among them, the MogDB database launched by Yunhe Enmo based on the openGauss kernel is continuously evolving while maintaining commercial deployment in industries such as finance.

Accelerating Independent Innovation in Financial Industry Databases

The current software upgrades and digital transformation in the financial market have entered a critical period. According to the “2022-2023 Annual Report on China’s Platform Software Market” released by the Software and Information Service Industry Research Center of the Ministry of Industry and Information Technology, the financial industry is expected to surpass telecommunications and the internet to become the fastest-growing and largest application market for platform software.

As a key software infrastructure for China’s financial information systems, domestic databases are not only actively supporting the digitalization and high-quality development of the financial industry but are also ushering in new developments. According to the “Database Development Research Report (2023)”, China has entered the first tier of the global database industry, accounting for 7.2% of the global market size.

In my view, for domestic databases to develop, they need to address the urgent needs of the financial industry’s upgrade and transformation while also coping with fierce competition in the local database market. To stand out, it is essential to gain a deep understanding of the financial industry’s requirements for databases, and to optimize databases in response to new changes in the financial sector such as internet-based services, mobile payment scenarios, universal service, and massive transactions.

In financial scenarios, upgrading and transforming databases must face the pressure from the coexistence of dynamic and stable demands: First, the rapidly developing internet finance business places significant pressure on IT systems in terms of performance, elasticity, and cost, and the pace of digital upgrades is accelerating, necessitating that database upgrades keep pace with business development; second, under the trends of information technology and application innovation, businesses require IT architectures that are high-performance, highly secure, easily scalable, and manageable; third, the requirements for business continuity are becoming increasingly stringent, and system upgrades must also proceed steadily.

Overall, in the selection process for database upgrades, databases need to meet higher requirements such as strong data consistency, extremely high availability, elastic scalability, and smooth upgrades. At the recently held openGauss Summit 2023, Luo Haixiong, a research architect from Yunhe Enmo’s customer success department, stated: “To meet the diverse needs of customers for dynamic and stable businesses, we need to fully consider and meet the future business development needs of clients from PoC to architecture design, data migration, application adaptation, and finally to system launch, helping customers achieve smoother database migration and launch.”

How MogDB Accelerates Self-Evolution and Application in Database Innovation

Luo Haixiong, a research architect from Yunhe Enmo’s customer success department, delivered a speech.

What Are the Core Points for Smooth Database Migration?

Taking the service for a futures exchange as an example, Yunhe Enmo divides the entire service process into PoC, architecture design, data migration and application adaptation, and system launch. Regarding the entire process, Luo Haixiong stated: “Yunhe Enmo has complete tools, a professional expert team, and proven solutions throughout the process, which can maximally support users’ business systems for smooth database migration and security assurance.”

Among them, PoC is the beginning and a crucial step of the entire service, primarily focused on matching customer needs and demonstrating product advantages. “In the PoC phase, our biggest challenge is how to showcase the qualities that customers need from the product,” Luo Haixiong said. This requires understanding customer requirements in terms of business continuity and strong data consistency, while also considering performance aspects such as high concurrency and low latency, and achieving source database compatibility and smooth migration.

In Luo Haixiong’s view, understanding customer needs is only the first step of PoC, and subsequent testing and verification stages are also required. Functionally, consistency ACID testing, high availability testing, and backup disaster recovery testing need to be conducted; performance-wise, TPCC stress testing, simple SQL testing, and complex SQL business testing are necessary; and adaptation testing involves table structure and migration testing, syntax compatibility testing, and SQL rewriting testing. Luo Haixiong stated: “Unlike other databases, MogDB also showcases proprietary features such as observability, automatic installation tools, and automated operations and maintenance.”

System architecture design is also a crucial step, where it is necessary to meet business architecture design requirements such as two-site three-center, fully domestic architecture, as well as operational and monitoring architecture design. Yunhe Enmo provides the zCloud database cloud management platform, achieving unified management of diverse mixed databases. Luo Haixiong stated: “The greatest capability of zCloud is heterogeneous compatibility, supporting Oracle, DB2, openGauss, MogDB, and Dameng databases, whether commercial, open-source, or domestic, enabling unified resource scheduling and management, as well as on-demand allocation.”

Luo Haixiong believes that the adaptation and migration stages following system architecture design also require significant effort. He stated: “Independent innovation migration is not merely about data relocation; in addition to ensuring data consistency, equivalent business functionality, and minimal downtime, it is more crucial to focus on compatibility transformation and performance assurance, thereby achieving a complete solution, reliable migration, appropriate transformation, thorough testing, controllable timelines, and stable operations.” In the data migration phase, the migration tools provided by Yunhe Enmo can ensure structural synchronization and data synchronization, achieving effects such as 1TB data migration per hour and automatic consistency verification.

What Value Does the MogDB Cube All-in-One Machine Bring with Technical Innovation?

When serving industries such as finance, Yunhe Enmo not only demonstrates strong service capabilities and complete processes but also has commendable iterative capabilities in technology research and development, products, or solutions. From the practical applications of Yunhe Enmo in the financial industry, we can see that MogDB exhibits high reliability, high performance, high usability, and high compatibility in assisting customers with independent innovation practices.

Of course, aside from the challenges faced by databases in migrating and replacing in various industries, we have also found that with the expansion of business and the surge in data volume, single-machine capabilities cannot withstand the pressure brought by business growth. At this time, the database field presents two technological evolution directions: Share-nothing distributed architecture and Share-everything resource pooling architecture. So, which solution should enterprises choose as a replacement for domestic databases?

According to Zhang Chengwei, a partner in data technology at Yunhe Enmo, considering reliability, performance, cost, and operations, the Shared-everything resource pooling architecture is more suitable for the current replacement scenarios for domestic databases. In response to the demand for domestic database replacement, Yunhe Enmo has been contemplating how to transform its insights and understanding of the industry, as well as user needs, into product strength. To this end, Yunhe Enmo has launched the MogDB database all-in-one machine – MogDB Cube.

Zhang Chengwei, a partner in data technology at Yunhe Enmo, delivered a speech.

Simply put, MogDB Cube is based on the performance computing power of Kunpeng multi-core processors, combined with the enterprise-level database MogDB, and utilizes Yunhe Enmo’s proprietary distributed storage software zStorage at the underlying level. zStorage achieves an average single-node performance of 500,000 IOPS under Kunpeng servers while maintaining an average latency of 0.8 milliseconds, and can reconstruct 1TB of data every 15 minutes in the event of disk failure. This meets users’ needs for high concurrency, high performance, and simplified operations in the process of digital transformation and upgrades.

For database scenario optimization, MogDB Cube’s storage layer implements 8K atomic writes, ensuring write atomicity and eliminating the double write cost of databases; it also includes multi-path asynchronous writes of xlog logs to ensure no gaps and ordered returns, improving transaction submission performance while ensuring data consistency. Zhang Chengwei stated: “Prioritizing the IO of xlog logs enables stable transaction submission performance even under overloaded conditions; at the same time, rapid cloning technology based on distributed storage allows for quick cloning of the entire database cluster.”

The resource pooling architecture is the biggest highlight of the latest version of MogDB. Memory pooling technology integrates the memory of different nodes into a globally consistent distributed cache through distributed locks, avoiding the replication of xlog logs between primary and standby nodes, reducing the RTO time for primary-standby switching to less than 10 seconds, while also enabling standby machines to provide real-time consistency read capabilities, helping businesses sensitive to data consistency expand from single nodes to clusters. Storage pooling technology provides multiple database nodes with consistent access to shared storage through a distributed file system, allowing primary and standby nodes in the database cluster to share access to the same data, reducing storage costs by over 50%. “When enterprises need to expand database nodes to improve performance, they no longer need to build full data on new nodes; they can directly mount and access the same data on shared storage, achieving minute-level standby machine expansion,” Zhang Chengwei elaborated.

Additionally, MogDB Cube has also optimized performance for large-capacity mixed loads. Through read-write separation and automatic load balancing of read-only business to multiple standby nodes, low-conflict scenarios can achieve a linearity of up to 70%, while under a one-primary two-standby architecture, multi-machine parallel queries can improve TPC-H total performance by 150%.

At the same time, MogDB Cube incorporates the graphical management capabilities of Yunhe Enmo’s database cloud management platform zCloud, along with automated and intelligent operational capabilities, providing an out-of-the-box integrated delivery format, saving users 80% of deployment time.

Zhang Chengwei introduced that in a co-creation plan with a customer, the customer deployed a set of MogDB Cube in both the production center and the disaster recovery center, adopting a “2+3” architecture, consisting of two database nodes and three storage nodes, thus forming the MogDB Cube resource pooling architecture. Additionally, the customer also employed xlog log synchronous replication in both the production center and disaster recovery center to ensure disaster recovery level requirements are met.

In summary, the MogDB Cube all-in-one machine product is particularly suitable for core business scenarios sensitive to RTO, and has made extensive performance optimizations for large data volume mixed load scenarios (TP and AP), effectively reducing construction costs and operational investments.

Final Thoughts

Today, as the country raises its requirements for information security and independent control, the domestic database market is gradually rising and entering a stage of rapid development.

Yang Xiaocheng, partner and managing director of Sullivan Consulting, once stated that since the national “14th Five-Year Plan” proposed vigorously developing databases, the database industry in China has seen vigorous growth. From the perspective of market share, the domestic database ratio was about 35% in 2019, and by the end of 2022, the domestic ratio had approached 50%, which is a very encouraging achievement.

Entering a stage of rapid development also requires domestic database vendors to continue to make efforts. On one hand, they need to strengthen technological research and development to overcome challenges in technical breakthroughs, industrial ecosystem optimization, and application collaboration; on the other hand, they need to strengthen industry practice, starting from the scenario needs of various industries to accumulate practical experience, thereby promoting the prosperity and development of the domestic database industry.

We have noted that in terms of independent innovation, embracing the open-source ecosystem, and promoting the implementation of industry applications, Yunhe Enmo is also conducting its own practices and is committed to empowering the digital upgrade and transformation of various industries through database foundational software and management software. We look forward to Yunhe Enmo’s self-evolution and wide application of MogDB in the future, which will drive innovation and development in China’s database technology and create more value for users.

Related posts

Leave a Comment Cancel reply