|
“The Performance Evaluation Action for Typical Server Application Scenarios” has been launched!——
To standardize the construction of a full-stack standard system, promote product technology iteration and upgrade, better showcase the advantages of the entire architecture and computing power, and support excellent product and solution brands in enhancing and expanding the market through authoritative certification released by the official body. The Green Computing Industry Alliance’s “Performance Evaluation Action for Typical Server Application Scenarios” (abbreviated as: Evaluation Action) was officially launched recently.
This evaluation action includes big data, distributed storage, web applications, high-performance computing, centralized relational database management systems, ARM native cloud phones, and virtualization as the seven typical server application scenarios.
|
Today, we bring you a detailed interpretation of the “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”.
The drafting units for the “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone” include the China Electronics Standardization Institute, Huawei Technologies Co., Ltd., Phytium Information Technology Co., Ltd., Changsha Mozhi Cloud Computing Technology Co., Ltd., Jiangsu Beigong Intelligent Technology Co., Ltd., Arm Technology (China) Co., Ltd., and Anshengpei Semiconductor Technology Co., Ltd. We thank the above units for their strong support.
We welcome you to continue following the series of articles on “Performance Testing Methods for Server Application Scenarios”. In the future, we will bring you a series of exhibitions for products/solutions evaluated through the “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”!
1. Background of the “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”
In recent years, China’s economic development has shifted from being industry-led to service-led, gradually changing people’s consumption patterns. With the booming development of cloud computing-related industries, the elastic demand for mobile devices has driven the emerging concept of cloud phones, which apply cloud computing technology to network terminal services, achieving mobile services through cloud servers. Essentially, it is a smartphone deeply integrated with network services. These smartphones can perform numerous functions via the internet, categorized by business scenarios: interactive entertainment, mobile office, online education, terminal companion, and APP hosting. ARM native cloud phones typically refer to simulated phones running on ARM architecture server data centers, operated and sold to end users by cloud phone service providers, allowing users to access cloud phones via the internet.
ARM native cloud phones are an emerging industry, and the current available testing methods and tools include open-source testing frameworks, testing tools, etc. These include CTS (Google’s official Android Compatibility Test Suite), dEQP (drawElements Quality Program (deqp) GPU test suite), Potplayer (third-party app), GFXBench (mobile graphics performance testing tool), and Perfdog (mobile all-platform performance testing analysis tool), which conduct comprehensive testing against cloud phone testing standards.
2. Testing Methods for “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”
This testing is primarily based on the server ARM native cloud phone scenario testing standards, covering functional testing, performance testing, compatibility testing, and experiential testing. The test network setup is shown in the figure below, with the infrastructure being ARM servers, virtualizing basic cloud phones in the underlying data center, deploying instruction stream engines/video stream engines on top of the basic cloud phones, forming the server for instruction stream/video stream cloud phones; simultaneously, users need to deploy instruction stream/video stream cloud phone client APPs on the terminal mobile phones, connect to the internet after deployment, and access the cloud phone. Subsequently, relevant testing tools are used on the server/cloud phone for single-instance/cluster testing.
ARM native cloud phone test network diagram
The test standard environment configuration is as follows:
Test cases refer to standard texts.
3. Test Results for “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”
|
Experimental Environment and Results
The evaluation action is undertaken by the China Electronics Standardization Institute, and the alliance collaborates with the China Electronics Standardization Institute to create the open laboratory “GCC Open Lab”. Registered units can apply for a professional typical application scenario software and hardware compatibility testing environment from the China Electronics Standardization Institute or set up their own testing environment, with experts arranged by the institute for remote guidance and review to ensure authoritative processes and results.
|
All test data or functional implementation results in this report originate from the joint laboratory of the Green Computing Industry Alliance, providing objective and fair testing data while striving to maintain the same test environment.
Table 1 Performance Testing Results
Table 2 Experiential Testing Results:
4. Summary and Outlook of “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”
From the test results of the ARM native cloud phone, it can be seen that the green computing servers based on Arm architecture are highly competitive compared to traditional architectures. In terms of overall solutions, green computing servers combined with commercial software solutions showed significant advantages over traditional architecture servers combined with open-source software solutions in this evaluation, fully meeting the performance needs of applications across various industries.
In the future, the Green Computing Industry Alliance will continue to promote the joint optimization of underlying server hardware and upper-layer application software through typical computing business scenario performance evaluations, highlighting the overall competitiveness of full-stack solutions. Additionally, the alliance will collect more industry requirements from its members, incorporate more typical server application scenarios (such as edge computing), and more green computing server configurations, making typical application scenario evaluations the core competitiveness of the Green Computing Industry Alliance.
Moreover, the alliance will conduct evaluations and research on green computing servers from more dimensions, such as artificial intelligence servers, green energy-saving (power management), etc. The alliance will also study the system and mechanism for advancing the implementation of alliance standards through evaluation certification, conducting preliminary research on the latest technology standards in green computing and upgrading testing environments to lay the foundation for subsequent compliance testing certification services.
The Green Computing Industry Alliance will continue to promote certification activities for green computing technology products, services, and management, enhancing the compliance, compatibility, and quality consistency of products and services, promoting interoperability of products, and building trust across the entire industry chain. The alliance is committed to ensuring that end users and relevant parties rely on certification results based on alliance standards, fully reflecting the value of standards and achieving their practical implementation!
Click the “Read Original” button below to visit the alliance’s official website and download the original text of “Performance Testing Methods for Server Application Scenarios: Arm Native Cloud Phone”.
About the Green Computing Industry AllianceSince its establishment in 2016, the Green Computing Industry Alliance aims to collaboratively build a green, open, independent, and shared ecological system, dedicated to promoting the development of the green computing industry and establishing a platform for industry exchange and cooperation to enhance enterprises in areas such as PCs, servers, storage, operating systems, and databases, promoting win-win cooperation in the computing field. It has now become a global alliance with the most complete partners in Arm infrastructure server chips, including Kunpeng, Phytium, Ampere, Marvell, and others.
