Innovative IoT-Based Remote Music Teaching Platform

As we all know, in traditional keyboard instrument teaching, the teaching location cannot overcome the constraints of distance, and the performance information cannot be effectively stored, leading to a lack of effective guidance outside of class, which causes students to gradually lose their motivation to learn. In today’s information age, IoT, cloud, and other related technologies have made great progress—everything is interconnected. Therefore, we envision that by organically combining traditional instrument teaching with new IoT technologies, we can establish a remote instrument teaching platform that will undoubtedly bring about tremendous changes in instrument teaching.

Mr.Piano is a product that features remote teaching and auxiliary practice capabilities, and it is also a work that combines traditional keyboard instrument teaching with IoT technology. It allows keyboard instrument teaching to break free from the constraints of distance, achieving the goal of real-time remote teaching, thereby changing the current mode of keyboard instrument teaching.

Mr.Piano consists of a student side and a teacher side, both of which can transmit their key information or obtain each other’s key information to achieve real-time teaching effects. In this design, both students and teachers can transmit key information to the cloud server for sharing, thus achieving various remote teaching modes such as one-on-one and one-to-many.

The implementation method for Mr.Piano is roughly as follows: first, the FPGA collects the keyboard playing information for preliminary encoding, then, after serial port processing, sends it to the BeagleBone Black. After receiving the data, the BeagleBone Black processes and packages the data before sending it to the local display device and the cloud server. Meanwhile, at the receiving end,

the BeagleBone Black receives data from the cloud server and sends it to the FPGA, which decodes the information and reproduces the playing information from the other end, thus achieving the sharing of performance information between teachers and students.

This product mainly consists of a student side and a teacher side

The software part of this design includes three modes: teaching mode, practice mode, and game mode

Mr.Piano not only achieves real-time teaching functionality but also captures playing information, allowing data mining and related technologies to be applied to teaching. By analyzing and processing the performance information of teachers or students and designing relevant algorithms, teachers can evaluate and summarize the quality of students’ performances, thereby better identifying student issues for timely correction.

The launch of Mr.Piano proposes a brand-new electronic keyboard teaching model, combining IoT technology with traditional instrument teaching, bringing about significant changes to existing instrument learning;

At the same time, since the key signals are stored in the cloud server, data mining technologies can be introduced into traditional instrument teaching, helping students with targeted learning;

Additionally, based on Mr.Piano’s information sharing capabilities, rich interactive elements can be added to instrument teaching, making learning enjoyable.

Team Introduction and Outlook – What Expectations Do You Have?

Members of the Hit Elites team are all from the School of Electronics and Information Engineering at Harbin Institute of Technology. The four-member team has extensive competition experience and is also familiar with TI development boards. In their usual designs, they often involve the use of CC3200 and MSP430. In this competition, the team had clear divisions of labor and complementary strengths. Throughout the design process, all team members adhered to the Harbin Institute of Technology motto of “strict specifications and diligent effort,” ensuring that no detail was overlooked and no flaw was missed, striving for perfection in their work.

Additionally, the team has a spirit of sincere cooperation; when encountering problems, they remain calm and diligent, discussing strategies together, solving problems collaboratively, and motivating each other to improve. During the four-month R&D process of Mr.Piano, the team made three significant improvements to the main code and printed circuit board, and with the rich hardware support provided by the TI University Program, they ultimately presented it on the stage of the 2017 National College Student IoT Design Competition (TI Cup) finals!

After winning first place in this competition, the team expressed their expectations for the project’s future:

More optimized algorithms, a more user-friendly UI, and commercializing the product for market launch

Select components

Persevere and communicate with each other

Aim for originality

WeChat ID: TI-Campus