Introduction to Embedded Systems Development

Key Knowledge Points in Chapter One:

Understand the characteristics, classifications, development, and applications of embedded systems, and be familiar with the logical components of embedded systems.

Understand the main types of embedded processing chips, be familiar with the SoC development process, and comprehend the significant importance of IP cores.

Be familiar with the coding of Chinese and Western characters and the types and processing of digital text, and master the parameters, file formats, and main applications of digital images.

Understand the classification and composition of computer networks, be familiar with the main content of the IP protocol, and master the composition of the Internet and commonly used access technologies.

Audio refers to sound signals audible to the human ear, while video generally refers to sequences of moving images. Both are important media for transmitting information. A common characteristic is that the content changes over time, hence they are also referred to as dynamic media.

1. Digitization of Audio/Video Information

Audio is an analog signal with a frequency range of 20 Hz to 20 kHz. To process it using a computer, it must be converted into a binary encoded representation, a process known as digitization of sound signals.

The process of digitizing sound signals is as follows:

  • • Sampling: Discretizing a continuous sound signal into a series of discrete samples;
  • • Quantization: Quantization is converting each sample’s analog value into a digital value, hence the quantization process is often referred to as A/D conversion;
  • • Encoding: The data obtained after sampling and quantization must be compressed to reduce the data size and organized into a file format for easier storage, processing, and transmission by computers.

The process of digitizing video signals is somewhat more complex than that of audio, as it operates on individual frames.

2. Common File Formats and Applications for Digital Audio

The main parameters of digital audio include sampling frequency, quantization bit depth, number of channels, compression encoding methods used, and bit rate; the bit rate, also known as data rate, refers to the amount of data per second. Before compression, the bit rate for uncompressed digital audio can be calculated as follows:

Note:

The bit rate after compression is the bit rate before compression divided by the compression ratio.

The main parameters of digital voice transmitted over wired telephone trunk lines and long-distance lines, and high-fidelity full-band stereo digital sound recorded on CD are as follows:

Type of Sound
Frequency Range/Hz
Sampling Frequency/kHz
Quantization Bit Depth/b
Number of Channels
Bit Rate When Uncompressed
Telephone Digital Voice
300 – 3,400
8
8
1
64 kb/s
CD Stereo Sound
20 – 20,000
44.1
16
2
1411.2 kb/s

3. Common File Formats and Applications for Digital Audio

The commonly used digital audio file formats, encoding types, and their main applications are shown in the table below:

Audio Format
File Extension
Encoding Type
Effect
Main Applications
Designer
WAV
.wav
Uncompressed
Sound reaches CD quality
Supports various sampling frequencies and quantization bit depths, widely supported
Microsoft Corporation
FLAC
.flac
Lossless Compression
Compression ratio of about 2:1
High-quality digital music
Xiph.Org Foundation
APE
.ape
Lossless Compression
Compression ratio of about 2:1
High-quality digital music
Matthew T. Ashland
M4A
.m4a
Lossless Compression
Compression ratio of about 2:1
Quicktime, iTunes, iPad, Real Player
Apple Inc.
MP3
.mp3
Lossy Compression
MPEG-1 Audio Layer compression ratio of 8~12:1
Internet, MP3 music
ISO
WMA
.wma
Lossy Compression
Compression ratio higher than MP3 with digital rights protection
Internet, music
Microsoft Corporation
AC3
.ac3
Lossy Compression
Adjustable compression ratio, supports 5.1, 7.1 channels
DVD, digital TV, home theater, etc.
Dolby Laboratories
AAC
.aac
Lossy Compression
Adjustable compression ratio, supports 5.1, 7.1 channels
DVD, digital TV, home theater, etc.
ISO MPEG-2/MPEG-4

The data volume of digital video is astonishingly large. The data volume for 1 minute of standard definition (resolution 720×576) video is about 1GB, which poses significant challenges for storage, transmission, and processing, necessitating data compression; international standards for video compression encoding and their applications are listed in the following table:

Name Source Image Format Compressed Bit Rate Main Applications
MPEG-1
360×288
Approximately 1.2~1.5 Mb/s
Suitable for VCDs, digital cameras, digital camcorders, etc.
H.261
360×288 or 180×144
Px64 kb/s (For P = 1, 2, only supports 180×144 format; for P > 6, supports 360×288 format)
Used in video communication, such as video phones, teleconferencing, etc.
MPEG-2 (MP@ ML)
720×576
5~15 Mb/s
Most widely used, such as DVD, digital satellite TV broadcasting, digital cable TV, etc.
MPEG-2 High Profile
1440×1152, 1920×1152
80-100 Mb/s
High-definition television (HDTV)
MPEG-4 ASP
Lower resolution image formats
Minimum bit rate of only 64 kb/s
Used in low-resolution low-bit-rate fields, such as surveillance, IPTV, mobile phones, MP4 players, etc.
MPEG-4 AVC (H.264)
Various different image formats
Utilizes many new technologies, achieving significantly reduced bit rate compared to MPEG-4 ASP at the same resolution
The latest and most widely used standard, applied in various fields such as HDTV, Blu-ray discs, IPTV, XBOX, iPod, iPhone, iPad, RMVB, etc.

There are various file formats for digital video and accompanying audio, such as:

  • • International standard MPEG formats (.dat, .mpg, .mpeg, .mp4, .vob, .3gp, .3g2, etc.).
  • • Microsoft’s AVI (.avi) and ASF (.asf) formats (the latter is suitable for streaming applications).
  • • Apple’s QTFF format (.mov and .qt).
  • • DivX’s DivX (.divx) format.
  • • Real Networks’ RM (.rm) and RMVB (.rmvb) formats (the .RMVB format is an extension of .RM, utilizing the H.264/MPEG-4 AVC algorithm, enhancing variable bit rate encoding capabilities, outperforming DivX and Xvid; many videos on the internet are currently in RMVB format).
  • • Adobe’s FLV (.flv) and F4V (.f4v) formats, as well as the open-source Matroska format (.mkv), etc.

Note:

.asf, .wmv, .mov, .rm, .rmvb, .flv, and .f4v formats all support streaming, allowing for real-time audio/video streaming and playback over the internet, meeting the needs for live streaming, video on demand, and video conferencing applications, and have seen widespread use.

Sample Questions

Introduction to Embedded Systems Development
Sample Question 24
Introduction to Embedded Systems Development
Sample Question 25
Introduction to Embedded Systems Development
Sample Question 26
Introduction to Embedded Systems Development
Sample Question 27
Introduction to Embedded Systems Development
Sample Question 28

Alright, that concludes this content.

Thank you for reading, and feel free to like, follow, and share

See you next time!

Leave a Comment