Understanding Endoscopes: The Role of FPGA in Imaging Technology

Endoscope imaging has become a hot topic in recent years due to the demand for exploration in medical and industrial fields. The FPGA plays a crucial role in endoscopic image processing. While dedicated ASICs cannot accommodate more functions and algorithms, FPGAs can!

The Development of Endoscopes

The development of endoscopes mainly involves the following aspects:

1) Higher Resolution: Requires higher resolution sensors (size-limited)
2) Lower Latency: Needs low-latency pipeline ISP solutions; ASICs are inflexible, while FPGAs provide significant investment.
3) Smaller Size: Requires smaller sensors; under the same resolution, pixel size decreases, leading to poorer light sensitivity.
4) Better Image Quality: The limited internal space and lighting constraints involve algorithms for strong light suppression, wide dynamic range, low illumination, and dehazing.
5) More Functions: Includes image transmission, storage, handheld use, depth/defect recognition, AI analysis, 3D imaging, etc.

These challenges pose significant obstacles for sensor manufacturers, structural manufacturers, algorithm engineers, and application engineers. Where there are challenges, there is a market; where there is a market, there is competition. As a result, although the prices of endoscopes have decreased significantly in recent years, and some demands have been continuously met, there are still many technologies that need iteration and markets that need expansion.

Therefore, endoscopes have a wide range of applications in both medical and industrial fields, making them worthy of our research today.

Classification of Endoscopes

Endoscopes can mainly be divided into rigid endoscopes and flexible endoscopes. The physical images are shown below:

Understanding Endoscopes: The Role of FPGA in Imaging Technology

[Structural Comparison]:

1) Flexible Endoscope: The black device in the image has a soft body that can bend, and the head can rotate.

Understanding Endoscopes: The Role of FPGA in Imaging Technology

2) Rigid Endoscope: The silver device in the image has a rigid body that cannot bend.

Understanding Endoscopes: The Role of FPGA in Imaging Technology

[Depth Comparison]

1) Flexible Endoscope: The soft body can bend and reach deeper areas inside the body.
2) Rigid Endoscope: The structure is rigid, with limited length, resulting in less depth and distance inside the body compared to flexible endoscopes.

[Sensor Comparison]

1) Flexible Endoscope: The sensor is located at the front, with resolution affected by size and distance factors, usually smaller.

2) Rigid Endoscope: The sensor is located at the back, with a short and relatively thick size, allowing for higher resolution.

[Usage Comparison]

1) Flexible Endoscope: Mainly used for examinations, diagnoses, and treatments through natural cavities in the body, such as gastroscopes, colonoscopes, laryngoscopes, and bronchoscopy, entering through the digestive tract, respiratory tract, and urinary tract.

2) Rigid Endoscope: Mainly used to enter sterile tissues, organs, or sterile cavities through surgical incisions, such as laparoscopes, thoracoscopes, arthroscopes, intervertebral disc endoscopes, and ventriculoscopy, with shallower depth.

Comparative Analysis

Flexible endoscopes are more challenging to use and have broader applications, thus offering more potential for technological improvement. Therefore, we will primarily study the FPGA solutions for flexible endoscopes.

The Chinese market for flexible endoscopes is mainly dominated by three Japanese giants: Olympus, Fujifilm, and Pentax, with a market share exceeding 95%. In recent years, with continuous technological advancements, domestic companies like Kaidi Medical and Auhua have gradually achieved technological breakthroughs, breaking the monopoly. Domestic flexible endoscopes currently only account for 5% of the market share, so we still have significant room for improvement, not only in optics and structure but also in image algorithms.

PS: The data may be delayed, but the overall trend remains unchanged.

Structure of Flexible Endoscope

Flexible endoscopes consist of image sensors, optical lenses, light sources, and mechanical devices, allowing entry into the stomach through the mouth or other natural openings, enabling direct observation of changes in relevant areas. This significantly enhances the safety of surgeries by allowing doctors to conduct more comprehensive examinations of internal conditions under visual guidance.

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Next, we will primarily study the FPGA solutions for flexible endoscopes, starting with a block diagram as shown below:

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Here, we customized a 1-meter long OV6946 flexible endoscope module, planning to integrate the decoding chip OV426 and FPGA + cache onto one board, supporting onboard HDMI display or local RGB LCD display. The OV6946 module integrates two LED lights and outputs analog signals, as shown in the physical image below:

(Considering whether to launch an endoscope FPGA development kit…..)

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Additionally, the parameters of the OV6946 sensor are as follows.

Understanding Endoscopes: The Role of FPGA in Imaging Technology

The specific implementation of the FPGA demo will be discussed in future articles. We will continue to use FPGA to start our ISP journey and exhaust the last straw of endoscopy!

As promised, I have been diligently writing about ISP image processing knowledge on the Knowledge Planet, having already produced four articles. I hope the content I wish to write is unique and not plagiarized.

The Knowledge Planet will continue to be updated, and we are about to move on to the camera acquisition section.

Friends who support paid knowledge are welcome to join the CrazyBingo Knowledge Planet to encourage creation.

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Understanding Endoscopes: The Role of FPGA in Imaging Technology

Leave a Comment

×