Научная статья на тему 'Research on foreign body detection in transmission lines based on a multi-UAV cooperative system and YOLOv7'

Research on foreign body detection in transmission lines based on a multi-UAV cooperative system and YOLOv7 Текст научной статьи по специальности «Физика»

CC BY
108
14
i Надоели баннеры? Вы всегда можете отключить рекламу.
Журнал
Компьютерная оптика
Scopus
ВАК
RSCI
ESCI
Область наук
Ключевые слова
Object-Detection / Multi-UAV / YOLOv7 / Transmission-lines

Аннотация научной статьи по физике, автор научной работы — Chang R., Mao Z.X., Hu J., Bai H.C., Zhou C.J.

The unique plateau geographical features and variable weather of Yunnan, China make transmission lines in this region more susceptible to coverage and damage by various foreign bodies compared to flat areas. The mountainous terrain also presents great challenges for inspecting and removing such objects. In order to improve the efficiency and detection accuracy of foreign body inspection of transmission lines, we propose a multi-UAV collaborative system specifically designed for the geographical characteristics of Yunnan's transmission lines in this paper. Additionally, the image data of foreign bodies was augmented, and the YOLOv7 target detection model, which offers a more balanced trade-off between precision and speed, was adopted to improve the accuracy and speed of foreign body detection.

i Надоели баннеры? Вы всегда можете отключить рекламу.
iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.
i Надоели баннеры? Вы всегда можете отключить рекламу.

Текст научной работы на тему «Research on foreign body detection in transmission lines based on a multi-UAV cooperative system and YOLOv7»

Research on foreign body detection in transmission lines based on a multi-UAV cooperative system and YOLOv7

R. Chang1, Z.X. Mao 2, J. Hu 2, H.C. Bai3, C.J. Zhou 4, Y. Yang 4, S. Gao 5 1 Yuxi Power Supply Bureau, Yunnan Power Grid Corporation, Yuxi, 653100, China;

2Information Center, Yunnan Power Grid Co., LTD, Kunming, 650032, China;

3 Network and Information Center, Yunnan Normal University, Kunming, 650500, China;

4 School of Information Science and Technology, Yunnan Normal University, Kunming, 650500, China; 5 Guangzhou JianRuan Technology Co., Ltd., Guangzhou, 650500, China

Abstract

The unique plateau geographical features and variable weather of Yunnan, China make transmission lines in this region more susceptible to coverage and damage by various foreign bodies compared to flat areas. The mountainous terrain also presents great challenges for inspecting and removing such objects. In order to improve the efficiency and detection accuracy of foreign body inspection of transmission lines, we propose a multi-UAV collaborative system specifically designed for the geographical characteristics of Yunnan's transmission lines in this paper. Additionally, the image data of foreign bodies was augmented, and the YOLOv7 target detection model, which offers a more balanced trade-off between precision and speed, was adopted to improve the accuracy and speed of foreign body detection.

Keywords: Object-Detection, Multi-UAV, YOLOv7, Transmission-lines.

Citation: Chang R, Mao ZX, Hu J, Bai HC, Zhou CJ, Yang Y, Gao S. Research on foreign body detection in transmission lines based on a multi-UAV cooperative system and YOLOv7. Computer Optics 2023; 47(5): 788-794. DOI: 10.18287/2412-6179-CO-1257.

Introduction

The province of Yunnan in China is characterized by its high-altitude plateau, abundant forests, and variable climate. Due to the harsh climate and environment, transmission lines and power towers in Yunnan are more prone to foreign body coverage. These foreign bodies include lightweight kites, balloons, agricultural plastic sheeting, plastic bags, and bird nests, and can cause power outages and affect the normal operation of the power system on a large scale. Therefore, regular inspection and cleaning of foreign bodies on transmission lines is crucial.

In the past, the detection method of foreign bodies in transmission lines in Yunnan, China, was mainly based on manual detection. As mentioned above, transmission lines in Yunnan are often located in complex geographical environments, where the natural environment is harsh, traffic is inconvenient, and 4G/5G signals are poor [1]. The traditional way of relying on simple manual detection and paper media recording is inefficient, heavy work intensity, poor reliability, complex detection environment and harsh climate will also cause danger to patrol personnel. The UAV (unmanned aerial vehicles) is a kind of aircraft controlled by radio remote control equipment and an application program. As an auxiliary tool, the research on its application in different fields is increasing. It is widely used in remote sensing [2, 3], topographic survey [4 -6], intelligent agriculture [7, 8], power system inspection and monitoring [9 - 11]. With the maturity and popularization of UAV technology, using UAV for foreign object inspections on power transmission lines has become an important means. This method is easy to operate, high ef-

ficiency, and the inspection field is adjustable and has been widely used. At the same time, combined with the rapid development of image detection technology in recent years, it is possible to use UAV to detect foreign bodies in transmission lines automatically, so as to no longer rely on manual judgment, which greatly improves the inspection effect of foreign bodies in transmission lines. However, compared with plain areas, the high mountains, and deep valleys of Yunnan have caused many difficulties for UAV inspections. For example, the inspection of transmission lines is complex, and there is a large difference in altitude. This makes the efficiency of using UAVs to inspect power transmission lines in Yunnan low. At the same time, the foreign body detection results of transmission lines need to be fed back at all times (rather than after the event). Therefore, the foreign body detection algorithm with fast detection speed and high detection accuracy is necessary. The current detection algorithms still have many limitations in terms of speed and accuracy.

To overcome the above limitations and in combination with the characteristics of Yunnan's power transmission lines, this paper proposes a multi-UAV cooperative foreign body detection method for transmission lines based on the latest target detection model YOLOv7. Our main contribution is in the following three parts.

1. Establish a cooperative system of multi-UAV that can plan a path based on the detection task and design the path according to the global planning of the detection line and flight path, to address the low efficiency of foreign object detection on transmission lines caused by the mountainous and deep valley terrain in Yunnan.

2. YOLOv7 target detection model with more balanced speed and accuracy is used. So that the transmission line foreign body detection is timelier and more accurate. The efficiency of identification is improved and leakage identification is reduced.

3. Aiming at the problem of fewer data sets of foreign body images in transmission lines, an image augmentation method for multi-UAV foreign body image was proposed to improve the detection ability of YOLOv7 for foreign bodies.

1. Related work 1.1. Research on the application of UAV in transmission line inspection

Most of the transmission lines are located in sparsely populated outdoor areas with inconvenient transportation. This special working environment causes difficulties in detection. Therefore, there is a very early detection method using helicopters instead of manual walking. However, it cannot be widely adopted because of the high cost of using helicopters. In addition, when flying helicopters cannot pass close to the line, some small objects cannot be easily detected. The UAV combines satellite positioning and controllable programming technology, showing the characteristics of stability, economy, portability, weather resistance, and durable cruise. In transmission, line inspection has been a lot of research and application. Li [12] studied the development process of UAV-powered patrol and implemented intelligent rapid mission planning through programming. Toth et al. [13] studied and summarized the application of UAVs in the transmission line inspection of British Columbia Transmission Corporation. Zormpas et al. [14] combined basic image processing methods and assembled specific UAVs for the job to fully specify the job according to the consideration of the purpose of transmission line inspection. He et al. [15] studied safety inspection rules and automatic detailed inspection methods for transmission towers of multi-rotor UAVs. A theoretical model for transmission line detection of multi-rotor UAVs is established. The UAV waypoints are connected in order to automatically generate the inspection path and realize automatic detailed inspection. The results show that the position error of UAV automatic detailed inspection is less than 10 cm. The height error is between 1.26 and 1.76 meters.

1.2. Research on _ foreign body detection algorithm in transmission lines

In order to realize automatic foreign body detection in transmission lines, it is necessary to use object detection algorithm to detect foreign body from image data collected by camera carried by UAV. Object detection algorithms include classical algorithms (such as SIFT and ORB feature matching algorithms.) and deep learning algorithms. Compared with deep learning, the detection accuracy of the classical algorithm for edge-blurred images and complex background images is lower. Therefore,

deep learning has become a mainstream object detection algorithm in recent years.

Guo et al. [16] train the Faster R-CNN model to detect falling objects, kites, balloons, and other foreign objects in the transmission lines. And experimental results show that compared with the traditional target detection method, fast R-CNN can realize the detection of foreign bodies in transmission lines in complex scenes compared with the classical detection algorithm. Yao and Zhu [17] proposes an unsupervised foreign object detection algorithm based on GMM (Gaussian Mixture Model) and k-means. But the accuracy of the algorithm depends on the number of samples. Li et al. [18] proposes a method to improve the YOLOv3 thus it can be easily deployed to embedded platforms without losing performance. Song et al. [19] research a high-voltage line foreign object intrusion detection model based on Yolov4. But there is no comparison with other Yolo models. Wang et al. [20] improve the original YOLOv5 object detection model and propose a novel fusion detection model using multi-scale appearance and relationship features.

2. A multi-UAV cooperative system

We propose a multi-UAV cooperative system to address the issue of low efficiency in foreign object detection for power transmission lines due to the unique terrain and landforms in Yunnan [21]. This system carried out path planning through the platform and assigned reasonable tasks to the UAVs in the working group. Meanwhile, the platform has an open design and can carry any number of UAVs. The system is mainly composed of three parts: (1) A multi-UAV cooperative system; (2) Path planning module; and (3) Task allocation module. The system is responsible for planning the inspection paths and tasks of multi-UAV for transmission lines, and sending image data back to YOLOv7 for foreign body detection, and feeding back the results to staff. The system interface is shown in Fig. 1.

PJBj

^A-C

# A-H

# B-A

Fig. 1. A multi-UAV cooperative system interface. Where A, B and C are power towers

The system is designed to establish a multi-UAV cooperative inspection system that is built on an open interface platform. DJI UAVs are not only cheap, excellent performance. More importantly, DJI also provides a stable SDK- DJI Mobile SDK, which is convenient for secondary development. Users can use it to perform various

functions, such as automatic flight, control the camera and universal joint, receive real-time video and monitor the status of other components, and so on. The multi-UAV system allows for the seamless integration of any number of UAVs.

The path planning module is designed for the global planning of transmission lines and flight paths of UAVs, which can obtain the position of each UAV visually through map markers. Path planning is realized through the waypoint task, that is, arranging a set of ordered geographic coordinate points of the power tower that the UAVs need to reach in turn. The selection of points can be done manually on the map module, after which the system completes the path planning.

The task allocation module distributes the path obtained from the path planning to the UAVs in the working group, enabling them to the UAVs can complete the route inspection and detection. The working relationship between UAVs can be divided into independent line inspection and single-line cooperative inspection. Independent line inspection means that the task allocation module assigns a path to each UAV in the working group to avoid the duplication of paths. The coordinated inspection of a single line refers to the joint inspection of a line by UAVs. Due to visual angle issues, a single UAV may be obstructed by steel frames or other objects, resulting in missed foreign object detection.

3. Methodfor detection

As the most typical representative of the one-stage target detection algorithm, the YOLO series algorithm is based on deep neural network for object detection and positioning, which runs fast and can be used in real-time systems. The accuracy and speed of detection are very balanced in real detection applications. The YOLOv7 [22], the latest version of the YOLO series, outperforms all known target detectors in both speed and accuracy in the range of 5 FPS to 160 FPS. In addition, the performance of YOLOv7 in speed and accuracy is also better than YOLOR, YOLOX, Scaled-YOLOv4, YOLOv5, DETR and other target detectors. Therefore, this paper uses YOLOv7 as the detection model.

This paper focuses on the detection of foreign bodies in transmission lines. The detection targets mainly include the detection of bird nests on power towers, foreign bodies on wires, and the detection of foreign bodies cover on insulators. In the following sections, we will introduce our detection methods.

3.1. Detection of bird nests on power tower

The power tower is relatively high, so ordinary foreign objects are unlikely to be blown onto the towers. However, some birds prefer to nest on the towers, which can affect the electrical equipment. Therefore, the main object of foreign bodies detection on the power tower are bird nests.

Difficulty: Bird nests on power towers are usually built on the supporting structure, which is mainly located

near the inside of the tower. Therefore, bird nests are susceptible to the influence of the external tower structure, and the whole structure of the nests cannot be clearly photographed by the UAV.

Methods: Aiming at the problem of bird nests image occlusion and insufficient data. We adopted a multi-UAV cooperative inspection to increase the field of view of inspection, and added the method of bird nests image not on the tower to the YOLO training dataset to strengthen the detection ability of neural network for such objects. And the image augmentation operation, the main method for bird nests is to give the original data artificial occlusion. To enhance the ability of the network to resist occlusion. Data augmentation are explained in detail in Sect 4.

3.2. Detection of _foreign bodies on wires

Foreign objects on the wire are generally due to their lightweight, which causes them to be blown onto the facility by wind, such balloons, kites, plastic bags, and so on.

Difficulty: Because foreign objects are relatively lightweight, they can appear in many different forms depending on the perspective of the UAV. Under the same Angle of view, they also change different shapes, especially kites and plastic bags. This makes it more difficult for neural networks to detect this type.

Methods: We used artificially generated foreign bodies in multiple forms to expand the dataset. Additionally, we included image data of these foreign bodies in nonpower line backgrounds to increase variety in the dataset. Data augmentation is also explained in detail in Sect 4.

3.3. Detection of _foreign body cover on insulators

Insulators are very important components in transmission lines. They are easy to be covered and wrapped with long and light objects, such as plastic bags and long fabrics.

Difficulty: Foreign bodies on the insulator are a significant safety hazard for the insulator, but they are not very common. Therefore, there will be insufficient data on foreign bodies coverage of insulators. At the same time, the shape of the insulator is long and short, and its appearance varies from different angles of view.

Methods: In view of the shortage of foreign bodies data on insulators, we simulated the real situation by manually covering or winding objects on insulators to increase the amount of data, and used data augmentation techniques to further expand the dataset.

4. Data augmentation

As mentioned above, although foreign bodies on power transmission lines have an important impact on power equipment, it is difficult to collect data on these foreign bodies, results in an inadequate amount of data. At the same time, in each foreign body data, there is still a problem that some categories of data are large and some categories of data are small. Given the network and limited prior knowledge, introducing more new data for training means that the trained network is more robust. A

common problem in object detection is that the training dataset is too small, which leads to poor network detection capability after training. Data augmentation is an effective method to increase the quantity and diversity of limited data. It extracts more useful information from limited data and generates the value of more data. Therefore, when the training sample size is limited, data expan-

The image data of certain foreign bodies in transmission lines is limited, and it is not feasible to reproduce these scenarios on power lines in reality. Therefore, we use a re-fusion method to combine the foreign bodies with the background and augment the available data. The method of refusion refers to the segmentation of foreign bodies from images of foreign bodies in different background environments and then refusion with the environment of transmission lines.

Partial occlusion and erasure: Foreign bodies in transmission lines will be blocked by branches or power facilities due to the environment, making capturing all foreign bodies when using UAVs impossible. we artificially added partially occluded and erased image data.

Affine transformation: Affine transformation was used to change the size, direction, and position of foreign bodies in the original image, and the transmission line inspection scene shot by UAV was simulated from different angles.

5. Experiments

5.1. Data construction

The datasets used in the experiment consist of six classes: the insulator, covered insulator, balloon, kite, nest, and plastic trash. The first two classes are the detection of uncovered and covered insulators, and the last four classes are the classes of foreign bodies on transmission lines. It should be noted that all six classes of original images were either obtained from the Internet or captured by UAVs. Besides, we randomly divide the whole images into a training set and validation set at an approximate ratio of 3/4 and 1/4. A test set with 200 images was also collected, which were captured in the real situation for the six classes. The detailed composition of the datasets is shown in Tab. 1.

5.2. Experimental configuration

All of our experiments are based on the PyTorch deep learning framework, deployed on the Ubuntu operating system. In the process of training models, we use a computer with an NVIDIA GeForce RTX 3090 GPU, whose

sion and augmentation are very necessary. The data augmentation method used in this paper mainly includes five operations (as shown in Fig.2): 1. refusion of foreign object and background; 2. partial occlusion and erasure; 3. Affine transformation; 4. Brightness and contrast transformation. Each operation simulates the imaging environment of a UAV inspecting a power transmission line.

memory is 24 GB. And in the process of testing models, the GPU is NVIDIA GeForce RTX 3080 Ti, whose memory is 12 GB.

Tab. 1. Composition of the dataset

Class Training Validation Total

Insulator 357 119 476

Covered 59 20 79

insulator

Balloon 389 130 519

Kite 381 127 508

Nest 2216 739 2955

Trash 401 134 535

Total 3803 1260 5063

5.3. Evaluation criteria

The four commonly used criteria for evaluating the performance of different object detection models are Precision (P), Recall (R), mean Average Precision (mAP), and F\ Score (F1). The formula of P, R, and F\ are defined as follows: P = 7>\(7>+Fp), R = 7>\(7>+Fp), and F = 2 x P x R (p + R).

where FP (false positive) represent the number of false samples which are incorrectly detected to be positive samples, Fn (false negative) the same way to define, and Tp (true positive) represents the number of correct detected ones. Tp+Fp is the total number of detected objects, and Tp + Fn is the total number of actual objects. F1 is the harmonic mean of P and R.

5.4. Implementation details

We aim to detect foreign bodies on transmission line equipment quickly and accurately, to reduce the damage of foreign bodies to transmission lines and improve the detection effect. In view of the good real-time performance and accuracy of the YOLO model, we choose to use the YOLO model as the target detection model, and use four variants of the YOLO model for training to compare the detection accuracy and speed. These models are YOLOv5-s, YOLOv5-m, YOLOv7 and YOLOv7-X.

a- m^

s

I Image Segmentation,

' — > /

; ; ^ à mm

Image Refusion

Affine Transformation Brightness Variance Partial Occlusion and Erasure '

Fig. 2. Example of the data augmentation process

All models are trained based on the weights before training, and we use the same dataset built before to train and validate all models. YOLOv7 training parameters of the specific Settings include Epoch: 300, Batch size: 16, IoU threshold: 0.2, Initial learning rate: 0.01, and Momentum: 0.937.

c 0.7

0.5

yolov5-s yolov5-m yolov7 yolov7-x

80 Epoch

140

Fig. 3. Comparison of training precision Tab. 2. Performance of different detection models

Model P R mAP Fi Speed(ms)

YOLOv5-s 0.964 0.959 0.974 0.961 1.8

YOLOv5-m 0.963 0.960 0.974 0.961 5.6

YOLOv7 0.969 0.963 0.976 0.966 3.6

YOLOv7-x 0.956 0.948 0.970 0.956 5.7

5.5. Performance of different detection models

Fig. 4. Compare and test results (the detection performance of 4 models)

In the experiment, the detection performance of a series of YOLO models is compared on the same validation dataset to choose a detection model that can not only accurately identify foreign bodies but can also be applied to real-life situations that require quick detection. The precision trend of four models in the first 150 epochs is depicted in Fig. 3, and the final detection results are detailed in Tab. 2. As we can see, although the speed of YOLOv5-s is faster, YOLOv7 has the best performance among P, R, mAP, and F1 parameters.

iНе можете найти то, что вам нужно? Попробуйте сервис подбора литературы.

Fig. 5. Compare and test results (detection effect on the test dataset)

At the same time, compared to the processing power of the camera carried by the UAV, the speed of 3.6 milliseconds is sufficient for our detection system. Considering the balance between detection accuracy and speed, we have selected YOLOv7 as the model for foreign body detection in transmission lines in this study. The detection results of the above five models in the testing datasets are shown in Fig. 4.

Tab. 3. Performance of YOLOv7 on the realistic datasets

Class P R mAP Fi

Insulator 0.969 0.963 0.976 0.927

Covered insulator 0.953 0.902 0.961 0.961

Balloon 0.94 0.982 0.986 0.995

Kite 0.993 0.998 0.993 0.954

Nest 0.954 0.954 0.959 0.980

Trash 0.992 0.960 0.973 0.978

5.6. Results in realistic transmission line

To illustrate the performance of our trained YOLOv7 model, we evaluated it with both test and real datasets, which are composed of images taken by UAVs and contain a large number of objects of all these classes. The testing performance is shown in Tab. 3. As we can see in Tab. 3, Fig. 5 and 6. Our method performs very well on every class in both the test set and the real dataset. We also use real data sets to measure the speed of our entire system. The results show that our final system can detect each image at a speed of 3.6 milliseconds, which meets the accuracy and speed of foreign body detection in transmission lines.

Conclusion

This paper proposes a multi-UAV cooperative system for foreign body detection in transmission lines based on the latest object detection model, YOLOv7. In order to meet the needs of the application, combined with a multi-UAV cooperative system, we adopted the YOLOv7 target detection model with a more balanced detection speed and accuracy. So that the detection of foreign bodies in

the transmission line is timelier and more accurate. At the same time, aiming at the problem of insufficient training samples, a series of foreign body image augmentation methods for transmission lines for UAVs are proposed to improve the foreign body detection ability of YOLOv7. However, there are still some incorrect detection results because of unexpected shapes and wrong logical judgment of the bounding box. In the future, in order to further improve the detection accuracy and speed, we will improve the detection network structure and modify the algorithm logic of foreign body detection.

Insulator&Covered Balloon

Fig. 6. In terms of real data, the detection effect of YOLOv7 indifferent classes

References

[1] Liu S, Yang Q, Cai H, Yan M, Zhang M, Wu D, Xie M. Market reform of Yunnan electricity in southwestern China: Practice, challenges and implications. Renew Sust En-erg Rev 2019; 113: 109265. DOI: \0.\0\6/j.rser.20\9.\09265.

[2] Manfreda S, McCabe MF, Miller PE, Lucas R, Madrigal VP, Mallinis G, Ben Dor E, Helman D, Estes L, Ciraolo G, Mullerova J, Tauro F, De Lima MI, De Lima JLMP, Maltese A, Frances F, Caylor K, Kohv M, Perks M, Ruiz-Perez G, Su Z, Vico G, Toth B. On the use of unmanned aerial systems for environmental monitoring. Remote Sens 2018; 10(4): 641. DOI: 10.3390/rs10040641.

[3] Ventura D, Bonifazi A, Gravina MF, Belluscio A, Ardiz-zone G. Mapping and classification of ecologically sensitive marine habitats using unmanned aerial vehicle (UAV) imagery and object-based image analysis (OBIA). Remote Sens2018; 10(9): 1331. DOI: 10.3390/rs10091331.

[4] Rusnak M, Sladek J, Kidova A, Lehotsky M. Template for high-resolution river landscape mapping using UAV technology. Measurement 2018; 115: 139-151. DOI: 10.1016/j.measurement.2017.10.023.

[5] Langhammer J, Vackova T. Detection and mapping of the geomorphic effects of flooding using UAV photogramme-try. Pure Appl Geophys 2018; 175: 3223-3245. DOI: 10.1007/s00024-018-1874-1.

[6] James MR, Chandler JH, Eltner A, Fraser C, Miller PE, Mills JP, Noble T, Robson S, Lane SN. Guidelines on the use of structure-from-motion photogrammetry in geo-morphic research. Earth Surf Process Landf 2019; 44: 2081-2084. DOI: 10.1002/esp.4637.

[7] Dyson J, Mancini A, Frontoni E, Zingaretti P. Deep learning for soil and crop segmentation from remotely sensed data. Remote Sens 2019; 11(16): 1859. DOI: 10.3390/rs11161859.

[8] Popescu D, Stoican F, Stamatescu G, Ichim L, Dragana C. Advanced UAV-WSN system for intelligent monitoring in

precision agriculture. Sensors 2020; 20(3): 817. DOI: 10.3390/s20030817.

[9] Constantin A, Dinculescu R-N. UAV development and impact in the power system. 2019 8th Int Conf on Modern Power Systems (MPS) 2019: 1-5. DOI: 10.1109/MPS.2019.8759745.

[10] Rafique SF, Bodla MK, Ahmed Z, Nasir U, Zaidi A, Saleem M. Design and implementation of a UAV for power system utility inspection. 2014 16 th Int Power Electronics and Motion Control Conf and Exposition 2014: 11461150. DOI: 10.1109/EPEPEMC.2014.6980665.

[11] Addabbo P, Angrisano A, Bernardi ML, Gagliarde G, Mennella A, Nisi M, Ullo SL. UAV system for photovoltaic plant inspection. IEEE Aerosp Electron Syst Mag 2018; 33: 58-67. DOI: 10.1109/MAES.2018.170145.

[12] Li L. The UAV intelligent inspection of transmission lines, In Book: Proceedings of the international conference on advances in mechanical engineering and industrial informatics. Atlantis Press; 2015: 1542-1545. DOI: 10.2991/ameii-15.2015.285.

[13] Toth J, Gilpin-Jackson A. Smart view for a smart grid -Unmanned Aerial Vehicles for transmission lines. 2010 1st Int Conf on Applied Robotics for the Power Industry 2010: 1-6. DOI: 10.1109/CARPI.2010.5624465.

[14] Zormpas A, Moirogiorgou K, Kalaitzakis K, Plokamakis GA, Partsinevelos P, Giakos G, Zervakis M. Power transmission lines inspection using properly equipped unmanned aerial vehicle (UAV). 2018 IEEE Int Conf on Imaging Systems and Techniques (IST) 2018: 1-5. DOI: 10.1109/IST.2018.8577142.

[15] He T, Zeng Y, Hu Z. Research of multi-rotor UAVs detailed autonomous inspection technology of transmission lines based on route planning. IEEE Access 2019; 7: 114955-114965. DOI: 10.1109/ACCESS.2019.2935551.

[16] Guo S, Bai Q, Zhou X. Foreign object detection of transmission lines based on faster R-CNN. In Book: Kim KJ, Kim H-Y, eds. Information science and applications, Singapore: Springer Nature Singapore Pte Ltd; 2020: 269-275. DOI: 10.1007/978-981-15-1465-4_28.

[17] Yao N, Zhu L. A novel foreign object detection algorithm based on GMM and K-means for power transmission line inspection. J Phys Conf Ser 2020; 1607: 012014. DOI: 10.1088/1742-6596/1607/1/012014.

[18] Li J, Nie Y, Cui W, Liu R, Zheng Z. Power transmission line foreign object detection based on improved YOLOv3 and deployed to the chip. 2020 3rd Int Conf on Machine Learning and Machine Intelligence, Association for Computing Machinery 2020: 100-104. DOI: 10.1145/3426826.3426845.

[19] Song Y, Zhou Z, Li Q, Chen Y, Xiang P, Yu Q, Zhang L, Lu Y. Intrusion detection of foreign objects in high-voltage lines based on YOLOv4. 2021 6th Int Conf on Intelligent Computing and Signal Processing (ICSP) 2021: 12951300. DOI: 10.1109/ICSP51882.2021.9408753.

[20] Wang Q, Si G, Qu K, Gong J, Cui L. Transmission line foreign body fault detection using multi-feature fusion based on modified YOLOv5. J Phys Conf Ser 2022; 2320: 012028. DOI: 10.1088/1742-6596/2320/1/012028.

[21] Xing L, Fan X, Dong Y, Xiong Z, Xing L, Yang Y, Bai H, Zhou C. Multi-UAV cooperative system for search and rescue based on YOLOv5. Int J Disaster Risk Reduct 2022; 76: 102972. DOI: 10.1016/j.ijdrr.2022.102972.

[22] Wang C-Y, Bochkovskiy A, Liao H-YM. YOLOv7: Train-able bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv Preprint. 2022. Source: <https://arxiv.org/abs/2207.02696>. DOI: 10.48550/arXiv.2207.02696.

Authors' information

Rong Chang, the senior engineer, the company's third-level technical expert, Yuxi City's "Yuxi Craftsman", "Xing-yu Information and Information Industry Top Talent", the company's expert internal trainer, has been engaged in the operation, maintenance, and construction of power information system, the operation and maintenance of software and hardware platform infrastructure, data asset management, power big data application construction, etc. for more than 10 years, has won more than 25 patent authorizations and won more than 20 awards such as the company's science and technology progress award, employee innovation, etc. E-mail: [email protected] .

Zhengxiong Mao (Member, IEEE) has a bachelor's degree from Chongqing University. His main research directions include computer vision, the Internet of Things, and information system operation and security. E-mail: [email protected] .

Jian Hu, M.S., engineer. received the master's degree from Yunnan University, Kunming, China. His research interests include information security and machine learning. E-mail: [email protected] .

Haicheng Bai (b. 1979) is a Ph.D. candidate and associate professor in the Department of Optical Engineering at Yunnan Normal University. His research focuses on digital image processing and deep learning object recognition. His research interests include computer vision and deep learning. E-mail: 3701 @ynnu.edu.cn .

Chengjiang Zhou (b. 1992) graduated from Kunming University of Science and Technology with a Ph.D. in 2020. Currently, he works as a teacher at Yunnan Normal University. Research interests are computer vision and deep learning. E-mail: [email protected] .

Yang Yang (Member, IEEE) received the master's degree from Waseda University, Tokyo, Japan, in 2007, and the Ph.D. degree from the National University of Singapore, Singapore, in 2013, both in computer science. He is currently a Professor with the School of Information Science and Technology, Yunnan Normal University, Kunming, China. He has (co)authored refereed journal and conference papers for many times, including IEEE Transactions on image processing / IEEE Transactions on neural networks and learning systems / IEEE Transactions on fuzzy systems / IEEE Transactions on evolutionary computation / IEEE Transactions on geoscience and remote sensing, PR, and ICCV. His research interests include computer vision, remote sensing, geography information systems, and medical imaging. E-mail: [email protected] .

Shan Gao (b. 1985) graduated from Xi'an International Studies University in 2009 with a bachelor's degree in Computer Science and Technology. Currently, he works as the Vice General Manager at JianRuan Technology Co., Ltd. in Guangzhou. His research interests include computer vision and deep learning. E-mail: [email protected] .

Received December 3, 2022. The final version - May 17, 2023.

i Надоели баннеры? Вы всегда можете отключить рекламу.