Abstract: In response to the computing power processing needs of intelligent applications, Multi-access Edge Computing (MEC) provides computing services at the network edge. Unmanned Aerial Vehicles (UAVs) have good maneuverability and can serve as temporary aerial edge nodes in MEC to provide edge services to ground users. However, the MEC environment is complex and dynamically variable, making it challenging to formulate appropriate service strategies for multiple UAVs. Additionally, many existing studies on UAV-MEC assume that the UAVs fly at a fixed altitude, ignoring the importance of flight height. Under the premise of co-channel interference, this paper maximizes the task completion volume by optimizing energy efficiency, allowing multiple UAVs to cooperate in three-dimensional space to provide task computing services to ground users. To achieve the energy efficiency optimization goal, maximizing task completion volume while minimizing flight energy consumption requires the formulation of optimal flight strategies, sub-channel selection strategies, and task scheduling strategies. Based on the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, this paper proposes a curiosity-driven and twin-networks-structured MADDPG (CTMADDPG) to address the aforementioned optimization problems. It promotes state exploration of agents through internal rewards, avoiding convergence to suboptimal strategies. At the same time, a dual-critic network is utilized to reduce the probability of Q value overestimation, achieving stable updates. Simulation results indicate that the CTMADDPG algorithm excels in maximizing overall system energy efficiency, outperforming other benchmark algorithms.Keywords: Multi-access Edge Computing; Multi-Agent Reinforcement Learning; Unmanned Aerial Vehicle; Task SchedulingAuthors:
| Li Yang1, Wei Ziling1, Su Jinshu1,2, Zhao Baokang1
Affiliation: 1National University of Defense Technology, College of Computer Science, Changsha, China, 410073 2Academy of Military Sciences, Beijing, China, 100091
Reference format for this paper: Yang LI, Ziling WEI, Jinshu SU, Baokang ZHAO, 2024. A multi-agent collaboration scheme for energy-efficient task scheduling in a 3D UAV-MEC space. Frontiers of Information Technology & Electronic Engineering, 25(6):824-838.https://doi.org/10.1631/FITEE.2300393 |
This paper provides a concise overview:
Scan the QR code below to read the full text:
Hot Articles
1. Academician Pan Yunhe | On Visual Knowledge
2. Academician Pan Yunhe | Five Fundamental Questions of Visual Knowledge
3. Academician Pan Yunhe | On Visual Understanding
4. Ma Yi, Shen Xiangyang et al. | On the Principles of Simplicity and Coherence in the Origins of Intelligence
5. Academician Duan Baoyan | Special Issue on the Evolution and Innovation of Antenna System Technology Post-5G and 6G
6. Academician Zhang Ping, Professor Peng Mugeng et al. | Special Issue on Simplified Wireless Network Theory and Technology
7. Academician Wu Jiangxing’s team | Discussion on a New Paradigm of Endogenous Security in 6G Networks
8. Yang Yi, Zhuang Yueting et al. from Zhejiang University | Multiple Knowledge Representations Under Big Data and Artificial Intelligence: Framework, Applications, and Case Studies
9. Su Jinshu, Zhao Baokang et al. from National University of Defense Technology | Trends in Network Technology Development in Large-Scale Efficient Network Computing
10. Academician Ye Peijun et al. from the Institute of Automation, Chinese Academy of Sciences | Parallel Cognition: Hybrid Intelligence for Human-Machine Interaction and Management
11. Academician Wang Feiyue et al. from the Chinese Academy of Sciences | Knowledge Automation and Hybrid Enhanced Intelligence for Human-Machine Trust: Mechanisms for Cognitive Control of Complex Systems and Their Applications
12. Liu Zhiming from Southwest University, Wang Ji from National University of Defense Technology | Human-Machine-Object Fusion Systems: Concepts, Challenges, and Research Opportunities
13. Hu Jinwen et al. from Northwestern Polytechnical University | Research on Obstacle Detection of Intelligent Vehicles in Outdoor Environments Based on Multi-Sensor Fusion
14. Zhang Jianhua et al. from Beijing University of Posts and Telecommunications | Channel Measurement and Modeling for 6G: Current Status and Prospects
15. Wang Haonan, Li Dongsheng et al. from National University of Defense Technology | Review of Deep Reinforcement Learning
16. Niu Zhongqian, Zhang Bo et al. from University of Electronic Science and Technology of China | Mechanical Reliability Study of 3-dB Branch Waveguide Directional Couplers in the Sub-Millimeter and Terahertz Bands
17. Lu Jianquan et al. from Southeast University | Binary Asynchronous Pulse Tracking Consensus in Multi-Agent Systems
18. Da Kai from National University of Defense Technology, Li Tiancheng et al. from Northwestern Polytechnical University | Research Progress on Multi-Sensor Multi-Target Tracking Based on Random Finite Sets
19. Xie Ying, Ma Jun et al. from Lanzhou University of Technology | Phase Synchronization and Energy Balance Among Neurons
20. Zhang Kaiqing et al. from the University of Illinois | Progress in Decentralized Multi-Agent Reinforcement Learning with Networked Agents
21. Branislav REHÁK et al. | Leader-Follower Synchronization in Multi-Agent Systems with Heterogeneous Delays
22. Xiao Renbin et al. from Huazhong University of Science and Technology | Role Division Firefly Algorithm for Complex Optimization Scheduling
23. Wen Guanghui et al. from Southeast University | Research Progress on Distributed Economic Dispatch in Smart Grids: A Review
24. Bu Mingxuan, Pi Xiaodong et al. from Zhejiang University | Semiconductor Nanocrystal-Based Neural Synaptic Devices
25. Yu Junzhi et al. from Peking University | Underwater Garbage Cleaning Robot Vision Detection Algorithm Based on Improved YOLOv4
26. Zhou Jie, Zhang Junping et al. from Fudan University | ChatGPT: Potential, Prospects, and Limitations
27. Zhang Ping, Xu Xiaodong, Dong Chen, Niu Kai et al. from Beijing University of Posts and Telecommunications | Modulation Division Multiple Access Technology for Semantic Communication
28. Xu Chi, Yu Haibin et al. from the Shenyang Institute of Automation, Chinese Academy of Sciences | Industrial Wireless Network Edge Resource Allocation Based on Multi-Agent Deep Reinforcement Learning
29. Wang Yuying, Li Jindong et al. from the China Academy of Space Technology | Progress in Space Applications of Mid-Long Wave Infrared Detection Technology
30. Xiao Renbin from Huazhong University of Science and Technology: Four Development Stages of Collective Intelligence
Journal Dynamics The Chinese Association for Science and Technology has released the “High-Quality Science and Technology Journal Classification Directory”, and FITEE has been selected as a T1 journal in the field of information and communication! The first academic frontier forum in the field of information and electronic engineering was successfully held, led by Academician Duan Baoyan. The latest impact factor for 2021 was announced, and FITEE has surpassed 2.0 for the first time. FITEE’s impact factor increased by 55%, entering the Q2 zone for the first time. FITEE released the first list of outstanding papers/special issues, distinguished editorial board members/communication experts! FITEE editor-in-chief and editorial board article list (2019.1~2021.8) FITEE communication expert article list (2019.1~2021.8) Focusing on advanced integrated circuit technology and industrial innovation, the 5th “Chinese Academy of Engineering Information and Electronic Engineering Frontier Forum” was successfully held! The Chinese Academy of Engineering released 10+10 global engineering frontiers in the field of information and electronics. FITEE WeChat has launched a new feature, allowing users to read the Chinese and English abstracts and full texts of each issue without downloading PDFs. “Frontiers of Information Technology & Electronic Engineering” (FITEE) successfully held the second expanded meeting of the second editorial board in 2020. The first meeting for the appointment of the first batch of communication experts for FITEE was held at Zhejiang University. The first meeting of the second editorial board of FITEE was held at Zhejiang University.
About this Journal
Frontiers of Information Technology & Electronic Engineering (abbreviated as FITEE, Chinese name《信息与电子工程前沿（英文）》, ISSN 2095-9184, CN 33-1389/TP) is an English academic monthly journal in the field of information electronics, indexed by SCI-E and EI, with the latest impact factor of 2.7, ranked in the JCR Q2 zone. It was formerly known as the “Journal of Zhejiang University (English Edition) C: Computer and Electronics”, founded in 2010, and was renamed to its current title in 2015. It is now a sub-journal of the Chinese Academy of Engineering’s journal in the field of information and electronic engineering. It covers fields such as computer science, information and communication, control, electronics, and optics. Article types include research papers, reviews, personal viewpoints, and commentaries. The current editor-in-chief is Academician Pan Yunhe and Fei Aiguo from the Chinese Academy of Engineering. The journal implements an international peer review system, with initial feedback generally within 2-3 months. Once accepted, articles will be published online promptly.
In 2019, it was funded by the Chinese Association for Science and Technology and seven ministries as part of the “Excellence Action Plan for Chinese Science and Technology Journals” (Tiered Journals). From 2021 to 2022, it was selected as a high-quality science and technology journal classification directory in the fields of information and communication (organized by the China Institute of Communications) and computing (organized by the China Computer Federation), both ranked at the highest T1 level; selected for the 2022 directory of recommended international academic conferences and journals by the China Computer Federation (cross-disciplinary/comprehensive/emerging).
Official website: http://www.fitee.zjujournals.com
Journal Springer homepage:
http://www.springer.com/computer/journal/11714
Submission: http://www.editorialmanager.com/zusc
Postal code: 32-324
Address: 148 Tianmushan Road, Xihu District, Hangzhou, Zhejiang Province, China
Phone: +86-571-88273162
Email: [email protected]
WeChat Group To facilitate communication and discussion among researchers, we have established the following WeChat groups for various disciplines. Users who wish to join a group should add the editor’s personal WeChat ID fitee_xb and leave a message indicating their institution and the group they wish to join; the editor will add you to the group. Marketing personnel, please do not disturb.
|
Computer Science and Technology Group |
Optical Engineering and Technology Group |
|
Control Science and Technology Group |
Information and Communication Group |
|
Electronics Discussion Group |
Artificial Intelligence Group |
Follow Us ID: fitee_caeThis official WeChat account is for the Chinese Academy of Engineering’s journal “Frontiers of Information Technology & Electronic Engineering” (SCI-E, EI indexed journal), with functions including: disseminating academic articles of the journal; providing convenient services for associated scholars (readers, authors, reviewers, editorial board members, etc.); publishing information related to academic writing, reviewing, editing, and publishing; introducing academic figures, thoughts, and achievements in the field of information and electronic engineering, showcasing cutting-edge scientific research progress in this field; and providing a friendly interactive platform for scholars at home and abroad in this field.
