Wireless Communications for Distributed Intelligence 

Wireless Network Design for Decentralized Machine Learning
Picture above: Two possible network topologies for distributed Machine Learning. Left: parameter-server-based. Right: fully decentralized.

This project aims at establishing a general framework for the joint design of information processing and wireless resource allocation to achieve communication efficiency and reliability in distributed learning, estimation and inference systems.

With 5G coming to reality, the next question is, what will 6G be? Mobile cellular standards are updated every decade, and its evolution is always driven by new application demands and user scenarios in mobile networks. From 1G to 5G, the application scenarios have evolved from phone calls, text messages, to online browsing, video streaming, and online gaming.

For 6G that is ahead of us, we expect that information data used for Artificial Intelligence (AI) tasks will possibly bypass human-perceived applications and become the dominant source of mobile data traffic. The related applications include autonomous vehicles, industrial automation, virtual reality/augmented reality, and E-health systems. Naturally, this means that next-generation wireless networks need to evolve to cope with the communication requirements of AI-oriented data traffic.

From centralized to decentralized Machine Learning systems

Conventionally, Machine Learning (ML) algorithms are performed in a centralized unit where the training data sets are stored. In many applications, the training data are collected from different user devices and those data might contain private information about the users. Due to the privacy concerns in centralized ML systems, decentralized ML has emerged as an alternative solution that allows user devices to perform intelligent information processing locally based on their raw data or observations, without uploading them to a centralized server/cloud.

For any distributed system that relies on signaling and information exchange between distributed nodes to achieve some collective goals, wireless connectivity will always be the performance bottleneck. In a wireless network, the amount of information bits that can be reliably delivered is limited by the available communication resources (time, frequency, space). An efficient communication protocol and resource allocation design for distributed ML systems can make a significant difference than blindly applying the conventional rate-driven wireless design.

Research Activities

Our current research directions in this project are:

  • Resource allocation for federated edge learning
  • Over-the-Air (OtA) computation for distributed learning and estimation
  • Communication-efficient designs for distributed consensus and optimization.

The specific topics cover data compression, resource allocation, signal processing, medium access control, privacy, and security aspects of distributed intelligence over wireless networks. Broadly speaking, our research group aims to identify new topics and interesting problems within the intersection of communication theory, distributed algorithms, and machine learning.

Acknowledgements: our research group is supported by ELLIIT, Swedish Research Council (VR), Wallenberg Foundations, and Zenith.

Researchers

Publications

2024

David Nordlund, Jialing Liao, Zheng Chen (2024) Byzantine-Resilient Hierarchical Federated Learning with Clustered Over-The-Air Aggregation 2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW 2024, p. 715-719 (Conference paper) Continue to DOI
Adrian Edin, Zheng Chen (2024) Over-the-Air Federated Learning with Compressed Sensing: Is Sparsification Necessary? 2024 IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING FOR COMMUNICATION AND NETWORKING, ICMLCN 2024, p. 287-292 (Conference paper) Continue to DOI
Morteza Tavana, Zheng Chen, Emil Bjornson (2024) Dynamic Queue-Aware RF Charging of Zero-Energy Devices via Reconfigurable Surfaces IEEE Wireless Communications Letters, Vol. 13, p. 2551-2555 (Article in journal) Continue to DOI

2023

David Nordlund, Zheng Chen, Erik G Larsson (2023) Detecting Active Attacks in Over-the-Air Computation using Dummy Samples FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF, p. 1691-1696 (Conference paper) Continue to DOI
Zheng Chen, Erik G Larsson, Carlo Fischione, Mikael Johansson, Yura Malitsky (2023) Over-the-Air Computation for Distributed Systems: Something Old and Something New IEEE Network, Vol. 37, p. 240-246 (Article in journal) Continue to DOI

About the division

About the department