16 April 2024

Sharing sensitive data, such as images of brain tumor patients, is complicated. This makes development of machine learning models for medical image analysis challenging. LiU researcher Anders Eklund shows how such models can be trained without sharing sensitive information outside the hospitals.

Info graphics with illustrations showing how local updates are being sent from the hospitals to a cloud. The cloud sends a new global modell to the hospitals. The trained model gives personal healthcare.
Infographic showing how AI models are trained using federated learning. In each hospital, the model is trained locally. In real-time, researchers combine the locally trained models into a joint so-called global model. The method ensures that the medical data each model is trained on is not shared outside the hospital. The image was created by Sara Läthén.

Developing artificial intelligence, AI, for applications in healthcare, for example in medical image analysis, can save substantial time in clinical workflows. But there are several challenges. Data-driven AI, i.e. large-scale machine learning models, needs a large amount of medical data to train on. For example, to train models to automatically analyze magnetic resonance (MR) images of brain tumor patients, a large number of images are needed. But sharing medical images is complicated due to ethics, anonymization and data protection regulations.

Combining medical information from multiple hospitals results in a larger medical dataset. Because each hospital individually trains an AI model locally, the sensitive information does not need to be sent outside the hospital. In a European research project, researchers combine locally trained models in real-time into a joint so-called global model on a server in another city. That way, they don't have to send the medical data each local model is trained on. The technique is called federated learning. The researchers have now performed federated learning between Linköping University and the radiation therapy clinic at Skåne University Hospital in Lund.

Porträtt på forskare
Anders Eklund, senior associate professor at the Department of Biomedical Engineering (IMT) and the Department of Computer and Information Science (IDA), together with senior associate professor Evren Özarslan at IMT, leads part of the European collaborative project ASSIST. Among other things, the researchers are developing methods to be able to train models with sensitive information that cannot be shared. 

First in Sweden

“We believe that we are among the first in Sweden to do federated learning with medical images. We will soon add several more cities, Umeå is next in line,” says Anders Eklund, senior associate professor at the Department of Biomedical Engineering (IMT) and the Department of Computer and Information Science (IDA).

Superdatorn Berzelius.
For the simulations with the open dataset BraTS, the project has had substantial help from the supercomputer Berzelius at the National Supercomputer Center (NSC) at Linköping University, one of the world's fastest computers. Thor Balkhed

One challenge that remains to be solved is that the images can differ between hospitals due to different equipment and MR scanners. The hospitals may also have different clinical guidelines for how oncologists, i.e. medical doctors who have special training in diagnosing and treating cancer, should mark the tumors and handle surrounding organs, so-called risk organs. Anders Eklund is hopeful that they will come up with a solution that compensates for that. To study how differences between hospitals affect the federation, they have made simulations where they used an open dataset, meaning an open collection of data, called BraTS. BraTS includes images and marked tumors for brain tumor patients from more than twenty different hospitals, and has been created specifically to develop similar models.

“If, for example, a hospital has marked the tumors with a smaller margin, which affects the federation negatively, we can hopefully develop methods so that it still works.”

More areas of application

The project also involves companies and universities in the Netherlands, Belgium and Türkiye. In the Netherlands, for example, researchers are developing similar models for images of the liver.

“With these images, the same methods are used but with a different application. That's the point, to learn from each other and use the same methods in different ways.”

Anders Eklund also mentions that other possible areas of application with federated learning could be genetics or text in medical journals, i.e. language models in healthcare. Companies that have a lot of data in different cities and don't want to put everything in the same place could also use the technology. Similarly, companies that want to take part in research projects and that do not want to send their data.

“Federated learning can be used for all types of information that is sensitive in various ways. It is becoming more and more popular, otherwise the companies would not be involved and invest in the project.”

About the research project

ASSIST

The European research project is called ASSIST and is financed by Vinnova and AIDA (Analytic Imaging Diagnostics Arena). It is also a collaboration with several companies. In Sweden, the companies Scaleout Systems, Inovia AI, RaySearch Laboratories, Spectronic Medical and Eigenvision are included.

Linköping University also collaborates with Region Östergötland, which has exported images from the oncology clinic's radiotherapy department. That collaboration is facilitated by CMIV, Center for Medical Image Science and Visualization, where medical doctors and engineers, among others, conduct interdisciplinary research.

Read more on the project's website:

Contact and more information

Read more about artificial intelligence at LiU

Research activity

Latest news from LiU

Nerve damage from cancer treatment can be predicted

Many women treated for breast cancer using taxanes, a type of cytostatic drug, often experience side effects in the nervous system. Researchers at LiU have developed a tool that can predict the risk level for each individual.

Woman in safety helmet.

Her mission is difficult – but fun and achievable

We are in the midst of a tough transition towards more sustainable development. This requires innovation and knowledge, says Marie Trogstam, a LiU alumna who is now head of sustainability and infrastructure at the Confederation of Swedish Enterprise.

Closeup of small pieces of liver in a petri dish.

A liver biopsy may predict spread of pancreatic cancer

Microscopic changes in the liver can be used to predict spread of pancreatic cancer. The discovery may provide new ways of predicting the course of the disease and preventing pancreatic cancer from spreading to other organs.