Publications Real-Time Virtualization
A Real-Time virtio-based Framework for Predictable Inter-VM Communication
42nd IEEE Real-Time Systems Symposium (RTSS 2021), December 2021, Dortmund, Germany
Abstract
Ensuring real-time properties on current heterogeneous multiprocessor systems on a chip is a challenging task. Furthermore, online artificial intelligent applications –which are routinely deployed on such chips– pose increasing pressure on the memory subsystem that becomes a source of unpredictability. Although techniques have been proposed to restore independent access to memory for concurrently executing virtual machines (VM), providing predictable inter-VM communication remains challenging. In this work, we tackle the problem of predictably transferring data between virtual machines and virtualized hardware resources on multiprocessor systems on chips under consideration of memory interference. We design a “broker-based” real-time communication framework for otherwise isolated virtual machines, provide a virtio-based reference implementation on top of the Jailhouse hypervisor, assess its overheads for FreeRTOS virtual machines, and formally analyze its communication flow schedulability under consideration of the implementation overheads. Furthermore, we define a methodology to assess the maximum DRAM memory saturation empirically, evaluate the framework’s performance and compare it with the theoretical schedulability.
Code and hardware artifacts
Cite this paper
@inproceedings{virtio_rtss21,
title = {{A Real-Time virtio-based Framework for Predictable Inter-VM Communication}},
author = {Schwaricke, Gero and Tabish, Rohan and Pellizzoni, Rodolfo and Mancuso, Renato and Bastoni, Andrea and Zuepke, Alexander and Caccamo, Marco},
booktitle = {42nd IEEE Real-Time Systems Symposium (RTSS 2021)},
year = 2021,
month = dec,
pages = {27--40},
address = {Dortmund, Germany},
doi = {10.1109/RTSS52674.2021.00015},
url = {https://doi.org/10.1109/RTSS52674.2021.00015}
}
TY - CONF AU - Schwaricke, Gero AU - Tabish, Rohan AU - Pellizzoni, Rodolfo AU - Mancuso, Renato AU - Bastoni, Andrea AU - Zuepke, Alexander AU - Caccamo, Marco TI - A Real-Time virtio-based Framework for Predictable Inter-VM Communication T2 - 42nd IEEE Real-Time Systems Symposium (RTSS 2021) PY - 2021 DA - 2021/12// CY - Dortmund, Germany SP - 27 EP - 40 DO - 10.1109/RTSS52674.2021.00015 UR - https://doi.org/10.1109/RTSS52674.2021.00015 AB - Ensuring real-time properties on current heterogeneous multiprocessor systems on a chip is a challenging task. Furthermore, online artificial intelligent applications –which are routinely deployed on such chips– pose increasing pressure on the memory subsystem that becomes a source of unpredictability. Although techniques have been proposed to restore independent access to memory for concurrently executing virtual machines (VM), providing predictable inter-VM communication remains challenging. In this work, we tackle the problem of predictably transferring data between virtual machines and virtualized hardware resources on multiprocessor systems on chips under consideration of memory interference. We design a “broker-based” real-time communication framework for otherwise isolated virtual machines, provide a virtio-based reference implementation on top of the Jailhouse hypervisor, assess its overheads for FreeRTOS virtual machines, and formally analyze its communication flow schedulability under consideration of the implementation overheads. Furthermore, we define a methodology to assess the maximum DRAM memory saturation empirically, evaluate the framework’s performance and compare it with the theoretical schedulability. ER -
%0 Conference Paper %A Schwaricke, Gero %A Tabish, Rohan %A Pellizzoni, Rodolfo %A Mancuso, Renato %A Bastoni, Andrea %A Zuepke, Alexander %A Caccamo, Marco %T A Real-Time virtio-based Framework for Predictable Inter-VM Communication %B 42nd IEEE Real-Time Systems Symposium (RTSS 2021) %D 2021 %P 27-40 %C Dortmund, Germany %R 10.1109/RTSS52674.2021.00015 %U https://doi.org/10.1109/RTSS52674.2021.00015 %X Ensuring real-time properties on current heterogeneous multiprocessor systems on a chip is a challenging task. Furthermore, online artificial intelligent applications –which are routinely deployed on such chips– pose increasing pressure on the memory subsystem that becomes a source of unpredictability. Although techniques have been proposed to restore independent access to memory for concurrently executing virtual machines (VM), providing predictable inter-VM communication remains challenging. In this work, we tackle the problem of predictably transferring data between virtual machines and virtualized hardware resources on multiprocessor systems on chips under consideration of memory interference. We design a “broker-based” real-time communication framework for otherwise isolated virtual machines, provide a virtio-based reference implementation on top of the Jailhouse hypervisor, assess its overheads for FreeRTOS virtual machines, and formally analyze its communication flow schedulability under consideration of the implementation overheads. Furthermore, we define a methodology to assess the maximum DRAM memory saturation empirically, evaluate the framework’s performance and compare it with the theoretical schedulability.
[
{
"id": "virtio_rtss21",
"type": "paper-conference",
"title": "A Real-Time virtio-based Framework for Predictable Inter-VM Communication",
"author": [
{
"family": "Schwaricke",
"given": "Gero"
},
{
"family": "Tabish",
"given": "Rohan"
},
{
"family": "Pellizzoni",
"given": "Rodolfo"
},
{
"family": "Mancuso",
"given": "Renato"
},
{
"family": "Bastoni",
"given": "Andrea"
},
{
"family": "Zuepke",
"given": "Alexander"
},
{
"family": "Caccamo",
"given": "Marco"
}
],
"container-title": "42nd IEEE Real-Time Systems Symposium (RTSS 2021)",
"issued": {
"date-parts": [
[
2021,
12
]
]
},
"page": "27-40",
"publisher-place": "Dortmund, Germany",
"DOI": "10.1109/RTSS52674.2021.00015",
"abstract": "Ensuring real-time properties on current heterogeneous multiprocessor systems on a chip is a challenging task. Furthermore, online artificial intelligent applications –which are routinely deployed on such chips– pose increasing pressure on the memory subsystem that becomes a source of unpredictability. Although techniques have been proposed to restore independent access to memory for concurrently executing virtual machines (VM), providing predictable inter-VM communication remains challenging. In this work, we tackle the problem of predictably transferring data between virtual machines and virtualized hardware resources on multiprocessor systems on chips under consideration of memory interference. We design a “broker-based” real-time communication framework for otherwise isolated virtual machines, provide a virtio-based reference implementation on top of the Jailhouse hypervisor, assess its overheads for FreeRTOS virtual machines, and formally analyze its communication flow schedulability under consideration of the implementation overheads. Furthermore, we define a methodology to assess the maximum DRAM memory saturation empirically, evaluate the framework’s performance and compare it with the theoretical schedulability."
}
]
G. Schwaricke, R. Tabish, R. Pellizzoni, R. Mancuso, A. Bastoni, A. Zuepke, and M. Caccamo, “A Real-Time virtio-based Framework for Predictable Inter-VM Communication,” in 42nd IEEE Real-Time Systems Symposium (RTSS 2021), pp. 27–40, Dec. 2021, doi: 10.1109/RTSS52674.2021.00015.
Schwaricke, G., Tabish, R., Pellizzoni, R., Mancuso, R., Bastoni, A., Zuepke, A., & Caccamo, M. (2021). A Real-Time virtio-based Framework for Predictable Inter-VM Communication. In 42nd IEEE Real-Time Systems Symposium (RTSS 2021) (pp. 27–40). https://doi.org/10.1109/RTSS52674.2021.00015