mirror of https://gitlab.com/YuriAlek/vfio
Massive update, rewrite most of it. Check the changelog for more info.
yurialek
5 years ago
parent
e459a498b3
commit
652f3aa6d1
@ -0,0 +1,51 @@
|
|||||||
|
# Changelog
|
||||||
|
All notable changes to this project will be documented in this file.
|
||||||
|
|
||||||
|
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
|
||||||
|
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 2018/12/30
|
||||||
|
### Added
|
||||||
|
- [Wiki](https://gitlab.com/YuriAlek/vfio/wikis/home)
|
||||||
|
- [Edit config and script](https://gitlab.com/YuriAlek/vfio/wikis/Edit-config-and-script)
|
||||||
|
- [Home](https://gitlab.com/YuriAlek/vfio/wikis/Home)
|
||||||
|
- [Install](https://gitlab.com/YuriAlek/vfio/wikis/Install)
|
||||||
|
- [Troubleshoot](https://gitlab.com/YuriAlek/vfio/wikis/Troubleshoot)
|
||||||
|
- [Use](https://gitlab.com/YuriAlek/vfio/wikis/Use)
|
||||||
|
- [vbios](https://gitlab.com/YuriAlek/vfio/wikis/vbios)
|
||||||
|
- [scritps](/scripts)
|
||||||
|
- [dnsmasq.conf](/scripts/dnsmasq.conf)
|
||||||
|
- [macos.sh](/scripts/macos.sh)
|
||||||
|
- [macos-basic.sh](/scripts/macos-basic.sh)
|
||||||
|
- [macos-network.sh](/scripts/macos-network.sh)
|
||||||
|
- [macos-virsh.sh](/scripts/macos-virsh.sh)
|
||||||
|
- [smb.conf](/scripts/smb.conf)
|
||||||
|
- [windows-basic.sh](/scripts/windows-basic.sh)
|
||||||
|
- [windows-network.sh](/scripts/windows-network.sh)
|
||||||
|
- [windows-virsh.sh](/scripts/windows-virsh.sh)
|
||||||
|
- [Changelog](/CHANGELOG.md)
|
||||||
|
|
||||||
|
### Changed
|
||||||
|
- [scripts](/scripts)
|
||||||
|
- [config](/scripts/config)
|
||||||
|
- [extract-vbios-linux.sh](/scripts/extract-vbios-linux.sh)
|
||||||
|
- [extract-vbios-nvflash.sh](/scripts/extract-vbios-nvflash.sh)
|
||||||
|
- [windows.sh](/scripts/windows.sh)
|
||||||
|
- [README.md](/README.md)
|
||||||
|
|
||||||
|
### Removed
|
||||||
|
- scripts
|
||||||
|
- config-macos
|
||||||
|
- macos-hs-install.md
|
||||||
|
- macos-hs.sh
|
||||||
|
- network.sh
|
||||||
|
- qemu-mac@.service
|
||||||
|
- qemu@.service
|
||||||
|
- test-qemu.sh
|
||||||
|
- windows-install.sh
|
||||||
|
- Troubleshoot.md [Moved to wiki]()
|
||||||
|
- Install.md [Moved to wiki]()
|
||||||
|
|
||||||
|
---
|
||||||
@ -1,49 +0,0 @@
|
|||||||
# Install guide for QEMU and VFIO
|
|
||||||
## ArchLinux
|
|
||||||
### Install the necessary packages
|
|
||||||
```
|
|
||||||
# pacman -S qemu ovmf
|
|
||||||
```
|
|
||||||
|
|
||||||
### Enabling IOMMU support on boot
|
|
||||||
#### For `systemd-boot` edit `/boot/loader/entries/arch.conf` and add `intel_iommu=on` **OR** `amd_iommu=on` and `iommu=pt`.
|
|
||||||
```
|
|
||||||
# AMD
|
|
||||||
options root=/dev/sda2 amd_iommu=on iommu=pt
|
|
||||||
---------------------------------------------
|
|
||||||
# Intel
|
|
||||||
options root=/dev/sda2 intel_iommu=on iommu=pt
|
|
||||||
```
|
|
||||||
Reboot.
|
|
||||||
|
|
||||||
#### For `GRUB` edit `/etc/default/grub` and append your kernel options, `intel_iommu=on` **OR** `amd_iommu=on` and `iommu=pt`, to the `GRUB_CMDLINE_LINUX_DEFAULT`.
|
|
||||||
```
|
|
||||||
# AMD
|
|
||||||
GRUB_CMDLINE_LINUX_DEFAULT="amd_iommu=on iommu=pt"
|
|
||||||
---------------------------------------------------
|
|
||||||
# Intel
|
|
||||||
GRUB_CMDLINE_LINUX_DEFAULT="intel_iommu=on iommu=pt"
|
|
||||||
```
|
|
||||||
And then automatically re-generate the grub.cfg file with:
|
|
||||||
```
|
|
||||||
# grub-mkconfig -o /boot/grub/grub.cfg
|
|
||||||
```
|
|
||||||
Reboot.
|
|
||||||
|
|
||||||
After reboot IOMMU should be working:
|
|
||||||
```
|
|
||||||
$ dmesg | grep -e DMAR -e IOMMU
|
|
||||||
--------------------------------------------
|
|
||||||
[ 0.492684] AMD-Vi: IOMMU performance counters supported
|
|
||||||
[ 0.494370] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
|
|
||||||
[ 0.494644] perf/amd_iommu: Detected AMD IOMMU #0 (2 banks, 4 counters/bank).
|
|
||||||
```
|
|
||||||
|
|
||||||
That's everything; unlike two GPU passthrough you don't need to load kernel modules on boot.
|
|
||||||
|
|
||||||
## For more information refer to this guides
|
|
||||||
[ArchWiki QEMU](https://wiki.archlinux.org/index.php/QEMU)
|
|
||||||
|
|
||||||
[ArchWiki PCI passthrough via OVMF](https://wiki.archlinux.org/index.php/PCI_passthrough_via_OVMF)
|
|
||||||
|
|
||||||
[How to setup a gaming virtual machine with gpu passthrough qemu kvm libvirt and vfio](https://www.se7ensins.com/forums/threads/how-to-setup-a-gaming-virtual-machine-with-gpu-passthrough-qemu-kvm-libvirt-and-vfio.1371980/)
|
|
||||||
|
Before Width: | Height: | Size: 194 KiB After Width: | Height: | Size: 194 KiB |
|
Before Width: | Height: | Size: 5.9 MiB After Width: | Height: | Size: 5.9 MiB |
|
Before Width: | Height: | Size: 4.1 MiB After Width: | Height: | Size: 4.1 MiB |
|
Before Width: | Height: | Size: 5.2 KiB After Width: | Height: | Size: 5.2 KiB |
@ -1,43 +1,59 @@
|
|||||||
# User.
|
## User
|
||||||
USER=yu
|
VM_USER=
|
||||||
|
|
||||||
# Path to VBIOS, IMG, Windows ISO, Virtio iso, ...
|
## For extracting the VBIOS
|
||||||
IMAGES=/home/$USER/vm
|
VBIOS_EXTRACT_PATH=/root/VBIOS.rom
|
||||||
|
NVFLASH=/root/nvflash_linux
|
||||||
# IOMMU groups for passed devices.
|
extract_videobusid="0000:"
|
||||||
IOMMU_GPU=06:00.0
|
|
||||||
IOMMU_GPU_AUDIO=06:00.1
|
## IOMMU groups
|
||||||
IOMMU_USB=07:00.3
|
IOMMU_GPU=""
|
||||||
|
IOMMU_GPU_AUDIO=""
|
||||||
# Virsh devices, only needed if you use virsh.
|
|
||||||
VIRSH_GPU=pci_0000_06_00_0
|
## Virsh devices
|
||||||
VIRSH_GPU_AUDIO=pci_0000_06_00_1
|
VIRSH_GPU=pci_0000_
|
||||||
VIRSH_USB=pci_0000_07_00_3
|
VIRSH_GPU_AUDIO=pci_0000_
|
||||||
|
|
||||||
# PCI BUS ID for binding/unbinding devices.
|
# PCI BUS ID
|
||||||
videoid="10de 1184"
|
videoid=""
|
||||||
audioid="10de 0e0a"
|
audioid=""
|
||||||
usbid="1022 145f"
|
videobusid="0000:$IOMMU_GPU"
|
||||||
videobusid="0000:06:00.0"
|
audiobusid="0000:$IOMMU_GPU_AUDIO"
|
||||||
audiobusid="0000:06:00.1"
|
|
||||||
usbbusid="0000:07:00.3"
|
## QEMU options
|
||||||
|
RAM=8G
|
||||||
# Images needed for QEMU.
|
CORES=8
|
||||||
VBIOS=$IMAGES/GK104_80.04.C3.00.0F-MODED.rom
|
MACOS_RAM=8G
|
||||||
IMG=$IMAGES/windows.raw
|
MACOS_CORES=4
|
||||||
VIRTIO=$IMAGES/virtio.iso
|
|
||||||
ISO=$IMAGES/win10.iso
|
## Network
|
||||||
HDD=/dev/sdc
|
TAP_INTERFACE=tap0
|
||||||
|
TAP_IP="10.10.10.1/24"
|
||||||
|
DNSMASQ_CONF="${BASH_SOURCE%/*}/dnsmasq.conf"
|
||||||
|
SMB_CONF="${BASH_SOURCE%/*}/smb.conf"
|
||||||
|
|
||||||
|
## Log file
|
||||||
|
LOG=/home/$VM_USER/qemu_log.txt
|
||||||
|
|
||||||
|
## Local path for storage
|
||||||
|
IMAGES=/home/$VM_USER/
|
||||||
|
|
||||||
|
## Windows and MacOS
|
||||||
|
VBIOS=$IMAGES/VBIOS.rom
|
||||||
OVMF=/usr/share/ovmf/x64/OVMF_CODE.fd
|
OVMF=/usr/share/ovmf/x64/OVMF_CODE.fd
|
||||||
|
OVMF_VARS=/usr/share/ovmf/x64/OVMF_VARS.fd
|
||||||
|
|
||||||
# QEMU options
|
## Windows
|
||||||
RAM=12G
|
VIRTIO=$IMAGES/virtio.iso
|
||||||
CORES=12
|
WINDOWS_ISO=$IMAGES/win10.iso
|
||||||
|
WINDOWS_IMG=$IMAGES/windows.raw
|
||||||
|
|
||||||
# To run QEMU as user you need to allow more RAM to be locked by an user.
|
## MacOS
|
||||||
ULIMIT=$(ulimit -a | grep "max locked memory" | awk '{print $6}')
|
MACOS_ISO=$IMAGES/mojave.iso
|
||||||
|
MACOS_IMG=$IMAGES/mojave.raw
|
||||||
|
MACOS_CLOVER=$IMAGES/clover.qcow2
|
||||||
|
MACOS_OPTIONS="+pcid,+ssse3,+sse4.2,+popcnt,+aes,+xsave,+avx,+xsaveopt,avx2,+smep,check"
|
||||||
|
|
||||||
## Network stuff
|
## Ulimit
|
||||||
TAP_INTERFACE=tap0
|
ULIMIT=$(ulimit -a | grep "max locked memory" | awk '{print $6}')
|
||||||
DNSMASQ_CONF=dnsmasq.conf
|
ULIMIT_TARGET=$(( $(echo $RAM | tr -d 'G')*1048576+100000 ))
|
||||||
SMB_CONF=smb.conf
|
|
||||||
|
|||||||
@ -1,47 +0,0 @@
|
|||||||
# User.
|
|
||||||
USER=yu
|
|
||||||
|
|
||||||
# Path to VBIOS, IMG, Mac OS ISO, Virtio iso, Clover, OVMF, ...
|
|
||||||
IMAGES=/home/$USER/vm
|
|
||||||
|
|
||||||
# IOMMU groups for passed devices.
|
|
||||||
IOMMU_GPU=06:00.0
|
|
||||||
IOMMU_GPU_AUDIO=06:00.1
|
|
||||||
IOMMU_USB=07:00.3
|
|
||||||
|
|
||||||
# Virsh devices, only needed if you use virsh.
|
|
||||||
VIRSH_GPU=pci_0000_06_00_0
|
|
||||||
VIRSH_GPU_AUDIO=pci_0000_06_00_1
|
|
||||||
VIRSH_USB=pci_0000_07_00_3
|
|
||||||
|
|
||||||
# PCI BUS ID for binding/unbinding devices.
|
|
||||||
videoid="10de 1184"
|
|
||||||
audioid="10de 0e0a"
|
|
||||||
usbid="1022 145f"
|
|
||||||
videobusid="0000:06:00.0"
|
|
||||||
audiobusid="0000:06:00.1"
|
|
||||||
usbbusid="0000:07:00.3"
|
|
||||||
|
|
||||||
# Images needed for QEMU.
|
|
||||||
VBIOS=$IMAGES/GK104_80.04.C3.00.0F-MODED.rom
|
|
||||||
IMG=$IMAGES/mac-hs.raw,id=disk,format=raw,if=none
|
|
||||||
IMG_MOJAVE=/mnt/wd/vm/hdd/macos-mojave.raw
|
|
||||||
CLOVER=$IMAGES/Clover-1080.qcow2
|
|
||||||
CLOVER_MOJAVE=/mnt/wd/vm/macos/clover-mojave.qcow2
|
|
||||||
ISO=$IMAGES/HighSierra-10.13.6-qemu.iso
|
|
||||||
OVMF=$IMAGES/OSX-KVM/OVMF_CODE.fd
|
|
||||||
OVMF_VARS=$IMAGES/OSX-KVM/OVMF_VARS.fd
|
|
||||||
|
|
||||||
# QEMU options
|
|
||||||
MY_OPTIONS="+aes,+xsave,+avx,+xsaveopt,avx2,+smep"
|
|
||||||
MOJAVE_OPTIONS="+pcid,+ssse3,+sse4.2,+popcnt,+aes,+xsave,+avx,+xsaveopt,avx2,+smep,check"
|
|
||||||
RAM=12G
|
|
||||||
CORES=4
|
|
||||||
|
|
||||||
# To run QEMU as user you need to allow more RAM to be locked by an user.
|
|
||||||
ULIMIT=$(ulimit -a | grep "max locked memory" | awk '{print $6}')
|
|
||||||
|
|
||||||
## Network stuff
|
|
||||||
TAP_INTERFACE=tap0
|
|
||||||
DNSMASQ_CONF=dnsmasq.conf
|
|
||||||
SMB_CONF=smb.conf
|
|
||||||
@ -0,0 +1,89 @@
|
|||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
## Check if the script was executed as root
|
||||||
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Remove the framebuffer and console
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
|
# Unload the Kernel Modules that use the GPU
|
||||||
|
modprobe -r nvidia_drm
|
||||||
|
modprobe -r nvidia_modeset
|
||||||
|
modprobe -r nvidia
|
||||||
|
modprobe -r snd_hda_intel
|
||||||
|
|
||||||
|
# Load the kernel module
|
||||||
|
modprobe vfio
|
||||||
|
modprobe vfio_iommu_type1
|
||||||
|
modprobe vfio-pci
|
||||||
|
|
||||||
|
## Detach the GPU
|
||||||
|
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
||||||
|
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
||||||
|
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
||||||
|
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
||||||
|
|
||||||
|
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
||||||
|
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
||||||
|
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
||||||
|
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
||||||
|
|
||||||
|
# QEMU (VM) command
|
||||||
|
qemu-system-x86_64 -runas $VM_USER -enable-kvm \
|
||||||
|
-nographic -vga none -parallel none -serial none \
|
||||||
|
-m $MACOS_RAM \
|
||||||
|
-cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,$MACOS_OPTIONS\
|
||||||
|
-machine pc-q35-2.11 \
|
||||||
|
-smp $MACOS_CORES,sockets=1,cores=$(( $MACOS_CORES / 2 )),threads=2 \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
|
-usb -device usb-kbd -device usb-tablet \
|
||||||
|
-device nec-usb-xhci,id=xhci \
|
||||||
|
-netdev user,id=net0 \
|
||||||
|
-device e1000-82545em,netdev=net0,id=net0,mac=52:54:00:c9:18:27 \
|
||||||
|
-device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" \
|
||||||
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
|
-drive if=pflash,format=raw,file=$OVMF_VARS \
|
||||||
|
-smbios type=2 \
|
||||||
|
-device ide-drive,bus=ide.2,drive=Clover \
|
||||||
|
-drive id=Clover,if=none,snapshot=on,format=qcow2,file=$MACOS_CLOVER \
|
||||||
|
-device ide-drive,bus=ide.0,drive=ISO \
|
||||||
|
-drive id=ISO,if=none,snapshot=on,media=cdrom,file=$MACOS_ISO \
|
||||||
|
-device ide-drive,bus=ide.1,drive=HDD \
|
||||||
|
-drive id=HDD,file=$MACOS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
|
|
||||||
|
# Wait for QEMU
|
||||||
|
wait
|
||||||
|
|
||||||
|
## Unload vfio
|
||||||
|
modprobe -r vfio-pci
|
||||||
|
modprobe -r vfio_iommu_type1
|
||||||
|
modprobe -r vfio
|
||||||
|
|
||||||
|
# Reload the kernel modules
|
||||||
|
modprobe snd_hda_intel
|
||||||
|
modprobe nvidia_drm
|
||||||
|
modprobe nvidia_modeset
|
||||||
|
modprobe nvidia
|
||||||
|
|
||||||
|
## Reload the framebuffer and console
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
nvidia-xconfig --query-gpu-info > /dev/null 2>&1
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
|
|
||||||
|
# Reload the Display Manager to access X
|
||||||
|
systemctl start lightdm
|
||||||
|
|
||||||
|
# Restore ulimit
|
||||||
|
ulimit -l $ULIMIT
|
||||||
@ -1,145 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Check if the script is executed as root
|
|
||||||
if [ "$EUID" -ne 0 ]
|
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
# END Check if you are sudo
|
|
||||||
|
|
||||||
source config-macos
|
|
||||||
|
|
||||||
# Memory lock limit
|
|
||||||
if [ $(ulimit -a | grep "max locked memory" | awk '{print $6}') != 12884900 ]; then
|
|
||||||
ulimit -l 12884900
|
|
||||||
fi
|
|
||||||
|
|
||||||
## Kill X and related
|
|
||||||
systemctl stop lightdm > /dev/null 2>&1
|
|
||||||
killall i3 > /dev/null 2>&1
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Kill the console to free the GPU
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 1
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Unload the Kernel Modules that use the GPU
|
|
||||||
modprobe -r nvidia_drm
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia_modeset
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia
|
|
||||||
sleep 1
|
|
||||||
modprobe -r snd_hda_intel
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Load the kernel module
|
|
||||||
modprobe vfio
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio_iommu_type1
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio-pci
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Detach the GPU from drivers and attach to vfio. Also the usb.
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# QEMU (VM) command
|
|
||||||
qemu-system-x86_64 -runas $USER -enable-kvm \
|
|
||||||
-nographic -vga none -parallel none -serial none \
|
|
||||||
-m $RAM \
|
|
||||||
-cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,$MY_OPTIONS\
|
|
||||||
-machine pc-q35-2.9 \
|
|
||||||
-smp $CORES,cores=$CORES \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
|
||||||
-device vfio-pci,host=$IOMMU_USB \
|
|
||||||
-usb -device usb-kbd -device usb-tablet \
|
|
||||||
-device nec-usb-xhci,id=xhci \
|
|
||||||
-netdev user,id=net0 \
|
|
||||||
-device e1000-82545em,netdev=net0,id=net0,mac=52:54:00:c9:18:27 \
|
|
||||||
-device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" \
|
|
||||||
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
|
||||||
-drive if=pflash,format=raw,file=$OVMF_VARS \
|
|
||||||
-smbios type=2 \
|
|
||||||
-device ide-drive,bus=ide.2,drive=Clover \
|
|
||||||
-drive id=Clover,if=none,snapshot=on,format=qcow2,file=$CLOVER \
|
|
||||||
-device ide-drive,bus=ide.1,drive=MacHDD \
|
|
||||||
-drive id=MacHDD,if=none,file=$IMG,format=raw \
|
|
||||||
-device ide-drive,bus=ide.0,drive=MacDVD \
|
|
||||||
-drive id=MacDVD,if=none,snapshot=on,media=cdrom,file=$ISO > /dev/null 2>&1 &
|
|
||||||
# END QEMU (VM) command
|
|
||||||
|
|
||||||
# Wait for QEMU to finish before continue
|
|
||||||
wait
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
|
|
||||||
# Unload the vfio module. I am lazy, this leaves the GPU without drivers
|
|
||||||
modprobe -r vfio-pci
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio_iommu_type1
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Reload the kernel modules. This loads the drivers for the GPU
|
|
||||||
modprobe snd_hda_intel
|
|
||||||
sleep 5
|
|
||||||
modprobe nvidia_drm
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia_modeset
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Bind the usb
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/xhci_hcd/bind
|
|
||||||
sleep 10
|
|
||||||
|
|
||||||
# Re-Bind EFI-Framebuffer and Re-bind to virtual consoles
|
|
||||||
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 1 > tee /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Reload the Display Manager to access X
|
|
||||||
systemctl start lightdm
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Restore the Frame Buffer
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Restore ulimit
|
|
||||||
ulimit -l $ULIMIT
|
|
||||||
@ -1,141 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Check if the script is executed as root
|
|
||||||
if [ "$EUID" -ne 0 ]
|
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
# END Check if you are sudo
|
|
||||||
|
|
||||||
source config-macos
|
|
||||||
|
|
||||||
# Memory lock limit
|
|
||||||
if [ $(ulimit -a | grep "max locked memory" | awk '{print $6}') != 12884900 ]; then
|
|
||||||
ulimit -l 12884900
|
|
||||||
fi
|
|
||||||
|
|
||||||
## Kill X and related
|
|
||||||
systemctl stop lightdm > /dev/null 2>&1
|
|
||||||
killall i3 > /dev/null 2>&1
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Kill the console to free the GPU
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 1
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Unload the Kernel Modules that use the GPU
|
|
||||||
modprobe -r nvidia_drm
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia_modeset
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia
|
|
||||||
sleep 1
|
|
||||||
modprobe -r snd_hda_intel
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Load the kernel module
|
|
||||||
modprobe vfio
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio_iommu_type1
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio-pci
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Detach the GPU from drivers and attach to vfio. Also the usb.
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
qemu-system-x86_64 -runas $USER -enable-kvm \
|
|
||||||
-nographic -vga none -parallel none -serial none \
|
|
||||||
-m $RAM \
|
|
||||||
-cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,$MY_OPTIONS\
|
|
||||||
-machine pc-q35-2.9 \
|
|
||||||
-smp $CORES,cores=$CORES \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
|
||||||
-device vfio-pci,host=$IOMMU_USB \
|
|
||||||
-usb -device usb-kbd -device usb-tablet \
|
|
||||||
-device nec-usb-xhci,id=xhci \
|
|
||||||
-netdev user,id=net0 \
|
|
||||||
-device e1000-82545em,netdev=net0,id=net0,mac=52:54:00:c9:18:27 \
|
|
||||||
-device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" \
|
|
||||||
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
|
||||||
-drive if=pflash,format=raw,file=$OVMF_VARS \
|
|
||||||
-smbios type=2 \
|
|
||||||
-device ide-drive,bus=ide.2,drive=Clover \
|
|
||||||
-drive id=Clover,if=none,snapshot=on,format=qcow2,file=$CLOVER \
|
|
||||||
-device ide-drive,bus=ide.1,drive=MacHDD \
|
|
||||||
-drive id=MacHDD,if=none,file=$IMG,format=raw > /dev/null 2>&1 &
|
|
||||||
# END QEMU (VM) command
|
|
||||||
|
|
||||||
# Wait for QEMU to finish before continue
|
|
||||||
wait
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Unload the vfio module. I am lazy, this leaves the GPU without drivers
|
|
||||||
modprobe -r vfio-pci
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio_iommu_type1
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Reload the kernel modules. This loads the drivers for the GPU
|
|
||||||
modprobe snd_hda_intel
|
|
||||||
sleep 5
|
|
||||||
modprobe nvidia_drm
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia_modeset
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Bind the usb
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/xhci_hcd/bind
|
|
||||||
sleep 10
|
|
||||||
|
|
||||||
# Re-Bind EFI-Framebuffer and Re-bind to virtual consoles
|
|
||||||
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 1 > tee /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Reload the Display Manager to access X
|
|
||||||
systemctl start lightdm
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Restore the Frame Buffer
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Restore ulimit
|
|
||||||
ulimit -l $ULIMIT
|
|
||||||
@ -0,0 +1,80 @@
|
|||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
## Check if the script was executed as root
|
||||||
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Check libvirtd
|
||||||
|
[[ $(systemctl status libvirtd | grep running) ]] || systemctl start libvirtd && LIBVIRTD=STOPPED
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Kill the console
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
|
## Detach the GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU_AUDIO
|
||||||
|
|
||||||
|
## Load vfio
|
||||||
|
modprobe vfio
|
||||||
|
modprobe vfio_iommu_type1
|
||||||
|
modprobe vfio-pci
|
||||||
|
|
||||||
|
## QEMU (VM) command
|
||||||
|
qemu-system-x86_64 -runas $VM_USER -enable-kvm \
|
||||||
|
-nographic -vga none -parallel none -serial none \
|
||||||
|
-m $MACOS_RAM \
|
||||||
|
-cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,$MACOS_OPTIONS\
|
||||||
|
-machine pc-q35-2.11 \
|
||||||
|
-smp $MACOS_CORES,sockets=1,cores=$(( $MACOS_CORES / 2 )),threads=2 \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
|
-usb -device usb-kbd -device usb-tablet \
|
||||||
|
-device nec-usb-xhci,id=xhci \
|
||||||
|
-netdev user,id=net0 \
|
||||||
|
-device e1000-82545em,netdev=net0,id=net0,mac=52:54:00:c9:18:27 \
|
||||||
|
-device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" \
|
||||||
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
|
-drive if=pflash,format=raw,file=$OVMF_VARS \
|
||||||
|
-smbios type=2 \
|
||||||
|
-device ide-drive,bus=ide.2,drive=Clover \
|
||||||
|
-drive id=Clover,if=none,snapshot=on,format=qcow2,file=$MACOS_CLOVER \
|
||||||
|
-device ide-drive,bus=ide.0,drive=ISO \
|
||||||
|
-drive id=ISO,if=none,snapshot=on,media=cdrom,file=$MACOS_ISO \
|
||||||
|
-device ide-drive,bus=ide.1,drive=HDD \
|
||||||
|
-drive id=HDD,file=$MACOS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
|
|
||||||
|
## Wait for QEMU
|
||||||
|
wait
|
||||||
|
|
||||||
|
## Unload vfio
|
||||||
|
modprobe -r vfio-pci
|
||||||
|
modprobe -r vfio_iommu_type1
|
||||||
|
modprobe -r vfio
|
||||||
|
|
||||||
|
## Reattach the GPU
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU_AUDIO
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU
|
||||||
|
|
||||||
|
## Reload the framebuffer
|
||||||
|
echo "efi-framebuffer.0" > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
|
||||||
|
## Reload the Display Manager
|
||||||
|
systemctl start lightdm
|
||||||
|
|
||||||
|
## If libvirtd was stopped then stop it
|
||||||
|
[[ $LIBVIRTD == "STOPPED" ]] && systemctl stop libvirtd
|
||||||
|
|
||||||
|
## Restore ulimit
|
||||||
|
ulimit -l $ULIMIT
|
||||||
@ -0,0 +1,130 @@
|
|||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
## Check if the script is being run as root
|
||||||
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
|
|
||||||
|
## Tap interface
|
||||||
|
tap_interface(){
|
||||||
|
tap_start(){
|
||||||
|
if [[ ! $(ip tuntap list | grep $1) ]]; then
|
||||||
|
ip tuntap add mode tap user $VM_USER name $TAP_INTERFACE
|
||||||
|
ip addr add dev $1 $TAP_IP
|
||||||
|
ip link set dev $1 up
|
||||||
|
fi
|
||||||
|
}
|
||||||
|
tap_stop(){
|
||||||
|
if [[ $(ip tuntap list | grep $1) ]]; then
|
||||||
|
ip link set dev $1 down
|
||||||
|
ip tuntap del mode tap name $TAP_INTERFACE
|
||||||
|
fi
|
||||||
|
}
|
||||||
|
if [ $1 == start ]; then tap_start $TAP_INTERFACE; elif [ $1 == stop ]; then tap_stop $TAP_INTERFACE; fi
|
||||||
|
}
|
||||||
|
|
||||||
|
## DHCP Server (DNSmasq)
|
||||||
|
dhcp_server(){
|
||||||
|
dhcp_start(){
|
||||||
|
[[ -f /var/run/dnsmasq.pid ]] || dnsmasq --conf-file=$DNSMASQ_CONF
|
||||||
|
}
|
||||||
|
dhcp_stop(){
|
||||||
|
[[ -f /var/run/dnsmasq.pid ]] && sudo kill -15 $(cat /var/run/dnsmasq.pid) && sudo rm /var/run/dnsmasq.pid
|
||||||
|
}
|
||||||
|
if [ $1 == start ]; then dhcp_start; elif [ $1 == stop ]; then dhcp_stop; fi
|
||||||
|
}
|
||||||
|
|
||||||
|
## Samba server
|
||||||
|
samba_server(){
|
||||||
|
samba_start(){
|
||||||
|
[[ -f /var/run/smbd.pid ]] || sudo smbd --configfile=$SMB_CONF
|
||||||
|
}
|
||||||
|
samba_stop(){
|
||||||
|
[[ -f /var/run/smbd.pid ]] && sudo kill -15 $(cat /var/run/smbd.pid)
|
||||||
|
}
|
||||||
|
if [ $1 == start ]; then samba_start; elif [ $1 == stop ]; then samba_stop; fi
|
||||||
|
}
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Check libvirtd
|
||||||
|
[[ $(systemctl status libvirtd | grep running) ]] || systemctl start libvirtd && LIBVIRTD=STOPPED
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Remove the framebuffer and console
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
|
## Detach the GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU_AUDIO
|
||||||
|
|
||||||
|
## Load vfio
|
||||||
|
modprobe vfio
|
||||||
|
modprobe vfio_iommu_type1
|
||||||
|
modprobe vfio-pci
|
||||||
|
|
||||||
|
## Start the network
|
||||||
|
tap_interface start
|
||||||
|
dhcp_server start
|
||||||
|
samba_server start
|
||||||
|
|
||||||
|
## QEMU (VM) command
|
||||||
|
qemu-system-x86_64 -runas $VM_USER -enable-kvm \
|
||||||
|
-nographic -vga none -parallel none -serial none \
|
||||||
|
-m $MACOS_RAM \
|
||||||
|
-cpu Penryn,kvm=on,vendor=GenuineIntel,+invtsc,vmware-cpuid-freq=on,$MACOS_OPTIONS\
|
||||||
|
-machine pc-q35-2.11 \
|
||||||
|
-smp $MACOS_CORES,sockets=1,cores=$(( $MACOS_CORES / 2 )),threads=2 \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
|
-usb -device usb-kbd -device usb-tablet \
|
||||||
|
-device nec-usb-xhci,id=xhci \
|
||||||
|
-netdev tap,id=net0,ifname=$TAP_INTERFACE,script=no,downscript=no \
|
||||||
|
-device e1000-82545em,netdev=net0,id=net0,mac=52:54:00:c9:18:27 \
|
||||||
|
-device isa-applesmc,osk="ourhardworkbythesewordsguardedpleasedontsteal(c)AppleComputerInc" \
|
||||||
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
|
-drive if=pflash,format=raw,file=$OVMF_VARS \
|
||||||
|
-smbios type=2 \
|
||||||
|
-device ide-drive,bus=ide.2,drive=Clover \
|
||||||
|
-drive id=Clover,if=none,snapshot=on,format=qcow2,file=$MACOS_CLOVER \
|
||||||
|
-device ide-drive,bus=ide.0,drive=ISO \
|
||||||
|
-drive id=ISO,if=none,snapshot=on,media=cdrom,file=$MACOS_ISO \
|
||||||
|
-device ide-drive,bus=ide.1,drive=HDD \
|
||||||
|
-drive id=HDD,file=$MACOS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
|
|
||||||
|
## Wait for QEMU
|
||||||
|
wait
|
||||||
|
|
||||||
|
## Stop the network
|
||||||
|
tap_interface stop
|
||||||
|
dhcp_server stop
|
||||||
|
samba_server stop
|
||||||
|
|
||||||
|
## Unload vfio module
|
||||||
|
modprobe -r vfio-pci
|
||||||
|
modprobe -r vfio_iommu_type1
|
||||||
|
modprobe -r vfio
|
||||||
|
|
||||||
|
## Reattach the GPU
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU_AUDIO
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU
|
||||||
|
|
||||||
|
## Reload the framebuffer and console
|
||||||
|
echo "efi-framebuffer.0" > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
|
||||||
|
## Reload the Display Manager
|
||||||
|
systemctl start lightdm
|
||||||
|
|
||||||
|
## If libvirtd was stopped then stop it
|
||||||
|
[[ $LIBVIRTD == "STOPPED" ]] && systemctl stop libvirtd
|
||||||
|
|
||||||
|
## Restore ulimit
|
||||||
|
ulimit -l $ULIMIT
|
||||||
@ -1,66 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
# Requires iproute2, dnsmasq, and firewall [iptables, shorewall, ...]
|
|
||||||
|
|
||||||
# Check if the script is executed as root
|
|
||||||
if [ "$EUID" -ne 0 ]
|
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
# END Check if you are sudo
|
|
||||||
|
|
||||||
# Variables
|
|
||||||
NIC=qemubr0
|
|
||||||
IP=10.10.10.1/24
|
|
||||||
|
|
||||||
start_network()
|
|
||||||
{
|
|
||||||
ip link add name $NIC type bridge
|
|
||||||
ip link set $NIC up
|
|
||||||
ip address add $IP dev $NIC
|
|
||||||
}
|
|
||||||
|
|
||||||
stop_network()
|
|
||||||
{
|
|
||||||
ip link set $NIC down
|
|
||||||
ip link delete $NIC type bridge
|
|
||||||
}
|
|
||||||
|
|
||||||
start_dnsmasq()
|
|
||||||
{
|
|
||||||
systemctl start dnsmasq
|
|
||||||
}
|
|
||||||
|
|
||||||
stop_dnsmasq()
|
|
||||||
{
|
|
||||||
systemctl stop dnsmasq
|
|
||||||
}
|
|
||||||
|
|
||||||
_help()
|
|
||||||
{
|
|
||||||
echo "Usage: network.sh [OPTIONS]"
|
|
||||||
echo " start - start the network"
|
|
||||||
echo " stop - stop the network"
|
|
||||||
}
|
|
||||||
|
|
||||||
_start()
|
|
||||||
{
|
|
||||||
if [ "$1" = "start" ]; then
|
|
||||||
start_network
|
|
||||||
start_dnsmasq
|
|
||||||
exit
|
|
||||||
elif [ "$1" = "stop" ]; then
|
|
||||||
stop_dnsmasq
|
|
||||||
stop_network
|
|
||||||
exit
|
|
||||||
else
|
|
||||||
_help
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
}
|
|
||||||
|
|
||||||
if [[ $1 ]]; then
|
|
||||||
_start $1
|
|
||||||
else
|
|
||||||
_help
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
@ -1,12 +0,0 @@
|
|||||||
[Unit]
|
|
||||||
Description=QEMU virtual machine (%i)
|
|
||||||
|
|
||||||
[Service]
|
|
||||||
#Type=forking
|
|
||||||
#PIDFile=/run/qemu_%i.pid
|
|
||||||
EnvironmentFile=/home/yu/scripts/config-macos
|
|
||||||
ExecStart=/home/yu/scripts/%i.sh
|
|
||||||
#TimeoutStopSec=1m
|
|
||||||
|
|
||||||
[Install]
|
|
||||||
WantedBy=multi-user.target
|
|
||||||
@ -1,12 +0,0 @@
|
|||||||
[Unit]
|
|
||||||
Description=QEMU virtual machine (%i)
|
|
||||||
|
|
||||||
[Service]
|
|
||||||
#Type=forking
|
|
||||||
#PIDFile=/run/qemu_%i.pid
|
|
||||||
EnvironmentFile=/home/yu/scripts/config
|
|
||||||
ExecStart=/home/yu/scripts/%i.sh
|
|
||||||
#TimeoutStopSec=1m
|
|
||||||
|
|
||||||
[Install]
|
|
||||||
WantedBy=multi-user.target
|
|
||||||
@ -1,159 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Check if the script is executed as root
|
|
||||||
if [ "$EUID" -ne 0 ]
|
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
# END Check if you are sudo
|
|
||||||
|
|
||||||
source config.sh
|
|
||||||
|
|
||||||
_start()
|
|
||||||
{
|
|
||||||
# Memory lock limit
|
|
||||||
if [ $(ulimit -a | grep "max locked memory" | awk '{print $6}') != 12884900 ]; then
|
|
||||||
ulimit -l 12884900
|
|
||||||
fi
|
|
||||||
|
|
||||||
## Kill X and related
|
|
||||||
systemctl stop lightdm > /dev/null 2>&1
|
|
||||||
killall i3 > /dev/null 2>&1
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Kill the console to free the GPU
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 1
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Unload the Kernel Modules that use the GPU
|
|
||||||
modprobe -r nvidia_drm
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia_modeset
|
|
||||||
sleep 1
|
|
||||||
modprobe -r nvidia
|
|
||||||
sleep 1
|
|
||||||
modprobe -r snd_hda_intel
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Load the kernel module
|
|
||||||
modprobe vfio
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio_iommu_type1
|
|
||||||
sleep 1
|
|
||||||
modprobe vfio-pci
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Detach the GPU from drivers and attach to vfio. Also the usb.
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
sleep 1
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
sleep 1
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
#ls -la /sys/bus/pci/devices/$usbbusid/
|
|
||||||
sleep 1
|
|
||||||
}
|
|
||||||
|
|
||||||
_stop()
|
|
||||||
{
|
|
||||||
# Wait for QEMU to finish before continue
|
|
||||||
wait
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Unload the vfio module. I am lazy, this leaves the GPU without drivers
|
|
||||||
modprobe -r vfio-pci
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio_iommu_type1
|
|
||||||
sleep 2
|
|
||||||
modprobe -r vfio
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
|
|
||||||
# Reload the kernel modules. This loads the drivers for the GPU
|
|
||||||
modprobe snd_hda_intel
|
|
||||||
sleep 5
|
|
||||||
modprobe nvidia_drm
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia_modeset
|
|
||||||
sleep 2
|
|
||||||
modprobe nvidia
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
# Bind the usb
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/new_id
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/xhci_hcd/bind
|
|
||||||
sleep 10
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/remove_id
|
|
||||||
#ls -la /sys/bus/pci/devices/$usbbusid/
|
|
||||||
|
|
||||||
# Re-Bind EFI-Framebuffer and Re-bind to virtual consoles
|
|
||||||
# [Source] [https://github.com/joeknock90/Single-GPU-Passthrough/blob/master/README.md#vm-stop-script]
|
|
||||||
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 1 > tee /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 5
|
|
||||||
#echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
|
||||||
#sleep 1
|
|
||||||
|
|
||||||
# Reload the Display Manager to access X
|
|
||||||
systemctl start lightdm
|
|
||||||
sleep 5
|
|
||||||
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Restore ulimit
|
|
||||||
ulimit -l $ULIMIT
|
|
||||||
}
|
|
||||||
|
|
||||||
_help()
|
|
||||||
{
|
|
||||||
echo "Usage: test-qemu.sh [OPTIONS]"
|
|
||||||
echo " start"
|
|
||||||
echo " stop"
|
|
||||||
}
|
|
||||||
|
|
||||||
_do()
|
|
||||||
{
|
|
||||||
if [ "$1" = "start" ]; then
|
|
||||||
_start
|
|
||||||
exit
|
|
||||||
elif [ "$1" = "stop" ]; then
|
|
||||||
_stop
|
|
||||||
exit
|
|
||||||
else
|
|
||||||
_help
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
}
|
|
||||||
|
|
||||||
if [[ $1 ]]; then
|
|
||||||
_do $1
|
|
||||||
else
|
|
||||||
_help
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
@ -0,0 +1,86 @@
|
|||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
## Check if the script was executed as root
|
||||||
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Remove the framebuffer and console
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
|
# Unload the Kernel Modules that use the GPU
|
||||||
|
modprobe -r nvidia_drm
|
||||||
|
modprobe -r nvidia_modeset
|
||||||
|
modprobe -r nvidia
|
||||||
|
modprobe -r snd_hda_intel
|
||||||
|
|
||||||
|
# Load the kernel module
|
||||||
|
modprobe vfio
|
||||||
|
modprobe vfio_iommu_type1
|
||||||
|
modprobe vfio-pci
|
||||||
|
|
||||||
|
## Detach the GPU
|
||||||
|
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
||||||
|
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
||||||
|
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
||||||
|
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
||||||
|
|
||||||
|
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
||||||
|
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
||||||
|
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
||||||
|
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
||||||
|
|
||||||
|
# QEMU (VM) command
|
||||||
|
qemu-system-x86_64 -runas $VM_USER -enable-kvm \
|
||||||
|
-nographic -vga none -parallel none -serial none \
|
||||||
|
-enable-kvm \
|
||||||
|
-m $RAM \
|
||||||
|
-cpu host,kvm=off,hv_relaxed,hv_spinlocks=0x1fff,hv_time,hv_vapic,hv_vendor_id=0xDEADBEEFFF \
|
||||||
|
-rtc clock=host,base=localtime \
|
||||||
|
-smp $CORES,sockets=1,cores=$(( $CORES / 2 )),threads=2 \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
|
-device virtio-net-pci,netdev=n1 \
|
||||||
|
-netdev user,id=n1 \
|
||||||
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
|
-drive media=cdrom,file=$WINDOWS_ISO,id=cd1,if=none \
|
||||||
|
-device ide-cd,bus=ide.1,drive=cd1 \
|
||||||
|
-drive media=cdrom,file=$VIRTIO,id=cd2,if=none \
|
||||||
|
-device ide-cd,bus=ide.1,drive=cd2 \
|
||||||
|
-device virtio-scsi-pci,id=scsi0 \
|
||||||
|
-device scsi-hd,bus=scsi0.0,drive=rootfs \
|
||||||
|
-drive id=rootfs,file=$WINDOWS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
|
|
||||||
|
# Wait for QEMU
|
||||||
|
wait
|
||||||
|
|
||||||
|
## Unload vfio
|
||||||
|
modprobe -r vfio-pci
|
||||||
|
modprobe -r vfio_iommu_type1
|
||||||
|
modprobe -r vfio
|
||||||
|
|
||||||
|
# Reload the kernel modules
|
||||||
|
modprobe snd_hda_intel
|
||||||
|
modprobe nvidia_drm
|
||||||
|
modprobe nvidia_modeset
|
||||||
|
modprobe nvidia
|
||||||
|
|
||||||
|
## Reload the framebuffer and console
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
nvidia-xconfig --query-gpu-info > /dev/null 2>&1
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
|
|
||||||
|
# Reload the Display Manager to access X
|
||||||
|
systemctl start lightdm
|
||||||
|
|
||||||
|
# Restore ulimit
|
||||||
|
ulimit -l $ULIMIT
|
||||||
@ -1,115 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Check if the script is executed as root
|
|
||||||
if [ "$EUID" -ne 0 ]
|
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
|
||||||
fi
|
|
||||||
# END Check if you are sudo
|
|
||||||
|
|
||||||
source config
|
|
||||||
|
|
||||||
# Memory lock limit
|
|
||||||
if [ $(ulimit -a | grep "max locked memory" | awk '{print $6}') != $(( $(echo $RAM | tr -d 'G')*1048576+10 )) ]; then
|
|
||||||
ulimit -l $(( $(echo $RAM | tr -d 'G')*1048576+10 ))
|
|
||||||
fi
|
|
||||||
|
|
||||||
## Kill X and related
|
|
||||||
systemctl stop lightdm > /dev/null 2>&1
|
|
||||||
killall i3 > /dev/null 2>&1
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Kill the console to free the GPU
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
|
||||||
|
|
||||||
# Unload the Kernel Modules that use the GPU
|
|
||||||
modprobe -r nvidia_drm
|
|
||||||
modprobe -r nvidia_modeset
|
|
||||||
modprobe -r nvidia
|
|
||||||
modprobe -r snd_hda_intel
|
|
||||||
|
|
||||||
# Load the kernel module
|
|
||||||
modprobe vfio
|
|
||||||
modprobe vfio_iommu_type1
|
|
||||||
modprobe vfio-pci
|
|
||||||
|
|
||||||
# Detach the GPU from drivers and attach to vfio. Also the usb.
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
|
||||||
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
|
||||||
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
# QEMU (VM) command
|
|
||||||
qemu-system-x86_64 -runas $USER -enable-kvm \
|
|
||||||
-nographic -vga none -parallel none -serial none \
|
|
||||||
-enable-kvm \
|
|
||||||
-m $RAM \
|
|
||||||
-cpu host,kvm=off,hv_relaxed,hv_spinlocks=0x1fff,hv_time,hv_vapic,hv_vendor_id=0xDEADBEEFFF \
|
|
||||||
-rtc clock=host,base=localtime \
|
|
||||||
-smp $CORES,sockets=1,cores=$CORES,threads=0 \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
|
||||||
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
|
||||||
-device vfio-pci,host=$IOMMU_USB \
|
|
||||||
-device virtio-net-pci,netdev=n1 \
|
|
||||||
-netdev user,id=n1 \
|
|
||||||
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
|
||||||
-drive media=cdrom,file=$ISO,id=virtiocd1,if=none \
|
|
||||||
-device ide-cd,bus=ide.1,drive=virtiocd1 \
|
|
||||||
-drive media=cdrom,file=$VIRTIO,id=virtiocd2,if=none \
|
|
||||||
-device ide-cd,bus=ide.1,drive=virtiocd2 \
|
|
||||||
-device virtio-scsi-pci,id=scsi0 \
|
|
||||||
-device scsi-hd,bus=scsi0.0,drive=rootfs \
|
|
||||||
-drive id=rootfs,file=$HDD,media=disk,format=raw,if=none > /dev/null 2>&1 &
|
|
||||||
# END QEMU (VM) command
|
|
||||||
|
|
||||||
# Wait for QEMU to finish before continue
|
|
||||||
wait
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Unload the vfio module. I am lazy, this leaves the GPU without drivers
|
|
||||||
modprobe -r vfio-pci
|
|
||||||
modprobe -r vfio_iommu_type1
|
|
||||||
modprobe -r vfio
|
|
||||||
|
|
||||||
# Reload the kernel modules. This loads the drivers for the GPU
|
|
||||||
modprobe snd_hda_intel
|
|
||||||
modprobe nvidia_drm
|
|
||||||
modprobe nvidia_modeset
|
|
||||||
modprobe nvidia
|
|
||||||
|
|
||||||
# Bind the usb
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/new_id
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/xhci_hcd/bind
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/remove_id
|
|
||||||
#ls -la /sys/bus/pci/devices/$usbbusid/
|
|
||||||
|
|
||||||
# Re-Bind EFI-Framebuffer and Re-bind to virtual consoles
|
|
||||||
# [Source] [https://github.com/joeknock90/Single-GPU-Passthrough/blob/master/README.md#vm-stop-script]
|
|
||||||
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
|
||||||
sleep 1
|
|
||||||
echo 1 > tee /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Reload the Display Manager to access X
|
|
||||||
systemctl start lightdm
|
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Restore the Frame Buffer
|
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Restore ulimit
|
|
||||||
ulimit -l $ULIMIT
|
|
||||||
@ -0,0 +1,77 @@
|
|||||||
|
#!/bin/bash
|
||||||
|
|
||||||
|
## Check if the script was executed as root
|
||||||
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Check libvirtd
|
||||||
|
[[ $(systemctl status libvirtd | grep running) ]] || systemctl start libvirtd && LIBVIRTD=STOPPED
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Kill the console
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
|
## Detach the GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU
|
||||||
|
virsh nodedev-detach $VIRSH_GPU_AUDIO
|
||||||
|
|
||||||
|
## Load vfio
|
||||||
|
modprobe vfio
|
||||||
|
modprobe vfio_iommu_type1
|
||||||
|
modprobe vfio-pci
|
||||||
|
|
||||||
|
## QEMU (VM) command
|
||||||
|
qemu-system-x86_64 -runas $VM_USER -enable-kvm \
|
||||||
|
-nographic -vga none -parallel none -serial none \
|
||||||
|
-enable-kvm \
|
||||||
|
-m $RAM \
|
||||||
|
-cpu host,kvm=off,hv_relaxed,hv_spinlocks=0x1fff,hv_time,hv_vapic,hv_vendor_id=0xDEADBEEFFF \
|
||||||
|
-rtc clock=host,base=localtime \
|
||||||
|
-smp $CORES,sockets=1,cores=$(( $CORES / 2 )),threads=2 \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
|
-device virtio-net-pci,netdev=n1 \
|
||||||
|
-netdev user,id=n1 \
|
||||||
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
|
-drive media=cdrom,file=$WINDOWS_ISO,id=cd1,if=none \
|
||||||
|
-device ide-cd,bus=ide.1,drive=cd1 \
|
||||||
|
-drive media=cdrom,file=$VIRTIO,id=cd2,if=none \
|
||||||
|
-device ide-cd,bus=ide.1,drive=cd2 \
|
||||||
|
-device virtio-scsi-pci,id=scsi0 \
|
||||||
|
-device scsi-hd,bus=scsi0.0,drive=rootfs \
|
||||||
|
-drive id=rootfs,file=$WINDOWS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
|
|
||||||
|
## Wait for QEMU
|
||||||
|
wait
|
||||||
|
|
||||||
|
## Unload vfio
|
||||||
|
modprobe -r vfio-pci
|
||||||
|
modprobe -r vfio_iommu_type1
|
||||||
|
modprobe -r vfio
|
||||||
|
|
||||||
|
## Reattach the GPU
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU_AUDIO
|
||||||
|
virsh nodedev-reattach $VIRSH_GPU
|
||||||
|
|
||||||
|
## Reload the framebuffer
|
||||||
|
echo "efi-framebuffer.0" > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
|
echo 1 > /sys/class/vtconsole/vtcon1/bind
|
||||||
|
|
||||||
|
## Reload the Display Manager
|
||||||
|
systemctl start lightdm
|
||||||
|
|
||||||
|
## If libvirtd was stopped then stop it
|
||||||
|
[[ $LIBVIRTD == "STOPPED" ]] && systemctl stop libvirtd
|
||||||
|
|
||||||
|
## Restore ulimit
|
||||||
|
ulimit -l $ULIMIT
|
||||||
@ -1,111 +1,126 @@
|
|||||||
#!/bin/bash
|
#!/bin/bash
|
||||||
|
|
||||||
# Check if the script is executed as root
|
## Check if the script is being run as root
|
||||||
if [ "$EUID" -ne 0 ]
|
[[ "$EUID" -ne 0 ]] && echo "Please run as root" && exit 1
|
||||||
then echo "Please run as root"
|
|
||||||
exit 1
|
## Tap interface
|
||||||
fi
|
tap_interface(){
|
||||||
# END Check if you are sudo
|
tap_start(){
|
||||||
|
if [[ ! $(ip tuntap list | grep $1) ]]; then
|
||||||
source config
|
ip tuntap add mode tap user $USER name $TAP_INTERFACE
|
||||||
|
ip addr add dev $1 $TAP_IP
|
||||||
# Memory lock limit.
|
ip link set dev $1 up
|
||||||
if [ $(ulimit -a | grep "max locked memory" | awk '{print $6}') != $(( $(echo $RAM | tr -d 'G')*1048576+10 )) ]; then
|
fi
|
||||||
ulimit -l $(( $(echo $RAM | tr -d 'G')*1048576+10 ))
|
}
|
||||||
fi
|
tap_stop(){
|
||||||
|
if [[ $(ip tuntap list | grep $1) ]]; then
|
||||||
## Kill X and related
|
ip link set dev $1 down
|
||||||
systemctl stop lightdm > /dev/null 2>&1
|
ip tuntap del mode tap name $TAP_INTERFACE
|
||||||
killall i3 > /dev/null 2>&1
|
fi
|
||||||
sleep 2
|
}
|
||||||
|
if [ $1 == start ]; then tap_start $TAP_INTERFACE; elif [ $1 == stop ]; then tap_stop $TAP_INTERFACE; fi
|
||||||
# Kill the console to free the GPU
|
}
|
||||||
|
|
||||||
|
## DHCP Server (DNSmasq)
|
||||||
|
dhcp_server(){
|
||||||
|
dhcp_start(){
|
||||||
|
[[ -f /var/run/dnsmasq.pid ]] || dnsmasq --conf-file=$DNSMASQ_CONF
|
||||||
|
}
|
||||||
|
dhcp_stop(){
|
||||||
|
[[ -f /var/run/dnsmasq.pid ]] && sudo kill -15 $(cat /var/run/dnsmasq.pid) && sudo rm /var/run/dnsmasq.pid
|
||||||
|
}
|
||||||
|
if [ $1 == start ]; then dhcp_start; elif [ $1 == stop ]; then dhcp_stop; fi
|
||||||
|
}
|
||||||
|
|
||||||
|
## Samba server
|
||||||
|
samba_server(){
|
||||||
|
samba_start(){
|
||||||
|
[[ -f /var/run/smbd.pid ]] || sudo smbd --configfile=$SMB_CONF
|
||||||
|
}
|
||||||
|
samba_stop(){
|
||||||
|
[[ -f /var/run/smbd.pid ]] && sudo kill -15 $(cat /var/run/smbd.pid)
|
||||||
|
}
|
||||||
|
if [ $1 == start ]; then samba_start; elif [ $1 == stop ]; then samba_stop; fi
|
||||||
|
}
|
||||||
|
|
||||||
|
## Load the config file
|
||||||
|
source "${BASH_SOURCE%/*}/config"
|
||||||
|
|
||||||
|
## Check libvirtd
|
||||||
|
[[ $(systemctl status libvirtd | grep running) ]] || systemctl start libvirtd && LIBVIRTD=STOPPED
|
||||||
|
|
||||||
|
## Memory lock limit
|
||||||
|
[[ $ULIMIT != $ULIMIT_TARGET ]] && ulimit -l $ULIMIT_TARGET
|
||||||
|
|
||||||
|
## Kill the Display Manager
|
||||||
|
systemctl stop lightdm
|
||||||
|
|
||||||
|
## Remove the framebuffer and console
|
||||||
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
echo 0 > /sys/class/vtconsole/vtcon0/bind
|
||||||
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
echo 0 > /sys/class/vtconsole/vtcon1/bind
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/unbind
|
||||||
|
|
||||||
# Unload the Kernel Modules that use the GPU
|
## Detach the GPU
|
||||||
modprobe -r nvidia_drm
|
virsh nodedev-detach $VIRSH_GPU
|
||||||
modprobe -r nvidia_modeset
|
virsh nodedev-detach $VIRSH_GPU_AUDIO
|
||||||
modprobe -r nvidia
|
|
||||||
modprobe -r snd_hda_intel
|
|
||||||
|
|
||||||
# Load the kernel module
|
## Load vfio
|
||||||
modprobe vfio
|
modprobe vfio
|
||||||
modprobe vfio_iommu_type1
|
modprobe vfio_iommu_type1
|
||||||
modprobe vfio-pci
|
modprobe vfio-pci
|
||||||
|
|
||||||
# Detach the GPU from drivers and attach to vfio. Also the usb.
|
## Start the network
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/new_id
|
tap_interface start
|
||||||
echo $videobusid > /sys/bus/pci/devices/$videobusid/driver/unbind
|
dhcp_server start
|
||||||
echo $videobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
samba_server start
|
||||||
echo $videoid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/new_id
|
## QEMU (VM) command
|
||||||
echo $audiobusid > /sys/bus/pci/devices/$audiobusid/driver/unbind
|
|
||||||
echo $audiobusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
echo $audioid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/new_id
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/vfio-pci/bind
|
|
||||||
echo $usbid > /sys/bus/pci/drivers/vfio-pci/remove_id
|
|
||||||
|
|
||||||
# QEMU (VM) command
|
|
||||||
qemu-system-x86_64 -runas $USER -enable-kvm \
|
qemu-system-x86_64 -runas $USER -enable-kvm \
|
||||||
-nographic -vga none -parallel none -serial none \
|
-nographic -vga none -parallel none -serial none \
|
||||||
-enable-kvm \
|
-m $RAM \
|
||||||
-m $RAM \
|
-cpu host,kvm=off,hv_relaxed,hv_spinlocks=0x1fff,hv_time,hv_vapic,hv_vendor_id=0xDEADBEEFFF \
|
||||||
-cpu host,kvm=off,hv_relaxed,hv_spinlocks=0x1fff,hv_time,hv_vapic,hv_vendor_id=0xDEADBEEFFF \
|
-rtc clock=host,base=localtime \
|
||||||
-rtc clock=host,base=localtime \
|
-smp $CORES,sockets=1,cores=$(( $CORES / 2 )),threads=2 \
|
||||||
-smp $CORES,sockets=1,cores=$CORES,threads=0 \
|
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
||||||
-device vfio-pci,host=$IOMMU_GPU,multifunction=on,x-vga=on,romfile=$VBIOS \
|
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
||||||
-device vfio-pci,host=$IOMMU_GPU_AUDIO \
|
-device virtio-net-pci,netdev=net0 \
|
||||||
-device vfio-pci,host=$IOMMU_USB \
|
-netdev tap,id=net0,ifname=$TAP_INTERFACE,script=no,downscript=no,vhost=on \
|
||||||
-device virtio-net-pci,netdev=n1 \
|
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
||||||
-netdev user,id=n1 \
|
-drive media=cdrom,file=$WINDOWS_ISO,id=cd1,if=none \
|
||||||
-drive if=pflash,format=raw,readonly,file=$OVMF \
|
-device ide-cd,bus=ide.1,drive=cd1 \
|
||||||
-device virtio-scsi-pci,id=scsi0 \
|
-drive media=cdrom,file=$VIRTIO,id=cd2,if=none \
|
||||||
-device scsi-hd,bus=scsi0.0,drive=rootfs \
|
-device ide-cd,bus=ide.1,drive=cd2 \
|
||||||
-drive id=rootfs,file=$HDD,media=disk,format=raw,if=none > /dev/null 2>&1 &
|
-device virtio-scsi-pci,id=scsi0 \
|
||||||
# END QEMU (VM) command
|
-device scsi-hd,bus=scsi0.0,drive=rootfs \
|
||||||
|
-drive id=rootfs,file=$WINDOWS_IMG,media=disk,format=raw,if=none >> $LOG 2>&1 &
|
||||||
# Wait for QEMU to finish before continue
|
|
||||||
|
## Wait for QEMU
|
||||||
wait
|
wait
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Unload the vfio module. I am lazy, this leaves the GPU without drivers
|
## Stop the network
|
||||||
|
tap_interface stop
|
||||||
|
dhcp_server stop
|
||||||
|
samba_server stop
|
||||||
|
|
||||||
|
## Unload vfio module
|
||||||
modprobe -r vfio-pci
|
modprobe -r vfio-pci
|
||||||
modprobe -r vfio_iommu_type1
|
modprobe -r vfio_iommu_type1
|
||||||
modprobe -r vfio
|
modprobe -r vfio
|
||||||
|
|
||||||
# Reload the kernel modules. This loads the drivers for the GPU
|
## Reattach the GPU
|
||||||
modprobe snd_hda_intel
|
virsh nodedev-reattach $VIRSH_GPU_AUDIO
|
||||||
modprobe nvidia_drm
|
virsh nodedev-reattach $VIRSH_GPU
|
||||||
modprobe nvidia_modeset
|
|
||||||
modprobe nvidia
|
## Reload the framebuffer and console
|
||||||
|
echo "efi-framebuffer.0" > /sys/bus/platform/drivers/efi-framebuffer/bind
|
||||||
# Bind the usb
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/new_id
|
|
||||||
echo $usbbusid > /sys/bus/pci/devices/$usbbusid/driver/unbind
|
|
||||||
echo $usbbusid > /sys/bus/pci/drivers/xhci_hcd/bind
|
|
||||||
#echo $usbid > /sys/bus/pci/drivers/xhci_hcd/remove_id
|
|
||||||
#ls -la /sys/bus/pci/devices/$usbbusid/
|
|
||||||
|
|
||||||
# Re-Bind EFI-Framebuffer and Re-bind to virtual consoles
|
|
||||||
# [Source] [https://github.com/joeknock90/Single-GPU-Passthrough/blob/master/README.md#vm-stop-script]
|
|
||||||
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
echo 1 > /sys/class/vtconsole/vtcon0/bind
|
||||||
sleep 1
|
echo 1 > /sys/class/vtconsole/vtcon1/bind
|
||||||
echo 1 > tee /sys/class/vtconsole/vtcon1/bind
|
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Reload the Display Manager to access X
|
## Reload the Display Manager
|
||||||
systemctl start lightdm
|
systemctl start lightdm
|
||||||
sleep 2
|
|
||||||
|
|
||||||
# Restore the Frame Buffer
|
## If libvirtd was stopped then stop it
|
||||||
echo efi-framebuffer.0 > /sys/bus/platform/drivers/efi-framebuffer/bind
|
[[ $LIBVIRTD == "STOPPED" ]] && systemctl stop libvirtd
|
||||||
sleep 1
|
|
||||||
|
|
||||||
# Restore ulimit
|
## Restore ulimit
|
||||||
ulimit -l $ULIMIT
|
ulimit -l $ULIMIT
|
||||||
|
|||||||
@ -1,16 +0,0 @@
|
|||||||
# Troubleshooting
|
|
||||||
|
|
||||||
## QEMU can not allocate memory
|
|
||||||
|
|
||||||
```
|
|
||||||
qemu-system-x86_64: VFIO_MAP_DMA: -12
|
|
||||||
qemu-system-x86_64: vfio_dma_map(0x7fae44695a00, 0xc0000000, 0x40000, 0x7fab29e00000) = -12 (Cannot allocate memory)
|
|
||||||
qemu: hardware error: vfio: DMA mapping failed, unable to continue
|
|
||||||
```
|
|
||||||
|
|
||||||
Solution:
|
|
||||||
```
|
|
||||||
ulimit -l $(( $(echo $RAM | tr -d 'G')*1048576+10 ))
|
|
||||||
```
|
|
||||||
|
|
||||||
Note: This is already addressed in the `windows.sh` script.
|
|
||||||
Loading…
Reference in New Issue