Kyle Howells kylehowells

Displaying HDMI sources on Apple Vision Pro

While it's possible to stream most content to Apple Vision Pro directly over the internet, having the ability to use Apple Vision Pro as an HDMI display can still be useful.

Since Apple Vision Pro does not support connecting to an HDMI input directly or using an HDMI capture card, we have to be a little creative to make this work. NDI provides the ability to stream HDMI content over a local network with really low latency, and it works great with Apple Vision Pro.

This page shows the setup I’m using.

Cloud Gaming on Apple Vision Pro

Cloud Gaming is a great way to enjoy graphically demanding games on Apple Vision Pro.

Since Safari on visionOS does not support PWA mode, here is how you can access cloud gaming services on Apple Vision Pro.

What’s needed

A compatible game controller

What the built-in font styles correspond to on iOS and macOS:

Style	iOS Default	macOS	macOS Emphasized
.largeTitle	Regular 34	Regular 26	Bold
.title	Regular 28	Regular 22	Bold
.title2	Regular 22	Regular 17	Bold
.title3	Regular 20	Regular 15	Semibold
.headline	Semibold 17	Bold 13	Heavy
.body	Regular 17	Regular 13	Semibold

	import Foundation
	import SwiftUI
	import UIKit

	extension UIBlurEffect {
	public static func variableBlurEffect(radius: Double, imageMask: UIImage) -> UIBlurEffect? {
	let methodType = (@convention(c) (AnyClass, Selector, Double, UIImage) -> UIBlurEffect).self
	let selectorName = ["imageMask:", "effectWithVariableBlurRadius:"].reversed().joined()
	let selector = NSSelectorFromString(selectorName)

	// 3D Dom viewer, copy-paste this into your console to visualise the DOM as a stack of solid blocks.
	// You can also minify and save it as a bookmarklet (https://www.freecodecamp.org/news/what-are-bookmarklets/)
	(() => {
	const SHOW_SIDES = false; // color sides of DOM nodes?
	const COLOR_SURFACE = true; // color tops of DOM nodes?
	const COLOR_RANDOM = false; // randomise color?
	const COLOR_HUE = 190; // hue in HSL (https://hslpicker.com)
	const MAX_ROTATION = 180; // set to 360 to rotate all the way round
	const THICKNESS = 20; // thickness of layers
	const DISTANCE = 10000; // ¯\\_(ツ)_/¯

	import UIKit
	import MetalKit

	class ViewController: UIViewController {
	override func viewDidAppear(_ animated: Bool) {
	super.viewDidAppear(animated)

	let imageView = UIImageView(image: UIImage(named: "landscape.jpeg"))
	imageView.frame = CGRect(x: 0, y: 200, width: 350, height: 197)
	view.addSubview(imageView)

	//
	// VolumePopupView.swift
	//
	// Created by Alex Rosenberg on 1/24/24.
	//

	import SwiftUI
	import AVFoundation
	import MediaPlayer

	//
	// MeshEntity+GenerateSolidInteriorModel.swift
	//
	// Created by Drew Olbrich on 12/16/23.
	// Copyright © 2023 Lunar Skydiving LLC. All rights reserved.
	//
	// MIT License
	//
	// Permission is hereby granted, free of charge, to any person obtaining a copy
	// of this software and associated documentation files (the "Software"), to deal

	// Lines
	float hash( float n ) {
	return fract(sin(n)*753.5453123);
	}

	// Slight modification of iq's noise function.
	float noise(vector_float2 x )
	{
	vector_float2 p = floor(x);
	vector_float2 f = fract(x);

	# 2023-11-27 MIT LICENSE

	Here's the open source version of my ChatGPT game MonkeyIslandAmsterdam.com.

	It's an unofficial image+text-based adventure game edition of Monkey Island in Amsterdam, my home town.

	Please use it however you want. It'd be nice to see more ChatGPT-based games appear from this. If you get inspired by it, please link back to my X https://x.com/levelsio or this Gist so more people can do the same!

	Send me your ChatGPT text adventure game on X, I'd love to try it!