Amazed (and concerned by the future it leads to) by the launch of Apple Vision Pro headset yesterday, I decided to check with ChatGPT to see if it’s able to foresee what was coming and comment on the device. I wouldn’t say it’s all-knowing given it’s also limited by its database cut off in 2021 September, but some of the answers I got are quite surprising. Also, some of the answers are also far off. But given ChatGPT could represent the collective knowledge owned by all internet users. I would say Apple’s imagination and development is far beyond prediction. I just wonder if Apple back in 2021 would know whether their final device look like what they presented yesterday at WWDC23. Also it would be interesting if they ever publish their draft drawings and designs of the device from back then for comparison.
One thing to note is that due to the limited quantity of ChatGPT-4 requests each day, my conversation in the end turned into ChatGPT-3.5 mode, which is far from the -4 performance, so I just wrapped up after that.
Anyway, below are some highlights from my conversation with ChatGPT, the full conversation link is attached at the end.
(For easier read, all replies from ChatGPT are Italic)
First and foremost, I asked ChatGPT about key features apple could offer, most of them are on point and align with the launch event, especially regards privacy and ecosystem, below is the answer:
If Apple were to release an AR/VR/XR headset in 2024, here are some likely features based on trends in the industry and Apple's usual focus on design, ease-of-use, and integration:
Sleek Design: Apple has always valued aesthetics and ergonomics. The headset would likely be lightweight, comfortable, and stylish, possibly available in different color variants.
High-resolution Display: Given Apple's emphasis on high-quality visuals in their Retina displays, we could expect the headset to feature a high-resolution, low-latency display for clear, realistic images.
Intuitive User Interface: The device would likely integrate well with the iOS/macOS ecosystem, providing an intuitive, familiar user interface. It might feature gesture control, voice control via Siri, or even eye-tracking technology.
Advanced Sensors: For realistic AR/VR/XR experiences, the device would need to understand the user's physical environment. Expect it to come equipped with depth sensors, accelerometers, and possibly LIDAR technology similar to what's found in recent iPhone models.
Privacy and Security: Apple prioritizes user privacy and security, so expect strong measures in this regard.
Content Ecosystem: Apple would likely leverage its existing App Store ecosystem to provide a range of immersive AR/VR/XR applications, including games, educational content, and productivity tools.
Then to get a more specific answer, I asked about the potential ID/CMF design of the device, ChatGPT also got it about 80% right, including the rounded stone-like design:
Goggle Part CMF:
Color: Consistent with Apple's minimalist aesthetic, the goggle part would likely come in neutral colors like Space Gray, Silver, or perhaps white, to reflect the overall design language of Apple.
Material: The goggle part would likely be made from a strong, lightweight material like aluminum or high-quality plastic. Considering weight distribution and comfort, the outer casing might be a lightweight metal or hard plastic, while the part facing the user's face could be a softer material or lined with a comfortable, skin-friendly fabric or silicone.
Headband Part CMF:
Color: The headband could match the color of the goggles for consistency and a unified look, although a contrasting color is also possible.
Finish: The outer part of the headband, similar to the goggle portion, could have a matte finish. The inner part, which will be in contact with the user, could have a soft-touch or fabric finish.
To follow up on a more specific design language, it gives below suggestions:
Simplicity: Apple's designs often focus on simplicity and minimalism. We can expect the headset to have a sleek and clean design with few, if any, superfluous elements. The shape could be rounded and organic, with no sharp edges, for comfort and aesthetic appeal.
Uniformity: Apple tends to prefer uniform, monolithic designs. It's likely that the headset will appear as a single, continuous piece rather than an assembly of distinct parts. The junction between the goggle part and the headband, for example, may be designed to be as seamless as possible.
Subtlety: Apple's devices are often understated and subtle. The headset might not have any large logos or branding, instead, small, tastefully placed logos or other brand identifiers might be used.
Material and Color: Apple often uses high-quality materials that feel premium to the touch. The headset could potentially use a mix of matte and gloss finishes for visual interest. The color scheme will likely be consistent with Apple's existing palette - shades of gray, silver, or potentially more color options similar to what they've done with AirPods Max.
User Comfort: Comfort would likely be a major consideration in the design. The shape of the goggle part might be designed to distribute weight evenly and minimize pressure on any one part of the user's face or head.
Attention to Detail: Apple is known for its meticulous attention to detail. Small design elements like the feel of the adjustment mechanism or the way the headset accommodates different head sizes and shapes might be carefully considered.
I then asked it to give more predictions on the Display specs. Apple didn’t reveal the exact information on Vision Pro (in total 23million pixels, so about 4000*3000 pixels each display), so we can’t verify if it’s 100% correct, but answer from ChatGPT is not far off.
A resolution around 3000 x 3000 pixels per eye, a PPI of about 1000, and an FOV closer to 120-130 degrees might be achievable.
For power supply, ChatGPT is a bit more too optimistic about it, when actual battery life is about 2 hours.
Given these considerations, it might be reasonable to expect an Apple AR/VR headset to target a battery life of around 3 to 5 hours for intensive use (like gaming or high-resolution video), and longer for less demanding tasks.
As I’m wearing glasses myself, I also asked about Myopia solutions, it got it right!
Prescription Lens Inserts: Given that this is a proven solution used in existing VR headsets and aligns with Apple's focus on a high-quality user experience, there's perhaps a 40% chance Apple might go in this direction.
Since I pushed ChatGPT to give more specific numbers, I then asked it about sensors and quantities. So far I haven’t seen any reviews mentioning haptic feedback, I wonder if Vision Pro has actually included it per ChatGPT’s instruction.
Inertial Measurement Unit (IMU): Most likely, just one IMU would be needed, located in the central part of the headset. Probability: 90%.
Camera Sensors: The number and placement of these would vary based on their intended use. For environmental mapping and hand tracking, there could be 2 to 4 cameras (30% chance), or even up to 6 cameras (20% chance) located at the front, sides, and possibly the top of the headset. For eye-tracking, there might be 2 additional cameras on the inside (50% chance).
Microphones: For voice commands and ambient noise pickup, there could be two (50% chance) or four microphones (30% chance), or even up to six microphones (20% chance) distributed around the headset.
Haptic Feedback: If haptic feedback is used, there could be two actuators (70% chance), or up to four actuators (30% chance) distributed around the parts of the headset that come into contact with the user's head.
One unexpected thing about Apple Vision Pro is the external display, I tried to verify if ChatGPT could see that coming, and it’s pretty wrong about it by only giving the design 5% possibility.
No External Screen (80% likelihood): As per the traditional design of VR/AR headsets, Apple might decide not to include an external screen to maintain a sleek, minimalist design and to focus on the inward-facing immersive experience.
Small External Screen (15% likelihood): Apple could include a small screen for limited interactions, perhaps similar to the small displays on the Apple Watch. This could be used for quick glances at notifications, battery life, or to display an avatar or some symbol representing the digital status of the user in the VR/AR space.
Full External Screen (5% likelihood): An even less likely scenario would be a larger external screen that might allow for more complex interactions or provide a "window" into the wearer's VR/AR experience for onlookers.
To test if it’s true artificial intelligence by checking how imaginative it could be, I then asked ChatGPT to imagine if there is an external screen, what could it possibly do. The answer is disappointing by not foreseeing what Apple planned interestingly for it, but it does provide some more use cases that Apple might need to copy one day. At least it proves that how actual human imagination can once again surpass expectations.
Shared Experiences: The external screen could provide a view into the virtual world the user is interacting with, allowing others in the vicinity to share in the user's experience.
Educational and Training Scenarios: In a classroom or training setting, an instructor could monitor what a student is seeing and doing in the virtual environment, providing real-time guidance and feedback.
Public Interaction: The external screen could display information for people in the surrounding environment, such as messages, emojis, or avatars, allowing the wearer to express themselves or communicate with others.
Mixed Reality Applications: For mixed reality applications, the external screen could provide an augmented reality view of the surroundings, overlaying digital information onto the real-world view.
Assistive Features: The screen could display assistive information to help people interact with the wearer. For example, it could display text-to-speech or speech-to-text translations, helping to bridge communication gaps.
Device Status: The screen could display useful information about the device status, such as battery life, connection status, or the currently running application.
Eventually, before my chat quota runs out, I tried to ask ChatGPT’s opinion on whether it thinks the headset will succeed. I have to admit, ChatGPT is a master of TaiChi by answering the question without actually answering it. I guess for some questions we have to leave it for time to tell.
Ultimately, it's hard to predict whether the product will succeed without knowing more about its capabilities, the market conditions at the time of its launch, and the reactions of users and developers. But given Apple's track record, they likely have a thoughtful strategy in place to address these challenges.
My whole chat with ChatGPT-4 for viewing: https://chat.openai.com/share/19214fb3-536a-4cf5-9c78-fbe7f2d57ce7