Microsoft Build, Inspire & Celebration

Role: Creative Lead - Unreal Engine Design Unreal Based Live interactive Design

Project Overview

I played a key role in bringing Microsoft's flagship events - Build, Inspire, and Celebrate - to life through cutting-edge virtual production techniques. Using Unreal Engine's nDisplay technology and LED backgrounds, we created immersive, dynamic environments that elevated these high-profile corporate events to new heights of visual engagement and technological innovation.

Technical Highlights

• Unreal Engine Versions: Leveraged both Unreal Engine 4.27 and 5.1, utilizing the strengths of each version to meet diverse production needs.

• nDisplay Implementation: Mastered Unreal's nDisplay feature to synchronize content across multiple LED screens, creating seamless, expansive virtual environments.

• LED Integration: Seamlessly blended physical presenters with digital backgrounds on massive LED walls, creating a hybrid reality that enhanced the presenters' interactions with virtual content.
  

Event-Specific Contributions

Microsoft Build

• Designed and implemented interactive 3D visualizations of complex software architectures and cloud systems.

• Created dynamic, code-themed environments that responded in real-time to on-stage demonstrations.

Microsoft Inspire

• Developed a virtual global marketplace, allowing presenters to seamlessly "travel" between different international settings.

• Implemented real-time data visualization tools to showcase Microsoft's global partner network.

Microsoft Celebrate

• Crafted celebratory virtual environments that dynamically changed based on the achievements being highlighted.

• Designed and animated virtual fireworks and particle effects for key moments in the presentations.
  

Technical Deep Dive

• Multi-Version Workflow: Developed a pipeline to efficiently work between Unreal Engine 4.27 and 5.1, leveraging each version's unique capabilities while maintaining consistency across events.

• Real-time Rendering Optimization: Fine-tuned rendering settings to achieve high visual fidelity while maintaining smooth performance on LED walls.

• Custom Blueprints: Created a library of reusable Blueprints for quick iteration of event-specific features and interactive elements.

• Dynamic Lighting: Implemented complex lighting scenarios that could be adjusted in real-time to match the mood and theme of different segments within each event.

• High FPS Asset Optimization: Implemented rigorous asset optimization techniques to ensure consistent high frame rates across all events:

• Developed a LOD (Level of Detail) system tailored for LED wall viewing distances, balancing visual quality and performance.

• Utilized texture atlasing to reduce draw calls and improve rendering efficiency.

• Implemented aggressive mesh optimization techniques, including polygon reduction and efficient UV mapping.

• Created a custom shader library optimized for high-performance rendering on LED displays.
  

Unreal Engine Innovations

• Developed a custom content streaming system to manage the vast amount of assets required for multiple events.

• Created a bespoke color correction system to ensure consistent visual output across different LED panel types and environments.

• Implemented a real-time compositing solution within Unreal to blend live camera feeds with virtual elements seamlessly.

• Performance Profiling Tools: Developed custom profiling tools within Unreal Engine to identify and address performance bottlenecks in real-time during live events.

• Adaptive Resolution Scaling: Implemented an adaptive resolution scaling system that dynamically adjusted render resolution to maintain target frame rates during complex scenes.
  

Challenges and Solutions

• Scale and Complexity: Managed the immense scale of these events by creating modular, reusable assets and implementing efficient level streaming techniques.

• Version Compatibility: Developed a robust pipeline to ensure assets and features were compatible and consistent across different Unreal Engine versions.

• Live Event Demands: Implemented fail-safe systems and real-time adjustment capabilities to handle the unpredictable nature of live events.

• High FPS Requirements:

• Tackled the challenge of maintaining 60+ FPS for LED wall displays by implementing aggressive GPU and CPU optimizations.

• Developed a dynamic asset loading system that intelligently managed memory usage to prevent frame rate drops during complex scenes.

• Created a real-time performance monitoring system that alerted operators to potential FPS issues before they became visible to the audience.
  

Impact on Events

Our virtual production work significantly enhanced the Microsoft events by:

• Providing visually stunning and immersive environments that reinforced Microsoft's position as a technology leader.

• Enabling presenters to interact with virtual 3D models and data in ways that made complex concepts more accessible and engaging.

• Allowing for quick transitions between diverse "locations" and themes without physical set changes.

• Creating a consistent, high-quality visual experience for both in-person and remote attendees.

• Delivering Flawless Performance: Achieved and maintained high frame rates throughout the events, ensuring smooth motion on LED walls and eliminating visual artifacts that could distract from the presentations.
  

This project showcases not only the power of Unreal Engine in transforming corporate events into immersive, interactive experiences but also demonstrates the technical expertise required to optimize these complex virtual environments for flawless, high-performance delivery in a live setting. By leveraging cutting-edge virtual production techniques and implementing robust optimization strategies, we were able to create environments that not only wowed audiences but also enhanced the communication of Microsoft's key messages and technological innovations.