Real-time Production Workflows with Dell Technologies and Unreal Engine
Download PDFFri, 02 Feb 2024 22:58:16 -0000
|Read Time: 0 minutes
Content production has changed
Powered by technologies like Epic Games’ Unreal Engine, the creative landscape of Film, Episodic, & Live TV Broadcast has been changed forever.
With the advent of Virtual Production, which is essentially an extension of both Game Development and Post-Production practices, we have fundamentally changed the way that we create and interact with our content during production.
Due to this shift, many production facilities have been challenged by the exponential growth of content. Data continues to grow at an alarming scale, driven by increasing resolutions, expected quality of assets, and the sheer volume of content being produced to meet viewers’ insatiable demands.
Dell Technologies and Epic Games have come together to help solve this challenge, developing solutions that enable media companies to deliver massively scalable architectures that remain easy to manage, even at petabyte scale, and allow data to flow between datacenters, the edge, and the cloud.
How do we help?
This solution brings together one of the most trusted names in media storage – PowerScale OneFS – and one of the biggest names in Virtual Production technology – Unreal Engine.
In the past, when working on levels / scenes in game engines like Unreal, all data required for playback had to be localised (copied to) to the machine being used to get the response times expected. This meant tasks required lengthy copies down to the workstation and lengthy saves back up to the storage when complete.
Faster ethernet technologies (10, 25, 50, 100GbE) are much more common in both workstations and access level switching. When you combine this shift in network throughput with PowerScale OneFS All-Flash nodes, Unreal editors can access their content simultaneously on PowerScale storage while also enabling modelers, riggers, texture artists, and so on to create and amend assets.
While all this live creativity is happening, on-set editors and colorists can perform ultra high-speed editing tasks on the footage to allow the Director of Photography to visualize the shot they want in real time. Fundamentally, this solution keeps actors acting, creatives creating, developers iterating, and directors directing - without having to worry about the constraints of the technology behind the shoot.
Solution Benefits
Real-time edit
Enable more creatives to work simultaneously on more assets than ever before when using Unreal Engine with PowerScale All-Flash nodes, eliminating bottlenecks and driving creative productivity.
Build repositories
Build titles and levels quicker and more reliably using PowerScale All-Flash nodes as a lightning-fast centralized Artefact and Cache store.
Version control
Grow your production version control storage without causing downtime to your developers / editors by using PowerScale as the depot storage for your facility.
Unreal Engine
Unreal Engine 5 is the latest generation of Unreal Engine, a complete suite of creation tools for game development, architectural and automotive visualization, linear film and television content creation, broadcast and live event production, training and simulation, and other real-time applications. With UE5, game developers and creators across industries can realize next-generation real-time 3D content and experiences with greater freedom, fidelity, and flexibility than ever before.
Dell Technologies
At Dell Technologies, we believe great storytelling comes from creative people empowered by advanced technology. Our solutions for storytellers span the workflow, built with leading technologies across storage, servers, networking, workstations, displays, and partnerships with key media software and services vendors. These solutions provide media professionals with the foundation to continue driving innovation without technology getting in the way of the art, so they can deliver more powerful stories faster.
Author: Andy Copeland, Global Solutions Architect - Media & Entertainment
Related Documents
Growing Depots with PowerScale OneFS and Perforce Helix Core
Fri, 02 Feb 2024 22:58:16 -0000
|Read Time: 0 minutes
Ever increasing demand for content
Game development companies are facing increasingly difficult data challenges, accelerated by two primary drivers. On one hand, their data continues to grow at an unprecedented rate, driven by increasing fidelity, higher resolutions, and the sheer volume of content being produced to meet gamers’ insatiable demands. On the other hand, if that data were to become inaccessible to the development team and creatives working on game assets, your project would be held up due to fundamental capacity management issues.
Scale without limits
This solution brings together the most trusted name in media storage – PowerScale (formerly Isilon) – and Perforce Helix Core, arguably the most trusted and widely used software version control system on the planet.
To help navigate change management and bring together the creative output of your teams, Perforce Helix Core gives teams of all sizes visibility and traceability into their projects and provides the Single Source of Truth that enables small teams to become more powerful and large teams to become more nimble. Helix Core offers stability to branching practices in distributed environments, full change traceability with secure asset versioning, and a scalable architecture suited to both artists and developers alike.
With your depots on PowerScale OneFS, you can scale their capacity nearly instantaneously without disruption to the running Helix Core application and without needing to schedule downtime of a studio.
Additionally, utilizing technologies like NFS over RDMA and nconnect for NFS directly to PowerScale from Helix Core servers, we can deliver extreme single stream throughput speeds, ensuring that your Helix Core server is able to access versioned data in the fastest possible time.
Game development at scale
Combining Perforce Helix Core with PowerScale scale-out storage enables you to hit your deadlines and realize your creative visions with a joint solution catered to artists, developers, and system administrators alike.
The joint solution of Helix Core and PowerScale accelerates workflows, supporting automated environments with tens of thousands of users running millions of daily transactions over petabytes of data.
Version large files of any type with Helix Core and Dell PowerScale, including code, config files, and large binaries. Developers can version and store everything – even in repos that can scale from hundreds of terabytes of data to petabytes in the same namespace – with no impact on system performance.
Feel secure knowing your successes can never outgrow the Helix Core and PowerScale storage system. Iterating fast, experimenting, and trying stuff out is just as much a priority to us as it is to you.
Additional benefits
PowerScale’s ‘Scale-Out’ architecture allows attached depots to grow seamlessly up to petabytes in a single namespace while remaining continuously online with no impact to servers or clients, bypassing the traditional constraints of having to upgrade an entire array or head, migrate LUNs, re-stripe data, concatenate LUNs, or expand dynamic volumes simply by allowing you to grow the entire filesystem on the fly.
Helix Core clients can also host their workspaces in NFS on PowerScale, which enables artists to work on their assets directly from the storage as if it were local without having to move data up and down between the server and their local machine’s workspace directory. Additionally, resources like build farms can access a shared NFS workspace so that only a single check-out is required to serve all builders.
Solution benefits
Scalable data management
Accelerate workflows. Nothing slows it down — automated environments, tens of thousands of users, millions of daily transactions, terabytes of data, etc.
Large files, all files
Version large files of any type, including code, config files, and large binaries. Developers can version everything — even in repos approaching hundreds of TB of data and 25 million files — with no impact on system performance.
Industry standard tool for artists
Give designers freedom to version art files quickly and easily from their preferred design tools while keeping all project files in a single source of truth.
One backlog that scales
Know your scope and prevent creep. Refine, prioritize, estimate, and give any other custom attribute to your deliverables.
Perforce Helix Core
Perforce Helix Core is the leading version control system for teams who need to accelerate innovation at scale. Store and track changes to all your digital assets, from source code to binary to IPs. Connect your teams and empower them to move faster and build better.
Dell Technologies
At Dell Technologies, we believe great storytelling comes from creative people empowered by advanced technology. Our solutions for storytellers span the workflow, built with leading technologies across storage, servers, networking, workstations, displays, and partnerships with key media software and services vendors. These solutions provide media professionals with the foundation to continue driving innovation without technology getting in the way of the art, so they can deliver more powerful stories faster.
Author: Andy Copeland, Global Solutions Architect - Media & Entertainment
Game Development and Virtual Production with Dell Technologies and Unreal Engine
Mon, 18 Sep 2023 19:07:48 -0000
|Read Time: 0 minutes
Content production has changed…
Powered by technologies like Epic Games’ Unreal Engine, the creative landscape of Film, Episodic TV, and Live Broadcast has been changed forever. With the advent of Virtual Production and In Camera VFX, which are essentially an extension of both Game Development and Post Production, we have changed the way that we create and interact with our content during its production life cycle.
Because of this shift, many production facilities are challenged by the exponential growth of their content. Data continues to grow at an alarming scale, driven by increasing resolutions, the expected quality of assets, and the sheer volume of content being produced to meet viewers’ insatiable demands.
Dell Technologies and Epic Games Unreal Engine can work together to help solve this challenge, with solutions that allow media companies to deliver massively scalable architectures that remain easy to manage, even at petabyte scale, and allow data to flow between datacenters, the edge, and the cloud.
Solution benefits
Real-time edit
Enable more creatives to work simultaneously on more assets than ever before, when using Unreal Engine with PowerScale All-Flash nodes. Eliminating bottlenecks and driving creative productivity.
Build repositories
Build game titles and levels quicker and more reliably using PowerScale All-Flash nodes as a lightning-fast centralized artifact and cache store.
Version control
Using PowerScale as your depot and repository storage for your facility enables you to grow your version control storage without subjecting your developers and editors to the usual downtimes associated with disk expansion.
How do we help?
This solution brings together a highly trusted name in media storage, PowerScale OneFS, with one of the most recognized names in Virtual Production and ICVFX technology, Unreal Engine.
In the past, when working on levels / scenes in tools like Unreal, all of the data for the game had to be localized to the machine you were working on in order to get the response times required. This meant lengthy copies down to the workstation to edit, and then lengthy saves back to the storage when done. Faster ethernet technologies (10, 25, 50, 100GbE, and beyond) are much more common in both workstations and access level switching now. When you combine this shift in network throughput with PowerScale OneFS All-Flash nodes, Unreal editors can access their content simultaneously on PowerScale storage, while modelers, riggers, texture artists, and others can create and amend assets on the fly as well.
While all of this live creativity is happening; on-set editors and colorists can perform ultra-high-speed editing tasks on the shot footage, ultimately giving the Director of Photography the freedom to visualize and capture the shot they want, in real time. Fundamentally, our solution keeps actors acting, creatives creating, developers iterating, and directors directing - without having to worry about the constraints of the technology behind the camera.
Figure 1. A sample Dell Technologies infrastructure for Game Dev / Virtual Production / ICVFX
Unreal Engine
Unreal Engine 5 is the latest generation of Unreal Engine, a complete suite of creation tools for game development, architectural and automotive visualization, linear film and television content creation, broadcast and live event production, training and simulation, and other real-time applications.
With UE5, game developers and creators across industries can realize next-generation real-time 3D content and experiences with greater freedom, fidelity, and flexibility than ever before.
Dell Technologies
At Dell Technologies, we believe great storytelling comes from creative people empowered by advanced technology. Our solutions for storytellers span the workflow, built with leading technologies across storage, servers, networking, workstations, displays, and partnerships with key media software and services vendors. These solutions provide media professionals with the foundation to continue driving innovation without technology getting in the way of the art, so they can deliver more powerful stories faster.