Scenario Simulation

Author scenes, generate sensor data, test algorithms in simulated environments

Simulation using realistic unmanned aerial vehicle (UAV) scenarios and sensor models is a crucial part of testing UAV algorithms. UAV Toolbox provides two simulation environments in which to test these algorithms. Both environments have their uses, and one environment is not a replacement for the other.

In the cuboid simulation environment, vehicles and other platforms in the scenario are represented as simple box shapes, or for lidar applications, as polygon meshes. Use this environment to rapidly author scenarios or generate sensor data. Test controllers, tracking algorithms, and sensor fusion algorithms in both MATLAB^® and Simulink^®. To get started authoring a scenario, use the uavScenario object.
In the Unreal Engine^® simulation environment, scenarios are rendered using the Unreal Engine from Epic Games^®. Use this environment to visualize scenarios using more realistic graphics; to generate high-fidelity radar, camera, and lidar sensor data; and to test perception-in-the-loop systems. This environment is available in Simulink and runs on Windows^® only. To learn more, see Unreal Engine Simulation for Unmanned Aerial Vehicles.

Acknowledgements

Apps

UAV Scenario Designer

Design UAV scenarios with terrain, platforms, and sensors

Functions

expand all

UAV Cuboid Scenarios

`uavScenario`	Generate UAV simulation scenario
`uavSensor`	Sensor for UAV scenario
`uavPlatform`	UAV platform for sensors in scenario
`extendedObjectMesh`	Mesh representation of extended object

Trajectory Generation

`uavMission`	Mission data for UAV flight
`multirotorMissionParser`	Generate trajectory for multirotor UAV from mission
`multirotorFlightTrajectory`	Multirotor UAV trajectory
`fixedwingMissionParser`	Generate trajectory for fixed-wing UAV from mission
`fixedwingFlightTrajectory`	Fixed-wing UAV trajectory
`waypointTrajectory`	Waypoint trajectory generator

Sensor Models

`gpsSensor`	GPS receiver simulation model
`insSensor`	Inertial navigation system and GNSS/GPS simulation model
`uavLidarPointCloudGenerator`	Generate point clouds from meshes
`createCustomSensorTemplate`	Create sample implementation for UAV custom sensor interface
`uav.SensorAdaptor`	Custom UAV sensor interface

Transformation Trees

`transformTree`	Define coordinate frames and relative transformations
`getGraph`	Graph object representing tree structure
`getTransform`	Get relative transform between frames
`info`	List all frame names and stored timestamps
`removeTransform`	Remove frame transform relative to its parent
`show`	Show transform tree
`updateTransform`	Update frame transform relative to its parent

Unreal Engine Projects

`sim3d.Editor`	Interface to the Unreal Engine project
`sim3d.maps`	Access additional scenes from the server
`sim3d.maps.Map.delete`	Delete local maps downloaded from the server
`sim3d.maps.Map.download`	Download maps from the server
`sim3d.maps.Map.local`	List of locally available maps
`sim3d.maps.Map.server`	List of maps available for download from the server

Blocks

UAV Guidance Model	Reduced-order model for UAV
UAV Animation	Animate UAV flight path using translations and rotations
Path Manager	Compute and execute a UAV autonomous mission
GPS	Simulate GPS sensor readings with noise
INS	Simulate INS sensor
Simulation 3D UAV Vehicle	Place UAV vehicle in 3D visualization
Simulation 3D Scene Configuration	Scene configuration for 3D simulation environment
Simulation 3D Camera	Camera sensor model with lens in 3D simulation environment
Simulation 3D Lidar	Lidar sensor model in 3D simulation environment
Simulation 3D Fisheye Camera	Fisheye camera sensor model in 3D simulation environment
Video Send	Send video stream to remote hardware
UAV Scenario Configuration	Configure and simulate UAV scenarios
UAV Scenario Get Transform	Get transforms from UAV scenario platforms
UAV Scenario Lidar	Simulate lidar measurements based on meshes in scenario
UAV Scenario Motion Read	Read platform and sensor motions from UAV scenario simulation
UAV Scenario Motion Write	Update platform motion in UAV scenario simulation
UAV Scenario Scope	Visualize UAV scenario and lidar point clouds

Scenes and Vehicle Dimensions

expand all

Scenes

US City Block	US city block Unreal Engine environment
Suburban	Suburban Unreal Engine environment

Vehicles

Quadrotor	Quadrotor vehicle dimensions
Fixed Wing Aircraft	Fixed wing aircraft dimensions

Topics

Simulation Basics

Unreal Engine Simulation for Unmanned Aerial Vehicles
Learn how to use unmanned aerial vehicle algorithms in Simulink and visualize their performance in a virtual environment using the Unreal Engine from Epic Games.
Unreal Engine Simulation Environment Requirements and Limitations
When simulating in the Unreal Engine environment, keep these software requirements, minimum hardware requirements, and limitations in mind.
How Unreal Engine Simulation for UAVs Works
Learn about the co-simulation framework between Simulink and the Unreal Engine and how block execution order affects simulation.
Coordinate Systems for Unreal Engine Simulation in UAV Toolbox
Understand the world and UAV coordinate systems when simulating in the Unreal Engine environment.

Simulation with Sensors

Simulate UAV Mission in Urban Environment
This example shows how to create and simulate a UAV mission in an urban environment in MATLAB® and Simulink® using the uavMission and uavScenario objects, as well as OpenStreetMap® (OSM) data from Manhattan, New York.
Simulate IMU Sensor Mounted on UAV
Create a sensor adaptor for an imuSensor from Navigation Toolbox™ and gather readings for a simulated UAV flight scenario.
Simulate Radar Sensor Mounted On UAV
The radar sensor enables a UAV to detect other vehicles in the airspace, so that the UAV can predict other vehicle motion and make decisions to ensure clearance from other vehicles.
Choose a Sensor for Unreal Engine Simulation
Decide which camera, or lidar sensors to use during 3D simulation with the Unreal Engine.
Simulate Simple Flight Scenario and Sensor in Unreal Engine Environment
Visualize sensors in a simulation environment that uses Unreal Engine® from Epic Games®.
Depth and Semantic Segmentation Visualization Using Unreal Engine Simulation
This example shows how to visualize depth and semantic segmentation data captured from a camera sensor in a simulation environment.
Stream Camera, Depth and Semantic Segmentation Data from Unreal Engine to NVIDIA Jetson
This example shows how to stream simulated camera, depth, and semantic segmentation label data from an Unreal Engine® scene to NVIDIA® Jetson hardware using the Video Send block in Simulink®.

Scene Customization

Customize Unreal Engine Scenes for UAVs

Customize Unreal Engine scenes for UAV flight applications.
- STEP 1: Install Support Package for Customizing Scenes
- STEP 2: Migrate Projects Developed Using Prior Support Packages
- STEP 3: Customize Unreal Engine Scenes Using Simulink and Unreal Editor
- STEP 4: Package Custom Scenes into Executable
Apply Semantic Segmentation Labels to Custom Scenes
Apply labels to objects in a scene so that you can obtain semantic segmentation data from a camera sensor.
Prepare Custom UAV Vehicle Mesh for the Unreal Editor
Create custom vehicle mesh for the Simulation 3D UAV Vehicle block.

Featured Examples

UAV Scenario Tutorial

Create a scenario to simulate unmanned aerial vehicle (UAV) flights between a set of buildings. The example demonstrates updating the UAV pose in open-loop simulations. Use the UAV scenario to visualize the UAV flight and generate simulated point cloud sensor readings.

Open Live Script

Design Obstacle Avoidance Package Delivery Scenario Using UAV Scenario Designer

Rapidly design and customize a UAV scenario to validate an obstacle avoidance algorithm.

Open Live Script

UAV Package Delivery

Implement a small multicopter simulation to takeoff, fly, and land in a city environment.

Open Live Script

Automate Testing for UAV Package Delivery Example

Edit requirements, link requirements to their implementation in a model, and verify their functionality in the context of a UAV application. The components of the model and requirements include guidance and control of a UAV implemented by the UAV Package Delivery example.

Open Live Script

Stereo Visual SLAM for UAV Navigation in 3D Simulation

Generate a map for a city block scene in an Unreal Engine environment using stereo visual simultaneous localization and mapping.

Open Live Script

Lidar and Radar Fusion in Urban Air Mobility Scenario

Track various unmanned aerial vehicles in an urban environment.

Open Live Script