Jason Deacutis - Portfolio

Inter-Coastal Electronics - MR M240

Prototype Mixed Reality M240 trainer using the HoloLens 2 (IVAS placeholder) & Unity Engine. Our goal is to perform on-aircraft training for helicopter door gunners, without the hassle of live-fire. The ACME M240 has simulated safety, trigger, belt reloading, malfunctions, & physical recoil (the firing sound is actually the recoil mechanism). Optional visual aids: ammo counter, safety, gun faults, ballistic trajectory, impact point (CCIP).

Disclaimer: Recording the HoloLens is hard. Microsoft’s recorder has misleading brightness & contrast, its misaligned, has transparency artifacts, and it’s at an agonizing 30fps. The best alternative was to tape a phone to the HoloLens, but this distorts the colors.

The virtual ground is placed 50ft underground to simulate a helicopter's height. Colors are only distorted in recordings.

Shooting down virtual drone targets at the AAAA show.

Visualization of safety & fault states.

Shooting virtual Humvees in the backyard.

A 3D scan of the backyard was used to ground the holograms & hide them behind walls.

Blob shadows are cheap but very important for grounding objects in MR.

M240's state comes in over ethernet at 60Hz.

This mesh is used to prevent X-ray vision through the gun, so its important that it matches as closely as possible to the physical gun.