Check out these two awesome projects made by Conor Grebel and Bob Dyce.
Yesterday, two artists released two separate projects that look nothing alike and yet have the same idea behind them. 3D Designer/Musician Conor Grebel, a.k.a. Bedtimes, and Co-Founder/CEO of Launchvox Bob Dyce both presented an extremely creative way of combining UE5 and a MIDI keyboard to create amazing art.
The former has managed to turn the engine into a music visualizer that can trigger pre-recorded animations and lights based on real-time inputs via a MIDI pad. The oscilloscope textures, commented the creator, were made by recording real-life oscilloscopes and turning said recordings into Flipbooks within the engine.
Bob Dyce, in collaboration with Ian Berget and John Miller, on the other hand, developed a fun and visually unique prototype that, besides the engine and a MIDI keyboard, also utilizes UE5's MetaHumans.
According to the creator, each beatbox sound effect was performed, captured, and mapped onto the MetaHuman facial rig. Tapping a button on the MIDI controller triggers a facial animation, sound effect, and a material light-up effect on the 3D synth modeled to hold the six digital performers. You can check out the full version with sounds by clicking this link.