Musings about music production, psychoacoustics, sound synthesis & anything else interesting, from the Centre 4 Digital Music's Audio Engineering research team.
🌟 Excited to Share Our Latest Work! 🎥🎶
Here we present Stable-V2A: Synthesis of Synchronized Sound Effects with Temporal and Semantic Controls
arxiv: arxiv.org/abs/2412.15023
web: ispamm.github.io/Stable-V2A
Our spin-out, nemisindo.com releases new procedural audio for the Unreal Engine
ALT Nemisindo is upgrading its Action Pack for the Unreal Game Engine - into Metasounds World.
If you are looking for handy interactive impact sound models in Unreal, our procedural audio solution would be a perfect bundle for you, coming soon with 11 models and over 90 presets, and new exciting features. Stay tuned!
#UE5 #Metasound #SoundDesign
SyncFusion: Multimodal Onset-synchronized Video-To-Audio Foley Synthesis.
We use onsets extracted from silent videos and audio/text embeddings to condition a diffusion model for synchronized sound effects synthesis.
arxiv: arxiv.org/abs/2310.15247
web: mcomunita.github.io/diffusio…
This was work done during an internship @tapeitapp. A special thanks to my collaborator Thomas Walther and my advisor Josh Reiss (@IntelSoundEng). We will present this work at the upcoming AES Convention. Stop by if you are interested in controlling DSP with neural networks.
Congratulations to 🇸🇪 🇫🇮 🇮🇱 🇮🇹 🇳🇴 🇪🇪 🇨🇿 , who I correctly predicted would finish in the top ten!
However, not everything about #Eurovision can be predicted. In the upcoming days, I'll be delving deeper into the results of my study.
#PhD@QMEECS@bbceurovision@Eurovision
Who will qualify to the Grand Final from the Eurovision 2nd Semi-Final tonight? 🎶I trained three models to predict which countries are the most likely to qualify. Will 🇨🇾 , 🇦🇲 , 🇵🇱 , 🇮🇸 , 🇦🇱 , 🇪🇪 , 🇬🇷 , 🇦🇹 and 🇷🇴 be going to the final? #Eurovision#EUROVISION2023
New blog on applying intelligent sound engineering to improve music for those with a hearing loss. @CadenzaChalleng has just launched open SP/ML challenges to do this. Why not enter? intelligentsoundengineering.…