NokiMo
elekktronaut
elekktronaut

patreon


algorhythm – Bachelor Project Overview

In this video I present the pratical part of my Bachelor project. I go over the general functioning and the UI and features in detail. Let me know if you have ideas, suggestions or if you wish to collaborate on this project with me in the future.

algorhythm – Bachelor Project Overview

Comments

Hi Brian! Thanks so much for your detailed answer. While I think it's super interesting and promising to use AI for audio analysis, I'd like to steer this more into the direction of an instrument, so that I as a user can play rhythms, beats etc. to the music. But let's see where it's really heading! Haven't seen that, no. Let's see when I'll get into Unreal..

Bileam Tschepe

This is very cool Bileam, and I think one possible development could be some kind of automated identification of the 'right' part of the spectrum to find the best rhythms to drive the visuals. For static WAV files this might be possible, but for VJs where the audio may also be shaped during the performance this gets a bit tricky. Likewise your comment about getting the right feedback for more ambient tracks - it might be that some kind of analysis of the track could suggest the right controls that would have the most impact. Almost normalise the controls on a per track basis. One thing I've found when working with various attempts at audio visualizations is that changing tracks needs the re-tuning the parameters, so having something that could take a 'good guess' at the right settings to get the VJ into the right ball-park would be good. I've seen some AI folks take a visual of the audiogram and use that to look form patterns - https://towardsdatascience.com/the-promise-of-ai-in-audio-processing-a7e4996eb2ca so this might be an approach. It might also be a way to shortlist the type of generative models that would best suite a specific track. The challenge of course would be getting a good training set - and doing some of this real time - even automating some of the controls as a song develops. Did you get a chance to try the Infinite Tunnel using Unreal Engine that Олег Тысячный posted in the FB group? Again, tuning is needed to get the best results with different tracks. I'll give this more thought - not sure what help I can be if I come up with ideas on achieving any of this I'll let you know.


Related Creators