Note this won't work with the osu!bgm because it is not a beatmap
No big optimizations yet, but groundwork is laid out.