I tried filing down the chainring a bit as suggested by @hamster (which was worryingly easy to do, it's a cheapy). Just went out for a quick test ride and ended up staying out for over an hour, it was a lot of fun to ride, and all gears engaged quickly and silently. I'm going to leave it like...