I looked into it more, and it turns out that the arrows are exactly one beat (ie. 1 quarter note) before the music, on all the songs I tried.