Are you sure the events aren't getting swallowed by Virtualbox? I think it highjacks right-alt, maybe it does somethng funny with alt-mouse too.