Hi Andy.
I have found that you have to ensure that the speed button is NOT selected and the Auto throttle is not selected, I then set the required speed in the window and set the Auto throttle, then when you require the Auto throttle to take over press the speed button, and it should work every time. Hope this helps.