Depends on the type of plane you are flying. With me, i always got somethin big, so its easier for me, because the response on the big iron is lighter than the small planes. I dont worry about the trim, and if you are that far away, dont worry about the trim either, just concentrate on keeping yourself on the glide slope, and when you turn off the AP, be ready to give some forward pressure on your stick, or keyboard to keep you flying level. Make sure that the trim wheel is not rotating when you take the autopilot off as well. And another thing you can try is switching off your AP earlier than a few hundred feet. I disengage mine as i'm on final, and hand fly it to landing. Not only is it more fun, it seems easier for me that way.
Good luck, if you need more help, ask!