Ultrasonic cleaner and flash rust

Cleaning all my rusty, grimey parts/bolts in an ultrasonic cleaner and they're flash rusting after removal. I have found solutions such as putting them in an oven or covering them with some sort of oil. These are all temporary though and the bolts will continue to rust once exposed to the elements. How can I permanently protect them from corrosion?