Same thing keeps happening to me even though have had headphone socket replaced. Is it a Samsung snag? ??

Try plugging in a headphone/headset then remove it again if it gets removed. Also double check the audio port if there's something stuck in it. Restarting the device may also work.

Please let us know how it goes.