If I understand you correctly, you already tried to set it to silent but it just doesn't work. If that's the case, try restarting your phone and try again. If that still won't work, just set it to a beep. Hopefully that should work. You still would hear a sound but very minimal. Let me know how it goes.