Simply removing the symptom does not necessarily "close the door" they used to get in with in the first place.
Remain calm and carefully follow this guide. When you're done, you may want to implement some (if not all) of the recommended security measures.