oil in spark plugs hole

hy guys the othe day i was changing the valve cover gasket when i notice that inside the spark plugs hole was a lot of oil. I managed to get most of it out with some paper towel but there still some inside. so my question is , what the easiest way to get that completely clean? and is that going to be a big problem???