After the rubber cover wears, breaks off or just doesn't seal properly, the port fills with dust, dirt, sand, etc. Then the charging cable does not fit right until the port is cleaned out.
Maybe the rubber covers works for most people, but it does not work for me.