Unfortunately not much you can do without a visit to the vet. It's likely an abscess or infection of some sort that usually requires treatment that may include antibiotics, for a cyst or abscess they may have to remove it to rid the affected area of infection then prescribe an antibiotic course.