i've had the same as you've described and it's bloody painful.
it does go on it's own eventually but if it really pains you, pop some savlon on overnight and go knickerless to stop chafing.
apparantly it's caused by shaving your twadge, ingrowing/infected hair follucle.
you can get some steroid cream from the doc's if it's bad.