There may be good reasons why some people don’t do it, but Tom Serpell argues that it can make a difference and we all have a duty to vote