Potential is never really used positively. It generally is used to explain the failures of someone with promise. The shame and guilt that accompany that are self defeating, but perhaps it's not that you don't care enough, but that you care too much to reach your full God created potential.