Building credit can be difficult if you’ve got bad credit, which means you probably don’t have much of it, to begin with. Once your credit score starts spiralling downward.