It's not really about financial risk. It's about trust. The FICO score is being used as a proxy for trust, which is problematic.

If you don't use credit or use it minimally your credit score will begin to fall.