I...feel as though the term "hermit" is being used quite loosely here.
Nope. The term is fine. It may by traditional usage refer to someone who lives alone for religious purposes, but it's not required. I can't call her a recluse because she still does visit people sometimes.