I think when they originally started with Hearts A/B testing (really long time ago, can't remember when) I wasn't even able to refill my hearts without using gems. Don't think there was any other way to get them back.

Made me quit duolingo for a couple of years.