Yes, even though a user has not yet logged in, they have a license assigned to them and the account could be activated at any time.
Cancelling the invite will free up that license.
Go to My team => Manage Users
Managing to the total number of licenses in use
Updated over a week ago