Your skill score is calculated based on the average of all the ratings from the feedback you've ever received for a skill.

Your skill score does not include feedback notes without a skill rating.