Each time a contact clicks on a link from your email or when your email is shared, it counts as a positive response. Also, the higher percentage of people that view your email the better for your score.
When a contact unsubscribes from your email, marks it as spam or if the email bounces it counts as a negative response. If a very low percentage of people open your email it will negatively affect your score.