Request For If Then Function Help

Hello, I would like to do an IF function to add a "yes" or "no" column based on if a cell's text matches the text on another sheet.

This is what I have right now: IF($A2=Sheet2!A:A,"yes","no"). The formula is only producing yes - can you identify my error?

Thank you!