Comparing the data of 2 columns

You need to use formulas when you set cells. A1:A4=B1:B4 is not a formula and the machine does not understand what are you looking for.

You said: "I so far used an IF function such that I would get 0 if the answers of two cells are identical and 0 if there are not identical."

I assume you made an error in typing, if not, if you assign 0 if something is true and 0 if something is not true, it's ok that the result is always 0.

Can you please attach here a sample file with a couple of rows of data, just to understand the mechanics you're looking for?

I asked that because "(i.e. comparing column 1 of set 1 with column 1 of set 2 etc.)" it's not self explanatory and that "etc" does not give me idea of what you need.

Thanks for the attention, bye!