Pivot Table Values Return "0"

I am trying to create a pivot table that averages a score, and the table is definitely formatted as "Number" in the cells.  But I can only get the Value field to calculate "Count" and not "Average" or "Sum" it only returns a 0.  When I try Average I get the #DIV/0 error, even though I've formatted the columns, cells, etc as a Number.