1B defense is given a harsher defensive weight. Idk the exact numbers, but for example, a 0 def SS is a below average defender at short and a -5 def at 1B is good. It's not a reflection on him, but the position he plays.
E: going by last few years, Smoak is just around average