I think it's largely the finger, but the effect highlights the underlying issues he has where other pitchers may be able to get away with it easier.
There's so many pitchers in the game having blister issues right now. The league either needs to fix the ball, which seems to be the cause, or they need to approve something the pitchers can wear on their fingers if they have problems (that won't give them an advantage).