Ideally, he would be perfect as a bench piece. Given the areas on the roster that need upgrades and improvements however, if the Jays need to save money in some places to spend elsewhere, rolling with Clement at 3B isn't the end of the world. Defensively alone he should be worth 2 WAR.
But yeah if the Blue Jays have another offseason where the main big additions are players like Justin Turner and KK, then yeah I would be annoyed!