I don't think too many people are mad about the player, just where he was taken. That being said, none of us know how likely it would have been that he would still be available later.
I did wonder why we didn't flip our pick to the Heat for Cole (or whatever) and take him at 26, but for all I know he'd be gone by then.
Trust Ujiri until he gives you reason not too. He's worked miracles before.