Jeffrey Tambor is speaking out.  Amazon confirmed to ET on Thursday that the actor would not