The way his eyes shifted around during that exchange looks exactly like someone preoccupied with listening to something else. Same way a persons eyes sometimes move while they’re having a phone conversation. Joe couldn’t process the Trump, earpiece and Wallace inputs simultaneously. That’s why he blurted out “shut up man”. He was trying to quiet Trump so he could hear his handlers instructions.