The Pirates defeated Clevedon Town 1-0 on Wednesday thanks to a first half Rob Quinn strike, but the evening was soured for Graydon when Tait got involved in an incident towards the end of the game.
The former Crewe man went to push a Clevedon player, and Graydon promptly substituted him.
He said: "If he wants to stay with me and wants to stay in the team, then he'll have to find out very quickly that I don't tolerate that."
Meanwhile Martin Cameron has signed for St. Mirren on a free transfer. The forward has signed a one-year contract with the Scottish club.