Hereford United manager John Trewick thought that the penalty, which settled the game, changed the course of the game.
"We had got plenty of territorial advantage and had passed the ball quite well," Trewick told BBC Hereford and Worcester.
"They got into our penalty area from a throw-in too easily and it was a soft penalty from our point of view.
"That changed it in the first half and obviously they got their tails up going a goal ahead.
"We kept battling away and had a goal disallowed. Marc Pugh insists he was on-side and Mathieu Manset who was the one offside wasn't involved in the play.
"I thought the penalty was the turning point. It was soft and we suffered from it.
"I don't think Torquay were particularily stronger than us but they competed well.
"We are struggling to find a level of consistency and struggling to keep clean sheets."
Trewick said that the players were tired after the game
"The pitch was quite heavy and one or two have got knocks. So we will have to see what happens Monday morning. We will see who is fit for the game against Aldershot.
"I don't think the fixture list was particularily kind as we've had to travel all the way to Torquay last night to prepare for the game.
"What I need to do now is to decide whether after the long journey back - some players won't get home until 10.30pm - whether it is worth dragging them all the way to Hereford tomorrow to do twenty minutes cool down.
"I might well let them rest at home and then we'll probably meet on Monday morning at 11am and we'll take stock."