The Imps took a second-half lead through Matt Green, following a good chance from Olufela Olomola to put the Glovers one-up, before Matt Rhead completed the scoring with a close range header on 69 minutes.
The result leaves Yeovil in 20th position, level on points with second from bottom Forest Green Rovers.
“It’s the margin of error,” Way told iFollow Glovers.
“We went one-on-one with the keeper, missed the opportunity which was a great scoring chance to put us 1-0 up and within two minutes they countered down the other end and it was a great finish from the lad.
“When you go 1-0 down, there is a little bit of disappointment and the noise is different and that’s when you expect personalities and characters to show really good commitment and confidence to get the game back – we didn’t do that.
“From having a young squad, there was a little bit of fear that set in and the players weren’t confident to play the right pass at the right time. There was no real fightback and want to get on the ball.
“As a team I didn’t really see any commitment and the supporters don’t want to see that; they want to see players wanting the ball, more energy and commitment so I understand their frustrations.”