Spurs took the lead at Chelsea with Sandro's brilliant half-volley, but they ended up leaving empty handed after assistant Mike Cairns incorrectly ruled that Frank Lampard's 35-yard strike had crossed the line before his colleague Martin Yerby allowed Salomon Kalou's offside winner to stand.
The defeat left Harry Redknapp's men down in sixth position, trailing fifth-placed Liverpool on goal difference with four matches of the season remaining.
Modric admits he was disappointed with the poor officiating at Saturday's game, but insists the squad must not dwell on the defeat given that they have crucial games against Blackpool, Manchester City, Liverpool and Birmingham ahead.
"I don't think we deserved to lose the game," he said. "When you look at the whole game, especially the first half, we were the much better team. The first goal really hurt us. It's not a goal. The second goal is offside as well. It's so disappointing to lose that way.
"If we were still 1-0 up (at half-time) we would have approached the second half differently. But what can we do? All we can do is pick ourselves up and try to win the next match, that's it."
Source: PA
Source: PA