New signing Thimothee Atouba's brilliant left foot shot gave Spurs victory at St James Park.
"I am delighted for my young team to win here in such a magnificent stadium," the new Spurs boss said after the 1-0 win.
"It is always difficult to play here.
"I'm happy for my team to pick up points in successive games - and this against Liverpool and Newcastle is good at the start of a long season.
"I'm also happy for Atouba."