And, after declaring his delight at reaching the last eight in the immediate aftermath of the match, Klopp told Sky Sports: "We are in the next round... do we know who we will play next?"
In the draw, which was done after his comments, the Reds were handed an away trip to Southampton in the last eight.
Reflecting on the performance of his much-changed side, Klopp commented: "It was very important because we decided that we would play this game with a new team, but to win is always good for the feeling of the whole team.
"Now we have another three days to prepare for Chelsea [in the Premier League], that's difficult too.
"You saw these guys want and, for me, that's the most important thing.
"If a new manager comes in they have a lot of new information and they have to talk about new and other things
"It's normal if you make first a step back because you try to understand.
"You want to do what I say, but sometimes they forget to do what they can.
"We need both, of course, but [the win] was a big step."
Christian Benteke missed the tie with a knee injury, but Klopp revealed the Belgian could be back in contention for the Chelsea clash
"It was cool, I like this. I don't want to talk about me but first game in the Premier League, coming to White Hart Lane, not the worst place in the world, but it was cool," he told reporters.
"When we have the whistle, it's good, before I tried to look at things I've never seen before. It's a stadium, I've been in other stadiums! We're in, now we can work."
Klopp also hinted that his work as Liverpool manager begins now, having seen his debut delayed by the recent international break, though he admitted that his side's performance could have been better, had they been less "hectic" on the ball.
"I'm satisfied with the start, this is not the worst sign because I did not have the biggest expectations, we have only three days, Tottenham are very, very strong and have a good team," he added. "It was difficult so I'm satisfied. The start was brilliant, we got on the second ball, good timing, Phil (Coutinho) and Adam (Lallana), perfect, in behind, good positions for them.
"The problem of the game, when we had the ball we were not cool enough. We didn't use our skills. We were too hectic, maybe, I'm not sure! Something like this! We didn't see the right option but it's normal, you get the ball, shoot open your view, and play to the side because Tottenham are defending.
"We didn't use these situations but we had our moments, Origi hit the post, some other situations when we could have been better. After three days it was brilliant. Now we have our own game, our experience together and we can go on working."
When asked about recent injury problems suffered by Daniel Sturridge and Danny Ings, Klopp praised the impact of Origi, who deputised in the absence of the duo, and revealed that he attempted to sign the forward when he was manager of Borussia Dortmund.
"I wanted to take him to Dortmund when Liverpool bought him," he added. "He went on loan to Lille, he's a very good player, very young, a good technician, in this moment not full of experience in the game because he didn't play so often but we will have fun with this player.
"We were in a battle with Liverpool for him!"
Klopp revealed that Sturridge may return for next week's clash with Rubin Kazan in the Europa League, having only suffered a "little bit of swelling" to his knee after a clash in training with Jordon Ibe
He has not had enough time with the players to get his message across. It will be exciting seeing him in the dugout in the Premier League, but his mood in Thursday's press conference was different to his first conference. It's different over here, and he will need to get used to it.
PAUL PREDICTS: 2-1
Klopp lifted two Bundesliga titles and finished as runner-up in the 2012-13 Champions League final during his seven year spell in charge of BVB and Hummels predicts further success in England.
“I am convinced Klopp can win the league at Liverpool," he said. “He has shown he doesn’t need the biggest transfer budget or the biggest name to win the biggest trophies."
“Of course there are teams in England that have no financial restrictions when it comes to buying players, but he showed at Dortmund that he has the intelligence to combat that. Perhaps not immediately, but in time I am sure that he can.
“He is a winner, I know him. His long term goal won’t just be to qualify for the Champions League, and settle for that.
“It will be to challenge Manchester United, Manchester City, Chelsea, and Arsenal for the title, and he is absolutely capable of doing that.”
However, former Tottenham manager Redknapp says he has heard that the Reds had spoken to ex-Real Madrid boss Carlo Ancelotti about the role first.
"I have heard from good sources that Ancelotti was offered the Liverpool job," he told talkSPORT.
"I don't think he wanted it. They spoke to him at some stage."
Klopp brough an end to a brief sabbatical to take over the Premier League side following his successful stint at Borussia Dortmund, which included two league titles and a Champions League final.
While Klopp insists he is no miracle worker, the coach says he believes he can win the Premier League with Liverpool in four years, and Redknapp feels he is the right man for the team.

"I do like the look of Klopp, he's a good appointment," he said.
"He looks bright, with great enthusiasm and he looks like he could be a really good addition to the Premier League.
"I'm looking forward to watching Liverpool play over the next few years."
"It's absolute excitement," Thompson told Sky Sports News HQ. "From what we've seen in Dortmund, we've all been excited about his passion and his love for the game.
"If he can bring half of that to Anfield it will be great. It's a marriage made in heaven."
The former Borussia Dortmund manager has reportedly agreed a three-year contract and faces a trip to White Hart Lane to play Tottenham in his first fixture as manager.
Thompson told Sky Sports earlier this week that he expected a deal to be wrapped up quickly following the sacking of Brendan Rodgers, and he now believes it can act as a catalyst for the club and the city of Liverpool.
"It's brought massive excitement to the city," he said. "I don't think there has been an appointment that's captured the fans like this since Kenny Dalglish made his return for the second time.
"This has just captured everybody and they are so looking forward to it. After the disappointment about Brendan going on Sunday, it has all been about Klopp."
“We would like to place on record our sincere thanks to Brendan Rodgers for the significant contribution he has made to the club and express our gratitude for his hard work and commitment,” read a joint Fenway Sports Group statement from principal owner John W Henry, chairman Tom Werner and president Mike Gordon.
“All of us have experienced some wonderful moments with Brendan as manager and we are confident he will enjoy a long career in the game.
“Although this has been a difficult decision, we believe it provides us with the best opportunity for success on the pitch. Ambition and winning are at the heart of what we want to bring to Liverpool and we believe this change gives us the best opportunity to deliver it.
“The search for a new manager is underway and we hope to make an appointment in a decisive and timely manner.”
Divock Origi will be sent out on loan again by Liverpool in January to gain more first-team experience, according to the Daily Star.
The Belgian forward signed for the Reds last summer but remained with Lille for another season on loan. He has found his opportunities limited despite Liverpool's struggles so far this season and as such the club will allow him to leave on a temporary basis.
Norwich, Bordeaux and Stuttgart are among those interested in the 20-year-old.
Brendan Rodgers's position at Liverpool has never felt quite as precarious as it does now. The Merseysiders have struggled to fill the massive void left after the disbandment of the SAS; Luis Suarez to Barcelona, Daniel Sturridge to the treatment table and, more recently, Raheem Sterling to Manchester City. The goals have dried up and the mood at Anfield has darkened.
Two seasons ago, the Reds hit three figures for goals scored – just two shy of the record set by Carlo Ancelotti's Chelsea. Now they have hit three figures for days since they last scored more than once in a game (against a relegated QPR in May), have been outscored by, among others, Sunderland, Aston Villa and Watford, and the spectre of the out-of-work Ancelotti is looming large.
It is not the first time that Rodgers has felt the breath of another manager creeping up his neck. Ahead of last season's FA Cup semi-final, speculation swirled that Fenway Sport Group were already eyeing Jurgen Klopp, who had dramatically decided to leave Borussia Dortmund. Rodgers and Liverpool were beaten by Aston Villa at Wembley and his job security has been fragile ever since.
Now he takes on that same opponent, though Tim Sherwood's side have themselves struggled in the aftermath of losing their own talisman (to Liverpool, ironically), and still FSG are thought to be mulling over a replacement, this time Ancelotti. Unlike Klopp and his disastrous final season at BVB, though, the Italian's stock is still high and he brings the expertise and gravitas the American owners have always wanted.
After so many poor showings and having almost been embarrassed by League Two's Carlisle in the League Cup, Rodgers is fast running out of credit. He needs points, he needs goals, and he needs them fast.
Villa won their first game, but that seems a long, long time ago. We're still not quite sure what Sherwood's style is, and results have shown that this season. The derby win against Birmingham was massive.
I'm a great believer that if teams aren't winning, they're not very good. It's not down to luck with Liverpool; something is not right. They failed to beat West Ham, failed to beat Norwich, couldn't beat Carlisle over 120 minutes. We're not talking about world-beating teams here.
PAUL PREDICTS: 1-0
I'll go with Liverpool, but I could easily be sitting back on Sunday thinking 'why didn't I go for what I fancied with a draw?' Coutinho will be back, and he makes the difference, just.
PAUL PREDICTS: 2-1
The 24-year-old's last goal came in a 3-1 defeat to Manchester United last weekend, where he scored a spectacular overhead kick
And Sky Sports' Phil Thompson believes Rodgers needs to alter how the front three of his 4-3-3 formation lines up if Liverpool are to see an improvement in results.
"I think that there's not been enough support for him," he told Sky Sports News HQ.
"When we've had it before where we've played up there with two either side it's been very close. Coutinho's been playing there at times - certainly when Suarez is up there with Sturridge was very, very close. Danny Ings started on the left, Firmino started on the right. Not enough support for Benteke.
"For me, if you're going to play Danny Ings, play him where he is best at, which is as a striker, or at least playing in and around Benteke. We didn't have a lot of pace in the side against Manchester United."
Thommo also thinks that the best front three would include Daniel Sturridge and Philippe Coutinho to get the most out of the Belgian international, pending on the England striker being fit.
He explained: "When Sturridge played with Suarez, Suarez would sometimes play down the middle and Sturridge would start to the left of him, not wide,"
"You're not getting the best out of your players. I think you have to play your players in their best positions to get the best out of them. If Benteke is going to be playing against Norwich on Sunday, play Sturridge - if he does start - alongside him and Coutinho the other side to get the best out of the players."
Rodgers admitted afterwards that his side had not shown the required quality against United, and says that they must avoid taking the easy way out by playing direct passes to summer signing Benteke.
He said: "It is too easy sometimes for us to go direct to Christian Benteke, who was excellent given the service that he had.
"Unless you can keep the ball for longer periods to connect the game and get it higher up the pitch all that happens is you end up getting rid of the ball and it goes up to him. We have to be more superior and better with the ball to build your attack so that is something that needs a lot of work.
"We need to be a lot technically better than we showed. Over the first five games now creating more goals is something we need to look at. We haven't created anywhere near as much as what I would have liked. That is something I need to look at with the coaches and staff.
"You are never happy when you lose a game, especially to your rival. I have a group who will respond but the key for us is to initiate a game and create chances - that is something we need to be better at.
"I am disappointed with the result and disappointed with the performance. We know we can play better."
Rodgers was unhappy with the award of the free-kick that led to Blind's opener after Nathaniel Clyne challenged substitute Ashley Young on the edge of the penalty area.
"I thought in the first half we defended well and didn't give away too much but we had nowhere near enough quality and composure on the ball," the manager continued.
"We were disappointed with a couple of the goals although I never thought the free kick was a free-kick. Both players were tangling for the ball and get their arms up, Ashley Young jumps on the player's back but gets the free-kick. Then United worked it well and created the space.
"I think Herrera has done well with the penalty, young Joe Gomez will learn he has to stay on his feet.
"We showed good character to get back into the game and Christian gets an incredible goal with a high level of technique but then we concede a disappointing third and that kills us."
Players out: Raheem Sterling (Man City), Fabio Borini (Sunderland), Iago Aspas (Sevilla), Tiago Ilori (Aston Villa, Loan) Rickie Lambert (West Brom), Sebastian Coates (Sunderland), Glen Johnson (Stoke), Steven Gerrard (LA Galaxy), Andre Wisdom (Norwich, Loan), Lloyd Jones (Blackpool, Loan), Jordan Williams (Swindon, Loan), Kevin Stewart (Swindon, Loan), Brad Jones (Bradford City), Javi Manquillo (Atletico Madrid, Loan terminated), Danny Ward (Aberdeen, Loan), Sheyi Ojo (Wolves, Loan), Lawrence Vigouroux (Swindon, Loan), Taiwo Awoniyi (FSV Frankfurt, Loan), Samed Yesil (FC Luzern)
Verdict: I think Christian Benteke is a good signing and Nathaniel Clyne is another good one. Joe Gomez has been outstanding so far and you always know what you're going to get from James Milner on a free transfer. They have brought in a lot of money for players like Raheem Sterling and Fabio Borini so they have done good deals. I like the way they've bought, but then I watched them against West Ham and oh dear…
Rodgers was not definitive on names but accepts some will want out if they view their chances as limited for this campaign.
"The spirit is strong but of course it is a difficult situation with the transfer market still being open until the end of the month.
"There is always going to be that speculation but I am sure there will be movement of some of the players that obviously want to play."
Liverpool have rejected a bid from Roma to take central defender Mamadou Sakho on a season-long loan
Despite this, Brendan Rodgers is not keen to let 25-year-old Sakho depart the club, though his defensive ranks have been bolstered over the summer with the signings of Nathaniel Clyne and Joe Gomez as well as Tiago Ilori's return from a loan spell at Bordeaux.
Sakho has made just 32 Premier League starts in his two seasons at Anfield due to a number of injury issues but has become something of a fan favourite due to the confidence that he has shown in possession following his move from Paris Saint-Germain.
Roma are looking for defensive options following the sales of Alessio Romagnoli to AC Milan and Mapou Yanga-Mbiwa to Lyon during the past week.
"I have been a big admirer of Coutinho and he can be a very important player for Liverpool and Brazil," he told reporters.
"There will be a lot of expectation on him with Liverpool fighting to get back into the Champions League, but I know that he can handle it.
"One great player doesn't make a team, but you can build a team around one great player, and I believe he can be that player.
"Coutinho is a humble guy. He won't talk about being able to replace a legend like Steven Gerrard, and the truth is nobody could ever replace him, but with Gerrard gone they do need somebody to step up - and he can do that."
17-year-old Joe Gomez - a summer arrival from Charlton Athletic - was preferred against Stoke on Sunday and while Enrique is determined to prove his worth to Rodgers, he concedes he may have to leave.
He told Marca: "I am in a difficult position. Myself, [Mario] Balotelli and [Fabio] Borini have been alienated.
"I have a year left on my contract and I want to stay and fight as I always have but if a good opportunity came in with a longer contract and better chances to play I would study it.
"I will not give up. Football changes from day to day, I know from experience.
"I am fit after two years with knee discomfort and with only one left-sided defender [Moreno] I know that if I stay I'll play. I want to prove that some people are wrong."
Enrique believes he would struggle to find a club the size of Liverpool in his homeland and accepts the economic situation in Spain makes a move difficult.
"I don't think I will play for a team better than this," he added. "It is true we have not won the league for many years but we must not forget that we have five European Cup successes.
"I had a good option to return to Spain but it is complicated because the economy is very different to what exists here. I would love to stay here until my legs stop me."
After coming close to winning the title in 2014, Liverpool slipped to sixth last term, finishing eight points behind fourth-placed Manchester United in the final Champions League slot.
Rogers has since strengthened his squad with the likes of Christian Benteke, Roberto Firmino, James Milner and Nathaniel Clyne, and Enrique admits Champions League qualification is a must for the Reds this term.
He said: "This season we have no excuse not to enter the top four. We have spent a lot of money to bring good players in and I think we have a great squad. We have many options."