The designated Quins home game is an 82,000 sell-out and should evoke plenty of positive memories of Brown's performance against the All Blacks.
But he insists he is focused purely on club matters as Conor O'Shea's men continue the defence of their title.
"It is just another game and you prepare yourself just as well as you would for any game," said the 27-year-old.
"It is going to be a great occasion but if you let it get to you that is where you will trip up. It is going to be a tough game against them, a London derby, and we are looking forward to it.
"I won't be thinking about the All Blacks game really. This is another game, another day. Conor (O'Shea) wouldn't let me take any notice of any talk of that and I am just focusing hard on my game and performing at the weekend.
"I just know it is going to be a tough test like it has been before at Twickenham so I am massively looking forward to it."
Given the magnitude of England's record-breaking win over New Zealand, Brown could have been forgiven had his intensity dipped slightly upon his return to club action.
But after an outstanding display against Northampton Saints last time out, Brown says that isn't made possible at a club like Harlequins.
"After the All Blacks game I was straight back into it," he said. "Conor made sure I was straight back into training. They have looked after me well.
"It can be tough but there is a great atmosphere at Quins, a great environment, and a great culture.
"We are going well at the moment so it was easy to slip back into a team that is going well.
"We have pulled off some good wins and are ticking along nicely. Hopefully we can keep it going."
Big Game 5 is a sell-out but never fear, it can be seen live on ESPN with kick-off at 2.15pm.