It was still in play and it sounds like your partner made a brilliant play on it. Too bad you weren't filming the match - that'd be one to watch later.
With that said, I think in this extremely odd case you guys were right to allow your opponents the let. I don't think they should have asked for one, but good on you for replaying the point.
Read my blog for club and USTA players at CourtCoverage.com