There's probably a small timeskip in between Yor ripping the doorknob off and the final panel - Loid is holding a bag of groceries, implying that he just got back from shopping, so Yor likely broke the door while he was out and the last panel is his reaction when he returned some time later. And with the door broken like that, it would be pretty easy to open it and let Anya out.