Open the modal. Then, open the popover inside. Hit escape. The popover should close, not the modal.
Open Modal
Popover menu
Menu Item One
Menu Item Two
Menu Item Three