Miss Manners: I can’t tell if I accidentally invited new neighbors to swim in our pool, or not

At a neighborly dinner the new couple made a half-joke about coming over to swim. Was anyone serious here?