Thanks for the explanation. I do so very much wish I could make the connections you suggest...I cannot. I think perhaps I need to sense the other swimmer is a lover, or one desired as a lover, and that you are conflicted by this meeting because of faithfulness to another lover. The title does not get me there, as we've not established you have any relationship with anyone.
Being that you like Maya (who doesn't!) I would like to point out how transparent her poetry is. She build a poetic narrative that is immediately comprehensible, but the poem builds into other meanings.
My own feeling is not to overly hide behind the poem. You can both keep a poetic distance while at the same time allowing the reader to be engaged in the central core of the idea of the poem. Abstraction in art can work, as it is also decorative and part of home furnishing. But poetry uses words and ideas, thoughts, images which we cannot hang on the wall.
It is not for me to change anyone's aesthetic, as there are no truths to art, only opinions. I prefer
those poets that compose works which have immediate recognition of its idea, and then builds and builds with meaning and emotion.

and unto the deep
(would depth not be better)
of our pearls.
maybe it's just me!

I can get the drift of it after you have given us the meaning, but like the man said. if you hadn't explained, I wouldn't have gotten it. Lovedly is right, making the point of depth versus deep! Good call Lovedly. Perhaps if you had made mention of a lover in some way... Maybe if you had said; "She swam beside me into the swirl" or something of the sort? Nice metaphors but a bit too early. ~ Geezer.
.

else
I would have asked

who was /is the infidel
you he or she
any how good imagery