A sentence is both a sequence and a tree of phrases. Phrases have a head and one or more valents; they’re relations.

If you wanted to create an embedding algorithm for phrases, you could and you could throw a transformer at it.

I don’t know how you get the output of higher levels to diffuse to phrase and word levels.