Generally "in the window" has two possible meanings.
(1) In a window as in seen through it. Needs the context of the viewer being on the other side. Means similar to framed by the window.
(2) In a large, non-flat window, as in an alcove with a bay window. Again needs the context. The window area of a shop.
On the window - no obvious meaning.
At the window, nears adjacent to,
So the winner is - at the window - most likely, only common meaning