Expanding the method for point trajectory guidance

[julia-joanna]

Hi,

It's a very impressive work!

I wanted to ask if you think that your method could be expanded for point trajectory guidance. Thanks in advance.

[agwmon]

@julia-joanna Thanks for your interest in our work!

I believe it may work to some extent, but it is likely to be quite inefficient.
Empirically, while frame-level control is relatively easy, updating cross-frame features such as trajectories requires a very large number of optimization steps. Therefore, in this setting, rather than using gradients in the pixel space as we do, it may be more effective to directly manipulate latent representations, such as attention maps, as explored in other works (e.g., https://arxiv.org/abs/2501.07563).