Workflow from Scientific Research

Temporal sampler with inputs at t-1 and t. Attention from the model’s first half at time t, hallucination computed at time t-1, and their SSIM score are fed to a GRU to compute the sampling vector r^(t), deciding how many frames to skip (including the second half of the current frame). Model weights are shared across frames.

DOI