IC-1225GPT-4 generates realistic dynamic scene layouts from text prompts with only 3 in-context examples, achieving 98% average accuracy across 5 spatiotemporal tasks, with physics knowledge (gravity, elasticity, perspective) generalising to unseen objects from its weights

Long Lian, Baifeng Shi, Adam Yala, Trevor Darrell, Boyi Li

SourceLLM-grounded Video Diffusion Models

The paper prompts GPT-4 (and GPT-3.5) to generate bounding-box sequences (dynamic scene layouts) for 6-frame videos from text captions, providing only 3 in-context examples illustrating gravity, elasticity, and perspective projection. GPT-4 achieves 98% average rule-based accuracy across 5 tasks (numeracy, attribution, visibility, dynamics, sequential), while GPT-3.5 reaches 77%. Critically, GPT-4 generalises to objects and properties not present in the examples: it correctly applies elasticity to a ball but not to a rock, infers air friction for a paper airplane, and applies perspective geometry to a car viewed from different angles. The authors argue this knowledge resides in the model's weights rather than being extracted from the few examples. Adding retrieval-based video examples does not improve performance (96% vs 98%), confirming the few-shot generalisation.

Evidence
correlational
Key metric
GPT-4: 100% numeracy, 100% attribution, 100% visibility, 100% dynamics, 88% sequential, 98% average. GPT-3.5: 100%, 100%, 100%, 71%, 16%, 77% average. Retrieval-based: 20%, 12%, 28%, 8%, 0%, 14% average. 500 prompts total (100 per task).
Caveat
GPT-4 still fails on some sequential (long-horizon) dynamics (88% not 100%). GPT-3.5 is unstable with only 1 in-context example (2 of 3 runs could not finish). The evaluation uses rule-based metrics on programmatically generated prompts, not human judgment of layout quality.
Model
GPT-4 / ChatGPT4 / GPT-4 Code Interpreter / GPT-4 Technical Report, GPT-3.5 / ChatGPT-3.5
Datasets
WebVid-2M [source]
Methods
Frozen in Time [compared-to], GLIP [compared-to], SORT [compared-to]
Related work
LMD [context], LayoutGPT [context], Attention Refocusing [context]
Extraction
automatic-extraction