Ask Anything: Chat With Any Video

The story

What the video said

This open source GitHub project turns a plain video clip into a chat you can have with a computer. You upload footage and then ask questions about what happens inside it.

You want to know exactly when a player scores in a game clip, but scrubbing through the whole video by hand takes forever. You need a faster way to get answers from the footage.

Ask Anything is an open source project that connects a video model to a chat assistant. You load a clip, type a question, and it replies with the moments that match what you asked.

In the demo recording, a basketball clip sits on the left while the chat fills the right. The model answers that playing basketball happens in seconds four, five, and seven, and that he is dribbling to practice his skills.

You can ask about any moment in a video and get a clear answer back. It is free and open source, so you can run it yourself. Would you use this to chat with your own videos?

This page was generated from the Ming Dao AI publication record.