Hands Up Live

Research demo

Sign to the camera and see the signs as text, live. This model knows about 1,200 German Sign Language (DGS) signs from TV weather forecasts, so everyday signing will mostly give wrong or no words. Video never leaves this device.

Loading the models…

Tap to turn on your camera, then allow it. Or try Demo clip below.

Captions

    Top: German sign glosses. Below: rough English words, ? = no English word yet.

    Camera
    –
    Delay
    –
    Model step
    –
    Engine
    –
    Diagnostics (for help)
    
          

    Delay: from the last frame of each 0.32 s chunk to its result, on this device. Signs are read in chunks of 8 frames at 25 frames a second.