clay display and input device

It starts with a clay ball that gets shaped by two robotic hands according to a chosen template

Then you interact with the image on the screen by handling, reshaping, and interacting with the clay "dough" which has embedded sensors in it and is being watched by cameras looking at the resulting shape. The camera is not static but rather on a robotic arm that bends over and peers at the resulting new shapes translating it all, together with the tactile sensors embedded in the clay into a shape shown on the display or into instructions to interact with the running software.

If something in the clay has to be changed by the computer it will ask for the clay and shape it on its own.

The whole experience is like playing with a robot using playdough.

For example, you can chose you want a "block tool" that is 4x5 inches and then push your thumb into the clay, the computerobot asks you to hand over the shape and replaces your thjmb mark into a stamp at the correct depth into the clay, and the same correctly appears in the regular computer screen.