[Feature] Visualize SignWriting more pictographically #114
Description
Problem
People without previous SignWriting experience have a hard time understanding SignWriting notation that looks like this:
Even when paired with a video producing these signs.
Description
We should support an alternative view to SignWriting, perhaps showing pictographs of the relevant signs.
For example:
| SignWriting | Pictograph |
|---|---|
 |
 |
 |
  |
 |
 |
Probably the easiest way to get a POC done: https://github.com/lllyasviel/ControlNet
(data should be then annotated with a textual prompt "man" or "woman" signing, and can be longer like "man with short hair signing")
Alternatives
Once videos are generated directly from SignWriting, we can also show the video for each sign.
Additional context
This can be server side only, doesn't have to be client-side, since it is not necessary for the translation, only assists in visualization. It will also make it faster, less heavy for the client, and cacheable
Data can be extracted from:
- https://www.signbank.org/signpuddle2.0/index.php?ui=1&sgn=49 (illustration on sign puddle can be different from the one on signsuisse website)
- the swiss german Vokabeltrainer
This feature is somewhat inspired by https://www.youtube.com/watch?v=Eq3bUFgEcb4 - I don't think that notation must die, but certainly we can give alternative notation to different use cases