Hey everyone!
I'm working on a project that aims to convert HamNoSys (Hamburg Sign Language Notation System) into 3D sign language animations using avatars.
For those unfamiliar with HamNoSys, it's a notation system used by linguists and researchers to describe sign languages. It represents the different components of a sign, such as handshape, hand orientation, location, and movement.
But here's what got me thinking:
What if we could make this notation system useful and accessible beyond the linguistics community?
Imagine writing down a sign using HamNoSys and immediately seeing a 3D avatar perform that sign. Instead of having to interpret complex notation, anyone could simply see what it represents. As they say, seeing is believing!
My vision: A community-driven sign language dictionary
One of the biggest challenges with sign languages is variation.
Every country has its own sign language, and even within a single sign language, there can be significant regional differences. Many sign languages, particularly those with fewer documented resources, also lack comprehensive digital documentation.
This can create barriers to learning, communication, and accessibility.
My long-term vision is to build a community-driven platform where people can:
Create signs using HamNoSys notation.
Convert those notations into 3D avatar demonstrations.
Contribute signs to a shared, searchable database.
Document regional variations and different sign languages.
Reuse and build upon contributions made by others.
Over time, this could grow into a collaborative sign language vocabulary database.
And interestingly: Once there is a sufficiently large and reliable database of documented signs, it could potentially become the foundation for converting text into sign language animations directly. For example, someone could enter an English sentence, and the system could retrieve corresponding signs from the database and generate an avatar demonstration.
Who could benefit from this?
There are several potential use cases:
Sign language enthusiasts: Experiment with creating different signs and sharing them with others.
Linguists and researchers: Document, study, and compare signs in a standardized format.
Developers and ML researchers: Use structured sign language data to build translation tools and other applications.
You can check out the initial demo here: https://shy-thunder-d1eb.clodeplusart.workers.dev/
If you like the project, you can support it's development here: https://ko-fi.com/codeplusart
Any feedback, suggestions, or contributions would be greatly appreciated!