Google release sign language transtext model, Pixel 11 can type directly

Google DeepMind publishes sign-language transliteration model SL2T and links it to Gboard and Live Transcribe in Pixel 11. The model initially supports the transfer of U.S. sign language to English, where users can search, write messages, enter documents and even question Gemini directly. SL2T has over 100,000 hours of data training covering more than 50 sign languages, about a quarter of which are United States sign languages. Hand-to-hands extraction of position coordinates of hands, faces and bodies, which are only sent to the server for translation and the original video is not uploaded。