Meta ' s new and public patent application indicates that the company is setting up a video system that can identify faces and record behaviour. The system is not only able to judge who is in the picture, but also to identify its movements and automatically organize video clips by query for mobile phone or headlight.
The application was submitted by Meta Platforms Technologies. The document is currently in the “preparation for review” phase, which is a continuing version of the 2022 mother's application, still some time from the date of formal approval or the arrival of the product.
The system can organize videos by character and action
According to the patent description, the camera collects real-time or historical images before being processed by the AI system. The first level is face recognition, which is used to determine which specific person appears in the picture and not just to detect “persons”.
Subsequently, another layer of action recognition module analyses behaviour, such as picking up objects, leaving the room or gathering people. The system will eventually compile the results of the identification into an independent media document with a personal, action or both.
Supports natural language retrieval clips
The patent file shows that a key focus of the system is on the means of retrieval. The connection device can search for the requested image and the system combines the answers from the marked video segment instead of allowing the user to manually drag the time axis.
The figure also shows that the processing can be performed either at the server or at the equipment end. The patent also refers to the natural language understanding process, which is used to translate user questions into partial retrieval and results.
The privacy dispute is rising again.
The focus of outside attention is not on the camera itself, but rather on its ability to mark and document the behaviour of a particular person through the face of the person without the person ' s consent. This is also one of the main concerns raised by US Democratic Senators when they questioned Meta’s smart glasses.
Criticism suggests that the ability of equipment to identify a stranger in real time may increase the risk of stalking, harassment, etc. The Ray-Ban smart glasses, launched by Meta in collaboration with Essilor Luxottica, have been controversial in recent years over public photography and private video audits.
Decrypt reported that it was still a patent application, not an online feature. The disclosure of the patent means that the concept is in the record and does not mean that the function has been developed or approved.