MPAI publishes Working Draft of Use Cases and Functional Requirements of Multimodal Conversation (MPAI-MMC) Version 2

Geneva, Switzerland - 20 April 2022. The international, non-profit, unaffiliated Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) standards developing organisation has concluded its 19th General Assembly. Among the outcomes is the publication of the working draft of the Use Cases and Functional Requirements of the planned Version 2 of the Multimodal Conversation (MPAI-MMC) standard. (https://mpai.community/standards/mpai-mmc/)
The MPAI process envisages that a standard be developed based on a Call for Technologies referring to two documents Functional Requirements and Framework Licence. While the MPAI-MMC V2 documents are still being finalised, MPAI offers an initial working draft (http://mpai.community/wp-content/uploads/2022/04/N646-MPAI-MMC-Use-Cases-and-Functional-Requirements-WD1.3.docx) of the Functional Requirements to alert the industry of its intention to initiate the development of the standard. This will happen when the Call for Technologies is published (planned to be the 13th of July 2022). Responses are expected to be submitted on the 10th of October 2022 and the standard to be published in the first few months of 2023.
Version 2 will substantially extend the capabilities of Version 1 of the MPAI-MMC standard (https://mpai.community/standards/mpai-mmc/introduction-to-mpai-mmc/) by supporting three new use cases:
1. Conversation About a Scene: a human holds a conversation with a machine about objects in a scene of which the human is part. While conversing, the human points their fingers to indicare their interest in a particular object.
2. Human-Connected Autonomous Vehicle Interaction: a group of humans has a conversation on a domain-specific suject (travel by car) with a Connected Autonomous Vehicle. The machine understands the utterances, the emotion in the specch and in the faces, and the expression in their gestures. The machine manifests itself as the torso of an avatar whose face and head convey emotions congruent with the the speech it utters.
3. Avatar Videoconference. In this instance of Mixed-reality Collaborative Space (MCS), avatars represent humans participating in a videoconference. Avatars reproduce the movements of the torsoes of human participants with a high degree of accuracy.
MPAI develops data coding standards for applications that have AI as the core enabling technology. Any legal entity supporting the MPAI mission may join MPAI (https://mpai.community/how-to-join/join/) , if able to contribute to the development of standards for the efficient use of data.
So far, MPAI has developed 5 standards (see the list below), is currently engaged in extending two approved standards and is developing other 9.
Name of standard: AI Framework (approved)
- Acronym: MPAI-AIF
- link: https://mpai.community/standards/mpai-aif
- Brief description: Specifies an infrastructure enabling the execution of implementations and access to the MPAI Store.

Name of standard: Context-based Audio Enhancement (developed)
-Acronym: MPAI-CAE
-link: https://mpai.community/standards/mpai-cae
- Brief description: Improves the user experience of audio-related applications in a variety of contexts.

Name of standard: Compression and Understanding of Industrial Data (developed)
- Acronym: MPAI-CUI
- link: https://mpai.community/standards/mpai-cui
- Brief description: Predicts the company performance from governance, financial, and risk data.

Name of standard: Governance of the MPAI Ecosystem (developed)
-Acronym: MPAI-GME
-link: https://mpai.community/standards/mpai-gme
- Brief description: Establishes the rules governing the submission of and access to interoperable implementations.

Name of standard: Multimodal Conversation (approved)
-Acronym: MPAI-MMC
- link: https://mpai.community/standards/mpai-mmc
- Brief description: Enables human-machine conversation emulating human-human conversation.

Name of standard: Server-based Predictive Multiplayer Gaming (in development)
-Acronym: MPAI-SPG
-link: https://mpai.community/standards/mpai-spg
- Brief description: Trains a network to com­pensate data losses and detects false data in online multiplayer gaming.

Name of standard: AI-Enhanced Video Coding (in development)
-Acronym: MPAI-EVC
-link: https://mpai.community/standards/mpai-evc
- Brief description: Improves existing video coding with AI tools for short-to-medium term applications.

Name of standard: End-to-End Video Coding (in development)
-Acronym: MPAI-EEV
-link: https://mpai.community/standards/mpai-eev
- Brief description: Explores the promising area of AI-based "end-to-end" video coding for longer-term applications.

Name of standard: Connected Autonomous Vehicles (in development)
-Acronym: MPAI-CAV
-link: https://mpai.community/standards/mpai-cav
- Brief description: Specifies components for Environment Sensing, Autonomous Motion, and Motion Actuation.

Name of standard: Avatar Representation and Animation (in development)
-Acronym: MPAI-ARA
-link: https://mpai.community/standards/mpai-ara
- Brief description: Specifies descriptors of avatars impersonating real humans.

Name of standard: Neural Network Watermarking (in development)
-Acronym: MPAI-NNW
-link: https://mpai.community/standards/mpai-nnw
- Brief description: Measures the impact of adding ownership and licensing information in models and inferences.

Name of standard: Integrative Genomic/Sensor Analysis (in development)
-Acronym: MPAI-GSA
-link: https://mpai.community/standards/mpai-gsa
- Brief description: Compresses high-throughput experiments data combining genomic/proteomic and other.

Name of standard: Mixed-reality Collaborative Spaces (in development)
-Acronym: MPAI-MCS
-link: https://mpai.community/standards/mpai-mcs
- Brief description: Supports collaboration of humans represented by avatars in virtual-reality spaces called Ambients

Name of standard: Visual Object and Scene Description (in development)
-Acronym: MPAI-OSD
link: https://mpai.community/standards/mpai-osd
- Brief description: Describes objects and their attributes in a scene and the semantic description of the objects.

Visit the MPAI web site (https://mpai.community/), contact the MPAI secretariat (secretariat@mpai.community) for specific information, subscribe to the MPAI Newsletter and follow MPAI on social media:
- LinkedIn (https://www.linkedin.com/groups/13949076/)
- Twitter (https://twitter.com/mpaicommunity)
- Facebook (https://www.facebook.com/mpaicommunity) ,
- Instagram (https://www.instagram.com/mpaicommunity/)
- YouTube (https://youtube.com/c/mpaistandards).
Most important: join MPAI (https://mpai.community/how-to-join/join/), share the fun, build the future.

MPAI, c/o Me Olivier Brunisholz
5 Cours des Bastions
CH-1205 Geneva, Switzerland.

Moving Picture, Audio and Data Coding by Artificial Intelligence (MPAI) is an international non-profit organisation with the mission is to develop Artificial Intelligence (AI) enabled digital data compression specifications, with clear Intellectual Property Rights (IPR) licensing frameworks,
1. Of Moving Picture, Audio and Data Coding, especially using new technologies such as Artificial Intelligence, and
2. That facilitate integration of Moving Picture, Audio and Data coding components into systems.

This release was published on openPR.