Multimodal Human-Machine Interface for Mixed Reality (XR) and Robotic Autonomous Systems (RAS) Control

Active

Contract Opportunity

Request for Information

For: Multimodal Human-Machine Interface for Mixed Reality (XR) and Robotic Autonomous Systems (RAS) Control

1. GENERAL INFORMATION

The information herein only initiates communication with industry in order to assess market potential. No solicitation document exists at this time. This Request for Information (RFI) constitutes no Government obligation to procure these items or issue a solicitation. The Government has no obligation or intent to pay for information responding to this RFI nor will it accept any responses as offers. Vendors should mark any proprietary information clearly and appropriately.

1. PURPOSE

The Cognitive Science and Applications Branch, Combat Capability Development Command Soldier Center (DEVCOM SC), is seeking cutting-edge technology solutions for multimodal human-machine interfaces for fast, accurate, and intuitive control of mixed reality (XR) and robotic autonomous systems (RAS). This RFI aims to identify innovative technologies and approaches that can:

1. Enable seamless and intuitive interaction between Soldiers and XR/RAS through intuitive and user-friendly interfaces, minimizing cognitive load and training requirements.


2. Enhance situational awareness (SA) for Soldiers operating in complex and dynamic environments.


3. Enable Soldiers to effectively offload risk and work to RAS, allowing them to focus on higher-level tasks.

CSAB is interested in human-machine interface (HMI) solutions that leverage a combination of information modalities, including but not limited to:

• Visual: XR displays, augmented reality overlays, and intuitive graphical user interfaces.


• Auditory: Voice commands, spatialized audio cues, and natural language processing.


• Haptic: Force feedback devices, tactile sensors, and gesture recognition.


• Biometric: Physiological monitoring, eye tracking, and brain-computer interfaces.

CSAB recognizes that HMI technology development is an iterative process. Therefore, respondents are encouraged to present solutions that offer incremental value and can be rapidly prototyped, tested, and fielded in operational environments.

Candidate solutions should meet the following requirements:

1. 
   
   
   
   1. System Specifications (T: Threshold, O: Objective)
   
   
   
   

Specification

System Capabilities

Multimodal Design

System should integrate 2 or more information modalities to recognize and classify user intent (e.g., Inertial Measurement Unit (IMU), Surface electromyography (sEMG), Electroencephalogram (EEG), eye tracking, head movement, voice, etc.)

Integration Ready, Modular Open System Architecture (MOSA)

System should include mature software development kits (SDKs) and/or application programming interfaces (APIs) to facilitate technology integration and data collection for human-subjects evaluation with XR and RAS systems. Integration with Unity and/or Android highly preferred.

End-to-End Input Recognition Latency

Input Recognition Accuracy

> 80 % (T), > 95% (O)

System Set-up Time

System Breakdown & Stowage Time

Low-to-No Calibration Time

Battery Efficient

> 2h continuous operation (T), > 6h continuous operation (O)

Robust Operation

System should demonstrate robust and reliable operation in contested and degraded environments.

Low-to-No Signature/Detectability

System should emit low-to-no signature or implement mitigations to minimize signature.

Secure Communication Protocol(s)

System should employ cybersecurity best practices.

Computer Hardware (if applicable)

Windows-based computer(s). All cables & connections included.

Warranty & Maintenance

First year included.

Electrical

120V AC

1. 
   
   
   
   1. Commercial Manual(s) containing system assembly, installation, operations, maintenance, calibration, troubleshooting, and software development (SDK/API) guides.
   
   
   
   

1. REQUESTED INFORMATION

There is no page restriction associated with this RFI; however, an executive summary, not to exceed five (5) pages, should accompany each submission. Responses may include any advertising or marketing information. Vendors deciding to submit competition sensitive or proprietary information bear sole responsibility for marking the information for appropriate safeguarding. Please include the following information in the response:

1. 
   
   
   
   1. 
      
      
      
      1. Company Name, Address, Point of Contact;
      
      
      2. Identification of Large or Small Business size status;
      
      
      3. Identification of the quality control system, i.e. compliance with ISO 9001:2008;
      
      
      4. Estimated unit price for each requirement listed in paragraphs 2.1-2.2;
      
      
      5. Material Description. The supplier must identify the desired requirements it meets. If a supplier submits multiple sample products to fulfill the outlined requirement, they must identify the advantage/disadvantage of the competing products submitted;
      
      
      6. Estimated time to delivery.
      
      
      
      
   
   
   
   

Please submit all responses to the following no later than 2:00 EST, 15 November 2024.

Responses: POC for this request is Aaron Gardony. Email your questions to the POC at the DEVCOM SC at the following address: aaron.gardony.civ@army.mil

1. PROPRIETARY DATA

The Government may use information received from this RFI to establish future U.S. Army requirements. Vendors deciding to submit competition sensitive or proprietary information bear sole responsibility for marking the information for appropriate safeguarding. Proprietary information will be protected from unauthorized disclosure as required by Subsection 27 of the Office of Procurement Policy Act as amended (41 U.S.C. 423) (hereinafter referred to as "the Act"), as implemented in the FAR.

ADDITIONAL INFORMATION

This Sources Sought notice is solely for information purposes and does not constitute a solicitation or the issuance thereof. This notice does not obligate the Government to issue a solicitation and/or award a contract. All information received in response to this notice that is marked proprietary will be handled accordingly. Any information submitted will not be returned, and no payment will be made by the Government for such information. The Government reserves the right to use information provided by respondents for any purpose deemed necessary and legally appropriate. Any organization responding to this notice should ensure that its response is complete and sufficiently detailed. Information provided will be used to assess tradeoffs and alternatives available for any potential requirement. Input on technical aspects of the responses may be solicited by DEVCOM SC from non-Government consultants/experts who are bound by appropriate non-disclosure requirements. By responding to this notice, the Respondent agrees to allow such input from non-Government consultants/experts concerning the information and materials submitted.

See Attachment 01 for details.

Attachments/Links