Futures Lab - Cutting edge technologies and research influencing Defence

Live transcription glasses

Our very own Defence Equipment and Support (DE&S) organisation has begun a staff trial of XRAI glasses. XRAI have developed augmented reality (AR) glasses that provide live conversation captions and translation in a form factor of regular spectacles. DE&S have made eight sets available to be booked by the deaf and hearing loss community. Various commentators describe transcription latency as around one second.

Captioning and translation of conversations in a user-friendly form factor and without appreciable lag is a positive step forward for day-to-day usability. This also represents a cultural shift towards the societal adoption of AR technology, moving on from the much-criticised Google Glass, launched a decade ago. It may also provide a useful capability for different military forces working together who do not speak a common language.

Hacking Meta/Ray-Ban glasses

Two Harvard researchers have used the Meta/Ray-Ban smart glasses to identify people seen by the built-in camera. Faces captured by the glasses’ live stream are fed through services that match to publicly available ones. This data is cross-referenced to other services to provide additional information such as addresses and social security numbers. Relatively simple automation scripts are used to obtain the data which is then summarised by a large language model and fed back into the wearer’s field of view.

Processing usually takes around a minute and the real impact is the automation of data scraping and summarisation, with the glasses providing a more conventional social interface between the wearer and those being identified. This type of automation could be used to improve battlefield awareness, though its application should be informed by debate on human rights and facial recognition.

Microsoft Hololens discontinued

Microsoft has announced its Hololens AR headset will be discontinued, with software and security support ending in December 2027. Futures Lab has previously reported on militaries experimenting with AR, including the US Army’s Integrated Visual Augmentation System (IVAS) programme using the Hololens. Microsoft has said they remain committed to IVAS, with the US Army planning an operational test in 2025, which may include embedding Anduril’s Lattice data fusion software.

Despite programmes such as IVAS, the bulkiness and fragility of AR hardware makes its widespread military use appear somewhat remote. Though Microsoft is exiting the AR hardware business, others continue to invest and release new products. Coupled with demand for civilian applications, it is likely the form factor of AR devices in the near future will settle on regular glasses.

New AR products

Meta has showcased their Orion AR glasses. To improve the field of view and weight, the lenses are made of silicon carbide, but the cost of manufacture (estimated at US$10,000) means Orion is not currently a consumer product. In live demonstrations, they have successfully shown an AR capability incorporating text, video and generative AI with a form factor of conventional glasses. While the glasses project the AR display, more intensive processing is offboarded to a smart-phone sized “puck” carried by the wearer. Interaction is via hand gestures interpreted by an electromyographic wristband that includes haptic feedback.

Other market competitors include Google’s Project Astra and Snap’s 5th generation Spectacles. Though none are likely mature enough for the mass-market just yet, ordinary glasses are the form factor that will likely make the AR experience more acceptable for consumers. If the IVAS programme is able to take advantage of a more conventional form factor, its acceptance by military users is likely to be more welcome.

Cybalthlon

Cybathlon 2024 took place in Switzerland in late October. The event consists of races and challenges for people that require assistive technologies, such as a prosthetic or using a wheelchair. Competitors include both users and developers from the universities and companies who design the assistive technologies. The competition spans eight categories including: arm prosthesis, leg prothesis, brain computer interface and vision assistance. With a goal of innovation and dialogue, the event is aimed at developing active assistive technologies, unlike the Paralympics that allow only passive devices/protheses.

The races and challenges are those of everyday tasks: for example, brushing teeth and hanging up a scarf. The development of new devices and prostheses that help the lives of service men and women who have lost limbs, eyesight, etc. will contribute to their wellbeing.

Wi-Lo communications

WiLo is a new, experimental standard that combines Wi-Fi with LoRa (Long Range networking protocol). While both standards operate in the 2.4GHz range, the signals are not compatible. Researchers developed an algorithm to manipulate the Wi-Fi multiplexing standard matching it to LoRa and allowing signals to be received by off the shelf LoRa components. A 96% transmission success rate was achieved at distances up to 500m.

This approach potentially bridges the traditional signal transmission trade-off between distance and capacity. Although this experimental technique currently uses more power (for the signal manipulation algorithm) further research and optimisation may address this to create a new protocol that improves bandwidth at longer distances.

Homemade weapons

The Sydney Morning Herald reports Australia is suffering a surge in home-made weapons, with an exponential rise in the number of such weapons being recovered from raids. Police say plans shared amongst criminals and the use of 3D printers is contributing to the proliferation, which includes the manufacture of both weapons and ammunition.

Alongside drones, this is another example of the democratisation of weapons manufacture. As manufacturing capabilities transition from the industrial to the domestic, military forces should expect to encounter home-made weapons of increasing sophistication and capability on the battlefield.

?

Follow Futures Lab on LinkedIn to keep up to date with our latest news.