Computer

Qualcomm AI Hub: artificial intelligence on mobile devices. There are also X80 and FastConnect 7900

Qualcomm AI Hub: artificial intelligence on mobile devices.  There are also X80 and FastConnect 7900

Al Mobile World Congress 2024 of Barcelona, Qualcomm announced a new 5G modem that further raises the standards both in terms of performance and energy efficiency. Snapdragon X80 it is the seventh 5G modem from the company led by Cristiano Amon and is the first to integrate a AI module which bases its operation on a dedicated tensor accelerator.

Before talking about hardware, however, we believe it makes sense to start from the software and the practical applications of the innovations introduced by Qualcomm in the market of solutions forartificial intelligence.

Qualcomm AI Hub: the platform that brings artificial intelligence to smartphones and other local devices

Until some time ago, the trend was that of move to the cloud the computing resources and therefore the processing used by AI tools. Now, however, the increasingly widespread availability of powerful GPUs and NPUs (Neural Processing Unit) on mobile devices, allows you to benefit from the computing locally, without “disturbing” remote systems managed by third parties.

Qualcomm AI Hub is just that: a platform that provides access to AI models optimized to run on Snapdragon devices, such as Snapdragon X Elite-powered smartphones and PCs.

I models distributed through Qualcomm AI Hub are optimized to make the most of thehardware acceleration of CPU, GPU and NPU integrated into the Snapdragon series SoCs. Developers can use this platform to download templates machine learning and develop artificial intelligence applications ready to be used on smartphones.

Qualcomm AI Hub generative models

How many and which models does Qualcomm AI Hub offer

At the time of writing, Qualcomm AI Hub offers more than 75 types of “ready-to-use” models: among them we mention Stable Diffusion for the image generation, Whisper for the transcription of the text e Clip for image recognition.

Qualcomm also publishes practical examples for using the models deployed through its solution. Some demonstration videos, for example, show how the “LLaVA” model, capable of recognizing images and answering questions, on an Android smartphone. Other videos focus on generating images using Stable Diffusion e LoRA (Low-Rank Adaptation)always on a smartphone.

As we explained in the article focused on AI solutions at the service of decision-making processes in companies, LoRA it is a fundamental technique for those approaching the study and use of open source LLMs, one of the most effective tools for improve a pre-existing model and carry out the fine tuning: here is a demonstration video from Qualcomm.

Models distributed through Qualcomm AI Hub, as mentioned above, can work not only on smartphones but also on future PCs ARM-based equipped with Snapdragon X Elite SoC. Here you see a multimodal generative model running on a Windows on ARM PC; here a multimodal LLM in use on an Android smartphone.

You can download Snapdragon-optimized templates not only from the Qualcomm AI Hub, but also from the repository GitHub and Hugging Face account managed by Qualcomm.

Qualcomm Snapdragon X80: new 5G modem that supports AI and satellite connection

Thanks to the dedicated processor for artificial intelligence (AI Processor) based, as mentioned previously, on a tensor accelerator, the new Qualcomm Snapdragon data transfer speed (up to 10 Gbps download and 3.5 Gbps upload), coverage, location accuracy, spectral efficiency and latency.

It also natively supports the technology NB-NTN (Non-Terrestrial Networks) which aims to extend satellite communications to a larger number of devices using the San Diego company’s flagship chips. In another article we saw what the idea of ​​the satellite phone inside the smartphone is based on and how it works.

Modem Qualcomm Snapdragon X80 5G AI

The new modem also boasts a 6 antennaimproving signal reception; carrier aggregation 6X, increasing available bandwidth for faster connectivity; the expansion of the coverage range for millimeter wave (mmWave) transmissions, liberalized in Europe. Thanks to AI, the Snapdragon X80 modem can significantly improve performance, especially in the case of Internet access via fixed location wireless devices (CPE).

The first commercial devices equipped with Qualcomm’s most updated, powerful and versatile 5G modem are expected to hit the market in the second half of 2024. Durga Malladi, Senior Vice President and General Manager of Qualcomm Technologies, highlights the importance of artificial intelligence in future of connectivity.

What the FastConnect 7900 chip is and how it works

In addition to the X80, Qualcomm also announced the platform FastConnect 7900a 6nm chip that integrates WiFi 7, Bluetooth 5.4 and UWB (Ultra Wide Band). It is the first system to integrate WiFi, Bluetooth and UWB technologies on a single chip – an integration that opens the door to seamless experiences. Think for example of movement in closed environmentssearching for objects, using digital keys.

According to the company’s technicians, the device improves “awareness of proximity” in the sense that it is able to optimize the identification, connection and control of devices physically located nearby. It also supports Qualcomm XPAN (Expanded Personal Area Network), useful for expanding the user’s personal network and offering advanced wireless connectivity features with audio support and Snapdragon Soundallowing high-speed music streaming over a WiFi network.

The Qualcomm FastConnect 7900 platform, like the X80 modem, uses AI to adapt to specific use cases and environments, resulting in low latency, improved bandwidth and other significant optimizations. FastConnect 7900 will also appear in the first commercial devices in the second half of 2024.

Leave a Reply

Your email address will not be published. Required fields are marked *