25.1 C
New York
Wednesday, July 16, 2025

Buy now

Finally, a dev kit for designing on-device, mobile AI apps is here: Liquid AI’s LEAP

Liquid AI, the startup shaped by former Massachusetts Institute of Know-how (MIT) researchers to develop novel AI mannequin architectures past the widely-used “Transformers“, at this time introduced the discharge of LEAP aka the “Liquid Edge AI Platform,” a cross-platform software program improvement package (SDK) designed to make it simpler for builders to combine small language fashions (SLMs) immediately into cell functions.

Alongside LEAP, the corporate additionally launched Apollo, a companion iOS app for testing these fashions regionally, furthering Liquid AI’s mission to allow privacy-preserving, environment friendly AI on shopper {hardware}.

The LEAP SDK arrives at a time when many builders are in search of alternate options to cloud-only AI providers because of issues over latency, value, privateness, and offline availability.

LEAP addresses these wants head-on with a local-first method that permits small fashions to run immediately on-device, lowering dependence on cloud infrastructure.

Constructed for cell devs with no prior ML expertise required

LEAP is designed for builders who need to construct with AI however could not have deep experience in machine studying.

In response to Liquid AI, the SDK may be added to an iOS or Android undertaking with only a few strains of code, and calling an area mannequin is supposed to really feel as acquainted as interacting with a conventional cloud API.

See also  Judge rejects bid to block Anthropic from using song lyrics for AI training

“Our analysis reveals builders are shifting past cloud-only AI and in search of trusted companions to assist them construct on-device,” stated Ramin Hasani, co-founder and CEO of Liquid AI, in a weblog submit saying the information at this time on Liquid’s web site. “LEAP is our reply—a versatile, end-to-end deployment platform constructed from the bottom as much as make highly effective, environment friendly, and personal edge AI really accessible.”

As soon as built-in, builders can choose a mannequin from the built-in LEAP mannequin library, which incorporates compact fashions as small as 300MB — light-weight sufficient for contemporary telephones with as little as 4GB of RAM (!!) and up.

The SDK handles native inference, reminiscence optimization, and machine compatibility, simplifying the everyday edge deployment course of.

LEAP is OS- and model-agnostic by design. At launch, it helps each iOS and Android, and affords compatibility with Liquid AI’s personal Liquid Basis Fashions (LFMs) in addition to many standard open-source small fashions.

The aim: a unified ecosystem for edge AI

Past mannequin execution, LEAP positions itself as an all-in-one platform for locating, adapting, testing, and deploying SLMs for edge use.

Builders can browse a curated mannequin catalog with numerous quantization and checkpoint choices, permitting them to tailor efficiency and reminiscence footprint to the constraints of the goal machine.

Liquid AI emphasizes that enormous fashions are typically generalists, whereas small fashions typically carry out finest when optimized for a slender set of duties. LEAP’s unified system is structured round that precept, providing instruments for fast iteration and deployment in real-world cell environments.

See also  Microsoft adds AI-powered deep research tools to Copilot

The SDK additionally comes with a developer neighborhood hosted on Discord, the place Liquid AI affords workplace hours, help, occasions, and competitions to encourage experimentation and suggestions.

Apollo: like Testflight for native AI fashions

To enrich LEAP, Liquid AI additionally launched Apollo, a free iOS app that lets builders and customers work together with LEAP-compatible fashions in an area, offline setting.

Initially a separate cell app startup that allowed customers to speak with LLMs privately on machine, which Liquid acquired earlier this yr, Apollo has been rebuilt to help the whole LEAP mannequin library.

Apollo is designed for low-friction experimentation — builders can “vibe examine” a mannequin’s tone, latency, or output habits proper on their telephones earlier than integrating it right into a manufacturing app. The app runs solely offline, preserving person privateness and lowering reliance on cloud compute.

Whether or not used as a light-weight dev software or a non-public AI assistant, Apollo displays Liquid AI’s broader push to decentralize AI entry and execution.

Constructed on the again of the LFM2 mannequin household introduced final week

LEAP SDK launch builds on Liquid AI’s July 10 announcement of LFM2, its second-generation basis mannequin household designed particularly for on-device workloads.

LFM2 fashions are available 350M, 700M, and 1.2B parameter sizes, and benchmark competitively with bigger fashions in pace and accuracy throughout a number of analysis duties.

These fashions kind the spine of the LEAP mannequin library and are optimized for quick inference on CPUs, GPUs, and NPUs.

Free and prepared for devs to start out constructing

LEAP is at the moment free to make use of below a developer license that features the core SDK and mannequin library.

See also  ChatGPT was downloaded 30 million times last month - but its user base data is more shocking

Liquid AI notes that premium enterprise options will probably be made out there below a separate industrial license sooner or later, however that it’s taking inquiries from enterprise prospects already via its web site contact kind.

LFM2 fashions are additionally free for tutorial use and industrial use by firms with below $10 million in income, with bigger organizations required to contact the corporate for licensing.

Builders can get began by visiting the LEAP SDK web site, downloading Apollo from the App Retailer, or becoming a member of the Liquid AI developer neighborhood on Discord.

Supply hyperlink

Related Articles

Leave a Reply

Please enter your comment!
Please enter your name here

Latest Articles