Skip to main content

Introduction

Overview

The LLM SDK provides an API that allows infotainment apps running on Pleos Connect to integrate with the LLM platform (LLM AI service). Using this SDK, user input is sent to the platform, and the generated text result is returned to the app. The app can interact with the LLM AI service to create plans or perform tasks suitable for the automotive environment.

Development Environment Setup

To use the LLM SDK, install the Pleos Connect Emulator in Android Studio and proceed with AVD setup.

LLM API

The list of APIs provided by the LLM SDK is as follows.

FunctionSummary
initialize APIAPI to initialize the LLM SDK.
release APIAPI to release the LLM SDK.
generateContent APIAPI to generate a result based on the app's input data source and deliver it to the app in real time, returning a response for a single request.
startChat APIAPI to start a conversation with the LLM service.
sendMessage APIAPI to support conversation and chat features by generating a result based on the app’s input data source and delivering it in real time, while incorporating conversation history into the response.
setModelParameter APIAPI to allow users to update the LLM model and configuration settings to their desired values.
registerApp APIAPI to register an app to use server-based LLM functionality.