Learn how to use a vector database to store and retrieve vectors for your LLM application.

Vector Database

Palico AI

Setup a Palico app locally in just a few steps.

Quickstart

Learn about the different components of a Palico app

Components

With Palico you can build complex LLM applications with complete flexibility.

Build You Application

Palico provides you flexiblity and tools to build complex Agent interactions. With Palico you can run functions on client and server side, manage states across requests, and stream messages or intermediate steps to client.

Agent With Tools

Feature Flags

You can stream messages, intermediate steps, and other data back to the user using the [ChatResponseStream](https://typedoc.palico.ai/classes/_palico_ai_app.ChatResponseStream.html) object. You can access this object from your `Chat` function's input.

Streaming

Create and restore conversation state without worrying about underlying storage infrastructure. Build chatbot with memory or complex stateless agent interactions.

Long-Term Memory

Add custom logs and traces and view them in Palico Studio.

Logs And Traces

To improve the performance of an application, we need to setup an iterative loop that helps us _systematically_ measure and improve performance of our application.

Experiments

AI Gateway is a service that let's you use with different LLM models from a single endpoint

AI Gateway

This guide will help you develop a structured way to manage your prompts

Prompt Management

Deploy your Palico app to production with Docker. Setup CI/CD and Pull Request Preview with Coolify.

Deployment

Palico provides complete flexibility over the implementation details of your LLM Application, and as such, you can libraries like LangChain to help build your LLM application logic.

LangChain

Palico provides complete flexibility over the implementation details of your LLM Application, and as such, you can libraries like LlamaIndex to help build your LLM application logic.

Llama Index

You can use any LLM Providers with Palico. Here are some examples of popular LLM providers.

Model Providers

Getting Started

The Palico REST API allows you to interact your Palico app from any application.

Get Started

Guides

Integrations

Vector Database