Feature/Add LocalAI

[HenryHengZJ]

LocalAI.mp4

[Egalitaristen]

So I tried to replace the ChatOpenAI wrapper with ChatLocalAI in the AutoGPT template but it won't connect the output from ChatLocalAI to the input of the AutoGPT wrapper.

Anyone got any ideas about how to solve this?

[DonXtasy]

How do you use LocalAI as Embedding?

[HenryHengZJ]

Will be creating an embedding node for LocalAI

[HenryHengZJ]

LocalAI Embedding node is merged now - #300

[DonXtasy]

@HenryHengZJ Thanks. Just a short question. I updated via git clone and then docker-compose up -d. But the LocalAi Embedding is not showing. Or what should be the worklfow? Im a beginner with Github and Docker :)

[HenryHengZJ]

@DonXtasy not yet pushed the new localai embeddings to docker. For now you can update locally by:

git pull
yarn build
yarn start

[mozg31337]

A bit of a daft question from a beginner. I am trying to use my llama.cpp model files stored locally on my computer. How do I expose them to the ChatLocalAI tool? I can't specify the path to the local file. It seem to want to access it via http. Thanks

[gregorym]

Is there any documentation for this?

[chungyau97]

Hi @gregorym,

Here are the documentation of LocalAI:

1. LocalAI Embeddings
2. ChatLocalAI