This project is not covered by Drupal’s security advisory policy.
AI-Provider for LocalAI: LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures. Does not require GPU.
Features of LocalAI:
- Text generation with GPTs (llama.cpp, gpt4all.cpp and more)
- Text to Audio
- Audio to Text (Audio transcription with whisper.cpp)
- Image generation with stable diffusion
- OpenAI functions
- Embeddings generation for vector databases
- Constrained grammars
- Download Models directly from Huggingface
- Vision API
- Stores
- Reranker
- P2P Inferencing
See here for more information.
Supporting organizations:
Project information
- Project categories: Integrations
- Ecosystem: AI (Artificial Intelligence)
- Created by jan kellermann on , updated
This project is not covered by the security advisory policy.
Use at your own risk! It may have publicly disclosed vulnerabilities.
