mirror of
https://github.com/vinta/awesome-python.git
synced 2026-11-20 06:40:51 +00:00
feat: add ollama to AI and Agents > Local LLM Inference
Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
parent
71bd580429
commit
532f05e4f6
1 changed files with 1 additions and 0 deletions
|
|
@ -169,6 +169,7 @@ _Libraries for building AI applications, LLM integrations, and autonomous agents
|
|||
- [transformers](https://github.com/huggingface/transformers) - The model-definition framework for pretrained models in text, computer vision, audio, video, and multimodal tasks, for inference and training.
|
||||
- [sentence-transformers](https://github.com/huggingface/sentence-transformers) - Compute embeddings, run retrieval, and rerank results with pretrained and fine-tuned models.
|
||||
- Local LLM Inference
|
||||
- [ollama](https://github.com/ollama/ollama-python) - Python client for Ollama, which downloads and runs open-weight LLMs locally.
|
||||
- [mlx-lm](https://github.com/ml-explore/mlx-lm) - Run and fine-tune large language models on Apple Silicon with MLX.
|
||||
- LLM Serving
|
||||
- [vllm](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue