Pinned Loading

1. llama.cpp-omni llama.cpp-omni Public

   Omni inference in C/C++

   C++ 105 23

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   Port of Facebook's LLaMA model in C/C++

   C++ 111 21

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 2

4. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 1