Skip to content

Pull requests: scaleapi/llm-engine

New pull request New
41 Open 668 Closed
41 Open 668 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: avoid global k8s Configuration singleton race in read_config_map
#764 opened Feb 23, 2026 by lilyz-ai Loading…
2 tasks
Adding SGP-related extensible configuration to the model engine helm chart
#762 opened Feb 20, 2026 by arniechops Loading…
2
feat: add ModelWeightsManager to auto-sync HF weights on endpoint creation
#761 opened Feb 20, 2026 by lilyz-ai Loading…
6 tasks done
15
perf improvements incl. client reuse, more efficient middleware
#759 opened Feb 15, 2026 by olliestanley • Draft
1
Inference: allow IPv4 bind host
#758 opened Feb 13, 2026 by dustinrubin5050 Loading…
Config: support IPv4 bind host for inference servers
#757 opened Feb 13, 2026 by dustinrubin5050 Loading…
add qwen3-8b-instruct as supported model
#756 opened Feb 12, 2026 by lukasewecker Loading…
Add task_expires_seconds for async endpoint task expiration
#754 opened Feb 11, 2026 by lukasewecker Loading…
25
cpu only endpoints
#751 opened Jan 31, 2026 by dmchoiboi Loading…
Revert openai schema back to 3.0.0
#740 opened Dec 18, 2025 by lilyz-ai Loading…
Share controller 20251206 133239
#736 opened Dec 6, 2025 by Shreyasg13 Loading…
🚧 Add queue_message_timeout_duration parameter to endpoints (from older TASMU base commit)
#731 opened Dec 1, 2025 by ValentineDragan • Draft
[PSP-449] Add on-prem support to model-engine
#725 opened Oct 28, 2025 by TarunRavikumar Loading…
5
[MLI-4966] Launch support multiple routes passthrough
#722 opened Oct 14, 2025 by meher-m Loading…
@meher-m
Vllm batch upgrade
#715 opened Sep 24, 2025 by dmchoiboi • Draft
1
Add configurable queue_message_timeout_duration parameter in endpoint service configs
#709 opened Sep 16, 2025 by ValentineDragan • Draft
1
changed host flag to be 0.0.0.0 to be compatible with both ipv4 and ipv6
#707 opened Sep 12, 2025 by andytang-scale Loading…
1
Enhance model engine with max concurrency support for sync endpoints
#701 opened Aug 24, 2025 by saeidbarati-scale Loading…
on prem changes to disable cloud solutions
#700 opened Aug 18, 2025 by jen-scymanski-scale Loading…
21
multinode readme changes and remove logs
#697 opened Jun 7, 2025 by meher-m • Draft
deepseek multinode and no logging
#696 opened Jun 6, 2025 by meher-m • Draft
Update celery forwarder to use greenlets instead of processes
#689 opened Mar 1, 2025 by dmchoiboi Loading…
2
[GCP] Aagamdalal/sgp 3575 model engine update pubsub model engine code
#686 opened Feb 18, 2025 by AaDalal Loading…
[GCP] Update artifact registry/db code
#685 opened Feb 13, 2025 by AaDalal Loading…
5
Google Cloud Storage Integration
#683 opened Feb 3, 2025 by anishxyz Loading…
11
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.