V2 Inference Bridge & Provider Config

[fearnworks]

Description

• Rewrite of the Inference Server to have no knowledge of provider configuration
• Removal of all file based provider configuration
• Add provider config to data service
• Consolidation of inference config, generation options, etc
• Several new options needed for configuring inference providers

Fixes # (issue)

Type of Change

• Bug fix
• New feature
• Documentation update
• Other (please describe):

How Has This Been Tested?

Manual testing tracked in https://discord.com/channels/1252752968416100485/1355641758956130485

Checklist:

• My code follows the style guidelines of this project
• I have performed a self-review of my code
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• My changes generate no new warnings
• I have added or updated tests that prove my fix is effective or my feature works

Additional Context

Add any additional information that might be helpful for the review.

[sonarqubecloud]

Quality Gate passed

Issues
13 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
1.7% Duplication on New Code

See analysis details on SonarQube Cloud