refactor: replace openai sdk with foundrysdk

[Rafi-Microsoft]

Purpose

This pull request migrates the content processing pipeline from using the OpenAI SDK to the new Azure AI Foundry (Inference) SDK, updates dependencies, and refactors related code to accommodate the new SDK’s response format. It also improves the confidence merging logic and updates infrastructure permissions for Azure AI Developer role.

SDK Migration and Dependency Updates

• Replaced the openai SDK with azure-ai-inference throughout the codebase, updating both requirements.txt and pyproject.toml to remove openai and add azure-ai-inference. [1] [2]
• Refactored the Azure OpenAI client logic in azure_openai.py to use ChatCompletionsClient from the Azure AI Foundry SDK and updated endpoint handling.

Pipeline Handler Refactoring

• Updated map_handler.py to invoke the Azure AI Foundry client for completions, handle schema validation, and serialize responses in the new format, including logprobs and usage details. [1] [2] [3]
• Refactored evaluate_handler.py to deserialize and process responses according to the new Azure AI Foundry format, including changes to how confidence scores and token usage are extracted. [1] [2] [3]

Confidence Logic Improvements

• Enhanced the confidence merging logic in confidence.py to merge keys from both input dictionaries, ensuring no data loss if keys are present in only one input.
• Updated the confidence evaluator to work with the new Azure AI Foundry response structure, replacing attribute access with dictionary access. [1] [2]

Configuration and Infrastructure Updates

• Added new configuration option for the AI Foundry project endpoint in application_configuration.py. [1] [2]
• Updated Bicep infrastructure to grant the Azure AI Developer role to the container app’s managed identity for access to AI Foundry resources.

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

[github-actions]

🎉 This PR is included in version 1.11.1 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀