An Azure service that enables users to identify content that is potentially offensive, risky, or otherwise undesirable. Previously known as Azure Content Moderator.
Hi B.B
you're facing some challenges with the Azure OpenAI content filters when summarizing sensitive topics in your meeting note-taking and summarization tool. This is a critical area, especially given the nature of services you're providing for vulnerable populations.
Here's what you can consider:
- Content Filtering Configuration: Azure OpenAI allows you to customize content filtering settings. You might want to review your current filtering thresholds, which are set to the lowest available level, and consider adjusting sensitivity settings. Even if you're already at the lowest threshold, it's good to double-check that this is set correctly.
- Reference: Content filtering overview.
- Modified Content Filters: If adjusting sensitivity settings doesn’t help, consider applying for modified content filtering. Only approved customers can have full control over content filters, including disabling them for your use case. This could potentially allow you to summarize conversations involving sensitive terms without them being filtered out.
- Apply for modified content filters here: Azure OpenAI Limited Access Review: Modified Content Filters.
- Monitoring and Alerts: Utilize Azure Monitor to keep track of which content is being filtered and set up alerts for any unexpected filtering incidents. This can help you fine-tune your filters and workflows.
- Reviewing Recorded Filtering Data: Regularly review any content that has been filtered out. This can give you insights into whether the filters are overly sensitive and help you to possibly adjust your approach accordingly.
- Community Input: You could also engage with other users in the Azure community who may have faced similar challenges. They might have insights or best practices for designing pipelines in support services where sensitive topics are unavoidable.
I hope this helps guide you in navigating the content filtering issues while aligning with your goals of responsible AI use in sensitive contexts! If you have more questions or need further assistance, let me know!
References:
- Azure OpenAI Service Content Filtering
- Data, Privacy, and Security for Azure OpenAI Service
- Azure Open AI Documentation
Thank you.