Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
But the web search is text based, correct? Its not image search if I understand it correctly.
Bing Visual Grounding using Azure OpenAI
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(243.2, 43%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMZ%3C/text%3E%3C/svg%3E)
Mrinal Zutshi
0
Reputation points Microsoft Employee
Hi,
I am looking for a solution to ground my Azure OpenAI API with image based web grounding. The default web grounding is only text based, it doesn't do image search. I also read that the Bing Visual API has been deprecated. https://learn.microsoft.com/en-us/previous-versions/azure/cognitive-services/bing-visual-search/overview
Do we have any current solution to do image grounding using Bing when used with any LLMs such as Azure OpenAI gpt 5.1 ?
Azure OpenAI Service
2 answers
Sort by: Most helpful
-
Mrinal Zutshi 0 Reputation points Microsoft Employee
2026-04-14T06:55:22.55+00:00 -
Mrinal Zutshi 0 Reputation points Microsoft Employee
2026-04-14T06:59:17.7966667+00:00 https://www.microsoft.com/en-us/bing/visual-search/?form=MT016O&cs=367099006
Like this is image search
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(204.8, 15%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator2026-04-14T07:26:47.0833333+00:00 Hi Mrinal,
I am able to search similar image with attached images
"Can you search the attached image "
"Text+vision" (multi mode) is already supported in vision models and helping serve the image grounding requirement with websearch.
Thank you for following up.
Sign in to comment -
-
Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator
2026-04-09T07:15:40.2966667+00:00 Web search works in Agent console worked to do image search with an image inputs.
WebSearch+Response API is already supported scenario (No work code available image inputs, facing not supported error when tested with image directly, feel free to test with base 64 image and share your observation).
But it worked with new foundry Agents.
Attached screenshot and documentation below for reference.
With Agents
Attached screenshot and relevant document from Agent with Websearch
Attached screenshot and relevant document on Agents from Grounding with Bing search.
Note:
Customer are advised to use Grounding with Bing search along Agents, Default Bing search resource are depreciated.
Reference - https://learn.microsoft.com/en-us/lifecycle/announcements/bing-search-api-retirement
Please let us know if it serves as solution for you.
Thank you.
-
Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator
2026-04-14T01:47:37.03+00:00 Hope you found my insights on Web search helpful for image search. you can use Grounding with Bing search.
Just quoting vision-based models would be useful to interact and derive insights here.
Thank you.
-
Mrinal Zutshi 0 Reputation points Microsoft Employee
2026-04-14T06:55:45.0866667+00:00 But the web search is text based, correct? Its not image search if I understand it correctly.
-
Mrinal Zutshi 0 Reputation points Microsoft Employee
2026-04-14T06:59:49.49+00:00 https://www.microsoft.com/en-us/bing/visual-search/?form=MT016O&cs=367099006
Like this is image search
-
Manas Mohanty 16,190 Reputation points Microsoft External Staff Moderator
2026-04-15T01:49:12.8133333+00:00 Hi Mrinal,
Exact interface is not there in Web search +with Agent.
But is giving results with image and image URL along with a prompt "search this image"
You can also give test with Bing visual search syntax as custom function, Syntax need to change (Both image and text input needed)
Let follow up on teams for further discussion.
Thank you.
Sign in to comment -