Visual Search Client (preview:1.0)

2025/10/21 • 1 deleted methods

Images_VisualSearch (removed)
Description :  Visual Search API lets you discover insights about an image such as visually similar images, shopping sources, and related searches. The API can also perform text recognition, identify entities (people, places, things), return other topical content for the user to explore, and more. For more information, see [Visual Search Overview](https://docs.microsoft.com/azure/cognitive-services/bing-visual-search/overview).
Reference :  Link ¶

⚼ Request

POST:  /images/visualsearch
{
X-BingApis-SDK:
{
Description: Activate swagger compliance. ,
Required: True ,
}
string ,
Accept:
{
Description: The default media type is application/json. To specify that the response use [JSON-LD](http://json-ld.org/), set the Accept header to application/ld+json. ,
Required: False ,
}
string ,
Accept-Language:
{
Description: A comma-delimited list of one or more languages to use for user interface strings. The list is in decreasing order of preference. For additional information, including expected format, see [RFC2616](http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html). This header and the [setLang](https://docs.microsoft.com/en-us/rest/api/cognitiveservices/bing-visual-search-api-v7-reference#setlang) query parameter are mutually exclusive; do not specify both. If you set this header, you must also specify the [cc](https://docs.microsoft.com/en-us/rest/api/cognitiveservices/bing-visual-search-api-v7-reference#cc) query parameter. To determine the market to return results for, Bing uses the first supported language it finds from the list and combines it with the cc parameter value. If the list does not include a supported language, Bing finds the closest language and market that supports the request or it uses an aggregated or default market for the results. To determine the market that Bing used, see the BingAPIs-Market header. Use this header and the cc query parameter only if you specify multiple languages. Otherwise, use the [mkt](https://docs.microsoft.com/en-us/rest/api/cognitiveservices/bing-visual-search-api-v7-reference#mkt) and [setLang](https://docs.microsoft.com/en-us/rest/api/cognitiveservices/bing-visual-search-api-v7-reference#setlang) query parameters. A user interface string is a string that's used as a label in a user interface. There are few user interface strings in the JSON response objects. Any links to Bing.com properties in the response objects apply the specified language. ,
Required: False ,
}
string ,
Content-Type:
{
Description: Must be set to multipart/form-data and include a boundary parameter (for example, multipart/form-data; boundary=). For more details, see [Content form types]( https://docs.microsoft.com/en-us/azure/cognitive-services/bing-visual-search/overview#content-form-types). ,
Required: False ,
}
string ,
User-Agent:
{
Description: The user agent originating the request. Bing uses the user agent to provide mobile users with an optimized experience. Although optional, you are encouraged to always specify this header. The user-agent should be the same string that any commonly used browser sends. For information about user agents, see [RFC 2616](http://www.w3.org/Protocols/rfc2616/rfc2616-sec14.html). The following are examples of user-agent strings. Windows Phone: Mozilla/5.0 (compatible; MSIE 10.0; Windows Phone 8.0; Trident/6.0; IEMobile/10.0; ARM; Touch; NOKIA; Lumia 822). Android: Mozilla / 5.0 (Linux; U; Android 2.3.5; en - us; SCH - I500 Build / GINGERBREAD) AppleWebKit / 533.1 (KHTML; like Gecko) Version / 4.0 Mobile Safari / 533.1. iPhone: Mozilla / 5.0 (iPhone; CPU iPhone OS 6_1 like Mac OS X) AppleWebKit / 536.26 (KHTML; like Gecko) Mobile / 10B142 iPhone4; 1 BingWeb / 3.03.1428.20120423. PC: Mozilla / 5.0 (Windows NT 6.3; WOW64; Trident / 7.0; Touch; rv:11.0) like Gecko. iPad: Mozilla / 5.0 (iPad; CPU OS 7_0 like Mac OS X) AppleWebKit / 537.51.1 (KHTML, like Gecko) Version / 7.0 Mobile / 11A465 Safari / 9537.53. ,
Required: False ,
}
string ,
X-MSEdge-ClientID:
{
Description: Bing uses this header to provide users with consistent behavior across Bing API calls. Bing often flights new features and improvements, and it uses the client ID as a key for assigning traffic on different flights. If you do not use the same client ID for a user across multiple requests, then Bing may assign the user to multiple conflicting flights. Being assigned to multiple conflicting flights can lead to an inconsistent user experience. For example, if the second request has a different flight assignment than the first, the experience may be unexpected. Also, Bing can use the client ID to tailor web results to that client ID’s search history, providing a richer experience for the user. Bing also uses this header to help improve result rankings by analyzing the activity generated by a client ID. The relevance improvements help with better quality of results delivered by Bing APIs and in turn enables higher click-through rates for the API consumer. IMPORTANT: Although optional, you should consider this header required. Persisting the client ID across multiple requests for the same end user and device combination enables 1) the API consumer to receive a consistent user experience, and 2) higher click-through rates via better quality of results from the Bing APIs. Each user that uses your application on the device must have a unique, Bing generated client ID. If you do not include this header in the request, Bing generates an ID and returns it in the X-MSEdge-ClientID response header. The only time that you should NOT include this header in a request is the first time the user uses your app on that device. Use the client ID for each Bing API request that your app makes for this user on the device. Persist the client ID. To persist the ID in a browser app, use a persistent HTTP cookie to ensure the ID is used across all sessions. Do not use a session cookie. For other apps such as mobile apps, use the device's persistent storage to persist the ID. The next time the user uses your app on that device, get the client ID that you persisted. Bing responses may or may not include this header. If the response includes this header, capture the client ID and use it for all subsequent Bing requests for the user on that device. ATTENTION: You must ensure that this Client ID is not linkable to any authenticatable user account information. If you include the X-MSEdge-ClientID, you must not include cookies in the request. ,
Required: False ,
}
string ,
X-MSEdge-ClientIP:
{
Description: The IPv4 or IPv6 address of the client device. The IP address is used to discover the user's location. Bing uses the location information to determine safe search behavior. Although optional, you are encouraged to always specify this header and the X-Search-Location header. Do not obfuscate the address (for example, by changing the last octet to 0). Obfuscating the address results in the location not being anywhere near the device's actual location, which may result in Bing serving erroneous results. ,
Required: False ,
}
string ,
X-Search-Location:
{
Description: A semicolon-delimited list of key/value pairs that describe the client's geographical location. Bing uses the location information to determine safe search behavior and to return relevant local content. Specify the key/value pair as :. The following are the keys that you use to specify the user's location. lat (required): The latitude of the client's location, in degrees. The latitude must be greater than or equal to -90.0 and less than or equal to +90.0. Negative values indicate southern latitudes and positive values indicate northern latitudes. long (required): The longitude of the client's location, in degrees. The longitude must be greater than or equal to -180.0 and less than or equal to +180.0. Negative values indicate western longitudes and positive values indicate eastern longitudes. re (required): The radius, in meters, which specifies the horizontal accuracy of the coordinates. Pass the value returned by the device's location service. Typical values might be 22m for GPS/Wi-Fi, 380m for cell tower triangulation, and 18,000m for reverse IP lookup. ts (optional): The UTC UNIX timestamp of when the client was at the location. (The UNIX timestamp is the number of seconds since January 1, 1970.) head (optional): The client's relative heading or direction of travel. Specify the direction of travel as degrees from 0 through 360, counting clockwise relative to true north. Specify this key only if the sp key is nonzero. sp (optional): The horizontal velocity (speed), in meters per second, that the client device is traveling. alt (optional): The altitude of the client device, in meters. are (optional): The radius, in meters, that specifies the vertical accuracy of the coordinates. Specify this key only if you specify the alt key. Although many of the keys are optional, the more information that you provide, the more accurate the location results are. Although optional, you are encouraged to always specify the user's geographical location. Providing the location is especially important if the client's IP address does not accurately reflect the user's physical location (for example, if the client uses VPN). For optimal results, you should include this header and the X-MSEdge-ClientIP header, but at a minimum, you should include this header. ,
Required: False ,
}
string ,
mkt:
{
Description: The market where the results come from. Typically, mkt is the country where the user is making the request from. However, it could be a different country if the user is not located in a country where Bing delivers results. The market must be in the form -. For example, en-US. The string is case insensitive. For a list of possible market values, see [Market Codes](https://docs.microsoft.com/en-us/azure/cognitive-services/bing-visual-search/supported-countries-markets). NOTE: If known, you are encouraged to always specify the market. Specifying the market helps Bing route the request and return an appropriate and optimal response. If you specify a market that is not listed in [Market Codes](https://docs.microsoft.com/en-us/azure/cognitive-services/bing-visual-search/supported-countries-markets), Bing uses a best fit market code based on an internal mapping that is subject to change. ,
Required: False ,
}
string ,
safeSearch:
{
Description: Filter the image results in actions with type 'VisualSearch' for adult content. The following are the possible filter values. Off: May return images with adult content. Moderate: Do not return images with adult content. Strict: Do not return images with adult content. The default is Moderate. If the request comes from a market that Bing's adult policy requires that safeSearch is set to Strict, Bing ignores the safeSearch value and uses Strict. If you use the site: filter in the knowledge request, there is the chance that the response may contain adult content regardless of what the safeSearch query parameter is set to. Use site: only if you are aware of the content on the site and your scenario supports the possibility of adult content. ,
Required: False ,
}
string ,
setLang:
{
Description: The language to use for user interface strings. Specify the language using the ISO 639-1 2-letter language code. For example, the language code for English is EN. The default is EN (English). Although optional, you should always specify the language. Typically, you set setLang to the same language specified by mkt unless the user wants the user interface strings displayed in a different language. A user interface string is a string that's used as a label in a user interface. There are few user interface strings in the JSON response objects. Also, any links to Bing.com properties in the response objects apply the specified language. ,
Required: False ,
}
string ,
knowledgeRequest:
{
Description: The form data is a JSON object that identifies the image using an insights token or URL to the image. The object may also include an optional crop area that identifies an area of interest in the image. The insights token and URL are mutually exclusive – do not specify both. You may specify knowledgeRequest form data and image form data in the same request only if knowledgeRequest form data specifies the cropArea field only (it must not include an insights token or URL). ,
Required: False ,
}
string ,
image:
{
Description: The form data is an image binary. The Content-Disposition header's name parameter must be set to "image". You must specify an image binary if you do not use knowledgeRequest form data to specify the image; you may not use both forms to specify an image. You may specify knowledgeRequest form data and image form data in the same request only if knowledgeRequest form data specifies the cropArea field only (it must not include an insights token or URL). ,
Required: False ,
}
file ,
}

⚐ Response (200)

{
tags:
{
Description: A list of visual search tags. ,
Required: False ,
}
[
{
displayName:
{
Description: Display name for this tag. For the default tag, the display name is empty. ,
Required: False ,
}
string ,
boundingBox:
{
Description: The bounding box for this tag. For the default tag, there is no bounding box. ,
Required: False ,
}
{
queryRectangle:
{
Description: A rectangle that outlines the area of interest for this tag. ,
Required: True ,
}
{
topLeft:
{
Description: The top left corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
topRight:
{
Description: The top right corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
bottomRight:
{
Description: The bottom right corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
bottomLeft:
{
Description: The bottom left corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
}
,
displayRectangle:
{
Description: A recommended rectangle to show to the user. ,
Required: True ,
}
{
topLeft:
{
Description: The top left corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
topRight:
{
Description: The top right corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
bottomRight:
{
Description: The bottom right corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
bottomLeft:
{
Description: The bottom left corner coordinate. ,
Required: True ,
}
{
x:
{
Description: The x-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
y:
{
Description: The y-coordinate of the point. ,
Format: float ,
Required: True ,
}
number ,
}
,
}
,
}
,
actions:
{
Description: Actions within this tag. The order of the items denotes the default ranking order of these actions, with the first action being the most likely user intent. ,
Required: False ,
}
[
{
actionType:
{
Description: A string representing the type of action. ,
Required: False ,
}
string ,
_type:
{
Description: Specifies the sub-class of the action. ,
Enum:
{
ImageEntityAction: No description available. ,
ImageModuleAction: No description available. ,
ImageRecipesAction: No description available. ,
ImageRelatedSearchesAction: No description available. ,
ImageShoppingSourcesAction: No description available. ,
}
,
Required: False ,
}
enum ,
}
,
]
,
}
,
]
,
image:
{
Description: Image object containing metadata about the requested image. ,
Required: False ,
}
{
thumbnail:
{
Required: False ,
}
string ,
imageInsightsToken:
{
Description: The token that you use in a subsequent call to Visual Search API to get additional information about the image. For information about using this token, see the imageInsightsToken field inside the knowledgeRequest request parameter. ,
Required: False ,
}
string ,
insightsMetadata:
{
Description: A count of the number of websites where you can shop or perform other actions related to the image. For example, if the image is of an apple pie, this object includes a count of the number of websites where you can buy an apple pie. To indicate the number of offers in your UX, include badging such as a shopping cart icon that contains the count. When the user clicks on the icon, use imageInsightsToken in a subsequent Visual Search API call to get the list of shopping websites. ,
Required: False ,
}
{
shoppingSourcesCount:
{
Description: The number of websites that sell the products seen in the image. ,
Format: int32 ,
Required: False ,
}
integer ,
recipeSourcesCount:
{
Description: The number of websites that offer recipes of the food seen in the image. ,
Format: int32 ,
Required: False ,
}
integer ,
aggregateOffer:
{
Description: A summary of the online offers of products found in the image. For example, if the image is of a dress, the offer might identify the lowest price and the number of offers found. Only visually similar products insights include this field. The offer includes the following fields: Name, AggregateRating, OfferCount, and LowPrice. ,
Required: False ,
}
{
offers:
{
Description: A list of offers from merchants that have offerings related to the image. ,
Required: False ,
}
[
{
seller:
{
Description: Seller for this offer. ,
Required: False ,
}
object ,
price:
{
Description: The item's price. ,
Format: float ,
Required: False ,
}
number ,
priceCurrency:
{
Description: The monetary currency. For example, USD. ,
Enum:
{
USD: No description available. ,
CAD: No description available. ,
GBP: No description available. ,
EUR: No description available. ,
COP: No description available. ,
JPY: No description available. ,
CNY: No description available. ,
AUD: No description available. ,
INR: No description available. ,
AED: No description available. ,
AFN: No description available. ,
ALL: No description available. ,
AMD: No description available. ,
ANG: No description available. ,
AOA: No description available. ,
ARS: No description available. ,
AWG: No description available. ,
AZN: No description available. ,
BAM: No description available. ,
BBD: No description available. ,
BDT: No description available. ,
BGN: No description available. ,
BHD: No description available. ,
BIF: No description available. ,
BMD: No description available. ,
BND: No description available. ,
BOB: No description available. ,
BOV: No description available. ,
BRL: No description available. ,
BSD: No description available. ,
BTN: No description available. ,
BWP: No description available. ,
BYR: No description available. ,
BZD: No description available. ,
CDF: No description available. ,
CHE: No description available. ,
CHF: No description available. ,
CHW: No description available. ,
CLF: No description available. ,
CLP: No description available. ,
COU: No description available. ,
CRC: No description available. ,
CUC: No description available. ,
CUP: No description available. ,
CVE: No description available. ,
CZK: No description available. ,
DJF: No description available. ,
DKK: No description available. ,
DOP: No description available. ,
DZD: No description available. ,
EGP: No description available. ,
ERN: No description available. ,
ETB: No description available. ,
FJD: No description available. ,
FKP: No description available. ,
GEL: No description available. ,
GHS: No description available. ,
GIP: No description available. ,
GMD: No description available. ,
GNF: No description available. ,
GTQ: No description available. ,
GYD: No description available. ,
HKD: No description available. ,
HNL: No description available. ,
HRK: No description available. ,
HTG: No description available. ,
HUF: No description available. ,
IDR: No description available. ,
ILS: No description available. ,
IQD: No description available. ,
IRR: No description available. ,
ISK: No description available. ,
JMD: No description available. ,
JOD: No description available. ,
KES: No description available. ,
KGS: No description available. ,
KHR: No description available. ,
KMF: No description available. ,
KPW: No description available. ,
KRW: No description available. ,
KWD: No description available. ,
KYD: No description available. ,
KZT: No description available. ,
LAK: No description available. ,
LBP: No description available. ,
LKR: No description available. ,
LRD: No description available. ,
LSL: No description available. ,
LYD: No description available. ,
MAD: No description available. ,
MDL: No description available. ,
MGA: No description available. ,
MKD: No description available. ,
MMK: No description available. ,
MNT: No description available. ,
MOP: No description available. ,
MRO: No description available. ,
MUR: No description available. ,
MVR: No description available. ,
MWK: No description available. ,
MXN: No description available. ,
MXV: No description available. ,
MYR: No description available. ,
MZN: No description available. ,
NAD: No description available. ,
NGN: No description available. ,
NIO: No description available. ,
NOK: No description available. ,
NPR: No description available. ,
NZD: No description available. ,
OMR: No description available. ,
PAB: No description available. ,
PEN: No description available. ,
PGK: No description available. ,
PHP: No description available. ,
PKR: No description available. ,
PLN: No description available. ,
PYG: No description available. ,
QAR: No description available. ,
RON: No description available. ,
RSD: No description available. ,
RUB: No description available. ,
RWF: No description available. ,
SAR: No description available. ,
SBD: No description available. ,
SCR: No description available. ,
SDG: No description available. ,
SEK: No description available. ,
SGD: No description available. ,
SHP: No description available. ,
SLL: No description available. ,
SOS: No description available. ,
SRD: No description available. ,
SSP: No description available. ,
STD: No description available. ,
SYP: No description available. ,
SZL: No description available. ,
THB: No description available. ,
TJS: No description available. ,
TMT: No description available. ,
TND: No description available. ,
TOP: No description available. ,
TRY: No description available. ,
TTD: No description available. ,
TWD: No description available. ,
TZS: No description available. ,
UAH: No description available. ,
UGX: No description available. ,
UYU: No description available. ,
UZS: No description available. ,
VEF: No description available. ,
VND: No description available. ,
VUV: No description available. ,
WST: No description available. ,
XAF: No description available. ,
XCD: No description available. ,
XOF: No description available. ,
XPF: No description available. ,
YER: No description available. ,
ZAR: No description available. ,
ZMW: No description available. ,
}
,
Required: False ,
}
enum ,
availability:
{
Description: The item's availability. The following are the possible values: Discontinued, InStock, InStoreOnly, LimitedAvailability, OnlineOnly, OutOfStock, PreOrder, SoldOut. ,
Enum:
{
Discontinued: No description available. ,
InStock: No description available. ,
InStoreOnly: No description available. ,
LimitedAvailability: No description available. ,
OnlineOnly: No description available. ,
OutOfStock: No description available. ,
PreOrder: No description available. ,
SoldOut: No description available. ,
}
,
Required: False ,
}
enum ,
aggregateRating:
{
Description: An aggregated rating that indicates how well the product has been rated by others. ,
Required: False ,
}
{
reviewCount:
{
Description: The number of times the recipe has been rated or reviewed. ,
Format: int32 ,
Required: False ,
}
integer ,
}
,
lastUpdated:
{
Description: The last date that the offer was updated. The date is in the form YYYY-MM-DD. ,
Required: False ,
}
string ,
}
,
]
,
}
,
}
,
imageId:
{
Description: Unique Id for the image. ,
Required: False ,
}
string ,
accentColor:
{
Description: A three-byte hexadecimal number that represents the color that dominates the image. Use the color as the temporary background in your client until the image is loaded. ,
Required: False ,
}
string ,
visualWords:
{
Description: For internal use only. ,
Required: False ,
}
string ,
}
,
}

⚐ Response (default)

{
errors:
{
Description: A list of errors that describe the reasons why the request failed. ,
Required: True ,
}
[
{
code:
{
Description: The error code that identifies the category of error. ,
Enum:
{
None: No description available. ,
ServerError: No description available. ,
InvalidRequest: No description available. ,
RateLimitExceeded: No description available. ,
InvalidAuthorization: No description available. ,
InsufficientAuthorization: No description available. ,
}
,
Required: True ,
}
enum ,
subCode:
{
Description: The error code that further helps to identify the error. ,
Enum:
{
UnexpectedError: No description available. ,
ResourceError: No description available. ,
NotImplemented: No description available. ,
ParameterMissing: No description available. ,
ParameterInvalidValue: No description available. ,
HttpNotAllowed: No description available. ,
Blocked: No description available. ,
AuthorizationMissing: No description available. ,
AuthorizationRedundancy: No description available. ,
AuthorizationDisabled: No description available. ,
AuthorizationExpired: No description available. ,
}
,
Required: False ,
}
enum ,
message:
{
Description: A description of the error. ,
Required: True ,
}
string ,
moreDetails:
{
Description: A description that provides additional information about the error. ,
Required: False ,
}
string ,
parameter:
{
Description: The parameter in the request that caused the error. ,
Required: False ,
}
string ,
value:
{
Description: The parameter's value in the request that was not valid. ,
Required: False ,
}
string ,
}
,
]
,
}