Google AI Vision

By Albert Su
Doctoral Candidate IT

Google Vision AI was used to analyze two pictures of dogs. The Request Body of the image was posted to the AI using JSON embedded into the browser while the AI Response responded with the type of animal and description of the background.

Request Body

{
“requests”: [
{
“features”: [
{
“type”: “LABEL_DETECTION”
}
],
“image”: {
“source”: {
“imageUri”: “gs://bucket-name-123/demo-image.jpg”
}
}
}
] }


AI Response

{
“responses”: [
{
“labelAnnotations”: [
{
“mid”: “/m/0bt9lr”,
“description”: “dog”,
“score”: 0.8920207,
“topicality”: 0.8920207
},
{
“mid”: “/m/01z5f”,
“description”: “dog like mammal”,
“score”: 0.88694125,
“topicality”: 0.88694125
},
{
“mid”: “/m/08t9c_”,
“description”: “grass”,
“score”: 0.8723395,
“topicality”: 0.8723395
},
{
“mid”: “/m/0kpmf”,
“description”: “dog breed”,
“score”: 0.86987364,
“topicality”: 0.86987364
},
{
“mid”: “/m/01c7cq”,
“description”: “grassland”,
“score”: 0.72486955,
“topicality”: 0.72486955
},
{
“mid”: “/m/025st_8”,
“description”: “meadow”,
“score”: 0.6538264,
“topicality”: 0.6538264
},
{
“mid”: “/m/05mqq3”,
“description”: “snout”,
“score”: 0.6483445,
“topicality”: 0.6483445
},
{
“mid”: “/m/02wbgd”,
“description”: “english cocker spaniel”,
“score”: 0.6269685,
“topicality”: 0.6269685
},
{
“mid”: “/m/02kysw”,
“description”: “spaniel”,
“score”: 0.62650734,
“topicality”: 0.62650734
},
{
“mid”: “/m/01gd91”,
“description”: “pasture”,
“score”: 0.62508965,
“topicality”: 0.62508965
}
] }
] }


Request Body

{
“requests”: [
{
“features”: [
{
“type”: “LABEL_DETECTION”
}
],
“image”: {
“source”: {
“imageUri”: “gs://bucketalice/IMG_3881.jpg”
}
}
}
] }


AI Response

{
“responses”: [
{
“labelAnnotations”: [
{
“mid”: “/m/01z5f”,
“description”: “dog like mammal”,
“score”: 0.8726515,
“topicality”: 0.8726515
},
{
“mid”: “/m/0kpmf”,
“description”: “dog breed”,
“score”: 0.8633622,
“topicality”: 0.8633622
},
{
“mid”: “/m/035qhg”,
“description”: “fauna”,
“score”: 0.8626649,
“topicality”: 0.8626649
},
{
“mid”: “/m/0bt9lr”,
“description”: “dog”,
“score”: 0.8539165,
“topicality”: 0.8539165
},
{
“mid”: “/m/02xl47d”,
“description”: “dog breed group”,
“score”: 0.79741335,
“topicality”: 0.79741335
},
{
“mid”: “/m/05zmzn1”,
“description”: “street dog”,
“score”: 0.7951209,
“topicality”: 0.7951209
},
{
“mid”: “/m/02gxqz”,
“description”: “hunting dog”,
“score”: 0.5730597,
“topicality”: 0.5730597
},
{
“mid”: “/m/0hm03”,
“description”: “trail”,
“score”: 0.5147512,
“topicality”: 0.5147512
}
] }
] }

References

https://cloud.google.com/vision/docs/request

https://cloud.google.com/vision/docs/quickstart

Leave a Reply

Your email address will not be published. Required fields are marked *