1. A mobile device, comprising:
a wireless interface to a server; and
a processor, communicating with the wireless interface, the processor being configured to initiate processing comprising:
acquiring an image;
detecting one or more objects in the acquired image;
receiving input that indicates a user selection of at least one of the detected objects;
generating metadata associated with the selected object;
extracting a query image from the acquired image based on the selected object;
generating a visual search query, wherein the visual search query includes the query image and the metadata;
communicating the visual search query to the server via the wireless interface; and
receiving and presenting, in response to the visual search query, information content associated with the at least one object.
2. The mobile device of claim 1, wherein generating metadata further comprises:
categorizing one or more of the detected objects as being in an object category;
highlighting the categorized objects;
receiving input that indicates a selected one of the categorized objects; and
generating the metadata based on the object category of the selected object.
3. The mobile device of claim 2, wherein categorizing one or more of the detected objects further comprises:
generating a feature vector based on at least one of the detected objects;
comparing the feature vector with a set of image coefficients of trained images in the object category to determine a matching trained image in the object category that matches the at least one detected object, wherein the set of image coefficients is stored in the mobile device; and
categorizing the detected object based on the matching trained image.
4. The mobile device of claim 3, wherein the processor performs, in real-time, the operations of acquiring, detecting, highlighting, and categorizing.
5. The mobile device of claim 3, wherein the object category includes a logo, a design, a face, a landmark, apparel, a sign, a natural object, or a man-made object.
6. The mobile device of claim 1, wherein generating the metadata further comprises:
highlighting, on a user interface of the mobile device, the detected objects.
7. The mobile device of claim 6, wherein generating the metadata further comprises:
categorizing the selected object as being in an object category; and
generating the metadata based on the object category of the selected object.
8. The mobile device of claim 7, wherein communicating the visual search query to the server further comprises:
generating a destination address for the visual search query based on the object category of the selected object; and
communicating the visual search query to the server according to the destination address.
9. The mobile device of claim 1, wherein extracting a query image from the acquired image further comprises cropping the acquired image, compressing the acquired image, scaling the acquired image, or converting the acquired image to grayscale.
10. The mobile device of claim 1, wherein generating metadata further comprises:
generating a feature vector based on at least one of the detected objects;
comparing the feature vector with a set of image coefficients of trained images to determine a matching trained image that matches the detected object, wherein the set of image coefficients is stored in the mobile device;
recognizing the detected object based on the matching trained image; and
generating the metadata associated with the recognized object based on the matching trained image.
11. The mobile device of claim 1, wherein the mobile device comprises a contextual data sensor, and wherein acquiring an image further comprises:
acquiring contextual data associated with the acquired image via the contextual data sensor, wherein the visual search query further includes the contextual data.
12. The mobile device of claim 11, wherein the contextual data comprises a Global Positioning System (GPS) location fix, an Assisted Global Positioning System (A-GPS) location fix, a Galileo system location fix, a tower trilateration fix, textual information, auditory information, an accelerometer reading, a gyroscope reading, or a temperature reading.
13. The mobile device of claim 1, wherein the information content includes a name, a price, a manufacturer, a review, a coupon, or an advertisement.
14. A method of performing image recognition, comprising:
acquiring an image by a mobile device;
detecting one or more objects in the acquired image;
receiving input that indicates a user selection of at least one of the detected objects;
generating metadata associated with the selected object;
extracting a query image from the acquired image based on the selected object;
generating a visual search query, wherein the visual search query includes the query image and the metadata;
wirelessly communicating the visual search query; and
receiving and presenting, in response to the visual search query, information content associated with the at least one object.
15. The method of claim 14, wherein generating metadata further comprises:
categorizing one or more of the detected objects as being in an object category;
highlighting the categorized objects;
receiving input that indicates a selected one of the categorized objects; and
generating the metadata based on the object category of the selected object.
16. The method of claim 15, wherein categorizing one or more of the detected objects further comprises:
generating a feature vector based on at least one of the detected objects;
comparing the feature vector with a set of image coefficients of trained images in the object category to determine a matching trained image in the object category that matches the at least one detected object, wherein the set of image coefficients is stored in the mobile device; and
categorizing the detected object based on the matching trained image.
17. The method of claim 16, wherein the mobile device performs, in real-time, the operations of acquiring, detecting, highlighting, or categorizing.
18. The method of claim 14, wherein generating the metadata further comprises:
highlighting the detected objects.
19. The method of claim 18, wherein generating the metadata further comprises:
categorizing the selected object as being in an object category; and
generating the metadata based on the object category of the selected object.
20. The method of claim 19, wherein wirelessly communicating the visual search query further comprises:
generating a destination address for the visual search query based on the object category of the selected object; and
communicating the visual search query to a destination according to the destination address.
21. The method of claim 14, wherein acquiring an image further comprises:
acquiring contextual data associated with the acquired image via a contextual data sensor of the mobile device, the visual search query further including the contextual data.
22. A system for performing image recognition, comprising:
means for acquiring an image by a mobile device;
means for detecting one or more objects in the acquired image;
means for receiving input that indicates a user selection of at least one of the detected objects;
means for generating metadata associated with the selected object;
means for extracting a query image from the acquired image based on the selected object;
means for generating a visual search query, wherein the visual search query includes the query image and the metadata;
means for wirelessly communicating the visual search query; and
means for receiving and presenting, in response to the visual search query, information content associated with the at least one object.
23. The system of claim 22, wherein the means for generating metadata further comprises:
means for categorizing one or more of the detected objects as being in an object category;
means for highlighting the categorized objects;
means for receiving input that indicates a selected one of the categorized objects; and
means for generating the metadata based on the object category of the selected object.
24. The system of claim 23, wherein the means for categorizing one or more of the detected objects further comprises:
means for generating a feature vector based on at least one of the detected objects;
means for comparing the feature vector with a set of image coefficients of trained images in the object category to determine a matching trained image in the object category that matches the at least one detected object, wherein the set of image coefficients is stored in the mobile device; and
means for categorizing the detected object based on the matching trained image.
25. The system of claim 24, wherein the means for acquiring, detecting, highlighting, and categorizing perform in real-time.
26. The system of claim 22, wherein the means for generating the metadata further comprises:
means for highlighting the detected objects.
27. The system of claim 26, wherein the means for generating the metadata further comprises:
means for categorizing the selected object as being in an object category; and
means for generating the metadata based on the object category of the selected object.
28. The system of claim 27, wherein the means for wirelessly communicating the visual search query further comprises:
means for generating a destination address for the visual search query based on the object category of the selected object; and
means for communicating the visual search query to a destination according to the destination address.
29. The system of claim 22, wherein the means for acquiring an image further comprises:
means for acquiring contextual data associated with the acquired image via a contextual data sensor of the mobile device, the visual search query further including the contextual data.
30. A non-transitory computer-readable medium storing instructions that cause a computer to perform image recognition when executed by the computer, comprising:
at least one instruction for causing the computer to acquire an image;
at least one instruction for causing the computer to detect one or more objects in the acquired image;
at least one instruction for causing the computer to receive input that indicates a user selection of at least one of the detected objects;
at least one instruction for causing the computer to generate metadata associated with the selected object;
at least one instruction for causing the computer to extract a query image from the acquired image based on the selected object;
at least one instruction for causing the computer to generate a visual search query, wherein the visual search query includes the query image and the metadata;
at least one instruction for causing the computer to wirelessly communicate the visual search query; and
at least one instruction for causing the computer to receive and present, in response to the visual search query, information content associated with the at least one object.
31. The non-transitory computer-readable medium of claim 30, wherein the at least one instruction for causing the computer to generate metadata further comprises:
at least one instruction for causing the computer to categorize one or more of the detected objects as being in an object category;
at least one instruction for causing the computer to highlight the categorized objects;
at least one instruction for causing the computer to receive input that indicates a selected one of the categorized objects; and
at least one instruction for causing the computer to generate the metadata based on the selected object category of the selected object.
32. The non-transitory computer-readable medium of claim 31, wherein the at least one instruction for causing the computer to categorize one or more of the detected objects further comprises:
at least one instruction for causing the computer to generate a feature vector based on at least one of the detected objects;
at least one instruction for causing the computer to compare the feature vector with a set of image coefficients of trained images in the object category to determine a matching trained image in the object category that matches the at least one detected object, wherein the set of image coefficients is stored in the computer; and
at least one instruction for causing the computer to categorize the detected object based on the matching trained image.
33. The non-transitory computer-readable medium of claim 32, wherein the at least one instruction for causing the computer to acquire, detect, highlight, and categorize causes the computer to acquire, detect, highlight, and categorize in real-time.
34. The non-transitory computer-readable medium of claim 30, wherein the at least one instruction for causing the computer to generate the metadata further comprises:
at least one instruction for causing the computer to highlight the detected objects.
35. The non-transitory computer-readable medium of claim 34, wherein the at least one instruction for causing the computer to generate the metadata further comprises:
at least one instruction for causing the computer to categorize the selected object as being in an object category; and
at least one instruction for causing the computer to generate the metadata based on the object category of the selected object.
36. The non-transitory computer-readable medium of claim 35, wherein the at least one instruction for causing the computer to wirelessly communicate the visual search query further comprises:
at least one instruction for causing the computer to generate a destination address for the visual search query based on the object category of the selected object; and
at least one instruction for causing the computer to communicate the visual search query to a destination according to the destination address.
37. The non-transitory computer-readable medium of claim 30, wherein the at least one instruction for causing the computer to acquire an image further comprises:
at least one instruction for causing the computer to acquire contextual data associated with the acquired image via a contextual data sensor of the mobile device, the visual search query further including the contextual data.
38. A system for performing image recognition, comprising:
a server configured to:
receive a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image, the at least one object selected by a user from one or more objects detected in the image,
recognize an object in the image associated with the at least one object based on the metadata,
generate information content based on the recognized object, and
communicate the information content in response to the visual search query.
39. The system of claim 38, wherein
the visual search query further includes contextual data associated with the image; and
further wherein the server is configured to generate the information content based on the recognized object and the contextual data.
40. The system of claim 39, wherein the contextual data comprises a Global Positioning System (GPS) location fix, an Assisted Global Positioning System (A-GPS) location fix, a Galileo system location fix, a tower trilateration fix, textual information, auditory information, an accelerometer reading, a gyroscope reading, or a temperature reading.
41. The system of claim 38, wherein the server is further configured to:
compare the image with trained images to determine a matching trained image that matches the image, wherein the trained images are selected based on the metadata, and
recognize the object in the image based on the matching trained image.
42. The system of claim 38, wherein the server is further configured to:
detect the object in the image based on the metadata,
generate a feature vector of the object,
compare the feature vector with image coefficients of trained images to determine a matching trained image that matches the object, wherein the image coefficients are selected based on the metadata, and
recognize the object based on the matching trained image.
43. The system of claim 38, wherein the object includes a logo, a design, a face, a landmark, apparel, a sign, a natural object, or a man-made object.
44. The system of claim 38, wherein the information content includes a name, a price, a manufacturer, a review, a coupon, or an advertisement.
45. The system of claim 38, wherein the server is further configured to:
store the visual search query, and
associate the information content with the visual search query.
46. A method of performing image recognition, comprising:
receiving a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image, the at least one object selected by a user from one or more objects detected in the image;
recognizing an object in the image associated with the at least one object based on the metadata;
generating information content based on the recognized object; and
communicating the information content in response to the visual search query.
47. The method of claim 46, wherein the visual search query further includes contextual data associated with the image, and further wherein generating information content comprises generating the information content based on the recognized object and the contextual data.
48. The method of claim 47, wherein the contextual data comprises a Global Positioning System (GPS) location fix, an Assisted Global Positioning System (A-GPS) location fix, a Galileo system location fix, a tower trilateration fix, textual information, auditory information, an accelerometer reading, a gyroscope reading, or a temperature reading.
49. The method of claim 46, wherein recognizing an object in the image further comprises:
comparing the image with a set of trained images to determine a matching trained image that matches the image, wherein the set of trained images is selected based on the metadata; and
recognizing the object in the image based on the matching trained image.
50. A system of performing image recognition, comprising:
means for receiving a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image, the at least one object selected by a user from one or more objects detected in the image;
means for recognizing an object in the image associated with the at least one object based on the metadata;
means for generating information content based on the recognized object; and
means for communicating the information content in response to the visual search query.
51. The system of claim 50, wherein the visual search query further includes contextual data associated with the image, and further wherein the means for generating information content comprises means for generating the information content based on the recognized object and the contextual data.
52. The system of claim 51, wherein the contextual data comprises a Global Positioning System (GPS) location fix, an Assisted Global Positioning System (A-GPS) location fix, a Galileo system location fix, a tower trilateration fix, textual information, auditory information, an accelerometer reading, a gyroscope reading, or a temperature reading.
53. The system of claim 50, wherein the means for recognizing an object in the image further comprises:
means for comparing the image with a set of trained images to determine a matching trained image that matches the image, wherein the set of trained images is selected based on the metadata; and
means for recognizing the object in the image based on the matching trained image.
54. A non-transitory computer-readable medium storing instructions that cause a computer to perform image recognition when executed by the computer, comprising:
at least one instruction for causing the computer to receive a visual search query from a mobile device, wherein the visual search query includes an image and metadata associated with at least one object in the image, the at least one object selected by a user from one or more objects detected in the image;
at least one instruction for causing the computer to recognize an object in the image associated with the at least one object based on the metadata;
at least one instruction for causing the computer to generate information content based on the recognized object; and
at least one instruction for causing the computer to communicate the information content in response to the visual search query.
55. The non-transitory computer-readable medium of claim 54, wherein the visual search query further includes contextual data associated with the image, and further wherein the at least one instruction for causing the computer to generate information content comprises at least one instruction for causing the computer to generate the information content based on the recognized object and the contextual data.
56. The non-transitory computer-readable medium of claim 55, wherein the contextual data comprises a Global Positioning System (GPS) location fix, an Assisted Global Positioning System (A-GPS) location fix, a Galileo system location fix, a tower trilateration fix, textual information, auditory information, an accelerometer reading, a gyroscope reading, or a temperature reading.
57. The non-transitory computer-readable medium of claim 54, wherein the at least one instruction for causing the computer to recognize an object in the image further comprises:
at least one instruction for causing the computer to compare the image with a set of trained images to determine a matching trained image that matches the image, wherein the set of trained images is selected based on the metadata; and
at least one instruction for causing the computer to recognize the object in the image based on the matching trained image.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A fluid filled type vibration damping device comprising:
a first mounting member and a second mounting member linked by a main rubber elastic body;
a pressure receiving chamber whose wall is partially defined by the main rubber elastic body;
an equilibrium chamber whose wall is partially defined by a flexible film, the pressure receiving chamber and the equilibrium chamber being filled with a non-compressible fluid,
and the pressure receiving chamber and the equilibrium chamber communicating with each other through an orifice passage
wherein a partition member that partitions the pressure receiving chamber and the equilibrium chamber is provided with a communication aperture that connects the pressure receiving chamber and the equilibrium chamber;
an obstructing rubber elastic plate is superposed against the communication aperture from a pressure receiving chamber side so as to obstruct the communication aperture, and is arranged such that pressure of the pressure receiving chamber acts upon a first face of the obstructing rubber elastic plate while pressure of the equilibrium chamber acts on another face thereof through the communication aperture;
a plurality of contact retaining portions that are held in contact against the partition member are arranged circumferentially on an outer peripheral edge of the obstructing rubber elastic plate;
an elastic deformation zone is arranged circumferentially between the contact retaining portions adjacently situated on the obstructing rubber elastic plate, so as to undergo elastic deformation on a basis of pressure differential between the pressure receiving chamber and the equilibrium chamber to be spaced away from the partition member to cause the communication aperture to open up; and
a non-linearizing member is provided to endow non-linear elastic characteristics on the elastic deformation zone of the obstructing rubber elastic plate such that the elastic characteristics become more rigid in a non-linear manner in association with increase in an amount of elastic deformation of the elastic deformation zone.
2. The fluid filled type vibration damping device according to claim 1, wherein a center mounting portion is integrally formed in a center section of the obstructing rubber elastic plate; the center mounting portion is securely attached to the partition member; at least one spoke-shaped retaining portion that extends radially from the center mounting portion towards an outer peripheral side is provided; and
the contact retaining portions are provided so as to extend in a circumferential direction from a distal end portion of the spoke-shaped retaining portion.
3. The fluid filled type vibration damping device according to claim 1, wherein a center mounting portion is integrally formed in a center section of the obstructing rubber elastic plate; the center mounting portion is securely attached to the partition member; at least one spoke-shaped retaining portion that extends radially from the center mounting portion towards an outer peripheral side is provided; a circumference retaining portion that extends in a circumferential direction from a distal end portion of the spoke-shaped retaining portion is provided; and in the obstructing rubber elastic plate, spring characteristics of the spoke-shaped retaining portion and the circumference retaining portion are made more rigid than that of a zone surrounded by the spoke-shaped retaining portion and the circumference retaining portion so that the contact retaining portions comprise the center mounting portion, the spoke-shaped retaining portion, and the circumference retaining portion.
4. The fluid filled type vibration damping device according to claim 1, wherein the contact retaining portions comprise thick rubber portions; a press retaining portion is provided on an opposite side of the partition member with the thick rubber portions being interposed therebetween; the thick rubber portions are pressed against the partition member by the press retaining portion and held elastically clamped therebetween; the elastic deformation zone situated circumferentially between the thick rubber portions is made thinner than the thick rubber portions; and a thickness dimension of the elastic deformation zone changes so as to become smaller gradually or in a stepwise manner from the thick rubber portions located on circumferentially opposite sides thereof towards a circumferentially center section thereof so as to constitute the non-linearizing member.
5. The fluid filled type vibration damping device according to claim 1, wherein a reinforcing member that is more rigid than the main rubber elastic body is attached to the outer peripheral edge of the obstructing rubber elastic plate so as to constitute the contact retaining portions while the elastic defotination zone situated circumferentially between the contact retaining portions is not attached by the reinforcing member and is allowed to readily deform;
the reinforcing member is provided an extended retaining portion that extends in a circumferential direction from the contact retaining portions towards the elastic deformation zone and has lower rigidity than the contact retaining portions; and
the extended retaining portion makes the elastic characteristics of the elastic deformation zone more rigid in circumferentially opposite sides rather than in a circumferentially center section so as to constitute the non-linearizing member.
6. The fluid filled type vibration damping device according to claim 2, wherein a reinforcing member that is integrally furnished with the center mounting portion and the at least one spoke-shaped retaining portion comprising a plurality of the spoke-shaped retaining portions is employed; and the reinforcing member partially limits elastic deformation of the obstructing rubber elastic plate so as to constitute the contact retaining portions.
7. The fluid filled type vibration damping device according to claim 2, wherein the center mounting portion and the plurality of the spoke-shaped retaining portions are integrally formed with the obstructing rubber elastic plate so as to constitute the contact retaining portions.
8. The fluid filled type vibration damping device according to claim 1, wherein a pressure receiving chamber-side cover member is provided for covering the elastic deformation zone of the obstructing rubber elastic plate from the pressure receiving chamber side with a gap therebetween;
an opposing contact projection is provided projecting from one of opposed faces of the elastic deformation zone and the pressure receiving chamber-side cover member towards another with a distal end portion thereof opposing to the other with a given spacing therebetween; and
the elastic deformation zone is adapted to undergo elastic deformation so as to be separated away from the partition member with the opposing contact projection coming into contact with the other to constitute the non-linearizing member.
9. The fluid filled type vibration damping device according to claim 1, wherein a pressure receiving chamber-side cover member is provided for covering the obstructing rubber elastic plate from the pressure receiving chamber side with a gap therebetween;
the pressure receiving chamber-side cover member is provided with a communication hole that connects an inside area between the pressure receiving chamber-side cover member and the obstructing rubber elastic plate with the pressure receiving chamber at a location away from an opposed portion against the elastic deformation zone of the obstructing rubber elastic plate.
10. The fluid filled type vibration damping device according to claim 1, wherein an excess pressure avoiding mechanism is provided in which the obstructing rubber elastic plate is adapted to undergo elastic deformation on the basis of pressure differential between the pressure receiving chamber and the equilibrium chamber so that the outer peripheral edge of the obstructing rubber elastic plate is separated from the partition member so as to cause the communication aperture to open up;
an obstructed space is formed so as to extend between superposed surfaces between the partition member and the obstructing rubber elastic plate; and
the communication aperture is connected with an outer peripheral portion of the obstructed space so that the pressure of the equilibrium chamber adapted to act on the obstructing rubber elastic plate through the communication aperture acts thereon via the obstructed space.
11. The fluid filled type vibration damping device according to claim 10, wherein a recess is formed on at least one of superposed surfaces between the partition member and the obstructing rubber elastic plate; and the obstructed space is defined by the recess being covered.
12. The fluid filled type vibration damping device according to claim 1, wherein the contact retaining portions, which are held in contact against the partition member on the obstructing rubber elastic plate, include a center mounting portion located in a center section of the obstructing rubber elastic plate and a plurality of spoke-shaped retaining portions that extend radially from the center mounting portion towards an outer peripheral side;
a zone situated circumferentially between the spoke-shaped retaining portions that are adjacently situated in a circumferential direction on the obstructing rubber elastic plate defines the elastic deformation zone adapted to undergo elastic deformation on the basis of pressure differential between the pressure receiving chamber and the equilibrium chamber such that the elastic deformation zone undergoes elastic deformation in a direction of separation from the partition member so as to cause the communication aperture to become an open state via an outer peripheral edge of the elastic deformation zone; and
the elastic deformation zone is provided with an elastic deformation limiting member in a center section thereof that is spaced away from both the spoke-shaped retaining portions located on circumferentially opposite sides thereof and the outer peripheral edge thereof such that the elastic deformation limiting member is adapted to limit an amount of displacement of the elastic deformation zone in the direction of separation from the partition member.
13. The fluid filled type vibration damping device according to claim 12, wherein a pressure receiving chamber-side cover member is provided for covering the elastic deformation zone of the obstructing rubber elastic plate from the pressure receiving chamber side with a gap therebetween;
a contacting projection is provided projecting from one of opposed faces of the elastic deformation zone and the pressure receiving chamber-side cover member towards another with a distal end portion thereof opposing to the other with a given spacing therebetween; and
the elastic deformation zone is adapted to undergo elastic deformation so as to be spaced away from the partition member with the contacting projection coming into contact with the other so as to constitute the elastic deformation limiting member.
14. The fluid filled type vibration damping device according to claim 13, wherein the communication aperture of the partition member is formed so as to open in a section thereof that is situated to the outside peripheral side of a forming portion of the contacting projection between the opposed faces of the elastic deformation zone of the obstructing rubber elastic plate and the pressure receiving chamber-side cover member.
15. The fluid filled type vibration damping device according to claim 1, wherein the obstructing rubber elastic plate is superposed against and disposed on a center section of the partition member; and the orifice passage is formed so as to extend along an outside peripheral section of the partition member in a circumferential direction.
16. The fluid filled type vibration damping device according to claim 1, wherein an annular seal rib is integrally formed with an outside peripheral section of the obstructing rubber elastic plate so as to project from an opposed face thereof against the partition member and extend continuously about an entire circumference in a circumferential direction; and in a superposed state of the obstructing rubber elastic plate against the partition member the seal rib is positioned in abutment with the partition member.