1. A head mounted portable wireless display device eyewear apparatus comprising:
a camera;
a set of earphones;
a microphone;
a processor;
memory;
a transceiver;
a geospatial location device;
a heads up lens system for the wearer to see message content and to see through;
wherein the microphone, processor and memory are used to implement audio capture and recording, voice recognition of the wearer and audio recognition of audio message content;
wherein the camera, processor and memory are used to implement capture and recording of text, graphics, images and video;
wherein the microphone, earphones, camera and heads up display provide the wearer of the head mounted portable wireless display device eyewear apparatus a hands free interface for operation of the apparatus;
wherein the transceiver receives message content comprising advertising data that is transmitted to the head mounted portable wireless display device eyewear apparatus based, at least in part, on a set pre-determined set of rules established between the wearer and a third party system;
wherein the pre-determined set of rules is based, at least in part, on location information of the head mounted portable wireless display apparatus, andor date, andor time;
wherein the transceiver transmits a return message in response to the advertising data, the message comprises: an audio recording component comprising voice and audio information available to the wearer, an image component comprising image content the wearer is currently viewing, from the point of view of the wearer, and a data component, wherein the data comprises geospatial location information or distance between the apparatus and stationary or mobile dynamic display devices;
wherein the return message is used by the third party system to determine the location information of the head mounted portable wireless display device eyewear apparatus, the audio, image, video, and voice content from the wearer in real time, and whether the third party’s own content was viewed by the wearer;
wherein the third party system uses content from the return message to determine the total number of times and duration the content was viewed by the wearer; and
wherein the third party system dynamically updates content to send in future advertisement messages to the head mounted portable wireless display device eyewear apparatus, based on the content and statistics generated from the return message.
2. A head mounted portable wireless display device eyewear apparatus according to claim 1, that determines its geospatial location using:
a. a GPS or other satellite based pseudo ranging receiver,
b. a wireless cellular transceiver,
c. a dead reckoning INS device,
d. a Bluetooth transceiver,
e. a WiMax transceiver, andor
f. a Radar responsive tag.
3. A head mounted portable wireless display device eyewear apparatus according to claim 1, that communicates with the central system using:
a. a cellular transceiver, andor
b. a wireless LAN.
4. A head mounted portable wireless display device eyewear apparatus according to claim 1, that communicates with stationary or mobile dynamic display devices using:
a. a wireless LAN,
b. a Bluetiith transceiver,
c. a WiMax transceiver, andor
d. a Radar responsive tag.
5. A head mounted portable wireless display device eyewear apparatus according to claim 1, wherein the third party system comprises:
a. Publishers,
b. a central system,
c. stationary dynamic display devices, and
d. mobile dynamic display devices.
6. A method for transmitting and receiving message content, the method comprising:
generating, by a third party system, advertising data message content to stationary and mobile dynamic display devices for reception, processing and reply by a head mounted portable wireless display device eyewear apparatus;
wherein the third party system generates advertising data message content based on a pre-determined set of rules is based, at least in part, on geo-spatial location information of a head mounted portable wireless display device eyewear apparatus or distance between the head mounted portable wireless display device eyewear apparatus and stationary or mobile dynamic display devices;
wherein the third party system transmits the advertising data message content to the head mounted portable wireless display device eyewear apparatus, the message comprises text, graphics, audio, images and video.
wherein the head mounted portable wireless display device eyewear apparatus transmits a return reply message in response to the advertising data message content, the message comprises audio, image and video content generated by the wearer;
wherein the head mounted portable wireless display device eyewear apparatus transmits a return reply message in response to the advertising data message content, the message comprises: a recognition and recording component comprised of voice, audio, image and video information available to the wearer, which the wearer is currently hearing andor viewing, from the point of view of the wearer, and a data component, wherein the data comprises date, time and geospatial location information or distance from a stationary or mobile dynamic display device;
wherein the return reply message is used by the third party system to determine the location information of the head mounted wireless portably display device eyewear apparatus, the audio, image, video, and voice content heard and observed by the wearer in real time, and whether the third party’s own message content was viewed by the wearer;
wherein the third party system uses content from the return message to determine the total number of times and duration the content was viewed by the wearer; and
wherein the third party system dynamically updates content to send in future advertisement messages, discounts and coupons to the head mounted portable wireless display device eyewear apparatus, based on the content and statistics generated from the return reply message.
7. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the apparatus using pseudo range data from GPS receiver or a similar pseudo range system.
8. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the apparatus using a cellular triangulation means using; (1) the geo-spatial location of the cellular towers and (2) the relative signal strength intensity (RSSI) of each cellular tower signal.
9. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the apparatus using a cellular triangulation means using; (1) the geo-spatial location of the cellular towers and (2) the time distance of arrival (TDOA) of each cellular tower signal.
10. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the cellular network using a cellular triangulation means using; (1) the geo-spatial location of the cellular towers and (2) the relative signal strength intensity (RSSI) of the cellular signal from the head mounted portable wireless display device eyewear apparatus.
11. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the cellular network using a cellular triangulation means using; (1) the geo-spatial location of the cellular towers and (2) the time distance of arrival (TDOA)of the cellular signal from the head mounted portable wireless display device eyewear apparatus.
12. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the apparatus using a WiFiWiMaxBluetooth triangulation means using; (1) the geo-spatial location of the WiFiWiMaxBluetooth transceivers and (2) the relative signal strength intensity (RSSI) of each WiFiWiMaxBluetooth transceiver signals.
13. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the apparatus using a WiFiWiMaxBluetooth triangulation means using; (1) the geo-spatial location of the WiFiWiMaxBluetooth transceivers and (2) the time disdantce of arrival (TDOA) of each WiFiWiMaxBluetooth transceiver signals.
14. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the WiFiWiMaxBluetooth transceiver network using a WiFiWiMaxBluetooth triangulation means using; (1) the geo-spatial location of the WiFiWiMaxBluetooth transceivers and (2) the relative signal strength intensity (RSSI) of the WiFiWiMaxBluetooth transceiver signals from the head mounted portable wireless display device eyewear apparatus.
15. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the WiFiWiMaxBluetooth transceiver network using a WiFiWiMaxBluetooth triangulation means using; (1) the geo-spatial location of the WiFiWiMaxBluetooth transceivers and (2) the time distance of arrival (TDOA)of the WiFiWiMaxBluetooth transceiver signals from the head mounted portable wireless display device eyewear apparatus.
16. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on a radar tower network using azimuth and range data returned by a radar responsive tag or RFID radar tag on the head mounted portable wireless display device eyewear apparatus.
17. A method, according to claim 6, where the geospatial location of the head mounted portable wireless display device eyewear apparatus is computed on the head mounted portable wireless display device eyewear apparatus using dead reckoning by an inertial navigation system on the head mounted portable wireless display device apparatus.
18. A method, according to claim 6, whereas the head mounted portable wireless display device eyewear apparatus communicates with the third party system, the geospatial location of the head mounted portable wireless display device using a wireless communication means.
19. A method, according to claim 6, to determine on the head mounted portable wireless display device eyewear apparatus, the distance between the head mounted portable wireless display device eyewear apparatus and a stationary dynamic display device or mobile dynamic display device measuring the RSSI andor TDOA of the WiFiWiMaxBluetooth transceivers of the stationary or mobile dynamic display devices.
20. A method, according to claim 6, to determine on a stationary dynamic display device or mobile dynamic display device, the distance between a head mounted portable wireless display device eyewear apparatus and a stationary dynamic display device or mobile dynamic display device measuring RSSI or TDOA of the WiFiWiMaxBluetooth transceivers on the head mounted portable wireless display device eyewear apparatus.
21. A method, according to claim 6, to determine on the head mounted portable wireless display device eyewear apparatus, the distance between a head mounted portable wireless display device apparatus and a stationary dynamic display device, or mobile dynamic display device by computing the distance using the camera and a visual recognition application means on the head mounted portable wireless display device eyewear apparatus.
22. A method according to claim 6, to determine on the head mounted portable wireless display device eyewear apparatus, when the portable head mounted wireless display device eyewear apparatus is within audio distance of a stationary dynamic display device or mobile dynamic display device using the microphone and an audio capture and recognition application means.
23. A method, according to claim 6, whereas the head mounted portable wireless display device eyewear apparatus communicates with the third party system, the distance between the head mounted portable wireless display device and a stationary dynamic display device or a mobile dynamic display device using a wireless communication means.
24. A method, according to claim 6, whereas the head mounted portable wireless display device apparatus communicates with a stationary dynamic display device or a mobile dynamic display device, the distance between the head mounted portable wireless display device eyewear apparatus and a stationary dynamic display device or a mobile dynamic display device using a wireless communication means.
25. A method, according to claim 6, whereas the head mounted portable wireless display device eyewear apparatus displays message content comprised of; text, graphics, images, and videos using a heads up display means.
26. A method, according to claim 6, whereas the head mounted portable wireless display device eyewear apparatus uses speech recognition to convert speech to text to generate a reply message to a third party system.
27. A method, according to claim 6, whereas the head mounted portable wireless display device eyewear apparatus utilizes the heads up display to show the geospatial location of the head mounted portable wireless display device and third party system generated navigation instructions to a destination downloaded by wireless means from a third party system.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. Method for the simultaneous segmentation of multiple or composed objects in an image, wherein a deformable surface model is to be adapted to a first surface of a first object and a second surface of a second object and wherein the deformable surface model comprises a first partial deformable surface model and a second partial deformable surface model, comprising acts of:
(a) applying the first partial deformable surface model describing a structure of the first surface of the first object;
(b) applying the second partial deformable surface model describing a structure of the second surface of the second object, wherein the first partial deformable surface model and the second partial deformable surface model have a prescribed spatial relationship corresponding to distances between portions of the first object and portions of the second object; and
(c) adapting the first partial deformable model to the first surface and the second partial deformable model to the second surface, wherein the prescribed spatial relationship of the first partial deformable surface model and the second partial deformable surface model is used for the adaptation.
2. Method according to claim 1, wherein the spatial relationship of the first partial deformable surface model and the second partial deformable surface model is prescribed by means of an additional edge, which connects a first vertex of the first partial deformable surface model with a second vertex of the second partial deformable surface model.
3. Method according to claim 2, wherein the additional edge is a featureless vertex connection.
4. Method according to claim 1, wherein the first and second partial deformable surface models each comprise a mesh with a plurality of surface elements, further comprising acts of:
detecting feature points for the surface elements at the first and second surfaces of the first and second objects; and
recalculating coordinates of the surface elements of the mesh to represent the feature points.
5. Method according to claim 4, wherein the recalculation act comprises acts of:
minimizing a distance between the feature points and the surface elements; and
minimizing an internal energy of the first and second partial deformable surface models.
6. Method according to claim 5, wherein the internal energy comprises an extended internal energy relating to a difference of a length of the additional edge and a distance between the first and second partial deformable models.
7. Image processing device, comprising:
a memory for storing a deformable surface model comprising a first deformable surface model and a second deformable surface model and for storing an image depicting a first object and a second object; and
an image processor for adapting the deformable surface model to a first surface of the first object and a second surface of the second object, which processor is configured to perform the following operation:
(a) applying the first partial deformable surface model describing a structure of the first surface of the first object;
(b) applying the second partial deformable surface model describing a structure of the second surface of the second object, wherein the first partial deformable surface model and the second partial deformable surface model have a prescribed spatial relationship corresponding to distances between portions of the first object and portions of the second object; and
(c) adapting the first partial deformable model to the first surface and the second partial deformable model to the second surface, wherein the prescribed spatial relationship of the first partial deformable surface model and the second partial deformable surface model is used for the adaptation.
8. Computer program stored on a computer readable medium for an image processing device, the computer program being configured to adapt a deformable surface model comprising a first partial deformable surface model and a second partial deformable surface model to a first surface of a first object and a second surface of a second object, the computer program comprising programming portions configured to:
(a) apply the first partial deformable surface model describing a structure of the first surface of the first object;
(b) apply the second partial deformable surface model describing a structure of the second surface of the second object, wherein the first partial deformable surface model and the second partial deformable surface model have a prescribed spatial relationship corresponding to distances between portions of the first object and portions of the second object; and
(c) adapt the first partial deformable model to the first surface and the second partial deformable model to the second surface, wherein the prescribed spatial relationship of the first partial deformable surface model and the second partial deformable surface model is used for the adaptation.
9. Method according to claim 4, wherein the portions of the first and second objects correspond to the detected feature points and wherein the distances between the portions of the first object and the portions of the second object correspond to distances between the feature points of the first and second objects.
10. Method according to claim 9, comprising an act of deleting distances that are larger than a threshold, wherein the act of adapting is performed utilizing distances that are not deleted.
11. Computer program according to claim 8, wherein the portions of the first and second objects correspond to the detected feature points and wherein the distances between the portions of the first object and the portions of the second object correspond to distances between the feature points of the first and second objects.
12. Computer program according to claim 11, comprising a programming portion configured to delete distances that are larger than a threshold, wherein the portion configured to adapt is configured to adapt the first partial deformable model to the first surface and the second partial deformable model to the second surface utilizing distances that are not deleted.
13. Computer program according to claim 8, wherein the first and second partial deformable surface models each comprise a mesh with a plurality of surface elements, the computer program comprising programming portions configured to:
detect feature points for the surface elements at the first and second surfaces of the first and second objects; and
recalculate coordinates of the surface elements of the mesh to represent the feature points.
14. Computer program according to claim 13, wherein the surface elements correspond to triangles.
15. Computer program according to claim 14, wherein the distances between portions of the first object and portions of the second object represent distances between vertices of triangles at the first and second surfaces of the first and second objects.
16. Computer program according to claim 13, wherein the portion configured to recalculate comprises programming portions configured to:
minimize a distance between the feature points and the surface elements; and
minimize an internal energy of the first and second partial deformable surface models.
17. Computer program according to claim 16, wherein the internal energy comprises an extended internal energy relating to a difference of a length of the additional edge and a distance between the first and second partial deformable models.
18. Computer program according to claim 8, the computer program comprising a programming portion configured to calculate the distances by searching for a shortest distance between vertices of the triangles at the first and second surfaces of the first and second objects.