1. A method for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the method comprising:
generating, using the at least one image sensor system, image data of the at least one calibrating object;
determining, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle, the geometric travel axis being a bisector of a total toe-in angle of a rear axis of the vehicle; end
determining a calibration using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle.
2. The method of claim 1, wherein the data on the geometric travel axis of the motor vehicle included in the generated image data are used.
3. The method of claim 1, wherein there are at least two image sensor systems which image essentially the same scene, and the alignment of each of the image sensor systems with respect to the geometric travel axis of the motor vehicle is determined separately for each of the image sensor systems, from which the alignment of the image sensor systems to each other is determined.
4. The method of claim 3, wherein the at least two image systems includes at least a stereo camera system.
5. The method of claim 1, wherein at least one value of intrinsic calibration data of the at least one image sensor system is determined.
6. The method of claim 1, wherein the generating, using the at least one image sensor system, of the image data of the at least one calibrating object, is in at least one image data set.
7. A method for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the method comprising:
generating, using the at least one image sensor system, image data of the at least one calibrating object;
determining, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle; and
determining a calibration using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle;
wherein:
in the determining of the alignment, at least one pointer is aligned at least one non-steered wheel of the motor vehicle by the at least one pointer,
at least one marking point is generated on the at least one calibrating object, and
data on the geometric travel axis of the motor vehicle is derivable from the at least one marking point.
8. The method of claim 7, wherein:
a first and a second pointer, each having a pointer beam on a first and a second non-steered wheel of the motor vehicle, are aligned,
the first and the second non-steered wheel approximately establish a wheel axis so that the pointer beam of the first pointer is aligned approximately parallel to the roadway plane and approximately parallel to the track of the first non-steered wheel, and the pointer beam of the second pointer is aligned approximately parallel to the roadway plane and approximately parallel to the track of the second non-steered wheel, the pointer beams being suitable in each case for generating a marking point on the at least one calibrating object,
the alignment of the calibrating object to the motor vehicle is such that an angle between the geometric travel axis and the calibrating object is between 0\xb0 and 180\xb0,
for the generation of the image data of the at least one calibrating object by the at least one image sensor system, image data of the marking points is included, and
the determining of the alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle is performed with the aid of the generated image data.
9. The method of claim 8, wherein:
the calibration includes determining at least one distance between the at least one calibrating object and at least one of the first and second non-steered wheel along at least one of the first and second pointer beam of at least one of the first and second pointer, and
the determining of the alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle is performed with the aid of the generated image data and at least one determined distance.
10. The method of claim 9, wherein in the alignment of the calibrating object to the motor vehicle, the angle between the geometric travel axis and the calibrating object is perpendicular.
11. The method of claim 9, wherein the geometric axis of the vehicle includes at least one of a yaw angle, a pitch angle, and roll angle.
12. The method of claim 8, wherein in the alignment of the calibrating object to the motor vehicle, the angle between the geometric travel axis and the calibrating object is perpendicular.
13. The method of claim 8, wherein the calibrating object has a flat surface.
14. The method of claim 8, wherein the geometric axis of the vehicle includes at least one of a yaw angle, a pitch angle, and a roll angle.
15. The method of claim 7, wherein:
the alignment of a first and a second pointer on a first and a second non-steered wheel of the motor vehicle,
the first and the second pointer each having a first and a second pointer beam,
the first and the second non-steered wheel approximately establishing a wheel axis so that the first pointer beam of the first pointer is aligned approximately parallel to the roadway plane and approximately parallel to the track of the first non-steered wheel, and the first pointer beam of the second pointer is aligned approximately parallel to the roadway plane and approximately parallel to the track of the second non-steered wheel,
the second pointer beams in each case are positioned at an angle different from zero to the first pointer beam of the same pointer,
the second pointer beams in each case are aligned approximately parallel to the track of the non-steered wheel,
all four pointer beams are suitable in each case for generating one marking point on the at least one calibrating object,
the calibrating includes determining a distance between the calibrating object and at least one of the non-steered wheels along the first and the second pointer beams of the first and the second pointer,
in the generating of the image data of the at least one calibrating object by the at least one image sensor system, image data of the marking points is included, and
the determining of the alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle is performed with the aid of the generated image data and at least one determined distance.
16. The method of claim 15, wherein the geometric axis of the vehicle includes at least one of a yaw angle, a pitch angle, and a roll angle.
17. A device for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the device comprising:
at least one calibrating object; and
at least one evaluation arrangement to evaluate image data of the at least one image sensor system, which generates the image data of the at least one calibrating object, and which includes a determining arrangement to determine, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle, the geometric travel axis being a bisector of a total toe-in angle of a rear axis of the vehicle;
wherein a calibration is determined using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle.
18. The device of claim 17, wherein the evaluation arrangement includes an arrangement to evaluate data concerning the geometric travel axis of the motor vehicle included in the image data.
19. The device of claim 17, wherein the at least one image sensor system includes at least two image sensor systems which image essentially the same scene.
20. The device of claim 19, wherein the at least two image sensor systems include at least one stereo camera system.
21. A device for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the device comprising:
at least one calibrating object; and
at least one evaluation arrangement to evaluate image data of the at least one image sensor system, which generates the image data of the at least one calibrating object, and which includes a determining arrangement to determine, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle;
wherein a calibration is determined using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle; and
wherein at least one pointer is aligned on at least one non-steered wheel of the motor vehicle, and at least one pointer beam of the at least one pointer generates at least one marking point on the at least one calibrating object.
22. The device of claim 21, wherein the at least one pointer includes a range finder.
23. The device of claim 21, wherein the at least one pointer includes an electronic range finder.
24. The device of claim 21, wherein the at least one pointer includes an optical range finder.
25. The device of claim 21, wherein the at least one pointer includes an electronicoptical range finder.
26. An image sensor system including a device for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the image sensor system comprising:
at least one calibrating object; and
at least one evaluation arrangement to evaluate image data of the at least one image sensor system, which generates the image data of the at least one calibrating object, and which includes a determining arrangement to determine, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle, the geometric travel axis being a bisector of a total toe-in angle of a rear axis of the vehicle;
wherein a calibration is determined using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle.
27. A method for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the method comprising:
generating, using the at least one image sensor system, image data of the at least one calibrating object;
determining, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle; and
determining a calibration using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle;
wherein there are at least two image sensor systems which image essentially the same scene, and the alignment of each of the image sensor systems with respect to the geometric travel axis of the motor vehicle is determined separately for each of the image sensor systems, from which the alignment of the image sensor systems to each other is determined;
wherein the at least two image sensor systems include at least a stereo camera system; and
wherein the intrinsic calibration data includes at least one of the camera’s principal point, the camera’s principal distance, at least one distortion parameter, and an influence of a glass pane in a light path of the camera.
28. A method for calibrating at least one image sensor system which is located at a motor vehicle, by the use of at least one calibrating object, the method comprising:
generating, using the at least one image sensor system, image data of the at least one calibrating object;
determining, from generated image data of the at least one calibrating object, an alignment of the at least one image sensor system with respect to a geometric travel axis of the motor vehicle; and
determining a calibration using a determined alignment of the at least one image sensor system with respect to the geometric travel axis of the motor vehicle;
wherein there are at least two image sensor systems which image essentially the same scene, and the alignment of each of the image sensor systems with respect to the geometric travel axis of the motor vehicle is determined separately for each of the image sensor systems, from which the alignment of the image sensor systems to each other is determined;
wherein the at least two image sensor systems include at least a stereo camera system; and
wherein the intrinsic calibration data includes at least one of a principal point, a principal distance, at least one distortion parameter, and an influence of a glass pane in a light path of at least one of the at least two image sensor systems.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A system for optimizing bandwidth during a video conference comprising:
a plurality of multipoint conference units (MCUs) each operable to facilitate video conferences between two or more participants, the MCUs further operable to facilitate cascaded video conferences comprising participants managed by two or more of the MCUs;
a plurality of endpoints participating in a video conference, each endpoint operable to establish a conference link with a selected one of the MCUs, to generate a plurality of video streams and a corresponding plurality of audio streams, to transmit the generated video streams and the generated audio streams on the conference link, to receive a plurality of video streams and a plurality of audio streams, to present the received audio streams using a plurality of speakers, and to display the received video streams using a plurality of monitors;
a controlled MCU of the MCUs managing a first set of the endpoints, the controlled MCU operable:
to receive a first set of available video streams comprising the generated video streams from each of the first set of endpoints;
to select N potential video streams out of the first set of available video streams, wherein N equals the maximum number of active video streams that any endpoint is able to display concurrently; and
to transmit the potential video streams to a master MCU of the MCUs; and
the master MCU managing a second set of the endpoints, the master MCU operable:
to receive a second set of available video streams comprising the generated video streams from each of the second set of endpoints and the potential video streams from the controlled MCU;
to select active video streams out of the second set of available video streams, the active video streams comprising N primary video streams and M alternate video streams;
to determine required ones of the active video streams for delivery to one or more of the first set of the endpoints; and
to transmit the required ones of the active video streams to the controlled MCU.
2. The system of claim 1, wherein the required ones of the active video streams consist of the active streams generated by the second set of endpoints.
3. The system of claim 1, wherein:
the required ones of the active video streams comprise the N primary video streams; and
if any of the primary video streams are generated by the first set of endpoints, then the required ones further comprise one or more of the M alternate video streams.
4. The system of claim 1, wherein the controlled MCU and the master MCU are each further operable to:
for each primary video stream, to transmit the primary video stream to each endpoint that did not generate the primary video stream; and
for each managed endpoint that generated L of the primary streams, to transmit L of the alternate video streams to that managed endpoint.
5. The system of claim 1, wherein selecting N potential video streams out of the first set of available video streams comprises:
for each available video stream in the first set of available video streams, identifying a confidence value associated with an audio stream corresponding to the available video stream, the confidence value indicating a likelihood that the corresponding audio stream is associated with an active speaker; and
selecting the N available video streams with confidence values that indicate the highest likelihoods.
6. The system of claim 1, wherein the controlled MCU and the master MCU are each further operable:
to determine that a period of time has elapsed since a particular audio stream was associated with an active speaker, the particular audio stream corresponding to a particular video stream generated by a particular endpoint; and
in response to the determination, to transmit a stop-video message to the particular endpoint, the stop-video message instructing the particular endpoint to discontinue transmission of the particular video stream.
7. The system of claim 1, wherein M equals N.
8. The system of claim 1, further comprising:
one or more single endpoints participating in the video conference, each single endpoint operable to generate one video stream and one audio stream and to receive one video stream and one audio stream;
wherein the plurality of endpoints comprises one or more double endpoints and one or more triple endpoints, each double endpoint operable to generate two video streams and two audio streams and to receive two video streams and two audio streams, each triple endpoint operable to generate three video streams and three audio streams and to receive three video streams and three audio streams.
9. The system of claim 1, wherein at least one of the plurality of monitors is operable to display a plurality of the received video streams.
10. The system of claim 1, further comprising a teleconference server operable:
to select the master MCU and the controlled MCU from the plurality of MCUs; and
to transmit a message to the controlled MCU, the message identifying the master MCU.
11. A multipoint conference unit (MCU) for optimizing bandwidth during a video conference comprising a controller operable:
in a first mode of operation:
to facilitate a video conference as a controlled MCU managing a first set of a plurality of endpoints participating in the video conference, each endpoint operable to generate a plurality of video streams and a corresponding plurality of audio streams and to receive a different plurality of video streams and a different plurality of audio streams;
to receive a first set of available video streams comprising the generated video streams from each of the first set of endpoints;
to select N potential video streams out of the first set of available video streams, wherein N equals the maximum number of active video streams that any endpoint is able to display concurrently; and
to transmit the potential video streams to a master MCU; and
the controller further operable, in a second mode of operation:
to facilitate the video conference as the master MCU managing a second set of the endpoints;
to receive a second set of available video streams comprising the generated video streams from each of the second set of endpoints and the potential video streams from the controlled MCU;
to select active video streams out of the second set of available video streams, the active video streams comprising N primary video streams and M alternate video streams;
to determine required ones of the active video streams for delivery to one or more of the first set of the endpoints; and
to transmit the required ones of the active video streams to the controlled MCU.
12. The MCU of claim 11, wherein the required ones of the active video streams consist of the active streams generated by the second set of endpoints.
13. The MCU of claim 11, wherein:
the required ones of the active video streams comprise the N primary video streams; and
if any of the primary video streams are generated by the first set of endpoints, then the required ones further comprise one or more of the M alternate video streams.
14. The MCU of claim 11, wherein the controller is further operable to:
for each primary video stream, to transmit the primary video stream to each endpoint that did not generate the primary video stream; and
for each managed endpoint that generated L of the primary streams, to transmit L of the alternate video streams to that managed endpoint.
15. The MCU of claim 11, wherein selecting N potential video streams out of the first set of available video streams comprises:
for each available video stream in the first set of available video streams, identifying a confidence value associated with an audio stream corresponding to the available video stream, the confidence value indicating a likelihood that the corresponding audio stream is associated with an active speaker; and
selecting the N available video streams with confidence values that indicate the highest likelihoods.
16. A method for optimizing bandwidth during a video conference comprising:
in a first mode of operation:
facilitating a video conference as a controlled MCU managing a first set of a plurality of endpoints participating in the video conference, each endpoint operable to generate a plurality of video streams and a corresponding plurality of audio streams and to receive a different plurality of video streams and a different plurality of audio streams;
receiving a first set of available video streams comprising the generated video streams from each of the first set of endpoints;
selecting N potential video streams out of the first set of available video streams, wherein N equals the maximum number of active video streams that any endpoint is able to display concurrently; and
transmitting the potential video streams to a master MCU; and
in a second mode of operation:
facilitating the video conference as the master MCU managing a second set of the endpoints;
receiving a second set of available video streams comprising the generated video streams from each of the second set of endpoints and the potential video streams from the controlled MCU;
selecting active video streams out of the second set of available video streams, the active video streams comprising N primary video streams and M alternate video streams;
determining required ones of the active video streams for delivery to one or more of the first set of the endpoints; and
transmitting the required ones of the active video streams to the controlled MCU.
17. The method of claim 16, wherein the required ones of the active video streams consist of the active streams generated by the second set of endpoints.
18. The method of claim 16, wherein:
the required ones of the active video streams comprise the N primary video streams; and
if any of the primary video streams are generated by the first set of endpoints, then the required ones further comprise one or more of the M alternate video streams.
19. The method of claim 16, further comprising:
for each primary video stream, transmitting the primary video stream to each endpoint that did not generate the primary video stream; and
for each managed endpoint that generated L of the primary streams, transmitting L of the alternate video streams to that managed endpoint.
20. The method of claim 16, wherein selecting N potential video streams out of the first set of available video streams comprises:
for each available video stream in the first set of available video streams, identifying a confidence value associated with an audio stream corresponding to the available video stream, the confidence value indicating a likelihood that the corresponding audio stream is associated with an active speaker; and
selecting the N available video streams with confidence values that indicate the highest likelihoods.
21. Logic for optimizing bandwidth during a video conference, the logic encoded in non-transitory computer readable media and operable when executed to:
in a first mode of operation:
facilitate a video conference as a controlled MCU managing a first set of a plurality of endpoints participating in the video conference, each endpoint operable to generate a plurality of video streams and a corresponding plurality of audio streams and to receive a different plurality of video streams and a different plurality of audio streams;
receive a first set of available video streams comprising the generated video streams from each of the first set of endpoints;
select N potential video streams out of the first set of available video streams, wherein N equals the maximum number of active video streams that any endpoint is able to display concurrently; and
transmit the potential video streams to a master MCU; and
in a second mode of operation:
facilitate the video conference as the master MCU managing a second set of the endpoints;
receive a second set of available video streams comprising the generated video streams from each of the second set of endpoints and the potential video streams from the controlled MCU;
select active video streams out of the second set of available video streams, the active video streams comprising N primary video streams and M alternate video streams;
determine required ones of the active video streams for delivery to one or more of the first set of the endpoints; and
transmit the required ones of the active video streams to the controlled MCU.
22. The logic of claim 21, wherein the required ones of the active video streams consist of the active streams generated by the second set of endpoints.
23. The logic of claim 21, wherein:
the required ones of the active video streams comprise the N primary video streams; and
if any of the primary video streams are generated by the first set of endpoints, then the required ones further comprise one or more of the M alternate video streams.
24. The logic of claim 21, further operable to:
for each primary video stream, transmit the primary video stream to each endpoint that did not generate the primary video stream; and
for each managed endpoint that generated L of the primary streams, transmit L of the alternate video streams to that managed endpoint.
25. The logic of claim 21, wherein selecting N potential video streams out of the first set of available video streams comprises:
for each available video stream in the first set of available video streams, identifying a confidence value associated with an audio stream corresponding to the available video stream, the confidence value indicating a likelihood that the audio stream is associated with an active speaker; and
selecting the N available video streams with confidence values that indicate the highest likelihoods.
26. A system for optimizing bandwidth during a video conference comprising:
in a first mode of operation:
means for facilitating a video conference as a controlled MCU managing a first set of a plurality of endpoints participating in the video conference, each endpoint operable to generate a plurality of video streams and a corresponding plurality of audio streams and to receive a different plurality of video streams and a different plurality of audio streams;
means for receiving a first set of available video streams comprising the generated video streams from each of the first set of endpoints;
means for selecting N potential video streams out of the first set of available video streams, wherein N equals the maximum number of active video streams that any endpoint is able to display concurrently; and
means for transmitting the potential video streams to a master MCU; and
in a second mode of operation:
means for facilitating the video conference as the master MCU managing a second set of the endpoints;
means for receiving a second set of available video streams comprising the generated video streams from each of the second set of endpoints and the potential video streams from the controlled MCU;
means for selecting active video streams out of the second set of available video streams, the active video streams comprising N primary video streams and M alternate video streams;
means for determining required ones of the active video streams for delivery to one or more of the first set of the endpoints; and
means for transmitting the required ones of the active video streams to the controlled MCU.