1. An image processing apparatus comprising:
a gradient strength calculating unit that calculates a gradient strength of a pixel value of each pixel based on an intraluminal image that is a captured image of an intralumen;
a closed region extracting unit that extracts a closed region from the intraluminal image, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with a predetermined curvature or higher toward an inner side of the closed region; and
an abnormal portion detecting unit that detects an abnormal portion inside the closed region, wherein
the closed region extracting unit includes
an initial closed region setting unit that sets an initial shape of the closed region;
an energy calculating unit that calculates values of a plurality of types of energy including at least energy determined by an outer shape of the closed region and energy determined by the gradient strength in the closed region;
an energy-weighted sum calculating unit that calculates a weighted sum of the plurality of types of energy; and
a closed region updating unit that updates a shape of the closed region within an update range based on the weighted sum, and
the closed region updating unit includes an update range determining unit that determines the update range in which the shape of the closed region is updated based on any one of the values of the plurality of types of energy.
2. The image processing apparatus according to claim 1, wherein the energy calculating unit includes an edge inclusion energy calculating unit that calculates a value of edge inclusion energy indicating a larger value as more pixels having the gradient strength equal to or higher than the predetermined value are present in the closed region.
3. The image processing apparatus according to claim 2, wherein the edge inclusion energy calculating unit includes a closed region gradient strength calculating unit that calculates a closed region gradient strength based on the gradient strength in the closed region, and calculates the value of the edge inclusion energy indicating a larger value as the closed region gradient strength becomes larger.
4. The image processing apparatus according to claim 2, wherein the edge inclusion energy calculating unit includes an edge extracting unit that extracts a pixel having the gradient strength equal to or higher than the predetermined value as an edge, and calculates the value of the edge inclusion energy based on the edge in the closed region.
5. The image processing apparatus according to claim 4, wherein
the edge inclusion energy calculating unit includes
a bending point detecting unit that detects a bending point of the edge; and
an end point detecting unit that detects an end point of the edge, and
the edge inclusion energy calculating unit calculates the value of the edge inclusion energy based on an inclusion state of the bending point and the end point in the closed region.
6. The image processing apparatus according to claim 5, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the edge inclusion energy calculating unit includes an outer product calculating unit that calculates an outer product of vectors drawn from the control points to the bending point and the end point, and
the edge inclusion energy calculating unit calculates the value of the edge inclusion energy based on a value of the outer product.
7. The image processing apparatus according to claim 3, wherein the edge inclusion energy calculating unit includes an increase rate calculating unit that calculates an increase rate of the gradient strength in the closed region before and after update of the shape, and
the edge inclusion energy calculating unit calculates the value of the edge inclusion energy based on the increase rate.
8. The image processing apparatus according to claim 1, wherein the energy calculating unit includes a curvature energy calculating unit that calculates a value of curvature energy indicating a larger value as the boundary of the closed region bends more inwardly.
9. The image processing apparatus according to claim 8, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the curvature energy calculating unit includes an outer product energy calculating unit that calculates a value of outer product energy based on an outer product of vectors drawn from each of the control points to another control point adjacent thereto, and
the curvature energy calculating unit determines the value of the outer product energy to be the value of the curvature energy.
10. The image processing apparatus according to claim 8, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the curvature energy calculating unit includes a general outer product energy calculating unit that calculates a value of general outer product energy based on an outer product of vectors drawn from each of the control points to another control point apart therefrom by a predetermined distance or larger, and
the curvature energy calculating unit determines the value of the general outer product energy to be the value of the curvature energy.
11. The image processing apparatus according to claim 8, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the curvature energy calculating unit includes a multiple outer product energy calculating unit that calculates a value of outer product energy based on an outer product of vectors drawn from each of the control points to be processed to another control point apart therefrom by a predetermined distance or larger, and when the value of the outer product energy is smaller than a predetermined threshold value, and repeats process for calculating the value of the outer product energy based on an outer product of vectors drawn from each of the control points to be processed to yet another control point closer thereto than the control point apart therefrom by the predetermined distance or larger, and
the curvature energy calculating unit determines the value of the outer product energy calculated by the multiple outer product energy calculating unit to be the value of the curvature energy.
12. The image processing apparatus according to claim 8, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the curvature energy calculating unit includes a convex energy calculating unit that calculates a value of convex energy based on an inclusion state of vectors between the control points in the closed region, and determines the value of the convex energy to be the value of the curvature energy.
13. The image processing apparatus according to claim 1, wherein
the closed region is specified as a region obtained by connecting a plurality of control points, and the shape of the closed region is updated by moving the control points, and
the update range determining unit includes a control point distance determining unit that calculates a distance between each of the control points and another control point at which at least one of the values of the plurality of types of energy is equal to or higher than a predetermined threshold value, and
the update range determining unit selects a control point to be moved next time among the control points based on the distance to determine the update range.
14. The image processing apparatus according to claim 1, wherein the update range determining unit includes a shape information calculating unit that calculates shape information of the closed region, and
the update range determining unit determines the update range based on the shape information of the closed region.
15. The image processing apparatus according to claim 14, wherein the shape information calculating unit includes an area calculating unit that calculates an area of the closed region.
16. The image processing apparatus according to claim 14, wherein the shape information calculating unit includes a perimeter calculating unit that calculates a perimeter of the closed region.
17. The image processing apparatus according to claim 14, wherein the shape information calculating unit includes a curvature calculating unit that calculates a curvature of the closed region.
18. The image processing apparatus according to claim 1, wherein the update range determining unit includes an edge information detecting unit that extracts a pixel having at least the gradient strength equal to or higher than the predetermined threshold value as an edge, and
the update range determining unit determines the update range based on the edge.
19. The image processing apparatus according to claim 18, wherein the edge information detecting unit detects an end point of the edge and a bending point of the edge, includes an end point and bending point distance calculating unit that calculates a distance from the end point of the edge or the bending point of the edge, and
the update range determining unit determines the update range based on the distance from the end point of the edge or the bending point of the edge.
20. The image processing apparatus according to claim 18, wherein
the update range determining unit includes an edge distance calculating unit that calculates a distance from the edge, and
the update range determining unit determines the update range based on the distance from the edge.
21. The image processing apparatus according to claim 1, further comprising:
a region integrating unit that integrates the closed region extracted by the closed region extracting unit so as to satisfy the conditions.
22. The image processing apparatus according to claim 21, wherein
the region integrating unit includes
an integrating unit that integrates closed regions partially overlapping with each other within the closed region; and
a post-integration energy calculating unit that calculates the values of the plurality of types of energy for the closed region thus integrated, and
the region integrating unit determines whether to permit integration based on the values of the plurality of types of energy calculated by the post-integration energy calculating unit.
23. An image processing method comprising:
calculating a gradient strength of a pixel value of each pixel based on an intraluminal image that is a captured image of an intralumen;
setting an initial shape of a closed region, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with a predetermined curvature or higher toward an inner side of the closed region;
extracting the closed region from the intraluminal image; and
detecting an abnormal portion inside the closed region, wherein
the extracting includes
calculating values of a plurality of types of energy including at least energy determined by an outer shape of the closed region and energy determined by the gradient strength in the closed region;
calculating a weighted sum of the plurality of types of energy;
determining an update range in which the shape of the closed region is updated based on any one of the values of the plurality of types of energy; and
updating the shape of the closed region within the update range based on the weighted sum.
24. A non-transitory computer-readable recording medium with an executable program stored thereon, wherein the program instructs a processor to perform:
calculating a gradient strength of a pixel value of each pixel based on an intraluminal image that is a captured image of an intralumen;
setting an initial shape of a closed region, the closed region satisfying conditions that the pixel of which gradient strength is a predetermined value or more is not included in the closed region and a boundary of the closed region does not bend with a predetermined curvature or higher toward an inner side of the closed region;
extracting the closed region from the intraluminal image; and
detecting an abnormal portion inside the closed region, wherein
the extracting includes
calculating values of a plurality of types of energy including at least energy determined by an outer shape of the closed region and energy determined by the gradient strength in the closed region;
calculating a weighted sum of the plurality of types of energy;
determining an update range in which the shape of the closed region is updated based on any one of the values of the plurality of types of energy; and
updating the shape of the closed region within the update range based on the weighted sum.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A telecommunications system comprising:
a first computer system comprising a processor operable to execute computer program instructions, a memory operable to store computer program instructions executable by the processor, and computer program instructions stored in the memory and executable to perform the steps of:
displaying a graphical user interface comprising information and controls implementing a telecommunications system operator switchboard displaying information relating to Session Initiation Protocol end-user devices of the telecommunications system and the controls controlling operation of a plurality of end-user devices of the telecommunications system,
receiving input with the graphical user interface, the input indicating an operation to be performed by at least Session Initiation Protocol one end-user device of the plurality of Session Initiation Protocol end-user devices,
in response to receiving the input, generating at least one first message in a first non-standard or proprietary simple message format other than Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol based on the received input, the least one first message indicating the operation and at least one Session Initiation Protocol end-user device to perform the operation and representing a message in Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and transmitting the at least one message to a second computer system; and
a second computer system comprising a processor operable to execute computer program instructions, a memory operable to store computer program instructions executable by the processor, and computer program instructions stored in the memory and executable to perform the steps of:
receiving the at least one first message from the first computer system,
translating the at least one first message from the first message format to form at least one second message in a second message format, the second message format being Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and
transmitting the at least one second message over the network to the at least one Session Initiation Protocol end-user device to cause the at least one Session Initiation Protocol end-user device to perform the operation.
2. The telecommunications system of claim 1, wherein:
the second computer system further performs the steps of:
receiving at least one third message in the second message format over the network from at least one Session Initiation Protocol end-user device of the telecommunications system,
translating the at least one third message from the second message format to form at least one fourth message in the first message format, and
transmitting the at least one fourth message to the first computer system; and
the first computer system further performs the steps of:
receiving the at least one fourth message from the second computer system, and
displaying information with the graphical user interface, performing an operation with the telecommunications system, or both, based on the fourth message.
3. An operator switchboard for a telecommunications system comprising a computer system comprising a processor operable to execute computer program instructions, a memory operable to store computer program instructions executable by the processor, and computer program instructions stored in the memory and executable to perform the steps of:
displaying a graphical user interface comprising information and controls implementing a telecommunications system operator switchboard displaying information relating to Session Initiation Protocol end-user devices of the telecommunications system and the controls controlling operation of a plurality of Session Initiation Protocol end-user devices of the telecommunications system,
receiving input with the graphical user interface, the input indicating an operation to be performed by at least one Session Initiation Protocol end-user device of the plurality of Session Initiation Protocol end-user devices,
in response to receiving the input, generating at least one first message in a first non-standard or proprietary simple message format other than Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol based on the received input, the at least one first message indicating the operation and at least one Session Initiation Protocol end-user device to perform the operation and representing a message in Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and transmitting the at least one message to a server for translation from the first message format to form at least one second message in a second message format, the second message format being Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and which, when transmitted by the server to the at least one Session Initiation Protocol end-user device causes the at least one Session Initiation Protocol end-user device to perform the operation to be performed.
4. The operator switchboard of claim 3, wherein:
the computer system further performs the steps of:
receiving from the server at least one third message in the first message format, the third message having been translated from a fourth message in the second message format from at least one Session Initiation Protocol end-user device of the telecommunications system; and
displaying information with the graphical user interface, performing an operation with the telecommunications system, or both, based on the third message.
5. A server for a telecommunications system comprising a computer system comprising a processor operable to execute computer program instructions, a memory operable to store computer program instructions executable by the processor, and computer program instructions stored in the memory and executable to perform the steps of:
receiving at least one first message in a first non-standard or proprietary simple message format other than Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol from an operator switchboard computer system, the at least one first message generated based on input received with a graphical user interface of the operator switchboard computer system displaying information relating to Session Initiation Protocol end-user devices of the telecommunications system and the controls controlling operation of a plurality of Session Initiation Protocol end-user devices of the telecommunications system, the input indicating an operation to be performed by at least one Session Initiation Protocol end-user device of the plurality of Session Initiation Protocol end-user devices, the at least one first message indicating the operation and at least one Session Initiation Protocol end-user device to perform the operation and representing a message in Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol;
translating the at least one first message from the first message format to form at least one second message in a second message format, the second message format being Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and
transmitting the at least one second message to the at least one Session Initiation Protocol end-user device to cause the at least one Session Initiation Protocol end-user device to perform the operation.
6. The server of claim 5, wherein:
the computer system further performs the steps of:
receiving at least one third message in the second message format over the network from at least one Session Initiation Protocol end-user device of the telecommunications system,
translating the at least one third message from the second message format to form at least one fourth message in the first message format, and
transmitting the at least one fourth message to the operator switchboard computer system for displaying information with the graphical user interface,
performing an operation with the telecommunications system, or both, based on the fourth message.
7. A computer program product for an operator switchboard for a telecommunications system comprising a non-transitory computer readable storage medium and computer program instructions, recorded on the non-transitory computer readable medium and executable by a processor, for performing the steps of:
displaying a graphical user interface comprising information and controls implementing a telecommunications system operator switchboard displaying information relating to Session Initiation Protocol end-user devices of the telecommunications system and the controls controlling operation of a plurality of Session Initiation Protocol end-user devices of the telecommunications system,
receiving input with the graphical user interface, the input indicating an operation to be performed by at least one Session Initiation Protocol end-user device of the plurality of Session Initiation Protocol end-user devices,
in response to receiving the input, generating at least one first message in a first non-standard or proprietary simple message format other than Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol based on the received input, the least one first message indicating the operation and at least one Session Initiation Protocol end-user device to perform the operation and representing a message in Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and transmitting the at least one message to a server for translation from the first message format to form at least one second message in a second message format, the second message format being Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and which, when transmitted by the server to the at least one Session Initiation Protocol end-user device causes the at least one Session Initiation Protocol end-user device to perform the operation to be performed.
8. The computer program product of claim 7, further comprising the steps of:
receiving from the server at least one third message in the first message format, the third message having been translated from a fourth message in the second message format from at least one Session Initiation Protocol end-user device of the telecommunications system; and
displaying information with the graphical user interface, performing an operation with the telecommunications system, or both, based on the third message.
9. A computer program product for server for a telecommunications system comprising a non-transitory computer readable storage medium and computer program instructions, recorded on the non-transitory computer readable medium and executable by a processor, for performing the steps of:
receiving at least one first message in a first non-standard or proprietary simple message format other than Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol from an operator switchboard computer system, the at least one first message generated based on input received with a graphical user interface of the operator switchboard computer system displaying information relating to Session Initiation Protocol end-user devices of the telecommunications system and the controls controlling operation of a plurality of Session Initiation Protocol end-user devices of the telecommunications system, the input indicating an operation to be performed by at least one Session Initiation Protocol end-user device of the plurality of Session Initiation Protocol end-user devices and the at least one first message indicating the operation and at least one Session Initiation Protocol end-user device to perform the operation and representing a message in Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol;
translating the at least one first message from the first message format to form at least one second message in a second message format, the second message format being Session Initiation Protocol, Session Description Protocol, or a combination of Session Initiation Protocol and Session Description Protocol, and
transmitting the at least one second message to the at least one Session Initiation Protocol end-user device to cause the at least one Session Initiation Protocol end-user device to perform the operation.
10. The computer program product of claim 9, further comprising the steps of:
receiving at least one third message in the second message format over the network from at least one Session Initiation Protocol end-user device of the telecommunications system,
translating the at least one third message from the second message format to form at least one fourth message in the first message format, and
transmitting the at least one fourth message to the operator switchboard computer system for displaying information with the graphical user interface, performing an operation with the telecommunications system, or both, based on the fourth message.