1. A video summarization apparatus comprising:
a first memory to store video data including video and audio;
a second memory to store a plurality of metadata items corresponding to a plurality of video segments included in the video data respectively, each of the metadata items including a keyword and characteristic information of content of corresponding video segment;
a selecting unit configured to select metadata items each including a specified keyword from the metadata items, to obtain selected metadata items;
a first extraction unit configured to extract, from the video data, video segments corresponding to the selected metadata items, to obtain extracted video segments;
a generation unit configured to generate summarized video data by connecting extracted video segments in time series;
a detection unit configured to detect a plurality of audio breakpoints included in the video data, to obtain a plurality of audio segments segmented by the audio breakpoints;
a second extraction unit configured to extract, from the video data, audio segments corresponding to the extracted video segments as audio narrations, to obtain extracted audio segments; and
a modifying unit configured to modify an ending time of a video segment in the summarized video data so that the ending time of the video segment in the summarized video data coincides with or is later than an ending time of corresponding audio segment of the extracted audio segments.
2. The apparatus according to claim 1, wherein the each of the metadata items includes an occurrence time of an event occurred in corresponding video segment.
3. The apparatus according to claim 1, further comprising:
a narrative generation unit configured to generate a narrative of the summarized video data based on the selected metadata items; and
a speech generation unit configured to generate a synthesized speech corresponding to the narrative.
4. The apparatus according to claim 1, wherein the detection unit detects the audio breakpoints each of which is an arbitrary time point in a silent segment where magnitude of audio of the video data is smaller than a predetermined value.
5. The apparatus according to claim 1, wherein the detection unit detects the audio breakpoints based on change of speakers in audio of the video data.
6. The apparatus according to claim 1, wherein the detection unit detects the audio breakpoints based on a pause in an audio sentence or phrase of the video data.
7. The apparatus according to claim 2, wherein the second extraction unit extracts the audio segments each including the occurrence time included in each of the selected metadata items.
8. The apparatus according to claim 3, wherein the second extraction unit extracts the audio segments each including content except for the narrative by speech-recognizing each of the audio segments in the neighborhood of the each of the extracted video segments in the summarized video data.
9. The apparatus according to claim 3, wherein the second extraction unit extracts the audio segments each including content except for the narrative by using closed caption information in each audio segment in the neighborhood of the each of the extracted video segments in the summarized video data.
10. The apparatus according to claim 1, wherein the modifying unit modifies a beginning time and the ending time of the video segment in the summarized video data so that the beginning time and the ending time of the video segment coincide with or includes a beginning time and the ending time of the corresponding audio segment of the extracted audio segment.
11. The apparatus according to claim 1, further comprising a sound volume control unit configured to set sound volume of each audio narration within corresponding video segment in the summarized video data including the video segment modified by the modifying unit larger than sound volume of audio except for the each audio narration within the corresponding video segment.
12. The apparatus according to claim 1, further comprising an audio segment control unit configured to shift temporal position for reproducing an audio segment of the extracted audio segments so that the temporal position lie within corresponding video segment in the summarized video data, when an ending time or a starting time of the audio segment of the extracted audio segments is later than an ending time of the corresponding video segment or earlier than a starting time of the corresponding video segment and length of the audio segment of the extracted audio segments is equal to or shorter than length of the corresponding video segment, and
wherein the modifying unit modifies the ending time of the video segment in the summarized video data, when the ending time of the corresponding audio segment of the extracted audio segments is later than the ending time of the video segment and length of the corresponding audio segment of the extracted audio segments is longer than length of the video segment.
13. The apparatus according to claim 12, further comprising a sound volume control unit configured to set sound volume of each audio narration within corresponding video segment in the summarized video data including the video segment modified by the modifying unit and the audio segment of the extracted audio segments whose temporal position is shifted by the audio segment control unit larger than sound volume of audio except for the each audio narration within the corresponding video segment.
14. A video summarization method including:
storing video data including video and audio in a first memory;
storing, in a second memory, a plurality of metadata items corresponding to a plurality of video segments included in the video data respectively, each of the metadata items including a keyword and characteristic information of content of corresponding video segment;
selecting metadata items each including a specified keyword from the metadata items, to obtain selected metadata items;
extracting, from the video data, video segments corresponding to the selected metadata items, to obtain selected video segments;
generating summarized video data by connecting the extracted video segments in time series;
detecting a plurality of audio breakpoints included in the video data, to obtain a plurality of audio segments segmented by the audio breakpoints;
extracting, from the video data, audio segments corresponding to the extracted video segments as audio narrations; and
modifying an ending time of a video segment in the summarized video data so that the ending time of the video segment in the summarized video data coincides with or is later than an ending time of corresponding audio segment of the extracted audio segments.
15. The method according to claim 14, further including:
setting sound volume of each audio narration within corresponding video segment in the summarized video data including the video segment modified larger than sound volume of audio except for the each audio narration within the corresponding video segment.
16. The method according to claim 14, further including:
shifting temporal position for reproducing an audio segment of the extracted audio segments so that the temporal position lie within corresponding video segment in the summarized video data, when an ending time or a starting time of the audio segment of the extracted audio segments is later than an ending time of the corresponding video segment or earlier than a starting time of the corresponding video segment and length of the audio segment of the extracted audio segments is equal to or shorter than length of the corresponding video segment, and
wherein modifying modifies the ending time of the video segment in the summarized video data, when the ending time of the corresponding audio segment of the extracted audio segments is later than the ending time of the video segment and length of the corresponding audio segment extracted is longer than length of the video segment.
17. The method according to claim 16, further including:
setting sound volume of the audio narration within corresponding video segment in the summarized video data including the video segment modified and the audio segment of the extracted audio segments whose temporal position is shifted larger than sound volume of audio except for the each audio narration within the corresponding video segment.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A method comprising:
growing a first III-nitride semiconductor layer;
growing a second semiconductor layer;
growing a third semiconductor layer; and
growing a semiconductor structure comprising a III-nitride light emitting layer disposed between an n-type region and a p-type region; wherein
the second semiconductor layer is disposed between the first semiconductor layer and the third semiconductor layer;
the third semiconductor layer is disposed between the second semiconductor layer and the light emitting layer, and the third semiconductor layer is a continuous layer of uniform composition that is as wide as the second semiconductor layer;
a difference between an in-plane lattice constant of the first semiconductor layer and a bulk lattice constant of the third semiconductor layer is no more than 1%;
a difference between an in-plane lattice constant of the first semiconductor layer and a bulk lattice constant of the second semiconductor layer is at least 1%; and
the second semiconductor layer and the third semiconductor layer are at least partially relaxed.
2. The method of claim 1 wherein the second semiconductor layer has a different in-plane lattice constant than the first semiconductor layer.
3. The method of claim 1 wherein the third semiconductor layer has a different in-plane lattice constant than the second semiconductor layer.
4. The method of claim 1 further comprising after growing the semiconductor structure, removing the growth substrate.
5. The method of claim 1 wherein the third semiconductor layer relaxes over a thickness of not more than 500 nm.
6. The method claim 1 wherein the third semiconductor layer has an in-plane lattice constant greater than 3.2 \u212b.
7. The method of claim 1 wherein the second semiconductor layer comprises aluminum.
8. The method of claim 1 wherein the second semiconductor layer comprises aluminum and the third semiconductor layer comprises indium.
9. The method of claim 1 wherein the second semiconductor layer is AlxGayN, wherein x>0.3.
10. The method of claim 1 wherein the second semiconductor layer is AlN and the third semiconductor layer is InGaN.
11. The method of claim 1 wherein the second semiconductor layer is AlGaN and the third semiconductor layer is InGaN.
12. The method of claim 1 wherein the third semiconductor layer is part of the n-type region.
13. The method claim 1 wherein the second semiconductor layer has a bulk lattice constant of 3.165 \u212b or less.
14. The method of claim 1 wherein the second semiconductor layer is in direct contact with the third semiconductor layer.