1. A method performed by data processing apparatus, comprising:
accessing a document that comprises a hint segment, a media metadata track, and a hint metadata track,
wherein the hint segment comprises first and second message headers that correspond to respective first and second media data samples, wherein the first media data sample is associated with audio data and is interleaved with the second media data sample associated with video data, wherein the message headers are arranged within the hint segment in a transmission order sequence, wherein separate ones of the media data samples are arranged as message payload data for corresponding ones of the message headers, wherein each of the message headers comprise a message stream identifier, a message type identifier, a timestamp, and a message length value,
wherein the hint metadata track includes pointers to respective ones of the message headers,
wherein the media metadata track includes pointers to respective associated ones of the media data samples; and
generating a data stream to stream media content of the document, the data stream comprising messages arranged in the transmission order sequence, wherein each of the messages are based on a different one of the message headers and a corresponding different one of the media data samples.
2. The method of claim 1, wherein the media metadata track is a first media metadata track, wherein the document includes a second media metadata track, wherein the first media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more first samples of the media data samples within the hint segment, and wherein the second media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more second samples of the media data samples within the hint segment, wherein the one or more second samples are different from the one or more first samples.
3. The method of claim 1, further comprising: transmitting the data stream to a remote device.
4. The method of claim 3, wherein transmitting the data stream to the remote device comprises transmitting the data stream in accordance with a Real-Time Messaging Protocol (RTMP), wherein each message header is arranged according to a RTMP message header format.
5. The method of claim 3, wherein transmitting the data stream to the remote device comprises multiplexing first messages that include audio data with second messages that include video data on the data stream.
6. The method of claim 1, further comprising: operating a server to deliver multiple streams to remote devices based on the hint segment.
7. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:
accessing a document that comprises a hint segment, a media metadata track, and a hint metadata track,
wherein the hint segment comprises first and second message headers that correspond to respective first and second media data samples, wherein the first media data sample is associated with audio data and is interleaved with the second media data sample associated with video data wherein the message headers are arranged within the hint segment in a transmission order sequence, wherein separate ones of the media data samples are arranged as message payload data for corresponding ones of the message headers, wherein each of the message headers comprise a message stream identifier, a message type identifier, a timestamp, and a message length value,
wherein the hint metadata track includes pointers to respective ones of the message headers,
wherein the media metadata track includes pointers to respective associated ones of the media data samples; and
generating a data stream to stream media content of the document, the data stream comprising messages arranged in the transmission order sequence, wherein each of the messages are based on a different one of the message headers and a corresponding different one of the media data samples.
8. The computer storage medium of claim 7, wherein the media metadata track is a first media metadata track, wherein the document includes a second media metadata track, wherein the first media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more first samples of the media data samples within the hint segment, and wherein the second media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more second samples of the media data samples within the hint segment, wherein the one or more second samples are different from the one or more first samples.
9. The computer storage medium of claim 7, the operations further comprising: transmitting the data stream to a remote device.
10. The computer storage medium of claim 9, wherein transmitting the data stream to the remote device comprises transmitting the data stream in accordance with a Real-Time Messaging Protocol (RTMP), wherein each message header is arranged according to a RTMP message header format.
11. The computer storage medium of claim 9, wherein transmitting the data stream to the remote device comprises multiplexing first messages that include audio data with second messages that include video data on the data stream.
12. A system comprising:
a computer storage device configured to store information comprising a document that contains a hint segment, a media metadata track, and a hint metadata track,
wherein the hint segment comprises first and second message headers that correspond to respective first and second media data samples, wherein the first media data sample is associated with audio data and is interleaved with the second media data sample associated with video data wherein the message headers are arranged within the hint segment in a transmission order sequence, wherein separate ones of the media data samples are arranged as message payload data for corresponding ones of the message headers, wherein each of the message headers comprise a message stream identifier, a message type identifier, a timestamp, and a message length value,
wherein the hint metadata track includes pointers to respective ones of the message headers,
wherein the media metadata track includes pointers to respective associated ones of the media data samples; and
a data processing apparatus configured to perform operations comprising (i) accessing the document, and (ii) generating a data stream to stream media content of the document, the data stream comprising messages arranged in the transmission order sequence, wherein each of the messages are based on a different one of the message headers and a corresponding different one of the media data samples.
13. The system of claim 12, wherein the media metadata track is a first media metadata track, wherein the document includes a second media metadata track, wherein the first media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more first samples of the media data samples within the hint segment, and wherein the second media metadata track includes, in lieu of samples, one or more pointers to corresponding one or more second samples of the media data samples within the hint segment, wherein the one or more second samples are different from the one or more first samples.
14. The system of claim 12, the operations further comprising: transmitting the data stream to a remote device.
15. The system of claim 14, wherein transmitting the data stream to the remote device comprises transmitting the data stream in accordance with a Real-Time Messaging Protocol (RTMP), wherein each message header is arranged according to a RTMP message header format.
16. The system of claim 14, wherein transmitting the data stream to the remote device comprises multiplexing first messages that include audio data with second messages that include video data on the data stream.
17. The system of claim 12, wherein the data processing apparatus includes the computer storage device.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A tactile communication apparatus comprising:
a signal receiver configured to receive a wireless signal containing data;
a tactile communication device having a plurality of electro tactile pads spaced apart from one another on one side thereof, each electro tactile pad configured to be driven by a corresponding activation control signal such that selective activation of subsets of the plurality of electro tactile pads as driven by corresponding activation control signals convey a plurality of electro tactile sensation combinations to a user; and
a communication processor having circuitry configured to generate the activation control signals based on the received data so as to convey the data tactilly to a user through the plurality of electro tactile sensation combinations when the one side of the tactile communication device is contacting the user.
2. The tactile communication apparatus of claim 1, wherein
the data includes digital music, and
the communication processor is configured to generate the activation control signals to create the plurality of electro tactile sensation combinations with stimulation amounts corresponding to predetermined frequency bands of the digital music, wherein a lower frequency band causes activation of at least one of the plurality of electro tactile pads on one end of the tactile communication device and a higher frequency band causes activation of at least one other of the plurality of electro tactile pads at the other end of the tactile communications device.
3. The tactile communication apparatus of claim 1, wherein
the data includes a video game event, and
the communication processor is configured to generate the activation control signals to create the plurality of electro tactile sensation combinations with stimulation amounts and distributions corresponding to video game events in a video game.
4. The tactile communication apparatus of claim 3, wherein
the stimulation amounts and distributions are predefined to represent alerts or events in an application.
5. The tactile communication apparatus of claim 4, wherein
the data is from another tactile communication apparatus and is created by capturing a touch of another person on the another tactile communication apparatus, such that a corresponding sensation is felt by the user via the plurality of electro tactile sensation combinations.
6. The tactile communication apparatus of claim 5, wherein
the one side of the tactile communication device containing the plurality of electro tactile pads is ergonomically shaped to match an opposing surface of a forearm of the user such that the plurality of electro tactile pads contact the forearm of the user.
7. The tactile communication apparatus of claim 6, further comprising:
a plurality of buttons and sensors disposed on an opposite side to the one side on which the plurality of electro tactile pads are disposed, the plurality of buttons and sensors being configured to be actuated by the user as a user interface to control the tactile communication apparatus.
8. The tactile communication apparatus of claim 7, further comprising:
a booster circuit configured to boost a battery voltage level that powers the tactile communication apparatus; and
a feedback loop configured to monitor and maintain a substantially fixed current level to the activation control signals by adjusting the boosted voltage level of the booster circuit.
9. The tactile communication apparatus of claim 8, further comprising:
a GPS unit that generates navigation data or a downloadable navigation application that when executed by circuitry generates navigation data, wherein
the communication processor is configured to generate the plurality of activation control signals to create the plurality of electro tactile sensation combinations with stimulation amounts and distributions corresponding to position andor navigation direction information.
10. A tactile communication method, the method comprising:
receiving input data via a wireless signal;
receiving a destination data from a user;
generating navigational data based on GPS positional information and the destination data;
generating with circuitry a plurality of activation control signals based on the navigational data, the activation control signals controllably activating a plurality of electro tactile pads spaced apart from one another on a tactile communication device worn by a user, each electro tactile pad configured to be driven by a corresponding activation control signal such that selective activation of subsets of the plurality of electro tactile pads as driven by corresponding activation control signals convey a plurality of electro tactile sensation combinations to the user, wherein the plurality of activation control signals create the plurality of electro tactile sensation combinations according to a pattern of music frequencies, video game events, social networking touch activations, or directional indications.
11. A non-transitory computer-readable storage medium with computer readable instructions stored therein that when executed by a computer, cause the computer to execute a method comprising:
receiving input data via a wireless signal;
receiving a destination data from a user;
generating navigational data based on GPS positional information and the destination data;
generating with circuitry a plurality of activation control signals based on the navigational data, the activation control signals controllably activating a plurality of electro tactile pads spaced apart from one another on a tactile communication device worn by a user, each electro tactile pad configured to be driven by a corresponding activation control signal such that selective activation of subsets of the plurality of electro tactile pads as driven by corresponding activation control signals convey a plurality of electro tactile sensation combinations to the user, wherein the plurality of activation control signals create the plurality of electro tactile sensation combinations according to a pattern of music frequencies, video game events, social networking touch activations, or directional indications.