1. A portable apparatus for monitoring the reaction of a user to a performance, the apparatus comprising:
one or more sensors adapted to detect one or more sensor signals together constituting an indirect user response to the performance;
a user interface adapted for the user to provide a direct user response to the performance;
a processor adapted to provide a user reaction signal comprising a combination of the indirect user response and the direct user response to the performance; and
a transmitter, whereby the processor is adapted to control the transmitter to transmit the user reaction signal to remote apparatus.
2. Apparatus according to claim 1 in which the processor is arranged to combine one or more of the sensor signals and the direct user response to produce a user reaction signal from which the individual input values cannot be extracted.
3. Apparatus according to claim 1 in which the processor is arranged to apply a set of logical rules to the sensor signals and the direct user response in order to provide an overall reaction measurement as the user reaction signal.
4. Apparatus according to claim 3 in which the logical rules define which of the separate sensor signals and the direct user response take preference over others of the separate sensor signals and the direct user response.
5. Apparatus according to claim 1 wherein the user interface includes a display adapted to display under the control of the processor prompts to the user to input information using the user interface.
6. Apparatus according to claim 1 in which each of the one or more sensors is arranged to sense a parameter of the user’s state of well being or physical behaviour indicative of the user’s response to the performance.
7. Apparatus according to claim 6 in which at least one of the sensors is a biometric sensor.
8. Apparatus according to claim 6 in which at least one of the sensors is a microphone.
9. Apparatus according to claim 6 in which at least one of the sensors is an inclinometer.
10. Apparatus according to claim 1 in which the user reaction signal output by the transmitter uniquely identifies the portable apparatus.
11. Apparatus according to claim 1 in which the transmitter is a radio-frequency transmitter adapted to transmit an encoded radio-frequency signal.
12. Apparatus according to claim 1, wherein the apparatus further comprises a receiver.
13. Apparatus according to claim 12, in which the apparatus is adapted only to transmit the user reaction signal in response to a request received through the receiver.
14. A system for monitoring the response of users to a performance, comprising:
two or more portable apparatuses for monitoring the reaction of a user to a performance, each such apparatus comprising one or more input devices each for obtaining a direct or indirect user response to the performance, a processor adapted to provide a user reaction signal from the user responses, and a transmitter, whereby the processor is adapted to control the transmitter to transmit the user reaction signal to a central monitoring apparatus; and
a central monitoring apparatus having a receiver and a processor adapted to receive user reaction signals from the receiver and to combine them into an audience reaction signal.
15. A performance generating system, comprising:
two or more portable apparatuses for monitoring the reaction of a user to a performance, each such apparatus comprising one or more input devices each for obtaining a direct or indirect user response to the performance, a processor adapted to provide a user reaction signal from the direct or indirect user responses, and a transmitter, whereby the processor is adapted to control the transmitter to transmit the user reaction signal to a central performance generator; and
a central monitoring apparatus having a receiver, a memory containing a plurality of performance elements, and a processor adapted to receive user reaction signals from the receiver and to generate a performance comprising at least one performance element selected from the memory in response to the user reaction signals.
16. A performance generating system as claimed in claim 15 wherein the performance comprises a musical performance,. and wherein the performance elements comprise song elements.
17. A music playing system comprising:
a plurality of inputs adapted to receive input signals containing information indicating the reaction of a user to a song:
memory for storing a plurality of sone elements; and
a selector adapted to select at least one song element or combination of song elements from the memory to be played, in which the selector is adapted to select the song element from memory in response to the input signals.
18. A data carrier having encoded therein a computer program comprising a set of instructions adapted to program the processor of a handheld computing device to monitor the reaction of a user to a performance, the programmed processor being adapted to provide:
a user interface adapted for the user to provide a direct user response to the performance;
a user reaction signal derived from the direct user response to the performance; and
a transmission of the user reaction signal through a communications interface of the handheld computing device to specified remote apparatus.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to introduce one or more image attributes into an optical image;
a detector that converts the optical image to electronic data while maintaining the image attributes; and
a digital signal processor for
subdividing the electronic data into one or more data sets,
classifying the one or more data sets based at least on the image attributes, and
independently processing the one or more data sets, based on results of the classifying, to form processed electronic data.
2. The imaging system of claim 1, wherein the imaging system has extended depth of field as compared to the system without the one or more phase modifying elements.
3. The imaging system of claim 1, wherein the digital signal processor is configured for classifying the one or more data sets based on (a) characteristics of the electronic data related to spatial regions of the optical image, and (b) the one or more image attributes.
4. The imaging system of claim 3, wherein the digital signal processor is further configured for classifying the one or more data sets based on power spectrum estimates for each of a plurality of identification subsets within the electronic data.
5. The imaging system of claim 4, wherein the digital signal processor is further configured for combining identification subsets with similar power spectrum estimates, to form the one or more data sets.
6. The imaging system of claim 4, wherein the digital signal processor is configured for (a) identifying dominant spatial frequencies in one or more of the power spectrum estimates, and (b) independently processing the one or more data sets by generating a filter for each of the data sets, based on the dominant spatial frequencies, to form the processed electronic data.
7. The imaging system of claim 3, wherein the digital signal processor is configured for identifying at least one edge in one of the spatial regions by utilizing one of Sobel, Prewitt, Roberts, Laplacian of Gaussian, zero cross and Canny methods.
8. The imaging system of claim 1, wherein the electronic data comprises one or more color channels.
9. The imaging system of claim 8, wherein the digital signal processor is configured for classifying the one or more data sets based on color information content of the one or more color channels.
10. The imaging system of claim 8, wherein the digital signal processor is further configured for classifying the one or more data sets based on spatial frequency information within the one or more color channels.
11. The imaging system of claim 8, wherein the digital signal processor is further configured for classifying the one or more data sets based on intensity information within the one or more color channels.
12. The imaging system of claim 1, wherein the electronic data comprises one or more intensity channels.
13. The imaging system of claim 12, wherein the digital signal processor is configured for classifying the one or more data sets based on intensity content of the one or more intensity channels.
14. The imaging system of claim 1, wherein the electronic data comprises a plurality of channels, each channel including at least color content and intensity content.
15. The imaging system of claim 14, wherein the digital signal processor is configured for classifying the one or more data sets based on the color content and intensity content of the plurality of channels.
16. The imaging system of claim 1, wherein the phase modifying element implements wavefront coding.
17. The imaging system of claim 1, wherein the one or more image attributes includes a blur that is removable by the digital signal processor.
18. The imaging system of claim 1, wherein the optics are characterized by a PSF having a shape that is substantially invariant with respect to misfocus.
19. The imaging system of claim 1, wherein the optics, the detector and the digital signal processor are located within a common system housing.
20. The imaging system of claim 1, wherein the optics and the detector are at a first location and the digital signal processor is at a second location.
21. The imaging system of claim 1, wherein the digital signal processor is further configured for operating on the electronic data in parallel with the detector converting the optical image to the electronic data.
22. The imaging system of claim 1, wherein the digital signal processor is configured for operating on the electronic data after the detector converts substantially all of the optical image to the electronic data.
23. The imaging system of claim 1, wherein the digital signal processor is further configured for classifying the one or more data sets in accordance with preset instructions.
24. The imaging system of claim 23, wherein the preset instructions are based on preferences of a user of the imaging system.
25. The imaging system of claim 23, wherein the preset instructions are based on the one or more image attributes.
26. The imaging system of claim 1, wherein the digital signal processor is additionally configured for recursively
subdividing the electronic data into one or more data sets,
classifying the one or more data sets, based at least on the image attributes, and
independently processing the one or more data sets, based on results of the classifying, to form the processed electronic data.
27. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to form an optical image;
a detector that converts the optical image to electronic data having one or more image attributes that are dependent on characteristics of at least one of the phase modifying elements and the detector; and
a digital signal processor for
subdividing the electronic data into one or more data sets,
classifying the one or more data sets, based at least in part on the one or more image attributes, and
independently processing each of the one or more data sets, based on results of classifying, to form processed electronic data.
28. The imaging system of claim 27, wherein the one or more image attributes includes a blur induced by the one or more phase modifying elements.
29. The imaging system of claim 27, wherein the one or more image attributes includes one or more of shot noise and fixed pattern noise characterizing the detector.
30. The imaging system of claim 27, wherein the electronic data further includes a plurality of subspaces.
31. The imaging system of claim 30, wherein the plurality of subspaces includes one or more signal subspaces and noise subspaces.
32. The imaging system of claim 27, wherein the digital signal processor alters one or more of the image attributes to a degree that is independently adjustable for each of the data sets, based on the one or more image attributes of the data sets.
33. The imaging system of claim 27, wherein the digital signal processor alters one or more of the image attributes to a degree that is independently adjustable for each of the data sets, based on preset instructions.
34. The imaging system of claim 33, wherein the preset instructions are based on preferences of a user of the imaging system.
35. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to introduce one or more image attributes into an optical image;
a detector that converts the optical image to electronic data while maintaining the image attributes; and
a digital signal processor configured for
subdividing the electronic data into one or more data sets,
classifying the one or more data sets based at least on the image attributes, and
independently processing the one or more data sets, based on results of the classifying, to form processed electronic data,
wherein the digital signal processor is further configured for altering one or more of the image attributes to a degree that is independently adjustable for each of the one or more data sets, based on preset instructions.
36. The imaging system of claim 35, wherein the preset instructions are based on one of preferences of a user of the imaging system and a characteristic of the one or more phase modifying elements.
37. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to predeterministically affect an optical image;
a detector that converts the optical image to electronic data;
a digital signal processor for
subdividing the electronic data into one or more data sets,
classifying the data sets, based at least in part on a priori knowledge about how the phase modifying elements modify the wavefront phase, and
independently processing each of the data sets, based on results of the classifying, to form processed electronic data.
38. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to predeterministically affect an optical image;
a detector that converts the optical image to electronic data;
a digital signal processor for
subdividing the electronic data into one or more data sets,
independently processing each of the data sets, based on a priori knowledge about how the phase modifying elements modify the wavefront phase and on results of the classifying, to form processed electronic data.
39. An imaging system, comprising
optics, including one or more phase modifying elements, that alter wavefront phase and produce an optical image with at least one known image attribute;
a detector that converts the optical image to electronic data that, while preserving the image attribute, is divisible into a plurality of data sets; and
a digital signal processor that processes the data sets to modify the image attribute in a degree and manner that is independently adjustable for each one of the data sets, to generate processed electronic data.
40. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to introduce one or more image attributes into an optical image;
a detector that converts the optical image to electronic data while maintaining the image attributes; and
a digital signal processor for
determining one or more characteristics of the electronic data, and
providing nonlinear processing of the electronic data to modify the image attribute and to form processed electronic data.
41. The imaging system of claim 40, wherein the imaging system has extended depth of field as compared to the system without the one or more phase modifying elements.
42. The imaging system of claim 40, wherein the digital signal processor utilizes a shock-filter routine for the nonlinear processing.
43. The imaging system of claim 40, wherein the digital signal processor implements one or more of a threshold operator, an edge enhancement operator, an inflection emphasis operator, a gradient operator, and a diffusion operator for the nonlinear processing.
44. The imaging system of claim 40, wherein the digital signal processor (a) implements two or more process operators, each process operator being one of a threshold operator, an edge enhancement operator, an inflection emphasis operator, a gradient operator, and a diffusion operator, (b) assigns a weight to each process operator and (c) sums the process operators according to the weight of each process operator.
45. The imaging system of claim 44, wherein the weight assigned to each process operator is optimized for one of spatial noise reduction and color noise reduction.
46. The imaging system of claim 40, wherein the one or more phase modifying elements implement wavefront coding.
47. The imaging system of claim 40, wherein the one or more image attributes includes introducing a blur that is removable by processing of the electronic data.
48. The imaging system of claim 40, wherein the one or more image attributes includes causing a PSF associated with the optics to have a shape that is substantially invariant with respect to misfocus.
49. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to introduce one or more image attributes into an optical image;
a detector that converts the optical image to electronic data while maintaining the image attributes; and
a digital signal processor for
subdividing the electronic data into one or more data sets,
classifying the one or more data sets, based at least on the image attributes, and
independently and nonlinearly processing the one or more data sets to form processed electronic data.
50. A method for generating processed electronic data, comprising
modifying phase of a wavefront from an object to introduce one or more image attributes into an optical image formed by an imaging system,
converting the optical image to electronic data while maintaining the image attributes,
subdividing the electronic data into one or more data sets,
classifying the one or more data sets based at least on the one or more image attributes, and
independently processing the one or more data sets to form processed electronic data.
51. Method of claim 50, wherein modifying phase extends a depth of field of the imaging system.
52. Method of claim 50, wherein classifying the one or more data sets is based on (a) characteristics of the electronic data related to spatial regions of the optical image, and (b) the one or more image attributes.
53. Method of claim 52, wherein classifying the one or more data sets is based on power spectrum estimates for each of a plurality of identification subsets within the electronic data.
54. Method of claim 53, wherein classifying comprises combining
identification subsets with similar power spectrum estimates to form the one or more data sets.
55. Method of claim 53, wherein classifying comprises
identifying dominant spatial frequencies in one or more of the power spectrum estimates,
and independently processing comprises
generating a corresponding filter for each of the data sets, based on the dominant spatial frequencies of each data set and
filtering each of the data sets with its corresponding filter to form the processed electronic data.
56. Method of claim 52, wherein classifying comprises identifying at least one edge in one of the spatial regions by utilizing one of Sobel, Prewitt, Roberts, Laplacian of Gaussian, zero cross and Canny methods.
57. Method of claim 50, wherein converting the optical image to electronic data comprises generating one or more color channels.
58. Method of claim 57, wherein classifying further comprises classifying based on color information content of the one or more color channels.
59. Method of claim 57, wherein classifying further comprises classifying the one or more data sets based on spatial frequency information within the one or more color channels.
60. Method of claim 57, wherein classifying further comprises classifying the one or more data sets based on intensity information within the one or more color channels.
61. Method of claim 50, wherein modifying phase comprises utilizing wavefront coding.
62. Method of claim 50, wherein modifying phase comprises introducing a blur that is removable by digital signal processing as one of the one or more image attributes.
63. Method of claim 50, wherein modifying phase comprises causing a PSF of the imaging system to have a shape that is substantially invariant with respect to misfocus.
64. Method of claim 50, wherein the subdividing, classifying and independently processing occur in parallel with the modifying and converting.
65. Method of claim 50, wherein the modifying and converting occur at one time and the subdividing, classifying and independently processing occur at a later time.
66. Method of claim 50, wherein classifying is performed in accordance with preset instructions.
67. Method of claim 66, further comprising generating the preset instructions according to preferences of a user of the imaging system.
68. Method of claim 50, wherein the steps of subdividing, classifying and independently processing are performed recursively.
69. A software product comprising instructions stored on computer-readable media, wherein the instructions, when executed by a computer, perform steps for processing electronic data generated by (a) modifying phase of a wavefront from an object to introduce one or more image attributes into an optical image formed by an imaging system and (b) converting the optical image to electronic data while maintaining the image attributes, the instructions comprising:
instructions for subdividing the electronic data into one or more data sets;
instructions for classifying the one or more data sets based at least on the one or more image attributes; and
instructions for independently processing the one or more data sets to form the processed electronic data.
70. Software product of claim 69, wherein the instructions for classifying include instructions for evaluating one of (a) characteristics of the electronic data related to spatial regions of the optical image and (b) the one or more image attributes.
71. Software product of claim 69, wherein the instructions for classifying include instructions for generating a power spectrum estimate for each of a plurality of identification subsets within the electronic data.
72. Software product of claim 71, wherein the instructions for classifying include instructions for combining identification subsets with similar power spectrum estimates to form the one or more data sets.
73. Software product of claim 71, wherein
the instructions for classifying include instructions for identifying dominant spatial frequencies in one or more of the power spectrum estimates, and
the instructions for independently processing include instructions for generating a corresponding filter for each of the data sets, based on the dominant spatial frequencies of each data set and instructions for filtering each of the data sets with its corresponding filter to form the processed electronic data.
74. Software product of claim 69, wherein the instructions for classifying include instructions for identifying at least one edge in one of the spatial regions by utilizing one of Sobel, Prewitt, Roberts, Laplacian of Gaussian, zero cross and Canny methods.
75. Software product of claim 69, wherein the instructions for classifying include instructions for utilizing one of (a) color information content, (b) spatial frequency information and (c) intensity information of one or more color channels of the electronic data.
76. Software product of claim 69, wherein the instructions for subdividing, classifying and independently processing, respectively, include instructions for subdividing, classifying and independently processing in accordance with user preferences.
77. Software product of claim 69, further comprising
instructions for recursively subdividing the electronic data into one or more data sets, classifying the one or more data sets based at least on the one or more image attributes; and processing the one or more data sets to form processed electronic data.
78. An imaging system, comprising
optics having one or more phase modifying elements that modify wavefront phase to introduce one or more image attributes into an optical image;
a detector that converts the optical image to electronic data while maintaining the image attributes; and
a digital signal processor for
subdividing the electronic data into one or more data sets,
independently processing the one or more data sets in one or more subspaces to form processed electronic data.
79. The imaging system of claim 78, wherein the digital signal processor is further configured for classifying the one or more data sets, and wherein the independently processing comprises independently processing the one or more subspaces based on results of the classifying.
80. A method for generating processed electronic data, comprising
modifying phase of a wavefront from an object to introduce one or more image attributes into an optical image formed by an imaging system;
converting the optical image to electronic data while maintaining the image attributes;
subdividing the electronic data into one or more data sets; and
independently processing the one or more data sets in one or more subspaces to form processed electronic data.