1. A method used by a test harness during a stress test of a system under test, including:
bounding a set of test commands with a transitory iterator command and a transitory iteration-verifier command, wherein the commands are passed to a test harness that is coupled to a system under test and the test commands are expressed in a declarative command language;
wherein the transitory iterator command and the transitory iteration-verifier command are active when they are executed and are inactive when the bounded test commands are active;
performing a sequence of network traffic stress tests in which test commands cause the test harness to send test traffic messages to the system under test via one or more network ports and measure performance of the system under test;
wherein the transitory iterator and iteration-verifier commands combine to implement a stability backoff test of stress levels;
beginning in an expected failure range that is above an approximately measured passfail threshold;
the transitory iterator command backing off an applied stress applied by the bounded test commands;
repeating the applied stress a predetermined number of times, which is more than once for the applied stress level;
the iteration-verifier command, evaluating a passfail result for the iteration of the applied stress level, and accumulating a passfail rate for results of iterations at the applied stress level; and
evaluating the accumulated passfail rate, after the predetermined number of times iterating at the applied stress level, against a predetermined pass rate, and scoring the applied stress level as passed or failed;
the transitory iterator command terminating the test when the predetermined pass rate has been achieved at a predetermined number of applied stress levels as the transitory iterator progressively backs off the applied stress level; and
one or more result commands outside the bounded test commands reporting test results.
2. The method of claim 1, wherein expressing test commands in a declarative command language, includes an end user modifying exposed data to control test process behavior.
3. The method of claim 1, wherein transitory commands are active during execution on the test harness.
4. The method of claim 1, wherein transitory commands are inactive when not being executed on the test harness.
5. The method of claim 1, wherein measuring performance of the system under test includes measuring frame dropping by a pass-through SUT.
6. The method of claim 1, wherein measuring performance of the system under test includes measuring command response by a SUT that responds to configuration commands during the test.
7. The method of claim 1, wherein implementing a stability backoff test of stress levels includes testing through-put capacity.
8. The method of claim 1, wherein implementing a stability backoff test of stress levels includes testing command processing capacity while under load.
9. The method of claim 1, wherein beginning in an expected failure range that is above an approximately measured passfail threshold includes chaining ramp-up test determining the approximately measured passfail threshold.
10. The method of claim 1, wherein beginning in an expected failure range that is above an approximately measured passfail threshold includes binary search test determining the approximately measured passfail threshold.
11. The method of claim 1, wherein beginning in an expected failure range that is above an approximately measured passfail threshold includes backoff resolution has a resolution at least ten times as precise as the approximately measured passfail threshold.
12. The method of claim 1, wherein the transitory iterator command backing off an applied stress applied by the bounded test commands includes parameter chaining.
13. The method of claim 1, including the iteration-verifier command causing a query against databases collecting results of each iteration at the applied stress level.
14. The method of claim 1, wherein the iteration-verifier command evaluates a passfail result for the iteration of the applied stress level from a response to the query.
15. The method of claim 1, wherein the transitory iterator progressively backs off the applied stress level using a specified backoff increment.
16. A test system for conducting stress testing of a system under test, including:
A test harness coupleable to the system under test; and
A test sequence processor that:
bounds a set of test commands with a transitory iterator command and a transitory iteration-verifier command, wherein the commands are passed to a test harness that is coupled to a system under test and the test commands are expressed in a declarative command language;
wherein the transitory iterator command and the transitory iteration-verifier command are active when they are executed and are inactive when the bounded test commands are active;
performs a sequence of network traffic stress tests in which test commands cause the test harness to send test traffic messages to the system under test via one or more network ports and measure performance of the system under test;
wherein the transitory iterator and iteration-verifier commands combine to implement a stability backoff test of stress levels;
begins in an expected failure range that is above an approximately measured passfail threshold;
the transitory iterator command backing off an applied stress applied by the bounded test commands;
repeats the applied stress a predetermined number of times, which is more than once for the applied stress level;
the iteration-verifier command, evaluating a passfail result for the iteration of the applied stress level, and accumulating a passfail rate for results of iterations at the applied stress level; and
evaluates the accumulated passfail rate, after the predetermined number of times iterating at the applied stress level, against a predetermined pass rate, and scoring the applied stress level as passed or failed;
the transitory iterator command terminating the test when the predetermined pass rate has been achieved at a predetermined number of applied stress levels as the transitory iterator progressively backs off the applied stress level; and
one or more result commands outside the bounded test commands reporting test results.
17. A tangible non-volatile computer readable medium that stores computer instructions that, when run on hardware, implement a stress test of a system under test, the implementation including:
bounding a set of test commands with a transitory iterator command and a transitory iteration-verifier command, wherein the commands are passed to a test harness that is coupled to a system under test and the test commands are expressed in a declarative command language;
wherein the transitory iterator command and the transitory iteration-verifier command are active when they are executed and are inactive when the bounded test commands are active;
performing a sequence of network traffic stress tests in which test commands cause the test harness to send test traffic messages to the system under test via one or more network ports and measure performance of the system under test;
wherein the transitory iterator and iteration-verifier commands combine to implement a stability backoff test of stress levels;
beginning in an expected failure range that is above an approximately measured passfail threshold;
the transitory iterator command backing off an applied stress applied by the bounded test commands;
repeating the applied stress a predetermined number of times, which is more than once for the applied stress level;
the iteration-verifier command, evaluating a passfail result for the iteration of the applied stress level, and accumulating a passfail rate for results of iterations at the applied stress level; and
evaluating the accumulated passfail rate, after the predetermined number of times iterating at the applied stress level, against a predetermined pass rate, and scoring the applied stress level as passed or failed;
the transitory iterator command terminating the test when the predetermined pass rate has been achieved at a predetermined number of applied stress levels as the transitory iterator progressively backs off the applied stress level; and
one or more result commands outside the bounded test commands reporting test results.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
What is claimed is:
1. A method for notifying a voice message reception to a terminal capable of receiving an E-main when a message is received in a voice mail system, the method comprising the steps of:
storing a voice message received at the voice mail system;
transmitting the voice message and information related to the voice message to a mail server according to a previously registered E-mail address; and
transmitting the voice message and the information related to the voice message to the terminal capable of receiving an E-mail according to the E-mail address registered in the mail server;
wherein the information related to the voice message is included in a message part of the E-mail and the voice message is attached to the E-mail in the form of a file, when transmitting the voice message and the information related to the voice message to the mail server.
2. The method as claimed in claim 1, further comprising the step of reproducing the received voice message in the terminal capable of receiving an E-mail by executing the file attached to the E-mail, when the terminal capable of receiving an E-mail receives the voice message and the information related to the voice message.
3. A method for notifying a voice message reception to a terminal capable of receiving an E-main when a message is received in a voice mail system, the method comprising the steps of:
registering an E-mail address in the voice mail system using a telephone;
storing a voice message received at the voice mail system;
determining whether an E-mail notification function is set;
transmitting the voice message and information related to the voice message to an Email server according to a registered E-mail address, when the E-mail notification function is set; and
transmitting the voice message and the information related to the voice message to the terminal capable of receiving an E-mail according to the registered E-mail address;
wherein the information related to the voice message is included in a message part of the E-mail and the voice message is attached to the E-mail in the form of a file, when transmitting the voice message and the information related to the voice message to the mail server.
4. The method as claimed in claim 3, further comprising the step of reproducing the received voice message in the terminal capable of receiving an E-mail by executing the file attached to the E-mail, when the terminal capable of receiving an E-mail receives the voice message and the information related to the voice message.
5. The method as claimed in claim 4, further comprising the steps of:
after storing the received voice message, determining whether an SMS (Short Message Service) function is set; and
notifying the terminal of message reception when the SMS function is set.
6. The method as claimed in claim 1, wherein the information related to the voice message includes date and time when the voice message is received, a phone number of a person who has left the voice message, and the total number of the voice messages stored in the voice mail system.
7. The method as claimed in claim 2, wherein the information related to the voice message includes date and time when the voice message is received, a phone number of a person who has left the voice message, and the total number of the voice messages stored in the voice mail system.
8. The method as claimed in claim 1, wherein the terminal capable of receiving an E-mail is a personal computer.
9. The method as claimed in claim 2, wherein the terminal capable of receiving an E-mail is a personal computer.
10. The method as claimed in claim 3, wherein the terminal capable of receiving an E-mail is a personal computer.
11. The method as claimed in claim 1, wherein the terminal capable of receiving an E-mail is a Personal Digital Assistant (PDA).
12. The method as claimed in claim 2, wherein the terminal capable of receiving an E-mail is a Personal Digital Assistant (PDA).
13. The method as claimed in claim 3, wherein the terminal capable of receiving an E-mail is a Personal Digital Assistant (PDA).
14. The method as claimed in claim 1, wherein the terminal capable of receiving an E-mail is a mobile phone which can support a radio data communication service.
15. The method as claimed in claim 2, wherein the terminal capable of receiving an E-mail is a mobile phone which can support a radio data communication service.
16. The method as claimed in claim 3, wherein the terminal capable of receiving an E-mail is a mobile phone which can support a radio data communication service.
17. The method as claimed in claim 3, wherein the E-mail address is registered in the voice mail system by recognizing a voice of the user.
18. The method as claimed in claim 3, wherein the information related to the voice message includes date and time when the voice message is received, a phone number of a person who has left the voice message, and the total number of the voice messages stored in the voice mail system.
19. The method as claimed in claim 4, wherein the information related to the voice message includes date and time when the voice message is received, a phone number of a person who has left the voice message, and the total number of the voice messages stored in the voice mail system.