1. A method of scheduling documents for crawling, performed on a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors, the method comprising:
receiving from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
accessing the sitemap at the sitemap URL; and
retrieving from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata comprises, for at least a plurality of respective documents associated with the website, document update rate information indicating update frequencies associated with the respective documents;
scheduling for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling includes scheduling a respective document for downloading when one of a date or date and time at which the respective document was last downloaded differs from a current date or a current date and time by an amount that is greater than a duration corresponding to the document update rate information for the respective document; and
downloading at least a subset of the documents scheduled for downloading.
2. The method of claim 1, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
3. The method of claim 2, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
4. The method of claim 1, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
5. The method of claim 1, wherein scheduling documents for downloading comprises generating a list of document identifiers that identify the scheduled documents.
6. A method of scheduling documents for crawling, performed on a computer system having one or more processors and memory storing one or more programs for execution by the one or more processors, the method comprising:
receiving from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
accessing the sitemap at the sitemap URL; and
retrieving from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata retrieved from the sitemap includes, for at least a plurality of respective documents associated with the website, document importance information indicating relative importance values associated with the respective documents;
scheduling for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling is performed in accordance with a score assigned to each document deemed eligible for downloading, and wherein the score assigned to a respective document is adjusted by a boost factor corresponding to the relative importance value indicated by the document importance information for the respective document; and
downloading at least a subset of the documents scheduled for downloading.
7. The method of claim 6, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
8. The method of claim 7, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
9. The method of claim 6, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
10. The method of claim 6, wherein scheduling documents for downloading comprises generating a list of document identifiers that identify the scheduled documents.
11. A system for scheduling documents for crawling, comprising:
one or more processors; and
memory storing one or more modules;
the one or more modules including instructions to:
receive from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
access the sitemap at the sitemap URL; and
retrieve from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata comprises, for at least a plurality of respective documents associated with the website, document update rate information indicating update frequencies associated with the respective documents;
schedule for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling includes scheduling a respective document for downloading when one of a date or date and time at which the respective document was last downloaded differs from a current date or a current date and time by an amount that is greater than a duration corresponding to the document update rate information for the respective document; and
download at least a subset of the documents scheduled for downloading.
12. The system of claim 11, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
13. The system of claim 12, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
14. The system of claim 11, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
15. The system of claim 11, wherein the instructions for scheduling documents for downloading comprise instructions for generating a list of document identifiers that identify the scheduled documents.
16. A system for scheduling documents for crawling, comprising:
one or more processors; and
memory storing one or more modules;
the one or more modules including instructions to:
receive from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
access the sitemap at the sitemap URL; and
retrieve from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata retrieved from the sitemap includes, for at least a plurality of respective documents associated with the website, document importance information indicating relative importance values associated with the respective documents;
schedule for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling is performed in accordance with a score assigned to each document deemed eligible for downloading, and wherein the score assigned to a respective document is adjusted by a boost factor corresponding to the relative importance value indicated by the document importance information for the respective document; and
download at least a subset of the documents scheduled for downloading.
17. The system of claim 16, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
18. The system of claim 17, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
19. The system of claim 16, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
20. The system of claim 16, wherein scheduling documents for downloading comprises generating a list of document identifiers that identify the scheduled documents.
21. A computer program product for use in conjunction with a computer system, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising instructions for:
receiving from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
accessing the sitemap at the sitemap URL; and
retrieving from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata comprises, for at least a plurality of respective documents associated with the website, document update rate information indicating update frequencies associated with the respective documents;
scheduling for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling includes scheduling a respective document for downloading when one of a date or date and time at which the respective document was last downloaded differs from a current date or a current date and time by an amount that is greater than a duration corresponding to the document update rate information for the respective document; and
downloading at least a subset of the documents scheduled for downloading.
22. The computer program product of claim 21, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
23. The computer program product of claim 22, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
24. The computer program product of claim 21, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
25. The computer program product of claim 21, wherein the instructions for scheduling documents for downloading comprise instructions for generating a list of document identifiers that identify the scheduled documents.
26. A computer program product for use in conjunction with a computer system, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising instructions for:
receiving from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
in response to the notification:
accessing the sitemap at the sitemap URL; and
retrieving from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata retrieved from the sitemap includes, for at least a plurality of respective documents associated with the website, document importance information indicating relative importance values associated with the respective documents;
scheduling for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling is performed in accordance with a score assigned to each document deemed eligible for downloading, and wherein the score assigned to a respective document is adjusted by a boost factor corresponding to the relative importance value indicated by the document importance information for the respective document; and
downloading at least a subset of the documents scheduled for downloading.
27. The computer program product of claim 26, wherein the metadata retrieved from the sitemap comprises, for at least a plurality of respective documents associated with the website, document modification date information indicating when the respective documents were last modified; and
wherein the scheduling is performed in accordance with the document modification date information for the respective documents.
28. The computer program product of claim 27, wherein the scheduling comprises deferring scheduling a respective document for downloading when the document modification date information for the respective document corresponds to a download date or a download date and time that is no later than a respective download date or a download date and time at which the respective document was last downloaded.
29. The computer program product of claim 26, the metadata providing information related to at least one of prioritizing documents for crawling by a web crawler and selecting documents for inclusion in a crawl; the scheduling including at least one of prioritizing documents for crawling and selecting documents for crawling in accordance with the metadata.
30. The computer program product of claim 26, wherein scheduling documents for downloading comprises generating a list of document identifiers that identify the scheduled documents.
31. A system for scheduling documents for crawling, comprising
one or more processors; and
memory storing one or more programs to be executed by the one or more processors;
the system including:
means for receiving from a website a notification that includes a sitemap URL corresponding to a sitemap for the website;
means for, in response to the notification:
accessing the sitemap at the sitemap URL; and
retrieving from the sitemap document location information and metadata for a plurality of documents associated with the website, wherein the metadata comprises, for at least a plurality of respective documents associated with the website, document update rate information indicating update frequencies associated with the respective documents;
means for scheduling for downloading documents, from among the plurality of documents, based at least in part on the metadata retrieved from the sitemap, wherein the scheduling includes scheduling a respective document for downloading when one of a date or date and time at which the respective document was last downloaded differs from a current date or a current date and time by an amount that is greater than a duration corresponding to the document update rate information for the respective document; and
means for downloading at least a subset of the documents scheduled for downloading.
The claims below are in addition to those above.
All refrences to claim(s) which appear below refer to the numbering after this setence.
1. A vehicle notification sound emitting apparatus comprising:
a sound emitting device configured to emit a starting movement notification sound to outside of a vehicle to inform a person in an outside area surrounding the vehicle that the vehicle will transition from a stopped state to a moving state, and emit a moving notification sound to outside of the vehicle to inform a person in the outside area surrounding the vehicle that the vehicle is moving; and
a notification sound control device configured to operate the sound emitting device to selectively emit the starting movement notification sound, the notification sound control device including a notification sound emission timing section configured to set a start timing of the starting movement notification sound in response to a shift operation, which issues a vehicle movement command, having been performed and an additional start movement preparation operation of the vehicle having been performed, the notification sound control device being further configured to operate the sound emitting device to automatically emit the moving notification sound after the starting movement notification sound has been emitted, the moving notification sound being different from the starting movement notification sound.
2. The vehicle notification sound emitting apparatus as recited in claim 1, wherein
the notification sound emission timing section is further configured to include a brake release operation as part of the additional start movement preparation operation of the vehicle such that the starting movement notification sound is emitted after the shift operation and the brake release operation have both been completed.
3. The vehicle notification sound emitting apparatus as recited in claim 1, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound after a brake release operation being completed while the vehicle was in a stopped state.
4. The vehicle notification sound emitting apparatus as recited in claim 3, wherein
the notification sound emission timing section is further configured to emit the starting movement notification sound for a prescribed amount of time after both the shift operation and the brake release operation have both been completed.
5. The vehicle notification sound emitting apparatus as recited in claim 4, wherein
the notification sound emission timing section is further configured to set the prescribed amount of time to correspond to a period occurring from when both the shift operation and the brake release operation have both been completed until a movement start operation is performed.
6. The vehicle notification sound emitting apparatus as recited in claim 1, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.
7. The vehicle notification sound emitting apparatus as recited in claim 2, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound after a brake release operation being completed while the vehicle was in a stopped state.
8. The vehicle notification sound emitting apparatus as recited in claim 7, wherein
the notification sound emission timing section is further configured to emit the starting movement notification sound for a prescribed amount of time after both the shift operation and the brake release operation have both been completed.
9. The vehicle notification sound emitting apparatus as recited in claim 8, wherein
the notification sound emission timing section is further configured to set the prescribed amount of time to correspond to a period occurring from when both the shift operation and the brake release operation have both been completed until a movement start operation is performed.
10. The vehicle notification sound emitting apparatus as recited in claim 9, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.
11. The vehicle notification sound emitting apparatus as recited in claim 2, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.
12. The vehicle notification sound emitting apparatus as recited in claim 3, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.
13. The vehicle notification sound emitting apparatus as recited in claim 4, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.
14. The vehicle notification sound emitting apparatus as recited in claim 5, wherein
the notification sound control device is further configured to operate the sound emitting device to emit the moving notification sound in response to the vehicle moving before the brake release operation is completed.