new Sitemap(message_obj)
Represents sitemap parser
Parameters:
| Name | Type | Description |
|---|---|---|
message_obj |
Message |
- Source:
Members
(private, inner) sitemap_queue :Array
List of urls for which sitemap have to parsed.
Type:
- Array
- Source:
Methods
fetch(url, callback)
Fetches given sitemap url
Parameters:
| Name | Type | Description |
|---|---|---|
url |
String | |
callback |
function |
- Source:
getSites(url, callback)
Parses and returns all the urls from the given sitemap url
Parameters:
| Name | Type | Description |
|---|---|---|
url |
String | |
callback |
function |
- Source:
queueSitemaps(domain_urls, fn)
Queues urls for sitemap fetching
Parameters:
| Name | Type | Description |
|---|---|---|
domain_urls |
Array | |
fn |
function | callback |
- Source:
updateSiteMap(domain, sites, fn)
Updates sitemap of given domain.
Parameters:
| Name | Type | Description |
|---|---|---|
domain |
String | |
sites |
Array | |
fn |
function | callback |
- Source:
(private, inner) lazy_sitemap_updator(domain)
It loads sitemap recursively in a queued fashion.
Next domain is automatically queued by popping element from sitemap_queue
Parameters:
| Name | Type | Description |
|---|---|---|
domain |
String |
- Source: