good evening dear communty, hello all OpenSuse-fans!
I looked up articles about using LWP however I am still lost What is aimed: Here on this following site we find a list of many shools:
see [b]this site - with a big server! http://www-db.sn.schule.de/index.php?id=25
i want to parse the sites - and therefore i want to use LWP::UserAgent;
and for the Parsing i want to use either
- use HTML::TreeBuilder::XPath; or
But this is another question: Well at the moment i have some issues with the LWP::Useragent Note the subsite of the overview can be reached via direct links…
but -note: each site has content. eg the following URLs
Datenblatt der Einrichtungeid=709
Datenblatt der Einrichtungeid=789
Datenblatt der Einrichtungeid=1297
Datenblatt der Einrichtungeid=761
…and so forth. The question is : how to i run LWP::UserAgent?
I want to have all the - 1000 sites.
Perhaps we have to count up form zero to 10000 with there
extern_eid=709 -(count from zero to 100000) here
What do you suggest!?
Here the ideas and specs for LWP User Agent;
The methods described in this section are used to dispatch requests via the user agent. The following request methods are provided:
$ua->get( $url )
$ua->get( $url , $field_name => $value, … )
This method will dispatch a GET request on the given $url. Further arguments can be given to initialize the headers of the request. These are given as separate name/value pairs. The return value is a response object. See HTTP::Response for
a description of the interface it provides. There will still be a response object returned when LWP can’t connect to the server specified in the URL or when
other failures in protocol handlers occur.
The question is: How to use LWP::UserAgent on the above mentioned site the right way - effectively!?
I look forward to any and all help!