fetch_url_content
Fetch the main text from a web URL, and return its title, author, content, excerpt and domain.
Usage
The following example shows how the step can be used in a recipe.Examples
Examples
Since the step has no configuration parameter, it’s simply
Inputs & Outputs
The following are the inputs expected by the step and the outputs it produces. These are generally columns (ds.first_name), datasets (ds or ds[["first_name", "last_name"]]) or models (referenced
by name e.g. "churn-clf").
Inputs
Inputs
A column of URLs linkling to articles, blog posts or webpages.
Outputs
Outputs
A text column containing the extracted article’s title.
A categorical column containing the extracted article’s author.
A text column containing the extracted article’s main text.
A text column containing a summary of the extracted article.
A column containing only the domain of each original URL.
Configuration
The following parameters can be used to configure the behaviour of the step by including them in a json object as the last “input” to the step, i.e.step(..., {"param": "value", ...}) -> (output).
Parameters
Parameters
This step doesn’t expect any configuration.