Skip to main content

Usage

The following example shows how the step can be used in a recipe.

Examples

  • Example 1
  • Signature
Since the step has no configuration parameter, it’s simply
fetch_url_content(ds.article_url) -> (
  ds.article_title,
  ds.article_author,
  ds.article_content,
  ds.article_excerpt,
  ds.article_domain
)

Inputs & Outputs

The following are the inputs expected by the step and the outputs it produces. These are generally columns (ds.first_name), datasets (ds or ds[["first_name", "last_name"]]) or models (referenced by name e.g. "churn-clf").
urls
column[url]
required
A column of URLs linkling to articles, blog posts or webpages.
title
column[text]
required
A text column containing the extracted article’s title.
author
column[category]
required
A categorical column containing the extracted article’s author.
content
column[text]
required
A text column containing the extracted article’s main text.
excerpt
column[text]
required
A text column containing a summary of the extracted article.
domain
column[url]
required
A column containing only the domain of each original URL.

Configuration

The following parameters can be used to configure the behaviour of the step by including them in a json object as the last “input” to the step, i.e. step(..., {"param": "value", ...}) -> (output).

Parameters

This step doesn’t expect any configuration.
I