Use tools for searching the internet

Last updated: June 9, 2025

We offer several powerful tools to help you pull from information on the internet, each tailored for different types of searches. Here’s a breakdown of what’s available and when to use each tool:

1. Stock websearch

What it is: The Stock websearch tool is a targeted web search tool that finds online information related to a list of stocks and a specific topic.

What it’s for: Use this when you need web-based information about companies, especially in relation to a shared subject like earnings, technology, or industry trends.

Example: "Find recent news about Tesla's battery technology."

Key Features:

  • Searches across multiple stocks using stock_ids

  • Focused on a particular topic like “product launch” or “regulatory updates”

  • Optional date_range to narrow the timeframe

  • Prioritizes relevance to both the company and the topic

  • Automatically summarizes results for easier reading

2. Websearch

What it is: The Websearch tool is a general-purpose web search tool for discovering information on any topic, not limited to companies or stocks.

What it’s for: Use it when you need broad or open-ended web-based information, such as market trends, economic events, or technology research.

Example: "Find information about recent inflation trends."

Key features:

  • Accepts one or more queries for flexible searching

  • Optional urls field to search within specific web addresses

  • date_range lets you filter by time window

  • Automatically summarizes web results

  • Can search general news, blogs, reports, or niche content

Web Page Crawling Tools

3. Crawl URL

What it is: The Crawl URL tool is a page-specific content extractor that pulls text from a known web page.

What it’s for: Use this when you want to analyze the text content of a specific URL you already have—ideal for press releases, reports, or blog posts.

Example: "Read the content of Apple's latest press release at [specific URL]."

Key features:

  • Takes complete urls as input

  • Optional queries to extract relevant content on the page

  • Delivers a processed summary of the page content

  • Best for deep dives on specific, known web pages

4. Crawl URL with multiple pages

What it is: The Crawl URL with multiple pages tool is a multi-page crawler for extracting content from websites that spread information across several pages (e.g., paginated articles or lists).

What it’s for: Use this when you're analyzing content that spans multiple pages, like review lists or multi-part blog entries.

Example: "Get all the product reviews from [website] that spans multiple pages."

Key features:

  • Takes a starting url and crawls up to 10 pages

  • Can handle pagination or “Load More” buttons

  • Summarizes extracted data across all pages

  • Best used for sites with structured, sequential content

5. Crawl visual components from page

What it is:

The Crawl visual components from page tool is a visual-aware crawler that extracts both text and image-based elements (like charts, graphs, or infographics) and converts them into descriptive text.

What it’s for: Use this when analyzing pages with key visual content, such as earnings slides, product comparison tables, or infographic-rich blog posts.

Example: "Analyze the charts on this quarterly earnings page and explain the trends."

Key features:

  • Requires a complete url

  • Captures and converts images, graphs, and charts to text descriptions

  • Ideal for extracting meaning from non-text content

  • More resource-intensive—use only when visuals matter

6. Crawl infinitely scrollable page

What it is: The Crawl infinitely scrollable page tool is a crawler built for infinite scroll pages, which continuously load new content as you scroll instead of using pagination.

What it’s for: Perfect for e-commerce listings, social feeds, or content platforms that don’t split content into distinct pages.

Example: "Get all product listings from this e-commerce site that loads more items as you scroll."

Key features:

  • Accepts a single url

  • Detects and follows scroll-based loading patterns

  • Summarizes content across multiple scrolls

  • Best used for dynamic or feed-style web layouts

7. Search website

What it is: The Search website tool is a site-specific search engine that looks for certain topics or terms within a specific domain.

What it’s for: Use this when you want to find content across a single website, such as news articles, support documents, or company announcements.

Example: "Find all mentions of 'new product launch' on Apple's website."

Key features:

  • Takes a list of queries and domain_urls

  • Supports optional date_range and get_latest_updates

  • Searches across full domains or specific subdirectories

  • More targeted than general search—great for monitoring a specific site