# 🚀 What’s New in v1.4.1? 🚀
Welcome to version 1.4.1! This release is all about squashing bugs, enhancing functionality, and making everything run smoother. Here’s the scoop:
## 🚀 New Features
- **Optional Request Logging**: Now you can configure optional request and response logging to help with debugging and tracking, thanks to @NeatGuyCoding in #19783.
- **Web Media Element Enhancements**: Added support for both `<video>` and `<audio>` elements with `src` attributes, bringing you more flexibility when embedding media, by @ruanjf in #19988.
- **Aliyun OSS Storage Support in Plugin Daemon**: The new Plugin Storage Type now supports Aliyun OSS, catering to users in need of this cloud storage option, courtesy of @quicksandznzn in #20012.
- **Tracing Conversation in Opik Tracer**: Introduced support for tracking conversations via Opik Tracer, enhancing your tracing capabilities, integrated by @Lothiraldan in #20063.
- **Streamlined App Creation**: Simplified the app
## Firecrawl v1.9.0 Release
### **What's New:**
**Self-Host Improvements**
- Supabase client fixes
- Fixed support for LLM Providers
- Crawl is much faster now
- Global adoption of cacheable lookup system
- Easier setup
**MCP Improvements (v1.11.0)**
- Tons of improvements to it (prompts, examples, and how to use params properly)
**SDK & API Enhancements**
- Added change tracking to SDK 2.0
- Crawl delay support with per-crawl concurrency limiting
- New Qwen3 crawler example via OpenRouter
- Cancel batch scrape endpoint
**Performance & Limits**
- Global adoption of cacheable lookup system
- Increased map endpoint limit from 5,000 to 30,000 links
- Search schema limit increased from 50 to 100
**Fixes & Stability**
- Better error handling for SSL failures
- Optional chaining bug fixes
- WaitAction field validation in firecrawl-py
- Concurrency queue reworked to prioritize by time, not priority
**Dashboard (Cloud version)**
- New activity logs
##
## Day 7 – Integration Day
### Overview
For the final day of Launch Week III, we’re rolling out new and updated integrations that make it easier to connect Firecrawl to the tools and platforms you already use.
From automation platforms to AI pipelines, Firecrawl now integrates with 20+ services, giving you a faster path from web data to workflow execution.
### Key Integration Updates
- **Discord Bot:** Trigger scrapes and receive structured results right inside your server. [Learn more](https://github.com/mendableai/firecrawl-discord-bot)
- **Make Integration:** Visually build workflows powered by Firecrawl's scraping and extraction. [Learn more](https://www.make.com/en/integrations/firecrawl)
- **n8n Integration:** Connect Firecrawl to custom automation flows. [Learn more](https://n8n.io/)
- **Langflow:** Seamlessly embed Firecrawl agents into Langflow pipelines. [Learn more](https://docs.langflow.org/)
- **LlamaIndex:** Use Firecrawl with LlamaIndex to enrich and retri
## v1.7.0 - Release Notes
### New Features
- **Deep Research Open Alpha**: Structured outputs + customizability.
- **llmstxt.new**: Generate an llms.txt for any website by just appending its url: llmstxt.new/firecrawl.dev
- **Concurrent Browsers**: Improved rate limits for all users.
- **Compare Beta**: Figure what has changed in the website directly in /scrape and /crawl endpoints. Currently in closed beta.
- **/extract**: URLs are now optional.
- **/scrape**: Warns if concurrency-limited.
- **New Firecrawl Examples**: Featuring models like Claude 3.7, Gemini 2.5, Deepseek V3, Mistral 3.1, and more.
- **Crawl**: `maxDiscoveryDepth` option added.
### Fixes & Improvements
- Fixed **circular JSON error** in search.
- Reworked new **tally** system.
- Fixed sitemaps poisoning crawler with unrelated links.
- Crawler status retries added on failure (up to 3 times).
- Credit check now snaps to remaining credits if exceeded.
- Fixed path filtering bug in Map.
-
## Thank you and welcome to our new contributors 🔥
@Olexandr88, @ozzy35410 and @sadikkuzu
## Summary 🎉
This release includes several enhancements to the developer experience, along with some general bug fixes.
## 🚀 What's Changed
- Refactored PackageBuilder to support dependency injection via positional arguments that are `fastapi.Depends` instances.
- Improved docstring and reference generation.
- Improved handling of custom apps by the `openbb-platform-api` launcher.
## 🆕 New Endpoints
- `obb.economy.fomc_documents`
- Provider: Federal Reserve
- Get current, and historical, FOMC documents.
- Includes an OpenBB Workspace template, and widget, with document viewer.
## 🦋 Pull Requests Included:
- Run "pre-commit autoupdate" @sadikkuzu (#7080)
- docs: (contributing) @Olexandr88 (#7033)
- Fix typo: MacOS to macOS @ozzy35410 (#7062)
- fix typos @ozzy35410 (#7063)
- [Feature] FOMC Documents With Workspace Multi-File Viewer Widget @deeleeramone (#7065
### Introducing LLMs.txt API
The /llmstxt endpoint allows you to transform any website into clean, [LLM-ready text files](https://www.firecrawl.dev/blog/How-to-Create-an-llms-txt-File-for-Any-Website). Simply provide a URL, and Firecrawl will crawl the site and generate both llms.txt and llms-full.txt files that can be used for training or analysis with any LLM.
Docs here: [https://docs.firecrawl.dev/features/alpha/llmstxt](https://docs.firecrawl.dev/features/alpha/llmstxt)
### Introducing Deep Research API (Alpha)
The /deep-research endpoint enables AI-powered deep research and analysis on any topic. Simply provide a research query, and Firecrawl will autonomously explore the web, gather relevant information, and synthesize findings into comprehensive insights.
Join the waitlist here: [https://www.firecrawl.dev/deep-research](https://www.firecrawl.dev/deep-research)
### Official Firecrawl MCP Server
Introducing the Firecrawl MCP Server. Give Cursor, Windsurf, Clau
## Thank you and welcome to our new contributors 🔥
@dijonkitchen
## Summary 🎉
This minor release fixes small bugs, enhances the developer experience, and updates some dependencies.
## What's changed 🚀
- Numpy 2 now fully supported by the charting, technical, quantitative, and econometrics extensions.
- Plotly has been downgraded to 5.24.1 due to changes in V6 to JSON serialization of Figure objects.
- API output of `derivatives.options.chains` is now oriented as 'records'.
- Router extension endpoints no longer require returning an `OBBject` as the response model.
- Arbitrary credentials stored in `user_settings.json` are now passed to the `obb` app and made available, as defined.
- Various enhancements to the `openbb-platform-api` app launcher and Workspace backend. See the [README](https://github.com/OpenBB-finance/OpenBB/tree/develop/openbb_platform/extensions/platform_api#readme)
- Legacy SDK example notebooks have been removed.
## 🆕 New Endpoints
- obb.r
#### Self-Host Fixes
- **Reworked Guide:** The `SELF_HOST.md` and `docker-compose.yaml` have been updated for clarity and compatibility
- **Kubernetes Improvements:** Updated self-hosted Kubernetes deployment examples for compatibility and consistency (#1177)
- **Self-Host Fixes:** Numerous fixes aimed at improving self-host performance and stability (#1207)
- **Proxy Support:** Added proxy support tailored for self-hosted environments (#1212)
- **Playwright Integration:** Added fixes and continuous integration for the Playwright microservice (#1210)
- **Search Endpoint Upgrade:** Added SearXNG support for the `/search` endpoint (#1193)
#### Core Fixes & Enhancements
- **Crawl Status Fixes:** Fixed various race conditions in the crawl status endpoint (#1184)
- **Timeout Enforcement:** Added timeout for scrapeURL engines to prevent hanging requests (#1183)
- **Query Parameter Retention:** Map function now preserves query parameters in results (#1191)
- **Screenshot
🚀 Features & Enhancements
- Scrape API: Added action & wait time validation ([#1146](https://github.com/mendableai/firecrawl/pull/1146))
- Extraction Improvements:
- Added detection of PDF/image sub-links & extracted text via Gemini ([#1173](https://github.com/mendableai/firecrawl/pull/1173))
- Multi-entity prompt enhancements for extraction ([#1181](https://github.com/mendableai/firecrawl/pull/1181))
- Show sources out of __experimental in extraction ([#1180](https://github.com/mendableai/firecrawl/pull/1180))
- Environment Setup: Added Serper & Search API env vars to docker-compose ([#1147](https://github.com/mendableai/firecrawl/pull/1147))
- Credit System Update: Now displays "tokens" instead of "credits" when out of tokens ([#1178](https://github.com/mendableai/firecrawl/pull/1178))
✏️ Examples
- Gemini 2.0 Crawler: Implemented new crawling example ([#1161](https://github.com/mendableai/firecrawl/pull/1161))
- Gemini TrendFinder: [https://github.com/mendableai
## Thank you and welcome to our new contributors 🔥
@joshuaBri and @maximevtush
## Summary 🎉
The first release of 2025, V4.4.0 comes with improved system/environment controls, new endpoints and data provider, and simplifies creating an OpenBB Workspace custom backend from an existing FastAPI app.
## What's changed 🚀
- Update LICENSE @maximevtush (#7020)
- Update README.md @jmaslek (#7011)
- HTTP configurations can now be defined in `system_settings.json`.
- See the [docs](https://docs.openbb.co/platform/settings_and_environment_variables#http)
- Output validation can be completely disabled in the `router.command` decorator by setting `no_validate = True`
- See the [docs](https://docs.openbb.co/platform/developer_guide/disabling_output_validation)
- FastAPI app instances can now be used by the `openbb-api` launcher to create custom Workspace backends for instant dashboarding.
- See the [docs](https://docs.openbb.co/platform/getting_started/quickstart-works
## Summary of changes
- Open Deep Research: An open source version of OpenAI Deep Research. See [here](https://github.com/nickscamara/open-deep-research)
- R1 Web Extractor Feature: New extraction capability added.
- O3-Mini Web Crawler: Introduces a lightweight crawler for specific use cases.
- Updated Model Parameters: Enhancements to o3-mini_company_researcher.
- URL Deduplication: Fixes handling of URLs ending with /, index.html, index.php, etc.
- Improved URL Blocking: Uses tldts parsing for better blocklist management.
- Valid JSON via rawHtml in Scrape: Ensures valid JSON extraction.
- Product Reviews Summarizer: Implements summarization using o3-mini.
- Scrape Options for Extract: Adds more configuration options for extracting data.
- O3-Mini Job Resource Extractor: Extracts job-related resources using o3-mini.
- Cached Scrapes for Extract evals: Improves performance by using cached data for extractions evals.
## What's Changed
* You forgot an 'e' by @sami0596 in
We're excited to announce several new features and improvements:
## New Features
- Added web search capabilities to the extract endpoint via the `enableWebSearch` parameter
- Introduced source tracking with `__experimental_showSources` parameter
- Added configurable webhook events for crawl and batch operations
- New `timeout` parameter for map endpoint
- Optional ad blocking with `blockAds` parameter (enabled by default)
## Infrastructure & UI
- Enhanced proxy selection and infrastructure reliability
- Added domain checker tool to cloud platform
- Redesigned LLMs.txt generator interface for better usability
## What's Changed
* (feat/extract) Refactor and Reranker improvements by @nickscamara in https://github.com/mendableai/firecrawl/pull/1100
* Fix bad WebSocket URL in CrawlWatcher by @ProfHercules in https://github.com/mendableai/firecrawl/pull/1053
* (feat/extract) Add sources to the extraction by @nickscamara in https://github.com/mendableai/firecrawl/pull/11
We've significantly enhanced our data extraction capabilities with several key updates:
- Extract now returns a lot more data due to a new re-ranker system
- Improved infrastructure reliability
- Migrated from Cheerio to a high-performance Rust-based parser for faster and more memory-efficient parsing
- Enhanced crawl cancellation functionality for better control over running jobs
## What's Changed
* Added "today" to extract prompts by @rafaelsideguide in https://github.com/mendableai/firecrawl/pull/1084
* docs: update cancel crawl response by @ftonato in https://github.com/mendableai/firecrawl/pull/1087
* port most of cheerio stuff to rust by @mogery in https://github.com/mendableai/firecrawl/pull/1089
* Re-ranker changes by @nickscamara in https://github.com/mendableai/firecrawl/pull/1090
* Rerank with lower threshold + back to map if length = 0 by @rafaelsideguide in https://github.com/mendableai/firecrawl/pull/1086
**Full Changelog**: https://github.com/mendablea
## Get structured web data with /extract
We’re excited to announce the [release of **/extract**](https://www.firecrawl.dev/extract) - get data from any website with just a prompt. With /extract, you can retrieve any information from anywhere on a website without being limited by scraping roadblocks or the typical context constraints of LLMs.
No more manual copy-pasting, broken scraping scripts, or debugging LLM calls. - it’s never been easier to **enrich your data**, **create datasets**, or **power AI applications** with clean, structured data from any website.
Companies are already using extract to:
- Enrich CRM data
- Streamline KYB processes
- Monitor competitors
- Supercharge onboarding experiences
- Build targeted prospecting lists
Instead of spending hours manually researching, fixing broken scrapers, or piecing together data from multiple sources, simply specify w
## What's Changed
* feat: new snips test framework (FIR-414) by @mogery in https://github.com/mendableai/firecrawl/pull/1033
* (feat/extract) New re-ranker + multi entity extraction by @nickscamara in https://github.com/mendableai/firecrawl/pull/1061
* __experimental_streamSteps by @nickscamara in https://github.com/mendableai/firecrawl/pull/1063
**Full Changelog**: https://github.com/mendableai/firecrawl/compare/v1.2.1...v.1.3.0
## What's Changed
* Indexes, Caching for /extract, Improvements by @nickscamara in https://github.com/mendableai/firecrawl/pull/1037
* [SDK] fixed none and undefined on response by @rafaelsideguide in https://github.com/mendableai/firecrawl/pull/1034
* feat: use new random user agent instead of the old one by @1101-1 in https://github.com/mendableai/firecrawl/pull/1038
* (feat/extract) Move extract to a queue system by @nickscamara in https://github.com/mendableai/firecrawl/pull/1044
## /extract (beta) changes
* We have updated the /extract endpoint to now be asynchronous. When you make a request to /extract, it will return an ID that you can use to check the status of your extract job. If you are using our SDKs, there are no changes required to your code, but please make sure to update the SDKs to the latest versions as soon as possible.
* For those using the API directly, we have made it backwards compatible. However, you have 10 days to update your implementation to the n
# /v1/search
The search endpoint combines web search with Firecrawl’s scraping capabilities to return full page content for any query.
Include `scrapeOptions` with `formats: ["markdown"]` to get complete markdown content for each search result otherwise it defaults to getting SERP results (url, title, description).
More info here [/v1/search docs](https://docs.firecrawl.dev/api-reference/endpoint/search)
## What's Changed
* /extract URL trace by @nickscamara in https://github.com/mendableai/firecrawl/pull/1014
* (feat/v1) Search by @nickscamara in https://github.com/mendableai/firecrawl/pull/1032
**Full Changelog**: https://github.com/mendableai/firecrawl/compare/v1.1.1...v1.2.0
## What's Changed
* feat(python-sdk): Make API key optional for self-hosted instances by @RutamBhagat in https://github.com/mendableai/firecrawl/pull/990
* Sitemap fixes by @mogery in https://github.com/mendableai/firecrawl/pull/1010
* fixed optional+default bug on llm schema by @rafaelsideguide in https://github.com/mendableai/firecrawl/pull/955
* [FIR-37] feat: extract and return favicon URL during scraping by @ftonato in https://github.com/mendableai/firecrawl/pull/1018
* fix: merge mock success data by @yujunhui in https://github.com/mendableai/firecrawl/pull/1013
* feat(rust-sdk): Make API key optional for self-hosted instances by @RutamBhagat in https://github.com/mendableai/firecrawl/pull/991
* feat(scrapeURL/pdf): switch to MU (FIR-356) by @mogery in https://github.com/mendableai/firecrawl/pull/1016
## New Contributors
* @ftonato made their first contribution in https://github.com/mendableai/firecrawl/pull/1018
* @yujunhui made their first contribution in https://gi
Starting today we are going to be posting weekly releases here and on [firecrawl.dev/changelog](https://firecrawl.dev/changelog). This release is just a summary of all the improvements and fixes we pushed since v1 release here. Thank you all for the contributions!
# v1.1.0
## Changelog Highlights
#### Feature Enhancements
- **New Features**:
- Geolocation, mobile scraping, 4x faster parsing, better webhooks,
- Credit packs, auto-recharges and batch scraping support.
- Iframe support and query parameter differentiation for URLs.
- Similar URL deduplication.
- Enhanced map ranking and sitemap fetching.
#### Performance Improvements
- Faster crawl status filtering and improved map ranking algorithm.
- Optimized Kubernetes setup and simplified build processes.
- Sitemap discoverability and performance improved
#### Bug Fixes
- Resolved issues:
- Badly formatted JSON, scrolling actions, and encoding errors.
- Crawl limits, relative URLs, and missing
## Thank you and welcome to our new contributors 🔥
@Atharva-3000, @HemuManju, @Khaan25, @NabidAkhtar, @Naprila, @Yash-1511, @adilkadivala, @adityadeshlahre, @emmanuel-ferdman and @harshsbhat
## Summary 🎉
V4.3.5 includes bug fixes, security updates, new data and endpoints, as well as additions to the example library.
## 🚨 OpenBB Platform Breaking Changes
V1.0.0 Mac/Windows OpenBB Platform Installer users need to manually apply this change:
1. In Finder/Explorer, open the folder where it was installed - probably in a folder, named "OpenBB", at the root of the operating system user account.
2. From the main installation folder, navigate into the subdirectory, "extensions/openbb_platform_installer".
3. Open, "pyproject.toml", in any text editor, and update line 21:
- From: openbb-core = "^1"
- To: openbb-core = ">=1.3.5"
4. Save the file, close it, and then run the "Update" shortcut.
## 💂 🔒 Security
- [Security] Bump `aiohttp` To V3.10.11 @deeleeramone (#69