Firecrawl

Generate LLMs.txt for your websites via the CLI You can now easily create llms txt files for your website using the command line with npx. Powered by Firecrawl npx generate-llmstxt -u url

Generate an llms.txt file for any website in seconds with /llmstxt Our new Firecrawl endpoint turns any site into a single text file that can be fed into any LLM. Available now on our API and SDKs. Check out the docs here: https://lnkd.in/emV_BbAH

Introducing our official LLM.txt Generator API ?? Concatenate any website into a single text file that can be fed into any LLM. With our new alpha endpoint you can quickly generate llms.txt and llms-full.txt files for any website. Available now on our API and SDKs. Check out the docs here: https://lnkd.in/eZeJh79w

Claude 3.7 creates beautiful charts ?? Just take a screenshot of a chart for inspiration and paste in your data. Here's a chart we made for Firecrawl weekly actives ??

Excited to announce Claude 3.7 Trend Finder ?? Use Anthropic's new model to monitor & extract trends on blogs and socials with Firecrawl and the X API. It collects posts from key influencers and sites, tracks the latest trends, and then pings you on Slack or Discord. See the code and get your API keys here: https://lnkd.in/gnJMe878

Excited to show off Firecrawl Fine-tuning Dataset Builder ?? Learn how to create high-quality training data for fine-tuning LLMs using Firecrawl to scrape web content. Build your own instruction-answer pairs dataset for domain-specific AI assistants! See the open-source code, an explainer article, and get your API keys to try it out here: https://lnkd.in/g-ztqikg

Excited to introduce DeepSeek R1 fine-tuning with Firecrawl ?? Learn how to fine-tune @deepseek_ai's R1 model on custom instruction datasets generated by @firecrawl_dev's web data extraction. Train your own AI expert to answer domain-specific questions about your website! See the open-source code, read the explainer article and get your Firecrawl API key here: https://lnkd.in/gWhqN3nY

Announcing the Firecrawl Deep Research API ?? A complete research API that allows you to easily build deep research into your own applications. Join the waitlist below!

Introducing Bulk Company Scraper ?? Instantly research companies & startups with @firecrawl_dev! Upload a list of names and get AI-powered insights on companies, funding & more. From names to knowledge in seconds ?? See the code and get your API keys: https://lnkd.in/gaavDxmn

Introducing Claude Job Matcher ?? Let AI find the perfect job for you - parse your resume & scrape any job board you want. Powered by @firecrawl_dev + Claude 3.5 and runs on schedule - so you'll never miss an opportunity ?? See the blog and code here: https://lnkd.in/gh6JaYWe