Web scraping SDKs & templates

Building scrapers has never been easier!

Learn how to create and deploy them to the Apify platform with our JavaScript and Python SDKs and starter templates.

Also, explore our guides to Airbyte and Telegram integrations and changes to Store in Apify Console.

JavaScript SDK and code templates ??

How to create and deploy a stock web scraper

Learn how to utilize Apify's Puppeteer and Headless Chrome web scraper template to extract stock data from Nasdaq.

Read the tutorial →

Apify CLI and Python templates ??

How to build a TechCrunch scraper

We guide you through creating a web scraper with the Apify CLI and Python code templates to scrape headlines from TechCrunch.

Read the tutorial →

Putting community Actors front and center ??

We redesigned how our Store looks in Apify Console and introduced new sections where we want to highlight the most interesting Actors. The goal is to progressively push community Actors to the front and ensure your work is visible!

We’ve also prepared specific collections of Actors and have taken the time to pick the best within each category. We’re starting with:

• Apify picks
• Social media essentials
• Actors from community experts

Show what you bring to the table ????

We redesigned the dev page. Our goal is to highlight what our community developers have to offer. We've updated their profiles, included more social media links, and added a new section for them to introduce their skills in more depth.

What should you do?

1. Make your Actors public (and paid) on the Apify platform, and make it easier for potential customers to contact you for customized versions or requests to build an Actor.
2. Then edit your profile in Apify Console's account settings and make sure your profile shines!

For inspiration, check out some of our favorite developer profiles:

• ???? curious_coder
• ?????? microworlds
• ???? jupri

Airbyte & Telegram integrations ??

We have released new integration guides for Airbyte and Telegram!

Airbyte is an open-source data integration platform that allows you to move your data between different sources and destinations using pre-built connectors, like the Apify Dataset connector. It makes it simple to move data from Apify datasets to any supported destination.

Learn how to integrate your Apify datasets with Airbyte →

Telegram is a cloud-based messaging app known for its focus on security. As well as basic messaging features, it boasts unique elements like channels for broadcasting to large audiences and multi-device accessibility. The guide below shows you how to post data from Apify via Zapier to a Telegram channel.

Learn how to integrate your Apify Actors with Telegram through Zapier →

We're hiring! ??

Join our CEO on a virtual tour of our offices in Prague ?? And check out our new Careers page ?? We're looking for talented people to join us on our mission to make the web more programmable.

Find your dream job here →

Blog showcase ??

• Learn how to use Scrapy in real projects , taking advantage of its features and overcoming its limitations by using tools like Playwright.

• How to build a Hacker News scraper with Python's Beautiful Soup & Requests libraries. Covers HTTP requests, parsing HTML, handling pagination, and blocking.

• Scraping the Monty Python online store with Selenium. Learn how to locate elements, take screenshots, and execute JavaScript code.

Read more helpful content on the Apify Blog →