Super scrapers!
Hi, web scraping enthusiasts!
This edition of Pro Web Scraping brings you the powerful SuperScraper API, schedule notifications, an upgraded request queue system, an invitation to a Crawlee webinar, and inspiring success stories from our community.
SuperScraper API ??
We're delighted to introduce you to a new Actor in Apify Store - SuperScraper API - a versatile, open-source REST API designed for web scraping.
SuperScraper API offers compatibility with services like ScrapingBee, ScrapingAnt, and ScraperAPI.
It allows users to extract fully rendered HTML from any URL using a headless browser to effectively handle dynamic content.
Key features include:
Note that this is an early version, and we're currently working on bugs and optimizations.
Schedule notifications ??
Introducing notifications for failed schedule runs of Apify Actors.
If a scheduled task fails to start, likely due to incorrect input, an email notification will be sent.
Each schedule will trigger a maximum of one email per day.
A new column in the Schedules table reflects this feature, with notifications enabled by default.
New and improved request queue ??
The Apify request queue has been upgraded to a new storage system to address previous limitations like throughput issues, fixed data retention policies, and concurrency limitations.
Key improvements include:
For more details:
领英推荐
Crawlee live webinar ??
On June 12th at 9 AM EST, you can learn how to scrape any website using Crawlee in JavaScript/TypeScript. Join our webinar on YouTube and discover the modern features of Crawlee and all of its capabilities, from working with JavaScript-rendered websites to its latest adaptive crawling feature.
Freelance web scraping on Apify Store ??
Meet Caleb David (aka microworlds).
His story highlights how freelance web scraping can lead to financial freedom.
Caleb transitioned from general software development to web scraping by using the Apify platform to build custom scrapers and monetize Actors.
This dual approach has provided him with a steady income and professional growth.
Dogfooding and automation at Apify ??
Learn how we use our own product!
From coordinating lunch groups with the Lunchbot to monitoring on-call duties and managing code migrations, we share how we use Apify Actors for work and fun.
Actor video tutorials ??
Watch more helpful content on our YouTube channel →
Gift cards for new Capterra reviews ??
If you love what we do, you can write a review of Apify on Capterra and get $20 in return. Gift cards are limited. Don't miss out!
Join our Discord ??
There are over 7,000 developers in our community on Discord. Join and participate in various exclusive events, chat with fellow scraping developers, and touch base with the Apify team.