Blog & Announcements
Discover what’s new at Crawlio — read our latest blogs for in-depth guides, product updates, and behind-the-scenes announcements.
How to Use Crawlio to Scrape Member-Only Content
Learn how to scrape authenticated, member-only content using Crawlio's new cookie injection feature. Perfect for dashboards, subscription pages, and logged-in areas — with tips on ethical usage.
New Crawlio Update: Click, Scroll & Run JavaScript Workflows in Your Browser — No Code Needed
Run browser-based automation with clicks, scrolls, and JavaScript — no SDK required. Try Crawlio's newest no-code dashboard workflow update.
Integrating Crawlio in Your Node.js App: A Practical Guide Using the SDK | Crawlio Blogs
Learn how to integrate Crawlio into your Node.js app using the official JavaScript SDK. Includes examples of scraping, crawling, and automating browser actions with workflows.
How Go-Based Scraper Engines Help You Save Resources | Crawlio Blogs
Learn how Go-based scraper engines can reduce memory usage compared to Python and Node.js. Explore Crawlio’s lightweight 7–15MB scraper engine and when to use tools like Colly or CDP-based browsers in web scraping workflows.
Understanding the Infinite Loop Behavior in ChromeDP’s Nodes Function
A deep dive into ChromeDP's persistent DOM querying behavior that causes infinite loops when elements don't exist, why it happens, and how tools like Crawlio mitigate the issue with safer defaults.
Simulating Real Browser Interactions with Crawlio's workflow Feature
Explore Crawlio's new workflow feature — a way to simulate browser actions like scroll, click, and JavaScript eval in web scraping jobs. Ideal for handling dynamic content without extra tooling.
Launching Crawlio
In this post, I share why I built it, how it compares to tools like FireCrawl and Crawl4AI, and how you can get started scraping websites with ease.