AI Automation

AI-Powered Facebook Group Lead Scraper & Automation Dashboard

An autonomous Facebook group scraper and AI lead qualification engine built with Puppeteer and Node.js. It extracts targeted posts via human-like Chrome automation, filters high-intent client leads using LLMs (Gemini, Groq, Ollama), and syncs qualified data directly to Google Sheets in real time. Published project: [x] (Check this box)

Project Overview

Facebook Group Lead Scraper & Automation Dashboard is an enterprise-grade web scraping and AI lead qualification solution designed to eliminate manual prospect hunting across social media communities. It autonomously navigates target Facebook groups, extracts post contents, classifies client intent using state-of-the-art Large Language Models (LLMs), and synchronizes actionable opportunities directly into Google Sheets.

Architecture & Engineering Highlights

Anti-Detection Session Preservation: Connects directly to an active Google Chrome profile via the Chrome Remote Debugging Protocol (CDP on port 9222). This completely avoids account checkpoints, re-logins, or bot-detection bans because all actions run inside an authentic authenticated session.
Intelligent Multi-LLM Qualification: Features a resilient multi-provider AI pipeline supporting Google Gemini 2.0 Flash, Groq (Llama 3.1), and local Ollama (Llama 3.2). The AI analyzes nuances across English, Bengali, and Banglish to distinguish authentic client hiring opportunities from job-seeker inquiries, advertisements, and spam.
Serverless Two-Way Sync: Leverages a custom Google Apps Script Webhook to read target group URLs dynamically from Google Sheets and instantly append qualified leads with post timestamps, author details, content, and links.
Real-Time Interactive Dashboard: Built with a modern dark-mode interface featuring live WebSocket-style scraping logs, real-time post preview feeds, humanized delay sliders, and quick Chrome launchers.
Zero-Dependency Portable Build: Packaged into a standalone Windows executable (.exe) using Caxa, enabling non-technical operators to run the application with no Node.js or development environment installed.

Key Features

Anti-Detection Chrome Remote Debugging: Hooks into active Chrome instances via CDP to preserve cookies, bypass checkpoints, and avoid bot bans.
Multi-Provider AI Lead Qualifier: Leverages Gemini 2.0 Flash, Groq, and local Ollama to accurately filter genuine client hiring posts from spam and job seekers.
Two-Way Google Sheets Webhook: Seamlessly reads target group queues and logs verified lead data directly to Google Sheets without complex cloud infrastructure.
Live Real-Time Control Dashboard: Sleek dark-mode interface providing live scraping progress, real-time post feeds, and activity logging.
Human-Like Automation Engine: Features randomized scrolling pauses, variable inter-group delays, and post-age cutoffs to mimic organic browsing behavior.
Automated Background Scheduler: Configurable recurring task scheduler with jitter variation to run periodic scraping cycles 100% hands-free.
Standalone Windows Executable: Packaged as a single portable .exe file for instant deployment on any Windows machine without requiring Node.js.

Technologies Used

Node.jsExpress.jsPuppeteer-CoreGoogle Apps ScriptGoogle Sheets APIOllama (Llama 3.2)JavaScript (ES6+)Vanilla CSSChrome DevTools ProtocolWeb Automation & Scraping

Project Details

Duration: 2 Weeks

Challenges

Bypassing Aggressive Anti-Bot Protections: Modern social platforms instantly detect headless automation tools. Solution: Integrated Chrome Remote Debugging Protocol (--remote-debugging-port), attaching Puppeteer to an existing authenticated user browser session alongside randomized human-like scrolling patterns and variable delay intervals.
Multilingual Context & Slang Classification: Target posts in localized community groups frequently blend English, Bengali, and phonetic Banglish. Simple keyword filters produced high false positives. Solution: Designed a specialized prompt pipeline with multi-LLM support (Gemini, Groq, and local Ollama) that understands informal hiring phrases like "need developer", "website banano dorkar", or "IT Executive urgent hiring".
Zero-Friction Deployment for Non-Technical Users: Setting up Google Cloud credentials, OAuth tokens, and Node.js environments can be overwhelming. Solution: Engineered a serverless Google Apps Script webhook for one-click setup and packaged the entire runtime into a standalone .exe desktop executable.

Results

100% Automated Workflow: Eliminated hours of repetitive manual group monitoring and post evaluation.
95%+ Lead Accuracy: Intelligent AI qualification filtered out spam, course promotions, and candidates looking for jobs, recording only legitimate hiring opportunities.
Zero Account Checkpoints: Achieved reliable, continuous operation without triggering security checkpoints or account restrictions.
Real-Time Synchronization: Leads are extracted, parsed, classified, and written to Google Sheets within seconds of discovery.