3 Commits

Author	SHA1	Message	Date
Ofure Ikheloa	fd4e8c9c05	feat(scraper): add LLM-powered job data refinement and new scraping logic ... - Implement LLMJobRefiner class for processing job data with Gemini API - Add new job_scraper2.py with enhanced scraping capabilities - Remove search_keywords parameter from scraping engine - Add environment variable loading in config.py - Update main script to use new scraper and target field	2025-11-24 12:25:50 +01:00
Ofure Ikheloa	458e914d71	feat(scraping): enhance job scraping with session persistence and feedback system ... - Add config module for spoof data management - Implement session persistence to reuse authenticated sessions - Add feedback system to track success rates and adjust fingerprinting - Improve job link collection with pagination and scroll detection - Separate verified/unverified job listings into different folders - Enhance error handling for CAPTCHA and Cloudflare challenges	2025-11-21 16:51:26 +01:00
Ofure	1a216a1aa8	Add scraping_engine.py	2025-11-20 18:58:26 +00:00