Block a user
5901e9c1a1
Refactor scraper.py to improve code readability by removing unnecessary blank lines and ensuring consistent formatting.
5939f2bd04
Refactor RedisManager methods to enhance job caching and error handling; implement sent and error cache management for improved job processing flow.
e2e1bc442e
Refactor RedisManager methods for improved error handling and logging; streamline job validation process by ensuring all compulsory fields are checked before processing.
87c67265f8
Refactor environment variable handling in scraper; remove default values for RabbitMQ and Redis configurations. Enhance job validation by checking for all compulsory fields before processing.
c370de83d5
Refactor scraper and sender modules for improved Redis management and SSL connection handling
0c447d0f77
Merge branch 'Ashby_agent' of https://gitea.thejobhub.xyz/Ofure/Web_scraping_project into Ashby_agent
94d87943de
Refactor environment variable handling in AshbyJobScraper and Sender classes; remove fallback values for RabbitMQ and Redis configurations.
762846cb4a
Add AshbyJobScraper and Sender classes for job scraping and message sending; implement Redis caching and RabbitMQ integration.
2d22fbdb92
Enhance AmazonJobScraper to support flexible location matching and extract posted dates; refine LLMJobRefiner prompts for better data extraction.
e216db35f9
Increase max pages to scrape and extend wait time between job title scrapes; add posted date to job data extraction
2b1387b3e6
modify to include scraping date posted, queuing failed jobs to be sent to redis for later scraping with back-up scraper.