Infrastructure Developer for High-Volume Web Automation Project

Job Title: Infrastructure Developer for High-Volume Web Automation Project
Location: Remote
Type: Contract (Project-Based)
Duration: Short-Term with Potential for Extension
About the Project:
We are seeking an experienced Infrastructure Developer to design and build a robust system for a high-volume web automation project. The goal is to create an infrastructure capable of handling up to 1 million form submissions, including email verification, within a 24-hour period once the target website goes live. Your role will be to set up and test the infrastructure in advance, ensuring it is fully operational and ready to deploy on short notice. We will use a mock up site to test on.
Key Responsibilities:
• Infrastructure Design & Setup: Design and develop a scalable, distributed system that can efficiently handle large-scale automated form submissions.
• Automation Integration: Collaborate with automation developers to ensure that the infrastructure supports and enhances the automated submission processes.
• Proxy Management: Implement a robust proxy rotation system to manage large volumes of requests without being blocked by the target site.
• Email Handling System: Develop or integrate with existing systems to manage the generation, receipt, and verification of large volumes of emails.
• Monitoring & Logging: Set up comprehensive monitoring and logging systems to track performance, identify issues, and ensure the system is ready for deployment.
• Pre-Launch Testing: Conduct thorough testing on a sample webpage to validate the infrastructure, making adjustments as needed to ensure reliability and scalability.
• Launch Support: Be on standby for the live launch to ensure a smooth transition and to address any issues that arise during the deployment.
Qualifications:
• Proven experience in designing and deploying scalable infrastructure for web automation projects.
• Strong background in distributed systems, cloud services (AWS, GCP, Azure), and load balancing.
• Familiarity with web automation tools (Selenium, Puppeteer) and their infrastructure requirements.
• Experience with email automation and bulk email verification systems.
• Proficiency in proxy management and anti-bot measures.
• Excellent problem-solving skills, with the ability to troubleshoot and optimize systems in real-time.
• Experience with Captcha Handling: If the form has Captcha, use an API like 2Captcha or DeathByCaptcha to solve them automatically.
• Knowledge of Proxy Management: Able to implement a rotating proxy system to avoid IP blocks by the website. This can be done using services like ScraperAPI, Bright Data, or self-hosted proxy solutions.
• Strong communication skills and the ability to work collaboratively with a team of developers.
• Ability to work flexibly and be available to provide support during the project launch.
Why Work With Us?
• Opportunity to work on a challenging and innovative project with real-world impact.
• Competitive compensation for your expertise and contributions.
• Flexibility in working hours, with a focus on project milestones.
• Potential for ongoing collaboration on future projects.
How to Apply:
If you have the experience and skills to design and deploy a high-performance infrastructure for a mission-critical project, we want to hear from you. Please send your resume and a brief overview of similar projects you have worked on. Highlight your approach to building scalable systems and how you’ve prepared infrastructure for high-demand scenarios.
Application Deadline: Rolling (Looking to fill this position promptly to begin development).