DevOps Engineer - Docker & AWS Specialist

Key Responsibilities:

Deploy and Maintain Danswer Instances:

Set up and configure Docker environments optimized for Danswer’s requirements.
Deploy and manage Danswer Docker instances on AWS infrastructure.
Implement load balancing and auto-scaling for high availability.
Configure security groups and network access controls.
Set up monitoring and logging using AWS CloudWatch or similar tools.
Custom Data Source Integration:

Develop and implement connectors for custom data sources not listed in the standard Danswer connectors.
Ensure proper authentication and secure data transfer for each integration.
Implement data refresh mechanisms to keep information up-to-date.
System Maintenance and Optimization:

Conduct regular system health checks and performance optimizations.
Troubleshoot and resolve issues related to Docker containers, networking, and system performance.
Optimize database queries for faster response times.
Implement caching mechanisms to reduce API calls and improve performance.
Security Implementation:

Configure end-to-end encryption for data in transit and at rest.
Implement role-based access control (RBAC) for user management.
Set up multi-factor authentication (MFA) for enhanced security.
Documentation and Training:

Create and maintain documentation for deployment processes, configurations, and operational procedures.
Prepare training materials and conduct training sessions for internal teams on system management and troubleshooting.
Requirements:

Proven experience in deploying and maintaining Docker containers and Kubernetes clusters.
Strong knowledge of CI/CD tools such as Jenkins, GitLab CI, or GitHub Actions.
Proficiency in scripting languages such as Python, Bash, or PowerShell.
Experience with cloud platforms like AWS, Google Cloud, or Azure.
Familiarity with monitoring and logging tools like Prometheus, Grafana, ELK Stack, or similar.
Understanding of network protocols, firewalls, VPNs, and security best practices.
Excellent problem-solving skills and the ability to work in a fast-paced environment.
Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Preferred Qualifications:

Experience with AI/ML platforms and tools.
Knowledge of database management systems such as PostgreSQL, MongoDB, or Elasticsearch.
Familiarity with infrastructure as code (IaC) tools like Terraform or Ansible.
Certification in Docker, Kubernetes, or cloud platforms.