Senior Site Reliability Engineer (Database) at Wikimedia Foundation

Job Description

• As a Senior Site Reliability Engineer for databases at the Wikimedia Foundation, you will be part of a small, focused team of skilled and experienced engineers. In this role, you will be responsible for ensuring the health of our database systems - including their availability and performance.
• Your responsibilities will include troubleshooting issues, planning for disaster recovery, and enhancing and maintaining backups.
• You do not have to be a database expert but must be willing to be trained to be one.
• The work we do is crucial and is used by hundreds of millions of people. This is a unique opportunity to have a huge impact.

Responsibilities

• Implementation, maintenance and troubleshooting of relational database systems in production and staging environments
• Database performance tuning, high availability, replication, backups, and general optimization
• Supporting the development and deployment of new services and systems
• Handling configuration management, (Debian) package maintenance, patching and building, working with upstream on bug identification and resolution
• Improving observability (alerting, metrics, monitoring) of database infrastructure
• Multi-datacenter design, capacity and infrastructure planning
• Taking part in incident response, diagnosis and follow-up on system outages or alerts across Wikimedia’s production infrastructure and participating in an on call rotation
• Sharing our values and work in accordance with them

Qualifications

• 5+ years experience in an DBA/SRE/Operations/DevOps role as part of a team
• Experience with Open Source configuration management and orchestration tools (Puppet, Ansible, Chef, SaltStack, etc.), as well as modern observability infrastructure (Prometheus, Grafana, Graphite, Logstash/Kibana, Icinga/Nagios, etc.)
• Advanced knowledge of Linux and IO/data storage concepts, internals and troubleshooting
• Experience with managing remotely both bare-metal servers and virtualized environments
• Proficient at automation/programming/scripting skills
• Experience with high traffic and highly available website architectures and operations
• Strong English language skills
• Ability to work independently in a fast paced environment, as an effective part of a globally distributed team, including ticket tracking systems and asynchronous communication tools
• B.S. or M.S. in Computer Science or equivalent work experience

Optional qualifications

• Advanced level of experience with MariaDB or MySQL database administration and replication topologies at scale
• Proficiency in SQL
• Solid knowledge of relational database concepts and working experience with storage systems and architecturesExperience with LAMP stack technologies (PHP/HHVM, memcached/Redis) - MediaWiki experience is a definite plus
• Experience with advanced distributed storage and database systems (Swift, Ceph, Cassandra, etc.) or graph databases (Titan, Blazegraph, etc.) is a big plus
• Experience in architecture, design, and implementation of persistent data storage & query infrastructure
• Strong track record of open source contributions is a major plus