Data Engineer at VerifyMe

Job Description

• Our ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
• As a data engineer, you will support the software developers, data analysts and data scientists on projects to ensure an optimal data delivery architecture.

Responsibilities

In this role, your tasks will include:

• Working with the team to understand data needs; defining and developing applications/architecture; performing source to target data mapping; designing, reviewing, implementing, and optimizing Data Engineering and ETL processes.
• Conducting exploratory data analysis, data cleaning & processing 
• Ensuring proper computational infrastructure is available to support development and iteration for projects
• Identifying, designing, and implementing internal process improvements for automating manual processes, optimizing data delivery, security, and scalability
• Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies.

Minimum Requirements

• Must have a solid understanding of Data structures, Algorithms and object oriented design
• Must have experience and/or knowledge of relational (e.g. Postgres), NOSQL (e.g. MongoDB/DynamoDB/Elasticsearch) data systems & distributed system concepts from a data storage and compute perspective.
• Must be able to write secure, stable, testable, maintainable code with minimal defects
• Must have experience with native AWS technologies for data storage, ETL and analytics such as S3, Lambda, API Gateway etc.
• Must have excellent communication skills
• Should have experience in application development and related open source technologies including microservices, RESTful APIs development
• Should have experience with DevOps toolchains for infrastructure deployment, software build/test/deploy, and systems/application monitoring/logging tools
• Should have good scripting and programming skills