RESPONSIBILITIES

• Responsible for data development, modeling, simulation, testing, and quality assurance.
• Analyze user requirements, create technical specifications, writing and test code. Maintain systems by monitoring and correcting defects. Completing systems risk and reliability analysis.
• Monitor systems performance, perform maintenance and data integrations for existing systems, and maintain compliance with industry standards.
• Assemble large, complex sets of data that meet non-functional and functional business requirements
• Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automate manual processes
• Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies
• Build analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics including operational efficiency and customer acquisition
• Work with stakeholders including data, design, product and executive teams and assist them with data-related technical issues
• Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
• The Data Engineer should continually update technical knowledge and skills by attending in-house and external courses, reading manuals, and accessing new applications.
• Good security practices and experience writing code that manages customer data.
• Impeccable communication and team skills with shared ownership of code and other deliverables.
• Willingness to work with and learn new technologies.
• Excellent communication skills, which is essential to execute his duty to the juniors in the team.
• Technical Skills Needed

REQUIREMENT

• BS/MS in Computer Science, Engineering or Math is preferred.
• 5+ years experience designing and coding enterprise-level applications.
• Strong experience developing complex enterprise applications with Java, Python, and/or NodeJS.
• Experience with REST API architecture and development especially using Swagger.
• Strong knowledge of Git including version control, branching, merging/rebasing, and pull requests.
• Strong focus on automation including Continuous Integration / Deployment with writing unit and integration tests.
• Hands-on experience with SQL database design
• Demonstrated understanding and experience using software and tools including big data tools like Kafka, Spark and Hadoop; relational NoSQL and SQL databases including DynamoDB and Postgres
• Experience with the Java/Kotlin and/or Python languages.
• Experience architecting solutions in GCP and/or AWS specifically using workflow management and pipeline tools such as Airflow, Luigi and Azkaban;
• Familiarity with managed cloud services (e.g. GCP, AWS, Azure) and their associated offerings.
• Candidates must possess ample knowledge and experience in system automation, deployment, and implementation.
• Candidates must possess experience in using JIRA, Jenkins, Github, Github Actions and ample experience in configuring and automating the monitoring tools.

PREFERRED QUALIFICATIONS

• Familiarity with Docker and Serverless architectures like GCP Cloud Functions, AWS Lambda, DynamoDB, ECS, S3, GCP Pubsub, SQS, CloudFormation, Terraform, and/or other similar cloud services.
• Experience with Maven/Gradle build systems.
• Experience with Github Actions / Jenkins CI/CD pipelines.
• Understanding of BFF (Backend-for-Frontend) patterns.
• Experience with the development of self-healing, reliable and reactive systems.