Data Engineer @ Qcells - Remote

Job Overview

17 days ago

Data Engineer

Qcells - Remote

Position Overview

We're looking for a seasoned Data Engineer to help our team build massively scalable consumer systems for clean energy. As a Data Engineer, you’ll help lead technical direction for respective engineering solutions at Hanwha Q Cells. As a Data Engineer, you’ll help lead technical direction for all data engineering solutions at Hanwha Q Cells and will also lead the way in transforming our systems to self-healing, reliable and reactive systems.
Want to work on massively scalable consumer systems? Re-invent how consumers use energy? Have a measurable impact on one of humanity’s biggest challenges? Come to Hanwha Q Cells. You'll work alongside passionate engineers engaged in the design and development of a product that is changing the world.


RESPONSIBILITIES

  • Responsible for data development, modeling, simulation, testing, and quality assurance.
  • Analyze user requirements, create technical specifications, writing and test code. Maintain systems by monitoring and correcting defects. Completing systems risk and reliability analysis.
  • Monitor systems performance, perform maintenance and data integrations for existing systems, and maintain compliance with industry standards.
  • Assemble large, complex sets of data that meet non-functional and functional business requirements
  • Identify, design and implement internal process improvements including re-design infrastructure for greater scalability, optimize data delivery, and automate manual processes
  • Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS and SQL technologies
  • Build analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics including operational efficiency and customer acquisition
  • Work with stakeholders including data, design, product and executive teams and assist them with data-related technical issues
  • Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
  • The Data Engineer should continually update technical knowledge and skills by attending in-house and external courses, reading manuals, and accessing new applications.
  • Good security practices and experience writing code that manages customer data.
  • Impeccable communication and team skills with shared ownership of code and other deliverables.
  • Willingness to work with and learn new technologies.
  • Excellent communication skills, which is essential to execute his duty to the juniors in the team.
  • Technical Skills Needed

REQUIREMENT

  • BS/MS in Computer Science, Engineering or Math is preferred.
  • 5+ years experience designing and coding enterprise-level applications.
  • Strong experience developing complex enterprise applications with Java, Python, and/or NodeJS.
  • Experience with REST API architecture and development especially using Swagger.
  • Strong knowledge of Git including version control, branching, merging/rebasing, and pull requests.
  • Strong focus on automation including Continuous Integration / Deployment with writing unit and integration tests.
  • Hands-on experience with SQL database design
  • Demonstrated understanding and experience using software and tools including big data tools like Kafka, Spark and Hadoop; relational NoSQL and SQL databases including DynamoDB and Postgres
  • Experience with the Java/Kotlin and/or Python languages.
  • Experience architecting solutions in GCP and/or AWS specifically using workflow management and pipeline tools such as Airflow, Luigi and Azkaban;
  • Familiarity with managed cloud services (e.g. GCP, AWS, Azure) and their associated offerings.
  • Candidates must possess ample knowledge and experience in system automation, deployment, and implementation.
  • Candidates must possess experience in using JIRA, Jenkins, Github, Github Actions and ample experience in configuring and automating the monitoring tools.


PREFERRED QUALIFICATIONS

  • Familiarity with Docker and Serverless architectures like GCP Cloud Functions, AWS Lambda, DynamoDB, ECS, S3, GCP Pubsub, SQS, CloudFormation, Terraform, and/or other similar cloud services.
  • Experience with Maven/Gradle build systems.
  • Experience with Github Actions / Jenkins CI/CD pipelines.
  • Understanding of BFF (Backend-for-Frontend) patterns.
  • Experience with the development of self-healing, reliable and reactive systems.

Physical, Mental, & Physical Demands

To comply with the Rehabilitation Act of 1973 the essential physical, mental and environmental requirements for this job are listed below. These are requirements normally expected to perform regular job duties. Incumbent must be able to successfully perform all of the functions of the job with or without reasonable accommodation.

Mobility
Standing: 20% of time
Sitting: 70% of time
Walking: 10% of time

Strength
Pulling: up to 10 Pounds
Pushing: up to 10 Pounds
Carrying: up to 10 Pounds
Lifting: up to 10 Pounds

Agility
(F = Frequently, O = Occasionally, N = Never)
Turning: F
Twisting: F
Bending: O
Crouching: O
Balancing: N
Climbing: N
Crawling: N
Kneeling: N

Dexterity
(F = Frequently, O = Occasionally, N = Never)
Typing: F
Handling: F
Reaching: F

Similar Jobs

Senior Data Engineer

iRhythm Technologies

San Diego, CA

Navigate new data sets frequently and model data efficiently and effectively. Assist with production issues in data warehouses like reloading data,…

Sr. Software Development Engineer - AWS Kinesis Data Firehose

Amazon Dev Center U.S., Inc.

Santa Monica, CA

Strong Computer Science fundamentals in algorithms and data structures. Amazon Kinesis Firehose is a new fully managed service to load streaming data into AWS.

Data Engineer - Enterprise Data Fabric

Amgen

Los Angeles, CA

Enable data consumers to realize value by understanding their business problem, offering data guidance, and creating data toolkits/services.

Data Engineer - TRAINING

PCS Global Tech

San Diego, CA

Technical expertise with data models, data mining, and segmentation techniques. Previous experience as a data engineer or in a similar role (such as internships…

Data Warehouse Engineer - Bootcamp

PCS GLOBAL TECH

Poway, CA

Work with other data engineers and analysts to build new and extend existing data structures. Develop, maintain, and support ETL processes for loading data from…

Azure Data Engineer

Deloitte

Los Angeles, CA

Experience operating and maintaining an existing Microsoft SQL Server data warehouse using a variety of data integration technologies.

Data Engineer

Amazon.com Services LLC

San Diego, CA

Familiarity with data quality automation. Proven success in communicating with users, other technical teams, and senior management to collect requirements,…

Software Engineer - Customer Data Services, Cash App

Cash App

Los Angeles, CA

Experience handling customer data at a non-trivial scale. A desire to teach, improve, and otherwise force multiply the strengths of the engineers that surround…

Data Engineer - Platform

Live Nation

Los Angeles, CA

An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems is…

Data Engineer - Marketing Business Partners Support

Square

Los Angeles, CA

Develop data model and make ETL code improvements to improve pipeline efficiency and data quality. Analyze new data sources and work with stakeholders to…

Staff Engineer - DevOps & Release - Big Data - Federal

ServiceNow

San Diego, CA

Responsible for enforcing data governance policies in Commercial and Regulated Big Data environments. Collecting, storing, and providing real-time access to…

Data Analytics Engineer (Hybrid)

The Wonderful Company

Los Angeles, CA

Proficient in writing SQL to extract data from data warehouses & build complex data models. Understand business requirements in BI context and design efficient…

Test Data Management (TDM) Engineer - 210269a

Bridgewater Consulting Group

Rosemead, CA

5+ years of experience working on test data management tools executing data life cycle activities such as data acquisition, data masking, data orchestration,…

Senior Data Engineer

Saatchi & Saatchi (We Are Saatchi)

El Segundo, CA

An ideal candidate should have hands-on experience working with large data sets, finding the best ways to engineer the data to help develop critical KPI metrics…

Big Data Systems Engineer

BYD NORTH AMERICA

Los Angeles, CA

Familiar with the basic principles of CAN network, understand the function of TBOX, have vehicle bus data analysis ability, and be proficient in using various…

Lead Data Engineer, Engagement and Retention

Disney Media & Entertainment Distribution

Santa Monica, CA

Help architect data solutions/frameworks and define data models for the underlying data warehouse and data marts. Familiar with Scrum and Agile methodologies.

Data Engineer

Pragmatics

San Diego, CA

Five (5) or more years of experience within the past ten (10) years in: data integration; data engineering; data operations (DataOps); data warehouse modeling…

Lead Data Engineer - Venture Portfolio Company

BCG Digital Ventures

Manhattan Beach, CA

Demonstrate expertise for data at all levels: low-latency, relational, and unstructured data stores; analytical and data lakes; data streaming, data in-transit.

Senior Staff Data Visualization Software Engineer

indie Semiconductor

Aliso Viejo, CA

Parsing point cloud data from an embedded ADAS sensor system in real time. Merging multiple different types of data arising from the sensor in a common…

Data Converter Senior Staff / Principal Analog IC Design Engineer

indie Semiconductor

Aliso Viejo, CA

High-speed clocking and/or data converter experience is desirable. We focus on edge sensors spanning multiple modalities including LiDAR, radar, ultrasound and…

Data Engineer

TriMark USA

Irvine, CA

Generate reports on data metrics like throughput (along points in the pipelines), accumulated data, dataset quality profiles, etc.

Senior Data Engineer

Auction.com

Irvine, CA

Create data environment to support our data analytics, reporting and data science teams. Build and automate productized data processing pipelines in AWS big…

Senior Data Engineer for Education Start up

Recruiting From Scratch

El Segundo, CA

Proven passion and talent for teaching fellow engineers and non-engineers. Strong knowledge of SQL, of datastores and their tradeoffs (including relational,…

Senior Data Engineer for Education Start up

Recruiting From Scratch

Los Angeles, CA

Proven passion and talent for teaching fellow engineers and non-engineers. Strong knowledge of SQL, of datastores and their tradeoffs (including relational,…