Client is looking for a strong developer to build ML pipelines on Kubeflow, connecting components from BigQuery, Google Cloud Storage, and Dataproc, and deploying API end points. The ideal candidate should be an expert in leading projects in developing and testing data pipelines, data analytics efforts, proactive issue identification and resolution and alerting mechanism using traditional, new and emerging technologies.
Google Cloud Platform Data Engineer – Indeed
- Assembling large to complex sets of data that meet non-functional and functional requirements
- Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Building required infrastructure for optimal extraction, transformation and loading of data from various data sources
- Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- work on a multi-vendor multi-geo team support one of the complex enterprise environments
Mandatory Skill sets
The candidate will be expected to build ML pipelines on Kubeflow, connecting components from BigQuery, Google Cloud Storage, and Dataproc, and deploy API end points.
Technology expectations
- 3 + years of experience in BigQuery
- 3+ years of experience in Kubeflow, and Dataproc
- 3+ years of hands-on experience in API deployment and 1+ years of experience in Kubernetes
- 3+ experience in Google Cloud Platform environment
- Good knowledge on DevOps background and Python
- Strong verbal and written communication skills to effectively share findings with shareholders.
- Good understanding of web-based application development
- Should be an independent contributor from day one and be able to operate with minimal to no supervision
- A bachelor s degree in computer science or relevant fields is mandatory.
- Should be hands on and be able to work in an agile, fast-moving environment.
Must Have Skills
The candidate will be expected to build ML pipelines on Kubeflow, connecting components from BigQuery, Google Cloud Storage, and Dataproc, and deploy API end points.
- Technology expectations o 3 + years of experience in BigQuery
- 3+ years of experience in Kubeflow, and Dataproc
- 3+ years of hands-on experience in API deployment and 1+ years of experience in Kubernetes
- 3+ experience in Google Cloud Platform environment
- Good knowledge on DevOps background and Python