- Design and develop distributed systems that support the data infrastructure for our streaming service.
- Maintain and optimize existing data platforms to ensure they are scalable, reliable, and efficient.
- Work closely with cross-functional teams, including content, analytics, and engineering, to understand data needs and design solutions that meet their requirements.
- Monitor and troubleshoot data platform performance and identify and resolve any issues that may arise.
- Stay up-to-date with the latest data processing technologies and make recommendations for their adoption if appropriate.
- Collaborate with other engineers to ensure data platforms are integrated with other systems and services.
- Conduct thorough testing and documentation of all data systems to ensure their functionality and reliability.
- Develop and implement data security protocols to protect sensitive information.
- Participate in code reviews and provide constructive feedback to ensure high-quality code and adherence to best practices.
- Continuously analyze and improve data processing workflows to optimize performance and efficiency.
- Communicate project updates and progress to team members and stakeholders.
- Mentor and guide junior team members, sharing knowledge and best practices.
- Take ownership of assigned tasks and projects and see them through to completion.
- Adhere to company policies and procedures, including security protocols and coding standards.
- Collaborate with other teams to troubleshoot and resolve system issues in a timely manner.
-
In-Depth Knowledge Of Distributed Systems Architecture And Design Principles
-
Proficiency In Programming Languages Such As Java, Python, Or Scala, And Experience With Distributed Data Processing Frameworks Like Hadoop, Spark, Or Flink
-
Strong Understanding Of Data Storage And Retrieval Technologies, Including Nosql Databases And Data Warehousing Solutions
-
Experience With Cloud Computing Platforms, Such As Aws, Azure, Or Google Cloud, And The Ability To Deploy And Maintain Systems In A Distributed Environment
-
Excellent Problem-Solving And Troubleshooting Skills, And The Ability To Identify And Resolve Performance Bottlenecks In Complex Distributed Systems.
-
Database Management
-
Big Data
-
Data Modeling
-
Distributed Systems
-
Automation
-
Cloud Computing
-
Performance Optimization
-
System Architecture
-
Infrastructure Management
-
Scalability
-
Data Streaming
-
Fault Tolerance
-
Communication
-
Conflict Resolution
-
Leadership
-
Time Management
-
Interpersonal Skills
-
Creativity
-
Attention To Detail
-
Teamwork
-
Adaptability
-
Problem-Solving
According to JobzMall, the average salary range for a Distributed Systems Engineer – Data Platform is between $115,000 to $160,000 per year. However, salary can vary depending on factors such as location, experience, and the specific company and industry. Additionally, some companies may offer additional benefits such as bonuses, stock options, and other perks.