We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have a minimum of 4 years of experience managing data engineering jobs in Big Data environment e.g., Cloudera Data Platform. The successful candidate will be responsible for designing, developing and maintaining data ingestion and processing jobs.
Responsibilities
- Analyze and document client data requirements to inform and guide project initiatives
- Streamline data pipelines and refine data collection by migrating to more efficient channels
- Design and implement data engineering solutions, from ETL jobs to analytical reporting
- Develop comprehensive test plans and scripts and support user acceptance testing (UAT)
- Build custom reports and dashboards that align with user needs
- Collaborate with client technical teams to ensure seamless solution deployment and adoption
- Maintain the operational health and service levels of IT solutions
- Troubleshoot and resolve production issues in a timely manner
Requirements
- Proven experience completing projects using Waterfall or Agile methodologies
- Expert-level skills in SQL, data modeling and data analysis
- Hands-on experience with big data engineering using Python, PySpark, Linux, and ETL tools like Informatica
- Proficiency in a reporting or visualization tool such as SAP BusinessObjects or Tableau
- Familiarity with DevOps deployment and data virtualization tools like Denodo is a plus
- Track record of implementing systems using Hive, Impala, and Cloudera Data Platform
- Strong understanding of analytics and data warehouse architectures
- Ability to troubleshoot complex issues, from system resources to application stack traces
- Experience with high-availability, high-performance, and secure system implementations in on-premise or cloud environments is an advantage
- A passion for automation, standardization and best practices
- No visa sponsorship
We offer
- By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
- Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
- You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
- We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
- At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us
Life at EPAM
- EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team with inspiring careers.
- You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards 2023 and Silver in the SkillsFuture Employers Awards 2022 for our efforts in championing employees' skills development and building a lifelong learning culture at the workplace. You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.
Report job
