Data Engineer – Big Data Platforms<div></div>Job Summary:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in Big Data platforms and a strong background in designing, developing, and maintaining data pipelines. You will be responsible for ensuring data quality, optimizing data workflows, and working with distributed data systems. This role requires a deep understanding of modern data engineering workflows, ETL processes, and large-scale data processing.<div></div>Key Responsibilities:Data Engineering:<ul><li>Design, develop, and maintain scalable and efficient data pipelines to support business needs.</li><li>Implement ETL/ELT processes to extract, transform, and load data from various sources into Big Data platforms.</li><li>Optimize data workflows for performance, scalability, and reliability.</li></ul>Big Data Platforms:<ul><li>Work with Big Data technologies such as Hadoop, Spark, Hive, or HDFS to process and analyze large datasets.</li><li>Develop distributed data processing pipelines using Spark (PySpark/Scala) and MapReduce.</li><li>Optimize Big Data workflows for performance and scalability.</li></ul>Data Integration:<ul><li>Integrate data from multiple sources, including APIs, flat files, and third-party systems.</li><li>Collaborate with data analysts, data scientists, and business teams to understand data requirements.</li></ul>Data Quality and Governance:<ul><li>Ensure data accuracy, consistency, and integrity across systems.</li><li>Implement data validation and error-handling mechanisms.</li></ul>Collaboration and Documentation:<ul><li>Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.</li><li>Document data pipelines, data designs, and processes for future reference.</li></ul><div></div>Required Skills and Qualifications:<ul><li>Technical Expertise:<ul><li>Expertise in Big Data platforms:<ul><li>Experience with Hadoop, Spark (PySpark/Scala), Hive, or HDFS for distributed data processing.</li></ul></li><li>Proficiency in SQL and database design principles.</li><li>Experience with ETL/ELT tools (e.g., Informatica, Talend, or Python-based ETL frameworks).</li></ul></li><li>Programming Skills:<ul><li>Proficiency in scripting languages such as Python, Scala, or Shell scripting for data processing and automation.</li></ul></li><li>Data Governance:<ul><li>Knowledge of data quality, data governance, and data security best practices.</li></ul></li><li>Soft Skills:<ul><li>Strong problem-solving and analytical skills.</li><li>Excellent communication and collaboration skills.</li></ul></li></ul>Ability to work in a fast-paced, dynamic environment.  Qualifications:<ul><li>7-9 years of relevant experience</li><li>Experience in systems analysis and programming of software applications</li><li>Experience in managing and implementing successful projects</li><li>Working knowledge of consulting/project management techniques/methods</li><li>Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements</li></ul> Education:<ul><li>Bachelor’s degree/University degree or equivalent experience</li></ul> This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.------------------------------------------------------Job Family Group: Technology------------------------------------------------------Job Family:Applications Development------------------------------------------------------Time Type:Full time------------------------------------------------------Most Relevant Skills Please see the requirements listed above.------------------------------------------------------Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review <a href="https://www.citigroup.com/citi/accessibility/application-accessibility.htm" target="_blank">Accessibility at Citi</a>. View Citi’s <a href="https://www.citigroup.com/global/eeo-aa-policy" target="_blank">EEO Policy Statement</a> and the <a href="https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf" target="_blank">Know Your Rights</a> poster.

Citi

Senior Data Engineer - Assistant Vice President

Citi

Similar Remote Jobs