We are seeking a highly skilled and experienced Senior Spark Developer to join our team. This role demands a deep understanding of Apache Spark and its ecosystem, along with a strong foundation in Java/J2EE application development. You will be responsible for designing, developing, and optimizing Spark-based solutions to process large volumes of data, collaborating with various teams to deliver high-performance and scalable data applications. This is a challenging and rewarding opportunity to contribute to a cutting-edge data engineering team.Responsibilities:<ul><li>Design, develop, and implement complex Spark applications for processing large datasets, leveraging your expertise in distributed computing and data manipulation techniques.</li><li>Partner with management teams to integrate Spark-based solutions into existing data infrastructure, ensuring seamless data flow and optimal performance.</li><li>Resolve critical data processing challenges by evaluating complex business processes, system processes, and industry standards, applying your deep understanding of Sparks capabilities.</li><li>Provide technical leadership and mentorship to other engineers, guiding them on Spark best practices and promoting efficient development strategies.</li><li>Develop and maintain coding standards, testing procedures, and debugging techniques specifically for Spark applications.</li><li>Contribute to the overall data architecture, ensuring that Spark solutions align with business goals and integrate effectively with other data technologies.</li><li>Appropriately assess risk when making technical decisions, considering factors such as data security, performance, and scalability.</li><li>Drive compliance with applicable laws, rules, and regulations, adhering to company policies and demonstrating sound ethical judgment.</li></ul>Qualifications:<ul><li>6+ years of application development experience, with a significant focus on Java/J2EE and Apache Spark.</li><li>Strong command of Object-Oriented Programming (OOP) principles and design patterns in Java.</li><li>Excellent understanding of data structures and algorithms, and their application in Spark development.</li><li>Proven experience developing complex Java/J2EE applications, encompassing all areas of the technology stack.</li><li>Thorough knowledge and hands-on experience with Hadoop, MapReduce, YARN, Sqoop, Pig, Hue, Unix, Impala, and Cassandra on Mesos.</li><li>Extensive experience designing, developing, and deploying Spark applications in a production environment, handling large volumes of data.</li><li>Deep understanding of Spark architecture, including Spark SQL, Spark Streaming, RDDs, and DataFrames.</li><li>Experience with ETL and BI tools is a plus.</li><li>Experience working in an agile environment using Scrum methodologies.</li><li>Expertise in designing and optimizing software solutions for performance and stability, particularly in the context of Spark.</li><li>Expertise in troubleshooting and problem-solving complex technical issues.</li><li>Experience with test-driven development (TDD).</li><li>Cloudera certification (CCDH) is an added advantage.</li></ul>Preferred Qualifications:<ul><li>Experience with cloud-based Spark platforms (e.g., Databricks, AWS EMR, Azure HDInsight).</li><li>Experience with other big data technologies (e.g., Kafka, Hive, HBase).</li><li>Experience with data visualization tools and techniques.</li></ul>Education:<ul><li>Bachelors degree in Computer Science, Engineering, or a related field.</li></ul><div></div> This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.------------------------------------------------------Job Family Group: Technology------------------------------------------------------Job Family:Applications Development------------------------------------------------------Time Type:Full time------------------------------------------------------Primary Location Full Time Salary Range:$120,800.00 - $170,800.00------------------------------------------------------Most Relevant Skills Please see the requirements listed above.------------------------------------------------------Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review <a href="https://www.citigroup.com/citi/accessibility/application-accessibility.htm" target="_blank">Accessibility at Citi</a>. View Citi’s <a href="https://www.citigroup.com/global/eeo-aa-policy" target="_blank">EEO Policy Statement</a> and the <a href="https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12ScreenRdr.pdf" target="_blank">Know Your Rights</a> poster.

Citi

Similar Remote Jobs