About this roleAt BlackRock, technology has always been at the core of what we do – and today, our technologists continue to shape the future of the industry with their innovative work. We are not only curious but also collaborative and eager to embrace experimentation as a means to solve complex challenges. Here you’ll find an environment that promotes working across teams, businesses, regions and specialties – and a firm committed to supporting your growth as a technologist through curated learning opportunities, tech-specific career paths, and access to experts and leaders around the world.We are seeking a highly skilled and motivated Senior level Data Engineer to join the Private Market Data Engineering team within Aladdin Data at BlackRock for driving our Private Market Data Engineering vision of making private markets more accessible and transparent for clients. In this role, you will work multi-functionally with Product, Data Research, Engineering, and Program management.Engineers looking to work in the areas of orchestration, data modeling, data pipelines, APIs, storage, distribution, distributed computation, consumption and infrastructure are ideal candidates. The candidate will have extensive experience in developing data pipelines using Python, Java, Apache Airflow orchestration platform, DBT (Data Build Tool), Great Expectations for data validation, Apache Spark, MongoDB, Elasticsearch, Snowflake and PostgreSQL. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines. You will collaborate with various stakeholders to ensure the data pipelines are efficient, reliable, and meet the needs of the business.<h1>Key Responsibilities</h1><ul><li>Design, develop, and maintain data pipelines using Aladdin Data Enterprise Data Platform framework</li><li>Develop ETL/ELT data pipelines using Python, SQL and deploy them as containerized apps on a Kubernetes cluster</li><li>Develop API for data distribution on top of the standard data model of the Enterprise Data Platform</li><li>Design and develop optimized back-end services in Java / Python for APIs to handle faster data retrieval and optimized processing</li><li>Develop reusable back-end services for data pipeline processing in Python / Java</li><li>Develop data transformation using DBT (Data Build Tool) with SQL or Python</li><li>Ensure data quality and integrity through automated testing and validation using tools like Great Expectations</li><li>Implement all observability requirements in the data pipeline</li><li>Optimize data workflows for performance and scalability</li><li>Monitor and troubleshoot data pipeline issues, ensuring timely resolution</li><li>Document data engineering processes and best practices whenever required</li></ul><h1>Required Skills and Qualifications</h1><ul><li>Must have 5 to 8 years of experience in data engineering, with a focus on building data pipelines and Data Services APIs</li><li>Strong server-side programming skills in Python and/or Java.Experience working with backend microservices and APIs using Java and/or Python</li><li>Experience with Apache Airflow or any other orchestration framework for data orchestration</li><li>Proficiency in DBT for data transformation and modeling</li><li>Experience with data quality validation tools like Great Expectations or any other similar tools</li><li>Strong at writing SQL and experience with relational databases like SQL Server, PostgreSQL</li><li>Experience with cloud-based data warehouse platform like Snowflake</li><li>Experience working on NoSQL databases like Elasticsearch and MongoDB</li><li>Experience working with container orchestration platform like Kubernetes on AWS and/or Azure cloud environments</li><li>Experience on Cloud platforms like AWS and/or Azure</li><li>Ability to work collaboratively in a team environment</li><li>Need to possess critical skills of being detail oriented, passion to learn new technologies and good analytical and problem-solving skills</li><li>Experience with Financial Services application is a plus</li><li>Effective communication skills, both written and verbal</li><li>Bachelor’s or Master’s degree in computer science, Engineering, or a related field</li></ul>Our benefits To help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about.Our hybrid work modelBlackRock’s hybrid work model is designed to enable a culture of collaboration and apprenticeship that enriches the experience of our employees, while supporting flexibility for all. Employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week. Some business groups may require more time in the office due to their roles and responsibilities. We remain focused on increasing the impactful moments that arise when we work together in person – aligned with our commitment to performance and innovation. As a new joiner, you can count on this hybrid model to accelerate your learning and onboarding experience here at BlackRock.About BlackRockAt BlackRock, we are all connected by one mission: to help more and more people experience financial well-being.  Our clients, and the people they serve, are saving for retirement, paying for their children’s educations, buying homes and starting businesses. Their investments also help to strengthen the global economy: support businesses small and large; finance infrastructure projects that connect and power cities; and facilitate innovations that drive progress.This mission would not be possible without our smartest investment – the one we make in our employees. It’s why we’re dedicated to creating an environment where our colleagues feel welcomed, valued and supported with networks, benefits and development opportunities to help them thrive.For additional information on BlackRock, please visit <a href="http://careers.blackrock.com/" target="_blank">@blackrock</a> | Twitter: <a href="https://twitter.com/blackrock" target="_blank">@blackrock</a> | LinkedIn: <a href="http://www.linkedin.com/company/blackrock" target="_blank">www.linkedin.com/company/blackrock</a><div></div><div></div>BlackRock is proud to be an Equal Opportunity Employer.  We evaluate qualified applicants without regard to age, disability, family status, gender identity, race, religion, sex, sexual orientation and other protected attributes at law.

BlackRock

Associate - Data Engineer

BlackRock

Similar Remote Jobs