Data Engineer

Location: Chantilly, VA

BT-393 – Data Engineer
Location- Chantilly



**MUST HAVE A TS/SCI CLEARANCE TO APPLY. Those without an active security clearance will not be considered.**





Bespoke Technologies is seeking a Software Developer to provide ETL, Data Engineering, and Full-Stack Software Development support

Required Skills:

• Demonstrates experience designing and maintaining enterprise-grade ETL/ELT pipelines, both batch and real-time.
• Demonstrates front-end development and implementation skills, using React, Next.js, or similar.
• Demonstrates back-end development using Python, Java, Scala, and microservices architecture.
• Demonstrates experience with API design.
• Demonstrates experience with containerization, using Docker.
• Demonstrates experience with CI/CD pipelines.
• Demonstrates experience with infrastructure-as-code patterns.
• Demonstrates experience with probabilistic models, risk scoring, Bayesian inference, Monte Carlo simulation, and probabilistic graphical models.
• Demonstrates experience applying statistical modeling tools.
• Demonstrates experience with designing cloud-native architectures using cloud services such as AWS, Google, IBM, and Oracle
• Demonstrates experience designing and operating big data systems
• Demonstrates experience building and optimizing performance of large scale graph databases (tens of billions of edges) using DynamoDB or new enhanced capabilities
• Demonstrates experience developing and operating graph traversal capabilities using data graphing tool traversal capabilities built upon Apache Gremlin or new enhanced capabilities
• Demonstrates experience developing and operating NoSQL solutions to complex big data applications
• Demonstrates experience in data modeling for performance, partition sharding, record/event aggregation workflows, stream processing, and metrics gathering
• Demonstrates experience designing and operating large-scale serverless geospatial indexes built with GeoMESA
• Demonstrates experience with partition and sort key design and implementation to ensure consistent performance
• Demonstrates experience with aggregation operations to de-duplicate records on continuous data feeds
• Demonstrates subject matter expertise experience with relational databases to noSQL
• Demonstrates experience building and operating high performance data processing pipelines using Lambda, Step Functions and PySpark
• Demonstrates experience building high quality User Interface/User experiences with the React framework and webGL
• Demonstrates experience designing and operating large scale graph databases using Apache Cassandra
• Demonstrates experience performing in-depth technical analysis of large-scale graph databases to develop implementation strategies for search optimizations
• Demonstrates experience developing technical capabilities for processing, persistence and search of datasets that are collected or maintained using standards common in the Sponsors community
• Demonstrates experience facilitating engineering discussions across teams representing multiple stakeholders to develop and execute implementation strategies that meet mission needs
• Demonstrates experience developing Machine Learning Operations (MLOps) pipelines for large scale application
• Demonstrates experience maintaining configuration of software using configuration management resources such as GitHub
• Demonstrates experience designing, building and operating big data systems, such as persistence, partitioning, indexing, at scale of trillions of records/events
• Demonstrates experience with Niagara Files (NiFi) applications or new enhanced capabilities
• Demonstrates experience developing and operating Kubernetes infrastructure
• Demonstrates experience supporting engineering efforts that will contribute to delivery of capabilities such as datasets and functionality such as communications, geospatial workflows
• Demonstrates experience implementing DevSecOps and agile development in production environments
• Demonstrates experience with agile software development and testing
• Demonstrates experience with federal security, regulatory and compliance requirements and security accreditation package development
• Demonstrates experience with data security and governance using centralized security controls like LDAP, encrypting the data, and auditing access to the data
• Demonstrates experience with specialized technologies that are optimized for the particular use of the data, such as relational databases, a NoSQL database (Cassandra), or object storage
• Demonstrates experience with Apache, TINKERPOP, GREMLIN and/or JANUSGRAPH to design, develop, implement and maintain system
• Demonstrates knowledge of Graph Database to design, develop, implement and maintain system
• Demonstrates experience with C or C++ to write interfaces
• Demonstrates experience using centralized security controls like LDAP, encrypting data, and auditing access to data
• Demonstrates experience with:

• Databases: Postgres, MariaDB, ELK, Minio, AWS S3, Neo4j, MongoDB, noSQL
• Languages: Python (pypi libraries)
• Operating Systems: Centos7, RockyLinux8
• Orchestration: Kubernetes, Docker, Docker-Compose, Docker-Swarm
• Development Tools: vscode, gitlab, jupyterhub/notebooks, MATLAB
• Environments: large collaboration and development environments
• Data types: Unstructured, structured, or semi-structured data, including: CSV, JSON, JSONL, AVRO, Protocol Buffers, Parquet, etc

• Demonstrates experience with designing cloud-native architectures using Sponsors cloud services
• Demonstrates experience designing and operating big data systems within the Sponsors policy and regulatory environment
• Demonstrates experience developing and operating graph traversal capabilities using the Sponsors data graphing tool traversal capabilities built upon Apache Gremlin
• Demonstrates experience building and operating high performance data processing pipelines using Lambda, Step Functions and PySpark on the Sponsors infrastructure with EMR
• Demonstrates experience working with the Sponsors enterprise services used for Data Management, including the enterprise catalog service (and associated APIs), and Policy Decision Points (PDPs).
• Demonstrates experience developing Machine Learning Operations (MLOps) pipelines for large scale application in the Sponsors environment
• Demonstrates experience and understanding of IT Service Management and common SLA measurements
• Demonstrates experience presenting solutions, requirements, and presentations to diverse audiences.
• Demonstrates experience working with container orchestration technologies such as AWS ECS, AWS Fargate, and Kubernetes or other enhanced capabilities available
• Demonstrates experience in managing large operational cloud environments spanning multiple tenants using Multi-Account management, AWS Well Architected Best Practices, and AWS Organization Units/Service Control Policies (OU/SCP).
• Demonstrates experience with Micro-services such as building decoupled systems, utilizing RESTful endpoints and lightweight systems
• Demonstrates experience in total systems perspectives, including a technical understanding of systems and applications relationships, dependencies, and requirements of hardware and software components
• Demonstrates experience consulting with customers to determine present and future user needs
• Demonstrates experience providing frequent contact with customers, traceability within program documents, and the overall computing environment and architecture

• AWS Certified Solutions Architect
• AWS Machine Learning Certification(s)
• Agile certification
• Azure
• Security+
• GSEC
• CCNA