Pacific Northwest National Laboratory Senior Data Engineer - Data Streaming in RICHLAND, Washington
Organization and Job ID
Job ID: 310763
Directorate: National Security
Division: Computing and Analytics
Group: Software Engineering and Architectures
Do you want to create cutting edge software and data technologies while working on the nation’s hardest problems? Do you enjoy engineering new data processing capabilities against large volumes of streaming data? Then consider a Senior Data Engineer position in the Software Engineering and Architectures Group at the Pacific Northwest National Laboratory (PNNL), where you will join a team of talented and dedicated professionals working in the areas of energy, the environment, and national security.
This Senior Data Engineer – Data Streaming position will focus on applying the latest in large-scale data streaming technologies to PNNL sponsor problems. This will include engineering cloud-scale data pipelines against high velocity and variety data streams and then integrating these with real-time analytics and machine learning capabilities.
The ideal candidate is a software engineer with substantial Data Streaming experience who understands the methods and pitfalls of working with Big Data. They build data pipelines that source and transform the data into the structures needed for analysis. These data pipelines must be well engineered for performance and reliability. This requires a strong understanding of software engineering best practices. Data engineering also uses monitoring and logging to help ensure reliability. They must design for performance and scalability to work with large data sets and demanding SLAs.
The ideal candidate will also possess qualities such as,
An interest, curiosity and technical depth to support the development and advancement of a variety of applied problems specific to the national security community
The ability and the desire to learn new technologies in this rapidly evolving field
Technical knowledge in configuring and deploying applications in multiple environments – cloud, container services, clusters
Excellent verbal and written communication skills
The Senior Data Engineer should have sophisticated working knowledge in several of the following related-skillsets:
5+ years of experience programming in at least one object-oriented programming language such as Python, Java, C#, or C++ Indexing and summarizing large data-sets to enable high-performance analytics
Data pipeline development, in particular for real-time streaming data (e.g., Spark, Apache NiFi, Apache Kafka, Apache Pulsar, AWS Glue, Amazon Kinesis)
Optimizing database queries for efficient real-time processing
Scaling and maintaining cloud, real-time databases and data processing pipelines
Experience with big data platforms
Developing data-driven APIs for machine learning applications
Crafting data normalization models and rules
Leveraging existing open source technologies like ElasticSearch, Hadoop, Spark, PostgreSQL, and other tools
Knowledge of software engineering best practices and software project lifecycles
Experience with cloud platforms such as Amazon Web Services or Microsoft Azure
EXPECTED OF YOU:
Apply knowledge of software engineering practices (e.g. source control, problem tracking, design principles, etc.) with minimal oversight
Take initiative to set personal direction and goals
Stay current about industry developments
Work collaboratively within a team to execute on the full system development life cycle
Maintain or follow quality assurance procedures
Demonstrate good time management skills
Be able to work with different technologies
WHY WE SHOULD TALK:
You want to work in a lively environment full of scientists, engineers, and subject matter experts who love learning and thinking creatively
You want to have impact on people's lives and national security problems
You want to work in an environment where diversity and equality are highly valued
You want to build novel solutions to complex problems
You are independent in your every-day work, and self-directed in your career goal
The hiring level will be determined based on the education, experience and skill set of the successful candidate based on the following:
Level III : Manages small to moderate projects and/or major project tasks. Integrates intellectual and technical capabilities of work teams. Enhances technical/professional skills of junior staff through active mentoring and training. Generates ideas for new proposals and participates in business development activities
Level IV : Manages moderate to large projects and/or major project tasks. Integrates intellectual and technical capabilities of work teams. Enhances technical/professional skills of junior and senior staff through active mentoring and training. Generates ideas for new capabilities and participates in business development activities.
- BS/BA with 5 years of experience MS/MA with 3 years of experience PhD with 1 year of experience
- Bachelor's degree in computer science or closely related field with strong software design and development skills with 7 years' experience, or a master’s degree with 5 years' experience, or a Ph.D. with 3 years experience.
Equal Employment Opportunity
Battelle Memorial Institute (BMI) at Pacific Northwest National Laboratory (PNNL) is an Affirmative Action/Equal Opportunity Employer and supports diversity in the workplace. All employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, marital or family status, sexual orientation, gender identity, or genetic information. All BMI staff must be able to demonstrate the legal right to work in the United States. BMI is an E-Verify employer. Learn more at jobs.pnnl.gov.
Please be aware that the Department of Energy (DOE) prohibits DOE employees and contractors from participation in certain foreign government talent recruitment programs. If you are offered a position at PNNL and are currently a participant in a foreign government talent recruitment program you will be required to disclose this information before your first day of employment.
This position requires the ability to obtain and maintain a federal security clearance.
Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance 10 CFR 710, Appendix B.
Drug Testing: All Security Clearance (L or Q) positions will be considered by the Department of Energy to be Testing Designated Positions which means that they are subject to applicant, random, and for cause drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy until non-use of illegal drugs, including marijuana, for 12 consecutive months can be demonstrated.
Directorate: National Security
Job Category: Engineering/Engineering Techs
Group: Software Eng & Architectures
Opening Date: 2020-04-14
Closing Date: 2020-08-11