Pacific Northwest National Laboratory Jobs

Job Information

Pacific Northwest National Laboratory Senior Data Engineer - Data Streaming in RICHLAND, Washington

Organization and Job ID

Job ID: 310763

Directorate: National Security

Division: Computing and Analytics

Group: Software Engineering and Architectures

Job Description

Do you want to create cutting edge software and data technologies while working on the nation’s hardest problems? Do you enjoy engineering new data processing capabilities against large volumes of streaming data? Then consider a Senior Data Engineer position in the Software Engineering and Architectures Group at the Pacific Northwest National Laboratory (PNNL), where you will join a team of talented and dedicated professionals working in the areas of energy, the environment, and national security.

This Senior Data Engineer – Data Streaming position will focus on applying the latest in large-scale data streaming technologies to PNNL sponsor problems. This will include engineering cloud-scale data pipelines against high velocity and variety data streams and then integrating these with real-time analytics and machine learning capabilities.

The ideal candidate is a software engineer with substantial Data Streaming experience who understands the methods and pitfalls of working with Big Data. They build data pipelines that source and transform the data into the structures needed for analysis. These data pipelines must be well engineered for performance and reliability. This requires a strong understanding of software engineering best practices. Data engineering also uses monitoring and logging to help ensure reliability. They must design for performance and scalability to work with large data sets and demanding SLAs.

The ideal candidate will also possess qualities such as,

  • An interest, curiosity and technical depth to support the development and advancement of a variety of applied problems specific to the national security community

  • The ability and the desire to learn new technologies in this rapidly evolving field

  • Technical knowledge in configuring and deploying applications in multiple environments – cloud, container services, clusters

  • Excellent verbal and written communication skills

The Senior Data Engineer should have sophisticated working knowledge in several of the following related-skillsets:

  • 5+ years of experience programming in at least one object-oriented programming language such as Python, Java, C#, or C++ Indexing and summarizing large data-sets to enable high-performance analytics

  • Data pipeline development, in particular for real-time streaming data (e.g., Spark, Apache NiFi, Apache Kafka, Apache Pulsar, AWS Glue, Amazon Kinesis)

  • Optimizing database queries for efficient real-time processing

  • Scaling and maintaining cloud, real-time databases and data processing pipelines

  • Experience with big data platforms

  • Developing data-driven APIs for machine learning applications

  • Crafting data normalization models and rules

  • Leveraging existing open source technologies like ElasticSearch, Hadoop, Spark, PostgreSQL, and other tools

  • Knowledge of software engineering best practices and software project lifecycles

  • Experience with cloud platforms such as Amazon Web Services or Microsoft Azure


  • Apply knowledge of software engineering practices (e.g. source control, problem tracking, design principles, etc.) with minimal oversight

  • Take initiative to set personal direction and goals

  • Stay current about industry developments

  • Work collaboratively within a team to execute on the full system development life cycle

  • Maintain or follow quality assurance procedures

  • Demonstrate good time management skills

  • Be able to work with different technologies


  • You want to work in a lively environment full of scientists, engineers, and subject matter experts who love learning and thinking creatively

  • You want to have impact on people's lives and national security problems

  • You want to work in an environment where diversity and equality are highly valued

  • You want to build novel solutions to complex problems

  • You are independent in your every-day work, and self-directed in your career goal

The hiring level will be determined based on the education, experience and skill set of the successful candidate based on the following:

  • Level III : Manages small to moderate projects and/or major project tasks. Integrates intellectual and technical capabilities of work teams. Enhances technical/professional skills of junior staff through active mentoring and training. Generates ideas for new proposals and participates in business development activities

  • Level IV : Manages moderate to large projects and/or major project tasks. Integrates intellectual and technical capabilities of work teams. Enhances technical/professional skills of junior and senior staff through active mentoring and training. Generates ideas for new capabilities and participates in business development activities.

Minimum Qualifications

  • BS/BA with 5 years of experience MS/MA with 3 years of experience PhD with 1 year of experience

Preferred Qualifications

  • Bachelor's degree in computer science or closely related field with strong software design and development skills with 7 years' experience, or a master’s degree with 5 years' experience, or a Ph.D. with 3 years experience.

Equal Employment Opportunity

Battelle Memorial Institute (BMI) at Pacific Northwest National Laboratory (PNNL) is an Affirmative Action/Equal Opportunity Employer and supports diversity in the workplace. All employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, marital or family status, sexual orientation, gender identity, or genetic information. All BMI staff must be able to demonstrate the legal right to work in the United States. BMI is an E-Verify employer. Learn more at

Please be aware that the Department of Energy (DOE) prohibits DOE employees and contractors from participation in certain foreign government talent recruitment programs. If you are offered a position at PNNL and are currently a participant in a foreign government talent recruitment program you will be required to disclose this information before your first day of employment.

Other Information

This position requires the ability to obtain and maintain a federal security clearance.


  • U.S. Citizenship

  • Background Investigation: Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance 10 CFR 710, Appendix B.

  • Drug Testing: All Security Clearance (L or Q) positions will be considered by the Department of Energy to be Testing Designated Positions which means that they are subject to applicant, random, and for cause drug testing. In addition, applicants must be able to demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).

Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy until non-use of illegal drugs, including marijuana, for 12 consecutive months can be demonstrated.

Directorate: National Security

Job Category: Engineering/Engineering Techs

Group: Software Eng & Architectures

Opening Date: 2020-04-14

Closing Date: 2020-08-11