Scalable Data Engineer

Scalable Data Engineer
Company:

(Confidential)


Place:

Tennessee


Area:

Programmer

Scalable Data Engineer

Details of the offer

Requisition Id2773 Overview Oak Ridge National Lab (ORNL) is a home to several hundred of the brightest scientists working on internationally relevant, diverse problems ranging from advanced materials to supercomputing. The Advanced Data and Workflow Group (ADWG) in the Oak Ridge Leadership Computing Facility (OLCF) supports artificial intelligence, visualization, and data handling requirements for the worlds fastest supercomputers such as Summit. The ADWG is looking for a self:motivated and creative engineer who can develop software, tools and infrastructure to support the collection, wrangling, curation, and preservation of large:scale science datasets.
We are an inclusive environment that welcomes a diversity of creative, spunky scientists and engineers with an eagerness to learn.

Job Duties and Responsibilities

:

Participate in the planning, design, implementation, and testing of new software capabilities for a distributed scientific data management system supporting cutting:edge cross:facility data:oriented science.
:

Develop software applications/utilities, data pipelines, and/or workflows to interface ORNL experimental facilities with NCCS compute, and analytics resources.
:

Develop, deploy, and maintain data services/infrastructure on NCCS analytics resources (Scalable HPC, OpenStack, OpenShift)

:

Develop data storage and management solution for domain scientists. Specifically, use or develop software to robustly and routinely transfer 100s of GB to 10s of TB of data from multiple computers attached to scientific instrumentation to scalable data storage facilities
:

Document all the developed software and workflows for reproducibility
:

Assist uses of developed software in using the software, debugging problems.

Basic Requirements

:
Bachelors degree in Computer Science, Computer Engineering, or related field.
:
2+ years of experience developing and maintaining complex data science software and services.

Preferred Qualifications

:

Masters or Ph.D. degree in Electrical/Computer Engineering, Computer Science, or related field, and 3 years experience

:

Experience with Python,

Javascript

/JSON, database programming, and multi:tier architectures, in general
:

Experience in developing software for Linux / Unix operating systems, or developing cross:platform software
:

Experience using version control systems, project/issue tracking systems, and continuous integration services.

:
Strong verbal and written skills.

:
Strong grasp of mathematics, scientific computing, computer hardware, software, and infrastructure
:
Self:motivated person with the ability to manage multiple projects and stay on schedule, work with multiple people in a team in a collaborative manner.

:
Experience with

distributed databases and graph/multi:model databases such as
ArangoDB
, MongoDB, H:Base, Cassandra, etc.
:

Experience with message:oriented technologies such as

ZeroMQ

, RabbitMQ, Protocol Buffers, etc.
:
Experience in scripting languages including Ruby, Python, and
Javascript
:

Strong understanding of software development methodologies, best practices, and object:oriented design.
:

Experience with microservice architectures and software containers.
:

Experience developing graphical web applications using HTML5/CSS/JS or web development frameworks.
:
Strong experience in developing and deploying software on a variety of environments ranging from cloud, to high:performance computing

ORNL Ethics and Conduct:

As a member of the ORNL scientific community, you will be expected to commit to ORNLs Research Code of Conduct. Our full code of conduct, and a statement by the Lab Directors office can be found here:
ornl.gov/content/research:integrity

Benefits at ORNL:

UT Battelle offers an exceptional benefits package to include matching 401K, Pension Pla


Source: Tiptopjob_Xml


Area:

Requirements

Senior java developers

We've been in business since 2002 and our team is constantly growing. 98% of our company is comprised of Engineers focused on Software Construction including...


From Solution Street - Virginia

Published 22 days ago

Functional solutions architect

Job Summary The Functional Solutions Architect provide expertise to our clients in performing Business Process Management activities. The Functional Solutions...


From Flintfox - Colorado

Published 22 days ago

Staff accountant 1

A TOWN WHERE EVERY DETAIL, FROM VISION TO EXECUTION, MAKES LUXURY SEEM SIMPLE. From the moment one views the iconic butteries and towering palms lining the...


Florida

Published 22 days ago

Java developer

Position is with a 30 Billion Global corporation in the Dallas, TX area, but will initially be REMOTE due to Covid 19. Job Responsibilities Develop a deep...


Texas

Published 22 days ago