*Must pass a drug test and background check once offered position*


Scope of Work:

The resource will be supporting an engineering team tasked with building out a research data platform which will ingest and make discoverable research generated data. Data Engineering

Skills & Experience:

-Create, verify, and maintain data replication scripts
-Create, verify, and maintain data validation, processing, and ingestion pipelines
-Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
–Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
-Create, verify, and maintain dashboards and reports that characterize ingested datasets
-Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range.
-Deploy and automate the execution of data validation scripts/APIs
-Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
-Define entitlements, user groups, roles, and permissions utilized to grant access to datasets

Programming Languages:

Primary pipeline development language with be python. Some datatypes and formats may require the use of other languages (i.e. java, R, etc.) because the libraries/frameworks/sdks available to work with those datatypes and formats are not available in python

Operating Systems: Primary operating system for data pipeline execution will be linux, with data pipelines packaged, deployed, and run as containers. Data source systems could be windows or linux based.

Infrastructure:

Primary data platform and data pipeline execution infrastructure will be hosted on Google Cloud Platform (GCP) utilizing cloud native technologies (i.e. Google Cloud Storage, BigQuery, Google Batch, Dataflow, Cloud SQL, etc.). Data will be replicated from various on-premises sources that include laboratory instruments, network shared drives, and windows desktops attached to instruments.

Development Tools:

Sprints, features, and tasks will be managed in Azure DevOps. Code will be managed and versioned Azure DevOps based git repositories. Code will be compiled, packaged, and deployed utilizing Azure DevOps build pipelines. Data pipelines will be packaged, deployed, and run in docker containers. Docker containers will be stored and versioned in Google Cloud Artifact Repositories. Veracode will be utilized to scan source code for vulnerabilities and Prisma Cloud will be utilized to scan containers. The standard integrated development environment will be jetbrains (pycharm, intellij, etc.) or VSCode.

Preferred Candidates:
- 5+ years Python experience
- Linux experience
- Azure Devops experience
- Experience with Google Cloud Platform based infrastructure and services
- Experience working on healthcare, life science, or scientific research projects
- A degree or domain knowledge in a life science related field (biochemistry, genetics, biology, etc)


Horizontal facilitates valuable and productive conversations between you and potential employers. We can assist you in growing your career by partnering you with employers that offer challenging assignments.  For those that join the team, we offer competitive compensation and benefits including medical, dental, vision, and retirement. Check out all we have to offer and how you can become part of the Horizontal Talent Team. The pay range for this role is $50 - $87 per hour. This is not a guarantee of compensation, as final offer amount may vary based on factors including but not limited to experience and geographic location.