Staff Software Engineer, Big Data, tvScientific

Posted 28d ago

The employer’s full description could not be read from their board. This is a summary of the posting — follow the apply link for the original.

Design and maintain a scalable identity resolution platform
Build pipelines and services to ingest, normalize, link, and version identity data
Ensure deterministic and probabilistic matching logic that is transparent and auditable
Expose identity data through reliable, well-documented APIs and datasets
Build and operate batch and streaming pipelines using modern data stack tools
Create documentation, standards, and runbooks for identity and governance systems
Own data governance foundations including lineage, quality, schema, and access controls
Implement privacy-by-design principles (PII handling, consent, retention)
Collaborate with legal, privacy, and security teams on regulatory requirements
Establish monitoring and alerting for data quality, freshness, and integrity

Production data engineering experience
Bachelor's degree in computer science or equivalent experience
Proficiency in Spark and Scala
Experience building data infrastructure in Spark using Scala
Experience delivering significant technical initiatives and large-scale services
Experience delivering APIs backed by relationship-heavy datasets
Experience implementing data governance practices (data quality, metadata, access controls)
Strong understanding of privacy-by-design principles and handling sensitive data
Familiarity with data lakes, cloud warehouses, and storage formats
Strong proficiency in AWS services
Excellent written and verbal communication skills
Successful design and implementation of scalable data infrastructure
High attention to detail in automated data quality checks
Effective collaboration with cross-functional teams
Demonstrated ability to use AI to improve speed and quality in daily workflow
Strong track record of critical evaluation and verification of AI-assisted work

Skills