Senior Software Engineer Data Pipelines

Who is Tenable

Tenable is the Exposure Management company. Over 40000 organizations around the globe rely on Tenable to understand and reduce cyber risk. Our global employees support 65 percent of the Fortune 500 50 percent of the Global 2000 and large government agencies. Come be part of our journey!

What makes Tenable such a great place to work

Ask a member of our team and theyll answer Our people! We work together to build and innovate best-in-class cybersecurity solutions for our customers; all while creating a culture of belonging respect and excellence where we can be our best selves. When youre part of our #OneTenable team you can expect to partner with some of the most talented and passionate people in the industry and have the support and resources you need to do work that truly matters. We deliver results that exceed expectations and we win together!

Your Role:

• Youll own the whole lifecycle of data pipelines running in 15 regions from design through production and set the technical direction for how we build them.
• Youll write and optimize big distributed processing jobs to handle massive datasets.
• Youll build and maintain pipelines that feed our products access layerthink threat intelligence assets and detectionsand evolve the data models underneath them.
• Quality is huge: youll design frameworks to check data health run conditional checks and keep everything observable.
• Youll lead our observability across all pipelines.
• Youll raise the engineering bar through design reviews code review and mentorship.

Team & Culture:

• We believe in owning your work end-to-end without annoying bottlenecks.
• Were AI-native using custom plugins and protocols to make development smoother.
• We take engineering rigor seriously (think dead-code detection constant security scans and always-on production monitoring).
• Yes we have on-call but weve built tools to automate the pain out of itand we expect you to keep automating.

What Youll Need:

• 7 years building and operating production data pipelines at scale including systems you designed yourself and then ran.
• Deep Python 3.10 chops (Pydantic async decorators packaging profiling).
• Apache Airflow in production DAG authoring at scale dynamic task mapping deferrable operators SLAs MWAA or self-hosted operations and upgrades.
• PySpark mastery job authoring plus real optimization (partitioning shuffle and skew mitigation join strategy reading Catalyst plans) EMR or Databricks.
• Snowflake depth (Snowpark schema and clustering design query tuning warehouse sizing cost attribution).
• AWS knowledge (S3 SQS/SNS EMR IAM infrastructure-as-code).
• Data quality tooling experience designing frameworks (Great Expectations or equivalent) not only configuring them.
• Observability: distributed tracing structured logging metrics.
• CI/CD with artifact packaging and staged deployments across many environments and regions.
• Strong testing discipline: pytest moto integration tests against real or mocked cloud services.

#LI-SK1

#LI-Hybrid

Were committed to promoting Equal Employment Opportunity (EEO) at Tenable - through all equal employment opportunity laws and regulations at the international federal state and local levels. If you need a reasonable accommodation due to a disability during the application or recruiting process please contact for further assistance.

Tenable Data Consent Statement

Tenable is committed to protecting the privacy and security of your personal data. Depending on your location one or more of the following notices may apply to you:

General Applicant Privacy Notice
California Applicant Privacy Notice
EU/EEA/UK Applicant Privacy Notice