Machine Learning Scientist

Overview

Spotter empowers the worlds best Creators with capital data and insights to scale their programming into sustainable media businesses. Through these partnerships Spotter helps brands partner with creator-led franchises to unlock growth amplify impact and build lasting cultural relevance.

Spotter has already deployed over $1 billion to YouTube Creators to reinvest in themselves and accelerate their growth. With a premium catalog that spans over 725000 videos Spotter generates more than 88 billion monthly watch-time minutes delivering a unique scaled media solution to Advertisers and Ad Agencies that is transparent efficient and 100% brand safe. For more information about Spotter please visit.

Overview

Were looking for a talented and intensely curious Machine Learning Scientist with deep expertise in building and deploying production machine learning models particularly reinforcement learning contextual bandits and adaptive learning systems along with deep learning ranking personalization and recommendation systems. You thrive in a fast-paced startup environment and are motivated by building models that dont just perform well in experiments they ship to production and create real value for YouTube Creators.

In this role youll train evaluate optimize and deploy a wide range of machine learning models from contextual bandits and sequential decision-making systems to neural networks ranking systems recommendation models and traditional machine learning approaches. Youre passionate about staying at the forefront of AI and machine learning especially in areas where models learn from feedback adapt over time and improve real-world product outcomes.

Were a team of builders who value continuous learning rapid experimentation and delivering AI solutions that make a measurable difference for Creators. If you enjoy solving complex problems iterating quickly and building intelligent products that help the worlds top YouTube Creators work smarter and create better content youll thrive at Spotter.

What Youll Do

Youll develop machine learning models that move beyond experimentation and into production where they directly improve Creator workflows and product experiences. Working alongside Analytics Product and Engineering youll help develop intelligent systems that improve how Creators discover insights make decisions and create content.

Your work may include:

• Designing training evaluating optimizing and deploying production reinforcement learning contextual bandit and online learning systems that improve product outcomes.
• Creating systems that balance exploration and exploitation short-term performance and long-term value and multiple competing product objectives.
• Developing reward models feedback models and objective functions that translate noisy sparse delayed or implicit signals into reliable model training and evaluation targets and diagnosing and mitigating reward hacking and feedback loops in deployed systems.
• Applying offline policy evaluation and counterfactual techniques such as inverse propensity scoring doubly robust estimation and replay evaluation to reason about model changes before and after deployment.
• Working with logged interaction data to understand user behavior evaluate model performance improve decision quality and reduce bias in model evaluation.
• Designing experiments to evaluate model performance measure product impact and continuously improve production systems.
• Building scalable model training evaluation deployment and inference pipelines.
• Optimizing models for accuracy latency scalability reliability and production maintainability.
• Working with structured and unstructured datasets using Python and SQL.
• Collaborating closely with Product and Engineering to translate customer problems into machine learning solutions.
• Staying current with advances in reinforcement learning bandits recommendation systems ranking personalization deep learning experimentation and production ML and thoughtfully applying new techniques where they create measurable value.

Who You Are

Required Skills & Experience

• Masters degree or PhD in Computer Science Statistics Applied Mathematics Electrical Engineering Physics or another quantitative field.
• 5 years building evaluating and deploying machine learning models in production environments.
• Experience with reinforcement learning or contextual bandit systems gained through graduate coursework academic research or hands-on industry experience. Candidates with experience building and deploying these systems in production from problem formulation through offline evaluation to live deployment are strongly preferred.
• Solid grasp of core RL training objectives and loss functions including temporal-difference and Bellman error losses (Q-learning DQN) policy gradient objectives (REINFORCE actor-critic advantage estimation) and clipped surrogate objectives (PPO TRPO) with an understanding of when each applies and how they behave in training.
• Practical experience with bandit and reinforcement learning methods such as Thompson sampling UCB or LinUCB neural bandits non-stationary bandits policy gradients actor-critic methods or Q-learning.
• Ability to design reward functions and objective trade-offs for systems optimizing long-horizon outcomes including diagnosing and mitigating reward hacking and feedback loops.
• Knowledge of off-policy and counterfactual evaluation such as inverse propensity scoring (IPS) self-normalized IPS doubly robust estimators and replay evaluation and with counterfactual learning from logged bandit feedback including propensity logging.
• Experience working with logged interaction data behavioral data or feedback signals to train evaluate and improve models.
• Track record of designing experiments and using data to improve model performance in real-world product environments including A/B testing and causal inference.
• Strong experience with modern deep learning frameworks and production ML workflows.
• Expertise in training evaluating tuning and deploying machine learning models across deep learning and traditional ML approaches.
• Strong understanding of embeddings representation learning neural networks sequence modeling and modern deep learning architectures.
• Strong Python and SQL skills.
• Excellent communication skills and the ability to work cross-functionally with Product Engineering Analytics and other stakeholders.
• Curiosity ownership and a passion for building products that customers love.

Nice to Have

• Hands-on work building large-scale recommendation ranking or personalization systems.
• Understanding of offline reinforcement learning methods such as CQL or IQL for training policies from logged data.
• Knowledge of constrained or safe reinforcement learning and guardrailed deployment including offline evaluation gates ahead of live A/B tests.
• Familiarity with ad recommendation ad ranking or campaign optimization systems used by large-scale platforms such as YouTube Google Meta TikTok Amazon or similar consumer marketplace platforms.
• Experience serving large-scale ML models in production.
• Background building machine learning systems for large-scale digital platforms such as Creator platforms consumer apps recommendation systems ad recommendation systems campaign optimization systems or workflow automation tools.

Why Spotter

• Build AI products used by the worlds top YouTube Creators.
• Ship production models every week not every year.
• Work on real-world reinforcement learning contextual bandit ranking recommendation personalization and adaptive learning problems.
• Build systems that learn from feedback improve over time and create measurable product impact.
• Join a small highly collaborative team where your work has immediate impact.
• Help shape the future of AI-powered Creator tools.
• Medical insurance covered up to 100%
• Dental & vision insurance
• 401(k) matching
• Stock options
• Discretionary PTO
• Complimentary gym access
• Autonomy and upward mobility
• Diverse equitable and inclusive culture where your voice matters.

In compliance with locallaw we are disclosing the compensation or a range thereof for roles that will be performed in Culver City. Actual salaries will vary and may be above or below the range based on various factors including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. A reasonable estimate of the current pay range is: $167K-$185K salary per year. The range listed is just one component of Spotters total compensation package for employees. Other rewards may include an annual discretionary bonus and equity.

Spotter is an equal opportunity employer. Spotter does not discriminate in employment on the basis of race religion creed color national origin ancestry citizenship physical or mental disability medical condition genetic characteristics or information marital status sex (including pregnancy childbirth breastfeeding and related medical conditions) gender gender identity gender expression age sexual orientation military status veteran status use of or request for family or medical leave political affiliation or any other status protected under applicable federal state or local laws.

Equal access to programs services and employment is available to all persons. Those applicants requiring reasonable accommodations as part of the application and/or interview process should notify a representative of the Human Resources Department.