Data Engineer CSS, AIP and HPX Analytics

Description -

Does Big Data and Cloud Native Data Lakes/DW get you excited Does the thought of building sustainable Big Data pipelines on behalf for customer make you smile How about working with leading edge technologies or Databricks or Airflow and S3

The Specialist Data engineer role is a team member that will help enhance and maintain the CSS Business Analytics Lakehouse system. This role will work with external and internal business partners to capture business requirements and help develop solutions to support the business. You will drive work youre doing to completion with hands-on development responsibilities and partner with the Data Engineering leaders to provide thought leadership and innovation with those results.

This individual will apply developed subject matter knowledge to solve common and complex business issues and recommend appropriate alternatives. The daily work will consist of solving problems that are of diverse complexity and scope while exercising independent judgment within generally defined policies and practices. This role will require handling unique or unclear requirements and seek advice from team members and leaders to make decisions on complex business issues.

Responsibilities

Partner with other data engineers and architects to establish secure and performant data architectures enhancements updates and programming changes for portions and subsystems of data platform repositories or models for structured/unstructured data.

Analyzes design and determines coding programming and integration activities required based on general objectives and knowledge of overall architecture of product or solution.

Reviews and evaluates designs and project activities for compliance with architecture security and quality guidelines and standards; provides tangible feedback to improve product quality and mitigate failure risk.

Writes and executes complete testing plans protocols and documentation for assigned portion of data system or component; identifies defects and creates solutions for issues with code and integration into data system architecture.

Collaborates and communicates with project team regarding project progress and issue resolution.

Works with the data engineering team for all phases of larger and more-complex development projects and engages with external users on business and technical requirements.

Collaborates with peers engineers data scientists and project team.

Typically interacts with high-level Individual Contributors Managers and Program Teams on a daily/weekly basis.

Helps define and lead portions of project requirements for data exchanges and business requirements with externals and internal teams

Collaborates with SMEs to develop procedures for collecting recording analyzing and communicating data for review and feedback.

Experience & Education:

Bachelors or Masters degree in Computer Science Information Systems Engineering or equivalent.

5 years of relevant experience with detailed knowledge of data warehouse technical architectures infrastructure components ETL/ ELT and reporting/analytic tools.

4 years of experience with Cloud based DW such as Databricks SQL Warehouse Redshift Snowflake etc.

4 years experience in Big Data Distributed ecosystems (Hadoop SPARK Hive & Delta Lake)

4 years experience in Big Data Distributed systems such as Databricks AWS EMR AWS Glue etc.

Leverage monitoring tools/frameworks like Splunk CloudWatch etc.

Experience with container management frameworks such as Docker Kubernetes ECR etc.

4 years working with multiple Big Data file formats (Parquet Avro Delta Lake)

Experience working on CI/CD processes such as Jenkins Codewayetc. and source control tools such as GitHub etc.

Strong experience in coding languages like Python Scala & Java

Knowledge and Skills

Fluent in relational based systems and writing complex SQL.

Fluent in complex distributed and massively parallel systems.

Strong analytical and problem-solving skills with ability to represent complex algorithms in software.

Experience in building lambda kappa microservice and batch architecture

Designing data systems/solutions to manage complex data.

Strong understanding of database technologies and management systems.

Strong understanding of data structures and algorithms

Database architecture testing methodology including execution of test plans debugging and testing scripts and tools.

Effective communication skills (with team members the business and in code)

Ability to effectively communicate product architectures design proposals and negotiate options at management levels.

Has a passion for data solutions and willing to pick up new programming languages technologies and frameworks

Strong analytical and problem-solving skills.

Nice to Have

Experience with transformation tools such as dbt.

Have experience in building realtime streaming data pipelines.

Disclaimer

This job description describes the general nature and level of work performed in this role. It is not intended to be an exhaustive list of all duties skills responsibilities knowledge etc. These may be subject to change and additional functions may be assigned as needed by management.

Salary

The pay range for this role is$105050to$161800USD annually with additional opportunities for pay in the form of bonus and/or equity (applies to United States of America candidates only). Pay varies by work location job-related knowledge skills and experience.

Benefits:

HP offers a comprehensive benefits package for this position including:

• Health insurance
• Dental insurance
• Vision insurance
• Long term/short term disability insurance
• Employee assistance program
• Flexible spending account
• Life insurance
• Generous time off policies including;
• 4-12 weeks fully paid parental leave based on tenure
• 11 paid holidays
• Additional flexible paid vacation and sick leave (US benefits overview)

The compensation and benefits information is accurate as of the date of this posting. The Company reserves the right to modify this information at any time with or without notice subject to applicable law.

Job -

Schedule -

Shift -

Travel -

Relocation -

Equal Opportunity Employer (EEO) -

HP Inc. provides equal employment opportunity to all employees and prospective employees without regard to race color religion sex national origin ancestry citizenship sexual orientation age disability or status as a protected veteran marital status familial status physical or mental disability medical condition pregnancy genetic predisposition or carrier status uniformed service status political affiliation or any other characteristic protected by applicable national federal state and local law(s).

Please be assured that you will not be subject to any adverse treatment if you choose to disclose the information requested. This information is provided voluntarily. The information obtained will be kept in strict confidence.

For more information review HPsEEO Policy or read about your rights as an applicant under the law here: Know Your Rights: Workplace Discrimination is Illegal