Data Architect (HadoopMLAIETL)
Pittsburgh, PA - USA
Job Summary
We are seeking an experienced Data Architect to lead the architecture and control frameworks for D&A technology on-premises data this role you will design robust data movement controls reconciliation pipelines and semantic abstraction layers that connect high-throughput relational data warehouses legacy Hadoop infrastructure and modern on-premises Lakehouse environments.
You will be responsible for defining standards that guarantee high availability strict enterprise security and accurate audited data movement across networks and private storage cluster.
Key Responsibilities
-Premises Data Movement & Control Architecture
& Reconciliation frameworks: Architect automated enterprise-wide data validation mechanisms (source-to-target row count verification checksum validation automated threshold alerting and schema evolution tracking) across internal networks.
-Orchestration Operations: Define standards bridging enterprise job scheduling (Control-M for batch/legacy workflows) with programmatic DAG orchestration (Apache Airflow deployed on-perm).
Catalog & Graph Architecture
Catalog Governance (Apache Polaris): Architect and maintain Apache Polaris as the centralized open-source REST catalog for Apache Iceberg tables. Enforce multi-engine catalog governance role-based access control (RBAC) and credential scoping across engines.
Federation (Trino): Implement and tune Trino across local bare-metal or private Kubernetes clusters to federate SQL queries seamlessly across relational databases Hadoop and Iceberg storage.
Databases & Knowledge Graphs: Architect property or RDF graph database integrations (Graph DB) to capture complex entity relationships data lineage and semantic ontologies.
& Lineage: Maintain complete operational metadata structural tracking and end-to-end data lineage across all internal data movement paths for strict regulatory compliance.
Experience in data architecture and enterprise data management within large-scale on-premises data center environments.
Proven track record designing enterprise-grade data control frameworks reconciliation patterns audit mechanisms and schema evolution strategies for high-throughput environments.
Deep conceptual and architectural understanding of on-premises Hadoop ecosystems (HDFS YARN Hive Spark Kerberos) and strategies for modernizing legacy workloads.
Preferred Qualifications
AI Strategy in Data Management: Exposure to or conceptual understanding of Agentic AI frameworks- specifically how autonomous agents can be leveraged for automated pipeline observability intelligent metadata tagging self-healing quality checks and context-aware schema drift mitigation.
this position you will:
Provide thought leadership for the control architecture evolution within the DnA Data Ops ecosystem.
Work with Architectural Leadership to drive out the strategic roadmap for all applications and ensure appropriate architectural and technical items are suitably prioritized.
Work with Product Owners to ensure prioritization and delivery of business priorities in a timely manner via the monthly releases.
participate in business requirements gathering sessions and understand client requirements.
Create present and get signoffs for design documents.
Support the enterprise architecture and perform proof of concepts for several new requirements to find innovative ways to enhance current architecture.
Be responsible for compliance to all architecture and technology standards and handle any exceptions and vulnerabilities.
Well-versed in new technologies to keep current architecture moving forward while maintaining the integrity of enterprise architectures.
The ideal candidate for this position should have:
Experience in architecture and operating mission critical high volume low latency services.
Experience in governance implementation of and or use of Analytic Data and software to do analysis and/or advanced analytics and visualization
Engagement with multiple teams and coordination of multiple requirements that have similar needs prioritizing based on business value
Implementation & Governance of Business Data Architecture Standards
Collaboration with Enterprise Architecture and Technology partners to generate business requirements in strategic business solution architecture with technology solution architecture
Experienced with architecting high-performance application data services against data stores with very large amounts of data.
Experience with Hadoop Data Modeling ETL/ELT APIs
Experience with distributed computer solutions
Strong written and verbal communicator with the ability to translate complex technical information for senior management and product team.
Experience providing technical thought leadership across an organization.
Skills/Competencies required: Data Modeling Design Enterprise Architecture Framework Governance Management Machine Learning (ML) Risk Assessments HDFS Structured Query Language (SQL) Team Management Technical Data Architecture Database Structures Data Warehousing IT Architecture Logical Data Modeling Organizational Leadership Problem Solving Requirements AnalysisPNC is an in-office company that fosters a supportive culture where employees can thrive and achieve balance. We encourage candidates to connect with their recruiter and hiring manager to understand workplace expectations and ensure the role aligns with their goals.PNC will not provide sponsorship for employment visas or participate in STEM OPT for this position.
- Designs develops and optimizes data warehouses with flexible and scalable data and ETL architecture to support business users and Business Intelligence (BI) applications.
- Analyzes business intelligence data and makes recommendations for data warehouse growth and integration an application/business function.
- Works with IT and business customers to capture requirements for designing the data warehouse architecture.
- Provides support and technical guidance to ensure the solutions are aligned with the architecture and framework.
- Leads and consults on the implementation and integration of data warehouses; ensures the solution meets organizational quality and integrity standards.
PNC Employees take pride in our reputation and to continue building upon that we expect our employees to be:
- Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
- Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNCs Enterprise Risk Management Framework.
Successful candidates must demonstrate appropriate knowledge skills and abilities for a role. Listed below are skills competencies work experience education and required certifications/licensures needed to be successful in this position.
To learn more about these and other programs including benefits for full time and part-time employees visit.
If an accommodation is required to participate in the application process please contact us via email at . Please include accommodation request in the subject line title and be sure to include your name the job ID and your preferred method of contact in the body of the email. Emails not related to accommodation requests will not receive responses. Applicants may also call and say Workday for accommodation assistance. All information provided will be kept confidential and will be used only to the extent required to provide needed reasonable accommodations.
At PNC we foster an inclusive and accessible workplace. We provide reasonable accommodations to employment applicants and qualified individuals with a disability who need an accommodation to perform the essential functions of their positions.
PNC provides equal employment opportunity to qualified persons regardless of race color sex religion national origin age sexual orientation gender identity disability veteran status or other categories protected by law.
This position is subject to the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA) and for any registered role the Secure and Fair Enforcement for Mortgage Licensing Act of 2008 (SAFE Act) and/or the Financial Industry Regulatory Authority (FINRA) which prohibit the hiring of individuals with certain criminal history.
Required Experience:
Staff IC