Data Engineer Databricks
Job Summary
This position is Hybrid in Tampa FL.
We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines deploy machine learning solutions and operationalize intelligent analytics to drive decision-making across the organization. The ideal candidate blends data engineering best practices with applied machine learning MLOps and AI.
Key Responsibilities
Project Responsibility: End-to-end data pipelines and integrations
Technical Competencies:
- Advanced SQL optimization and complex query design
- Kafka streaming applications and connector development
- Databricks workflow development with medallion architecture
- Data governance implementation and compliance
- Performance tuning for large-scale data processing
- Data security and privacy best practices
- Apache NiFi pipeline development for invoice and PO processing
- Integration with purpose-built data stores (Druid MongoDB OpenSearch Postgres)
- Build and maintain end-to-end ML pipelines for training deployment and monitoring of models.
- Design and optimize data architectures for large-scale ML workloads
- Explore and implement LLM-based solutions RAG architectures and generative AI for business use cases.
Soft Skills:
- Cross-functional collaboration with product and engineering teams
- Technical mentoring for junior data engineers
- Analytical thinking for complex data problems
- Stakeholder communication for data requirements
- Process improvement and efficiency focus
- Quality mindset for data accuracy and reliability Vendor Management:
- Direct communication with data platform vendors
- Evaluates vendor tools for specific data use cases
- Provides technical feedback on vendor product roadmaps
- Coordinates with vendors for data integration projects
Qualifications:
Bachelors/Masters in Computer Science Data Engineering Statistics or related field.
5 years in data engineering; 2 years applying ML in production.
Our Benefits:â
- Hybrid Workâ
- Employer Matched 401Kâ
- Company Paid Medical Insurance Option for Employee and Dependent Childrenâ
- Company Paid Dental Insurance for Employeeââ
- Company Paid Vision Insurance for Employeeââ
- Company Paid Long and Short-Term Disabilityâ
- Company Paid Life and AD&D Insuranceâ
- 18 Paid Vacation Days a Yearâ
- Six Paid Holidaysâ
- Employee Recognition Programsâ
- Holiday Bonusâ
- Incentive Compensationâ
- Community Outreach Opportunitiesâ
- Business Casual Dress Codeâ
â
About Fintech:â
Fintech a pioneering accounts payable (AP) automation solutions provider has dedicatednearly 35years to automating invoice processing between retail and hospitality businesses and their supply chain partners. Backed by leadinginvestorsTA Associates and General Atlantic it stands as a leader in this sector. Its flagship productPaymentSource was first built for the alcohol industry to provide invoice payment automation between alcohol distributors and their customers across all 50 states. Today it isutilizedby over 267000 businesses nationwide for invoice payment and collection associated with all B2B business transactions. This proven platform automates invoice payment streamlines payment collection andfacilitatescomprehensive data capture for over 1.1 million business relationships. Recognizing operational hurdles Fintech expanded its payment capabilities to include scan-based trading/consignment selling for its vendors and retailers and built an advanced CRM tool with functionality to fortify vendor supplier and distributor field execution addressing diverse profit center challenges. For more information about Fintech and its range of solutions please visitâ.â
Fintech is a Drug-Free Workplace. Fintech is an Equal Opportunity Employer that does not discriminate on the basis of actual or perceived race color creed religion national origin ancestry citizenship status age sex or gender (including pregnancy childbirth and pregnancy-related conditions) gender identity or expression (including transgender status) sexual orientation marital status military service and veteran status physical or mental disability genetic information or any other characteristic protected by applicable federal state or local laws and management team is dedicated to this policy with respect to recruitment hiring placement promotion transfer training compensation benefits employee activities access to facilities and programs and general treatment during employment.âWe E-Verify.â
Required Experience:
IC
About Company
Powering successful retail operations with EDI-powered invoice automation, unified product catalogs, and end-to-end inventory data visibility