Job Description

Data Engineers

Location: San Jose, ( Hybrid: Tues, Wed, Thurs- in Office)

Overview:

We are seeking a highly skilled Data Engineer with strong expertise in Databricks to lead the design and execution of scalable data pipelines and architectures. This role sits at the intersection of Customer Analytics , Master Data Management (MDM) , and Generative AI/LLMs . The ideal candidate also brings experience building custom applications , supporting BI integration , reverse ETL workflows , and applying user experience design principles to internal tools.

Key Responsibilities:

• Design, develop, and optimize advanced data pipelines using Databricks (SQL, Python, Spark, Delta Lake).
• Integrate and structure customer and enterprise data across systems to support analytics, AI, and MDM initiatives.
• Build and maintain custom internal applications and services that support data workflows and operational teams.
• Develop and refine prompts and workflows for LLM-based and generative AI use cases.
• Collaborate with MDM teams to support identity resolution and golden record management.
• Enable analytics delivery through Power BI , Tableau , and other BI tools.
• Replicate data from sources to targets via Fivetran
• Use reverse ETL tools like Census to replicate enriched data back into CRM and marketing systems.
• Apply user experience design principles to internal data tools, dashboards, and interfaces to improve usability and adoption.
• Ensure high data quality, reliability, and performance across the data stack.

Required Qualifications:

• Extensive hands-on experience with Databricks (Spark, Delta Lake, Lakehouse architecture, notebooks, orchestration).
• 3+ years of experience in data engineering, full-stack development, or a related field.
• Strong proficiency in SQL and data modeling best practices.
• Solid understanding of customer data structures, MDM concepts, and data governance.
• Experience working with generative AI and LLMs , including prompt engineering and AI-assisted workflows.
• Experience developing and deploying custom applications , APIs, or internal tools.
• Proficiency in cloud environments (Azure, AWS, or GCP).

Preferred Qualifications:

• Familiarity with Power BI , Tableau , and other business intelligence tools.
• Experience using Census or similar reverse ETL platforms.
• Background supporting marketing, sales, or customer experience analytics initiatives.
• Awareness of UX design best practices , especially when building internal tools or data interfaces.
• Strong collaboration and communication skills with both technical and business stakeholders.

Hiring Mgr is looking for candidate with exp-

Data migration from Hana to AZURE using Databricks

MS Dynamics knowledge/ exp.

Knowledge of Hana ( SQL db) , atleast basics of new generation data housre (data lake) eg Databricks .

Good understanding ETL pipelines ( ETL Tools / Reverse ETL tools : Snaplogic, Fivetran, Sensus, Hana)

Reporting dashboards.

BI tech, Analytics experience in general.

AI workflows ( Most of Gen AI algorithms based on Gen AI). May not necessarily work on AI tech, but need to know basis AI)

Databricks - exp Administration, Build pipelines, high level expertise

Azure experience

Job Tags

Similar Jobs