Snowflake Data Engineer

We are seeking a highly skilled Snowflake Data Engineer with deep expertise in Snowflake's modern AI and data platform capabilities. The ideal candidate goes beyond traditional data engineering — they are proficient in Snowflake Cortex AI, building intelligent agents, developing Streamlit-based data applications, and leveraging Snowpark for advanced analytics. This role is central to our healthcare data modernization strategy and requires someone who can architect, build, and scale next-generation data and AI solutions on Snowflake.

Responsibilities
Snowflake AI & Cortex (Core Focus)

• Design and deploy AI-powered solutions using Snowflake Cortex, including LLM-based functions (COMPLETE, SUMMARIZE, SENTIMENT, TRANSLATE, CLASSIFY) for healthcare data use cases.

• Build and orchestrate multi-step AI agents using Snowflake Cortex Agents and Cortex Analyst to automate data workflows and enable natural language querying of structured healthcare datasets.

• Leverage Cortex Search for semantic and hybrid search capabilities across unstructured clinical and operational data.

• Implement RAG (Retrieval-Augmented Generation) pipelines using Snowflake's native vector embeddings and VECTOR data type for domain-specific LLM grounding.

• Use Arctic Embed and other Snowflake-native embedding models to build scalable, cost-effective AI features within the Snowflake perimeter.

Streamlit & Application Development

• Build interactive, production-grade data applications and internal tools using Streamlit in Snowflake (SiS) for business stakeholders and data consumers.

• Develop self-service analytics dashboards and AI-assisted exploration tools embedded directly in the Snowflake environment.

• Create Streamlit-based front-ends for Cortex-powered features — enabling clinical users and analysts to interact with AI outputs without leaving the Snowflake ecosystem.

Snowpark & Data Engineering

• Develop complex data transformations, feature engineering pipelines, and ML preprocessing workflows using Snowpark for Python.

• Build and manage scalable ELT pipelines leveraging Snowflake Streams, Tasks, Dynamic Tables, and Snowpipe for real-time and batch ingestion.

• Optimize Snowflake performance through micro-partition pruning, clustering keys, materialized views, search optimization, and warehouse right-sizing.

• Design and implement Data Vault or Medallion architecture patterns for healthcare data platforms.

• Integrate Snowflake with upstream healthcare data sources and downstream BI platforms.

Data Governance & Security

• Implement Snowflake-native governance including row-level security, column masking policies, object tagging, and data classification.

• Ensure HIPAA compliance and PHI data handling best practices across all Snowflake data assets.

• Manage data lineage, cataloging, and access control in alignment with organizational governance frameworks.

Collaboration & Platform Ownership

• Partner with data scientists, ML engineers, clinical analysts, and business stakeholders to translate requirements into robust Snowflake-native solutions.

• Act as a Snowflake subject matter expert and internal champion — driving best practices, onboarding teams, and evangelizing new platform capabilities.

• Participate in platform roadmap planning and contribute to Snowflake feature adoption strategy.

Qualifications
• 5+ years of data engineering experience, with at least 3+ years of hands-on Snowflake expertise.

• Proven experience with Snowflake Cortex AI features: LLM functions, Cortex Analyst, Cortex Search, and AI agent orchestration.

• Hands-on experience building Streamlit in Snowflake applications deployed in production environments.

• Proficiency in Snowpark for Python — including custom UDFs/UDTFs, stored procedures, and DataFrame API usage.

• Strong SQL skills with deep understanding of Snowflake's execution engine, query profiling, and optimization techniques.

• Experience with Snowflake data sharing, Marketplace, and cross-cloud/cross-region replication.

• Familiarity with vector search, embeddings, and RAG architecture patterns within or integrated into Snowflake.

• Good to have experience with cloud platforms: Azure, and GCP — and connecting Snowflake to cloud-native services.

• Strong understanding of data modeling for analytics (star schema, Data Vault, Medallion/Lakehouse patterns).

• Knowledge of Medicare Stars Patient Safety is a strong plus.