Azure Data Engineer Job at Programmers.io, Cary, NC

  • Programmers.io
  • Cary, NC

Job Description

Role Descriptions:

Find out more about this role by reading the information below, then apply to be considered.

  • Design and build batch and streaming data pipelines using Azure, Databricks, and Kafka.
  • Develop ETL/ELT solutions using Spark, SQL and Python/Pyspark, or Scala
  • Implement and support Data Lake / Lakehouse architectures
  • Integrate data from legacy and modern platforms. Preferred postgres DB migration to Azure Cloud.
  • Expertise in handling Data migration using API's.
  • Apply data quality checks and support data governance basics (metadata, lineage, access controls)
  • Optimize Spark jobs for performance, reliability, and cost
  • Collaborate with cross-functional teams, Product owners, Admin teams, BSAs, Scrum & Project managers

Required Skills & Experience:

  • 8+ years of experience in data engineering in azure using Azure Databricks.
  • Strong experience with Azure Data Lake, Databricks, ADF, Postgres.
  • Strong Data Engineering experience in Big Data (Cloudera)
  • Hands-on expertise in SQL, Python and PySpark or Scala
  • Proven experience with batch & real-time ingestion
  • Experience with Kafka and big data processing

Added good to have experience with:

  • Informatica PowerCenter
  • Informatica IDMC or equivalent cloud data integration tools
  • SQL Server, Oracle, Azure SQL
  • Cosmos DB
  • Unix/Linux
  • Maestro xhyhwjd (or similar enterprise schedulers)
  • Data tools such as Precisely or equivalent

Added Advantage

  • Insurance domain knowledge (Policy, Claims, Billing, Underwriting, Actuarial, Regulatory data)
  • Experience with Azure DevOps (AzDO) and GitHub-based CI/CD
  • Practical usage of Copilot for data engineering and development productivity
  • Exposure to Generative AI / GenAI use cases in data platforms and analytics

Job Tags

Similar Jobs

Amdex Corporation

CATI Interviewer Job at Amdex Corporation

 ...science research, data collection and analysis, program evaluation, and policy analysis. Avar seeks a CATI (Computer Assisted Telephone Interview) Interviewerto join our team. The Computer-Assisted Telephone Interviewer (CATI Interviewer) conducts telephone surveys... 

Altitude Chiropractic

Associate Chiropractor - Future Ownership Opportunity Job at Altitude Chiropractic

 ...Manelick and an established administrative, billing, and massage therapy team. This position provides the opportunity to develop an...  ...administered in accordance with Alaska law and clinic policy ~ Assistance with reasonable, preapproved continuing-education expenses... 

Verizon

B2B Account Manager - Outside Sales-Verizon Job at Verizon

 ...show up, everywhere & always. Want in? Join the #VTeamLife. \n \n What youll be doing... \n With your sales experience, ability to efficiently manage your time, excellent customer relations skills, and excitement for technology, you'll deliver outstanding and innovative... 

Dematic

Mechanical Installer Job at Dematic

 ...As a Mechanical Installer, you will join our Installation team supporting large-scale material handling and conveyor system projects across the continental United States. This role is responsible for the layout, pre-assembly, installation, and run-in of conveyor equipment... 

Cynet Health

Travel Pharmacist in Salina, KS Job at Cynet Health

 ...Pharmacist Location: Salina, KS Agency: Cynet Health Pay: Competitive weekly pay (inquire for details) Shift Information...  ...assistance among other offerings. This position may allow for remote work one day a week, with other days requiring on-site...