Azure Data Engineer Job at Programmers.io, Cary, NC

Mk5nL2piWmRqbXo2UWVGc2svS0Zjek0vMkE9PQ==
  • Programmers.io
  • Cary, NC

Job Description

Role Description:

Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes.Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.Develop quality code with thought through performance optimizations in place right at the development stage.Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvementsBuilding and Implementing data ingestion and curation process developed using Big data tools such as Spark (ScalapythonJava), Hive, HDFS, Sqoop ,Kafka, Kerberos, Impala etc. and CDP 7.xIngesting huge volumes data from various platforms for Analytics needs and writing high-performance, reliable, and maintainable ETL code StrongStrong analytic skills related to working with unstructured datasetsStrong experience in building designing Data warehouses, data stores for analytics consumption On prem and Cloud (real time as well as batch use cases). Proficiency and extensive Experience with Spark Scala, Python and performance tuning is a MUSTHive database management and Performance tuning is a MUST. (Partitioning Bucketing )Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance.

Essential Skills: Digital Microsoft Azure


Top 3 Required Skills:
1. Should have strong experience in BigQuery, Big SQL, Cloud Composer, Dataproc, Cloud Storage
2. Should have strong hands on experience in Azure platform using Azure Databricks, Azure Data Factory (ADF), Azure Data Lake and Synapse
3. Should be familiar about relational data modeling, and implementing Star/Snowflake schemas using build analytical data warehouses cocnepts


Top 3 Preferred Skills:
1. BigQuery, Databricks, Azure Synapse and Snowflake.
2. Pyspark / Spark, kafka
3. Python, Scala, SQL, MySQL.

Job Tags

Similar Jobs

Bayer

Packaging Development Scientist IV Job at Bayer

Packaging Development Scientist IV At Bayer were visionaries, driven to solve the worlds toughest challenges and striving for a world where 'Health for all Hunger for none is no longer a dream, but a real possibility. Were doing it with energy, curiosity and sheer dedication... 

GO Media

Graphic Designer (Static & Motion, Marketing Assets) Job at GO Media

 ...Our team is lean, collaborative, and deeply strategic. As we scale, were seeking a talented, versatile Graphic Designer who can produce both static and motion creative assets across brands, channels, and mediumsand who understands the balance between aesthetic flair... 

Hillcrest Healthcare System

Nursing Manager of Cardiovascular ICU Job at Hillcrest Healthcare System

Overview: Join our team as a day shift, full-time, Cardiovascular Intensive Care Unit (ICU) Nursing Manager in Tulsa, OK. Why Join Us? Thrive in a People-First Environment and Make Healthcare Better Thrive: We empower our team with career growth opportunities... 

Ardor Health Solutions

Travel Nurse RN - Home Health - $1,958 per week Job at Ardor Health Solutions

 ...Ardor Health Solutions formed in 2001 and remains a privately held medical staffing business owned and operated by the same family. Over...  ...history. Ardor Health is pleased to offer a free medical insurance plan in addition to major medical plans. Please contact a recruiter... 

Your SmartSource

Journeyman Carpenter Foreman - Construction Company Job at Your SmartSource

 ...Company Profile: Tricamo Construction specializes in custom, residential, production house building and unique commercial projects...  ...Proficiency in industry-related software applications to include Google Docs, Bluebeam and Adobe Acrobat; Experience with...