Azure Data Engineer Job at Apptad Inc, Dallas, TX

MUlVYTk0eE9lU0NWcHJBU0ZLeTR3SnY1WUE9PQ==
  • Apptad Inc
  • Dallas, TX

Job Description

Desired Skills

1Possess a minimum of 5 years of experience in data engineering and development

2Strong experience in designing and implementing data solutions using Azure data services Azure Databricks Azure Data Lake Azure Synapse Analytics Azure Data Factory

3Have a strong background in Retail CPG domain

4Proficiency in SQL TSQL and data modelling techniques

5Experience with PySpark and orchestration tools like Apache Airflow are highly desirable

6Hands on experience with scripting languages such as Python for data processing and manipulation

7Strong analytical and problemsolving skills

8Excellent communication and interpersonal skills with ability to work effectively in a collaborative team environment

9Knowledge on Databricks Unity Catalog and visualization tools like Power BI is a plus

Roles and responsibilities

1Develop and optimize data workflows using PySpark ADLS and Databricks workflows to support business objectives

2Implement and maintain data pipelines to ensure efficient data processing and storage

3Collaborate with crossfunctional teams to gather requirements and deliver data solutions that meet business needs

4Provide technical expertise in the design and implementation of data solutions ensuring scalability and performance

5Monitor and troubleshoot data workflows to ensure reliability and accuracy of data processing

6Apply Spark in Python for advanced data processing and analytics

7Build automation solutions and utilities to eliminate manual efforts and repetitive tasks

8Utilize Databricks SQL for effective data management and querying

9Implement monitoring solutions in Azure to track resource utilization performance and health of data workflows

10Manage and organize data assets using Databricks Unity Catalog

11Leverage Azure DevOps for continuous integration and deployment of data solutions

12Secure data workflows using Azure Key Vault and ensure compliance with data security standards

Skills

Mandatory Skills : Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory,Azure Functions,Azure SQL,Azure Synapse Analytics,AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight

Job Tags

Similar Jobs

P.L. Marketing, Inc.

Grocery Retail Reset Merchandiser Job at P.L. Marketing, Inc.

 ...Marketing has assisted the sales and merchandising of Corporate Brand consumer products for the Kroger Company, the nation's largest supermarket retailer. Additionally, we provide a multitude of merchandising and operational services for Kroger's General Office, divisions,... 

Peraton

Jr Linux Security Compliance Engineer with Red Hat Enterprise Linux (RHEL) - Active Secret Job at Peraton

 ...role, you will: Perform security compliance duties for Linux systems, ensuring the secure, compliant, and reliable operation of Red Hat Enterprise Linux (RHEL) systems and associated applications. You will be responsible for applying DoD security standards, implementing... 

K2 Group, Inc.

Red Analyst (Cyber) Job at K2 Group, Inc.

 ...Red Analyst (Cyber) Red Team Analysts (cyber) are responsible for providing direct strategic and tactical analytic support to the DoD Red Team . The Red Analysts (cyber) drive the strategic direction of cyber operations by selecting cyber targets and identifying cyber... 

Archdiocese of St. Louis

Instructional Aide Job at Archdiocese of St. Louis

 ...and at the end of each day) Job Requirements Prevent and Protect certification through the Archdiocese of St. Louis or other Catholic Diocese Complete additional tasks that are asked by the Teacher or Principal The Archdiocese of St. Louis is an Equal Opportunity... 

Best Buy

Custom Home Lead Installer Job at Best Buy

 ...Electrical Code and Uniform Building Code standards as well as any Code or applicable laws mandated by the authorizing jurisdiction. At Best Buy, we create work environments where every employee feels like they truly belong and contribute to our shared purpose. We are one of...