Junior data engineer Job at Index Analytics Llc, Milford, CT

MVlFYTlZOUNlaUNacDdVUkVLQy93SjM2WWc9PQ==
  • Index Analytics Llc
  • Milford, CT

Job Description

Index Analytics, LLC, is a rapidly growing Baltimore-based small business providing health related consulting services to the federal government. At the center of our company culture is a commitment to instilling a dynamic and employee-friendly place to work. We place a priority on promoting a supportive and collegial team environment and enhancing staffs experience through career development and educational opportunities.

The Data Engineer will assist in supporting and moving the existing ETL solution into a more modernized platform while providing direct guidance to other members of the team. This includes acting as a go-to resource when technical challenges arise and providing leadership and coordination as part of a project team of data engineers, Cloud Architects, analysts, and testers to implement a Snowflake environment to ingest a wide variety of data sources to enable data analytics.

The Data Engineer determines structural, interface, and business requirements for developing and installing data solutions. This includes the design of relational databases, other types of databases, and associated interfaces, used for data storage and processing. The Data Engineer performs data acquisition, develops warehouse and data mart implementation, and data archive and recovery tasks. In pursuit of system and service optimization, the Data Engineer may perform other duties, such as investigating new data products and technology, evaluating new data sources, and reviewing existing products and products under development for adherence to the organization's quality standards and ease of integration.

Responsibilities

  • Design and onboard new ETL streams using selected AWS services with Python
  • Migrate existing ETL streams from COTS products like Informatica, Databricks to Linux/Python/Pyspark scripts using cloud service such as AWS Glue
  • Re-engineer and incrementally improve the performance of ETL solutions without impacting the delivery of new features requested by the client
  • Assist with development efforts to modernize current state data ingestion patterns
  • Maintain existing ETL pipelines and debug pipeline failures
  • Completing development tasks such as building custom reports, developing complex queries, ETL and data warehousing, and disseminating data to stakeholders.
  • Cloud data engineering and data migrations, testing, DevOps, application support, and data pipeline job orchestration
  • Work with DevSecOps team to set up any supporting infrastructure.
  • Remediate security vulnerabilities in data pipeline code identified through static code analysis or environment scanning.
  • Understand data modeling concepts to support ingestion of a wide variety of CMS data sources and formats to meet requirements from data analysts and other stakeholders
  • Using Python and/or Linux shell scripting for automating data movement tasks via scripting
  • Optimizing existing processes to improve performance
  • Work closely with product owners and DevOps to ensure compliance with SDLC processes
  • Collaborate with business analysts to gather requirements, develop, and document business rules, create test scenarios to ensure properly working code, and communicate technical concepts for transparency

Qualifications

  • US citizen or Authorized to work and lived in the US for 3 years out of the last 5 years.
  • Bachelors Degree or equivalent. 4 years work experience is equivalent to bachelors degree and vice versa
  • 4 years of overall experience
  • Experience with Cloud platforms such as AWS and working knowledge of basis AWS service such as EC2, S3, RDS, Lambda, Glue, CloudWatch and CloudFormation (or Terraform) IaC
  • Strong experience with Python and data transformation libraries such as Pandas and PySpark (2+ years)
  • Experience working with semi-structured (XML, JSON, PARQUET) data
  • Strong experience with SQL
  • Strong fundamentals of AI/ML engineering techniques and knowledge of associated AWS cloud services such as Bedrock, Textract or similar
  • Deployment automation experience via CI/CD tools such as Aws Code Pipeline or Jenkins is a plus
  • Experience with version control, preferably with GitHub
  • Experience working within an Agile development environment or development and testing activities is a plus
  • Understanding of database security, audit, and RBAC controls
  • Knowledge of Snowflake cloud database platform is a plus
  • AWS, Python and SnowPro Core snowflake certifications are a plus
  • Experience analyzing data and presenting information to stakeholders.
  • Ability to obtain Public Trust level clearance.

The salary range provided represents the estimated compensation for new hires in this position, applicable across all locations. Actual offers may vary based on factors such as the candidate's skills, qualifications, experience, and market conditions. Index complements its base salary offering with a competitive package that includes health and retirement benefits, discretionary bonuses, and reimbursement for professional development opportunities.

Index Analytics provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Attention Candidates

We're dedicated to ensuring a safe and transparent recruitment process for all candidates and have implemented robust measures to protect your personal information. Please be aware that all employment-related communications will originate from a secure portal ( NAME@msg.paycomonline.com ) or a corporate email address ( NAME@index-analytics.com ). If you have any concerns, please don't hesitate to reach out to us at recruiting@index-analytics.com

Job Tags

Work experience placement, Local area,

Similar Jobs

Cintas Corporation

Production Associate - Picker - 2nd Shift - Temporary Job at Cintas Corporation

 ...category protected by local, state, or federal law. This job posting will remain open for at least five (5) days. Job Category: Production Hourly Organization: Global Supply Chain Employee Status: Temporary Schedule: Full Time Shift: 2nd Shift... 

PERSUIT

Sales Enablement Trainer Job at PERSUIT

 ...out our Enablement team, and were looking for an experienced Enablement Trainer and Onboarding Specialist to join us in New York. This role will focus primarily on enabling our high-performing Sales team, while also supporting Customer Success and Marketing initiatives... 

Enexor

Mechanical or Biomedical Engineer - Product Design & Development Job at Enexor

 ..., this is the kind of place where your work will matter every day. The Opportunity We have openings for Mechanical or Biomedical Engineers who are either recent graduates or have up to five years of professional experience. You will help design and develop a new... 

Hana Group

Operations Director, Fresh Cut Produce Job at Hana Group

 ...Asian-inspired dishes to customers through our in-store kiosks and food service operations. With a presence in major grocery retailers...  ...environment. Ensure all company standards, procedures, and regulatory and quality standards are met, including specific requirements... 

Prattwhitney

Manufacturing/Production Supervisor Job at Prattwhitney

 ...as only U.S. citizens are authorized to access information under this program/contract.**Security Clearance:**None/Not RequiredAt Raytheon, the foundation of everything we do is rooted in our values and a higher calling - to help our nation and allies defend freedoms and...