Data Engineer Job at Qode, Texas

dnFZUWRPaUYvZ3c0UEhEalVtQlIrVVlkL2c9PQ==
  • Qode
  • Texas

Job Description

Job Summary:

We are seeking a skilled and motivated Data Engineer with strong expertise in PySpark, SQL to join our Data Engineering team. You will be responsible for designing, building, and maintaining scalable data pipelines and processing systems that support our business intelligence, analytics, and machine learning initiatives.

Key Responsibilities:

  • Develop and maintain scalable, robust data pipelines using Scala and big data technologies.
  • Work with large datasets from multiple sources to ingest, transform, and make data available for analytics and reporting.
  • Collaborate with Data Scientists, Analysts, and other engineers to understand data requirements and deliver efficient solutions.
  • Optimize ETL jobs for performance and cost.
  • Ensure data quality, governance, and consistency across all environments.
  • Monitor production jobs, troubleshoot issues, and ensure system reliability.
  • Implement best practices for data engineering, including code reviews, testing, and documentation.

Required Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
  • 6+ years of experience as a Data Engineer or in a similar role.
  • Strong skills in PySpark and SQL (experience with functional programming is a plus).
  • Hands-on experience with big data tools like Apache Spark , Kafka , Hadoop , or Hive .
  • Proficiency in building ETL pipelines and working with structured and unstructured data.
  • Experience with cloud platforms (e.g., AWS , Azure , GCP ) and their data services.
  • Familiarity with version control systems (e.g., Git ), CI/CD, and DevOps practices.
  • Solid understanding of data warehousing and data modeling concepts.

Preferred Qualifications:

  • Knowledge of SQL and database systems such as Postgres, Redshift, or Snowflake.
  • Exposure to containerization technologies like Docker and orchestration tools like Airflow or Kubernetes.

Job Tags

Full time,

Similar Jobs

Fidelity National Financial

Commercial Title Officer/Underwriter Job at Fidelity National Financial

 ...Overview Fidelity National Financial, Inc. (NYSE: FNF) is seeking a Commercial Title Officer/Underwriter to join its Phonex, AZ office. FNF is a leading provider of title insurance and transaction services to the real estate and mortgage industries. FNF is the nation... 

Humareso

Customer Service Representative Job at Humareso

 ...We are looking for a motivated and service-oriented licensed Insurance Customer Service Representative for both personal and commercial lines to join our team. This role is focused on supporting clients with their policy needs, handling service requests, and ensuring... 

Trinity Health

Student Intern Pharmacist Job at Trinity Health

 ...returned to the pharmacy. - Files medication orders. - Assists the pharmacists with audits. - Completes assigned unit inspections. - Restocks...  ...lists. Required Qualifications: Certified Pharmacy intern or Certified Pharmacy Technician or Enrolled in a... 

Industrial Air Flow Dynamics

Structural Welder - We Pay for Travel Job at Industrial Air Flow Dynamics

 ...Overview Traveling Structural Welder - $25/hr + Paid Travel, Tools Supplied, and Referral Bonuses At Industrial Air Flow Dynamics, Inc., we supply all the tools and PPE, cover travel and hotel, pay you for passing weld tests, and reward referrals. You'll be part... 

Company3

VFX Producer (General Submission) Job at Company3

 ...Curated Position : VFX Producer Location : New York, NY (Remote)*Pay Range : $97,680 - $146,520 USD annually POSITION...  ...pre-vis, look development, ideation and rapid prototyping, 3D animation/CGI, motion graphics/designers, matte painting, compositing, dailies...