Data Engineer

Our ad server produces over 50 TB of new raw data every day. It amounts to ~100 billion events per day that needs to be processed. Dealing with data at this scale is challenging in a number of ways. We deal with number off-the-shelf frameworks including Spark, Kafka, Cassandra, DynamoDB, RedShift, but often push them past their limits. This team is responsible for providing critical ad reporting data for our internal and external customers.

If you are looking to work with a fast growing and stable American company then this position is for you.  We offer the following perks and benefits:

  • Competitive salary based on knowledge and experience
  • 100% of salary registered at IMSS (as it should be)
  • Retirement housing and retirement social security is part of 100% registry at IMSS
  • Private minor and major medical Insurance with $3,000,000 pesos in coverage for employee and direct family (capped at a cost of $50,000 pesos a year)
  • Great work environment / relaxed atmosphere
  • 10 vacation days since the first year of employment
  • Gym membership sponsorship
  • Direct working relationship between client and employee

As a Data Engineer, you will be building and maintaining exciting systems, services and data tools. You’ll bring your experience with complex distributed systems, passion for performance and optimization, and ability to write highly scalable and fault tolerant code.

Responsibilities:

  • Implement and maintain our data infrastructure.

  • Build streaming and batch ETL pipelines to extract, transform, and load data from various sources.

  • Create tools and automation to support our data analysts.

  • Designing a framework for ensuring data quality.

  • Help troubleshoot complex data issues and recommend solutions

Requirements

  • 5+ years of experience creating streaming and batch ETL systems (Streamsets, Airflow, Spark) 

  • Expert level at writing efficient SQL queries

  • Strong coding ability in an object oriented language (Python, Java, etc.)

  • Experience with Google BigQuery, AWS Redshift, or AWS Athena

  • Experience with message distribution systems like Kafka or Google Pub/Sub

  • Excellent team player with strong communication skills (verbal and written)

  • Enthusiastic about collaborative problem solving

  • Love of Learning, eagerness to solve new and challenging problems and become a master

  • BS in Computer Science or related field or equivalent experience

About Aviada

We are a company by employees, for employees. We put people before profits. Unlike other companies, we can brag that we put the well-being of the employee first, and that we have complied with the Mexican law from day 1 (and not when we were forced to do it).

grupal marco