Our ad server produces over 50 TB of new raw data every day. It amounts to ~100 billion events per day that needs to be processed. Dealing with data at this scale is challenging in a number of ways. We deal with number off-the-shelf frameworks including Spark, Kafka, Cassandra, DynamoDB, RedShift, but often push them past their limits. This team is responsible for providing critical ad reporting data for our internal and external customers.
If you are looking to work with a fast growing and stable American company then this position is for you. We offer the following perks and benefits:
As a Data Engineer, you will be building and maintaining exciting systems, services and data tools. You’ll bring your experience with complex distributed systems, passion for performance and optimization, and ability to write highly scalable and fault tolerant code.
Implement and maintain our data infrastructure.
Build streaming and batch ETL pipelines to extract, transform, and load data from various sources.
Create tools and automation to support our data analysts.
Designing a framework for ensuring data quality.
Help troubleshoot complex data issues and recommend solutions
5+ years of experience creating streaming and batch ETL systems (Streamsets, Airflow, Spark)
Expert level at writing efficient SQL queries
Strong coding ability in an object oriented language (Python, Java, etc.)
Experience with Google BigQuery, AWS Redshift, or AWS Athena
Experience with message distribution systems like Kafka or Google Pub/Sub
Excellent team player with strong communication skills (verbal and written)
Enthusiastic about collaborative problem solving
Love of Learning, eagerness to solve new and challenging problems and become a master
BS in Computer Science or related field or equivalent experience
We are a company by employees, for employees. We put people before profits. Unlike other companies, we can brag that we put the well-being of the employee first, and that we have complied with the Mexican law from day 1 (and not when we were forced to do it).