Lead Data Engineer- Hulu

Location: San Francisco

P006857 (IC4)

What You'll Do

●        Contribute to the design and growth of our Data Products and Data Warehouses around Acquisition marketing spend and Acquisition campaign Performance data.

●        Develop and optimize performant database, data model, integration and ETL in RDBMS and Big Data environments

●        Collaborate with Data Product Managers, Data Architects and Data Engineers to design, implement, and deliver successful data solutions

●        Help define technical requirements and implementation details for the underlying data warehouse and data marts

●        Maintain detailed documentation of your work and changes to support data quality and data governance

●        Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to the customers

●        Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team

What To Bring

●        6+ years of data engineering experience developing large data systems

●        You are a problem solver with strong attention to detail and excellent analytical and communication skills

●        Proven experience with at least one major RDBMS (SQL Server, MySQL or Oracle)

●        Experience with distributed systems such as Spark, Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Presto, Pig, HBase)

●        Solid experience with data integration toolsets and writing and maintaining ETL jobs

●        Strong SQL skills and ability to create queries to extract and build tables

●        Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices

●        Good Scripting skills, including Bash scripting and Python

●        Familiarity with Amazon s3 and/or ETL using databricks

●        Familiarity with workflow management tools, like Airflow

●        You have experience with Scrum and Agile methodologies

●        Hands-on experience with Hadoop implementations including a deep understanding of Hive or Spark to query and process data in Hadoop

●        Bachelor’s or Master’s Degree in Computer Science, Information Systems or related field