Our client is looking for an experienced Senior Data Engineer to come in and help to build scalable and reliable data pipelines using Data engine technologies like Matillion, Python, and SQL based programming.
· 8+ years of experience with and detailed knowledge of AWS based data warehouse technical architectures, data modeling, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures and hands-on SQL coding.
· 4+ years experience designing and developing complex ETL/ELT programs with the following Matillion, Python etc
· 8+ years experience developing complex SQL
· Experience using Cloud database technologies such as RedShift, Snowflake
· 3+ years experience programming in Python, and/or Java
· 2+ years experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues
· 2+ years implementing and programming data ingestion and ETL programs with large datasets (Terabytes sized analytical environment)
· Experience with integration of data from multiple data sources
· Experience developing and implementing streaming data ingestion solutions
· Experience in Agile methodology (2+ years)