Data Engineer

Data Engineer

You have experience with client projects and in handling vast amounts of data – working on database design and

development, data integration and ingestion, designing ETL architectures using a variety of ETL tools and

techniques. You are someone with a drive to implement the best possible solutions for clients and work closely

with a highly skilled Data Science team. Lead on projects from a data engineering perspective, working with our

clients to model their data landscape, obtain data extracts and define secure data exchange approaches

? Plan and execute secure, good practice data integration strategies and approaches

? Acquire, ingest, and process data from multiple sources and systems into Big Data platforms

? Create and manage data environments in the Cloud

? Collaborate with our data scientists to map data fields to hypotheses and curate, wrangle, and

prepare data for use in their advanced analytical models

? Have a strong understanding of Information Security principles to ensure compliant handling and

management of client data

? This is a fantastic opportunity to be involved in end-to-end data management for cutting edge

Advanced Analytics and Data Science


Qualifications:

? Commercial experience leading on client-facing projects, including working in close-knit teams

? 3+ years of experience and interest in Big Data technologies (Hadoop / Spark / NoSQL DBs)

? 3+ years of experience working on projects within the cloud ideally AWS or Azure

? 3+ years of experience working with streaming architectures and patterns like Kafka, Kinesis, Flink, or

Confluent

? Experience with open source tools like Apache Airflow and Griffin

? Experience with DevOps and DataOps patterns and tools like Jenkins, Kubernetes, Docker, and

Terraform

? Data Warehousing experience with cloud products like Snowflake, Azure DW, or Redshift

? Experience building operational ETL data pipelines across a number of sources, and constructing

relational and dimensional data models

? Experience with one or more ETL/ELT tools like Talend, Matillion, FiveTran, or Alooma

? Experience building automated data quality and testing into data pipelines

? Experience with AI, NLP, Machine Learning, etc. is a plus

? Strong development background with experience in at least two scripting, object oriented or

functional programming language, etc. SQL, Python, Java, Scala, C#, R

? Experience working on lively projects and a consulting setting, often working on different and

multiple projects at the same time

? Excellent interpersonal skills when interacting with clients in a clear, timely, and professional



--

要查看或添加评论,请登录

Mansi Mishra的更多文章

  • UI Developer Job

    UI Developer Job

    UI Developer Job We are looking for a creative, skilled UI Developer to design websites with functionality and…

  • Project Manager

    Project Manager

    Project Manager: Job Summary To provide advanced project management services and to develop, maintain and enhance…

  • Alteryx Professionals Required

    Alteryx Professionals Required

    3 -8 years of experience performing detailed data analysis. Track record in data analytics, data science, modeling and…

  • Tableau VS Talend

    Tableau VS Talend

    Difference in layers First of all, if you have worked with Tableau, PowerBI or QlikView before, chances are good you…

  • AWS or Azure

    AWS or Azure

    With Cloud Computing at its prime, various cloud service vendors have contested to claim supremacy in the Cloud domain.…

  • Data Visualizat

    Data Visualizat

    The concept of using pictures to understand data has been around for centuries, from maps and graphs in the 17th…

  • Data Scientist Skills

    Data Scientist Skills

    A Data Scientist creates predictive models and performs custom analysis on the data according to company requirements…

  • Types of Cloud Deployment

    Types of Cloud Deployment

    Although the term “cloud” often gives cloud computing a somewhat mystical connotation, in reality, it isn’t all that…

  • Robotics Process Automation Developer

    Robotics Process Automation Developer

    Robotics Process Automation Developer We are looking for a Robotic Process Automation (RPA) Developer to join our…

  • BACKEND DEVELOPER WITH PYTHON REQUIRED

    BACKEND DEVELOPER WITH PYTHON REQUIRED

    BACKEND DEVELOPER We are looking for a Back-End Web Developer responsible for managing the interchange of data between…

社区洞察

其他会员也浏览了