Job Description
The client is looking for a Data Engineer / Data Platform Engineer with a strong blend of technical expertise, cloud data engineering experience, and stakeholder collaboration skills .
In this role you will:
- Collaborate with business partners and peers within the organization to understand and scope the problem, gather business requirements, and facilitate the data integration process.
- Help guide the development and maintenance of an integrated data platform.
- Create and maintain automated and semi-automated data pipelines within on-prem servers as well as in cloud (Azure).
- Play an active role in model monitoring automation.
- Create excellent working relationships with business partners across the organization, IT and Analytics peer groups.
- Effectively communicate with key stakeholders in written, oral and presentation formats.
Qualifications
- Required
- Hands-on experience with big data technologies and cloud (Databricks / Spark, Azure/AWS/GCP).
- Significant programming experience in SQL, ideally SQL Server.
- Strong programming ability in Python.
- Working knowledge/familiarity with Git version control.
- Solid understanding of databases and ETL/ELT best practices.
- Exposure to at least one technology such as Snowflake, DBT, Apache Airflow or Luigi
- Ability to multi-task, learn new things quickly, and have excellent problem solving & communication skills.
- A mindset for collaboration, knowledge sharing and keeping up to date on emerging industry trends.
- Preferred
- Comfortable with command line (Linux, Windows) scripting.
- Experience with architecting and consuming APIs in a scalable (multi-threaded/batched) fashion.
- Strong expertise in authoring ETL pipelines and processing data at scale.
- Ability to provide mentorship and guidance to other members of the team
- Experience in the insurance industry
- Nice to have
- Experience with at least one other programming language (R, Julia, Scala, Go, Java, C++).
- Working knowledge of containers, specifically Dockerizing APIs.
- Exposure to CI-CD pipelines.
- Comfortable with at least one NoSQL database (MongoDB, ElasticSearch, CosmosDB, etc.).
- Experience in personal lines insurance.
Location:
- We are open to the following work locations for this position: (Philadelphia, PA - Jersey City, NJ - Whitehouse Station, NJ - Simsbury, CT).
- Please note there will be limited expected travel to various work locations for in person collaboration and meetings.
Job Tags