Job details
Job type contract
Full job description
Transforming the future with convergence of simulation and data
Data engineer
Job summary:
Our client in auburn hills, michigan is looking for an data engineerThis is a contract position.
What you will do:
The data engineer will establish the organization’s data infrastructure, promoting engineering best practices on data management, and keeping the high bar for data qualityResponsibilities include but not limited to:
Design and implement secure, scalable, high-performance and robust data services for connected vehicle data in distributed data processing platforms using modern big data technologies.
Design, extend, and review data architecture, model, flow, and integration – be hands on and involved with every stage of the software development life cycle.
Partner with software engineers and data scientists to meet the need of upstream and downstream dependencies.
Work with external carrier stakeholders and internal partner teams to ingest connectivity data for data processing.
Develop state of the art code – influence/establish the software development culture of the teamEstablish standards and best practice for instrumentation within software engineering.
Keep up to date with the evolving big data technology, share the knowledge across the organization by enabling best practices, standards, governed processes and relevant technologies.
Comprehensive knowledge of relational database concepts, including; data architecture, operational data stores, interface processes, multidimensional modeling, master data management, and data manipulation
Expert knowledge and experience with custom etl design, implementation and maintenance
Comprehensive experience designing, implementing, and iterating data pipelines using big data technologies
Experienced working on cross-functional teams and leading efforts to build data services from ground up
Excellent communication skills with the ability to understand complex business problems and provide solutions.
Basics:
Ba/bsc in computer science, engineering, mathematics, or a related technical discipline required
2+ years of experience in the data engineering and software development life cycle.
2+ years of hands-on experience in building and maintaining production data applications, current experience in both relational and columnar data stores.
Experience with more than one coding language.
Experience with one or more functional languages such as f#, scala or haskell
Experience working with cloud big data platforms (i.eSpark, google bigquery, azure data warehouse, etc.)
Familiarity with time series database, data streaming applications, kafka, flink, and more
Experience with workflow management engines (i.eAirflow, luigi, azure data factory, etc.)
Understand how to work with hive metastores
Experience with continuous integration tools like jenkins
Experience with creating containerized applications using docker running them on kubernetes.
Preferred:
Experience with designing and implementing real-time pipelines.
Experience with data quality and validation.
Experience with sql performance tuning and e2e process optimization.
Experience with notebook-based data science workflow.
Experience with airflow.
Experience using spark, presto, hive, etc.
Experience using cats or zio
Familiarity with modern data science and product analytics tools and techniques such as r, machine learning, and advanced statistics is a plus
How you will be successful:
Envision the future
Communicate honestly and broadly
Seek technology and business “first”
Embrace diversity and take risks
What we offer:
Competitive salary
Comprehensive benefit package
401(k) with matching contributions
Paid time off
Employee discounts
Free training on all altair products
Why work with us:
Altair is a global technology company providing software and cloud solutions in the areas of data analytics, product development, and high-performance computing (hpc)Altair enables organizations in nearly every industry to compete more effectively in a connected world, while creating a more sustainable futureWith more than 3,000 engineers, scientists, and creative thinkers in 25 countries, we help solve our customer’s toughest challenges and deliver unparalleled service, helping the innovators innovate, drive better decisions, and turn today’s problems into tomorrow’s opportunities.
Our vision is to transform customer decision making with data analytics, simulation, and high-performance computing.
For more than 30 years, we have been helping our customers integrate electronics and controls with mechanical design to expand product value, develop ai, simulation and data-driven digital twins to drive better decisions, and deliver advanced hpc and cloud solutions to support unlimited idea explorationTo learn more, please visit altair.com
Ready to go? #onlyforward
At our core we are explorers; adventures; pioneersWe are the brains behind some of the world’s most revolutionary innovations and are not only comfortable in new and unchartered waters, we dive headfirstWe are the original trailblazers that make the impossible possible, discovering new solutions to our customer’s toughest challenges.
Altair is an equal opportunity employerOur backgrounds are diverse, and every member of our global team is critical to our successAltair’s history demonstrations a belief that empowering each individual authentic voice reinforces a culture that thrives because of the uniqueness among our team.
Hiring insights
Job activity
Posted 30+ days ago
