Big Data Engineer

3 - 5 Years
Bengaluru

Job Description

Danlaw is a global leader in connected car and automotive electronics creating the future of transportation with V2X (vehicle to everything) technology along with its advanced Datalogger and automotive test tools. Connected cars are the next big thing in the Internet of Things and this area is currently undergoing dramatic transformations. Applications built on real-time vehicle data will make cars and businesses smarter and transform the future of transportation.

Danlaw is seeking an experienced Data Engineer to join its Data Science team and be a part of the journey to build the next levels of intelligence in connected vehicles. The team plays a high-impact role in providing analytical and modelling insights from location and sensor data collected from vehicles and contributes to the development of next-gen solutions. This is a very exciting position that plays a key role in building the data science platform and pipelines for the team.
If you want to own and solve problems, work with a creative dynamic team, while growing your career and working on a platform that powers cutting edge data science applications in the automotive sector we want to hear from you.

Core responsibilities
Build a high quality, scalable and resilient distributed system that powers the analytics platform using open source frameworks on the cloud or on-premises
Collaborate with internal and external teams to gather requirements needed for multiple metrics
Develop and manage ETL pipelines and automated workflows required for analysis, modelling and scoring by the Data Science team
Develop and support ad hoc analyses, reports and dashboards, and drive continuous improvement through automation
Deploy models built by the team and develop data science services as required
Investigate and implement new technologies to solve business problems where appropriate

Required skills and qualifications
Computer Science degree (Masters degree preferred) with 5-8 years of experience; 2+ years of relevant work experience in a Data Engineer / BI Engineer role, including SQL, ETL, Linux, OLAP, data modeling, data mining, and working with large-scale datasets
Consistent track record of designing and implementing scalable, performant data pipelines, data services, and data products
Programming experience in building high quality software. Skills with Java or Python preferred
Proficiency in Hadoop, Kafka, Spark frameworks in a large-scale environment with
relational and non-relational data bases.
Strong aptitude for learning new technologies related to Data Management and Data Science
Work with noisy, dirty and unstructured data. Data cleansing, scraping unstructured data and converting into structured data
Evaluate, benchmark and improve the scalability, robustness, efficiency and performance of the big data platform and applications
Proven ability to work well independently and within a fast-paced, collaborative environment
Excellent debugging and critical thinking skills

Desired skills and qualifications
Stream processing experience desirable Kafka streams / Spark streaming
Knowledge in engineering machine learning, feature engineering is a plus
Experience with data lakes
Experience using Deep Learning libraries

Salary: Not Disclosed by Recruiter

Industry:Automobile / Auto Anciliary / Auto Components

Functional Area:IT Software - Application Programming, Maintenance

Role Category:Programming & Design

Role:Software Developer

Employment Type:Permanent Job, Full Time

Keyskills

Desired Candidate Profile

Please refer to the Job description above

Company Profile

DANLAW

Danlaw is a global leader in connected car and automotive electronics creating the future of transportation with V2X (vehicle to everything) technology along with its advanced Datalogger and automotive test tools. Connected cars are the next big thing in the Internet of Things and this area is currently undergoing dramatic transformations. Applications built on real-time vehicle data will make cars and businesses smarter and transform the future of transportation.
View Contact Details+

Recruiter Name:Ramya Chaitanya

Contact Company:DANLAW

Website:https://www.danlawinc.com/