Senior Data Engineer
Job Number:
3248994
Posting Date
:Apr 15, 2024
Primary Location
:Non-Japan Asia-India-India-Bengaluru
Job
:TechnologyEmployment Type:Full TimeJob Level:Vice President
Description
Qualifications
Primary Skills • Total 10 years and a minimum of 3 years in management, in a space with strong focus on large scale data processing and instrumentation.
• Strong coding background, ideally in Java/ Python / Scala
• Strong working knowledge of engineering best practices & big data ecosystem..
• Experience in at least one big data product: Databricks, Elasticsearch, Snowflake
• Experience building batch / real time data pipelines for production systems.
• Experience with Relational and Non-Relational DBs like DB2, MongoDB
• Experience with various data formats: Parquet, CSV, JSON, XML, Relational Data
• Strong familiarity with Kafka, Spark, Hadoop, Iceberg, Airflow, Data Modeling, relational databases, columnar databases
• Previous working experience in large scale distributed systems.
• Strong familiarity with software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.
• Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders. Good To haveSkills Desired Qualifications
• Experience with Rest based applications
• Experience with Databricks/ Delta Lake
• Experience with client reference data sourcing from vendors Morgan Stanley is an equal opportunities employer. We work to provide a supportive and inclusive environment where all individuals can maximise their full potential. Our skilled and creative workforce is comprised of individuals drawn from a broad cross section of the global communities in which we operate and who reflect a variety of backgrounds, talents, perspectives and experiences. Our strong commitment to a culture of inclusion is evident through our constant focus on recruiting, developing and advancing individuals based on their skills and talents.