Powervantage Consulting Partners LLP’s Post

#hiringnow Data Engineer II(Hybrid) for or a Leading U.S. MNC ("Great Place To Work" certified) into Software Product Development || Bangalore. #applynow with your updated CV to avishek.chatterjee@powervantage.in Key Responsibilities: Develop a scalable and resilient cloud data platform and scalable data pipelines. Ensure industry best practices around data pipelines, metadata management, data quality, data governance, and data privacy. Build highly scalable AWS Infrastructure (from scratch or through 3rd party products) to enable Big Data Processing in the platform. Identify and implement performance sensitive solutions within a well-defined portion of the product, and update exiting code used for performance measurement and monitoring across the data platform utilizing tools (e.g., Splunk and New Relic, Cloud Watch, etc.) Identify opportunities for cost reduction and resource optimization within AWS while maintaining performance and reliability. Requirements: Proficiency in Scala and Spark programming language Experience working with big data and large datasets (100 gigs or more) is a plus. Understanding of unit testing best practices. Possess strong command of AWS services and data engineering tools to diagnose and solve complex issues efficiently, specifically AWS EMR for big data processing. Experience with GIT or other distributed version control systems. Excellent communication. Essential to performing at maximum efficiency within the team. Collaborative attitude. This role is part of a larger, more dynamic team that nurtures collaboration. Strong technical, process, and problem-solving proficiency. Proficiency in SQL and database management systems (e.g., Oracle, SQL Server). Experience with Linux or Unix. Preferred Skills: 2+ years of development experience with big data technologies. 2+ years using Apache Spark Understanding of cloud computing platforms (e.g., AWS, Azure, Google Cloud). Experience with ETL tools and data integration concepts. Eagerness to learn and adapt to new technologies and tools. Experience with Software Development Life Cycle. Experience with Software Development Best Practices (Version control, Change Management, Unit Testing, etc.). Any relevant certifications (e.g., AWS Certified Developer, Google Cloud Data Engineer) would be a plus but not required. #alert #job #hiring #aws #data #analytics #google #cloud #scala #spark #bigdata #engineer