FASTTEK GLOBALpowered by Fast Switch - Great Lakes
Chennai, Tamil Nadu
Data Engineering Engineer 3 #1035702Job Description:
- Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Key Responsibilities:
- Collaborate with business and technology stakeholders to understand current and future data requirements
- Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
- Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
- Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
- Ensure optimum performance and identify improvement opportunities
Skills Required:
- Big Query,, Data Fusion, Data Flow
Experience Required:
- Engineer 3 Exp: 7+ years Data Engineering work experience
Experience Preferred:
- Professional Certification in GCP (e.g., Professional Data Engineer).
- Data engineering or development experience gained in a regulated, financial environment.
- Experience with Teradata to GCP migrations is a plus.
- Strong expertise in SQL and experience with programming languages such as Python, Java, and/or Apache Beam
- Experience of coaching and mentoring Data Engineers
- Experience with data security, governance, and compliance best practices in the cloud.
- An understanding of current architecture standards and digital platform services strategy
- Advanced experience on Functional Architecture, or Software Architecture.
- Effectively uses software configuration management (source control, DevSecOps, CI/CD, etc.).
- Proven experience with: o Java Full stack development (Springboot, Microservices, React) o Persistence - Buckets, PostgreSQL Bigtable
- Work effectively on an agile team following agile practices with Internal SW Development groups as well as Tier I&II (external suppliers)
- Cloud technologies experience (such as GCP, AWS, Azure).
- Experience with software operations (DevSecOps, SRE, observability, support/maintenance, etc.).
- Experience in secure coding practices and modern software development methodology, such as pair programming, test-first/test-driven development OR demonstrated delivery of singular focus programming.
- Proficient with Automation tools such as Selenium, Cucumber, REST Assured.
Education Required:
- Bachelor's Degree
Additional Information :
- Develop technical solutions for Data Engineering
- This role will work closely with teams in US and as well as Europe to ensure robust, integrated migration aligned with Global Data Engineering patterns and standards.
- Design and deploying data pipelines with automated data lineage.
- Develop, reusable Data Engineering patterns.
- Design and build production data engineering solutions to deliver pipeline patterns using Google Cloud Platform (GCP) services: BigQuery, DataFlow, Pub/Sub, BigTable, Data Fusion, DataProc, Cloud Composer, Cloud SQL, Compute Engine, Cloud Functions, and App Engine
- Ensure timely setup of product for FCNA.