FASTTEK GLOBALpowered by Fast Switch - Great Lakes
Chennai, Tamil Nadu
Data Engineering Engineer #1040388Job Description:
- Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
Key Responsibilities:
- Collaborate with business and technology stakeholders to understand current and future data requirements
- Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
- Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
- Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
- Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
- Ensure optimum performance and identify improvement opportunities
Skills Required:
- Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API, Pub/Sub, KAFKA
Skills Preferred:
- Jira, Data Governance
Experience Required:
- Engineer 2 Exp: 4+ years Data Engineering work experience
Education Required:
- Bachelor's Degree
Education Preferred:
- Certification Program
Additional Information :
- Design and implement data architecture with specialized knowledge in various data transformation mechanisms.
- Leverage big data tools and programming framework that meets the organization requirements for data storage, processing, analytics and data science including machine learning by considering long term strategy, right tools in a cost-effective way.
- Deliver appropriate Analytical Data Modeling techniques based on data usage needs for Data Science, Machine Learning, Visualization or any other business needs.
- Develop scalable & maintainable data
- Incorporate CI/ CD Pipelines to improve efficiency and quality of development and deployment processes, accelerate the release cycle also enhances the overall stability of the products.
- Establish benchmarks and adopt pro-active monitoring & reliability techniques as needed.
- Staying up to date with technology: introducing innovative solutions and practices and serve as a role model for the team to do the same.
- Responsible for adopting appropriate data governance processes to ensure compliance with data protection and data safeguard needs - both at regional level and at organization level.
- Ownership and Execution within timelines: Own and execute initiatives/ projects within timelines, mitigate risks to ensure that projects are delivered on time with high quality and participate in periodic retrospectives to identify opportunities to perform better.
- Be a self-motivated team player and contribute to team excellence by proactively identifying and working with partners to clear roadblocks that can help the team perform at its peak and achieve its goals; Be available to mentor juniors.
- Should have familiarity with productionizing components/ models at scale including working with data in very large volumes.
- Inquisitive, proactive, and interested in learning new tools and techniques.
- Strong oral, written and interpersonal communication skills.