location_onNoida, Uttar Pradesh, India
watch_later Posted: Jun 24, 2024
Skills Required
Nice To Have skills
Job Description
Job Summary:
As a Data Engineer, you will be responsible for designing, implementing, and maintaining the data architecture and infrastructure necessary for supporting our data analytics and business intelligence efforts. You will work closely with data scientists, analysts, and other stakeholders to ensure the efficient and reliable flow of data throughout the organization.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines and ETL processes to ingest, process, and transform large volumes of data from various sources.
• Build and optimize data storage solutions, including databases, data lakes, and data warehouses.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement and manage data governance, data quality, and data security measures to ensure data integrity and compliance with relevant regulations.
• Monitor and troubleshoot data pipelines and infrastructure to ensure optimal performance and reliability.
• Develop and maintain documentation for data processes, architecture, and workflows.
• Stay current with emerging trends and technologies in data engineering and recommend improvements to existing systems.
Qualifications
• Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Strong proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL).
• Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (e.g., AWS, Azure, Google Cloud).
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with ETL tools and frameworks (e.g., Apache NiFi, Talend, Airflow).
• Familiarity with data warehousing solutions (e.g., Redshift, Snowflake, BigQuery).
• Knowledge of data modeling, data governance, and data security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.