About Crion Learning
At Crion Learning we're bringing an innovative and new approach to improve Education, Skill development and Training undertakings through the combination of Immersive digital simulations, Roleplay concepts and Social & Emotional aspects. We work on use-cases targeting students, working professionals and corporates
Roles & Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data from various sources into our data warehouse.
Build and optimize data models and schemas to support data analytics and reporting requirements.
Implement and maintain data governance practices to ensure data quality, consistency, and security.
Identify and resolve performance issues in data processing and recommend improvements to optimize data pipelines.
Collaborate with infrastructure and operations teams to ensure the availability, reliability, and scalability of data systems.
Stay up-to-date with emerging technologies and industry trends in data engineering, and evaluate and recommend tools and frameworks to enhance data processing capabilities.
Create and maintain documentation for data engineering processes, including data flows, data lineage, and system architecture.
Relevant skills required
Proven experience as a Data Engineer or in a similar role, with a strong understanding of data integration, ETL processes, and data modeling.
Proficiency in SQL and experience with relational databases (., MySQL, PostgreSQL) and NoSQL databases (., MongoDB, Cassandra).
Strong programming skills in at least one language, such as Python, Java, or Scala.
Experience with big data processing frameworks like Hadoop, Spark, or similar technologies.
Knowledge of cloud platforms, such as AWS, Azure, or Google Cloud, and experience with their data services (., S3, Redshift, BigQuery).
Familiarity with data visualization and business intelligence tools (., Tableau, Power