Brillio
Posted 20 days ago
Senior Data Engineer
HyderabadHybridFull-time
AI Summary
Senior data engineer building ELT/ETL pipelines and analytical data models on Snowflake for real-time and batch data workloads.
About this role
Primary Skills
- DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern Data Platform Fundamentals, PLSQL, T-SQL, Stored Procedures
Job requirements
- Design, develop, and maintain robust ELT/ETL data pipelines to load structured and semi-structured data into Snowflake. Implement data ingestion workflows using tools like Azure Data Factory, Informatica, DBT, or custom Python/SQL scripts.
- Write and optimize complex SQL queries, stored procedures, views, and UDFs within Snowflake.
- Use Snowpipe for continuous data ingestion and manage tasks, streams, and file formats for near real-time processing Optimize query performance using techniques like clustering keys, result caching, materialized views, and pruning strategies. Monitor and tune warehouse sizing and usage to balance cost and performance.
- Design and implement data models (star, snowflake, normalized, or denormalized) suitable for analytical workloads.
- Create logical and physical data models for reporting and analytics use cases.
We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Skills
PythonSQLData ModelingETLstored proceduresT-SQLData WarehousingSnowflakeAzure Data FactorydbtInformaticaSnowpipeSnowSQLPLSQL