Praveen G.

Background

About Praveen G.

As a Data Engineer with a strong background in ETL development, cloud technologies, and data processing frameworks, I specialize in optimizing data pipelines, automating workflows, and ensuring seamless integration across systems.Currently, working as a Data Engineer at Squadron Data, delivering end-to-end data solutions on the Snowflake platform.Throughout my career, I have developed and implemented solutions that streamline data ingestion, transformation, migration and documentation:• ETL Optimization & Scripting: Designed and developed Python scripts to parse and analyze exported files from Informatica ETL, enabling efficient extraction of source, transformation logic, and destination tables. This work enhanced ETL pipeline documentation and analysis.• Cloud Data Ingestion: Spearheaded the implementation of data ingestion processes for Azure Data Lake, integrating flat files from external Dropbox sources to ensure seamless cloud data storage and accessibility.• Big Data Frameworks: Crafted efficient HQL scripts for defining and populating Hive external tables, which improved data loading efficiency and optimized table management within the Hadoop ecosystem. Additionally, I configured a PySpark framework for enhanced data transformation and ingestion.• ETL Workflow Development: Led the development of ETL workflows using the iWay-Data Migrator tool, transforming data to meet business requirements and successfully migrating mainframe ETL jobs to the cloud.• Database Management & Migration: Designed relational tables for source, staging, and submission layers, and migrated them to Oracle Cloud from on-premises data warehouses. Developed DDLs and DMLs for efficient database operations and supported migration testing.• Scripting & Automation: Leveraged UNIX shell scripts to automate and trigger ETL flows, and developed PL/SQL procedures and packages, invoking them within ETL workflows to improve performance and reliability.I am passionate about transforming complex data challenges into efficient, scalable solutions. My experience spans across big data ecosystems, cloud platforms, and ETL tools, and I am always eager to tackle new challenges that drive business growth.