With 7+ years of experience, I specialize in data engineering, analytics, and automationβhelping businesses transform raw data into meaningful insights.
My work spans across APAC, ANZ, and North America in the insurance sector, where I design and optimize scalable ETL pipelines, ensuring efficient data processing and migration.
I started my career as an IT Recruiter, but my fascination with data and analytics led me to transition into data engineering.
Looking back, I realized that no matter what profession we work in, we all engage in some form of analysis.
- π Data-Driven Decisions: Understanding market trends, candidate skills, and job requirements is no different from analyzing datasets.
- π’ Storytelling: In analytics, we derive insights from data; in recruitment, we present information meaningfully to both clients and candidates.
This shift fueled my passion for solving data challenges, and today I work with tools like Apache Spark, PySpark, Azure Databricks, Snowflake, and Python to build high-performance, scalable data solutions.
πΉ Big Data & Cloud βοΈ: Apache Spark β‘, PySpark, Azure Databricks, Snowflake βοΈ
πΉ ETL & Data Processing π: SQL Server ποΈ, SSIS, Apache Airflow π¬οΈ, dbt tool
πΉ Programming π»: Python π, R π, SQL, NoSQL
πΉ Automation & Web Scraping π€: Selenium π, BeautifulSoup π, Flask π₯
πΉ Version Control & Collaboration π: Git π±, GitHub π, Jira π
πΉ Data Formats π: Parquet π¦, Delta πΌ, JSON π, CSV π, Excel π
π Postgraduate Program in Artificial Intelligence & Machine Learning (view certificate)
β Texas McCombs School of Business
π
Databricks Certified Data Engineer Associate (view certificate)
π§± dbt Fundamentals (view certificate)
π¬οΈ DAG Authoring for Apache Airflow (view certificate)
π Apache Airflow Fundamentals (view certificate)
βοΈ Hands-On Essentials: Data Engineering (view certificate)
- π° Currency Collector: Iβve collected currency notes from 180+ countries over the last 17 years.
- π Space & Astronomy Enthusiast: Fascinated by exoplanets and the mysteries of the universe.
- π Lifelong Learner: Continuously exploring AI, cloud technologies, and big data trends.
πΌ LinkedIn: linkedin.com/in/vijayrodrigues
π Portfolio: vijayrodrigues.com
π» HackerRank: hackerrank.com/profile/vijayrodrigues18