Data Engineer | Data Analyst | Business Analyst

Abdul Rahman Jahir Hussain

Building Enterprise-Scale Data Solutions & Exploring AI Innovation

Results-driven Data Engineer with 4 + years of experience architecting and implementing production-scale data pipelines across AWS and Azure ecosystems. Specialized in processing hundreds of millions of records daily while maintaining data integrity and governance standards.

4+ Years of Experience
5TB+ Data Processed Daily
400M+ Records Per Day
5 Professional Certifications

Experience

Track record of delivering high-impact data engineering solutions across finance, healthcare, and retail industries.

Data Engineer

Onix Networking Grp, USA

Feb 2025 - Present
  • Architected end-to-end AWS-native data pipelines processing 5+ TB daily (400M+ records) of financial transactions with 30-minute latency for real-time risk analytics
  • Implemented Databricks Delta Lake with ACID guarantees and schema enforcement, achieving 99.995% data correctness for regulatory compliance
  • Established production-grade data control frameworks including cross-system reconciliation and anomaly detection, reducing incidents to near zero
  • Optimized Spark and SQL execution plans, reducing pipeline runtimes by 60% and generating $500K+ annual cloud cost savings
  • Enabled data science and BI teams with real-time datasets supporting risk models and executive dashboards for 250+ users

Data Engineer

Axtria - Ingenious Insights, USA

Mar 2022 - Jul 2023
  • Designed cross-cloud (AWS + Azure) analytics platform ingesting 1B+ clinical and claims records for population-scale healthcare analytics
  • Developed Databricks standardization layers harmonizing 50+ heterogeneous data sources into governed, analytics-ready datasets
  • Implemented enterprise data governance frameworks with schema validation and audit trails, reducing data defects by 70%
  • Automated data quality monitoring in Python and SQL, accelerating data release cycles by 2× and eliminating manual reconciliation
  • Collaborated with cross-functional teams to deliver feature-ready datasets for patient outcome analytics and operational insights

Data Engineer

HashiCorp, India

Jan 2020 - Feb 2022
  • Built AWS-based data ingestion pipelines processing 200M+ daily retail transactions supporting high-volume analytics
  • Created Python and SQL transformation frameworks unifying sales, inventory, and customer data, improving forecasting accuracy by 35%
  • Implemented reconciliation and integrity checks reducing revenue-impacting data discrepancies by 50%
  • Designed analytics-optimized data warehouse schemas enabling high-concurrency BI usage with 45% performance improvement
  • Partnered with business intelligence teams to deliver trusted datasets driving executive revenue and performance reporting

Skills & Technologies

Comprehensive technical stack spanning data engineering, cloud platforms, and modern analytics tools.

Programming & Scripting

Python SQL PySpark Spark SQL Shell Scripting

Data Engineering Frameworks

Apache Spark Databricks Delta Lake Hadoop Apache Airflow

Cloud Platforms

AWS (S3, Glue, Redshift, IAM) Azure (ADLS, Data Factory) Cross-Cloud Architecture

Data Warehousing & Modeling

Dimensional Modeling Star Schema Snowflake Schema SQL Server Redshift Teradata Presto

Data Governance & Quality

Schema Enforcement Data Validation Reconciliation Audit Trails Data Integrity Controls

Business Intelligence & Analytics

Tableau Power BI Data Visualization Analytics Enablement

Development & Collaboration

Git Bitbucket JIRA Agile Methodology

Emerging Technologies (AI/ML)

Azure AI Foundry Agentic AI LLM Integration Microsoft Fabric

Projects & Achievements

Hands-on projects demonstrating expertise in data engineering, analytics, and AI technologies.

Microsoft

🤖 From Assistant to Agent: Azure AI Foundry Journey

Completed the Microsoft AI Skills Fest challenge, earning a badge for building agentic AI solutions with Azure AI Foundry. This 50-day learning journey opened my eyes to the next evolution of AI - autonomous agents that can reason, plan, and execute tasks.

Key Learnings:

  • AI agents evolving from simple assistants to autonomous teammates
  • Azure AI Foundry's unified platform integrating 1,800+ models
  • Multi-agent orchestration through Semantic Kernel reducing complexity
  • Built-in safety, security, and governance for enterprise deployments
  • Created intelligent systems that integrate with enterprise data and trigger real-world actions
#AzureAIFoundry #AgenticAI #SemanticKernel #EnterpriseAI
May 2025

🎵 Maven Spotify Wrapped Challenge: 5 Years of Data

Analyzed 5 years of personal Spotify streaming data for the Maven Analytics Challenge, uncovering the soundtrack of my life through 46,000+ streaming records across multiple countries.

Key Discoveries:

  • Analyzed 46,000+ streaming records across different countries
  • Tracked evolution from desktop to mobile listening patterns
  • Uncovered peak creativity hours through behavioral analysis
  • Mapped global listening footprint from India to Puerto Rico

Technical Implementation:

  • Built end-to-end ETL data pipeline in Python
  • Created interactive visualizations in Tableau
  • Implemented time zone-aware analysis for global insights
  • Demonstrated user behavior analytics and BI capabilities
#DataAnalytics #Python #Tableau #ETL
January 2024 View Project →

Certifications

Industry-recognized certifications demonstrating expertise across data engineering platforms and emerging AI technologies.

Microsoft

Microsoft Certified: Fabric Data Engineer Associate

Issued December 2025

Amazon Web Services

AWS Certified Data Engineer - Associate

Issued January 2026 • Expires January 2029

Databricks Certified Data Engineer Associate

Issued August 2025 • Expires August 2027

Databricks

Databricks Certified Data Analyst Associate

Issued May 2025 • Expires May 2027

Anthropic

AI Fluency Framework & Foundations

Issued February 2026

Databricks

Academy Accreditation - Databricks Fundamentals

Issued January 2025 • Expires January 2026

Education

Master of Science in Engineering Science (Data Science)

State University of New York at Buffalo

August 2023 - February 2025

Bachelor of Technology in Computer Science and Engineering

Anna University, India

August 2017 - August 2021

Get In Touch

Currently seeking opportunities in Data Engineering, Data Analytics, and AI roles. Open to full-time positions and interesting projects. Based in Buffalo, NY with flexibility for remote and hybrid arrangements.