Hi, I'm Nikhil Kothapally

Data Engineering Manager & Cloud Solutions Architect

Over 13 years of expertise in architecting scalable data solutions, leading cross-functional teams, and driving data-driven decision-making that supports revenue growth and operational excellence.

About Me

I'm a Data Engineering Manager with over 13 years of expertise in architecting scalable data solutions and leading cross-functional teams. I excel at building analytical dashboards and data pipelines that empower stakeholders to make accurate business decisions.

My experience spans from hands-on development to strategic leadership, balancing technical excellence with business acumen. I've successfully led major cloud migration projects, optimized ETL workflows, and reduced infrastructure costs by 87.5% through innovative use of AWS, Databricks, and modern big data technologies.

I'm committed to delivering scalable data architectures that drive business insights and support strategic growth, while mentoring teams and fostering a culture of continuous improvement.

Skills & Technologies

AWS Databricks Python SQL Spark Scala ETL/ELT Data Warehousing Redshift Airflow DBT Data Lake Big Data Data Modeling Cloud Platforms Data Governance Machine Learning

My Projects

Here are some of my key achievements and projects. Each represents significant impact on business operations and cost optimization.

Databricks Cost Optimization

Reduced Databricks costs by 87.5%, saving $7K monthly through optimized clustering strategies and efficient resource allocation. Implemented intelligent auto-scaling and job optimization techniques.

Databricks AWS Spark Cost Optimization

Cloud Warehouse Migration

Led migration of on-premises data warehouse to scalable cloud solution, enhancing uptime and performance. Designed and implemented modern data architecture using AWS services and best practices.

AWS Redshift Data Warehousing Cloud Migration

ETL Pipeline Optimization

Developed scalable ETL pipelines with AWS and Spark, increasing data processing speed by 70%. Optimized workflows to handle large-scale data processing while reducing operational costs.

AWS Spark ETL Python Airflow

Team Leadership & Project Delivery

Led a team of engineers to deliver complex data projects on time and within budget, improving delivery efficiency. Balanced hands-on development with managerial responsibilities while ensuring high-quality deliverables.

Team Leadership Project Management Agile Data Engineering

Get In Touch

Have a project in mind or just want to chat? I'd love to hear from you!

Contact Information

Location

Charlotte, NC